Retbleed Mitigations AMD Zen 1

AMD Ryzen 7 1700 mitigation benchmarks by Michael Larabel for a future article.

Compare your own system(s) to this result file with the Phoronix Test Suite by running the command: phoronix-test-suite benchmark 2207175-NE-RETBLEEDZ09
Jump To Table - Results

View

Do Not Show Noisy Results
Do Not Show Results With Incomplete Data
Do Not Show Results With Little Change/Spread
List Notable Results
Show Result Confidence Charts
Allow Limiting Results To Certain Suite(s)

Statistics

Show Overall Harmonic Mean(s)
Show Overall Geometric Mean
Show Wins / Losses Counts (Pie Chart)
Normalize Results
Remove Outliers Before Calculating Averages

Graph Settings

Force Line Graphs Where Applicable
Convert To Scalar Where Applicable
Prefer Vertical Bar Graphs

Additional Graphs

Show Perf Per Core/Thread Calculation Graphs Where Applicable

Multi-Way Comparison

Condense Multi-Option Tests Into Single Result Graphs

Table

Show Detailed System Result Table

Run Management

Highlight
Result
Toggle/Hide
Result
Result
Identifier
View Logs
Performance Per
Dollar
Date
Run
  Test
  Duration
Current Linux Default
July 14 2022
  8 Hours, 53 Minutes
mitigations=off
July 15 2022
  8 Hours, 26 Minutes
retbleed=off
July 16 2022
  9 Hours, 10 Minutes
mitigations=auto,nosmt
July 16 2022
  9 Hours, 12 Minutes
Invert Behavior (Only Show Selected Data)
  8 Hours, 55 Minutes

Only show results where is faster than
Only show results matching title/arguments (delimit multiple options with a comma):
Do not show results matching title/arguments (delimit multiple options with a comma):


Retbleed Mitigations AMD Zen 1OpenBenchmarking.orgPhoronix Test SuiteAMD Ryzen 7 1700 Eight-Core @ 3.00GHz (8 Cores / 16 Threads)AMD Ryzen 7 1700 Eight-Core @ 3.00GHz (8 Cores)MSI B350 TOMAHAWK (MS-7A34) v1.0 (1.Q6 BIOS)AMD 17h16GB120GB Samsung SSD 840 + 32GB Flash DiskAMD Radeon RX 480 8GB (1266/2000MHz)AMD Ellesmere HDMI AudioDELL S2409WRealtek RTL8111/8168/8411Ubuntu 22.045.19.0-rc6-phx-retbleed (x86_64)GNOME Shell 42.2X Server + Wayland4.6 Mesa 22.0.1 (LLVM 13.0.1 DRM 3.47)1.3.204GCC 11.2.0ext41920x1080ProcessorsMotherboardChipsetMemoryDiskGraphicsAudioMonitorNetworkOSKernelDesktopDisplay ServerOpenGLVulkanCompilerFile-SystemScreen ResolutionRetbleed Mitigations AMD Zen 1 BenchmarksSystem Logs- Transparent Huge Pages: madvise- --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-bootstrap --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-link-serialization=2 --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none=/build/gcc-11-gBFGDP/gcc-11-11.2.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-11-gBFGDP/gcc-11-11.2.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-build-config=bootstrap-lto-lean --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v - MQ-DEADLINE / errors=remount-ro,relatime,rw / Block Size: 4096- Scaling Governor: acpi-cpufreq schedutil (Boost: Enabled) - CPU Microcode: 0x8001138 - OpenJDK Runtime Environment (build 11.0.15+10-Ubuntu-0ubuntu0.22.04.1)- Python 3.10.4- Current Linux Default: itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Mitigation of untrained return thunk; SMT vulnerable + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional STIBP: disabled RSB filling + srbds: Not affected + tsx_async_abort: Not affected - mitigations=off: itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Vulnerable + spec_store_bypass: Vulnerable + spectre_v1: Vulnerable: __user pointer sanitization and usercopy barriers only; no swapgs barriers + spectre_v2: Vulnerable IBPB: disabled STIBP: disabled + srbds: Not affected + tsx_async_abort: Not affected - retbleed=off: itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Vulnerable + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional STIBP: disabled RSB filling + srbds: Not affected + tsx_async_abort: Not affected - mitigations=auto,nosmt: itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Mitigation of untrained return thunk; SMT disabled + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional STIBP: disabled RSB filling + srbds: Not affected + tsx_async_abort: Not affected

Current Linux Defaultmitigations=offretbleed=offmitigations=auto,nosmtResult OverviewPhoronix Test Suite100%139%178%218%257%LevelDBHackbenchctx_clockStress-NGSockperfTensorFlow LiteEthrDaCapo BenchmarkTimed Linux Kernel CompilationOCRMyPDFPostMarkKeyDBFacebook RocksDBTimed MPlayer CompilationSQLite SpeedtestTimed Godot Game Engine CompilationCryptsetupTimed Gem5 CompilationGitOSBenchRawTherapeeRenaissanceRedisTimed Mesa CompilationGIMPTimed Apache CompilationSelenium

Retbleed Mitigations AMD Zen 1leveldb: Seq Fillleveldb: Rand Deleteleveldb: Seek Randstress-ng: SENDFILEethr: TCP - Latency - 1ethr: TCP - Latency - 32leveldb: Seq Fillstress-ng: Mallochackbench: 32 - Processhackbench: 8 - Threadhackbench: 16 - Processhackbench: 16 - Threaddacapobench: Tradebeanshackbench: 8 - Processhackbench: 4 - Processhackbench: 4 - Threadhackbench: 1 - Threadhackbench: 2 - Threadhackbench: 2 - Processhackbench: 1 - Processctx-clock: Context Switch Timestress-ng: Forkingethr: UDP - Bandwidth - 32tensorflow-lite: Mobilenet Quantrocksdb: Read Rand Write Randbuild-linux-kernel: allmodconfigstress-ng: NUMAsockperf: Throughputethr: UDP - Bandwidth - 8osbench: Create Filesocrmypdf: Processing 60 Page PDF Documentpostmark: Disk Transaction Performancekeydb: build-linux-kernel: defconfigrocksdb: Update Randstress-ng: MEMFDbuild-mplayer: Time To Compileselenium: ARES-6 - Google Chromeethr: TCP - Bandwidth - 8sqlite-speedtest: Timed Time - Size 1,000build-godot: Time To Compileselenium: Jetstream 2 - Google Chromeethr: UDP - Bandwidth - 1cryptsetup: AES-XTS 512b Encryptionbuild-gem5: Time To Compileselenium: WASM collisionDetection - Google Chromecryptsetup: AES-XTS 256b Decryptioncryptsetup: AES-XTS 512b Decryptionselenium: Jetstream 2 - Firefoxgit: Time To Complete Common Git Commandsselenium: ARES-6 - Firefoxgimp: resizeosbench: Create Threadsethr: TCP - Bandwidth - 1osbench: Launch Programsosbench: Create Processesrawtherapee: Total Benchmark Timeredis: SADDselenium: WASM collisionDetection - Firefoxselenium: Octane - Firefoxredis: SETgimp: unsharp-maskgimp: auto-levelsselenium: Speedometer - Firefoxredis: LPUSHosbench: Memory Allocationsselenium: Kraken - Google Chromeselenium: Octane - Google Chromerenaissance: Apache Spark PageRankgimp: rotatebuild-mesa: Time To Compileselenium: Speedometer - Google Chromestress-ng: IO_uringbuild-apache: Time To Compiledacapobench: Jythonclickhouse: 100M Rows Web Analytics Dataset, Third Runclickhouse: 100M Rows Web Analytics Dataset, First Run / Cold Cacheclickhouse: 100M Rows Web Analytics Dataset, Second Runethr: TCP - Latency - 8leveldb: Rand Fillleveldb: Rand Fillleveldb: Overwriteleveldb: Overwritestress-ng: Context Switchingselenium: WASM imageConvolute - Google Chromeselenium: WASM imageConvolute - Firefoxselenium: Kraken - Firefoxsockperf: Latency Ping PongCurrent Linux Defaultmitigations=offretbleed=offmitigations=auto,nosmt124.830115.18515.197103861.7243.21743.34214.24293451.01153.58835.41973.50074.013735434.74817.85418.4104.9479.6019.2534.76430036551.4422078679253.1610029361827.790140.88396914150826728.75908831.5463676346316.39148.016310652363.7657.77826.6081.8583.326187.786105.8651468812223.6681.165322.212612.22229.768.63260.52852.3724.90223.47389915.8967.16092452.40678885.8261533253.79512.4210521330720.1227.37024.3731031103357.9698.144293982.7384604943.322.57881.77812569877.7631.517641793.9678.3894.4743.346125.83514.0125.44314.12011376.2732.8135.51384.112.125118.636109.95015.021147479.1839.30238.62314.95062556.43137.72531.79466.27067.275721831.40916.10016.6734.4818.6838.3824.37921038587.9023742678777.5410228181830.357152.41477347166800023.90516930.4594491351271.34146.566319614416.2957.37426.1884.0379.393186.616107.5641596402302.8680.224315.922708.12290.670.76458.53652.1323.68720.84334717.0859.84544846.78328881.7021607270.29513.2216381342551.7225.46522.6011041119872.3893.365272921.7409484827.620.94181.55912571748.3430.756631096.9977.1093.5138.290119.40514.8119.21514.92368740.1433.1532.11222.610.849122.153112.94915.246106607.6342.89143.58614.54894036.46144.18833.52769.44770.392719132.92316.89517.5604.7039.1578.7964.56321038553.8722216008775.7910377401855.366150.15428542154680025.99361631.4814214344872.87148.288315445404.0557.62826.4982.5280.675188.841105.4701521572295.6680.691314.702692.02287.570.40458.39052.0823.57121.08653416.2460.60997746.70063783.9751588511.21506.2209651364767.8725.43022.6791051115334.0394.642639956.4404734880.820.98881.69612770498.4630.841631394.7178.1294.1644.051123.74914.3123.08414.42125792.8534.4035.91351.011.83233.27931.0736.40869619.0720.63821.72026.62746529.21250.08757.633119.270120.667410855.05626.12826.9447.22413.89013.4046.95333025509.7716764007020.247940602336.385119.47375732131453330.23766938.3433571433102.54183.120262498341.9569.59921.9870.694.362221.524125.0741725691982.6789.514364.482339.31980.179.10166.44846.0826.59722.87308417.8463.64981351.88306290.8841446745.00561.9195121234329.4224.86922.300112.31027352.9897.772439904.5378934584.821.54387.375133.873808.5731.952652120.35238.41023.137.54623.81326955.2140.1335.41347.46.096OpenBenchmarking.org

LevelDB

LevelDB is a key-value storage library developed by Google that supports making use of Snappy for data compression and has other modern features. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgMicroseconds Per Op, Fewer Is BetterLevelDB 1.22Benchmark: Sequential FillCurrent Linux Defaultmitigations=offretbleed=offmitigations=auto,nosmt306090120150SE +/- 0.29, N = 3SE +/- 0.08, N = 3SE +/- 0.24, N = 3SE +/- 0.31, N = 3124.83118.64122.1533.281. (CXX) g++ options: -O3 -lsnappy -ltcmalloc

OpenBenchmarking.orgMicroseconds Per Op, Fewer Is BetterLevelDB 1.22Benchmark: Random DeleteCurrent Linux Defaultmitigations=offretbleed=offmitigations=auto,nosmt306090120150SE +/- 0.01, N = 3SE +/- 0.19, N = 3SE +/- 0.01, N = 3SE +/- 0.06, N = 3115.19109.95112.9531.071. (CXX) g++ options: -O3 -lsnappy -ltcmalloc

OpenBenchmarking.orgMicroseconds Per Op, Fewer Is BetterLevelDB 1.22Benchmark: Seek RandomCurrent Linux Defaultmitigations=offretbleed=offmitigations=auto,nosmt48121620SE +/- 0.010, N = 3SE +/- 0.027, N = 3SE +/- 0.031, N = 3SE +/- 0.012, N = 315.19715.02115.2466.4081. (CXX) g++ options: -O3 -lsnappy -ltcmalloc

Stress-NG

Stress-NG is a Linux stress tool developed by Colin King of Canonical. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.14Test: SENDFILECurrent Linux Defaultmitigations=offretbleed=offmitigations=auto,nosmt30K60K90K120K150KSE +/- 12.91, N = 3SE +/- 220.20, N = 3SE +/- 54.84, N = 3SE +/- 266.32, N = 3103861.72147479.18106607.6369619.071. (CC) gcc options: -O2 -std=gnu99 -lm -laio -lapparmor -latomic -lc -lcrypt -ldl -lrt -lsctp -lz -pthread

Ethr

Ethr is a cross-platform Golang-written network performance measurement tool developed by Microsoft that is capable of testing multiple protocols and conducting different measurements. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgus, Fewer Is BetterEthr 1.0Server Address: localhost - Protocol: TCP - Test: Latency - Threads: 1Current Linux Defaultmitigations=offretbleed=offmitigations=auto,nosmt1020304050SE +/- 0.46, N = 5SE +/- 0.46, N = 4SE +/- 0.29, N = 15SE +/- 0.21, N = 343.2239.3042.8920.64MIN: 31.35 / MAX: 53.43MIN: 28.45 / MAX: 50.99MIN: 31.17 / MAX: 54.2MIN: 13.9 / MAX: 26.29

OpenBenchmarking.orgus, Fewer Is BetterEthr 1.0Server Address: localhost - Protocol: TCP - Test: Latency - Threads: 32Current Linux Defaultmitigations=offretbleed=offmitigations=auto,nosmt1020304050SE +/- 0.28, N = 15SE +/- 0.34, N = 15SE +/- 0.50, N = 15SE +/- 0.19, N = 843.3438.6243.5921.72MIN: 31.45 / MAX: 53.32MIN: 28.36 / MAX: 51.69MIN: 30.59 / MAX: 56.44MIN: 13.75 / MAX: 26.79

LevelDB

LevelDB is a key-value storage library developed by Google that supports making use of Snappy for data compression and has other modern features. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgMB/s, More Is BetterLevelDB 1.22Benchmark: Sequential FillCurrent Linux Defaultmitigations=offretbleed=offmitigations=auto,nosmt612182430SE +/- 0.03, N = 3SE +/- 0.00, N = 3SE +/- 0.03, N = 3SE +/- 0.23, N = 314.214.914.526.61. (CXX) g++ options: -O3 -lsnappy -ltcmalloc

Stress-NG

Stress-NG is a Linux stress tool developed by Colin King of Canonical. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.14Test: MallocCurrent Linux Defaultmitigations=offretbleed=offmitigations=auto,nosmt1.1M2.2M3.3M4.4M5.5MSE +/- 11267.20, N = 3SE +/- 25564.49, N = 3SE +/- 22624.56, N = 3SE +/- 17927.58, N = 34293451.015062556.434894036.462746529.211. (CC) gcc options: -O2 -std=gnu99 -lm -laio -lapparmor -latomic -lc -lcrypt -ldl -lrt -lsctp -lz -pthread

Hackbench

This is a benchmark of Hackbench, a test of the Linux kernel scheduler. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterHackbenchCount: 32 - Type: ProcessCurrent Linux Defaultmitigations=offretbleed=offmitigations=auto,nosmt50100150200250SE +/- 1.04, N = 12SE +/- 0.19, N = 3SE +/- 0.31, N = 3SE +/- 2.22, N = 9153.59137.73144.19250.091. (CC) gcc options: -lpthread

OpenBenchmarking.orgSeconds, Fewer Is BetterHackbenchCount: 8 - Type: ThreadCurrent Linux Defaultmitigations=offretbleed=offmitigations=auto,nosmt1326395265SE +/- 0.11, N = 3SE +/- 0.06, N = 3SE +/- 0.05, N = 3SE +/- 0.22, N = 335.4231.7933.5357.631. (CC) gcc options: -lpthread

OpenBenchmarking.orgSeconds, Fewer Is BetterHackbenchCount: 16 - Type: ProcessCurrent Linux Defaultmitigations=offretbleed=offmitigations=auto,nosmt306090120150SE +/- 0.28, N = 3SE +/- 0.06, N = 3SE +/- 0.13, N = 3SE +/- 0.21, N = 373.5066.2769.45119.271. (CC) gcc options: -lpthread

OpenBenchmarking.orgSeconds, Fewer Is BetterHackbenchCount: 16 - Type: ThreadCurrent Linux Defaultmitigations=offretbleed=offmitigations=auto,nosmt306090120150SE +/- 0.08, N = 3SE +/- 0.03, N = 3SE +/- 0.09, N = 3SE +/- 0.12, N = 374.0167.2870.39120.671. (CC) gcc options: -lpthread

DaCapo Benchmark

This test runs the DaCapo Benchmarks written in Java and intended to test system/CPU performance. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgmsec, Fewer Is BetterDaCapo Benchmark 9.12-MR1Java Test: TradebeansCurrent Linux Defaultmitigations=offretbleed=offmitigations=auto,nosmt16003200480064008000SE +/- 74.32, N = 5SE +/- 72.89, N = 6SE +/- 47.11, N = 4SE +/- 41.17, N = 207354721871914108

Hackbench

This is a benchmark of Hackbench, a test of the Linux kernel scheduler. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterHackbenchCount: 8 - Type: ProcessCurrent Linux Defaultmitigations=offretbleed=offmitigations=auto,nosmt1224364860SE +/- 0.09, N = 3SE +/- 0.03, N = 3SE +/- 0.04, N = 3SE +/- 0.04, N = 334.7531.4132.9255.061. (CC) gcc options: -lpthread

OpenBenchmarking.orgSeconds, Fewer Is BetterHackbenchCount: 4 - Type: ProcessCurrent Linux Defaultmitigations=offretbleed=offmitigations=auto,nosmt612182430SE +/- 0.03, N = 3SE +/- 0.02, N = 3SE +/- 0.02, N = 3SE +/- 0.05, N = 317.8516.1016.9026.131. (CC) gcc options: -lpthread

OpenBenchmarking.orgSeconds, Fewer Is BetterHackbenchCount: 4 - Type: ThreadCurrent Linux Defaultmitigations=offretbleed=offmitigations=auto,nosmt612182430SE +/- 0.01, N = 3SE +/- 0.05, N = 3SE +/- 0.01, N = 3SE +/- 0.21, N = 318.4116.6717.5626.941. (CC) gcc options: -lpthread

OpenBenchmarking.orgSeconds, Fewer Is BetterHackbenchCount: 1 - Type: ThreadCurrent Linux Defaultmitigations=offretbleed=offmitigations=auto,nosmt246810SE +/- 0.014, N = 3SE +/- 0.009, N = 3SE +/- 0.001, N = 3SE +/- 0.012, N = 34.9474.4814.7037.2241. (CC) gcc options: -lpthread

OpenBenchmarking.orgSeconds, Fewer Is BetterHackbenchCount: 2 - Type: ThreadCurrent Linux Defaultmitigations=offretbleed=offmitigations=auto,nosmt48121620SE +/- 0.012, N = 3SE +/- 0.010, N = 3SE +/- 0.024, N = 3SE +/- 0.036, N = 39.6018.6839.15713.8901. (CC) gcc options: -lpthread

OpenBenchmarking.orgSeconds, Fewer Is BetterHackbenchCount: 2 - Type: ProcessCurrent Linux Defaultmitigations=offretbleed=offmitigations=auto,nosmt3691215SE +/- 0.008, N = 3SE +/- 0.006, N = 3SE +/- 0.002, N = 3SE +/- 0.024, N = 39.2538.3828.79613.4041. (CC) gcc options: -lpthread

OpenBenchmarking.orgSeconds, Fewer Is BetterHackbenchCount: 1 - Type: ProcessCurrent Linux Defaultmitigations=offretbleed=offmitigations=auto,nosmt246810SE +/- 0.012, N = 3SE +/- 0.005, N = 3SE +/- 0.006, N = 3SE +/- 0.004, N = 34.7644.3794.5636.9531. (CC) gcc options: -lpthread

ctx_clock

Ctx_clock is a simple test program to measure the context switch time in clock cycles. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgClocks, Fewer Is Betterctx_clockContext Switch TimeCurrent Linux Defaultmitigations=offretbleed=offmitigations=auto,nosmt70140210280350SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3300210210330

Stress-NG

Stress-NG is a Linux stress tool developed by Colin King of Canonical. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.14Test: ForkingCurrent Linux Defaultmitigations=offretbleed=offmitigations=auto,nosmt8K16K24K32K40KSE +/- 204.81, N = 3SE +/- 32.31, N = 3SE +/- 207.11, N = 3SE +/- 146.23, N = 336551.4438587.9038553.8725509.771. (CC) gcc options: -O2 -std=gnu99 -lm -laio -lapparmor -latomic -lc -lcrypt -ldl -lrt -lsctp -lz -pthread

Ethr

Ethr is a cross-platform Golang-written network performance measurement tool developed by Microsoft that is capable of testing multiple protocols and conducting different measurements. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgPackets/sec, More Is BetterEthr 1.0Server Address: localhost - Protocol: UDP - Test: Bandwidth - Threads: 32Current Linux Defaultmitigations=offretbleed=offmitigations=auto,nosmt500K1000K1500K2000K2500KSE +/- 3962.04, N = 3SE +/- 9034.26, N = 3SE +/- 4636.09, N = 3SE +/- 5661.57, N = 32207867237426722216001676400MIN: 2130000 / MAX: 2280000MIN: 2280000 / MAX: 2440000MIN: 2140000 / MAX: 2320000MIN: 1590000 / MAX: 1740000

TensorFlow Lite

This is a benchmark of the TensorFlow Lite implementation focused on TensorFlow machine learning for mobile, IoT, edge, and other cases. The current Linux support is limited to running on CPUs. This test profile is measuring the average inference time. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgMicroseconds, Fewer Is BetterTensorFlow Lite 2022-05-18Model: Mobilenet QuantCurrent Linux Defaultmitigations=offretbleed=offmitigations=auto,nosmt2K4K6K8K10KSE +/- 61.59, N = 3SE +/- 108.26, N = 15SE +/- 82.58, N = 3SE +/- 4.00, N = 39253.168777.548775.797020.24

Facebook RocksDB

This is a benchmark of Facebook's RocksDB as an embeddable persistent key-value store for fast storage based on Google's LevelDB. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgOp/s, More Is BetterFacebook RocksDB 7.0.1Test: Read Random Write RandomCurrent Linux Defaultmitigations=offretbleed=offmitigations=auto,nosmt200K400K600K800K1000KSE +/- 659.00, N = 3SE +/- 4505.30, N = 3SE +/- 926.94, N = 3SE +/- 11003.11, N = 31002936102281810377407940601. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti -lpthread

Timed Linux Kernel Compilation

This test times how long it takes to build the Linux kernel in a default configuration (defconfig) for the architecture being tested or alternatively an allmodconfig for building all possible kernel modules for the build. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed Linux Kernel Compilation 5.18Build: allmodconfigCurrent Linux Defaultmitigations=offretbleed=offmitigations=auto,nosmt5001000150020002500SE +/- 0.92, N = 3SE +/- 4.32, N = 3SE +/- 2.13, N = 3SE +/- 1.21, N = 31827.791830.361855.372336.39

Stress-NG

Stress-NG is a Linux stress tool developed by Colin King of Canonical. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.14Test: NUMACurrent Linux Defaultmitigations=offretbleed=offmitigations=auto,nosmt306090120150SE +/- 1.48, N = 3SE +/- 1.04, N = 3SE +/- 1.13, N = 15SE +/- 0.19, N = 3140.88152.41150.15119.471. (CC) gcc options: -O2 -std=gnu99 -lm -laio -lapparmor -latomic -lc -lcrypt -ldl -lrt -lsctp -lz -pthread

Sockperf

This is a network socket API performance benchmark developed by Mellanox. This test profile runs both the client and server on the local host for evaluating individual system performance. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgMessages Per Second, More Is BetterSockperf 3.7Test: ThroughputCurrent Linux Defaultmitigations=offretbleed=offmitigations=auto,nosmt100K200K300K400K500KSE +/- 3521.88, N = 5SE +/- 2164.03, N = 5SE +/- 2765.72, N = 15SE +/- 3208.48, N = 53969144773474285423757321. (CXX) g++ options: --param -O3 -rdynamic

Ethr

Ethr is a cross-platform Golang-written network performance measurement tool developed by Microsoft that is capable of testing multiple protocols and conducting different measurements. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgPackets/sec, More Is BetterEthr 1.0Server Address: localhost - Protocol: UDP - Test: Bandwidth - Threads: 8Current Linux Defaultmitigations=offretbleed=offmitigations=auto,nosmt400K800K1200K1600K2000KSE +/- 6533.33, N = 3SE +/- 3401.96, N = 3SE +/- 4460.19, N = 3SE +/- 11076.30, N = 31508267166800015468001314533MIN: 1410000 / MAX: 1570000MIN: 1550000 / MAX: 1730000MIN: 1440000 / MAX: 1610000MIN: 1200000 / MAX: 1420000

OSBench

OSBench is a collection of micro-benchmarks for measuring operating system primitives like time to create threads/processes, launching programs, creating files, and memory allocation. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgus Per Event, Fewer Is BetterOSBenchTest: Create FilesCurrent Linux Defaultmitigations=offretbleed=offmitigations=auto,nosmt714212835SE +/- 0.09, N = 3SE +/- 0.06, N = 3SE +/- 0.11, N = 3SE +/- 0.10, N = 328.7623.9125.9930.24

OCRMyPDF

OCRMyPDF is an optical character recognition (OCR) text layer to scanned PDF files, producing new PDFs with the text now selectable/searchable/copy-paste capable. OCRMyPDF leverages the Tesseract OCR engine and is written in Python. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterOCRMyPDF 13.4.0+dfsgProcessing 60 Page PDF DocumentCurrent Linux Defaultmitigations=offretbleed=offmitigations=auto,nosmt918273645SE +/- 0.22, N = 3SE +/- 0.11, N = 3SE +/- 0.03, N = 3SE +/- 0.12, N = 331.5530.4631.4838.34

PostMark

This is a test of NetApp's PostMark benchmark designed to simulate small-file testing similar to the tasks endured by web and mail servers. This test profile will set PostMark to perform 25,000 transactions with 500 files simultaneously with the file sizes ranging between 5 and 512 kilobytes. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgTPS, More Is BetterPostMark 1.51Disk Transaction PerformanceCurrent Linux Defaultmitigations=offretbleed=offmitigations=auto,nosmt10002000300040005000SE +/- 0.00, N = 3SE +/- 27.00, N = 3SE +/- 48.00, N = 3SE +/- 0.00, N = 336764491421435711. (CC) gcc options: -O3

KeyDB

A benchmark of KeyDB as a multi-threaded fork of the Redis server. The KeyDB benchmark is conducted using memtier-benchmark. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgOps/sec, More Is BetterKeyDB 6.2.0Current Linux Defaultmitigations=offretbleed=offmitigations=auto,nosmt90K180K270K360K450KSE +/- 4328.49, N = 4SE +/- 4872.32, N = 3SE +/- 2799.74, N = 3SE +/- 2007.09, N = 3346316.39351271.34344872.87433102.541. (CXX) g++ options: -O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre

Timed Linux Kernel Compilation

This test times how long it takes to build the Linux kernel in a default configuration (defconfig) for the architecture being tested or alternatively an allmodconfig for building all possible kernel modules for the build. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed Linux Kernel Compilation 5.18Build: defconfigCurrent Linux Defaultmitigations=offretbleed=offmitigations=auto,nosmt4080120160200SE +/- 1.03, N = 3SE +/- 0.74, N = 3SE +/- 1.63, N = 12SE +/- 1.27, N = 12148.02146.57148.29183.12

Facebook RocksDB

This is a benchmark of Facebook's RocksDB as an embeddable persistent key-value store for fast storage based on Google's LevelDB. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgOp/s, More Is BetterFacebook RocksDB 7.0.1Test: Update RandomCurrent Linux Defaultmitigations=offretbleed=offmitigations=auto,nosmt70K140K210K280K350KSE +/- 3637.35, N = 3SE +/- 827.87, N = 3SE +/- 623.13, N = 3SE +/- 1064.24, N = 33106523196143154452624981. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti -lpthread

Stress-NG

Stress-NG is a Linux stress tool developed by Colin King of Canonical. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.14Test: MEMFDCurrent Linux Defaultmitigations=offretbleed=offmitigations=auto,nosmt90180270360450SE +/- 4.98, N = 3SE +/- 0.41, N = 3SE +/- 3.33, N = 9SE +/- 0.18, N = 3363.76416.29404.05341.951. (CC) gcc options: -O2 -std=gnu99 -lm -laio -lapparmor -latomic -lc -lcrypt -ldl -lrt -lsctp -lz -pthread

Timed MPlayer Compilation

This test times how long it takes to build the MPlayer open-source media player program. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed MPlayer Compilation 1.5Time To CompileCurrent Linux Defaultmitigations=offretbleed=offmitigations=auto,nosmt1530456075SE +/- 0.02, N = 3SE +/- 0.04, N = 3SE +/- 0.05, N = 3SE +/- 0.02, N = 357.7857.3757.6369.60

Selenium

This test profile uses the Selenium WebDriver for running various browser benchmarks in different available web browsers such as Mozilla Firefox and Google Chrome. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgms, Fewer Is BetterSeleniumBenchmark: ARES-6 - Browser: Google ChromeCurrent Linux Defaultmitigations=offretbleed=offmitigations=auto,nosmt612182430SE +/- 0.20, N = 3SE +/- 0.12, N = 3SE +/- 0.19, N = 3SE +/- 0.16, N = 326.6026.1826.4921.981. chrome 103.0.5060.114

Ethr

Ethr is a cross-platform Golang-written network performance measurement tool developed by Microsoft that is capable of testing multiple protocols and conducting different measurements. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgGbits/sec, More Is BetterEthr 1.0Server Address: localhost - Protocol: TCP - Test: Bandwidth - Threads: 8Current Linux Defaultmitigations=offretbleed=offmitigations=auto,nosmt20406080100SE +/- 0.19, N = 3SE +/- 0.26, N = 3SE +/- 0.36, N = 3SE +/- 0.00, N = 381.8584.0382.5270.60MIN: 80.15 / MAX: 83.43MIN: 82.86 / MAX: 85.53MIN: 80.98 / MAX: 84.08MIN: 68.39 / MAX: 73.38

SQLite Speedtest

This is a benchmark of SQLite's speedtest1 benchmark program with an increased problem size of 1,000. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterSQLite Speedtest 3.30Timed Time - Size 1,000Current Linux Defaultmitigations=offretbleed=offmitigations=auto,nosmt20406080100SE +/- 0.10, N = 3SE +/- 0.24, N = 3SE +/- 0.12, N = 3SE +/- 0.12, N = 383.6379.3980.6894.361. (CC) gcc options: -O2 -lz

Timed Godot Game Engine Compilation

This test times how long it takes to compile the Godot Game Engine. Godot is a popular, open-source, cross-platform 2D/3D game engine and is built using the SCons build system and targeting the X11 platform. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed Godot Game Engine Compilation 3.2.3Time To CompileCurrent Linux Defaultmitigations=offretbleed=offmitigations=auto,nosmt50100150200250SE +/- 0.03, N = 3SE +/- 0.03, N = 3SE +/- 0.93, N = 3SE +/- 0.19, N = 3187.79186.62188.84221.52

Selenium

This test profile uses the Selenium WebDriver for running various browser benchmarks in different available web browsers such as Mozilla Firefox and Google Chrome. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgScore, More Is BetterSeleniumBenchmark: Jetstream 2 - Browser: Google ChromeCurrent Linux Defaultmitigations=offretbleed=offmitigations=auto,nosmt306090120150SE +/- 0.46, N = 3SE +/- 0.54, N = 3SE +/- 1.08, N = 3SE +/- 0.42, N = 3105.87107.56105.47125.071. chrome 103.0.5060.114

Ethr

Ethr is a cross-platform Golang-written network performance measurement tool developed by Microsoft that is capable of testing multiple protocols and conducting different measurements. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgPackets/sec, More Is BetterEthr 1.0Server Address: localhost - Protocol: UDP - Test: Bandwidth - Threads: 1Current Linux Defaultmitigations=offretbleed=offmitigations=auto,nosmt40K80K120K160K200KSE +/- 1049.73, N = 3SE +/- 1242.43, N = 3SE +/- 401.44, N = 3SE +/- 392.55, N = 3146881159640152157172569MIN: 124730 / MAX: 157680MIN: 143290 / MAX: 177560MIN: 137380 / MAX: 166300MIN: 168350 / MAX: 178780

Cryptsetup

This is a test profile for running the cryptsetup benchmark to report on the system's cryptography performance. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgMiB/s, More Is BetterCryptsetupAES-XTS 512b EncryptionCurrent Linux Defaultmitigations=offretbleed=offmitigations=auto,nosmt5001000150020002500SE +/- 12.25, N = 4SE +/- 19.45, N = 3SE +/- 9.10, N = 3SE +/- 5.88, N = 32223.62302.82295.61982.6

Timed Gem5 Compilation

This test times how long it takes to compile Gem5. Gem5 is a simulator for computer system architecture research. Gem5 is widely used for computer architecture research within the industry, academia, and more. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed Gem5 Compilation 21.2Time To CompileCurrent Linux Defaultmitigations=offretbleed=offmitigations=auto,nosmt2004006008001000SE +/- 1.27, N = 2SE +/- 0.39, N = 3SE +/- 0.91, N = 3SE +/- 0.45, N = 3681.17680.22680.69789.51

Selenium

This test profile uses the Selenium WebDriver for running various browser benchmarks in different available web browsers such as Mozilla Firefox and Google Chrome. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgms, Fewer Is BetterSeleniumBenchmark: WASM collisionDetection - Browser: Google ChromeCurrent Linux Defaultmitigations=offretbleed=offmitigations=auto,nosmt80160240320400SE +/- 0.81, N = 3SE +/- 1.36, N = 3SE +/- 0.45, N = 3SE +/- 0.09, N = 3322.21315.92314.70364.481. chrome 103.0.5060.114

Cryptsetup

This is a test profile for running the cryptsetup benchmark to report on the system's cryptography performance. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgMiB/s, More Is BetterCryptsetupAES-XTS 256b DecryptionCurrent Linux Defaultmitigations=offretbleed=offmitigations=auto,nosmt6001200180024003000SE +/- 5.81, N = 4SE +/- 26.68, N = 3SE +/- 8.59, N = 3SE +/- 9.50, N = 32612.22708.12692.02339.3

OpenBenchmarking.orgMiB/s, More Is BetterCryptsetupAES-XTS 512b DecryptionCurrent Linux Defaultmitigations=offretbleed=offmitigations=auto,nosmt5001000150020002500SE +/- 9.71, N = 4SE +/- 20.34, N = 3SE +/- 9.22, N = 3SE +/- 5.67, N = 32229.72290.62287.51980.1

Selenium

This test profile uses the Selenium WebDriver for running various browser benchmarks in different available web browsers such as Mozilla Firefox and Google Chrome. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgScore, More Is BetterSeleniumBenchmark: Jetstream 2 - Browser: FirefoxCurrent Linux Defaultmitigations=offretbleed=offmitigations=auto,nosmt20406080100SE +/- 0.39, N = 3SE +/- 0.32, N = 3SE +/- 0.31, N = 3SE +/- 0.27, N = 368.6370.7670.4079.101. firefox 102.0.1

Git

This test measures the time needed to carry out some sample Git operations on an example, static repository that happens to be a copy of the GNOME GTK tool-kit repository. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterGitTime To Complete Common Git CommandsCurrent Linux Defaultmitigations=offretbleed=offmitigations=auto,nosmt1530456075SE +/- 0.44, N = 15SE +/- 0.13, N = 3SE +/- 0.08, N = 3SE +/- 0.13, N = 359.9658.5458.3966.451. git version 2.34.1

Selenium

This test profile uses the Selenium WebDriver for running various browser benchmarks in different available web browsers such as Mozilla Firefox and Google Chrome. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgms, Fewer Is BetterSeleniumBenchmark: ARES-6 - Browser: FirefoxCurrent Linux Defaultmitigations=offretbleed=offmitigations=auto,nosmt1224364860SE +/- 0.11, N = 3SE +/- 0.31, N = 3SE +/- 0.34, N = 3SE +/- 0.13, N = 352.3752.1352.0846.081. firefox 102.0.1

GIMP

GIMP is an open-source image manipulaton program. This test profile will use the system-provided GIMP program otherwise on Windows relys upon a pre-packaged Windows binary from upstream GIMP.org. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterGIMP 2.10.30Test: resizeCurrent Linux Defaultmitigations=offretbleed=offmitigations=auto,nosmt612182430SE +/- 0.21, N = 9SE +/- 0.21, N = 7SE +/- 0.19, N = 8SE +/- 0.23, N = 824.9023.6923.5726.60

OSBench

OSBench is a collection of micro-benchmarks for measuring operating system primitives like time to create threads/processes, launching programs, creating files, and memory allocation. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgus Per Event, Fewer Is BetterOSBenchTest: Create ThreadsCurrent Linux Defaultmitigations=offretbleed=offmitigations=auto,nosmt612182430SE +/- 0.06, N = 3SE +/- 0.08, N = 3SE +/- 0.10, N = 3SE +/- 0.14, N = 323.4720.8421.0922.87

Ethr

Ethr is a cross-platform Golang-written network performance measurement tool developed by Microsoft that is capable of testing multiple protocols and conducting different measurements. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgGbits/sec, More Is BetterEthr 1.0Server Address: localhost - Protocol: TCP - Test: Bandwidth - Threads: 1Current Linux Defaultmitigations=offretbleed=offmitigations=auto,nosmt48121620SE +/- 0.13, N = 3SE +/- 0.11, N = 3SE +/- 0.20, N = 3SE +/- 0.11, N = 315.8917.0816.2417.84MIN: 12.54 / MAX: 18.57MIN: 14.52 / MAX: 20.45MIN: 12.39 / MAX: 19.49MIN: 15.78 / MAX: 19.37

OSBench

OSBench is a collection of micro-benchmarks for measuring operating system primitives like time to create threads/processes, launching programs, creating files, and memory allocation. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgus Per Event, Fewer Is BetterOSBenchTest: Launch ProgramsCurrent Linux Defaultmitigations=offretbleed=offmitigations=auto,nosmt1530456075SE +/- 0.24, N = 3SE +/- 0.03, N = 3SE +/- 0.05, N = 3SE +/- 0.25, N = 367.1659.8560.6163.65

OpenBenchmarking.orgus Per Event, Fewer Is BetterOSBenchTest: Create ProcessesCurrent Linux Defaultmitigations=offretbleed=offmitigations=auto,nosmt1224364860SE +/- 0.43, N = 3SE +/- 0.58, N = 3SE +/- 0.33, N = 3SE +/- 0.37, N = 352.4146.7846.7051.88

RawTherapee

RawTherapee is a cross-platform, open-source multi-threaded RAW image processing program. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterRawTherapeeTotal Benchmark TimeCurrent Linux Defaultmitigations=offretbleed=offmitigations=auto,nosmt20406080100SE +/- 0.06, N = 3SE +/- 0.04, N = 3SE +/- 0.14, N = 3SE +/- 0.03, N = 385.8381.7083.9890.881. RawTherapee, version 5.8, command line.

Redis

Redis is an open-source in-memory data structure store, used as a database, cache, and message broker. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgRequests Per Second, More Is BetterRedis 6.0.9Test: SADDCurrent Linux Defaultmitigations=offretbleed=offmitigations=auto,nosmt300K600K900K1200K1500KSE +/- 5562.99, N = 3SE +/- 21729.58, N = 3SE +/- 16694.25, N = 3SE +/- 14969.36, N = 31533253.791607270.291588511.211446745.001. (CXX) g++ options: -MM -MT -g3 -fvisibility=hidden -O3

Selenium

This test profile uses the Selenium WebDriver for running various browser benchmarks in different available web browsers such as Mozilla Firefox and Google Chrome. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgms, Fewer Is BetterSeleniumBenchmark: WASM collisionDetection - Browser: FirefoxCurrent Linux Defaultmitigations=offretbleed=offmitigations=auto,nosmt120240360480600SE +/- 0.22, N = 3SE +/- 0.75, N = 3SE +/- 2.66, N = 3SE +/- 0.25, N = 3512.4513.2506.2561.91. firefox 102.0.1

OpenBenchmarking.orgGeometric Mean, More Is BetterSeleniumBenchmark: Octane - Browser: FirefoxCurrent Linux Defaultmitigations=offretbleed=offmitigations=auto,nosmt5K10K15K20K25KSE +/- 223.91, N = 3SE +/- 37.36, N = 3SE +/- 259.28, N = 4SE +/- 46.59, N = 3210522163820965195121. firefox 102.0.1

Redis

Redis is an open-source in-memory data structure store, used as a database, cache, and message broker. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgRequests Per Second, More Is BetterRedis 6.0.9Test: SETCurrent Linux Defaultmitigations=offretbleed=offmitigations=auto,nosmt300K600K900K1200K1500KSE +/- 9857.69, N = 3SE +/- 12676.86, N = 15SE +/- 6226.48, N = 3SE +/- 12226.80, N = 51330720.121342551.721364767.871234329.421. (CXX) g++ options: -MM -MT -g3 -fvisibility=hidden -O3

GIMP

GIMP is an open-source image manipulaton program. This test profile will use the system-provided GIMP program otherwise on Windows relys upon a pre-packaged Windows binary from upstream GIMP.org. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterGIMP 2.10.30Test: unsharp-maskCurrent Linux Defaultmitigations=offretbleed=offmitigations=auto,nosmt612182430SE +/- 0.11, N = 3SE +/- 0.04, N = 3SE +/- 0.08, N = 3SE +/- 0.03, N = 327.3725.4725.4324.87

OpenBenchmarking.orgSeconds, Fewer Is BetterGIMP 2.10.30Test: auto-levelsCurrent Linux Defaultmitigations=offretbleed=offmitigations=auto,nosmt612182430SE +/- 0.10, N = 3SE +/- 0.07, N = 3SE +/- 0.10, N = 3SE +/- 0.09, N = 324.3722.6022.6822.30

Selenium

This test profile uses the Selenium WebDriver for running various browser benchmarks in different available web browsers such as Mozilla Firefox and Google Chrome. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgRuns Per Minute, More Is BetterSeleniumBenchmark: Speedometer - Browser: FirefoxCurrent Linux Defaultmitigations=offretbleed=offmitigations=auto,nosmt306090120150SE +/- 0.33, N = 3SE +/- 0.00, N = 3SE +/- 0.33, N = 3SE +/- 0.28, N = 3103.0104.0105.0112.31. firefox 102.0.1

Redis

Redis is an open-source in-memory data structure store, used as a database, cache, and message broker. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgRequests Per Second, More Is BetterRedis 6.0.9Test: LPUSHCurrent Linux Defaultmitigations=offretbleed=offmitigations=auto,nosmt200K400K600K800K1000KSE +/- 6713.90, N = 3SE +/- 8200.31, N = 3SE +/- 7473.68, N = 15SE +/- 6678.55, N = 31103357.961119872.381115334.031027352.981. (CXX) g++ options: -MM -MT -g3 -fvisibility=hidden -O3

OSBench

OSBench is a collection of micro-benchmarks for measuring operating system primitives like time to create threads/processes, launching programs, creating files, and memory allocation. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgNs Per Event, Fewer Is BetterOSBenchTest: Memory AllocationsCurrent Linux Defaultmitigations=offretbleed=offmitigations=auto,nosmt20406080100SE +/- 1.31, N = 3SE +/- 1.17, N = 3SE +/- 0.52, N = 3SE +/- 0.62, N = 3101.5493.3794.6497.77

Selenium

This test profile uses the Selenium WebDriver for running various browser benchmarks in different available web browsers such as Mozilla Firefox and Google Chrome. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgms, Fewer Is BetterSeleniumBenchmark: Kraken - Browser: Google ChromeCurrent Linux Defaultmitigations=offretbleed=offmitigations=auto,nosmt2004006008001000SE +/- 10.50, N = 15SE +/- 3.23, N = 3SE +/- 7.03, N = 15SE +/- 7.80, N = 15982.7921.7956.4904.51. chrome 103.0.5060.114

OpenBenchmarking.orgGeometric Mean, More Is BetterSeleniumBenchmark: Octane - Browser: Google ChromeCurrent Linux Defaultmitigations=offretbleed=offmitigations=auto,nosmt9K18K27K36K45KSE +/- 422.84, N = 3SE +/- 151.64, N = 3SE +/- 212.56, N = 3SE +/- 502.69, N = 3384604094840473378931. chrome 103.0.5060.114

Renaissance

Renaissance is a suite of benchmarks designed to test the Java JVM from Apache Spark to a Twitter-like service to Scala and other features. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgms, Fewer Is BetterRenaissance 0.14Test: Apache Spark PageRankCurrent Linux Defaultmitigations=offretbleed=offmitigations=auto,nosmt11002200330044005500SE +/- 70.01, N = 3SE +/- 49.99, N = 12SE +/- 59.50, N = 4SE +/- 60.12, N = 104943.34827.64880.84584.8MIN: 4367.94 / MAX: 5181.66MIN: 4062.79 / MAX: 5207.94MIN: 4470.3 / MAX: 5116.98MIN: 4051.39 / MAX: 4898.74

GIMP

GIMP is an open-source image manipulaton program. This test profile will use the system-provided GIMP program otherwise on Windows relys upon a pre-packaged Windows binary from upstream GIMP.org. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterGIMP 2.10.30Test: rotateCurrent Linux Defaultmitigations=offretbleed=offmitigations=auto,nosmt510152025SE +/- 0.17, N = 3SE +/- 0.03, N = 3SE +/- 0.10, N = 3SE +/- 0.08, N = 322.5820.9420.9921.54

Timed Mesa Compilation

This test profile times how long it takes to compile Mesa with Meson/Ninja. For minimizing build dependencies and avoid versioning conflicts, test this is just the core Mesa build without LLVM or the extra Gallium3D/Mesa drivers enabled. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed Mesa Compilation 21.0Time To CompileCurrent Linux Defaultmitigations=offretbleed=offmitigations=auto,nosmt20406080100SE +/- 0.08, N = 3SE +/- 0.03, N = 3SE +/- 0.08, N = 3SE +/- 0.05, N = 381.7881.5681.7087.38

Selenium

This test profile uses the Selenium WebDriver for running various browser benchmarks in different available web browsers such as Mozilla Firefox and Google Chrome. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgRuns Per Minute, More Is BetterSeleniumBenchmark: Speedometer - Browser: Google ChromeCurrent Linux Defaultmitigations=offretbleed=offmitigations=auto,nosmt306090120150SE +/- 0.33, N = 3SE +/- 1.00, N = 3SE +/- 1.33, N = 3SE +/- 0.27, N = 3125.0125.0127.0133.81. chrome 103.0.5060.114

Stress-NG

Stress-NG is a Linux stress tool developed by Colin King of Canonical. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.14Test: IO_uringCurrent Linux Defaultmitigations=offretbleed=offmitigations=auto,nosmt16K32K48K64K80KSE +/- 578.74, N = 3SE +/- 408.31, N = 3SE +/- 328.18, N = 3SE +/- 28.07, N = 369877.7671748.3470498.4673808.571. (CC) gcc options: -O2 -std=gnu99 -lm -laio -lapparmor -latomic -lc -lcrypt -ldl -lrt -lsctp -lz -pthread

Timed Apache Compilation

This test times how long it takes to build the Apache HTTPD web server. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed Apache Compilation 2.4.41Time To CompileCurrent Linux Defaultmitigations=offretbleed=offmitigations=auto,nosmt714212835SE +/- 0.07, N = 3SE +/- 0.06, N = 3SE +/- 0.08, N = 3SE +/- 0.03, N = 331.5230.7630.8431.95

DaCapo Benchmark

This test runs the DaCapo Benchmarks written in Java and intended to test system/CPU performance. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgmsec, Fewer Is BetterDaCapo Benchmark 9.12-MR1Java Test: JythonCurrent Linux Defaultmitigations=offretbleed=offmitigations=auto,nosmt14002800420056007000SE +/- 43.22, N = 13SE +/- 38.70, N = 16SE +/- 53.68, N = 4SE +/- 5.74, N = 46417631063136521

ClickHouse

ClickHouse is an open-source, high performance OLAP data management system. This test profile uses ClickHouse's standard benchmark recommendations per https://clickhouse.com/docs/en/operations/performance-test/ with the 100 million rows web analytics dataset. The reported value is the query processing time using the geometric mean of all queries performed. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgQueries Per Minute, Geo Mean, More Is BetterClickHouse100M Rows Web Analytics Dataset, Third RunCurrent Linux Defaultmitigations=offretbleed=off20406080100SE +/- 0.98, N = 12SE +/- 0.69, N = 12SE +/- 0.66, N = 1293.9696.9994.71MIN: 6.78 / MAX: 15000MIN: 6.98 / MAX: 15000MIN: 6.76 / MAX: 120001. ClickHouse server version 22.7.1.687 (official build).

100M Rows Web Analytics Dataset, Third Run

mitigations=auto,nosmt: The test run did not produce a result. The test run did not produce a result. The test run did not produce a result.

OpenBenchmarking.orgQueries Per Minute, Geo Mean, More Is BetterClickHouse100M Rows Web Analytics Dataset, First Run / Cold CacheCurrent Linux Defaultmitigations=offretbleed=off20406080100SE +/- 0.93, N = 12SE +/- 1.08, N = 12SE +/- 0.90, N = 1278.3877.1078.12MIN: 5.78 / MAX: 10000MIN: 6.09 / MAX: 12000MIN: 5.73 / MAX: 120001. ClickHouse server version 22.7.1.687 (official build).

100M Rows Web Analytics Dataset, First Run / Cold Cache

mitigations=auto,nosmt: The test run did not produce a result. The test run did not produce a result. The test run did not produce a result.

OpenBenchmarking.orgQueries Per Minute, Geo Mean, More Is BetterClickHouse100M Rows Web Analytics Dataset, Second RunCurrent Linux Defaultmitigations=offretbleed=off20406080100SE +/- 0.56, N = 12SE +/- 0.99, N = 12SE +/- 0.62, N = 1294.4793.5194.16MIN: 6.61 / MAX: 15000MIN: 6.84 / MAX: 15000MIN: 6.71 / MAX: 150001. ClickHouse server version 22.7.1.687 (official build).

100M Rows Web Analytics Dataset, Second Run

mitigations=auto,nosmt: The test run did not produce a result. The test run did not produce a result. The test run did not produce a result.

Ethr

Ethr is a cross-platform Golang-written network performance measurement tool developed by Microsoft that is capable of testing multiple protocols and conducting different measurements. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgus, Fewer Is BetterEthr 1.0Server Address: localhost - Protocol: TCP - Test: Latency - Threads: 8Current Linux Defaultmitigations=offretbleed=offmitigations=auto,nosmt1020304050SE +/- 0.36, N = 15SE +/- 0.50, N = 3SE +/- 0.25, N = 3SE +/- 0.41, N = 1543.3538.2944.0520.35MIN: 30.99 / MAX: 54.01MIN: 28.85 / MAX: 49.31MIN: 30.85 / MAX: 53.19MIN: 13.56 / MAX: 26.8

LevelDB

LevelDB is a key-value storage library developed by Google that supports making use of Snappy for data compression and has other modern features. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgMicroseconds Per Op, Fewer Is BetterLevelDB 1.22Benchmark: Random FillCurrent Linux Defaultmitigations=offretbleed=offmitigations=auto,nosmt306090120150SE +/- 0.35, N = 3SE +/- 0.40, N = 3SE +/- 0.03, N = 3SE +/- 0.84, N = 15125.84119.41123.7538.411. (CXX) g++ options: -O3 -lsnappy -ltcmalloc

OpenBenchmarking.orgMB/s, More Is BetterLevelDB 1.22Benchmark: Random FillCurrent Linux Defaultmitigations=offretbleed=offmitigations=auto,nosmt612182430SE +/- 0.03, N = 3SE +/- 0.06, N = 3SE +/- 0.00, N = 3SE +/- 0.51, N = 1514.014.814.323.11. (CXX) g++ options: -O3 -lsnappy -ltcmalloc

OpenBenchmarking.orgMicroseconds Per Op, Fewer Is BetterLevelDB 1.22Benchmark: OverwriteCurrent Linux Defaultmitigations=offretbleed=offmitigations=auto,nosmt306090120150SE +/- 0.20, N = 3SE +/- 0.28, N = 3SE +/- 0.25, N = 3SE +/- 1.00, N = 15125.44119.22123.0837.551. (CXX) g++ options: -O3 -lsnappy -ltcmalloc

OpenBenchmarking.orgMB/s, More Is BetterLevelDB 1.22Benchmark: OverwriteCurrent Linux Defaultmitigations=offretbleed=offmitigations=auto,nosmt612182430SE +/- 0.00, N = 3SE +/- 0.03, N = 3SE +/- 0.03, N = 3SE +/- 0.60, N = 1514.114.914.423.81. (CXX) g++ options: -O3 -lsnappy -ltcmalloc

Stress-NG

Stress-NG is a Linux stress tool developed by Colin King of Canonical. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.14Test: Context SwitchingCurrent Linux Defaultmitigations=offretbleed=offmitigations=auto,nosmt500K1000K1500K2000K2500KSE +/- 6974.46, N = 3SE +/- 57786.46, N = 12SE +/- 16689.47, N = 15SE +/- 2020.18, N = 32011376.272368740.142125792.851326955.211. (CC) gcc options: -O2 -std=gnu99 -lm -laio -lapparmor -latomic -lc -lcrypt -ldl -lrt -lsctp -lz -pthread

Selenium

This test profile uses the Selenium WebDriver for running various browser benchmarks in different available web browsers such as Mozilla Firefox and Google Chrome. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgms, Fewer Is BetterSeleniumBenchmark: WASM imageConvolute - Browser: Google ChromeCurrent Linux Defaultmitigations=offretbleed=offmitigations=auto,nosmt918273645SE +/- 0.21, N = 3SE +/- 0.19, N = 3SE +/- 0.51, N = 15SE +/- 0.64, N = 1532.8133.1534.4040.131. chrome 103.0.5060.114

OpenBenchmarking.orgms, Fewer Is BetterSeleniumBenchmark: WASM imageConvolute - Browser: FirefoxCurrent Linux Defaultmitigations=offretbleed=offmitigations=auto,nosmt816243240SE +/- 1.04, N = 15SE +/- 0.37, N = 3SE +/- 1.31, N = 15SE +/- 0.03, N = 335.532.135.935.41. firefox 102.0.1

OpenBenchmarking.orgms, Fewer Is BetterSeleniumBenchmark: Kraken - Browser: FirefoxCurrent Linux Defaultmitigations=offretbleed=offmitigations=auto,nosmt30060090012001500SE +/- 28.56, N = 15SE +/- 4.76, N = 3SE +/- 25.14, N = 15SE +/- 10.67, N = 151384.11222.61351.01347.41. firefox 102.0.1

Sockperf

This is a network socket API performance benchmark developed by Mellanox. This test profile runs both the client and server on the local host for evaluating individual system performance. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgusec, Fewer Is BetterSockperf 3.7Test: Latency Ping PongCurrent Linux Defaultmitigations=offretbleed=offmitigations=auto,nosmt3691215SE +/- 0.023, N = 5SE +/- 0.137, N = 25SE +/- 0.215, N = 20SE +/- 0.043, N = 2512.12510.84911.8326.0961. (CXX) g++ options: --param -O3 -rdynamic

88 Results Shown

LevelDB:
  Seq Fill
  Rand Delete
  Seek Rand
Stress-NG
Ethr:
  TCP - Latency - 1
  TCP - Latency - 32
LevelDB
Stress-NG
Hackbench:
  32 - Process
  8 - Thread
  16 - Process
  16 - Thread
DaCapo Benchmark
Hackbench:
  8 - Process
  4 - Process
  4 - Thread
  1 - Thread
  2 - Thread
  2 - Process
  1 - Process
ctx_clock
Stress-NG
Ethr
TensorFlow Lite
Facebook RocksDB
Timed Linux Kernel Compilation
Stress-NG
Sockperf
Ethr
OSBench
OCRMyPDF
PostMark
KeyDB
Timed Linux Kernel Compilation
Facebook RocksDB
Stress-NG
Timed MPlayer Compilation
Selenium
Ethr
SQLite Speedtest
Timed Godot Game Engine Compilation
Selenium
Ethr
Cryptsetup
Timed Gem5 Compilation
Selenium
Cryptsetup:
  AES-XTS 256b Decryption
  AES-XTS 512b Decryption
Selenium
Git
Selenium
GIMP
OSBench
Ethr
OSBench:
  Launch Programs
  Create Processes
RawTherapee
Redis
Selenium:
  WASM collisionDetection - Firefox
  Octane - Firefox
Redis
GIMP:
  unsharp-mask
  auto-levels
Selenium
Redis
OSBench
Selenium:
  Kraken - Google Chrome
  Octane - Google Chrome
Renaissance
GIMP
Timed Mesa Compilation
Selenium
Stress-NG
Timed Apache Compilation
DaCapo Benchmark
ClickHouse:
  100M Rows Web Analytics Dataset, Third Run
  100M Rows Web Analytics Dataset, First Run / Cold Cache
  100M Rows Web Analytics Dataset, Second Run
Ethr
LevelDB:
  Rand Fill:
    Microseconds Per Op
    MB/s
  Overwrite:
    Microseconds Per Op
    MB/s
Stress-NG
Selenium:
  WASM imageConvolute - Google Chrome
  WASM imageConvolute - Firefox
  Kraken - Firefox
Sockperf