Retbleed Mitigations AMD Zen 1

AMD Ryzen 7 1700 mitigation benchmarks by Michael Larabel for a future article.

Compare your own system(s) to this result file with the Phoronix Test Suite by running the command: phoronix-test-suite benchmark 2207175-NE-RETBLEEDZ09
Jump To Table - Results

View

Do Not Show Noisy Results
Do Not Show Results With Incomplete Data
Do Not Show Results With Little Change/Spread
List Notable Results
Show Result Confidence Charts
Allow Limiting Results To Certain Suite(s)

Statistics

Show Overall Harmonic Mean(s)
Show Overall Geometric Mean
Show Wins / Losses Counts (Pie Chart)
Normalize Results
Remove Outliers Before Calculating Averages

Graph Settings

Force Line Graphs Where Applicable
Convert To Scalar Where Applicable
Prefer Vertical Bar Graphs

Additional Graphs

Show Perf Per Core/Thread Calculation Graphs Where Applicable

Multi-Way Comparison

Condense Multi-Option Tests Into Single Result Graphs

Table

Show Detailed System Result Table

Run Management

Highlight
Result
Toggle/Hide
Result
Result
Identifier
View Logs
Performance Per
Dollar
Date
Run
  Test
  Duration
Current Linux Default
July 14 2022
  8 Hours, 53 Minutes
mitigations=off
July 15 2022
  8 Hours, 26 Minutes
retbleed=off
July 16 2022
  9 Hours, 10 Minutes
mitigations=auto,nosmt
July 16 2022
  9 Hours, 12 Minutes
Invert Behavior (Only Show Selected Data)
  8 Hours, 55 Minutes

Only show results where is faster than
Only show results matching title/arguments (delimit multiple options with a comma):
Do not show results matching title/arguments (delimit multiple options with a comma):


Retbleed Mitigations AMD Zen 1OpenBenchmarking.orgPhoronix Test SuiteAMD Ryzen 7 1700 Eight-Core @ 3.00GHz (8 Cores / 16 Threads)AMD Ryzen 7 1700 Eight-Core @ 3.00GHz (8 Cores)MSI B350 TOMAHAWK (MS-7A34) v1.0 (1.Q6 BIOS)AMD 17h16GB120GB Samsung SSD 840 + 32GB Flash DiskAMD Radeon RX 480 8GB (1266/2000MHz)AMD Ellesmere HDMI AudioDELL S2409WRealtek RTL8111/8168/8411Ubuntu 22.045.19.0-rc6-phx-retbleed (x86_64)GNOME Shell 42.2X Server + Wayland4.6 Mesa 22.0.1 (LLVM 13.0.1 DRM 3.47)1.3.204GCC 11.2.0ext41920x1080ProcessorsMotherboardChipsetMemoryDiskGraphicsAudioMonitorNetworkOSKernelDesktopDisplay ServerOpenGLVulkanCompilerFile-SystemScreen ResolutionRetbleed Mitigations AMD Zen 1 BenchmarksSystem Logs- Transparent Huge Pages: madvise- --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-bootstrap --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-link-serialization=2 --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none=/build/gcc-11-gBFGDP/gcc-11-11.2.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-11-gBFGDP/gcc-11-11.2.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-build-config=bootstrap-lto-lean --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v - MQ-DEADLINE / errors=remount-ro,relatime,rw / Block Size: 4096- Scaling Governor: acpi-cpufreq schedutil (Boost: Enabled) - CPU Microcode: 0x8001138 - OpenJDK Runtime Environment (build 11.0.15+10-Ubuntu-0ubuntu0.22.04.1)- Python 3.10.4- Current Linux Default: itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Mitigation of untrained return thunk; SMT vulnerable + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional STIBP: disabled RSB filling + srbds: Not affected + tsx_async_abort: Not affected - mitigations=off: itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Vulnerable + spec_store_bypass: Vulnerable + spectre_v1: Vulnerable: __user pointer sanitization and usercopy barriers only; no swapgs barriers + spectre_v2: Vulnerable IBPB: disabled STIBP: disabled + srbds: Not affected + tsx_async_abort: Not affected - retbleed=off: itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Vulnerable + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional STIBP: disabled RSB filling + srbds: Not affected + tsx_async_abort: Not affected - mitigations=auto,nosmt: itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Mitigation of untrained return thunk; SMT disabled + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional STIBP: disabled RSB filling + srbds: Not affected + tsx_async_abort: Not affected

Current Linux Defaultmitigations=offretbleed=offmitigations=auto,nosmtResult OverviewPhoronix Test Suite100%139%178%218%257%LevelDBHackbenchctx_clockStress-NGSockperfTensorFlow LiteEthrDaCapo BenchmarkTimed Linux Kernel CompilationOCRMyPDFPostMarkKeyDBFacebook RocksDBTimed MPlayer CompilationSQLite SpeedtestTimed Godot Game Engine CompilationCryptsetupTimed Gem5 CompilationGitOSBenchRawTherapeeRenaissanceRedisTimed Mesa CompilationGIMPTimed Apache CompilationSelenium

Retbleed Mitigations AMD Zen 1leveldb: Seq Fillleveldb: Rand Deleteleveldb: Seek Randstress-ng: SENDFILEethr: TCP - Latency - 1ethr: TCP - Latency - 32leveldb: Seq Fillstress-ng: Mallochackbench: 32 - Processhackbench: 8 - Threadhackbench: 16 - Processhackbench: 16 - Threaddacapobench: Tradebeanshackbench: 8 - Processhackbench: 4 - Processhackbench: 4 - Threadhackbench: 1 - Threadhackbench: 2 - Threadhackbench: 2 - Processhackbench: 1 - Processctx-clock: Context Switch Timestress-ng: Forkingethr: UDP - Bandwidth - 32tensorflow-lite: Mobilenet Quantrocksdb: Read Rand Write Randbuild-linux-kernel: allmodconfigstress-ng: NUMAsockperf: Throughputethr: UDP - Bandwidth - 8osbench: Create Filesocrmypdf: Processing 60 Page PDF Documentpostmark: Disk Transaction Performancekeydb: build-linux-kernel: defconfigrocksdb: Update Randstress-ng: MEMFDbuild-mplayer: Time To Compileselenium: ARES-6 - Google Chromeethr: TCP - Bandwidth - 8sqlite-speedtest: Timed Time - Size 1,000build-godot: Time To Compileselenium: Jetstream 2 - Google Chromeethr: UDP - Bandwidth - 1cryptsetup: AES-XTS 512b Encryptionbuild-gem5: Time To Compileselenium: WASM collisionDetection - Google Chromecryptsetup: AES-XTS 256b Decryptioncryptsetup: AES-XTS 512b Decryptionselenium: Jetstream 2 - Firefoxgit: Time To Complete Common Git Commandsselenium: ARES-6 - Firefoxgimp: resizeosbench: Create Threadsethr: TCP - Bandwidth - 1osbench: Launch Programsosbench: Create Processesrawtherapee: Total Benchmark Timeredis: SADDselenium: WASM collisionDetection - Firefoxselenium: Octane - Firefoxredis: SETgimp: unsharp-maskgimp: auto-levelsselenium: Speedometer - Firefoxredis: LPUSHosbench: Memory Allocationsselenium: Kraken - Google Chromeselenium: Octane - Google Chromerenaissance: Apache Spark PageRankgimp: rotatebuild-mesa: Time To Compileselenium: Speedometer - Google Chromestress-ng: IO_uringbuild-apache: Time To Compiledacapobench: Jythonclickhouse: 100M Rows Web Analytics Dataset, Third Runclickhouse: 100M Rows Web Analytics Dataset, First Run / Cold Cacheclickhouse: 100M Rows Web Analytics Dataset, Second Runethr: TCP - Latency - 8leveldb: Rand Fillleveldb: Rand Fillleveldb: Overwriteleveldb: Overwritestress-ng: Context Switchingselenium: WASM imageConvolute - Google Chromeselenium: WASM imageConvolute - Firefoxselenium: Kraken - Firefoxsockperf: Latency Ping PongCurrent Linux Defaultmitigations=offretbleed=offmitigations=auto,nosmt124.830115.18515.197103861.7243.21743.34214.24293451.01153.58835.41973.50074.013735434.74817.85418.4104.9479.6019.2534.76430036551.4422078679253.1610029361827.790140.88396914150826728.75908831.5463676346316.39148.016310652363.7657.77826.6081.8583.326187.786105.8651468812223.6681.165322.212612.22229.768.63260.52852.3724.90223.47389915.8967.16092452.40678885.8261533253.79512.4210521330720.1227.37024.3731031103357.9698.144293982.7384604943.322.57881.77812569877.7631.517641793.9678.3894.4743.346125.83514.0125.44314.12011376.2732.8135.51384.112.125118.636109.95015.021147479.1839.30238.62314.95062556.43137.72531.79466.27067.275721831.40916.10016.6734.4818.6838.3824.37921038587.9023742678777.5410228181830.357152.41477347166800023.90516930.4594491351271.34146.566319614416.2957.37426.1884.0379.393186.616107.5641596402302.8680.224315.922708.12290.670.76458.53652.1323.68720.84334717.0859.84544846.78328881.7021607270.29513.2216381342551.7225.46522.6011041119872.3893.365272921.7409484827.620.94181.55912571748.3430.756631096.9977.1093.5138.290119.40514.8119.21514.92368740.1433.1532.11222.610.849122.153112.94915.246106607.6342.89143.58614.54894036.46144.18833.52769.44770.392719132.92316.89517.5604.7039.1578.7964.56321038553.8722216008775.7910377401855.366150.15428542154680025.99361631.4814214344872.87148.288315445404.0557.62826.4982.5280.675188.841105.4701521572295.6680.691314.702692.02287.570.40458.39052.0823.57121.08653416.2460.60997746.70063783.9751588511.21506.2209651364767.8725.43022.6791051115334.0394.642639956.4404734880.820.98881.69612770498.4630.841631394.7178.1294.1644.051123.74914.3123.08414.42125792.8534.4035.91351.011.83233.27931.0736.40869619.0720.63821.72026.62746529.21250.08757.633119.270120.667410855.05626.12826.9447.22413.89013.4046.95333025509.7716764007020.247940602336.385119.47375732131453330.23766938.3433571433102.54183.120262498341.9569.59921.9870.694.362221.524125.0741725691982.6789.514364.482339.31980.179.10166.44846.0826.59722.87308417.8463.64981351.88306290.8841446745.00561.9195121234329.4224.86922.300112.31027352.9897.772439904.5378934584.821.54387.375133.873808.5731.952652120.35238.41023.137.54623.81326955.2140.1335.41347.46.096OpenBenchmarking.org

LevelDB

LevelDB is a key-value storage library developed by Google that supports making use of Snappy for data compression and has other modern features. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgMicroseconds Per Op, Fewer Is BetterLevelDB 1.22Benchmark: Sequential Fillmitigations=auto,nosmtretbleed=offmitigations=offCurrent Linux Default306090120150SE +/- 0.31, N = 3SE +/- 0.24, N = 3SE +/- 0.08, N = 3SE +/- 0.29, N = 333.28122.15118.64124.831. (CXX) g++ options: -O3 -lsnappy -ltcmalloc

OpenBenchmarking.orgMicroseconds Per Op, Fewer Is BetterLevelDB 1.22Benchmark: Random Deletemitigations=auto,nosmtretbleed=offmitigations=offCurrent Linux Default306090120150SE +/- 0.06, N = 3SE +/- 0.01, N = 3SE +/- 0.19, N = 3SE +/- 0.01, N = 331.07112.95109.95115.191. (CXX) g++ options: -O3 -lsnappy -ltcmalloc

OpenBenchmarking.orgMicroseconds Per Op, Fewer Is BetterLevelDB 1.22Benchmark: Seek Randommitigations=auto,nosmtretbleed=offmitigations=offCurrent Linux Default48121620SE +/- 0.012, N = 3SE +/- 0.031, N = 3SE +/- 0.027, N = 3SE +/- 0.010, N = 36.40815.24615.02115.1971. (CXX) g++ options: -O3 -lsnappy -ltcmalloc

Stress-NG

Stress-NG is a Linux stress tool developed by Colin King of Canonical. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.14Test: SENDFILEmitigations=auto,nosmtretbleed=offmitigations=offCurrent Linux Default30K60K90K120K150KSE +/- 266.32, N = 3SE +/- 54.84, N = 3SE +/- 220.20, N = 3SE +/- 12.91, N = 369619.07106607.63147479.18103861.721. (CC) gcc options: -O2 -std=gnu99 -lm -laio -lapparmor -latomic -lc -lcrypt -ldl -lrt -lsctp -lz -pthread

Ethr

Ethr is a cross-platform Golang-written network performance measurement tool developed by Microsoft that is capable of testing multiple protocols and conducting different measurements. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgus, Fewer Is BetterEthr 1.0Server Address: localhost - Protocol: TCP - Test: Latency - Threads: 1mitigations=auto,nosmtretbleed=offmitigations=offCurrent Linux Default1020304050SE +/- 0.21, N = 3SE +/- 0.29, N = 15SE +/- 0.46, N = 4SE +/- 0.46, N = 520.6442.8939.3043.22MIN: 13.9 / MAX: 26.29MIN: 31.17 / MAX: 54.2MIN: 28.45 / MAX: 50.99MIN: 31.35 / MAX: 53.43

OpenBenchmarking.orgus, Fewer Is BetterEthr 1.0Server Address: localhost - Protocol: TCP - Test: Latency - Threads: 32mitigations=auto,nosmtretbleed=offmitigations=offCurrent Linux Default1020304050SE +/- 0.19, N = 8SE +/- 0.50, N = 15SE +/- 0.34, N = 15SE +/- 0.28, N = 1521.7243.5938.6243.34MIN: 13.75 / MAX: 26.79MIN: 30.59 / MAX: 56.44MIN: 28.36 / MAX: 51.69MIN: 31.45 / MAX: 53.32

LevelDB

LevelDB is a key-value storage library developed by Google that supports making use of Snappy for data compression and has other modern features. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgMB/s, More Is BetterLevelDB 1.22Benchmark: Sequential Fillmitigations=auto,nosmtretbleed=offmitigations=offCurrent Linux Default612182430SE +/- 0.23, N = 3SE +/- 0.03, N = 3SE +/- 0.00, N = 3SE +/- 0.03, N = 326.614.514.914.21. (CXX) g++ options: -O3 -lsnappy -ltcmalloc

Stress-NG

Stress-NG is a Linux stress tool developed by Colin King of Canonical. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.14Test: Mallocmitigations=auto,nosmtretbleed=offmitigations=offCurrent Linux Default1.1M2.2M3.3M4.4M5.5MSE +/- 17927.58, N = 3SE +/- 22624.56, N = 3SE +/- 25564.49, N = 3SE +/- 11267.20, N = 32746529.214894036.465062556.434293451.011. (CC) gcc options: -O2 -std=gnu99 -lm -laio -lapparmor -latomic -lc -lcrypt -ldl -lrt -lsctp -lz -pthread

Hackbench

This is a benchmark of Hackbench, a test of the Linux kernel scheduler. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterHackbenchCount: 32 - Type: Processmitigations=auto,nosmtretbleed=offmitigations=offCurrent Linux Default50100150200250SE +/- 2.22, N = 9SE +/- 0.31, N = 3SE +/- 0.19, N = 3SE +/- 1.04, N = 12250.09144.19137.73153.591. (CC) gcc options: -lpthread

OpenBenchmarking.orgSeconds, Fewer Is BetterHackbenchCount: 8 - Type: Threadmitigations=auto,nosmtretbleed=offmitigations=offCurrent Linux Default1326395265SE +/- 0.22, N = 3SE +/- 0.05, N = 3SE +/- 0.06, N = 3SE +/- 0.11, N = 357.6333.5331.7935.421. (CC) gcc options: -lpthread

OpenBenchmarking.orgSeconds, Fewer Is BetterHackbenchCount: 16 - Type: Processmitigations=auto,nosmtretbleed=offmitigations=offCurrent Linux Default306090120150SE +/- 0.21, N = 3SE +/- 0.13, N = 3SE +/- 0.06, N = 3SE +/- 0.28, N = 3119.2769.4566.2773.501. (CC) gcc options: -lpthread

OpenBenchmarking.orgSeconds, Fewer Is BetterHackbenchCount: 16 - Type: Threadmitigations=auto,nosmtretbleed=offmitigations=offCurrent Linux Default306090120150SE +/- 0.12, N = 3SE +/- 0.09, N = 3SE +/- 0.03, N = 3SE +/- 0.08, N = 3120.6770.3967.2874.011. (CC) gcc options: -lpthread

DaCapo Benchmark

This test runs the DaCapo Benchmarks written in Java and intended to test system/CPU performance. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgmsec, Fewer Is BetterDaCapo Benchmark 9.12-MR1Java Test: Tradebeansmitigations=auto,nosmtretbleed=offmitigations=offCurrent Linux Default16003200480064008000SE +/- 41.17, N = 20SE +/- 47.11, N = 4SE +/- 72.89, N = 6SE +/- 74.32, N = 54108719172187354

Hackbench

This is a benchmark of Hackbench, a test of the Linux kernel scheduler. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterHackbenchCount: 8 - Type: Processmitigations=auto,nosmtretbleed=offmitigations=offCurrent Linux Default1224364860SE +/- 0.04, N = 3SE +/- 0.04, N = 3SE +/- 0.03, N = 3SE +/- 0.09, N = 355.0632.9231.4134.751. (CC) gcc options: -lpthread

OpenBenchmarking.orgSeconds, Fewer Is BetterHackbenchCount: 4 - Type: Processmitigations=auto,nosmtretbleed=offmitigations=offCurrent Linux Default612182430SE +/- 0.05, N = 3SE +/- 0.02, N = 3SE +/- 0.02, N = 3SE +/- 0.03, N = 326.1316.9016.1017.851. (CC) gcc options: -lpthread

OpenBenchmarking.orgSeconds, Fewer Is BetterHackbenchCount: 4 - Type: Threadmitigations=auto,nosmtretbleed=offmitigations=offCurrent Linux Default612182430SE +/- 0.21, N = 3SE +/- 0.01, N = 3SE +/- 0.05, N = 3SE +/- 0.01, N = 326.9417.5616.6718.411. (CC) gcc options: -lpthread

OpenBenchmarking.orgSeconds, Fewer Is BetterHackbenchCount: 1 - Type: Threadmitigations=auto,nosmtretbleed=offmitigations=offCurrent Linux Default246810SE +/- 0.012, N = 3SE +/- 0.001, N = 3SE +/- 0.009, N = 3SE +/- 0.014, N = 37.2244.7034.4814.9471. (CC) gcc options: -lpthread

OpenBenchmarking.orgSeconds, Fewer Is BetterHackbenchCount: 2 - Type: Threadmitigations=auto,nosmtretbleed=offmitigations=offCurrent Linux Default48121620SE +/- 0.036, N = 3SE +/- 0.024, N = 3SE +/- 0.010, N = 3SE +/- 0.012, N = 313.8909.1578.6839.6011. (CC) gcc options: -lpthread

OpenBenchmarking.orgSeconds, Fewer Is BetterHackbenchCount: 2 - Type: Processmitigations=auto,nosmtretbleed=offmitigations=offCurrent Linux Default3691215SE +/- 0.024, N = 3SE +/- 0.002, N = 3SE +/- 0.006, N = 3SE +/- 0.008, N = 313.4048.7968.3829.2531. (CC) gcc options: -lpthread

OpenBenchmarking.orgSeconds, Fewer Is BetterHackbenchCount: 1 - Type: Processmitigations=auto,nosmtretbleed=offmitigations=offCurrent Linux Default246810SE +/- 0.004, N = 3SE +/- 0.006, N = 3SE +/- 0.005, N = 3SE +/- 0.012, N = 36.9534.5634.3794.7641. (CC) gcc options: -lpthread

ctx_clock

Ctx_clock is a simple test program to measure the context switch time in clock cycles. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgClocks, Fewer Is Betterctx_clockContext Switch Timemitigations=auto,nosmtretbleed=offmitigations=offCurrent Linux Default70140210280350SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3330210210300

Stress-NG

Stress-NG is a Linux stress tool developed by Colin King of Canonical. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.14Test: Forkingmitigations=auto,nosmtretbleed=offmitigations=offCurrent Linux Default8K16K24K32K40KSE +/- 146.23, N = 3SE +/- 207.11, N = 3SE +/- 32.31, N = 3SE +/- 204.81, N = 325509.7738553.8738587.9036551.441. (CC) gcc options: -O2 -std=gnu99 -lm -laio -lapparmor -latomic -lc -lcrypt -ldl -lrt -lsctp -lz -pthread

Ethr

Ethr is a cross-platform Golang-written network performance measurement tool developed by Microsoft that is capable of testing multiple protocols and conducting different measurements. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgPackets/sec, More Is BetterEthr 1.0Server Address: localhost - Protocol: UDP - Test: Bandwidth - Threads: 32mitigations=auto,nosmtretbleed=offmitigations=offCurrent Linux Default500K1000K1500K2000K2500KSE +/- 5661.57, N = 3SE +/- 4636.09, N = 3SE +/- 9034.26, N = 3SE +/- 3962.04, N = 31676400222160023742672207867MIN: 1590000 / MAX: 1740000MIN: 2140000 / MAX: 2320000MIN: 2280000 / MAX: 2440000MIN: 2130000 / MAX: 2280000

TensorFlow Lite

This is a benchmark of the TensorFlow Lite implementation focused on TensorFlow machine learning for mobile, IoT, edge, and other cases. The current Linux support is limited to running on CPUs. This test profile is measuring the average inference time. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgMicroseconds, Fewer Is BetterTensorFlow Lite 2022-05-18Model: Mobilenet Quantmitigations=auto,nosmtretbleed=offmitigations=offCurrent Linux Default2K4K6K8K10KSE +/- 4.00, N = 3SE +/- 82.58, N = 3SE +/- 108.26, N = 15SE +/- 61.59, N = 37020.248775.798777.549253.16

Facebook RocksDB

This is a benchmark of Facebook's RocksDB as an embeddable persistent key-value store for fast storage based on Google's LevelDB. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgOp/s, More Is BetterFacebook RocksDB 7.0.1Test: Read Random Write Randommitigations=auto,nosmtretbleed=offmitigations=offCurrent Linux Default200K400K600K800K1000KSE +/- 11003.11, N = 3SE +/- 926.94, N = 3SE +/- 4505.30, N = 3SE +/- 659.00, N = 37940601037740102281810029361. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti -lpthread

Timed Linux Kernel Compilation

This test times how long it takes to build the Linux kernel in a default configuration (defconfig) for the architecture being tested or alternatively an allmodconfig for building all possible kernel modules for the build. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed Linux Kernel Compilation 5.18Build: allmodconfigmitigations=auto,nosmtretbleed=offmitigations=offCurrent Linux Default5001000150020002500SE +/- 1.21, N = 3SE +/- 2.13, N = 3SE +/- 4.32, N = 3SE +/- 0.92, N = 32336.391855.371830.361827.79

Stress-NG

Stress-NG is a Linux stress tool developed by Colin King of Canonical. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.14Test: NUMAmitigations=auto,nosmtretbleed=offmitigations=offCurrent Linux Default306090120150SE +/- 0.19, N = 3SE +/- 1.13, N = 15SE +/- 1.04, N = 3SE +/- 1.48, N = 3119.47150.15152.41140.881. (CC) gcc options: -O2 -std=gnu99 -lm -laio -lapparmor -latomic -lc -lcrypt -ldl -lrt -lsctp -lz -pthread

Sockperf

This is a network socket API performance benchmark developed by Mellanox. This test profile runs both the client and server on the local host for evaluating individual system performance. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgMessages Per Second, More Is BetterSockperf 3.7Test: Throughputmitigations=auto,nosmtretbleed=offmitigations=offCurrent Linux Default100K200K300K400K500KSE +/- 3208.48, N = 5SE +/- 2765.72, N = 15SE +/- 2164.03, N = 5SE +/- 3521.88, N = 53757324285424773473969141. (CXX) g++ options: --param -O3 -rdynamic

Ethr

Ethr is a cross-platform Golang-written network performance measurement tool developed by Microsoft that is capable of testing multiple protocols and conducting different measurements. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgPackets/sec, More Is BetterEthr 1.0Server Address: localhost - Protocol: UDP - Test: Bandwidth - Threads: 8mitigations=auto,nosmtretbleed=offmitigations=offCurrent Linux Default400K800K1200K1600K2000KSE +/- 11076.30, N = 3SE +/- 4460.19, N = 3SE +/- 3401.96, N = 3SE +/- 6533.33, N = 31314533154680016680001508267MIN: 1200000 / MAX: 1420000MIN: 1440000 / MAX: 1610000MIN: 1550000 / MAX: 1730000MIN: 1410000 / MAX: 1570000

OSBench

OSBench is a collection of micro-benchmarks for measuring operating system primitives like time to create threads/processes, launching programs, creating files, and memory allocation. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgus Per Event, Fewer Is BetterOSBenchTest: Create Filesmitigations=auto,nosmtretbleed=offmitigations=offCurrent Linux Default714212835SE +/- 0.10, N = 3SE +/- 0.11, N = 3SE +/- 0.06, N = 3SE +/- 0.09, N = 330.2425.9923.9128.76

OCRMyPDF

OCRMyPDF is an optical character recognition (OCR) text layer to scanned PDF files, producing new PDFs with the text now selectable/searchable/copy-paste capable. OCRMyPDF leverages the Tesseract OCR engine and is written in Python. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterOCRMyPDF 13.4.0+dfsgProcessing 60 Page PDF Documentmitigations=auto,nosmtretbleed=offmitigations=offCurrent Linux Default918273645SE +/- 0.12, N = 3SE +/- 0.03, N = 3SE +/- 0.11, N = 3SE +/- 0.22, N = 338.3431.4830.4631.55

PostMark

This is a test of NetApp's PostMark benchmark designed to simulate small-file testing similar to the tasks endured by web and mail servers. This test profile will set PostMark to perform 25,000 transactions with 500 files simultaneously with the file sizes ranging between 5 and 512 kilobytes. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgTPS, More Is BetterPostMark 1.51Disk Transaction Performancemitigations=auto,nosmtretbleed=offmitigations=offCurrent Linux Default10002000300040005000SE +/- 0.00, N = 3SE +/- 48.00, N = 3SE +/- 27.00, N = 3SE +/- 0.00, N = 335714214449136761. (CC) gcc options: -O3

KeyDB

A benchmark of KeyDB as a multi-threaded fork of the Redis server. The KeyDB benchmark is conducted using memtier-benchmark. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgOps/sec, More Is BetterKeyDB 6.2.0mitigations=auto,nosmtretbleed=offmitigations=offCurrent Linux Default90K180K270K360K450KSE +/- 2007.09, N = 3SE +/- 2799.74, N = 3SE +/- 4872.32, N = 3SE +/- 4328.49, N = 4433102.54344872.87351271.34346316.391. (CXX) g++ options: -O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre

Timed Linux Kernel Compilation

This test times how long it takes to build the Linux kernel in a default configuration (defconfig) for the architecture being tested or alternatively an allmodconfig for building all possible kernel modules for the build. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed Linux Kernel Compilation 5.18Build: defconfigmitigations=auto,nosmtretbleed=offmitigations=offCurrent Linux Default4080120160200SE +/- 1.27, N = 12SE +/- 1.63, N = 12SE +/- 0.74, N = 3SE +/- 1.03, N = 3183.12148.29146.57148.02

Facebook RocksDB

This is a benchmark of Facebook's RocksDB as an embeddable persistent key-value store for fast storage based on Google's LevelDB. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgOp/s, More Is BetterFacebook RocksDB 7.0.1Test: Update Randommitigations=auto,nosmtretbleed=offmitigations=offCurrent Linux Default70K140K210K280K350KSE +/- 1064.24, N = 3SE +/- 623.13, N = 3SE +/- 827.87, N = 3SE +/- 3637.35, N = 32624983154453196143106521. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti -lpthread

Stress-NG

Stress-NG is a Linux stress tool developed by Colin King of Canonical. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.14Test: MEMFDmitigations=auto,nosmtretbleed=offmitigations=offCurrent Linux Default90180270360450SE +/- 0.18, N = 3SE +/- 3.33, N = 9SE +/- 0.41, N = 3SE +/- 4.98, N = 3341.95404.05416.29363.761. (CC) gcc options: -O2 -std=gnu99 -lm -laio -lapparmor -latomic -lc -lcrypt -ldl -lrt -lsctp -lz -pthread

Timed MPlayer Compilation

This test times how long it takes to build the MPlayer open-source media player program. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed MPlayer Compilation 1.5Time To Compilemitigations=auto,nosmtretbleed=offmitigations=offCurrent Linux Default1530456075SE +/- 0.02, N = 3SE +/- 0.05, N = 3SE +/- 0.04, N = 3SE +/- 0.02, N = 369.6057.6357.3757.78

Selenium

This test profile uses the Selenium WebDriver for running various browser benchmarks in different available web browsers such as Mozilla Firefox and Google Chrome. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgms, Fewer Is BetterSeleniumBenchmark: ARES-6 - Browser: Google Chromemitigations=auto,nosmtretbleed=offmitigations=offCurrent Linux Default612182430SE +/- 0.16, N = 3SE +/- 0.19, N = 3SE +/- 0.12, N = 3SE +/- 0.20, N = 321.9826.4926.1826.601. chrome 103.0.5060.114

Ethr

Ethr is a cross-platform Golang-written network performance measurement tool developed by Microsoft that is capable of testing multiple protocols and conducting different measurements. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgGbits/sec, More Is BetterEthr 1.0Server Address: localhost - Protocol: TCP - Test: Bandwidth - Threads: 8mitigations=auto,nosmtretbleed=offmitigations=offCurrent Linux Default20406080100SE +/- 0.00, N = 3SE +/- 0.36, N = 3SE +/- 0.26, N = 3SE +/- 0.19, N = 370.6082.5284.0381.85MIN: 68.39 / MAX: 73.38MIN: 80.98 / MAX: 84.08MIN: 82.86 / MAX: 85.53MIN: 80.15 / MAX: 83.43

SQLite Speedtest

This is a benchmark of SQLite's speedtest1 benchmark program with an increased problem size of 1,000. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterSQLite Speedtest 3.30Timed Time - Size 1,000mitigations=auto,nosmtretbleed=offmitigations=offCurrent Linux Default20406080100SE +/- 0.12, N = 3SE +/- 0.12, N = 3SE +/- 0.24, N = 3SE +/- 0.05, N = 394.3680.6879.3983.331. (CC) gcc options: -O2 -lz

Timed Godot Game Engine Compilation

This test times how long it takes to compile the Godot Game Engine. Godot is a popular, open-source, cross-platform 2D/3D game engine and is built using the SCons build system and targeting the X11 platform. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed Godot Game Engine Compilation 3.2.3Time To Compilemitigations=auto,nosmtretbleed=offmitigations=offCurrent Linux Default50100150200250SE +/- 0.19, N = 3SE +/- 0.93, N = 3SE +/- 0.03, N = 3SE +/- 0.03, N = 3221.52188.84186.62187.79

Selenium

This test profile uses the Selenium WebDriver for running various browser benchmarks in different available web browsers such as Mozilla Firefox and Google Chrome. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgScore, More Is BetterSeleniumBenchmark: Jetstream 2 - Browser: Google Chromemitigations=auto,nosmtretbleed=offmitigations=offCurrent Linux Default306090120150SE +/- 0.42, N = 3SE +/- 1.08, N = 3SE +/- 0.54, N = 3SE +/- 0.46, N = 3125.07105.47107.56105.871. chrome 103.0.5060.114

Ethr

Ethr is a cross-platform Golang-written network performance measurement tool developed by Microsoft that is capable of testing multiple protocols and conducting different measurements. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgPackets/sec, More Is BetterEthr 1.0Server Address: localhost - Protocol: UDP - Test: Bandwidth - Threads: 1mitigations=auto,nosmtretbleed=offmitigations=offCurrent Linux Default40K80K120K160K200KSE +/- 392.55, N = 3SE +/- 401.44, N = 3SE +/- 1242.43, N = 3SE +/- 1049.73, N = 3172569152157159640146881MIN: 168350 / MAX: 178780MIN: 137380 / MAX: 166300MIN: 143290 / MAX: 177560MIN: 124730 / MAX: 157680

Cryptsetup

This is a test profile for running the cryptsetup benchmark to report on the system's cryptography performance. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgMiB/s, More Is BetterCryptsetupAES-XTS 512b Encryptionmitigations=auto,nosmtretbleed=offmitigations=offCurrent Linux Default5001000150020002500SE +/- 5.88, N = 3SE +/- 9.10, N = 3SE +/- 19.45, N = 3SE +/- 12.25, N = 41982.62295.62302.82223.6

Timed Gem5 Compilation

This test times how long it takes to compile Gem5. Gem5 is a simulator for computer system architecture research. Gem5 is widely used for computer architecture research within the industry, academia, and more. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed Gem5 Compilation 21.2Time To Compilemitigations=auto,nosmtretbleed=offmitigations=offCurrent Linux Default2004006008001000SE +/- 0.45, N = 3SE +/- 0.91, N = 3SE +/- 0.39, N = 3SE +/- 1.27, N = 2789.51680.69680.22681.17

Selenium

This test profile uses the Selenium WebDriver for running various browser benchmarks in different available web browsers such as Mozilla Firefox and Google Chrome. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgms, Fewer Is BetterSeleniumBenchmark: WASM collisionDetection - Browser: Google Chromemitigations=auto,nosmtretbleed=offmitigations=offCurrent Linux Default80160240320400SE +/- 0.09, N = 3SE +/- 0.45, N = 3SE +/- 1.36, N = 3SE +/- 0.81, N = 3364.48314.70315.92322.211. chrome 103.0.5060.114

Cryptsetup

This is a test profile for running the cryptsetup benchmark to report on the system's cryptography performance. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgMiB/s, More Is BetterCryptsetupAES-XTS 256b Decryptionmitigations=auto,nosmtretbleed=offmitigations=offCurrent Linux Default6001200180024003000SE +/- 9.50, N = 3SE +/- 8.59, N = 3SE +/- 26.68, N = 3SE +/- 5.81, N = 42339.32692.02708.12612.2

OpenBenchmarking.orgMiB/s, More Is BetterCryptsetupAES-XTS 512b Decryptionmitigations=auto,nosmtretbleed=offmitigations=offCurrent Linux Default5001000150020002500SE +/- 5.67, N = 3SE +/- 9.22, N = 3SE +/- 20.34, N = 3SE +/- 9.71, N = 41980.12287.52290.62229.7

Selenium

This test profile uses the Selenium WebDriver for running various browser benchmarks in different available web browsers such as Mozilla Firefox and Google Chrome. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgScore, More Is BetterSeleniumBenchmark: Jetstream 2 - Browser: Firefoxmitigations=auto,nosmtretbleed=offmitigations=offCurrent Linux Default20406080100SE +/- 0.27, N = 3SE +/- 0.31, N = 3SE +/- 0.32, N = 3SE +/- 0.39, N = 379.1070.4070.7668.631. firefox 102.0.1

Git

This test measures the time needed to carry out some sample Git operations on an example, static repository that happens to be a copy of the GNOME GTK tool-kit repository. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterGitTime To Complete Common Git Commandsmitigations=auto,nosmtretbleed=offmitigations=offCurrent Linux Default1530456075SE +/- 0.13, N = 3SE +/- 0.08, N = 3SE +/- 0.13, N = 3SE +/- 0.53, N = 1566.4558.3958.5460.531. git version 2.34.1

Selenium

This test profile uses the Selenium WebDriver for running various browser benchmarks in different available web browsers such as Mozilla Firefox and Google Chrome. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgms, Fewer Is BetterSeleniumBenchmark: ARES-6 - Browser: Firefoxmitigations=auto,nosmtretbleed=offmitigations=offCurrent Linux Default1224364860SE +/- 0.13, N = 3SE +/- 0.34, N = 3SE +/- 0.31, N = 3SE +/- 0.11, N = 346.0852.0852.1352.371. firefox 102.0.1

GIMP

GIMP is an open-source image manipulaton program. This test profile will use the system-provided GIMP program otherwise on Windows relys upon a pre-packaged Windows binary from upstream GIMP.org. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterGIMP 2.10.30Test: resizemitigations=auto,nosmtretbleed=offmitigations=offCurrent Linux Default612182430SE +/- 0.23, N = 8SE +/- 0.19, N = 8SE +/- 0.21, N = 7SE +/- 0.21, N = 926.6023.5723.6924.90

OSBench

OSBench is a collection of micro-benchmarks for measuring operating system primitives like time to create threads/processes, launching programs, creating files, and memory allocation. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgus Per Event, Fewer Is BetterOSBenchTest: Create Threadsmitigations=auto,nosmtretbleed=offmitigations=offCurrent Linux Default612182430SE +/- 0.14, N = 3SE +/- 0.10, N = 3SE +/- 0.08, N = 3SE +/- 0.06, N = 322.8721.0920.8423.47

Ethr

Ethr is a cross-platform Golang-written network performance measurement tool developed by Microsoft that is capable of testing multiple protocols and conducting different measurements. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgGbits/sec, More Is BetterEthr 1.0Server Address: localhost - Protocol: TCP - Test: Bandwidth - Threads: 1mitigations=auto,nosmtretbleed=offmitigations=offCurrent Linux Default48121620SE +/- 0.11, N = 3SE +/- 0.20, N = 3SE +/- 0.11, N = 3SE +/- 0.13, N = 317.8416.2417.0815.89MIN: 15.78 / MAX: 19.37MIN: 12.39 / MAX: 19.49MIN: 14.52 / MAX: 20.45MIN: 12.54 / MAX: 18.57

OSBench

OSBench is a collection of micro-benchmarks for measuring operating system primitives like time to create threads/processes, launching programs, creating files, and memory allocation. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgus Per Event, Fewer Is BetterOSBenchTest: Launch Programsmitigations=auto,nosmtretbleed=offmitigations=offCurrent Linux Default1530456075SE +/- 0.25, N = 3SE +/- 0.05, N = 3SE +/- 0.03, N = 3SE +/- 0.24, N = 363.6560.6159.8567.16

OpenBenchmarking.orgus Per Event, Fewer Is BetterOSBenchTest: Create Processesmitigations=auto,nosmtretbleed=offmitigations=offCurrent Linux Default1224364860SE +/- 0.37, N = 3SE +/- 0.33, N = 3SE +/- 0.58, N = 3SE +/- 0.43, N = 351.8846.7046.7852.41

RawTherapee

RawTherapee is a cross-platform, open-source multi-threaded RAW image processing program. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterRawTherapeeTotal Benchmark Timemitigations=auto,nosmtretbleed=offmitigations=offCurrent Linux Default20406080100SE +/- 0.03, N = 3SE +/- 0.14, N = 3SE +/- 0.04, N = 3SE +/- 0.06, N = 390.8883.9881.7085.831. RawTherapee, version 5.8, command line.

Redis

Redis is an open-source in-memory data structure store, used as a database, cache, and message broker. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgRequests Per Second, More Is BetterRedis 6.0.9Test: SADDmitigations=auto,nosmtretbleed=offmitigations=offCurrent Linux Default300K600K900K1200K1500KSE +/- 14969.36, N = 3SE +/- 16694.25, N = 3SE +/- 21729.58, N = 3SE +/- 5562.99, N = 31446745.001588511.211607270.291533253.791. (CXX) g++ options: -MM -MT -g3 -fvisibility=hidden -O3

Selenium

This test profile uses the Selenium WebDriver for running various browser benchmarks in different available web browsers such as Mozilla Firefox and Google Chrome. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgms, Fewer Is BetterSeleniumBenchmark: WASM collisionDetection - Browser: Firefoxmitigations=auto,nosmtretbleed=offmitigations=offCurrent Linux Default120240360480600SE +/- 0.25, N = 3SE +/- 2.66, N = 3SE +/- 0.75, N = 3SE +/- 0.22, N = 3561.9506.2513.2512.41. firefox 102.0.1

OpenBenchmarking.orgGeometric Mean, More Is BetterSeleniumBenchmark: Octane - Browser: Firefoxmitigations=auto,nosmtretbleed=offmitigations=offCurrent Linux Default5K10K15K20K25KSE +/- 46.59, N = 3SE +/- 259.28, N = 4SE +/- 37.36, N = 3SE +/- 223.91, N = 3195122096521638210521. firefox 102.0.1

Redis

Redis is an open-source in-memory data structure store, used as a database, cache, and message broker. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgRequests Per Second, More Is BetterRedis 6.0.9Test: SETmitigations=auto,nosmtretbleed=offmitigations=offCurrent Linux Default300K600K900K1200K1500KSE +/- 12226.80, N = 5SE +/- 6226.48, N = 3SE +/- 12676.86, N = 15SE +/- 9857.69, N = 31234329.421364767.871342551.721330720.121. (CXX) g++ options: -MM -MT -g3 -fvisibility=hidden -O3

GIMP

GIMP is an open-source image manipulaton program. This test profile will use the system-provided GIMP program otherwise on Windows relys upon a pre-packaged Windows binary from upstream GIMP.org. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterGIMP 2.10.30Test: unsharp-maskmitigations=auto,nosmtretbleed=offmitigations=offCurrent Linux Default612182430SE +/- 0.03, N = 3SE +/- 0.08, N = 3SE +/- 0.04, N = 3SE +/- 0.11, N = 324.8725.4325.4727.37

OpenBenchmarking.orgSeconds, Fewer Is BetterGIMP 2.10.30Test: auto-levelsmitigations=auto,nosmtretbleed=offmitigations=offCurrent Linux Default612182430SE +/- 0.09, N = 3SE +/- 0.10, N = 3SE +/- 0.07, N = 3SE +/- 0.10, N = 322.3022.6822.6024.37

Selenium

This test profile uses the Selenium WebDriver for running various browser benchmarks in different available web browsers such as Mozilla Firefox and Google Chrome. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgRuns Per Minute, More Is BetterSeleniumBenchmark: Speedometer - Browser: Firefoxmitigations=auto,nosmtretbleed=offmitigations=offCurrent Linux Default306090120150SE +/- 0.28, N = 3SE +/- 0.33, N = 3SE +/- 0.00, N = 3SE +/- 0.33, N = 3112.3105.0104.0103.01. firefox 102.0.1

Redis

Redis is an open-source in-memory data structure store, used as a database, cache, and message broker. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgRequests Per Second, More Is BetterRedis 6.0.9Test: LPUSHmitigations=auto,nosmtretbleed=offmitigations=offCurrent Linux Default200K400K600K800K1000KSE +/- 6678.55, N = 3SE +/- 7473.68, N = 15SE +/- 8200.31, N = 3SE +/- 6713.90, N = 31027352.981115334.031119872.381103357.961. (CXX) g++ options: -MM -MT -g3 -fvisibility=hidden -O3

OSBench

OSBench is a collection of micro-benchmarks for measuring operating system primitives like time to create threads/processes, launching programs, creating files, and memory allocation. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgNs Per Event, Fewer Is BetterOSBenchTest: Memory Allocationsmitigations=auto,nosmtretbleed=offmitigations=offCurrent Linux Default20406080100SE +/- 0.62, N = 3SE +/- 0.52, N = 3SE +/- 1.17, N = 3SE +/- 0.96, N = 397.7794.6493.3798.14

Selenium

This test profile uses the Selenium WebDriver for running various browser benchmarks in different available web browsers such as Mozilla Firefox and Google Chrome. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgms, Fewer Is BetterSeleniumBenchmark: Kraken - Browser: Google Chromemitigations=auto,nosmtretbleed=offmitigations=offCurrent Linux Default2004006008001000SE +/- 7.80, N = 15SE +/- 7.03, N = 15SE +/- 3.23, N = 3SE +/- 10.50, N = 15904.5956.4921.7982.71. chrome 103.0.5060.114

OpenBenchmarking.orgGeometric Mean, More Is BetterSeleniumBenchmark: Octane - Browser: Google Chromemitigations=auto,nosmtretbleed=offmitigations=offCurrent Linux Default9K18K27K36K45KSE +/- 502.69, N = 3SE +/- 212.56, N = 3SE +/- 151.64, N = 3SE +/- 422.84, N = 3378934047340948384601. chrome 103.0.5060.114

Renaissance

Renaissance is a suite of benchmarks designed to test the Java JVM from Apache Spark to a Twitter-like service to Scala and other features. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgms, Fewer Is BetterRenaissance 0.14Test: Apache Spark PageRankmitigations=auto,nosmtretbleed=offmitigations=offCurrent Linux Default11002200330044005500SE +/- 60.12, N = 10SE +/- 59.50, N = 4SE +/- 49.99, N = 12SE +/- 70.01, N = 34584.84880.84827.64943.3MIN: 4051.39 / MAX: 4898.74MIN: 4470.3 / MAX: 5116.98MIN: 4062.79 / MAX: 5207.94MIN: 4367.94 / MAX: 5181.66

GIMP

GIMP is an open-source image manipulaton program. This test profile will use the system-provided GIMP program otherwise on Windows relys upon a pre-packaged Windows binary from upstream GIMP.org. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterGIMP 2.10.30Test: rotatemitigations=auto,nosmtretbleed=offmitigations=offCurrent Linux Default510152025SE +/- 0.08, N = 3SE +/- 0.10, N = 3SE +/- 0.03, N = 3SE +/- 0.17, N = 321.5420.9920.9422.58

Timed Mesa Compilation

This test profile times how long it takes to compile Mesa with Meson/Ninja. For minimizing build dependencies and avoid versioning conflicts, test this is just the core Mesa build without LLVM or the extra Gallium3D/Mesa drivers enabled. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed Mesa Compilation 21.0Time To Compilemitigations=auto,nosmtretbleed=offmitigations=offCurrent Linux Default20406080100SE +/- 0.05, N = 3SE +/- 0.08, N = 3SE +/- 0.03, N = 3SE +/- 0.08, N = 387.3881.7081.5681.78

Selenium

This test profile uses the Selenium WebDriver for running various browser benchmarks in different available web browsers such as Mozilla Firefox and Google Chrome. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgRuns Per Minute, More Is BetterSeleniumBenchmark: Speedometer - Browser: Google Chromemitigations=auto,nosmtretbleed=offmitigations=offCurrent Linux Default306090120150SE +/- 0.27, N = 3SE +/- 1.33, N = 3SE +/- 1.00, N = 3SE +/- 0.33, N = 3133.8127.0125.0125.01. chrome 103.0.5060.114

Stress-NG

Stress-NG is a Linux stress tool developed by Colin King of Canonical. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.14Test: IO_uringmitigations=auto,nosmtretbleed=offmitigations=offCurrent Linux Default16K32K48K64K80KSE +/- 28.07, N = 3SE +/- 328.18, N = 3SE +/- 408.31, N = 3SE +/- 578.74, N = 373808.5770498.4671748.3469877.761. (CC) gcc options: -O2 -std=gnu99 -lm -laio -lapparmor -latomic -lc -lcrypt -ldl -lrt -lsctp -lz -pthread

Timed Apache Compilation

This test times how long it takes to build the Apache HTTPD web server. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed Apache Compilation 2.4.41Time To Compilemitigations=auto,nosmtretbleed=offmitigations=offCurrent Linux Default714212835SE +/- 0.03, N = 3SE +/- 0.08, N = 3SE +/- 0.06, N = 3SE +/- 0.07, N = 331.9530.8430.7631.52

DaCapo Benchmark

This test runs the DaCapo Benchmarks written in Java and intended to test system/CPU performance. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgmsec, Fewer Is BetterDaCapo Benchmark 9.12-MR1Java Test: Jythonmitigations=auto,nosmtretbleed=offmitigations=offCurrent Linux Default14002800420056007000SE +/- 5.74, N = 4SE +/- 53.68, N = 4SE +/- 38.70, N = 16SE +/- 43.22, N = 136521631363106417

ClickHouse

ClickHouse is an open-source, high performance OLAP data management system. This test profile uses ClickHouse's standard benchmark recommendations per https://clickhouse.com/docs/en/operations/performance-test/ with the 100 million rows web analytics dataset. The reported value is the query processing time using the geometric mean of all queries performed. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgQueries Per Minute, Geo Mean, More Is BetterClickHouse100M Rows Web Analytics Dataset, Third Runretbleed=offmitigations=offCurrent Linux Default20406080100SE +/- 0.66, N = 12SE +/- 0.69, N = 12SE +/- 0.98, N = 1294.7196.9993.96MIN: 6.76 / MAX: 12000MIN: 6.98 / MAX: 15000MIN: 6.78 / MAX: 150001. ClickHouse server version 22.7.1.687 (official build).

100M Rows Web Analytics Dataset, Third Run

mitigations=auto,nosmt: The test run did not produce a result. The test run did not produce a result. The test run did not produce a result.

OpenBenchmarking.orgQueries Per Minute, Geo Mean, More Is BetterClickHouse100M Rows Web Analytics Dataset, First Run / Cold Cacheretbleed=offmitigations=offCurrent Linux Default20406080100SE +/- 0.90, N = 12SE +/- 1.08, N = 12SE +/- 0.93, N = 1278.1277.1078.38MIN: 5.73 / MAX: 12000MIN: 6.09 / MAX: 12000MIN: 5.78 / MAX: 100001. ClickHouse server version 22.7.1.687 (official build).

100M Rows Web Analytics Dataset, First Run / Cold Cache

mitigations=auto,nosmt: The test run did not produce a result. The test run did not produce a result. The test run did not produce a result.

OpenBenchmarking.orgQueries Per Minute, Geo Mean, More Is BetterClickHouse100M Rows Web Analytics Dataset, Second Runretbleed=offmitigations=offCurrent Linux Default20406080100SE +/- 0.62, N = 12SE +/- 0.99, N = 12SE +/- 0.56, N = 1294.1693.5194.47MIN: 6.71 / MAX: 15000MIN: 6.84 / MAX: 15000MIN: 6.61 / MAX: 150001. ClickHouse server version 22.7.1.687 (official build).

100M Rows Web Analytics Dataset, Second Run

mitigations=auto,nosmt: The test run did not produce a result. The test run did not produce a result. The test run did not produce a result.

Ethr

Ethr is a cross-platform Golang-written network performance measurement tool developed by Microsoft that is capable of testing multiple protocols and conducting different measurements. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgus, Fewer Is BetterEthr 1.0Server Address: localhost - Protocol: TCP - Test: Latency - Threads: 8mitigations=auto,nosmtretbleed=offmitigations=offCurrent Linux Default1020304050SE +/- 0.41, N = 15SE +/- 0.25, N = 3SE +/- 0.50, N = 3SE +/- 0.36, N = 1520.3544.0538.2943.35MIN: 13.56 / MAX: 26.8MIN: 30.85 / MAX: 53.19MIN: 28.85 / MAX: 49.31MIN: 30.99 / MAX: 54.01

LevelDB

LevelDB is a key-value storage library developed by Google that supports making use of Snappy for data compression and has other modern features. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgMicroseconds Per Op, Fewer Is BetterLevelDB 1.22Benchmark: Random Fillmitigations=auto,nosmtretbleed=offmitigations=offCurrent Linux Default306090120150SE +/- 0.84, N = 15SE +/- 0.03, N = 3SE +/- 0.40, N = 3SE +/- 0.35, N = 338.41123.75119.41125.841. (CXX) g++ options: -O3 -lsnappy -ltcmalloc

OpenBenchmarking.orgMB/s, More Is BetterLevelDB 1.22Benchmark: Random Fillmitigations=auto,nosmtretbleed=offmitigations=offCurrent Linux Default612182430SE +/- 0.51, N = 15SE +/- 0.00, N = 3SE +/- 0.06, N = 3SE +/- 0.03, N = 323.114.314.814.01. (CXX) g++ options: -O3 -lsnappy -ltcmalloc

OpenBenchmarking.orgMicroseconds Per Op, Fewer Is BetterLevelDB 1.22Benchmark: Overwritemitigations=auto,nosmtretbleed=offmitigations=offCurrent Linux Default306090120150SE +/- 1.00, N = 15SE +/- 0.25, N = 3SE +/- 0.28, N = 3SE +/- 0.20, N = 337.55123.08119.22125.441. (CXX) g++ options: -O3 -lsnappy -ltcmalloc

OpenBenchmarking.orgMB/s, More Is BetterLevelDB 1.22Benchmark: Overwritemitigations=auto,nosmtretbleed=offmitigations=offCurrent Linux Default612182430SE +/- 0.60, N = 15SE +/- 0.03, N = 3SE +/- 0.03, N = 3SE +/- 0.00, N = 323.814.414.914.11. (CXX) g++ options: -O3 -lsnappy -ltcmalloc

Stress-NG

Stress-NG is a Linux stress tool developed by Colin King of Canonical. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.14Test: Context Switchingmitigations=auto,nosmtretbleed=offmitigations=offCurrent Linux Default500K1000K1500K2000K2500KSE +/- 2020.18, N = 3SE +/- 16689.47, N = 15SE +/- 57786.46, N = 12SE +/- 6974.46, N = 31326955.212125792.852368740.142011376.271. (CC) gcc options: -O2 -std=gnu99 -lm -laio -lapparmor -latomic -lc -lcrypt -ldl -lrt -lsctp -lz -pthread

Selenium

This test profile uses the Selenium WebDriver for running various browser benchmarks in different available web browsers such as Mozilla Firefox and Google Chrome. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgms, Fewer Is BetterSeleniumBenchmark: WASM imageConvolute - Browser: Google Chromemitigations=auto,nosmtretbleed=offmitigations=offCurrent Linux Default918273645SE +/- 0.64, N = 15SE +/- 0.51, N = 15SE +/- 0.19, N = 3SE +/- 0.21, N = 340.1334.4033.1532.811. chrome 103.0.5060.114

OpenBenchmarking.orgms, Fewer Is BetterSeleniumBenchmark: WASM imageConvolute - Browser: Firefoxmitigations=auto,nosmtretbleed=offmitigations=offCurrent Linux Default816243240SE +/- 0.03, N = 3SE +/- 1.31, N = 15SE +/- 0.37, N = 3SE +/- 1.04, N = 1535.435.932.135.51. firefox 102.0.1

OpenBenchmarking.orgms, Fewer Is BetterSeleniumBenchmark: Kraken - Browser: Firefoxmitigations=auto,nosmtretbleed=offmitigations=offCurrent Linux Default30060090012001500SE +/- 10.67, N = 15SE +/- 25.14, N = 15SE +/- 4.76, N = 3SE +/- 28.56, N = 151347.41351.01222.61384.11. firefox 102.0.1

Sockperf

This is a network socket API performance benchmark developed by Mellanox. This test profile runs both the client and server on the local host for evaluating individual system performance. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgusec, Fewer Is BetterSockperf 3.7Test: Latency Ping Pongmitigations=auto,nosmtretbleed=offmitigations=offCurrent Linux Default3691215SE +/- 0.043, N = 25SE +/- 0.215, N = 20SE +/- 0.137, N = 25SE +/- 0.023, N = 56.09611.83210.84912.1251. (CXX) g++ options: --param -O3 -rdynamic

88 Results Shown

LevelDB:
  Seq Fill
  Rand Delete
  Seek Rand
Stress-NG
Ethr:
  TCP - Latency - 1
  TCP - Latency - 32
LevelDB
Stress-NG
Hackbench:
  32 - Process
  8 - Thread
  16 - Process
  16 - Thread
DaCapo Benchmark
Hackbench:
  8 - Process
  4 - Process
  4 - Thread
  1 - Thread
  2 - Thread
  2 - Process
  1 - Process
ctx_clock
Stress-NG
Ethr
TensorFlow Lite
Facebook RocksDB
Timed Linux Kernel Compilation
Stress-NG
Sockperf
Ethr
OSBench
OCRMyPDF
PostMark
KeyDB
Timed Linux Kernel Compilation
Facebook RocksDB
Stress-NG
Timed MPlayer Compilation
Selenium
Ethr
SQLite Speedtest
Timed Godot Game Engine Compilation
Selenium
Ethr
Cryptsetup
Timed Gem5 Compilation
Selenium
Cryptsetup:
  AES-XTS 256b Decryption
  AES-XTS 512b Decryption
Selenium
Git
Selenium
GIMP
OSBench
Ethr
OSBench:
  Launch Programs
  Create Processes
RawTherapee
Redis
Selenium:
  WASM collisionDetection - Firefox
  Octane - Firefox
Redis
GIMP:
  unsharp-mask
  auto-levels
Selenium
Redis
OSBench
Selenium:
  Kraken - Google Chrome
  Octane - Google Chrome
Renaissance
GIMP
Timed Mesa Compilation
Selenium
Stress-NG
Timed Apache Compilation
DaCapo Benchmark
ClickHouse:
  100M Rows Web Analytics Dataset, Third Run
  100M Rows Web Analytics Dataset, First Run / Cold Cache
  100M Rows Web Analytics Dataset, Second Run
Ethr
LevelDB:
  Rand Fill:
    Microseconds Per Op
    MB/s
  Overwrite:
    Microseconds Per Op
    MB/s
Stress-NG
Selenium:
  WASM imageConvolute - Google Chrome
  WASM imageConvolute - Firefox
  Kraken - Firefox
Sockperf