Intel Raptor Lake Mitigation Cost

Benchmarks by Michael Larabel for a future article.

HTML result view exported from: https://openbenchmarking.org/result/2211306-NE-INTELRAPT80&sgm&sor&grr.

Intel Raptor Lake Mitigation CostProcessorMotherboardChipsetMemoryDiskGraphicsAudioMonitorNetworkOSKernelDesktopDisplay ServerOpenGLVulkanCompilerFile-SystemScreen ResolutionLinux 6.1 Defaultsmitigations=offIntel Core i9-13900K @ 5.50GHz (24 Cores / 32 Threads)ASUS PRIME Z790-P WIFI (0602 BIOS)Intel Device 7a2732GB1000GB Western Digital WDS100T1X0E-00AFY0AMD Radeon RX 6800 16GB (2475/1000MHz)Realtek ALC897ASUS VP28URealtek RTL8125 2.5GbE + Intel Device 7a70Ubuntu 22.046.1.0-060100rc5daily20221117-generic (x86_64)GNOME Shell 42.5X Server 1.21.1.3 + Wayland4.6 Mesa 22.0.5 (LLVM 13.0.1 DRM 3.49)1.3.204GCC 11.3.0ext43840x2160OpenBenchmarking.orgKernel Details- Transparent Huge Pages: madviseCompiler Details- --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-bootstrap --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-link-serialization=2 --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none=/build/gcc-11-xKiWfi/gcc-11-11.3.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-11-xKiWfi/gcc-11-11.3.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-build-config=bootstrap-lto-lean --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v Processor Details- Scaling Governor: intel_pstate powersave (EPP: balance_performance) - CPU Microcode: 0x10e - Thermald 2.4.9 Java Details- OpenJDK Runtime Environment (build 11.0.17+8-post-Ubuntu-1ubuntu222.04)Python Details- Python 3.10.6Security Details- Linux 6.1 Defaults: itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Not affected - mitigations=off: itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Vulnerable + spectre_v1: Vulnerable: __user pointer sanitization and usercopy barriers only; no swapgs barriers + spectre_v2: Vulnerable IBPB: disabled STIBP: disabled PBRSB-eIBRS: Vulnerable + srbds: Not affected + tsx_async_abort: Not affected

Intel Raptor Lake Mitigation Costwebp2: Quality 100, Lossless Compressionbuild-linux-kernel: allmodconfigjava-gradle-perf: Reactorspark: 1000000 - 100 - Broadcast Inner Join Test Timespark: 1000000 - 100 - Inner Join Test Timespark: 1000000 - 100 - Repartition Test Timespark: 1000000 - 100 - Group By Test Timespark: 1000000 - 100 - Calculate Pi Benchmark Using Dataframespark: 1000000 - 100 - Calculate Pi Benchmarkspark: 1000000 - 100 - SHA-512 Benchmark Timebrl-cad: VGR Performance Metricrocksdb: Read While Writingcouchdb: 300 - 1000 - 30clickhouse: 100M Rows Web Analytics Dataset, Third Runclickhouse: 100M Rows Web Analytics Dataset, Second Runclickhouse: 100M Rows Web Analytics Dataset, First Run / Cold Cachecouchdb: 300 - 3000 - 30hbase: 1000000 - Async Rand Write - 16hbase: 1000000 - Async Rand Write - 16build-gem5: Time To Compilecouchdb: 100 - 3000 - 30pgbench: 100 - 100 - Read Only - Average Latencypgbench: 100 - 100 - Read Onlywebp2: Quality 95, Compression Effort 7stress-ng: Futexstress-ng: CPU Cacherenaissance: Akka Unbalanced Cobwebbed Treepgbench: 100 - 50 - Read Only - Average Latencypgbench: 100 - 50 - Read Onlyhbase: 1000000 - Increment - 16hbase: 1000000 - Increment - 16stress-ng: Context Switchingspark: 1000000 - 500 - Broadcast Inner Join Test Timespark: 1000000 - 500 - Repartition Test Timespark: 1000000 - 500 - Calculate Pi Benchmark Using Dataframespark: 1000000 - 500 - Calculate Pi Benchmarkkeydb: renaissance: Scala Dottyrenaissance: ALS Movie Lensnginx: 1000stress-ng: Socket Activitynginx: 500nginx: 200nginx: 100stress-ng: Atomicdeepsparse: NLP Token Classification, BERT base uncased conll2003 - Asynchronous Multi-Streamdeepsparse: NLP Token Classification, BERT base uncased conll2003 - Asynchronous Multi-Streamdeepsparse: NLP Document Classification, oBERT base uncased on IMDB - Asynchronous Multi-Streamdeepsparse: NLP Document Classification, oBERT base uncased on IMDB - Asynchronous Multi-Streamdeepsparse: NLP Text Classification, BERT base uncased SST2 - Asynchronous Multi-Streamdeepsparse: NLP Text Classification, BERT base uncased SST2 - Asynchronous Multi-Streamstress-ng: Mutexwebp2: Quality 75, Compression Effort 7avifenc: 0dragonflydb: 200 - 1:5dragonflydb: 200 - 5:1dragonflydb: 200 - 1:1dragonflydb: 50 - 5:1dragonflydb: 50 - 1:5dragonflydb: 50 - 1:1stargate: 192000 - 512mysqlslap: 32openvino: Person Detection FP16 - CPUopenvino: Person Detection FP16 - CPUopenvino: Person Detection FP32 - CPUopenvino: Person Detection FP32 - CPUopenvino: Face Detection FP16 - CPUopenvino: Face Detection FP16 - CPUinfluxdb: 4 - 10000 - 2,5000,1 - 10000aom-av1: Speed 4 Two-Pass - Bosphorus 4Krenaissance: Apache Spark PageRankrenaissance: Genetic Algorithm Using Jenetics + Futuresopenvino: Machine Translation EN To DE FP16 - CPUopenvino: Machine Translation EN To DE FP16 - CPUopenvino: Face Detection FP16-INT8 - CPUopenvino: Face Detection FP16-INT8 - CPUrocksdb: Rand Fill Syncopenvino: Person Vehicle Bike Detection FP16 - CPUopenvino: Person Vehicle Bike Detection FP16 - CPUopenvino: Weld Porosity Detection FP16 - CPUopenvino: Weld Porosity Detection FP16 - CPUopenvino: Vehicle Detection FP16 - CPUopenvino: Vehicle Detection FP16 - CPUopenvino: Vehicle Detection FP16-INT8 - CPUopenvino: Vehicle Detection FP16-INT8 - CPUopenvino: Age Gender Recognition Retail 0013 FP16-INT8 - CPUopenvino: Age Gender Recognition Retail 0013 FP16-INT8 - CPUopenvino: Weld Porosity Detection FP16-INT8 - CPUopenvino: Weld Porosity Detection FP16-INT8 - CPUopenvino: Age Gender Recognition Retail 0013 FP16 - CPUopenvino: Age Gender Recognition Retail 0013 FP16 - CPUrocksdb: Rand Fillrocksdb: Update Randrocksdb: Read Rand Write Randrocksdb: Rand Readstargate: 192000 - 1024hbase: 1000000 - Rand Read - 16hbase: 1000000 - Rand Read - 16renaissance: Savina Reactors.IOcouchdb: 100 - 1000 - 30renaissance: Apache Spark ALSsvt-av1: Preset 4 - Bosphorus 4Kaom-av1: Speed 0 Two-Pass - Bosphorus 4Kdeepsparse: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Asynchronous Multi-Streamdeepsparse: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Asynchronous Multi-Streamdeepsparse: NLP Text Classification, DistilBERT mnli - Asynchronous Multi-Streamdeepsparse: NLP Text Classification, DistilBERT mnli - Asynchronous Multi-Streaminfluxdb: 64 - 10000 - 2,5000,1 - 10000hbase: 1000000 - Rand Read - 1hbase: 1000000 - Rand Read - 1deepsparse: CV Detection,YOLOv5s COCO - Asynchronous Multi-Streamdeepsparse: CV Detection,YOLOv5s COCO - Asynchronous Multi-Streamcryptsetup: Twofish-XTS 512b Decryptioncryptsetup: Twofish-XTS 512b Encryptioncryptsetup: Serpent-XTS 512b Decryptioncryptsetup: Serpent-XTS 512b Encryptioncryptsetup: AES-XTS 512b Decryptioncryptsetup: AES-XTS 512b Encryptioncryptsetup: Twofish-XTS 256b Decryptioncryptsetup: Twofish-XTS 256b Encryptioncryptsetup: Serpent-XTS 256b Decryptioncryptsetup: Serpent-XTS 256b Encryptioncryptsetup: AES-XTS 256b Decryptioncryptsetup: AES-XTS 256b Encryptioncryptsetup: PBKDF2-whirlpoolcryptsetup: PBKDF2-sha512deepsparse: CV Classification, ResNet-50 ImageNet - Asynchronous Multi-Streamdeepsparse: CV Classification, ResNet-50 ImageNet - Asynchronous Multi-Streamaom-av1: Speed 6 Two-Pass - Bosphorus 4Kastcenc: Exhaustivebuild-linux-kernel: defconfigstress-ng: SENDFILErenaissance: In-Memory Database Shootoutavifenc: 2rawtherapee: Total Benchmark Timesqlite-speedtest: Timed Time - Size 1,000stress-ng: x86_64 RdRandaircrack-ng: stress-ng: System V Message Passingstress-ng: Semaphoresstress-ng: Glibc C String Functionsstress-ng: NUMAstress-ng: Mallocstress-ng: Cryptostress-ng: Memory Copyingstress-ng: Forkingstress-ng: Vector Mathstress-ng: Matrix Mathstress-ng: MMAPstress-ng: CPU Stressstress-ng: IO_uringstress-ng: Glibc Qsort Data Sortingsrsran: 4G PHY_DL_Test 100 PRB MIMO 256-QAMsrsran: 4G PHY_DL_Test 100 PRB MIMO 256-QAMdacapobench: H2webp: Quality 100, Lossless, Highest Compressionrenaissance: Finagle HTTP Requestssrsran: 4G PHY_DL_Test 100 PRB MIMO 64-QAMsrsran: 4G PHY_DL_Test 100 PRB MIMO 64-QAMrenaissance: Apache Spark Bayessrsran: OFDM_Testrocksdb: Seq Filldacapobench: Tradesoaprenaissance: Rand Forestastcenc: Thoroughsvt-av1: Preset 8 - Bosphorus 4Kaom-av1: Speed 6 Realtime - Bosphorus 4Ksrsran: 4G PHY_DL_Test 100 PRB SISO 64-QAMsrsran: 4G PHY_DL_Test 100 PRB SISO 64-QAMsrsran: 5G PHY_DL_NR Test 52 PRB SISO 64-QAMsrsran: 5G PHY_DL_NR Test 52 PRB SISO 64-QAMastcenc: Fastsrsran: 4G PHY_DL_Test 100 PRB SISO 256-QAMsrsran: 4G PHY_DL_Test 100 PRB SISO 256-QAMwebp: Quality 100, Losslessaom-av1: Speed 8 Realtime - Bosphorus 4Kavifenc: 6, Losslesswebp2: Quality 100, Compression Effort 5aom-av1: Speed 9 Realtime - Bosphorus 4Kaom-av1: Speed 10 Realtime - Bosphorus 4Kdacapobench: Tradebeansastcenc: Mediumdacapobench: Jythonavifenc: 10, Losslessosbench: Create Filesosbench: Memory Allocationsosbench: Create Processesosbench: Launch Programsosbench: Create Threadsbork: File Encryption Timewebp: Quality 100, Highest Compressionsvt-av1: Preset 10 - Bosphorus 4Kavifenc: 6svt-av1: Preset 12 - Bosphorus 4Kwebp2: Defaultwebp: Quality 100ctx-clock: Context Switch Timewebp: DefaultLinux 6.1 Defaultsmitigations=off0.04410.703141.7220.820.931.052.553.3451.211.99462945508988794.253309.00303.65300.04287.56720278783174.640168.6610.08112306880.163515710.9197.767188.40.040126088512612520811794492.430.791.083.3851.291507777.21451.44371.9187512.5425195.77203178.40211451.29207280.77338549.56947.673912.5083948.177612.5442220.946454.164616677300.350.3370.3447029354.716440950.326696607.286159328.586742394.016335702.642.63559033042212.513.592223.373.581556.545.132696816.312.091900.61033.2125.0063.95437.5018.263892710.58755.3650.57473.8121.45372.548.70919.040.7233202.8814.411664.641.6314690.90135611777001736411551774808533.033533542911174188.353.8491592.73.0590.42236.763150.5335112.7703106.26592980179.43825419158.056875.6443704.2699.61043.41011.76503.16523.5704.6698.41043.61009.07108.87107.71334634283910977.1868155.273221.701.451635.652610692.101921.434.25731.60631.30782763.6969682.14332462582.173517936.223741573.78688.8032335069.7642801.847302.74132107.51134428.58102476.69664.9551499.1527773.35414.37202.0706.421110.931992.9181.5643.2701.819983333315024311642380.016.240276.34544.19229.1646.2104.3227.5345.1054245.1713.62.3465.785.5899.1183.6084.711709126.146917093.4248.31267142.12697417.20269523.9928569.1163324.8455.18146.0923.299216.78314.9216.6912425.880.04410.342141.4210.760.871.072.553.3851.251.99463365493058190.812304.77306.76299.11287.31020079629174.410167.4740.08112382650.163421101.2899.427359.20.040126865712412826416210513.970.781.073.4051.421518638.23414.34371.5187868.7326073.14202777.49211212.37207784.83331842.59952.751412.4503937.654012.6734223.813553.485617479306.270.3370.0357029304.56436491.376650409.606243118.046765462.426423833.882.62922533302209.763.602236.033.561557.365.132680364.812.051877.81051.3125.1063.87438.1118.243860710.68748.0650.67472.8121.56370.548.74914.620.7233193.1114.511653.361.6314683.75136726776455836246441775031223.046716522997084159.155.0171561.13.0440.41237.438250.3007113.4271105.73462976169.83627660158.912375.1975704.1699.81043.11010.46490.66508.0704.3698.51042.71008.97083.97078.41336901284038777.1962155.323821.681.461235.688602354.791968.234.10731.17831.38582746.8769948.18732855914.633519548.923778821.91679.6632341790.8542952.327275.14133593.49134263.01101602.63649.5951447.4827589.43411.91201.8712.121370.941963.9180.4639.1697.820060000014946101656378.816.063677.34444.71224.3631.3103.1225.8344.7621245.5713.62.3466.495.4539.4685.9186.621719126.261317153.3268.23969840.82862517.47051923.8871579.1067954.8175.18147.8503.242217.73415.1716.6412825.82OpenBenchmarking.org

WebP2 Image Encode

Encode Settings: Quality 100, Lossless Compression

OpenBenchmarking.orgMP/s, More Is BetterWebP2 Image Encode 20220823Encode Settings: Quality 100, Lossless Compressionmitigations=offLinux 6.1 Defaults0.0090.0180.0270.0360.045SE +/- 0.00, N = 3SE +/- 0.00, N = 30.040.041. (CXX) g++ options: -msse4.2 -fno-rtti -O3 -ldl

Timed Linux Kernel Compilation

Build: allmodconfig

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed Linux Kernel Compilation 5.18Build: allmodconfigmitigations=offLinux 6.1 Defaults90180270360450SE +/- 0.35, N = 3SE +/- 0.44, N = 3410.34410.70

Java Gradle Build

Gradle Build: Reactor

OpenBenchmarking.orgSeconds, Fewer Is BetterJava Gradle BuildGradle Build: Reactormitigations=offLinux 6.1 Defaults306090120150SE +/- 1.41, N = 12SE +/- 1.24, N = 3141.42141.72

Apache Spark

Row Count: 1000000 - Partitions: 100 - Broadcast Inner Join Test Time

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 1000000 - Partitions: 100 - Broadcast Inner Join Test Timemitigations=offLinux 6.1 Defaults0.18450.3690.55350.7380.9225SE +/- 0.01, N = 15SE +/- 0.02, N = 150.760.82

Apache Spark

Row Count: 1000000 - Partitions: 100 - Inner Join Test Time

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 1000000 - Partitions: 100 - Inner Join Test Timemitigations=offLinux 6.1 Defaults0.20930.41860.62790.83721.0465SE +/- 0.01, N = 15SE +/- 0.02, N = 150.870.93

Apache Spark

Row Count: 1000000 - Partitions: 100 - Repartition Test Time

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 1000000 - Partitions: 100 - Repartition Test TimeLinux 6.1 Defaultsmitigations=off0.24080.48160.72240.96321.204SE +/- 0.01, N = 15SE +/- 0.01, N = 151.051.07

Apache Spark

Row Count: 1000000 - Partitions: 100 - Group By Test Time

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 1000000 - Partitions: 100 - Group By Test TimeLinux 6.1 Defaultsmitigations=off0.57381.14761.72142.29522.869SE +/- 0.02, N = 15SE +/- 0.01, N = 152.552.55

Apache Spark

Row Count: 1000000 - Partitions: 100 - Calculate Pi Benchmark Using Dataframe

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 1000000 - Partitions: 100 - Calculate Pi Benchmark Using DataframeLinux 6.1 Defaultsmitigations=off0.76051.5212.28153.0423.8025SE +/- 0.05, N = 15SE +/- 0.04, N = 153.343.38

Apache Spark

Row Count: 1000000 - Partitions: 100 - Calculate Pi Benchmark

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 1000000 - Partitions: 100 - Calculate Pi BenchmarkLinux 6.1 Defaultsmitigations=off1224364860SE +/- 0.07, N = 15SE +/- 0.08, N = 1551.2151.25

Apache Spark

Row Count: 1000000 - Partitions: 100 - SHA-512 Benchmark Time

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 1000000 - Partitions: 100 - SHA-512 Benchmark TimeLinux 6.1 Defaultsmitigations=off0.44780.89561.34341.79122.239SE +/- 0.02, N = 15SE +/- 0.02, N = 151.991.99

BRL-CAD

VGR Performance Metric

OpenBenchmarking.orgVGR Performance Metric, More Is BetterBRL-CAD 7.32.6VGR Performance Metricmitigations=offLinux 6.1 Defaults100K200K300K400K500K4633654629451. (CXX) g++ options: -std=c++11 -pipe -fvisibility=hidden -fno-strict-aliasing -fno-common -fexceptions -ftemplate-depth-128 -m64 -ggdb3 -O3 -fipa-pta -fstrength-reduce -finline-functions -flto -pedantic -ldl -lm

Facebook RocksDB

Test: Read While Writing

OpenBenchmarking.orgOp/s, More Is BetterFacebook RocksDB 7.5.3Test: Read While WritingLinux 6.1 Defaultsmitigations=off1.1M2.2M3.3M4.4M5.5MSE +/- 97089.51, N = 15SE +/- 97717.39, N = 15508988749305811. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti -lpthread

Apache CouchDB

Bulk Size: 300 - Inserts: 1000 - Rounds: 30

OpenBenchmarking.orgSeconds, Fewer Is BetterApache CouchDB 3.2.2Bulk Size: 300 - Inserts: 1000 - Rounds: 30mitigations=offLinux 6.1 Defaults20406080100SE +/- 0.99, N = 4SE +/- 1.45, N = 1590.8194.251. (CXX) g++ options: -std=c++17 -lmozjs-91 -lm -lei -fPIC -MMD

ClickHouse

100M Rows Web Analytics Dataset, Third Run

OpenBenchmarking.orgQueries Per Minute, Geo Mean, More Is BetterClickHouse 22.5.4.19100M Rows Web Analytics Dataset, Third RunLinux 6.1 Defaultsmitigations=off70140210280350SE +/- 1.24, N = 15SE +/- 2.73, N = 15309.00304.77MIN: 24.35 / MAX: 30000MIN: 23.27 / MAX: 300001. ClickHouse server version 22.5.4.19 (official build).

ClickHouse

100M Rows Web Analytics Dataset, Second Run

OpenBenchmarking.orgQueries Per Minute, Geo Mean, More Is BetterClickHouse 22.5.4.19100M Rows Web Analytics Dataset, Second Runmitigations=offLinux 6.1 Defaults70140210280350SE +/- 1.81, N = 15SE +/- 2.35, N = 15306.76303.65MIN: 24.29 / MAX: 30000MIN: 24.32 / MAX: 300001. ClickHouse server version 22.5.4.19 (official build).

ClickHouse

100M Rows Web Analytics Dataset, First Run / Cold Cache

OpenBenchmarking.orgQueries Per Minute, Geo Mean, More Is BetterClickHouse 22.5.4.19100M Rows Web Analytics Dataset, First Run / Cold CacheLinux 6.1 Defaultsmitigations=off70140210280350SE +/- 1.97, N = 15SE +/- 2.21, N = 15300.04299.11MIN: 23.58 / MAX: 30000MIN: 23.78 / MAX: 300001. ClickHouse server version 22.5.4.19 (official build).

Apache CouchDB

Bulk Size: 300 - Inserts: 3000 - Rounds: 30

OpenBenchmarking.orgSeconds, Fewer Is BetterApache CouchDB 3.2.2Bulk Size: 300 - Inserts: 3000 - Rounds: 30mitigations=offLinux 6.1 Defaults60120180240300SE +/- 0.88, N = 3SE +/- 2.18, N = 3287.31287.571. (CXX) g++ options: -std=c++17 -lmozjs-91 -lm -lei -fPIC -MMD

Apache HBase

Rows: 1000000 - Test: Async Random Write - Clients: 16

OpenBenchmarking.orgMicroseconds - Average Latency, Fewer Is BetterApache HBase 2.5.0Rows: 1000000 - Test: Async Random Write - Clients: 16mitigations=offLinux 6.1 Defaults4080120160200SE +/- 2.08, N = 3SE +/- 2.67, N = 3200202

Apache HBase

Rows: 1000000 - Test: Async Random Write - Clients: 16

OpenBenchmarking.orgRows Per Second, More Is BetterApache HBase 2.5.0Rows: 1000000 - Test: Async Random Write - Clients: 16mitigations=offLinux 6.1 Defaults20K40K60K80K100KSE +/- 824.47, N = 3SE +/- 1004.83, N = 37962978783

Timed Gem5 Compilation

Time To Compile

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed Gem5 Compilation 21.2Time To Compilemitigations=offLinux 6.1 Defaults4080120160200SE +/- 0.76, N = 3SE +/- 0.24, N = 3174.41174.64

Apache CouchDB

Bulk Size: 100 - Inserts: 3000 - Rounds: 30

OpenBenchmarking.orgSeconds, Fewer Is BetterApache CouchDB 3.2.2Bulk Size: 100 - Inserts: 3000 - Rounds: 30mitigations=offLinux 6.1 Defaults4080120160200SE +/- 0.35, N = 3SE +/- 0.13, N = 3167.47168.661. (CXX) g++ options: -std=c++17 -lmozjs-91 -lm -lei -fPIC -MMD

PostgreSQL

Scaling Factor: 100 - Clients: 100 - Mode: Read Only - Average Latency

OpenBenchmarking.orgms, Fewer Is BetterPostgreSQL 15Scaling Factor: 100 - Clients: 100 - Mode: Read Only - Average LatencyLinux 6.1 Defaultsmitigations=off0.01820.03640.05460.07280.091SE +/- 0.000, N = 3SE +/- 0.001, N = 40.0810.0811. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm

PostgreSQL

Scaling Factor: 100 - Clients: 100 - Mode: Read Only

OpenBenchmarking.orgTPS, More Is BetterPostgreSQL 15Scaling Factor: 100 - Clients: 100 - Mode: Read Onlymitigations=offLinux 6.1 Defaults300K600K900K1200K1500KSE +/- 13433.82, N = 4SE +/- 3039.24, N = 3123826512306881. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm

WebP2 Image Encode

Encode Settings: Quality 95, Compression Effort 7

OpenBenchmarking.orgMP/s, More Is BetterWebP2 Image Encode 20220823Encode Settings: Quality 95, Compression Effort 7mitigations=offLinux 6.1 Defaults0.0360.0720.1080.1440.18SE +/- 0.00, N = 3SE +/- 0.00, N = 30.160.161. (CXX) g++ options: -msse4.2 -fno-rtti -O3 -ldl

Stress-NG

Test: Futex

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.14.06Test: FutexLinux 6.1 Defaultsmitigations=off800K1600K2400K3200K4000KSE +/- 41459.49, N = 15SE +/- 41423.32, N = 153515710.913421101.281. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -lapparmor -latomic -lc -lcrypt -ldl -ljpeg -lrt -lsctp -lz -pthread

Stress-NG

Test: CPU Cache

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.14.06Test: CPU Cachemitigations=offLinux 6.1 Defaults20406080100SE +/- 1.99, N = 15SE +/- 1.56, N = 1599.4297.761. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -lapparmor -latomic -lc -lcrypt -ldl -ljpeg -lrt -lsctp -lz -pthread

Renaissance

Test: Akka Unbalanced Cobwebbed Tree

OpenBenchmarking.orgms, Fewer Is BetterRenaissance 0.14Test: Akka Unbalanced Cobwebbed TreeLinux 6.1 Defaultsmitigations=off16003200480064008000SE +/- 19.11, N = 3SE +/- 34.79, N = 37188.47359.2MIN: 5401.58 / MAX: 7219.72MIN: 5648.82 / MAX: 7428.65

PostgreSQL

Scaling Factor: 100 - Clients: 50 - Mode: Read Only - Average Latency

OpenBenchmarking.orgms, Fewer Is BetterPostgreSQL 15Scaling Factor: 100 - Clients: 50 - Mode: Read Only - Average LatencyLinux 6.1 Defaultsmitigations=off0.0090.0180.0270.0360.045SE +/- 0.000, N = 3SE +/- 0.000, N = 30.0400.0401. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm

PostgreSQL

Scaling Factor: 100 - Clients: 50 - Mode: Read Only

OpenBenchmarking.orgTPS, More Is BetterPostgreSQL 15Scaling Factor: 100 - Clients: 50 - Mode: Read Onlymitigations=offLinux 6.1 Defaults300K600K900K1200K1500KSE +/- 6479.50, N = 3SE +/- 10486.93, N = 3126865712608851. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm

Apache HBase

Rows: 1000000 - Test: Increment - Clients: 16

OpenBenchmarking.orgMicroseconds - Average Latency, Fewer Is BetterApache HBase 2.5.0Rows: 1000000 - Test: Increment - Clients: 16mitigations=offLinux 6.1 Defaults306090120150SE +/- 1.67, N = 3SE +/- 1.33, N = 3124126

Apache HBase

Rows: 1000000 - Test: Increment - Clients: 16

OpenBenchmarking.orgRows Per Second, More Is BetterApache HBase 2.5.0Rows: 1000000 - Test: Increment - Clients: 16mitigations=offLinux 6.1 Defaults30K60K90K120K150KSE +/- 1763.01, N = 3SE +/- 1182.66, N = 3128264125208

Stress-NG

Test: Context Switching

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.14.06Test: Context Switchingmitigations=offLinux 6.1 Defaults3M6M9M12M15MSE +/- 538579.50, N = 12SE +/- 457851.80, N = 1216210513.9711794492.431. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -lapparmor -latomic -lc -lcrypt -ldl -ljpeg -lrt -lsctp -lz -pthread

Apache Spark

Row Count: 1000000 - Partitions: 500 - Broadcast Inner Join Test Time

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 1000000 - Partitions: 500 - Broadcast Inner Join Test Timemitigations=offLinux 6.1 Defaults0.17780.35560.53340.71120.889SE +/- 0.02, N = 7SE +/- 0.03, N = 30.780.79

Apache Spark

Row Count: 1000000 - Partitions: 500 - Repartition Test Time

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 1000000 - Partitions: 500 - Repartition Test Timemitigations=offLinux 6.1 Defaults0.2430.4860.7290.9721.215SE +/- 0.01, N = 7SE +/- 0.03, N = 31.071.08

Apache Spark

Row Count: 1000000 - Partitions: 500 - Calculate Pi Benchmark Using Dataframe

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 1000000 - Partitions: 500 - Calculate Pi Benchmark Using DataframeLinux 6.1 Defaultsmitigations=off0.7651.532.2953.063.825SE +/- 0.10, N = 3SE +/- 0.06, N = 73.383.40

Apache Spark

Row Count: 1000000 - Partitions: 500 - Calculate Pi Benchmark

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 1000000 - Partitions: 500 - Calculate Pi BenchmarkLinux 6.1 Defaultsmitigations=off1224364860SE +/- 0.24, N = 3SE +/- 0.11, N = 751.2951.42

KeyDB

OpenBenchmarking.orgOps/sec, More Is BetterKeyDB 6.2.0mitigations=offLinux 6.1 Defaults300K600K900K1200K1500KSE +/- 3433.04, N = 3SE +/- 3644.79, N = 31518638.231507777.211. (CXX) g++ options: -O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre

Renaissance

Test: Scala Dotty

OpenBenchmarking.orgms, Fewer Is BetterRenaissance 0.14Test: Scala Dottymitigations=offLinux 6.1 Defaults100200300400500SE +/- 0.49, N = 3SE +/- 6.25, N = 15414.3451.4MIN: 348.11 / MAX: 744.04MIN: 343.36 / MAX: 782.31

Renaissance

Test: ALS Movie Lens

OpenBenchmarking.orgms, Fewer Is BetterRenaissance 0.14Test: ALS Movie Lensmitigations=offLinux 6.1 Defaults9001800270036004500SE +/- 22.27, N = 3SE +/- 32.41, N = 34371.54371.9MIN: 4345.9 / MAX: 4750.01MIN: 4308.11 / MAX: 4860.44

nginx

Connections: 1000

OpenBenchmarking.orgRequests Per Second, More Is Betternginx 1.23.2Connections: 1000mitigations=offLinux 6.1 Defaults40K80K120K160K200KSE +/- 586.42, N = 3SE +/- 221.20, N = 3187868.73187512.541. (CC) gcc options: -lluajit-5.1 -lm -lssl -lcrypto -lpthread -ldl -std=c99 -O2

Stress-NG

Test: Socket Activity

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.14.06Test: Socket Activitymitigations=offLinux 6.1 Defaults6K12K18K24K30KSE +/- 323.81, N = 15SE +/- 197.02, N = 326073.1425195.771. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -lapparmor -latomic -lc -lcrypt -ldl -ljpeg -lrt -lsctp -lz -pthread

nginx

Connections: 500

OpenBenchmarking.orgRequests Per Second, More Is Betternginx 1.23.2Connections: 500Linux 6.1 Defaultsmitigations=off40K80K120K160K200KSE +/- 845.21, N = 3SE +/- 812.38, N = 3203178.40202777.491. (CC) gcc options: -lluajit-5.1 -lm -lssl -lcrypto -lpthread -ldl -std=c99 -O2

nginx

Connections: 200

OpenBenchmarking.orgRequests Per Second, More Is Betternginx 1.23.2Connections: 200Linux 6.1 Defaultsmitigations=off50K100K150K200K250KSE +/- 806.08, N = 3SE +/- 702.24, N = 3211451.29211212.371. (CC) gcc options: -lluajit-5.1 -lm -lssl -lcrypto -lpthread -ldl -std=c99 -O2

nginx

Connections: 100

OpenBenchmarking.orgRequests Per Second, More Is Betternginx 1.23.2Connections: 100mitigations=offLinux 6.1 Defaults40K80K120K160K200KSE +/- 1384.83, N = 3SE +/- 1157.09, N = 3207784.83207280.771. (CC) gcc options: -lluajit-5.1 -lm -lssl -lcrypto -lpthread -ldl -std=c99 -O2

Stress-NG

Test: Atomic

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.14.06Test: AtomicLinux 6.1 Defaultsmitigations=off70K140K210K280K350KSE +/- 7379.51, N = 15SE +/- 2320.39, N = 3338549.56331842.591. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -lapparmor -latomic -lc -lcrypt -ldl -ljpeg -lrt -lsctp -lz -pthread

Neural Magic DeepSparse

Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-StreamLinux 6.1 Defaultsmitigations=off2004006008001000SE +/- 3.70, N = 3SE +/- 1.94, N = 3947.67952.75

Neural Magic DeepSparse

Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-StreamLinux 6.1 Defaultsmitigations=off3691215SE +/- 0.05, N = 3SE +/- 0.04, N = 312.5112.45

Neural Magic DeepSparse

Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Streammitigations=offLinux 6.1 Defaults2004006008001000SE +/- 1.73, N = 3SE +/- 3.52, N = 3937.65948.18

Neural Magic DeepSparse

Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Streammitigations=offLinux 6.1 Defaults3691215SE +/- 0.02, N = 3SE +/- 0.05, N = 312.6712.54

Neural Magic DeepSparse

Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-StreamLinux 6.1 Defaultsmitigations=off50100150200250SE +/- 0.42, N = 3SE +/- 0.57, N = 3220.95223.81

Neural Magic DeepSparse

Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-StreamLinux 6.1 Defaultsmitigations=off1224364860SE +/- 0.10, N = 3SE +/- 0.13, N = 354.1653.49

Stress-NG

Test: Mutex

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.14.06Test: Mutexmitigations=offLinux 6.1 Defaults4M8M12M16M20MSE +/- 153223.16, N = 3SE +/- 368734.03, N = 1217479306.2716677300.351. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -lapparmor -latomic -lc -lcrypt -ldl -ljpeg -lrt -lsctp -lz -pthread

WebP2 Image Encode

Encode Settings: Quality 75, Compression Effort 7

OpenBenchmarking.orgMP/s, More Is BetterWebP2 Image Encode 20220823Encode Settings: Quality 75, Compression Effort 7mitigations=offLinux 6.1 Defaults0.07430.14860.22290.29720.3715SE +/- 0.00, N = 3SE +/- 0.00, N = 30.330.331. (CXX) g++ options: -msse4.2 -fno-rtti -O3 -ldl

libavif avifenc

Encoder Speed: 0

OpenBenchmarking.orgSeconds, Fewer Is Betterlibavif avifenc 0.11Encoder Speed: 0mitigations=offLinux 6.1 Defaults1632486480SE +/- 0.18, N = 3SE +/- 0.12, N = 370.0470.341. (CXX) g++ options: -O3 -fPIC -lm

Dragonflydb

Clients: 200 - Set To Get Ratio: 1:5

OpenBenchmarking.orgOps/sec, More Is BetterDragonflydb 0.6Clients: 200 - Set To Get Ratio: 1:5Linux 6.1 Defaultsmitigations=off1.5M3M4.5M6M7.5MSE +/- 41132.46, N = 3SE +/- 33271.78, N = 37029354.717029304.501. (CXX) g++ options: -O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre

Dragonflydb

Clients: 200 - Set To Get Ratio: 5:1

OpenBenchmarking.orgOps/sec, More Is BetterDragonflydb 0.6Clients: 200 - Set To Get Ratio: 5:1Linux 6.1 Defaultsmitigations=off1.4M2.8M4.2M5.6M7MSE +/- 19398.36, N = 3SE +/- 46202.73, N = 36440950.326436491.371. (CXX) g++ options: -O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre

Dragonflydb

Clients: 200 - Set To Get Ratio: 1:1

OpenBenchmarking.orgOps/sec, More Is BetterDragonflydb 0.6Clients: 200 - Set To Get Ratio: 1:1Linux 6.1 Defaultsmitigations=off1.4M2.8M4.2M5.6M7MSE +/- 42144.49, N = 3SE +/- 49539.07, N = 36696607.286650409.601. (CXX) g++ options: -O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre

Dragonflydb

Clients: 50 - Set To Get Ratio: 5:1

OpenBenchmarking.orgOps/sec, More Is BetterDragonflydb 0.6Clients: 50 - Set To Get Ratio: 5:1mitigations=offLinux 6.1 Defaults1.3M2.6M3.9M5.2M6.5MSE +/- 5261.63, N = 3SE +/- 22475.30, N = 36243118.046159328.581. (CXX) g++ options: -O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre

Dragonflydb

Clients: 50 - Set To Get Ratio: 1:5

OpenBenchmarking.orgOps/sec, More Is BetterDragonflydb 0.6Clients: 50 - Set To Get Ratio: 1:5mitigations=offLinux 6.1 Defaults1.4M2.8M4.2M5.6M7MSE +/- 31744.79, N = 3SE +/- 16253.11, N = 36765462.426742394.011. (CXX) g++ options: -O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre

Dragonflydb

Clients: 50 - Set To Get Ratio: 1:1

OpenBenchmarking.orgOps/sec, More Is BetterDragonflydb 0.6Clients: 50 - Set To Get Ratio: 1:1mitigations=offLinux 6.1 Defaults1.4M2.8M4.2M5.6M7MSE +/- 36510.22, N = 3SE +/- 54773.05, N = 36423833.886335702.641. (CXX) g++ options: -O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre

Stargate Digital Audio Workstation

Sample Rate: 192000 - Buffer Size: 512

OpenBenchmarking.orgRender Ratio, More Is BetterStargate Digital Audio Workstation 22.11.5Sample Rate: 192000 - Buffer Size: 512Linux 6.1 Defaultsmitigations=off0.5931.1861.7792.3722.965SE +/- 0.005802, N = 3SE +/- 0.006256, N = 32.6355902.6292251. (CXX) g++ options: -lpthread -lsndfile -lm -O3 -march=native -ffast-math -funroll-loops -fstrength-reduce -fstrict-aliasing -finline-functions

MariaDB

Clients: 32

OpenBenchmarking.orgQueries Per Second, More Is BetterMariaDB 10.8.2Clients: 32mitigations=offLinux 6.1 Defaults7001400210028003500SE +/- 9.76, N = 3SE +/- 28.86, N = 3333033041. (CXX) g++ options: -pie -fPIC -fstack-protector -O3 -lnuma -lpcre2-8 -lcrypt -lz -lm -lssl -lcrypto -lpthread -ldl

OpenVINO

Model: Person Detection FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.2.devModel: Person Detection FP16 - Device: CPUmitigations=offLinux 6.1 Defaults5001000150020002500SE +/- 2.24, N = 3SE +/- 1.23, N = 32209.762212.51MIN: 1693.41 / MAX: 2903.99MIN: 1666.75 / MAX: 2938.51. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -flto -shared

OpenVINO

Model: Person Detection FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.2.devModel: Person Detection FP16 - Device: CPUmitigations=offLinux 6.1 Defaults0.811.622.433.244.05SE +/- 0.00, N = 3SE +/- 0.00, N = 33.603.591. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -flto -shared

OpenVINO

Model: Person Detection FP32 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.2.devModel: Person Detection FP32 - Device: CPULinux 6.1 Defaultsmitigations=off5001000150020002500SE +/- 4.82, N = 3SE +/- 6.69, N = 32223.372236.03MIN: 1691.82 / MAX: 2995.51MIN: 1702.71 / MAX: 3129.631. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -flto -shared

OpenVINO

Model: Person Detection FP32 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.2.devModel: Person Detection FP32 - Device: CPULinux 6.1 Defaultsmitigations=off0.80551.6112.41653.2224.0275SE +/- 0.00, N = 3SE +/- 0.01, N = 33.583.561. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -flto -shared

OpenVINO

Model: Face Detection FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.2.devModel: Face Detection FP16 - Device: CPULinux 6.1 Defaultsmitigations=off30060090012001500SE +/- 8.27, N = 3SE +/- 9.54, N = 31556.541557.36MIN: 1401.44 / MAX: 1905.83MIN: 1398.63 / MAX: 1895.621. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -flto -shared

OpenVINO

Model: Face Detection FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.2.devModel: Face Detection FP16 - Device: CPUmitigations=offLinux 6.1 Defaults1.15432.30863.46294.61725.7715SE +/- 0.03, N = 3SE +/- 0.03, N = 35.135.131. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -flto -shared

InfluxDB

Concurrent Streams: 4 - Batch Size: 10000 - Tags: 2,5000,1 - Points Per Series: 10000

OpenBenchmarking.orgval/sec, More Is BetterInfluxDB 1.8.2Concurrent Streams: 4 - Batch Size: 10000 - Tags: 2,5000,1 - Points Per Series: 10000Linux 6.1 Defaultsmitigations=off600K1200K1800K2400K3000KSE +/- 11434.48, N = 3SE +/- 26949.91, N = 62696816.32680364.8

AOM AV1

Encoder Mode: Speed 4 Two-Pass - Input: Bosphorus 4K

OpenBenchmarking.orgFrames Per Second, More Is BetterAOM AV1 3.5Encoder Mode: Speed 4 Two-Pass - Input: Bosphorus 4KLinux 6.1 Defaultsmitigations=off3691215SE +/- 0.01, N = 3SE +/- 0.04, N = 312.0912.051. (CXX) g++ options: -O3 -std=c++11 -U_FORTIFY_SOURCE -lm

Renaissance

Test: Apache Spark PageRank

OpenBenchmarking.orgms, Fewer Is BetterRenaissance 0.14Test: Apache Spark PageRankmitigations=offLinux 6.1 Defaults400800120016002000SE +/- 7.79, N = 3SE +/- 15.25, N = 31877.81900.6MIN: 1729.93 / MAX: 1920.13MIN: 1751.32 / MAX: 1979.24

Renaissance

Test: Genetic Algorithm Using Jenetics + Futures

OpenBenchmarking.orgms, Fewer Is BetterRenaissance 0.14Test: Genetic Algorithm Using Jenetics + FuturesLinux 6.1 Defaultsmitigations=off2004006008001000SE +/- 12.61, N = 4SE +/- 7.18, N = 31033.21051.3MIN: 963.25 / MAX: 1123.84MIN: 988.02 / MAX: 1106.1

OpenVINO

Model: Machine Translation EN To DE FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.2.devModel: Machine Translation EN To DE FP16 - Device: CPULinux 6.1 Defaultsmitigations=off306090120150SE +/- 0.10, N = 3SE +/- 0.22, N = 3125.00125.10MIN: 88.24 / MAX: 330.6MIN: 90.23 / MAX: 327.31. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -flto -shared

OpenVINO

Model: Machine Translation EN To DE FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.2.devModel: Machine Translation EN To DE FP16 - Device: CPULinux 6.1 Defaultsmitigations=off1428425670SE +/- 0.06, N = 3SE +/- 0.10, N = 363.9563.871. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -flto -shared

OpenVINO

Model: Face Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.2.devModel: Face Detection FP16-INT8 - Device: CPULinux 6.1 Defaultsmitigations=off90180270360450SE +/- 0.12, N = 3SE +/- 0.58, N = 3437.50438.11MIN: 270.24 / MAX: 992.11MIN: 270.11 / MAX: 1300.721. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -flto -shared

OpenVINO

Model: Face Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.2.devModel: Face Detection FP16-INT8 - Device: CPULinux 6.1 Defaultsmitigations=off48121620SE +/- 0.00, N = 3SE +/- 0.03, N = 318.2618.241. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -flto -shared

Facebook RocksDB

Test: Random Fill Sync

OpenBenchmarking.orgOp/s, More Is BetterFacebook RocksDB 7.5.3Test: Random Fill SyncLinux 6.1 Defaultsmitigations=off8K16K24K32K40KSE +/- 8.74, N = 3SE +/- 248.77, N = 338927386071. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti -lpthread

OpenVINO

Model: Person Vehicle Bike Detection FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.2.devModel: Person Vehicle Bike Detection FP16 - Device: CPULinux 6.1 Defaultsmitigations=off3691215SE +/- 0.05, N = 3SE +/- 0.01, N = 310.5810.68MIN: 7.56 / MAX: 57.78MIN: 7.52 / MAX: 54.711. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -flto -shared

OpenVINO

Model: Person Vehicle Bike Detection FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.2.devModel: Person Vehicle Bike Detection FP16 - Device: CPULinux 6.1 Defaultsmitigations=off160320480640800SE +/- 3.32, N = 3SE +/- 0.34, N = 3755.36748.061. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -flto -shared

OpenVINO

Model: Weld Porosity Detection FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.2.devModel: Weld Porosity Detection FP16 - Device: CPULinux 6.1 Defaultsmitigations=off1122334455SE +/- 0.04, N = 3SE +/- 0.01, N = 350.5750.67MIN: 22.73 / MAX: 185.96MIN: 30.2 / MAX: 197.711. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -flto -shared

OpenVINO

Model: Weld Porosity Detection FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.2.devModel: Weld Porosity Detection FP16 - Device: CPULinux 6.1 Defaultsmitigations=off100200300400500SE +/- 0.35, N = 3SE +/- 0.03, N = 3473.81472.811. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -flto -shared

OpenVINO

Model: Vehicle Detection FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.2.devModel: Vehicle Detection FP16 - Device: CPULinux 6.1 Defaultsmitigations=off510152025SE +/- 0.02, N = 3SE +/- 0.03, N = 321.4521.56MIN: 11.89 / MAX: 88MIN: 11.75 / MAX: 89.391. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -flto -shared

OpenVINO

Model: Vehicle Detection FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.2.devModel: Vehicle Detection FP16 - Device: CPULinux 6.1 Defaultsmitigations=off80160240320400SE +/- 0.29, N = 3SE +/- 0.52, N = 3372.54370.541. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -flto -shared

OpenVINO

Model: Vehicle Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.2.devModel: Vehicle Detection FP16-INT8 - Device: CPULinux 6.1 Defaultsmitigations=off246810SE +/- 0.00, N = 3SE +/- 0.01, N = 38.708.74MIN: 5.93 / MAX: 62.71MIN: 5.93 / MAX: 611. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -flto -shared

OpenVINO

Model: Vehicle Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.2.devModel: Vehicle Detection FP16-INT8 - Device: CPULinux 6.1 Defaultsmitigations=off2004006008001000SE +/- 0.49, N = 3SE +/- 1.18, N = 3919.04914.621. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -flto -shared

OpenVINO

Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.2.devModel: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPULinux 6.1 Defaultsmitigations=off0.1620.3240.4860.6480.81SE +/- 0.00, N = 3SE +/- 0.00, N = 30.720.72MIN: 0.5 / MAX: 5.07MIN: 0.5 / MAX: 5.061. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -flto -shared

OpenVINO

Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.2.devModel: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPULinux 6.1 Defaultsmitigations=off7K14K21K28K35KSE +/- 4.98, N = 3SE +/- 20.38, N = 333202.8833193.111. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -flto -shared

OpenVINO

Model: Weld Porosity Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.2.devModel: Weld Porosity Detection FP16-INT8 - Device: CPULinux 6.1 Defaultsmitigations=off48121620SE +/- 0.02, N = 3SE +/- 0.03, N = 314.4114.51MIN: 7.04 / MAX: 135.23MIN: 7.71 / MAX: 127.131. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -flto -shared

OpenVINO

Model: Weld Porosity Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.2.devModel: Weld Porosity Detection FP16-INT8 - Device: CPULinux 6.1 Defaultsmitigations=off400800120016002000SE +/- 1.49, N = 3SE +/- 3.13, N = 31664.641653.361. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -flto -shared

OpenVINO

Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.2.devModel: Age Gender Recognition Retail 0013 FP16 - Device: CPULinux 6.1 Defaultsmitigations=off0.36680.73361.10041.46721.834SE +/- 0.00, N = 3SE +/- 0.00, N = 31.631.63MIN: 1.11 / MAX: 10.18MIN: 0.83 / MAX: 10.171. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -flto -shared

OpenVINO

Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.2.devModel: Age Gender Recognition Retail 0013 FP16 - Device: CPULinux 6.1 Defaultsmitigations=off3K6K9K12K15KSE +/- 5.29, N = 3SE +/- 8.91, N = 314690.9014683.751. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -flto -shared

Facebook RocksDB

Test: Random Fill

OpenBenchmarking.orgOp/s, More Is BetterFacebook RocksDB 7.5.3Test: Random Fillmitigations=offLinux 6.1 Defaults300K600K900K1200K1500KSE +/- 5444.71, N = 3SE +/- 6463.89, N = 3136726713561171. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti -lpthread

Facebook RocksDB

Test: Update Random

OpenBenchmarking.orgOp/s, More Is BetterFacebook RocksDB 7.5.3Test: Update RandomLinux 6.1 Defaultsmitigations=off160K320K480K640K800KSE +/- 7415.12, N = 3SE +/- 4236.67, N = 37700177645581. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti -lpthread

Facebook RocksDB

Test: Read Random Write Random

OpenBenchmarking.orgOp/s, More Is BetterFacebook RocksDB 7.5.3Test: Read Random Write RandomLinux 6.1 Defaultsmitigations=off800K1600K2400K3200K4000KSE +/- 3258.62, N = 3SE +/- 15106.42, N = 3364115536246441. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti -lpthread

Facebook RocksDB

Test: Random Read

OpenBenchmarking.orgOp/s, More Is BetterFacebook RocksDB 7.5.3Test: Random Readmitigations=offLinux 6.1 Defaults40M80M120M160M200MSE +/- 2519557.52, N = 3SE +/- 2292531.98, N = 31775031221774808531. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti -lpthread

Stargate Digital Audio Workstation

Sample Rate: 192000 - Buffer Size: 1024

OpenBenchmarking.orgRender Ratio, More Is BetterStargate Digital Audio Workstation 22.11.5Sample Rate: 192000 - Buffer Size: 1024mitigations=offLinux 6.1 Defaults0.68551.3712.05652.7423.4275SE +/- 0.003982, N = 3SE +/- 0.002663, N = 33.0467163.0335331. (CXX) g++ options: -lpthread -lsndfile -lm -O3 -march=native -ffast-math -funroll-loops -fstrength-reduce -fstrict-aliasing -finline-functions

Apache HBase

Rows: 1000000 - Test: Random Read - Clients: 16

OpenBenchmarking.orgMicroseconds - Average Latency, Fewer Is BetterApache HBase 2.5.0Rows: 1000000 - Test: Random Read - Clients: 16mitigations=offLinux 6.1 Defaults1224364860SE +/- 0.33, N = 3SE +/- 0.58, N = 35254

Apache HBase

Rows: 1000000 - Test: Random Read - Clients: 16

OpenBenchmarking.orgRows Per Second, More Is BetterApache HBase 2.5.0Rows: 1000000 - Test: Random Read - Clients: 16mitigations=offLinux 6.1 Defaults60K120K180K240K300KSE +/- 984.52, N = 3SE +/- 2676.47, N = 3299708291117

Renaissance

Test: Savina Reactors.IO

OpenBenchmarking.orgms, Fewer Is BetterRenaissance 0.14Test: Savina Reactors.IOmitigations=offLinux 6.1 Defaults9001800270036004500SE +/- 3.06, N = 3SE +/- 45.21, N = 34159.14188.3MIN: 4153.01 / MAX: 5832.37MIN: 4132.82 / MAX: 5963.25

Apache CouchDB

Bulk Size: 100 - Inserts: 1000 - Rounds: 30

OpenBenchmarking.orgSeconds, Fewer Is BetterApache CouchDB 3.2.2Bulk Size: 100 - Inserts: 1000 - Rounds: 30Linux 6.1 Defaultsmitigations=off1224364860SE +/- 0.07, N = 3SE +/- 0.45, N = 353.8555.021. (CXX) g++ options: -std=c++17 -lmozjs-91 -lm -lei -fPIC -MMD

Renaissance

Test: Apache Spark ALS

OpenBenchmarking.orgms, Fewer Is BetterRenaissance 0.14Test: Apache Spark ALSmitigations=offLinux 6.1 Defaults30060090012001500SE +/- 8.72, N = 3SE +/- 4.17, N = 31561.11592.7MIN: 1476.82 / MAX: 1681.97MIN: 1505.66 / MAX: 1729.7

SVT-AV1

Encoder Mode: Preset 4 - Input: Bosphorus 4K

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.2Encoder Mode: Preset 4 - Input: Bosphorus 4KLinux 6.1 Defaultsmitigations=off0.68831.37662.06492.75323.4415SE +/- 0.016, N = 3SE +/- 0.005, N = 33.0593.0441. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

AOM AV1

Encoder Mode: Speed 0 Two-Pass - Input: Bosphorus 4K

OpenBenchmarking.orgFrames Per Second, More Is BetterAOM AV1 3.5Encoder Mode: Speed 0 Two-Pass - Input: Bosphorus 4KLinux 6.1 Defaultsmitigations=off0.09450.1890.28350.3780.4725SE +/- 0.00, N = 3SE +/- 0.00, N = 30.420.411. (CXX) g++ options: -O3 -std=c++11 -U_FORTIFY_SOURCE -lm

Neural Magic DeepSparse

Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-StreamLinux 6.1 Defaultsmitigations=off50100150200250SE +/- 0.44, N = 3SE +/- 0.27, N = 3236.76237.44

Neural Magic DeepSparse

Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-StreamLinux 6.1 Defaultsmitigations=off1122334455SE +/- 0.16, N = 3SE +/- 0.12, N = 350.5350.30

Neural Magic DeepSparse

Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-StreamLinux 6.1 Defaultsmitigations=off306090120150SE +/- 1.09, N = 3SE +/- 1.06, N = 3112.77113.43

Neural Magic DeepSparse

Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-StreamLinux 6.1 Defaultsmitigations=off20406080100SE +/- 1.00, N = 3SE +/- 1.02, N = 3106.27105.73

InfluxDB

Concurrent Streams: 64 - Batch Size: 10000 - Tags: 2,5000,1 - Points Per Series: 10000

OpenBenchmarking.orgval/sec, More Is BetterInfluxDB 1.8.2Concurrent Streams: 64 - Batch Size: 10000 - Tags: 2,5000,1 - Points Per Series: 10000Linux 6.1 Defaultsmitigations=off600K1200K1800K2400K3000KSE +/- 5792.62, N = 3SE +/- 3790.37, N = 32980179.42976169.8

Apache HBase

Rows: 1000000 - Test: Random Read - Clients: 1

OpenBenchmarking.orgMicroseconds - Average Latency, Fewer Is BetterApache HBase 2.5.0Rows: 1000000 - Test: Random Read - Clients: 1mitigations=offLinux 6.1 Defaults918273645SE +/- 0.33, N = 3SE +/- 0.33, N = 33638

Apache HBase

Rows: 1000000 - Test: Random Read - Clients: 1

OpenBenchmarking.orgRows Per Second, More Is BetterApache HBase 2.5.0Rows: 1000000 - Test: Random Read - Clients: 1mitigations=offLinux 6.1 Defaults6K12K18K24K30KSE +/- 87.43, N = 3SE +/- 201.55, N = 32766025419

Neural Magic DeepSparse

Model: CV Detection,YOLOv5s COCO - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: CV Detection,YOLOv5s COCO - Scenario: Asynchronous Multi-StreamLinux 6.1 Defaultsmitigations=off4080120160200SE +/- 0.69, N = 3SE +/- 0.78, N = 3158.06158.91

Neural Magic DeepSparse

Model: CV Detection,YOLOv5s COCO - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: CV Detection,YOLOv5s COCO - Scenario: Asynchronous Multi-StreamLinux 6.1 Defaultsmitigations=off20406080100SE +/- 0.27, N = 3SE +/- 0.47, N = 375.6475.20

Cryptsetup

Twofish-XTS 512b Decryption

OpenBenchmarking.orgMiB/s, More Is BetterCryptsetupTwofish-XTS 512b DecryptionLinux 6.1 Defaultsmitigations=off150300450600750SE +/- 0.26, N = 3SE +/- 0.26, N = 3704.2704.1

Cryptsetup

Twofish-XTS 512b Encryption

OpenBenchmarking.orgMiB/s, More Is BetterCryptsetupTwofish-XTS 512b Encryptionmitigations=offLinux 6.1 Defaults150300450600750SE +/- 0.21, N = 3SE +/- 0.15, N = 3699.8699.6

Cryptsetup

Serpent-XTS 512b Decryption

OpenBenchmarking.orgMiB/s, More Is BetterCryptsetupSerpent-XTS 512b DecryptionLinux 6.1 Defaultsmitigations=off2004006008001000SE +/- 0.74, N = 3SE +/- 0.87, N = 31043.41043.1

Cryptsetup

Serpent-XTS 512b Encryption

OpenBenchmarking.orgMiB/s, More Is BetterCryptsetupSerpent-XTS 512b EncryptionLinux 6.1 Defaultsmitigations=off2004006008001000SE +/- 0.62, N = 3SE +/- 0.80, N = 21011.71010.4

Cryptsetup

AES-XTS 512b Decryption

OpenBenchmarking.orgMiB/s, More Is BetterCryptsetupAES-XTS 512b DecryptionLinux 6.1 Defaultsmitigations=off14002800420056007000SE +/- 16.52, N = 3SE +/- 21.42, N = 36503.16490.6

Cryptsetup

AES-XTS 512b Encryption

OpenBenchmarking.orgMiB/s, More Is BetterCryptsetupAES-XTS 512b EncryptionLinux 6.1 Defaultsmitigations=off14002800420056007000SE +/- 16.24, N = 3SE +/- 22.60, N = 36523.56508.0

Cryptsetup

Twofish-XTS 256b Decryption

OpenBenchmarking.orgMiB/s, More Is BetterCryptsetupTwofish-XTS 256b DecryptionLinux 6.1 Defaultsmitigations=off150300450600750SE +/- 0.27, N = 3SE +/- 0.30, N = 3704.6704.3

Cryptsetup

Twofish-XTS 256b Encryption

OpenBenchmarking.orgMiB/s, More Is BetterCryptsetupTwofish-XTS 256b Encryptionmitigations=offLinux 6.1 Defaults150300450600750SE +/- 1.37, N = 3SE +/- 1.56, N = 3698.5698.4

Cryptsetup

Serpent-XTS 256b Decryption

OpenBenchmarking.orgMiB/s, More Is BetterCryptsetupSerpent-XTS 256b DecryptionLinux 6.1 Defaultsmitigations=off2004006008001000SE +/- 0.74, N = 3SE +/- 0.95, N = 31043.61042.7

Cryptsetup

Serpent-XTS 256b Encryption

OpenBenchmarking.orgMiB/s, More Is BetterCryptsetupSerpent-XTS 256b EncryptionLinux 6.1 Defaultsmitigations=off2004006008001000SE +/- 2.59, N = 3SE +/- 2.16, N = 31009.01008.9

Cryptsetup

AES-XTS 256b Decryption

OpenBenchmarking.orgMiB/s, More Is BetterCryptsetupAES-XTS 256b DecryptionLinux 6.1 Defaultsmitigations=off15003000450060007500SE +/- 15.14, N = 3SE +/- 24.01, N = 37108.87083.9

Cryptsetup

AES-XTS 256b Encryption

OpenBenchmarking.orgMiB/s, More Is BetterCryptsetupAES-XTS 256b EncryptionLinux 6.1 Defaultsmitigations=off15003000450060007500SE +/- 15.48, N = 3SE +/- 24.85, N = 37107.77078.4

Cryptsetup

PBKDF2-whirlpool

OpenBenchmarking.orgIterations Per Second, More Is BetterCryptsetupPBKDF2-whirlpoolmitigations=offLinux 6.1 Defaults300K600K900K1200K1500KSE +/- 568.00, N = 3SE +/- 1131.33, N = 313369011334634

Cryptsetup

PBKDF2-sha512

OpenBenchmarking.orgIterations Per Second, More Is BetterCryptsetupPBKDF2-sha512mitigations=offLinux 6.1 Defaults600K1200K1800K2400K3000KSE +/- 1281.67, N = 3SE +/- 2560.00, N = 328403872839109

Neural Magic DeepSparse

Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-StreamLinux 6.1 Defaultsmitigations=off20406080100SE +/- 0.28, N = 3SE +/- 0.51, N = 377.1977.20

Neural Magic DeepSparse

Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Streammitigations=offLinux 6.1 Defaults306090120150SE +/- 1.00, N = 3SE +/- 0.64, N = 3155.32155.27

AOM AV1

Encoder Mode: Speed 6 Two-Pass - Input: Bosphorus 4K

OpenBenchmarking.orgFrames Per Second, More Is BetterAOM AV1 3.5Encoder Mode: Speed 6 Two-Pass - Input: Bosphorus 4KLinux 6.1 Defaultsmitigations=off510152025SE +/- 0.06, N = 3SE +/- 0.07, N = 321.7021.681. (CXX) g++ options: -O3 -std=c++11 -U_FORTIFY_SOURCE -lm

ASTC Encoder

Preset: Exhaustive

OpenBenchmarking.orgMT/s, More Is BetterASTC Encoder 4.0Preset: Exhaustivemitigations=offLinux 6.1 Defaults0.32880.65760.98641.31521.644SE +/- 0.0029, N = 3SE +/- 0.0062, N = 31.46121.45161. (CXX) g++ options: -O3 -flto -pthread

Timed Linux Kernel Compilation

Build: defconfig

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed Linux Kernel Compilation 5.18Build: defconfigLinux 6.1 Defaultsmitigations=off816243240SE +/- 0.26, N = 3SE +/- 0.43, N = 335.6535.69

Stress-NG

Test: SENDFILE

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.14.06Test: SENDFILELinux 6.1 Defaultsmitigations=off130K260K390K520K650KSE +/- 7415.69, N = 3SE +/- 7176.09, N = 4610692.10602354.791. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -lapparmor -latomic -lc -lcrypt -ldl -ljpeg -lrt -lsctp -lz -pthread

Renaissance

Test: In-Memory Database Shootout

OpenBenchmarking.orgms, Fewer Is BetterRenaissance 0.14Test: In-Memory Database ShootoutLinux 6.1 Defaultsmitigations=off400800120016002000SE +/- 27.32, N = 3SE +/- 24.16, N = 31921.41968.2MIN: 1708.07 / MAX: 2253.56MIN: 1760.93 / MAX: 2449.66

libavif avifenc

Encoder Speed: 2

OpenBenchmarking.orgSeconds, Fewer Is Betterlibavif avifenc 0.11Encoder Speed: 2mitigations=offLinux 6.1 Defaults816243240SE +/- 0.09, N = 3SE +/- 0.28, N = 334.1134.261. (CXX) g++ options: -O3 -fPIC -lm

RawTherapee

Total Benchmark Time

OpenBenchmarking.orgSeconds, Fewer Is BetterRawTherapeeTotal Benchmark Timemitigations=offLinux 6.1 Defaults714212835SE +/- 0.20, N = 3SE +/- 0.32, N = 331.1831.611. RawTherapee, version 5.8, command line.

SQLite Speedtest

Timed Time - Size 1,000

OpenBenchmarking.orgSeconds, Fewer Is BetterSQLite Speedtest 3.30Timed Time - Size 1,000Linux 6.1 Defaultsmitigations=off714212835SE +/- 0.04, N = 3SE +/- 0.01, N = 331.3131.391. (CC) gcc options: -O2 -lz

Stress-NG

Test: x86_64 RdRand

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.14.06Test: x86_64 RdRandLinux 6.1 Defaultsmitigations=off20K40K60K80K100KSE +/- 3.35, N = 3SE +/- 28.05, N = 382763.6982746.871. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -lapparmor -latomic -lc -lcrypt -ldl -ljpeg -lrt -lsctp -lz -pthread

Aircrack-ng

OpenBenchmarking.orgk/s, More Is BetterAircrack-ng 1.7mitigations=offLinux 6.1 Defaults15K30K45K60K75KSE +/- 47.65, N = 3SE +/- 164.84, N = 369948.1969682.141. (CXX) g++ options: -std=gnu++17 -O3 -fvisibility=hidden -fcommon -rdynamic -lnl-3 -lnl-genl-3 -lpcre -lsqlite3 -lpthread -lz -lssl -lcrypto -lhwloc -ldl -lm -pthread

Stress-NG

Test: System V Message Passing

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.14.06Test: System V Message Passingmitigations=offLinux 6.1 Defaults7M14M21M28M35MSE +/- 441148.10, N = 3SE +/- 12278.20, N = 332855914.6332462582.171. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -lapparmor -latomic -lc -lcrypt -ldl -ljpeg -lrt -lsctp -lz -pthread

Stress-NG

Test: Semaphores

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.14.06Test: Semaphoresmitigations=offLinux 6.1 Defaults800K1600K2400K3200K4000KSE +/- 4974.11, N = 3SE +/- 6818.46, N = 33519548.923517936.221. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -lapparmor -latomic -lc -lcrypt -ldl -ljpeg -lrt -lsctp -lz -pthread

Stress-NG

Test: Glibc C String Functions

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.14.06Test: Glibc C String Functionsmitigations=offLinux 6.1 Defaults800K1600K2400K3200K4000KSE +/- 29422.94, N = 3SE +/- 44204.27, N = 33778821.913741573.781. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -lapparmor -latomic -lc -lcrypt -ldl -ljpeg -lrt -lsctp -lz -pthread

Stress-NG

Test: NUMA

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.14.06Test: NUMALinux 6.1 Defaultsmitigations=off150300450600750SE +/- 9.66, N = 3SE +/- 3.21, N = 3688.80679.661. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -lapparmor -latomic -lc -lcrypt -ldl -ljpeg -lrt -lsctp -lz -pthread

Stress-NG

Test: Malloc

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.14.06Test: Mallocmitigations=offLinux 6.1 Defaults7M14M21M28M35MSE +/- 95450.84, N = 3SE +/- 145595.11, N = 332341790.8532335069.761. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -lapparmor -latomic -lc -lcrypt -ldl -ljpeg -lrt -lsctp -lz -pthread

Stress-NG

Test: Crypto

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.14.06Test: Cryptomitigations=offLinux 6.1 Defaults9K18K27K36K45KSE +/- 226.79, N = 3SE +/- 251.10, N = 342952.3242801.841. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -lapparmor -latomic -lc -lcrypt -ldl -ljpeg -lrt -lsctp -lz -pthread

Stress-NG

Test: Memory Copying

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.14.06Test: Memory CopyingLinux 6.1 Defaultsmitigations=off16003200480064008000SE +/- 42.34, N = 3SE +/- 24.63, N = 37302.747275.141. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -lapparmor -latomic -lc -lcrypt -ldl -ljpeg -lrt -lsctp -lz -pthread

Stress-NG

Test: Forking

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.14.06Test: Forkingmitigations=offLinux 6.1 Defaults30K60K90K120K150KSE +/- 714.85, N = 3SE +/- 866.53, N = 3133593.49132107.511. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -lapparmor -latomic -lc -lcrypt -ldl -ljpeg -lrt -lsctp -lz -pthread

Stress-NG

Test: Vector Math

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.14.06Test: Vector MathLinux 6.1 Defaultsmitigations=off30K60K90K120K150KSE +/- 174.14, N = 3SE +/- 179.45, N = 3134428.58134263.011. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -lapparmor -latomic -lc -lcrypt -ldl -ljpeg -lrt -lsctp -lz -pthread

Stress-NG

Test: Matrix Math

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.14.06Test: Matrix MathLinux 6.1 Defaultsmitigations=off20K40K60K80K100KSE +/- 692.52, N = 3SE +/- 1306.38, N = 3102476.69101602.631. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -lapparmor -latomic -lc -lcrypt -ldl -ljpeg -lrt -lsctp -lz -pthread

Stress-NG

Test: MMAP

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.14.06Test: MMAPLinux 6.1 Defaultsmitigations=off140280420560700SE +/- 6.66, N = 3SE +/- 7.79, N = 3664.95649.591. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -lapparmor -latomic -lc -lcrypt -ldl -ljpeg -lrt -lsctp -lz -pthread

Stress-NG

Test: CPU Stress

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.14.06Test: CPU StressLinux 6.1 Defaultsmitigations=off11K22K33K44K55KSE +/- 433.83, N = 3SE +/- 646.04, N = 351499.1551447.481. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -lapparmor -latomic -lc -lcrypt -ldl -ljpeg -lrt -lsctp -lz -pthread

Stress-NG

Test: IO_uring

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.14.06Test: IO_uringLinux 6.1 Defaultsmitigations=off6K12K18K24K30KSE +/- 6.02, N = 3SE +/- 16.82, N = 327773.3527589.431. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -lapparmor -latomic -lc -lcrypt -ldl -ljpeg -lrt -lsctp -lz -pthread

Stress-NG

Test: Glibc Qsort Data Sorting

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.14.06Test: Glibc Qsort Data SortingLinux 6.1 Defaultsmitigations=off90180270360450SE +/- 2.44, N = 3SE +/- 1.72, N = 3414.37411.911. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -lapparmor -latomic -lc -lcrypt -ldl -ljpeg -lrt -lsctp -lz -pthread

srsRAN

Test: 4G PHY_DL_Test 100 PRB MIMO 256-QAM

OpenBenchmarking.orgUE Mb/s, More Is BettersrsRAN 22.04.1Test: 4G PHY_DL_Test 100 PRB MIMO 256-QAMLinux 6.1 Defaultsmitigations=off4080120160200SE +/- 0.12, N = 3SE +/- 0.32, N = 3202.0201.81. (CXX) g++ options: -std=c++14 -fno-strict-aliasing -march=native -mfpmath=sse -mavx2 -fvisibility=hidden -O3 -fno-trapping-math -fno-math-errno -ldl -lpthread -lm

srsRAN

Test: 4G PHY_DL_Test 100 PRB MIMO 256-QAM

OpenBenchmarking.orgeNb Mb/s, More Is BettersrsRAN 22.04.1Test: 4G PHY_DL_Test 100 PRB MIMO 256-QAMmitigations=offLinux 6.1 Defaults150300450600750SE +/- 2.62, N = 3SE +/- 2.42, N = 3712.1706.41. (CXX) g++ options: -std=c++14 -fno-strict-aliasing -march=native -mfpmath=sse -mavx2 -fvisibility=hidden -O3 -fno-trapping-math -fno-math-errno -ldl -lpthread -lm

DaCapo Benchmark

Java Test: H2

OpenBenchmarking.orgmsec, Fewer Is BetterDaCapo Benchmark 9.12-MR1Java Test: H2Linux 6.1 Defaultsmitigations=off5001000150020002500SE +/- 41.36, N = 20SE +/- 52.45, N = 2021112137

WebP Image Encode

Encode Settings: Quality 100, Lossless, Highest Compression

OpenBenchmarking.orgMP/s, More Is BetterWebP Image Encode 1.2.4Encode Settings: Quality 100, Lossless, Highest Compressionmitigations=offLinux 6.1 Defaults0.21150.4230.63450.8461.0575SE +/- 0.00, N = 3SE +/- 0.00, N = 30.940.931. (CC) gcc options: -fvisibility=hidden -O2 -lm

Renaissance

Test: Finagle HTTP Requests

OpenBenchmarking.orgms, Fewer Is BetterRenaissance 0.14Test: Finagle HTTP Requestsmitigations=offLinux 6.1 Defaults400800120016002000SE +/- 12.55, N = 3SE +/- 2.14, N = 31963.91992.9MIN: 1798.97 / MAX: 2151.27MIN: 1809.15 / MAX: 2148.58

srsRAN

Test: 4G PHY_DL_Test 100 PRB MIMO 64-QAM

OpenBenchmarking.orgUE Mb/s, More Is BettersrsRAN 22.04.1Test: 4G PHY_DL_Test 100 PRB MIMO 64-QAMLinux 6.1 Defaultsmitigations=off4080120160200SE +/- 0.17, N = 3SE +/- 1.23, N = 3181.5180.41. (CXX) g++ options: -std=c++14 -fno-strict-aliasing -march=native -mfpmath=sse -mavx2 -fvisibility=hidden -O3 -fno-trapping-math -fno-math-errno -ldl -lpthread -lm

srsRAN

Test: 4G PHY_DL_Test 100 PRB MIMO 64-QAM

OpenBenchmarking.orgeNb Mb/s, More Is BettersrsRAN 22.04.1Test: 4G PHY_DL_Test 100 PRB MIMO 64-QAMLinux 6.1 Defaultsmitigations=off140280420560700SE +/- 5.43, N = 3SE +/- 4.97, N = 3643.2639.11. (CXX) g++ options: -std=c++14 -fno-strict-aliasing -march=native -mfpmath=sse -mavx2 -fvisibility=hidden -O3 -fno-trapping-math -fno-math-errno -ldl -lpthread -lm

Renaissance

Test: Apache Spark Bayes

OpenBenchmarking.orgms, Fewer Is BetterRenaissance 0.14Test: Apache Spark Bayesmitigations=offLinux 6.1 Defaults150300450600750SE +/- 3.25, N = 3SE +/- 1.25, N = 3697.8701.8MIN: 502.51 / MAX: 703.67MIN: 510.43 / MAX: 704.23

srsRAN

Test: OFDM_Test

OpenBenchmarking.orgSamples / Second, More Is BettersrsRAN 22.04.1Test: OFDM_Testmitigations=offLinux 6.1 Defaults40M80M120M160M200MSE +/- 642910.05, N = 3SE +/- 866666.67, N = 32006000001998333331. (CXX) g++ options: -std=c++14 -fno-strict-aliasing -march=native -mfpmath=sse -mavx2 -fvisibility=hidden -O3 -fno-trapping-math -fno-math-errno -ldl -lpthread -lm

Facebook RocksDB

Test: Sequential Fill

OpenBenchmarking.orgOp/s, More Is BetterFacebook RocksDB 7.5.3Test: Sequential FillLinux 6.1 Defaultsmitigations=off300K600K900K1200K1500KSE +/- 17853.48, N = 3SE +/- 2086.01, N = 3150243114946101. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti -lpthread

DaCapo Benchmark

Java Test: Tradesoap

OpenBenchmarking.orgmsec, Fewer Is BetterDaCapo Benchmark 9.12-MR1Java Test: TradesoapLinux 6.1 Defaultsmitigations=off400800120016002000SE +/- 10.42, N = 20SE +/- 11.96, N = 416421656

Renaissance

Test: Random Forest

OpenBenchmarking.orgms, Fewer Is BetterRenaissance 0.14Test: Random Forestmitigations=offLinux 6.1 Defaults80160240320400SE +/- 1.71, N = 3SE +/- 1.64, N = 3378.8380.0MIN: 350.48 / MAX: 457.26MIN: 353.4 / MAX: 457.98

ASTC Encoder

Preset: Thorough

OpenBenchmarking.orgMT/s, More Is BetterASTC Encoder 4.0Preset: ThoroughLinux 6.1 Defaultsmitigations=off48121620SE +/- 0.01, N = 3SE +/- 0.08, N = 316.2416.061. (CXX) g++ options: -O3 -flto -pthread

SVT-AV1

Encoder Mode: Preset 8 - Input: Bosphorus 4K

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.2Encoder Mode: Preset 8 - Input: Bosphorus 4Kmitigations=offLinux 6.1 Defaults20406080100SE +/- 0.72, N = 7SE +/- 0.86, N = 477.3476.351. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

AOM AV1

Encoder Mode: Speed 6 Realtime - Input: Bosphorus 4K

OpenBenchmarking.orgFrames Per Second, More Is BetterAOM AV1 3.5Encoder Mode: Speed 6 Realtime - Input: Bosphorus 4Kmitigations=offLinux 6.1 Defaults1020304050SE +/- 0.22, N = 3SE +/- 0.13, N = 344.7144.191. (CXX) g++ options: -O3 -std=c++11 -U_FORTIFY_SOURCE -lm

srsRAN

Test: 4G PHY_DL_Test 100 PRB SISO 64-QAM

OpenBenchmarking.orgUE Mb/s, More Is BettersrsRAN 22.04.1Test: 4G PHY_DL_Test 100 PRB SISO 64-QAMLinux 6.1 Defaultsmitigations=off50100150200250SE +/- 0.44, N = 3SE +/- 1.80, N = 5229.1224.31. (CXX) g++ options: -std=c++14 -fno-strict-aliasing -march=native -mfpmath=sse -mavx2 -fvisibility=hidden -O3 -fno-trapping-math -fno-math-errno -ldl -lpthread -lm

srsRAN

Test: 4G PHY_DL_Test 100 PRB SISO 64-QAM

OpenBenchmarking.orgeNb Mb/s, More Is BettersrsRAN 22.04.1Test: 4G PHY_DL_Test 100 PRB SISO 64-QAMLinux 6.1 Defaultsmitigations=off140280420560700SE +/- 2.79, N = 3SE +/- 6.50, N = 5646.2631.31. (CXX) g++ options: -std=c++14 -fno-strict-aliasing -march=native -mfpmath=sse -mavx2 -fvisibility=hidden -O3 -fno-trapping-math -fno-math-errno -ldl -lpthread -lm

srsRAN

Test: 5G PHY_DL_NR Test 52 PRB SISO 64-QAM

OpenBenchmarking.orgUE Mb/s, More Is BettersrsRAN 22.04.1Test: 5G PHY_DL_NR Test 52 PRB SISO 64-QAMLinux 6.1 Defaultsmitigations=off20406080100SE +/- 0.12, N = 3SE +/- 0.52, N = 3104.3103.11. (CXX) g++ options: -std=c++14 -fno-strict-aliasing -march=native -mfpmath=sse -mavx2 -fvisibility=hidden -O3 -fno-trapping-math -fno-math-errno -ldl -lpthread -lm

srsRAN

Test: 5G PHY_DL_NR Test 52 PRB SISO 64-QAM

OpenBenchmarking.orgeNb Mb/s, More Is BettersrsRAN 22.04.1Test: 5G PHY_DL_NR Test 52 PRB SISO 64-QAMLinux 6.1 Defaultsmitigations=off50100150200250SE +/- 1.46, N = 3SE +/- 1.89, N = 3227.5225.81. (CXX) g++ options: -std=c++14 -fno-strict-aliasing -march=native -mfpmath=sse -mavx2 -fvisibility=hidden -O3 -fno-trapping-math -fno-math-errno -ldl -lpthread -lm

ASTC Encoder

Preset: Fast

OpenBenchmarking.orgMT/s, More Is BetterASTC Encoder 4.0Preset: FastLinux 6.1 Defaultsmitigations=off70140210280350SE +/- 0.16, N = 3SE +/- 0.26, N = 3345.11344.761. (CXX) g++ options: -O3 -flto -pthread

srsRAN

Test: 4G PHY_DL_Test 100 PRB SISO 256-QAM

OpenBenchmarking.orgUE Mb/s, More Is BettersrsRAN 22.04.1Test: 4G PHY_DL_Test 100 PRB SISO 256-QAMmitigations=offLinux 6.1 Defaults50100150200250SE +/- 0.50, N = 3SE +/- 1.56, N = 3245.5245.11. (CXX) g++ options: -std=c++14 -fno-strict-aliasing -march=native -mfpmath=sse -mavx2 -fvisibility=hidden -O3 -fno-trapping-math -fno-math-errno -ldl -lpthread -lm

srsRAN

Test: 4G PHY_DL_Test 100 PRB SISO 256-QAM

OpenBenchmarking.orgeNb Mb/s, More Is BettersrsRAN 22.04.1Test: 4G PHY_DL_Test 100 PRB SISO 256-QAMmitigations=offLinux 6.1 Defaults150300450600750SE +/- 1.00, N = 3SE +/- 7.34, N = 3713.6713.61. (CXX) g++ options: -std=c++14 -fno-strict-aliasing -march=native -mfpmath=sse -mavx2 -fvisibility=hidden -O3 -fno-trapping-math -fno-math-errno -ldl -lpthread -lm

WebP Image Encode

Encode Settings: Quality 100, Lossless

OpenBenchmarking.orgMP/s, More Is BetterWebP Image Encode 1.2.4Encode Settings: Quality 100, Losslessmitigations=offLinux 6.1 Defaults0.52651.0531.57952.1062.6325SE +/- 0.00, N = 3SE +/- 0.00, N = 32.342.341. (CC) gcc options: -fvisibility=hidden -O2 -lm

AOM AV1

Encoder Mode: Speed 8 Realtime - Input: Bosphorus 4K

OpenBenchmarking.orgFrames Per Second, More Is BetterAOM AV1 3.5Encoder Mode: Speed 8 Realtime - Input: Bosphorus 4Kmitigations=offLinux 6.1 Defaults1530456075SE +/- 0.78, N = 3SE +/- 0.37, N = 366.4965.781. (CXX) g++ options: -O3 -std=c++11 -U_FORTIFY_SOURCE -lm

libavif avifenc

Encoder Speed: 6, Lossless

OpenBenchmarking.orgSeconds, Fewer Is Betterlibavif avifenc 0.11Encoder Speed: 6, Losslessmitigations=offLinux 6.1 Defaults1.25752.5153.77255.036.2875SE +/- 0.051, N = 6SE +/- 0.060, N = 35.4535.5891. (CXX) g++ options: -O3 -fPIC -lm

WebP2 Image Encode

Encode Settings: Quality 100, Compression Effort 5

OpenBenchmarking.orgMP/s, More Is BetterWebP2 Image Encode 20220823Encode Settings: Quality 100, Compression Effort 5mitigations=offLinux 6.1 Defaults3691215SE +/- 0.06, N = 3SE +/- 0.16, N = 159.469.111. (CXX) g++ options: -msse4.2 -fno-rtti -O3 -ldl

AOM AV1

Encoder Mode: Speed 9 Realtime - Input: Bosphorus 4K

OpenBenchmarking.orgFrames Per Second, More Is BetterAOM AV1 3.5Encoder Mode: Speed 9 Realtime - Input: Bosphorus 4Kmitigations=offLinux 6.1 Defaults20406080100SE +/- 0.19, N = 3SE +/- 0.19, N = 385.9183.601. (CXX) g++ options: -O3 -std=c++11 -U_FORTIFY_SOURCE -lm

AOM AV1

Encoder Mode: Speed 10 Realtime - Input: Bosphorus 4K

OpenBenchmarking.orgFrames Per Second, More Is BetterAOM AV1 3.5Encoder Mode: Speed 10 Realtime - Input: Bosphorus 4Kmitigations=offLinux 6.1 Defaults20406080100SE +/- 0.57, N = 3SE +/- 0.27, N = 386.6284.711. (CXX) g++ options: -O3 -std=c++11 -U_FORTIFY_SOURCE -lm

DaCapo Benchmark

Java Test: Tradebeans

OpenBenchmarking.orgmsec, Fewer Is BetterDaCapo Benchmark 9.12-MR1Java Test: TradebeansLinux 6.1 Defaultsmitigations=off400800120016002000SE +/- 13.02, N = 4SE +/- 10.14, N = 417091719

ASTC Encoder

Preset: Medium

OpenBenchmarking.orgMT/s, More Is BetterASTC Encoder 4.0Preset: Mediummitigations=offLinux 6.1 Defaults306090120150SE +/- 0.12, N = 3SE +/- 0.19, N = 3126.26126.151. (CXX) g++ options: -O3 -flto -pthread

DaCapo Benchmark

Java Test: Jython

OpenBenchmarking.orgmsec, Fewer Is BetterDaCapo Benchmark 9.12-MR1Java Test: JythonLinux 6.1 Defaultsmitigations=off400800120016002000SE +/- 11.93, N = 4SE +/- 13.09, N = 1017091715

libavif avifenc

Encoder Speed: 10, Lossless

OpenBenchmarking.orgSeconds, Fewer Is Betterlibavif avifenc 0.11Encoder Speed: 10, Losslessmitigations=offLinux 6.1 Defaults0.77041.54082.31123.08163.852SE +/- 0.033, N = 3SE +/- 0.031, N = 73.3263.4241. (CXX) g++ options: -O3 -fPIC -lm

OSBench

Test: Create Files

OpenBenchmarking.orgus Per Event, Fewer Is BetterOSBenchTest: Create Filesmitigations=offLinux 6.1 Defaults246810SE +/- 0.004001, N = 3SE +/- 0.010422, N = 38.2396988.3126711. (CC) gcc options: -lm

OSBench

Test: Memory Allocations

OpenBenchmarking.orgNs Per Event, Fewer Is BetterOSBenchTest: Memory Allocationsmitigations=offLinux 6.1 Defaults1020304050SE +/- 0.05, N = 3SE +/- 0.11, N = 340.8342.131. (CC) gcc options: -lm

OSBench

Test: Create Processes

OpenBenchmarking.orgus Per Event, Fewer Is BetterOSBenchTest: Create ProcessesLinux 6.1 Defaultsmitigations=off48121620SE +/- 0.06, N = 3SE +/- 0.17, N = 317.2017.471. (CC) gcc options: -lm

OSBench

Test: Launch Programs

OpenBenchmarking.orgus Per Event, Fewer Is BetterOSBenchTest: Launch Programsmitigations=offLinux 6.1 Defaults612182430SE +/- 0.16, N = 3SE +/- 0.07, N = 323.8923.991. (CC) gcc options: -lm

OSBench

Test: Create Threads

OpenBenchmarking.orgus Per Event, Fewer Is BetterOSBenchTest: Create Threadsmitigations=offLinux 6.1 Defaults3691215SE +/- 0.101921, N = 3SE +/- 0.059195, N = 39.1067959.1163321. (CC) gcc options: -lm

Bork File Encrypter

File Encryption Time

OpenBenchmarking.orgSeconds, Fewer Is BetterBork File Encrypter 1.4File Encryption Timemitigations=offLinux 6.1 Defaults1.09012.18023.27034.36045.4505SE +/- 0.030, N = 3SE +/- 0.033, N = 34.8174.845

WebP Image Encode

Encode Settings: Quality 100, Highest Compression

OpenBenchmarking.orgMP/s, More Is BetterWebP Image Encode 1.2.4Encode Settings: Quality 100, Highest Compressionmitigations=offLinux 6.1 Defaults1.16552.3313.49654.6625.8275SE +/- 0.00, N = 3SE +/- 0.00, N = 35.185.181. (CC) gcc options: -fvisibility=hidden -O2 -lm

SVT-AV1

Encoder Mode: Preset 10 - Input: Bosphorus 4K

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.2Encoder Mode: Preset 10 - Input: Bosphorus 4Kmitigations=offLinux 6.1 Defaults306090120150SE +/- 1.43, N = 3SE +/- 1.34, N = 3147.85146.091. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

libavif avifenc

Encoder Speed: 6

OpenBenchmarking.orgSeconds, Fewer Is Betterlibavif avifenc 0.11Encoder Speed: 6mitigations=offLinux 6.1 Defaults0.74231.48462.22692.96923.7115SE +/- 0.011, N = 3SE +/- 0.034, N = 43.2423.2991. (CXX) g++ options: -O3 -fPIC -lm

SVT-AV1

Encoder Mode: Preset 12 - Input: Bosphorus 4K

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.2Encoder Mode: Preset 12 - Input: Bosphorus 4Kmitigations=offLinux 6.1 Defaults50100150200250SE +/- 0.64, N = 3SE +/- 1.49, N = 3217.73216.781. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

WebP2 Image Encode

Encode Settings: Default

OpenBenchmarking.orgMP/s, More Is BetterWebP2 Image Encode 20220823Encode Settings: Defaultmitigations=offLinux 6.1 Defaults48121620SE +/- 0.14, N = 7SE +/- 0.20, N = 315.1714.921. (CXX) g++ options: -msse4.2 -fno-rtti -O3 -ldl

WebP Image Encode

Encode Settings: Quality 100

OpenBenchmarking.orgMP/s, More Is BetterWebP Image Encode 1.2.4Encode Settings: Quality 100Linux 6.1 Defaultsmitigations=off48121620SE +/- 0.01, N = 3SE +/- 0.01, N = 316.6916.641. (CC) gcc options: -fvisibility=hidden -O2 -lm

ctx_clock

Context Switch Time

OpenBenchmarking.orgClocks, Fewer Is Betterctx_clockContext Switch TimeLinux 6.1 Defaultsmitigations=off306090120150SE +/- 0.00, N = 3SE +/- 0.95, N = 11124128

WebP Image Encode

Encode Settings: Default

OpenBenchmarking.orgMP/s, More Is BetterWebP Image Encode 1.2.4Encode Settings: DefaultLinux 6.1 Defaultsmitigations=off612182430SE +/- 0.01, N = 3SE +/- 0.02, N = 325.8825.821. (CC) gcc options: -fvisibility=hidden -O2 -lm

Geometric Mean Of All Test Results

Result Composite - Intel Raptor Lake Mitigation Cost

OpenBenchmarking.orgGeometric Mean, More Is BetterGeometric Mean Of All Test ResultsResult Composite - Intel Raptor Lake Mitigation Costmitigations=offLinux 6.1 Defaults50100150200250206.93206.07

Phoronix Test Suite v10.8.4