Intel Raptor Lake Mitigation Cost Benchmarks by Michael Larabel for a future article. Linux 6.1 Defaults: Processor: Intel Core i9-13900K @ 5.50GHz (24 Cores / 32 Threads), Motherboard: ASUS PRIME Z790-P WIFI (0602 BIOS), Chipset: Intel Device 7a27, Memory: 32GB, Disk: 1000GB Western Digital WDS100T1X0E-00AFY0, Graphics: AMD Radeon RX 6800 16GB (2475/1000MHz), Audio: Realtek ALC897, Monitor: ASUS VP28U, Network: Realtek RTL8125 2.5GbE + Intel Device 7a70 OS: Ubuntu 22.04, Kernel: 6.1.0-060100rc5daily20221117-generic (x86_64), Desktop: GNOME Shell 42.5, Display Server: X Server 1.21.1.3 + Wayland, OpenGL: 4.6 Mesa 22.0.5 (LLVM 13.0.1 DRM 3.49), Vulkan: 1.3.204, Compiler: GCC 11.3.0, File-System: ext4, Screen Resolution: 3840x2160 mitigations=off: Processor: Intel Core i9-13900K @ 5.50GHz (24 Cores / 32 Threads), Motherboard: ASUS PRIME Z790-P WIFI (0602 BIOS), Chipset: Intel Device 7a27, Memory: 32GB, Disk: 1000GB Western Digital WDS100T1X0E-00AFY0, Graphics: AMD Radeon RX 6800 16GB (2475/1000MHz), Audio: Realtek ALC897, Monitor: ASUS VP28U, Network: Realtek RTL8125 2.5GbE + Intel Device 7a70 OS: Ubuntu 22.04, Kernel: 6.1.0-060100rc5daily20221117-generic (x86_64), Desktop: GNOME Shell 42.5, Display Server: X Server 1.21.1.3 + Wayland, OpenGL: 4.6 Mesa 22.0.5 (LLVM 13.0.1 DRM 3.49), Vulkan: 1.3.204, Compiler: GCC 11.3.0, File-System: ext4, Screen Resolution: 3840x2160 WebP2 Image Encode 20220823 Encode Settings: Quality 100, Lossless Compression MP/s > Higher Is Better Linux 6.1 Defaults . 0.04 |==================================================== mitigations=off .... 0.04 |==================================================== Timed Linux Kernel Compilation 5.18 Build: allmodconfig Seconds < Lower Is Better Linux 6.1 Defaults . 410.70 |================================================== mitigations=off .... 410.34 |================================================== Java Gradle Build Gradle Build: Reactor Seconds < Lower Is Better Linux 6.1 Defaults . 141.72 |================================================== mitigations=off .... 141.42 |================================================== Apache Spark 3.3 Row Count: 1000000 - Partitions: 100 - Broadcast Inner Join Test Time Seconds < Lower Is Better Linux 6.1 Defaults . 0.82 |==================================================== mitigations=off .... 0.76 |================================================ Apache Spark 3.3 Row Count: 1000000 - Partitions: 100 - Inner Join Test Time Seconds < Lower Is Better Linux 6.1 Defaults . 0.93 |==================================================== mitigations=off .... 0.87 |================================================= Apache Spark 3.3 Row Count: 1000000 - Partitions: 100 - Repartition Test Time Seconds < Lower Is Better Linux 6.1 Defaults . 1.05 |=================================================== mitigations=off .... 1.07 |==================================================== Apache Spark 3.3 Row Count: 1000000 - Partitions: 100 - Group By Test Time Seconds < Lower Is Better Linux 6.1 Defaults . 2.55 |==================================================== mitigations=off .... 2.55 |==================================================== Apache Spark 3.3 Row Count: 1000000 - Partitions: 100 - Calculate Pi Benchmark Using Dataframe Seconds < Lower Is Better Linux 6.1 Defaults . 3.34 |=================================================== mitigations=off .... 3.38 |==================================================== Apache Spark 3.3 Row Count: 1000000 - Partitions: 100 - Calculate Pi Benchmark Seconds < Lower Is Better Linux 6.1 Defaults . 51.21 |=================================================== mitigations=off .... 51.25 |=================================================== Apache Spark 3.3 Row Count: 1000000 - Partitions: 100 - SHA-512 Benchmark Time Seconds < Lower Is Better Linux 6.1 Defaults . 1.99 |==================================================== mitigations=off .... 1.99 |==================================================== BRL-CAD 7.32.6 VGR Performance Metric VGR Performance Metric > Higher Is Better Linux 6.1 Defaults . 462945 |================================================== mitigations=off .... 463365 |================================================== Facebook RocksDB 7.5.3 Test: Read While Writing Op/s > Higher Is Better Linux 6.1 Defaults . 5089887 |================================================= mitigations=off .... 4930581 |=============================================== Apache CouchDB 3.2.2 Bulk Size: 300 - Inserts: 1000 - Rounds: 30 Seconds < Lower Is Better Linux 6.1 Defaults . 94.25 |=================================================== mitigations=off .... 90.81 |================================================= ClickHouse 22.5.4.19 100M Rows Web Analytics Dataset, Third Run Queries Per Minute, Geo Mean > Higher Is Better Linux 6.1 Defaults . 309.00 |================================================== mitigations=off .... 304.77 |================================================= ClickHouse 22.5.4.19 100M Rows Web Analytics Dataset, Second Run Queries Per Minute, Geo Mean > Higher Is Better Linux 6.1 Defaults . 303.65 |================================================= mitigations=off .... 306.76 |================================================== ClickHouse 22.5.4.19 100M Rows Web Analytics Dataset, First Run / Cold Cache Queries Per Minute, Geo Mean > Higher Is Better Linux 6.1 Defaults . 300.04 |================================================== mitigations=off .... 299.11 |================================================== Apache CouchDB 3.2.2 Bulk Size: 300 - Inserts: 3000 - Rounds: 30 Seconds < Lower Is Better Linux 6.1 Defaults . 287.57 |================================================== mitigations=off .... 287.31 |================================================== Apache HBase 2.5.0 Rows: 1000000 - Test: Async Random Write - Clients: 16 Microseconds - Average Latency < Lower Is Better Linux 6.1 Defaults . 202 |===================================================== mitigations=off .... 200 |==================================================== Apache HBase 2.5.0 Rows: 1000000 - Test: Async Random Write - Clients: 16 Rows Per Second > Higher Is Better Linux 6.1 Defaults . 78783 |================================================== mitigations=off .... 79629 |=================================================== Timed Gem5 Compilation 21.2 Time To Compile Seconds < Lower Is Better Linux 6.1 Defaults . 174.64 |================================================== mitigations=off .... 174.41 |================================================== Apache CouchDB 3.2.2 Bulk Size: 100 - Inserts: 3000 - Rounds: 30 Seconds < Lower Is Better Linux 6.1 Defaults . 168.66 |================================================== mitigations=off .... 167.47 |================================================== PostgreSQL 15 Scaling Factor: 100 - Clients: 100 - Mode: Read Only - Average Latency ms < Lower Is Better Linux 6.1 Defaults . 0.081 |=================================================== mitigations=off .... 0.081 |=================================================== PostgreSQL 15 Scaling Factor: 100 - Clients: 100 - Mode: Read Only TPS > Higher Is Better Linux 6.1 Defaults . 1230688 |================================================= mitigations=off .... 1238265 |================================================= WebP2 Image Encode 20220823 Encode Settings: Quality 95, Compression Effort 7 MP/s > Higher Is Better Linux 6.1 Defaults . 0.16 |==================================================== mitigations=off .... 0.16 |==================================================== Stress-NG 0.14.06 Test: Futex Bogo Ops/s > Higher Is Better Linux 6.1 Defaults . 3515710.91 |============================================== mitigations=off .... 3421101.28 |============================================= Stress-NG 0.14.06 Test: CPU Cache Bogo Ops/s > Higher Is Better Linux 6.1 Defaults . 97.76 |================================================== mitigations=off .... 99.42 |=================================================== Renaissance 0.14 Test: Akka Unbalanced Cobwebbed Tree ms < Lower Is Better Linux 6.1 Defaults . 7188.4 |================================================= mitigations=off .... 7359.2 |================================================== PostgreSQL 15 Scaling Factor: 100 - Clients: 50 - Mode: Read Only - Average Latency ms < Lower Is Better Linux 6.1 Defaults . 0.040 |=================================================== mitigations=off .... 0.040 |=================================================== PostgreSQL 15 Scaling Factor: 100 - Clients: 50 - Mode: Read Only TPS > Higher Is Better Linux 6.1 Defaults . 1260885 |================================================= mitigations=off .... 1268657 |================================================= Apache HBase 2.5.0 Rows: 1000000 - Test: Increment - Clients: 16 Microseconds - Average Latency < Lower Is Better Linux 6.1 Defaults . 126 |===================================================== mitigations=off .... 124 |==================================================== Apache HBase 2.5.0 Rows: 1000000 - Test: Increment - Clients: 16 Rows Per Second > Higher Is Better Linux 6.1 Defaults . 125208 |================================================= mitigations=off .... 128264 |================================================== Stress-NG 0.14.06 Test: Context Switching Bogo Ops/s > Higher Is Better Linux 6.1 Defaults . 11794492.43 |================================= mitigations=off .... 16210513.97 |============================================= Apache Spark 3.3 Row Count: 1000000 - Partitions: 500 - Broadcast Inner Join Test Time Seconds < Lower Is Better Linux 6.1 Defaults . 0.79 |==================================================== mitigations=off .... 0.78 |=================================================== Apache Spark 3.3 Row Count: 1000000 - Partitions: 500 - Repartition Test Time Seconds < Lower Is Better Linux 6.1 Defaults . 1.08 |==================================================== mitigations=off .... 1.07 |==================================================== Apache Spark 3.3 Row Count: 1000000 - Partitions: 500 - Calculate Pi Benchmark Using Dataframe Seconds < Lower Is Better Linux 6.1 Defaults . 3.38 |==================================================== mitigations=off .... 3.40 |==================================================== Apache Spark 3.3 Row Count: 1000000 - Partitions: 500 - Calculate Pi Benchmark Seconds < Lower Is Better Linux 6.1 Defaults . 51.29 |=================================================== mitigations=off .... 51.42 |=================================================== KeyDB 6.2.0 Ops/sec > Higher Is Better Linux 6.1 Defaults . 1507777.21 |============================================== mitigations=off .... 1518638.23 |============================================== Renaissance 0.14 Test: Scala Dotty ms < Lower Is Better Linux 6.1 Defaults . 451.4 |=================================================== mitigations=off .... 414.3 |=============================================== Renaissance 0.14 Test: ALS Movie Lens ms < Lower Is Better Linux 6.1 Defaults . 4371.9 |================================================== mitigations=off .... 4371.5 |================================================== nginx 1.23.2 Connections: 1000 Requests Per Second > Higher Is Better Linux 6.1 Defaults . 187512.54 |=============================================== mitigations=off .... 187868.73 |=============================================== Stress-NG 0.14.06 Test: Socket Activity Bogo Ops/s > Higher Is Better Linux 6.1 Defaults . 25195.77 |============================================== mitigations=off .... 26073.14 |================================================ nginx 1.23.2 Connections: 500 Requests Per Second > Higher Is Better Linux 6.1 Defaults . 203178.40 |=============================================== mitigations=off .... 202777.49 |=============================================== nginx 1.23.2 Connections: 200 Requests Per Second > Higher Is Better Linux 6.1 Defaults . 211451.29 |=============================================== mitigations=off .... 211212.37 |=============================================== nginx 1.23.2 Connections: 100 Requests Per Second > Higher Is Better Linux 6.1 Defaults . 207280.77 |=============================================== mitigations=off .... 207784.83 |=============================================== Stress-NG 0.14.06 Test: Atomic Bogo Ops/s > Higher Is Better Linux 6.1 Defaults . 338549.56 |=============================================== mitigations=off .... 331842.59 |============================================== Neural Magic DeepSparse 1.1 Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Stream ms/batch < Lower Is Better Linux 6.1 Defaults . 947.67 |================================================== mitigations=off .... 952.75 |================================================== Neural Magic DeepSparse 1.1 Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Stream items/sec > Higher Is Better Linux 6.1 Defaults . 12.51 |=================================================== mitigations=off .... 12.45 |=================================================== Neural Magic DeepSparse 1.1 Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Stream ms/batch < Lower Is Better Linux 6.1 Defaults . 948.18 |================================================== mitigations=off .... 937.65 |================================================= Neural Magic DeepSparse 1.1 Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Stream items/sec > Higher Is Better Linux 6.1 Defaults . 12.54 |================================================== mitigations=off .... 12.67 |=================================================== Neural Magic DeepSparse 1.1 Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-Stream ms/batch < Lower Is Better Linux 6.1 Defaults . 220.95 |================================================= mitigations=off .... 223.81 |================================================== Neural Magic DeepSparse 1.1 Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-Stream items/sec > Higher Is Better Linux 6.1 Defaults . 54.16 |=================================================== mitigations=off .... 53.49 |================================================== Stress-NG 0.14.06 Test: Mutex Bogo Ops/s > Higher Is Better Linux 6.1 Defaults . 16677300.35 |=========================================== mitigations=off .... 17479306.27 |============================================= WebP2 Image Encode 20220823 Encode Settings: Quality 75, Compression Effort 7 MP/s > Higher Is Better Linux 6.1 Defaults . 0.33 |==================================================== mitigations=off .... 0.33 |==================================================== libavif avifenc 0.11 Encoder Speed: 0 Seconds < Lower Is Better Linux 6.1 Defaults . 70.34 |=================================================== mitigations=off .... 70.04 |=================================================== Dragonflydb 0.6 Clients: 200 - Set To Get Ratio: 1:5 Ops/sec > Higher Is Better Linux 6.1 Defaults . 7029354.71 |============================================== mitigations=off .... 7029304.50 |============================================== Dragonflydb 0.6 Clients: 200 - Set To Get Ratio: 5:1 Ops/sec > Higher Is Better Linux 6.1 Defaults . 6440950.32 |============================================== mitigations=off .... 6436491.37 |============================================== Dragonflydb 0.6 Clients: 200 - Set To Get Ratio: 1:1 Ops/sec > Higher Is Better Linux 6.1 Defaults . 6696607.28 |============================================== mitigations=off .... 6650409.60 |============================================== Dragonflydb 0.6 Clients: 50 - Set To Get Ratio: 5:1 Ops/sec > Higher Is Better Linux 6.1 Defaults . 6159328.58 |============================================= mitigations=off .... 6243118.04 |============================================== Dragonflydb 0.6 Clients: 50 - Set To Get Ratio: 1:5 Ops/sec > Higher Is Better Linux 6.1 Defaults . 6742394.01 |============================================== mitigations=off .... 6765462.42 |============================================== Dragonflydb 0.6 Clients: 50 - Set To Get Ratio: 1:1 Ops/sec > Higher Is Better Linux 6.1 Defaults . 6335702.64 |============================================= mitigations=off .... 6423833.88 |============================================== Stargate Digital Audio Workstation 22.11.5 Sample Rate: 192000 - Buffer Size: 512 Render Ratio > Higher Is Better Linux 6.1 Defaults . 2.635590 |================================================ mitigations=off .... 2.629225 |================================================ MariaDB 10.8.2 Clients: 32 Queries Per Second > Higher Is Better Linux 6.1 Defaults . 3304 |==================================================== mitigations=off .... 3330 |==================================================== OpenVINO 2022.2.dev Model: Person Detection FP16 - Device: CPU ms < Lower Is Better Linux 6.1 Defaults . 2212.51 |================================================= mitigations=off .... 2209.76 |================================================= OpenVINO 2022.2.dev Model: Person Detection FP16 - Device: CPU FPS > Higher Is Better Linux 6.1 Defaults . 3.59 |==================================================== mitigations=off .... 3.60 |==================================================== OpenVINO 2022.2.dev Model: Person Detection FP32 - Device: CPU ms < Lower Is Better Linux 6.1 Defaults . 2223.37 |================================================= mitigations=off .... 2236.03 |================================================= OpenVINO 2022.2.dev Model: Person Detection FP32 - Device: CPU FPS > Higher Is Better Linux 6.1 Defaults . 3.58 |==================================================== mitigations=off .... 3.56 |==================================================== OpenVINO 2022.2.dev Model: Face Detection FP16 - Device: CPU ms < Lower Is Better Linux 6.1 Defaults . 1556.54 |================================================= mitigations=off .... 1557.36 |================================================= OpenVINO 2022.2.dev Model: Face Detection FP16 - Device: CPU FPS > Higher Is Better Linux 6.1 Defaults . 5.13 |==================================================== mitigations=off .... 5.13 |==================================================== InfluxDB 1.8.2 Concurrent Streams: 4 - Batch Size: 10000 - Tags: 2,5000,1 - Points Per Series: 10000 val/sec > Higher Is Better Linux 6.1 Defaults . 2696816.3 |=============================================== mitigations=off .... 2680364.8 |=============================================== AOM AV1 3.5 Encoder Mode: Speed 4 Two-Pass - Input: Bosphorus 4K Frames Per Second > Higher Is Better Linux 6.1 Defaults . 12.09 |=================================================== mitigations=off .... 12.05 |=================================================== Renaissance 0.14 Test: Apache Spark PageRank ms < Lower Is Better Linux 6.1 Defaults . 1900.6 |================================================== mitigations=off .... 1877.8 |================================================= Renaissance 0.14 Test: Genetic Algorithm Using Jenetics + Futures ms < Lower Is Better Linux 6.1 Defaults . 1033.2 |================================================= mitigations=off .... 1051.3 |================================================== OpenVINO 2022.2.dev Model: Machine Translation EN To DE FP16 - Device: CPU ms < Lower Is Better Linux 6.1 Defaults . 125.00 |================================================== mitigations=off .... 125.10 |================================================== OpenVINO 2022.2.dev Model: Machine Translation EN To DE FP16 - Device: CPU FPS > Higher Is Better Linux 6.1 Defaults . 63.95 |=================================================== mitigations=off .... 63.87 |=================================================== OpenVINO 2022.2.dev Model: Face Detection FP16-INT8 - Device: CPU ms < Lower Is Better Linux 6.1 Defaults . 437.50 |================================================== mitigations=off .... 438.11 |================================================== OpenVINO 2022.2.dev Model: Face Detection FP16-INT8 - Device: CPU FPS > Higher Is Better Linux 6.1 Defaults . 18.26 |=================================================== mitigations=off .... 18.24 |=================================================== Facebook RocksDB 7.5.3 Test: Random Fill Sync Op/s > Higher Is Better Linux 6.1 Defaults . 38927 |=================================================== mitigations=off .... 38607 |=================================================== OpenVINO 2022.2.dev Model: Person Vehicle Bike Detection FP16 - Device: CPU ms < Lower Is Better Linux 6.1 Defaults . 10.58 |=================================================== mitigations=off .... 10.68 |=================================================== OpenVINO 2022.2.dev Model: Person Vehicle Bike Detection FP16 - Device: CPU FPS > Higher Is Better Linux 6.1 Defaults . 755.36 |================================================== mitigations=off .... 748.06 |================================================== OpenVINO 2022.2.dev Model: Weld Porosity Detection FP16 - Device: CPU ms < Lower Is Better Linux 6.1 Defaults . 50.57 |=================================================== mitigations=off .... 50.67 |=================================================== OpenVINO 2022.2.dev Model: Weld Porosity Detection FP16 - Device: CPU FPS > Higher Is Better Linux 6.1 Defaults . 473.81 |================================================== mitigations=off .... 472.81 |================================================== OpenVINO 2022.2.dev Model: Vehicle Detection FP16 - Device: CPU ms < Lower Is Better Linux 6.1 Defaults . 21.45 |=================================================== mitigations=off .... 21.56 |=================================================== OpenVINO 2022.2.dev Model: Vehicle Detection FP16 - Device: CPU FPS > Higher Is Better Linux 6.1 Defaults . 372.54 |================================================== mitigations=off .... 370.54 |================================================== OpenVINO 2022.2.dev Model: Vehicle Detection FP16-INT8 - Device: CPU ms < Lower Is Better Linux 6.1 Defaults . 8.70 |==================================================== mitigations=off .... 8.74 |==================================================== OpenVINO 2022.2.dev Model: Vehicle Detection FP16-INT8 - Device: CPU FPS > Higher Is Better Linux 6.1 Defaults . 919.04 |================================================== mitigations=off .... 914.62 |================================================== OpenVINO 2022.2.dev Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU ms < Lower Is Better Linux 6.1 Defaults . 0.72 |==================================================== mitigations=off .... 0.72 |==================================================== OpenVINO 2022.2.dev Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU FPS > Higher Is Better Linux 6.1 Defaults . 33202.88 |================================================ mitigations=off .... 33193.11 |================================================ OpenVINO 2022.2.dev Model: Weld Porosity Detection FP16-INT8 - Device: CPU ms < Lower Is Better Linux 6.1 Defaults . 14.41 |=================================================== mitigations=off .... 14.51 |=================================================== OpenVINO 2022.2.dev Model: Weld Porosity Detection FP16-INT8 - Device: CPU FPS > Higher Is Better Linux 6.1 Defaults . 1664.64 |================================================= mitigations=off .... 1653.36 |================================================= OpenVINO 2022.2.dev Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU ms < Lower Is Better Linux 6.1 Defaults . 1.63 |==================================================== mitigations=off .... 1.63 |==================================================== OpenVINO 2022.2.dev Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU FPS > Higher Is Better Linux 6.1 Defaults . 14690.90 |================================================ mitigations=off .... 14683.75 |================================================ Facebook RocksDB 7.5.3 Test: Random Fill Op/s > Higher Is Better Linux 6.1 Defaults . 1356117 |================================================= mitigations=off .... 1367267 |================================================= Facebook RocksDB 7.5.3 Test: Update Random Op/s > Higher Is Better Linux 6.1 Defaults . 770017 |================================================== mitigations=off .... 764558 |================================================== Facebook RocksDB 7.5.3 Test: Read Random Write Random Op/s > Higher Is Better Linux 6.1 Defaults . 3641155 |================================================= mitigations=off .... 3624644 |================================================= Facebook RocksDB 7.5.3 Test: Random Read Op/s > Higher Is Better Linux 6.1 Defaults . 177480853 |=============================================== mitigations=off .... 177503122 |=============================================== Stargate Digital Audio Workstation 22.11.5 Sample Rate: 192000 - Buffer Size: 1024 Render Ratio > Higher Is Better Linux 6.1 Defaults . 3.033533 |================================================ mitigations=off .... 3.046716 |================================================ Apache HBase 2.5.0 Rows: 1000000 - Test: Random Read - Clients: 16 Microseconds - Average Latency < Lower Is Better Linux 6.1 Defaults . 54 |====================================================== mitigations=off .... 52 |==================================================== Apache HBase 2.5.0 Rows: 1000000 - Test: Random Read - Clients: 16 Rows Per Second > Higher Is Better Linux 6.1 Defaults . 291117 |================================================= mitigations=off .... 299708 |================================================== Renaissance 0.14 Test: Savina Reactors.IO ms < Lower Is Better Linux 6.1 Defaults . 4188.3 |================================================== mitigations=off .... 4159.1 |================================================== Apache CouchDB 3.2.2 Bulk Size: 100 - Inserts: 1000 - Rounds: 30 Seconds < Lower Is Better Linux 6.1 Defaults . 53.85 |================================================== mitigations=off .... 55.02 |=================================================== Renaissance 0.14 Test: Apache Spark ALS ms < Lower Is Better Linux 6.1 Defaults . 1592.7 |================================================== mitigations=off .... 1561.1 |================================================= SVT-AV1 1.2 Encoder Mode: Preset 4 - Input: Bosphorus 4K Frames Per Second > Higher Is Better Linux 6.1 Defaults . 3.059 |=================================================== mitigations=off .... 3.044 |=================================================== AOM AV1 3.5 Encoder Mode: Speed 0 Two-Pass - Input: Bosphorus 4K Frames Per Second > Higher Is Better Linux 6.1 Defaults . 0.42 |==================================================== mitigations=off .... 0.41 |=================================================== Neural Magic DeepSparse 1.1 Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-Stream ms/batch < Lower Is Better Linux 6.1 Defaults . 236.76 |================================================== mitigations=off .... 237.44 |================================================== Neural Magic DeepSparse 1.1 Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-Stream items/sec > Higher Is Better Linux 6.1 Defaults . 50.53 |=================================================== mitigations=off .... 50.30 |=================================================== Neural Magic DeepSparse 1.1 Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream ms/batch < Lower Is Better Linux 6.1 Defaults . 112.77 |================================================== mitigations=off .... 113.43 |================================================== Neural Magic DeepSparse 1.1 Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream items/sec > Higher Is Better Linux 6.1 Defaults . 106.27 |================================================== mitigations=off .... 105.73 |================================================== InfluxDB 1.8.2 Concurrent Streams: 64 - Batch Size: 10000 - Tags: 2,5000,1 - Points Per Series: 10000 val/sec > Higher Is Better Linux 6.1 Defaults . 2980179.4 |=============================================== mitigations=off .... 2976169.8 |=============================================== Apache HBase 2.5.0 Rows: 1000000 - Test: Random Read - Clients: 1 Microseconds - Average Latency < Lower Is Better Linux 6.1 Defaults . 38 |====================================================== mitigations=off .... 36 |=================================================== Apache HBase 2.5.0 Rows: 1000000 - Test: Random Read - Clients: 1 Rows Per Second > Higher Is Better Linux 6.1 Defaults . 25419 |=============================================== mitigations=off .... 27660 |=================================================== Neural Magic DeepSparse 1.1 Model: CV Detection,YOLOv5s COCO - Scenario: Asynchronous Multi-Stream ms/batch < Lower Is Better Linux 6.1 Defaults . 158.06 |================================================== mitigations=off .... 158.91 |================================================== Neural Magic DeepSparse 1.1 Model: CV Detection,YOLOv5s COCO - Scenario: Asynchronous Multi-Stream items/sec > Higher Is Better Linux 6.1 Defaults . 75.64 |=================================================== mitigations=off .... 75.20 |=================================================== Cryptsetup Twofish-XTS 512b Decryption MiB/s > Higher Is Better Linux 6.1 Defaults . 704.2 |=================================================== mitigations=off .... 704.1 |=================================================== Cryptsetup Twofish-XTS 512b Encryption MiB/s > Higher Is Better Linux 6.1 Defaults . 699.6 |=================================================== mitigations=off .... 699.8 |=================================================== Cryptsetup Serpent-XTS 512b Decryption MiB/s > Higher Is Better Linux 6.1 Defaults . 1043.4 |================================================== mitigations=off .... 1043.1 |================================================== Cryptsetup Serpent-XTS 512b Encryption MiB/s > Higher Is Better Linux 6.1 Defaults . 1011.7 |================================================== mitigations=off .... 1010.4 |================================================== Cryptsetup AES-XTS 512b Decryption MiB/s > Higher Is Better Linux 6.1 Defaults . 6503.1 |================================================== mitigations=off .... 6490.6 |================================================== Cryptsetup AES-XTS 512b Encryption MiB/s > Higher Is Better Linux 6.1 Defaults . 6523.5 |================================================== mitigations=off .... 6508.0 |================================================== Cryptsetup Twofish-XTS 256b Decryption MiB/s > Higher Is Better Linux 6.1 Defaults . 704.6 |=================================================== mitigations=off .... 704.3 |=================================================== Cryptsetup Twofish-XTS 256b Encryption MiB/s > Higher Is Better Linux 6.1 Defaults . 698.4 |=================================================== mitigations=off .... 698.5 |=================================================== Cryptsetup Serpent-XTS 256b Decryption MiB/s > Higher Is Better Linux 6.1 Defaults . 1043.6 |================================================== mitigations=off .... 1042.7 |================================================== Cryptsetup Serpent-XTS 256b Encryption MiB/s > Higher Is Better Linux 6.1 Defaults . 1009.0 |================================================== mitigations=off .... 1008.9 |================================================== Cryptsetup AES-XTS 256b Decryption MiB/s > Higher Is Better Linux 6.1 Defaults . 7108.8 |================================================== mitigations=off .... 7083.9 |================================================== Cryptsetup AES-XTS 256b Encryption MiB/s > Higher Is Better Linux 6.1 Defaults . 7107.7 |================================================== mitigations=off .... 7078.4 |================================================== Cryptsetup PBKDF2-whirlpool Iterations Per Second > Higher Is Better Linux 6.1 Defaults . 1334634 |================================================= mitigations=off .... 1336901 |================================================= Cryptsetup PBKDF2-sha512 Iterations Per Second > Higher Is Better Linux 6.1 Defaults . 2839109 |================================================= mitigations=off .... 2840387 |================================================= Neural Magic DeepSparse 1.1 Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream ms/batch < Lower Is Better Linux 6.1 Defaults . 77.19 |=================================================== mitigations=off .... 77.20 |=================================================== Neural Magic DeepSparse 1.1 Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream items/sec > Higher Is Better Linux 6.1 Defaults . 155.27 |================================================== mitigations=off .... 155.32 |================================================== AOM AV1 3.5 Encoder Mode: Speed 6 Two-Pass - Input: Bosphorus 4K Frames Per Second > Higher Is Better Linux 6.1 Defaults . 21.70 |=================================================== mitigations=off .... 21.68 |=================================================== ASTC Encoder 4.0 Preset: Exhaustive MT/s > Higher Is Better Linux 6.1 Defaults . 1.4516 |================================================== mitigations=off .... 1.4612 |================================================== Timed Linux Kernel Compilation 5.18 Build: defconfig Seconds < Lower Is Better Linux 6.1 Defaults . 35.65 |=================================================== mitigations=off .... 35.69 |=================================================== Stress-NG 0.14.06 Test: SENDFILE Bogo Ops/s > Higher Is Better Linux 6.1 Defaults . 610692.10 |=============================================== mitigations=off .... 602354.79 |============================================== Renaissance 0.14 Test: In-Memory Database Shootout ms < Lower Is Better Linux 6.1 Defaults . 1921.4 |================================================= mitigations=off .... 1968.2 |================================================== libavif avifenc 0.11 Encoder Speed: 2 Seconds < Lower Is Better Linux 6.1 Defaults . 34.26 |=================================================== mitigations=off .... 34.11 |=================================================== RawTherapee Total Benchmark Time Seconds < Lower Is Better Linux 6.1 Defaults . 31.61 |=================================================== mitigations=off .... 31.18 |================================================== SQLite Speedtest 3.30 Timed Time - Size 1,000 Seconds < Lower Is Better Linux 6.1 Defaults . 31.31 |=================================================== mitigations=off .... 31.39 |=================================================== Stress-NG 0.14.06 Test: x86_64 RdRand Bogo Ops/s > Higher Is Better Linux 6.1 Defaults . 82763.69 |================================================ mitigations=off .... 82746.87 |================================================ Aircrack-ng 1.7 k/s > Higher Is Better Linux 6.1 Defaults . 69682.14 |================================================ mitigations=off .... 69948.19 |================================================ Stress-NG 0.14.06 Test: System V Message Passing Bogo Ops/s > Higher Is Better Linux 6.1 Defaults . 32462582.17 |============================================ mitigations=off .... 32855914.63 |============================================= Stress-NG 0.14.06 Test: Semaphores Bogo Ops/s > Higher Is Better Linux 6.1 Defaults . 3517936.22 |============================================== mitigations=off .... 3519548.92 |============================================== Stress-NG 0.14.06 Test: Glibc C String Functions Bogo Ops/s > Higher Is Better Linux 6.1 Defaults . 3741573.78 |============================================== mitigations=off .... 3778821.91 |============================================== Stress-NG 0.14.06 Test: NUMA Bogo Ops/s > Higher Is Better Linux 6.1 Defaults . 688.80 |================================================== mitigations=off .... 679.66 |================================================= Stress-NG 0.14.06 Test: Malloc Bogo Ops/s > Higher Is Better Linux 6.1 Defaults . 32335069.76 |============================================= mitigations=off .... 32341790.85 |============================================= Stress-NG 0.14.06 Test: Crypto Bogo Ops/s > Higher Is Better Linux 6.1 Defaults . 42801.84 |================================================ mitigations=off .... 42952.32 |================================================ Stress-NG 0.14.06 Test: Memory Copying Bogo Ops/s > Higher Is Better Linux 6.1 Defaults . 7302.74 |================================================= mitigations=off .... 7275.14 |================================================= Stress-NG 0.14.06 Test: Forking Bogo Ops/s > Higher Is Better Linux 6.1 Defaults . 132107.51 |============================================== mitigations=off .... 133593.49 |=============================================== Stress-NG 0.14.06 Test: Vector Math Bogo Ops/s > Higher Is Better Linux 6.1 Defaults . 134428.58 |=============================================== mitigations=off .... 134263.01 |=============================================== Stress-NG 0.14.06 Test: Matrix Math Bogo Ops/s > Higher Is Better Linux 6.1 Defaults . 102476.69 |=============================================== mitigations=off .... 101602.63 |=============================================== Stress-NG 0.14.06 Test: MMAP Bogo Ops/s > Higher Is Better Linux 6.1 Defaults . 664.95 |================================================== mitigations=off .... 649.59 |================================================= Stress-NG 0.14.06 Test: CPU Stress Bogo Ops/s > Higher Is Better Linux 6.1 Defaults . 51499.15 |================================================ mitigations=off .... 51447.48 |================================================ Stress-NG 0.14.06 Test: IO_uring Bogo Ops/s > Higher Is Better Linux 6.1 Defaults . 27773.35 |================================================ mitigations=off .... 27589.43 |================================================ Stress-NG 0.14.06 Test: Glibc Qsort Data Sorting Bogo Ops/s > Higher Is Better Linux 6.1 Defaults . 414.37 |================================================== mitigations=off .... 411.91 |================================================== srsRAN 22.04.1 Test: 4G PHY_DL_Test 100 PRB MIMO 256-QAM UE Mb/s > Higher Is Better Linux 6.1 Defaults . 202.0 |=================================================== mitigations=off .... 201.8 |=================================================== srsRAN 22.04.1 Test: 4G PHY_DL_Test 100 PRB MIMO 256-QAM eNb Mb/s > Higher Is Better Linux 6.1 Defaults . 706.4 |=================================================== mitigations=off .... 712.1 |=================================================== DaCapo Benchmark 9.12-MR1 Java Test: H2 msec < Lower Is Better Linux 6.1 Defaults . 2111 |=================================================== mitigations=off .... 2137 |==================================================== WebP Image Encode 1.2.4 Encode Settings: Quality 100, Lossless, Highest Compression MP/s > Higher Is Better Linux 6.1 Defaults . 0.93 |=================================================== mitigations=off .... 0.94 |==================================================== Renaissance 0.14 Test: Finagle HTTP Requests ms < Lower Is Better Linux 6.1 Defaults . 1992.9 |================================================== mitigations=off .... 1963.9 |================================================= srsRAN 22.04.1 Test: 4G PHY_DL_Test 100 PRB MIMO 64-QAM UE Mb/s > Higher Is Better Linux 6.1 Defaults . 181.5 |=================================================== mitigations=off .... 180.4 |=================================================== srsRAN 22.04.1 Test: 4G PHY_DL_Test 100 PRB MIMO 64-QAM eNb Mb/s > Higher Is Better Linux 6.1 Defaults . 643.2 |=================================================== mitigations=off .... 639.1 |=================================================== Renaissance 0.14 Test: Apache Spark Bayes ms < Lower Is Better Linux 6.1 Defaults . 701.8 |=================================================== mitigations=off .... 697.8 |=================================================== srsRAN 22.04.1 Test: OFDM_Test Samples / Second > Higher Is Better Linux 6.1 Defaults . 199833333 |=============================================== mitigations=off .... 200600000 |=============================================== Facebook RocksDB 7.5.3 Test: Sequential Fill Op/s > Higher Is Better Linux 6.1 Defaults . 1502431 |================================================= mitigations=off .... 1494610 |================================================= DaCapo Benchmark 9.12-MR1 Java Test: Tradesoap msec < Lower Is Better Linux 6.1 Defaults . 1642 |==================================================== mitigations=off .... 1656 |==================================================== Renaissance 0.14 Test: Random Forest ms < Lower Is Better Linux 6.1 Defaults . 380.0 |=================================================== mitigations=off .... 378.8 |=================================================== ASTC Encoder 4.0 Preset: Thorough MT/s > Higher Is Better Linux 6.1 Defaults . 16.24 |=================================================== mitigations=off .... 16.06 |================================================== SVT-AV1 1.2 Encoder Mode: Preset 8 - Input: Bosphorus 4K Frames Per Second > Higher Is Better Linux 6.1 Defaults . 76.35 |================================================== mitigations=off .... 77.34 |=================================================== AOM AV1 3.5 Encoder Mode: Speed 6 Realtime - Input: Bosphorus 4K Frames Per Second > Higher Is Better Linux 6.1 Defaults . 44.19 |================================================== mitigations=off .... 44.71 |=================================================== srsRAN 22.04.1 Test: 4G PHY_DL_Test 100 PRB SISO 64-QAM UE Mb/s > Higher Is Better Linux 6.1 Defaults . 229.1 |=================================================== mitigations=off .... 224.3 |================================================== srsRAN 22.04.1 Test: 4G PHY_DL_Test 100 PRB SISO 64-QAM eNb Mb/s > Higher Is Better Linux 6.1 Defaults . 646.2 |=================================================== mitigations=off .... 631.3 |================================================== srsRAN 22.04.1 Test: 5G PHY_DL_NR Test 52 PRB SISO 64-QAM UE Mb/s > Higher Is Better Linux 6.1 Defaults . 104.3 |=================================================== mitigations=off .... 103.1 |================================================== srsRAN 22.04.1 Test: 5G PHY_DL_NR Test 52 PRB SISO 64-QAM eNb Mb/s > Higher Is Better Linux 6.1 Defaults . 227.5 |=================================================== mitigations=off .... 225.8 |=================================================== ASTC Encoder 4.0 Preset: Fast MT/s > Higher Is Better Linux 6.1 Defaults . 345.11 |================================================== mitigations=off .... 344.76 |================================================== srsRAN 22.04.1 Test: 4G PHY_DL_Test 100 PRB SISO 256-QAM UE Mb/s > Higher Is Better Linux 6.1 Defaults . 245.1 |=================================================== mitigations=off .... 245.5 |=================================================== srsRAN 22.04.1 Test: 4G PHY_DL_Test 100 PRB SISO 256-QAM eNb Mb/s > Higher Is Better Linux 6.1 Defaults . 713.6 |=================================================== mitigations=off .... 713.6 |=================================================== WebP Image Encode 1.2.4 Encode Settings: Quality 100, Lossless MP/s > Higher Is Better Linux 6.1 Defaults . 2.34 |==================================================== mitigations=off .... 2.34 |==================================================== AOM AV1 3.5 Encoder Mode: Speed 8 Realtime - Input: Bosphorus 4K Frames Per Second > Higher Is Better Linux 6.1 Defaults . 65.78 |================================================== mitigations=off .... 66.49 |=================================================== libavif avifenc 0.11 Encoder Speed: 6, Lossless Seconds < Lower Is Better Linux 6.1 Defaults . 5.589 |=================================================== mitigations=off .... 5.453 |================================================== WebP2 Image Encode 20220823 Encode Settings: Quality 100, Compression Effort 5 MP/s > Higher Is Better Linux 6.1 Defaults . 9.11 |================================================== mitigations=off .... 9.46 |==================================================== AOM AV1 3.5 Encoder Mode: Speed 9 Realtime - Input: Bosphorus 4K Frames Per Second > Higher Is Better Linux 6.1 Defaults . 83.60 |================================================== mitigations=off .... 85.91 |=================================================== AOM AV1 3.5 Encoder Mode: Speed 10 Realtime - Input: Bosphorus 4K Frames Per Second > Higher Is Better Linux 6.1 Defaults . 84.71 |================================================== mitigations=off .... 86.62 |=================================================== DaCapo Benchmark 9.12-MR1 Java Test: Tradebeans msec < Lower Is Better Linux 6.1 Defaults . 1709 |==================================================== mitigations=off .... 1719 |==================================================== ASTC Encoder 4.0 Preset: Medium MT/s > Higher Is Better Linux 6.1 Defaults . 126.15 |================================================== mitigations=off .... 126.26 |================================================== DaCapo Benchmark 9.12-MR1 Java Test: Jython msec < Lower Is Better Linux 6.1 Defaults . 1709 |==================================================== mitigations=off .... 1715 |==================================================== libavif avifenc 0.11 Encoder Speed: 10, Lossless Seconds < Lower Is Better Linux 6.1 Defaults . 3.424 |=================================================== mitigations=off .... 3.326 |================================================== OSBench Test: Create Files us Per Event < Lower Is Better Linux 6.1 Defaults . 8.312671 |================================================ mitigations=off .... 8.239698 |================================================ OSBench Test: Memory Allocations Ns Per Event < Lower Is Better Linux 6.1 Defaults . 42.13 |=================================================== mitigations=off .... 40.83 |================================================= OSBench Test: Create Processes us Per Event < Lower Is Better Linux 6.1 Defaults . 17.20 |================================================== mitigations=off .... 17.47 |=================================================== OSBench Test: Launch Programs us Per Event < Lower Is Better Linux 6.1 Defaults . 23.99 |=================================================== mitigations=off .... 23.89 |=================================================== OSBench Test: Create Threads us Per Event < Lower Is Better Linux 6.1 Defaults . 9.116332 |================================================ mitigations=off .... 9.106795 |================================================ Bork File Encrypter 1.4 File Encryption Time Seconds < Lower Is Better Linux 6.1 Defaults . 4.845 |=================================================== mitigations=off .... 4.817 |=================================================== WebP Image Encode 1.2.4 Encode Settings: Quality 100, Highest Compression MP/s > Higher Is Better Linux 6.1 Defaults . 5.18 |==================================================== mitigations=off .... 5.18 |==================================================== SVT-AV1 1.2 Encoder Mode: Preset 10 - Input: Bosphorus 4K Frames Per Second > Higher Is Better Linux 6.1 Defaults . 146.09 |================================================= mitigations=off .... 147.85 |================================================== libavif avifenc 0.11 Encoder Speed: 6 Seconds < Lower Is Better Linux 6.1 Defaults . 3.299 |=================================================== mitigations=off .... 3.242 |================================================== SVT-AV1 1.2 Encoder Mode: Preset 12 - Input: Bosphorus 4K Frames Per Second > Higher Is Better Linux 6.1 Defaults . 216.78 |================================================== mitigations=off .... 217.73 |================================================== WebP2 Image Encode 20220823 Encode Settings: Default MP/s > Higher Is Better Linux 6.1 Defaults . 14.92 |================================================== mitigations=off .... 15.17 |=================================================== WebP Image Encode 1.2.4 Encode Settings: Quality 100 MP/s > Higher Is Better Linux 6.1 Defaults . 16.69 |=================================================== mitigations=off .... 16.64 |=================================================== ctx_clock Context Switch Time Clocks < Lower Is Better Linux 6.1 Defaults . 124 |=================================================== mitigations=off .... 128 |===================================================== WebP Image Encode 1.2.4 Encode Settings: Default MP/s > Higher Is Better Linux 6.1 Defaults . 25.88 |=================================================== mitigations=off .... 25.82 |===================================================