10980xe feb 2023 Intel Core i9-10980XE testing with a ASRock X299 Steel Legend (P1.30 BIOS) and llvmpipe on Ubuntu 22.04 via the Phoronix Test Suite. a: Processor: Intel Core i9-10980XE @ 4.80GHz (18 Cores / 36 Threads), Motherboard: ASRock X299 Steel Legend (P1.30 BIOS), Chipset: Intel Sky Lake-E DMI3 Registers, Memory: 32GB, Disk: Samsung SSD 970 PRO 512GB, Graphics: llvmpipe, Audio: Realtek ALC1220, Network: Intel I219-V + Intel I211 OS: Ubuntu 22.04, Kernel: 5.19.0-051900rc7-generic (x86_64), Desktop: GNOME Shell 42.2, Display Server: X Server 1.21.1.3, OpenGL: 4.5 Mesa 22.0.1 (LLVM 13.0.1 256 bits), Vulkan: 1.2.204, Compiler: GCC 11.3.0, File-System: ext4, Screen Resolution: 1024x768 b: Processor: Intel Core i9-10980XE @ 4.80GHz (18 Cores / 36 Threads), Motherboard: ASRock X299 Steel Legend (P1.30 BIOS), Chipset: Intel Sky Lake-E DMI3 Registers, Memory: 32GB, Disk: Samsung SSD 970 PRO 512GB, Graphics: llvmpipe, Audio: Realtek ALC1220, Network: Intel I219-V + Intel I211 OS: Ubuntu 22.04, Kernel: 5.19.0-051900rc7-generic (x86_64), Desktop: GNOME Shell 42.2, Display Server: X Server 1.21.1.3, OpenGL: 4.5 Mesa 22.0.1 (LLVM 13.0.1 256 bits), Vulkan: 1.2.204, Compiler: GCC 11.3.0, File-System: ext4, Screen Resolution: 1024x768 c: Processor: Intel Core i9-10980XE @ 4.80GHz (18 Cores / 36 Threads), Motherboard: ASRock X299 Steel Legend (P1.30 BIOS), Chipset: Intel Sky Lake-E DMI3 Registers, Memory: 32GB, Disk: Samsung SSD 970 PRO 512GB, Graphics: llvmpipe, Audio: Realtek ALC1220, Network: Intel I219-V + Intel I211 OS: Ubuntu 22.04, Kernel: 5.19.0-051900rc7-generic (x86_64), Desktop: GNOME Shell 42.2, Display Server: X Server 1.21.1.3, OpenGL: 4.5 Mesa 22.0.1 (LLVM 13.0.1 256 bits), Vulkan: 1.2.204, Compiler: GCC 11.3.0, File-System: ext4, Screen Resolution: 1024x768 VVenC 1.7 Video Input: Bosphorus 4K - Video Preset: Fast Frames Per Second > Higher Is Better a . 2.907 |==================================================================== b . 2.914 |==================================================================== c . 2.914 |==================================================================== VVenC 1.7 Video Input: Bosphorus 4K - Video Preset: Faster Frames Per Second > Higher Is Better a . 6.701 |==================================================================== b . 6.669 |==================================================================== c . 6.687 |==================================================================== VVenC 1.7 Video Input: Bosphorus 1080p - Video Preset: Fast Frames Per Second > Higher Is Better a . 5.972 |==================================================================== b . 5.952 |==================================================================== c . 5.955 |==================================================================== VVenC 1.7 Video Input: Bosphorus 1080p - Video Preset: Faster Frames Per Second > Higher Is Better a . 12.92 |=================================================================== b . 13.03 |==================================================================== c . 12.90 |=================================================================== ClickHouse 22.12.3.5 100M Rows Hits Dataset, First Run / Cold Cache Queries Per Minute, Geo Mean > Higher Is Better a . 135.53 |================================================================== a . 135.54 |================================================================== b . 138.39 |=================================================================== c . 133.40 |================================================================= ClickHouse 22.12.3.5 100M Rows Hits Dataset, Second Run Queries Per Minute, Geo Mean > Higher Is Better a . 146.03 |================================================================ a . 153.43 |=================================================================== b . 147.01 |================================================================ c . 146.37 |================================================================ ClickHouse 22.12.3.5 100M Rows Hits Dataset, Third Run Queries Per Minute, Geo Mean > Higher Is Better a . 150.79 |=================================================================== a . 142.36 |=============================================================== b . 151.09 |=================================================================== c . 148.49 |================================================================== Apache Spark 3.3 Row Count: 1000000 - Partitions: 100 - SHA-512 Benchmark Time Seconds < Lower Is Better a . 3.610000000 |============================================================ a . 3.560000000 |=========================================================== b . 3.710000000 |============================================================== c . 3.543322427 |=========================================================== Apache Spark 3.3 Row Count: 1000000 - Partitions: 100 - Calculate Pi Benchmark Seconds < Lower Is Better a . 103.23 |=================================================================== a . 103.63 |=================================================================== b . 103.20 |=================================================================== c . 103.59 |=================================================================== Apache Spark 3.3 Row Count: 1000000 - Partitions: 100 - Calculate Pi Benchmark Using Dataframe Seconds < Lower Is Better a . 5.88 |==================================================================== a . 5.92 |===================================================================== b . 5.91 |===================================================================== c . 5.93 |===================================================================== Apache Spark 3.3 Row Count: 1000000 - Partitions: 100 - Group By Test Time Seconds < Lower Is Better a . 4.62 |===================================================================== a . 4.37 |================================================================= b . 4.47 |=================================================================== c . 4.38 |================================================================= Apache Spark 3.3 Row Count: 1000000 - Partitions: 100 - Repartition Test Time Seconds < Lower Is Better a . 1.98 |===================================================================== a . 1.95 |==================================================================== b . 1.98 |===================================================================== c . 1.97 |===================================================================== Apache Spark 3.3 Row Count: 1000000 - Partitions: 100 - Inner Join Test Time Seconds < Lower Is Better a . 1.467346253 |========================================================== a . 1.560000000 |============================================================== b . 1.530000000 |============================================================= c . 1.540000000 |============================================================= Apache Spark 3.3 Row Count: 1000000 - Partitions: 100 - Broadcast Inner Join Test Time Seconds < Lower Is Better a . 1.27 |======================================================== a . 1.57 |===================================================================== b . 1.36 |============================================================ c . 1.35 |=========================================================== KeyDB 6.3.2 Test: GET - Parallel Connections: 50 Requests Per Second > Higher Is Better a . 1523461.38 |=============================================================== KeyDB 6.3.2 Test: SET - Parallel Connections: 50 Requests Per Second > Higher Is Better a . 1275412.62 |=============================================================== KeyDB 6.3.2 Test: GET - Parallel Connections: 100 Requests Per Second > Higher Is Better a . 1152047.12 |=============================================================== Neural Magic DeepSparse 1.3.2 Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Stream items/sec > Higher Is Better a . 12.09 |==================================================================== b . 12.08 |==================================================================== c . 12.11 |==================================================================== Neural Magic DeepSparse 1.3.2 Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Stream ms/batch < Lower Is Better a . 744.49 |=================================================================== b . 744.69 |=================================================================== c . 743.39 |=================================================================== Neural Magic DeepSparse 1.3.2 Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Synchronous Single-Stream items/sec > Higher Is Better a . 11.31 |=================================================================== b . 11.46 |==================================================================== c . 11.40 |==================================================================== Neural Magic DeepSparse 1.3.2 Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Synchronous Single-Stream ms/batch < Lower Is Better a . 88.37 |==================================================================== b . 87.24 |=================================================================== c . 87.69 |=================================================================== Neural Magic DeepSparse 1.3.2 Model: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Scenario: Asynchronous Multi-Stream items/sec > Higher Is Better a . 231.59 |================================================================== b . 232.89 |=================================================================== c . 233.97 |=================================================================== Neural Magic DeepSparse 1.3.2 Model: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Scenario: Asynchronous Multi-Stream ms/batch < Lower Is Better a . 38.82 |==================================================================== b . 38.62 |==================================================================== c . 38.44 |=================================================================== Neural Magic DeepSparse 1.3.2 Model: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Scenario: Synchronous Single-Stream items/sec > Higher Is Better a . 110.84 |================================================================= b . 114.96 |=================================================================== c . 113.69 |================================================================== Neural Magic DeepSparse 1.3.2 Model: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Scenario: Synchronous Single-Stream ms/batch < Lower Is Better a . 9.0133 |=================================================================== b . 8.6891 |================================================================= c . 8.7863 |================================================================= Neural Magic DeepSparse 1.3.2 Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-Stream items/sec > Higher Is Better a . 53.02 |=================================================================== b . 53.47 |==================================================================== c . 53.05 |=================================================================== Neural Magic DeepSparse 1.3.2 Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-Stream ms/batch < Lower Is Better a . 169.70 |=================================================================== b . 168.17 |================================================================== c . 169.63 |=================================================================== Neural Magic DeepSparse 1.3.2 Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Synchronous Single-Stream items/sec > Higher Is Better a . 46.98 |=================================================================== b . 47.11 |==================================================================== c . 47.42 |==================================================================== Neural Magic DeepSparse 1.3.2 Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Synchronous Single-Stream ms/batch < Lower Is Better a . 21.27 |==================================================================== b . 21.22 |==================================================================== c . 21.08 |=================================================================== Neural Magic DeepSparse 1.3.2 Model: CV Detection, YOLOv5s COCO - Scenario: Asynchronous Multi-Stream items/sec > Higher Is Better a . 97.09 |==================================================================== b . 97.17 |==================================================================== c . 96.25 |=================================================================== Neural Magic DeepSparse 1.3.2 Model: CV Detection, YOLOv5s COCO - Scenario: Asynchronous Multi-Stream ms/batch < Lower Is Better a . 92.60 |=================================================================== b . 92.52 |=================================================================== c . 93.42 |==================================================================== Neural Magic DeepSparse 1.3.2 Model: CV Detection, YOLOv5s COCO - Scenario: Synchronous Single-Stream items/sec > Higher Is Better a . 63.36 |==================================================================== b . 63.22 |==================================================================== c . 63.58 |==================================================================== Neural Magic DeepSparse 1.3.2 Model: CV Detection, YOLOv5s COCO - Scenario: Synchronous Single-Stream ms/batch < Lower Is Better a . 15.77 |==================================================================== b . 15.80 |==================================================================== c . 15.71 |==================================================================== Neural Magic DeepSparse 1.3.2 Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream items/sec > Higher Is Better a . 255.77 |=================================================================== b . 255.43 |=================================================================== c . 255.94 |=================================================================== Neural Magic DeepSparse 1.3.2 Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream ms/batch < Lower Is Better a . 35.16 |==================================================================== b . 35.21 |==================================================================== c . 35.14 |==================================================================== Neural Magic DeepSparse 1.3.2 Model: CV Classification, ResNet-50 ImageNet - Scenario: Synchronous Single-Stream items/sec > Higher Is Better a . 129.12 |================================================================== b . 127.43 |================================================================= c . 131.63 |=================================================================== Neural Magic DeepSparse 1.3.2 Model: CV Classification, ResNet-50 ImageNet - Scenario: Synchronous Single-Stream ms/batch < Lower Is Better a . 7.7325 |================================================================== b . 7.8358 |=================================================================== c . 7.5867 |================================================================= Neural Magic DeepSparse 1.3.2 Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream items/sec > Higher Is Better a . 124.70 |================================================================== b . 127.20 |=================================================================== c . 121.97 |================================================================ Neural Magic DeepSparse 1.3.2 Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream ms/batch < Lower Is Better a . 72.15 |=================================================================== b . 70.74 |================================================================= c . 73.77 |==================================================================== Neural Magic DeepSparse 1.3.2 Model: NLP Text Classification, DistilBERT mnli - Scenario: Synchronous Single-Stream items/sec > Higher Is Better a . 71.98 |=============================================================== b . 78.09 |==================================================================== c . 75.75 |================================================================== Neural Magic DeepSparse 1.3.2 Model: NLP Text Classification, DistilBERT mnli - Scenario: Synchronous Single-Stream ms/batch < Lower Is Better a . 13.88 |==================================================================== b . 12.80 |=============================================================== c . 13.19 |================================================================= Neural Magic DeepSparse 1.3.2 Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Asynchronous Multi-Stream items/sec > Higher Is Better a . 22.94 |==================================================================== b . 22.55 |=================================================================== c . 22.57 |=================================================================== Neural Magic DeepSparse 1.3.2 Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Asynchronous Multi-Stream ms/batch < Lower Is Better a . 392.29 |================================================================== b . 399.09 |=================================================================== c . 398.72 |=================================================================== Neural Magic DeepSparse 1.3.2 Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Synchronous Single-Stream items/sec > Higher Is Better a . 22.70 |==================================================================== b . 22.66 |==================================================================== c . 22.37 |=================================================================== Neural Magic DeepSparse 1.3.2 Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Synchronous Single-Stream ms/batch < Lower Is Better a . 44.04 |=================================================================== b . 44.10 |=================================================================== c . 44.68 |==================================================================== Neural Magic DeepSparse 1.3.2 Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-Stream items/sec > Higher Is Better a . 63.65 |=================================================================== b . 63.42 |=================================================================== c . 64.40 |==================================================================== Neural Magic DeepSparse 1.3.2 Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-Stream ms/batch < Lower Is Better a . 141.38 |=================================================================== b . 141.90 |=================================================================== c . 139.72 |================================================================== Neural Magic DeepSparse 1.3.2 Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Synchronous Single-Stream items/sec > Higher Is Better a . 41.29 |=================================================================== b . 39.60 |================================================================ c . 41.86 |==================================================================== Neural Magic DeepSparse 1.3.2 Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Synchronous Single-Stream ms/batch < Lower Is Better a . 24.21 |================================================================= b . 25.24 |==================================================================== c . 23.88 |================================================================ Neural Magic DeepSparse 1.3.2 Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Stream items/sec > Higher Is Better a . 12.36 |==================================================================== b . 12.35 |==================================================================== c . 12.32 |==================================================================== Neural Magic DeepSparse 1.3.2 Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Stream ms/batch < Lower Is Better a . 728.03 |=================================================================== b . 728.86 |=================================================================== c . 730.38 |=================================================================== Neural Magic DeepSparse 1.3.2 Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Synchronous Single-Stream items/sec > Higher Is Better a . 11.45 |==================================================================== b . 11.23 |=================================================================== c . 11.27 |=================================================================== Neural Magic DeepSparse 1.3.2 Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Synchronous Single-Stream ms/batch < Lower Is Better a . 87.30 |=================================================================== b . 89.00 |==================================================================== c . 88.74 |==================================================================== RocksDB 7.9.2 Test: Random Fill Op/s > Higher Is Better a . 1145133 |================================================================= b . 1157063 |================================================================== c . 1146614 |================================================================= RocksDB 7.9.2 Test: Random Read Op/s > Higher Is Better a . 80437935 |================================================================ b . 81639198 |================================================================= c . 82098045 |================================================================= RocksDB 7.9.2 Test: Update Random Op/s > Higher Is Better a . 656969 |=================================================================== b . 659313 |=================================================================== c . 661009 |=================================================================== RocksDB 7.9.2 Test: Sequential Fill Op/s > Higher Is Better a . 1315521 |================================================================== b . 1316396 |================================================================== c . 1319647 |================================================================== RocksDB 7.9.2 Test: Random Fill Sync Op/s > Higher Is Better a . 4683 |===================================================================== b . 4712 |===================================================================== c . 4555 |=================================================================== RocksDB 7.9.2 Test: Read While Writing Op/s > Higher Is Better a . 3303735 |================================================================ b . 3409823 |================================================================== c . 3306782 |================================================================ RocksDB 7.9.2 Test: Read Random Write Random Op/s > Higher Is Better a . 2250910 |================================================================== b . 2254812 |================================================================== c . 2254824 |==================================================================