dds AMD Ryzen 7 PRO 5850U testing with a HP 8A78 (F.04 BIOS) and AMD Cezanne 512MB on Pop 22.04 via the Phoronix Test Suite. s: Processor: AMD Ryzen 7 PRO 5850U @ 4.51GHz (8 Cores / 16 Threads), Motherboard: HP 8A78 (F.04 BIOS), Chipset: AMD Renoir/Cezanne, Memory: 16GB, Disk: 1024GB SK hynix PC711 HFS001TDE9X073N, Graphics: AMD Cezanne 512MB (2000/400MHz), Audio: AMD Renoir Radeon HD Audio, Network: Realtek RTL8822CE 802.11ac PCIe OS: Pop 22.04, Kernel: 5.19.0-76051900-generic (x86_64), Desktop: GNOME Shell 42.3.1, Display Server: X Server 1.21.1.3, OpenGL: 4.6 Mesa 22.0.5 (LLVM 13.0.1 DRM 3.47), Vulkan: 1.3.204, Compiler: GCC 11.2.0, File-System: ext4, Screen Resolution: 1920x1080 b: Processor: AMD Ryzen 7 PRO 5850U @ 4.51GHz (8 Cores / 16 Threads), Motherboard: HP 8A78 (F.04 BIOS), Chipset: AMD Renoir/Cezanne, Memory: 16GB, Disk: 1024GB SK hynix PC711 HFS001TDE9X073N, Graphics: AMD Cezanne 512MB (2000/400MHz), Audio: AMD Renoir Radeon HD Audio, Network: Realtek RTL8822CE 802.11ac PCIe OS: Pop 22.04, Kernel: 5.19.0-76051900-generic (x86_64), Desktop: GNOME Shell 42.3.1, Display Server: X Server 1.21.1.3, OpenGL: 4.6 Mesa 22.0.5 (LLVM 13.0.1 DRM 3.47), Vulkan: 1.3.204, Compiler: GCC 11.2.0, File-System: ext4, Screen Resolution: 1920x1080 c: Processor: AMD Ryzen 7 PRO 5850U @ 4.51GHz (8 Cores / 16 Threads), Motherboard: HP 8A78 (F.04 BIOS), Chipset: AMD Renoir/Cezanne, Memory: 16GB, Disk: 1024GB SK hynix PC711 HFS001TDE9X073N, Graphics: AMD Cezanne 512MB (2000/400MHz), Audio: AMD Renoir Radeon HD Audio, Network: Realtek RTL8822CE 802.11ac PCIe OS: Pop 22.04, Kernel: 5.19.0-76051900-generic (x86_64), Desktop: GNOME Shell 42.3.1, Display Server: X Server 1.21.1.3, OpenGL: 4.6 Mesa 22.0.5 (LLVM 13.0.1 DRM 3.47), Vulkan: 1.3.204, Compiler: GCC 11.2.0, File-System: ext4, Screen Resolution: 1920x1080 OpenEMS 0.0.35-86 Test: pyEMS Coupler MCells/s > Higher Is Better s . 28.40 |==================================================================== b . 28.14 |=================================================================== c . 28.34 |==================================================================== OpenEMS 0.0.35-86 Test: openEMS MSL_NotchFilter MCells/s > Higher Is Better s . 72.46 |================================================================== b . 75.09 |==================================================================== c . 73.38 |================================================================== Neural Magic DeepSparse 1.3.2 Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Stream ms/batch < Lower Is Better s . 897.72 |=================================================================== b . 892.99 |=================================================================== c . 895.31 |=================================================================== Neural Magic DeepSparse 1.3.2 Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Synchronous Single-Stream items/sec > Higher Is Better s . 4.3484 |=================================================================== b . 4.3458 |=================================================================== c . 4.3407 |=================================================================== Neural Magic DeepSparse 1.3.2 Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Synchronous Single-Stream ms/batch < Lower Is Better s . 229.96 |=================================================================== b . 230.09 |=================================================================== c . 230.36 |=================================================================== Neural Magic DeepSparse 1.3.2 Model: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Scenario: Asynchronous Multi-Stream items/sec > Higher Is Better s . 60.11 |================================================================== b . 60.83 |=================================================================== c . 61.65 |==================================================================== Neural Magic DeepSparse 1.3.2 Model: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Scenario: Asynchronous Multi-Stream ms/batch < Lower Is Better s . 66.53 |==================================================================== b . 65.73 |=================================================================== c . 64.86 |================================================================== Neural Magic DeepSparse 1.3.2 Model: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Scenario: Synchronous Single-Stream items/sec > Higher Is Better s . 49.84 |==================================================================== b . 49.44 |=================================================================== c . 49.70 |==================================================================== Unvanquished 0.54 Resolution: 1920 x 1080 - Effects Quality: Medium Frames Per Second > Higher Is Better s . 277.3 |=================================================================== b . 282.7 |==================================================================== c . 230.3 |======================================================= Unvanquished 0.54 Resolution: 1920 x 1080 - Effects Quality: Ultra Frames Per Second > Higher Is Better s . 177.1 |=================================================================== b . 176.3 |=================================================================== c . 179.3 |==================================================================== Neural Magic DeepSparse 1.3.2 Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Stream items/sec > Higher Is Better s . 4.4326 |================================================================== b . 4.4792 |=================================================================== c . 4.4656 |=================================================================== Neural Magic DeepSparse 1.3.2 Model: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Scenario: Synchronous Single-Stream ms/batch < Lower Is Better s . 20.05 |=================================================================== b . 20.22 |==================================================================== c . 20.11 |==================================================================== Neural Magic DeepSparse 1.3.2 Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-Stream items/sec > Higher Is Better s . 18.05 |=================================================================== b . 18.28 |==================================================================== c . 18.19 |==================================================================== Neural Magic DeepSparse 1.3.2 Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-Stream ms/batch < Lower Is Better s . 221.41 |=================================================================== b . 218.42 |================================================================== c . 219.62 |================================================================== Neural Magic DeepSparse 1.3.2 Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Synchronous Single-Stream items/sec > Higher Is Better s . 16.17 |==================================================================== b . 16.11 |==================================================================== c . 16.20 |==================================================================== Neural Magic DeepSparse 1.3.2 Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Synchronous Single-Stream ms/batch < Lower Is Better s . 61.83 |==================================================================== b . 62.06 |==================================================================== c . 61.73 |==================================================================== Neural Magic DeepSparse 1.3.2 Model: CV Detection, YOLOv5s COCO - Scenario: Asynchronous Multi-Stream items/sec > Higher Is Better s . 26.72 |==================================================================== b . 26.71 |==================================================================== c . 26.76 |==================================================================== Neural Magic DeepSparse 1.3.2 Model: CV Detection, YOLOv5s COCO - Scenario: Asynchronous Multi-Stream ms/batch < Lower Is Better s . 149.65 |=================================================================== b . 149.71 |=================================================================== c . 149.40 |=================================================================== Neural Magic DeepSparse 1.3.2 Model: CV Detection, YOLOv5s COCO - Scenario: Synchronous Single-Stream items/sec > Higher Is Better s . 24.83 |==================================================================== b . 24.90 |==================================================================== c . 24.87 |==================================================================== Neural Magic DeepSparse 1.3.2 Model: CV Detection, YOLOv5s COCO - Scenario: Synchronous Single-Stream ms/batch < Lower Is Better s . 40.25 |==================================================================== b . 40.14 |==================================================================== c . 40.19 |==================================================================== Neural Magic DeepSparse 1.3.2 Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream items/sec > Higher Is Better s . 59.59 |==================================================================== b . 59.23 |==================================================================== c . 59.52 |==================================================================== Neural Magic DeepSparse 1.3.2 Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream ms/batch < Lower Is Better s . 67.11 |==================================================================== b . 67.51 |==================================================================== c . 67.19 |==================================================================== Neural Magic DeepSparse 1.3.2 Model: CV Classification, ResNet-50 ImageNet - Scenario: Synchronous Single-Stream items/sec > Higher Is Better s . 53.55 |==================================================================== b . 53.73 |==================================================================== c . 53.57 |==================================================================== Neural Magic DeepSparse 1.3.2 Model: CV Classification, ResNet-50 ImageNet - Scenario: Synchronous Single-Stream ms/batch < Lower Is Better s . 18.66 |==================================================================== b . 18.60 |==================================================================== c . 18.65 |==================================================================== Neural Magic DeepSparse 1.3.2 Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream items/sec > Higher Is Better s . 39.09 |=================================================================== b . 39.55 |==================================================================== c . 39.58 |==================================================================== Neural Magic DeepSparse 1.3.2 Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream ms/batch < Lower Is Better s . 102.30 |=================================================================== b . 101.12 |================================================================== c . 101.03 |================================================================== Neural Magic DeepSparse 1.3.2 Model: NLP Text Classification, DistilBERT mnli - Scenario: Synchronous Single-Stream items/sec > Higher Is Better s . 34.93 |==================================================================== b . 34.98 |==================================================================== c . 34.96 |==================================================================== Neural Magic DeepSparse 1.3.2 Model: NLP Text Classification, DistilBERT mnli - Scenario: Synchronous Single-Stream ms/batch < Lower Is Better s . 28.62 |==================================================================== b . 28.58 |==================================================================== c . 28.59 |==================================================================== Neural Magic DeepSparse 1.3.2 Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Asynchronous Multi-Stream items/sec > Higher Is Better s . 6.6780 |=================================================================== b . 6.6499 |=================================================================== c . 6.6511 |=================================================================== Neural Magic DeepSparse 1.3.2 Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Asynchronous Multi-Stream ms/batch < Lower Is Better s . 598.95 |=================================================================== b . 601.48 |=================================================================== c . 601.37 |=================================================================== Neural Magic DeepSparse 1.3.2 Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Synchronous Single-Stream items/sec > Higher Is Better s . 6.5375 |=================================================================== b . 6.5335 |=================================================================== c . 6.5336 |=================================================================== Neural Magic DeepSparse 1.3.2 Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Synchronous Single-Stream ms/batch < Lower Is Better s . 152.95 |=================================================================== b . 153.04 |=================================================================== c . 153.04 |=================================================================== Neural Magic DeepSparse 1.3.2 Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-Stream items/sec > Higher Is Better s . 19.42 |==================================================================== b . 19.42 |==================================================================== c . 19.39 |==================================================================== Unvanquished 0.54 Resolution: 1920 x 1080 - Effects Quality: High Frames Per Second > Higher Is Better s . 230.8 |==================================================================== b . 206.9 |============================================================= c . 220.8 |================================================================= Neural Magic DeepSparse 1.3.2 Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-Stream ms/batch < Lower Is Better s . 205.94 |=================================================================== b . 205.95 |=================================================================== c . 206.30 |=================================================================== Neural Magic DeepSparse 1.3.2 Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Synchronous Single-Stream items/sec > Higher Is Better s . 17.35 |==================================================================== b . 17.32 |==================================================================== c . 17.31 |==================================================================== Neural Magic DeepSparse 1.3.2 Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Synchronous Single-Stream ms/batch < Lower Is Better s . 57.64 |==================================================================== b . 57.71 |==================================================================== c . 57.74 |==================================================================== Neural Magic DeepSparse 1.3.2 Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Stream items/sec > Higher Is Better s . 4.4669 |=================================================================== b . 4.4933 |=================================================================== c . 4.4681 |=================================================================== Neural Magic DeepSparse 1.3.2 Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Stream ms/batch < Lower Is Better s . 895.44 |=================================================================== b . 890.19 |=================================================================== c . 895.20 |=================================================================== Neural Magic DeepSparse 1.3.2 Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Synchronous Single-Stream items/sec > Higher Is Better s . 4.3440 |=================================================================== b . 4.3485 |=================================================================== c . 4.3555 |=================================================================== Neural Magic DeepSparse 1.3.2 Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Synchronous Single-Stream ms/batch < Lower Is Better s . 230.19 |=================================================================== b . 229.95 |=================================================================== c . 229.58 |=================================================================== VVenC 1.7 Video Input: Bosphorus 4K - Video Preset: Fast Frames Per Second > Higher Is Better s . 2.254 |==================================================================== b . 2.257 |==================================================================== c . 2.258 |==================================================================== VVenC 1.7 Video Input: Bosphorus 4K - Video Preset: Faster Frames Per Second > Higher Is Better s . 4.881 |==================================================================== b . 4.840 |=================================================================== c . 4.828 |=================================================================== VVenC 1.7 Video Input: Bosphorus 1080p - Video Preset: Fast Frames Per Second > Higher Is Better s . 6.485 |==================================================================== b . 6.479 |==================================================================== c . 6.475 |==================================================================== VVenC 1.7 Video Input: Bosphorus 1080p - Video Preset: Faster Frames Per Second > Higher Is Better s . 15.59 |==================================================================== b . 15.42 |=================================================================== c . 15.58 |==================================================================== Apache Spark 3.3 Row Count: 1000000 - Partitions: 100 - SHA-512 Benchmark Time Seconds < Lower Is Better s . 4.24 |================================================================ b . 4.31 |================================================================= c . 4.60 |===================================================================== Apache Spark 3.3 Row Count: 1000000 - Partitions: 100 - Calculate Pi Benchmark Seconds < Lower Is Better s . 233.02 |=================================================================== b . 234.51 |=================================================================== c . 232.54 |================================================================== Apache Spark 3.3 Row Count: 1000000 - Partitions: 100 - Calculate Pi Benchmark Using Dataframe Seconds < Lower Is Better s . 12.95 |=================================================================== b . 12.89 |=================================================================== c . 13.05 |==================================================================== Apache Spark 3.3 Row Count: 1000000 - Partitions: 100 - Group By Test Time Seconds < Lower Is Better s . 4.34 |==================================================================== b . 4.29 |=================================================================== c . 4.41 |===================================================================== Apache Spark 3.3 Row Count: 1000000 - Partitions: 100 - Repartition Test Time Seconds < Lower Is Better s . 3.26 |===================================================================== b . 3.08 |================================================================= c . 3.26 |===================================================================== Apache Spark 3.3 Row Count: 1000000 - Partitions: 100 - Inner Join Test Time Seconds < Lower Is Better s . 2.420000000 |============================================================== b . 2.340000000 |============================================================ c . 2.397617523 |============================================================= Apache Spark 3.3 Row Count: 1000000 - Partitions: 100 - Broadcast Inner Join Test Time Seconds < Lower Is Better s . 1.990703468 |============================================================== b . 1.940000000 |============================================================ c . 1.920000000 |============================================================ ClickHouse 22.12.3.5 100M Rows Hits Dataset, First Run / Cold Cache Queries Per Minute, Geo Mean > Higher Is Better s . 90.16 |================================================================== b . 90.73 |================================================================== c . 92.90 |==================================================================== ClickHouse 22.12.3.5 100M Rows Hits Dataset, Second Run Queries Per Minute, Geo Mean > Higher Is Better s . 100.05 |================================================================== b . 100.50 |=================================================================== c . 101.23 |=================================================================== ClickHouse 22.12.3.5 100M Rows Hits Dataset, Third Run Queries Per Minute, Geo Mean > Higher Is Better s . 102.13 |=================================================================== b . 102.82 |=================================================================== c . 101.36 |================================================================== Memcached 1.6.18 Set To Get Ratio: 1:1 Ops/sec > Higher Is Better s . 1830535.33 |=============================================================== b . 1835865.54 |=============================================================== c . 1812832.85 |============================================================== Memcached 1.6.18 Set To Get Ratio: 1:5 Ops/sec > Higher Is Better s . 1466197.67 |=============================================================== b . 1455028.55 |=============================================================== c . 1449002.16 |============================================================== Memcached 1.6.18 Set To Get Ratio: 1:10 Ops/sec > Higher Is Better s . 1331770.61 |============================================================== b . 1322702.52 |============================================================= c . 1359271.06 |=============================================================== Memcached 1.6.18 Set To Get Ratio: 1:100 Ops/sec > Higher Is Better s . 1243196.21 |============================================================== b . 1247617.09 |============================================================== c . 1269999.44 |=============================================================== KeyDB 6.3.2 Test: GET - Parallel Connections: 50 Requests Per Second > Higher Is Better s . 1893222.25 |=============================================== b . 1441420.62 |==================================== c . 2543882.00 |=============================================================== KeyDB 6.3.2 Test: SET - Parallel Connections: 50 Requests Per Second > Higher Is Better s . 1859289.00 |========================================================= b . 2049264.25 |=============================================================== c . 1958326.88 |============================================================ KeyDB 6.3.2 Test: LPOP - Parallel Connections: 50 Requests Per Second > Higher Is Better s . 2094328.50 |===================================================== b . 2481759.25 |=============================================================== c . 1872168.25 |================================================ KeyDB 6.3.2 Test: SADD - Parallel Connections: 50 Requests Per Second > Higher Is Better s . 1819041.75 |===================================================== b . 1482755.50 |=========================================== c . 2163659.25 |=============================================================== KeyDB 6.3.2 Test: HMSET - Parallel Connections: 50 Requests Per Second > Higher Is Better s . 700928.06 |================================================================ b . 698753.44 |================================================================ c . 698597.25 |================================================================ KeyDB 6.3.2 Test: LPUSH - Parallel Connections: 50 Requests Per Second > Higher Is Better s . 1639720.62 |============================================================== b . 1509342.88 |========================================================= c . 1662123.50 |=============================================================== RocksDB 7.9.2 Test: Random Fill Op/s > Higher Is Better s . 733471 |=================================================================== b . 734273 |=================================================================== c . 732871 |=================================================================== RocksDB 7.9.2 Test: Random Read Op/s > Higher Is Better s . 35831332 |================================================================= b . 35504961 |================================================================ c . 35910234 |================================================================= RocksDB 7.9.2 Test: Update Random Op/s > Higher Is Better s . 369357 |=================================================================== b . 370999 |=================================================================== c . 369363 |=================================================================== RocksDB 7.9.2 Test: Sequential Fill Op/s > Higher Is Better s . 988800 |================================================================= b . 1005983 |================================================================== c . 994060 |================================================================= RocksDB 7.9.2 Test: Random Fill Sync Op/s > Higher Is Better s . 15188 |==================================================================== b . 15150 |==================================================================== c . 15196 |==================================================================== RocksDB 7.9.2 Test: Read While Writing Op/s > Higher Is Better s . 1606138 |================================================================ b . 1647252 |================================================================== c . 1656909 |================================================================== RocksDB 7.9.2 Test: Read Random Write Random Op/s > Higher Is Better s . 1221543 |================================================================= b . 1234760 |================================================================== c . 1233032 |================================================================== ET: Legacy 2.81 Resolution: 1920 x 1080 Frames Per Second > Higher Is Better s . 157.8 |============================================================== b . 169.4 |=================================================================== c . 171.8 |====================================================================