whiskey 2023 Intel Core i7-8565U testing with a Dell 0KTW76 (1.17.0 BIOS) and Intel UHD 620 WHL GT2 15GB on Ubuntu 22.04 via the Phoronix Test Suite. a: Processor: Intel Core i7-8565U @ 4.60GHz (4 Cores / 8 Threads), Motherboard: Dell 0KTW76 (1.17.0 BIOS), Chipset: Intel Cannon Point-LP, Memory: 16GB, Disk: SK hynix PC401 NVMe 256GB, Graphics: Intel UHD 620 WHL GT2 15GB (1150MHz), Audio: Realtek ALC3271, Network: Qualcomm Atheros QCA6174 802.11ac OS: Ubuntu 22.04, Kernel: 5.19.0-rc6-phx-retbleed (x86_64), Desktop: GNOME Shell 42.2, Display Server: X Server + Wayland, OpenGL: 4.6 Mesa 22.0.1, OpenCL: OpenCL 3.0, Vulkan: 1.3.204, Compiler: GCC 11.3.0, File-System: ext4, Screen Resolution: 1920x1080 b: Processor: Intel Core i7-8565U @ 4.60GHz (4 Cores / 8 Threads), Motherboard: Dell 0KTW76 (1.17.0 BIOS), Chipset: Intel Cannon Point-LP, Memory: 16GB, Disk: SK hynix PC401 NVMe 256GB, Graphics: Intel UHD 620 WHL GT2 15GB (1150MHz), Audio: Realtek ALC3271, Network: Qualcomm Atheros QCA6174 802.11ac OS: Ubuntu 22.04, Kernel: 5.19.0-rc6-phx-retbleed (x86_64), Desktop: GNOME Shell 42.2, Display Server: X Server + Wayland, OpenGL: 4.6 Mesa 22.0.1, OpenCL: OpenCL 3.0, Vulkan: 1.3.204, Compiler: GCC 11.3.0, File-System: ext4, Screen Resolution: 1920x1080 c: Processor: Intel Core i7-8565U @ 4.60GHz (4 Cores / 8 Threads), Motherboard: Dell 0KTW76 (1.17.0 BIOS), Chipset: Intel Cannon Point-LP, Memory: 16GB, Disk: SK hynix PC401 NVMe 256GB, Graphics: Intel UHD 620 WHL GT2 15GB (1150MHz), Audio: Realtek ALC3271, Network: Qualcomm Atheros QCA6174 802.11ac OS: Ubuntu 22.04, Kernel: 5.19.0-rc6-phx-retbleed (x86_64), Desktop: GNOME Shell 42.2, Display Server: X Server + Wayland, OpenGL: 4.6 Mesa 22.0.1, OpenCL: OpenCL 3.0, Vulkan: 1.3.204, Compiler: GCC 11.3.0, File-System: ext4, Screen Resolution: 1920x1080 ET: Legacy 2.81 Resolution: 1920 x 1080 Frames Per Second > Higher Is Better a . 69.1 |=================================================================== b . 70.9 |===================================================================== c . 70.1 |==================================================================== Unvanquished 0.54 Resolution: 1920 x 1080 - Effects Quality: High Frames Per Second > Higher Is Better a . 81.1 |==================================================================== b . 81.3 |==================================================================== c . 82.1 |===================================================================== Unvanquished 0.54 Resolution: 1920 x 1080 - Effects Quality: Ultra Frames Per Second > Higher Is Better a . 44.7 |===================================================================== b . 44.7 |===================================================================== c . 44.7 |===================================================================== Unvanquished 0.54 Resolution: 1920 x 1080 - Effects Quality: Medium Frames Per Second > Higher Is Better a . 158.2 |==================================================================== b . 157.0 |=================================================================== c . 157.0 |=================================================================== VVenC 1.7 Video Input: Bosphorus 4K - Video Preset: Fast Frames Per Second > Higher Is Better a . 0.950 |================================================================== b . 0.981 |==================================================================== c . 0.909 |=============================================================== VVenC 1.7 Video Input: Bosphorus 4K - Video Preset: Faster Frames Per Second > Higher Is Better a . 2.037 |================================================================ b . 2.154 |==================================================================== c . 1.773 |======================================================== VVenC 1.7 Video Input: Bosphorus 1080p - Video Preset: Fast Frames Per Second > Higher Is Better a . 2.926 |================================================================ b . 3.089 |==================================================================== c . 2.644 |========================================================== VVenC 1.7 Video Input: Bosphorus 1080p - Video Preset: Faster Frames Per Second > Higher Is Better a . 7.902 |==================================================================== b . 7.447 |================================================================ c . 7.530 |================================================================= Memcached 1.6.18 Set To Get Ratio: 1:5 Ops/sec > Higher Is Better a . 538809.67 |============================================================== b . 557004.30 |================================================================ c . 549836.96 |=============================================================== Memcached 1.6.18 Set To Get Ratio: 1:10 Ops/sec > Higher Is Better a . 501410.40 |================================================================ b . 498153.29 |================================================================ c . 486670.16 |============================================================== Memcached 1.6.18 Set To Get Ratio: 1:100 Ops/sec > Higher Is Better a . 483749.69 |============================================================ b . 519516.91 |================================================================ c . 510063.94 |=============================================================== Neural Magic DeepSparse 1.3.2 Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Stream items/sec > Higher Is Better a . 2.3995 |================================================================= b . 2.4593 |=================================================================== c . 2.4534 |=================================================================== Neural Magic DeepSparse 1.3.2 Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Stream ms/batch < Lower Is Better a . 833.49 |=================================================================== b . 813.21 |================================================================= c . 815.16 |================================================================== Neural Magic DeepSparse 1.3.2 Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Synchronous Single-Stream items/sec > Higher Is Better a . 1.8483 |======================================================== b . 2.1935 |=================================================================== c . 2.0565 |=============================================================== Neural Magic DeepSparse 1.3.2 Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Synchronous Single-Stream ms/batch < Lower Is Better a . 541.04 |=================================================================== b . 455.88 |======================================================== c . 486.25 |============================================================ Neural Magic DeepSparse 1.3.2 Model: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Scenario: Asynchronous Multi-Stream items/sec > Higher Is Better a . 33.88 |==================================================================== b . 32.55 |================================================================= c . 32.43 |================================================================= Neural Magic DeepSparse 1.3.2 Model: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Scenario: Asynchronous Multi-Stream ms/batch < Lower Is Better a . 59.00 |================================================================= b . 61.40 |==================================================================== c . 61.61 |==================================================================== Neural Magic DeepSparse 1.3.2 Model: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Scenario: Synchronous Single-Stream items/sec > Higher Is Better a . 24.78 |================================================================= b . 24.47 |================================================================= c . 25.73 |==================================================================== Neural Magic DeepSparse 1.3.2 Model: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Scenario: Synchronous Single-Stream ms/batch < Lower Is Better a . 40.35 |=================================================================== b . 40.85 |==================================================================== c . 38.85 |================================================================= Neural Magic DeepSparse 1.3.2 Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-Stream items/sec > Higher Is Better a . 9.3547 |================================================================== b . 9.4726 |=================================================================== c . 9.3736 |================================================================== Neural Magic DeepSparse 1.3.2 Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-Stream ms/batch < Lower Is Better a . 213.67 |=================================================================== b . 210.80 |================================================================== c . 213.14 |=================================================================== Neural Magic DeepSparse 1.3.2 Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Synchronous Single-Stream items/sec > Higher Is Better a . 7.5943 |=========================================================== b . 7.8555 |============================================================= c . 8.6591 |=================================================================== Neural Magic DeepSparse 1.3.2 Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Synchronous Single-Stream ms/batch < Lower Is Better a . 131.67 |=================================================================== b . 127.29 |================================================================= c . 115.47 |=========================================================== Neural Magic DeepSparse 1.3.2 Model: CV Detection, YOLOv5s COCO - Scenario: Asynchronous Multi-Stream items/sec > Higher Is Better a . 13.74 |==================================================================== b . 13.74 |==================================================================== c . 11.92 |=========================================================== Neural Magic DeepSparse 1.3.2 Model: CV Detection, YOLOv5s COCO - Scenario: Asynchronous Multi-Stream ms/batch < Lower Is Better a . 145.51 |========================================================== b . 145.43 |========================================================== c . 167.55 |=================================================================== Neural Magic DeepSparse 1.3.2 Model: CV Detection, YOLOv5s COCO - Scenario: Synchronous Single-Stream items/sec > Higher Is Better a . 10.65 |===================================================== b . 10.75 |====================================================== c . 13.54 |==================================================================== Neural Magic DeepSparse 1.3.2 Model: CV Detection, YOLOv5s COCO - Scenario: Synchronous Single-Stream ms/batch < Lower Is Better a . 93.90 |==================================================================== b . 93.00 |=================================================================== c . 73.84 |===================================================== Neural Magic DeepSparse 1.3.2 Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream items/sec > Higher Is Better a . 28.94 |=================================================================== b . 29.30 |==================================================================== c . 23.98 |======================================================== Neural Magic DeepSparse 1.3.2 Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream ms/batch < Lower Is Better a . 69.07 |======================================================== b . 68.24 |======================================================== c . 83.35 |==================================================================== Neural Magic DeepSparse 1.3.2 Model: CV Classification, ResNet-50 ImageNet - Scenario: Synchronous Single-Stream items/sec > Higher Is Better a . 22.06 |===================================================== b . 28.23 |=================================================================== c . 28.48 |==================================================================== Neural Magic DeepSparse 1.3.2 Model: CV Classification, ResNet-50 ImageNet - Scenario: Synchronous Single-Stream ms/batch < Lower Is Better a . 45.32 |==================================================================== b . 35.41 |===================================================== c . 35.10 |===================================================== Neural Magic DeepSparse 1.3.2 Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream items/sec > Higher Is Better a . 22.13 |==================================================================== b . 21.48 |================================================================== c . 22.10 |==================================================================== Neural Magic DeepSparse 1.3.2 Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream ms/batch < Lower Is Better a . 90.29 |================================================================== b . 93.09 |==================================================================== c . 90.38 |================================================================== Neural Magic DeepSparse 1.3.2 Model: NLP Text Classification, DistilBERT mnli - Scenario: Synchronous Single-Stream items/sec > Higher Is Better a . 18.33 |==================================================================== b . 18.00 |=================================================================== c . 16.43 |============================================================= Neural Magic DeepSparse 1.3.2 Model: NLP Text Classification, DistilBERT mnli - Scenario: Synchronous Single-Stream ms/batch < Lower Is Better a . 54.54 |============================================================= b . 55.55 |============================================================== c . 60.85 |==================================================================== Neural Magic DeepSparse 1.3.2 Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Asynchronous Multi-Stream items/sec > Higher Is Better a . 3.6723 |================================================================ b . 3.7060 |================================================================= c . 3.8496 |=================================================================== Neural Magic DeepSparse 1.3.2 Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Asynchronous Multi-Stream ms/batch < Lower Is Better a . 544.58 |=================================================================== b . 535.30 |================================================================== c . 519.50 |================================================================ Neural Magic DeepSparse 1.3.2 Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Synchronous Single-Stream items/sec > Higher Is Better a . 3.5507 |=============================================================== b . 3.7619 |=================================================================== c . 3.3768 |============================================================ Neural Magic DeepSparse 1.3.2 Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Synchronous Single-Stream ms/batch < Lower Is Better a . 281.62 |================================================================ b . 265.80 |============================================================ c . 296.12 |=================================================================== Neural Magic DeepSparse 1.3.2 Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-Stream items/sec > Higher Is Better a . 10.57 |=================================================================== b . 10.65 |==================================================================== c . 10.46 |=================================================================== Neural Magic DeepSparse 1.3.2 Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-Stream ms/batch < Lower Is Better a . 189.13 |================================================================== b . 187.64 |================================================================== c . 191.13 |=================================================================== Neural Magic DeepSparse 1.3.2 Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Synchronous Single-Stream items/sec > Higher Is Better a . 8.2184 |================================================================ b . 8.6263 |=================================================================== c . 7.9541 |============================================================== Neural Magic DeepSparse 1.3.2 Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Synchronous Single-Stream ms/batch < Lower Is Better a . 121.67 |================================================================= b . 115.91 |============================================================== c . 125.71 |=================================================================== Neural Magic DeepSparse 1.3.2 Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Stream items/sec > Higher Is Better a . 2.4005 |================================================================== b . 2.4152 |================================================================== c . 2.4432 |=================================================================== Neural Magic DeepSparse 1.3.2 Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Stream ms/batch < Lower Is Better a . 828.55 |=================================================================== b . 825.40 |=================================================================== c . 810.46 |================================================================== Neural Magic DeepSparse 1.3.2 Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Synchronous Single-Stream items/sec > Higher Is Better a . 1.8795 |========================================================= b . 1.9599 |============================================================ c . 2.2035 |=================================================================== Neural Magic DeepSparse 1.3.2 Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Synchronous Single-Stream ms/batch < Lower Is Better a . 532.04 |=================================================================== b . 510.21 |================================================================ c . 453.82 |========================================================= RocksDB 7.9.2 Test: Random Fill Op/s > Higher Is Better a . 331087 |=================================================================== b . 328215 |================================================================== c . 316031 |================================================================ RocksDB 7.9.2 Test: Random Read Op/s > Higher Is Better a . 12709778 |================================================================= b . 12740624 |================================================================= c . 12369210 |=============================================================== RocksDB 7.9.2 Test: Update Random Op/s > Higher Is Better a . 157185 |================================================================== b . 159393 |=================================================================== c . 157215 |================================================================== RocksDB 7.9.2 Test: Sequential Fill Op/s > Higher Is Better a . 413064 |=========================================================== b . 451827 |================================================================ c . 471462 |=================================================================== RocksDB 7.9.2 Test: Random Fill Sync Op/s > Higher Is Better a . 1479 |==================================================================== b . 1495 |===================================================================== c . 1458 |=================================================================== RocksDB 7.9.2 Test: Read While Writing Op/s > Higher Is Better a . 651051 |================================================================= b . 647639 |================================================================= c . 666731 |=================================================================== RocksDB 7.9.2 Test: Read Random Write Random Op/s > Higher Is Better a . 525262 |================================================================= b . 541188 |=================================================================== c . 530525 |==================================================================