2 x Intel Xeon Platinum 8380 testing with a Intel M50CYP2SB2U (SE5C6200.86B.0022.D08.2103221623 BIOS) and ASPEED on Ubuntu 22.10 via the Phoronix Test Suite.
Compare your own system(s) to this result file with the
Phoronix Test Suite by running the command:
phoronix-test-suite benchmark 2301278-NE-83802023239
8380 2023,
"Neural Magic DeepSparse 1.3.2 - Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Stream",
Higher Results Are Better
"a",
"b",
"c",
"Neural Magic DeepSparse 1.3.2 - Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Stream",
Lower Results Are Better
"a",
"b",
"c",
"Neural Magic DeepSparse 1.3.2 - Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Synchronous Single-Stream",
Higher Results Are Better
"a",
"b",
"c",
"Neural Magic DeepSparse 1.3.2 - Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Synchronous Single-Stream",
Lower Results Are Better
"a",
"b",
"c",
"Neural Magic DeepSparse 1.3.2 - Model: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Scenario: Asynchronous Multi-Stream",
Higher Results Are Better
"a",
"b",
"c",
"Neural Magic DeepSparse 1.3.2 - Model: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Scenario: Synchronous Single-Stream",
Higher Results Are Better
"a",
"b",
"c",
"Neural Magic DeepSparse 1.3.2 - Model: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Scenario: Synchronous Single-Stream",
Lower Results Are Better
"a",
"b",
"c",
"Neural Magic DeepSparse 1.3.2 - Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-Stream",
Higher Results Are Better
"a",
"b",
"c",
"Neural Magic DeepSparse 1.3.2 - Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-Stream",
Lower Results Are Better
"a",
"b",
"c",
"Neural Magic DeepSparse 1.3.2 - Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Synchronous Single-Stream",
Higher Results Are Better
"a",
"b",
"c",
"Neural Magic DeepSparse 1.3.2 - Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Synchronous Single-Stream",
Lower Results Are Better
"a",
"b",
"c",
"Neural Magic DeepSparse 1.3.2 - Model: CV Detection, YOLOv5s COCO - Scenario: Asynchronous Multi-Stream",
Higher Results Are Better
"a",
"b",
"c",
"Neural Magic DeepSparse 1.3.2 - Model: CV Detection, YOLOv5s COCO - Scenario: Asynchronous Multi-Stream",
Lower Results Are Better
"a",
"b",
"c",
"Neural Magic DeepSparse 1.3.2 - Model: CV Detection, YOLOv5s COCO - Scenario: Synchronous Single-Stream",
Higher Results Are Better
"a",
"b",
"c",
"Neural Magic DeepSparse 1.3.2 - Model: CV Detection, YOLOv5s COCO - Scenario: Synchronous Single-Stream",
Lower Results Are Better
"a",
"b",
"c",
"Neural Magic DeepSparse 1.3.2 - Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream",
Higher Results Are Better
"a",
"b",
"c",
"Neural Magic DeepSparse 1.3.2 - Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream",
Lower Results Are Better
"a",
"b",
"c",
"Neural Magic DeepSparse 1.3.2 - Model: CV Classification, ResNet-50 ImageNet - Scenario: Synchronous Single-Stream",
Higher Results Are Better
"a",
"b",
"c",
"Neural Magic DeepSparse 1.3.2 - Model: CV Classification, ResNet-50 ImageNet - Scenario: Synchronous Single-Stream",
Lower Results Are Better
"a",
"b",
"c",
"Neural Magic DeepSparse 1.3.2 - Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream",
Higher Results Are Better
"a",
"b",
"c",
"Neural Magic DeepSparse 1.3.2 - Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream",
Lower Results Are Better
"a",
"b",
"c",
"Neural Magic DeepSparse 1.3.2 - Model: NLP Text Classification, DistilBERT mnli - Scenario: Synchronous Single-Stream",
Higher Results Are Better
"a",
"b",
"c",
"Neural Magic DeepSparse 1.3.2 - Model: NLP Text Classification, DistilBERT mnli - Scenario: Synchronous Single-Stream",
Lower Results Are Better
"a",
"b",
"c",
"Neural Magic DeepSparse 1.3.2 - Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Asynchronous Multi-Stream",
Higher Results Are Better
"a",
"b",
"c",
"Neural Magic DeepSparse 1.3.2 - Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Asynchronous Multi-Stream",
Lower Results Are Better
"a",
"b",
"c",
"Neural Magic DeepSparse 1.3.2 - Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Synchronous Single-Stream",
Higher Results Are Better
"a",
"b",
"c",
"Neural Magic DeepSparse 1.3.2 - Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Synchronous Single-Stream",
Lower Results Are Better
"a",
"b",
"c",
"Neural Magic DeepSparse 1.3.2 - Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-Stream",
Higher Results Are Better
"a",
"b",
"c",
"Neural Magic DeepSparse 1.3.2 - Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-Stream",
Lower Results Are Better
"a",
"b",
"c",
"Neural Magic DeepSparse 1.3.2 - Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Synchronous Single-Stream",
Higher Results Are Better
"a",
"b",
"c",
"Neural Magic DeepSparse 1.3.2 - Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Synchronous Single-Stream",
Lower Results Are Better
"a",
"b",
"c",
"Neural Magic DeepSparse 1.3.2 - Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Stream",
Higher Results Are Better
"a",
"b",
"c",
"Neural Magic DeepSparse 1.3.2 - Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Stream",
Lower Results Are Better
"a",
"b",
"c",
"Neural Magic DeepSparse 1.3.2 - Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Synchronous Single-Stream",
Higher Results Are Better
"a",
"b",
"c",
"Neural Magic DeepSparse 1.3.2 - Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Synchronous Single-Stream",
Lower Results Are Better
"a",
"b",
"c",
"Neural Magic DeepSparse 1.3.2 - Model: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Scenario: Asynchronous Multi-Stream",
Lower Results Are Better
"b",
"c",
"Kvazaar 2.2 - Video Input: Bosphorus 4K - Video Preset: Slow",
Higher Results Are Better
"a",
"b",
"c",
"Kvazaar 2.2 - Video Input: Bosphorus 4K - Video Preset: Medium",
Higher Results Are Better
"a",
"b",
"c",
"Kvazaar 2.2 - Video Input: Bosphorus 1080p - Video Preset: Slow",
Higher Results Are Better
"a",
"b",
"c",
"Kvazaar 2.2 - Video Input: Bosphorus 1080p - Video Preset: Medium",
Higher Results Are Better
"a",
"b",
"c",
"Kvazaar 2.2 - Video Input: Bosphorus 4K - Video Preset: Very Fast",
Higher Results Are Better
"a",
"b",
"c",
"Kvazaar 2.2 - Video Input: Bosphorus 4K - Video Preset: Super Fast",
Higher Results Are Better
"a",
"b",
"c",
"Kvazaar 2.2 - Video Input: Bosphorus 4K - Video Preset: Ultra Fast",
Higher Results Are Better
"a",
"b",
"c",
"Kvazaar 2.2 - Video Input: Bosphorus 1080p - Video Preset: Very Fast",
Higher Results Are Better
"a",
"b",
"c",
"Kvazaar 2.2 - Video Input: Bosphorus 1080p - Video Preset: Super Fast",
Higher Results Are Better
"a",
"b",
"c",
"Kvazaar 2.2 - Video Input: Bosphorus 1080p - Video Preset: Ultra Fast",
Higher Results Are Better
"a",
"b",
"c",
"uvg266 0.4.1 - Video Input: Bosphorus 4K - Video Preset: Slow",
Higher Results Are Better
"a",
"b",
"c",
"uvg266 0.4.1 - Video Input: Bosphorus 4K - Video Preset: Medium",
Higher Results Are Better
"a",
"b",
"c",
"uvg266 0.4.1 - Video Input: Bosphorus 1080p - Video Preset: Slow",
Higher Results Are Better
"a",
"b",
"c",
"uvg266 0.4.1 - Video Input: Bosphorus 1080p - Video Preset: Medium",
Higher Results Are Better
"a",
"b",
"c",
"uvg266 0.4.1 - Video Input: Bosphorus 4K - Video Preset: Very Fast",
Higher Results Are Better
"a",
"b",
"c",
"uvg266 0.4.1 - Video Input: Bosphorus 4K - Video Preset: Super Fast",
Higher Results Are Better
"a",
"b",
"c",
"uvg266 0.4.1 - Video Input: Bosphorus 4K - Video Preset: Ultra Fast",
Higher Results Are Better
"a",
"b",
"c",
"uvg266 0.4.1 - Video Input: Bosphorus 1080p - Video Preset: Very Fast",
Higher Results Are Better
"a",
"b",
"c",
"uvg266 0.4.1 - Video Input: Bosphorus 1080p - Video Preset: Super Fast",
Higher Results Are Better
"a",
"b",
"c",
"uvg266 0.4.1 - Video Input: Bosphorus 1080p - Video Preset: Ultra Fast",
Higher Results Are Better
"a",
"b",
"c",
"ClickHouse 22.12.3.5 - 100M Rows Hits Dataset, First Run / Cold Cache",
Higher Results Are Better
"a",399.60906041171
"b",398.97513783493
"c",387.29855829223
"ClickHouse 22.12.3.5 - 100M Rows Hits Dataset, Second Run",
Higher Results Are Better
"a",424.15850379819
"b",421.1865356593
"c",420.60560872097
"ClickHouse 22.12.3.5 - 100M Rows Hits Dataset, Third Run",
Higher Results Are Better
"a",427.97008085004
"b",418.33936180917
"c",426.6418079597
"RocksDB 7.9.2 - Test: Random Fill",
Higher Results Are Better
"a",
"b",
"c",
"RocksDB 7.9.2 - Test: Random Read",
Higher Results Are Better
"a",
"b",
"c",
"RocksDB 7.9.2 - Test: Update Random",
Higher Results Are Better
"a",
"b",
"c",
"RocksDB 7.9.2 - Test: Sequential Fill",
Higher Results Are Better
"a",
"b",
"c",
"RocksDB 7.9.2 - Test: Random Fill Sync",
Higher Results Are Better
"a",
"b",
"c",
"RocksDB 7.9.2 - Test: Read While Writing",
Higher Results Are Better
"a",
"b",
"c",
"RocksDB 7.9.2 - Test: Read Random Write Random",
Higher Results Are Better
"a",
"b",
"c",