2 x INTEL XEON PLATINUM 8592+ testing with a Quanta Cloud QuantaGrid D54Q-2U S6Q-MB-MPS (3B05.TEL4P1 BIOS) and ASPEED on Ubuntu 23.10 via the Phoronix Test Suite.
Compare your own system(s) to this result file with the
Phoronix Test Suite by running the command:
phoronix-test-suite benchmark 2403172-NE-XEONEMR4990
xeon emr,
"Google Draco 1.5.6 - Model: Lion",
Lower Results Are Better
"a",
"b",
"c",
"d",
"Google Draco 1.5.6 - Model: Church Facade",
Lower Results Are Better
"a",
"b",
"c",
"d",
"Neural Magic DeepSparse 1.7 - Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Stream",
Higher Results Are Better
"a",
"b",
"c",
"d",
"Neural Magic DeepSparse 1.7 - Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Stream",
Lower Results Are Better
"a",
"b",
"c",
"d",
"Neural Magic DeepSparse 1.7 - Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Synchronous Single-Stream",
Higher Results Are Better
"a",
"b",
"c",
"d",
"Neural Magic DeepSparse 1.7 - Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Synchronous Single-Stream",
Lower Results Are Better
"a",
"b",
"c",
"d",
"Neural Magic DeepSparse 1.7 - Model: NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Scenario: Asynchronous Multi-Stream",
Higher Results Are Better
"a",
"b",
"c",
"d",
"Neural Magic DeepSparse 1.7 - Model: NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Scenario: Asynchronous Multi-Stream",
Lower Results Are Better
"a",
"b",
"c",
"d",
"Neural Magic DeepSparse 1.7 - Model: NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Scenario: Synchronous Single-Stream",
Higher Results Are Better
"a",
"b",
"c",
"d",
"Neural Magic DeepSparse 1.7 - Model: NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Scenario: Synchronous Single-Stream",
Lower Results Are Better
"a",
"b",
"c",
"d",
"Neural Magic DeepSparse 1.7 - Model: ResNet-50, Baseline - Scenario: Asynchronous Multi-Stream",
Higher Results Are Better
"a",
"b",
"c",
"d",
"Neural Magic DeepSparse 1.7 - Model: ResNet-50, Baseline - Scenario: Asynchronous Multi-Stream",
Lower Results Are Better
"a",
"b",
"c",
"d",
"Neural Magic DeepSparse 1.7 - Model: ResNet-50, Baseline - Scenario: Synchronous Single-Stream",
Higher Results Are Better
"a",
"b",
"c",
"d",
"Neural Magic DeepSparse 1.7 - Model: ResNet-50, Baseline - Scenario: Synchronous Single-Stream",
Lower Results Are Better
"a",
"b",
"c",
"d",
"Neural Magic DeepSparse 1.7 - Model: ResNet-50, Sparse INT8 - Scenario: Asynchronous Multi-Stream",
Higher Results Are Better
"a",
"b",
"c",
"d",
"Neural Magic DeepSparse 1.7 - Model: ResNet-50, Sparse INT8 - Scenario: Asynchronous Multi-Stream",
Lower Results Are Better
"a",
"b",
"c",
"d",
"Neural Magic DeepSparse 1.7 - Model: ResNet-50, Sparse INT8 - Scenario: Synchronous Single-Stream",
Higher Results Are Better
"a",
"b",
"c",
"d",
"Neural Magic DeepSparse 1.7 - Model: ResNet-50, Sparse INT8 - Scenario: Synchronous Single-Stream",
Lower Results Are Better
"a",
"b",
"c",
"d",
"Neural Magic DeepSparse 1.7 - Model: Llama2 Chat 7b Quantized - Scenario: Asynchronous Multi-Stream",
Higher Results Are Better
"a",
"b",
"c",
"d",
"Neural Magic DeepSparse 1.7 - Model: Llama2 Chat 7b Quantized - Scenario: Asynchronous Multi-Stream",
Lower Results Are Better
"a",
"b",
"c",
"d",
"Neural Magic DeepSparse 1.7 - Model: Llama2 Chat 7b Quantized - Scenario: Synchronous Single-Stream",
Higher Results Are Better
"a",
"b",
"c",
"d",
"Neural Magic DeepSparse 1.7 - Model: Llama2 Chat 7b Quantized - Scenario: Synchronous Single-Stream",
Lower Results Are Better
"a",
"b",
"c",
"d",
"Neural Magic DeepSparse 1.7 - Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream",
Higher Results Are Better
"a",
"b",
"c",
"d",
"Neural Magic DeepSparse 1.7 - Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream",
Lower Results Are Better
"a",
"b",
"c",
"d",
"Neural Magic DeepSparse 1.7 - Model: CV Classification, ResNet-50 ImageNet - Scenario: Synchronous Single-Stream",
Higher Results Are Better
"a",
"b",
"c",
"d",
"Neural Magic DeepSparse 1.7 - Model: CV Classification, ResNet-50 ImageNet - Scenario: Synchronous Single-Stream",
Lower Results Are Better
"a",
"b",
"c",
"d",
"Neural Magic DeepSparse 1.7 - Model: CV Detection, YOLOv5s COCO, Sparse INT8 - Scenario: Asynchronous Multi-Stream",
Higher Results Are Better
"a",
"b",
"c",
"d",
"Neural Magic DeepSparse 1.7 - Model: CV Detection, YOLOv5s COCO, Sparse INT8 - Scenario: Asynchronous Multi-Stream",
Lower Results Are Better
"a",
"b",
"c",
"d",
"Neural Magic DeepSparse 1.7 - Model: CV Detection, YOLOv5s COCO, Sparse INT8 - Scenario: Synchronous Single-Stream",
Higher Results Are Better
"a",
"b",
"c",
"d",
"Neural Magic DeepSparse 1.7 - Model: CV Detection, YOLOv5s COCO, Sparse INT8 - Scenario: Synchronous Single-Stream",
Lower Results Are Better
"a",
"b",
"c",
"d",
"Neural Magic DeepSparse 1.7 - Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream",
Higher Results Are Better
"a",
"b",
"c",
"d",
"Neural Magic DeepSparse 1.7 - Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream",
Lower Results Are Better
"a",
"b",
"c",
"d",
"Neural Magic DeepSparse 1.7 - Model: NLP Text Classification, DistilBERT mnli - Scenario: Synchronous Single-Stream",
Higher Results Are Better
"a",
"b",
"c",
"d",
"Neural Magic DeepSparse 1.7 - Model: NLP Text Classification, DistilBERT mnli - Scenario: Synchronous Single-Stream",
Lower Results Are Better
"a",
"b",
"c",
"d",
"Neural Magic DeepSparse 1.7 - Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Asynchronous Multi-Stream",
Higher Results Are Better
"a",
"b",
"c",
"d",
"Neural Magic DeepSparse 1.7 - Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Asynchronous Multi-Stream",
Lower Results Are Better
"a",
"b",
"c",
"d",
"Neural Magic DeepSparse 1.7 - Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Synchronous Single-Stream",
Higher Results Are Better
"a",
"b",
"c",
"d",
"Neural Magic DeepSparse 1.7 - Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Synchronous Single-Stream",
Lower Results Are Better
"a",
"b",
"c",
"d",
"Neural Magic DeepSparse 1.7 - Model: BERT-Large, NLP Question Answering, Sparse INT8 - Scenario: Asynchronous Multi-Stream",
Higher Results Are Better
"a",
"b",
"c",
"d",
"Neural Magic DeepSparse 1.7 - Model: BERT-Large, NLP Question Answering, Sparse INT8 - Scenario: Asynchronous Multi-Stream",
Lower Results Are Better
"a",
"b",
"c",
"d",
"Neural Magic DeepSparse 1.7 - Model: BERT-Large, NLP Question Answering, Sparse INT8 - Scenario: Synchronous Single-Stream",
Higher Results Are Better
"a",
"b",
"c",
"d",
"Neural Magic DeepSparse 1.7 - Model: BERT-Large, NLP Question Answering, Sparse INT8 - Scenario: Synchronous Single-Stream",
Lower Results Are Better
"a",
"b",
"c",
"d",
"Neural Magic DeepSparse 1.7 - Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Stream",
Higher Results Are Better
"a",
"b",
"c",
"d",
"Neural Magic DeepSparse 1.7 - Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Stream",
Lower Results Are Better
"a",
"b",
"c",
"d",
"Neural Magic DeepSparse 1.7 - Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Synchronous Single-Stream",
Higher Results Are Better
"a",
"b",
"c",
"d",
"Neural Magic DeepSparse 1.7 - Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Synchronous Single-Stream",
Lower Results Are Better
"a",
"b",
"c",
"d",
"Parallel BZIP2 Compression 1.1.13 - FreeBSD-13.0-RELEASE-amd64-memstick.img Compression",
Lower Results Are Better
"a",
"b",
"c",
"d",
"Primesieve 12.1 - Length: 1e12",
Lower Results Are Better
"a",
"b",
"c",
"d",
"Primesieve 12.1 - Length: 1e13",
Lower Results Are Better
"a",
"b",
"c",
"d",
"srsRAN Project 23.10.1-20240219 - Test: PDSCH Processor Benchmark, Throughput Total",
Higher Results Are Better
"a",
"a",
"b",
"c",
"d",
"srsRAN Project 23.10.1-20240219 - Test: PDSCH Processor Benchmark, Throughput Thread",
Higher Results Are Better
"a",
"b",
"c",
"d",
"Stockfish 16.1 - Chess Benchmark",
Higher Results Are Better
"a",
"b",
"c",
"d",
"SVT-AV1 2.0 - Encoder Mode: Preset 4 - Input: Bosphorus 4K",
Higher Results Are Better
"a",
"b",
"c",
"d",
"SVT-AV1 2.0 - Encoder Mode: Preset 8 - Input: Bosphorus 4K",
Higher Results Are Better
"a",
"b",
"c",
"d",
"SVT-AV1 2.0 - Encoder Mode: Preset 12 - Input: Bosphorus 4K",
Higher Results Are Better
"a",
"b",
"c",
"d",
"SVT-AV1 2.0 - Encoder Mode: Preset 13 - Input: Bosphorus 4K",
Higher Results Are Better
"a",
"b",
"c",
"d",
"SVT-AV1 2.0 - Encoder Mode: Preset 4 - Input: Bosphorus 1080p",
Higher Results Are Better
"a",
"b",
"c",
"d",
"SVT-AV1 2.0 - Encoder Mode: Preset 8 - Input: Bosphorus 1080p",
Higher Results Are Better
"a",
"b",
"c",
"d",
"SVT-AV1 2.0 - Encoder Mode: Preset 12 - Input: Bosphorus 1080p",
Higher Results Are Better
"a",
"b",
"c",
"d",
"SVT-AV1 2.0 - Encoder Mode: Preset 13 - Input: Bosphorus 1080p",
Higher Results Are Better
"a",
"b",
"c",
"d",
"Timed Linux Kernel Compilation 6.8 - Build: defconfig",
Lower Results Are Better
"a",
"b",
"c",
"d",
"Timed Linux Kernel Compilation 6.8 - Build: allmodconfig",
Lower Results Are Better
"a",
"b",
"c",
"d",