2 x INTEL XEON PLATINUM 8592+ testing with a Quanta Cloud QuantaGrid D54Q-2U S6Q-MB-MPS (3B05.TEL4P1 BIOS) and ASPEED on Ubuntu 23.10 via the Phoronix Test Suite.
Compare your own system(s) to this result file with the
Phoronix Test Suite by running the command:
phoronix-test-suite benchmark 2403172-NE-XEONEMR4990
xeon emr
2 x INTEL XEON PLATINUM 8592+ testing with a Quanta Cloud QuantaGrid D54Q-2U S6Q-MB-MPS (3B05.TEL4P1 BIOS) and ASPEED on Ubuntu 23.10 via the Phoronix Test Suite.
,,"a","b","c","d"
Processor,,2 x INTEL XEON PLATINUM 8592+ @ 3.90GHz (128 Cores / 256 Threads),2 x INTEL XEON PLATINUM 8592+ @ 3.90GHz (128 Cores / 256 Threads),2 x INTEL XEON PLATINUM 8592+ @ 3.90GHz (128 Cores / 256 Threads),2 x INTEL XEON PLATINUM 8592+ @ 3.90GHz (128 Cores / 256 Threads)
Motherboard,,Quanta Cloud QuantaGrid D54Q-2U S6Q-MB-MPS (3B05.TEL4P1 BIOS),Quanta Cloud QuantaGrid D54Q-2U S6Q-MB-MPS (3B05.TEL4P1 BIOS),Quanta Cloud QuantaGrid D54Q-2U S6Q-MB-MPS (3B05.TEL4P1 BIOS),Quanta Cloud QuantaGrid D54Q-2U S6Q-MB-MPS (3B05.TEL4P1 BIOS)
Chipset,,Intel Device 1bce,Intel Device 1bce,Intel Device 1bce,Intel Device 1bce
Memory,,1008GB,1008GB,1008GB,1008GB
Disk,,3201GB Micron_7450_MTFDKCC3T2TFS,3201GB Micron_7450_MTFDKCC3T2TFS,3201GB Micron_7450_MTFDKCC3T2TFS,3201GB Micron_7450_MTFDKCC3T2TFS
Graphics,,ASPEED,ASPEED,ASPEED,ASPEED
Network,,2 x Intel X710 for 10GBASE-T,2 x Intel X710 for 10GBASE-T,2 x Intel X710 for 10GBASE-T,2 x Intel X710 for 10GBASE-T
OS,,Ubuntu 23.10,Ubuntu 23.10,Ubuntu 23.10,Ubuntu 23.10
Kernel,,6.6.0-rc5-phx-patched (x86_64),6.6.0-rc5-phx-patched (x86_64),6.6.0-rc5-phx-patched (x86_64),6.6.0-rc5-phx-patched (x86_64)
Desktop,,GNOME Shell 45.0,GNOME Shell 45.0,GNOME Shell 45.0,GNOME Shell 45.0
Display Server,,X Server 1.21.1.7,X Server 1.21.1.7,X Server 1.21.1.7,X Server 1.21.1.7
Compiler,,GCC 13.2.0,GCC 13.2.0,GCC 13.2.0,GCC 13.2.0
File-System,,ext4,ext4,ext4,ext4
Screen Resolution,,1920x1200,1920x1200,1920x1200,1920x1200
,,"a","b","c","d"
"Timed Linux Kernel Compilation - Build: allmodconfig (sec)",LIB,181.564,183.153,182.434,181.284
"Stockfish - Chess Benchmark (Nodes/s)",HIB,212133268,207635904,221316167,214224198
"Neural Magic DeepSparse - Model: Llama2 Chat 7b Quantized - Scenario: Asynchronous Multi-Stream (ms/batch)",LIB,16509.1382,17153.2257,17224.3584,16021.351
"Neural Magic DeepSparse - Model: Llama2 Chat 7b Quantized - Scenario: Asynchronous Multi-Stream (items/sec)",HIB,3.1028,2.9676,2.9506,3.2137
"Neural Magic DeepSparse - Model: NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Scenario: Asynchronous Multi-Stream (ms/batch)",LIB,13.9187,13.8924,13.8713,13.9223
"Neural Magic DeepSparse - Model: NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Scenario: Asynchronous Multi-Stream (items/sec)",HIB,4590.2273,4598.881,4605.9916,4589.1483
"Neural Magic DeepSparse - Model: BERT-Large, NLP Question Answering, Sparse INT8 - Scenario: Asynchronous Multi-Stream (ms/batch)",LIB,33.5718,33.5942,33.5913,33.5967
"Neural Magic DeepSparse - Model: BERT-Large, NLP Question Answering, Sparse INT8 - Scenario: Asynchronous Multi-Stream (items/sec)",HIB,1904.0783,1902.9145,1902.1758,1902.9281
"Neural Magic DeepSparse - Model: NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Scenario: Synchronous Single-Stream (ms/batch)",LIB,3.2778,3.2774,3.2761,3.2877
"Neural Magic DeepSparse - Model: NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Scenario: Synchronous Single-Stream (items/sec)",HIB,304.7581,304.7953,304.8963,303.8422
"Neural Magic DeepSparse - Model: Llama2 Chat 7b Quantized - Scenario: Synchronous Single-Stream (ms/batch)",LIB,68.8874,69.8791,69.6416,69.945
"Neural Magic DeepSparse - Model: Llama2 Chat 7b Quantized - Scenario: Synchronous Single-Stream (items/sec)",HIB,14.5001,14.2937,14.3408,14.2809
"Neural Magic DeepSparse - Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Synchronous Single-Stream (ms/batch)",LIB,29.3545,29.2948,29.4115,29.495
"Neural Magic DeepSparse - Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Synchronous Single-Stream (items/sec)",HIB,34.0569,34.1233,33.9896,33.8913
"Neural Magic DeepSparse - Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Stream (ms/batch)",LIB,461.3828,462.5178,465.457,460.9087
"Neural Magic DeepSparse - Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Stream (items/sec)",HIB,137.9486,137.2758,136.559,137.823
"Neural Magic DeepSparse - Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Stream (ms/batch)",LIB,460.7323,461.2167,461.9932,462.0284
"Neural Magic DeepSparse - Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Stream (items/sec)",HIB,138.305,137.7909,137.9705,137.9657
"Neural Magic DeepSparse - Model: BERT-Large, NLP Question Answering, Sparse INT8 - Scenario: Synchronous Single-Stream (ms/batch)",LIB,9.9739,10.0233,9.8997,10.1216
"Neural Magic DeepSparse - Model: BERT-Large, NLP Question Answering, Sparse INT8 - Scenario: Synchronous Single-Stream (items/sec)",HIB,100.2084,99.7096,100.9536,98.7467
"Neural Magic DeepSparse - Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Synchronous Single-Stream (ms/batch)",LIB,29.2486,29.2084,29.2768,29.2364
"Neural Magic DeepSparse - Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Synchronous Single-Stream (items/sec)",HIB,34.1833,34.2297,34.1503,34.1968
"Neural Magic DeepSparse - Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Asynchronous Multi-Stream (ms/batch)",LIB,351.8687,350.3778,349.8032,350.443
"Neural Magic DeepSparse - Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Asynchronous Multi-Stream (items/sec)",HIB,181.7853,182.1096,182.809,182.5524
"Neural Magic DeepSparse - Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Synchronous Single-Stream (ms/batch)",LIB,27.8836,27.8666,28.3852,27.9309
"Neural Magic DeepSparse - Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Synchronous Single-Stream (items/sec)",HIB,35.8292,35.851,35.1943,35.7654
"Neural Magic DeepSparse - Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream (ms/batch)",LIB,51.6596,51.5131,51.8422,51.7072
"Neural Magic DeepSparse - Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream (items/sec)",HIB,1238.0561,1241.5488,1233.705,1236.9478
"Neural Magic DeepSparse - Model: ResNet-50, Baseline - Scenario: Asynchronous Multi-Stream (ms/batch)",LIB,35.7151,35.6661,35.8738,35.7107
"Neural Magic DeepSparse - Model: ResNet-50, Baseline - Scenario: Asynchronous Multi-Stream (items/sec)",HIB,1789.6958,1792.6939,1781.8907,1789.8075
"Neural Magic DeepSparse - Model: NLP Text Classification, DistilBERT mnli - Scenario: Synchronous Single-Stream (ms/batch)",LIB,5.0199,5.0378,4.9896,5.0371
"Neural Magic DeepSparse - Model: NLP Text Classification, DistilBERT mnli - Scenario: Synchronous Single-Stream (items/sec)",HIB,199.0668,198.3448,200.2818,198.3789
"Neural Magic DeepSparse - Model: CV Classification, ResNet-50 ImageNet - Scenario: Synchronous Single-Stream (ms/batch)",LIB,2.9085,2.9192,2.9173,2.9035
"Neural Magic DeepSparse - Model: CV Classification, ResNet-50 ImageNet - Scenario: Synchronous Single-Stream (items/sec)",HIB,343.4587,342.2084,342.4421,344.0469
"Neural Magic DeepSparse - Model: ResNet-50, Sparse INT8 - Scenario: Asynchronous Multi-Stream (ms/batch)",LIB,5.4463,5.4445,5.4544,5.4675
"Neural Magic DeepSparse - Model: ResNet-50, Sparse INT8 - Scenario: Asynchronous Multi-Stream (items/sec)",HIB,11719.0071,11722.5863,11702.1757,11674.2462
"Neural Magic DeepSparse - Model: CV Detection, YOLOv5s COCO, Sparse INT8 - Scenario: Asynchronous Multi-Stream (ms/batch)",LIB,73.9698,73.9961,74.0382,74.0261
"Neural Magic DeepSparse - Model: CV Detection, YOLOv5s COCO, Sparse INT8 - Scenario: Asynchronous Multi-Stream (items/sec)",HIB,864.3474,863.6692,863.8538,863.9257
"Neural Magic DeepSparse - Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream (ms/batch)",LIB,35.4998,35.7303,35.4543,35.6137
"Neural Magic DeepSparse - Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream (items/sec)",HIB,1800.7146,1788.7978,1803.2322,1794.8462
"Neural Magic DeepSparse - Model: CV Detection, YOLOv5s COCO, Sparse INT8 - Scenario: Synchronous Single-Stream (ms/batch)",LIB,5.058,5.103,5.1037,5.0734
"Neural Magic DeepSparse - Model: CV Detection, YOLOv5s COCO, Sparse INT8 - Scenario: Synchronous Single-Stream (items/sec)",HIB,197.6133,195.8717,195.8325,197.0081
"Neural Magic DeepSparse - Model: ResNet-50, Baseline - Scenario: Synchronous Single-Stream (ms/batch)",LIB,2.9188,2.9135,2.9257,2.908
"Neural Magic DeepSparse - Model: ResNet-50, Baseline - Scenario: Synchronous Single-Stream (items/sec)",HIB,342.2814,342.9008,341.4441,343.5349
"Neural Magic DeepSparse - Model: ResNet-50, Sparse INT8 - Scenario: Synchronous Single-Stream (ms/batch)",LIB,0.9394,0.9232,0.9356,0.9449
"Neural Magic DeepSparse - Model: ResNet-50, Sparse INT8 - Scenario: Synchronous Single-Stream (items/sec)",HIB,1060.9522,1079.5719,1065.9665,1055.1822
"Timed Linux Kernel Compilation - Build: defconfig (sec)",LIB,26.074,26.364,26.042,26.131
"SVT-AV1 - Encoder Mode: Preset 4 - Input: Bosphorus 4K (FPS)",HIB,7.75,7.531,7.541,7.586
"Primesieve - Length: 1e13 (sec)",LIB,25.033,24.975,25.077,24.925
"srsRAN Project - Test: PDSCH Processor Benchmark, Throughput Total (Mbps)",HIB,43297.4,50572.1,52220.4,49150.3
"SVT-AV1 - Encoder Mode: Preset 8 - Input: Bosphorus 4K (FPS)",HIB,72.86,73.713,72.827,71.511
"SVT-AV1 - Encoder Mode: Preset 4 - Input: Bosphorus 1080p (FPS)",HIB,22.033,22.161,22.392,22.24
"SVT-AV1 - Encoder Mode: Preset 8 - Input: Bosphorus 1080p (FPS)",HIB,152.48,152.788,153.098,154.5
"Google Draco - Model: Church Facade (ms)",LIB,4837,4793,4765,4820
"SVT-AV1 - Encoder Mode: Preset 13 - Input: Bosphorus 4K (FPS)",HIB,168.799,167.052,168.2,168.292
"SVT-AV1 - Encoder Mode: Preset 12 - Input: Bosphorus 4K (FPS)",HIB,172.718,168.298,169.91,169.387
"Google Draco - Model: Lion (ms)",LIB,4060,4041,4092,4059
"srsRAN Project - Test: PDSCH Processor Benchmark, Throughput Thread (Mbps)",HIB,755.6,728.7,755.3,756
"Primesieve - Length: 1e12 (sec)",LIB,2.213,2.163,2.159,2.163
"SVT-AV1 - Encoder Mode: Preset 12 - Input: Bosphorus 1080p (FPS)",HIB,457.741,439.119,441.419,442.336
"SVT-AV1 - Encoder Mode: Preset 13 - Input: Bosphorus 1080p (FPS)",HIB,643.525,640.892,620.865,627.59
"Parallel BZIP2 Compression - FreeBSD-13.0-RELEASE-amd64-memstick.img Compression (sec)",LIB,1.249184,1.235156,1.235287,1.252094