INTEL XEON PLATINUM 8592+ testing with a Quanta Cloud S6Q-MB-MPS (3B05.TEL4P1 BIOS) and ASPEED on Ubuntu 23.10 via the Phoronix Test Suite.
Compare your own system(s) to this result file with the
Phoronix Test Suite by running the command:
phoronix-test-suite benchmark 2312187-NE-NET50813920
net
INTEL XEON PLATINUM 8592+ testing with a Quanta Cloud S6Q-MB-MPS (3B05.TEL4P1 BIOS) and ASPEED on Ubuntu 23.10 via the Phoronix Test Suite.
,,"a","b","c"
Processor,,INTEL XEON PLATINUM 8592+ @ 3.90GHz (64 Cores / 128 Threads),INTEL XEON PLATINUM 8592+ @ 3.90GHz (64 Cores / 128 Threads),INTEL XEON PLATINUM 8592+ @ 3.90GHz (64 Cores / 128 Threads)
Motherboard,,Quanta Cloud S6Q-MB-MPS (3B05.TEL4P1 BIOS),Quanta Cloud S6Q-MB-MPS (3B05.TEL4P1 BIOS),Quanta Cloud S6Q-MB-MPS (3B05.TEL4P1 BIOS)
Chipset,,Intel Device 1bce,Intel Device 1bce,Intel Device 1bce
Memory,,512GB,512GB,512GB
Disk,,3201GB Micron_7450_MTFDKCC3T2TFS + 0GB Virtual HDisk0 + 0GB Virtual HDisk2 + 0GB Virtual HDisk1 + 0GB Virtual HDisk3,3201GB Micron_7450_MTFDKCC3T2TFS + 0GB Virtual HDisk0 + 0GB Virtual HDisk2 + 0GB Virtual HDisk1 + 0GB Virtual HDisk3,3201GB Micron_7450_MTFDKCC3T2TFS + 0GB Virtual HDisk0 + 0GB Virtual HDisk2 + 0GB Virtual HDisk1 + 0GB Virtual HDisk3
Graphics,,ASPEED,ASPEED,ASPEED
OS,,Ubuntu 23.10,Ubuntu 23.10,Ubuntu 23.10
Kernel,,6.6.0-rc5-phx-patched (x86_64),6.6.0-rc5-phx-patched (x86_64),6.6.0-rc5-phx-patched (x86_64)
Desktop,,GNOME Shell 45.0,GNOME Shell 45.0,GNOME Shell 45.0
Display Server,,X Server 1.21.1.7,X Server 1.21.1.7,X Server 1.21.1.7
Compiler,,GCC 13.2.0,GCC 13.2.0,GCC 13.2.0
File-System,,ext4,ext4,ext4
Screen Resolution,,1920x1200,1920x1200,1920x1200
,,"a","b","c"
"LeelaChessZero - Backend: BLAS (Nodes/s)",HIB,67,67,68
"LeelaChessZero - Backend: Eigen (Nodes/s)",HIB,796,805,817
"Xmrig - Variant: KawPow - Hash Count: 1M (H/s)",HIB,39936.2,40344.7,40242.5
"Xmrig - Variant: Monero - Hash Count: 1M (H/s)",HIB,40329.6,40153.2,40072.2
"Xmrig - Variant: Wownero - Hash Count: 1M (H/s)",HIB,43088.3,42998.7,43080.4
"Xmrig - Variant: GhostRider - Hash Count: 1M (H/s)",HIB,6862.9,6857.8,6820.8
"Xmrig - Variant: CryptoNight-Heavy - Hash Count: 1M (H/s)",HIB,40394.9,40282.2,40286.6
"Xmrig - Variant: CryptoNight-Femto UPX2 - Hash Count: 1M (H/s)",HIB,40425.9,40080.4,40331.1
"SVT-AV1 - Encoder Mode: Preset 4 - Input: Bosphorus 4K (FPS)",HIB,7.156,7.168,7.151
"SVT-AV1 - Encoder Mode: Preset 8 - Input: Bosphorus 4K (FPS)",HIB,75.139,75.737,74.926
"SVT-AV1 - Encoder Mode: Preset 12 - Input: Bosphorus 4K (FPS)",HIB,228.874,229.514,228.518
"SVT-AV1 - Encoder Mode: Preset 13 - Input: Bosphorus 4K (FPS)",HIB,227.285,229.556,229.075
"SVT-AV1 - Encoder Mode: Preset 4 - Input: Bosphorus 1080p (FPS)",HIB,20.770,20.587,20.492
"SVT-AV1 - Encoder Mode: Preset 8 - Input: Bosphorus 1080p (FPS)",HIB,139.811,141.977,141.873
"SVT-AV1 - Encoder Mode: Preset 12 - Input: Bosphorus 1080p (FPS)",HIB,545.910,543.725,546.877
"SVT-AV1 - Encoder Mode: Preset 13 - Input: Bosphorus 1080p (FPS)",HIB,632.459,636.909,637.337
"Neural Magic DeepSparse - Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Stream (items/sec)",HIB,71.9864,71.6759,71.9685
"Neural Magic DeepSparse - Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Stream (ms/batch)",LIB,442.3119,443.3971,442.7525
"Neural Magic DeepSparse - Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Synchronous Single-Stream (items/sec)",HIB,34.4749,34.4826,34.2377
"Neural Magic DeepSparse - Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Synchronous Single-Stream (ms/batch)",LIB,29.0016,28.9953,29.2030
"Neural Magic DeepSparse - Model: NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Scenario: Asynchronous Multi-Stream (items/sec)",HIB,2323.9799,2324.7362,2322.5803
"Neural Magic DeepSparse - Model: NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Scenario: Asynchronous Multi-Stream (ms/batch)",LIB,13.7504,13.7462,13.7597
"Neural Magic DeepSparse - Model: NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Scenario: Synchronous Single-Stream (items/sec)",HIB,210.9638,210.8100,209.6095
"Neural Magic DeepSparse - Model: NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Scenario: Synchronous Single-Stream (ms/batch)",LIB,4.7354,4.7386,4.7654
"Neural Magic DeepSparse - Model: ResNet-50, Baseline - Scenario: Asynchronous Multi-Stream (items/sec)",HIB,934.6524,928.4462,939.5363
"Neural Magic DeepSparse - Model: ResNet-50, Baseline - Scenario: Asynchronous Multi-Stream (ms/batch)",LIB,34.2126,34.4463,34.0380
"Neural Magic DeepSparse - Model: ResNet-50, Baseline - Scenario: Synchronous Single-Stream (items/sec)",HIB,286.8882,290.2826,287.3469
"Neural Magic DeepSparse - Model: ResNet-50, Baseline - Scenario: Synchronous Single-Stream (ms/batch)",LIB,3.4825,3.4417,3.4767
"Neural Magic DeepSparse - Model: ResNet-50, Sparse INT8 - Scenario: Asynchronous Multi-Stream (items/sec)",HIB,5706.6964,5717.5185,5704.9530
"Neural Magic DeepSparse - Model: ResNet-50, Sparse INT8 - Scenario: Asynchronous Multi-Stream (ms/batch)",LIB,5.5953,5.5844,5.5965
"Neural Magic DeepSparse - Model: ResNet-50, Sparse INT8 - Scenario: Synchronous Single-Stream (items/sec)",HIB,701.7915,705.8268,701.7061
"Neural Magic DeepSparse - Model: ResNet-50, Sparse INT8 - Scenario: Synchronous Single-Stream (ms/batch)",LIB,1.4200,1.4123,1.4205
"Neural Magic DeepSparse - Model: CV Detection, YOLOv5s COCO - Scenario: Asynchronous Multi-Stream (items/sec)",HIB,436.5226,436.3286,435.4932
"Neural Magic DeepSparse - Model: CV Detection, YOLOv5s COCO - Scenario: Asynchronous Multi-Stream (ms/batch)",LIB,73.2660,73.2935,73.4267
"Neural Magic DeepSparse - Model: CV Detection, YOLOv5s COCO - Scenario: Synchronous Single-Stream (items/sec)",HIB,164.9393,164.8968,163.9718
"Neural Magic DeepSparse - Model: CV Detection, YOLOv5s COCO - Scenario: Synchronous Single-Stream (ms/batch)",LIB,6.0577,6.0589,6.0922
"Neural Magic DeepSparse - Model: BERT-Large, NLP Question Answering - Scenario: Asynchronous Multi-Stream (items/sec)",HIB,86.3024,86.2914,86.1709
"Neural Magic DeepSparse - Model: BERT-Large, NLP Question Answering - Scenario: Asynchronous Multi-Stream (ms/batch)",LIB,370.7287,370.7761,371.2957
"Neural Magic DeepSparse - Model: BERT-Large, NLP Question Answering - Scenario: Synchronous Single-Stream (items/sec)",HIB,31.2246,31.1465,31.1875
"Neural Magic DeepSparse - Model: BERT-Large, NLP Question Answering - Scenario: Synchronous Single-Stream (ms/batch)",LIB,32.0197,32.0999,32.0585
"Neural Magic DeepSparse - Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream (items/sec)",HIB,933.0074,934.5224,940.2198
"Neural Magic DeepSparse - Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream (ms/batch)",LIB,34.2750,34.2173,34.0080
"Neural Magic DeepSparse - Model: CV Classification, ResNet-50 ImageNet - Scenario: Synchronous Single-Stream (items/sec)",HIB,290.0133,288.6849,289.8081
"Neural Magic DeepSparse - Model: CV Classification, ResNet-50 ImageNet - Scenario: Synchronous Single-Stream (ms/batch)",LIB,3.4452,3.4609,3.4473
"Neural Magic DeepSparse - Model: CV Detection, YOLOv5s COCO, Sparse INT8 - Scenario: Asynchronous Multi-Stream (items/sec)",HIB,452.1951,452.1641,450.4918
"Neural Magic DeepSparse - Model: CV Detection, YOLOv5s COCO, Sparse INT8 - Scenario: Asynchronous Multi-Stream (ms/batch)",LIB,70.7373,70.7412,71.0046
"Neural Magic DeepSparse - Model: CV Detection, YOLOv5s COCO, Sparse INT8 - Scenario: Synchronous Single-Stream (items/sec)",HIB,166.6567,166.5123,166.3050
"Neural Magic DeepSparse - Model: CV Detection, YOLOv5s COCO, Sparse INT8 - Scenario: Synchronous Single-Stream (ms/batch)",LIB,5.9970,6.0023,6.0096
"Neural Magic DeepSparse - Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream (items/sec)",HIB,641.1047,637.6092,637.4175
"Neural Magic DeepSparse - Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream (ms/batch)",LIB,49.8955,50.1708,50.1864
"Neural Magic DeepSparse - Model: NLP Text Classification, DistilBERT mnli - Scenario: Synchronous Single-Stream (items/sec)",HIB,186.0257,188.5376,188.2324
"Neural Magic DeepSparse - Model: NLP Text Classification, DistilBERT mnli - Scenario: Synchronous Single-Stream (ms/batch)",LIB,5.3729,5.3005,5.3092
"Neural Magic DeepSparse - Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Asynchronous Multi-Stream (items/sec)",HIB,96.1343,95.6329,96.8521
"Neural Magic DeepSparse - Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Asynchronous Multi-Stream (ms/batch)",LIB,332.8063,334.3153,330.3352
"Neural Magic DeepSparse - Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Synchronous Single-Stream (items/sec)",HIB,35.1023,34.6174,33.7246
"Neural Magic DeepSparse - Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Synchronous Single-Stream (ms/batch)",LIB,28.4611,28.8654,29.6799
"Neural Magic DeepSparse - Model: BERT-Large, NLP Question Answering, Sparse INT8 - Scenario: Asynchronous Multi-Stream (items/sec)",HIB,938.0661,937.5775,937.8630
"Neural Magic DeepSparse - Model: BERT-Large, NLP Question Answering, Sparse INT8 - Scenario: Asynchronous Multi-Stream (ms/batch)",LIB,34.0725,34.0905,34.0792
"Neural Magic DeepSparse - Model: BERT-Large, NLP Question Answering, Sparse INT8 - Scenario: Synchronous Single-Stream (items/sec)",HIB,67.8694,68.1760,67.5802
"Neural Magic DeepSparse - Model: BERT-Large, NLP Question Answering, Sparse INT8 - Scenario: Synchronous Single-Stream (ms/batch)",LIB,14.7276,14.6612,14.7898
"Neural Magic DeepSparse - Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Stream (items/sec)",HIB,72.0462,72.0875,71.7827
"Neural Magic DeepSparse - Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Stream (ms/batch)",LIB,442.2210,441.4776,443.1582
"Neural Magic DeepSparse - Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Synchronous Single-Stream (items/sec)",HIB,34.6092,34.6250,34.4526
"Neural Magic DeepSparse - Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Synchronous Single-Stream (ms/batch)",LIB,28.8890,28.8756,29.0205