Benchmarks for a future article.
Compare your own system(s) to this result file with the
Phoronix Test Suite by running the command:
phoronix-test-suite benchmark 2312143-NE-A8154652071
a
Benchmarks for a future article.
,,"a","b","c","d"
Processor,,2 x INTEL XEON PLATINUM 8592+ @ 3.90GHz (128 Cores / 256 Threads),2 x INTEL XEON PLATINUM 8592+ @ 3.90GHz (128 Cores / 256 Threads),2 x INTEL XEON PLATINUM 8592+ @ 3.90GHz (128 Cores / 256 Threads),2 x INTEL XEON PLATINUM 8592+ @ 3.90GHz (128 Cores / 256 Threads)
Motherboard,,Quanta Cloud S6Q-MB-MPS (3B05.TEL4P1 BIOS),Quanta Cloud S6Q-MB-MPS (3B05.TEL4P1 BIOS),Quanta Cloud S6Q-MB-MPS (3B05.TEL4P1 BIOS),Quanta Cloud S6Q-MB-MPS (3B05.TEL4P1 BIOS)
Chipset,,Intel Device 1bce,Intel Device 1bce,Intel Device 1bce,Intel Device 1bce
Memory,,1008GB,1008GB,1008GB,1008GB
Disk,,3201GB Micron_7450_MTFDKCB3T2TFS,3201GB Micron_7450_MTFDKCB3T2TFS,3201GB Micron_7450_MTFDKCB3T2TFS,3201GB Micron_7450_MTFDKCB3T2TFS
Graphics,,ASPEED,ASPEED,ASPEED,ASPEED
Network,,2 x Intel X710 for 10GBASE-T,2 x Intel X710 for 10GBASE-T,2 x Intel X710 for 10GBASE-T,2 x Intel X710 for 10GBASE-T
OS,,Ubuntu 23.10,Ubuntu 23.10,Ubuntu 23.10,Ubuntu 23.10
Kernel,,6.5.0-13-generic (x86_64),6.5.0-13-generic (x86_64),6.5.0-13-generic (x86_64),6.5.0-13-generic (x86_64)
Compiler,,GCC 13.2.0,GCC 13.2.0,GCC 13.2.0,GCC 13.2.0
File-System,,ext4,ext4,ext4,ext4
Screen Resolution,,1920x1080,1920x1080,1920x1080,1920x1080
,,"a","b","c","d"
"Neural Magic DeepSparse - Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Synchronous Single-Stream (items/sec)",HIB,31.1945,31.2336,31.6300,32.8936
"Neural Magic DeepSparse - Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Synchronous Single-Stream (ms/batch)",LIB,32.0613,32.0368,31.6501,30.4222
"Neural Magic DeepSparse - Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Synchronous Single-Stream (items/sec)",HIB,31.6954,31.5332,31.7202,33.0540
"Neural Magic DeepSparse - Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Synchronous Single-Stream (ms/batch)",LIB,31.5821,31.7303,31.5618,30.2891
"Neural Magic DeepSparse - Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Asynchronous Multi-Stream (items/sec)",HIB,183.4966,180.3157,177.1512,181.2029
"Neural Magic DeepSparse - Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Asynchronous Multi-Stream (ms/batch)",LIB,347.6637,353.6889,359.8919,352.2235
"Neural Magic DeepSparse - Model: BERT-Large, NLP Question Answering - Scenario: Synchronous Single-Stream (items/sec)",HIB,29.9421,30.3891,30.2944,29.5231
"Neural Magic DeepSparse - Model: BERT-Large, NLP Question Answering - Scenario: Synchronous Single-Stream (ms/batch)",LIB,33.4022,32.8989,32.9984,33.8635
"Neural Magic DeepSparse - Model: ResNet-50, Sparse INT8 - Scenario: Synchronous Single-Stream (ms/batch)",LIB,0.9681,0.9706,0.9556,0.9667
"NWChem - Input: C240 Buckyball (sec)",LIB,1744,1730.7,1757.3,1748
"Neural Magic DeepSparse - Model: ResNet-50, Sparse INT8 - Scenario: Synchronous Single-Stream (items/sec)",HIB,1030.3181,1027.5117,1043.2804,1032.2410
"Neural Magic DeepSparse - Model: NLP Text Classification, DistilBERT mnli - Scenario: Synchronous Single-Stream (items/sec)",HIB,199.6930,199.3380,199.3323,196.7874
"Neural Magic DeepSparse - Model: NLP Text Classification, DistilBERT mnli - Scenario: Synchronous Single-Stream (ms/batch)",LIB,5.0073,5.0196,5.0179,5.0808
"Neural Magic DeepSparse - Model: BERT-Large, NLP Question Answering, Sparse INT8 - Scenario: Synchronous Single-Stream (ms/batch)",LIB,10.3634,10.3695,10.3507,10.4501
"Neural Magic DeepSparse - Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream (ms/batch)",LIB,34.8681,35.1423,34.8217,35.1013
"Neural Magic DeepSparse - Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream (items/sec)",HIB,1832.7927,1817.9939,1834.4771,1819.6861
"WRF - Input: conus 2.5km (sec)",LIB,5566.729,5600.976,5583.112,5617.197
"Neural Magic DeepSparse - Model: BERT-Large, NLP Question Answering, Sparse INT8 - Scenario: Synchronous Single-Stream (items/sec)",HIB,96.4300,96.3790,96.5474,95.6981
"Neural Magic DeepSparse - Model: BERT-Large, NLP Question Answering, Sparse INT8 - Scenario: Asynchronous Multi-Stream (items/sec)",HIB,1880.7688,1875.9035,1879.8388,1865.0193
"Neural Magic DeepSparse - Model: BERT-Large, NLP Question Answering, Sparse INT8 - Scenario: Asynchronous Multi-Stream (ms/batch)",LIB,33.9808,34.0815,33.9939,34.2508
"Neural Magic DeepSparse - Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Stream (ms/batch)",LIB,475.6964,474.1852,475.6804,477.6108
"Neural Magic DeepSparse - Model: ResNet-50, Baseline - Scenario: Asynchronous Multi-Stream (items/sec)",HIB,1829.9644,1824.3759,1827.9780,1837.4977
"Neural Magic DeepSparse - Model: ResNet-50, Baseline - Scenario: Asynchronous Multi-Stream (ms/batch)",LIB,34.9169,35.0063,34.9683,34.7567
"Neural Magic DeepSparse - Model: CV Detection, YOLOv5s COCO, Sparse INT8 - Scenario: Synchronous Single-Stream (ms/batch)",LIB,5.1485,5.1659,5.1802,5.1614
"Neural Magic DeepSparse - Model: CV Detection, YOLOv5s COCO, Sparse INT8 - Scenario: Synchronous Single-Stream (items/sec)",HIB,194.2476,193.5972,193.0872,193.8186
"Neural Magic DeepSparse - Model: ResNet-50, Sparse INT8 - Scenario: Asynchronous Multi-Stream (items/sec)",HIB,11228.6625,11169.8517,11163.6593,11221.1357
"Neural Magic DeepSparse - Model: ResNet-50, Sparse INT8 - Scenario: Asynchronous Multi-Stream (ms/batch)",LIB,5.6852,5.7140,5.7165,5.6908
"Neural Magic DeepSparse - Model: CV Detection, YOLOv5s COCO - Scenario: Synchronous Single-Stream (items/sec)",HIB,190.8420,190.0399,189.8175,190.1376
"Neural Magic DeepSparse - Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Stream (items/sec)",HIB,133.5159,133.7189,133.4843,133.0079
"Neural Magic DeepSparse - Model: CV Detection, YOLOv5s COCO - Scenario: Synchronous Single-Stream (ms/batch)",LIB,5.2382,5.2617,5.2651,5.2589
"Neural Magic DeepSparse - Model: CV Detection, YOLOv5s COCO - Scenario: Asynchronous Multi-Stream (ms/batch)",LIB,77.1758,77.0924,77.1235,77.4573
"Neural Magic DeepSparse - Model: CV Detection, YOLOv5s COCO - Scenario: Asynchronous Multi-Stream (items/sec)",HIB,828.0384,828.6532,828.4462,825.0841
"Neural Magic DeepSparse - Model: BERT-Large, NLP Question Answering - Scenario: Asynchronous Multi-Stream (ms/batch)",LIB,407.2777,408.6263,408.9699,408.1638
"Neural Magic DeepSparse - Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Synchronous Single-Stream (items/sec)",HIB,34.9620,35.1065,35.0057,34.9987
"Neural Magic DeepSparse - Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Synchronous Single-Stream (ms/batch)",LIB,28.5876,28.4701,28.5521,28.5586
"Neural Magic DeepSparse - Model: CV Detection, YOLOv5s COCO, Sparse INT8 - Scenario: Asynchronous Multi-Stream (items/sec)",HIB,854.0525,852.9455,854.2521,850.8926
"Neural Magic DeepSparse - Model: CV Detection, YOLOv5s COCO, Sparse INT8 - Scenario: Asynchronous Multi-Stream (ms/batch)",LIB,74.8177,74.9435,74.7945,75.0848
"Neural Magic DeepSparse - Model: ResNet-50, Baseline - Scenario: Synchronous Single-Stream (items/sec)",HIB,338.9562,337.6799,338.5536,338.1466
"Neural Magic DeepSparse - Model: ResNet-50, Baseline - Scenario: Synchronous Single-Stream (ms/batch)",LIB,2.9492,2.9602,2.9530,2.9573
"Neural Magic DeepSparse - Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream (items/sec)",HIB,1231.2049,1231.2939,1231.2736,1226.7960
"Neural Magic DeepSparse - Model: CV Classification, ResNet-50 ImageNet - Scenario: Synchronous Single-Stream (ms/batch)",LIB,2.9484,2.9500,2.9555,2.9455
"Neural Magic DeepSparse - Model: CV Classification, ResNet-50 ImageNet - Scenario: Synchronous Single-Stream (items/sec)",HIB,339.0416,338.8583,338.2192,339.3671
"Neural Magic DeepSparse - Model: BERT-Large, NLP Question Answering - Scenario: Asynchronous Multi-Stream (items/sec)",HIB,156.0563,155.7222,155.7677,155.6020
"Neural Magic DeepSparse - Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream (ms/batch)",LIB,51.9301,51.9273,51.9192,52.0706
"Neural Magic DeepSparse - Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Stream (ms/batch)",LIB,475.1265,474.3687,475.3497,475.4464
"Neural Magic DeepSparse - Model: NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Scenario: Asynchronous Multi-Stream (ms/batch)",LIB,14.0362,14.0081,14.0090,14.0315
"Neural Magic DeepSparse - Model: NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Scenario: Asynchronous Multi-Stream (items/sec)",HIB,4554.9796,4563.5097,4563.4278,4556.0233
"Neural Magic DeepSparse - Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Stream (items/sec)",HIB,133.6023,133.8239,133.6004,133.5969
"Neural Magic DeepSparse - Model: NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Scenario: Synchronous Single-Stream (ms/batch)",LIB,4.2083,4.2295,4.3436,4.1604
"Neural Magic DeepSparse - Model: NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Scenario: Synchronous Single-Stream (items/sec)",HIB,238.6523,237.0460,230.7640,240.2336