AMD Ryzen 9 7950X 16-Core testing with a ASUS ROG STRIX X670E-E GAMING WIFI (1905 BIOS) and NVIDIA GeForce RTX 3080 10GB on Ubuntu 23.10 via the Phoronix Test Suite.
Compare your own system(s) to this result file with the
Phoronix Test Suite by running the command:
phoronix-test-suite benchmark 2403151-PTS-DEEPSPAA58
deepspaarse 17
AMD Ryzen 9 7950X 16-Core testing with a ASUS ROG STRIX X670E-E GAMING WIFI (1905 BIOS) and NVIDIA GeForce RTX 3080 10GB on Ubuntu 23.10 via the Phoronix Test Suite.
,,"a","b","c","d","e"
Processor,,AMD Ryzen 9 7950X 16-Core @ 5.88GHz (16 Cores / 32 Threads),AMD Ryzen 9 7950X 16-Core @ 5.88GHz (16 Cores / 32 Threads),AMD Ryzen 9 7950X 16-Core @ 5.88GHz (16 Cores / 32 Threads),AMD Ryzen 9 7950X 16-Core @ 5.88GHz (16 Cores / 32 Threads),AMD Ryzen 9 7950X 16-Core @ 5.88GHz (16 Cores / 32 Threads)
Motherboard,,ASUS ROG STRIX X670E-E GAMING WIFI (1905 BIOS),ASUS ROG STRIX X670E-E GAMING WIFI (1905 BIOS),ASUS ROG STRIX X670E-E GAMING WIFI (1905 BIOS),ASUS ROG STRIX X670E-E GAMING WIFI (1905 BIOS),ASUS ROG STRIX X670E-E GAMING WIFI (1905 BIOS)
Chipset,,AMD Device 14d8,AMD Device 14d8,AMD Device 14d8,AMD Device 14d8,AMD Device 14d8
Memory,,2 x 16GB DRAM-6000MT/s G Skill F5-6000J3038F16G,2 x 16GB DRAM-6000MT/s G Skill F5-6000J3038F16G,2 x 16GB DRAM-6000MT/s G Skill F5-6000J3038F16G,2 x 16GB DRAM-6000MT/s G Skill F5-6000J3038F16G,2 x 16GB DRAM-6000MT/s G Skill F5-6000J3038F16G
Disk,,2000GB Samsung SSD 980 PRO 2TB + Western Digital WD_BLACK SN850X 2000GB,2000GB Samsung SSD 980 PRO 2TB + Western Digital WD_BLACK SN850X 2000GB,2000GB Samsung SSD 980 PRO 2TB + Western Digital WD_BLACK SN850X 2000GB,2000GB Samsung SSD 980 PRO 2TB + Western Digital WD_BLACK SN850X 2000GB,2000GB Samsung SSD 980 PRO 2TB + Western Digital WD_BLACK SN850X 2000GB
Graphics,,NVIDIA GeForce RTX 3080 10GB,NVIDIA GeForce RTX 3080 10GB,NVIDIA GeForce RTX 3080 10GB,NVIDIA GeForce RTX 3080 10GB,NVIDIA GeForce RTX 3080 10GB
Audio,,NVIDIA GA102 HD Audio,NVIDIA GA102 HD Audio,NVIDIA GA102 HD Audio,NVIDIA GA102 HD Audio,NVIDIA GA102 HD Audio
Monitor,,DELL U2723QE,DELL U2723QE,DELL U2723QE,DELL U2723QE,DELL U2723QE
Network,,Intel I225-V + Intel Wi-Fi 6 AX210/AX211/AX411,Intel I225-V + Intel Wi-Fi 6 AX210/AX211/AX411,Intel I225-V + Intel Wi-Fi 6 AX210/AX211/AX411,Intel I225-V + Intel Wi-Fi 6 AX210/AX211/AX411,Intel I225-V + Intel Wi-Fi 6 AX210/AX211/AX411
OS,,Ubuntu 23.10,Ubuntu 23.10,Ubuntu 23.10,Ubuntu 23.10,Ubuntu 23.10
Kernel,,6.7.0-060700-generic (x86_64),6.7.0-060700-generic (x86_64),6.7.0-060700-generic (x86_64),6.7.0-060700-generic (x86_64),6.7.0-060700-generic (x86_64)
Desktop,,GNOME Shell 45.2,GNOME Shell 45.2,GNOME Shell 45.2,GNOME Shell 45.2,GNOME Shell 45.2
Display Server,,X Server 1.21.1.7,X Server 1.21.1.7,X Server 1.21.1.7,X Server 1.21.1.7,X Server 1.21.1.7
Display Driver,,NVIDIA 550.54.14,NVIDIA 550.54.14,NVIDIA 550.54.14,NVIDIA 550.54.14,NVIDIA 550.54.14
OpenGL,,4.6.0,4.6.0,4.6.0,4.6.0,4.6.0
OpenCL,,OpenCL 3.0 CUDA 12.4.89,OpenCL 3.0 CUDA 12.4.89,OpenCL 3.0 CUDA 12.4.89,OpenCL 3.0 CUDA 12.4.89,OpenCL 3.0 CUDA 12.4.89
Compiler,,GCC 13.2.0,GCC 13.2.0,GCC 13.2.0,GCC 13.2.0,GCC 13.2.0
File-System,,ext4,ext4,ext4,ext4,ext4
Screen Resolution,,3840x2160,3840x2160,3840x2160,3840x2160,3840x2160
,,"a","b","c","d","e"
"Neural Magic DeepSparse - Model: NLP Text Classification, DistilBERT mnli - Scenario: Synchronous Single-Stream (items/sec)",HIB,117.6643,116.3492,116.5639,115.2566,117.2079
"Neural Magic DeepSparse - Model: NLP Text Classification, DistilBERT mnli - Scenario: Synchronous Single-Stream (ms/batch)",LIB,8.4942,8.5902,8.5743,8.6715,8.5269
"Neural Magic DeepSparse - Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Stream (ms/batch)",LIB,369.7269,376.3639,375.8659,376.5224,374.9653
"Neural Magic DeepSparse - Model: ResNet-50, Sparse INT8 - Scenario: Synchronous Single-Stream (ms/batch)",LIB,0.6937,0.6932,0.6899,0.7019,0.6957
"Neural Magic DeepSparse - Model: ResNet-50, Sparse INT8 - Scenario: Synchronous Single-Stream (items/sec)",HIB,1437.5523,1438.271,1444.8333,1420.7445,1433.2426
"Neural Magic DeepSparse - Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Stream (items/sec)",HIB,21.5986,21.2505,21.2799,21.2445,21.3119
"Neural Magic DeepSparse - Model: ResNet-50, Sparse INT8 - Scenario: Asynchronous Multi-Stream (ms/batch)",LIB,3.3518,3.3559,3.3425,3.3488,3.3800
"Neural Magic DeepSparse - Model: ResNet-50, Sparse INT8 - Scenario: Asynchronous Multi-Stream (items/sec)",HIB,2379.9513,2376.5719,2385.769,2381.2716,2359.6605
"Neural Magic DeepSparse - Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream (ms/batch)",LIB,28.6159,28.5076,28.4559,28.5083,28.3070
"Neural Magic DeepSparse - Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream (items/sec)",HIB,279.4430,280.4549,280.98,280.5104,282.4848
"Neural Magic DeepSparse - Model: NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Scenario: Asynchronous Multi-Stream (items/sec)",HIB,929.8526,928.1657,927.609,920.2774,926.3913
"Neural Magic DeepSparse - Model: NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Scenario: Asynchronous Multi-Stream (ms/batch)",LIB,8.5925,8.6079,8.6128,8.6817,8.6244
"Neural Magic DeepSparse - Model: CV Classification, ResNet-50 ImageNet - Scenario: Synchronous Single-Stream (items/sec)",HIB,194.4294,195.4038,196.3357,196.3727,195.9355
"Neural Magic DeepSparse - Model: CV Classification, ResNet-50 ImageNet - Scenario: Synchronous Single-Stream (ms/batch)",LIB,5.1378,5.112,5.088,5.0871,5.0981
"Neural Magic DeepSparse - Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream (items/sec)",HIB,191.7023,192.506,192.6076,192.3054,190.7916
"Neural Magic DeepSparse - Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream (ms/batch)",LIB,41.7072,41.53,41.5244,41.5819,41.9183
"Neural Magic DeepSparse - Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Stream (items/sec)",HIB,21.5097,21.4734,21.3153,21.4523,21.4247
"Neural Magic DeepSparse - Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Stream (ms/batch)",LIB,371.5702,370.8275,374.0775,371.948,372.4923
"Neural Magic DeepSparse - Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Synchronous Single-Stream (items/sec)",HIB,18.8124,18.6562,18.6913,18.7156,18.6648
"Neural Magic DeepSparse - Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Synchronous Single-Stream (ms/batch)",LIB,53.1496,53.5945,53.494,53.4247,53.5694
"Neural Magic DeepSparse - Model: Llama2 Chat 7b Quantized - Scenario: Asynchronous Multi-Stream (ms/batch)",LIB,1900.4795,1894.2203,1905.4156,1908.6078,1900.5641
"Neural Magic DeepSparse - Model: Llama2 Chat 7b Quantized - Scenario: Asynchronous Multi-Stream (items/sec)",HIB,4.0959,4.1098,4.0853,4.0791,4.0962
"Neural Magic DeepSparse - Model: BERT-Large, NLP Question Answering, Sparse INT8 - Scenario: Asynchronous Multi-Stream (ms/batch)",LIB,18.5738,18.5138,18.5539,18.5638,18.6294
"Neural Magic DeepSparse - Model: BERT-Large, NLP Question Answering, Sparse INT8 - Scenario: Asynchronous Multi-Stream (items/sec)",HIB,430.4254,431.8114,430.8886,430.6637,429.1529
"Neural Magic DeepSparse - Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Synchronous Single-Stream (ms/batch)",LIB,53.7610,53.9298,53.7145,53.6024,53.7068
"Neural Magic DeepSparse - Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Synchronous Single-Stream (items/sec)",HIB,18.5981,18.5403,18.6145,18.6535,18.6168
"Neural Magic DeepSparse - Model: BERT-Large, NLP Question Answering, Sparse INT8 - Scenario: Synchronous Single-Stream (items/sec)",HIB,112.8655,112.649,112.2523,112.5691,112.5344
"Neural Magic DeepSparse - Model: BERT-Large, NLP Question Answering, Sparse INT8 - Scenario: Synchronous Single-Stream (ms/batch)",LIB,8.8521,8.8696,8.9004,8.8748,8.8780
"Neural Magic DeepSparse - Model: CV Detection, YOLOv5s COCO, Sparse INT8 - Scenario: Asynchronous Multi-Stream (items/sec)",HIB,126.3399,126.6763,127.0251,126.4112,126.7258
"Neural Magic DeepSparse - Model: NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Scenario: Synchronous Single-Stream (items/sec)",HIB,300.8741,301.2353,300.1138,301.7005,301.1689
"Neural Magic DeepSparse - Model: NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Scenario: Synchronous Single-Stream (ms/batch)",LIB,3.3206,3.3168,3.3287,3.3113,3.3176
"Neural Magic DeepSparse - Model: CV Detection, YOLOv5s COCO, Sparse INT8 - Scenario: Asynchronous Multi-Stream (ms/batch)",LIB,63.2681,63.1227,62.9466,63.2608,63.0966
"Neural Magic DeepSparse - Model: CV Detection, YOLOv5s COCO, Sparse INT8 - Scenario: Synchronous Single-Stream (items/sec)",HIB,99.0032,99.497,99.4073,99.4984,99.1040
"Neural Magic DeepSparse - Model: CV Detection, YOLOv5s COCO, Sparse INT8 - Scenario: Synchronous Single-Stream (ms/batch)",LIB,10.0959,10.046,10.0546,10.046,10.0857
"Neural Magic DeepSparse - Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Synchronous Single-Stream (ms/batch)",LIB,31.6588,31.5706,31.5743,31.5308,31.6738
"Neural Magic DeepSparse - Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Asynchronous Multi-Stream (ms/batch)",LIB,212.4479,211.7512,211.819,212.0904,212.7103
"Neural Magic DeepSparse - Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Asynchronous Multi-Stream (items/sec)",HIB,37.6522,37.7759,37.7639,37.7156,37.6057
"Neural Magic DeepSparse - Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Synchronous Single-Stream (items/sec)",HIB,31.5733,31.6614,31.6577,31.7017,31.5591
"Neural Magic DeepSparse - Model: ResNet-50, Baseline - Scenario: Synchronous Single-Stream (items/sec)",HIB,195.2905,195.9601,195.5005,196.0237,195.7473
"Neural Magic DeepSparse - Model: ResNet-50, Baseline - Scenario: Synchronous Single-Stream (ms/batch)",LIB,5.1149,5.0976,5.1095,5.0963,5.1030
"Neural Magic DeepSparse - Model: ResNet-50, Baseline - Scenario: Asynchronous Multi-Stream (items/sec)",HIB,280.6164,280.4277,281.0267,280.4486,280.5353
"Neural Magic DeepSparse - Model: ResNet-50, Baseline - Scenario: Asynchronous Multi-Stream (ms/batch)",LIB,28.4928,28.5051,28.458,28.5145,28.5061
"Neural Magic DeepSparse - Model: Llama2 Chat 7b Quantized - Scenario: Synchronous Single-Stream (ms/batch)",LIB,131.3760,131.409,131.4587,131.5957,131.5494
"Neural Magic DeepSparse - Model: Llama2 Chat 7b Quantized - Scenario: Synchronous Single-Stream (items/sec)",HIB,7.6108,7.6089,7.606,7.5982,7.6006