3970X satty AMD Ryzen Threadripper 3970X 32-Core testing with a ASUS ROG ZENITH II EXTREME (1603 BIOS) and AMD Radeon RX 5700 8GB on Ubuntu 22.04 via the Phoronix Test Suite. A: Processor: AMD Ryzen Threadripper 3970X 32-Core @ 3.70GHz (32 Cores / 64 Threads), Motherboard: ASUS ROG ZENITH II EXTREME (1603 BIOS), Chipset: AMD Starship/Matisse, Memory: 64GB, Disk: Samsung SSD 980 PRO 500GB, Graphics: AMD Radeon RX 5700 8GB (1750/875MHz), Audio: AMD Navi 10 HDMI Audio, Monitor: ASUS VP28U, Network: Aquantia AQC107 NBase-T/IEEE + Intel I211 + Intel Wi-Fi 6 AX200 OS: Ubuntu 22.04, Kernel: 5.19.0-051900rc7-generic (x86_64), Desktop: GNOME Shell 42.2, Display Server: X Server + Wayland, OpenGL: 4.6 Mesa 22.0.1 (LLVM 13.0.1 DRM 3.47), Vulkan: 1.2.204, Compiler: GCC 11.2.0, File-System: ext4, Screen Resolution: 3840x2160 B: Processor: AMD Ryzen Threadripper 3970X 32-Core @ 3.70GHz (32 Cores / 64 Threads), Motherboard: ASUS ROG ZENITH II EXTREME (1603 BIOS), Chipset: AMD Starship/Matisse, Memory: 64GB, Disk: Samsung SSD 980 PRO 500GB, Graphics: AMD Radeon RX 5700 8GB (1750/875MHz), Audio: AMD Navi 10 HDMI Audio, Monitor: ASUS VP28U, Network: Aquantia AQC107 NBase-T/IEEE + Intel I211 + Intel Wi-Fi 6 AX200 OS: Ubuntu 22.04, Kernel: 5.19.0-051900rc7-generic (x86_64), Desktop: GNOME Shell 42.2, Display Server: X Server + Wayland, OpenGL: 4.6 Mesa 22.0.1 (LLVM 13.0.1 DRM 3.47), Vulkan: 1.2.204, Compiler: GCC 11.2.0, File-System: ext4, Screen Resolution: 3840x2160 C: Processor: AMD Ryzen Threadripper 3970X 32-Core @ 3.70GHz (32 Cores / 64 Threads), Motherboard: ASUS ROG ZENITH II EXTREME (1603 BIOS), Chipset: AMD Starship/Matisse, Memory: 64GB, Disk: Samsung SSD 980 PRO 500GB, Graphics: AMD Radeon RX 5700 8GB (1750/875MHz), Audio: AMD Navi 10 HDMI Audio, Monitor: ASUS VP28U, Network: Aquantia AQC107 NBase-T/IEEE + Intel I211 + Intel Wi-Fi 6 AX200 OS: Ubuntu 22.04, Kernel: 5.19.0-051900rc7-generic (x86_64), Desktop: GNOME Shell 42.2, Display Server: X Server + Wayland, OpenGL: 4.6 Mesa 22.0.1 (LLVM 13.0.1 DRM 3.47), Vulkan: 1.2.204, Compiler: GCC 11.2.0, File-System: ext4, Screen Resolution: 3840x2160 JPEG XL libjxl 0.7 Input: JPEG - Quality: 100 MP/s > Higher Is Better A . 0.69 |===================================================================== B . 0.68 |==================================================================== C . 0.68 |==================================================================== JPEG XL libjxl 0.7 Input: PNG - Quality: 100 MP/s > Higher Is Better A . 0.7 |====================================================================== B . 0.7 |====================================================================== C . 0.7 |====================================================================== OpenRadioss 2022.10.13 Model: INIVOL and Fluid Structure Interaction Drop Container Seconds < Lower Is Better A . 225.14 |================================================================== B . 225.22 |================================================================== C . 229.88 |=================================================================== OpenRadioss 2022.10.13 Model: Bird Strike on Windshield Seconds < Lower Is Better A . 152.94 |================================================================== B . 153.28 |================================================================== C . 155.77 |=================================================================== JPEG XL libjxl 0.7 Input: JPEG - Quality: 80 MP/s > Higher Is Better A . 9.19 |===================================================================== B . 9.06 |==================================================================== C . 8.88 |=================================================================== JPEG XL libjxl 0.7 Input: PNG - Quality: 80 MP/s > Higher Is Better A . 9.50 |===================================================================== B . 9.41 |==================================================================== C . 9.34 |==================================================================== JPEG XL libjxl 0.7 Input: JPEG - Quality: 90 MP/s > Higher Is Better A . 9.03 |===================================================================== B . 8.93 |==================================================================== C . 8.83 |=================================================================== JPEG XL libjxl 0.7 Input: PNG - Quality: 90 MP/s > Higher Is Better A . 9.45 |===================================================================== B . 9.34 |==================================================================== C . 9.28 |==================================================================== OpenRadioss 2022.10.13 Model: Bumper Beam Seconds < Lower Is Better A . 90.75 |==================================================================== B . 90.34 |==================================================================== C . 90.38 |==================================================================== libavif avifenc 0.11 Encoder Speed: 0 Seconds < Lower Is Better A . 80.52 |=================================================================== B . 79.72 |================================================================== C . 81.56 |==================================================================== OpenRadioss 2022.10.13 Model: Rubber O-Ring Seal Installation Seconds < Lower Is Better A . 68.72 |=================================================================== B . 69.73 |==================================================================== C . 69.28 |==================================================================== Neural Magic DeepSparse 1.1 Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-Stream ms/batch < Lower Is Better A . 178.18 |================================================================== B . 179.64 |=================================================================== C . 178.25 |================================================================== Neural Magic DeepSparse 1.1 Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-Stream items/sec > Higher Is Better A . 89.71 |==================================================================== B . 88.98 |=================================================================== C . 89.43 |==================================================================== Neural Magic DeepSparse 1.1 Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Stream ms/batch < Lower Is Better A . 624.74 |================================================================== B . 635.76 |=================================================================== C . 631.02 |=================================================================== Neural Magic DeepSparse 1.1 Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Stream items/sec > Higher Is Better A . 25.31 |==================================================================== B . 25.11 |=================================================================== C . 25.26 |==================================================================== Neural Magic DeepSparse 1.1 Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Stream ms/batch < Lower Is Better A . 633.36 |=================================================================== B . 632.85 |=================================================================== C . 634.19 |=================================================================== Neural Magic DeepSparse 1.1 Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Stream items/sec > Higher Is Better A . 25.16 |==================================================================== B . 25.21 |==================================================================== C . 25.14 |==================================================================== Neural Magic DeepSparse 1.1 Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-Stream ms/batch < Lower Is Better A . 157.08 |=================================================================== B . 157.19 |=================================================================== C . 157.00 |=================================================================== Neural Magic DeepSparse 1.1 Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-Stream items/sec > Higher Is Better A . 101.84 |=================================================================== B . 101.76 |=================================================================== C . 101.89 |=================================================================== JPEG XL Decoding libjxl 0.7 CPU Threads: 1 MP/s > Higher Is Better A . 46.61 |=================================================================== B . 46.08 |================================================================== C . 47.24 |==================================================================== Neural Magic DeepSparse 1.1 Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Synchronous Single-Stream ms/batch < Lower Is Better A . 32.96 |=================================================================== B . 33.70 |==================================================================== C . 33.38 |=================================================================== Neural Magic DeepSparse 1.1 Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Synchronous Single-Stream items/sec > Higher Is Better A . 30.33 |==================================================================== B . 29.67 |=================================================================== C . 29.95 |=================================================================== Neural Magic DeepSparse 1.1 Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Synchronous Single-Stream ms/batch < Lower Is Better A . 62.08 |=================================================================== B . 62.62 |==================================================================== C . 62.62 |==================================================================== Neural Magic DeepSparse 1.1 Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Synchronous Single-Stream items/sec > Higher Is Better A . 16.11 |==================================================================== B . 15.97 |=================================================================== C . 15.97 |=================================================================== Neural Magic DeepSparse 1.1 Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Synchronous Single-Stream ms/batch < Lower Is Better A . 62.71 |=================================================================== B . 63.35 |==================================================================== C . 62.98 |==================================================================== Neural Magic DeepSparse 1.1 Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Synchronous Single-Stream items/sec > Higher Is Better A . 15.94 |==================================================================== B . 15.78 |=================================================================== C . 15.88 |==================================================================== Neural Magic DeepSparse 1.1 Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Synchronous Single-Stream ms/batch < Lower Is Better A . 23.97 |=================================================================== B . 24.41 |==================================================================== C . 23.80 |================================================================== Neural Magic DeepSparse 1.1 Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Synchronous Single-Stream items/sec > Higher Is Better A . 41.71 |==================================================================== B . 40.96 |================================================================== C . 42.01 |==================================================================== OpenRadioss 2022.10.13 Model: Cell Phone Drop Test Seconds < Lower Is Better A . 43.31 |=================================================================== B . 43.19 |=================================================================== C . 43.96 |==================================================================== libavif avifenc 0.11 Encoder Speed: 2 Seconds < Lower Is Better A . 43.20 |==================================================================== B . 43.11 |==================================================================== C . 42.91 |==================================================================== Neural Magic DeepSparse 1.1 Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream ms/batch < Lower Is Better A . 79.34 |==================================================================== B . 79.79 |==================================================================== C . 79.38 |==================================================================== Neural Magic DeepSparse 1.1 Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream items/sec > Higher Is Better A . 201.60 |=================================================================== B . 200.45 |=================================================================== C . 201.50 |=================================================================== Neural Magic DeepSparse 1.1 Model: CV Detection,YOLOv5s COCO - Scenario: Asynchronous Multi-Stream ms/batch < Lower Is Better A . 111.13 |=============================================================== B . 118.26 |=================================================================== C . 115.32 |================================================================= Neural Magic DeepSparse 1.1 Model: CV Detection,YOLOv5s COCO - Scenario: Asynchronous Multi-Stream items/sec > Higher Is Better A . 143.82 |=================================================================== B . 135.12 |=============================================================== C . 138.51 |================================================================= Neural Magic DeepSparse 1.1 Model: NLP Text Classification, DistilBERT mnli - Scenario: Synchronous Single-Stream ms/batch < Lower Is Better A . 11.88 |================================================================= B . 12.37 |==================================================================== C . 12.24 |=================================================================== Neural Magic DeepSparse 1.1 Model: NLP Text Classification, DistilBERT mnli - Scenario: Synchronous Single-Stream items/sec > Higher Is Better A . 84.10 |==================================================================== B . 80.79 |================================================================= C . 81.63 |================================================================== Neural Magic DeepSparse 1.1 Model: CV Detection,YOLOv5s COCO - Scenario: Synchronous Single-Stream ms/batch < Lower Is Better A . 12.92 |==================================================================== B . 13.00 |==================================================================== C . 12.96 |==================================================================== Neural Magic DeepSparse 1.1 Model: CV Detection,YOLOv5s COCO - Scenario: Synchronous Single-Stream items/sec > Higher Is Better A . 77.34 |==================================================================== B . 76.89 |==================================================================== C . 77.11 |==================================================================== Neural Magic DeepSparse 1.1 Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream ms/batch < Lower Is Better A . 54.11 |==================================================================== B . 54.27 |==================================================================== C . 54.20 |==================================================================== Neural Magic DeepSparse 1.1 Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream items/sec > Higher Is Better A . 295.57 |=================================================================== B . 294.69 |=================================================================== C . 295.10 |=================================================================== Neural Magic DeepSparse 1.1 Model: CV Classification, ResNet-50 ImageNet - Scenario: Synchronous Single-Stream ms/batch < Lower Is Better A . 7.5796 |=================================================================== B . 7.6183 |=================================================================== C . 7.6032 |=================================================================== Neural Magic DeepSparse 1.1 Model: CV Classification, ResNet-50 ImageNet - Scenario: Synchronous Single-Stream items/sec > Higher Is Better A . 131.82 |=================================================================== B . 131.14 |=================================================================== C . 131.41 |=================================================================== JPEG XL Decoding libjxl 0.7 CPU Threads: All MP/s > Higher Is Better A . 276.65 |=================================================================== B . 270.31 |================================================================= C . 271.88 |================================================================== libavif avifenc 0.11 Encoder Speed: 6, Lossless Seconds < Lower Is Better A . 6.850 |=================================================================== B . 6.890 |=================================================================== C . 6.947 |==================================================================== libavif avifenc 0.11 Encoder Speed: 10, Lossless Seconds < Lower Is Better A . 4.901 |=================================================================== B . 4.948 |==================================================================== C . 4.948 |==================================================================== libavif avifenc 0.11 Encoder Speed: 6 Seconds < Lower Is Better A . 3.407 |=================================================================== B . 3.419 |=================================================================== C . 3.447 |====================================================================