sss AMD Ryzen 9 5950X 16-Core testing with a ASUS ROG CROSSHAIR VIII HERO (WI-FI) (4006 BIOS) and llvmpipe on Ubuntu 20.04 via the Phoronix Test Suite. A: Processor: AMD Ryzen 9 5950X 16-Core @ 3.40GHz (16 Cores / 32 Threads), Motherboard: ASUS ROG CROSSHAIR VIII HERO (WI-FI) (4006 BIOS), Chipset: AMD Starship/Matisse, Memory: 32GB, Disk: 500GB Western Digital WDS500G3X0C-00SJG0, Graphics: llvmpipe (2450MHz), Audio: Intel Device 4f92, Monitor: ASUS MG28U, Network: Realtek RTL8125 2.5GbE + Intel I211 + Intel Wi-Fi 6 AX200 OS: Ubuntu 20.04, Kernel: 6.0.0-060000rc5daily20220915-generic (x86_64), Desktop: GNOME Shell 3.36.9, Display Server: X Server 1.20.13, OpenGL: 4.5 Mesa 21.2.6 (LLVM 12.0.0 256 bits), OpenCL: OpenCL 3.0, Vulkan: 1.1.182, Compiler: GCC 9.4.0, File-System: ext4, Screen Resolution: 3840x2160 B: Processor: AMD Ryzen 9 5950X 16-Core @ 3.40GHz (16 Cores / 32 Threads), Motherboard: ASUS ROG CROSSHAIR VIII HERO (WI-FI) (4006 BIOS), Chipset: AMD Starship/Matisse, Memory: 32GB, Disk: 500GB Western Digital WDS500G3X0C-00SJG0, Graphics: llvmpipe (2450MHz), Audio: Intel Device 4f92, Monitor: ASUS MG28U, Network: Realtek RTL8125 2.5GbE + Intel I211 + Intel Wi-Fi 6 AX200 OS: Ubuntu 20.04, Kernel: 6.0.0-060000rc5daily20220915-generic (x86_64), Desktop: GNOME Shell 3.36.9, Display Server: X Server 1.20.13, OpenGL: 4.5 Mesa 21.2.6 (LLVM 12.0.0 256 bits), OpenCL: OpenCL 3.0, Vulkan: 1.1.182, Compiler: GCC 9.4.0, File-System: ext4, Screen Resolution: 3840x2160 C: Processor: AMD Ryzen 9 5950X 16-Core @ 3.40GHz (16 Cores / 32 Threads), Motherboard: ASUS ROG CROSSHAIR VIII HERO (WI-FI) (4006 BIOS), Chipset: AMD Starship/Matisse, Memory: 32GB, Disk: 500GB Western Digital WDS500G3X0C-00SJG0, Graphics: llvmpipe (2450MHz), Audio: Intel Device 4f92, Monitor: ASUS MG28U, Network: Realtek RTL8125 2.5GbE + Intel I211 + Intel Wi-Fi 6 AX200 OS: Ubuntu 20.04, Kernel: 6.0.0-060000rc5daily20220915-generic (x86_64), Desktop: GNOME Shell 3.36.9, Display Server: X Server 1.20.13, OpenGL: 4.5 Mesa 21.2.6 (LLVM 12.0.0 256 bits), OpenCL: OpenCL 3.0, Vulkan: 1.1.182, Compiler: GCC 9.4.0, File-System: ext4, Screen Resolution: 3840x2160 Neural Magic DeepSparse 1.1 Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Stream items/sec > Higher Is Better A . 12.73 |==================================================================== B . 12.74 |==================================================================== C . 12.67 |==================================================================== Neural Magic DeepSparse 1.1 Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Stream ms/batch < Lower Is Better A . 622.84 |================================================================== B . 625.55 |=================================================================== C . 628.29 |=================================================================== Neural Magic DeepSparse 1.1 Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Synchronous Single-Stream items/sec > Higher Is Better A . 11.36 |==================================================================== B . 11.35 |==================================================================== C . 11.33 |==================================================================== Neural Magic DeepSparse 1.1 Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Synchronous Single-Stream ms/batch < Lower Is Better A . 88.01 |==================================================================== B . 88.10 |==================================================================== C . 88.28 |==================================================================== Neural Magic DeepSparse 1.1 Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-Stream items/sec > Higher Is Better A . 41.58 |==================================================================== B . 41.48 |==================================================================== C . 40.58 |================================================================== Neural Magic DeepSparse 1.1 Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-Stream ms/batch < Lower Is Better A . 192.36 |================================================================= B . 192.83 |================================================================== C . 197.10 |=================================================================== Neural Magic DeepSparse 1.1 Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Synchronous Single-Stream items/sec > Higher Is Better A . 31.91 |==================================================================== B . 31.88 |==================================================================== C . 31.83 |==================================================================== Neural Magic DeepSparse 1.1 Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Synchronous Single-Stream ms/batch < Lower Is Better A . 31.33 |==================================================================== B . 31.36 |==================================================================== C . 31.41 |==================================================================== Neural Magic DeepSparse 1.1 Model: CV Detection,YOLOv5s COCO - Scenario: Asynchronous Multi-Stream items/sec > Higher Is Better A . 67.81 |=================================================================== B . 68.33 |==================================================================== C . 67.49 |=================================================================== Neural Magic DeepSparse 1.1 Model: CV Detection,YOLOv5s COCO - Scenario: Asynchronous Multi-Stream ms/batch < Lower Is Better A . 117.85 |=================================================================== B . 116.97 |================================================================== C . 118.41 |=================================================================== Neural Magic DeepSparse 1.1 Model: CV Detection,YOLOv5s COCO - Scenario: Synchronous Single-Stream items/sec > Higher Is Better A . 56.23 |==================================================================== B . 56.30 |==================================================================== C . 55.91 |==================================================================== Neural Magic DeepSparse 1.1 Model: CV Detection,YOLOv5s COCO - Scenario: Synchronous Single-Stream ms/batch < Lower Is Better A . 17.78 |==================================================================== B . 17.75 |==================================================================== C . 17.88 |==================================================================== Neural Magic DeepSparse 1.1 Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream items/sec > Higher Is Better A . 159.54 |=================================================================== B . 158.59 |=================================================================== C . 158.25 |================================================================== Neural Magic DeepSparse 1.1 Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream ms/batch < Lower Is Better A . 50.10 |=================================================================== B . 50.42 |==================================================================== C . 50.52 |==================================================================== Neural Magic DeepSparse 1.1 Model: CV Classification, ResNet-50 ImageNet - Scenario: Synchronous Single-Stream items/sec > Higher Is Better A . 112.56 |=================================================================== B . 112.46 |=================================================================== C . 112.36 |=================================================================== Neural Magic DeepSparse 1.1 Model: CV Classification, ResNet-50 ImageNet - Scenario: Synchronous Single-Stream ms/batch < Lower Is Better A . 8.8777 |=================================================================== B . 8.8852 |=================================================================== C . 8.8930 |=================================================================== Neural Magic DeepSparse 1.1 Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream items/sec > Higher Is Better A . 119.37 |=================================================================== B . 119.28 |=================================================================== C . 118.96 |=================================================================== Neural Magic DeepSparse 1.1 Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream ms/batch < Lower Is Better A . 66.99 |==================================================================== B . 67.03 |==================================================================== C . 67.21 |==================================================================== Neural Magic DeepSparse 1.1 Model: NLP Text Classification, DistilBERT mnli - Scenario: Synchronous Single-Stream items/sec > Higher Is Better A . 80.50 |==================================================================== B . 80.33 |==================================================================== C . 80.04 |==================================================================== Neural Magic DeepSparse 1.1 Model: NLP Text Classification, DistilBERT mnli - Scenario: Synchronous Single-Stream ms/batch < Lower Is Better A . 12.42 |==================================================================== B . 12.44 |==================================================================== C . 12.49 |==================================================================== Neural Magic DeepSparse 1.1 Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-Stream items/sec > Higher Is Better A . 55.30 |==================================================================== B . 55.24 |==================================================================== C . 55.22 |==================================================================== Neural Magic DeepSparse 1.1 Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-Stream ms/batch < Lower Is Better A . 144.47 |=================================================================== B . 144.70 |=================================================================== C . 144.77 |=================================================================== Neural Magic DeepSparse 1.1 Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Synchronous Single-Stream items/sec > Higher Is Better A . 41.35 |==================================================================== B . 41.29 |==================================================================== C . 41.23 |==================================================================== Neural Magic DeepSparse 1.1 Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Synchronous Single-Stream ms/batch < Lower Is Better A . 24.18 |==================================================================== B . 24.21 |==================================================================== C . 24.25 |==================================================================== Neural Magic DeepSparse 1.1 Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Stream items/sec > Higher Is Better A . 12.71 |==================================================================== B . 12.69 |==================================================================== C . 12.62 |==================================================================== Neural Magic DeepSparse 1.1 Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Stream ms/batch < Lower Is Better A . 626.73 |=================================================================== B . 626.01 |================================================================== C . 631.12 |=================================================================== Neural Magic DeepSparse 1.1 Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Synchronous Single-Stream items/sec > Higher Is Better A . 11.43 |==================================================================== B . 11.31 |=================================================================== C . 11.35 |==================================================================== Neural Magic DeepSparse 1.1 Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Synchronous Single-Stream ms/batch < Lower Is Better A . 87.49 |=================================================================== B . 88.43 |==================================================================== C . 88.13 |==================================================================== oneDNN 2.7 Harness: IP Shapes 1D - Data Type: f32 - Engine: CPU ms < Lower Is Better A . 3.86625 |================================================================ B . 3.92386 |================================================================= C . 3.96322 |================================================================== oneDNN 2.7 Harness: IP Shapes 3D - Data Type: f32 - Engine: CPU ms < Lower Is Better A . 8.18095 |=========================================================== B . 7.95740 |========================================================== C . 9.08580 |================================================================== oneDNN 2.7 Harness: IP Shapes 1D - Data Type: u8s8f32 - Engine: CPU ms < Lower Is Better A . 0.776119 |================================================================= B . 0.777507 |================================================================= C . 0.775055 |================================================================= oneDNN 2.7 Harness: IP Shapes 3D - Data Type: u8s8f32 - Engine: CPU ms < Lower Is Better A . 0.467669 |================================================================ B . 0.459909 |=============================================================== C . 0.473113 |================================================================= oneDNN 2.7 Harness: IP Shapes 1D - Data Type: bf16bf16bf16 - Engine: CPU ms < Lower Is Better oneDNN 2.7 Harness: IP Shapes 3D - Data Type: bf16bf16bf16 - Engine: CPU ms < Lower Is Better oneDNN 2.7 Harness: Convolution Batch Shapes Auto - Data Type: f32 - Engine: CPU ms < Lower Is Better A . 17.03 |==================================================================== B . 16.81 |=================================================================== C . 17.12 |==================================================================== oneDNN 2.7 Harness: Deconvolution Batch shapes_1d - Data Type: f32 - Engine: CPU ms < Lower Is Better A . 4.40752 |================================================================== B . 4.36002 |================================================================= C . 4.39504 |================================================================== oneDNN 2.7 Harness: Deconvolution Batch shapes_3d - Data Type: f32 - Engine: CPU ms < Lower Is Better A . 3.57805 |================================================================= B . 3.63445 |================================================================== C . 3.60370 |================================================================= oneDNN 2.7 Harness: Convolution Batch Shapes Auto - Data Type: u8s8f32 - Engine: CPU ms < Lower Is Better A . 18.42 |================================================================== B . 18.23 |================================================================= C . 18.93 |==================================================================== oneDNN 2.7 Harness: Deconvolution Batch shapes_1d - Data Type: u8s8f32 - Engine: CPU ms < Lower Is Better A . 1.07159 |================================================================== B . 1.07245 |================================================================== C . 1.07602 |================================================================== oneDNN 2.7 Harness: Deconvolution Batch shapes_3d - Data Type: u8s8f32 - Engine: CPU ms < Lower Is Better A . 1.65982 |================================================================= B . 1.68678 |================================================================== C . 1.67046 |================================================================= oneDNN 2.7 Harness: Recurrent Neural Network Training - Data Type: f32 - Engine: CPU ms < Lower Is Better A . 2602.44 |================================================================ B . 2624.27 |================================================================= C . 2670.40 |================================================================== oneDNN 2.7 Harness: Recurrent Neural Network Inference - Data Type: f32 - Engine: CPU ms < Lower Is Better A . 1647.73 |============================================================== B . 1666.79 |=============================================================== C . 1744.78 |================================================================== oneDNN 2.7 Harness: Recurrent Neural Network Training - Data Type: u8s8f32 - Engine: CPU ms < Lower Is Better A . 2594.59 |================================================================= B . 2590.10 |================================================================= C . 2627.85 |================================================================== oneDNN 2.7 Harness: Convolution Batch Shapes Auto - Data Type: bf16bf16bf16 - Engine: CPU ms < Lower Is Better oneDNN 2.7 Harness: Deconvolution Batch shapes_1d - Data Type: bf16bf16bf16 - Engine: CPU ms < Lower Is Better oneDNN 2.7 Harness: Deconvolution Batch shapes_3d - Data Type: bf16bf16bf16 - Engine: CPU ms < Lower Is Better oneDNN 2.7 Harness: Recurrent Neural Network Inference - Data Type: u8s8f32 - Engine: CPU ms < Lower Is Better A . 1641.15 |================================================================= B . 1655.47 |================================================================== C . 1664.44 |================================================================== oneDNN 2.7 Harness: Matrix Multiply Batch Shapes Transformer - Data Type: f32 - Engine: CPU ms < Lower Is Better A . 0.786243 |================================================================ B . 0.795473 |================================================================= C . 0.789910 |================================================================= oneDNN 2.7 Harness: Recurrent Neural Network Training - Data Type: bf16bf16bf16 - Engine: CPU ms < Lower Is Better A . 2608.12 |================================================================== B . 2597.67 |================================================================== C . 2598.17 |================================================================== oneDNN 2.7 Harness: Recurrent Neural Network Inference - Data Type: bf16bf16bf16 - Engine: CPU ms < Lower Is Better A . 1637.87 |=============================================================== B . 1679.64 |================================================================= C . 1703.11 |================================================================== oneDNN 2.7 Harness: Matrix Multiply Batch Shapes Transformer - Data Type: u8s8f32 - Engine: CPU ms < Lower Is Better A . 0.681937 |================================================================= B . 0.682747 |================================================================= C . 0.682228 |================================================================= oneDNN 2.7 Harness: Matrix Multiply Batch Shapes Transformer - Data Type: bf16bf16bf16 - Engine: CPU ms < Lower Is Better OpenRadioss 2022.10.13 Model: Bumper Beam Seconds < Lower Is Better A . 110.06 |=================================================================== B . 110.29 |=================================================================== C . 107.76 |================================================================= OpenRadioss 2022.10.13 Model: Cell Phone Drop Test Seconds < Lower Is Better A . 87.55 |=================================================================== B . 87.66 |=================================================================== C . 88.81 |==================================================================== OpenRadioss 2022.10.13 Model: Bird Strike on Windshield Seconds < Lower Is Better A . 225.54 |================================================================== B . 226.96 |=================================================================== C . 227.52 |=================================================================== OpenRadioss 2022.10.13 Model: Rubber O-Ring Seal Installation Seconds < Lower Is Better A . 92.08 |================================================================== B . 93.05 |=================================================================== C . 94.30 |==================================================================== OpenRadioss 2022.10.13 Model: INIVOL and Fluid Structure Interaction Drop Container Seconds < Lower Is Better A . 512.25 |================================================================== B . 511.38 |================================================================== C . 518.29 |=================================================================== QuadRay 2022.05.25 Scene: 1 - Resolution: 4K FPS > Higher Is Better A . 11.10 |==================================================================== B . 11.11 |==================================================================== C . 11.11 |==================================================================== QuadRay 2022.05.25 Scene: 2 - Resolution: 4K FPS > Higher Is Better A . 3.41 |===================================================================== B . 3.39 |===================================================================== C . 3.39 |===================================================================== QuadRay 2022.05.25 Scene: 3 - Resolution: 4K FPS > Higher Is Better A . 2.87 |==================================================================== B . 2.90 |===================================================================== C . 2.90 |===================================================================== QuadRay 2022.05.25 Scene: 5 - Resolution: 4K FPS > Higher Is Better A . 0.89 |===================================================================== B . 0.89 |===================================================================== C . 0.89 |===================================================================== QuadRay 2022.05.25 Scene: 1 - Resolution: 1080p FPS > Higher Is Better A . 46.03 |==================================================================== B . 45.94 |==================================================================== C . 45.75 |==================================================================== QuadRay 2022.05.25 Scene: 2 - Resolution: 1080p FPS > Higher Is Better A . 13.44 |==================================================================== B . 13.33 |=================================================================== C . 13.36 |==================================================================== QuadRay 2022.05.25 Scene: 3 - Resolution: 1080p FPS > Higher Is Better A . 11.44 |==================================================================== B . 11.44 |==================================================================== C . 11.44 |==================================================================== QuadRay 2022.05.25 Scene: 5 - Resolution: 1080p FPS > Higher Is Better A . 3.54 |==================================================================== B . 3.55 |===================================================================== C . 3.57 |===================================================================== SMHasher 2022-08-22 Hash: wyhash MiB/sec > Higher Is Better A . 28600.24 |================================================================= B . 27320.49 |============================================================== C . 27857.67 |=============================================================== SMHasher 2022-08-22 Hash: wyhash cycles/hash < Lower Is Better A . 14.97 |============================================================== B . 16.32 |==================================================================== C . 15.42 |================================================================ SMHasher 2022-08-22 Hash: SHA3-256 MiB/sec > Higher Is Better A . 209.85 |=================================================================== B . 204.91 |================================================================= C . 206.29 |================================================================== SMHasher 2022-08-22 Hash: SHA3-256 cycles/hash < Lower Is Better A . 1852.23 |================================================================ B . 1898.74 |================================================================== C . 1889.91 |================================================================== SMHasher 2022-08-22 Hash: Spooky32 MiB/sec > Higher Is Better A . 19879.93 |================================================================= B . 19280.72 |=============================================================== C . 19028.97 |============================================================== SMHasher 2022-08-22 Hash: Spooky32 cycles/hash < Lower Is Better A . 29.94 |================================================================= B . 30.82 |=================================================================== C . 31.20 |==================================================================== SMHasher 2022-08-22 Hash: fasthash32 MiB/sec > Higher Is Better A . 8321.97 |================================================================== B . 7974.21 |=============================================================== C . 8089.02 |================================================================ SMHasher 2022-08-22 Hash: fasthash32 cycles/hash < Lower Is Better A . 23.51 |================================================================= B . 24.69 |==================================================================== C . 24.32 |=================================================================== SMHasher 2022-08-22 Hash: FarmHash128 MiB/sec > Higher Is Better A . 20617.68 |================================================================= B . 20202.81 |================================================================ C . 20364.50 |================================================================ SMHasher 2022-08-22 Hash: FarmHash128 cycles/hash < Lower Is Better A . 52.11 |==================================================================== B . 51.83 |==================================================================== C . 51.63 |=================================================================== SMHasher 2022-08-22 Hash: t1ha2_atonce MiB/sec > Higher Is Better A . 18113.85 |================================================================ B . 18237.82 |================================================================ C . 18384.27 |================================================================= SMHasher 2022-08-22 Hash: t1ha2_atonce cycles/hash < Lower Is Better A . 22.88 |=================================================================== B . 23.11 |==================================================================== C . 22.88 |=================================================================== SMHasher 2022-08-22 Hash: FarmHash32 x86_64 AVX MiB/sec > Higher Is Better A . 33990.69 |================================================================= B . 34077.20 |================================================================= C . 33941.33 |================================================================= SMHasher 2022-08-22 Hash: FarmHash32 x86_64 AVX cycles/hash < Lower Is Better A . 28.73 |==================================================================== B . 28.52 |==================================================================== C . 28.56 |==================================================================== SMHasher 2022-08-22 Hash: t1ha0_aes_avx2 x86_64 MiB/sec > Higher Is Better A . 83813.93 |================================================================= B . 82904.44 |================================================================ C . 81425.19 |=============================================================== SMHasher 2022-08-22 Hash: t1ha0_aes_avx2 x86_64 cycles/hash < Lower Is Better A . 22.10 |==================================================================== B . 21.95 |==================================================================== C . 22.10 |==================================================================== SMHasher 2022-08-22 Hash: MeowHash x86_64 AES-NI MiB/sec > Higher Is Better A . 46922.83 |================================================================ B . 46726.11 |================================================================ C . 47376.73 |================================================================= SMHasher 2022-08-22 Hash: MeowHash x86_64 AES-NI cycles/hash < Lower Is Better A . 53.59 |==================================================================== B . 53.46 |==================================================================== C . 53.36 |==================================================================== spaCy 3.4.1 Model: en_core_web_lg tokens/sec > Higher Is Better A . 16000 |==================================================================== B . 16021 |==================================================================== C . 16016 |==================================================================== spaCy 3.4.1 Model: en_core_web_trf tokens/sec > Higher Is Better A . 1074 |===================================================================== B . 1076 |===================================================================== C . 1069 |===================================================================== TensorFlow 2.10 Device: CPU - Batch Size: 16 - Model: AlexNet images/sec > Higher Is Better A . 56.17 |=================================================================== B . 56.67 |==================================================================== C . 56.51 |==================================================================== TensorFlow 2.10 Device: CPU - Batch Size: 32 - Model: AlexNet images/sec > Higher Is Better A . 80.01 |==================================================================== B . 79.67 |==================================================================== C . 79.54 |==================================================================== TensorFlow 2.10 Device: CPU - Batch Size: 16 - Model: GoogLeNet images/sec > Higher Is Better A . 34.05 |==================================================================== B . 34.16 |==================================================================== C . 34.20 |==================================================================== TensorFlow 2.10 Device: CPU - Batch Size: 16 - Model: ResNet-50 images/sec > Higher Is Better A . 11.79 |==================================================================== B . 11.83 |==================================================================== C . 11.78 |==================================================================== TensorFlow 2.10 Device: CPU - Batch Size: 32 - Model: GoogLeNet images/sec > Higher Is Better A . 32.36 |==================================================================== B . 32.48 |==================================================================== C . 32.53 |==================================================================== TensorFlow 2.10 Device: CPU - Batch Size: 32 - Model: ResNet-50 images/sec > Higher Is Better A . 11.50 |==================================================================== B . 11.49 |==================================================================== C . 11.47 |==================================================================== Y-Cruncher 0.7.10.9513 Pi Digits To Calculate: 1B Seconds < Lower Is Better A . 38.82 |==================================================================== B . 38.82 |==================================================================== C . 38.71 |==================================================================== Y-Cruncher 0.7.10.9513 Pi Digits To Calculate: 500M Seconds < Lower Is Better A . 18.06 |==================================================================== B . 18.13 |==================================================================== C . 18.12 |====================================================================