AMD 3D V-Cache Comparison Tests for a future article. Ryzen 9 5950X: Processor: AMD Ryzen 9 5950X 16-Core @ 3.40GHz (16 Cores / 32 Threads), Motherboard: ASUS ROG CROSSHAIR VIII HERO (WI-FI) (4006 BIOS), Chipset: AMD Starship/Matisse, Memory: 32GB, Disk: 1000GB Sabrent Rocket 4.0 1TB, Graphics: AMD Radeon RX 6800 16GB (2475/1000MHz), Audio: AMD Navi 21 HDMI Audio, Monitor: ASUS MG28U, Network: Realtek RTL8125 2.5GbE + Intel I211 + Intel Wi-Fi 6 AX200 OS: Ubuntu 22.04, Kernel: 5.17.4-051704-generic (x86_64), Desktop: GNOME Shell 42.0, Display Server: X Server + Wayland, OpenGL: 4.6 Mesa 22.2.0-devel (git-092ac67 2022-04-21 jammy-oibaf-ppa) (LLVM 14.0.0 DRM 3.44), Vulkan: 1.3.211, Compiler: GCC 11.2.0, File-System: ext4, Screen Resolution: 3840x2160 Ryzen 7 5800X3D: Processor: AMD Ryzen 7 5800X3D 8-Core @ 3.40GHz (8 Cores / 16 Threads), Motherboard: ASRock X570 Pro4 (P4.30 BIOS), Chipset: AMD Starship/Matisse, Memory: 16GB, Disk: 1000GB Sabrent Rocket 4.0 1TB, Graphics: AMD Radeon RX 6800 XT 16GB (2575/1000MHz), Audio: AMD Navi 21 HDMI Audio, Monitor: ASUS VP28U, Network: Intel I211 OS: Ubuntu 22.04, Kernel: 5.17.4-051704-generic (x86_64), Desktop: GNOME Shell 42.0, Display Server: X Server + Wayland, OpenGL: 4.6 Mesa 22.2.0-devel (git-092ac67 2022-04-21 jammy-oibaf-ppa) (LLVM 14.0.0 DRM 3.44), Vulkan: 1.3.211, Compiler: GCC 11.2.0, File-System: ext4, Screen Resolution: 3840x2160 Ryzen 7 5800X: Processor: AMD Ryzen 7 5800X 8-Core @ 3.80GHz (8 Cores / 16 Threads), Motherboard: ASRock X570 Pro4 (P4.30 BIOS), Chipset: AMD Starship/Matisse, Memory: 16GB, Disk: 1000GB Sabrent Rocket 4.0 1TB, Graphics: AMD Radeon RX 6800 XT 16GB (2575/1000MHz), Audio: AMD Navi 21 HDMI Audio, Monitor: ASUS VP28U, Network: Intel I211 OS: Ubuntu 22.04, Kernel: 5.17.4-051704-generic (x86_64), Desktop: GNOME Shell 42.0, Display Server: X Server + Wayland, OpenGL: 4.6 Mesa 22.2.0-devel (git-092ac67 2022-04-21 jammy-oibaf-ppa) (LLVM 14.0.0 DRM 3.44), Vulkan: 1.3.211, Compiler: GCC 11.2.0, File-System: ext4, Screen Resolution: 3840x2160 Ryzen 9 5900X: Processor: AMD Ryzen 9 5900X 12-Core @ 3.70GHz (12 Cores / 24 Threads), Motherboard: ASUS ROG CROSSHAIR VIII HERO (3904 BIOS), Chipset: AMD Starship/Matisse, Memory: 16GB, Disk: 1000GB Sabrent Rocket 4.0 1TB, Graphics: NVIDIA NV134 8GB, Audio: NVIDIA GP104 HD Audio, Monitor: ASUS MG28U, Network: Realtek RTL8125 2.5GbE + Intel I211 OS: Ubuntu 22.04, Kernel: 5.17.4-051704-generic (x86_64), Desktop: GNOME Shell 42.0, Display Server: X Server + Wayland, Display Driver: nouveau, OpenGL: 4.3 Mesa 22.2.0-devel (git-092ac67 2022-04-21 jammy-oibaf-ppa), Vulkan: 1.3.211, Compiler: GCC 11.2.0, File-System: ext4, Screen Resolution: 3840x2160 Core i9 12900K: Processor: Intel Core i9-12900K @ 5.20GHz (16 Cores / 24 Threads), Motherboard: ASUS ROG STRIX Z690-E GAMING WIFI (1003 BIOS), Chipset: Intel Device 7aa7, Memory: 32GB, Disk: 1000GB Sabrent Rocket 4.0 1TB, Graphics: AMD Radeon RX 6800 XT 16GB (2575/1000MHz), Audio: Intel Device 7ad0, Monitor: ASUS VP28U, Network: Intel I225-V + Intel Wi-Fi 6 AX210/AX211/AX411 OS: Ubuntu 22.04, Kernel: 5.17.4-051704-generic (x86_64), Desktop: GNOME Shell 42.0, Display Server: X Server + Wayland, OpenGL: 4.6 Mesa 22.2.0-devel (git-092ac67 2022-04-21 jammy-oibaf-ppa) (LLVM 14.0.0 DRM 3.44), Vulkan: 1.3.211, Compiler: GCC 11.2.0, File-System: ext4, Screen Resolution: 3840x2160 oneDNN 2.6 Harness: Convolution Batch Shapes Auto - Data Type: f32 - Engine: CPU ms < Lower Is Better Ryzen 9 5950X ... 16.70510 |============================================= Ryzen 7 5800X3D . 12.62270 |================================== Ryzen 7 5800X ... 18.75350 |=================================================== Ryzen 9 5900X ... 16.13980 |============================================ Core i9 12900K .. 5.87536 |================ oneDNN 2.6 Harness: Convolution Batch Shapes Auto - Data Type: u8s8f32 - Engine: CPU ms < Lower Is Better Ryzen 9 5950X ... 18.03210 |=================================================== Ryzen 7 5800X3D . 10.38000 |============================= Ryzen 7 5800X ... 16.35340 |============================================== Ryzen 9 5900X ... 16.73820 |=============================================== Core i9 12900K .. 6.00214 |================= oneDNN 2.6 Harness: Deconvolution Batch shapes_1d - Data Type: f32 - Engine: CPU ms < Lower Is Better Ryzen 9 5950X ... 4.75533 |============================ Ryzen 7 5800X3D . 7.27623 |=========================================== Ryzen 7 5800X ... 8.34203 |================================================== Ryzen 9 5900X ... 5.38689 |================================ Core i9 12900K .. 8.73750 |==================================================== oneDNN 2.6 Harness: Deconvolution Batch shapes_1d - Data Type: u8s8f32 - Engine: CPU ms < Lower Is Better Ryzen 9 5950X ... 1.06926 |=========================== Ryzen 7 5800X3D . 1.77641 |============================================= Ryzen 7 5800X ... 2.03600 |==================================================== Ryzen 9 5900X ... 1.30049 |================================= Core i9 12900K .. 1.35212 |=================================== oneDNN 2.6 Harness: Deconvolution Batch shapes_3d - Data Type: f32 - Engine: CPU ms < Lower Is Better Ryzen 9 5950X ... 3.62609 |============================== Ryzen 7 5800X3D . 5.57109 |============================================= Ryzen 7 5800X ... 6.37023 |==================================================== Ryzen 9 5900X ... 4.38773 |==================================== Core i9 12900K .. 5.25394 |=========================================== oneDNN 2.6 Harness: Deconvolution Batch shapes_3d - Data Type: u8s8f32 - Engine: CPU ms < Lower Is Better Ryzen 9 5950X ... 1.61899 |============================== Ryzen 7 5800X3D . 2.48393 |============================================= Ryzen 7 5800X ... 2.83913 |==================================================== Ryzen 9 5900X ... 1.99742 |===================================== Core i9 12900K .. 2.22336 |========================================= oneDNN 2.6 Harness: IP Shapes 1D - Data Type: f32 - Engine: CPU ms < Lower Is Better Ryzen 9 5950X ... 3.89647 |==================================================== Ryzen 7 5800X3D . 2.89717 |======================================= Ryzen 7 5800X ... 3.29136 |============================================ Ryzen 9 5900X ... 3.44548 |============================================== Core i9 12900K .. 2.63611 |=================================== oneDNN 2.6 Harness: IP Shapes 1D - Data Type: u8s8f32 - Engine: CPU ms < Lower Is Better Ryzen 9 5950X ... 0.823009 |============================== Ryzen 7 5800X3D . 1.237850 |============================================= Ryzen 7 5800X ... 1.407280 |=================================================== Ryzen 9 5900X ... 1.006941 |==================================== Core i9 12900K .. 1.052000 |====================================== oneDNN 2.6 Harness: IP Shapes 3D - Data Type: f32 - Engine: CPU ms < Lower Is Better Ryzen 9 5950X ... 7.79652 |============================================= Ryzen 7 5800X3D . 6.55765 |====================================== Ryzen 7 5800X ... 8.93552 |==================================================== Ryzen 9 5900X ... 7.54843 |============================================ Core i9 12900K .. 3.44643 |==================== oneDNN 2.6 Harness: IP Shapes 3D - Data Type: u8s8f32 - Engine: CPU ms < Lower Is Better Ryzen 9 5950X ... 0.476097 |================= Ryzen 7 5800X3D . 0.604780 |===================== Ryzen 7 5800X ... 1.457520 |=================================================== Ryzen 9 5900X ... 0.519733 |================== Core i9 12900K .. 0.812047 |============================ oneDNN 2.6 Harness: Recurrent Neural Network Training - Data Type: f32 - Engine: CPU ms < Lower Is Better Ryzen 9 5950X ... 2703.33 |============================================== Ryzen 7 5800X3D . 2683.16 |============================================== Ryzen 7 5800X ... 3053.30 |==================================================== Ryzen 9 5900X ... 2873.45 |================================================= Core i9 12900K .. 2881.72 |================================================= oneDNN 2.6 Harness: Recurrent Neural Network Training - Data Type: u8s8f32 - Engine: CPU ms < Lower Is Better Ryzen 9 5950X ... 2745.44 |=============================================== Ryzen 7 5800X3D . 2691.67 |============================================== Ryzen 7 5800X ... 3055.84 |==================================================== Ryzen 9 5900X ... 2908.28 |================================================= Core i9 12900K .. 2881.10 |================================================= oneDNN 2.6 Harness: Recurrent Neural Network Training - Data Type: bf16bf16bf16 - Engine: CPU ms < Lower Is Better Ryzen 9 5950X ... 2750.18 |=============================================== Ryzen 7 5800X3D . 2691.24 |============================================== Ryzen 7 5800X ... 3065.26 |==================================================== Ryzen 9 5900X ... 2904.33 |================================================= Core i9 12900K .. 2881.32 |================================================= oneDNN 2.6 Harness: Recurrent Neural Network Inference - Data Type: f32 - Engine: CPU ms < Lower Is Better Ryzen 9 5950X ... 1814.13 |=================================================== Ryzen 7 5800X3D . 1382.16 |======================================= Ryzen 7 5800X ... 1859.14 |==================================================== Ryzen 9 5900X ... 1785.05 |================================================== Core i9 12900K .. 1613.81 |============================================= oneDNN 2.6 Harness: Recurrent Neural Network Inference - Data Type: u8s8f32 - Engine: CPU ms < Lower Is Better Ryzen 9 5950X ... 1783.85 |================================================== Ryzen 7 5800X3D . 1387.86 |======================================= Ryzen 7 5800X ... 1864.54 |==================================================== Ryzen 9 5900X ... 1742.06 |================================================= Core i9 12900K .. 1616.06 |============================================= oneDNN 2.6 Harness: Recurrent Neural Network Inference - Data Type: bf16bf16bf16 - Engine: CPU ms < Lower Is Better Ryzen 9 5950X ... 1820.40 |=================================================== Ryzen 7 5800X3D . 1385.79 |======================================= Ryzen 7 5800X ... 1847.70 |==================================================== Ryzen 9 5900X ... 1776.19 |================================================== Core i9 12900K .. 1617.10 |============================================== NCNN 20210720 Target: CPU - Model: mobilenet ms < Lower Is Better Ryzen 9 5950X ... 12.27 |====================================================== Ryzen 7 5800X3D . 7.62 |================================== Ryzen 7 5800X ... 11.63 |=================================================== Ryzen 9 5900X ... 11.42 |================================================== Core i9 12900K .. 11.11 |================================================= NCNN 20210720 Target: CPU-v2-v2 - Model: mobilenet-v2 ms < Lower Is Better Ryzen 9 5950X ... 4.29 |======================================================= Ryzen 7 5800X3D . 2.13 |=========================== Ryzen 7 5800X ... 2.61 |================================= Ryzen 9 5900X ... 3.91 |================================================== Core i9 12900K .. 3.41 |============================================ NCNN 20210720 Target: CPU-v3-v3 - Model: mobilenet-v3 ms < Lower Is Better Ryzen 9 5950X ... 3.77 |======================================================= Ryzen 7 5800X3D . 1.90 |============================ Ryzen 7 5800X ... 2.28 |================================= Ryzen 9 5900X ... 3.46 |================================================== Core i9 12900K .. 2.90 |========================================== NCNN 20210720 Target: CPU - Model: shufflenet-v2 ms < Lower Is Better Ryzen 9 5950X ... 4.16 |======================================================= Ryzen 7 5800X3D . 2.11 |============================ Ryzen 7 5800X ... 2.35 |=============================== Ryzen 9 5900X ... 3.88 |=================================================== Core i9 12900K .. 3.10 |========================================= NCNN 20210720 Target: CPU - Model: mnasnet ms < Lower Is Better Ryzen 9 5950X ... 3.87 |======================================================= Ryzen 7 5800X3D . 2.01 |============================= Ryzen 7 5800X ... 2.24 |================================ Ryzen 9 5900X ... 3.44 |================================================= Core i9 12900K .. 3.10 |============================================ NCNN 20210720 Target: CPU - Model: efficientnet-b0 ms < Lower Is Better Ryzen 9 5950X ... 5.23 |====================================================== Ryzen 7 5800X3D . 3.01 |=============================== Ryzen 7 5800X ... 3.60 |===================================== Ryzen 9 5900X ... 4.77 |================================================= Core i9 12900K .. 5.34 |======================================================= NCNN 20210720 Target: CPU - Model: blazeface ms < Lower Is Better Ryzen 9 5950X ... 1.80 |======================================================= Ryzen 7 5800X3D . 1.06 |================================ Ryzen 7 5800X ... 1.22 |===================================== Ryzen 9 5900X ... 1.63 |================================================== Core i9 12900K .. 1.46 |============================================= NCNN 20210720 Target: CPU - Model: googlenet ms < Lower Is Better Ryzen 9 5950X ... 12.92 |====================================================== Ryzen 7 5800X3D . 7.31 |=============================== Ryzen 7 5800X ... 10.22 |=========================================== Ryzen 9 5900X ... 11.44 |================================================ Core i9 12900K .. 9.94 |========================================== NCNN 20210720 Target: CPU - Model: vgg16 ms < Lower Is Better Ryzen 9 5950X ... 56.55 |====================================================== Ryzen 7 5800X3D . 42.60 |========================================= Ryzen 7 5800X ... 55.97 |===================================================== Ryzen 9 5900X ... 50.75 |================================================ Core i9 12900K .. 28.24 |=========================== NCNN 20210720 Target: CPU - Model: resnet18 ms < Lower Is Better Ryzen 9 5950X ... 14.28 |====================================================== Ryzen 7 5800X3D . 10.27 |======================================= Ryzen 7 5800X ... 13.02 |================================================= Ryzen 9 5900X ... 12.50 |=============================================== Core i9 12900K .. 9.66 |===================================== NCNN 20210720 Target: CPU - Model: alexnet ms < Lower Is Better Ryzen 9 5950X ... 11.08 |=================================================== Ryzen 7 5800X3D . 9.62 |============================================ Ryzen 7 5800X ... 11.83 |====================================================== Ryzen 9 5900X ... 10.01 |============================================== Core i9 12900K .. 7.58 |=================================== NCNN 20210720 Target: CPU - Model: resnet50 ms < Lower Is Better Ryzen 9 5950X ... 24.40 |====================================================== Ryzen 7 5800X3D . 18.13 |======================================== Ryzen 7 5800X ... 20.22 |============================================= Ryzen 9 5900X ... 21.21 |=============================================== Core i9 12900K .. 16.84 |===================================== NCNN 20210720 Target: CPU - Model: yolov4-tiny ms < Lower Is Better Ryzen 9 5950X ... 20.49 |====================================================== Ryzen 7 5800X3D . 14.80 |======================================= Ryzen 7 5800X ... 19.78 |==================================================== Ryzen 9 5900X ... 20.63 |====================================================== Core i9 12900K .. 15.86 |========================================== NCNN 20210720 Target: CPU - Model: squeezenet_ssd ms < Lower Is Better Ryzen 9 5950X ... 14.55 |=============================================== Ryzen 7 5800X3D . 12.44 |======================================== Ryzen 7 5800X ... 16.76 |====================================================== Ryzen 9 5900X ... 13.51 |============================================ Core i9 12900K .. 13.27 |=========================================== NCNN 20210720 Target: CPU - Model: regnety_400m ms < Lower Is Better Ryzen 9 5950X ... 9.61 |======================================================= Ryzen 7 5800X3D . 5.18 |============================== Ryzen 7 5800X ... 5.93 |================================== Ryzen 9 5900X ... 8.43 |================================================ Core i9 12900K .. 7.39 |========================================== TNN 0.3 Target: CPU - Model: DenseNet ms < Lower Is Better Ryzen 9 5950X ... 2425.59 |========================================== Ryzen 7 5800X3D . 2609.84 |============================================= Ryzen 7 5800X ... 3016.48 |==================================================== Ryzen 9 5900X ... 2563.76 |============================================ Core i9 12900K .. 1792.97 |=============================== TNN 0.3 Target: CPU - Model: MobileNet v2 ms < Lower Is Better Ryzen 9 5950X ... 224.26 |============================================ Ryzen 7 5800X3D . 233.18 |============================================= Ryzen 7 5800X ... 272.04 |===================================================== Ryzen 9 5900X ... 224.20 |============================================ Core i9 12900K .. 170.58 |================================= TNN 0.3 Target: CPU - Model: SqueezeNet v1.1 ms < Lower Is Better Ryzen 9 5950X ... 213.32 |========================================== Ryzen 7 5800X3D . 222.33 |============================================ Ryzen 7 5800X ... 266.19 |===================================================== Ryzen 9 5900X ... 213.78 |=========================================== Core i9 12900K .. 133.97 |=========================== TNN 0.3 Target: CPU - Model: SqueezeNet v2 ms < Lower Is Better Ryzen 9 5950X ... 50.94 |=========================================== Ryzen 7 5800X3D . 53.22 |============================================= Ryzen 7 5800X ... 63.61 |====================================================== Ryzen 9 5900X ... 50.85 |=========================================== Core i9 12900K .. 38.92 |================================= Mobile Neural Network 1.2 Model: mobilenetV3 ms < Lower Is Better Ryzen 9 5950X ... 2.391 |====================================================== Ryzen 7 5800X3D . 1.082 |======================== Ryzen 7 5800X ... 1.156 |========================== Ryzen 9 5900X ... 1.838 |========================================== Core i9 12900K .. 1.174 |=========================== Mobile Neural Network 1.2 Model: squeezenetv1.1 ms < Lower Is Better Ryzen 9 5950X ... 3.988 |====================================================== Ryzen 7 5800X3D . 2.590 |=================================== Ryzen 7 5800X ... 2.805 |====================================== Ryzen 9 5900X ... 3.394 |============================================== Core i9 12900K .. 2.405 |================================= Mobile Neural Network 1.2 Model: resnet-v2-50 ms < Lower Is Better Ryzen 9 5950X ... 20.52 |============================================= Ryzen 7 5800X3D . 16.36 |==================================== Ryzen 7 5800X ... 18.44 |========================================= Ryzen 9 5900X ... 24.50 |====================================================== Core i9 12900K .. 23.09 |=================================================== Mobile Neural Network 1.2 Model: SqueezeNetV1.0 ms < Lower Is Better Ryzen 9 5950X ... 5.231 |====================================================== Ryzen 7 5800X3D . 4.213 |=========================================== Ryzen 7 5800X ... 4.536 |=============================================== Ryzen 9 5900X ... 4.758 |================================================= Core i9 12900K .. 4.151 |=========================================== Mobile Neural Network 1.2 Model: MobileNetV2_224 ms < Lower Is Better Ryzen 9 5950X ... 3.275 |====================================================== Ryzen 7 5800X3D . 1.831 |============================== Ryzen 7 5800X ... 1.942 |================================ Ryzen 9 5900X ... 2.975 |================================================= Core i9 12900K .. 2.410 |======================================== Mobile Neural Network 1.2 Model: mobilenet-v1-1.0 ms < Lower Is Better Ryzen 9 5950X ... 2.639 |=================================== Ryzen 7 5800X3D . 1.676 |====================== Ryzen 7 5800X ... 1.816 |======================== Ryzen 9 5900X ... 4.072 |====================================================== Core i9 12900K .. 2.891 |====================================== Mobile Neural Network 1.2 Model: inception-v3 ms < Lower Is Better Ryzen 9 5950X ... 25.73 |====================================================== Ryzen 7 5800X3D . 23.19 |================================================= Ryzen 7 5800X ... 25.69 |====================================================== Ryzen 9 5900X ... 23.69 |================================================== Core i9 12900K .. 24.30 |=================================================== Caffe 2020-02-13 Model: AlexNet - Acceleration: CPU - Iterations: 100 Milli-Seconds < Lower Is Better Ryzen 9 5950X ... 36658 |====================================================== Ryzen 7 5800X3D . 30222 |============================================= Ryzen 7 5800X ... 33905 |================================================== Ryzen 9 5900X ... 34329 |=================================================== Core i9 12900K .. 25590 |====================================== Caffe 2020-02-13 Model: AlexNet - Acceleration: CPU - Iterations: 200 Milli-Seconds < Lower Is Better Ryzen 9 5950X ... 73352 |====================================================== Ryzen 7 5800X3D . 60494 |============================================= Ryzen 7 5800X ... 67661 |================================================== Ryzen 9 5900X ... 68676 |=================================================== Core i9 12900K .. 51713 |====================================== Caffe 2020-02-13 Model: GoogleNet - Acceleration: CPU - Iterations: 100 Milli-Seconds < Lower Is Better Ryzen 9 5950X ... 96624 |====================================================== Ryzen 7 5800X3D . 80862 |============================================= Ryzen 7 5800X ... 89825 |================================================== Ryzen 9 5900X ... 89492 |================================================== Core i9 12900K .. 67833 |====================================== Caffe 2020-02-13 Model: GoogleNet - Acceleration: CPU - Iterations: 200 Milli-Seconds < Lower Is Better Ryzen 9 5950X ... 193710 |===================================================== Ryzen 7 5800X3D . 162022 |============================================ Ryzen 7 5800X ... 179146 |================================================= Ryzen 9 5900X ... 178725 |================================================= Core i9 12900K .. 134045 |===================================== ECP-CANDLE 0.4 Benchmark: P1B2 Seconds < Lower Is Better Ryzen 9 5950X ... 31.39 |================================================= Ryzen 7 5800X3D . 29.99 |============================================== Ryzen 7 5800X ... 34.84 |====================================================== Ryzen 9 5900X ... 30.24 |=============================================== Core i9 12900K .. 20.94 |================================ ECP-CANDLE 0.4 Benchmark: P3B1 Seconds < Lower Is Better Ryzen 9 5950X ... 1309.59 |==================================================== Ryzen 7 5800X3D . 1023.32 |========================================= Ryzen 7 5800X ... 1158.67 |============================================== Ryzen 9 5900X ... 1174.47 |=============================================== Core i9 12900K .. 429.61 |================= ECP-CANDLE 0.4 Benchmark: P3B2 Seconds < Lower Is Better Ryzen 9 5950X ... 654.35 |======================= Ryzen 7 5800X3D . 553.75 |=================== Ryzen 7 5800X ... 390.27 |============== Ryzen 9 5900X ... 667.28 |======================= Core i9 12900K .. 1503.26 |==================================================== Numpy Benchmark Score > Higher Is Better Ryzen 9 5950X ... 591.54 |=============================================== Ryzen 7 5800X3D . 603.09 |================================================ Ryzen 7 5800X ... 491.56 |======================================= Ryzen 9 5900X ... 605.17 |================================================ Core i9 12900K .. 665.34 |===================================================== Mlpack Benchmark Benchmark: scikit_svm Seconds < Lower Is Better Ryzen 9 5950X ... 16.56 |============================================ Ryzen 7 5800X3D . 16.17 |=========================================== Ryzen 7 5800X ... 20.29 |====================================================== Ryzen 9 5900X ... 16.15 |=========================================== Core i9 12900K .. 10.54 |============================ Mlpack Benchmark Benchmark: scikit_linearridgeregression Seconds < Lower Is Better Ryzen 9 5950X ... 1.69 |=================================================== Ryzen 7 5800X3D . 1.63 |================================================= Ryzen 7 5800X ... 1.82 |======================================================= Ryzen 9 5900X ... 1.58 |================================================ Core i9 12900K .. 1.60 |================================================ Mlpack Benchmark Benchmark: scikit_qda Seconds < Lower Is Better Ryzen 9 5950X ... 55.06 |====================================================== Ryzen 7 5800X3D . 38.27 |====================================== Ryzen 7 5800X ... 52.57 |==================================================== Ryzen 9 5900X ... 51.39 |================================================== Core i9 12900K .. 27.31 |=========================== Mlpack Benchmark Benchmark: scikit_ica Seconds < Lower Is Better Ryzen 9 5950X ... 41.77 |====================================================== Ryzen 7 5800X3D . 34.88 |============================================= Ryzen 7 5800X ... 39.16 |=================================================== Ryzen 9 5900X ... 39.37 |=================================================== Core i9 12900K .. 32.93 |=========================================== ONNX Runtime 1.11 Model: yolov4 - Device: CPU - Executor: Standard Inferences Per Minute > Higher Is Better Ryzen 9 5950X ... 487 |======================================= Ryzen 7 5800X3D . 572 |============================================== Ryzen 7 5800X ... 431 |=================================== Ryzen 9 5900X ... 539 |============================================ Core i9 12900K .. 693 |======================================================== ONNX Runtime 1.11 Model: yolov4 - Device: CPU - Executor: Parallel Inferences Per Minute > Higher Is Better Ryzen 9 5950X ... 296 |========================== Ryzen 7 5800X3D . 308 |=========================== Ryzen 7 5800X ... 273 |======================== Ryzen 9 5900X ... 299 |=========================== Core i9 12900K .. 629 |======================================================== ONNX Runtime 1.11 Model: fcn-resnet101-11 - Device: CPU - Executor: Standard Inferences Per Minute > Higher Is Better Ryzen 9 5950X ... 98 |================================================ Ryzen 7 5800X3D . 107 |==================================================== Ryzen 7 5800X ... 49 |======================== Ryzen 9 5900X ... 115 |======================================================== Core i9 12900K .. 101 |================================================= ONNX Runtime 1.11 Model: fcn-resnet101-11 - Device: CPU - Executor: Parallel Inferences Per Minute > Higher Is Better Ryzen 9 5950X ... 88 |============================================ Ryzen 7 5800X3D . 72 |==================================== Ryzen 7 5800X ... 67 |================================== Ryzen 9 5900X ... 85 |=========================================== Core i9 12900K .. 111 |======================================================== ONNX Runtime 1.11 Model: super-resolution-10 - Device: CPU - Executor: Standard Inferences Per Minute > Higher Is Better Ryzen 9 5950X ... 6169 |============================================= Ryzen 7 5800X3D . 4107 |============================== Ryzen 7 5800X ... 3628 |========================== Ryzen 9 5900X ... 7545 |======================================================= Core i9 12900K .. 4747 |=================================== ONNX Runtime 1.11 Model: super-resolution-10 - Device: CPU - Executor: Parallel Inferences Per Minute > Higher Is Better Ryzen 9 5950X ... 6436 |======================================================= Ryzen 7 5800X3D . 4606 |======================================= Ryzen 7 5800X ... 4103 |=================================== Ryzen 9 5900X ... 5591 |================================================ Core i9 12900K .. 4516 |======================================= ONNX Runtime 1.11 Model: bertsquad-12 - Device: CPU - Executor: Standard Inferences Per Minute > Higher Is Better Ryzen 9 5950X ... 800 |============================================= Ryzen 7 5800X3D . 822 |=============================================== Ryzen 7 5800X ... 557 |================================ Ryzen 9 5900X ... 949 |====================================================== Core i9 12900K .. 988 |======================================================== ONNX Runtime 1.11 Model: bertsquad-12 - Device: CPU - Executor: Parallel Inferences Per Minute > Higher Is Better Ryzen 9 5950X ... 554 |================================== Ryzen 7 5800X3D . 518 |================================ Ryzen 7 5800X ... 480 |============================= Ryzen 9 5900X ... 540 |================================= Core i9 12900K .. 919 |======================================================== ONNX Runtime 1.11 Model: GPT-2 - Device: CPU - Executor: Standard Inferences Per Minute > Higher Is Better Ryzen 9 5950X ... 7062 |================================== Ryzen 7 5800X3D . 8826 |=========================================== Ryzen 7 5800X ... 6832 |================================= Ryzen 9 5900X ... 7862 |====================================== Core i9 12900K .. 11082 |====================================================== ONNX Runtime 1.11 Model: GPT-2 - Device: CPU - Executor: Parallel Inferences Per Minute > Higher Is Better Ryzen 9 5950X ... 5534 |====================================== Ryzen 7 5800X3D . 6919 |=============================================== Ryzen 7 5800X ... 5621 |====================================== Ryzen 9 5900X ... 5687 |======================================= Core i9 12900K .. 8088 |======================================================= ONNX Runtime 1.11 Model: ArcFace ResNet-100 - Device: CPU - Executor: Standard Inferences Per Minute > Higher Is Better Ryzen 9 5950X ... 1668 |============================================== Ryzen 7 5800X3D . 1939 |====================================================== Ryzen 7 5800X ... 1042 |============================= Ryzen 9 5900X ... 1519 |========================================== Core i9 12900K .. 1975 |======================================================= ONNX Runtime 1.11 Model: ArcFace ResNet-100 - Device: CPU - Executor: Parallel Inferences Per Minute > Higher Is Better Ryzen 9 5950X ... 1540 |======================================================= Ryzen 7 5800X3D . 1223 |============================================ Ryzen 7 5800X ... 1107 |======================================== Ryzen 9 5900X ... 1421 |=================================================== Core i9 12900K .. 362 |============= LeelaChessZero 0.28 Backend: BLAS Nodes Per Second > Higher Is Better Ryzen 9 5950X ... 668 |================= Ryzen 7 5800X3D . 1254 |=============================== Ryzen 7 5800X ... 867 |====================== Ryzen 9 5900X ... 954 |======================== Core i9 12900K .. 2201 |======================================================= LeelaChessZero 0.28 Backend: Eigen Nodes Per Second > Higher Is Better Ryzen 9 5950X ... 684 |================= Ryzen 7 5800X3D . 1160 |============================== Ryzen 7 5800X ... 854 |====================== Ryzen 9 5900X ... 886 |======================= Core i9 12900K .. 2161 |======================================================= ASKAP 1.0 Test: tConvolve MPI - Degridding Mpix/sec > Higher Is Better Ryzen 9 5950X ... 6643.64 |============================================= Ryzen 7 5800X3D . 6453.22 |============================================ Ryzen 7 5800X ... 3976.30 |=========================== Ryzen 9 5900X ... 7668.05 |==================================================== Core i9 12900K .. 4198.51 |============================ ASKAP 1.0 Test: tConvolve MPI - Gridding Mpix/sec > Higher Is Better Ryzen 9 5950X ... 6728.09 |======================================== Ryzen 7 5800X3D . 8746.52 |==================================================== Ryzen 7 5800X ... 4256.05 |========================= Ryzen 9 5900X ... 8258.02 |================================================= Core i9 12900K .. 4472.73 |=========================== ASKAP 1.0 Test: tConvolve OpenMP - Gridding Million Grid Points Per Second > Higher Is Better Ryzen 9 5950X ... 2755.72 |===================== Ryzen 7 5800X3D . 6946.11 |==================================================== Ryzen 7 5800X ... 1709.25 |============= Ryzen 9 5900X ... 2936.85 |====================== Core i9 12900K .. 4631.82 |=================================== ASKAP 1.0 Test: tConvolve OpenMP - Degridding Million Grid Points Per Second > Higher Is Better Ryzen 9 5950X ... 3214.58 |=================== Ryzen 7 5800X3D . 8741.60 |==================================================== Ryzen 7 5800X ... 3367.67 |==================== Ryzen 9 5900X ... 3732.72 |====================== Core i9 12900K .. 7793.77 |============================================== ASKAP 1.0 Test: tConvolve MT - Gridding Million Grid Points Per Second > Higher Is Better Ryzen 9 5950X ... 784.51 |=============== Ryzen 7 5800X3D . 930.57 |================== Ryzen 7 5800X ... 854.71 |================ Ryzen 9 5900X ... 837.94 |================ Core i9 12900K .. 2721.15 |==================================================== ASKAP 1.0 Test: tConvolve MT - Degridding Million Grid Points Per Second > Higher Is Better Ryzen 9 5950X ... 1346.57 |================== Ryzen 7 5800X3D . 1594.95 |===================== Ryzen 7 5800X ... 1471.58 |==================== Ryzen 9 5900X ... 1541.67 |===================== Core i9 12900K .. 3872.03 |==================================================== ASKAP 1.0 Test: Hogbom Clean OpenMP Iterations Per Second > Higher Is Better Ryzen 9 5950X ... 220.04 |====================== Ryzen 7 5800X3D . 527.72 |==================================================== Ryzen 7 5800X ... 221.73 |====================== Ryzen 9 5900X ... 238.67 |======================= Core i9 12900K .. 540.54 |===================================================== OpenFOAM 8 Input: Motorbike 30M Seconds < Lower Is Better Ryzen 9 5950X ... 98.44 |============================= Ryzen 7 5800X3D . 80.29 |======================== Ryzen 7 5800X ... 177.60 |===================================================== Ryzen 9 5900X ... 96.16 |============================= Core i9 12900K .. 84.47 |========================= OpenFOAM 8 Input: Motorbike 60M Seconds < Lower Is Better Ryzen 9 5950X ... 1382.54 |==================================================== Ryzen 7 5800X3D . 1090.21 |========================================= Ryzen 7 5800X ... 1270.72 |================================================ Ryzen 9 5900X ... 1277.55 |================================================ Core i9 12900K .. 487.80 |================== Xcompact3d Incompact3d 2021-03-11 Input: input.i3d 129 Cells Per Direction Seconds < Lower Is Better Ryzen 9 5950X ... 33.95 |================================================= Ryzen 7 5800X3D . 27.18 |======================================= Ryzen 7 5800X ... 37.21 |====================================================== Ryzen 9 5900X ... 32.15 |=============================================== Core i9 12900K .. 14.55 |===================== Xcompact3d Incompact3d 2021-03-11 Input: input.i3d 193 Cells Per Direction Seconds < Lower Is Better Ryzen 9 5950X ... 156.16 |===================================================== Ryzen 7 5800X3D . 126.86 |=========================================== Ryzen 7 5800X ... 141.21 |================================================ Ryzen 9 5900X ... 144.47 |================================================= Core i9 12900K .. 55.61 |=================== Open Porous Media Git OPM Benchmark: Flow MPI Norne - Threads: 1 Seconds < Lower Is Better Ryzen 9 5950X ... 270.81 |=================================================== Ryzen 7 5800X3D . 224.10 |========================================== Ryzen 7 5800X ... 281.47 |===================================================== Ryzen 9 5900X ... 273.89 |==================================================== Core i9 12900K .. 247.89 |=============================================== Open Porous Media Git OPM Benchmark: Flow MPI Norne - Threads: 2 Seconds < Lower Is Better Ryzen 9 5950X ... 203.89 |============================================== Ryzen 7 5800X3D . 187.49 |========================================== Ryzen 7 5800X ... 234.63 |===================================================== Ryzen 9 5900X ... 203.98 |============================================== Core i9 12900K .. 223.20 |================================================== Open Porous Media Git OPM Benchmark: Flow MPI Norne - Threads: 4 Seconds < Lower Is Better Ryzen 9 5950X ... 232.61 |============================================ Ryzen 7 5800X3D . 223.97 |========================================== Ryzen 7 5800X ... 275.40 |==================================================== Ryzen 9 5900X ... 233.63 |============================================ Core i9 12900K .. 280.85 |===================================================== Open Porous Media Git OPM Benchmark: Flow MPI Norne - Threads: 8 Seconds < Lower Is Better Ryzen 9 5950X ... 357.86 |===================================== Ryzen 7 5800X3D . 361.91 |===================================== Ryzen 7 5800X ... 447.63 |============================================== Ryzen 9 5900X ... 361.84 |===================================== Core i9 12900K .. 515.71 |===================================================== Open Porous Media Git OPM Benchmark: Flow MPI Norne-4C MSW - Threads: 1 Seconds < Lower Is Better Ryzen 9 5950X ... 569.14 |================================================== Ryzen 7 5800X3D . 476.91 |========================================== Ryzen 7 5800X ... 601.31 |===================================================== Ryzen 9 5900X ... 572.60 |================================================== Core i9 12900K .. 537.38 |=============================================== Open Porous Media Git OPM Benchmark: Flow MPI Norne-4C MSW - Threads: 2 Seconds < Lower Is Better Ryzen 9 5950X ... 441.07 |============================================== Ryzen 7 5800X3D . 403.35 |========================================== Ryzen 7 5800X ... 511.31 |===================================================== Ryzen 9 5900X ... 441.14 |============================================== Core i9 12900K .. 475.95 |================================================= Open Porous Media Git OPM Benchmark: Flow MPI Norne-4C MSW - Threads: 4 Seconds < Lower Is Better Ryzen 9 5950X ... 377.03 |============================================ Ryzen 7 5800X3D . 357.33 |========================================== Ryzen 7 5800X ... 454.34 |===================================================== Ryzen 9 5900X ... 378.33 |============================================ Core i9 12900K .. 451.00 |===================================================== Open Porous Media Git OPM Benchmark: Flow MPI Norne-4C MSW - Threads: 8 Seconds < Lower Is Better Ryzen 9 5950X ... 575.13 |===================================== Ryzen 7 5800X3D . 581.46 |===================================== Ryzen 7 5800X ... 733.91 |=============================================== Ryzen 9 5900X ... 581.35 |===================================== Core i9 12900K .. 825.56 |===================================================== Open Porous Media Git OPM Benchmark: Flow MPI Extra - Threads: 1 Seconds < Lower Is Better Ryzen 9 5950X ... 1074.33 |================================================ Ryzen 7 5800X3D . 997.34 |============================================= Ryzen 7 5800X ... 1154.09 |==================================================== Ryzen 9 5900X ... 1073.71 |================================================ Core i9 12900K .. 1053.38 |=============================================== Open Porous Media Git OPM Benchmark: Flow MPI Extra - Threads: 2 Seconds < Lower Is Better Ryzen 9 5950X ... 712.62 |=============================================== Ryzen 7 5800X3D . 672.48 |============================================= Ryzen 7 5800X ... 799.40 |===================================================== Ryzen 9 5900X ... 713.34 |=============================================== Core i9 12900K .. 717.04 |================================================ Open Porous Media Git OPM Benchmark: Flow MPI Extra - Threads: 4 Seconds < Lower Is Better Ryzen 9 5950X ... 690.62 |============================================ Ryzen 7 5800X3D . 643.96 |========================================= Ryzen 7 5800X ... 829.49 |===================================================== Ryzen 9 5900X ... 691.38 |============================================ Core i9 12900K .. 671.56 |=========================================== Open Porous Media Git OPM Benchmark: Flow MPI Extra - Threads: 8 Seconds < Lower Is Better Ryzen 9 5950X ... 808.05 |========================================= Ryzen 7 5800X3D . 781.98 |======================================== Ryzen 7 5800X ... 1027.17 |==================================================== Ryzen 9 5900X ... 810.33 |========================================= Core i9 12900K .. 891.78 |============================================= WebP2 Image Encode 20220422 Encode Settings: Default Seconds < Lower Is Better Ryzen 9 5950X ... 2.165 |================================ Ryzen 7 5800X3D . 3.170 |=============================================== Ryzen 7 5800X ... 3.619 |====================================================== Ryzen 9 5900X ... 2.439 |==================================== Core i9 12900K .. 2.062 |=============================== WebP2 Image Encode 20220422 Encode Settings: Quality 75, Compression Effort 7 Seconds < Lower Is Better Ryzen 9 5950X ... 110.28 |============================= Ryzen 7 5800X3D . 178.01 |=============================================== Ryzen 7 5800X ... 199.65 |===================================================== Ryzen 9 5900X ... 129.73 |================================== Core i9 12900K .. 101.57 |=========================== WebP2 Image Encode 20220422 Encode Settings: Quality 95, Compression Effort 7 Seconds < Lower Is Better Ryzen 9 5950X ... 234.93 |============================== Ryzen 7 5800X3D . 376.96 |================================================ Ryzen 7 5800X ... 420.03 |===================================================== Ryzen 9 5900X ... 268.61 |================================== Core i9 12900K .. 215.58 |=========================== WebP2 Image Encode 20220422 Encode Settings: Quality 100, Compression Effort 5 Seconds < Lower Is Better Ryzen 9 5950X ... 3.249 |============================== Ryzen 7 5800X3D . 5.169 |================================================ Ryzen 7 5800X ... 5.875 |====================================================== Ryzen 9 5900X ... 3.709 |================================== Core i9 12900K .. 2.936 |=========================== WebP2 Image Encode 20220422 Encode Settings: Quality 100, Lossless Compression Seconds < Lower Is Better Ryzen 9 5950X ... 536.77 |============================= Ryzen 7 5800X3D . 864.94 |=============================================== Ryzen 7 5800X ... 974.59 |===================================================== Ryzen 9 5900X ... 614.81 |================================= Core i9 12900K .. 476.45 |==========================