ncnn mnn 3950x AMD Ryzen 9 3950X 16-Core testing with a ASUS ROG CROSSHAIR VII HERO (WI-FI) (3103 BIOS) and Sapphire AMD Radeon RX 470/480/570/570X/580/580X/590 4GB on Ubuntu 20.04 via the Phoronix Test Suite. a: Processor: AMD Ryzen 9 3950X 16-Core @ 3.50GHz (16 Cores / 32 Threads), Motherboard: ASUS ROG CROSSHAIR VII HERO (WI-FI) (3103 BIOS), Chipset: AMD Starship/Matisse, Memory: 16GB, Disk: Samsung SSD 970 EVO 250GB + 32GB Flash Drive, Graphics: Sapphire AMD Radeon RX 470/480/570/570X/580/580X/590 4GB (1260/1750MHz), Audio: AMD Ellesmere HDMI Audio, Monitor: DELL S2409W, Network: Intel I211 + Realtek RTL8822BE 802.11a/b/g/n/ac OS: Ubuntu 20.04, Kernel: 5.11.0-43-generic (x86_64), Desktop: GNOME Shell 3.36.4, Display Server: X Server 1.20.13, OpenGL: 4.6 Mesa 20.0.8 (LLVM 10.0.0), Vulkan: 1.2.128, Compiler: GCC 9.3.0, File-System: ext4, Screen Resolution: 1920x1080 b: Processor: AMD Ryzen 9 3950X 16-Core @ 3.50GHz (16 Cores / 32 Threads), Motherboard: ASUS ROG CROSSHAIR VII HERO (WI-FI) (3103 BIOS), Chipset: AMD Starship/Matisse, Memory: 16GB, Disk: Samsung SSD 970 EVO 250GB + 32GB Flash Drive, Graphics: Sapphire AMD Radeon RX 470/480/570/570X/580/580X/590 4GB (1260/1750MHz), Audio: AMD Ellesmere HDMI Audio, Monitor: DELL S2409W, Network: Intel I211 + Realtek RTL8822BE 802.11a/b/g/n/ac OS: Ubuntu 20.04, Kernel: 5.11.0-43-generic (x86_64), Desktop: GNOME Shell 3.36.4, Display Server: X Server 1.20.13, OpenGL: 4.6 Mesa 20.0.8 (LLVM 10.0.0), Vulkan: 1.2.128, Compiler: GCC 9.3.0, File-System: ext4, Screen Resolution: 1920x1080 c: Processor: AMD Ryzen 9 3950X 16-Core @ 3.50GHz (16 Cores / 32 Threads), Motherboard: ASUS ROG CROSSHAIR VII HERO (WI-FI) (3103 BIOS), Chipset: AMD Starship/Matisse, Memory: 16GB, Disk: Samsung SSD 970 EVO 250GB + 32GB Flash Drive, Graphics: Sapphire AMD Radeon RX 470/480/570/570X/580/580X/590 4GB (1260/1750MHz), Audio: AMD Ellesmere HDMI Audio, Monitor: DELL S2409W, Network: Intel I211 + Realtek RTL8822BE 802.11a/b/g/n/ac OS: Ubuntu 20.04, Kernel: 5.11.0-43-generic (x86_64), Desktop: GNOME Shell 3.36.4, Display Server: X Server 1.20.13, OpenGL: 4.6 Mesa 20.0.8 (LLVM 10.0.0), Vulkan: 1.2.128, Compiler: GCC 9.3.0, File-System: ext4, Screen Resolution: 1920x1080 Mobile Neural Network 2.0 Model: mobilenetV3 ms < Lower Is Better a . 2.848 |==================================================================== b . 2.841 |==================================================================== c . 2.821 |=================================================================== Mobile Neural Network 2.0 Model: squeezenetv1.1 ms < Lower Is Better a . 4.937 |==================================================================== b . 4.937 |==================================================================== c . 4.677 |================================================================ Mobile Neural Network 2.0 Model: resnet-v2-50 ms < Lower Is Better a . 32.47 |=================================================================== b . 33.15 |==================================================================== c . 32.73 |=================================================================== Mobile Neural Network 2.0 Model: SqueezeNetV1.0 ms < Lower Is Better a . 7.812 |==================================================================== b . 7.775 |==================================================================== c . 7.652 |=================================================================== Mobile Neural Network 2.0 Model: MobileNetV2_224 ms < Lower Is Better a . 5.317 |================================================================== b . 5.407 |==================================================================== c . 5.438 |==================================================================== Mobile Neural Network 2.0 Model: mobilenet-v1-1.0 ms < Lower Is Better a . 4.056 |==================================================================== b . 3.752 |=============================================================== c . 3.745 |=============================================================== Mobile Neural Network 2.0 Model: inception-v3 ms < Lower Is Better a . 35.53 |=================================================================== b . 35.52 |=================================================================== c . 36.02 |==================================================================== NCNN 20220729 Target: CPU - Model: mobilenet ms < Lower Is Better a . 15.46 |==================================================================== b . 15.44 |==================================================================== c . 15.50 |==================================================================== NCNN 20220729 Target: CPU-v2-v2 - Model: mobilenet-v2 ms < Lower Is Better a . 5.44 |===================================================================== b . 5.45 |===================================================================== c . 5.45 |===================================================================== NCNN 20220729 Target: CPU-v3-v3 - Model: mobilenet-v3 ms < Lower Is Better a . 4.76 |===================================================================== b . 4.75 |===================================================================== c . 4.75 |===================================================================== NCNN 20220729 Target: CPU - Model: shufflenet-v2 ms < Lower Is Better a . 5.52 |===================================================================== b . 5.54 |===================================================================== c . 5.51 |===================================================================== NCNN 20220729 Target: CPU - Model: mnasnet ms < Lower Is Better a . 4.90 |===================================================================== b . 4.87 |==================================================================== c . 4.93 |===================================================================== NCNN 20220729 Target: CPU - Model: efficientnet-b0 ms < Lower Is Better a . 7.30 |==================================================================== b . 7.32 |==================================================================== c . 7.38 |===================================================================== NCNN 20220729 Target: CPU - Model: blazeface ms < Lower Is Better a . 2.40 |===================================================================== b . 2.40 |===================================================================== c . 2.40 |===================================================================== NCNN 20220729 Target: CPU - Model: googlenet ms < Lower Is Better a . 17.42 |==================================================================== b . 17.46 |==================================================================== c . 17.35 |==================================================================== NCNN 20220729 Target: CPU - Model: vgg16 ms < Lower Is Better a . 53.10 |==================================================================== b . 53.03 |==================================================================== c . 53.12 |==================================================================== NCNN 20220729 Target: CPU - Model: resnet18 ms < Lower Is Better a . 14.41 |=================================================================== b . 14.50 |==================================================================== c . 14.52 |==================================================================== NCNN 20220729 Target: CPU - Model: alexnet ms < Lower Is Better a . 11.14 |==================================================================== b . 11.18 |==================================================================== c . 11.18 |==================================================================== NCNN 20220729 Target: CPU - Model: resnet50 ms < Lower Is Better a . 23.74 |==================================================================== b . 23.65 |==================================================================== c . 23.69 |==================================================================== NCNN 20220729 Target: CPU - Model: yolov4-tiny ms < Lower Is Better a . 27.62 |==================================================================== b . 27.46 |==================================================================== c . 27.36 |=================================================================== NCNN 20220729 Target: CPU - Model: squeezenet_ssd ms < Lower Is Better a . 23.06 |==================================================================== b . 23.13 |==================================================================== c . 23.01 |==================================================================== NCNN 20220729 Target: CPU - Model: regnety_400m ms < Lower Is Better a . 16.78 |==================================================================== b . 16.83 |==================================================================== c . 16.78 |==================================================================== NCNN 20220729 Target: CPU - Model: vision_transformer ms < Lower Is Better a . 146.15 |=================================================================== b . 145.70 |=================================================================== c . 146.34 |=================================================================== NCNN 20220729 Target: CPU - Model: FastestDet ms < Lower Is Better a . 6.46 |=================================================================== b . 6.68 |===================================================================== c . 6.43 |================================================================== NCNN 20220729 Target: Vulkan GPU - Model: mobilenet ms < Lower Is Better a . 9.38 |===================================================================== b . 9.34 |===================================================================== c . 9.29 |==================================================================== NCNN 20220729 Target: Vulkan GPU-v2-v2 - Model: mobilenet-v2 ms < Lower Is Better a . 4.43 |===================================================================== b . 4.43 |===================================================================== c . 4.45 |===================================================================== NCNN 20220729 Target: Vulkan GPU-v3-v3 - Model: mobilenet-v3 ms < Lower Is Better a . 5.62 |===================================================================== b . 5.65 |===================================================================== c . 5.62 |===================================================================== NCNN 20220729 Target: Vulkan GPU - Model: shufflenet-v2 ms < Lower Is Better a . 3.61 |=================================================================== b . 3.71 |===================================================================== c . 3.57 |================================================================== NCNN 20220729 Target: Vulkan GPU - Model: mnasnet ms < Lower Is Better a . 5.04 |==================================================================== b . 5.03 |==================================================================== c . 5.08 |===================================================================== NCNN 20220729 Target: Vulkan GPU - Model: efficientnet-b0 ms < Lower Is Better a . 18.49 |==================================================================== b . 18.44 |=================================================================== c . 18.58 |==================================================================== NCNN 20220729 Target: Vulkan GPU - Model: blazeface ms < Lower Is Better a . 1.94 |==================================================================== b . 1.95 |===================================================================== c . 1.96 |===================================================================== NCNN 20220729 Target: Vulkan GPU - Model: googlenet ms < Lower Is Better a . 11.41 |=================================================================== b . 11.60 |==================================================================== c . 11.59 |==================================================================== NCNN 20220729 Target: Vulkan GPU - Model: vgg16 ms < Lower Is Better a . 18.00 |=================================================================== b . 18.15 |==================================================================== c . 18.22 |==================================================================== NCNN 20220729 Target: Vulkan GPU - Model: resnet18 ms < Lower Is Better a . 5.95 |===================================================================== b . 5.94 |===================================================================== c . 5.90 |==================================================================== NCNN 20220729 Target: Vulkan GPU - Model: alexnet ms < Lower Is Better a . 7.70 |===================================================================== b . 7.71 |===================================================================== c . 7.72 |===================================================================== NCNN 20220729 Target: Vulkan GPU - Model: resnet50 ms < Lower Is Better a . 13.04 |==================================================================== b . 12.98 |==================================================================== c . 13.00 |==================================================================== NCNN 20220729 Target: Vulkan GPU - Model: yolov4-tiny ms < Lower Is Better a . 11.68 |==================================================================== b . 11.66 |==================================================================== c . 11.68 |==================================================================== NCNN 20220729 Target: Vulkan GPU - Model: squeezenet_ssd ms < Lower Is Better a . 8.41 |===================================================================== b . 8.44 |===================================================================== c . 8.43 |===================================================================== NCNN 20220729 Target: Vulkan GPU - Model: regnety_400m ms < Lower Is Better a . 9.14 |===================================================================== b . 9.10 |===================================================================== c . 9.12 |===================================================================== NCNN 20220729 Target: Vulkan GPU - Model: vision_transformer ms < Lower Is Better a . 377.05 |=================================================================== b . 378.95 |=================================================================== c . 377.51 |=================================================================== NCNN 20220729 Target: Vulkan GPU - Model: FastestDet ms < Lower Is Better a . 3.22 |===================================================================== b . 3.17 |==================================================================== c . 3.21 |=====================================================================