NCNN mit Vulkan AMD Ryzen 9 3950X 16-Core testing with a ASUS ROG CROSSHAIR VIII HERO (WI-FI) (1302 BIOS) and NVIDIA GeForce RTX 2080 Ti 11GB on Ubuntu 20.04 via the Phoronix Test Suite. TR 3950X + RTX 2080 Ti: Processor: AMD Ryzen 9 3950X 16-Core @ 3.50GHz (16 Cores / 32 Threads), Motherboard: ASUS ROG CROSSHAIR VIII HERO (WI-FI) (1302 BIOS), Chipset: AMD Starship/Matisse, Memory: 16GB, Disk: 2000GB Corsair Force MP600 + 2000GB, Graphics: NVIDIA GeForce RTX 2080 Ti 11GB (1350/7000MHz), Audio: NVIDIA TU102 HD Audio, Monitor: DELL P2415Q, Network: Realtek RTL8125 2.5GbE + Intel I211 + Intel Wi-Fi 6 AX200 OS: Ubuntu 20.04, Kernel: 5.4.0-47-generic (x86_64), Desktop: GNOME Shell 3.36.4, Display Server: X Server 1.20.8, Display Driver: NVIDIA 450.66, OpenGL: 4.6.0, OpenCL: OpenCL 1.2 CUDA 11.0.228 + OpenCL 2.0 AMD-APP (3182.0), Vulkan: 1.2.133, Compiler: GCC 9.3.0 + CUDA 11.0, File-System: ext4, Screen Resolution: 3840x2160 2: Processor: AMD Ryzen 9 3950X 16-Core @ 3.50GHz (16 Cores / 32 Threads), Motherboard: ASUS ROG CROSSHAIR VIII HERO (WI-FI) (1302 BIOS), Chipset: AMD Starship/Matisse, Memory: 16GB, Disk: 2000GB Corsair Force MP600 + 2000GB, Graphics: NVIDIA GeForce RTX 2080 Ti 11GB (1350/7000MHz), Audio: NVIDIA TU102 HD Audio, Monitor: DELL P2415Q, Network: Realtek RTL8125 2.5GbE + Intel I211 + Intel Wi-Fi 6 AX200 OS: Ubuntu 20.04, Kernel: 5.4.0-47-generic (x86_64), Desktop: GNOME Shell 3.36.4, Display Server: X Server 1.20.8, Display Driver: NVIDIA 450.66, OpenGL: 4.6.0, OpenCL: OpenCL 1.2 CUDA 11.0.228 + OpenCL 2.0 AMD-APP (3182.0), Vulkan: 1.2.133, Compiler: GCC 9.3.0 + CUDA 11.0, File-System: ext4, Screen Resolution: 3840x2160 3: Processor: AMD Ryzen 9 3950X 16-Core @ 3.50GHz (16 Cores / 32 Threads), Motherboard: ASUS ROG CROSSHAIR VIII HERO (WI-FI) (1302 BIOS), Chipset: AMD Starship/Matisse, Memory: 16GB, Disk: 2000GB Corsair Force MP600 + 2000GB, Graphics: NVIDIA GeForce RTX 2080 Ti 11GB (1350/7000MHz), Audio: NVIDIA TU102 HD Audio, Monitor: DELL P2415Q, Network: Realtek RTL8125 2.5GbE + Intel I211 + Intel Wi-Fi 6 AX200 OS: Ubuntu 20.04, Kernel: 5.4.0-47-generic (x86_64), Desktop: GNOME Shell 3.36.4, Display Server: X Server 1.20.8, Display Driver: NVIDIA 450.66, OpenGL: 4.6.0, OpenCL: OpenCL 1.2 CUDA 11.0.228 + OpenCL 2.0 AMD-APP (3182.0), Vulkan: 1.2.133, Compiler: GCC 9.3.0 + CUDA 11.0, File-System: ext4, Screen Resolution: 3840x2160 NCNN 20200916 Target: CPU - Model: squeezenet ms < Lower Is Better TR 3950X + RTX 2080 Ti . 27.61 |=============================================== 2 ...................... 26.72 |============================================= 3 ...................... 26.42 |============================================= NCNN 20200916 Target: CPU - Model: mobilenet ms < Lower Is Better TR 3950X + RTX 2080 Ti . 17.11 |=============================================== 2 ...................... 16.68 |============================================== 3 ...................... 16.82 |============================================== NCNN 20200916 Target: CPU-v2-v2 - Model: mobilenet-v2 ms < Lower Is Better TR 3950X + RTX 2080 Ti . 5.83 |=============================================== 2 ...................... 5.82 |=============================================== 3 ...................... 6.00 |================================================ NCNN 20200916 Target: CPU-v3-v3 - Model: mobilenet-v3 ms < Lower Is Better TR 3950X + RTX 2080 Ti . 5.19 |=============================================== 2 ...................... 5.23 |=============================================== 3 ...................... 5.31 |================================================ NCNN 20200916 Target: CPU - Model: shufflenet-v2 ms < Lower Is Better TR 3950X + RTX 2080 Ti . 5.04 |================================================ 2 ...................... 5.04 |================================================ 3 ...................... 5.06 |================================================ NCNN 20200916 Target: CPU - Model: mnasnet ms < Lower Is Better TR 3950X + RTX 2080 Ti . 5.23 |=============================================== 2 ...................... 5.23 |=============================================== 3 ...................... 5.35 |================================================ NCNN 20200916 Target: CPU - Model: efficientnet-b0 ms < Lower Is Better TR 3950X + RTX 2080 Ti . 7.03 |=============================================== 2 ...................... 7.13 |=============================================== 3 ...................... 7.25 |================================================ NCNN 20200916 Target: CPU - Model: blazeface ms < Lower Is Better TR 3950X + RTX 2080 Ti . 1.98 |================================================ 2 ...................... 1.99 |================================================ 3 ...................... 2.00 |================================================ NCNN 20200916 Target: CPU - Model: googlenet ms < Lower Is Better TR 3950X + RTX 2080 Ti . 35.00 |=============================================== 2 ...................... 35.20 |=============================================== 3 ...................... 35.16 |=============================================== NCNN 20200916 Target: CPU - Model: vgg16 ms < Lower Is Better TR 3950X + RTX 2080 Ti . 91.89 |=============================================== 2 ...................... 85.95 |============================================ 3 ...................... 85.97 |============================================ NCNN 20200916 Target: CPU - Model: resnet18 ms < Lower Is Better TR 3950X + RTX 2080 Ti . 17.39 |=============================================== 2 ...................... 17.34 |=============================================== 3 ...................... 17.39 |=============================================== NCNN 20200916 Target: CPU - Model: alexnet ms < Lower Is Better TR 3950X + RTX 2080 Ti . 16.74 |=============================================== 2 ...................... 16.79 |=============================================== 3 ...................... 16.81 |=============================================== NCNN 20200916 Target: CPU - Model: resnet50 ms < Lower Is Better TR 3950X + RTX 2080 Ti . 53.85 |=============================================== 2 ...................... 53.55 |=============================================== 3 ...................... 53.22 |============================================== NCNN 20200916 Target: CPU - Model: yolov4-tiny ms < Lower Is Better TR 3950X + RTX 2080 Ti . 28.85 |=============================================== 2 ...................... 28.62 |=============================================== 3 ...................... 28.83 |=============================================== NCNN 20200916 Target: Vulkan GPU - Model: squeezenet ms < Lower Is Better TR 3950X + RTX 2080 Ti . 28.16 |============================================== 2 ...................... 28.02 |============================================== 3 ...................... 28.53 |=============================================== NCNN 20200916 Target: Vulkan GPU - Model: mobilenet ms < Lower Is Better TR 3950X + RTX 2080 Ti . 4.10 |================================================ 2 ...................... 4.09 |================================================ 3 ...................... 4.10 |================================================ NCNN 20200916 Target: Vulkan GPU-v2-v2 - Model: mobilenet-v2 ms < Lower Is Better TR 3950X + RTX 2080 Ti . 2.34 |=============================================== 2 ...................... 2.27 |============================================= 3 ...................... 2.41 |================================================ NCNN 20200916 Target: Vulkan GPU-v3-v3 - Model: mobilenet-v3 ms < Lower Is Better TR 3950X + RTX 2080 Ti . 1.60 |================================================ 2 ...................... 1.61 |================================================ 3 ...................... 1.60 |================================================ NCNN 20200916 Target: Vulkan GPU - Model: shufflenet-v2 ms < Lower Is Better TR 3950X + RTX 2080 Ti . 1.26 |================================================ 2 ...................... 1.26 |================================================ 3 ...................... 1.27 |================================================ NCNN 20200916 Target: Vulkan GPU - Model: mnasnet ms < Lower Is Better TR 3950X + RTX 2080 Ti . 1.42 |================================================ 2 ...................... 1.42 |================================================ 3 ...................... 1.42 |================================================ NCNN 20200916 Target: Vulkan GPU - Model: efficientnet-b0 ms < Lower Is Better TR 3950X + RTX 2080 Ti . 2.52 |================================================ 2 ...................... 2.53 |================================================ 3 ...................... 2.52 |================================================ NCNN 20200916 Target: Vulkan GPU - Model: blazeface ms < Lower Is Better TR 3950X + RTX 2080 Ti . 0.59 |================================================ 2 ...................... 0.59 |================================================ 3 ...................... 0.58 |=============================================== NCNN 20200916 Target: Vulkan GPU - Model: googlenet ms < Lower Is Better TR 3950X + RTX 2080 Ti . 35.17 |=============================================== 2 ...................... 35.29 |=============================================== 3 ...................... 35.16 |=============================================== NCNN 20200916 Target: Vulkan GPU - Model: vgg16 ms < Lower Is Better TR 3950X + RTX 2080 Ti . 87.17 |=============================================== 2 ...................... 86.51 |=============================================== 3 ...................... 87.13 |=============================================== NCNN 20200916 Target: Vulkan GPU - Model: resnet18 ms < Lower Is Better TR 3950X + RTX 2080 Ti . 17.31 |============================================== 2 ...................... 17.41 |============================================== 3 ...................... 17.65 |=============================================== NCNN 20200916 Target: Vulkan GPU - Model: alexnet ms < Lower Is Better TR 3950X + RTX 2080 Ti . 2.23 |============================================ 2 ...................... 2.32 |============================================= 3 ...................... 2.45 |================================================ NCNN 20200916 Target: Vulkan GPU - Model: resnet50 ms < Lower Is Better TR 3950X + RTX 2080 Ti . 54.18 |=============================================== 2 ...................... 54.09 |=============================================== 3 ...................... 54.60 |=============================================== NCNN 20200916 Target: Vulkan GPU - Model: yolov4-tiny ms < Lower Is Better TR 3950X + RTX 2080 Ti . 7.25 |================================================ 2 ...................... 7.09 |=============================================== 3 ...................... 7.13 |===============================================