3900XT NN AMD Ryzen 9 3900XT 12-Core testing with a MSI MEG X570 GODLIKE (MS-7C34) v1.0 (1.94 BIOS) and AMD Radeon RX 56/64 8GB on Ubuntu 20.04 via the Phoronix Test Suite.
HTML result view exported from: https://openbenchmarking.org/result/2009250-PTS-3900XTNN87&sor&grr .
3900XT NN Processor Motherboard Chipset Memory Disk Graphics Audio Monitor Network OS Kernel Desktop Display Server Display Driver OpenGL Compiler File-System Screen Resolution 1 2 3 AMD Ryzen 9 3900XT 12-Core @ 3.80GHz (12 Cores / 24 Threads) MSI MEG X570 GODLIKE (MS-7C34) v1.0 (1.94 BIOS) AMD Starship/Matisse 16GB 500GB Seagate FireCuda 520 SSD ZP500GM30002 AMD Radeon RX 56/64 8GB (1630/945MHz) AMD Vega 10 HDMI Audio ASUS MG28U Realtek Device 2600 + Realtek Device 3000 + Intel Wi-Fi 6 AX200 Ubuntu 20.04 5.9.0-050900rc6daily20200922-generic (x86_64) 20200921 GNOME Shell 3.36.4 X Server 1.20.8 amdgpu 19.1.0 4.6 Mesa 20.3.0-devel (git-31f75aa 2020-08-28 focal-oibaf-ppa) (LLVM 10.0.1) GCC 9.3.0 ext4 3840x2160 OpenBenchmarking.org Compiler Details - --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++,gm2 --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none,hsa --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v Processor Details - Scaling Governor: acpi-cpufreq ondemand - CPU Microcode: 0x8701021 Graphics Details - GLAMOR Security Details - itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Full AMD retpoline IBPB: conditional STIBP: conditional RSB filling + srbds: Not affected + tsx_async_abort: Not affected
3900XT NN ncnn: CPU - yolov4-tiny ncnn: CPU - resnet50 ncnn: CPU - alexnet ncnn: CPU - resnet18 ncnn: CPU - vgg16 ncnn: CPU - googlenet ncnn: CPU - blazeface ncnn: CPU - efficientnet-b0 ncnn: CPU - mnasnet ncnn: CPU - shufflenet-v2 ncnn: CPU-v3-v3 - mobilenet-v3 ncnn: CPU-v2-v2 - mobilenet-v2 ncnn: CPU - mobilenet ncnn: CPU - squeezenet realsr-ncnn: 4x - Yes ncnn: Vulkan GPU - yolov4-tiny ncnn: Vulkan GPU - resnet50 ncnn: Vulkan GPU - alexnet ncnn: Vulkan GPU - resnet18 ncnn: Vulkan GPU - vgg16 ncnn: Vulkan GPU - googlenet ncnn: Vulkan GPU - blazeface ncnn: Vulkan GPU - efficientnet-b0 ncnn: Vulkan GPU - mnasnet ncnn: Vulkan GPU - shufflenet-v2 ncnn: Vulkan GPU-v3-v3 - mobilenet-v3 ncnn: Vulkan GPU-v2-v2 - mobilenet-v2 ncnn: Vulkan GPU - mobilenet ncnn: Vulkan GPU - squeezenet tnn: CPU - MobileNet v2 tnn: CPU - SqueezeNet v1.1 realsr-ncnn: 4x - No 1 2 3 28.15 27.55 16.13 16.20 67.41 17.17 1.91 6.54 4.76 4.82 4.71 5.36 16.33 15.96 63.327 10.70 6.02 3.92 2.10 11.95 5.78 0.90 10.41 2.69 2.28 3.55 2.52 7.77 4.66 245.154 230.022 9.845 28.07 27.56 16.18 16.36 67.82 17.18 1.91 6.58 4.80 4.78 4.71 5.33 16.17 15.87 64.551 10.68 6.38 3.94 2.1 11.46 5.66 0.87 10.47 2.67 2.28 3.50 2.49 7.72 4.68 246.961 228.479 9.797 28.08 27.50 16.18 16.27 67.67 17.14 1.91 6.62 4.88 4.80 4.70 5.35 16.36 15.97 63.569 10.71 6.13 3.91 2.10 11.69 5.71 0.85 10.44 2.68 2.26 3.49 2.49 7.68 4.71 244.143 226.902 9.838 OpenBenchmarking.org
NCNN Target: CPU - Model: yolov4-tiny OpenBenchmarking.org ms, Fewer Is Better NCNN 20200916 Target: CPU - Model: yolov4-tiny 2 3 1 7 14 21 28 35 SE +/- 0.19, N = 3 SE +/- 0.14, N = 3 SE +/- 0.09, N = 3 28.07 28.08 28.15 MIN: 27.62 / MAX: 37.12 MIN: 27.74 / MAX: 30.21 MIN: 27.83 / MAX: 28.94 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
NCNN Target: CPU - Model: resnet50 OpenBenchmarking.org ms, Fewer Is Better NCNN 20200916 Target: CPU - Model: resnet50 3 1 2 6 12 18 24 30 SE +/- 0.26, N = 3 SE +/- 0.08, N = 3 SE +/- 0.27, N = 3 27.50 27.55 27.56 MIN: 27.04 / MAX: 38.34 MIN: 27.15 / MAX: 40.33 MIN: 27.02 / MAX: 33.89 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
NCNN Target: CPU - Model: alexnet OpenBenchmarking.org ms, Fewer Is Better NCNN 20200916 Target: CPU - Model: alexnet 1 2 3 4 8 12 16 20 SE +/- 0.04, N = 3 SE +/- 0.02, N = 3 SE +/- 0.02, N = 3 16.13 16.18 16.18 MIN: 15.99 / MAX: 18.49 MIN: 16.03 / MAX: 16.44 MIN: 16.03 / MAX: 16.91 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
NCNN Target: CPU - Model: resnet18 OpenBenchmarking.org ms, Fewer Is Better NCNN 20200916 Target: CPU - Model: resnet18 1 3 2 4 8 12 16 20 SE +/- 0.02, N = 3 SE +/- 0.13, N = 3 SE +/- 0.02, N = 3 16.20 16.27 16.36 MIN: 16.02 / MAX: 21.18 MIN: 16.02 / MAX: 16.66 MIN: 16.04 / MAX: 27.68 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
NCNN Target: CPU - Model: vgg16 OpenBenchmarking.org ms, Fewer Is Better NCNN 20200916 Target: CPU - Model: vgg16 1 3 2 15 30 45 60 75 SE +/- 0.12, N = 3 SE +/- 0.16, N = 3 SE +/- 0.29, N = 3 67.41 67.67 67.82 MIN: 66.51 / MAX: 110.23 MIN: 66.42 / MAX: 140.75 MIN: 66.53 / MAX: 109.38 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
NCNN Target: CPU - Model: googlenet OpenBenchmarking.org ms, Fewer Is Better NCNN 20200916 Target: CPU - Model: googlenet 3 1 2 4 8 12 16 20 SE +/- 0.15, N = 3 SE +/- 0.20, N = 3 SE +/- 0.16, N = 3 17.14 17.17 17.18 MIN: 16.62 / MAX: 22.64 MIN: 16.63 / MAX: 121.77 MIN: 16.59 / MAX: 19.11 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
NCNN Target: CPU - Model: blazeface OpenBenchmarking.org ms, Fewer Is Better NCNN 20200916 Target: CPU - Model: blazeface 1 2 3 0.4298 0.8596 1.2894 1.7192 2.149 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.02, N = 3 1.91 1.91 1.91 MIN: 1.87 / MAX: 2.43 MIN: 1.86 / MAX: 2.01 MIN: 1.85 / MAX: 2.6 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
NCNN Target: CPU - Model: efficientnet-b0 OpenBenchmarking.org ms, Fewer Is Better NCNN 20200916 Target: CPU - Model: efficientnet-b0 1 2 3 2 4 6 8 10 SE +/- 0.04, N = 3 SE +/- 0.05, N = 3 SE +/- 0.09, N = 3 6.54 6.58 6.62 MIN: 6.42 / MAX: 13.95 MIN: 6.45 / MAX: 11.26 MIN: 6.41 / MAX: 8.49 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
NCNN Target: CPU - Model: mnasnet OpenBenchmarking.org ms, Fewer Is Better NCNN 20200916 Target: CPU - Model: mnasnet 1 2 3 1.098 2.196 3.294 4.392 5.49 SE +/- 0.02, N = 3 SE +/- 0.06, N = 3 SE +/- 0.11, N = 3 4.76 4.80 4.88 MIN: 4.68 / MAX: 6.21 MIN: 4.67 / MAX: 6.45 MIN: 4.69 / MAX: 47.76 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
NCNN Target: CPU - Model: shufflenet-v2 OpenBenchmarking.org ms, Fewer Is Better NCNN 20200916 Target: CPU - Model: shufflenet-v2 2 3 1 1.0845 2.169 3.2535 4.338 5.4225 SE +/- 0.06, N = 3 SE +/- 0.02, N = 3 SE +/- 0.01, N = 3 4.78 4.80 4.82 MIN: 4.61 / MAX: 6.32 MIN: 4.72 / MAX: 5.75 MIN: 4.77 / MAX: 5.98 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
NCNN Target: CPU-v3-v3 - Model: mobilenet-v3 OpenBenchmarking.org ms, Fewer Is Better NCNN 20200916 Target: CPU-v3-v3 - Model: mobilenet-v3 3 1 2 1.0598 2.1196 3.1794 4.2392 5.299 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.07, N = 3 4.70 4.71 4.71 MIN: 4.65 / MAX: 6.27 MIN: 4.64 / MAX: 6.36 MIN: 4.56 / MAX: 7 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
NCNN Target: CPU-v2-v2 - Model: mobilenet-v2 OpenBenchmarking.org ms, Fewer Is Better NCNN 20200916 Target: CPU-v2-v2 - Model: mobilenet-v2 2 3 1 1.206 2.412 3.618 4.824 6.03 SE +/- 0.07, N = 3 SE +/- 0.02, N = 3 SE +/- 0.02, N = 3 5.33 5.35 5.36 MIN: 5.13 / MAX: 6.51 MIN: 5.21 / MAX: 7.22 MIN: 5.24 / MAX: 7.13 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
NCNN Target: CPU - Model: mobilenet OpenBenchmarking.org ms, Fewer Is Better NCNN 20200916 Target: CPU - Model: mobilenet 2 1 3 4 8 12 16 20 SE +/- 0.13, N = 3 SE +/- 0.16, N = 3 SE +/- 0.12, N = 3 16.17 16.33 16.36 MIN: 15.85 / MAX: 16.8 MIN: 15.8 / MAX: 17.16 MIN: 16.1 / MAX: 16.93 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
NCNN Target: CPU - Model: squeezenet OpenBenchmarking.org ms, Fewer Is Better NCNN 20200916 Target: CPU - Model: squeezenet 2 1 3 4 8 12 16 20 SE +/- 0.11, N = 3 SE +/- 0.11, N = 3 SE +/- 0.05, N = 3 15.87 15.96 15.97 MIN: 15.46 / MAX: 16.57 MIN: 15.54 / MAX: 18.64 MIN: 15.61 / MAX: 16.77 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
RealSR-NCNN Scale: 4x - TAA: Yes OpenBenchmarking.org Seconds, Fewer Is Better RealSR-NCNN 20200818 Scale: 4x - TAA: Yes 1 3 2 14 28 42 56 70 SE +/- 0.49, N = 3 SE +/- 0.78, N = 3 SE +/- 0.91, N = 3 63.33 63.57 64.55
NCNN Target: Vulkan GPU - Model: yolov4-tiny OpenBenchmarking.org ms, Fewer Is Better NCNN 20200916 Target: Vulkan GPU - Model: yolov4-tiny 2 1 3 3 6 9 12 15 SE +/- 0.00, N = 2 SE +/- 0.01, N = 3 SE +/- 0.02, N = 3 10.68 10.70 10.71 MIN: 10.49 / MAX: 10.95 MIN: 10.47 / MAX: 11.01 MIN: 10.45 / MAX: 11.19 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
NCNN Target: Vulkan GPU - Model: resnet50 OpenBenchmarking.org ms, Fewer Is Better NCNN 20200916 Target: Vulkan GPU - Model: resnet50 1 3 2 2 4 6 8 10 SE +/- 0.03, N = 3 SE +/- 0.14, N = 3 SE +/- 0.32, N = 3 6.02 6.13 6.38 MIN: 5.83 / MAX: 13.11 MIN: 5.85 / MAX: 23.94 MIN: 5.85 / MAX: 22.05 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
NCNN Target: Vulkan GPU - Model: alexnet OpenBenchmarking.org ms, Fewer Is Better NCNN 20200916 Target: Vulkan GPU - Model: alexnet 3 1 2 0.8865 1.773 2.6595 3.546 4.4325 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 3.91 3.92 3.94 MIN: 3.8 / MAX: 4.91 MIN: 3.79 / MAX: 4.97 MIN: 3.8 / MAX: 5.12 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
NCNN Target: Vulkan GPU - Model: resnet18 OpenBenchmarking.org ms, Fewer Is Better NCNN 20200916 Target: Vulkan GPU - Model: resnet18 1 2 3 0.4725 0.945 1.4175 1.89 2.3625 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 2.10 2.10 2.10 MIN: 2.01 / MAX: 2.81 MIN: 2.01 / MAX: 2.87 MIN: 2.01 / MAX: 2.88 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
NCNN Target: Vulkan GPU - Model: vgg16 OpenBenchmarking.org ms, Fewer Is Better NCNN 20200916 Target: Vulkan GPU - Model: vgg16 2 3 1 3 6 9 12 15 SE +/- 0.27, N = 3 SE +/- 0.30, N = 3 SE +/- 0.36, N = 3 11.46 11.69 11.95 MIN: 9.59 / MAX: 31.3 MIN: 9.56 / MAX: 36.67 MIN: 9.6 / MAX: 31.99 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
NCNN Target: Vulkan GPU - Model: googlenet OpenBenchmarking.org ms, Fewer Is Better NCNN 20200916 Target: Vulkan GPU - Model: googlenet 2 3 1 1.3005 2.601 3.9015 5.202 6.5025 SE +/- 0.06, N = 3 SE +/- 0.06, N = 3 SE +/- 0.12, N = 3 5.66 5.71 5.78 MIN: 5.53 / MAX: 17.32 MIN: 5.52 / MAX: 13.35 MIN: 5.53 / MAX: 23.31 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
NCNN Target: Vulkan GPU - Model: blazeface OpenBenchmarking.org ms, Fewer Is Better NCNN 20200916 Target: Vulkan GPU - Model: blazeface 3 2 1 0.2025 0.405 0.6075 0.81 1.0125 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.05, N = 3 0.85 0.87 0.90 MIN: 0.83 / MAX: 1.36 MIN: 0.84 / MAX: 1.67 MIN: 0.84 / MAX: 1.56 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
NCNN Target: Vulkan GPU - Model: efficientnet-b0 OpenBenchmarking.org ms, Fewer Is Better NCNN 20200916 Target: Vulkan GPU - Model: efficientnet-b0 1 3 2 3 6 9 12 15 SE +/- 0.17, N = 3 SE +/- 0.08, N = 3 SE +/- 0.13, N = 3 10.41 10.44 10.47 MIN: 8.75 / MAX: 26.47 MIN: 8.74 / MAX: 23.62 MIN: 8.76 / MAX: 24.1 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
NCNN Target: Vulkan GPU - Model: mnasnet OpenBenchmarking.org ms, Fewer Is Better NCNN 20200916 Target: Vulkan GPU - Model: mnasnet 2 3 1 0.6053 1.2106 1.8159 2.4212 3.0265 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 2.67 2.68 2.69 MIN: 2.64 / MAX: 3.26 MIN: 2.64 / MAX: 3.71 MIN: 2.64 / MAX: 3.72 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
NCNN Target: Vulkan GPU - Model: shufflenet-v2 OpenBenchmarking.org ms, Fewer Is Better NCNN 20200916 Target: Vulkan GPU - Model: shufflenet-v2 3 1 2 0.513 1.026 1.539 2.052 2.565 SE +/- 0.00, N = 3 SE +/- 0.02, N = 3 SE +/- 0.02, N = 3 2.26 2.28 2.28 MIN: 2.24 / MAX: 2.82 MIN: 2.25 / MAX: 3.05 MIN: 2.24 / MAX: 6.97 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
NCNN Target: Vulkan GPU-v3-v3 - Model: mobilenet-v3 OpenBenchmarking.org ms, Fewer Is Better NCNN 20200916 Target: Vulkan GPU-v3-v3 - Model: mobilenet-v3 3 2 1 0.7988 1.5976 2.3964 3.1952 3.994 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 SE +/- 0.04, N = 3 3.49 3.50 3.55 MIN: 3.46 / MAX: 3.99 MIN: 3.47 / MAX: 4.03 MIN: 3.47 / MAX: 18.04 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
NCNN Target: Vulkan GPU-v2-v2 - Model: mobilenet-v2 OpenBenchmarking.org ms, Fewer Is Better NCNN 20200916 Target: Vulkan GPU-v2-v2 - Model: mobilenet-v2 2 3 1 0.567 1.134 1.701 2.268 2.835 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 SE +/- 0.02, N = 3 2.49 2.49 2.52 MIN: 2.47 / MAX: 2.85 MIN: 2.46 / MAX: 2.84 MIN: 2.47 / MAX: 3.46 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
NCNN Target: Vulkan GPU - Model: mobilenet OpenBenchmarking.org ms, Fewer Is Better NCNN 20200916 Target: Vulkan GPU - Model: mobilenet 3 2 1 2 4 6 8 10 SE +/- 0.03, N = 3 SE +/- 0.05, N = 3 SE +/- 0.05, N = 3 7.68 7.72 7.77 MIN: 5.58 / MAX: 11.76 MIN: 5.6 / MAX: 8.83 MIN: 5.52 / MAX: 11.8 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
NCNN Target: Vulkan GPU - Model: squeezenet OpenBenchmarking.org ms, Fewer Is Better NCNN 20200916 Target: Vulkan GPU - Model: squeezenet 1 2 3 1.0598 2.1196 3.1794 4.2392 5.299 SE +/- 0.02, N = 3 SE +/- 0.01, N = 3 SE +/- 0.03, N = 3 4.66 4.68 4.71 MIN: 4.48 / MAX: 6.06 MIN: 4.51 / MAX: 6.25 MIN: 4.51 / MAX: 6.36 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
TNN Target: CPU - Model: MobileNet v2 OpenBenchmarking.org ms, Fewer Is Better TNN 0.2.3 Target: CPU - Model: MobileNet v2 3 1 2 50 100 150 200 250 SE +/- 1.92, N = 3 SE +/- 1.13, N = 3 SE +/- 1.34, N = 3 244.14 245.15 246.96 MIN: 232.48 / MAX: 272.94 MIN: 233.67 / MAX: 275.36 MIN: 233.69 / MAX: 262.21 1. (CXX) g++ options: -fopenmp -pthread -fvisibility=hidden -O3 -rdynamic -ldl
TNN Target: CPU - Model: SqueezeNet v1.1 OpenBenchmarking.org ms, Fewer Is Better TNN 0.2.3 Target: CPU - Model: SqueezeNet v1.1 3 2 1 50 100 150 200 250 SE +/- 0.19, N = 3 SE +/- 0.04, N = 3 SE +/- 3.76, N = 3 226.90 228.48 230.02 MIN: 224.24 / MAX: 228.35 MIN: 225.95 / MAX: 229.21 MIN: 222.17 / MAX: 240.13 1. (CXX) g++ options: -fopenmp -pthread -fvisibility=hidden -O3 -rdynamic -ldl
RealSR-NCNN Scale: 4x - TAA: No OpenBenchmarking.org Seconds, Fewer Is Better RealSR-NCNN 20200818 Scale: 4x - TAA: No 2 3 1 3 6 9 12 15 SE +/- 0.042, N = 3 SE +/- 0.038, N = 3 SE +/- 0.103, N = 3 9.797 9.838 9.845
Phoronix Test Suite v10.8.4