NCNN TR 3970X AMD Ryzen Threadripper 3970X 32-Core testing with a ASUS ROG ZENITH II EXTREME (0702 BIOS) and NVIDIA TITAN RTX 24GB on Ubuntu 20.04 via the Phoronix Test Suite.
HTML result view exported from: https://openbenchmarking.org/result/2009187-PTS-NCNNTR3951 .
NCNN TR 3970X Processor Motherboard Chipset Memory Disk Graphics Audio Monitor Network OS Kernel Desktop Display Server Display Driver OpenGL OpenCL Compiler File-System Screen Resolution TR 3970X AMD Ryzen Threadripper 3970X 32-Core @ 3.70GHz (32 Cores / 64 Threads) ASUS ROG ZENITH II EXTREME (0702 BIOS) AMD Starship/Matisse 64GB 1000GB Corsair Force MP600 NVIDIA TITAN RTX 24GB NVIDIA TU102 HD Audio ASUS MG28U Aquantia AQC107 NBase-T/IEEE + Intel I211 + Intel Wi-Fi 6 AX200 Ubuntu 20.04 5.4.0-47-generic (x86_64) GNOME Shell 3.36.4 X Server 1.20.8 NVIDIA 450.36.06 4.6.0 OpenCL 1.2 CUDA 11.0.185 GCC 9.3.0 + CUDA 11.0 ext4 3840x2160 OpenBenchmarking.org - --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++,gm2 --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none,hsa --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v - Scaling Governor: acpi-cpufreq ondemand - CPU Microcode: 0x8301025 - itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Full AMD retpoline IBPB: conditional STIBP: conditional RSB filling + srbds: Not affected + tsx_async_abort: Not affected
NCNN TR 3970X ncnn: CPU - squeezenet_int8 ncnn: CPU - mobilenet_v3 ncnn: CPU - squeezenet ncnn: CPU - mnasnet ncnn: CPU - blazeface ncnn: CPU - googlenet_int8 ncnn: CPU - vgg16_int8 ncnn: CPU - resnet18_int8 ncnn: CPU - alexnet ncnn: CPU - resnet50_int8 ncnn: CPU - mobilenetv2_yolov3 TR 3970X 14.51 7.50 7.68 7.12 3.13 41.56 58.50 19.34 10.83 54.11 18.20 OpenBenchmarking.org
NCNN Target: CPU - Model: squeezenet_int8 OpenBenchmarking.org ms, Fewer Is Better NCNN 20200916 Target: CPU - Model: squeezenet_int8 TR 3970X 4 8 12 16 20 SE +/- 0.06, N = 3 14.51 MIN: 13.62 / MAX: 28.13 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
NCNN Target: CPU - Model: mobilenet_v3 OpenBenchmarking.org ms, Fewer Is Better NCNN 20200916 Target: CPU - Model: mobilenet_v3 TR 3970X 2 4 6 8 10 SE +/- 0.08, N = 3 7.50 MIN: 6.75 / MAX: 22.76 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
NCNN Target: CPU - Model: squeezenet OpenBenchmarking.org ms, Fewer Is Better NCNN 20200916 Target: CPU - Model: squeezenet TR 3970X 2 4 6 8 10 SE +/- 0.07, N = 3 7.68 MIN: 7.04 / MAX: 20.01 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
NCNN Target: CPU - Model: mnasnet OpenBenchmarking.org ms, Fewer Is Better NCNN 20200916 Target: CPU - Model: mnasnet TR 3970X 2 4 6 8 10 SE +/- 0.09, N = 3 7.12 MIN: 6.39 / MAX: 19.63 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
NCNN Target: CPU - Model: blazeface OpenBenchmarking.org ms, Fewer Is Better NCNN 20200916 Target: CPU - Model: blazeface TR 3970X 0.7043 1.4086 2.1129 2.8172 3.5215 SE +/- 0.05, N = 3 3.13 MIN: 2.86 / MAX: 12.76 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
NCNN Target: CPU - Model: googlenet_int8 OpenBenchmarking.org ms, Fewer Is Better NCNN 20200916 Target: CPU - Model: googlenet_int8 TR 3970X 9 18 27 36 45 SE +/- 0.55, N = 3 41.56 MIN: 37.84 / MAX: 108.9 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
NCNN Target: CPU - Model: vgg16_int8 OpenBenchmarking.org ms, Fewer Is Better NCNN 20200916 Target: CPU - Model: vgg16_int8 TR 3970X 13 26 39 52 65 SE +/- 0.89, N = 3 58.50 MIN: 52.64 / MAX: 73.85 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
NCNN Target: CPU - Model: resnet18_int8 OpenBenchmarking.org ms, Fewer Is Better NCNN 20200916 Target: CPU - Model: resnet18_int8 TR 3970X 5 10 15 20 25 SE +/- 0.41, N = 3 19.34 MIN: 17.63 / MAX: 34 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
NCNN Target: CPU - Model: alexnet OpenBenchmarking.org ms, Fewer Is Better NCNN 20200916 Target: CPU - Model: alexnet TR 3970X 3 6 9 12 15 SE +/- 0.18, N = 3 10.83 MIN: 9.75 / MAX: 47.61 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
NCNN Target: CPU - Model: resnet50_int8 OpenBenchmarking.org ms, Fewer Is Better NCNN 20200916 Target: CPU - Model: resnet50_int8 TR 3970X 12 24 36 48 60 SE +/- 0.25, N = 3 54.11 MIN: 48.87 / MAX: 79.23 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
NCNN Target: CPU - Model: mobilenetv2_yolov3 OpenBenchmarking.org ms, Fewer Is Better NCNN 20200916 Target: CPU - Model: mobilenetv2_yolov3 TR 3970X 4 8 12 16 20 SE +/- 0.30, N = 3 18.20 MIN: 16.77 / MAX: 34.02 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
Phoronix Test Suite v10.8.4