NN TR 3970X AMD Ryzen Threadripper 3970X 32-Core testing with a ASUS ROG ZENITH II EXTREME (0702 BIOS) and NVIDIA TITAN RTX 24GB on Ubuntu 20.04 via the Phoronix Test Suite.
HTML result view exported from: https://openbenchmarking.org/result/2009183-PTS-NNTR397064 .
NN TR 3970X Processor Motherboard Chipset Memory Disk Graphics Audio Monitor Network OS Kernel Desktop Display Server Display Driver OpenGL OpenCL Compiler File-System Screen Resolution Threadripper 3970X AMD Ryzen Threadripper 3970X 32-Core @ 3.70GHz (32 Cores / 64 Threads) ASUS ROG ZENITH II EXTREME (0702 BIOS) AMD Starship/Matisse 64GB 1000GB Corsair Force MP600 NVIDIA TITAN RTX 24GB NVIDIA TU102 HD Audio ASUS MG28U Aquantia AQC107 NBase-T/IEEE + Intel I211 + Intel Wi-Fi 6 AX200 Ubuntu 20.04 5.4.0-47-generic (x86_64) GNOME Shell 3.36.4 X Server 1.20.8 NVIDIA 450.36.06 4.6.0 OpenCL 1.2 CUDA 11.0.185 GCC 9.3.0 + CUDA 11.0 ext4 3840x2160 OpenBenchmarking.org - --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++,gm2 --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none,hsa --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v - Scaling Governor: acpi-cpufreq ondemand - CPU Microcode: 0x8301025 - itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Full AMD retpoline IBPB: conditional STIBP: conditional RSB filling + srbds: Not affected + tsx_async_abort: Not affected
NN TR 3970X mnn: SqueezeNetV1.0 mnn: resnet-v2-50 mnn: MobileNetV2_224 mnn: mobilenet-v1-1.0 mnn: inception-v3 ncnn: CPU - squeezenet_int8 ncnn: CPU - mobilenet_v3 ncnn: CPU - squeezenet ncnn: CPU - mnasnet ncnn: CPU - blazeface ncnn: CPU - googlenet_int8 ncnn: CPU - vgg16_int8 ncnn: CPU - resnet18_int8 ncnn: CPU - alexnet ncnn: CPU - resnet50_int8 ncnn: CPU - mobilenetv2_yolov3 Threadripper 3970X 6.347 24.726 4.071 4.344 22.661 15.12 7.64 7.77 7.29 3.26 42.44 60.78 19.97 11.24 53.85 18.22 OpenBenchmarking.org
Mobile Neural Network Model: SqueezeNetV1.0 OpenBenchmarking.org ms, Fewer Is Better Mobile Neural Network 2020-09-17 Model: SqueezeNetV1.0 Threadripper 3970X 2 4 6 8 10 SE +/- 0.072, N = 3 6.347 MIN: 6.06 / MAX: 7.29 1. (CXX) g++ options: -std=c++11 -O3 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl
Mobile Neural Network Model: resnet-v2-50 OpenBenchmarking.org ms, Fewer Is Better Mobile Neural Network 2020-09-17 Model: resnet-v2-50 Threadripper 3970X 6 12 18 24 30 SE +/- 0.08, N = 3 24.73 MIN: 24.16 / MAX: 27.89 1. (CXX) g++ options: -std=c++11 -O3 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl
Mobile Neural Network Model: MobileNetV2_224 OpenBenchmarking.org ms, Fewer Is Better Mobile Neural Network 2020-09-17 Model: MobileNetV2_224 Threadripper 3970X 0.916 1.832 2.748 3.664 4.58 SE +/- 0.009, N = 3 4.071 MIN: 4.01 / MAX: 4.4 1. (CXX) g++ options: -std=c++11 -O3 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl
Mobile Neural Network Model: mobilenet-v1-1.0 OpenBenchmarking.org ms, Fewer Is Better Mobile Neural Network 2020-09-17 Model: mobilenet-v1-1.0 Threadripper 3970X 0.9774 1.9548 2.9322 3.9096 4.887 SE +/- 0.023, N = 3 4.344 MIN: 4.14 / MAX: 4.69 1. (CXX) g++ options: -std=c++11 -O3 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl
Mobile Neural Network Model: inception-v3 OpenBenchmarking.org ms, Fewer Is Better Mobile Neural Network 2020-09-17 Model: inception-v3 Threadripper 3970X 5 10 15 20 25 SE +/- 0.17, N = 3 22.66 MIN: 22.1 / MAX: 24.86 1. (CXX) g++ options: -std=c++11 -O3 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl
NCNN Target: CPU - Model: squeezenet_int8 OpenBenchmarking.org ms, Fewer Is Better NCNN 20200916 Target: CPU - Model: squeezenet_int8 Threadripper 3970X 4 8 12 16 20 SE +/- 0.12, N = 13 15.12 MIN: 13.74 / MAX: 39.46 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
NCNN Target: CPU - Model: mobilenet_v3 OpenBenchmarking.org ms, Fewer Is Better NCNN 20200916 Target: CPU - Model: mobilenet_v3 Threadripper 3970X 2 4 6 8 10 SE +/- 0.03, N = 13 7.64 MIN: 6.8 / MAX: 24.4 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
NCNN Target: CPU - Model: squeezenet OpenBenchmarking.org ms, Fewer Is Better NCNN 20200916 Target: CPU - Model: squeezenet Threadripper 3970X 2 4 6 8 10 SE +/- 0.05, N = 13 7.77 MIN: 6.84 / MAX: 26 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
NCNN Target: CPU - Model: mnasnet OpenBenchmarking.org ms, Fewer Is Better NCNN 20200916 Target: CPU - Model: mnasnet Threadripper 3970X 2 4 6 8 10 SE +/- 0.04, N = 13 7.29 MIN: 6.52 / MAX: 20.78 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
NCNN Target: CPU - Model: blazeface OpenBenchmarking.org ms, Fewer Is Better NCNN 20200916 Target: CPU - Model: blazeface Threadripper 3970X 0.7335 1.467 2.2005 2.934 3.6675 SE +/- 0.02, N = 13 3.26 MIN: 2.89 / MAX: 16.25 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
NCNN Target: CPU - Model: googlenet_int8 OpenBenchmarking.org ms, Fewer Is Better NCNN 20200916 Target: CPU - Model: googlenet_int8 Threadripper 3970X 10 20 30 40 50 SE +/- 0.16, N = 13 42.44 MIN: 38.14 / MAX: 100.2 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
NCNN Target: CPU - Model: vgg16_int8 OpenBenchmarking.org ms, Fewer Is Better NCNN 20200916 Target: CPU - Model: vgg16_int8 Threadripper 3970X 14 28 42 56 70 SE +/- 0.56, N = 13 60.78 MIN: 53.03 / MAX: 702.85 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
NCNN Target: CPU - Model: resnet18_int8 OpenBenchmarking.org ms, Fewer Is Better NCNN 20200916 Target: CPU - Model: resnet18_int8 Threadripper 3970X 5 10 15 20 25 SE +/- 0.12, N = 13 19.97 MIN: 17.9 / MAX: 34.82 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
NCNN Target: CPU - Model: alexnet OpenBenchmarking.org ms, Fewer Is Better NCNN 20200916 Target: CPU - Model: alexnet Threadripper 3970X 3 6 9 12 15 SE +/- 0.10, N = 13 11.24 MIN: 9.72 / MAX: 30.17 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
NCNN Target: CPU - Model: resnet50_int8 OpenBenchmarking.org ms, Fewer Is Better NCNN 20200916 Target: CPU - Model: resnet50_int8 Threadripper 3970X 12 24 36 48 60 SE +/- 0.22, N = 13 53.85 MIN: 48.6 / MAX: 73.23 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
NCNN Target: CPU - Model: mobilenetv2_yolov3 OpenBenchmarking.org ms, Fewer Is Better NCNN 20200916 Target: CPU - Model: mobilenetv2_yolov3 Threadripper 3970X 4 8 12 16 20 SE +/- 0.07, N = 13 18.22 MIN: 16.63 / MAX: 38.33 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
Phoronix Test Suite v10.8.4