mnn 2021 Intel Core i9-10900K testing with a Gigabyte Z490 AORUS MASTER (F3 BIOS) and Gigabyte AMD Radeon RX 5500/5500M / Pro 5500M 8GB on Ubuntu 20.10 via the Phoronix Test Suite.
HTML result view exported from: https://openbenchmarking.org/result/2101077-SYST-MNN202137&grr .
mnn 2021 Processor Motherboard Chipset Memory Disk Graphics Audio Monitor Network OS Kernel Desktop Display Server Display Driver OpenGL Vulkan Compiler File-System Screen Resolution 1 2 3 Intel Core i9-10900K @ 5.30GHz (10 Cores / 20 Threads) Gigabyte Z490 AORUS MASTER (F3 BIOS) Intel Comet Lake PCH 16GB Samsung SSD 970 EVO 250GB Gigabyte AMD Radeon RX 5500/5500M / Pro 5500M 8GB (1900/875MHz) Realtek ALC1220 ASUS MG28U Intel + Intel Wi-Fi 6 AX201 Ubuntu 20.10 5.11.0-rc1-phx (x86_64) 20201228 GNOME Shell 3.38.1 X Server 1.20.9 modesetting 1.20.9 4.6 Mesa 20.2.1 (LLVM 11.0.0) 1.2.131 GCC 10.2.0 ext4 3840x2160 OpenBenchmarking.org Compiler Details - --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none=/build/gcc-10-JvwpWM/gcc-10-10.2.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-10-JvwpWM/gcc-10-10.2.0/debian/tmp-gcn/usr,hsa --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v Processor Details - Scaling Governor: intel_pstate powersave - CPU Microcode: 0xe0 - Thermald 2.3 Security Details - itlb_multihit: KVM: Mitigation of VMX disabled + l1tf: Not affected + mds: Not affected + meltdown: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced IBRS IBPB: conditional RSB filling + srbds: Not affected + tsx_async_abort: Not affected
mnn 2021 mnn: inception-v3 mnn: mobilenet-v1-1.0 mnn: MobileNetV2_224 mnn: resnet-v2-50 mnn: SqueezeNetV1.0 1 2 3 31.644 3.581 3.201 28.745 4.937 31.885 3.657 3.320 28.455 4.951 32.627 3.711 3.229 28.623 4.983 OpenBenchmarking.org
Mobile Neural Network Model: inception-v3 OpenBenchmarking.org ms, Fewer Is Better Mobile Neural Network 1.1.1 Model: inception-v3 1 2 3 8 16 24 32 40 SE +/- 0.17, N = 11 SE +/- 0.12, N = 15 SE +/- 0.53, N = 3 31.64 31.89 32.63 MIN: 30.13 / MAX: 42.04 MIN: 30.01 / MAX: 93.98 MIN: 30.72 / MAX: 173.38 1. (CXX) g++ options: -std=c++11 -O3 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl
Mobile Neural Network Model: mobilenet-v1-1.0 OpenBenchmarking.org ms, Fewer Is Better Mobile Neural Network 1.1.1 Model: mobilenet-v1-1.0 1 2 3 0.835 1.67 2.505 3.34 4.175 SE +/- 0.024, N = 11 SE +/- 0.029, N = 15 SE +/- 0.002, N = 3 3.581 3.657 3.711 MIN: 3.29 / MAX: 12.81 MIN: 3.33 / MAX: 13.96 MIN: 3.53 / MAX: 4.95 1. (CXX) g++ options: -std=c++11 -O3 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl
Mobile Neural Network Model: MobileNetV2_224 OpenBenchmarking.org ms, Fewer Is Better Mobile Neural Network 1.1.1 Model: MobileNetV2_224 1 2 3 0.747 1.494 2.241 2.988 3.735 SE +/- 0.028, N = 11 SE +/- 0.059, N = 15 SE +/- 0.008, N = 3 3.201 3.320 3.229 MIN: 2.86 / MAX: 13.57 MIN: 2.9 / MAX: 12.47 MIN: 3.02 / MAX: 12.44 1. (CXX) g++ options: -std=c++11 -O3 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl
Mobile Neural Network Model: resnet-v2-50 OpenBenchmarking.org ms, Fewer Is Better Mobile Neural Network 1.1.1 Model: resnet-v2-50 1 2 3 7 14 21 28 35 SE +/- 0.15, N = 11 SE +/- 0.09, N = 15 SE +/- 0.15, N = 3 28.75 28.46 28.62 MIN: 27.64 / MAX: 47.05 MIN: 27.47 / MAX: 38.92 MIN: 27.39 / MAX: 38.52 1. (CXX) g++ options: -std=c++11 -O3 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl
Mobile Neural Network Model: SqueezeNetV1.0 OpenBenchmarking.org ms, Fewer Is Better Mobile Neural Network 1.1.1 Model: SqueezeNetV1.0 1 2 3 1.1212 2.2424 3.3636 4.4848 5.606 SE +/- 0.043, N = 11 SE +/- 0.041, N = 15 SE +/- 0.014, N = 3 4.937 4.951 4.983 MIN: 4.33 / MAX: 60.24 MIN: 4.32 / MAX: 16.06 MIN: 4.7 / MAX: 14.89 1. (CXX) g++ options: -std=c++11 -O3 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl
Phoronix Test Suite v10.8.4