mnn-blade-0 AMD Ryzen 9 5900X 12-Core testing with a ASUS PRIME X570-PRO (4204 BIOS) and MSI NVIDIA GeForce RTX 3090 24GB on Ubuntu 20.04 via the Phoronix Test Suite.
HTML result view exported from: https://openbenchmarking.org/result/2310180-NE-MNNBLADE093 .
mnn-blade-0 Processor Motherboard Chipset Memory Disk Graphics Audio Network OS Kernel Display Driver Vulkan Compiler File-System Screen Resolution mnn-blade-0 AMD Ryzen 9 5900X 12-Core @ 3.90GHz (12 Cores / 24 Threads) ASUS PRIME X570-PRO (4204 BIOS) AMD Starship/Matisse 128GB 2 x 2000GB Samsung SSD 980 PRO 2TB + 7 x 12000GB Seagate ST12000NM001G-2M + 1000GB Samsung SSD 860 MSI NVIDIA GeForce RTX 3090 24GB NVIDIA Device 1aef Intel I211 Ubuntu 20.04 5.4.0-163-generic (x86_64) NVIDIA 1.3.242 GCC 9.4.0 + CUDA 12.2 ext4 1920x1080 OpenBenchmarking.org - Transparent Huge Pages: madvise - --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++,gm2 --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none=/build/gcc-9-9QDOt0/gcc-9-9.4.0/debian/tmp-nvptx/usr,hsa --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v - Scaling Governor: acpi-cpufreq ondemand (Boost: Disabled) - CPU Microcode: 0xa201205 - gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional IBRS_FW STIBP: always-on RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected
mnn-blade-0 mnn: nasnet mnn: mobilenetV3 mnn: squeezenetv1.1 mnn: resnet-v2-50 mnn: SqueezeNetV1.0 mnn: MobileNetV2_224 mnn: mobilenet-v1-1.0 mnn: inception-v3 mnn-blade-0 17.873 2.761 4.740 33.046 6.854 5.170 5.507 30.695 OpenBenchmarking.org
Mobile Neural Network Model: nasnet OpenBenchmarking.org ms, Fewer Is Better Mobile Neural Network 2.1 Model: nasnet mnn-blade-0 4 8 12 16 20 SE +/- 0.13, N = 3 17.87 MIN: 12.94 / MAX: 148.94 1. (CXX) g++ options: -std=c++11 -O3 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl
Mobile Neural Network Model: mobilenetV3 OpenBenchmarking.org ms, Fewer Is Better Mobile Neural Network 2.1 Model: mobilenetV3 mnn-blade-0 0.6212 1.2424 1.8636 2.4848 3.106 SE +/- 0.094, N = 3 2.761 MIN: 2.11 / MAX: 37.4 1. (CXX) g++ options: -std=c++11 -O3 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl
Mobile Neural Network Model: squeezenetv1.1 OpenBenchmarking.org ms, Fewer Is Better Mobile Neural Network 2.1 Model: squeezenetv1.1 mnn-blade-0 1.0665 2.133 3.1995 4.266 5.3325 SE +/- 0.147, N = 3 4.740 MIN: 3.68 / MAX: 67.71 1. (CXX) g++ options: -std=c++11 -O3 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl
Mobile Neural Network Model: resnet-v2-50 OpenBenchmarking.org ms, Fewer Is Better Mobile Neural Network 2.1 Model: resnet-v2-50 mnn-blade-0 8 16 24 32 40 SE +/- 0.40, N = 3 33.05 MIN: 26.22 / MAX: 193.56 1. (CXX) g++ options: -std=c++11 -O3 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl
Mobile Neural Network Model: SqueezeNetV1.0 OpenBenchmarking.org ms, Fewer Is Better Mobile Neural Network 2.1 Model: SqueezeNetV1.0 mnn-blade-0 2 4 6 8 10 SE +/- 0.092, N = 3 6.854 MIN: 5.31 / MAX: 91.87 1. (CXX) g++ options: -std=c++11 -O3 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl
Mobile Neural Network Model: MobileNetV2_224 OpenBenchmarking.org ms, Fewer Is Better Mobile Neural Network 2.1 Model: MobileNetV2_224 mnn-blade-0 1.1633 2.3266 3.4899 4.6532 5.8165 SE +/- 0.182, N = 3 5.170 MIN: 3.78 / MAX: 73.85 1. (CXX) g++ options: -std=c++11 -O3 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl
Mobile Neural Network Model: mobilenet-v1-1.0 OpenBenchmarking.org ms, Fewer Is Better Mobile Neural Network 2.1 Model: mobilenet-v1-1.0 mnn-blade-0 1.2391 2.4782 3.7173 4.9564 6.1955 SE +/- 0.088, N = 3 5.507 MIN: 4.43 / MAX: 67.82 1. (CXX) g++ options: -std=c++11 -O3 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl
Mobile Neural Network Model: inception-v3 OpenBenchmarking.org ms, Fewer Is Better Mobile Neural Network 2.1 Model: inception-v3 mnn-blade-0 7 14 21 28 35 SE +/- 0.25, N = 3 30.70 MIN: 24.06 / MAX: 160.48 1. (CXX) g++ options: -std=c++11 -O3 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl
Phoronix Test Suite v10.8.5