mnn3 AMD Ryzen 7 7840HS testing with a Framework Laptop 16 (AMD Ryzen 7040 ) FRANMZCP07 (03.01 BIOS) and AMD Radeon 780M 512MB on Ubuntu 24.04 via the Phoronix Test Suite.
HTML result view exported from: https://openbenchmarking.org/result/2411180-NE-MNN39454591&rdt .
mnn3 Processor Motherboard Chipset Memory Disk Graphics Audio Network OS Kernel Desktop Display Server OpenGL Compiler File-System Screen Resolution a b c AMD Ryzen 7 7840HS @ 5.29GHz (8 Cores / 16 Threads) Framework Laptop 16 (AMD Ryzen 7040 ) FRANMZCP07 (03.01 BIOS) AMD Device 14e8 2 x 8GB DDR5-5600MT/s A-DATA AD5S56008G-B 512GB Western Digital PC SN810 SDCPNRY-512G AMD Radeon 780M 512MB AMD Navi 31 HDMI/DP MEDIATEK MT7922 802.11ax PCI Ubuntu 24.04 6.8.0-48-generic (x86_64) GNOME Shell 46.0 X Server + Wayland 4.6 Mesa 24.2~git2406200600.0ac0fb~oibaf~n (git-0ac0fbc 2024-06-20 noble-oibaf-ppa) (LLVM 17.0.6 DRM 3.57) GCC 13.2.0 ext4 2560x1600 OpenBenchmarking.org Kernel Details - Transparent Huge Pages: madvise Compiler Details - --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-backtrace --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-defaulted --enable-offload-targets=nvptx-none=/build/gcc-13-uJ7kn6/gcc-13-13.2.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-13-uJ7kn6/gcc-13-13.2.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v Processor Details - Scaling Governor: amd-pstate-epp powersave (EPP: balance_performance) - Platform Profile: balanced - CPU Microcode: 0xa704103 - ACPI Profile: balanced Security Details - gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + reg_file_data_sampling: Not affected + retbleed: Not affected + spec_rstack_overflow: Vulnerable: Safe RET no microcode + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS; IBPB: conditional; STIBP: always-on; RSB filling; PBRSB-eIBRS: Not affected; BHI: Not affected + srbds: Not affected + tsx_async_abort: Not affected
mnn3 mnn: nasnet mnn: mobilenetV3 mnn: squeezenetv1.1 mnn: resnet-v2-50 mnn: SqueezeNetV1.0 mnn: MobileNetV2_224 mnn: mobilenet-v1-1.0 mnn: inception-v3 a b c 10.776 1.437 2.757 16.929 4.354 3.452 4.199 35.494 10.905 1.439 2.650 16.868 4.225 3.340 4.176 35.583 10.876 1.431 2.763 16.893 4.375 3.473 4.256 35.505 OpenBenchmarking.org
Mobile Neural Network Model: nasnet OpenBenchmarking.org ms, Fewer Is Better Mobile Neural Network 3.0 Model: nasnet a b c 3 6 9 12 15 SE +/- 0.08, N = 3 SE +/- 0.04, N = 3 SE +/- 0.13, N = 3 10.78 10.91 10.88 MIN: 10.58 / MAX: 32.51 MIN: 10.61 / MAX: 57.2 MIN: 10.6 / MAX: 24.81 1. (CXX) g++ options: -std=c++11 -O3 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -pthread -ldl
Mobile Neural Network Model: mobilenetV3 OpenBenchmarking.org ms, Fewer Is Better Mobile Neural Network 3.0 Model: mobilenetV3 a b c 0.3238 0.6476 0.9714 1.2952 1.619 SE +/- 0.013, N = 3 SE +/- 0.017, N = 3 SE +/- 0.014, N = 3 1.437 1.439 1.431 MIN: 1.38 / MAX: 14.2 MIN: 1.38 / MAX: 18.28 MIN: 1.38 / MAX: 9.09 1. (CXX) g++ options: -std=c++11 -O3 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -pthread -ldl
Mobile Neural Network Model: squeezenetv1.1 OpenBenchmarking.org ms, Fewer Is Better Mobile Neural Network 3.0 Model: squeezenetv1.1 a b c 0.6217 1.2434 1.8651 2.4868 3.1085 SE +/- 0.048, N = 3 SE +/- 0.004, N = 3 SE +/- 0.049, N = 3 2.757 2.650 2.763 MIN: 2.62 / MAX: 13.68 MIN: 2.58 / MAX: 14.34 MIN: 2.62 / MAX: 20.09 1. (CXX) g++ options: -std=c++11 -O3 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -pthread -ldl
Mobile Neural Network Model: resnet-v2-50 OpenBenchmarking.org ms, Fewer Is Better Mobile Neural Network 3.0 Model: resnet-v2-50 a b c 4 8 12 16 20 SE +/- 0.01, N = 3 SE +/- 0.03, N = 3 SE +/- 0.00, N = 3 16.93 16.87 16.89 MIN: 16.75 / MAX: 32.56 MIN: 16.68 / MAX: 33.16 MIN: 16.73 / MAX: 33.21 1. (CXX) g++ options: -std=c++11 -O3 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -pthread -ldl
Mobile Neural Network Model: SqueezeNetV1.0 OpenBenchmarking.org ms, Fewer Is Better Mobile Neural Network 3.0 Model: SqueezeNetV1.0 a b c 0.9844 1.9688 2.9532 3.9376 4.922 SE +/- 0.058, N = 3 SE +/- 0.003, N = 3 SE +/- 0.068, N = 3 4.354 4.225 4.375 MIN: 4.15 / MAX: 23.87 MIN: 4.15 / MAX: 16.78 MIN: 4.18 / MAX: 21.86 1. (CXX) g++ options: -std=c++11 -O3 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -pthread -ldl
Mobile Neural Network Model: MobileNetV2_224 OpenBenchmarking.org ms, Fewer Is Better Mobile Neural Network 3.0 Model: MobileNetV2_224 a b c 0.7814 1.5628 2.3442 3.1256 3.907 SE +/- 0.072, N = 3 SE +/- 0.019, N = 3 SE +/- 0.072, N = 3 3.452 3.340 3.473 MIN: 3.23 / MAX: 13.82 MIN: 3.22 / MAX: 102.37 MIN: 3.24 / MAX: 54.33 1. (CXX) g++ options: -std=c++11 -O3 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -pthread -ldl
Mobile Neural Network Model: mobilenet-v1-1.0 OpenBenchmarking.org ms, Fewer Is Better Mobile Neural Network 3.0 Model: mobilenet-v1-1.0 a b c 0.9576 1.9152 2.8728 3.8304 4.788 SE +/- 0.004, N = 3 SE +/- 0.012, N = 3 SE +/- 0.011, N = 2 4.199 4.176 4.256 MIN: 4.1 / MAX: 13.96 MIN: 4.12 / MAX: 18.54 MIN: 4.2 / MAX: 13.23 1. (CXX) g++ options: -std=c++11 -O3 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -pthread -ldl
Mobile Neural Network Model: inception-v3 OpenBenchmarking.org ms, Fewer Is Better Mobile Neural Network 3.0 Model: inception-v3 a b c 8 16 24 32 40 SE +/- 0.03, N = 3 SE +/- 0.09, N = 3 SE +/- 0.06, N = 3 35.49 35.58 35.51 MIN: 35.07 / MAX: 114.9 MIN: 35.07 / MAX: 82.4 MIN: 35.06 / MAX: 52.06 1. (CXX) g++ options: -std=c++11 -O3 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -pthread -ldl
Phoronix Test Suite v10.8.5