mnn3 AMD Ryzen 7 9800X3D 8-Core testing with a ASRock X870E Taichi (3.09.AS03 BIOS) and AMD Radeon RX 7900 GRE 16GB on Ubuntu 24.04 via the Phoronix Test Suite.
HTML result view exported from: https://openbenchmarking.org/result/2411188-PTS-MNN3956449&grr&sor .
mnn3 Processor Motherboard Chipset Memory Disk Graphics Audio Monitor Network OS Kernel Desktop Display Server OpenGL Compiler File-System Screen Resolution a b c d e AMD Ryzen 7 9800X3D 8-Core @ 5.27GHz (8 Cores / 16 Threads) ASRock X870E Taichi (3.09.AS03 BIOS) AMD Device 14d8 2 x 16GB DDR5-6000MT/s F5-6000J2836G16G 2000GB Corsair MP700 PRO AMD Radeon RX 7900 GRE 16GB AMD Navi 31 HDMI/DP DELL U2723QE Realtek Device 8126 + MEDIATEK Device 0717 Ubuntu 24.04 6.10.0-phx (x86_64) GNOME Shell 46.0 X Server + Wayland 4.6 Mesa 24.2~git2406040600.8112d4~oibaf~n (git-8112d44 2024-06-04 noble-oibaf-ppa) (LLVM 17.0.6 DRM 3.57) GCC 13.2.0 ext4 3840x2160 OpenBenchmarking.org Kernel Details - Transparent Huge Pages: madvise Compiler Details - --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-backtrace --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-defaulted --enable-offload-targets=nvptx-none=/build/gcc-13-uJ7kn6/gcc-13-13.2.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-13-uJ7kn6/gcc-13-13.2.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v Processor Details - Scaling Governor: amd-pstate-epp powersave (EPP: balance_performance) - CPU Microcode: 0xb404023 Security Details - gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + reg_file_data_sampling: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS; IBPB: conditional; STIBP: always-on; RSB filling; PBRSB-eIBRS: Not affected; BHI: Not affected + srbds: Not affected + tsx_async_abort: Not affected
mnn3 mnn: inception-v3 mnn: mobilenet-v1-1.0 mnn: MobileNetV2_224 mnn: SqueezeNetV1.0 mnn: resnet-v2-50 mnn: squeezenetv1.1 mnn: mobilenetV3 mnn: nasnet a b c d e 9.317 1.016 1.114 1.345 4.715 0.860 0.578 4.344 9.323 1.009 1.128 1.351 4.680 0.863 0.573 4.392 9.274 1.010 1.093 1.335 4.693 0.859 0.567 4.308 9.375 1.014 1.129 1.361 4.690 0.856 0.578 4.381 9.309 1.008 1.097 1.347 4.706 0.858 0.574 4.387 OpenBenchmarking.org
Mobile Neural Network Model: inception-v3 OpenBenchmarking.org ms, Fewer Is Better Mobile Neural Network 3.0 Model: inception-v3 c e a b d 3 6 9 12 15 SE +/- 0.056, N = 13 SE +/- 0.046, N = 15 SE +/- 0.067, N = 14 SE +/- 0.108, N = 3 SE +/- 0.055, N = 15 9.274 9.309 9.317 9.323 9.375 MIN: 8.36 / MAX: 32.72 MIN: 8.36 / MAX: 34.14 MIN: 8.41 / MAX: 33.45 MIN: 8.44 / MAX: 33.38 MIN: 8.44 / MAX: 31.53 1. (CXX) g++ options: -std=c++11 -O3 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -pthread -ldl
Mobile Neural Network Model: mobilenet-v1-1.0 OpenBenchmarking.org ms, Fewer Is Better Mobile Neural Network 3.0 Model: mobilenet-v1-1.0 e b c d a 0.2286 0.4572 0.6858 0.9144 1.143 SE +/- 0.002, N = 15 SE +/- 0.005, N = 3 SE +/- 0.004, N = 13 SE +/- 0.006, N = 15 SE +/- 0.004, N = 14 1.008 1.009 1.010 1.014 1.016 MIN: 0.93 / MAX: 4.99 MIN: 0.97 / MAX: 10.35 MIN: 0.98 / MAX: 10.41 MIN: 0.94 / MAX: 11.02 MIN: 0.94 / MAX: 10.13 1. (CXX) g++ options: -std=c++11 -O3 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -pthread -ldl
Mobile Neural Network Model: MobileNetV2_224 OpenBenchmarking.org ms, Fewer Is Better Mobile Neural Network 3.0 Model: MobileNetV2_224 c e a b d 0.254 0.508 0.762 1.016 1.27 SE +/- 0.008, N = 13 SE +/- 0.009, N = 15 SE +/- 0.010, N = 14 SE +/- 0.042, N = 3 SE +/- 0.012, N = 15 1.093 1.097 1.114 1.128 1.129 MIN: 1.03 / MAX: 9.4 MIN: 1.02 / MAX: 4.83 MIN: 1.04 / MAX: 9.2 MIN: 1.03 / MAX: 4.41 MIN: 1.03 / MAX: 10.28 1. (CXX) g++ options: -std=c++11 -O3 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -pthread -ldl
Mobile Neural Network Model: SqueezeNetV1.0 OpenBenchmarking.org ms, Fewer Is Better Mobile Neural Network 3.0 Model: SqueezeNetV1.0 c a e b d 0.3062 0.6124 0.9186 1.2248 1.531 SE +/- 0.013, N = 13 SE +/- 0.008, N = 14 SE +/- 0.013, N = 15 SE +/- 0.038, N = 3 SE +/- 0.017, N = 15 1.335 1.345 1.347 1.351 1.361 MIN: 1.27 / MAX: 10.66 MIN: 1.29 / MAX: 9.52 MIN: 1.27 / MAX: 10.91 MIN: 1.28 / MAX: 2.34 MIN: 1.27 / MAX: 10.96 1. (CXX) g++ options: -std=c++11 -O3 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -pthread -ldl
Mobile Neural Network Model: resnet-v2-50 OpenBenchmarking.org ms, Fewer Is Better Mobile Neural Network 3.0 Model: resnet-v2-50 b d c e a 1.0609 2.1218 3.1827 4.2436 5.3045 SE +/- 0.036, N = 3 SE +/- 0.010, N = 15 SE +/- 0.009, N = 13 SE +/- 0.015, N = 15 SE +/- 0.015, N = 14 4.680 4.690 4.693 4.706 4.715 MIN: 4.41 / MAX: 17.03 MIN: 4.47 / MAX: 22.02 MIN: 4.43 / MAX: 21.25 MIN: 4.45 / MAX: 22.32 MIN: 4.47 / MAX: 35.34 1. (CXX) g++ options: -std=c++11 -O3 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -pthread -ldl
Mobile Neural Network Model: squeezenetv1.1 OpenBenchmarking.org ms, Fewer Is Better Mobile Neural Network 3.0 Model: squeezenetv1.1 d e c a b 0.1942 0.3884 0.5826 0.7768 0.971 SE +/- 0.003, N = 15 SE +/- 0.005, N = 15 SE +/- 0.004, N = 13 SE +/- 0.004, N = 14 SE +/- 0.008, N = 3 0.856 0.858 0.859 0.860 0.863 MIN: 0.82 / MAX: 8.33 MIN: 0.82 / MAX: 10.43 MIN: 0.83 / MAX: 4.89 MIN: 0.83 / MAX: 9.88 MIN: 0.82 / MAX: 4.87 1. (CXX) g++ options: -std=c++11 -O3 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -pthread -ldl
Mobile Neural Network Model: mobilenetV3 OpenBenchmarking.org ms, Fewer Is Better Mobile Neural Network 3.0 Model: mobilenetV3 c b e a d 0.1301 0.2602 0.3903 0.5204 0.6505 SE +/- 0.002, N = 13 SE +/- 0.006, N = 3 SE +/- 0.002, N = 15 SE +/- 0.003, N = 14 SE +/- 0.003, N = 15 0.567 0.573 0.574 0.578 0.578 MIN: 0.54 / MAX: 4.68 MIN: 0.56 / MAX: 1.29 MIN: 0.55 / MAX: 9.53 MIN: 0.55 / MAX: 12.01 MIN: 0.55 / MAX: 13.79 1. (CXX) g++ options: -std=c++11 -O3 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -pthread -ldl
Mobile Neural Network Model: nasnet OpenBenchmarking.org ms, Fewer Is Better Mobile Neural Network 3.0 Model: nasnet c a d e b 0.9882 1.9764 2.9646 3.9528 4.941 SE +/- 0.032, N = 13 SE +/- 0.042, N = 14 SE +/- 0.035, N = 15 SE +/- 0.042, N = 15 SE +/- 0.053, N = 3 4.308 4.344 4.381 4.387 4.392 MIN: 4.07 / MAX: 16.75 MIN: 4.09 / MAX: 18.96 MIN: 4.06 / MAX: 14.14 MIN: 4.02 / MAX: 21.04 MIN: 4.09 / MAX: 21.15 1. (CXX) g++ options: -std=c++11 -O3 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -pthread -ldl
Phoronix Test Suite v10.8.5