mnn3 AMD Ryzen 7 9800X3D 8-Core testing with a ASRock X870E Taichi (3.09.AS03 BIOS) and AMD Radeon RX 7900 GRE 16GB on Ubuntu 24.04 via the Phoronix Test Suite.
HTML result view exported from: https://openbenchmarking.org/result/2411188-PTS-MNN3956449&rdt .
mnn3 Processor Motherboard Chipset Memory Disk Graphics Audio Monitor Network OS Kernel Desktop Display Server OpenGL Compiler File-System Screen Resolution a b c d e AMD Ryzen 7 9800X3D 8-Core @ 5.27GHz (8 Cores / 16 Threads) ASRock X870E Taichi (3.09.AS03 BIOS) AMD Device 14d8 2 x 16GB DDR5-6000MT/s F5-6000J2836G16G 2000GB Corsair MP700 PRO AMD Radeon RX 7900 GRE 16GB AMD Navi 31 HDMI/DP DELL U2723QE Realtek Device 8126 + MEDIATEK Device 0717 Ubuntu 24.04 6.10.0-phx (x86_64) GNOME Shell 46.0 X Server + Wayland 4.6 Mesa 24.2~git2406040600.8112d4~oibaf~n (git-8112d44 2024-06-04 noble-oibaf-ppa) (LLVM 17.0.6 DRM 3.57) GCC 13.2.0 ext4 3840x2160 OpenBenchmarking.org Kernel Details - Transparent Huge Pages: madvise Compiler Details - --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-backtrace --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-defaulted --enable-offload-targets=nvptx-none=/build/gcc-13-uJ7kn6/gcc-13-13.2.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-13-uJ7kn6/gcc-13-13.2.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v Processor Details - Scaling Governor: amd-pstate-epp powersave (EPP: balance_performance) - CPU Microcode: 0xb404023 Security Details - gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + reg_file_data_sampling: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS; IBPB: conditional; STIBP: always-on; RSB filling; PBRSB-eIBRS: Not affected; BHI: Not affected + srbds: Not affected + tsx_async_abort: Not affected
mnn3 mnn: nasnet mnn: mobilenetV3 mnn: squeezenetv1.1 mnn: resnet-v2-50 mnn: SqueezeNetV1.0 mnn: MobileNetV2_224 mnn: mobilenet-v1-1.0 mnn: inception-v3 a b c d e 4.344 0.578 0.860 4.715 1.345 1.114 1.016 9.317 4.392 0.573 0.863 4.680 1.351 1.128 1.009 9.323 4.308 0.567 0.859 4.693 1.335 1.093 1.010 9.274 4.381 0.578 0.856 4.690 1.361 1.129 1.014 9.375 4.387 0.574 0.858 4.706 1.347 1.097 1.008 9.309 OpenBenchmarking.org
Mobile Neural Network Model: nasnet OpenBenchmarking.org ms, Fewer Is Better Mobile Neural Network 3.0 Model: nasnet a b c d e 0.9882 1.9764 2.9646 3.9528 4.941 SE +/- 0.042, N = 14 SE +/- 0.053, N = 3 SE +/- 0.032, N = 13 SE +/- 0.035, N = 15 SE +/- 0.042, N = 15 4.344 4.392 4.308 4.381 4.387 MIN: 4.09 / MAX: 18.96 MIN: 4.09 / MAX: 21.15 MIN: 4.07 / MAX: 16.75 MIN: 4.06 / MAX: 14.14 MIN: 4.02 / MAX: 21.04 1. (CXX) g++ options: -std=c++11 -O3 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -pthread -ldl
Mobile Neural Network Model: mobilenetV3 OpenBenchmarking.org ms, Fewer Is Better Mobile Neural Network 3.0 Model: mobilenetV3 a b c d e 0.1301 0.2602 0.3903 0.5204 0.6505 SE +/- 0.003, N = 14 SE +/- 0.006, N = 3 SE +/- 0.002, N = 13 SE +/- 0.003, N = 15 SE +/- 0.002, N = 15 0.578 0.573 0.567 0.578 0.574 MIN: 0.55 / MAX: 12.01 MIN: 0.56 / MAX: 1.29 MIN: 0.54 / MAX: 4.68 MIN: 0.55 / MAX: 13.79 MIN: 0.55 / MAX: 9.53 1. (CXX) g++ options: -std=c++11 -O3 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -pthread -ldl
Mobile Neural Network Model: squeezenetv1.1 OpenBenchmarking.org ms, Fewer Is Better Mobile Neural Network 3.0 Model: squeezenetv1.1 a b c d e 0.1942 0.3884 0.5826 0.7768 0.971 SE +/- 0.004, N = 14 SE +/- 0.008, N = 3 SE +/- 0.004, N = 13 SE +/- 0.003, N = 15 SE +/- 0.005, N = 15 0.860 0.863 0.859 0.856 0.858 MIN: 0.83 / MAX: 9.88 MIN: 0.82 / MAX: 4.87 MIN: 0.83 / MAX: 4.89 MIN: 0.82 / MAX: 8.33 MIN: 0.82 / MAX: 10.43 1. (CXX) g++ options: -std=c++11 -O3 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -pthread -ldl
Mobile Neural Network Model: resnet-v2-50 OpenBenchmarking.org ms, Fewer Is Better Mobile Neural Network 3.0 Model: resnet-v2-50 a b c d e 1.0609 2.1218 3.1827 4.2436 5.3045 SE +/- 0.015, N = 14 SE +/- 0.036, N = 3 SE +/- 0.009, N = 13 SE +/- 0.010, N = 15 SE +/- 0.015, N = 15 4.715 4.680 4.693 4.690 4.706 MIN: 4.47 / MAX: 35.34 MIN: 4.41 / MAX: 17.03 MIN: 4.43 / MAX: 21.25 MIN: 4.47 / MAX: 22.02 MIN: 4.45 / MAX: 22.32 1. (CXX) g++ options: -std=c++11 -O3 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -pthread -ldl
Mobile Neural Network Model: SqueezeNetV1.0 OpenBenchmarking.org ms, Fewer Is Better Mobile Neural Network 3.0 Model: SqueezeNetV1.0 a b c d e 0.3062 0.6124 0.9186 1.2248 1.531 SE +/- 0.008, N = 14 SE +/- 0.038, N = 3 SE +/- 0.013, N = 13 SE +/- 0.017, N = 15 SE +/- 0.013, N = 15 1.345 1.351 1.335 1.361 1.347 MIN: 1.29 / MAX: 9.52 MIN: 1.28 / MAX: 2.34 MIN: 1.27 / MAX: 10.66 MIN: 1.27 / MAX: 10.96 MIN: 1.27 / MAX: 10.91 1. (CXX) g++ options: -std=c++11 -O3 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -pthread -ldl
Mobile Neural Network Model: MobileNetV2_224 OpenBenchmarking.org ms, Fewer Is Better Mobile Neural Network 3.0 Model: MobileNetV2_224 a b c d e 0.254 0.508 0.762 1.016 1.27 SE +/- 0.010, N = 14 SE +/- 0.042, N = 3 SE +/- 0.008, N = 13 SE +/- 0.012, N = 15 SE +/- 0.009, N = 15 1.114 1.128 1.093 1.129 1.097 MIN: 1.04 / MAX: 9.2 MIN: 1.03 / MAX: 4.41 MIN: 1.03 / MAX: 9.4 MIN: 1.03 / MAX: 10.28 MIN: 1.02 / MAX: 4.83 1. (CXX) g++ options: -std=c++11 -O3 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -pthread -ldl
Mobile Neural Network Model: mobilenet-v1-1.0 OpenBenchmarking.org ms, Fewer Is Better Mobile Neural Network 3.0 Model: mobilenet-v1-1.0 a b c d e 0.2286 0.4572 0.6858 0.9144 1.143 SE +/- 0.004, N = 14 SE +/- 0.005, N = 3 SE +/- 0.004, N = 13 SE +/- 0.006, N = 15 SE +/- 0.002, N = 15 1.016 1.009 1.010 1.014 1.008 MIN: 0.94 / MAX: 10.13 MIN: 0.97 / MAX: 10.35 MIN: 0.98 / MAX: 10.41 MIN: 0.94 / MAX: 11.02 MIN: 0.93 / MAX: 4.99 1. (CXX) g++ options: -std=c++11 -O3 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -pthread -ldl
Mobile Neural Network Model: inception-v3 OpenBenchmarking.org ms, Fewer Is Better Mobile Neural Network 3.0 Model: inception-v3 a b c d e 3 6 9 12 15 SE +/- 0.067, N = 14 SE +/- 0.108, N = 3 SE +/- 0.056, N = 13 SE +/- 0.055, N = 15 SE +/- 0.046, N = 15 9.317 9.323 9.274 9.375 9.309 MIN: 8.41 / MAX: 33.45 MIN: 8.44 / MAX: 33.38 MIN: 8.36 / MAX: 32.72 MIN: 8.44 / MAX: 31.53 MIN: 8.36 / MAX: 34.14 1. (CXX) g++ options: -std=c++11 -O3 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -pthread -ldl
Phoronix Test Suite v10.8.5