mnn grace

ARMv8 Neoverse-V2 testing with a Pegatron JIMBO P4352 (00022432 BIOS) and ASPEED on Ubuntu 24.04 via the Phoronix Test Suite.

HTML result view exported from: https://openbenchmarking.org/result/2411187-NE-MNNGRACE721&sro.

mnn graceProcessorMotherboardMemoryDiskGraphicsNetworkOSKernelCompilerFile-SystemScreen ResolutionabcdARMv8 Neoverse-V2 @ 3.47GHz (72 Cores)Pegatron JIMBO P4352 (00022432 BIOS)1 x 480GB LPDDR5-6400MT/s NVIDIA 699-2G530-0236-RC11000GB CT1000T700SSD3ASPEED2 x Intel X550Ubuntu 24.046.8.0-48-generic-64k (aarch64)GCC 13.2.0 + Clang 18.1.3 + CUDA 11.8ext41920x1200OpenBenchmarking.orgKernel Details- Transparent Huge Pages: madviseCompiler Details- --build=aarch64-linux-gnu --disable-libquadmath --disable-libquadmath-support --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-fix-cortex-a53-843419 --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-backtrace --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-nls --enable-objc-gc=auto --enable-offload-defaulted --enable-offload-targets=nvptx-none=/build/gcc-13-dIwDw0/gcc-13-13.2.0/debian/tmp-nvptx/usr --enable-plugin --enable-shared --enable-threads=posix --host=aarch64-linux-gnu --program-prefix=aarch64-linux-gnu- --target=aarch64-linux-gnu --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-target-system-zlib=auto --without-cuda-driver -v Processor Details- Scaling Governor: cppc_cpufreq ondemand (Boost: Disabled)Security Details- gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + reg_file_data_sampling: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of __user pointer sanitization + spectre_v2: Not affected + srbds: Not affected + tsx_async_abort: Not affected

mnn gracemnn: nasnetmnn: mobilenetV3mnn: squeezenetv1.1mnn: resnet-v2-50mnn: SqueezeNetV1.0mnn: MobileNetV2_224mnn: mobilenet-v1-1.0mnn: inception-v3abcd3.9690.8640.9796.1491.7821.0161.0567.6653.9900.8760.9766.0711.7921.0051.0527.7053.9930.8770.9746.0281.7631.0171.0537.6833.9620.8870.9896.1771.7851.0131.0477.700OpenBenchmarking.org

Mobile Neural Network

Model: nasnet

OpenBenchmarking.orgms, Fewer Is BetterMobile Neural Network 3.0Model: nasnetabcd0.89841.79682.69523.59364.492SE +/- 0.012, N = 3SE +/- 0.013, N = 3SE +/- 0.014, N = 3SE +/- 0.007, N = 33.9693.9903.9933.962MIN: 3.64 / MAX: 12.2MIN: 3.63 / MAX: 14.43MIN: 3.65 / MAX: 20.64MIN: 3.62 / MAX: 16.351. (CXX) g++ options: -std=c++11 -O3 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -pthread -ldl

Mobile Neural Network

Model: mobilenetV3

OpenBenchmarking.orgms, Fewer Is BetterMobile Neural Network 3.0Model: mobilenetV3abcd0.19960.39920.59880.79840.998SE +/- 0.002, N = 3SE +/- 0.009, N = 3SE +/- 0.009, N = 3SE +/- 0.006, N = 30.8640.8760.8770.887MIN: 0.65 / MAX: 6.93MIN: 0.65 / MAX: 5.53MIN: 0.63 / MAX: 6.08MIN: 0.66 / MAX: 5.751. (CXX) g++ options: -std=c++11 -O3 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -pthread -ldl

Mobile Neural Network

Model: squeezenetv1.1

OpenBenchmarking.orgms, Fewer Is BetterMobile Neural Network 3.0Model: squeezenetv1.1abcd0.22250.4450.66750.891.1125SE +/- 0.005, N = 3SE +/- 0.001, N = 3SE +/- 0.004, N = 3SE +/- 0.008, N = 30.9790.9760.9740.989MIN: 0.84 / MAX: 6.91MIN: 0.83 / MAX: 6.74MIN: 0.81 / MAX: 6.66MIN: 0.84 / MAX: 6.611. (CXX) g++ options: -std=c++11 -O3 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -pthread -ldl

Mobile Neural Network

Model: resnet-v2-50

OpenBenchmarking.orgms, Fewer Is BetterMobile Neural Network 3.0Model: resnet-v2-50abcd246810SE +/- 0.055, N = 3SE +/- 0.050, N = 3SE +/- 0.089, N = 3SE +/- 0.024, N = 36.1496.0716.0286.177MIN: 4.69 / MAX: 32.49MIN: 4.7 / MAX: 27.38MIN: 4.68 / MAX: 29.94MIN: 4.69 / MAX: 35.21. (CXX) g++ options: -std=c++11 -O3 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -pthread -ldl

Mobile Neural Network

Model: SqueezeNetV1.0

OpenBenchmarking.orgms, Fewer Is BetterMobile Neural Network 3.0Model: SqueezeNetV1.0abcd0.40320.80641.20961.61282.016SE +/- 0.011, N = 3SE +/- 0.010, N = 3SE +/- 0.004, N = 3SE +/- 0.008, N = 31.7821.7921.7631.785MIN: 1.46 / MAX: 15.59MIN: 1.46 / MAX: 19.47MIN: 1.46 / MAX: 14.99MIN: 1.45 / MAX: 16.641. (CXX) g++ options: -std=c++11 -O3 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -pthread -ldl

Mobile Neural Network

Model: MobileNetV2_224

OpenBenchmarking.orgms, Fewer Is BetterMobile Neural Network 3.0Model: MobileNetV2_224abcd0.22880.45760.68640.91521.144SE +/- 0.006, N = 3SE +/- 0.007, N = 3SE +/- 0.002, N = 3SE +/- 0.003, N = 31.0161.0051.0171.013MIN: 0.89 / MAX: 12.27MIN: 0.88 / MAX: 4.83MIN: 0.89 / MAX: 12.18MIN: 0.87 / MAX: 7.361. (CXX) g++ options: -std=c++11 -O3 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -pthread -ldl

Mobile Neural Network

Model: mobilenet-v1-1.0

OpenBenchmarking.orgms, Fewer Is BetterMobile Neural Network 3.0Model: mobilenet-v1-1.0abcd0.23760.47520.71280.95041.188SE +/- 0.003, N = 3SE +/- 0.003, N = 3SE +/- 0.003, N = 3SE +/- 0.002, N = 31.0561.0521.0531.047MIN: 0.94 / MAX: 5.16MIN: 0.94 / MAX: 14.01MIN: 0.94 / MAX: 8.22MIN: 0.94 / MAX: 5.161. (CXX) g++ options: -std=c++11 -O3 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -pthread -ldl

Mobile Neural Network

Model: inception-v3

OpenBenchmarking.orgms, Fewer Is BetterMobile Neural Network 3.0Model: inception-v3abcd246810SE +/- 0.023, N = 3SE +/- 0.107, N = 3SE +/- 0.087, N = 3SE +/- 0.097, N = 37.6657.7057.6837.700MIN: 6.64 / MAX: 34.07MIN: 6.57 / MAX: 35.96MIN: 6.65 / MAX: 38.24MIN: 6.64 / MAX: 36.481. (CXX) g++ options: -std=c++11 -O3 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -pthread -ldl

Phoronix Test Suite v10.8.5