mnn grace

ARMv8 Neoverse-V2 testing with a Pegatron JIMBO P4352 (00022432 BIOS) and ASPEED on Ubuntu 24.04 via the Phoronix Test Suite.

HTML result view exported from: https://openbenchmarking.org/result/2411187-NE-MNNGRACE721&sor&grs.

mnn graceProcessorMotherboardMemoryDiskGraphicsNetworkOSKernelCompilerFile-SystemScreen ResolutionabcdARMv8 Neoverse-V2 @ 3.47GHz (72 Cores)Pegatron JIMBO P4352 (00022432 BIOS)1 x 480GB LPDDR5-6400MT/s NVIDIA 699-2G530-0236-RC11000GB CT1000T700SSD3ASPEED2 x Intel X550Ubuntu 24.046.8.0-48-generic-64k (aarch64)GCC 13.2.0 + Clang 18.1.3 + CUDA 11.8ext41920x1200OpenBenchmarking.orgKernel Details- Transparent Huge Pages: madviseCompiler Details- --build=aarch64-linux-gnu --disable-libquadmath --disable-libquadmath-support --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-fix-cortex-a53-843419 --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-backtrace --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-nls --enable-objc-gc=auto --enable-offload-defaulted --enable-offload-targets=nvptx-none=/build/gcc-13-dIwDw0/gcc-13-13.2.0/debian/tmp-nvptx/usr --enable-plugin --enable-shared --enable-threads=posix --host=aarch64-linux-gnu --program-prefix=aarch64-linux-gnu- --target=aarch64-linux-gnu --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-target-system-zlib=auto --without-cuda-driver -v Processor Details- Scaling Governor: cppc_cpufreq ondemand (Boost: Disabled)Security Details- gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + reg_file_data_sampling: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of __user pointer sanitization + spectre_v2: Not affected + srbds: Not affected + tsx_async_abort: Not affected

mnn gracemnn: mobilenetV3mnn: resnet-v2-50mnn: SqueezeNetV1.0mnn: squeezenetv1.1mnn: MobileNetV2_224mnn: mobilenet-v1-1.0mnn: nasnetmnn: inception-v3abcd0.8646.1491.7820.9791.0161.0563.9697.6650.8766.0711.7920.9761.0051.0523.9907.7050.8776.0281.7630.9741.0171.0533.9937.6830.8876.1771.7850.9891.0131.0473.9627.700OpenBenchmarking.org

Mobile Neural Network

Model: mobilenetV3

OpenBenchmarking.orgms, Fewer Is BetterMobile Neural Network 3.0Model: mobilenetV3abcd0.19960.39920.59880.79840.998SE +/- 0.002, N = 3SE +/- 0.009, N = 3SE +/- 0.009, N = 3SE +/- 0.006, N = 30.8640.8760.8770.887MIN: 0.65 / MAX: 6.93MIN: 0.65 / MAX: 5.53MIN: 0.63 / MAX: 6.08MIN: 0.66 / MAX: 5.751. (CXX) g++ options: -std=c++11 -O3 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -pthread -ldl

Mobile Neural Network

Model: resnet-v2-50

OpenBenchmarking.orgms, Fewer Is BetterMobile Neural Network 3.0Model: resnet-v2-50cbad246810SE +/- 0.089, N = 3SE +/- 0.050, N = 3SE +/- 0.055, N = 3SE +/- 0.024, N = 36.0286.0716.1496.177MIN: 4.68 / MAX: 29.94MIN: 4.7 / MAX: 27.38MIN: 4.69 / MAX: 32.49MIN: 4.69 / MAX: 35.21. (CXX) g++ options: -std=c++11 -O3 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -pthread -ldl

Mobile Neural Network

Model: SqueezeNetV1.0

OpenBenchmarking.orgms, Fewer Is BetterMobile Neural Network 3.0Model: SqueezeNetV1.0cadb0.40320.80641.20961.61282.016SE +/- 0.004, N = 3SE +/- 0.011, N = 3SE +/- 0.008, N = 3SE +/- 0.010, N = 31.7631.7821.7851.792MIN: 1.46 / MAX: 14.99MIN: 1.46 / MAX: 15.59MIN: 1.45 / MAX: 16.64MIN: 1.46 / MAX: 19.471. (CXX) g++ options: -std=c++11 -O3 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -pthread -ldl

Mobile Neural Network

Model: squeezenetv1.1

OpenBenchmarking.orgms, Fewer Is BetterMobile Neural Network 3.0Model: squeezenetv1.1cbad0.22250.4450.66750.891.1125SE +/- 0.004, N = 3SE +/- 0.001, N = 3SE +/- 0.005, N = 3SE +/- 0.008, N = 30.9740.9760.9790.989MIN: 0.81 / MAX: 6.66MIN: 0.83 / MAX: 6.74MIN: 0.84 / MAX: 6.91MIN: 0.84 / MAX: 6.611. (CXX) g++ options: -std=c++11 -O3 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -pthread -ldl

Mobile Neural Network

Model: MobileNetV2_224

OpenBenchmarking.orgms, Fewer Is BetterMobile Neural Network 3.0Model: MobileNetV2_224bdac0.22880.45760.68640.91521.144SE +/- 0.007, N = 3SE +/- 0.003, N = 3SE +/- 0.006, N = 3SE +/- 0.002, N = 31.0051.0131.0161.017MIN: 0.88 / MAX: 4.83MIN: 0.87 / MAX: 7.36MIN: 0.89 / MAX: 12.27MIN: 0.89 / MAX: 12.181. (CXX) g++ options: -std=c++11 -O3 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -pthread -ldl

Mobile Neural Network

Model: mobilenet-v1-1.0

OpenBenchmarking.orgms, Fewer Is BetterMobile Neural Network 3.0Model: mobilenet-v1-1.0dbca0.23760.47520.71280.95041.188SE +/- 0.002, N = 3SE +/- 0.003, N = 3SE +/- 0.003, N = 3SE +/- 0.003, N = 31.0471.0521.0531.056MIN: 0.94 / MAX: 5.16MIN: 0.94 / MAX: 14.01MIN: 0.94 / MAX: 8.22MIN: 0.94 / MAX: 5.161. (CXX) g++ options: -std=c++11 -O3 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -pthread -ldl

Mobile Neural Network

Model: nasnet

OpenBenchmarking.orgms, Fewer Is BetterMobile Neural Network 3.0Model: nasnetdabc0.89841.79682.69523.59364.492SE +/- 0.007, N = 3SE +/- 0.012, N = 3SE +/- 0.013, N = 3SE +/- 0.014, N = 33.9623.9693.9903.993MIN: 3.62 / MAX: 16.35MIN: 3.64 / MAX: 12.2MIN: 3.63 / MAX: 14.43MIN: 3.65 / MAX: 20.641. (CXX) g++ options: -std=c++11 -O3 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -pthread -ldl

Mobile Neural Network

Model: inception-v3

OpenBenchmarking.orgms, Fewer Is BetterMobile Neural Network 3.0Model: inception-v3acdb246810SE +/- 0.023, N = 3SE +/- 0.087, N = 3SE +/- 0.097, N = 3SE +/- 0.107, N = 37.6657.6837.7007.705MIN: 6.64 / MAX: 34.07MIN: 6.65 / MAX: 38.24MIN: 6.64 / MAX: 36.48MIN: 6.57 / MAX: 35.961. (CXX) g++ options: -std=c++11 -O3 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -pthread -ldl

Phoronix Test Suite v10.8.5