testoutputncnn

ARMv8 Cortex-A76 testing on Debian 12 via the Phoronix Test Suite.

Compare your own system(s) to this result file with the Phoronix Test Suite by running the command: phoronix-test-suite benchmark 2406097-NE-2404282NE52
Jump To Table - Results

View

Do Not Show Noisy Results
Do Not Show Results With Incomplete Data
Do Not Show Results With Little Change/Spread
List Notable Results

Statistics

Show Overall Harmonic Mean(s)
Show Overall Geometric Mean
Show Wins / Losses Counts (Pie Chart)
Normalize Results
Remove Outliers Before Calculating Averages

Graph Settings

Force Line Graphs Where Applicable
Convert To Scalar Where Applicable
Prefer Vertical Bar Graphs

Multi-Way Comparison

Condense Multi-Option Tests Into Single Result Graphs

Table

Show Detailed System Result Table

Run Management

Highlight
Result
Hide
Result
Result
Identifier
View Logs
Performance Per
Dollar
Date
Run
  Test
  Duration
1
April 29
  4 Hours, 38 Minutes
ARMv8 Cortex-A76 - - Raspberry Pi 5 Model B Rev 1.0
June 10
  4 Hours, 41 Minutes
Invert Hiding All Results Option
  4 Hours, 39 Minutes
Only show results matching title/arguments (delimit multiple options with a comma):
Do not show results matching title/arguments (delimit multiple options with a comma):


testoutputncnnProcessorMotherboardMemoryDiskNetworkOSKernelOpenGLCompilerFile-System1ARMv8 Cortex-A76 - - Raspberry Pi 5 Model B Rev 1.0ARMv8 Cortex-A76 @ 2.40GHz (4 Cores)Raspberry Pi 5 Model B Rev 1.08GB31GB SD32GDevice 1de4:0001Debian 126.6.28+rpt-rpi-2712 (aarch64)4.5 Mesa 23.2.1-1~bpo12+rpt3 (LLVM 15.0.6 128 bits)GCC 12.2.0ext44096MB6.6.31+rpt-rpi-2712 (aarch64)OpenBenchmarking.orgKernel Details- cfg80211.ieee80211_regdom=USCompiler Details- --build=aarch64-linux-gnu --disable-libquadmath --disable-libquadmath-support --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-fix-cortex-a53-843419 --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-nls --enable-objc-gc=auto --enable-plugin --enable-shared --enable-threads=posix --host=aarch64-linux-gnu --program-prefix=aarch64-linux-gnu- --target=aarch64-linux-gnu --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-target-system-zlib=auto -v Processor Details- Scaling Governor: cpufreq-dt ondemandSecurity Details- 1: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + reg_file_data_sampling: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Not affected + spectre_v1: Mitigation of __user pointer sanitization + spectre_v2: Mitigation of CSV2 but not BHB + srbds: Not affected + tsx_async_abort: Not affected - ARMv8 Cortex-A76 - - Raspberry Pi 5 Model B Rev 1.0: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + reg_file_data_sampling: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of __user pointer sanitization + spectre_v2: Mitigation of CSV2 BHB + srbds: Not affected + tsx_async_abort: Not affected

1 vs. ARMv8 Cortex-A76 - - Raspberry Pi 5 Model B Rev 1.0 ComparisonPhoronix Test SuiteBaseline+3.5%+3.5%+7%+7%+10.5%+10.5%14%10.1%9.6%8.5%7.8%7.8%7.7%7.4%7.3%7.2%7%6.7%6.3%2.6%2.1%Vulkan GPU - vgg16Vulkan GPU-v2-v2 - mobilenet-v2Vulkan GPU - squeezenet_ssdVulkan GPU - yolov4-tinyVulkan GPU - resnet50Vulkan GPU - googlenetVulkan GPU-v3-v3 - mobilenet-v3Vulkan GPU - efficientnet-b0Vulkan GPU - mnasnetVulkan GPU - FastestDetVulkan GPU - mobilenetVulkan GPU - resnet18Vulkan GPU - alexnetVulkan GPU - blazefaceVulkan GPU - regnety_400mNCNNNCNNNCNNNCNNNCNNNCNNNCNNNCNNNCNNNCNNNCNNNCNNNCNNNCNNNCNN1ARMv8 Cortex-A76 - - Raspberry Pi 5 Model B Rev 1.0

testoutputncnnncnn: Vulkan GPU - mobilenetncnn: Vulkan GPU-v2-v2 - mobilenet-v2ncnn: Vulkan GPU-v3-v3 - mobilenet-v3ncnn: Vulkan GPU - shufflenet-v2ncnn: Vulkan GPU - mnasnetncnn: Vulkan GPU - efficientnet-b0ncnn: Vulkan GPU - blazefacencnn: Vulkan GPU - googlenetncnn: Vulkan GPU - vgg16ncnn: Vulkan GPU - resnet18ncnn: Vulkan GPU - alexnetncnn: Vulkan GPU - resnet50ncnn: Vulkan GPU - yolov4-tinyncnn: Vulkan GPU - squeezenet_ssdncnn: Vulkan GPU - regnety_400mncnn: Vulkan GPU - vision_transformerncnn: Vulkan GPU - FastestDetncnn: Vulkan GPUv2-yolov3v2-yolov3 - mobilenetv2-yolov31ARMv8 Cortex-A76 - - Raspberry Pi 5 Model B Rev 1.043.8912.398.763.348.1314.241.631.06155.1722.3824.7952.5552.7238.3710.56600.405.5441.0311.258.133.307.5813.261.5628.82136.0820.9823.3248.7348.5835.0110.34598.135.1741.03OpenBenchmarking.org

NCNN

NCNN is a high performance neural network inference framework optimized for mobile and other platforms developed by Tencent. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: Vulkan GPU - Model: mobilenet1ARMv8 Cortex-A76 - - Raspberry Pi 5 Model B Rev 1.01020304050SE +/- 0.14, N = 3SE +/- 0.16, N = 343.8941.03MIN: 42.94 / MAX: 80.12MIN: 40.31 / MAX: 77.211. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: Vulkan GPU - Model: mobilenet1ARMv8 Cortex-A76 - - Raspberry Pi 5 Model B Rev 1.0918273645Min: 43.75 / Avg: 43.89 / Max: 44.16Min: 40.79 / Avg: 41.03 / Max: 41.321. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: Vulkan GPU-v2-v2 - Model: mobilenet-v21ARMv8 Cortex-A76 - - Raspberry Pi 5 Model B Rev 1.03691215SE +/- 0.06, N = 3SE +/- 0.10, N = 312.3911.25MIN: 11.98 / MAX: 24.92MIN: 10.81 / MAX: 18.31. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: Vulkan GPU-v2-v2 - Model: mobilenet-v21ARMv8 Cortex-A76 - - Raspberry Pi 5 Model B Rev 1.048121620Min: 12.3 / Avg: 12.39 / Max: 12.51Min: 11.06 / Avg: 11.25 / Max: 11.421. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: Vulkan GPU-v3-v3 - Model: mobilenet-v31ARMv8 Cortex-A76 - - Raspberry Pi 5 Model B Rev 1.0246810SE +/- 0.01, N = 3SE +/- 0.02, N = 38.768.13MIN: 8.49 / MAX: 18.08MIN: 7.86 / MAX: 40.211. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: Vulkan GPU-v3-v3 - Model: mobilenet-v31ARMv8 Cortex-A76 - - Raspberry Pi 5 Model B Rev 1.03691215Min: 8.74 / Avg: 8.76 / Max: 8.78Min: 8.11 / Avg: 8.13 / Max: 8.171. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: Vulkan GPU - Model: shufflenet-v21ARMv8 Cortex-A76 - - Raspberry Pi 5 Model B Rev 1.00.75151.5032.25453.0063.7575SE +/- 0.00, N = 3SE +/- 0.01, N = 33.343.30MIN: 3.29 / MAX: 4.41MIN: 3.25 / MAX: 3.91. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: Vulkan GPU - Model: shufflenet-v21ARMv8 Cortex-A76 - - Raspberry Pi 5 Model B Rev 1.0246810Min: 3.34 / Avg: 3.34 / Max: 3.35Min: 3.29 / Avg: 3.3 / Max: 3.311. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: Vulkan GPU - Model: mnasnet1ARMv8 Cortex-A76 - - Raspberry Pi 5 Model B Rev 1.0246810SE +/- 0.03, N = 3SE +/- 0.06, N = 38.137.58MIN: 7.74 / MAX: 16.69MIN: 7.27 / MAX: 33.091. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: Vulkan GPU - Model: mnasnet1ARMv8 Cortex-A76 - - Raspberry Pi 5 Model B Rev 1.03691215Min: 8.08 / Avg: 8.13 / Max: 8.17Min: 7.49 / Avg: 7.58 / Max: 7.71. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: Vulkan GPU - Model: efficientnet-b01ARMv8 Cortex-A76 - - Raspberry Pi 5 Model B Rev 1.048121620SE +/- 0.06, N = 3SE +/- 0.13, N = 314.2413.26MIN: 13.8 / MAX: 53.63MIN: 12.8 / MAX: 34.051. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: Vulkan GPU - Model: efficientnet-b01ARMv8 Cortex-A76 - - Raspberry Pi 5 Model B Rev 1.048121620Min: 14.12 / Avg: 14.24 / Max: 14.32Min: 13.01 / Avg: 13.26 / Max: 13.471. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: Vulkan GPU - Model: blazeface1ARMv8 Cortex-A76 - - Raspberry Pi 5 Model B Rev 1.00.360.721.081.441.8SE +/- 0.00, N = 3SE +/- 0.01, N = 31.601.56MIN: 1.52 / MAX: 10.2MIN: 1.52 / MAX: 1.981. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: Vulkan GPU - Model: blazeface1ARMv8 Cortex-A76 - - Raspberry Pi 5 Model B Rev 1.0246810Min: 1.6 / Avg: 1.6 / Max: 1.6Min: 1.55 / Avg: 1.56 / Max: 1.591. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: Vulkan GPU - Model: googlenet1ARMv8 Cortex-A76 - - Raspberry Pi 5 Model B Rev 1.0714212835SE +/- 0.21, N = 3SE +/- 0.18, N = 331.0628.82MIN: 30.13 / MAX: 62.25MIN: 27.94 / MAX: 61.361. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: Vulkan GPU - Model: googlenet1ARMv8 Cortex-A76 - - Raspberry Pi 5 Model B Rev 1.0714212835Min: 30.79 / Avg: 31.06 / Max: 31.46Min: 28.52 / Avg: 28.82 / Max: 29.141. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: Vulkan GPU - Model: vgg161ARMv8 Cortex-A76 - - Raspberry Pi 5 Model B Rev 1.0306090120150SE +/- 0.11, N = 3SE +/- 0.57, N = 3155.17136.08MIN: 151.67 / MAX: 190.11MIN: 132.28 / MAX: 172.421. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: Vulkan GPU - Model: vgg161ARMv8 Cortex-A76 - - Raspberry Pi 5 Model B Rev 1.0306090120150Min: 154.99 / Avg: 155.17 / Max: 155.37Min: 135.04 / Avg: 136.08 / Max: 137.011. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: Vulkan GPU - Model: resnet181ARMv8 Cortex-A76 - - Raspberry Pi 5 Model B Rev 1.0510152025SE +/- 0.13, N = 3SE +/- 0.03, N = 322.3820.98MIN: 21.66 / MAX: 31.23MIN: 20.39 / MAX: 35.461. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: Vulkan GPU - Model: resnet181ARMv8 Cortex-A76 - - Raspberry Pi 5 Model B Rev 1.0510152025Min: 22.12 / Avg: 22.38 / Max: 22.54Min: 20.92 / Avg: 20.98 / Max: 21.021. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: Vulkan GPU - Model: alexnet1ARMv8 Cortex-A76 - - Raspberry Pi 5 Model B Rev 1.0612182430SE +/- 0.04, N = 3SE +/- 0.09, N = 324.7923.32MIN: 24.28 / MAX: 37.29MIN: 22.67 / MAX: 53.591. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: Vulkan GPU - Model: alexnet1ARMv8 Cortex-A76 - - Raspberry Pi 5 Model B Rev 1.0612182430Min: 24.74 / Avg: 24.79 / Max: 24.87Min: 23.18 / Avg: 23.32 / Max: 23.491. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: Vulkan GPU - Model: resnet501ARMv8 Cortex-A76 - - Raspberry Pi 5 Model B Rev 1.01224364860SE +/- 0.13, N = 3SE +/- 0.32, N = 352.5548.73MIN: 51.41 / MAX: 93.48MIN: 47.39 / MAX: 87.541. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: Vulkan GPU - Model: resnet501ARMv8 Cortex-A76 - - Raspberry Pi 5 Model B Rev 1.01122334455Min: 52.3 / Avg: 52.55 / Max: 52.7Min: 48.1 / Avg: 48.73 / Max: 49.111. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: Vulkan GPU - Model: yolov4-tiny1ARMv8 Cortex-A76 - - Raspberry Pi 5 Model B Rev 1.01224364860SE +/- 0.07, N = 3SE +/- 0.31, N = 352.7248.58MIN: 51.92 / MAX: 86.56MIN: 47.56 / MAX: 85.361. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: Vulkan GPU - Model: yolov4-tiny1ARMv8 Cortex-A76 - - Raspberry Pi 5 Model B Rev 1.01122334455Min: 52.61 / Avg: 52.72 / Max: 52.85Min: 48.23 / Avg: 48.58 / Max: 49.21. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: Vulkan GPU - Model: squeezenet_ssd1ARMv8 Cortex-A76 - - Raspberry Pi 5 Model B Rev 1.0918273645SE +/- 0.10, N = 3SE +/- 0.16, N = 338.3735.01MIN: 37.76 / MAX: 45.63MIN: 34.15 / MAX: 72.641. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: Vulkan GPU - Model: squeezenet_ssd1ARMv8 Cortex-A76 - - Raspberry Pi 5 Model B Rev 1.0816243240Min: 38.18 / Avg: 38.37 / Max: 38.54Min: 34.71 / Avg: 35.01 / Max: 35.271. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: Vulkan GPU - Model: regnety_400m1ARMv8 Cortex-A76 - - Raspberry Pi 5 Model B Rev 1.03691215SE +/- 0.04, N = 3SE +/- 0.07, N = 310.5610.34MIN: 10.31 / MAX: 22.07MIN: 10.05 / MAX: 37.41. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: Vulkan GPU - Model: regnety_400m1ARMv8 Cortex-A76 - - Raspberry Pi 5 Model B Rev 1.03691215Min: 10.49 / Avg: 10.56 / Max: 10.62Min: 10.23 / Avg: 10.34 / Max: 10.481. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: Vulkan GPU - Model: vision_transformer1ARMv8 Cortex-A76 - - Raspberry Pi 5 Model B Rev 1.0130260390520650SE +/- 1.09, N = 3SE +/- 3.62, N = 3600.40598.13MIN: 573.15 / MAX: 645.75MIN: 563.05 / MAX: 652.351. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: Vulkan GPU - Model: vision_transformer1ARMv8 Cortex-A76 - - Raspberry Pi 5 Model B Rev 1.0110220330440550Min: 599.22 / Avg: 600.4 / Max: 602.57Min: 593.94 / Avg: 598.13 / Max: 605.341. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: Vulkan GPU - Model: FastestDet1ARMv8 Cortex-A76 - - Raspberry Pi 5 Model B Rev 1.01.24652.4933.73954.9866.2325SE +/- 0.07, N = 3SE +/- 0.05, N = 35.545.17MIN: 5.28 / MAX: 14.64MIN: 4.89 / MAX: 6.041. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: Vulkan GPU - Model: FastestDet1ARMv8 Cortex-A76 - - Raspberry Pi 5 Model B Rev 1.0246810Min: 5.4 / Avg: 5.54 / Max: 5.62Min: 5.08 / Avg: 5.17 / Max: 5.251. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: Vulkan GPUv2-yolov3v2-yolov3 - Model: mobilenetv2-yolov3ARMv8 Cortex-A76 - - Raspberry Pi 5 Model B Rev 1.0918273645SE +/- 0.16, N = 341.03MIN: 40.31 / MAX: 77.211. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread