mnn ncnn zen 1 epyc

AMD EPYC 7551 32-Core testing with a GIGABYTE MZ31-AR0-00 v01010101 (F10 BIOS) and ASPEED on Debian 11 via the Phoronix Test Suite.

Compare your own system(s) to this result file with the Phoronix Test Suite by running the command: phoronix-test-suite benchmark 2208156-NE-MNNNCNNZE48
Jump To Table - Results

View

Do Not Show Noisy Results
Do Not Show Results With Incomplete Data
Do Not Show Results With Little Change/Spread
List Notable Results

Limit displaying results to tests within:

HPC - High Performance Computing 2 Tests
Machine Learning 2 Tests

Statistics

Show Overall Harmonic Mean(s)
Show Overall Geometric Mean
Show Geometric Means Per-Suite/Category
Show Wins / Losses Counts (Pie Chart)
Normalize Results
Remove Outliers Before Calculating Averages

Graph Settings

Force Line Graphs Where Applicable
Convert To Scalar Where Applicable
Prefer Vertical Bar Graphs

Multi-Way Comparison

Condense Multi-Option Tests Into Single Result Graphs

Table

Show Detailed System Result Table

Run Management

Highlight
Result
Hide
Result
Result
Identifier
View Logs
Performance Per
Dollar
Date
Run
  Test
  Duration
A
August 15
  19 Hours, 22 Minutes
B
August 15
  21 Hours, 6 Minutes
C
August 15
  21 Hours, 3 Minutes
Invert Hiding All Results Option
  20 Hours, 30 Minutes

Only show results where is faster than
Only show results matching title/arguments (delimit multiple options with a comma):


mnn ncnn zen 1 epycOpenBenchmarking.orgPhoronix Test Suite 10.8.4AMD EPYC 7551 32-Core @ 2.00GHz (32 Cores / 64 Threads)GIGABYTE MZ31-AR0-00 v01010101 (F10 BIOS)AMD 17h8 x 4 GB DDR4-2133MT/s 9ASF51272PZ-2G6E1Samsung SSD 960 EVO 500GBASPEEDRealtek RTL8111/8168/8411 + 2 x Broadcom NetXtreme II BCM57810 10Debian 115.10.0-9-amd64 (x86_64)GCC 10.2.1 20210110ext41024x768ProcessorMotherboardChipsetMemoryDiskGraphicsNetworkOSKernelCompilerFile-SystemScreen ResolutionMnn Ncnn Zen 1 Epyc BenchmarksSystem Logs- Transparent Huge Pages: always- --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-bootstrap --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-link-mutex --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none=/build/gcc-10-Km9U7s/gcc-10-10.2.1/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-10-Km9U7s/gcc-10-10.2.1/debian/tmp-gcn/usr,hsa --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-build-config=bootstrap-lto-lean --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v - Scaling Governor: acpi-cpufreq schedutil (Boost: Enabled) - CPU Microcode: 0x8001227- itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Full AMD retpoline IBPB: conditional STIBP: disabled RSB filling + srbds: Not affected + tsx_async_abort: Not affected

ABCResult OverviewPhoronix Test Suite 10.8.4100%107%114%120%NCNNNCNNNCNNMobile Neural NetworkMobile Neural NetworkNCNNNCNNNCNNNCNNNCNNMobile Neural NetworkNCNNNCNNNCNNMobile Neural NetworkNCNNNCNNNCNNNCNNMobile Neural NetworkNCNNMobile Neural NetworkMobile Neural NetworkNCNNCPU - blazefaceCPU - mnasnetCPU - resnet50MobileNetV2_224mobilenetV3CPU - yolov4-tinyCPU - resnet18CPU-v2-v2 - mobilenet-v2CPU - googlenetCPU - mobilenetresnet-v2-50CPU - shufflenet-v2CPU - efficientnet-b0CPU-v3-v3 - mobilenet-v3mobilenet-v1-1.0CPU - FastestDetCPU - squeezenet_ssdCPU - vgg16CPU - regnety_400msqueezenetv1.1CPU - alexnetinception-v3SqueezeNetV1.0CPU - vision_transformer

mnn ncnn zen 1 epycmnn: mobilenetV3mnn: squeezenetv1.1mnn: resnet-v2-50mnn: SqueezeNetV1.0mnn: MobileNetV2_224mnn: mobilenet-v1-1.0mnn: inception-v3ncnn: CPU - mobilenetncnn: CPU-v2-v2 - mobilenet-v2ncnn: CPU-v3-v3 - mobilenet-v3ncnn: CPU - shufflenet-v2ncnn: CPU - mnasnetncnn: CPU - efficientnet-b0ncnn: CPU - blazefacencnn: CPU - googlenetncnn: CPU - vgg16ncnn: CPU - resnet18ncnn: CPU - alexnetncnn: CPU - resnet50ncnn: CPU - yolov4-tinyncnn: CPU - squeezenet_ssdncnn: CPU - regnety_400mncnn: CPU - vision_transformerncnn: CPU - FastestDetABC5.2819.15752.38014.09010.0488.34159.58945.0024.0421.6029.1622.3733.1912.2859.4194.4745.4241.3671.3463.2860.88103.41353.6832.285.4649.00954.15213.9838.5958.11957.84741.5224.6323.5126.6122.0734.6514.4753.8298.9945.6540.9477.6155.4856.8096.94352.3632.756.0709.51657.82614.4929.8988.78359.95545.8827.0522.3527.0726.2931.8011.3853.2492.7040.3942.4765.4160.0658.65100.75350.5830.45OpenBenchmarking.org

Mobile Neural Network

OpenBenchmarking.orgms, Fewer Is BetterMobile Neural Network 2.0Model: mobilenetV3ABC246810SE +/- 0.074, N = 5SE +/- 0.230, N = 9SE +/- 0.285, N = 95.2815.4646.070MIN: 5 / MAX: 10.66MIN: 4.57 / MAX: 11.22MIN: 4.96 / MAX: 9.81. (CXX) g++ options: -std=c++11 -O3 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl
OpenBenchmarking.orgms, Fewer Is BetterMobile Neural Network 2.0Model: mobilenetV3ABC246810Min: 5.06 / Avg: 5.28 / Max: 5.49Min: 4.83 / Avg: 5.46 / Max: 6.71Min: 5.03 / Avg: 6.07 / Max: 7.021. (CXX) g++ options: -std=c++11 -O3 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl

OpenBenchmarking.orgms, Fewer Is BetterMobile Neural Network 2.0Model: squeezenetv1.1ABC3691215SE +/- 0.160, N = 5SE +/- 0.283, N = 9SE +/- 0.364, N = 99.1579.0099.516MIN: 8.54 / MAX: 14.69MIN: 7.68 / MAX: 15.21MIN: 8.27 / MAX: 17.731. (CXX) g++ options: -std=c++11 -O3 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl
OpenBenchmarking.orgms, Fewer Is BetterMobile Neural Network 2.0Model: squeezenetv1.1ABC3691215Min: 8.73 / Avg: 9.16 / Max: 9.7Min: 7.97 / Avg: 9.01 / Max: 10.97Min: 8.37 / Avg: 9.52 / Max: 11.441. (CXX) g++ options: -std=c++11 -O3 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl

OpenBenchmarking.orgms, Fewer Is BetterMobile Neural Network 2.0Model: resnet-v2-50ABC1326395265SE +/- 1.12, N = 5SE +/- 2.76, N = 9SE +/- 2.46, N = 952.3854.1557.83MIN: 47.96 / MAX: 141.5MIN: 47.92 / MAX: 164.33MIN: 50.22 / MAX: 132.711. (CXX) g++ options: -std=c++11 -O3 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl
OpenBenchmarking.orgms, Fewer Is BetterMobile Neural Network 2.0Model: resnet-v2-50ABC1122334455Min: 49.08 / Avg: 52.38 / Max: 55.71Min: 48.75 / Avg: 54.15 / Max: 75.81Min: 51.6 / Avg: 57.83 / Max: 71.771. (CXX) g++ options: -std=c++11 -O3 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl

OpenBenchmarking.orgms, Fewer Is BetterMobile Neural Network 2.0Model: SqueezeNetV1.0ABC48121620SE +/- 0.32, N = 5SE +/- 0.36, N = 9SE +/- 0.35, N = 914.0913.9814.49MIN: 12.99 / MAX: 16.82MIN: 12.79 / MAX: 21.34MIN: 12.97 / MAX: 21.041. (CXX) g++ options: -std=c++11 -O3 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl
OpenBenchmarking.orgms, Fewer Is BetterMobile Neural Network 2.0Model: SqueezeNetV1.0ABC48121620Min: 13.39 / Avg: 14.09 / Max: 15.28Min: 12.96 / Avg: 13.98 / Max: 16.73Min: 13.2 / Avg: 14.49 / Max: 16.411. (CXX) g++ options: -std=c++11 -O3 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl

OpenBenchmarking.orgms, Fewer Is BetterMobile Neural Network 2.0Model: MobileNetV2_224ABC3691215SE +/- 0.209, N = 5SE +/- 0.066, N = 9SE +/- 0.196, N = 910.0488.5959.898MIN: 8.59 / MAX: 32.81MIN: 7.48 / MAX: 39.13MIN: 8.56 / MAX: 34.581. (CXX) g++ options: -std=c++11 -O3 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl
OpenBenchmarking.orgms, Fewer Is BetterMobile Neural Network 2.0Model: MobileNetV2_224ABC3691215Min: 9.62 / Avg: 10.05 / Max: 10.75Min: 8.25 / Avg: 8.6 / Max: 8.95Min: 9.24 / Avg: 9.9 / Max: 11.051. (CXX) g++ options: -std=c++11 -O3 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl

OpenBenchmarking.orgms, Fewer Is BetterMobile Neural Network 2.0Model: mobilenet-v1-1.0ABC246810SE +/- 0.583, N = 5SE +/- 0.478, N = 9SE +/- 0.610, N = 98.3418.1198.783MIN: 7.04 / MAX: 16.49MIN: 7.14 / MAX: 17.24MIN: 6.3 / MAX: 16.91. (CXX) g++ options: -std=c++11 -O3 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl
OpenBenchmarking.orgms, Fewer Is BetterMobile Neural Network 2.0Model: mobilenet-v1-1.0ABC3691215Min: 7.2 / Avg: 8.34 / Max: 9.79Min: 7.33 / Avg: 8.12 / Max: 11.9Min: 6.9 / Avg: 8.78 / Max: 11.661. (CXX) g++ options: -std=c++11 -O3 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl

OpenBenchmarking.orgms, Fewer Is BetterMobile Neural Network 2.0Model: inception-v3ABC1326395265SE +/- 2.14, N = 5SE +/- 3.36, N = 9SE +/- 2.98, N = 959.5957.8559.96MIN: 54.7 / MAX: 74.6MIN: 51.06 / MAX: 261.45MIN: 51.78 / MAX: 271.461. (CXX) g++ options: -std=c++11 -O3 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl
OpenBenchmarking.orgms, Fewer Is BetterMobile Neural Network 2.0Model: inception-v3ABC1224364860Min: 55.67 / Avg: 59.59 / Max: 67.66Min: 53.3 / Avg: 57.85 / Max: 84.65Min: 52.58 / Avg: 59.96 / Max: 81.811. (CXX) g++ options: -std=c++11 -O3 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl

NCNN

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20220729Target: CPU - Model: mobilenetABC1020304050SE +/- 2.07, N = 9SE +/- 1.16, N = 9SE +/- 3.76, N = 945.0041.5245.88MIN: 35.78 / MAX: 540.85MIN: 35.31 / MAX: 563.93MIN: 35.78 / MAX: 543.711. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20220729Target: CPU - Model: mobilenetABC918273645Min: 36.88 / Avg: 45 / Max: 53.57Min: 37.35 / Avg: 41.52 / Max: 46.87Min: 36.26 / Avg: 45.88 / Max: 64.211. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20220729Target: CPU-v2-v2 - Model: mobilenet-v2ABC612182430SE +/- 1.12, N = 9SE +/- 2.10, N = 9SE +/- 2.11, N = 924.0424.6327.05MIN: 19.32 / MAX: 466.34MIN: 18.22 / MAX: 475.35MIN: 18.97 / MAX: 481.631. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20220729Target: CPU-v2-v2 - Model: mobilenet-v2ABC612182430Min: 20.41 / Avg: 24.04 / Max: 31.17Min: 18.82 / Avg: 24.63 / Max: 35.79Min: 20.95 / Avg: 27.05 / Max: 39.211. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20220729Target: CPU-v3-v3 - Model: mobilenet-v3ABC612182430SE +/- 1.04, N = 9SE +/- 1.97, N = 9SE +/- 1.30, N = 921.6023.5122.35MIN: 18.42 / MAX: 485.33MIN: 17.83 / MAX: 487.74MIN: 18.39 / MAX: 509.431. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20220729Target: CPU-v3-v3 - Model: mobilenet-v3ABC510152025Min: 19.21 / Avg: 21.6 / Max: 27.5Min: 18.42 / Avg: 23.51 / Max: 36.15Min: 19.46 / Avg: 22.35 / Max: 32.331. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20220729Target: CPU - Model: shufflenet-v2ABC714212835SE +/- 4.25, N = 9SE +/- 1.64, N = 9SE +/- 1.75, N = 929.1626.6127.07MIN: 21.67 / MAX: 560.88MIN: 21.24 / MAX: 559.88MIN: 21.66 / MAX: 552.291. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20220729Target: CPU - Model: shufflenet-v2ABC612182430Min: 22.53 / Avg: 29.16 / Max: 61.5Min: 22.2 / Avg: 26.61 / Max: 34.99Min: 22.41 / Avg: 27.07 / Max: 37.51. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20220729Target: CPU - Model: mnasnetABC612182430SE +/- 1.65, N = 9SE +/- 1.74, N = 9SE +/- 2.10, N = 922.3722.0726.29MIN: 17.86 / MAX: 463.92MIN: 17 / MAX: 472.21MIN: 17.4 / MAX: 477.821. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20220729Target: CPU - Model: mnasnetABC612182430Min: 19.25 / Avg: 22.37 / Max: 35.12Min: 17.56 / Avg: 22.07 / Max: 30.93Min: 19.07 / Avg: 26.29 / Max: 35.611. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20220729Target: CPU - Model: efficientnet-b0ABC816243240SE +/- 2.26, N = 9SE +/- 2.89, N = 9SE +/- 1.79, N = 933.1934.6531.80MIN: 24.9 / MAX: 696.74MIN: 24.08 / MAX: 682.94MIN: 24.43 / MAX: 693.071. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20220729Target: CPU - Model: efficientnet-b0ABC714212835Min: 29.03 / Avg: 33.19 / Max: 50.24Min: 24.73 / Avg: 34.65 / Max: 49.55Min: 27.67 / Avg: 31.8 / Max: 42.751. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20220729Target: CPU - Model: blazefaceABC48121620SE +/- 0.71, N = 9SE +/- 2.43, N = 9SE +/- 0.13, N = 912.2814.4711.38MIN: 9.88 / MAX: 292.47MIN: 9.52 / MAX: 295.9MIN: 9.98 / MAX: 289.171. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20220729Target: CPU - Model: blazefaceABC48121620Min: 10.08 / Avg: 12.28 / Max: 17.02Min: 9.93 / Avg: 14.47 / Max: 33.16Min: 10.78 / Avg: 11.38 / Max: 11.811. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20220729Target: CPU - Model: googlenetABC1326395265SE +/- 4.24, N = 9SE +/- 4.18, N = 9SE +/- 3.42, N = 959.4153.8253.24MIN: 40.06 / MAX: 739.56MIN: 39.13 / MAX: 737.69MIN: 40.33 / MAX: 740.641. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20220729Target: CPU - Model: googlenetABC1224364860Min: 46.03 / Avg: 59.41 / Max: 79.61Min: 41.09 / Avg: 53.82 / Max: 75.32Min: 41.6 / Avg: 53.24 / Max: 71.191. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20220729Target: CPU - Model: vgg16ABC20406080100SE +/- 4.80, N = 9SE +/- 7.53, N = 9SE +/- 6.48, N = 994.4798.9992.70MIN: 60.89 / MAX: 237.15MIN: 56.24 / MAX: 223.87MIN: 61.84 / MAX: 235.511. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20220729Target: CPU - Model: vgg16ABC20406080100Min: 76.46 / Avg: 94.47 / Max: 120.13Min: 79.46 / Avg: 98.99 / Max: 136.89Min: 77.64 / Avg: 92.7 / Max: 131.781. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20220729Target: CPU - Model: resnet18ABC1020304050SE +/- 4.60, N = 9SE +/- 5.31, N = 9SE +/- 3.06, N = 945.4245.6540.39MIN: 28.71 / MAX: 297.65MIN: 25.28 / MAX: 296.12MIN: 28.07 / MAX: 300.71. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20220729Target: CPU - Model: resnet18ABC918273645Min: 30.62 / Avg: 45.42 / Max: 68.35Min: 30.55 / Avg: 45.65 / Max: 74.85Min: 30.44 / Avg: 40.39 / Max: 57.471. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20220729Target: CPU - Model: alexnetABC1020304050SE +/- 4.07, N = 9SE +/- 5.19, N = 9SE +/- 6.22, N = 941.3640.9442.47MIN: 22.74 / MAX: 146.56MIN: 18.3 / MAX: 145.6MIN: 20.35 / MAX: 145.061. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20220729Target: CPU - Model: alexnetABC918273645Min: 25.2 / Avg: 41.36 / Max: 58.55Min: 26.1 / Avg: 40.94 / Max: 64.28Min: 23.61 / Avg: 42.47 / Max: 77.151. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20220729Target: CPU - Model: resnet50ABC20406080100SE +/- 4.54, N = 9SE +/- 4.17, N = 9SE +/- 4.24, N = 971.3477.6165.41MIN: 49.22 / MAX: 673.07MIN: 43.89 / MAX: 663.09MIN: 47.44 / MAX: 680.351. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20220729Target: CPU - Model: resnet50ABC1530456075Min: 53.69 / Avg: 71.34 / Max: 96.39Min: 49.99 / Avg: 77.61 / Max: 93.08Min: 52.64 / Avg: 65.41 / Max: 96.251. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20220729Target: CPU - Model: yolov4-tinyABC1428425670SE +/- 3.13, N = 9SE +/- 1.09, N = 9SE +/- 2.83, N = 963.2855.4860.06MIN: 47.49 / MAX: 295.76MIN: 47.61 / MAX: 284.14MIN: 47.24 / MAX: 293.121. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20220729Target: CPU - Model: yolov4-tinyABC1224364860Min: 50.65 / Avg: 63.28 / Max: 76.67Min: 49.95 / Avg: 55.48 / Max: 58.9Min: 51.2 / Avg: 60.06 / Max: 75.821. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20220729Target: CPU - Model: squeezenet_ssdABC1428425670SE +/- 3.79, N = 9SE +/- 3.24, N = 9SE +/- 2.64, N = 860.8856.8058.65MIN: 42.5 / MAX: 643.01MIN: 41.76 / MAX: 641.24MIN: 42.73 / MAX: 650.921. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20220729Target: CPU - Model: squeezenet_ssdABC1224364860Min: 49.04 / Avg: 60.88 / Max: 81.63Min: 46.65 / Avg: 56.8 / Max: 75.32Min: 46.92 / Avg: 58.65 / Max: 71.261. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20220729Target: CPU - Model: regnety_400mABC20406080100SE +/- 6.20, N = 9SE +/- 5.95, N = 9SE +/- 4.65, N = 9103.4196.94100.75MIN: 81.96 / MAX: 3182MIN: 81.39 / MAX: 3202.54MIN: 82.33 / MAX: 2992.231. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20220729Target: CPU - Model: regnety_400mABC20406080100Min: 86.82 / Avg: 103.41 / Max: 136.84Min: 83.72 / Avg: 96.94 / Max: 140.08Min: 85.58 / Avg: 100.75 / Max: 126.661. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20220729Target: CPU - Model: vision_transformerABC80160240320400SE +/- 2.70, N = 9SE +/- 2.37, N = 9SE +/- 1.57, N = 9353.68352.36350.58MIN: 271.26 / MAX: 973.13MIN: 270.26 / MAX: 969.01MIN: 285.44 / MAX: 1166.881. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20220729Target: CPU - Model: vision_transformerABC60120180240300Min: 340.19 / Avg: 353.68 / Max: 367.52Min: 343.52 / Avg: 352.36 / Max: 368.17Min: 345.1 / Avg: 350.58 / Max: 359.021. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20220729Target: CPU - Model: FastestDetABC816243240SE +/- 1.74, N = 9SE +/- 2.48, N = 9SE +/- 1.25, N = 932.2832.7530.45MIN: 26.06 / MAX: 617.85MIN: 25.68 / MAX: 619.82MIN: 25.8 / MAX: 616.561. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20220729Target: CPU - Model: FastestDetABC714212835Min: 26.79 / Avg: 32.28 / Max: 42.52Min: 27.27 / Avg: 32.75 / Max: 45.67Min: 27.63 / Avg: 30.45 / Max: 37.781. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread