ncnn mnn 2022

AMD Ryzen 9 5950X 16-Core testing with a ASUS ROG CROSSHAIR VIII HERO (WI-FI) (4006 BIOS) and AMD Radeon RX 6700/6700 XT / 6800M on Ubuntu 22.04 via the Phoronix Test Suite.

HTML result view exported from: https://openbenchmarking.org/result/2208131-PTS-NCNNMNN216.

ncnn mnn 2022ProcessorMotherboardChipsetMemoryDiskGraphicsAudioMonitorNetworkOSKernelDesktopDisplay ServerOpenGLVulkanCompilerFile-SystemScreen ResolutionABCDEAMD Ryzen 9 5950X 16-Core @ 3.40GHz (16 Cores / 32 Threads)ASUS ROG CROSSHAIR VIII HERO (WI-FI) (4006 BIOS)AMD Starship/Matisse32GB1000GB Sabrent Rocket 4.0 PlusAMD Radeon RX 6700/6700 XT / 6800M (2880/1124MHz)AMD Navi 21 HDMI AudioASUS MG28URealtek RTL8125 2.5GbE + Intel I211 + Intel Wi-Fi 6 AX200Ubuntu 22.045.15.0-46-generic (x86_64)GNOME Shell 42.2X Server 1.21.1.3 + Wayland4.6 Mesa 22.0.1 (LLVM 13.0.1 DRM 3.42)1.3.204GCC 11.2.0ext43840x2160OpenBenchmarking.orgKernel Details- Transparent Huge Pages: madviseCompiler Details- --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-bootstrap --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-link-serialization=2 --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none=/build/gcc-11-gBFGDP/gcc-11-11.2.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-11-gBFGDP/gcc-11-11.2.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-build-config=bootstrap-lto-lean --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v Processor Details- Scaling Governor: acpi-cpufreq schedutil (Boost: Enabled) - CPU Microcode: 0xa201016 Security Details- itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional IBRS_FW STIBP: always-on RSB filling + srbds: Not affected + tsx_async_abort: Not affected

ncnn mnn 2022mnn: mobilenetV3mnn: squeezenetv1.1mnn: resnet-v2-50mnn: SqueezeNetV1.0mnn: MobileNetV2_224mnn: mobilenet-v1-1.0mnn: inception-v3ncnn: CPU - mobilenetncnn: CPU-v2-v2 - mobilenet-v2ncnn: CPU-v3-v3 - mobilenet-v3ncnn: CPU - shufflenet-v2ncnn: CPU - mnasnetncnn: CPU - efficientnet-b0ncnn: CPU - blazefacencnn: CPU - googlenetncnn: CPU - vgg16ncnn: CPU - resnet18ncnn: CPU - alexnetncnn: CPU - resnet50ncnn: CPU - yolov4-tinyncnn: CPU - squeezenet_ssdncnn: CPU - regnety_400mncnn: CPU - vision_transformerncnn: CPU - FastestDetncnn: Vulkan GPU - mobilenetncnn: Vulkan GPU-v2-v2 - mobilenet-v2ncnn: Vulkan GPU-v3-v3 - mobilenet-v3ncnn: Vulkan GPU - shufflenet-v2ncnn: Vulkan GPU - mnasnetncnn: Vulkan GPU - efficientnet-b0ncnn: Vulkan GPU - blazefacencnn: Vulkan GPU - googlenetncnn: Vulkan GPU - vgg16ncnn: Vulkan GPU - resnet18ncnn: Vulkan GPU - alexnetncnn: Vulkan GPU - resnet50ncnn: Vulkan GPU - yolov4-tinyncnn: Vulkan GPU - squeezenet_ssdncnn: Vulkan GPU - regnety_400mncnn: Vulkan GPU - vision_transformerncnn: Vulkan GPU - FastestDetABCDE1.9033.20921.9565.2343.4492.62526.07411.464.293.784.303.895.911.8212.1947.5812.177.7921.4721.5118.3212.83123.554.989.451.922.352.041.974.931.643.676.772.632.084.9914.585.233.11220.752.501.8603.22721.5645.1443.4222.54225.80611.924.333.824.303.975.971.8011.6947.5212.217.7320.9821.3318.5312.81122.894.909.341.952.362.122.044.891.603.716.932.542.244.9414.485.143.03219.902.281.8653.27821.0985.3503.4682.55625.90511.714.283.774.303.895.901.8211.3847.5812.087.6721.7021.5718.5912.90122.634.939.841.992.342.092.014.901.653.666.752.602.095.0014.565.473.09219.572.331.9133.29821.7045.3023.4562.59225.92411.844.313.774.263.906.021.8811.5647.3412.167.7221.4821.3018.3912.85123.874.869.901.982.362.092.044.861.643.716.752.612.085.0014.595.503.08220.312.381.9023.29621.5365.3823.4722.58125.99011.644.303.764.283.905.901.8311.5347.9412.149.3021.3921.4318.1712.79123.444.8410.052.002.412.092.044.861.663.726.802.622.124.9714.775.553.06220.852.37OpenBenchmarking.org

Mobile Neural Network

Model: mobilenetV3

OpenBenchmarking.orgms, Fewer Is BetterMobile Neural Network 2.0Model: mobilenetV3ABCDE0.43040.86081.29121.72162.152SE +/- 0.020, N = 3SE +/- 0.010, N = 3SE +/- 0.014, N = 3SE +/- 0.015, N = 15SE +/- 0.015, N = 151.9031.8601.8651.9131.902MIN: 1.71 / MAX: 13.23MIN: 1.74 / MAX: 11.33MIN: 1.74 / MAX: 10.98MIN: 1.69 / MAX: 11.76MIN: 1.69 / MAX: 11.391. (CXX) g++ options: -std=c++11 -O3 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl

Mobile Neural Network

Model: squeezenetv1.1

OpenBenchmarking.orgms, Fewer Is BetterMobile Neural Network 2.0Model: squeezenetv1.1ABCDE0.74211.48422.22632.96843.7105SE +/- 0.079, N = 3SE +/- 0.058, N = 3SE +/- 0.046, N = 3SE +/- 0.036, N = 15SE +/- 0.028, N = 153.2093.2273.2783.2983.296MIN: 2.96 / MAX: 11.86MIN: 2.95 / MAX: 11.74MIN: 3.03 / MAX: 11.65MIN: 2.83 / MAX: 11.8MIN: 2.88 / MAX: 12.561. (CXX) g++ options: -std=c++11 -O3 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl

Mobile Neural Network

Model: resnet-v2-50

OpenBenchmarking.orgms, Fewer Is BetterMobile Neural Network 2.0Model: resnet-v2-50ABCDE510152025SE +/- 0.06, N = 3SE +/- 0.49, N = 3SE +/- 0.14, N = 3SE +/- 0.10, N = 15SE +/- 0.08, N = 1521.9621.5621.1021.7021.54MIN: 19.8 / MAX: 82.59MIN: 19.55 / MAX: 34.8MIN: 19.73 / MAX: 46.88MIN: 19.47 / MAX: 39.03MIN: 19.51 / MAX: 34.691. (CXX) g++ options: -std=c++11 -O3 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl

Mobile Neural Network

Model: SqueezeNetV1.0

OpenBenchmarking.orgms, Fewer Is BetterMobile Neural Network 2.0Model: SqueezeNetV1.0ABCDE1.2112.4223.6334.8446.055SE +/- 0.029, N = 3SE +/- 0.059, N = 3SE +/- 0.070, N = 3SE +/- 0.047, N = 15SE +/- 0.042, N = 155.2345.1445.3505.3025.382MIN: 4.93 / MAX: 13.77MIN: 4.8 / MAX: 17.58MIN: 5.01 / MAX: 13.89MIN: 4.58 / MAX: 14.4MIN: 4.9 / MAX: 40.681. (CXX) g++ options: -std=c++11 -O3 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl

Mobile Neural Network

Model: MobileNetV2_224

OpenBenchmarking.orgms, Fewer Is BetterMobile Neural Network 2.0Model: MobileNetV2_224ABCDE0.78121.56242.34363.12483.906SE +/- 0.011, N = 3SE +/- 0.019, N = 3SE +/- 0.008, N = 3SE +/- 0.026, N = 15SE +/- 0.024, N = 153.4493.4223.4683.4563.472MIN: 3.24 / MAX: 13.32MIN: 3.2 / MAX: 12.93MIN: 3.25 / MAX: 13.17MIN: 3.05 / MAX: 17.71MIN: 3.04 / MAX: 13.371. (CXX) g++ options: -std=c++11 -O3 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl

Mobile Neural Network

Model: mobilenet-v1-1.0

OpenBenchmarking.orgms, Fewer Is BetterMobile Neural Network 2.0Model: mobilenet-v1-1.0ABCDE0.59061.18121.77182.36242.953SE +/- 0.021, N = 3SE +/- 0.018, N = 3SE +/- 0.031, N = 3SE +/- 0.025, N = 15SE +/- 0.018, N = 152.6252.5422.5562.5922.581MIN: 2.41 / MAX: 11.15MIN: 2.36 / MAX: 11.09MIN: 2.32 / MAX: 11.13MIN: 2.32 / MAX: 11.27MIN: 2.32 / MAX: 11.341. (CXX) g++ options: -std=c++11 -O3 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl

Mobile Neural Network

Model: inception-v3

OpenBenchmarking.orgms, Fewer Is BetterMobile Neural Network 2.0Model: inception-v3ABCDE612182430SE +/- 0.18, N = 3SE +/- 0.07, N = 3SE +/- 0.05, N = 3SE +/- 0.08, N = 15SE +/- 0.06, N = 1526.0725.8125.9125.9225.99MIN: 24.37 / MAX: 39.27MIN: 24.39 / MAX: 40.84MIN: 24.43 / MAX: 37.78MIN: 23.04 / MAX: 39.16MIN: 23.91 / MAX: 39.71. (CXX) g++ options: -std=c++11 -O3 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl

NCNN

Target: CPU - Model: mobilenet

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20220729Target: CPU - Model: mobilenetABCDE3691215SE +/- 0.16, N = 3SE +/- 0.35, N = 15SE +/- 0.14, N = 3SE +/- 0.14, N = 3SE +/- 0.05, N = 311.4611.9211.7111.8411.64MIN: 10.61 / MAX: 19.16MIN: 10.28 / MAX: 716.44MIN: 10.59 / MAX: 60.99MIN: 10.94 / MAX: 29.92MIN: 10.9 / MAX: 20.481. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: CPU-v2-v2 - Model: mobilenet-v2

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20220729Target: CPU-v2-v2 - Model: mobilenet-v2ABCDE0.97431.94862.92293.89724.8715SE +/- 0.01, N = 3SE +/- 0.04, N = 15SE +/- 0.01, N = 3SE +/- 0.02, N = 3SE +/- 0.01, N = 34.294.334.284.314.30MIN: 3.94 / MAX: 12.29MIN: 3.93 / MAX: 33.03MIN: 3.95 / MAX: 12.13MIN: 3.94 / MAX: 16.66MIN: 3.94 / MAX: 12.371. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: CPU-v3-v3 - Model: mobilenet-v3

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20220729Target: CPU-v3-v3 - Model: mobilenet-v3ABCDE0.85951.7192.57853.4384.2975SE +/- 0.00, N = 3SE +/- 0.04, N = 15SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 33.783.823.773.773.76MIN: 3.56 / MAX: 11.69MIN: 3.55 / MAX: 35.21MIN: 3.56 / MAX: 11.78MIN: 3.55 / MAX: 11.83MIN: 3.56 / MAX: 12.521. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: CPU - Model: shufflenet-v2

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20220729Target: CPU - Model: shufflenet-v2ABCDE0.96751.9352.90253.874.8375SE +/- 0.03, N = 2SE +/- 0.01, N = 14SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 34.304.304.304.264.28MIN: 4.03 / MAX: 12.41MIN: 3.97 / MAX: 35.81MIN: 4.07 / MAX: 12.2MIN: 4.01 / MAX: 12.04MIN: 4.01 / MAX: 12.081. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: CPU - Model: mnasnet

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20220729Target: CPU - Model: mnasnetABCDE0.89331.78662.67993.57324.4665SE +/- 0.01, N = 3SE +/- 0.05, N = 15SE +/- 0.01, N = 3SE +/- 0.02, N = 3SE +/- 0.01, N = 33.893.973.893.903.90MIN: 3.68 / MAX: 11.81MIN: 3.69 / MAX: 14.19MIN: 3.69 / MAX: 11.45MIN: 3.68 / MAX: 11.86MIN: 3.65 / MAX: 24.961. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: CPU - Model: efficientnet-b0

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20220729Target: CPU - Model: efficientnet-b0ABCDE246810SE +/- 0.02, N = 3SE +/- 0.03, N = 15SE +/- 0.01, N = 3SE +/- 0.08, N = 3SE +/- 0.01, N = 35.915.975.906.025.90MIN: 5.57 / MAX: 17MIN: 5.56 / MAX: 78.45MIN: 5.59 / MAX: 14.02MIN: 5.56 / MAX: 47.25MIN: 5.53 / MAX: 32.651. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: CPU - Model: blazeface

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20220729Target: CPU - Model: blazefaceABCDE0.4230.8461.2691.6922.115SE +/- 0.01, N = 3SE +/- 0.01, N = 15SE +/- 0.00, N = 3SE +/- 0.04, N = 3SE +/- 0.01, N = 31.821.801.821.881.83MIN: 1.7 / MAX: 9.71MIN: 1.63 / MAX: 9.64MIN: 1.71 / MAX: 4.41MIN: 1.68 / MAX: 49.69MIN: 1.69 / MAX: 10.061. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: CPU - Model: googlenet

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20220729Target: CPU - Model: googlenetABCDE3691215SE +/- 0.31, N = 3SE +/- 0.10, N = 15SE +/- 0.01, N = 3SE +/- 0.14, N = 3SE +/- 0.11, N = 312.1911.6911.3811.5611.53MIN: 10.69 / MAX: 42.59MIN: 10.57 / MAX: 54.38MIN: 10.66 / MAX: 20.39MIN: 10.58 / MAX: 20.15MIN: 10.64 / MAX: 33.911. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: CPU - Model: vgg16

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20220729Target: CPU - Model: vgg16ABCDE1122334455SE +/- 0.13, N = 3SE +/- 0.12, N = 15SE +/- 0.04, N = 3SE +/- 0.08, N = 3SE +/- 0.40, N = 347.5847.5247.5847.3447.94MIN: 44.3 / MAX: 69.79MIN: 43.88 / MAX: 109.37MIN: 44.41 / MAX: 87.25MIN: 43.83 / MAX: 71.03MIN: 44.37 / MAX: 85.571. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: CPU - Model: resnet18

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20220729Target: CPU - Model: resnet18ABCDE3691215SE +/- 0.02, N = 3SE +/- 0.05, N = 15SE +/- 0.04, N = 3SE +/- 0.17, N = 3SE +/- 0.08, N = 312.1712.2112.0812.1612.14MIN: 11.06 / MAX: 20.42MIN: 10.82 / MAX: 25.49MIN: 10.9 / MAX: 20.66MIN: 10.93 / MAX: 21.19MIN: 10.93 / MAX: 29.461. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: CPU - Model: alexnet

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20220729Target: CPU - Model: alexnetABCDE3691215SE +/- 0.05, N = 3SE +/- 0.03, N = 15SE +/- 0.09, N = 3SE +/- 0.03, N = 3SE +/- 1.56, N = 37.797.737.677.729.30MIN: 7.1 / MAX: 16.44MIN: 7.11 / MAX: 21.38MIN: 7.09 / MAX: 16.27MIN: 7.14 / MAX: 16.18MIN: 7.13 / MAX: 633.171. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: CPU - Model: resnet50

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20220729Target: CPU - Model: resnet50ABCDE510152025SE +/- 0.28, N = 3SE +/- 0.11, N = 15SE +/- 0.15, N = 3SE +/- 0.10, N = 3SE +/- 0.19, N = 321.4720.9821.7021.4821.39MIN: 19.56 / MAX: 30.76MIN: 18.95 / MAX: 79.65MIN: 19.94 / MAX: 30.5MIN: 19.75 / MAX: 39.98MIN: 19.66 / MAX: 37.461. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: CPU - Model: yolov4-tiny

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20220729Target: CPU - Model: yolov4-tinyABCDE510152025SE +/- 0.14, N = 3SE +/- 0.09, N = 15SE +/- 0.14, N = 3SE +/- 0.04, N = 3SE +/- 0.14, N = 321.5121.3321.5721.3021.43MIN: 19.61 / MAX: 83.91MIN: 19.29 / MAX: 47.85MIN: 19.56 / MAX: 36.88MIN: 19.44 / MAX: 33.91MIN: 19.88 / MAX: 29.431. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: CPU - Model: squeezenet_ssd

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20220729Target: CPU - Model: squeezenet_ssdABCDE510152025SE +/- 0.19, N = 3SE +/- 0.13, N = 15SE +/- 0.14, N = 3SE +/- 0.17, N = 3SE +/- 0.19, N = 318.3218.5318.5918.3918.17MIN: 15.5 / MAX: 34.97MIN: 15.19 / MAX: 66.5MIN: 16.26 / MAX: 43.69MIN: 15.88 / MAX: 27.52MIN: 16.13 / MAX: 27.121. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: CPU - Model: regnety_400m

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20220729Target: CPU - Model: regnety_400mABCDE3691215SE +/- 0.04, N = 3SE +/- 0.05, N = 15SE +/- 0.04, N = 3SE +/- 0.03, N = 3SE +/- 0.10, N = 312.8312.8112.9012.8512.79MIN: 12.11 / MAX: 26.51MIN: 11.76 / MAX: 25.73MIN: 12.14 / MAX: 20.46MIN: 12.05 / MAX: 26.05MIN: 11.97 / MAX: 21.291. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: CPU - Model: vision_transformer

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20220729Target: CPU - Model: vision_transformerABCDE306090120150SE +/- 0.06, N = 3SE +/- 0.11, N = 15SE +/- 0.17, N = 3SE +/- 0.36, N = 3SE +/- 0.61, N = 3123.55122.89122.63123.87123.44MIN: 119.55 / MAX: 191.98MIN: 119.06 / MAX: 171.55MIN: 119.12 / MAX: 162.72MIN: 119.07 / MAX: 187.38MIN: 119.37 / MAX: 173.881. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: CPU - Model: FastestDet

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20220729Target: CPU - Model: FastestDetABCDE1.12052.2413.36154.4825.6025SE +/- 0.11, N = 3SE +/- 0.04, N = 15SE +/- 0.08, N = 3SE +/- 0.02, N = 3SE +/- 0.19, N = 34.984.904.934.864.84MIN: 4.56 / MAX: 12.11MIN: 4.19 / MAX: 12.29MIN: 4.52 / MAX: 11.93MIN: 4.61 / MAX: 12MIN: 4.19 / MAX: 12.161. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: Vulkan GPU - Model: mobilenet

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20220729Target: Vulkan GPU - Model: mobilenetABCDE3691215SE +/- 0.13, N = 3SE +/- 0.10, N = 3SE +/- 0.22, N = 15SE +/- 0.17, N = 15SE +/- 0.23, N = 159.459.349.849.9010.05MIN: 5.91 / MAX: 20.24MIN: 5.97 / MAX: 18.47MIN: 5.61 / MAX: 25.64MIN: 4.66 / MAX: 29.74MIN: 4.72 / MAX: 26.351. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: Vulkan GPU-v2-v2 - Model: mobilenet-v2

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20220729Target: Vulkan GPU-v2-v2 - Model: mobilenet-v2ABCDE0.450.91.351.82.25SE +/- 0.04, N = 3SE +/- 0.05, N = 3SE +/- 0.04, N = 15SE +/- 0.01, N = 15SE +/- 0.02, N = 151.921.951.991.982.00MIN: 1.7 / MAX: 6.92MIN: 1.71 / MAX: 6.43MIN: 1.69 / MAX: 14.04MIN: 1.69 / MAX: 9.54MIN: 1.7 / MAX: 12.731. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: Vulkan GPU-v3-v3 - Model: mobilenet-v3

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20220729Target: Vulkan GPU-v3-v3 - Model: mobilenet-v3ABCDE0.54231.08461.62692.16922.7115SE +/- 0.02, N = 3SE +/- 0.02, N = 3SE +/- 0.01, N = 15SE +/- 0.01, N = 15SE +/- 0.03, N = 152.352.362.342.362.41MIN: 2.07 / MAX: 8.2MIN: 2.09 / MAX: 9.49MIN: 2.07 / MAX: 14.62MIN: 2.08 / MAX: 15.13MIN: 2.07 / MAX: 19.361. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: Vulkan GPU - Model: shufflenet-v2

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20220729Target: Vulkan GPU - Model: shufflenet-v2ABCDE0.4770.9541.4311.9082.385SE +/- 0.07, N = 3SE +/- 0.02, N = 3SE +/- 0.02, N = 15SE +/- 0.02, N = 15SE +/- 0.01, N = 152.042.122.092.092.09MIN: 1.65 / MAX: 11.74MIN: 1.67 / MAX: 7.91MIN: 1.65 / MAX: 9.6MIN: 1.65 / MAX: 13.26MIN: 1.65 / MAX: 9.441. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: Vulkan GPU - Model: mnasnet

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20220729Target: Vulkan GPU - Model: mnasnetABCDE0.4590.9181.3771.8362.295SE +/- 0.02, N = 3SE +/- 0.03, N = 3SE +/- 0.01, N = 15SE +/- 0.02, N = 13SE +/- 0.02, N = 141.972.042.012.042.04MIN: 1.73 / MAX: 6.43MIN: 1.74 / MAX: 9.58MIN: 1.73 / MAX: 9.57MIN: 1.73 / MAX: 14.09MIN: 1.73 / MAX: 11.291. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: Vulkan GPU - Model: efficientnet-b0

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20220729Target: Vulkan GPU - Model: efficientnet-b0ABCDE1.10932.21863.32794.43725.5465SE +/- 0.04, N = 3SE +/- 0.05, N = 3SE +/- 0.02, N = 15SE +/- 0.01, N = 15SE +/- 0.01, N = 154.934.894.904.864.86MIN: 4.52 / MAX: 29.24MIN: 4.53 / MAX: 27.46MIN: 4.48 / MAX: 29.81MIN: 4.49 / MAX: 18.62MIN: 4.52 / MAX: 18.871. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: Vulkan GPU - Model: blazeface

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20220729Target: Vulkan GPU - Model: blazefaceABCDE0.37350.7471.12051.4941.8675SE +/- 0.04, N = 3SE +/- 0.02, N = 3SE +/- 0.01, N = 15SE +/- 0.01, N = 15SE +/- 0.02, N = 151.641.601.651.641.66MIN: 1.18 / MAX: 11.1MIN: 1.25 / MAX: 10.18MIN: 1.15 / MAX: 12.54MIN: 1.16 / MAX: 14.86MIN: 1.15 / MAX: 22.721. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: Vulkan GPU - Model: googlenet

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20220729Target: Vulkan GPU - Model: googlenetABCDE0.8371.6742.5113.3484.185SE +/- 0.01, N = 3SE +/- 0.08, N = 3SE +/- 0.03, N = 15SE +/- 0.04, N = 15SE +/- 0.03, N = 153.673.713.663.713.72MIN: 3.25 / MAX: 17.16MIN: 3.26 / MAX: 16.59MIN: 3.24 / MAX: 16.69MIN: 3.24 / MAX: 25.35MIN: 3.24 / MAX: 18.211. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: Vulkan GPU - Model: vgg16

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20220729Target: Vulkan GPU - Model: vgg16ABCDE246810SE +/- 0.05, N = 3SE +/- 0.06, N = 3SE +/- 0.03, N = 15SE +/- 0.02, N = 15SE +/- 0.02, N = 156.776.936.756.756.80MIN: 6.25 / MAX: 25.32MIN: 6.25 / MAX: 28.94MIN: 6.25 / MAX: 36.3MIN: 6.25 / MAX: 28.85MIN: 6.24 / MAX: 30.41. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: Vulkan GPU - Model: resnet18

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20220729Target: Vulkan GPU - Model: resnet18ABCDE0.59181.18361.77542.36722.959SE +/- 0.03, N = 3SE +/- 0.02, N = 3SE +/- 0.02, N = 15SE +/- 0.03, N = 15SE +/- 0.03, N = 132.632.542.602.612.62MIN: 2.15 / MAX: 16.21MIN: 2.16 / MAX: 11.84MIN: 2.15 / MAX: 15.22MIN: 2.15 / MAX: 21.7MIN: 2.15 / MAX: 20.981. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: Vulkan GPU - Model: alexnet

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20220729Target: Vulkan GPU - Model: alexnetABCDE0.5041.0081.5122.0162.52SE +/- 0.06, N = 3SE +/- 0.08, N = 3SE +/- 0.03, N = 15SE +/- 0.02, N = 13SE +/- 0.03, N = 122.082.242.092.082.12MIN: 1.68 / MAX: 11.23MIN: 1.68 / MAX: 18.33MIN: 1.67 / MAX: 18.2MIN: 1.67 / MAX: 18.09MIN: 1.68 / MAX: 19.91. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: Vulkan GPU - Model: resnet50

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20220729Target: Vulkan GPU - Model: resnet50ABCDE1.1252.253.3754.55.625SE +/- 0.02, N = 3SE +/- 0.03, N = 3SE +/- 0.03, N = 15SE +/- 0.04, N = 15SE +/- 0.03, N = 154.994.945.005.004.97MIN: 4.5 / MAX: 26.58MIN: 4.5 / MAX: 26.23MIN: 4.49 / MAX: 33.3MIN: 4.5 / MAX: 30.89MIN: 4.49 / MAX: 30.821. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: Vulkan GPU - Model: yolov4-tiny

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20220729Target: Vulkan GPU - Model: yolov4-tinyABCDE48121620SE +/- 0.04, N = 3SE +/- 0.09, N = 3SE +/- 0.04, N = 15SE +/- 0.03, N = 15SE +/- 0.25, N = 1514.5814.4814.5614.5914.77MIN: 13.18 / MAX: 22.42MIN: 13.05 / MAX: 21.86MIN: 12.76 / MAX: 28.55MIN: 12.89 / MAX: 35.38MIN: 12.94 / MAX: 50.631. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: Vulkan GPU - Model: squeezenet_ssd

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20220729Target: Vulkan GPU - Model: squeezenet_ssdABCDE1.24882.49763.74644.99526.244SE +/- 0.07, N = 3SE +/- 0.10, N = 3SE +/- 0.13, N = 15SE +/- 0.12, N = 15SE +/- 0.14, N = 155.235.145.475.505.55MIN: 3.64 / MAX: 17.71MIN: 3.67 / MAX: 16.01MIN: 3.7 / MAX: 27.5MIN: 3.7 / MAX: 21.81MIN: 3.7 / MAX: 22.311. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: Vulkan GPU - Model: regnety_400m

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20220729Target: Vulkan GPU - Model: regnety_400mABCDE0.69981.39962.09942.79923.499SE +/- 0.13, N = 3SE +/- 0.12, N = 3SE +/- 0.03, N = 15SE +/- 0.03, N = 15SE +/- 0.03, N = 153.113.033.093.083.06MIN: 2.71 / MAX: 12.9MIN: 2.67 / MAX: 13.33MIN: 2.7 / MAX: 23.46MIN: 2.69 / MAX: 25.76MIN: 2.69 / MAX: 14.141. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: Vulkan GPU - Model: vision_transformer

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20220729Target: Vulkan GPU - Model: vision_transformerABCDE50100150200250SE +/- 0.44, N = 3SE +/- 1.44, N = 3SE +/- 0.33, N = 15SE +/- 0.34, N = 15SE +/- 0.36, N = 15220.75219.90219.57220.31220.85MIN: 205.2 / MAX: 332.92MIN: 204.44 / MAX: 295.75MIN: 204.22 / MAX: 967.44MIN: 204.86 / MAX: 914.53MIN: 204.72 / MAX: 1074.161. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: Vulkan GPU - Model: FastestDet

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20220729Target: Vulkan GPU - Model: FastestDetABCDE0.56251.1251.68752.252.8125SE +/- 0.17, N = 3SE +/- 0.03, N = 3SE +/- 0.01, N = 14SE +/- 0.04, N = 15SE +/- 0.03, N = 152.502.282.332.382.37MIN: 1.86 / MAX: 8.64MIN: 1.85 / MAX: 8.13MIN: 1.84 / MAX: 7.89MIN: 1.84 / MAX: 9.1MIN: 1.85 / MAX: 17.061. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread


Phoronix Test Suite v10.8.5