ncnn updated 5950x + rx 6800 xt

AMD Ryzen 9 5950X 16-Core testing with a ASUS ROG CROSSHAIR VIII HERO (WI-FI) (3003 BIOS) and AMD SIENNA_CICHLID 16GB on Ubuntu 20.04 via the Phoronix Test Suite.

Compare your own system(s) to this result file with the Phoronix Test Suite by running the command: phoronix-test-suite benchmark 2012187-PTS-NCNNUPDA37
Jump To Table - Results

View

Do Not Show Noisy Results
Do Not Show Results With Incomplete Data
Do Not Show Results With Little Change/Spread
List Notable Results

Statistics

Show Overall Harmonic Mean(s)
Show Overall Geometric Mean
Show Wins / Losses Counts (Pie Chart)
Normalize Results
Remove Outliers Before Calculating Averages

Graph Settings

Force Line Graphs Where Applicable
Convert To Scalar Where Applicable
Prefer Vertical Bar Graphs

Multi-Way Comparison

Condense Multi-Option Tests Into Single Result Graphs

Table

Show Detailed System Result Table

Run Management

Highlight
Result
Hide
Result
Result
Identifier
Performance Per
Dollar
Date
Run
  Test
  Duration
1
December 18 2020
  4 Hours
2
December 18 2020
  1 Hour, 47 Minutes
3
December 18 2020
  1 Hour, 20 Minutes
4
December 18 2020
  6 Hours, 41 Minutes
Invert Hiding All Results Option
  3 Hours, 27 Minutes

Only show results where is faster than
Only show results matching title/arguments (delimit multiple options with a comma):
Do not show results matching title/arguments (delimit multiple options with a comma):


ncnn updated 5950x + rx 6800 xtProcessorMotherboardChipsetMemoryDiskGraphicsAudioMonitorNetworkOSKernelDesktopDisplay ServerDisplay DriverOpenGLVulkanCompilerFile-SystemScreen Resolution1234AMD Ryzen 9 5950X 16-Core @ 3.40GHz (16 Cores / 32 Threads)ASUS ROG CROSSHAIR VIII HERO (WI-FI) (3003 BIOS)AMD Starship/Matisse16GB2000GB Corsair Force MP600 + 2000GBAMD SIENNA_CICHLID 16GB (2575/1000MHz)AMD Device ab28ASUS MG28URealtek RTL8125 2.5GbE + Intel I211 + Intel Wi-Fi 6 AX200Ubuntu 20.045.10.0-051000rc6daily20201205-generic (x86_64) 20201204GNOME Shell 3.36.4X Server 1.20.8modesetting 1.20.84.6 Mesa 21.0.0-devel (git-e6a6620 2020-12-17 focal-oibaf-ppa) (LLVM 11.0.0)1.2.145GCC 9.3.0ext43840x2160OpenBenchmarking.orgCompiler Details- --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++,gm2 --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none=/build/gcc-9-HskZEa/gcc-9-9.3.0/debian/tmp-nvptx/usr,hsa --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v Processor Details- Scaling Governor: acpi-cpufreq ondemand (Boost: Enabled) - CPU Microcode: 0xa201009Security Details- itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Full AMD retpoline IBPB: conditional IBRS_FW STIBP: always-on RSB filling + srbds: Not affected + tsx_async_abort: Not affected

1234Result OverviewPhoronix Test Suite100%102%103%105%NCNNNCNNNCNNNCNNNCNNNCNNNCNNNCNNNCNNNCNNNCNNNCNNNCNNNCNNNCNNNCNNNCNNNCNNNCNNNCNNNCNNNCNNNCNNNCNNNCNNNCNNNCNNNCNNNCNNNCNNCPU - blazefaceVulkan GPU - yolov4-tinyVulkan GPU - resnet50CPU - googlenetVulkan GPU - googlenetCPU - mnasnetCPU - yolov4-tinyCPU - resnet50CPU - mobilenetVulkan GPU - mobilenetCPU - efficientnet-b0Vulkan GPU - alexnetVulkan GPU - regnety_400mVulkan GPU - efficientnet-b0CPU - alexnetVulkan GPU-v2-v2 - mobilenet-v2Vulkan GPU - mnasnetCPU-v3-v3 - mobilenet-v3Vulkan GPU-v3-v3 - mobilenet-v3CPU-v2-v2 - mobilenet-v2CPU - regnety_400mVulkan GPU - resnet18CPU - resnet18CPU - squeezenet_ssdVulkan GPU - squeezenet_ssdVulkan GPU - shufflenet-v2CPU - shufflenet-v2Vulkan GPU - blazefaceCPU - vgg16Vulkan GPU - vgg16

ncnn updated 5950x + rx 6800 xtncnn: CPU - mobilenetncnn: CPU-v2-v2 - mobilenet-v2ncnn: CPU-v3-v3 - mobilenet-v3ncnn: CPU - mnasnetncnn: CPU - efficientnet-b0ncnn: CPU - blazefacencnn: CPU - googlenetncnn: CPU - vgg16ncnn: CPU - resnet18ncnn: CPU - alexnetncnn: CPU - resnet50ncnn: CPU - yolov4-tinyncnn: CPU - squeezenet_ssdncnn: CPU - regnety_400mncnn: CPU - shufflenet-v2ncnn: Vulkan GPU - mobilenetncnn: Vulkan GPU-v2-v2 - mobilenet-v2ncnn: Vulkan GPU-v3-v3 - mobilenet-v3ncnn: Vulkan GPU - shufflenet-v2ncnn: Vulkan GPU - mnasnetncnn: Vulkan GPU - efficientnet-b0ncnn: Vulkan GPU - blazefacencnn: Vulkan GPU - googlenetncnn: Vulkan GPU - vgg16ncnn: Vulkan GPU - resnet18ncnn: Vulkan GPU - alexnetncnn: Vulkan GPU - resnet50ncnn: Vulkan GPU - yolov4-tinyncnn: Vulkan GPU - squeezenet_ssdncnn: Vulkan GPU - regnety_400m123412.554.464.154.015.401.8412.9957.9314.5611.3025.4721.7314.6717.954.4612.204.464.134.483.995.381.8413.0357.6114.5311.4024.8320.8714.3318.2412.394.404.103.925.301.8212.6957.9614.3911.0225.2121.3414.5617.894.4312.564.494.224.454.055.391.8413.1457.6814.7911.4826.0721.9214.5217.9312.254.494.174.055.451.9313.2957.7214.6411.2525.1121.5014.4518.254.4412.394.424.174.464.085.521.8513.5157.4614.7111.5425.4721.4514.3118.4112.634.464.194.025.381.8413.2657.8614.6111.2225.9322.0414.6317.974.4512.514.524.184.444.045.441.8413.3157.6814.5811.2325.4921.6914.4118.13OpenBenchmarking.org

NCNN

NCNN is a high performance neural network inference framework optimized for mobile and other platforms developed by Tencent. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: CPU - Model: mobilenet41233691215SE +/- 0.11, N = 15SE +/- 0.14, N = 15SE +/- 0.17, N = 4SE +/- 0.20, N = 312.6312.5512.3912.25MIN: 11.82 / MAX: 22.7MIN: 11.79 / MAX: 49.77MIN: 11.78 / MAX: 13.07MIN: 11.91 / MAX: 13.081. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: CPU - Model: mobilenet412348121620Min: 12 / Avg: 12.63 / Max: 13.49Min: 11.98 / Avg: 12.55 / Max: 13.65Min: 11.94 / Avg: 12.39 / Max: 12.74Min: 12.03 / Avg: 12.25 / Max: 12.661. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: CPU-v2-v2 - Model: mobilenet-v234121.01032.02063.03094.04125.0515SE +/- 0.08, N = 3SE +/- 0.03, N = 15SE +/- 0.03, N = 15SE +/- 0.02, N = 44.494.464.464.40MIN: 4.24 / MAX: 6.18MIN: 4.22 / MAX: 8.58MIN: 4.22 / MAX: 15.2MIN: 4.18 / MAX: 5.951. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: CPU-v2-v2 - Model: mobilenet-v23412246810Min: 4.4 / Avg: 4.49 / Max: 4.65Min: 4.39 / Avg: 4.46 / Max: 4.71Min: 4.39 / Avg: 4.46 / Max: 4.9Min: 4.34 / Avg: 4.4 / Max: 4.421. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: CPU-v3-v3 - Model: mobilenet-v343120.94281.88562.82843.77124.714SE +/- 0.03, N = 15SE +/- 0.07, N = 3SE +/- 0.03, N = 15SE +/- 0.03, N = 44.194.174.154.10MIN: 4.06 / MAX: 27.02MIN: 4.03 / MAX: 5.48MIN: 4.02 / MAX: 6.24MIN: 3.99 / MAX: 5.461. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: CPU-v3-v3 - Model: mobilenet-v34312246810Min: 4.09 / Avg: 4.19 / Max: 4.4Min: 4.07 / Avg: 4.17 / Max: 4.3Min: 4.05 / Avg: 4.15 / Max: 4.45Min: 4.02 / Avg: 4.1 / Max: 4.171. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: CPU - Model: mnasnet34120.91131.82262.73393.64524.5565SE +/- 0.11, N = 3SE +/- 0.04, N = 15SE +/- 0.04, N = 15SE +/- 0.02, N = 44.054.024.013.92MIN: 3.79 / MAX: 4.82MIN: 3.8 / MAX: 5.62MIN: 3.81 / MAX: 6.1MIN: 3.77 / MAX: 4.941. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: CPU - Model: mnasnet3412246810Min: 3.92 / Avg: 4.05 / Max: 4.27Min: 3.91 / Avg: 4.02 / Max: 4.28Min: 3.9 / Avg: 4.01 / Max: 4.44Min: 3.87 / Avg: 3.92 / Max: 3.951. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: CPU - Model: efficientnet-b031421.22632.45263.67894.90526.1315SE +/- 0.11, N = 3SE +/- 0.04, N = 15SE +/- 0.03, N = 15SE +/- 0.02, N = 45.455.405.385.30MIN: 5.22 / MAX: 15.71MIN: 5.21 / MAX: 11.8MIN: 5.21 / MAX: 8.08MIN: 5.2 / MAX: 6.551. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: CPU - Model: efficientnet-b03142246810Min: 5.34 / Avg: 5.45 / Max: 5.67Min: 5.29 / Avg: 5.4 / Max: 5.8Min: 5.28 / Avg: 5.38 / Max: 5.61Min: 5.25 / Avg: 5.3 / Max: 5.331. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: CPU - Model: blazeface34120.43430.86861.30291.73722.1715SE +/- 0.13, N = 3SE +/- 0.01, N = 15SE +/- 0.02, N = 15SE +/- 0.03, N = 41.931.841.841.82MIN: 1.78 / MAX: 54.82MIN: 1.77 / MAX: 2.2MIN: 1.77 / MAX: 3.69MIN: 1.76 / MAX: 2.221. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: CPU - Model: blazeface3412246810Min: 1.79 / Avg: 1.93 / Max: 2.2Min: 1.78 / Avg: 1.84 / Max: 1.92Min: 1.78 / Avg: 1.84 / Max: 1.95Min: 1.77 / Avg: 1.82 / Max: 1.911. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: CPU - Model: googlenet34123691215SE +/- 0.59, N = 3SE +/- 0.22, N = 15SE +/- 0.15, N = 15SE +/- 0.04, N = 413.2913.2612.9912.69MIN: 12.37 / MAX: 45.24MIN: 12.33 / MAX: 24.32MIN: 12.32 / MAX: 24.45MIN: 12.3 / MAX: 13.331. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: CPU - Model: googlenet341248121620Min: 12.64 / Avg: 13.29 / Max: 14.47Min: 12.62 / Avg: 13.26 / Max: 14.77Min: 12.56 / Avg: 12.99 / Max: 14.91Min: 12.58 / Avg: 12.69 / Max: 12.731. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: CPU - Model: vgg1621431326395265SE +/- 0.10, N = 4SE +/- 0.07, N = 15SE +/- 0.06, N = 15SE +/- 0.35, N = 357.9657.9357.8657.72MIN: 56.88 / MAX: 68.65MIN: 56.29 / MAX: 191.26MIN: 56.32 / MAX: 97.91MIN: 56.04 / MAX: 62.771. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: CPU - Model: vgg1621431122334455Min: 57.7 / Avg: 57.96 / Max: 58.17Min: 57.32 / Avg: 57.93 / Max: 58.67Min: 57.28 / Avg: 57.86 / Max: 58.17Min: 57.02 / Avg: 57.72 / Max: 58.071. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: CPU - Model: resnet18341248121620SE +/- 0.33, N = 3SE +/- 0.08, N = 15SE +/- 0.07, N = 15SE +/- 0.09, N = 414.6414.6114.5614.39MIN: 14.21 / MAX: 16.42MIN: 14.2 / MAX: 46.42MIN: 14.13 / MAX: 27.65MIN: 14.18 / MAX: 18.311. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: CPU - Model: resnet18341248121620Min: 14.31 / Avg: 14.64 / Max: 15.29Min: 14.31 / Avg: 14.61 / Max: 15.11Min: 14.25 / Avg: 14.56 / Max: 15.31Min: 14.27 / Avg: 14.39 / Max: 14.661. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: CPU - Model: alexnet13423691215SE +/- 0.08, N = 15SE +/- 0.35, N = 3SE +/- 0.08, N = 15SE +/- 0.14, N = 411.3011.2511.2211.02MIN: 10.78 / MAX: 33.73MIN: 10.82 / MAX: 12.32MIN: 10.81 / MAX: 32.79MIN: 10.77 / MAX: 11.721. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: CPU - Model: alexnet13423691215Min: 10.86 / Avg: 11.3 / Max: 11.84Min: 10.9 / Avg: 11.25 / Max: 11.96Min: 10.89 / Avg: 11.22 / Max: 11.75Min: 10.86 / Avg: 11.02 / Max: 11.431. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: CPU - Model: resnet504123612182430SE +/- 0.21, N = 15SE +/- 0.18, N = 15SE +/- 0.34, N = 4SE +/- 0.48, N = 325.9325.4725.2125.11MIN: 24.27 / MAX: 38.92MIN: 24.19 / MAX: 49.11MIN: 24.42 / MAX: 36.51MIN: 24.35 / MAX: 26.821. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: CPU - Model: resnet504123612182430Min: 24.56 / Avg: 25.93 / Max: 26.87Min: 24.5 / Avg: 25.47 / Max: 26.72Min: 24.7 / Avg: 25.21 / Max: 26.22Min: 24.63 / Avg: 25.11 / Max: 26.061. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: CPU - Model: yolov4-tiny4132510152025SE +/- 0.24, N = 15SE +/- 0.24, N = 15SE +/- 0.65, N = 3SE +/- 0.42, N = 422.0421.7321.5021.34MIN: 20.45 / MAX: 31.56MIN: 20.42 / MAX: 55.87MIN: 20.57 / MAX: 31MIN: 20.53 / MAX: 27.411. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: CPU - Model: yolov4-tiny4132510152025Min: 20.66 / Avg: 22.04 / Max: 23Min: 20.66 / Avg: 21.73 / Max: 23.35Min: 20.83 / Avg: 21.5 / Max: 22.8Min: 20.82 / Avg: 21.34 / Max: 22.611. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: CPU - Model: squeezenet_ssd142348121620SE +/- 0.06, N = 13SE +/- 0.07, N = 14SE +/- 0.05, N = 4SE +/- 0.06, N = 314.6714.6314.5614.45MIN: 14.05 / MAX: 17.24MIN: 13.7 / MAX: 25.32MIN: 14.05 / MAX: 30.66MIN: 14.1 / MAX: 18.731. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: CPU - Model: squeezenet_ssd142348121620Min: 14.4 / Avg: 14.67 / Max: 15.12Min: 13.91 / Avg: 14.63 / Max: 15.12Min: 14.42 / Avg: 14.56 / Max: 14.64Min: 14.34 / Avg: 14.45 / Max: 14.511. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: CPU - Model: regnety_400m341248121620SE +/- 0.38, N = 3SE +/- 0.05, N = 15SE +/- 0.04, N = 15SE +/- 0.10, N = 418.2517.9717.9517.89MIN: 17.57 / MAX: 28.63MIN: 17.57 / MAX: 24.73MIN: 17.59 / MAX: 28.89MIN: 17.51 / MAX: 19.121. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: CPU - Model: regnety_400m3412510152025Min: 17.76 / Avg: 18.25 / Max: 18.99Min: 17.72 / Avg: 17.97 / Max: 18.27Min: 17.73 / Avg: 17.95 / Max: 18.21Min: 17.65 / Avg: 17.89 / Max: 18.131. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: CPU - Model: shufflenet-v214321.00352.0073.01054.0145.0175SE +/- 0.01, N = 13SE +/- 0.01, N = 14SE +/- 0.01, N = 3SE +/- 0.02, N = 44.464.454.444.43MIN: 4.38 / MAX: 15.65MIN: 4.38 / MAX: 9.11MIN: 4.39 / MAX: 5.93MIN: 4.34 / MAX: 5.31. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: CPU - Model: shufflenet-v21432246810Min: 4.42 / Avg: 4.46 / Max: 4.53Min: 4.42 / Avg: 4.45 / Max: 4.51Min: 4.42 / Avg: 4.44 / Max: 4.45Min: 4.38 / Avg: 4.43 / Max: 4.461. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: Vulkan GPU - Model: mobilenet24313691215SE +/- 0.17, N = 4SE +/- 0.14, N = 15SE +/- 0.01, N = 3SE +/- 0.16, N = 312.5612.5112.3912.20MIN: 11.93 / MAX: 13.44MIN: 11.8 / MAX: 30.08MIN: 11.87 / MAX: 40.91MIN: 11.86 / MAX: 12.961. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: Vulkan GPU - Model: mobilenet243148121620Min: 12.13 / Avg: 12.56 / Max: 12.84Min: 12 / Avg: 12.51 / Max: 13.86Min: 12.37 / Avg: 12.39 / Max: 12.41Min: 11.99 / Avg: 12.2 / Max: 12.521. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: Vulkan GPU-v2-v2 - Model: mobilenet-v242131.0172.0343.0514.0685.085SE +/- 0.06, N = 15SE +/- 0.06, N = 4SE +/- 0.04, N = 3SE +/- 0.01, N = 34.524.494.464.42MIN: 4.19 / MAX: 45.88MIN: 4.24 / MAX: 6.12MIN: 4.2 / MAX: 5.95MIN: 4.23 / MAX: 5.891. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: Vulkan GPU-v2-v2 - Model: mobilenet-v24213246810Min: 4.38 / Avg: 4.52 / Max: 5.22Min: 4.42 / Avg: 4.49 / Max: 4.67Min: 4.39 / Avg: 4.46 / Max: 4.54Min: 4.4 / Avg: 4.42 / Max: 4.441. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: Vulkan GPU-v3-v3 - Model: mobilenet-v324310.94951.8992.84853.7984.7475SE +/- 0.04, N = 4SE +/- 0.04, N = 15SE +/- 0.04, N = 3SE +/- 0.03, N = 34.224.184.174.13MIN: 4.12 / MAX: 5.78MIN: 4 / MAX: 5.78MIN: 4.02 / MAX: 35.81MIN: 4.05 / MAX: 5.581. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: Vulkan GPU-v3-v3 - Model: mobilenet-v32431246810Min: 4.15 / Avg: 4.22 / Max: 4.34Min: 4.03 / Avg: 4.18 / Max: 4.61Min: 4.1 / Avg: 4.17 / Max: 4.25Min: 4.09 / Avg: 4.13 / Max: 4.181. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: Vulkan GPU - Model: shufflenet-v213241.0082.0163.0244.0325.04SE +/- 0.02, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 4SE +/- 0.01, N = 154.484.464.454.44MIN: 4.41 / MAX: 5.45MIN: 4.4 / MAX: 6.53MIN: 4.37 / MAX: 7.43MIN: 4.33 / MAX: 9.441. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: Vulkan GPU - Model: shufflenet-v21324246810Min: 4.45 / Avg: 4.48 / Max: 4.52Min: 4.45 / Avg: 4.46 / Max: 4.47Min: 4.42 / Avg: 4.45 / Max: 4.48Min: 4.38 / Avg: 4.44 / Max: 4.511. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: Vulkan GPU - Model: mnasnet32410.9181.8362.7543.6724.59SE +/- 0.08, N = 3SE +/- 0.09, N = 4SE +/- 0.05, N = 15SE +/- 0.04, N = 34.084.054.043.99MIN: 3.84 / MAX: 9.46MIN: 3.83 / MAX: 5.37MIN: 3.79 / MAX: 16.94MIN: 3.83 / MAX: 5.271. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: Vulkan GPU - Model: mnasnet3241246810Min: 3.96 / Avg: 4.08 / Max: 4.24Min: 3.93 / Avg: 4.05 / Max: 4.33Min: 3.91 / Avg: 4.04 / Max: 4.6Min: 3.95 / Avg: 3.99 / Max: 4.061. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: Vulkan GPU - Model: efficientnet-b034211.2422.4843.7264.9686.21SE +/- 0.10, N = 3SE +/- 0.05, N = 15SE +/- 0.07, N = 4SE +/- 0.02, N = 35.525.445.395.38MIN: 5.31 / MAX: 7.1MIN: 5.23 / MAX: 9.54MIN: 5.21 / MAX: 7.2MIN: 5.28 / MAX: 6.91. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: Vulkan GPU - Model: efficientnet-b03421246810Min: 5.33 / Avg: 5.52 / Max: 5.67Min: 5.28 / Avg: 5.44 / Max: 6.07Min: 5.27 / Avg: 5.39 / Max: 5.6Min: 5.35 / Avg: 5.38 / Max: 5.411. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: Vulkan GPU - Model: blazeface34210.41630.83261.24891.66522.0815SE +/- 0.03, N = 3SE +/- 0.01, N = 15SE +/- 0.04, N = 4SE +/- 0.03, N = 31.851.841.841.84MIN: 1.78 / MAX: 2.35MIN: 1.77 / MAX: 4.09MIN: 1.77 / MAX: 3.2MIN: 1.79 / MAX: 21. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: Vulkan GPU - Model: blazeface3421246810Min: 1.8 / Avg: 1.85 / Max: 1.89Min: 1.79 / Avg: 1.84 / Max: 2Min: 1.79 / Avg: 1.84 / Max: 1.97Min: 1.81 / Avg: 1.84 / Max: 1.891. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: Vulkan GPU - Model: googlenet34213691215SE +/- 0.57, N = 3SE +/- 0.21, N = 15SE +/- 0.48, N = 4SE +/- 0.12, N = 313.5113.3113.1413.03MIN: 12.55 / MAX: 15.7MIN: 12.22 / MAX: 21.56MIN: 12.31 / MAX: 23.44MIN: 12.5 / MAX: 15.431. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: Vulkan GPU - Model: googlenet342148121620Min: 12.81 / Avg: 13.51 / Max: 14.63Min: 12.55 / Avg: 13.31 / Max: 14.67Min: 12.63 / Avg: 13.14 / Max: 14.59Min: 12.86 / Avg: 13.03 / Max: 13.271. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: Vulkan GPU - Model: vgg1642131326395265SE +/- 0.08, N = 15SE +/- 0.10, N = 4SE +/- 0.15, N = 3SE +/- 0.20, N = 357.6857.6857.6157.46MIN: 56.28 / MAX: 76.55MIN: 56.61 / MAX: 63.83MIN: 56.32 / MAX: 71.44MIN: 56.2 / MAX: 65.711. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: Vulkan GPU - Model: vgg1642131122334455Min: 57.18 / Avg: 57.68 / Max: 58.24Min: 57.47 / Avg: 57.68 / Max: 57.96Min: 57.33 / Avg: 57.61 / Max: 57.85Min: 57.25 / Avg: 57.46 / Max: 57.851. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: Vulkan GPU - Model: resnet18234148121620SE +/- 0.27, N = 4SE +/- 0.24, N = 3SE +/- 0.11, N = 15SE +/- 0.03, N = 314.7914.7114.5814.53MIN: 14.17 / MAX: 27.11MIN: 14.34 / MAX: 15.61MIN: 14 / MAX: 25.57MIN: 14.36 / MAX: 16.661. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: Vulkan GPU - Model: resnet18234148121620Min: 14.28 / Avg: 14.79 / Max: 15.27Min: 14.47 / Avg: 14.71 / Max: 15.18Min: 14.1 / Avg: 14.58 / Max: 15.26Min: 14.5 / Avg: 14.53 / Max: 14.581. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: Vulkan GPU - Model: alexnet32143691215SE +/- 0.04, N = 3SE +/- 0.21, N = 4SE +/- 0.11, N = 3SE +/- 0.08, N = 1511.5411.4811.4011.23MIN: 11.24 / MAX: 11.92MIN: 10.83 / MAX: 51.16MIN: 11.13 / MAX: 23.55MIN: 10.76 / MAX: 22.251. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: Vulkan GPU - Model: alexnet32143691215Min: 11.48 / Avg: 11.54 / Max: 11.61Min: 10.91 / Avg: 11.48 / Max: 11.86Min: 11.27 / Avg: 11.4 / Max: 11.61Min: 10.84 / Avg: 11.23 / Max: 11.661. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: Vulkan GPU - Model: resnet502431612182430SE +/- 0.30, N = 4SE +/- 0.22, N = 15SE +/- 0.65, N = 3SE +/- 0.04, N = 326.0725.4925.4724.83MIN: 24.45 / MAX: 57.42MIN: 24.17 / MAX: 47.83MIN: 24.4 / MAX: 28.74MIN: 24.5 / MAX: 25.661. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: Vulkan GPU - Model: resnet502431612182430Min: 25.24 / Avg: 26.07 / Max: 26.52Min: 24.42 / Avg: 25.49 / Max: 26.62Min: 24.62 / Avg: 25.47 / Max: 26.74Min: 24.79 / Avg: 24.83 / Max: 24.911. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: Vulkan GPU - Model: yolov4-tiny2431510152025SE +/- 0.56, N = 4SE +/- 0.22, N = 15SE +/- 0.61, N = 3SE +/- 0.04, N = 321.9221.6921.4520.87MIN: 20.74 / MAX: 31.66MIN: 20.33 / MAX: 31.85MIN: 20.47 / MAX: 75.48MIN: 20.56 / MAX: 23.421. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: Vulkan GPU - Model: yolov4-tiny2431510152025Min: 20.92 / Avg: 21.92 / Max: 23.05Min: 20.57 / Avg: 21.69 / Max: 22.99Min: 20.71 / Avg: 21.45 / Max: 22.66Min: 20.8 / Avg: 20.87 / Max: 20.931. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: Vulkan GPU - Model: squeezenet_ssd241348121620SE +/- 0.06, N = 4SE +/- 0.06, N = 15SE +/- 0.04, N = 3SE +/- 0.26, N = 314.5214.4114.3314.31MIN: 14.15 / MAX: 15.06MIN: 13.63 / MAX: 25.57MIN: 14.03 / MAX: 18.14MIN: 13.61 / MAX: 22.821. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: Vulkan GPU - Model: squeezenet_ssd241348121620Min: 14.43 / Avg: 14.52 / Max: 14.66Min: 13.75 / Avg: 14.41 / Max: 14.68Min: 14.27 / Avg: 14.33 / Max: 14.42Min: 13.79 / Avg: 14.31 / Max: 14.611. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: Vulkan GPU - Model: regnety_400m3142510152025SE +/- 0.07, N = 3SE +/- 0.37, N = 3SE +/- 0.09, N = 15SE +/- 0.07, N = 418.4118.2418.1317.93MIN: 18.12 / MAX: 20.01MIN: 17.68 / MAX: 52.19MIN: 17.55 / MAX: 31.68MIN: 17.68 / MAX: 28.351. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: Vulkan GPU - Model: regnety_400m3142510152025Min: 18.3 / Avg: 18.41 / Max: 18.55Min: 17.82 / Avg: 18.24 / Max: 18.98Min: 17.71 / Avg: 18.13 / Max: 19.03Min: 17.84 / Avg: 17.93 / Max: 18.121. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread