ncnn updated 5950x + rx 6800 xt

AMD Ryzen 9 5950X 16-Core testing with a ASUS ROG CROSSHAIR VIII HERO (WI-FI) (3003 BIOS) and AMD SIENNA_CICHLID 16GB on Ubuntu 20.04 via the Phoronix Test Suite.

Compare your own system(s) to this result file with the Phoronix Test Suite by running the command: phoronix-test-suite benchmark 2012187-PTS-NCNNUPDA37
Jump To Table - Results

View

Do Not Show Noisy Results
Do Not Show Results With Incomplete Data
Do Not Show Results With Little Change/Spread
List Notable Results

Statistics

Show Overall Harmonic Mean(s)
Show Overall Geometric Mean
Show Wins / Losses Counts (Pie Chart)
Normalize Results
Remove Outliers Before Calculating Averages

Graph Settings

Force Line Graphs Where Applicable
Convert To Scalar Where Applicable
Prefer Vertical Bar Graphs

Multi-Way Comparison

Condense Multi-Option Tests Into Single Result Graphs

Table

Show Detailed System Result Table

Run Management

Highlight
Result
Hide
Result
Result
Identifier
Performance Per
Dollar
Date
Run
  Test
  Duration
1
December 18 2020
  4 Hours
2
December 18 2020
  1 Hour, 47 Minutes
3
December 18 2020
  1 Hour, 20 Minutes
4
December 18 2020
  6 Hours, 41 Minutes
Invert Hiding All Results Option
  3 Hours, 27 Minutes

Only show results where is faster than
Only show results matching title/arguments (delimit multiple options with a comma):
Do not show results matching title/arguments (delimit multiple options with a comma):


ncnn updated 5950x + rx 6800 xtProcessorMotherboardChipsetMemoryDiskGraphicsAudioMonitorNetworkOSKernelDesktopDisplay ServerDisplay DriverOpenGLVulkanCompilerFile-SystemScreen Resolution1234AMD Ryzen 9 5950X 16-Core @ 3.40GHz (16 Cores / 32 Threads)ASUS ROG CROSSHAIR VIII HERO (WI-FI) (3003 BIOS)AMD Starship/Matisse16GB2000GB Corsair Force MP600 + 2000GBAMD SIENNA_CICHLID 16GB (2575/1000MHz)AMD Device ab28ASUS MG28URealtek RTL8125 2.5GbE + Intel I211 + Intel Wi-Fi 6 AX200Ubuntu 20.045.10.0-051000rc6daily20201205-generic (x86_64) 20201204GNOME Shell 3.36.4X Server 1.20.8modesetting 1.20.84.6 Mesa 21.0.0-devel (git-e6a6620 2020-12-17 focal-oibaf-ppa) (LLVM 11.0.0)1.2.145GCC 9.3.0ext43840x2160OpenBenchmarking.orgCompiler Details- --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++,gm2 --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none=/build/gcc-9-HskZEa/gcc-9-9.3.0/debian/tmp-nvptx/usr,hsa --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v Processor Details- Scaling Governor: acpi-cpufreq ondemand (Boost: Enabled) - CPU Microcode: 0xa201009Security Details- itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Full AMD retpoline IBPB: conditional IBRS_FW STIBP: always-on RSB filling + srbds: Not affected + tsx_async_abort: Not affected

1234Result OverviewPhoronix Test Suite100%102%103%105%NCNNNCNNNCNNNCNNNCNNNCNNNCNNNCNNNCNNNCNNNCNNNCNNNCNNNCNNNCNNNCNNNCNNNCNNNCNNNCNNNCNNNCNNNCNNNCNNNCNNNCNNNCNNNCNNNCNNNCNNCPU - blazefaceVulkan GPU - yolov4-tinyVulkan GPU - resnet50CPU - googlenetVulkan GPU - googlenetCPU - mnasnetCPU - yolov4-tinyCPU - resnet50CPU - mobilenetVulkan GPU - mobilenetCPU - efficientnet-b0Vulkan GPU - alexnetVulkan GPU - regnety_400mVulkan GPU - efficientnet-b0CPU - alexnetVulkan GPU-v2-v2 - mobilenet-v2Vulkan GPU - mnasnetCPU-v3-v3 - mobilenet-v3Vulkan GPU-v3-v3 - mobilenet-v3CPU-v2-v2 - mobilenet-v2CPU - regnety_400mVulkan GPU - resnet18CPU - resnet18CPU - squeezenet_ssdVulkan GPU - squeezenet_ssdVulkan GPU - shufflenet-v2CPU - shufflenet-v2Vulkan GPU - blazefaceCPU - vgg16Vulkan GPU - vgg16

ncnn updated 5950x + rx 6800 xtncnn: CPU - mobilenetncnn: CPU-v2-v2 - mobilenet-v2ncnn: CPU-v3-v3 - mobilenet-v3ncnn: CPU - mnasnetncnn: CPU - efficientnet-b0ncnn: CPU - blazefacencnn: CPU - googlenetncnn: CPU - vgg16ncnn: CPU - resnet18ncnn: CPU - alexnetncnn: CPU - resnet50ncnn: CPU - yolov4-tinyncnn: CPU - squeezenet_ssdncnn: CPU - regnety_400mncnn: CPU - shufflenet-v2ncnn: Vulkan GPU - mobilenetncnn: Vulkan GPU-v2-v2 - mobilenet-v2ncnn: Vulkan GPU-v3-v3 - mobilenet-v3ncnn: Vulkan GPU - shufflenet-v2ncnn: Vulkan GPU - mnasnetncnn: Vulkan GPU - efficientnet-b0ncnn: Vulkan GPU - blazefacencnn: Vulkan GPU - googlenetncnn: Vulkan GPU - vgg16ncnn: Vulkan GPU - resnet18ncnn: Vulkan GPU - alexnetncnn: Vulkan GPU - resnet50ncnn: Vulkan GPU - yolov4-tinyncnn: Vulkan GPU - squeezenet_ssdncnn: Vulkan GPU - regnety_400m123412.554.464.154.015.401.8412.9957.9314.5611.3025.4721.7314.6717.954.4612.204.464.134.483.995.381.8413.0357.6114.5311.4024.8320.8714.3318.2412.394.404.103.925.301.8212.6957.9614.3911.0225.2121.3414.5617.894.4312.564.494.224.454.055.391.8413.1457.6814.7911.4826.0721.9214.5217.9312.254.494.174.055.451.9313.2957.7214.6411.2525.1121.5014.4518.254.4412.394.424.174.464.085.521.8513.5157.4614.7111.5425.4721.4514.3118.4112.634.464.194.025.381.8413.2657.8614.6111.2225.9322.0414.6317.974.4512.514.524.184.444.045.441.8413.3157.6814.5811.2325.4921.6914.4118.13OpenBenchmarking.org

NCNN

NCNN is a high performance neural network inference framework optimized for mobile and other platforms developed by Tencent. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: CPU - Model: mobilenet32143691215SE +/- 0.20, N = 3SE +/- 0.17, N = 4SE +/- 0.14, N = 15SE +/- 0.11, N = 1512.2512.3912.5512.63MIN: 11.91 / MAX: 13.08MIN: 11.78 / MAX: 13.07MIN: 11.79 / MAX: 49.77MIN: 11.82 / MAX: 22.71. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: CPU - Model: mobilenet321448121620Min: 12.03 / Avg: 12.25 / Max: 12.66Min: 11.94 / Avg: 12.39 / Max: 12.74Min: 11.98 / Avg: 12.55 / Max: 13.65Min: 12 / Avg: 12.63 / Max: 13.491. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: CPU-v2-v2 - Model: mobilenet-v221431.01032.02063.03094.04125.0515SE +/- 0.02, N = 4SE +/- 0.03, N = 15SE +/- 0.03, N = 15SE +/- 0.08, N = 34.404.464.464.49MIN: 4.18 / MAX: 5.95MIN: 4.22 / MAX: 15.2MIN: 4.22 / MAX: 8.58MIN: 4.24 / MAX: 6.181. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: CPU-v2-v2 - Model: mobilenet-v22143246810Min: 4.34 / Avg: 4.4 / Max: 4.42Min: 4.39 / Avg: 4.46 / Max: 4.9Min: 4.39 / Avg: 4.46 / Max: 4.71Min: 4.4 / Avg: 4.49 / Max: 4.651. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: CPU-v3-v3 - Model: mobilenet-v321340.94281.88562.82843.77124.714SE +/- 0.03, N = 4SE +/- 0.03, N = 15SE +/- 0.07, N = 3SE +/- 0.03, N = 154.104.154.174.19MIN: 3.99 / MAX: 5.46MIN: 4.02 / MAX: 6.24MIN: 4.03 / MAX: 5.48MIN: 4.06 / MAX: 27.021. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: CPU-v3-v3 - Model: mobilenet-v32134246810Min: 4.02 / Avg: 4.1 / Max: 4.17Min: 4.05 / Avg: 4.15 / Max: 4.45Min: 4.07 / Avg: 4.17 / Max: 4.3Min: 4.09 / Avg: 4.19 / Max: 4.41. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: CPU - Model: mnasnet21430.91131.82262.73393.64524.5565SE +/- 0.02, N = 4SE +/- 0.04, N = 15SE +/- 0.04, N = 15SE +/- 0.11, N = 33.924.014.024.05MIN: 3.77 / MAX: 4.94MIN: 3.81 / MAX: 6.1MIN: 3.8 / MAX: 5.62MIN: 3.79 / MAX: 4.821. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: CPU - Model: mnasnet2143246810Min: 3.87 / Avg: 3.92 / Max: 3.95Min: 3.9 / Avg: 4.01 / Max: 4.44Min: 3.91 / Avg: 4.02 / Max: 4.28Min: 3.92 / Avg: 4.05 / Max: 4.271. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: CPU - Model: efficientnet-b024131.22632.45263.67894.90526.1315SE +/- 0.02, N = 4SE +/- 0.03, N = 15SE +/- 0.04, N = 15SE +/- 0.11, N = 35.305.385.405.45MIN: 5.2 / MAX: 6.55MIN: 5.21 / MAX: 8.08MIN: 5.21 / MAX: 11.8MIN: 5.22 / MAX: 15.711. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: CPU - Model: efficientnet-b02413246810Min: 5.25 / Avg: 5.3 / Max: 5.33Min: 5.28 / Avg: 5.38 / Max: 5.61Min: 5.29 / Avg: 5.4 / Max: 5.8Min: 5.34 / Avg: 5.45 / Max: 5.671. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: CPU - Model: blazeface21430.43430.86861.30291.73722.1715SE +/- 0.03, N = 4SE +/- 0.02, N = 15SE +/- 0.01, N = 15SE +/- 0.13, N = 31.821.841.841.93MIN: 1.76 / MAX: 2.22MIN: 1.77 / MAX: 3.69MIN: 1.77 / MAX: 2.2MIN: 1.78 / MAX: 54.821. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: CPU - Model: blazeface2143246810Min: 1.77 / Avg: 1.82 / Max: 1.91Min: 1.78 / Avg: 1.84 / Max: 1.95Min: 1.78 / Avg: 1.84 / Max: 1.92Min: 1.79 / Avg: 1.93 / Max: 2.21. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: CPU - Model: googlenet21433691215SE +/- 0.04, N = 4SE +/- 0.15, N = 15SE +/- 0.22, N = 15SE +/- 0.59, N = 312.6912.9913.2613.29MIN: 12.3 / MAX: 13.33MIN: 12.32 / MAX: 24.45MIN: 12.33 / MAX: 24.32MIN: 12.37 / MAX: 45.241. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: CPU - Model: googlenet214348121620Min: 12.58 / Avg: 12.69 / Max: 12.73Min: 12.56 / Avg: 12.99 / Max: 14.91Min: 12.62 / Avg: 13.26 / Max: 14.77Min: 12.64 / Avg: 13.29 / Max: 14.471. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: CPU - Model: vgg1634121326395265SE +/- 0.35, N = 3SE +/- 0.06, N = 15SE +/- 0.07, N = 15SE +/- 0.10, N = 457.7257.8657.9357.96MIN: 56.04 / MAX: 62.77MIN: 56.32 / MAX: 97.91MIN: 56.29 / MAX: 191.26MIN: 56.88 / MAX: 68.651. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: CPU - Model: vgg1634121122334455Min: 57.02 / Avg: 57.72 / Max: 58.07Min: 57.28 / Avg: 57.86 / Max: 58.17Min: 57.32 / Avg: 57.93 / Max: 58.67Min: 57.7 / Avg: 57.96 / Max: 58.171. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: CPU - Model: resnet18214348121620SE +/- 0.09, N = 4SE +/- 0.07, N = 15SE +/- 0.08, N = 15SE +/- 0.33, N = 314.3914.5614.6114.64MIN: 14.18 / MAX: 18.31MIN: 14.13 / MAX: 27.65MIN: 14.2 / MAX: 46.42MIN: 14.21 / MAX: 16.421. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: CPU - Model: resnet18214348121620Min: 14.27 / Avg: 14.39 / Max: 14.66Min: 14.25 / Avg: 14.56 / Max: 15.31Min: 14.31 / Avg: 14.61 / Max: 15.11Min: 14.31 / Avg: 14.64 / Max: 15.291. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: CPU - Model: alexnet24313691215SE +/- 0.14, N = 4SE +/- 0.08, N = 15SE +/- 0.35, N = 3SE +/- 0.08, N = 1511.0211.2211.2511.30MIN: 10.77 / MAX: 11.72MIN: 10.81 / MAX: 32.79MIN: 10.82 / MAX: 12.32MIN: 10.78 / MAX: 33.731. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: CPU - Model: alexnet24313691215Min: 10.86 / Avg: 11.02 / Max: 11.43Min: 10.89 / Avg: 11.22 / Max: 11.75Min: 10.9 / Avg: 11.25 / Max: 11.96Min: 10.86 / Avg: 11.3 / Max: 11.841. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: CPU - Model: resnet503214612182430SE +/- 0.48, N = 3SE +/- 0.34, N = 4SE +/- 0.18, N = 15SE +/- 0.21, N = 1525.1125.2125.4725.93MIN: 24.35 / MAX: 26.82MIN: 24.42 / MAX: 36.51MIN: 24.19 / MAX: 49.11MIN: 24.27 / MAX: 38.921. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: CPU - Model: resnet503214612182430Min: 24.63 / Avg: 25.11 / Max: 26.06Min: 24.7 / Avg: 25.21 / Max: 26.22Min: 24.5 / Avg: 25.47 / Max: 26.72Min: 24.56 / Avg: 25.93 / Max: 26.871. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: CPU - Model: yolov4-tiny2314510152025SE +/- 0.42, N = 4SE +/- 0.65, N = 3SE +/- 0.24, N = 15SE +/- 0.24, N = 1521.3421.5021.7322.04MIN: 20.53 / MAX: 27.41MIN: 20.57 / MAX: 31MIN: 20.42 / MAX: 55.87MIN: 20.45 / MAX: 31.561. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: CPU - Model: yolov4-tiny2314510152025Min: 20.82 / Avg: 21.34 / Max: 22.61Min: 20.83 / Avg: 21.5 / Max: 22.8Min: 20.66 / Avg: 21.73 / Max: 23.35Min: 20.66 / Avg: 22.04 / Max: 231. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: CPU - Model: squeezenet_ssd324148121620SE +/- 0.06, N = 3SE +/- 0.05, N = 4SE +/- 0.07, N = 14SE +/- 0.06, N = 1314.4514.5614.6314.67MIN: 14.1 / MAX: 18.73MIN: 14.05 / MAX: 30.66MIN: 13.7 / MAX: 25.32MIN: 14.05 / MAX: 17.241. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: CPU - Model: squeezenet_ssd324148121620Min: 14.34 / Avg: 14.45 / Max: 14.51Min: 14.42 / Avg: 14.56 / Max: 14.64Min: 13.91 / Avg: 14.63 / Max: 15.12Min: 14.4 / Avg: 14.67 / Max: 15.121. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: CPU - Model: regnety_400m214348121620SE +/- 0.10, N = 4SE +/- 0.04, N = 15SE +/- 0.05, N = 15SE +/- 0.38, N = 317.8917.9517.9718.25MIN: 17.51 / MAX: 19.12MIN: 17.59 / MAX: 28.89MIN: 17.57 / MAX: 24.73MIN: 17.57 / MAX: 28.631. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: CPU - Model: regnety_400m2143510152025Min: 17.65 / Avg: 17.89 / Max: 18.13Min: 17.73 / Avg: 17.95 / Max: 18.21Min: 17.72 / Avg: 17.97 / Max: 18.27Min: 17.76 / Avg: 18.25 / Max: 18.991. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: CPU - Model: shufflenet-v223411.00352.0073.01054.0145.0175SE +/- 0.02, N = 4SE +/- 0.01, N = 3SE +/- 0.01, N = 14SE +/- 0.01, N = 134.434.444.454.46MIN: 4.34 / MAX: 5.3MIN: 4.39 / MAX: 5.93MIN: 4.38 / MAX: 9.11MIN: 4.38 / MAX: 15.651. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: CPU - Model: shufflenet-v22341246810Min: 4.38 / Avg: 4.43 / Max: 4.46Min: 4.42 / Avg: 4.44 / Max: 4.45Min: 4.42 / Avg: 4.45 / Max: 4.51Min: 4.42 / Avg: 4.46 / Max: 4.531. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: Vulkan GPU - Model: mobilenet13423691215SE +/- 0.16, N = 3SE +/- 0.01, N = 3SE +/- 0.14, N = 15SE +/- 0.17, N = 412.2012.3912.5112.56MIN: 11.86 / MAX: 12.96MIN: 11.87 / MAX: 40.91MIN: 11.8 / MAX: 30.08MIN: 11.93 / MAX: 13.441. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: Vulkan GPU - Model: mobilenet134248121620Min: 11.99 / Avg: 12.2 / Max: 12.52Min: 12.37 / Avg: 12.39 / Max: 12.41Min: 12 / Avg: 12.51 / Max: 13.86Min: 12.13 / Avg: 12.56 / Max: 12.841. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: Vulkan GPU-v2-v2 - Model: mobilenet-v231241.0172.0343.0514.0685.085SE +/- 0.01, N = 3SE +/- 0.04, N = 3SE +/- 0.06, N = 4SE +/- 0.06, N = 154.424.464.494.52MIN: 4.23 / MAX: 5.89MIN: 4.2 / MAX: 5.95MIN: 4.24 / MAX: 6.12MIN: 4.19 / MAX: 45.881. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: Vulkan GPU-v2-v2 - Model: mobilenet-v23124246810Min: 4.4 / Avg: 4.42 / Max: 4.44Min: 4.39 / Avg: 4.46 / Max: 4.54Min: 4.42 / Avg: 4.49 / Max: 4.67Min: 4.38 / Avg: 4.52 / Max: 5.221. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: Vulkan GPU-v3-v3 - Model: mobilenet-v313420.94951.8992.84853.7984.7475SE +/- 0.03, N = 3SE +/- 0.04, N = 3SE +/- 0.04, N = 15SE +/- 0.04, N = 44.134.174.184.22MIN: 4.05 / MAX: 5.58MIN: 4.02 / MAX: 35.81MIN: 4 / MAX: 5.78MIN: 4.12 / MAX: 5.781. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: Vulkan GPU-v3-v3 - Model: mobilenet-v31342246810Min: 4.09 / Avg: 4.13 / Max: 4.18Min: 4.1 / Avg: 4.17 / Max: 4.25Min: 4.03 / Avg: 4.18 / Max: 4.61Min: 4.15 / Avg: 4.22 / Max: 4.341. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: Vulkan GPU - Model: shufflenet-v242311.0082.0163.0244.0325.04SE +/- 0.01, N = 15SE +/- 0.01, N = 4SE +/- 0.01, N = 3SE +/- 0.02, N = 34.444.454.464.48MIN: 4.33 / MAX: 9.44MIN: 4.37 / MAX: 7.43MIN: 4.4 / MAX: 6.53MIN: 4.41 / MAX: 5.451. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: Vulkan GPU - Model: shufflenet-v24231246810Min: 4.38 / Avg: 4.44 / Max: 4.51Min: 4.42 / Avg: 4.45 / Max: 4.48Min: 4.45 / Avg: 4.46 / Max: 4.47Min: 4.45 / Avg: 4.48 / Max: 4.521. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: Vulkan GPU - Model: mnasnet14230.9181.8362.7543.6724.59SE +/- 0.04, N = 3SE +/- 0.05, N = 15SE +/- 0.09, N = 4SE +/- 0.08, N = 33.994.044.054.08MIN: 3.83 / MAX: 5.27MIN: 3.79 / MAX: 16.94MIN: 3.83 / MAX: 5.37MIN: 3.84 / MAX: 9.461. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: Vulkan GPU - Model: mnasnet1423246810Min: 3.95 / Avg: 3.99 / Max: 4.06Min: 3.91 / Avg: 4.04 / Max: 4.6Min: 3.93 / Avg: 4.05 / Max: 4.33Min: 3.96 / Avg: 4.08 / Max: 4.241. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: Vulkan GPU - Model: efficientnet-b012431.2422.4843.7264.9686.21SE +/- 0.02, N = 3SE +/- 0.07, N = 4SE +/- 0.05, N = 15SE +/- 0.10, N = 35.385.395.445.52MIN: 5.28 / MAX: 6.9MIN: 5.21 / MAX: 7.2MIN: 5.23 / MAX: 9.54MIN: 5.31 / MAX: 7.11. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: Vulkan GPU - Model: efficientnet-b01243246810Min: 5.35 / Avg: 5.38 / Max: 5.41Min: 5.27 / Avg: 5.39 / Max: 5.6Min: 5.28 / Avg: 5.44 / Max: 6.07Min: 5.33 / Avg: 5.52 / Max: 5.671. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: Vulkan GPU - Model: blazeface12430.41630.83261.24891.66522.0815SE +/- 0.03, N = 3SE +/- 0.04, N = 4SE +/- 0.01, N = 15SE +/- 0.03, N = 31.841.841.841.85MIN: 1.79 / MAX: 2MIN: 1.77 / MAX: 3.2MIN: 1.77 / MAX: 4.09MIN: 1.78 / MAX: 2.351. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: Vulkan GPU - Model: blazeface1243246810Min: 1.81 / Avg: 1.84 / Max: 1.89Min: 1.79 / Avg: 1.84 / Max: 1.97Min: 1.79 / Avg: 1.84 / Max: 2Min: 1.8 / Avg: 1.85 / Max: 1.891. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: Vulkan GPU - Model: googlenet12433691215SE +/- 0.12, N = 3SE +/- 0.48, N = 4SE +/- 0.21, N = 15SE +/- 0.57, N = 313.0313.1413.3113.51MIN: 12.5 / MAX: 15.43MIN: 12.31 / MAX: 23.44MIN: 12.22 / MAX: 21.56MIN: 12.55 / MAX: 15.71. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: Vulkan GPU - Model: googlenet124348121620Min: 12.86 / Avg: 13.03 / Max: 13.27Min: 12.63 / Avg: 13.14 / Max: 14.59Min: 12.55 / Avg: 13.31 / Max: 14.67Min: 12.81 / Avg: 13.51 / Max: 14.631. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: Vulkan GPU - Model: vgg1631241326395265SE +/- 0.20, N = 3SE +/- 0.15, N = 3SE +/- 0.10, N = 4SE +/- 0.08, N = 1557.4657.6157.6857.68MIN: 56.2 / MAX: 65.71MIN: 56.32 / MAX: 71.44MIN: 56.61 / MAX: 63.83MIN: 56.28 / MAX: 76.551. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: Vulkan GPU - Model: vgg1631241122334455Min: 57.25 / Avg: 57.46 / Max: 57.85Min: 57.33 / Avg: 57.61 / Max: 57.85Min: 57.47 / Avg: 57.68 / Max: 57.96Min: 57.18 / Avg: 57.68 / Max: 58.241. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: Vulkan GPU - Model: resnet18143248121620SE +/- 0.03, N = 3SE +/- 0.11, N = 15SE +/- 0.24, N = 3SE +/- 0.27, N = 414.5314.5814.7114.79MIN: 14.36 / MAX: 16.66MIN: 14 / MAX: 25.57MIN: 14.34 / MAX: 15.61MIN: 14.17 / MAX: 27.111. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: Vulkan GPU - Model: resnet18143248121620Min: 14.5 / Avg: 14.53 / Max: 14.58Min: 14.1 / Avg: 14.58 / Max: 15.26Min: 14.47 / Avg: 14.71 / Max: 15.18Min: 14.28 / Avg: 14.79 / Max: 15.271. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: Vulkan GPU - Model: alexnet41233691215SE +/- 0.08, N = 15SE +/- 0.11, N = 3SE +/- 0.21, N = 4SE +/- 0.04, N = 311.2311.4011.4811.54MIN: 10.76 / MAX: 22.25MIN: 11.13 / MAX: 23.55MIN: 10.83 / MAX: 51.16MIN: 11.24 / MAX: 11.921. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: Vulkan GPU - Model: alexnet41233691215Min: 10.84 / Avg: 11.23 / Max: 11.66Min: 11.27 / Avg: 11.4 / Max: 11.61Min: 10.91 / Avg: 11.48 / Max: 11.86Min: 11.48 / Avg: 11.54 / Max: 11.611. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: Vulkan GPU - Model: resnet501342612182430SE +/- 0.04, N = 3SE +/- 0.65, N = 3SE +/- 0.22, N = 15SE +/- 0.30, N = 424.8325.4725.4926.07MIN: 24.5 / MAX: 25.66MIN: 24.4 / MAX: 28.74MIN: 24.17 / MAX: 47.83MIN: 24.45 / MAX: 57.421. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: Vulkan GPU - Model: resnet501342612182430Min: 24.79 / Avg: 24.83 / Max: 24.91Min: 24.62 / Avg: 25.47 / Max: 26.74Min: 24.42 / Avg: 25.49 / Max: 26.62Min: 25.24 / Avg: 26.07 / Max: 26.521. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: Vulkan GPU - Model: yolov4-tiny1342510152025SE +/- 0.04, N = 3SE +/- 0.61, N = 3SE +/- 0.22, N = 15SE +/- 0.56, N = 420.8721.4521.6921.92MIN: 20.56 / MAX: 23.42MIN: 20.47 / MAX: 75.48MIN: 20.33 / MAX: 31.85MIN: 20.74 / MAX: 31.661. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: Vulkan GPU - Model: yolov4-tiny1342510152025Min: 20.8 / Avg: 20.87 / Max: 20.93Min: 20.71 / Avg: 21.45 / Max: 22.66Min: 20.57 / Avg: 21.69 / Max: 22.99Min: 20.92 / Avg: 21.92 / Max: 23.051. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: Vulkan GPU - Model: squeezenet_ssd314248121620SE +/- 0.26, N = 3SE +/- 0.04, N = 3SE +/- 0.06, N = 15SE +/- 0.06, N = 414.3114.3314.4114.52MIN: 13.61 / MAX: 22.82MIN: 14.03 / MAX: 18.14MIN: 13.63 / MAX: 25.57MIN: 14.15 / MAX: 15.061. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: Vulkan GPU - Model: squeezenet_ssd314248121620Min: 13.79 / Avg: 14.31 / Max: 14.61Min: 14.27 / Avg: 14.33 / Max: 14.42Min: 13.75 / Avg: 14.41 / Max: 14.68Min: 14.43 / Avg: 14.52 / Max: 14.661. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: Vulkan GPU - Model: regnety_400m2413510152025SE +/- 0.07, N = 4SE +/- 0.09, N = 15SE +/- 0.37, N = 3SE +/- 0.07, N = 317.9318.1318.2418.41MIN: 17.68 / MAX: 28.35MIN: 17.55 / MAX: 31.68MIN: 17.68 / MAX: 52.19MIN: 18.12 / MAX: 20.011. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: Vulkan GPU - Model: regnety_400m2413510152025Min: 17.84 / Avg: 17.93 / Max: 18.12Min: 17.71 / Avg: 18.13 / Max: 19.03Min: 17.82 / Avg: 18.24 / Max: 18.98Min: 18.3 / Avg: 18.41 / Max: 18.551. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread