ncnn updated 5950x + rx 6800 xt

AMD Ryzen 9 5950X 16-Core testing with a ASUS ROG CROSSHAIR VIII HERO (WI-FI) (3003 BIOS) and AMD SIENNA_CICHLID 16GB on Ubuntu 20.04 via the Phoronix Test Suite.

Compare your own system(s) to this result file with the Phoronix Test Suite by running the command: phoronix-test-suite benchmark 2012187-PTS-NCNNUPDA37
Jump To Table - Results

View

Do Not Show Noisy Results
Do Not Show Results With Incomplete Data
Do Not Show Results With Little Change/Spread
List Notable Results

Statistics

Show Overall Harmonic Mean(s)
Show Overall Geometric Mean
Show Wins / Losses Counts (Pie Chart)
Normalize Results
Remove Outliers Before Calculating Averages

Graph Settings

Force Line Graphs Where Applicable
Convert To Scalar Where Applicable
Prefer Vertical Bar Graphs

Multi-Way Comparison

Condense Multi-Option Tests Into Single Result Graphs

Table

Show Detailed System Result Table

Run Management

Highlight
Result
Hide
Result
Result
Identifier
Performance Per
Dollar
Date
Run
  Test
  Duration
1
December 18 2020
  4 Hours
2
December 18 2020
  1 Hour, 47 Minutes
3
December 18 2020
  1 Hour, 20 Minutes
4
December 18 2020
  6 Hours, 41 Minutes
Invert Hiding All Results Option
  3 Hours, 27 Minutes

Only show results where is faster than
Only show results matching title/arguments (delimit multiple options with a comma):
Do not show results matching title/arguments (delimit multiple options with a comma):


ncnn updated 5950x + rx 6800 xtProcessorMotherboardChipsetMemoryDiskGraphicsAudioMonitorNetworkOSKernelDesktopDisplay ServerDisplay DriverOpenGLVulkanCompilerFile-SystemScreen Resolution1234AMD Ryzen 9 5950X 16-Core @ 3.40GHz (16 Cores / 32 Threads)ASUS ROG CROSSHAIR VIII HERO (WI-FI) (3003 BIOS)AMD Starship/Matisse16GB2000GB Corsair Force MP600 + 2000GBAMD SIENNA_CICHLID 16GB (2575/1000MHz)AMD Device ab28ASUS MG28URealtek RTL8125 2.5GbE + Intel I211 + Intel Wi-Fi 6 AX200Ubuntu 20.045.10.0-051000rc6daily20201205-generic (x86_64) 20201204GNOME Shell 3.36.4X Server 1.20.8modesetting 1.20.84.6 Mesa 21.0.0-devel (git-e6a6620 2020-12-17 focal-oibaf-ppa) (LLVM 11.0.0)1.2.145GCC 9.3.0ext43840x2160OpenBenchmarking.orgCompiler Details- --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++,gm2 --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none=/build/gcc-9-HskZEa/gcc-9-9.3.0/debian/tmp-nvptx/usr,hsa --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v Processor Details- Scaling Governor: acpi-cpufreq ondemand (Boost: Enabled) - CPU Microcode: 0xa201009Security Details- itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Full AMD retpoline IBPB: conditional IBRS_FW STIBP: always-on RSB filling + srbds: Not affected + tsx_async_abort: Not affected

1234Result OverviewPhoronix Test Suite100%102%103%105%NCNNNCNNNCNNNCNNNCNNNCNNNCNNNCNNNCNNNCNNNCNNNCNNNCNNNCNNNCNNNCNNNCNNNCNNNCNNNCNNNCNNNCNNNCNNNCNNNCNNNCNNNCNNNCNNNCNNNCNNCPU - blazefaceVulkan GPU - yolov4-tinyVulkan GPU - resnet50CPU - googlenetVulkan GPU - googlenetCPU - mnasnetCPU - yolov4-tinyCPU - resnet50CPU - mobilenetVulkan GPU - mobilenetCPU - efficientnet-b0Vulkan GPU - alexnetVulkan GPU - regnety_400mVulkan GPU - efficientnet-b0CPU - alexnetVulkan GPU-v2-v2 - mobilenet-v2Vulkan GPU - mnasnetCPU-v3-v3 - mobilenet-v3Vulkan GPU-v3-v3 - mobilenet-v3CPU-v2-v2 - mobilenet-v2CPU - regnety_400mVulkan GPU - resnet18CPU - resnet18CPU - squeezenet_ssdVulkan GPU - squeezenet_ssdVulkan GPU - shufflenet-v2CPU - shufflenet-v2Vulkan GPU - blazefaceCPU - vgg16Vulkan GPU - vgg16

ncnn updated 5950x + rx 6800 xtncnn: CPU - mobilenetncnn: CPU-v2-v2 - mobilenet-v2ncnn: CPU-v3-v3 - mobilenet-v3ncnn: CPU - mnasnetncnn: CPU - efficientnet-b0ncnn: CPU - blazefacencnn: CPU - googlenetncnn: CPU - vgg16ncnn: CPU - resnet18ncnn: CPU - alexnetncnn: CPU - resnet50ncnn: CPU - yolov4-tinyncnn: CPU - squeezenet_ssdncnn: CPU - regnety_400mncnn: CPU - shufflenet-v2ncnn: Vulkan GPU - mobilenetncnn: Vulkan GPU-v2-v2 - mobilenet-v2ncnn: Vulkan GPU-v3-v3 - mobilenet-v3ncnn: Vulkan GPU - shufflenet-v2ncnn: Vulkan GPU - mnasnetncnn: Vulkan GPU - efficientnet-b0ncnn: Vulkan GPU - blazefacencnn: Vulkan GPU - googlenetncnn: Vulkan GPU - vgg16ncnn: Vulkan GPU - resnet18ncnn: Vulkan GPU - alexnetncnn: Vulkan GPU - resnet50ncnn: Vulkan GPU - yolov4-tinyncnn: Vulkan GPU - squeezenet_ssdncnn: Vulkan GPU - regnety_400m123412.554.464.154.015.401.8412.9957.9314.5611.3025.4721.7314.6717.954.4612.204.464.134.483.995.381.8413.0357.6114.5311.4024.8320.8714.3318.2412.394.404.103.925.301.8212.6957.9614.3911.0225.2121.3414.5617.894.4312.564.494.224.454.055.391.8413.1457.6814.7911.4826.0721.9214.5217.9312.254.494.174.055.451.9313.2957.7214.6411.2525.1121.5014.4518.254.4412.394.424.174.464.085.521.8513.5157.4614.7111.5425.4721.4514.3118.4112.634.464.194.025.381.8413.2657.8614.6111.2225.9322.0414.6317.974.4512.514.524.184.444.045.441.8413.3157.6814.5811.2325.4921.6914.4118.13OpenBenchmarking.org

NCNN

NCNN is a high performance neural network inference framework optimized for mobile and other platforms developed by Tencent. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: CPU - Model: mobilenet12343691215SE +/- 0.14, N = 15SE +/- 0.17, N = 4SE +/- 0.20, N = 3SE +/- 0.11, N = 1512.5512.3912.2512.63MIN: 11.79 / MAX: 49.77MIN: 11.78 / MAX: 13.07MIN: 11.91 / MAX: 13.08MIN: 11.82 / MAX: 22.71. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: CPU - Model: mobilenet123448121620Min: 11.98 / Avg: 12.55 / Max: 13.65Min: 11.94 / Avg: 12.39 / Max: 12.74Min: 12.03 / Avg: 12.25 / Max: 12.66Min: 12 / Avg: 12.63 / Max: 13.491. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: CPU-v2-v2 - Model: mobilenet-v212341.01032.02063.03094.04125.0515SE +/- 0.03, N = 15SE +/- 0.02, N = 4SE +/- 0.08, N = 3SE +/- 0.03, N = 154.464.404.494.46MIN: 4.22 / MAX: 15.2MIN: 4.18 / MAX: 5.95MIN: 4.24 / MAX: 6.18MIN: 4.22 / MAX: 8.581. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: CPU-v2-v2 - Model: mobilenet-v21234246810Min: 4.39 / Avg: 4.46 / Max: 4.9Min: 4.34 / Avg: 4.4 / Max: 4.42Min: 4.4 / Avg: 4.49 / Max: 4.65Min: 4.39 / Avg: 4.46 / Max: 4.711. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: CPU-v3-v3 - Model: mobilenet-v312340.94281.88562.82843.77124.714SE +/- 0.03, N = 15SE +/- 0.03, N = 4SE +/- 0.07, N = 3SE +/- 0.03, N = 154.154.104.174.19MIN: 4.02 / MAX: 6.24MIN: 3.99 / MAX: 5.46MIN: 4.03 / MAX: 5.48MIN: 4.06 / MAX: 27.021. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: CPU-v3-v3 - Model: mobilenet-v31234246810Min: 4.05 / Avg: 4.15 / Max: 4.45Min: 4.02 / Avg: 4.1 / Max: 4.17Min: 4.07 / Avg: 4.17 / Max: 4.3Min: 4.09 / Avg: 4.19 / Max: 4.41. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: CPU - Model: mnasnet12340.91131.82262.73393.64524.5565SE +/- 0.04, N = 15SE +/- 0.02, N = 4SE +/- 0.11, N = 3SE +/- 0.04, N = 154.013.924.054.02MIN: 3.81 / MAX: 6.1MIN: 3.77 / MAX: 4.94MIN: 3.79 / MAX: 4.82MIN: 3.8 / MAX: 5.621. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: CPU - Model: mnasnet1234246810Min: 3.9 / Avg: 4.01 / Max: 4.44Min: 3.87 / Avg: 3.92 / Max: 3.95Min: 3.92 / Avg: 4.05 / Max: 4.27Min: 3.91 / Avg: 4.02 / Max: 4.281. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: CPU - Model: efficientnet-b012341.22632.45263.67894.90526.1315SE +/- 0.04, N = 15SE +/- 0.02, N = 4SE +/- 0.11, N = 3SE +/- 0.03, N = 155.405.305.455.38MIN: 5.21 / MAX: 11.8MIN: 5.2 / MAX: 6.55MIN: 5.22 / MAX: 15.71MIN: 5.21 / MAX: 8.081. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: CPU - Model: efficientnet-b01234246810Min: 5.29 / Avg: 5.4 / Max: 5.8Min: 5.25 / Avg: 5.3 / Max: 5.33Min: 5.34 / Avg: 5.45 / Max: 5.67Min: 5.28 / Avg: 5.38 / Max: 5.611. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: CPU - Model: blazeface12340.43430.86861.30291.73722.1715SE +/- 0.02, N = 15SE +/- 0.03, N = 4SE +/- 0.13, N = 3SE +/- 0.01, N = 151.841.821.931.84MIN: 1.77 / MAX: 3.69MIN: 1.76 / MAX: 2.22MIN: 1.78 / MAX: 54.82MIN: 1.77 / MAX: 2.21. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: CPU - Model: blazeface1234246810Min: 1.78 / Avg: 1.84 / Max: 1.95Min: 1.77 / Avg: 1.82 / Max: 1.91Min: 1.79 / Avg: 1.93 / Max: 2.2Min: 1.78 / Avg: 1.84 / Max: 1.921. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: CPU - Model: googlenet12343691215SE +/- 0.15, N = 15SE +/- 0.04, N = 4SE +/- 0.59, N = 3SE +/- 0.22, N = 1512.9912.6913.2913.26MIN: 12.32 / MAX: 24.45MIN: 12.3 / MAX: 13.33MIN: 12.37 / MAX: 45.24MIN: 12.33 / MAX: 24.321. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: CPU - Model: googlenet123448121620Min: 12.56 / Avg: 12.99 / Max: 14.91Min: 12.58 / Avg: 12.69 / Max: 12.73Min: 12.64 / Avg: 13.29 / Max: 14.47Min: 12.62 / Avg: 13.26 / Max: 14.771. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: CPU - Model: vgg1612341326395265SE +/- 0.07, N = 15SE +/- 0.10, N = 4SE +/- 0.35, N = 3SE +/- 0.06, N = 1557.9357.9657.7257.86MIN: 56.29 / MAX: 191.26MIN: 56.88 / MAX: 68.65MIN: 56.04 / MAX: 62.77MIN: 56.32 / MAX: 97.911. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: CPU - Model: vgg1612341122334455Min: 57.32 / Avg: 57.93 / Max: 58.67Min: 57.7 / Avg: 57.96 / Max: 58.17Min: 57.02 / Avg: 57.72 / Max: 58.07Min: 57.28 / Avg: 57.86 / Max: 58.171. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: CPU - Model: resnet18123448121620SE +/- 0.07, N = 15SE +/- 0.09, N = 4SE +/- 0.33, N = 3SE +/- 0.08, N = 1514.5614.3914.6414.61MIN: 14.13 / MAX: 27.65MIN: 14.18 / MAX: 18.31MIN: 14.21 / MAX: 16.42MIN: 14.2 / MAX: 46.421. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: CPU - Model: resnet18123448121620Min: 14.25 / Avg: 14.56 / Max: 15.31Min: 14.27 / Avg: 14.39 / Max: 14.66Min: 14.31 / Avg: 14.64 / Max: 15.29Min: 14.31 / Avg: 14.61 / Max: 15.111. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: CPU - Model: alexnet12343691215SE +/- 0.08, N = 15SE +/- 0.14, N = 4SE +/- 0.35, N = 3SE +/- 0.08, N = 1511.3011.0211.2511.22MIN: 10.78 / MAX: 33.73MIN: 10.77 / MAX: 11.72MIN: 10.82 / MAX: 12.32MIN: 10.81 / MAX: 32.791. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: CPU - Model: alexnet12343691215Min: 10.86 / Avg: 11.3 / Max: 11.84Min: 10.86 / Avg: 11.02 / Max: 11.43Min: 10.9 / Avg: 11.25 / Max: 11.96Min: 10.89 / Avg: 11.22 / Max: 11.751. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: CPU - Model: resnet501234612182430SE +/- 0.18, N = 15SE +/- 0.34, N = 4SE +/- 0.48, N = 3SE +/- 0.21, N = 1525.4725.2125.1125.93MIN: 24.19 / MAX: 49.11MIN: 24.42 / MAX: 36.51MIN: 24.35 / MAX: 26.82MIN: 24.27 / MAX: 38.921. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: CPU - Model: resnet501234612182430Min: 24.5 / Avg: 25.47 / Max: 26.72Min: 24.7 / Avg: 25.21 / Max: 26.22Min: 24.63 / Avg: 25.11 / Max: 26.06Min: 24.56 / Avg: 25.93 / Max: 26.871. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: CPU - Model: yolov4-tiny1234510152025SE +/- 0.24, N = 15SE +/- 0.42, N = 4SE +/- 0.65, N = 3SE +/- 0.24, N = 1521.7321.3421.5022.04MIN: 20.42 / MAX: 55.87MIN: 20.53 / MAX: 27.41MIN: 20.57 / MAX: 31MIN: 20.45 / MAX: 31.561. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: CPU - Model: yolov4-tiny1234510152025Min: 20.66 / Avg: 21.73 / Max: 23.35Min: 20.82 / Avg: 21.34 / Max: 22.61Min: 20.83 / Avg: 21.5 / Max: 22.8Min: 20.66 / Avg: 22.04 / Max: 231. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: CPU - Model: squeezenet_ssd123448121620SE +/- 0.06, N = 13SE +/- 0.05, N = 4SE +/- 0.06, N = 3SE +/- 0.07, N = 1414.6714.5614.4514.63MIN: 14.05 / MAX: 17.24MIN: 14.05 / MAX: 30.66MIN: 14.1 / MAX: 18.73MIN: 13.7 / MAX: 25.321. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: CPU - Model: squeezenet_ssd123448121620Min: 14.4 / Avg: 14.67 / Max: 15.12Min: 14.42 / Avg: 14.56 / Max: 14.64Min: 14.34 / Avg: 14.45 / Max: 14.51Min: 13.91 / Avg: 14.63 / Max: 15.121. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: CPU - Model: regnety_400m123448121620SE +/- 0.04, N = 15SE +/- 0.10, N = 4SE +/- 0.38, N = 3SE +/- 0.05, N = 1517.9517.8918.2517.97MIN: 17.59 / MAX: 28.89MIN: 17.51 / MAX: 19.12MIN: 17.57 / MAX: 28.63MIN: 17.57 / MAX: 24.731. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: CPU - Model: regnety_400m1234510152025Min: 17.73 / Avg: 17.95 / Max: 18.21Min: 17.65 / Avg: 17.89 / Max: 18.13Min: 17.76 / Avg: 18.25 / Max: 18.99Min: 17.72 / Avg: 17.97 / Max: 18.271. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: CPU - Model: shufflenet-v212341.00352.0073.01054.0145.0175SE +/- 0.01, N = 13SE +/- 0.02, N = 4SE +/- 0.01, N = 3SE +/- 0.01, N = 144.464.434.444.45MIN: 4.38 / MAX: 15.65MIN: 4.34 / MAX: 5.3MIN: 4.39 / MAX: 5.93MIN: 4.38 / MAX: 9.111. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: CPU - Model: shufflenet-v21234246810Min: 4.42 / Avg: 4.46 / Max: 4.53Min: 4.38 / Avg: 4.43 / Max: 4.46Min: 4.42 / Avg: 4.44 / Max: 4.45Min: 4.42 / Avg: 4.45 / Max: 4.511. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: Vulkan GPU - Model: mobilenet12343691215SE +/- 0.16, N = 3SE +/- 0.17, N = 4SE +/- 0.01, N = 3SE +/- 0.14, N = 1512.2012.5612.3912.51MIN: 11.86 / MAX: 12.96MIN: 11.93 / MAX: 13.44MIN: 11.87 / MAX: 40.91MIN: 11.8 / MAX: 30.081. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: Vulkan GPU - Model: mobilenet123448121620Min: 11.99 / Avg: 12.2 / Max: 12.52Min: 12.13 / Avg: 12.56 / Max: 12.84Min: 12.37 / Avg: 12.39 / Max: 12.41Min: 12 / Avg: 12.51 / Max: 13.861. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: Vulkan GPU-v2-v2 - Model: mobilenet-v212341.0172.0343.0514.0685.085SE +/- 0.04, N = 3SE +/- 0.06, N = 4SE +/- 0.01, N = 3SE +/- 0.06, N = 154.464.494.424.52MIN: 4.2 / MAX: 5.95MIN: 4.24 / MAX: 6.12MIN: 4.23 / MAX: 5.89MIN: 4.19 / MAX: 45.881. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: Vulkan GPU-v2-v2 - Model: mobilenet-v21234246810Min: 4.39 / Avg: 4.46 / Max: 4.54Min: 4.42 / Avg: 4.49 / Max: 4.67Min: 4.4 / Avg: 4.42 / Max: 4.44Min: 4.38 / Avg: 4.52 / Max: 5.221. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: Vulkan GPU-v3-v3 - Model: mobilenet-v312340.94951.8992.84853.7984.7475SE +/- 0.03, N = 3SE +/- 0.04, N = 4SE +/- 0.04, N = 3SE +/- 0.04, N = 154.134.224.174.18MIN: 4.05 / MAX: 5.58MIN: 4.12 / MAX: 5.78MIN: 4.02 / MAX: 35.81MIN: 4 / MAX: 5.781. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: Vulkan GPU-v3-v3 - Model: mobilenet-v31234246810Min: 4.09 / Avg: 4.13 / Max: 4.18Min: 4.15 / Avg: 4.22 / Max: 4.34Min: 4.1 / Avg: 4.17 / Max: 4.25Min: 4.03 / Avg: 4.18 / Max: 4.611. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: Vulkan GPU - Model: shufflenet-v212341.0082.0163.0244.0325.04SE +/- 0.02, N = 3SE +/- 0.01, N = 4SE +/- 0.01, N = 3SE +/- 0.01, N = 154.484.454.464.44MIN: 4.41 / MAX: 5.45MIN: 4.37 / MAX: 7.43MIN: 4.4 / MAX: 6.53MIN: 4.33 / MAX: 9.441. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: Vulkan GPU - Model: shufflenet-v21234246810Min: 4.45 / Avg: 4.48 / Max: 4.52Min: 4.42 / Avg: 4.45 / Max: 4.48Min: 4.45 / Avg: 4.46 / Max: 4.47Min: 4.38 / Avg: 4.44 / Max: 4.511. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: Vulkan GPU - Model: mnasnet12340.9181.8362.7543.6724.59SE +/- 0.04, N = 3SE +/- 0.09, N = 4SE +/- 0.08, N = 3SE +/- 0.05, N = 153.994.054.084.04MIN: 3.83 / MAX: 5.27MIN: 3.83 / MAX: 5.37MIN: 3.84 / MAX: 9.46MIN: 3.79 / MAX: 16.941. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: Vulkan GPU - Model: mnasnet1234246810Min: 3.95 / Avg: 3.99 / Max: 4.06Min: 3.93 / Avg: 4.05 / Max: 4.33Min: 3.96 / Avg: 4.08 / Max: 4.24Min: 3.91 / Avg: 4.04 / Max: 4.61. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: Vulkan GPU - Model: efficientnet-b012341.2422.4843.7264.9686.21SE +/- 0.02, N = 3SE +/- 0.07, N = 4SE +/- 0.10, N = 3SE +/- 0.05, N = 155.385.395.525.44MIN: 5.28 / MAX: 6.9MIN: 5.21 / MAX: 7.2MIN: 5.31 / MAX: 7.1MIN: 5.23 / MAX: 9.541. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: Vulkan GPU - Model: efficientnet-b01234246810Min: 5.35 / Avg: 5.38 / Max: 5.41Min: 5.27 / Avg: 5.39 / Max: 5.6Min: 5.33 / Avg: 5.52 / Max: 5.67Min: 5.28 / Avg: 5.44 / Max: 6.071. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: Vulkan GPU - Model: blazeface12340.41630.83261.24891.66522.0815SE +/- 0.03, N = 3SE +/- 0.04, N = 4SE +/- 0.03, N = 3SE +/- 0.01, N = 151.841.841.851.84MIN: 1.79 / MAX: 2MIN: 1.77 / MAX: 3.2MIN: 1.78 / MAX: 2.35MIN: 1.77 / MAX: 4.091. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: Vulkan GPU - Model: blazeface1234246810Min: 1.81 / Avg: 1.84 / Max: 1.89Min: 1.79 / Avg: 1.84 / Max: 1.97Min: 1.8 / Avg: 1.85 / Max: 1.89Min: 1.79 / Avg: 1.84 / Max: 21. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: Vulkan GPU - Model: googlenet12343691215SE +/- 0.12, N = 3SE +/- 0.48, N = 4SE +/- 0.57, N = 3SE +/- 0.21, N = 1513.0313.1413.5113.31MIN: 12.5 / MAX: 15.43MIN: 12.31 / MAX: 23.44MIN: 12.55 / MAX: 15.7MIN: 12.22 / MAX: 21.561. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: Vulkan GPU - Model: googlenet123448121620Min: 12.86 / Avg: 13.03 / Max: 13.27Min: 12.63 / Avg: 13.14 / Max: 14.59Min: 12.81 / Avg: 13.51 / Max: 14.63Min: 12.55 / Avg: 13.31 / Max: 14.671. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: Vulkan GPU - Model: vgg1612341326395265SE +/- 0.15, N = 3SE +/- 0.10, N = 4SE +/- 0.20, N = 3SE +/- 0.08, N = 1557.6157.6857.4657.68MIN: 56.32 / MAX: 71.44MIN: 56.61 / MAX: 63.83MIN: 56.2 / MAX: 65.71MIN: 56.28 / MAX: 76.551. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: Vulkan GPU - Model: vgg1612341122334455Min: 57.33 / Avg: 57.61 / Max: 57.85Min: 57.47 / Avg: 57.68 / Max: 57.96Min: 57.25 / Avg: 57.46 / Max: 57.85Min: 57.18 / Avg: 57.68 / Max: 58.241. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: Vulkan GPU - Model: resnet18123448121620SE +/- 0.03, N = 3SE +/- 0.27, N = 4SE +/- 0.24, N = 3SE +/- 0.11, N = 1514.5314.7914.7114.58MIN: 14.36 / MAX: 16.66MIN: 14.17 / MAX: 27.11MIN: 14.34 / MAX: 15.61MIN: 14 / MAX: 25.571. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: Vulkan GPU - Model: resnet18123448121620Min: 14.5 / Avg: 14.53 / Max: 14.58Min: 14.28 / Avg: 14.79 / Max: 15.27Min: 14.47 / Avg: 14.71 / Max: 15.18Min: 14.1 / Avg: 14.58 / Max: 15.261. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: Vulkan GPU - Model: alexnet12343691215SE +/- 0.11, N = 3SE +/- 0.21, N = 4SE +/- 0.04, N = 3SE +/- 0.08, N = 1511.4011.4811.5411.23MIN: 11.13 / MAX: 23.55MIN: 10.83 / MAX: 51.16MIN: 11.24 / MAX: 11.92MIN: 10.76 / MAX: 22.251. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: Vulkan GPU - Model: alexnet12343691215Min: 11.27 / Avg: 11.4 / Max: 11.61Min: 10.91 / Avg: 11.48 / Max: 11.86Min: 11.48 / Avg: 11.54 / Max: 11.61Min: 10.84 / Avg: 11.23 / Max: 11.661. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: Vulkan GPU - Model: resnet501234612182430SE +/- 0.04, N = 3SE +/- 0.30, N = 4SE +/- 0.65, N = 3SE +/- 0.22, N = 1524.8326.0725.4725.49MIN: 24.5 / MAX: 25.66MIN: 24.45 / MAX: 57.42MIN: 24.4 / MAX: 28.74MIN: 24.17 / MAX: 47.831. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: Vulkan GPU - Model: resnet501234612182430Min: 24.79 / Avg: 24.83 / Max: 24.91Min: 25.24 / Avg: 26.07 / Max: 26.52Min: 24.62 / Avg: 25.47 / Max: 26.74Min: 24.42 / Avg: 25.49 / Max: 26.621. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: Vulkan GPU - Model: yolov4-tiny1234510152025SE +/- 0.04, N = 3SE +/- 0.56, N = 4SE +/- 0.61, N = 3SE +/- 0.22, N = 1520.8721.9221.4521.69MIN: 20.56 / MAX: 23.42MIN: 20.74 / MAX: 31.66MIN: 20.47 / MAX: 75.48MIN: 20.33 / MAX: 31.851. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: Vulkan GPU - Model: yolov4-tiny1234510152025Min: 20.8 / Avg: 20.87 / Max: 20.93Min: 20.92 / Avg: 21.92 / Max: 23.05Min: 20.71 / Avg: 21.45 / Max: 22.66Min: 20.57 / Avg: 21.69 / Max: 22.991. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: Vulkan GPU - Model: squeezenet_ssd123448121620SE +/- 0.04, N = 3SE +/- 0.06, N = 4SE +/- 0.26, N = 3SE +/- 0.06, N = 1514.3314.5214.3114.41MIN: 14.03 / MAX: 18.14MIN: 14.15 / MAX: 15.06MIN: 13.61 / MAX: 22.82MIN: 13.63 / MAX: 25.571. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: Vulkan GPU - Model: squeezenet_ssd123448121620Min: 14.27 / Avg: 14.33 / Max: 14.42Min: 14.43 / Avg: 14.52 / Max: 14.66Min: 13.79 / Avg: 14.31 / Max: 14.61Min: 13.75 / Avg: 14.41 / Max: 14.681. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: Vulkan GPU - Model: regnety_400m1234510152025SE +/- 0.37, N = 3SE +/- 0.07, N = 4SE +/- 0.07, N = 3SE +/- 0.09, N = 1518.2417.9318.4118.13MIN: 17.68 / MAX: 52.19MIN: 17.68 / MAX: 28.35MIN: 18.12 / MAX: 20.01MIN: 17.55 / MAX: 31.681. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: Vulkan GPU - Model: regnety_400m1234510152025Min: 17.82 / Avg: 18.24 / Max: 18.98Min: 17.84 / Avg: 17.93 / Max: 18.12Min: 18.3 / Avg: 18.41 / Max: 18.55Min: 17.71 / Avg: 18.13 / Max: 19.031. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread