ncnn 10900k dec

Intel Core i9-10900K testing with a Gigabyte Z490 AORUS MASTER (F3 BIOS) and Gigabyte AMD Radeon RX 5500/5500M / Pro 5500M 8GB on Ubuntu 20.10 via the Phoronix Test Suite.

Compare your own system(s) to this result file with the Phoronix Test Suite by running the command: phoronix-test-suite benchmark 2012191-HA-NCNN1090077
Jump To Table - Results

View

Do Not Show Noisy Results
Do Not Show Results With Incomplete Data
Do Not Show Results With Little Change/Spread
List Notable Results

Statistics

Show Overall Harmonic Mean(s)
Show Overall Geometric Mean
Show Wins / Losses Counts (Pie Chart)
Normalize Results
Remove Outliers Before Calculating Averages

Graph Settings

Force Line Graphs Where Applicable
Convert To Scalar Where Applicable
Prefer Vertical Bar Graphs

Multi-Way Comparison

Condense Multi-Option Tests Into Single Result Graphs

Table

Show Detailed System Result Table

Run Management

Highlight
Result
Hide
Result
Result
Identifier
View Logs
Performance Per
Dollar
Date
Run
  Test
  Duration
1
December 19 2020
  1 Hour, 27 Minutes
2
December 19 2020
  1 Hour, 26 Minutes
3
December 19 2020
  1 Hour, 26 Minutes
4
December 19 2020
  1 Hour, 26 Minutes
5
December 19 2020
  1 Hour, 26 Minutes
Invert Hiding All Results Option
  1 Hour, 26 Minutes

Only show results where is faster than
Only show results matching title/arguments (delimit multiple options with a comma):
Do not show results matching title/arguments (delimit multiple options with a comma):


ncnn 10900k decProcessorMotherboardChipsetMemoryDiskGraphicsAudioMonitorNetworkOSKernelDesktopDisplay ServerDisplay DriverOpenGLVulkanCompilerFile-SystemScreen Resolution12345Intel Core i9-10900K @ 5.30GHz (10 Cores / 20 Threads)Gigabyte Z490 AORUS MASTER (F3 BIOS)Intel Comet Lake PCH16GBSamsung SSD 970 EVO 250GBGigabyte AMD Radeon RX 5500/5500M / Pro 5500M 8GB (1890/875MHz)Realtek ALC1220ASUS MG28UIntel + Intel Wi-Fi 6 AX201Ubuntu 20.105.8.0-31-generic (x86_64)GNOME Shell 3.38.1X Server 1.20.9modesetting 1.20.94.6 Mesa 20.2.1 (LLVM 11.0.0)1.2.131GCC 10.2.0ext43840x2160OpenBenchmarking.orgCompiler Details- --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none=/build/gcc-10-JvwpWM/gcc-10-10.2.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-10-JvwpWM/gcc-10-10.2.0/debian/tmp-gcn/usr,hsa --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v Processor Details- Scaling Governor: intel_pstate powersave - CPU Microcode: 0xe0 - Thermald 2.3Security Details- itlb_multihit: KVM: Mitigation of VMX disabled + l1tf: Not affected + mds: Not affected + meltdown: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced IBRS IBPB: conditional RSB filling + srbds: Not affected + tsx_async_abort: Not affected

12345Result OverviewPhoronix Test Suite100%112%123%135%NCNNNCNNNCNNNCNNNCNNNCNNNCNNNCNNNCNNNCNNNCNNNCNNNCNNNCNNNCNNNCNNNCNNNCNNNCNNNCNNNCNNNCNNNCNNNCNNNCNNNCNNNCNNNCNNNCNNNCNNCPU - googlenetVulkan GPU - mnasnetVulkan GPU - mobilenetCPU - mnasnetVulkan GPU - blazefaceCPU - shufflenet-v2Vulkan GPU - efficientnet-b0CPU - resnet18Vulkan GPU-v3-v3 - mobilenet-v3Vulkan GPU-v2-v2 - mobilenet-v2CPU - regnety_400mVulkan GPU - regnety_400mVulkan GPU - shufflenet-v2CPU - mobilenetCPU - yolov4-tinyCPU - efficientnet-b0Vulkan GPU - yolov4-tinyVulkan GPU - vgg16Vulkan GPU - resnet50CPU-v3-v3 - mobilenet-v3CPU - resnet50CPU-v2-v2 - mobilenet-v2Vulkan GPU - googlenetVulkan GPU - resnet18CPU - squeezenet_ssdCPU - vgg16CPU - blazefaceVulkan GPU - alexnetCPU - alexnetVulkan GPU - squeezenet_ssd

ncnn 10900k decncnn: CPU - mobilenetncnn: CPU-v2-v2 - mobilenet-v2ncnn: CPU-v3-v3 - mobilenet-v3ncnn: CPU - shufflenet-v2ncnn: CPU - mnasnetncnn: CPU - efficientnet-b0ncnn: CPU - blazefacencnn: CPU - googlenetncnn: CPU - vgg16ncnn: CPU - resnet18ncnn: CPU - alexnetncnn: CPU - resnet50ncnn: CPU - yolov4-tinyncnn: CPU - squeezenet_ssdncnn: CPU - regnety_400mncnn: Vulkan GPU - mobilenetncnn: Vulkan GPU-v2-v2 - mobilenet-v2ncnn: Vulkan GPU-v3-v3 - mobilenet-v3ncnn: Vulkan GPU - shufflenet-v2ncnn: Vulkan GPU - mnasnetncnn: Vulkan GPU - efficientnet-b0ncnn: Vulkan GPU - blazefacencnn: Vulkan GPU - googlenetncnn: Vulkan GPU - vgg16ncnn: Vulkan GPU - resnet18ncnn: Vulkan GPU - alexnetncnn: Vulkan GPU - resnet50ncnn: Vulkan GPU - yolov4-tinyncnn: Vulkan GPU - squeezenet_ssdncnn: Vulkan GPU - regnety_400m1234516.214.933.874.413.815.891.6018.7661.9813.7412.0624.3824.0517.8913.2416.684.943.834.353.805.911.5812.8862.0313.4112.0124.2024.0917.8612.9816.194.943.884.373.795.901.5912.8962.0913.4312.0024.0823.6717.7413.1916.124.963.884.403.936.001.6112.8661.6613.4612.0024.3023.8117.8513.1516.424.983.914.483.925.921.6012.8462.1813.4311.9924.3423.7417.8813.1616.204.973.884.363.795.871.5712.8562.5013.4612.0024.3623.9617.8213.0216.134.983.874.413.825.831.5913.0262.3913.4512.0224.0923.8217.8313.1516.154.963.914.433.835.861.5912.9962.5113.4812.0424.0923.7917.8313.2316.174.993.924.433.835.861.5912.8862.2313.4412.0224.0823.7517.8812.9816.164.873.884.383.875.901.5912.9662.2813.5511.9724.0323.7617.7613.11OpenBenchmarking.org

NCNN

NCNN is a high performance neural network inference framework optimized for mobile and other platforms developed by Tencent. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: CPU - Model: mobilenet1234548121620SE +/- 0.04, N = 3SE +/- 0.00, N = 3SE +/- 0.24, N = 3SE +/- 0.03, N = 3SE +/- 0.02, N = 316.2116.1916.4216.1316.17MIN: 16.02 / MAX: 16.98MIN: 16.12 / MAX: 16.95MIN: 16.1 / MAX: 17.16MIN: 15.83 / MAX: 17.26MIN: 15.99 / MAX: 16.971. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: CPU - Model: mobilenet1234548121620Min: 16.15 / Avg: 16.21 / Max: 16.29Min: 16.19 / Avg: 16.19 / Max: 16.2Min: 16.17 / Avg: 16.42 / Max: 16.9Min: 16.1 / Avg: 16.13 / Max: 16.19Min: 16.14 / Avg: 16.17 / Max: 16.221. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: CPU-v2-v2 - Model: mobilenet-v2123451.12282.24563.36844.49125.614SE +/- 0.02, N = 3SE +/- 0.03, N = 3SE +/- 0.02, N = 3SE +/- 0.01, N = 3SE +/- 0.00, N = 34.934.944.984.984.99MIN: 4.69 / MAX: 5.98MIN: 4.66 / MAX: 6.31MIN: 4.83 / MAX: 6.23MIN: 4.85 / MAX: 6.2MIN: 4.86 / MAX: 6.411. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: CPU-v2-v2 - Model: mobilenet-v212345246810Min: 4.91 / Avg: 4.93 / Max: 4.97Min: 4.87 / Avg: 4.94 / Max: 4.97Min: 4.95 / Avg: 4.98 / Max: 5.01Min: 4.96 / Avg: 4.98 / Max: 5Min: 4.98 / Avg: 4.99 / Max: 4.991. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: CPU-v3-v3 - Model: mobilenet-v3123450.8821.7642.6463.5284.41SE +/- 0.02, N = 3SE +/- 0.02, N = 3SE +/- 0.02, N = 3SE +/- 0.03, N = 3SE +/- 0.01, N = 33.873.883.913.873.92MIN: 3.8 / MAX: 5.15MIN: 3.81 / MAX: 5.37MIN: 3.83 / MAX: 5.53MIN: 3.68 / MAX: 5.34MIN: 3.87 / MAX: 4.981. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: CPU-v3-v3 - Model: mobilenet-v312345246810Min: 3.84 / Avg: 3.87 / Max: 3.91Min: 3.84 / Avg: 3.88 / Max: 3.92Min: 3.88 / Avg: 3.91 / Max: 3.94Min: 3.82 / Avg: 3.87 / Max: 3.93Min: 3.91 / Avg: 3.92 / Max: 3.931. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: CPU - Model: shufflenet-v2123451.0082.0163.0244.0325.04SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.07, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 34.414.374.484.414.43MIN: 4.29 / MAX: 5.6MIN: 4.31 / MAX: 5.75MIN: 4.33 / MAX: 5.58MIN: 4.36 / MAX: 5.73MIN: 4.35 / MAX: 5.391. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: CPU - Model: shufflenet-v212345246810Min: 4.4 / Avg: 4.41 / Max: 4.42Min: 4.35 / Avg: 4.37 / Max: 4.39Min: 4.39 / Avg: 4.48 / Max: 4.61Min: 4.4 / Avg: 4.41 / Max: 4.43Min: 4.41 / Avg: 4.43 / Max: 4.451. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: CPU - Model: mnasnet123450.8821.7642.6463.5284.41SE +/- 0.00, N = 2SE +/- 0.01, N = 3SE +/- 0.11, N = 3SE +/- 0.01, N = 3SE +/- 0.00, N = 33.813.793.923.823.83MIN: 3.77 / MAX: 4.58MIN: 3.76 / MAX: 5.14MIN: 3.77 / MAX: 5.14MIN: 3.78 / MAX: 5.23MIN: 3.79 / MAX: 4.871. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: CPU - Model: mnasnet12345246810Min: 3.81 / Avg: 3.81 / Max: 3.81Min: 3.78 / Avg: 3.79 / Max: 3.81Min: 3.79 / Avg: 3.92 / Max: 4.15Min: 3.8 / Avg: 3.82 / Max: 3.83Min: 3.82 / Avg: 3.83 / Max: 3.831. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: CPU - Model: efficientnet-b0123451.3322.6643.9965.3286.66SE +/- 0.05, N = 3SE +/- 0.03, N = 3SE +/- 0.02, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 35.895.905.925.835.86MIN: 5.65 / MAX: 10.92MIN: 5.67 / MAX: 7.36MIN: 5.83 / MAX: 7.12MIN: 5.63 / MAX: 7.06MIN: 5.67 / MAX: 7.341. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: CPU - Model: efficientnet-b012345246810Min: 5.82 / Avg: 5.89 / Max: 5.98Min: 5.84 / Avg: 5.9 / Max: 5.94Min: 5.89 / Avg: 5.92 / Max: 5.95Min: 5.81 / Avg: 5.83 / Max: 5.86Min: 5.84 / Avg: 5.86 / Max: 5.871. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: CPU - Model: blazeface123450.360.721.081.441.8SE +/- 0.01, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 31.601.591.601.591.59MIN: 1.57 / MAX: 1.81MIN: 1.57 / MAX: 1.64MIN: 1.57 / MAX: 2.96MIN: 1.57 / MAX: 1.63MIN: 1.57 / MAX: 1.631. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: CPU - Model: blazeface12345246810Min: 1.59 / Avg: 1.6 / Max: 1.61Min: 1.59 / Avg: 1.59 / Max: 1.6Min: 1.59 / Avg: 1.6 / Max: 1.6Min: 1.58 / Avg: 1.59 / Max: 1.59Min: 1.59 / Avg: 1.59 / Max: 1.591. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: CPU - Model: googlenet12345510152025SE +/- 5.74, N = 3SE +/- 0.01, N = 3SE +/- 0.05, N = 3SE +/- 0.04, N = 3SE +/- 0.03, N = 318.7612.8912.8413.0212.88MIN: 12.6 / MAX: 2024.54MIN: 12.59 / MAX: 13.73MIN: 12.5 / MAX: 20.39MIN: 12.66 / MAX: 13.92MIN: 12.59 / MAX: 13.851. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: CPU - Model: googlenet12345510152025Min: 13 / Avg: 18.76 / Max: 30.24Min: 12.88 / Avg: 12.89 / Max: 12.9Min: 12.79 / Avg: 12.84 / Max: 12.94Min: 12.96 / Avg: 13.02 / Max: 13.1Min: 12.85 / Avg: 12.88 / Max: 12.931. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: CPU - Model: vgg16123451428425670SE +/- 0.30, N = 3SE +/- 0.18, N = 3SE +/- 0.13, N = 3SE +/- 0.28, N = 3SE +/- 0.11, N = 361.9862.0962.1862.3962.23MIN: 61.46 / MAX: 75.82MIN: 61.46 / MAX: 63.12MIN: 61.69 / MAX: 67.41MIN: 61.82 / MAX: 63.73MIN: 61.76 / MAX: 74.651. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: CPU - Model: vgg16123451224364860Min: 61.6 / Avg: 61.98 / Max: 62.56Min: 61.73 / Avg: 62.09 / Max: 62.28Min: 61.93 / Avg: 62.18 / Max: 62.32Min: 61.99 / Avg: 62.39 / Max: 62.92Min: 62.05 / Avg: 62.23 / Max: 62.441. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: CPU - Model: resnet181234548121620SE +/- 0.25, N = 3SE +/- 0.01, N = 3SE +/- 0.06, N = 3SE +/- 0.00, N = 3SE +/- 0.02, N = 313.7413.4313.4313.4513.44MIN: 13.23 / MAX: 20.94MIN: 13.25 / MAX: 14.26MIN: 13.21 / MAX: 14.31MIN: 13.23 / MAX: 14.24MIN: 13.23 / MAX: 14.661. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: CPU - Model: resnet181234548121620Min: 13.46 / Avg: 13.74 / Max: 14.24Min: 13.41 / Avg: 13.43 / Max: 13.44Min: 13.33 / Avg: 13.43 / Max: 13.52Min: 13.44 / Avg: 13.45 / Max: 13.45Min: 13.39 / Avg: 13.44 / Max: 13.471. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: CPU - Model: alexnet123453691215SE +/- 0.02, N = 3SE +/- 0.02, N = 3SE +/- 0.03, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 312.0612.0011.9912.0212.02MIN: 11.91 / MAX: 20.31MIN: 11.85 / MAX: 13.25MIN: 11.85 / MAX: 19.49MIN: 11.9 / MAX: 12.81MIN: 11.91 / MAX: 13.11. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: CPU - Model: alexnet1234548121620Min: 12.01 / Avg: 12.06 / Max: 12.08Min: 11.96 / Avg: 12 / Max: 12.03Min: 11.93 / Avg: 11.99 / Max: 12.02Min: 12.01 / Avg: 12.02 / Max: 12.04Min: 12.01 / Avg: 12.02 / Max: 12.031. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: CPU - Model: resnet5012345612182430SE +/- 0.30, N = 3SE +/- 0.02, N = 3SE +/- 0.19, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 324.3824.0824.3424.0924.08MIN: 23.64 / MAX: 25.8MIN: 23.56 / MAX: 25.79MIN: 23.65 / MAX: 26.1MIN: 23.89 / MAX: 24.87MIN: 23.56 / MAX: 24.921. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: CPU - Model: resnet5012345612182430Min: 24.04 / Avg: 24.38 / Max: 24.98Min: 24.05 / Avg: 24.08 / Max: 24.12Min: 24.14 / Avg: 24.34 / Max: 24.72Min: 24.06 / Avg: 24.09 / Max: 24.11Min: 24.06 / Avg: 24.08 / Max: 24.111. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: CPU - Model: yolov4-tiny12345612182430SE +/- 0.33, N = 3SE +/- 0.06, N = 3SE +/- 0.02, N = 3SE +/- 0.07, N = 3SE +/- 0.02, N = 324.0523.6723.7423.8223.75MIN: 23.51 / MAX: 25.63MIN: 23.42 / MAX: 24.62MIN: 23.49 / MAX: 31.58MIN: 23.44 / MAX: 26.33MIN: 23.35 / MAX: 24.751. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: CPU - Model: yolov4-tiny12345612182430Min: 23.68 / Avg: 24.05 / Max: 24.7Min: 23.57 / Avg: 23.67 / Max: 23.78Min: 23.71 / Avg: 23.74 / Max: 23.77Min: 23.68 / Avg: 23.82 / Max: 23.92Min: 23.71 / Avg: 23.75 / Max: 23.781. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: CPU - Model: squeezenet_ssd1234548121620SE +/- 0.13, N = 3SE +/- 0.01, N = 3SE +/- 0.13, N = 3SE +/- 0.05, N = 3SE +/- 0.01, N = 317.8917.7417.8817.8317.88MIN: 17.63 / MAX: 18.61MIN: 17.62 / MAX: 18.48MIN: 17.65 / MAX: 18.51MIN: 17.45 / MAX: 18.66MIN: 17.79 / MAX: 21.811. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: CPU - Model: squeezenet_ssd12345510152025Min: 17.68 / Avg: 17.89 / Max: 18.13Min: 17.72 / Avg: 17.74 / Max: 17.76Min: 17.72 / Avg: 17.88 / Max: 18.14Min: 17.73 / Avg: 17.83 / Max: 17.88Min: 17.86 / Avg: 17.88 / Max: 17.911. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: CPU - Model: regnety_400m123453691215SE +/- 0.14, N = 3SE +/- 0.11, N = 3SE +/- 0.08, N = 3SE +/- 0.06, N = 3SE +/- 0.03, N = 313.2413.1913.1613.1512.98MIN: 12.86 / MAX: 21.35MIN: 12.93 / MAX: 14.63MIN: 12.96 / MAX: 14.78MIN: 12.88 / MAX: 14.64MIN: 12.85 / MAX: 14.391. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: CPU - Model: regnety_400m1234548121620Min: 12.96 / Avg: 13.24 / Max: 13.42Min: 13 / Avg: 13.19 / Max: 13.37Min: 13.04 / Avg: 13.16 / Max: 13.32Min: 13.04 / Avg: 13.15 / Max: 13.25Min: 12.94 / Avg: 12.98 / Max: 13.051. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: Vulkan GPU - Model: mobilenet1234548121620SE +/- 0.26, N = 3SE +/- 0.01, N = 3SE +/- 0.05, N = 3SE +/- 0.04, N = 3SE +/- 0.02, N = 316.6816.1216.2016.1516.16MIN: 16.08 / MAX: 17.74MIN: 16 / MAX: 23.01MIN: 16 / MAX: 16.85MIN: 16 / MAX: 16.99MIN: 16 / MAX: 18.261. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: Vulkan GPU - Model: mobilenet1234548121620Min: 16.16 / Avg: 16.68 / Max: 16.95Min: 16.1 / Avg: 16.12 / Max: 16.14Min: 16.14 / Avg: 16.2 / Max: 16.3Min: 16.11 / Avg: 16.15 / Max: 16.23Min: 16.12 / Avg: 16.16 / Max: 16.191. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: Vulkan GPU-v2-v2 - Model: mobilenet-v2123451.11832.23663.35494.47325.5915SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.03, N = 3SE +/- 0.01, N = 34.944.964.974.964.87MIN: 4.73 / MAX: 6.5MIN: 4.67 / MAX: 6.31MIN: 4.81 / MAX: 6.41MIN: 4.68 / MAX: 6.28MIN: 4.68 / MAX: 6.191. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: Vulkan GPU-v2-v2 - Model: mobilenet-v212345246810Min: 4.92 / Avg: 4.94 / Max: 4.95Min: 4.94 / Avg: 4.96 / Max: 4.97Min: 4.94 / Avg: 4.97 / Max: 4.98Min: 4.91 / Avg: 4.96 / Max: 5Min: 4.86 / Avg: 4.87 / Max: 4.891. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: Vulkan GPU-v3-v3 - Model: mobilenet-v3123450.87981.75962.63943.51924.399SE +/- 0.04, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.02, N = 3SE +/- 0.02, N = 33.833.883.883.913.88MIN: 3.7 / MAX: 4.86MIN: 3.81 / MAX: 6.21MIN: 3.83 / MAX: 5.24MIN: 3.83 / MAX: 4.98MIN: 3.79 / MAX: 4.931. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: Vulkan GPU-v3-v3 - Model: mobilenet-v312345246810Min: 3.76 / Avg: 3.83 / Max: 3.88Min: 3.86 / Avg: 3.88 / Max: 3.89Min: 3.86 / Avg: 3.88 / Max: 3.9Min: 3.89 / Avg: 3.91 / Max: 3.95Min: 3.84 / Avg: 3.88 / Max: 3.911. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: Vulkan GPU - Model: shufflenet-v2123450.99681.99362.99043.98724.984SE +/- 0.01, N = 3SE +/- 0.04, N = 3SE +/- 0.01, N = 3SE +/- 0.02, N = 3SE +/- 0.03, N = 34.354.404.364.434.38MIN: 4.29 / MAX: 5.67MIN: 4.29 / MAX: 5.8MIN: 4.3 / MAX: 5.78MIN: 4.35 / MAX: 5.33MIN: 4.28 / MAX: 5.651. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: Vulkan GPU - Model: shufflenet-v212345246810Min: 4.34 / Avg: 4.35 / Max: 4.37Min: 4.34 / Avg: 4.4 / Max: 4.49Min: 4.34 / Avg: 4.36 / Max: 4.38Min: 4.4 / Avg: 4.43 / Max: 4.45Min: 4.32 / Avg: 4.38 / Max: 4.411. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: Vulkan GPU - Model: mnasnet123450.88431.76862.65293.53724.4215SE +/- 0.01, N = 3SE +/- 0.13, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.06, N = 33.803.933.793.833.87MIN: 3.75 / MAX: 5.21MIN: 3.76 / MAX: 5.53MIN: 3.75 / MAX: 5.18MIN: 3.79 / MAX: 4.87MIN: 3.74 / MAX: 5.571. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: Vulkan GPU - Model: mnasnet12345246810Min: 3.79 / Avg: 3.8 / Max: 3.82Min: 3.8 / Avg: 3.93 / Max: 4.18Min: 3.78 / Avg: 3.79 / Max: 3.8Min: 3.82 / Avg: 3.83 / Max: 3.84Min: 3.81 / Avg: 3.87 / Max: 3.991. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: Vulkan GPU - Model: efficientnet-b012345246810SE +/- 0.02, N = 3SE +/- 0.13, N = 3SE +/- 0.04, N = 3SE +/- 0.03, N = 3SE +/- 0.02, N = 35.916.005.875.865.90MIN: 5.69 / MAX: 7.29MIN: 5.65 / MAX: 6.95MIN: 5.64 / MAX: 7.33MIN: 5.66 / MAX: 6.89MIN: 5.66 / MAX: 9.611. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: Vulkan GPU - Model: efficientnet-b012345246810Min: 5.87 / Avg: 5.91 / Max: 5.94Min: 5.86 / Avg: 6 / Max: 6.25Min: 5.8 / Avg: 5.87 / Max: 5.92Min: 5.81 / Avg: 5.86 / Max: 5.9Min: 5.88 / Avg: 5.9 / Max: 5.941. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: Vulkan GPU - Model: blazeface123450.36230.72461.08691.44921.8115SE +/- 0.00, N = 3SE +/- 0.02, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.00, N = 31.581.611.571.591.59MIN: 1.55 / MAX: 2.05MIN: 1.56 / MAX: 2.34MIN: 1.51 / MAX: 2.35MIN: 1.57 / MAX: 1.81MIN: 1.56 / MAX: 2.041. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: Vulkan GPU - Model: blazeface12345246810Min: 1.57 / Avg: 1.58 / Max: 1.58Min: 1.58 / Avg: 1.61 / Max: 1.65Min: 1.55 / Avg: 1.57 / Max: 1.59Min: 1.58 / Avg: 1.59 / Max: 1.6Min: 1.59 / Avg: 1.59 / Max: 1.591. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: Vulkan GPU - Model: googlenet123453691215SE +/- 0.00, N = 3SE +/- 0.01, N = 3SE +/- 0.02, N = 3SE +/- 0.03, N = 3SE +/- 0.05, N = 312.8812.8612.8512.9912.96MIN: 12.56 / MAX: 13.75MIN: 12.56 / MAX: 13.19MIN: 12.56 / MAX: 13.71MIN: 12.59 / MAX: 14.33MIN: 12.63 / MAX: 13.881. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: Vulkan GPU - Model: googlenet1234548121620Min: 12.88 / Avg: 12.88 / Max: 12.89Min: 12.84 / Avg: 12.86 / Max: 12.88Min: 12.81 / Avg: 12.85 / Max: 12.89Min: 12.93 / Avg: 12.99 / Max: 13.03Min: 12.87 / Avg: 12.96 / Max: 13.051. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: Vulkan GPU - Model: vgg16123451428425670SE +/- 0.02, N = 3SE +/- 0.04, N = 3SE +/- 0.39, N = 3SE +/- 0.24, N = 3SE +/- 0.14, N = 362.0361.6662.5062.5162.28MIN: 61.82 / MAX: 66.09MIN: 61.46 / MAX: 68.61MIN: 61.54 / MAX: 63.92MIN: 61.75 / MAX: 69.6MIN: 61.92 / MAX: 71.611. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: Vulkan GPU - Model: vgg16123451224364860Min: 62 / Avg: 62.03 / Max: 62.07Min: 61.59 / Avg: 61.66 / Max: 61.7Min: 61.78 / Avg: 62.5 / Max: 63.11Min: 62.04 / Avg: 62.51 / Max: 62.76Min: 62.11 / Avg: 62.28 / Max: 62.571. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: Vulkan GPU - Model: resnet18123453691215SE +/- 0.00, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.07, N = 313.4113.4613.4613.4813.55MIN: 13.23 / MAX: 14.19MIN: 13.27 / MAX: 14.21MIN: 13.24 / MAX: 14.24MIN: 13.24 / MAX: 14.9MIN: 13.21 / MAX: 14.281. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: Vulkan GPU - Model: resnet181234548121620Min: 13.41 / Avg: 13.41 / Max: 13.41Min: 13.44 / Avg: 13.46 / Max: 13.48Min: 13.44 / Avg: 13.46 / Max: 13.48Min: 13.47 / Avg: 13.48 / Max: 13.5Min: 13.45 / Avg: 13.55 / Max: 13.691. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: Vulkan GPU - Model: alexnet123453691215SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.02, N = 3SE +/- 0.02, N = 3SE +/- 0.01, N = 312.0112.0012.0012.0411.97MIN: 11.9 / MAX: 12.84MIN: 11.9 / MAX: 12.85MIN: 11.83 / MAX: 12.84MIN: 11.91 / MAX: 12.83MIN: 11.88 / MAX: 12.721. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: Vulkan GPU - Model: alexnet1234548121620Min: 12 / Avg: 12.01 / Max: 12.03Min: 11.98 / Avg: 12 / Max: 12.02Min: 11.97 / Avg: 12 / Max: 12.03Min: 12.01 / Avg: 12.04 / Max: 12.06Min: 11.95 / Avg: 11.97 / Max: 11.991. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: Vulkan GPU - Model: resnet5012345612182430SE +/- 0.10, N = 3SE +/- 0.22, N = 3SE +/- 0.26, N = 3SE +/- 0.01, N = 3SE +/- 0.03, N = 324.2024.3024.3624.0924.03MIN: 23.56 / MAX: 25.4MIN: 23.53 / MAX: 25.57MIN: 23.6 / MAX: 25.7MIN: 23.62 / MAX: 26.99MIN: 23.62 / MAX: 24.81. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: Vulkan GPU - Model: resnet5012345612182430Min: 24.08 / Avg: 24.2 / Max: 24.41Min: 24.05 / Avg: 24.3 / Max: 24.74Min: 24.08 / Avg: 24.36 / Max: 24.88Min: 24.07 / Avg: 24.09 / Max: 24.11Min: 24 / Avg: 24.03 / Max: 24.081. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: Vulkan GPU - Model: yolov4-tiny12345612182430SE +/- 0.35, N = 3SE +/- 0.11, N = 3SE +/- 0.19, N = 3SE +/- 0.10, N = 3SE +/- 0.04, N = 324.0923.8123.9623.7923.76MIN: 23.45 / MAX: 115.98MIN: 23.41 / MAX: 24.81MIN: 23.48 / MAX: 24.81MIN: 23.46 / MAX: 24.73MIN: 23.46 / MAX: 30.921. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: Vulkan GPU - Model: yolov4-tiny12345612182430Min: 23.74 / Avg: 24.09 / Max: 24.8Min: 23.65 / Avg: 23.81 / Max: 24.02Min: 23.71 / Avg: 23.96 / Max: 24.33Min: 23.62 / Avg: 23.79 / Max: 23.95Min: 23.7 / Avg: 23.76 / Max: 23.841. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: Vulkan GPU - Model: squeezenet_ssd1234548121620SE +/- 0.16, N = 3SE +/- 0.19, N = 3SE +/- 0.11, N = 3SE +/- 0.04, N = 3SE +/- 0.07, N = 317.8617.8517.8217.8317.76MIN: 17.35 / MAX: 21.4MIN: 17.41 / MAX: 18.98MIN: 17.6 / MAX: 25.31MIN: 17.42 / MAX: 18.65MIN: 17.51 / MAX: 18.651. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: Vulkan GPU - Model: squeezenet_ssd12345510152025Min: 17.57 / Avg: 17.86 / Max: 18.14Min: 17.58 / Avg: 17.85 / Max: 18.23Min: 17.69 / Avg: 17.82 / Max: 18.05Min: 17.76 / Avg: 17.83 / Max: 17.88Min: 17.65 / Avg: 17.76 / Max: 17.881. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: Vulkan GPU - Model: regnety_400m123453691215SE +/- 0.06, N = 3SE +/- 0.30, N = 3SE +/- 0.05, N = 3SE +/- 0.08, N = 3SE +/- 0.06, N = 312.9813.1513.0213.2313.11MIN: 12.8 / MAX: 20.28MIN: 12.7 / MAX: 20.78MIN: 12.83 / MAX: 14.53MIN: 12.95 / MAX: 14.31MIN: 12.94 / MAX: 14.371. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: Vulkan GPU - Model: regnety_400m1234548121620Min: 12.87 / Avg: 12.98 / Max: 13.04Min: 12.81 / Avg: 13.15 / Max: 13.76Min: 12.93 / Avg: 13.02 / Max: 13.11Min: 13.09 / Avg: 13.23 / Max: 13.36Min: 13 / Avg: 13.11 / Max: 13.221. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread