ncnn 10900k dec

Intel Core i9-10900K testing with a Gigabyte Z490 AORUS MASTER (F3 BIOS) and Gigabyte AMD Radeon RX 5500/5500M / Pro 5500M 8GB on Ubuntu 20.10 via the Phoronix Test Suite.

Compare your own system(s) to this result file with the Phoronix Test Suite by running the command: phoronix-test-suite benchmark 2012191-HA-NCNN1090077
Jump To Table - Results

View

Do Not Show Noisy Results
Do Not Show Results With Incomplete Data
Do Not Show Results With Little Change/Spread
List Notable Results

Statistics

Show Overall Harmonic Mean(s)
Show Overall Geometric Mean
Show Wins / Losses Counts (Pie Chart)
Normalize Results
Remove Outliers Before Calculating Averages

Graph Settings

Force Line Graphs Where Applicable
Convert To Scalar Where Applicable
Prefer Vertical Bar Graphs

Multi-Way Comparison

Condense Multi-Option Tests Into Single Result Graphs

Table

Show Detailed System Result Table

Run Management

Highlight
Result
Hide
Result
Result
Identifier
View Logs
Performance Per
Dollar
Date
Run
  Test
  Duration
1
December 19 2020
  1 Hour, 27 Minutes
2
December 19 2020
  1 Hour, 26 Minutes
3
December 19 2020
  1 Hour, 26 Minutes
4
December 19 2020
  1 Hour, 26 Minutes
5
December 19 2020
  1 Hour, 26 Minutes
Invert Hiding All Results Option
  1 Hour, 26 Minutes

Only show results where is faster than
Only show results matching title/arguments (delimit multiple options with a comma):
Do not show results matching title/arguments (delimit multiple options with a comma):


ncnn 10900k decProcessorMotherboardChipsetMemoryDiskGraphicsAudioMonitorNetworkOSKernelDesktopDisplay ServerDisplay DriverOpenGLVulkanCompilerFile-SystemScreen Resolution12345Intel Core i9-10900K @ 5.30GHz (10 Cores / 20 Threads)Gigabyte Z490 AORUS MASTER (F3 BIOS)Intel Comet Lake PCH16GBSamsung SSD 970 EVO 250GBGigabyte AMD Radeon RX 5500/5500M / Pro 5500M 8GB (1890/875MHz)Realtek ALC1220ASUS MG28UIntel + Intel Wi-Fi 6 AX201Ubuntu 20.105.8.0-31-generic (x86_64)GNOME Shell 3.38.1X Server 1.20.9modesetting 1.20.94.6 Mesa 20.2.1 (LLVM 11.0.0)1.2.131GCC 10.2.0ext43840x2160OpenBenchmarking.orgCompiler Details- --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none=/build/gcc-10-JvwpWM/gcc-10-10.2.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-10-JvwpWM/gcc-10-10.2.0/debian/tmp-gcn/usr,hsa --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v Processor Details- Scaling Governor: intel_pstate powersave - CPU Microcode: 0xe0 - Thermald 2.3Security Details- itlb_multihit: KVM: Mitigation of VMX disabled + l1tf: Not affected + mds: Not affected + meltdown: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced IBRS IBPB: conditional RSB filling + srbds: Not affected + tsx_async_abort: Not affected

12345Result OverviewPhoronix Test Suite100%112%123%135%NCNNNCNNNCNNNCNNNCNNNCNNNCNNNCNNNCNNNCNNNCNNNCNNNCNNNCNNNCNNNCNNNCNNNCNNNCNNNCNNNCNNNCNNNCNNNCNNNCNNNCNNNCNNNCNNNCNNNCNNCPU - googlenetVulkan GPU - mnasnetVulkan GPU - mobilenetCPU - mnasnetVulkan GPU - blazefaceCPU - shufflenet-v2Vulkan GPU - efficientnet-b0CPU - resnet18Vulkan GPU-v3-v3 - mobilenet-v3Vulkan GPU-v2-v2 - mobilenet-v2CPU - regnety_400mVulkan GPU - regnety_400mVulkan GPU - shufflenet-v2CPU - mobilenetCPU - yolov4-tinyCPU - efficientnet-b0Vulkan GPU - yolov4-tinyVulkan GPU - vgg16Vulkan GPU - resnet50CPU-v3-v3 - mobilenet-v3CPU - resnet50CPU-v2-v2 - mobilenet-v2Vulkan GPU - googlenetVulkan GPU - resnet18CPU - squeezenet_ssdCPU - vgg16CPU - blazefaceVulkan GPU - alexnetCPU - alexnetVulkan GPU - squeezenet_ssd

ncnn 10900k decncnn: CPU - mobilenetncnn: CPU-v2-v2 - mobilenet-v2ncnn: CPU-v3-v3 - mobilenet-v3ncnn: CPU - shufflenet-v2ncnn: CPU - mnasnetncnn: CPU - efficientnet-b0ncnn: CPU - blazefacencnn: CPU - googlenetncnn: CPU - vgg16ncnn: CPU - resnet18ncnn: CPU - alexnetncnn: CPU - resnet50ncnn: CPU - yolov4-tinyncnn: CPU - squeezenet_ssdncnn: CPU - regnety_400mncnn: Vulkan GPU - mobilenetncnn: Vulkan GPU-v2-v2 - mobilenet-v2ncnn: Vulkan GPU-v3-v3 - mobilenet-v3ncnn: Vulkan GPU - shufflenet-v2ncnn: Vulkan GPU - mnasnetncnn: Vulkan GPU - efficientnet-b0ncnn: Vulkan GPU - blazefacencnn: Vulkan GPU - googlenetncnn: Vulkan GPU - vgg16ncnn: Vulkan GPU - resnet18ncnn: Vulkan GPU - alexnetncnn: Vulkan GPU - resnet50ncnn: Vulkan GPU - yolov4-tinyncnn: Vulkan GPU - squeezenet_ssdncnn: Vulkan GPU - regnety_400m1234516.214.933.874.413.815.891.6018.7661.9813.7412.0624.3824.0517.8913.2416.684.943.834.353.805.911.5812.8862.0313.4112.0124.2024.0917.8612.9816.194.943.884.373.795.901.5912.8962.0913.4312.0024.0823.6717.7413.1916.124.963.884.403.936.001.6112.8661.6613.4612.0024.3023.8117.8513.1516.424.983.914.483.925.921.6012.8462.1813.4311.9924.3423.7417.8813.1616.204.973.884.363.795.871.5712.8562.5013.4612.0024.3623.9617.8213.0216.134.983.874.413.825.831.5913.0262.3913.4512.0224.0923.8217.8313.1516.154.963.914.433.835.861.5912.9962.5113.4812.0424.0923.7917.8313.2316.174.993.924.433.835.861.5912.8862.2313.4412.0224.0823.7517.8812.9816.164.873.884.383.875.901.5912.9662.2813.5511.9724.0323.7617.7613.11OpenBenchmarking.org

NCNN

NCNN is a high performance neural network inference framework optimized for mobile and other platforms developed by Tencent. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: CPU - Model: mobilenet3125448121620SE +/- 0.24, N = 3SE +/- 0.04, N = 3SE +/- 0.00, N = 3SE +/- 0.02, N = 3SE +/- 0.03, N = 316.4216.2116.1916.1716.13MIN: 16.1 / MAX: 17.16MIN: 16.02 / MAX: 16.98MIN: 16.12 / MAX: 16.95MIN: 15.99 / MAX: 16.97MIN: 15.83 / MAX: 17.261. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: CPU - Model: mobilenet3125448121620Min: 16.17 / Avg: 16.42 / Max: 16.9Min: 16.15 / Avg: 16.21 / Max: 16.29Min: 16.19 / Avg: 16.19 / Max: 16.2Min: 16.14 / Avg: 16.17 / Max: 16.22Min: 16.1 / Avg: 16.13 / Max: 16.191. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: CPU-v2-v2 - Model: mobilenet-v2543211.12282.24563.36844.49125.614SE +/- 0.00, N = 3SE +/- 0.01, N = 3SE +/- 0.02, N = 3SE +/- 0.03, N = 3SE +/- 0.02, N = 34.994.984.984.944.93MIN: 4.86 / MAX: 6.41MIN: 4.85 / MAX: 6.2MIN: 4.83 / MAX: 6.23MIN: 4.66 / MAX: 6.31MIN: 4.69 / MAX: 5.981. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: CPU-v2-v2 - Model: mobilenet-v254321246810Min: 4.98 / Avg: 4.99 / Max: 4.99Min: 4.96 / Avg: 4.98 / Max: 5Min: 4.95 / Avg: 4.98 / Max: 5.01Min: 4.87 / Avg: 4.94 / Max: 4.97Min: 4.91 / Avg: 4.93 / Max: 4.971. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: CPU-v3-v3 - Model: mobilenet-v3532410.8821.7642.6463.5284.41SE +/- 0.01, N = 3SE +/- 0.02, N = 3SE +/- 0.02, N = 3SE +/- 0.03, N = 3SE +/- 0.02, N = 33.923.913.883.873.87MIN: 3.87 / MAX: 4.98MIN: 3.83 / MAX: 5.53MIN: 3.81 / MAX: 5.37MIN: 3.68 / MAX: 5.34MIN: 3.8 / MAX: 5.151. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: CPU-v3-v3 - Model: mobilenet-v353241246810Min: 3.91 / Avg: 3.92 / Max: 3.93Min: 3.88 / Avg: 3.91 / Max: 3.94Min: 3.84 / Avg: 3.88 / Max: 3.92Min: 3.82 / Avg: 3.87 / Max: 3.93Min: 3.84 / Avg: 3.87 / Max: 3.911. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: CPU - Model: shufflenet-v2354121.0082.0163.0244.0325.04SE +/- 0.07, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 34.484.434.414.414.37MIN: 4.33 / MAX: 5.58MIN: 4.35 / MAX: 5.39MIN: 4.36 / MAX: 5.73MIN: 4.29 / MAX: 5.6MIN: 4.31 / MAX: 5.751. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: CPU - Model: shufflenet-v235412246810Min: 4.39 / Avg: 4.48 / Max: 4.61Min: 4.41 / Avg: 4.43 / Max: 4.45Min: 4.4 / Avg: 4.41 / Max: 4.43Min: 4.4 / Avg: 4.41 / Max: 4.42Min: 4.35 / Avg: 4.37 / Max: 4.391. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: CPU - Model: mnasnet354120.8821.7642.6463.5284.41SE +/- 0.11, N = 3SE +/- 0.00, N = 3SE +/- 0.01, N = 3SE +/- 0.00, N = 2SE +/- 0.01, N = 33.923.833.823.813.79MIN: 3.77 / MAX: 5.14MIN: 3.79 / MAX: 4.87MIN: 3.78 / MAX: 5.23MIN: 3.77 / MAX: 4.58MIN: 3.76 / MAX: 5.141. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: CPU - Model: mnasnet35412246810Min: 3.79 / Avg: 3.92 / Max: 4.15Min: 3.82 / Avg: 3.83 / Max: 3.83Min: 3.8 / Avg: 3.82 / Max: 3.83Min: 3.81 / Avg: 3.81 / Max: 3.81Min: 3.78 / Avg: 3.79 / Max: 3.811. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: CPU - Model: efficientnet-b0321541.3322.6643.9965.3286.66SE +/- 0.02, N = 3SE +/- 0.03, N = 3SE +/- 0.05, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 35.925.905.895.865.83MIN: 5.83 / MAX: 7.12MIN: 5.67 / MAX: 7.36MIN: 5.65 / MAX: 10.92MIN: 5.67 / MAX: 7.34MIN: 5.63 / MAX: 7.061. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: CPU - Model: efficientnet-b032154246810Min: 5.89 / Avg: 5.92 / Max: 5.95Min: 5.84 / Avg: 5.9 / Max: 5.94Min: 5.82 / Avg: 5.89 / Max: 5.98Min: 5.84 / Avg: 5.86 / Max: 5.87Min: 5.81 / Avg: 5.83 / Max: 5.861. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: CPU - Model: blazeface315420.360.721.081.441.8SE +/- 0.00, N = 3SE +/- 0.01, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 31.601.601.591.591.59MIN: 1.57 / MAX: 2.96MIN: 1.57 / MAX: 1.81MIN: 1.57 / MAX: 1.63MIN: 1.57 / MAX: 1.63MIN: 1.57 / MAX: 1.641. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: CPU - Model: blazeface31542246810Min: 1.59 / Avg: 1.6 / Max: 1.6Min: 1.59 / Avg: 1.6 / Max: 1.61Min: 1.59 / Avg: 1.59 / Max: 1.59Min: 1.58 / Avg: 1.59 / Max: 1.59Min: 1.59 / Avg: 1.59 / Max: 1.61. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: CPU - Model: googlenet14253510152025SE +/- 5.74, N = 3SE +/- 0.04, N = 3SE +/- 0.01, N = 3SE +/- 0.03, N = 3SE +/- 0.05, N = 318.7613.0212.8912.8812.84MIN: 12.6 / MAX: 2024.54MIN: 12.66 / MAX: 13.92MIN: 12.59 / MAX: 13.73MIN: 12.59 / MAX: 13.85MIN: 12.5 / MAX: 20.391. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: CPU - Model: googlenet14253510152025Min: 13 / Avg: 18.76 / Max: 30.24Min: 12.96 / Avg: 13.02 / Max: 13.1Min: 12.88 / Avg: 12.89 / Max: 12.9Min: 12.85 / Avg: 12.88 / Max: 12.93Min: 12.79 / Avg: 12.84 / Max: 12.941. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: CPU - Model: vgg16453211428425670SE +/- 0.28, N = 3SE +/- 0.11, N = 3SE +/- 0.13, N = 3SE +/- 0.18, N = 3SE +/- 0.30, N = 362.3962.2362.1862.0961.98MIN: 61.82 / MAX: 63.73MIN: 61.76 / MAX: 74.65MIN: 61.69 / MAX: 67.41MIN: 61.46 / MAX: 63.12MIN: 61.46 / MAX: 75.821. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: CPU - Model: vgg16453211224364860Min: 61.99 / Avg: 62.39 / Max: 62.92Min: 62.05 / Avg: 62.23 / Max: 62.44Min: 61.93 / Avg: 62.18 / Max: 62.32Min: 61.73 / Avg: 62.09 / Max: 62.28Min: 61.6 / Avg: 61.98 / Max: 62.561. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: CPU - Model: resnet181453248121620SE +/- 0.25, N = 3SE +/- 0.00, N = 3SE +/- 0.02, N = 3SE +/- 0.06, N = 3SE +/- 0.01, N = 313.7413.4513.4413.4313.43MIN: 13.23 / MAX: 20.94MIN: 13.23 / MAX: 14.24MIN: 13.23 / MAX: 14.66MIN: 13.21 / MAX: 14.31MIN: 13.25 / MAX: 14.261. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: CPU - Model: resnet181453248121620Min: 13.46 / Avg: 13.74 / Max: 14.24Min: 13.44 / Avg: 13.45 / Max: 13.45Min: 13.39 / Avg: 13.44 / Max: 13.47Min: 13.33 / Avg: 13.43 / Max: 13.52Min: 13.41 / Avg: 13.43 / Max: 13.441. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: CPU - Model: alexnet154233691215SE +/- 0.02, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.02, N = 3SE +/- 0.03, N = 312.0612.0212.0212.0011.99MIN: 11.91 / MAX: 20.31MIN: 11.91 / MAX: 13.1MIN: 11.9 / MAX: 12.81MIN: 11.85 / MAX: 13.25MIN: 11.85 / MAX: 19.491. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: CPU - Model: alexnet1542348121620Min: 12.01 / Avg: 12.06 / Max: 12.08Min: 12.01 / Avg: 12.02 / Max: 12.03Min: 12.01 / Avg: 12.02 / Max: 12.04Min: 11.96 / Avg: 12 / Max: 12.03Min: 11.93 / Avg: 11.99 / Max: 12.021. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: CPU - Model: resnet5013452612182430SE +/- 0.30, N = 3SE +/- 0.19, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.02, N = 324.3824.3424.0924.0824.08MIN: 23.64 / MAX: 25.8MIN: 23.65 / MAX: 26.1MIN: 23.89 / MAX: 24.87MIN: 23.56 / MAX: 24.92MIN: 23.56 / MAX: 25.791. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: CPU - Model: resnet5013452612182430Min: 24.04 / Avg: 24.38 / Max: 24.98Min: 24.14 / Avg: 24.34 / Max: 24.72Min: 24.06 / Avg: 24.09 / Max: 24.11Min: 24.06 / Avg: 24.08 / Max: 24.11Min: 24.05 / Avg: 24.08 / Max: 24.121. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: CPU - Model: yolov4-tiny14532612182430SE +/- 0.33, N = 3SE +/- 0.07, N = 3SE +/- 0.02, N = 3SE +/- 0.02, N = 3SE +/- 0.06, N = 324.0523.8223.7523.7423.67MIN: 23.51 / MAX: 25.63MIN: 23.44 / MAX: 26.33MIN: 23.35 / MAX: 24.75MIN: 23.49 / MAX: 31.58MIN: 23.42 / MAX: 24.621. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: CPU - Model: yolov4-tiny14532612182430Min: 23.68 / Avg: 24.05 / Max: 24.7Min: 23.68 / Avg: 23.82 / Max: 23.92Min: 23.71 / Avg: 23.75 / Max: 23.78Min: 23.71 / Avg: 23.74 / Max: 23.77Min: 23.57 / Avg: 23.67 / Max: 23.781. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: CPU - Model: squeezenet_ssd1534248121620SE +/- 0.13, N = 3SE +/- 0.01, N = 3SE +/- 0.13, N = 3SE +/- 0.05, N = 3SE +/- 0.01, N = 317.8917.8817.8817.8317.74MIN: 17.63 / MAX: 18.61MIN: 17.79 / MAX: 21.81MIN: 17.65 / MAX: 18.51MIN: 17.45 / MAX: 18.66MIN: 17.62 / MAX: 18.481. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: CPU - Model: squeezenet_ssd15342510152025Min: 17.68 / Avg: 17.89 / Max: 18.13Min: 17.86 / Avg: 17.88 / Max: 17.91Min: 17.72 / Avg: 17.88 / Max: 18.14Min: 17.73 / Avg: 17.83 / Max: 17.88Min: 17.72 / Avg: 17.74 / Max: 17.761. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: CPU - Model: regnety_400m123453691215SE +/- 0.14, N = 3SE +/- 0.11, N = 3SE +/- 0.08, N = 3SE +/- 0.06, N = 3SE +/- 0.03, N = 313.2413.1913.1613.1512.98MIN: 12.86 / MAX: 21.35MIN: 12.93 / MAX: 14.63MIN: 12.96 / MAX: 14.78MIN: 12.88 / MAX: 14.64MIN: 12.85 / MAX: 14.391. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: CPU - Model: regnety_400m1234548121620Min: 12.96 / Avg: 13.24 / Max: 13.42Min: 13 / Avg: 13.19 / Max: 13.37Min: 13.04 / Avg: 13.16 / Max: 13.32Min: 13.04 / Avg: 13.15 / Max: 13.25Min: 12.94 / Avg: 12.98 / Max: 13.051. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: Vulkan GPU - Model: mobilenet1354248121620SE +/- 0.26, N = 3SE +/- 0.05, N = 3SE +/- 0.02, N = 3SE +/- 0.04, N = 3SE +/- 0.01, N = 316.6816.2016.1616.1516.12MIN: 16.08 / MAX: 17.74MIN: 16 / MAX: 16.85MIN: 16 / MAX: 18.26MIN: 16 / MAX: 16.99MIN: 16 / MAX: 23.011. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: Vulkan GPU - Model: mobilenet1354248121620Min: 16.16 / Avg: 16.68 / Max: 16.95Min: 16.14 / Avg: 16.2 / Max: 16.3Min: 16.12 / Avg: 16.16 / Max: 16.19Min: 16.11 / Avg: 16.15 / Max: 16.23Min: 16.1 / Avg: 16.12 / Max: 16.141. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: Vulkan GPU-v2-v2 - Model: mobilenet-v2342151.11832.23663.35494.47325.5915SE +/- 0.01, N = 3SE +/- 0.03, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 34.974.964.964.944.87MIN: 4.81 / MAX: 6.41MIN: 4.68 / MAX: 6.28MIN: 4.67 / MAX: 6.31MIN: 4.73 / MAX: 6.5MIN: 4.68 / MAX: 6.191. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: Vulkan GPU-v2-v2 - Model: mobilenet-v234215246810Min: 4.94 / Avg: 4.97 / Max: 4.98Min: 4.91 / Avg: 4.96 / Max: 5Min: 4.94 / Avg: 4.96 / Max: 4.97Min: 4.92 / Avg: 4.94 / Max: 4.95Min: 4.86 / Avg: 4.87 / Max: 4.891. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: Vulkan GPU-v3-v3 - Model: mobilenet-v3453210.87981.75962.63943.51924.399SE +/- 0.02, N = 3SE +/- 0.02, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.04, N = 33.913.883.883.883.83MIN: 3.83 / MAX: 4.98MIN: 3.79 / MAX: 4.93MIN: 3.83 / MAX: 5.24MIN: 3.81 / MAX: 6.21MIN: 3.7 / MAX: 4.861. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: Vulkan GPU-v3-v3 - Model: mobilenet-v345321246810Min: 3.89 / Avg: 3.91 / Max: 3.95Min: 3.84 / Avg: 3.88 / Max: 3.91Min: 3.86 / Avg: 3.88 / Max: 3.9Min: 3.86 / Avg: 3.88 / Max: 3.89Min: 3.76 / Avg: 3.83 / Max: 3.881. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: Vulkan GPU - Model: shufflenet-v2425310.99681.99362.99043.98724.984SE +/- 0.02, N = 3SE +/- 0.04, N = 3SE +/- 0.03, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 34.434.404.384.364.35MIN: 4.35 / MAX: 5.33MIN: 4.29 / MAX: 5.8MIN: 4.28 / MAX: 5.65MIN: 4.3 / MAX: 5.78MIN: 4.29 / MAX: 5.671. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: Vulkan GPU - Model: shufflenet-v242531246810Min: 4.4 / Avg: 4.43 / Max: 4.45Min: 4.34 / Avg: 4.4 / Max: 4.49Min: 4.32 / Avg: 4.38 / Max: 4.41Min: 4.34 / Avg: 4.36 / Max: 4.38Min: 4.34 / Avg: 4.35 / Max: 4.371. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: Vulkan GPU - Model: mnasnet254130.88431.76862.65293.53724.4215SE +/- 0.13, N = 3SE +/- 0.06, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 33.933.873.833.803.79MIN: 3.76 / MAX: 5.53MIN: 3.74 / MAX: 5.57MIN: 3.79 / MAX: 4.87MIN: 3.75 / MAX: 5.21MIN: 3.75 / MAX: 5.181. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: Vulkan GPU - Model: mnasnet25413246810Min: 3.8 / Avg: 3.93 / Max: 4.18Min: 3.81 / Avg: 3.87 / Max: 3.99Min: 3.82 / Avg: 3.83 / Max: 3.84Min: 3.79 / Avg: 3.8 / Max: 3.82Min: 3.78 / Avg: 3.79 / Max: 3.81. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: Vulkan GPU - Model: efficientnet-b021534246810SE +/- 0.13, N = 3SE +/- 0.02, N = 3SE +/- 0.02, N = 3SE +/- 0.04, N = 3SE +/- 0.03, N = 36.005.915.905.875.86MIN: 5.65 / MAX: 6.95MIN: 5.69 / MAX: 7.29MIN: 5.66 / MAX: 9.61MIN: 5.64 / MAX: 7.33MIN: 5.66 / MAX: 6.891. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: Vulkan GPU - Model: efficientnet-b021534246810Min: 5.86 / Avg: 6 / Max: 6.25Min: 5.87 / Avg: 5.91 / Max: 5.94Min: 5.88 / Avg: 5.9 / Max: 5.94Min: 5.8 / Avg: 5.87 / Max: 5.92Min: 5.81 / Avg: 5.86 / Max: 5.91. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: Vulkan GPU - Model: blazeface254130.36230.72461.08691.44921.8115SE +/- 0.02, N = 3SE +/- 0.00, N = 3SE +/- 0.01, N = 3SE +/- 0.00, N = 3SE +/- 0.01, N = 31.611.591.591.581.57MIN: 1.56 / MAX: 2.34MIN: 1.56 / MAX: 2.04MIN: 1.57 / MAX: 1.81MIN: 1.55 / MAX: 2.05MIN: 1.51 / MAX: 2.351. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: Vulkan GPU - Model: blazeface25413246810Min: 1.58 / Avg: 1.61 / Max: 1.65Min: 1.59 / Avg: 1.59 / Max: 1.59Min: 1.58 / Avg: 1.59 / Max: 1.6Min: 1.57 / Avg: 1.58 / Max: 1.58Min: 1.55 / Avg: 1.57 / Max: 1.591. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: Vulkan GPU - Model: googlenet451233691215SE +/- 0.03, N = 3SE +/- 0.05, N = 3SE +/- 0.00, N = 3SE +/- 0.01, N = 3SE +/- 0.02, N = 312.9912.9612.8812.8612.85MIN: 12.59 / MAX: 14.33MIN: 12.63 / MAX: 13.88MIN: 12.56 / MAX: 13.75MIN: 12.56 / MAX: 13.19MIN: 12.56 / MAX: 13.711. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: Vulkan GPU - Model: googlenet4512348121620Min: 12.93 / Avg: 12.99 / Max: 13.03Min: 12.87 / Avg: 12.96 / Max: 13.05Min: 12.88 / Avg: 12.88 / Max: 12.89Min: 12.84 / Avg: 12.86 / Max: 12.88Min: 12.81 / Avg: 12.85 / Max: 12.891. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: Vulkan GPU - Model: vgg16435121428425670SE +/- 0.24, N = 3SE +/- 0.39, N = 3SE +/- 0.14, N = 3SE +/- 0.02, N = 3SE +/- 0.04, N = 362.5162.5062.2862.0361.66MIN: 61.75 / MAX: 69.6MIN: 61.54 / MAX: 63.92MIN: 61.92 / MAX: 71.61MIN: 61.82 / MAX: 66.09MIN: 61.46 / MAX: 68.611. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: Vulkan GPU - Model: vgg16435121224364860Min: 62.04 / Avg: 62.51 / Max: 62.76Min: 61.78 / Avg: 62.5 / Max: 63.11Min: 62.11 / Avg: 62.28 / Max: 62.57Min: 62 / Avg: 62.03 / Max: 62.07Min: 61.59 / Avg: 61.66 / Max: 61.71. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: Vulkan GPU - Model: resnet18543213691215SE +/- 0.07, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.00, N = 313.5513.4813.4613.4613.41MIN: 13.21 / MAX: 14.28MIN: 13.24 / MAX: 14.9MIN: 13.24 / MAX: 14.24MIN: 13.27 / MAX: 14.21MIN: 13.23 / MAX: 14.191. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: Vulkan GPU - Model: resnet185432148121620Min: 13.45 / Avg: 13.55 / Max: 13.69Min: 13.47 / Avg: 13.48 / Max: 13.5Min: 13.44 / Avg: 13.46 / Max: 13.48Min: 13.44 / Avg: 13.46 / Max: 13.48Min: 13.41 / Avg: 13.41 / Max: 13.411. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: Vulkan GPU - Model: alexnet413253691215SE +/- 0.02, N = 3SE +/- 0.01, N = 3SE +/- 0.02, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 312.0412.0112.0012.0011.97MIN: 11.91 / MAX: 12.83MIN: 11.9 / MAX: 12.84MIN: 11.83 / MAX: 12.84MIN: 11.9 / MAX: 12.85MIN: 11.88 / MAX: 12.721. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: Vulkan GPU - Model: alexnet4132548121620Min: 12.01 / Avg: 12.04 / Max: 12.06Min: 12 / Avg: 12.01 / Max: 12.03Min: 11.97 / Avg: 12 / Max: 12.03Min: 11.98 / Avg: 12 / Max: 12.02Min: 11.95 / Avg: 11.97 / Max: 11.991. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: Vulkan GPU - Model: resnet5032145612182430SE +/- 0.26, N = 3SE +/- 0.22, N = 3SE +/- 0.10, N = 3SE +/- 0.01, N = 3SE +/- 0.03, N = 324.3624.3024.2024.0924.03MIN: 23.6 / MAX: 25.7MIN: 23.53 / MAX: 25.57MIN: 23.56 / MAX: 25.4MIN: 23.62 / MAX: 26.99MIN: 23.62 / MAX: 24.81. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: Vulkan GPU - Model: resnet5032145612182430Min: 24.08 / Avg: 24.36 / Max: 24.88Min: 24.05 / Avg: 24.3 / Max: 24.74Min: 24.08 / Avg: 24.2 / Max: 24.41Min: 24.07 / Avg: 24.09 / Max: 24.11Min: 24 / Avg: 24.03 / Max: 24.081. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: Vulkan GPU - Model: yolov4-tiny13245612182430SE +/- 0.35, N = 3SE +/- 0.19, N = 3SE +/- 0.11, N = 3SE +/- 0.10, N = 3SE +/- 0.04, N = 324.0923.9623.8123.7923.76MIN: 23.45 / MAX: 115.98MIN: 23.48 / MAX: 24.81MIN: 23.41 / MAX: 24.81MIN: 23.46 / MAX: 24.73MIN: 23.46 / MAX: 30.921. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: Vulkan GPU - Model: yolov4-tiny13245612182430Min: 23.74 / Avg: 24.09 / Max: 24.8Min: 23.71 / Avg: 23.96 / Max: 24.33Min: 23.65 / Avg: 23.81 / Max: 24.02Min: 23.62 / Avg: 23.79 / Max: 23.95Min: 23.7 / Avg: 23.76 / Max: 23.841. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: Vulkan GPU - Model: squeezenet_ssd1243548121620SE +/- 0.16, N = 3SE +/- 0.19, N = 3SE +/- 0.04, N = 3SE +/- 0.11, N = 3SE +/- 0.07, N = 317.8617.8517.8317.8217.76MIN: 17.35 / MAX: 21.4MIN: 17.41 / MAX: 18.98MIN: 17.42 / MAX: 18.65MIN: 17.6 / MAX: 25.31MIN: 17.51 / MAX: 18.651. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: Vulkan GPU - Model: squeezenet_ssd12435510152025Min: 17.57 / Avg: 17.86 / Max: 18.14Min: 17.58 / Avg: 17.85 / Max: 18.23Min: 17.76 / Avg: 17.83 / Max: 17.88Min: 17.69 / Avg: 17.82 / Max: 18.05Min: 17.65 / Avg: 17.76 / Max: 17.881. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: Vulkan GPU - Model: regnety_400m425313691215SE +/- 0.08, N = 3SE +/- 0.30, N = 3SE +/- 0.06, N = 3SE +/- 0.05, N = 3SE +/- 0.06, N = 313.2313.1513.1113.0212.98MIN: 12.95 / MAX: 14.31MIN: 12.7 / MAX: 20.78MIN: 12.94 / MAX: 14.37MIN: 12.83 / MAX: 14.53MIN: 12.8 / MAX: 20.281. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: Vulkan GPU - Model: regnety_400m4253148121620Min: 13.09 / Avg: 13.23 / Max: 13.36Min: 12.81 / Avg: 13.15 / Max: 13.76Min: 13 / Avg: 13.11 / Max: 13.22Min: 12.93 / Avg: 13.02 / Max: 13.11Min: 12.87 / Avg: 12.98 / Max: 13.041. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread