TR 3970X NCNN

AMD Ryzen Threadripper 3970X 32-Core testing with a ASUS ROG ZENITH II EXTREME (1201 BIOS) and AMD Radeon RX 5600 OEM/5600 XT / 5700/5700 8GB on Ubuntu 20.10 via the Phoronix Test Suite.

Compare your own system(s) to this result file with the Phoronix Test Suite by running the command: phoronix-test-suite benchmark 2012184-PTS-TR3970XN50
Jump To Table - Results

View

Do Not Show Noisy Results
Do Not Show Results With Incomplete Data
Do Not Show Results With Little Change/Spread
List Notable Results

Statistics

Show Overall Harmonic Mean(s)
Show Overall Geometric Mean
Show Wins / Losses Counts (Pie Chart)
Normalize Results
Remove Outliers Before Calculating Averages

Graph Settings

Force Line Graphs Where Applicable
Convert To Scalar Where Applicable
Prefer Vertical Bar Graphs

Multi-Way Comparison

Condense Multi-Option Tests Into Single Result Graphs

Table

Show Detailed System Result Table

Run Management

Highlight
Result
Hide
Result
Result
Identifier
Performance Per
Dollar
Date
Run
  Test
  Duration
1
December 18 2020
  1 Hour, 45 Minutes
2
December 18 2020
  1 Hour, 34 Minutes
3
December 18 2020
  1 Hour, 35 Minutes
4
December 18 2020
  1 Hour, 35 Minutes
Invert Hiding All Results Option
  1 Hour, 37 Minutes

Only show results where is faster than
Only show results matching title/arguments (delimit multiple options with a comma):
Do not show results matching title/arguments (delimit multiple options with a comma):


TR 3970X NCNNProcessorMotherboardChipsetMemoryDiskGraphicsAudioMonitorNetworkOSKernelDesktopDisplay ServerDisplay DriverOpenGLVulkanCompilerFile-SystemScreen Resolution1234AMD Ryzen Threadripper 3970X 32-Core @ 3.70GHz (32 Cores / 64 Threads)ASUS ROG ZENITH II EXTREME (1201 BIOS)AMD Starship/Matisse64GBSamsung SSD 980 PRO 500GBAMD Radeon RX 5600 OEM/5600 XT / 5700/5700 8GB (1750/875MHz)AMD Navi 10 HDMI AudioASUS VP28UAquantia AQC107 NBase-T/IEEE + Intel I211 + Intel Wi-Fi 6 AX200Ubuntu 20.105.8.0-29-generic (x86_64)GNOME Shell 3.38.1X Server 1.20.9amdgpu 19.1.04.6 Mesa 20.2.1 (LLVM 11.0.0)1.2.131GCC 10.2.0ext43840x2160OpenBenchmarking.orgCompiler Details- --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none=/build/gcc-10-JvwpWM/gcc-10-10.2.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-10-JvwpWM/gcc-10-10.2.0/debian/tmp-gcn/usr,hsa --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v Processor Details- Scaling Governor: acpi-cpufreq ondemand (Boost: Enabled) - CPU Microcode: 0x8301039Security Details- itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Full AMD retpoline IBPB: conditional STIBP: conditional RSB filling + srbds: Not affected + tsx_async_abort: Not affected

1234Logarithmic Result OverviewPhoronix Test SuiteNCNNNCNNNCNNNCNNNCNNNCNNNCNNNCNNNCNNNCNNNCNNNCNNNCNNNCNNNCNNNCNNNCNNNCNNNCNNNCNNNCNNNCNNNCNNNCNNNCNNNCNNNCNNNCNNNCNNNCNNVulkan GPU - efficientnet-b0Vulkan GPU - mnasnetVulkan GPU-v2-v2 - mobilenet-v2Vulkan GPU - regnety_400mCPU - resnet18CPU - yolov4-tinyCPU - resnet50CPU - alexnetVulkan GPU - resnet18Vulkan GPU-v3-v3 - mobilenet-v3CPU - googlenetVulkan GPU - resnet50Vulkan GPU - yolov4-tinyVulkan GPU - googlenetVulkan GPU - vgg16CPU - vgg16Vulkan GPU - shufflenet-v2Vulkan GPU - alexnetVulkan GPU - blazefaceVulkan GPU - mobilenetCPU-v2-v2 - mobilenet-v2Vulkan GPU - squeezenet_ssdCPU-v3-v3 - mobilenet-v3CPU - squeezenet_ssdCPU - efficientnet-b0CPU - regnety_400mCPU - mobilenetCPU - blazefaceCPU - mnasnetCPU - shufflenet-v2

TR 3970X NCNNncnn: CPU - mobilenetncnn: CPU-v2-v2 - mobilenet-v2ncnn: CPU-v3-v3 - mobilenet-v3ncnn: CPU - shufflenet-v2ncnn: CPU - mnasnetncnn: CPU - efficientnet-b0ncnn: CPU - blazefacencnn: CPU - googlenetncnn: CPU - vgg16ncnn: CPU - resnet18ncnn: CPU - alexnetncnn: CPU - resnet50ncnn: CPU - yolov4-tinyncnn: CPU - squeezenet_ssdncnn: CPU - regnety_400mncnn: Vulkan GPU - mobilenetncnn: Vulkan GPU-v2-v2 - mobilenet-v2ncnn: Vulkan GPU-v3-v3 - mobilenet-v3ncnn: Vulkan GPU - shufflenet-v2ncnn: Vulkan GPU - mnasnetncnn: Vulkan GPU - efficientnet-b0ncnn: Vulkan GPU - blazefacencnn: Vulkan GPU - googlenetncnn: Vulkan GPU - vgg16ncnn: Vulkan GPU - resnet18ncnn: Vulkan GPU - alexnetncnn: Vulkan GPU - resnet50ncnn: Vulkan GPU - yolov4-tinyncnn: Vulkan GPU - squeezenet_ssdncnn: Vulkan GPU - regnety_400m123416.727.256.607.206.649.303.3915.7932.5112.248.3521.6323.9018.5242.8817.0710.286.977.4315.2942.353.4916.4133.0213.008.8622.3524.6318.6254.9316.927.286.567.256.669.283.4216.7134.0213.278.9622.7425.0318.7442.3216.877.266.597.186.609.213.416.2933.9212.978.8522.3625.1618.7742.4616.857.406.667.216.719.463.4016.7433.9813.628.9623.1925.1718.8842.9816.727.206.577.216.509.273.3816.5334.2713.219.0622.9425.0718.6442.9816.797.356.697.276.699.363.4316.6733.6213.818.8223.4726.0418.8843.0917.017.206.587.146.579.353.4617.2034.8213.819.2023.6526.0419.0042.75OpenBenchmarking.org

NCNN

NCNN is a high performance neural network inference framework optimized for mobile and other platforms developed by Tencent. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: CPU - Model: mobilenet123448121620SE +/- 0.04, N = 3SE +/- 0.15, N = 3SE +/- 0.13, N = 3SE +/- 0.02, N = 316.7216.9216.8516.79MIN: 16.44 / MAX: 29.43MIN: 16.5 / MAX: 21.7MIN: 16.47 / MAX: 19.15MIN: 16.57 / MAX: 19.391. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: CPU - Model: mobilenet123448121620Min: 16.67 / Avg: 16.72 / Max: 16.81Min: 16.67 / Avg: 16.92 / Max: 17.2Min: 16.63 / Avg: 16.85 / Max: 17.07Min: 16.75 / Avg: 16.79 / Max: 16.831. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: CPU-v2-v2 - Model: mobilenet-v21234246810SE +/- 0.03, N = 3SE +/- 0.07, N = 3SE +/- 0.05, N = 3SE +/- 0.02, N = 37.257.287.407.35MIN: 6.98 / MAX: 11.89MIN: 6.98 / MAX: 9.99MIN: 7.13 / MAX: 16.07MIN: 7.01 / MAX: 8.211. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: CPU-v2-v2 - Model: mobilenet-v212343691215Min: 7.22 / Avg: 7.25 / Max: 7.3Min: 7.17 / Avg: 7.28 / Max: 7.4Min: 7.35 / Avg: 7.4 / Max: 7.49Min: 7.31 / Avg: 7.35 / Max: 7.391. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: CPU-v3-v3 - Model: mobilenet-v31234246810SE +/- 0.04, N = 3SE +/- 0.05, N = 3SE +/- 0.03, N = 3SE +/- 0.04, N = 36.606.566.666.69MIN: 6.41 / MAX: 7.58MIN: 6.34 / MAX: 11.16MIN: 6.49 / MAX: 7.73MIN: 6.47 / MAX: 7.711. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: CPU-v3-v3 - Model: mobilenet-v312343691215Min: 6.55 / Avg: 6.6 / Max: 6.68Min: 6.48 / Avg: 6.56 / Max: 6.66Min: 6.63 / Avg: 6.66 / Max: 6.72Min: 6.61 / Avg: 6.69 / Max: 6.761. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: CPU - Model: shufflenet-v21234246810SE +/- 0.07, N = 3SE +/- 0.08, N = 3SE +/- 0.02, N = 3SE +/- 0.09, N = 37.207.257.217.27MIN: 6.91 / MAX: 8.16MIN: 6.87 / MAX: 8.35MIN: 6.96 / MAX: 12.42MIN: 6.9 / MAX: 18.21. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: CPU - Model: shufflenet-v212343691215Min: 7.13 / Avg: 7.2 / Max: 7.35Min: 7.14 / Avg: 7.25 / Max: 7.41Min: 7.17 / Avg: 7.21 / Max: 7.23Min: 7.14 / Avg: 7.27 / Max: 7.431. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: CPU - Model: mnasnet1234246810SE +/- 0.04, N = 3SE +/- 0.08, N = 3SE +/- 0.03, N = 3SE +/- 0.03, N = 36.646.666.716.69MIN: 6.43 / MAX: 7.37MIN: 6.37 / MAX: 17.57MIN: 6.57 / MAX: 9.29MIN: 6.51 / MAX: 7.411. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: CPU - Model: mnasnet12343691215Min: 6.57 / Avg: 6.64 / Max: 6.72Min: 6.54 / Avg: 6.66 / Max: 6.82Min: 6.67 / Avg: 6.71 / Max: 6.77Min: 6.64 / Avg: 6.69 / Max: 6.731. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: CPU - Model: efficientnet-b012343691215SE +/- 0.10, N = 3SE +/- 0.08, N = 3SE +/- 0.09, N = 3SE +/- 0.02, N = 39.309.289.469.36MIN: 9.07 / MAX: 13.25MIN: 9.07 / MAX: 13.91MIN: 9.18 / MAX: 80.88MIN: 9.17 / MAX: 21.551. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: CPU - Model: efficientnet-b012343691215Min: 9.14 / Avg: 9.3 / Max: 9.49Min: 9.14 / Avg: 9.28 / Max: 9.41Min: 9.35 / Avg: 9.46 / Max: 9.64Min: 9.31 / Avg: 9.36 / Max: 9.381. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: CPU - Model: blazeface12340.77181.54362.31543.08723.859SE +/- 0.01, N = 3SE +/- 0.02, N = 3SE +/- 0.01, N = 3SE +/- 0.03, N = 33.393.423.403.43MIN: 3.25 / MAX: 7.43MIN: 3.26 / MAX: 13.06MIN: 3.28 / MAX: 5.7MIN: 3.3 / MAX: 13.251. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: CPU - Model: blazeface1234246810Min: 3.36 / Avg: 3.39 / Max: 3.41Min: 3.39 / Avg: 3.42 / Max: 3.45Min: 3.39 / Avg: 3.4 / Max: 3.41Min: 3.4 / Avg: 3.43 / Max: 3.481. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: CPU - Model: googlenet123448121620SE +/- 0.12, N = 3SE +/- 0.20, N = 3SE +/- 0.12, N = 3SE +/- 0.03, N = 315.7916.7116.7416.67MIN: 15.32 / MAX: 79.38MIN: 16.17 / MAX: 19.05MIN: 16.24 / MAX: 23.66MIN: 16.27 / MAX: 19.351. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: CPU - Model: googlenet123448121620Min: 15.55 / Avg: 15.79 / Max: 15.96Min: 16.41 / Avg: 16.71 / Max: 17.09Min: 16.54 / Avg: 16.74 / Max: 16.95Min: 16.64 / Avg: 16.67 / Max: 16.731. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: CPU - Model: vgg161234816243240SE +/- 0.28, N = 3SE +/- 0.09, N = 3SE +/- 0.24, N = 3SE +/- 0.09, N = 332.5134.0233.9833.62MIN: 31.99 / MAX: 37.64MIN: 33.06 / MAX: 89.38MIN: 33.25 / MAX: 38.76MIN: 33.11 / MAX: 38.581. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: CPU - Model: vgg161234714212835Min: 32.15 / Avg: 32.51 / Max: 33.07Min: 33.91 / Avg: 34.02 / Max: 34.2Min: 33.5 / Avg: 33.98 / Max: 34.26Min: 33.45 / Avg: 33.62 / Max: 33.731. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: CPU - Model: resnet18123448121620SE +/- 0.09, N = 3SE +/- 0.20, N = 3SE +/- 0.09, N = 3SE +/- 0.01, N = 312.2413.2713.6213.81MIN: 11.94 / MAX: 21.71MIN: 12.86 / MAX: 16.9MIN: 13.32 / MAX: 18.31MIN: 13.63 / MAX: 17.731. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: CPU - Model: resnet18123448121620Min: 12.1 / Avg: 12.24 / Max: 12.41Min: 13.05 / Avg: 13.27 / Max: 13.66Min: 13.44 / Avg: 13.62 / Max: 13.74Min: 13.8 / Avg: 13.81 / Max: 13.821. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: CPU - Model: alexnet12343691215SE +/- 0.19, N = 3SE +/- 0.18, N = 3SE +/- 0.21, N = 3SE +/- 0.00, N = 38.358.968.968.82MIN: 7.97 / MAX: 12.66MIN: 8.51 / MAX: 13.98MIN: 8.55 / MAX: 12.87MIN: 8.68 / MAX: 11.981. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: CPU - Model: alexnet12343691215Min: 8.11 / Avg: 8.35 / Max: 8.73Min: 8.6 / Avg: 8.96 / Max: 9.15Min: 8.72 / Avg: 8.96 / Max: 9.38Min: 8.81 / Avg: 8.82 / Max: 8.821. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: CPU - Model: resnet501234612182430SE +/- 0.07, N = 3SE +/- 0.23, N = 3SE +/- 0.13, N = 3SE +/- 0.02, N = 321.6322.7423.1923.47MIN: 21.34 / MAX: 24.31MIN: 22.23 / MAX: 27.31MIN: 22.78 / MAX: 25.87MIN: 23.22 / MAX: 25.941. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: CPU - Model: resnet501234510152025Min: 21.48 / Avg: 21.63 / Max: 21.71Min: 22.38 / Avg: 22.74 / Max: 23.18Min: 22.94 / Avg: 23.19 / Max: 23.37Min: 23.44 / Avg: 23.47 / Max: 23.511. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: CPU - Model: yolov4-tiny1234612182430SE +/- 0.13, N = 3SE +/- 0.39, N = 3SE +/- 0.22, N = 3SE +/- 0.69, N = 323.9025.0325.1726.04MIN: 23.53 / MAX: 25.32MIN: 24.36 / MAX: 28.32MIN: 24.49 / MAX: 28.24MIN: 25.05 / MAX: 447.881. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: CPU - Model: yolov4-tiny1234612182430Min: 23.65 / Avg: 23.9 / Max: 24.09Min: 24.58 / Avg: 25.03 / Max: 25.81Min: 24.72 / Avg: 25.17 / Max: 25.4Min: 25.31 / Avg: 26.04 / Max: 27.431. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: CPU - Model: squeezenet_ssd1234510152025SE +/- 0.10, N = 3SE +/- 0.05, N = 3SE +/- 0.05, N = 3SE +/- 0.02, N = 318.5218.7418.8818.88MIN: 18.13 / MAX: 19.44MIN: 18.42 / MAX: 21.09MIN: 18.58 / MAX: 21MIN: 18.61 / MAX: 23.541. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: CPU - Model: squeezenet_ssd1234510152025Min: 18.34 / Avg: 18.52 / Max: 18.68Min: 18.68 / Avg: 18.74 / Max: 18.83Min: 18.77 / Avg: 18.88 / Max: 18.94Min: 18.85 / Avg: 18.88 / Max: 18.911. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: CPU - Model: regnety_400m12341020304050SE +/- 0.48, N = 3SE +/- 0.37, N = 3SE +/- 0.53, N = 3SE +/- 0.19, N = 342.8842.3242.9843.09MIN: 41.86 / MAX: 146.63MIN: 41.09 / MAX: 105.16MIN: 42.06 / MAX: 55.19MIN: 42.3 / MAX: 85.221. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: CPU - Model: regnety_400m1234918273645Min: 42.01 / Avg: 42.88 / Max: 43.66Min: 41.71 / Avg: 42.32 / Max: 42.98Min: 42.33 / Avg: 42.98 / Max: 44.04Min: 42.8 / Avg: 43.09 / Max: 43.441. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: Vulkan GPU - Model: mobilenet123448121620SE +/- 0.07, N = 3SE +/- 0.23, N = 3SE +/- 0.15, N = 3SE +/- 0.15, N = 317.0716.8716.7217.01MIN: 16.76 / MAX: 19.44MIN: 16.34 / MAX: 19.11MIN: 16.27 / MAX: 20.76MIN: 16.54 / MAX: 21.491. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: Vulkan GPU - Model: mobilenet123448121620Min: 16.96 / Avg: 17.07 / Max: 17.21Min: 16.53 / Avg: 16.87 / Max: 17.31Min: 16.43 / Avg: 16.72 / Max: 16.91Min: 16.74 / Avg: 17.01 / Max: 17.261. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: Vulkan GPU-v2-v2 - Model: mobilenet-v212343691215SE +/- 2.74, N = 3SE +/- 0.06, N = 3SE +/- 0.05, N = 3SE +/- 0.05, N = 310.287.267.207.20MIN: 7.19 / MAX: 1621.51MIN: 6.96 / MAX: 8.01MIN: 6.96 / MAX: 8.16MIN: 6.94 / MAX: 8.611. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: Vulkan GPU-v2-v2 - Model: mobilenet-v212343691215Min: 7.51 / Avg: 10.28 / Max: 15.76Min: 7.15 / Avg: 7.26 / Max: 7.33Min: 7.1 / Avg: 7.2 / Max: 7.26Min: 7.1 / Avg: 7.2 / Max: 7.271. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: Vulkan GPU-v3-v3 - Model: mobilenet-v31234246810SE +/- 0.08, N = 3SE +/- 0.06, N = 3SE +/- 0.06, N = 3SE +/- 0.07, N = 36.976.596.576.58MIN: 6.61 / MAX: 70.49MIN: 6.32 / MAX: 8.92MIN: 6.38 / MAX: 10.6MIN: 6.33 / MAX: 11.211. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: Vulkan GPU-v3-v3 - Model: mobilenet-v312343691215Min: 6.88 / Avg: 6.97 / Max: 7.13Min: 6.47 / Avg: 6.59 / Max: 6.67Min: 6.45 / Avg: 6.57 / Max: 6.67Min: 6.44 / Avg: 6.58 / Max: 6.681. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: Vulkan GPU - Model: shufflenet-v21234246810SE +/- 0.03, N = 3SE +/- 0.07, N = 3SE +/- 0.03, N = 2SE +/- 0.05, N = 37.437.187.217.14MIN: 7.01 / MAX: 31.94MIN: 6.81 / MAX: 11.92MIN: 6.95 / MAX: 8.09MIN: 6.94 / MAX: 8.721. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: Vulkan GPU - Model: shufflenet-v212343691215Min: 7.36 / Avg: 7.43 / Max: 7.46Min: 7.05 / Avg: 7.18 / Max: 7.25Min: 7.18 / Avg: 7.21 / Max: 7.23Min: 7.05 / Avg: 7.14 / Max: 7.221. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: Vulkan GPU - Model: mnasnet123448121620SE +/- 8.22, N = 3SE +/- 0.09, N = 3SE +/- 0.11, N = 2SE +/- 0.09, N = 315.296.606.506.57MIN: 6.37 / MAX: 789.45MIN: 6.21 / MAX: 11.38MIN: 6.34 / MAX: 7.19MIN: 6.32 / MAX: 7.641. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: Vulkan GPU - Model: mnasnet123448121620Min: 6.86 / Avg: 15.29 / Max: 31.72Min: 6.43 / Avg: 6.6 / Max: 6.7Min: 6.39 / Avg: 6.5 / Max: 6.61Min: 6.4 / Avg: 6.57 / Max: 6.721. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: Vulkan GPU - Model: efficientnet-b012341020304050SE +/- 32.78, N = 3SE +/- 0.09, N = 3SE +/- 0.02, N = 3SE +/- 0.03, N = 342.359.219.279.35MIN: 9.43 / MAX: 3150.76MIN: 8.97 / MAX: 13.92MIN: 9.15 / MAX: 10.46MIN: 9.17 / MAX: 26.121. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: Vulkan GPU - Model: efficientnet-b01234918273645Min: 9.55 / Avg: 42.35 / Max: 107.9Min: 9.04 / Avg: 9.21 / Max: 9.31Min: 9.23 / Avg: 9.27 / Max: 9.3Min: 9.32 / Avg: 9.35 / Max: 9.41. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: Vulkan GPU - Model: blazeface12340.78531.57062.35593.14123.9265SE +/- 0.02, N = 3SE +/- 0.03, N = 3SE +/- 0.02, N = 3SE +/- 0.04, N = 33.493.403.383.46MIN: 3.33 / MAX: 5.94MIN: 3.21 / MAX: 4.75MIN: 3.31 / MAX: 4.04MIN: 3.28 / MAX: 4.121. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: Vulkan GPU - Model: blazeface1234246810Min: 3.47 / Avg: 3.49 / Max: 3.52Min: 3.3 / Avg: 3.37 / Max: 3.4Min: 3.34 / Avg: 3.38 / Max: 3.41Min: 3.37 / Avg: 3.46 / Max: 3.521. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: Vulkan GPU - Model: googlenet123448121620SE +/- 0.18, N = 3SE +/- 0.24, N = 3SE +/- 0.14, N = 3SE +/- 0.34, N = 316.4116.2916.5317.20MIN: 15.86 / MAX: 19.6MIN: 15.63 / MAX: 64.38MIN: 16.02 / MAX: 19.51MIN: 16.25 / MAX: 19.91. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: Vulkan GPU - Model: googlenet123448121620Min: 16.09 / Avg: 16.41 / Max: 16.73Min: 15.84 / Avg: 16.29 / Max: 16.65Min: 16.33 / Avg: 16.53 / Max: 16.79Min: 16.55 / Avg: 17.2 / Max: 17.71. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: Vulkan GPU - Model: vgg161234816243240SE +/- 0.35, N = 3SE +/- 0.28, N = 3SE +/- 0.19, N = 3SE +/- 0.38, N = 333.0233.9234.2734.82MIN: 32.36 / MAX: 88.29MIN: 33.1 / MAX: 38.42MIN: 33.73 / MAX: 51.13MIN: 33.83 / MAX: 39.11. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: Vulkan GPU - Model: vgg161234714212835Min: 32.66 / Avg: 33.02 / Max: 33.71Min: 33.46 / Avg: 33.92 / Max: 34.42Min: 33.96 / Avg: 34.27 / Max: 34.63Min: 34.07 / Avg: 34.82 / Max: 35.341. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: Vulkan GPU - Model: resnet18123448121620SE +/- 0.23, N = 3SE +/- 0.13, N = 3SE +/- 0.15, N = 3SE +/- 0.24, N = 313.0012.9713.2113.81MIN: 12.47 / MAX: 112.43MIN: 12.6 / MAX: 17.75MIN: 12.83 / MAX: 23.31MIN: 13.2 / MAX: 24.061. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: Vulkan GPU - Model: resnet18123448121620Min: 12.66 / Avg: 13 / Max: 13.43Min: 12.74 / Avg: 12.97 / Max: 13.18Min: 12.96 / Avg: 13.21 / Max: 13.47Min: 13.35 / Avg: 13.81 / Max: 14.141. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: Vulkan GPU - Model: alexnet12343691215SE +/- 0.09, N = 3SE +/- 0.28, N = 3SE +/- 0.20, N = 3SE +/- 0.21, N = 38.868.859.069.20MIN: 8.61 / MAX: 9.35MIN: 8.44 / MAX: 15.84MIN: 8.57 / MAX: 13.77MIN: 8.64 / MAX: 11.591. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: Vulkan GPU - Model: alexnet12343691215Min: 8.71 / Avg: 8.86 / Max: 9.02Min: 8.54 / Avg: 8.85 / Max: 9.41Min: 8.68 / Avg: 9.06 / Max: 9.37Min: 8.79 / Avg: 9.2 / Max: 9.481. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: Vulkan GPU - Model: resnet501234612182430SE +/- 0.10, N = 3SE +/- 0.29, N = 3SE +/- 0.25, N = 3SE +/- 0.40, N = 322.3522.3622.9423.65MIN: 22.04 / MAX: 26.33MIN: 21.61 / MAX: 25.06MIN: 22.35 / MAX: 27.84MIN: 22.75 / MAX: 26.781. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: Vulkan GPU - Model: resnet501234612182430Min: 22.18 / Avg: 22.35 / Max: 22.51Min: 21.77 / Avg: 22.36 / Max: 22.68Min: 22.47 / Avg: 22.94 / Max: 23.3Min: 22.9 / Avg: 23.65 / Max: 24.281. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: Vulkan GPU - Model: yolov4-tiny1234612182430SE +/- 0.13, N = 3SE +/- 0.48, N = 3SE +/- 0.14, N = 3SE +/- 0.42, N = 324.6325.1625.0726.04MIN: 24.14 / MAX: 27.26MIN: 24.26 / MAX: 27.69MIN: 24.51 / MAX: 25.86MIN: 25.03 / MAX: 29.251. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: Vulkan GPU - Model: yolov4-tiny1234612182430Min: 24.4 / Avg: 24.63 / Max: 24.85Min: 24.45 / Avg: 25.16 / Max: 26.07Min: 24.81 / Avg: 25.07 / Max: 25.27Min: 25.28 / Avg: 26.04 / Max: 26.741. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: Vulkan GPU - Model: squeezenet_ssd1234510152025SE +/- 0.10, N = 3SE +/- 0.14, N = 3SE +/- 0.15, N = 3SE +/- 0.16, N = 318.6218.7718.6419.00MIN: 18.29 / MAX: 21.32MIN: 18.29 / MAX: 20.31MIN: 18.18 / MAX: 19.59MIN: 18.54 / MAX: 20.041. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: Vulkan GPU - Model: squeezenet_ssd1234510152025Min: 18.48 / Avg: 18.62 / Max: 18.81Min: 18.52 / Avg: 18.77 / Max: 19.01Min: 18.35 / Avg: 18.64 / Max: 18.83Min: 18.8 / Avg: 19 / Max: 19.311. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: Vulkan GPU - Model: regnety_400m12341224364860SE +/- 11.69, N = 3SE +/- 0.74, N = 3SE +/- 0.20, N = 3SE +/- 0.30, N = 354.9342.4642.9842.75MIN: 42.85 / MAX: 3213.84MIN: 40.85 / MAX: 79MIN: 42.4 / MAX: 115MIN: 42.01 / MAX: 82.871. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: Vulkan GPU - Model: regnety_400m12341122334455Min: 43.08 / Avg: 54.93 / Max: 78.31Min: 40.99 / Avg: 42.46 / Max: 43.24Min: 42.61 / Avg: 42.98 / Max: 43.28Min: 42.45 / Avg: 42.75 / Max: 43.361. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread