TNN NCNN

AMD Ryzen 9 3950X 16-Core testing with a ASUS ROG CROSSHAIR VIII HERO (WI-FI) (1302 BIOS) and Sapphire AMD Radeon RX 5600 OEM/5600 XT / 5700/5700 6GB on Ubuntu 20.04 via the Phoronix Test Suite.

Compare your own system(s) to this result file with the Phoronix Test Suite by running the command: phoronix-test-suite benchmark 2009258-PTS-TNNNCNN783
Jump To Table - Results

View

Do Not Show Noisy Results
Do Not Show Results With Incomplete Data
Do Not Show Results With Little Change/Spread
List Notable Results

Limit displaying results to tests within:

HPC - High Performance Computing 2 Tests
Machine Learning 2 Tests

Statistics

Show Overall Harmonic Mean(s)
Show Overall Geometric Mean
Show Geometric Means Per-Suite/Category
Show Wins / Losses Counts (Pie Chart)
Normalize Results
Remove Outliers Before Calculating Averages

Graph Settings

Force Line Graphs Where Applicable
Convert To Scalar Where Applicable
Prefer Vertical Bar Graphs

Multi-Way Comparison

Condense Multi-Option Tests Into Single Result Graphs

Table

Show Detailed System Result Table

Run Management

Highlight
Result
Hide
Result
Result
Identifier
Performance Per
Dollar
Date
Run
  Test
  Duration
3950X + Navi
September 25 2020
  1 Hour, 4 Minutes
2
September 25 2020
  1 Hour, 3 Minutes
3
September 25 2020
  1 Hour, 3 Minutes
Invert Hiding All Results Option
  1 Hour, 3 Minutes

Only show results where is faster than
Only show results matching title/arguments (delimit multiple options with a comma):
Do not show results matching title/arguments (delimit multiple options with a comma):


TNN NCNNProcessorMotherboardChipsetMemoryDiskGraphicsAudioMonitorNetworkOSKernelDesktopDisplay ServerOpenGLOpenCLVulkanCompilerFile-SystemScreen Resolution3950X + Navi23AMD Ryzen 9 3950X 16-Core @ 3.50GHz (16 Cores / 32 Threads)ASUS ROG CROSSHAIR VIII HERO (WI-FI) (1302 BIOS)AMD Starship/Matisse16GB2000GB Corsair Force MP600 + 2000GBSapphire AMD Radeon RX 5600 OEM/5600 XT / 5700/5700 6GB (1780/875MHz)AMD Navi 10 HDMI AudioDELL P2415QRealtek RTL8125 2.5GbE + Intel I211 + Intel Wi-Fi 6 AX200Ubuntu 20.045.9.0-050900rc6daily20200925-generic (x86_64) 20200924GNOME Shell 3.36.4X Server 1.20.84.6 Mesa 20.3.0-devel (git-3173367 2020-09-25 focal-oibaf-ppa) (LLVM 10.0.1)OpenCL 2.0 AMD-APP (3182.0)1.2.145GCC 9.3.0 + CUDA 11.0ext43840x2160OpenBenchmarking.orgCompiler Details- --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++,gm2 --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none,hsa --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v Processor Details- Scaling Governor: acpi-cpufreq performance - CPU Microcode: 0x8701013Security Details- itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Full AMD retpoline IBPB: conditional STIBP: conditional RSB filling + srbds: Not affected + tsx_async_abort: Not affected

3950X + Navi23Result OverviewPhoronix Test Suite100%101%103%104%TNNNCNNNCNNNCNNTNNNCNNNCNNNCNNNCNNNCNNNCNNNCNNNCNNNCNNNCNNNCNNNCNNNCNNNCNNNCNNNCNNNCNNNCNNNCNNNCNNNCNNNCNNNCNNNCNNNCNNCPU - SqueezeNet v1.1CPU - efficientnet-b0CPU - mobilenetCPU - googlenetCPU - MobileNet v2Vulkan GPU - shufflenet-v2CPU-v2-v2 - mobilenet-v2CPU - yolov4-tinyCPU - resnet18Vulkan GPU - yolov4-tinyCPU - resnet50Vulkan GPU - efficientnet-b0CPU - alexnetVulkan GPU - alexnetCPU - squeezenetVulkan GPU - resnet18CPU - mnasnetVulkan GPU - squeezenetCPU - vgg16CPU-v3-v3 - mobilenet-v3Vulkan GPU-v3-v3 - mobilenet-v3Vulkan GPU - googlenetVulkan GPU - resnet50CPU - shufflenet-v2Vulkan GPU - mobilenetVulkan GPU - vgg16CPU - blazefaceVulkan GPU-v2-v2 - mobilenet-v2Vulkan GPU - mnasnetVulkan GPU - blazeface

TNN NCNNncnn: CPU - squeezenetncnn: CPU - mobilenetncnn: CPU-v2-v2 - mobilenet-v2ncnn: CPU-v3-v3 - mobilenet-v3ncnn: CPU - shufflenet-v2ncnn: CPU - mnasnetncnn: CPU - efficientnet-b0ncnn: CPU - blazefacencnn: CPU - googlenetncnn: CPU - vgg16ncnn: CPU - resnet18ncnn: CPU - alexnetncnn: CPU - resnet50ncnn: CPU - yolov4-tinyncnn: Vulkan GPU - squeezenetncnn: Vulkan GPU - mobilenetncnn: Vulkan GPU-v2-v2 - mobilenet-v2ncnn: Vulkan GPU-v3-v3 - mobilenet-v3ncnn: Vulkan GPU - shufflenet-v2ncnn: Vulkan GPU - mnasnetncnn: Vulkan GPU - efficientnet-b0ncnn: Vulkan GPU - blazefacencnn: Vulkan GPU - googlenetncnn: Vulkan GPU - vgg16ncnn: Vulkan GPU - resnet18ncnn: Vulkan GPU - alexnetncnn: Vulkan GPU - resnet50ncnn: Vulkan GPU - yolov4-tinytnn: CPU - MobileNet v2tnn: CPU - SqueezeNet v1.13950X + Navi2315.9617.575.925.155.15.217.052.0119.2270.2917.6916.5829.7029.263.586.582.143.11.842.236.830.764.2514.971.735.234.958.65244.905236.99615.8517.185.835.175.105.187.202.0119.3370.0117.6016.6329.3628.943.586.582.143.101.862.236.870.764.2514.971.725.214.958.55240.615225.24715.9017.165.865.165.095.197.012.0118.9070.2917.4316.5029.5328.823.606.592.143.091.832.236.800.764.2614.981.735.194.968.55240.195238.144OpenBenchmarking.org

NCNN

NCNN is a high performance neural network inference framework optimized for mobile and other platforms developed by Tencent. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: CPU - Model: squeezenet3950X + Navi3248121620SE +/- 0.14, N = 3SE +/- 0.04, N = 3SE +/- 0.04, N = 315.9615.9015.85MIN: 15.48 / MAX: 17.29MIN: 15.48 / MAX: 16.35MIN: 15.47 / MAX: 16.51. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: CPU - Model: squeezenet3950X + Navi3248121620Min: 15.72 / Avg: 15.96 / Max: 16.21Min: 15.83 / Avg: 15.9 / Max: 15.95Min: 15.76 / Avg: 15.85 / Max: 15.911. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: CPU - Model: mobilenet3950X + Navi3248121620SE +/- 0.34, N = 3SE +/- 0.10, N = 3SE +/- 0.21, N = 317.5717.1617.18MIN: 16.92 / MAX: 18.71MIN: 16.72 / MAX: 17.56MIN: 16.64 / MAX: 18.061. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: CPU - Model: mobilenet3950X + Navi3248121620Min: 17.15 / Avg: 17.57 / Max: 18.25Min: 17 / Avg: 17.16 / Max: 17.33Min: 16.88 / Avg: 17.18 / Max: 17.581. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: CPU-v2-v2 - Model: mobilenet-v23950X + Navi321.3322.6643.9965.3286.66SE +/- 0.07, N = 3SE +/- 0.02, N = 3SE +/- 0.01, N = 35.925.865.83MIN: 5.69 / MAX: 29.4MIN: 5.7 / MAX: 7.43MIN: 5.69 / MAX: 7.351. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: CPU-v2-v2 - Model: mobilenet-v23950X + Navi32246810Min: 5.85 / Avg: 5.92 / Max: 6.06Min: 5.84 / Avg: 5.86 / Max: 5.89Min: 5.82 / Avg: 5.83 / Max: 5.841. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: CPU-v3-v3 - Model: mobilenet-v33950X + Navi321.16332.32663.48994.65325.8165SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.03, N = 35.155.165.17MIN: 5.04 / MAX: 16.03MIN: 5.04 / MAX: 6.76MIN: 5.05 / MAX: 6.681. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: CPU-v3-v3 - Model: mobilenet-v33950X + Navi32246810Min: 5.13 / Avg: 5.15 / Max: 5.17Min: 5.14 / Avg: 5.16 / Max: 5.18Min: 5.14 / Avg: 5.17 / Max: 5.231. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: CPU - Model: shufflenet-v23950X + Navi321.14752.2953.44254.595.7375SE +/- 0.00, N = 3SE +/- 0.01, N = 3SE +/- 0.02, N = 35.105.095.10MIN: 5.04 / MAX: 6.5MIN: 5.01 / MAX: 6.95MIN: 5.02 / MAX: 6.451. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: CPU - Model: shufflenet-v23950X + Navi32246810Min: 5.1 / Avg: 5.1 / Max: 5.1Min: 5.06 / Avg: 5.09 / Max: 5.11Min: 5.07 / Avg: 5.1 / Max: 5.131. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: CPU - Model: mnasnet3950X + Navi321.17232.34463.51694.68925.8615SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.00, N = 35.215.195.18MIN: 5.1 / MAX: 7.28MIN: 5.1 / MAX: 6.68MIN: 5.07 / MAX: 7.051. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: CPU - Model: mnasnet3950X + Navi32246810Min: 5.18 / Avg: 5.21 / Max: 5.23Min: 5.17 / Avg: 5.19 / Max: 5.21Min: 5.18 / Avg: 5.18 / Max: 5.191. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: CPU - Model: efficientnet-b03950X + Navi32246810SE +/- 0.03, N = 3SE +/- 0.01, N = 3SE +/- 0.16, N = 37.057.017.20MIN: 6.94 / MAX: 7.27MIN: 6.92 / MAX: 7.51MIN: 6.89 / MAX: 32.311. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: CPU - Model: efficientnet-b03950X + Navi323691215Min: 7.01 / Avg: 7.05 / Max: 7.1Min: 7 / Avg: 7.01 / Max: 7.02Min: 7 / Avg: 7.2 / Max: 7.511. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: CPU - Model: blazeface3950X + Navi320.45230.90461.35691.80922.2615SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.01, N = 32.012.012.01MIN: 1.97 / MAX: 2.14MIN: 1.98 / MAX: 2.29MIN: 1.97 / MAX: 2.111. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: CPU - Model: blazeface3950X + Navi32246810Min: 2 / Avg: 2.01 / Max: 2.01Min: 2.01 / Avg: 2.01 / Max: 2.02Min: 2 / Avg: 2.01 / Max: 2.021. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: CPU - Model: googlenet3950X + Navi32510152025SE +/- 0.23, N = 3SE +/- 0.01, N = 3SE +/- 0.35, N = 319.2218.9019.33MIN: 18.31 / MAX: 56.39MIN: 18.17 / MAX: 19.69MIN: 18.21 / MAX: 23.941. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: CPU - Model: googlenet3950X + Navi32510152025Min: 18.88 / Avg: 19.22 / Max: 19.66Min: 18.88 / Avg: 18.9 / Max: 18.92Min: 18.93 / Avg: 19.33 / Max: 20.021. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: CPU - Model: vgg163950X + Navi321632486480SE +/- 0.11, N = 3SE +/- 0.06, N = 3SE +/- 0.09, N = 370.2970.2970.01MIN: 68.71 / MAX: 72.85MIN: 68.56 / MAX: 118.37MIN: 68.34 / MAX: 79.571. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: CPU - Model: vgg163950X + Navi321428425670Min: 70.18 / Avg: 70.29 / Max: 70.5Min: 70.2 / Avg: 70.29 / Max: 70.39Min: 69.9 / Avg: 70.01 / Max: 70.181. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: CPU - Model: resnet183950X + Navi3248121620SE +/- 0.17, N = 3SE +/- 0.01, N = 3SE +/- 0.16, N = 317.6917.4317.60MIN: 17.36 / MAX: 18.26MIN: 17.29 / MAX: 17.97MIN: 17.3 / MAX: 18.731. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: CPU - Model: resnet183950X + Navi3248121620Min: 17.48 / Avg: 17.69 / Max: 18.04Min: 17.4 / Avg: 17.43 / Max: 17.45Min: 17.43 / Avg: 17.6 / Max: 17.911. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: CPU - Model: alexnet3950X + Navi3248121620SE +/- 0.06, N = 3SE +/- 0.01, N = 3SE +/- 0.09, N = 316.5816.5016.63MIN: 16.38 / MAX: 18.55MIN: 16.37 / MAX: 17.15MIN: 16.38 / MAX: 35.761. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: CPU - Model: alexnet3950X + Navi3248121620Min: 16.51 / Avg: 16.58 / Max: 16.69Min: 16.49 / Avg: 16.5 / Max: 16.51Min: 16.49 / Avg: 16.63 / Max: 16.81. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: CPU - Model: resnet503950X + Navi32714212835SE +/- 0.16, N = 3SE +/- 0.12, N = 3SE +/- 0.04, N = 329.7029.5329.36MIN: 29.28 / MAX: 71.36MIN: 29.11 / MAX: 67.88MIN: 29.03 / MAX: 30.441. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: CPU - Model: resnet503950X + Navi32714212835Min: 29.53 / Avg: 29.7 / Max: 30.03Min: 29.4 / Avg: 29.53 / Max: 29.76Min: 29.29 / Avg: 29.36 / Max: 29.421. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: CPU - Model: yolov4-tiny3950X + Navi32714212835SE +/- 0.18, N = 3SE +/- 0.08, N = 3SE +/- 0.16, N = 329.2628.8228.94MIN: 28.61 / MAX: 39.41MIN: 28.43 / MAX: 30.08MIN: 28.45 / MAX: 30.871. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: CPU - Model: yolov4-tiny3950X + Navi32612182430Min: 28.91 / Avg: 29.26 / Max: 29.49Min: 28.72 / Avg: 28.82 / Max: 28.97Min: 28.75 / Avg: 28.94 / Max: 29.251. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: Vulkan GPU - Model: squeezenet3950X + Navi320.811.622.433.244.05SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.00, N = 33.583.603.58MIN: 3.47 / MAX: 3.8MIN: 3.48 / MAX: 3.82MIN: 3.47 / MAX: 3.761. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: Vulkan GPU - Model: squeezenet3950X + Navi32246810Min: 3.57 / Avg: 3.58 / Max: 3.6Min: 3.59 / Avg: 3.6 / Max: 3.61Min: 3.57 / Avg: 3.58 / Max: 3.581. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: Vulkan GPU - Model: mobilenet3950X + Navi32246810SE +/- 0.01, N = 3SE +/- 0.02, N = 3SE +/- 0.01, N = 36.586.596.58MIN: 6.53 / MAX: 7.07MIN: 6.53 / MAX: 12.11MIN: 6.54 / MAX: 6.791. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: Vulkan GPU - Model: mobilenet3950X + Navi323691215Min: 6.57 / Avg: 6.58 / Max: 6.6Min: 6.57 / Avg: 6.59 / Max: 6.62Min: 6.57 / Avg: 6.58 / Max: 6.61. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: Vulkan GPU-v2-v2 - Model: mobilenet-v23950X + Navi320.48150.9631.44451.9262.4075SE +/- 0.00, N = 3SE +/- 0.01, N = 3SE +/- 0.00, N = 32.142.142.14MIN: 2.09 / MAX: 2.55MIN: 2.09 / MAX: 3.03MIN: 2.09 / MAX: 3.71. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: Vulkan GPU-v2-v2 - Model: mobilenet-v23950X + Navi32246810Min: 2.13 / Avg: 2.14 / Max: 2.14Min: 2.13 / Avg: 2.14 / Max: 2.15Min: 2.14 / Avg: 2.14 / Max: 2.141. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: Vulkan GPU-v3-v3 - Model: mobilenet-v33950X + Navi320.69751.3952.09252.793.4875SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 33.103.093.10MIN: 3.05 / MAX: 4.87MIN: 3.05 / MAX: 3.9MIN: 3.05 / MAX: 3.511. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: Vulkan GPU-v3-v3 - Model: mobilenet-v33950X + Navi32246810Min: 3.1 / Avg: 3.1 / Max: 3.1Min: 3.09 / Avg: 3.09 / Max: 3.1Min: 3.09 / Avg: 3.1 / Max: 3.11. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: Vulkan GPU - Model: shufflenet-v23950X + Navi320.41850.8371.25551.6742.0925SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.03, N = 31.841.831.86MIN: 1.82 / MAX: 3.18MIN: 1.82 / MAX: 1.99MIN: 1.82 / MAX: 11.331. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: Vulkan GPU - Model: shufflenet-v23950X + Navi32246810Min: 1.84 / Avg: 1.84 / Max: 1.84Min: 1.83 / Avg: 1.83 / Max: 1.84Min: 1.83 / Avg: 1.86 / Max: 1.921. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: Vulkan GPU - Model: mnasnet3950X + Navi320.50181.00361.50542.00722.509SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 32.232.232.23MIN: 2.19 / MAX: 2.47MIN: 2.19 / MAX: 2.7MIN: 2.19 / MAX: 2.461. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: Vulkan GPU - Model: mnasnet3950X + Navi32246810Min: 2.23 / Avg: 2.23 / Max: 2.23Min: 2.22 / Avg: 2.23 / Max: 2.23Min: 2.23 / Avg: 2.23 / Max: 2.231. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: Vulkan GPU - Model: efficientnet-b03950X + Navi32246810SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.04, N = 36.836.806.87MIN: 6.71 / MAX: 15.49MIN: 6.7 / MAX: 10.76MIN: 6.71 / MAX: 17.281. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: Vulkan GPU - Model: efficientnet-b03950X + Navi323691215Min: 6.82 / Avg: 6.83 / Max: 6.85Min: 6.78 / Avg: 6.8 / Max: 6.81Min: 6.8 / Avg: 6.87 / Max: 6.921. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: Vulkan GPU - Model: blazeface3950X + Navi320.1710.3420.5130.6840.855SE +/- 0.00, N = 3SE +/- 0.01, N = 3SE +/- 0.00, N = 30.760.760.76MIN: 0.75 / MAX: 0.99MIN: 0.75 / MAX: 0.97MIN: 0.75 / MAX: 0.961. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: Vulkan GPU - Model: blazeface3950X + Navi32246810Min: 0.76 / Avg: 0.76 / Max: 0.77Min: 0.75 / Avg: 0.76 / Max: 0.77Min: 0.76 / Avg: 0.76 / Max: 0.771. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: Vulkan GPU - Model: googlenet3950X + Navi320.95851.9172.87553.8344.7925SE +/- 0.00, N = 3SE +/- 0.01, N = 3SE +/- 0.00, N = 34.254.264.25MIN: 4.22 / MAX: 4.91MIN: 4.23 / MAX: 9.69MIN: 4.22 / MAX: 5.321. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: Vulkan GPU - Model: googlenet3950X + Navi32246810Min: 4.24 / Avg: 4.25 / Max: 4.25Min: 4.25 / Avg: 4.26 / Max: 4.29Min: 4.24 / Avg: 4.25 / Max: 4.251. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: Vulkan GPU - Model: vgg163950X + Navi3248121620SE +/- 0.00, N = 3SE +/- 0.02, N = 3SE +/- 0.00, N = 314.9714.9814.97MIN: 14.41 / MAX: 15.48MIN: 14.38 / MAX: 19.49MIN: 14.46 / MAX: 15.661. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: Vulkan GPU - Model: vgg163950X + Navi3248121620Min: 14.97 / Avg: 14.97 / Max: 14.98Min: 14.96 / Avg: 14.98 / Max: 15.02Min: 14.96 / Avg: 14.97 / Max: 14.971. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: Vulkan GPU - Model: resnet183950X + Navi320.38930.77861.16791.55721.9465SE +/- 0.01, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 31.731.731.72MIN: 1.7 / MAX: 2.77MIN: 1.71 / MAX: 2.05MIN: 1.7 / MAX: 2.251. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: Vulkan GPU - Model: resnet183950X + Navi32246810Min: 1.72 / Avg: 1.73 / Max: 1.74Min: 1.73 / Avg: 1.73 / Max: 1.73Min: 1.72 / Avg: 1.72 / Max: 1.731. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: Vulkan GPU - Model: alexnet3950X + Navi321.17682.35363.53044.70725.884SE +/- 0.04, N = 3SE +/- 0.02, N = 3SE +/- 0.05, N = 35.235.195.21MIN: 4.89 / MAX: 16.85MIN: 4.9 / MAX: 9.27MIN: 4.86 / MAX: 20.011. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: Vulkan GPU - Model: alexnet3950X + Navi32246810Min: 5.15 / Avg: 5.23 / Max: 5.28Min: 5.17 / Avg: 5.19 / Max: 5.22Min: 5.16 / Avg: 5.21 / Max: 5.311. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: Vulkan GPU - Model: resnet503950X + Navi321.1162.2323.3484.4645.58SE +/- 0.01, N = 3SE +/- 0.00, N = 3SE +/- 0.01, N = 34.954.964.95MIN: 4.88 / MAX: 8.9MIN: 4.89 / MAX: 10.05MIN: 4.9 / MAX: 8.861. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: Vulkan GPU - Model: resnet503950X + Navi32246810Min: 4.93 / Avg: 4.95 / Max: 4.96Min: 4.95 / Avg: 4.96 / Max: 4.96Min: 4.94 / Avg: 4.95 / Max: 4.971. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: Vulkan GPU - Model: yolov4-tiny3950X + Navi32246810SE +/- 0.09, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 38.658.558.55MIN: 8.5 / MAX: 46.41MIN: 8.5 / MAX: 8.75MIN: 8.46 / MAX: 13.541. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: Vulkan GPU - Model: yolov4-tiny3950X + Navi323691215Min: 8.56 / Avg: 8.65 / Max: 8.82Min: 8.53 / Avg: 8.55 / Max: 8.56Min: 8.54 / Avg: 8.55 / Max: 8.561. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

TNN

TNN is an open-source deep learning reasoning framework developed by Tencent. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgms, Fewer Is BetterTNN 0.2.3Target: CPU - Model: MobileNet v23950X + Navi3250100150200250SE +/- 2.51, N = 3SE +/- 0.31, N = 3SE +/- 0.38, N = 3244.91240.20240.62MIN: 240.06 / MAX: 267.36MIN: 238.85 / MAX: 245.71MIN: 239.1 / MAX: 274.31. (CXX) g++ options: -fopenmp -pthread -fvisibility=hidden -O3 -rdynamic -ldl
OpenBenchmarking.orgms, Fewer Is BetterTNN 0.2.3Target: CPU - Model: MobileNet v23950X + Navi324080120160200Min: 241.19 / Avg: 244.91 / Max: 249.68Min: 239.73 / Avg: 240.19 / Max: 240.78Min: 239.97 / Avg: 240.62 / Max: 241.291. (CXX) g++ options: -fopenmp -pthread -fvisibility=hidden -O3 -rdynamic -ldl

OpenBenchmarking.orgms, Fewer Is BetterTNN 0.2.3Target: CPU - Model: SqueezeNet v1.13950X + Navi3250100150200250SE +/- 0.72, N = 3SE +/- 0.09, N = 3SE +/- 0.72, N = 3237.00238.14225.25MIN: 234.3 / MAX: 240MIN: 235.38 / MAX: 238.84MIN: 223.02 / MAX: 233.91. (CXX) g++ options: -fopenmp -pthread -fvisibility=hidden -O3 -rdynamic -ldl
OpenBenchmarking.orgms, Fewer Is BetterTNN 0.2.3Target: CPU - Model: SqueezeNet v1.13950X + Navi324080120160200Min: 235.6 / Avg: 237 / Max: 238.01Min: 237.96 / Avg: 238.14 / Max: 238.24Min: 223.96 / Avg: 225.25 / Max: 226.441. (CXX) g++ options: -fopenmp -pthread -fvisibility=hidden -O3 -rdynamic -ldl