ncnn december

AMD Ryzen Threadripper 3990X 64-Core testing with a System76 Thelio Major (F4c Z5 BIOS) and AMD Radeon RX 5600 OEM/5600 XT / 5700/5700 8GB on Pop 20.10 via the Phoronix Test Suite.

Compare your own system(s) to this result file with the Phoronix Test Suite by running the command: phoronix-test-suite benchmark 2012181-PTS-NCNNDECE88
Jump To Table - Results

View

Do Not Show Noisy Results
Do Not Show Results With Incomplete Data
Do Not Show Results With Little Change/Spread
List Notable Results

Statistics

Show Overall Harmonic Mean(s)
Show Overall Geometric Mean
Show Wins / Losses Counts (Pie Chart)
Normalize Results
Remove Outliers Before Calculating Averages

Graph Settings

Force Line Graphs Where Applicable
Convert To Scalar Where Applicable
Disable Color Branding
Prefer Vertical Bar Graphs

Multi-Way Comparison

Condense Multi-Option Tests Into Single Result Graphs

Table

Show Detailed System Result Table

Run Management

Highlight
Result
Hide
Result
Result
Identifier
Performance Per
Dollar
Date
Run
  Test
  Duration
1
December 18 2020
  2 Hours, 41 Minutes
3
December 18 2020
  2 Hours, 40 Minutes
2
December 18 2020
  4 Hours, 29 Minutes
AMD Ryzen Threadripper 3990X 64-Core - AMD Radeon RX
December 18 2020
  2 Hours, 41 Minutes
Invert Hiding All Results Option
  3 Hours, 8 Minutes

Only show results where is faster than
Only show results matching title/arguments (delimit multiple options with a comma):
Do not show results matching title/arguments (delimit multiple options with a comma):


ncnn decemberProcessorMotherboardChipsetMemoryDiskGraphicsAudioMonitorNetworkOSKernelDesktopDisplay ServerDisplay DriverOpenGLVulkanCompilerFile-SystemScreen Resolution132AMD Ryzen Threadripper 3990X 64-Core - AMD Radeon RXAMD Ryzen Threadripper 3990X 64-Core @ 2.90GHz (64 Cores / 128 Threads)System76 Thelio Major (F4c Z5 BIOS)AMD Starship/Matisse126GBSamsung SSD 970 EVO Plus 500GBAMD Radeon RX 5600 OEM/5600 XT / 5700/5700 8GB (1750/875MHz)AMD Navi 10 HDMI AudioDELL P2415QIntel I211 + Intel Wi-Fi 6 AX200Pop 20.105.8.0-7625-generic (x86_64)GNOME Shell 3.38.1X Server 1.20.8amdgpu 19.1.04.6 Mesa 20.2.1 (LLVM 11.0.0)1.2.131GCC 10.2.0 + Clang 11.0.0-2ext43840x2160OpenBenchmarking.orgKernel Details- snd_usb_audio.ignore_ctl_error=1Compiler Details- --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none=/build/gcc-10-JvwpWM/gcc-10-10.2.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-10-JvwpWM/gcc-10-10.2.0/debian/tmp-gcn/usr,hsa --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v Processor Details- Scaling Governor: acpi-cpufreq ondemand (Boost: Enabled) - CPU Microcode: 0x8301025Security Details- itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Full AMD retpoline IBPB: conditional STIBP: conditional RSB filling + srbds: Not affected + tsx_async_abort: Not affected

132AMD Ryzen Threadripper 3990X 64-Core - AMD Radeon RXResult OverviewPhoronix Test Suite100%118%136%154%NCNNNCNNNCNNNCNNNCNNNCNNNCNNNCNNNCNNNCNNNCNNNCNNNCNNNCNNNCNNNCNNNCNNNCNNNCNNNCNNNCNNNCNNNCNNNCNNNCNNNCNNNCNNNCNNNCNNNCNNCPU - mnasnetVulkan GPU-v2-v2 - mobilenet-v2CPU - resnet50CPU - resnet18Vulkan GPU - resnet50Vulkan GPU - mnasnetVulkan GPU - resnet18Vulkan GPU-v3-v3 - mobilenet-v3CPU - yolov4-tinyVulkan GPU - alexnetCPU - vgg16CPU-v2-v2 - mobilenet-v2Vulkan GPU - yolov4-tinyVulkan GPU - googlenetVulkan GPU - vgg16CPU - alexnetCPU - googlenetVulkan GPU - efficientnet-b0Vulkan GPU - shufflenet-v2CPU - efficientnet-b0Vulkan GPU - squeezenet_ssdCPU-v3-v3 - mobilenet-v3CPU - blazefaceVulkan GPU - blazefaceCPU - mobilenetCPU - regnety_400mVulkan GPU - regnety_400mVulkan GPU - mobilenetCPU - shufflenet-v2CPU - squeezenet_ssd

ncnn decemberncnn: CPU - mobilenetncnn: CPU-v2-v2 - mobilenet-v2ncnn: CPU-v3-v3 - mobilenet-v3ncnn: CPU - shufflenet-v2ncnn: CPU - mnasnetncnn: CPU - efficientnet-b0ncnn: CPU - blazefacencnn: CPU - googlenetncnn: CPU - vgg16ncnn: CPU - resnet18ncnn: CPU - alexnetncnn: CPU - resnet50ncnn: CPU - yolov4-tinyncnn: CPU - squeezenet_ssdncnn: CPU - regnety_400mncnn: Vulkan GPU - mobilenetncnn: Vulkan GPU-v2-v2 - mobilenet-v2ncnn: Vulkan GPU-v3-v3 - mobilenet-v3ncnn: Vulkan GPU - shufflenet-v2ncnn: Vulkan GPU - mnasnetncnn: Vulkan GPU - efficientnet-b0ncnn: Vulkan GPU - blazefacencnn: Vulkan GPU - googlenetncnn: Vulkan GPU - vgg16ncnn: Vulkan GPU - resnet18ncnn: Vulkan GPU - alexnetncnn: Vulkan GPU - resnet50ncnn: Vulkan GPU - yolov4-tinyncnn: Vulkan GPU - squeezenet_ssdncnn: Vulkan GPU - regnety_400m132AMD Ryzen Threadripper 3990X 64-Core - AMD Radeon RX28.0113.5412.2812.5320.8916.876.2526.5050.5116.9810.2435.7732.5728.6394.0727.2613.2812.2312.2712.4517.006.0326.1451.8617.4410.3237.6633.4628.3091.8127.4312.8012.0912.4812.1716.486.0325.2550.9117.6410.6038.7734.4028.7591.0227.8814.5013.1112.4613.2617.506.2426.7353.2317.9710.5038.7934.5129.2693.7528.3513.3512.5512.3412.6717.246.1626.2253.3118.7710.7940.3634.7928.8892.8127.5013.1612.7112.6812.7116.946.1425.7953.8318.7510.9140.4235.3829.4793.6327.9513.0812.1512.3212.3116.786.0726.3054.1819.0510.7940.4535.1128.8392.0427.8212.7412.1212.1212.1216.686.0525.3054.7619.0211.0941.3035.2729.2091.16OpenBenchmarking.org

NCNN

NCNN is a high performance neural network inference framework optimized for mobile and other platforms developed by Tencent. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: CPU - Model: mobilenet132AMD Ryzen Threadripper 3990X 64-Core - AMD Radeon RX714212835SE +/- 0.13, N = 3SE +/- 0.30, N = 3SE +/- 0.32, N = 7SE +/- 0.06, N = 328.0127.4328.3527.95MIN: 25.95 / MAX: 32.69MIN: 25.91 / MAX: 130.23MIN: 25.83 / MAX: 163.15MIN: 25.96 / MAX: 39.871. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: CPU - Model: mobilenet132AMD Ryzen Threadripper 3990X 64-Core - AMD Radeon RX612182430Min: 27.74 / Avg: 28.01 / Max: 28.14Min: 27.04 / Avg: 27.43 / Max: 28.01Min: 27.7 / Avg: 28.35 / Max: 30.1Min: 27.84 / Avg: 27.95 / Max: 28.041. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: CPU-v2-v2 - Model: mobilenet-v2132AMD Ryzen Threadripper 3990X 64-Core - AMD Radeon RX3691215SE +/- 0.39, N = 3SE +/- 0.11, N = 3SE +/- 0.23, N = 7SE +/- 0.10, N = 313.5412.8013.3513.08MIN: 11.97 / MAX: 88.03MIN: 11.79 / MAX: 17.83MIN: 11.94 / MAX: 19.88MIN: 12.31 / MAX: 17.481. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: CPU-v2-v2 - Model: mobilenet-v2132AMD Ryzen Threadripper 3990X 64-Core - AMD Radeon RX48121620Min: 13.14 / Avg: 13.54 / Max: 14.31Min: 12.57 / Avg: 12.8 / Max: 12.93Min: 12.62 / Avg: 13.35 / Max: 14.19Min: 12.93 / Avg: 13.08 / Max: 13.271. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: CPU-v3-v3 - Model: mobilenet-v3132AMD Ryzen Threadripper 3990X 64-Core - AMD Radeon RX3691215SE +/- 0.21, N = 3SE +/- 0.11, N = 3SE +/- 0.17, N = 7SE +/- 0.06, N = 312.2812.0912.5512.15MIN: 11.88 / MAX: 13.4MIN: 11.79 / MAX: 13.55MIN: 11.83 / MAX: 18.78MIN: 11.75 / MAX: 17.021. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: CPU-v3-v3 - Model: mobilenet-v3132AMD Ryzen Threadripper 3990X 64-Core - AMD Radeon RX48121620Min: 12.04 / Avg: 12.28 / Max: 12.69Min: 11.9 / Avg: 12.09 / Max: 12.28Min: 11.98 / Avg: 12.55 / Max: 13.16Min: 12.03 / Avg: 12.15 / Max: 12.221. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: CPU - Model: shufflenet-v2132AMD Ryzen Threadripper 3990X 64-Core - AMD Radeon RX3691215SE +/- 0.24, N = 3SE +/- 0.06, N = 3SE +/- 0.13, N = 7SE +/- 0.16, N = 312.5312.4812.3412.32MIN: 11.92 / MAX: 35.11MIN: 12.13 / MAX: 17.09MIN: 11.69 / MAX: 16.82MIN: 11.97 / MAX: 13.581. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: CPU - Model: shufflenet-v2132AMD Ryzen Threadripper 3990X 64-Core - AMD Radeon RX48121620Min: 12.05 / Avg: 12.53 / Max: 12.85Min: 12.37 / Avg: 12.48 / Max: 12.55Min: 11.84 / Avg: 12.34 / Max: 12.78Min: 12.12 / Avg: 12.32 / Max: 12.641. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: CPU - Model: mnasnet132AMD Ryzen Threadripper 3990X 64-Core - AMD Radeon RX510152025SE +/- 7.59, N = 3SE +/- 0.02, N = 3SE +/- 0.20, N = 7SE +/- 0.14, N = 320.8912.1712.6712.31MIN: 11.9 / MAX: 1962.05MIN: 11.95 / MAX: 17.25MIN: 11.85 / MAX: 17.96MIN: 11.85 / MAX: 16.61. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: CPU - Model: mnasnet132AMD Ryzen Threadripper 3990X 64-Core - AMD Radeon RX510152025Min: 12.36 / Avg: 20.89 / Max: 36.04Min: 12.14 / Avg: 12.17 / Max: 12.22Min: 12.05 / Avg: 12.67 / Max: 13.3Min: 12.05 / Avg: 12.31 / Max: 12.531. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: CPU - Model: efficientnet-b0132AMD Ryzen Threadripper 3990X 64-Core - AMD Radeon RX48121620SE +/- 0.26, N = 3SE +/- 0.06, N = 3SE +/- 0.27, N = 7SE +/- 0.13, N = 316.8716.4817.2416.78MIN: 16.09 / MAX: 22.24MIN: 16.16 / MAX: 21.11MIN: 16.23 / MAX: 28.63MIN: 16.27 / MAX: 18.221. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: CPU - Model: efficientnet-b0132AMD Ryzen Threadripper 3990X 64-Core - AMD Radeon RX48121620Min: 16.36 / Avg: 16.87 / Max: 17.25Min: 16.37 / Avg: 16.48 / Max: 16.57Min: 16.39 / Avg: 17.24 / Max: 18.05Min: 16.65 / Avg: 16.78 / Max: 17.041. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: CPU - Model: blazeface132AMD Ryzen Threadripper 3990X 64-Core - AMD Radeon RX246810SE +/- 0.22, N = 3SE +/- 0.01, N = 3SE +/- 0.05, N = 7SE +/- 0.05, N = 36.256.036.166.07MIN: 5.88 / MAX: 7.48MIN: 5.87 / MAX: 10.72MIN: 5.86 / MAX: 11.53MIN: 5.8 / MAX: 6.671. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: CPU - Model: blazeface132AMD Ryzen Threadripper 3990X 64-Core - AMD Radeon RX3691215Min: 6.01 / Avg: 6.25 / Max: 6.69Min: 6.02 / Avg: 6.03 / Max: 6.04Min: 6.01 / Avg: 6.16 / Max: 6.37Min: 6.02 / Avg: 6.07 / Max: 6.161. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: CPU - Model: googlenet132AMD Ryzen Threadripper 3990X 64-Core - AMD Radeon RX612182430SE +/- 0.78, N = 3SE +/- 0.27, N = 3SE +/- 0.25, N = 7SE +/- 0.28, N = 326.5025.2526.2226.30MIN: 24.78 / MAX: 30.62MIN: 24.45 / MAX: 30MIN: 24.84 / MAX: 54.91MIN: 25.05 / MAX: 38.671. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: CPU - Model: googlenet132AMD Ryzen Threadripper 3990X 64-Core - AMD Radeon RX612182430Min: 25.17 / Avg: 26.5 / Max: 27.86Min: 24.74 / Avg: 25.25 / Max: 25.64Min: 25.62 / Avg: 26.22 / Max: 27.56Min: 25.77 / Avg: 26.3 / Max: 26.71. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: CPU - Model: vgg16132AMD Ryzen Threadripper 3990X 64-Core - AMD Radeon RX1224364860SE +/- 0.58, N = 3SE +/- 0.23, N = 3SE +/- 0.34, N = 7SE +/- 0.22, N = 350.5150.9153.3154.18MIN: 48.05 / MAX: 77.55MIN: 48.34 / MAX: 56.53MIN: 50.01 / MAX: 141.72MIN: 51.71 / MAX: 81.381. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: CPU - Model: vgg16132AMD Ryzen Threadripper 3990X 64-Core - AMD Radeon RX1122334455Min: 49.37 / Avg: 50.51 / Max: 51.29Min: 50.6 / Avg: 50.91 / Max: 51.37Min: 51.98 / Avg: 53.31 / Max: 54.42Min: 53.85 / Avg: 54.18 / Max: 54.61. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: CPU - Model: resnet18132AMD Ryzen Threadripper 3990X 64-Core - AMD Radeon RX510152025SE +/- 0.24, N = 3SE +/- 0.25, N = 3SE +/- 0.25, N = 7SE +/- 0.25, N = 316.9817.6418.7719.05MIN: 15.85 / MAX: 27.73MIN: 16.56 / MAX: 22.13MIN: 17.47 / MAX: 31.54MIN: 18.11 / MAX: 21.421. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: CPU - Model: resnet18132AMD Ryzen Threadripper 3990X 64-Core - AMD Radeon RX510152025Min: 16.59 / Avg: 16.98 / Max: 17.42Min: 17.16 / Avg: 17.64 / Max: 17.98Min: 18 / Avg: 18.77 / Max: 19.87Min: 18.77 / Avg: 19.05 / Max: 19.541. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: CPU - Model: alexnet132AMD Ryzen Threadripper 3990X 64-Core - AMD Radeon RX3691215SE +/- 0.18, N = 3SE +/- 0.29, N = 3SE +/- 0.13, N = 7SE +/- 0.05, N = 310.2410.6010.7910.79MIN: 9.5 / MAX: 11.82MIN: 9.62 / MAX: 85.91MIN: 9.8 / MAX: 16.8MIN: 10.21 / MAX: 16.611. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: CPU - Model: alexnet132AMD Ryzen Threadripper 3990X 64-Core - AMD Radeon RX3691215Min: 9.97 / Avg: 10.24 / Max: 10.57Min: 10.01 / Avg: 10.6 / Max: 10.93Min: 10.32 / Avg: 10.79 / Max: 11.29Min: 10.69 / Avg: 10.79 / Max: 10.841. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: CPU - Model: resnet50132AMD Ryzen Threadripper 3990X 64-Core - AMD Radeon RX918273645SE +/- 1.02, N = 3SE +/- 0.53, N = 3SE +/- 0.23, N = 7SE +/- 0.65, N = 335.7738.7740.3640.45MIN: 33.45 / MAX: 52.59MIN: 36.04 / MAX: 141.88MIN: 36.56 / MAX: 93.49MIN: 37.37 / MAX: 56.321. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: CPU - Model: resnet50132AMD Ryzen Threadripper 3990X 64-Core - AMD Radeon RX816243240Min: 34.24 / Avg: 35.77 / Max: 37.7Min: 37.86 / Avg: 38.77 / Max: 39.7Min: 39.29 / Avg: 40.36 / Max: 41.17Min: 39.14 / Avg: 40.45 / Max: 41.171. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: CPU - Model: yolov4-tiny132AMD Ryzen Threadripper 3990X 64-Core - AMD Radeon RX816243240SE +/- 0.40, N = 3SE +/- 0.54, N = 3SE +/- 0.20, N = 7SE +/- 0.09, N = 332.5734.4034.7935.11MIN: 31.34 / MAX: 37.29MIN: 32.58 / MAX: 39.94MIN: 33.38 / MAX: 46.81MIN: 34.07 / MAX: 39.691. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: CPU - Model: yolov4-tiny132AMD Ryzen Threadripper 3990X 64-Core - AMD Radeon RX816243240Min: 31.8 / Avg: 32.57 / Max: 33.11Min: 33.64 / Avg: 34.4 / Max: 35.44Min: 34.17 / Avg: 34.79 / Max: 35.63Min: 34.95 / Avg: 35.11 / Max: 35.241. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: CPU - Model: squeezenet_ssd132AMD Ryzen Threadripper 3990X 64-Core - AMD Radeon RX714212835SE +/- 0.25, N = 3SE +/- 0.32, N = 3SE +/- 0.13, N = 7SE +/- 0.16, N = 328.6328.7528.8828.83MIN: 27.31 / MAX: 50.07MIN: 27.57 / MAX: 31.02MIN: 28.07 / MAX: 165.39MIN: 27.93 / MAX: 37.751. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: CPU - Model: squeezenet_ssd132AMD Ryzen Threadripper 3990X 64-Core - AMD Radeon RX612182430Min: 28.13 / Avg: 28.63 / Max: 28.92Min: 28.12 / Avg: 28.75 / Max: 29.13Min: 28.52 / Avg: 28.88 / Max: 29.4Min: 28.51 / Avg: 28.83 / Max: 29.021. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: CPU - Model: regnety_400m132AMD Ryzen Threadripper 3990X 64-Core - AMD Radeon RX20406080100SE +/- 1.25, N = 3SE +/- 0.06, N = 3SE +/- 0.58, N = 7SE +/- 0.86, N = 394.0791.0292.8192.04MIN: 88.58 / MAX: 101.67MIN: 89.77 / MAX: 110.72MIN: 90.19 / MAX: 108.38MIN: 89.57 / MAX: 116.861. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: CPU - Model: regnety_400m132AMD Ryzen Threadripper 3990X 64-Core - AMD Radeon RX20406080100Min: 92.68 / Avg: 94.07 / Max: 96.56Min: 90.91 / Avg: 91.02 / Max: 91.09Min: 90.98 / Avg: 92.81 / Max: 94.76Min: 90.64 / Avg: 92.04 / Max: 93.611. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: Vulkan GPU - Model: mobilenet132AMD Ryzen Threadripper 3990X 64-Core - AMD Radeon RX714212835SE +/- 0.12, N = 3SE +/- 0.40, N = 3SE +/- 0.24, N = 3SE +/- 0.28, N = 327.2627.8827.5027.82MIN: 25.66 / MAX: 39.94MIN: 25.81 / MAX: 32.4MIN: 25.96 / MAX: 37.45MIN: 25.1 / MAX: 43.111. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: Vulkan GPU - Model: mobilenet132AMD Ryzen Threadripper 3990X 64-Core - AMD Radeon RX612182430Min: 27.03 / Avg: 27.26 / Max: 27.42Min: 27.13 / Avg: 27.88 / Max: 28.49Min: 27.03 / Avg: 27.5 / Max: 27.79Min: 27.27 / Avg: 27.82 / Max: 28.121. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: Vulkan GPU-v2-v2 - Model: mobilenet-v2132AMD Ryzen Threadripper 3990X 64-Core - AMD Radeon RX48121620SE +/- 0.17, N = 3SE +/- 0.98, N = 3SE +/- 0.37, N = 3SE +/- 0.16, N = 313.2814.5013.1612.74MIN: 12.07 / MAX: 19.38MIN: 11.83 / MAX: 21.23MIN: 12.01 / MAX: 15.14MIN: 11.81 / MAX: 14.251. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: Vulkan GPU-v2-v2 - Model: mobilenet-v2132AMD Ryzen Threadripper 3990X 64-Core - AMD Radeon RX48121620Min: 13.01 / Avg: 13.28 / Max: 13.6Min: 12.54 / Avg: 14.5 / Max: 15.54Min: 12.76 / Avg: 13.16 / Max: 13.9Min: 12.54 / Avg: 12.74 / Max: 13.061. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: Vulkan GPU-v3-v3 - Model: mobilenet-v3132AMD Ryzen Threadripper 3990X 64-Core - AMD Radeon RX3691215SE +/- 0.11, N = 3SE +/- 0.68, N = 3SE +/- 0.61, N = 3SE +/- 0.17, N = 312.2313.1112.7112.12MIN: 11.76 / MAX: 17.03MIN: 11.64 / MAX: 18.34MIN: 11.82 / MAX: 18.28MIN: 11.75 / MAX: 13.381. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: Vulkan GPU-v3-v3 - Model: mobilenet-v3132AMD Ryzen Threadripper 3990X 64-Core - AMD Radeon RX48121620Min: 12 / Avg: 12.23 / Max: 12.34Min: 11.76 / Avg: 13.11 / Max: 13.95Min: 12.06 / Avg: 12.71 / Max: 13.92Min: 11.86 / Avg: 12.12 / Max: 12.441. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: Vulkan GPU - Model: shufflenet-v2132AMD Ryzen Threadripper 3990X 64-Core - AMD Radeon RX3691215SE +/- 0.26, N = 3SE +/- 0.45, N = 3SE +/- 0.64, N = 2SE +/- 0.05, N = 312.2712.4612.6812.12MIN: 11.72 / MAX: 154.19MIN: 11.74 / MAX: 16.58MIN: 11.87 / MAX: 18.13MIN: 11.91 / MAX: 17.371. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: Vulkan GPU - Model: shufflenet-v2132AMD Ryzen Threadripper 3990X 64-Core - AMD Radeon RX48121620Min: 11.85 / Avg: 12.27 / Max: 12.74Min: 11.85 / Avg: 12.46 / Max: 13.33Min: 12.04 / Avg: 12.68 / Max: 13.31Min: 12.03 / Avg: 12.12 / Max: 12.191. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: Vulkan GPU - Model: mnasnet132AMD Ryzen Threadripper 3990X 64-Core - AMD Radeon RX3691215SE +/- 0.10, N = 3SE +/- 0.74, N = 3SE +/- 0.58, N = 3SE +/- 0.08, N = 312.4513.2612.7112.12MIN: 11.91 / MAX: 17.84MIN: 11.6 / MAX: 19.32MIN: 11.95 / MAX: 22.18MIN: 11.74 / MAX: 13.451. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: Vulkan GPU - Model: mnasnet132AMD Ryzen Threadripper 3990X 64-Core - AMD Radeon RX48121620Min: 12.35 / Avg: 12.45 / Max: 12.64Min: 11.79 / Avg: 13.26 / Max: 14.03Min: 12.12 / Avg: 12.71 / Max: 13.86Min: 11.98 / Avg: 12.12 / Max: 12.251. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: Vulkan GPU - Model: efficientnet-b0132AMD Ryzen Threadripper 3990X 64-Core - AMD Radeon RX48121620SE +/- 0.17, N = 3SE +/- 0.77, N = 3SE +/- 0.50, N = 3SE +/- 0.18, N = 317.0017.5016.9416.68MIN: 16.37 / MAX: 22.21MIN: 15.79 / MAX: 29.9MIN: 16.13 / MAX: 22.13MIN: 16.06 / MAX: 31.191. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: Vulkan GPU - Model: efficientnet-b0132AMD Ryzen Threadripper 3990X 64-Core - AMD Radeon RX48121620Min: 16.68 / Avg: 17 / Max: 17.28Min: 15.98 / Avg: 17.5 / Max: 18.51Min: 16.42 / Avg: 16.94 / Max: 17.94Min: 16.34 / Avg: 16.68 / Max: 16.961. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: Vulkan GPU - Model: blazeface132AMD Ryzen Threadripper 3990X 64-Core - AMD Radeon RX246810SE +/- 0.02, N = 3SE +/- 0.17, N = 3SE +/- 0.12, N = 3SE +/- 0.04, N = 36.036.246.146.05MIN: 5.88 / MAX: 7.17MIN: 5.82 / MAX: 7.29MIN: 5.9 / MAX: 10.8MIN: 5.76 / MAX: 6.921. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: Vulkan GPU - Model: blazeface132AMD Ryzen Threadripper 3990X 64-Core - AMD Radeon RX246810Min: 6.01 / Avg: 6.03 / Max: 6.07Min: 5.91 / Avg: 6.24 / Max: 6.41Min: 6.02 / Avg: 6.14 / Max: 6.38Min: 6.01 / Avg: 6.05 / Max: 6.121. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: Vulkan GPU - Model: googlenet132AMD Ryzen Threadripper 3990X 64-Core - AMD Radeon RX612182430SE +/- 0.39, N = 3SE +/- 0.91, N = 3SE +/- 0.50, N = 3SE +/- 0.11, N = 326.1426.7325.7925.30MIN: 24.77 / MAX: 29.43MIN: 24.37 / MAX: 31.56MIN: 24.48 / MAX: 43.13MIN: 24.57 / MAX: 27.071. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: Vulkan GPU - Model: googlenet132AMD Ryzen Threadripper 3990X 64-Core - AMD Radeon RX612182430Min: 25.36 / Avg: 26.14 / Max: 26.58Min: 24.91 / Avg: 26.73 / Max: 27.64Min: 25.23 / Avg: 25.79 / Max: 26.79Min: 25.07 / Avg: 25.3 / Max: 25.441. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: Vulkan GPU - Model: vgg16132AMD Ryzen Threadripper 3990X 64-Core - AMD Radeon RX1224364860SE +/- 0.18, N = 3SE +/- 0.55, N = 3SE +/- 0.20, N = 3SE +/- 0.06, N = 351.8653.2353.8354.76MIN: 49.19 / MAX: 98.7MIN: 50.05 / MAX: 367.01MIN: 51.82 / MAX: 106.35MIN: 52.47 / MAX: 80.691. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: Vulkan GPU - Model: vgg16132AMD Ryzen Threadripper 3990X 64-Core - AMD Radeon RX1122334455Min: 51.54 / Avg: 51.86 / Max: 52.17Min: 52.25 / Avg: 53.23 / Max: 54.16Min: 53.43 / Avg: 53.83 / Max: 54.06Min: 54.7 / Avg: 54.76 / Max: 54.871. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: Vulkan GPU - Model: resnet18132AMD Ryzen Threadripper 3990X 64-Core - AMD Radeon RX510152025SE +/- 0.31, N = 3SE +/- 0.14, N = 3SE +/- 0.04, N = 3SE +/- 0.06, N = 317.4417.9718.7519.02MIN: 16.54 / MAX: 21.85MIN: 17.18 / MAX: 22.29MIN: 17.83 / MAX: 23.83MIN: 18.18 / MAX: 23.561. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: Vulkan GPU - Model: resnet18132AMD Ryzen Threadripper 3990X 64-Core - AMD Radeon RX510152025Min: 17.09 / Avg: 17.44 / Max: 18.05Min: 17.79 / Avg: 17.97 / Max: 18.25Min: 18.68 / Avg: 18.75 / Max: 18.83Min: 18.91 / Avg: 19.02 / Max: 19.081. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: Vulkan GPU - Model: alexnet132AMD Ryzen Threadripper 3990X 64-Core - AMD Radeon RX3691215SE +/- 0.11, N = 3SE +/- 0.07, N = 3SE +/- 0.18, N = 3SE +/- 0.26, N = 310.3210.5010.9111.09MIN: 9.72 / MAX: 48.4MIN: 9.91 / MAX: 14.76MIN: 10.22 / MAX: 15.29MIN: 10.41 / MAX: 12.451. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: Vulkan GPU - Model: alexnet132AMD Ryzen Threadripper 3990X 64-Core - AMD Radeon RX3691215Min: 10.18 / Avg: 10.32 / Max: 10.53Min: 10.37 / Avg: 10.5 / Max: 10.62Min: 10.57 / Avg: 10.91 / Max: 11.16Min: 10.79 / Avg: 11.09 / Max: 11.611. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: Vulkan GPU - Model: resnet50132AMD Ryzen Threadripper 3990X 64-Core - AMD Radeon RX918273645SE +/- 0.33, N = 3SE +/- 0.17, N = 3SE +/- 0.11, N = 3SE +/- 0.18, N = 337.6638.7940.4241.30MIN: 35.19 / MAX: 53.55MIN: 36.42 / MAX: 43.87MIN: 37.9 / MAX: 57.12MIN: 38.76 / MAX: 48.671. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: Vulkan GPU - Model: resnet50132AMD Ryzen Threadripper 3990X 64-Core - AMD Radeon RX918273645Min: 37.12 / Avg: 37.66 / Max: 38.27Min: 38.46 / Avg: 38.79 / Max: 38.96Min: 40.26 / Avg: 40.42 / Max: 40.63Min: 40.94 / Avg: 41.3 / Max: 41.511. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: Vulkan GPU - Model: yolov4-tiny132AMD Ryzen Threadripper 3990X 64-Core - AMD Radeon RX816243240SE +/- 0.46, N = 3SE +/- 0.27, N = 3SE +/- 0.37, N = 3SE +/- 0.10, N = 333.4634.5135.3835.27MIN: 32.29 / MAX: 114.09MIN: 33.41 / MAX: 37.63MIN: 34.06 / MAX: 83.19MIN: 34.09 / MAX: 46.711. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: Vulkan GPU - Model: yolov4-tiny132AMD Ryzen Threadripper 3990X 64-Core - AMD Radeon RX816243240Min: 32.89 / Avg: 33.46 / Max: 34.38Min: 34.18 / Avg: 34.51 / Max: 35.05Min: 34.75 / Avg: 35.38 / Max: 36.02Min: 35.14 / Avg: 35.27 / Max: 35.471. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: Vulkan GPU - Model: squeezenet_ssd132AMD Ryzen Threadripper 3990X 64-Core - AMD Radeon RX714212835SE +/- 0.13, N = 3SE +/- 0.08, N = 3SE +/- 0.38, N = 3SE +/- 0.16, N = 328.3029.2629.4729.20MIN: 27.48 / MAX: 32.9MIN: 28.48 / MAX: 81.29MIN: 28.38 / MAX: 33.93MIN: 28.37 / MAX: 45.571. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: Vulkan GPU - Model: squeezenet_ssd132AMD Ryzen Threadripper 3990X 64-Core - AMD Radeon RX714212835Min: 28.07 / Avg: 28.3 / Max: 28.52Min: 29.16 / Avg: 29.26 / Max: 29.41Min: 29.03 / Avg: 29.47 / Max: 30.23Min: 28.96 / Avg: 29.2 / Max: 29.511. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: Vulkan GPU - Model: regnety_400m132AMD Ryzen Threadripper 3990X 64-Core - AMD Radeon RX20406080100SE +/- 0.28, N = 3SE +/- 2.23, N = 3SE +/- 1.74, N = 3SE +/- 1.08, N = 391.8193.7593.6391.16MIN: 89.83 / MAX: 218.37MIN: 88.45 / MAX: 113.82MIN: 90.61 / MAX: 221.87MIN: 88.63 / MAX: 102.811. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: Vulkan GPU - Model: regnety_400m132AMD Ryzen Threadripper 3990X 64-Core - AMD Radeon RX20406080100Min: 91.29 / Avg: 91.81 / Max: 92.27Min: 89.32 / Avg: 93.75 / Max: 96.35Min: 91.89 / Avg: 93.63 / Max: 97.1Min: 89.42 / Avg: 91.16 / Max: 93.151. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread