3900XT NN

AMD Ryzen 9 3900XT 12-Core testing with a MSI MEG X570 GODLIKE (MS-7C34) v1.0 (1.94 BIOS) and AMD Radeon RX 56/64 8GB on Ubuntu 20.04 via the Phoronix Test Suite.

Compare your own system(s) to this result file with the Phoronix Test Suite by running the command: phoronix-test-suite benchmark 2009250-PTS-3900XTNN87
Jump To Table - Results

View

Do Not Show Noisy Results
Do Not Show Results With Incomplete Data
Do Not Show Results With Little Change/Spread
List Notable Results

Limit displaying results to tests within:

HPC - High Performance Computing 2 Tests
Machine Learning 2 Tests
NVIDIA GPU Compute 2 Tests
Vulkan Compute 2 Tests

Statistics

Show Overall Harmonic Mean(s)
Show Overall Geometric Mean
Show Geometric Means Per-Suite/Category
Show Wins / Losses Counts (Pie Chart)
Normalize Results
Remove Outliers Before Calculating Averages

Graph Settings

Force Line Graphs Where Applicable
Convert To Scalar Where Applicable
Prefer Vertical Bar Graphs

Multi-Way Comparison

Condense Multi-Option Tests Into Single Result Graphs

Table

Show Detailed System Result Table

Run Management

Highlight
Result
Hide
Result
Result
Identifier
Performance Per
Dollar
Date
Run
  Test
  Duration
1
September 25 2020
  1 Hour, 8 Minutes
2
September 25 2020
  1 Hour, 7 Minutes
3
September 25 2020
  1 Hour, 7 Minutes
Invert Hiding All Results Option
  1 Hour, 7 Minutes

Only show results where is faster than
Only show results matching title/arguments (delimit multiple options with a comma):
Do not show results matching title/arguments (delimit multiple options with a comma):


3900XT NNProcessorMotherboardChipsetMemoryDiskGraphicsAudioMonitorNetworkOSKernelDesktopDisplay ServerDisplay DriverOpenGLCompilerFile-SystemScreen Resolution123AMD Ryzen 9 3900XT 12-Core @ 3.80GHz (12 Cores / 24 Threads)MSI MEG X570 GODLIKE (MS-7C34) v1.0 (1.94 BIOS)AMD Starship/Matisse16GB500GB Seagate FireCuda 520 SSD ZP500GM30002AMD Radeon RX 56/64 8GB (1630/945MHz)AMD Vega 10 HDMI AudioASUS MG28URealtek Device 2600 + Realtek Device 3000 + Intel Wi-Fi 6 AX200Ubuntu 20.045.9.0-050900rc6daily20200922-generic (x86_64) 20200921GNOME Shell 3.36.4X Server 1.20.8amdgpu 19.1.04.6 Mesa 20.3.0-devel (git-31f75aa 2020-08-28 focal-oibaf-ppa) (LLVM 10.0.1)GCC 9.3.0ext43840x2160OpenBenchmarking.orgCompiler Details- --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++,gm2 --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none,hsa --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v Processor Details- Scaling Governor: acpi-cpufreq ondemand - CPU Microcode: 0x8701021Graphics Details- GLAMORSecurity Details- itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Full AMD retpoline IBPB: conditional STIBP: conditional RSB filling + srbds: Not affected + tsx_async_abort: Not affected

123Result OverviewPhoronix Test Suite100%100%101%101%101%TNNRealSR-NCNNNCNN

3900XT NNrealsr-ncnn: 4x - Norealsr-ncnn: 4x - Yesncnn: CPU - squeezenetncnn: CPU - mobilenetncnn: CPU-v2-v2 - mobilenet-v2ncnn: CPU-v3-v3 - mobilenet-v3ncnn: CPU - shufflenet-v2ncnn: CPU - mnasnetncnn: CPU - efficientnet-b0ncnn: CPU - blazefacencnn: CPU - googlenetncnn: CPU - vgg16ncnn: CPU - resnet18ncnn: CPU - alexnetncnn: CPU - resnet50ncnn: CPU - yolov4-tinyncnn: Vulkan GPU - squeezenetncnn: Vulkan GPU - mobilenetncnn: Vulkan GPU-v2-v2 - mobilenet-v2ncnn: Vulkan GPU-v3-v3 - mobilenet-v3ncnn: Vulkan GPU - shufflenet-v2ncnn: Vulkan GPU - mnasnetncnn: Vulkan GPU - efficientnet-b0ncnn: Vulkan GPU - blazefacencnn: Vulkan GPU - googlenetncnn: Vulkan GPU - vgg16ncnn: Vulkan GPU - resnet18ncnn: Vulkan GPU - alexnetncnn: Vulkan GPU - resnet50ncnn: Vulkan GPU - yolov4-tinytnn: CPU - MobileNet v2tnn: CPU - SqueezeNet v1.11239.84563.32715.9616.335.364.714.824.766.541.9117.1767.4116.2016.1327.5528.154.667.772.523.552.282.6910.410.905.7811.952.103.926.0210.70245.154230.0229.79764.55115.8716.175.334.714.784.806.581.9117.1867.8216.3616.1827.5628.074.687.722.493.502.282.6710.470.875.6611.462.13.946.3810.68246.961228.4799.83863.56915.9716.365.354.704.804.886.621.9117.1467.6716.2716.1827.5028.084.717.682.493.492.262.6810.440.855.7111.692.103.916.1310.71244.143226.902OpenBenchmarking.org

RealSR-NCNN

RealSR-NCNN is an NCNN neural network implementation of the RealSR project and accelerated using the Vulkan API. RealSR is the Real-World Super Resolution via Kernel Estimation and Noise Injection. NCNN is a high performance neural network inference framework optimized for mobile and other platforms developed by Tencent. This test profile times how long it takes to increase the resolution of a sample image by a scale of 4x with Vulkan. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterRealSR-NCNN 20200818Scale: 4x - TAA: No1233691215SE +/- 0.103, N = 3SE +/- 0.042, N = 3SE +/- 0.038, N = 39.8459.7979.838
OpenBenchmarking.orgSeconds, Fewer Is BetterRealSR-NCNN 20200818Scale: 4x - TAA: No1233691215Min: 9.71 / Avg: 9.85 / Max: 10.05Min: 9.75 / Avg: 9.8 / Max: 9.88Min: 9.78 / Avg: 9.84 / Max: 9.91

OpenBenchmarking.orgSeconds, Fewer Is BetterRealSR-NCNN 20200818Scale: 4x - TAA: Yes1231428425670SE +/- 0.49, N = 3SE +/- 0.91, N = 3SE +/- 0.78, N = 363.3364.5563.57
OpenBenchmarking.orgSeconds, Fewer Is BetterRealSR-NCNN 20200818Scale: 4x - TAA: Yes1231326395265Min: 62.83 / Avg: 63.33 / Max: 64.31Min: 62.86 / Avg: 64.55 / Max: 66Min: 62.53 / Avg: 63.57 / Max: 65.1

NCNN

NCNN is a high performance neural network inference framework optimized for mobile and other platforms developed by Tencent. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: CPU - Model: squeezenet12348121620SE +/- 0.11, N = 3SE +/- 0.11, N = 3SE +/- 0.05, N = 315.9615.8715.97MIN: 15.54 / MAX: 18.64MIN: 15.46 / MAX: 16.57MIN: 15.61 / MAX: 16.771. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: CPU - Model: squeezenet12348121620Min: 15.74 / Avg: 15.96 / Max: 16.11Min: 15.69 / Avg: 15.87 / Max: 16.07Min: 15.89 / Avg: 15.97 / Max: 16.071. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: CPU - Model: mobilenet12348121620SE +/- 0.16, N = 3SE +/- 0.13, N = 3SE +/- 0.12, N = 316.3316.1716.36MIN: 15.8 / MAX: 17.16MIN: 15.85 / MAX: 16.8MIN: 16.1 / MAX: 16.931. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: CPU - Model: mobilenet12348121620Min: 16.01 / Avg: 16.33 / Max: 16.52Min: 15.96 / Avg: 16.17 / Max: 16.42Min: 16.22 / Avg: 16.36 / Max: 16.591. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: CPU-v2-v2 - Model: mobilenet-v21231.2062.4123.6184.8246.03SE +/- 0.02, N = 3SE +/- 0.07, N = 3SE +/- 0.02, N = 35.365.335.35MIN: 5.24 / MAX: 7.13MIN: 5.13 / MAX: 6.51MIN: 5.21 / MAX: 7.221. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: CPU-v2-v2 - Model: mobilenet-v2123246810Min: 5.33 / Avg: 5.36 / Max: 5.4Min: 5.2 / Avg: 5.33 / Max: 5.43Min: 5.32 / Avg: 5.35 / Max: 5.391. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: CPU-v3-v3 - Model: mobilenet-v31231.05982.11963.17944.23925.299SE +/- 0.01, N = 3SE +/- 0.07, N = 3SE +/- 0.01, N = 34.714.714.70MIN: 4.64 / MAX: 6.36MIN: 4.56 / MAX: 7MIN: 4.65 / MAX: 6.271. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: CPU-v3-v3 - Model: mobilenet-v3123246810Min: 4.69 / Avg: 4.71 / Max: 4.72Min: 4.59 / Avg: 4.71 / Max: 4.82Min: 4.69 / Avg: 4.7 / Max: 4.711. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: CPU - Model: shufflenet-v21231.08452.1693.25354.3385.4225SE +/- 0.01, N = 3SE +/- 0.06, N = 3SE +/- 0.02, N = 34.824.784.80MIN: 4.77 / MAX: 5.98MIN: 4.61 / MAX: 6.32MIN: 4.72 / MAX: 5.751. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: CPU - Model: shufflenet-v2123246810Min: 4.81 / Avg: 4.82 / Max: 4.84Min: 4.65 / Avg: 4.78 / Max: 4.86Min: 4.76 / Avg: 4.8 / Max: 4.821. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: CPU - Model: mnasnet1231.0982.1963.2944.3925.49SE +/- 0.02, N = 3SE +/- 0.06, N = 3SE +/- 0.11, N = 34.764.804.88MIN: 4.68 / MAX: 6.21MIN: 4.67 / MAX: 6.45MIN: 4.69 / MAX: 47.761. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: CPU - Model: mnasnet123246810Min: 4.73 / Avg: 4.76 / Max: 4.78Min: 4.72 / Avg: 4.8 / Max: 4.91Min: 4.76 / Avg: 4.88 / Max: 5.091. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: CPU - Model: efficientnet-b0123246810SE +/- 0.04, N = 3SE +/- 0.05, N = 3SE +/- 0.09, N = 36.546.586.62MIN: 6.42 / MAX: 13.95MIN: 6.45 / MAX: 11.26MIN: 6.41 / MAX: 8.491. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: CPU - Model: efficientnet-b01233691215Min: 6.46 / Avg: 6.54 / Max: 6.6Min: 6.51 / Avg: 6.58 / Max: 6.67Min: 6.48 / Avg: 6.62 / Max: 6.81. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: CPU - Model: blazeface1230.42980.85961.28941.71922.149SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.02, N = 31.911.911.91MIN: 1.87 / MAX: 2.43MIN: 1.86 / MAX: 2.01MIN: 1.85 / MAX: 2.61. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: CPU - Model: blazeface123246810Min: 1.89 / Avg: 1.91 / Max: 1.92Min: 1.89 / Avg: 1.91 / Max: 1.93Min: 1.89 / Avg: 1.91 / Max: 1.961. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: CPU - Model: googlenet12348121620SE +/- 0.20, N = 3SE +/- 0.16, N = 3SE +/- 0.15, N = 317.1717.1817.14MIN: 16.63 / MAX: 121.77MIN: 16.59 / MAX: 19.11MIN: 16.62 / MAX: 22.641. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: CPU - Model: googlenet12348121620Min: 16.96 / Avg: 17.17 / Max: 17.57Min: 16.89 / Avg: 17.18 / Max: 17.46Min: 16.9 / Avg: 17.14 / Max: 17.431. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: CPU - Model: vgg161231530456075SE +/- 0.12, N = 3SE +/- 0.29, N = 3SE +/- 0.16, N = 367.4167.8267.67MIN: 66.51 / MAX: 110.23MIN: 66.53 / MAX: 109.38MIN: 66.42 / MAX: 140.751. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: CPU - Model: vgg161231326395265Min: 67.26 / Avg: 67.41 / Max: 67.64Min: 67.31 / Avg: 67.82 / Max: 68.3Min: 67.36 / Avg: 67.67 / Max: 67.871. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: CPU - Model: resnet1812348121620SE +/- 0.02, N = 3SE +/- 0.02, N = 3SE +/- 0.13, N = 316.2016.3616.27MIN: 16.02 / MAX: 21.18MIN: 16.04 / MAX: 27.68MIN: 16.02 / MAX: 16.661. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: CPU - Model: resnet1812348121620Min: 16.17 / Avg: 16.2 / Max: 16.24Min: 16.32 / Avg: 16.36 / Max: 16.4Min: 16.14 / Avg: 16.27 / Max: 16.521. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: CPU - Model: alexnet12348121620SE +/- 0.04, N = 3SE +/- 0.02, N = 3SE +/- 0.02, N = 316.1316.1816.18MIN: 15.99 / MAX: 18.49MIN: 16.03 / MAX: 16.44MIN: 16.03 / MAX: 16.911. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: CPU - Model: alexnet12348121620Min: 16.09 / Avg: 16.13 / Max: 16.21Min: 16.14 / Avg: 16.18 / Max: 16.2Min: 16.13 / Avg: 16.18 / Max: 16.211. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: CPU - Model: resnet50123612182430SE +/- 0.08, N = 3SE +/- 0.27, N = 3SE +/- 0.26, N = 327.5527.5627.50MIN: 27.15 / MAX: 40.33MIN: 27.02 / MAX: 33.89MIN: 27.04 / MAX: 38.341. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: CPU - Model: resnet50123612182430Min: 27.42 / Avg: 27.55 / Max: 27.71Min: 27.17 / Avg: 27.56 / Max: 28.07Min: 27.19 / Avg: 27.5 / Max: 28.031. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: CPU - Model: yolov4-tiny123714212835SE +/- 0.09, N = 3SE +/- 0.19, N = 3SE +/- 0.14, N = 328.1528.0728.08MIN: 27.83 / MAX: 28.94MIN: 27.62 / MAX: 37.12MIN: 27.74 / MAX: 30.211. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: CPU - Model: yolov4-tiny123612182430Min: 27.99 / Avg: 28.15 / Max: 28.29Min: 27.77 / Avg: 28.07 / Max: 28.43Min: 27.92 / Avg: 28.08 / Max: 28.371. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: Vulkan GPU - Model: squeezenet1231.05982.11963.17944.23925.299SE +/- 0.02, N = 3SE +/- 0.01, N = 3SE +/- 0.03, N = 34.664.684.71MIN: 4.48 / MAX: 6.06MIN: 4.51 / MAX: 6.25MIN: 4.51 / MAX: 6.361. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: Vulkan GPU - Model: squeezenet123246810Min: 4.61 / Avg: 4.66 / Max: 4.68Min: 4.66 / Avg: 4.68 / Max: 4.7Min: 4.68 / Avg: 4.71 / Max: 4.761. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: Vulkan GPU - Model: mobilenet123246810SE +/- 0.05, N = 3SE +/- 0.05, N = 3SE +/- 0.03, N = 37.777.727.68MIN: 5.52 / MAX: 11.8MIN: 5.6 / MAX: 8.83MIN: 5.58 / MAX: 11.761. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: Vulkan GPU - Model: mobilenet1233691215Min: 7.69 / Avg: 7.77 / Max: 7.85Min: 7.67 / Avg: 7.72 / Max: 7.82Min: 7.63 / Avg: 7.68 / Max: 7.711. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: Vulkan GPU-v2-v2 - Model: mobilenet-v21230.5671.1341.7012.2682.835SE +/- 0.02, N = 3SE +/- 0.00, N = 3SE +/- 0.01, N = 32.522.492.49MIN: 2.47 / MAX: 3.46MIN: 2.47 / MAX: 2.85MIN: 2.46 / MAX: 2.841. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: Vulkan GPU-v2-v2 - Model: mobilenet-v2123246810Min: 2.49 / Avg: 2.52 / Max: 2.55Min: 2.49 / Avg: 2.49 / Max: 2.5Min: 2.48 / Avg: 2.49 / Max: 2.51. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: Vulkan GPU-v3-v3 - Model: mobilenet-v31230.79881.59762.39643.19523.994SE +/- 0.04, N = 3SE +/- 0.00, N = 3SE +/- 0.01, N = 33.553.503.49MIN: 3.47 / MAX: 18.04MIN: 3.47 / MAX: 4.03MIN: 3.46 / MAX: 3.991. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: Vulkan GPU-v3-v3 - Model: mobilenet-v3123246810Min: 3.5 / Avg: 3.55 / Max: 3.62Min: 3.5 / Avg: 3.5 / Max: 3.51Min: 3.47 / Avg: 3.49 / Max: 3.51. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: Vulkan GPU - Model: shufflenet-v21230.5131.0261.5392.0522.565SE +/- 0.02, N = 3SE +/- 0.02, N = 3SE +/- 0.00, N = 32.282.282.26MIN: 2.25 / MAX: 3.05MIN: 2.24 / MAX: 6.97MIN: 2.24 / MAX: 2.821. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: Vulkan GPU - Model: shufflenet-v2123246810Min: 2.26 / Avg: 2.28 / Max: 2.33Min: 2.25 / Avg: 2.28 / Max: 2.31Min: 2.25 / Avg: 2.26 / Max: 2.261. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: Vulkan GPU - Model: mnasnet1230.60531.21061.81592.42123.0265SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 32.692.672.68MIN: 2.64 / MAX: 3.72MIN: 2.64 / MAX: 3.26MIN: 2.64 / MAX: 3.711. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: Vulkan GPU - Model: mnasnet123246810Min: 2.68 / Avg: 2.69 / Max: 2.71Min: 2.66 / Avg: 2.67 / Max: 2.68Min: 2.67 / Avg: 2.68 / Max: 2.711. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: Vulkan GPU - Model: efficientnet-b01233691215SE +/- 0.17, N = 3SE +/- 0.13, N = 3SE +/- 0.08, N = 310.4110.4710.44MIN: 8.75 / MAX: 26.47MIN: 8.76 / MAX: 24.1MIN: 8.74 / MAX: 23.621. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: Vulkan GPU - Model: efficientnet-b01233691215Min: 10.2 / Avg: 10.41 / Max: 10.74Min: 10.22 / Avg: 10.47 / Max: 10.66Min: 10.32 / Avg: 10.44 / Max: 10.591. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: Vulkan GPU - Model: blazeface1230.20250.4050.60750.811.0125SE +/- 0.05, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 30.900.870.85MIN: 0.84 / MAX: 1.56MIN: 0.84 / MAX: 1.67MIN: 0.83 / MAX: 1.361. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: Vulkan GPU - Model: blazeface123246810Min: 0.85 / Avg: 0.9 / Max: 1Min: 0.86 / Avg: 0.87 / Max: 0.87Min: 0.85 / Avg: 0.85 / Max: 0.861. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: Vulkan GPU - Model: googlenet1231.30052.6013.90155.2026.5025SE +/- 0.12, N = 3SE +/- 0.06, N = 3SE +/- 0.06, N = 35.785.665.71MIN: 5.53 / MAX: 23.31MIN: 5.53 / MAX: 17.32MIN: 5.52 / MAX: 13.351. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: Vulkan GPU - Model: googlenet123246810Min: 5.6 / Avg: 5.78 / Max: 6.01Min: 5.56 / Avg: 5.66 / Max: 5.76Min: 5.59 / Avg: 5.71 / Max: 5.811. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: Vulkan GPU - Model: vgg161233691215SE +/- 0.36, N = 3SE +/- 0.27, N = 3SE +/- 0.30, N = 311.9511.4611.69MIN: 9.6 / MAX: 31.99MIN: 9.59 / MAX: 31.3MIN: 9.56 / MAX: 36.671. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: Vulkan GPU - Model: vgg161233691215Min: 11.32 / Avg: 11.95 / Max: 12.58Min: 10.96 / Avg: 11.46 / Max: 11.88Min: 11.2 / Avg: 11.69 / Max: 12.231. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: Vulkan GPU - Model: resnet181230.47250.9451.41751.892.3625SE +/- 0.01, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 32.102.102.10MIN: 2.01 / MAX: 2.81MIN: 2.01 / MAX: 2.87MIN: 2.01 / MAX: 2.881. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: Vulkan GPU - Model: resnet18123246810Min: 2.09 / Avg: 2.1 / Max: 2.11Min: 2.1 / Avg: 2.1 / Max: 2.1Min: 2.09 / Avg: 2.1 / Max: 2.11. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: Vulkan GPU - Model: alexnet1230.88651.7732.65953.5464.4325SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.00, N = 33.923.943.91MIN: 3.79 / MAX: 4.97MIN: 3.8 / MAX: 5.12MIN: 3.8 / MAX: 4.911. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: Vulkan GPU - Model: alexnet123246810Min: 3.9 / Avg: 3.92 / Max: 3.93Min: 3.93 / Avg: 3.94 / Max: 3.95Min: 3.91 / Avg: 3.91 / Max: 3.921. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: Vulkan GPU - Model: resnet50123246810SE +/- 0.03, N = 3SE +/- 0.32, N = 3SE +/- 0.14, N = 36.026.386.13MIN: 5.83 / MAX: 13.11MIN: 5.85 / MAX: 22.05MIN: 5.85 / MAX: 23.941. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: Vulkan GPU - Model: resnet501233691215Min: 5.96 / Avg: 6.02 / Max: 6.06Min: 6.03 / Avg: 6.38 / Max: 7.01Min: 5.89 / Avg: 6.13 / Max: 6.391. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: Vulkan GPU - Model: yolov4-tiny1233691215SE +/- 0.01, N = 3SE +/- 0.00, N = 2SE +/- 0.02, N = 310.7010.6810.71MIN: 10.47 / MAX: 11.01MIN: 10.49 / MAX: 10.95MIN: 10.45 / MAX: 11.191. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: Vulkan GPU - Model: yolov4-tiny1233691215Min: 10.67 / Avg: 10.7 / Max: 10.72Min: 10.68 / Avg: 10.68 / Max: 10.68Min: 10.67 / Avg: 10.71 / Max: 10.741. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

TNN

TNN is an open-source deep learning reasoning framework developed by Tencent. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgms, Fewer Is BetterTNN 0.2.3Target: CPU - Model: MobileNet v212350100150200250SE +/- 1.13, N = 3SE +/- 1.34, N = 3SE +/- 1.92, N = 3245.15246.96244.14MIN: 233.67 / MAX: 275.36MIN: 233.69 / MAX: 262.21MIN: 232.48 / MAX: 272.941. (CXX) g++ options: -fopenmp -pthread -fvisibility=hidden -O3 -rdynamic -ldl
OpenBenchmarking.orgms, Fewer Is BetterTNN 0.2.3Target: CPU - Model: MobileNet v21234080120160200Min: 243.7 / Avg: 245.15 / Max: 247.39Min: 244.99 / Avg: 246.96 / Max: 249.53Min: 240.54 / Avg: 244.14 / Max: 247.091. (CXX) g++ options: -fopenmp -pthread -fvisibility=hidden -O3 -rdynamic -ldl

OpenBenchmarking.orgms, Fewer Is BetterTNN 0.2.3Target: CPU - Model: SqueezeNet v1.112350100150200250SE +/- 3.76, N = 3SE +/- 0.04, N = 3SE +/- 0.19, N = 3230.02228.48226.90MIN: 222.17 / MAX: 240.13MIN: 225.95 / MAX: 229.21MIN: 224.24 / MAX: 228.351. (CXX) g++ options: -fopenmp -pthread -fvisibility=hidden -O3 -rdynamic -ldl
OpenBenchmarking.orgms, Fewer Is BetterTNN 0.2.3Target: CPU - Model: SqueezeNet v1.11234080120160200Min: 222.5 / Avg: 230.02 / Max: 233.89Min: 228.42 / Avg: 228.48 / Max: 228.55Min: 226.62 / Avg: 226.9 / Max: 227.271. (CXX) g++ options: -fopenmp -pthread -fvisibility=hidden -O3 -rdynamic -ldl