NN TR 3960X + Radeon RX 5500 XT

AMD Ryzen Threadripper 3960X 24-Core testing with a MSI Creator TRX40 (MS-7C59) v1.0 (1.12N1 BIOS) and Sapphire AMD Radeon RX 5500/5500M / Pro 5500M 4GB on Ubuntu 20.04 via the Phoronix Test Suite.

Compare your own system(s) to this result file with the Phoronix Test Suite by running the command: phoronix-test-suite benchmark 2009245-PTS-NNTR396012
Jump To Table - Results

View

Do Not Show Noisy Results
Do Not Show Results With Incomplete Data
Do Not Show Results With Little Change/Spread
List Notable Results
Show Result Confidence Charts

Limit displaying results to tests within:

HPC - High Performance Computing 2 Tests
Machine Learning 2 Tests
NVIDIA GPU Compute 2 Tests
Vulkan Compute 2 Tests

Statistics

Show Overall Harmonic Mean(s)
Show Overall Geometric Mean
Show Geometric Means Per-Suite/Category
Show Wins / Losses Counts (Pie Chart)
Normalize Results
Remove Outliers Before Calculating Averages

Graph Settings

Force Line Graphs Where Applicable
Convert To Scalar Where Applicable
Prefer Vertical Bar Graphs

Multi-Way Comparison

Condense Multi-Option Tests Into Single Result Graphs

Table

Show Detailed System Result Table

Run Management

Highlight
Result
Hide
Result
Result
Identifier
Performance Per
Dollar
Date
Run
  Test
  Duration
1
September 24 2020
  4 Hours, 57 Minutes
2
September 24 2020
  3 Hours, 1 Minute
3
September 24 2020
  3 Hours, 3 Minutes
Invert Hiding All Results Option
  3 Hours, 40 Minutes

Only show results where is faster than
Only show results matching title/arguments (delimit multiple options with a comma):
Do not show results matching title/arguments (delimit multiple options with a comma):


NN TR 3960X + Radeon RX 5500 XTProcessorMotherboardChipsetMemoryDiskGraphicsAudioMonitorNetworkOSKernelDesktopDisplay ServerDisplay DriverOpenGLVulkanCompilerFile-SystemScreen Resolution123AMD Ryzen Threadripper 3960X 24-Core @ 3.80GHz (24 Cores / 48 Threads)MSI Creator TRX40 (MS-7C59) v1.0 (1.12N1 BIOS)AMD Starship/Matisse32GB1000GB Sabrent Rocket 4.0 1TBSapphire AMD Radeon RX 5500/5500M / Pro 5500M 4GB (1900/875MHz)AMD Navi 10 HDMI AudioASUS MG28UAquantia AQC107 NBase-T/IEEE + Intel I211 + Intel Wi-Fi 6 AX200Ubuntu 20.045.9.0-rc5-14sep-patch (x86_64) 20200914GNOME Shell 3.36.4X Server 1.20.8modesetting 1.20.84.6 Mesa 20.0.8 (LLVM 10.0.0)1.2.128GCC 9.3.0ext43840x2160OpenBenchmarking.orgCompiler Details- --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++,gm2 --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none,hsa --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v Processor Details- Scaling Governor: acpi-cpufreq ondemand - CPU Microcode: 0x8301025Security Details- itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Full AMD retpoline IBPB: conditional STIBP: conditional RSB filling + srbds: Not affected + tsx_async_abort: Not affected

123Result OverviewPhoronix Test Suite100%100%100%101%101%NCNNTNNRealSR-NCNN

NN TR 3960X + Radeon RX 5500 XTncnn: CPU - squeezenetncnn: CPU - mobilenetncnn: CPU-v2-v2 - mobilenet-v2ncnn: CPU-v3-v3 - mobilenet-v3ncnn: CPU - shufflenet-v2ncnn: CPU - mnasnetncnn: CPU - efficientnet-b0ncnn: CPU - blazefacencnn: CPU - googlenetncnn: CPU - vgg16ncnn: CPU - resnet18ncnn: CPU - alexnetncnn: CPU - resnet50ncnn: CPU - yolov4-tinyncnn: Vulkan GPU - squeezenetncnn: Vulkan GPU - mobilenetncnn: Vulkan GPU-v2-v2 - mobilenet-v2ncnn: Vulkan GPU-v3-v3 - mobilenet-v3ncnn: Vulkan GPU - shufflenet-v2ncnn: Vulkan GPU - mnasnetncnn: Vulkan GPU - efficientnet-b0ncnn: Vulkan GPU - blazefacencnn: Vulkan GPU - googlenetncnn: Vulkan GPU - vgg16ncnn: Vulkan GPU - resnet18ncnn: Vulkan GPU - alexnetncnn: Vulkan GPU - resnet50ncnn: Vulkan GPU - yolov4-tinyrealsr-ncnn: 4x - Norealsr-ncnn: 4x - Yestnn: CPU - MobileNet v2tnn: CPU - SqueezeNet v1.112334.1616.997.226.747.136.528.572.9039.5369.5820.2511.4356.9727.3836.309.594.378.433.204.4412.060.8941.2186.0520.8228.1658.7921.2825.178183.307257.861237.81633.5116.937.196.717.156.498.572.8839.2769.7319.8011.7156.3528.0037.239.304.358.223.204.4511.980.9041.3770.4320.9228.6058.7821.3025.135183.344257.621237.23634.1716.937.256.907.156.508.642.8941.2271.6121.0111.8858.1628.2136.789.544.368.213.224.4412.110.9041.0869.4520.6028.4558.0621.3525.184183.380257.427237.826OpenBenchmarking.org

NCNN

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: CPU - Model: squeezenet312816243240SE +/- 0.26, N = 3SE +/- 0.51, N = 3SE +/- 0.24, N = 334.1734.1633.51MIN: 33.09 / MAX: 77.53MIN: 32.67 / MAX: 117.09MIN: 32.21 / MAX: 92.061. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: CPU - Model: mobilenet13248121620SE +/- 0.09, N = 3SE +/- 0.09, N = 3SE +/- 0.03, N = 316.9916.9316.93MIN: 16.74 / MAX: 18.01MIN: 16.64 / MAX: 17.48MIN: 16.66 / MAX: 17.451. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: CPU-v2-v2 - Model: mobilenet-v2312246810SE +/- 0.06, N = 3SE +/- 0.03, N = 3SE +/- 0.02, N = 37.257.227.19MIN: 6.86 / MAX: 7.96MIN: 6.94 / MAX: 7.7MIN: 6.97 / MAX: 7.731. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: CPU-v3-v3 - Model: mobilenet-v3312246810SE +/- 0.16, N = 3SE +/- 0.03, N = 3SE +/- 0.03, N = 36.906.746.71MIN: 6.54 / MAX: 105.24MIN: 6.57 / MAX: 7.22MIN: 6.56 / MAX: 7.431. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: CPU - Model: shufflenet-v2321246810SE +/- 0.03, N = 3SE +/- 0.01, N = 3SE +/- 0.04, N = 37.157.157.13MIN: 6.91 / MAX: 8.35MIN: 6.93 / MAX: 8.31MIN: 6.84 / MAX: 7.571. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: CPU - Model: mnasnet132246810SE +/- 0.03, N = 3SE +/- 0.04, N = 3SE +/- 0.01, N = 36.526.506.49MIN: 6.35 / MAX: 8.85MIN: 6.23 / MAX: 6.91MIN: 6.34 / MAX: 8.661. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: CPU - Model: efficientnet-b0321246810SE +/- 0.06, N = 3SE +/- 0.01, N = 3SE +/- 0.05, N = 38.648.578.57MIN: 8.43 / MAX: 9.13MIN: 8.44 / MAX: 9.1MIN: 8.35 / MAX: 9.021. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: CPU - Model: blazeface1320.65251.3051.95752.613.2625SE +/- 0.02, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 32.902.892.88MIN: 2.76 / MAX: 3.07MIN: 2.77 / MAX: 3.02MIN: 2.74 / MAX: 3.291. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: CPU - Model: googlenet312918273645SE +/- 0.14, N = 3SE +/- 0.06, N = 3SE +/- 0.06, N = 341.2239.5339.27MIN: 40.07 / MAX: 42.85MIN: 38.19 / MAX: 97.58MIN: 38.25 / MAX: 49.661. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: CPU - Model: vgg163211632486480SE +/- 0.33, N = 3SE +/- 0.18, N = 3SE +/- 0.37, N = 371.6169.7369.58MIN: 69.64 / MAX: 129.25MIN: 68.49 / MAX: 77.46MIN: 67.57 / MAX: 82.431. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: CPU - Model: resnet18312510152025SE +/- 0.17, N = 3SE +/- 0.52, N = 3SE +/- 0.03, N = 321.0120.2519.80MIN: 20.51 / MAX: 33.69MIN: 19.51 / MAX: 24.44MIN: 19.56 / MAX: 24.321. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: CPU - Model: alexnet3213691215SE +/- 0.04, N = 3SE +/- 0.07, N = 3SE +/- 0.08, N = 311.8811.7111.43MIN: 11.76 / MAX: 12.7MIN: 11.51 / MAX: 12.77MIN: 11.22 / MAX: 12.31. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: CPU - Model: resnet503121326395265SE +/- 0.67, N = 3SE +/- 0.80, N = 3SE +/- 0.18, N = 358.1656.9756.35MIN: 56.46 / MAX: 72.94MIN: 55.76 / MAX: 116.12MIN: 55.8 / MAX: 101.341. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: CPU - Model: yolov4-tiny321714212835SE +/- 0.13, N = 3SE +/- 0.30, N = 3SE +/- 0.21, N = 328.2128.0027.38MIN: 27.77 / MAX: 32.51MIN: 27.26 / MAX: 46.57MIN: 26.82 / MAX: 28.171. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: Vulkan GPU - Model: squeezenet231918273645SE +/- 0.30, N = 3SE +/- 0.18, N = 3SE +/- 0.40, N = 737.2336.7836.30MIN: 36.09 / MAX: 42.49MIN: 34.68 / MAX: 102.95MIN: 34.06 / MAX: 93.71. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: Vulkan GPU - Model: mobilenet1323691215SE +/- 0.24, N = 7SE +/- 0.47, N = 3SE +/- 0.39, N = 39.599.549.30MIN: 6.09 / MAX: 36.77MIN: 6.58 / MAX: 28.71MIN: 6.71 / MAX: 31.051. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: Vulkan GPU-v2-v2 - Model: mobilenet-v21320.98331.96662.94993.93324.9165SE +/- 0.01, N = 7SE +/- 0.00, N = 3SE +/- 0.00, N = 34.374.364.35MIN: 4.08 / MAX: 8.18MIN: 4.18 / MAX: 4.64MIN: 4.18 / MAX: 5.041. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: Vulkan GPU-v3-v3 - Model: mobilenet-v3123246810SE +/- 0.13, N = 7SE +/- 0.15, N = 3SE +/- 0.38, N = 38.438.228.21MIN: 6.97 / MAX: 52MIN: 6.98 / MAX: 50.24MIN: 7 / MAX: 35.791. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: Vulkan GPU - Model: shufflenet-v23210.72451.4492.17352.8983.6225SE +/- 0.01, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 73.223.203.20MIN: 3.14 / MAX: 5.74MIN: 3.14 / MAX: 3.4MIN: 3.14 / MAX: 3.471. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: Vulkan GPU - Model: mnasnet2311.00132.00263.00394.00525.0065SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.00, N = 74.454.444.44MIN: 4.3 / MAX: 4.78MIN: 4.29 / MAX: 4.71MIN: 4.28 / MAX: 4.891. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: Vulkan GPU - Model: efficientnet-b03123691215SE +/- 0.15, N = 3SE +/- 0.11, N = 7SE +/- 0.03, N = 312.1112.0611.98MIN: 10.06 / MAX: 39.37MIN: 10.04 / MAX: 43.67MIN: 10.04 / MAX: 38.231. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: Vulkan GPU - Model: blazeface3210.20250.4050.60750.811.0125SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 70.900.900.89MIN: 0.88 / MAX: 1.15MIN: 0.88 / MAX: 1.25MIN: 0.87 / MAX: 1.191. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: Vulkan GPU - Model: googlenet213918273645SE +/- 0.15, N = 3SE +/- 0.13, N = 7SE +/- 0.20, N = 341.3741.2141.08MIN: 40.38 / MAX: 43.2MIN: 39.9 / MAX: 107.26MIN: 39.95 / MAX: 42.381. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: Vulkan GPU - Model: vgg1612320406080100SE +/- 16.43, N = 7SE +/- 0.28, N = 3SE +/- 0.18, N = 386.0570.4369.45MIN: 67.47 / MAX: 1163.59MIN: 68.71 / MAX: 81.81MIN: 68.18 / MAX: 83.461. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: Vulkan GPU - Model: resnet18213510152025SE +/- 0.21, N = 3SE +/- 0.13, N = 7SE +/- 0.01, N = 320.9220.8220.60MIN: 20.37 / MAX: 21.98MIN: 20.25 / MAX: 23.91MIN: 19.97 / MAX: 80.961. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: Vulkan GPU - Model: alexnet231714212835SE +/- 0.18, N = 3SE +/- 0.17, N = 3SE +/- 0.22, N = 728.6028.4528.16MIN: 24.84 / MAX: 71.78MIN: 25.05 / MAX: 67.53MIN: 24.94 / MAX: 57.141. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: Vulkan GPU - Model: resnet501231326395265SE +/- 0.07, N = 7SE +/- 0.18, N = 3SE +/- 0.85, N = 358.7958.7858.06MIN: 57.94 / MAX: 143.22MIN: 58.17 / MAX: 141.3MIN: 56.02 / MAX: 60.021. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: Vulkan GPU - Model: yolov4-tiny321510152025SE +/- 0.29, N = 3SE +/- 0.06, N = 3SE +/- 0.22, N = 721.3521.3021.28MIN: 11.91 / MAX: 44.45MIN: 10.97 / MAX: 44.03MIN: 11.57 / MAX: 43.21. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

RealSR-NCNN

RealSR-NCNN is an NCNN neural network implementation of the RealSR project and accelerated using the Vulkan API. RealSR is the Real-World Super Resolution via Kernel Estimation and Noise Injection. NCNN is a high performance neural network inference framework optimized for mobile and other platforms developed by Tencent. This test profile times how long it takes to increase the resolution of a sample image by a scale of 4x with Vulkan. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterRealSR-NCNN 20200818Scale: 4x - TAA: No312612182430SE +/- 0.02, N = 3SE +/- 0.07, N = 3SE +/- 0.03, N = 325.1825.1825.14

OpenBenchmarking.orgSeconds, Fewer Is BetterRealSR-NCNN 20200818Scale: 4x - TAA: Yes3214080120160200SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 3183.38183.34183.31

TNN

TNN is an open-source deep learning reasoning framework developed by Tencent. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgms, Fewer Is BetterTNN 0.2.3Target: CPU - Model: MobileNet v212360120180240300SE +/- 0.71, N = 3SE +/- 0.04, N = 3SE +/- 0.56, N = 3257.86257.62257.43MIN: 244.35 / MAX: 289.49MIN: 248.05 / MAX: 298.14MIN: 248.96 / MAX: 288.021. (CXX) g++ options: -fopenmp -pthread -fvisibility=hidden -O3 -rdynamic -ldl

OpenBenchmarking.orgms, Fewer Is BetterTNN 0.2.3Target: CPU - Model: SqueezeNet v1.131250100150200250SE +/- 2.15, N = 3SE +/- 0.56, N = 3SE +/- 0.79, N = 3237.83237.82237.24MIN: 230.78 / MAX: 240.86MIN: 234.12 / MAX: 239.65MIN: 234.05 / MAX: 239.251. (CXX) g++ options: -fopenmp -pthread -fvisibility=hidden -O3 -rdynamic -ldl