NN TR 3960X + Radeon RX 5500 XT

AMD Ryzen Threadripper 3960X 24-Core testing with a MSI Creator TRX40 (MS-7C59) v1.0 (1.12N1 BIOS) and Sapphire AMD Radeon RX 5500/5500M / Pro 5500M 4GB on Ubuntu 20.04 via the Phoronix Test Suite.

Compare your own system(s) to this result file with the Phoronix Test Suite by running the command: phoronix-test-suite benchmark 2009245-PTS-NNTR396012
Jump To Table - Results

View

Do Not Show Noisy Results
Do Not Show Results With Incomplete Data
Do Not Show Results With Little Change/Spread
List Notable Results
Show Result Confidence Charts
Allow Limiting Results To Certain Suite(s)

Statistics

Show Overall Harmonic Mean(s)
Show Overall Geometric Mean
Show Wins / Losses Counts (Pie Chart)
Normalize Results
Remove Outliers Before Calculating Averages

Graph Settings

Force Line Graphs Where Applicable
Convert To Scalar Where Applicable
Prefer Vertical Bar Graphs

Multi-Way Comparison

Condense Multi-Option Tests Into Single Result Graphs

Table

Show Detailed System Result Table

Run Management

Highlight
Result
Toggle/Hide
Result
Result
Identifier
Performance Per
Dollar
Date
Run
  Test
  Duration
1
September 24 2020
  4 Hours, 57 Minutes
2
September 24 2020
  3 Hours, 1 Minute
3
September 24 2020
  3 Hours, 3 Minutes
Invert Behavior (Only Show Selected Data)
  3 Hours, 40 Minutes

Only show results where is faster than
Only show results matching title/arguments (delimit multiple options with a comma):
Do not show results matching title/arguments (delimit multiple options with a comma):


NN TR 3960X + Radeon RX 5500 XTProcessorMotherboardChipsetMemoryDiskGraphicsAudioMonitorNetworkOSKernelDesktopDisplay ServerDisplay DriverOpenGLVulkanCompilerFile-SystemScreen Resolution123AMD Ryzen Threadripper 3960X 24-Core @ 3.80GHz (24 Cores / 48 Threads)MSI Creator TRX40 (MS-7C59) v1.0 (1.12N1 BIOS)AMD Starship/Matisse32GB1000GB Sabrent Rocket 4.0 1TBSapphire AMD Radeon RX 5500/5500M / Pro 5500M 4GB (1900/875MHz)AMD Navi 10 HDMI AudioASUS MG28UAquantia AQC107 NBase-T/IEEE + Intel I211 + Intel Wi-Fi 6 AX200Ubuntu 20.045.9.0-rc5-14sep-patch (x86_64) 20200914GNOME Shell 3.36.4X Server 1.20.8modesetting 1.20.84.6 Mesa 20.0.8 (LLVM 10.0.0)1.2.128GCC 9.3.0ext43840x2160OpenBenchmarking.orgCompiler Details- --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++,gm2 --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none,hsa --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v Processor Details- Scaling Governor: acpi-cpufreq ondemand - CPU Microcode: 0x8301025Security Details- itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Full AMD retpoline IBPB: conditional STIBP: conditional RSB filling + srbds: Not affected + tsx_async_abort: Not affected

123Result OverviewPhoronix Test Suite100%100%100%101%101%NCNNTNNRealSR-NCNN

NN TR 3960X + Radeon RX 5500 XTrealsr-ncnn: 4x - Norealsr-ncnn: 4x - Yesncnn: CPU - squeezenetncnn: CPU - mobilenetncnn: CPU-v2-v2 - mobilenet-v2ncnn: CPU-v3-v3 - mobilenet-v3ncnn: CPU - shufflenet-v2ncnn: CPU - mnasnetncnn: CPU - efficientnet-b0ncnn: CPU - blazefacencnn: CPU - googlenetncnn: CPU - vgg16ncnn: CPU - resnet18ncnn: CPU - alexnetncnn: CPU - resnet50ncnn: CPU - yolov4-tinyncnn: Vulkan GPU - squeezenetncnn: Vulkan GPU - mobilenetncnn: Vulkan GPU-v2-v2 - mobilenet-v2ncnn: Vulkan GPU-v3-v3 - mobilenet-v3ncnn: Vulkan GPU - shufflenet-v2ncnn: Vulkan GPU - mnasnetncnn: Vulkan GPU - efficientnet-b0ncnn: Vulkan GPU - blazefacencnn: Vulkan GPU - googlenetncnn: Vulkan GPU - vgg16ncnn: Vulkan GPU - resnet18ncnn: Vulkan GPU - alexnetncnn: Vulkan GPU - resnet50ncnn: Vulkan GPU - yolov4-tinytnn: CPU - MobileNet v2tnn: CPU - SqueezeNet v1.112325.178183.30734.1616.997.226.747.136.528.572.9039.5369.5820.2511.4356.9727.3836.309.594.378.433.204.4412.060.8941.2186.0520.8228.1658.7921.28257.861237.81625.135183.34433.5116.937.196.717.156.498.572.8839.2769.7319.8011.7156.3528.0037.239.304.358.223.204.4511.980.9041.3770.4320.9228.6058.7821.30257.621237.23625.184183.38034.1716.937.256.907.156.508.642.8941.2271.6121.0111.8858.1628.2136.789.544.368.213.224.4412.110.9041.0869.4520.6028.4558.0621.35257.427237.826OpenBenchmarking.org

RealSR-NCNN

RealSR-NCNN is an NCNN neural network implementation of the RealSR project and accelerated using the Vulkan API. RealSR is the Real-World Super Resolution via Kernel Estimation and Noise Injection. NCNN is a high performance neural network inference framework optimized for mobile and other platforms developed by Tencent. This test profile times how long it takes to increase the resolution of a sample image by a scale of 4x with Vulkan. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterRealSR-NCNN 20200818Scale: 4x - TAA: No321612182430SE +/- 0.02, N = 3SE +/- 0.03, N = 3SE +/- 0.07, N = 325.1825.1425.18

OpenBenchmarking.orgSeconds, Fewer Is BetterRealSR-NCNN 20200818Scale: 4x - TAA: Yes3214080120160200SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 3183.38183.34183.31

NCNN

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: CPU - Model: squeezenet321816243240SE +/- 0.26, N = 3SE +/- 0.24, N = 3SE +/- 0.51, N = 334.1733.5134.16MIN: 33.09 / MAX: 77.53MIN: 32.21 / MAX: 92.06MIN: 32.67 / MAX: 117.091. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: CPU - Model: mobilenet32148121620SE +/- 0.09, N = 3SE +/- 0.03, N = 3SE +/- 0.09, N = 316.9316.9316.99MIN: 16.64 / MAX: 17.48MIN: 16.66 / MAX: 17.45MIN: 16.74 / MAX: 18.011. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: CPU-v2-v2 - Model: mobilenet-v2321246810SE +/- 0.06, N = 3SE +/- 0.02, N = 3SE +/- 0.03, N = 37.257.197.22MIN: 6.86 / MAX: 7.96MIN: 6.97 / MAX: 7.73MIN: 6.94 / MAX: 7.71. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: CPU-v3-v3 - Model: mobilenet-v3321246810SE +/- 0.16, N = 3SE +/- 0.03, N = 3SE +/- 0.03, N = 36.906.716.74MIN: 6.54 / MAX: 105.24MIN: 6.56 / MAX: 7.43MIN: 6.57 / MAX: 7.221. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: CPU - Model: shufflenet-v2321246810SE +/- 0.03, N = 3SE +/- 0.01, N = 3SE +/- 0.04, N = 37.157.157.13MIN: 6.91 / MAX: 8.35MIN: 6.93 / MAX: 8.31MIN: 6.84 / MAX: 7.571. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: CPU - Model: mnasnet321246810SE +/- 0.04, N = 3SE +/- 0.01, N = 3SE +/- 0.03, N = 36.506.496.52MIN: 6.23 / MAX: 6.91MIN: 6.34 / MAX: 8.66MIN: 6.35 / MAX: 8.851. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: CPU - Model: efficientnet-b0321246810SE +/- 0.06, N = 3SE +/- 0.01, N = 3SE +/- 0.05, N = 38.648.578.57MIN: 8.43 / MAX: 9.13MIN: 8.44 / MAX: 9.1MIN: 8.35 / MAX: 9.021. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: CPU - Model: blazeface3210.65251.3051.95752.613.2625SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.02, N = 32.892.882.90MIN: 2.77 / MAX: 3.02MIN: 2.74 / MAX: 3.29MIN: 2.76 / MAX: 3.071. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: CPU - Model: googlenet321918273645SE +/- 0.14, N = 3SE +/- 0.06, N = 3SE +/- 0.06, N = 341.2239.2739.53MIN: 40.07 / MAX: 42.85MIN: 38.25 / MAX: 49.66MIN: 38.19 / MAX: 97.581. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: CPU - Model: vgg163211632486480SE +/- 0.33, N = 3SE +/- 0.18, N = 3SE +/- 0.37, N = 371.6169.7369.58MIN: 69.64 / MAX: 129.25MIN: 68.49 / MAX: 77.46MIN: 67.57 / MAX: 82.431. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: CPU - Model: resnet18321510152025SE +/- 0.17, N = 3SE +/- 0.03, N = 3SE +/- 0.52, N = 321.0119.8020.25MIN: 20.51 / MAX: 33.69MIN: 19.56 / MAX: 24.32MIN: 19.51 / MAX: 24.441. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: CPU - Model: alexnet3213691215SE +/- 0.04, N = 3SE +/- 0.07, N = 3SE +/- 0.08, N = 311.8811.7111.43MIN: 11.76 / MAX: 12.7MIN: 11.51 / MAX: 12.77MIN: 11.22 / MAX: 12.31. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: CPU - Model: resnet503211326395265SE +/- 0.67, N = 3SE +/- 0.18, N = 3SE +/- 0.80, N = 358.1656.3556.97MIN: 56.46 / MAX: 72.94MIN: 55.8 / MAX: 101.34MIN: 55.76 / MAX: 116.121. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: CPU - Model: yolov4-tiny321714212835SE +/- 0.13, N = 3SE +/- 0.30, N = 3SE +/- 0.21, N = 328.2128.0027.38MIN: 27.77 / MAX: 32.51MIN: 27.26 / MAX: 46.57MIN: 26.82 / MAX: 28.171. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: Vulkan GPU - Model: squeezenet321918273645SE +/- 0.18, N = 3SE +/- 0.30, N = 3SE +/- 0.40, N = 736.7837.2336.30MIN: 34.68 / MAX: 102.95MIN: 36.09 / MAX: 42.49MIN: 34.06 / MAX: 93.71. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: Vulkan GPU - Model: mobilenet3213691215SE +/- 0.47, N = 3SE +/- 0.39, N = 3SE +/- 0.24, N = 79.549.309.59MIN: 6.58 / MAX: 28.71MIN: 6.71 / MAX: 31.05MIN: 6.09 / MAX: 36.771. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: Vulkan GPU-v2-v2 - Model: mobilenet-v23210.98331.96662.94993.93324.9165SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.01, N = 74.364.354.37MIN: 4.18 / MAX: 4.64MIN: 4.18 / MAX: 5.04MIN: 4.08 / MAX: 8.181. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: Vulkan GPU-v3-v3 - Model: mobilenet-v3321246810SE +/- 0.38, N = 3SE +/- 0.15, N = 3SE +/- 0.13, N = 78.218.228.43MIN: 7 / MAX: 35.79MIN: 6.98 / MAX: 50.24MIN: 6.97 / MAX: 521. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: Vulkan GPU - Model: shufflenet-v23210.72451.4492.17352.8983.6225SE +/- 0.01, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 73.223.203.20MIN: 3.14 / MAX: 5.74MIN: 3.14 / MAX: 3.4MIN: 3.14 / MAX: 3.471. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: Vulkan GPU - Model: mnasnet3211.00132.00263.00394.00525.0065SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.00, N = 74.444.454.44MIN: 4.29 / MAX: 4.71MIN: 4.3 / MAX: 4.78MIN: 4.28 / MAX: 4.891. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: Vulkan GPU - Model: efficientnet-b03213691215SE +/- 0.15, N = 3SE +/- 0.03, N = 3SE +/- 0.11, N = 712.1111.9812.06MIN: 10.06 / MAX: 39.37MIN: 10.04 / MAX: 38.23MIN: 10.04 / MAX: 43.671. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: Vulkan GPU - Model: blazeface3210.20250.4050.60750.811.0125SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 70.900.900.89MIN: 0.88 / MAX: 1.15MIN: 0.88 / MAX: 1.25MIN: 0.87 / MAX: 1.191. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: Vulkan GPU - Model: googlenet321918273645SE +/- 0.20, N = 3SE +/- 0.15, N = 3SE +/- 0.13, N = 741.0841.3741.21MIN: 39.95 / MAX: 42.38MIN: 40.38 / MAX: 43.2MIN: 39.9 / MAX: 107.261. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: Vulkan GPU - Model: vgg1632120406080100SE +/- 0.18, N = 3SE +/- 0.28, N = 3SE +/- 16.43, N = 769.4570.4386.05MIN: 68.18 / MAX: 83.46MIN: 68.71 / MAX: 81.81MIN: 67.47 / MAX: 1163.591. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: Vulkan GPU - Model: resnet18321510152025SE +/- 0.01, N = 3SE +/- 0.21, N = 3SE +/- 0.13, N = 720.6020.9220.82MIN: 19.97 / MAX: 80.96MIN: 20.37 / MAX: 21.98MIN: 20.25 / MAX: 23.911. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: Vulkan GPU - Model: alexnet321714212835SE +/- 0.17, N = 3SE +/- 0.18, N = 3SE +/- 0.22, N = 728.4528.6028.16MIN: 25.05 / MAX: 67.53MIN: 24.84 / MAX: 71.78MIN: 24.94 / MAX: 57.141. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: Vulkan GPU - Model: resnet503211326395265SE +/- 0.85, N = 3SE +/- 0.18, N = 3SE +/- 0.07, N = 758.0658.7858.79MIN: 56.02 / MAX: 60.02MIN: 58.17 / MAX: 141.3MIN: 57.94 / MAX: 143.221. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: Vulkan GPU - Model: yolov4-tiny321510152025SE +/- 0.29, N = 3SE +/- 0.06, N = 3SE +/- 0.22, N = 721.3521.3021.28MIN: 11.91 / MAX: 44.45MIN: 10.97 / MAX: 44.03MIN: 11.57 / MAX: 43.21. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

TNN

TNN is an open-source deep learning reasoning framework developed by Tencent. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgms, Fewer Is BetterTNN 0.2.3Target: CPU - Model: MobileNet v232160120180240300SE +/- 0.56, N = 3SE +/- 0.04, N = 3SE +/- 0.71, N = 3257.43257.62257.86MIN: 248.96 / MAX: 288.02MIN: 248.05 / MAX: 298.14MIN: 244.35 / MAX: 289.491. (CXX) g++ options: -fopenmp -pthread -fvisibility=hidden -O3 -rdynamic -ldl

OpenBenchmarking.orgms, Fewer Is BetterTNN 0.2.3Target: CPU - Model: SqueezeNet v1.132150100150200250SE +/- 2.15, N = 3SE +/- 0.79, N = 3SE +/- 0.56, N = 3237.83237.24237.82MIN: 230.78 / MAX: 240.86MIN: 234.05 / MAX: 239.25MIN: 234.12 / MAX: 239.651. (CXX) g++ options: -fopenmp -pthread -fvisibility=hidden -O3 -rdynamic -ldl