RealSR-NCNN

RealSR-NCNN is an NCNN neural network implementation of the RealSR project and accelerated using the Vulkan API. RealSR is the Real-World Super Resolution via Kernel Estimation and Noise Injection. NCNN is a high performance neural network inference framework optimized for mobile and other platforms developed by Tencent. This test profile times how long it takes to increase the resolution of a sample image by a scale of 4x with Vulkan.

To run this test with the Phoronix Test Suite, the basic command is: phoronix-test-suite benchmark realsr-ncnn.

Project Site

github.com

Test Created

24 September 2020

Test Maintainer

Michael Larabel 

Test Type

Graphics

Average Install Time

3 Seconds

Average Run Time

8 Minutes

Test Dependencies

Vulkan

Accolades

5k+ Downloads

Supported Platforms

Supported Architectures

x86_64

Public Result Uploads *Reported Installs **Reported Test Completions **Test Profile Page Views ***OpenBenchmarking.orgEventsRealSR-NCNN Popularity Statisticspts/realsr-ncnn2020.092020.112021.012021.032021.052021.072021.092021.112022.012022.032022.052022.072022.092022.112023.012023.032023.052023.072023.092023.112024.012024.032024.052024.072024.092024.1115003000450060007500
* Uploading of benchmark result data to OpenBenchmarking.org is always optional (opt-in) via the Phoronix Test Suite for users wishing to share their results publicly.
** Data based on those opting to upload their test results to OpenBenchmarking.org and users enabling the opt-in anonymous statistics reporting while running benchmarks from an Internet-connected platform.
*** Test profile page view reporting began March 2021.
Data updated weekly as of 18 November 2024.
No51.7%Yes48.3%TAA Option PopularityOpenBenchmarking.org

Revision History

pts/realsr-ncnn-1.0.0   [View Source]   Thu, 24 Sep 2020 17:11:49 GMT
Initial commit of RealSR-NCNN Vulkan.

Suites Using This Test

NVIDIA GPU Compute

Vulkan Compute


Performance Metrics

Analyze Test Configuration:

RealSR-NCNN 20200818

Scale: 4x - TAA: No

OpenBenchmarking.org metrics for this test profile configuration based on 1,006 public results since 24 September 2020 with the latest data as of 18 October 2024.

Below is an overview of the generalized performance for components where there is sufficient statistically significant data based upon user-uploaded results. It is important to keep in mind particularly in the Linux/open-source space there can be vastly different OS configurations, with this overview intended to offer just general guidance as to the performance expectations.

Component
Percentile Rank
# Compatible Public Results
Seconds (Average)
Mid-Tier
75th
> 8
52nd
3
11 +/- 1
Median
50th
12
33rd
5
21 +/- 1
31st
3
29 +/- 2
29th
5
34 +/- 2
28th
8
38 +/- 1
Low-Tier
25th
> 59
25th
4
59 +/- 1
23rd
3
65 +/- 2
22nd
10
66 +/- 3
15th
7
103 +/- 6
14th
4
104 +/- 1
13th
3
127 +/- 8
11th
11
151 +/- 15
7th
15
249 +/- 19
2nd
3
320 +/- 1
OpenBenchmarking.orgDistribution Of Public Results - Scale: 4x - TAA: No1006 Results Range From 3 To 3507 Seconds3741452162873584295005716427137848559269971068113912101281135214231494156516361707177818491920199120622133220422752346241724882559263027012772284329142985305631273198326933403411348235532004006008001000

Based on OpenBenchmarking.org data, the selected test / test configuration (RealSR-NCNN 20200818 - Scale: 4x - TAA: No) has an average run-time of 3 minutes. By default this test profile is set to run at least 3 times but may increase if the standard deviation exceeds pre-defined defaults or other calculations deem additional runs necessary for greater statistical accuracy of the result.

OpenBenchmarking.orgMinutesTime Required To Complete BenchmarkScale: 4x - TAA: NoRun-Time612182430Min: 1 / Avg: 2.95 / Max: 25

Based on public OpenBenchmarking.org results, the selected test / test configuration has an average standard deviation of 0.6%.

OpenBenchmarking.orgPercent, Fewer Is BetterAverage Deviation Between RunsScale: 4x - TAA: NoDeviation3691215Min: 0 / Avg: 0.58 / Max: 9

Notable Instruction Set Usage

Notable instruction set extensions supported by this test, based on an automatic analysis by the Phoronix Test Suite / OpenBenchmarking.org analytics engine.

Instruction Set
Support
Instructions Detected
SSE2 (SSE2)
Used by default on supported hardware.
 
MOVD CVTSI2SD MULSD CVTTSD2SI PSHUFD MOVDQA MOVDQU PSLLDQ PSRLDQ CVTSS2SD PUNPCKLQDQ CVTDQ2PS ADDSD DIVSD CVTSD2SS MOVAPD MULPD CVTPS2PD CVTPD2PS UNPCKLPD SUBSD UCOMISD PMULUDQ PSHUFLW PSHUFHW CVTDQ2PD DIVPD ADDPD MINSD MAXSD XORPD ANDPD CMPLTSD ANDNPD SQRTSD ORPD PUNPCKHQDQ PADDQ PSUBQ
SSSE3 (SSSE3)
Used by default on supported hardware.
 
PSHUFB PABSW PSIGNW PALIGNR
Used by default on supported hardware.
Found on Intel processors since Sandy Bridge (2011).
Found on AMD processors since Bulldozer (2011).

 
VZEROUPPER VBROADCASTSS VINSERTF128 VEXTRACTF128 VPERM2F128 VMASKMOVPS
Used by default on supported hardware.
Found on Intel processors since Haswell (2013).
Found on AMD processors since Excavator (2016).

 
VINSERTI128 VPERMQ VEXTRACTI128 VPERM2I128 VGATHERDPS VPERMD VPBROADCASTD
FMA (FMA)
Used by default on supported hardware.
Found on Intel processors since Haswell (2013).
Found on AMD processors since Bulldozer (2011).

 
VFMADD132PS VFMADD213PS VFNMADD231PS VFMADD132SS VFMADD231SS VFMADD231PS VFMSUB132PS VFNMADD132PS
Last automated analysis: 18 January 2022

This test profile binary relies on the shared libraries libc.so.6, libvulkan.so.1, libgomp.so.1, libpthread.so.0, libm.so.6, libmvec.so.1.

Tested CPU Architectures

This benchmark has been successfully tested on the below mentioned architectures. The CPU architectures listed is where successful OpenBenchmarking.org result uploads occurred, namely for helping to determine if a given test is compatible with various alternative CPU architectures.

CPU Architecture
Kernel Identifier
Verified On
Intel / AMD x86 64-bit
x86_64
(Many Processors)

Recent Test Results

OpenBenchmarking.org Results Compare

1 System - 113 Benchmark Results

AMD Ryzen 9 7900X3D 12-Core - ASUS ProArt B650-CREATOR - AMD Device 14d8

Ubuntu 24.04 - 6.8.0-47-generic - GNOME Shell 46.0

1 System - 116 Benchmark Results

AMD Ryzen 7 3700X 8-Core - ASUS TUF GAMING X570-PLUS - AMD Starship

RockyLinux 9.4 - 6.1.102-1.el9.elrepo.x86_64 - KDE Plasma 5.27.11

2 Systems - 130 Benchmark Results

1 System - 1 Benchmark Result

Intel Core i7-4790K - ASUS SABERTOOTH Z97 MARK 2 - Intel 4th Gen Core DRAM

Ubuntu 22.04 - 6.5.0-35-generic - GNOME Shell 42.9

2 Systems - 20 Benchmark Results

AMD PRO A6-8570E R5 6 COMPUTE CORES 2C+4G - LENOVO 30FD - 1 x 4096 MB 2400MHz Samsung M471A5244CB0-CRC

Microsoft Windows 10 Pro Build 19045 - 10.0.19045.4291 - 27.20.1034.6

1 System - 63 Benchmark Results

Find More Test Results