rtx 30 compute

Tests for a future article.

Compare your own system(s) to this result file with the Phoronix Test Suite by running the command: phoronix-test-suite benchmark 2011309-HA-RTX30COMP21
Jump To Table - Results

View

Do Not Show Noisy Results
Do Not Show Results With Incomplete Data
Do Not Show Results With Little Change/Spread
List Notable Results

Limit displaying results to tests within:

NVIDIA GPU Compute 5 Tests
Vulkan Compute 5 Tests

Statistics

Show Overall Harmonic Mean(s)
Show Overall Geometric Mean
Show Geometric Means Per-Suite/Category
Show Wins / Losses Counts (Pie Chart)
Normalize Results
Remove Outliers Before Calculating Averages

Graph Settings

Force Line Graphs Where Applicable
Convert To Scalar Where Applicable
Disable Color Branding
Prefer Vertical Bar Graphs

Multi-Way Comparison

Condense Multi-Option Tests Into Single Result Graphs

Table

Show Detailed System Result Table

Run Management

Highlight
Result
Hide
Result
Result
Identifier
View Logs
Performance Per
Dollar
Date
Run
  Test
  Duration
RTX 3060 Ti 1
November 26 2020
  56 Minutes
RTX 3060 Ti 2
November 26 2020
  15 Minutes
RTX 3060 Ti 3
November 26 2020
  15 Minutes
RTX 3080 1
November 26 2020
  1 Hour, 22 Minutes
RTX 3080 2
November 26 2020
  13 Minutes
RTX 3080 3
November 26 2020
  13 Minutes
Invert Hiding All Results Option
  32 Minutes

Only show results where is faster than
Only show results matching title/arguments (delimit multiple options with a comma):
Do not show results matching title/arguments (delimit multiple options with a comma):


rtx 30 computeOpenBenchmarking.orgPhoronix Test SuiteAMD Ryzen 9 5950X 16-Core @ 3.40GHz (16 Cores / 32 Threads)ASUS ROG CROSSHAIR VIII HERO (WI-FI) (2311 BIOS)AMD Starship/Matisse16GB2000GB Corsair Force MP600 + 2000GBNVIDIA GeForce RTX 3060 Ti 8GB (1665/7000MHz)NVIDIA GeForce RTX 3080 10GB (1710/9501MHz)NVIDIA GeForce RTX 3080 10GB (420/405MHz)NVIDIA Device 228bNVIDIA Device 1aefASUS MG28URealtek RTL8125 2.5GbE + Intel I211 + Intel Wi-Fi 6 AX200Ubuntu 20.045.4.0-54-generic (x86_64)GNOME Shell 3.36.4X Server 1.20.8NVIDIA 455.45.014.6.0OpenCL 1.2 CUDA 11.1.1141.2.142GCC 9.3.0ext43840x2160ProcessorMotherboardChipsetMemoryDiskGraphicsAudiosMonitorNetworkOSKernelDesktopDisplay ServerDisplay DriverOpenGLOpenCLVulkanCompilerFile-SystemScreen ResolutionRtx 30 Compute BenchmarksSystem Logs- --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++,gm2 --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none=/build/gcc-9-HskZEa/gcc-9-9.3.0/debian/tmp-nvptx/usr,hsa --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v - Scaling Governor: acpi-cpufreq performance - CPU Microcode: 0xa201009- itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Full AMD retpoline IBPB: conditional IBRS_FW STIBP: always-on RSB filling + srbds: Not affected + tsx_async_abort: Not affected

RTX 3060 Ti 1RTX 3060 Ti 2RTX 3060 Ti 3RTX 3080 1RTX 3080 2RTX 3080 3Logarithmic Result OverviewPhoronix Test SuiteBetsy GPU CompressorVkFFTRealSR-NCNNWaifu2x-NCNN VulkanNCNN

rtx 30 computerealsr-ncnn: 4x - Norealsr-ncnn: 4x - Yeswaifu2x-ncnn: 2x - 3 - Yesvkfft: betsy: ETC1 - Highestbetsy: ETC2 RGB - Highestncnn: Vulkan GPU - squeezenetncnn: Vulkan GPU - mobilenetncnn: Vulkan GPU-v2-v2 - mobilenet-v2ncnn: Vulkan GPU-v3-v3 - mobilenet-v3ncnn: Vulkan GPU - shufflenet-v2ncnn: Vulkan GPU - mnasnetncnn: Vulkan GPU - efficientnet-b0ncnn: Vulkan GPU - blazefacencnn: Vulkan GPU - googlenetncnn: Vulkan GPU - vgg16ncnn: Vulkan GPU - resnet18ncnn: Vulkan GPU - alexnetncnn: Vulkan GPU - yolov4-tinyncnn: Vulkan GPU - resnet50RTX 3060 Ti 1RTX 3060 Ti 2RTX 3060 Ti 3RTX 3080 1RTX 3080 2RTX 3080 38.56752.5034.214320184.459345.4363.613.841.541.761.341.682.780.613.455.591.391.596.123.448.57252.3104.212320514.3095.8243.673.811.541.761.321.642.780.603.475.611.411.596.103.438.57252.3034.211320784.2815.8663.703.881.541.771.341.672.780.623.465.581.401.596.113.466.26033.9223.374514102.700661.9463.333.541.411.661.251.512.620.533.164.031.191.45.493.016.24533.9823.350516892.6483.4903.373.571.441.671.261.542.660.563.184.041.211.425.523.026.28734.0443.355513312.6693.4983.353.551.421.671.261.522.640.533.184.031.201.415.513.02OpenBenchmarking.org

RealSR-NCNN

RealSR-NCNN is an NCNN neural network implementation of the RealSR project and accelerated using the Vulkan API. RealSR is the Real-World Super Resolution via Kernel Estimation and Noise Injection. NCNN is a high performance neural network inference framework optimized for mobile and other platforms developed by Tencent. This test profile times how long it takes to increase the resolution of a sample image by a scale of 4x with Vulkan. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterRealSR-NCNN 20200818Scale: 4x - TAA: NoRTX 3060 Ti 1RTX 3060 Ti 2RTX 3060 Ti 3RTX 3080 1RTX 3080 2RTX 3080 3246810SE +/- 0.003, N = 3SE +/- 0.031, N = 3SE +/- 0.032, N = 3SE +/- 0.084, N = 3SE +/- 0.026, N = 3SE +/- 0.026, N = 38.5678.5728.5726.2606.2456.287
OpenBenchmarking.orgSeconds, Fewer Is BetterRealSR-NCNN 20200818Scale: 4x - TAA: NoRTX 3060 Ti 1RTX 3060 Ti 2RTX 3060 Ti 3RTX 3080 1RTX 3080 2RTX 3080 33691215Min: 8.56 / Avg: 8.57 / Max: 8.57Min: 8.54 / Avg: 8.57 / Max: 8.63Min: 8.54 / Avg: 8.57 / Max: 8.64Min: 6.16 / Avg: 6.26 / Max: 6.43Min: 6.21 / Avg: 6.24 / Max: 6.3Min: 6.25 / Avg: 6.29 / Max: 6.34

OpenBenchmarking.orgSeconds, Fewer Is BetterRealSR-NCNN 20200818Scale: 4x - TAA: YesRTX 3060 Ti 1RTX 3060 Ti 2RTX 3060 Ti 3RTX 3080 1RTX 3080 2RTX 3080 31224364860SE +/- 0.09, N = 3SE +/- 0.10, N = 3SE +/- 0.09, N = 3SE +/- 0.05, N = 3SE +/- 0.08, N = 3SE +/- 0.08, N = 352.5052.3152.3033.9233.9834.04
OpenBenchmarking.orgSeconds, Fewer Is BetterRealSR-NCNN 20200818Scale: 4x - TAA: YesRTX 3060 Ti 1RTX 3060 Ti 2RTX 3060 Ti 3RTX 3080 1RTX 3080 2RTX 3080 31122334455Min: 52.33 / Avg: 52.5 / Max: 52.61Min: 52.13 / Avg: 52.31 / Max: 52.47Min: 52.12 / Avg: 52.3 / Max: 52.42Min: 33.84 / Avg: 33.92 / Max: 34.02Min: 33.87 / Avg: 33.98 / Max: 34.13Min: 33.9 / Avg: 34.04 / Max: 34.18

Waifu2x-NCNN Vulkan

Waifu2x-NCNN is an NCNN neural network implementation of the Waifu2x converter project and accelerated using the Vulkan API. NCNN is a high performance neural network inference framework optimized for mobile and other platforms developed by Tencent. This test profile times how long it takes to increase the resolution of a sample image with Vulkan. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterWaifu2x-NCNN Vulkan 20200818Scale: 2x - Denoise: 3 - TAA: YesRTX 3060 Ti 1RTX 3060 Ti 2RTX 3060 Ti 3RTX 3080 1RTX 3080 2RTX 3080 30.94821.89642.84463.79284.741SE +/- 0.011, N = 3SE +/- 0.007, N = 3SE +/- 0.007, N = 3SE +/- 0.012, N = 3SE +/- 0.003, N = 3SE +/- 0.008, N = 34.2144.2124.2113.3743.3503.355
OpenBenchmarking.orgSeconds, Fewer Is BetterWaifu2x-NCNN Vulkan 20200818Scale: 2x - Denoise: 3 - TAA: YesRTX 3060 Ti 1RTX 3060 Ti 2RTX 3060 Ti 3RTX 3080 1RTX 3080 2RTX 3080 3246810Min: 4.2 / Avg: 4.21 / Max: 4.24Min: 4.2 / Avg: 4.21 / Max: 4.22Min: 4.2 / Avg: 4.21 / Max: 4.22Min: 3.35 / Avg: 3.37 / Max: 3.39Min: 3.35 / Avg: 3.35 / Max: 3.35Min: 3.34 / Avg: 3.36 / Max: 3.37

VkFFT

VkFFT is a Fast Fourier Transform (FFT) Library that is GPU accelerated by means of the Vulkan API. The VkFFT benchmark runs FFT performance differences of many different sizes before returning an overall benchmark score. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgBenchmark Score, More Is BetterVkFFT 2020-09-29RTX 3060 Ti 1RTX 3060 Ti 2RTX 3060 Ti 3RTX 3080 1RTX 3080 2RTX 3080 311K22K33K44K55KSE +/- 6.56, N = 3SE +/- 25.67, N = 3SE +/- 31.06, N = 3SE +/- 52.47, N = 3SE +/- 86.11, N = 3SE +/- 69.31, N = 3320183205132078514105168951331
OpenBenchmarking.orgBenchmark Score, More Is BetterVkFFT 2020-09-29RTX 3060 Ti 1RTX 3060 Ti 2RTX 3060 Ti 3RTX 3080 1RTX 3080 2RTX 3080 39K18K27K36K45KMin: 32005 / Avg: 32018 / Max: 32026Min: 32003 / Avg: 32050.67 / Max: 32091Min: 32041 / Avg: 32078.33 / Max: 32140Min: 51324 / Avg: 51409.67 / Max: 51505Min: 51521 / Avg: 51689.33 / Max: 51805Min: 51196 / Avg: 51331.33 / Max: 51425

Betsy GPU Compressor

Betsy is an open-source GPU compressor of various GPU compression techniques. Betsy is written in GLSL for Vulkan/OpenGL (compute shader) support for GPU-based texture compression. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterBetsy GPU Compressor 1.1 BetaCodec: ETC1 - Quality: HighestRTX 3060 Ti 1RTX 3060 Ti 2RTX 3060 Ti 3RTX 3080 1RTX 3080 2RTX 3080 31.00332.00663.00994.01325.0165SE +/- 0.049, N = 12SE +/- 0.011, N = 3SE +/- 0.018, N = 3SE +/- 0.050, N = 15SE +/- 0.010, N = 3SE +/- 0.037, N = 34.4594.3094.2812.7002.6482.6691. (CXX) g++ options: -O3 -O2 -lpthread -ldl
OpenBenchmarking.orgSeconds, Fewer Is BetterBetsy GPU Compressor 1.1 BetaCodec: ETC1 - Quality: HighestRTX 3060 Ti 1RTX 3060 Ti 2RTX 3060 Ti 3RTX 3080 1RTX 3080 2RTX 3080 3246810Min: 4.33 / Avg: 4.46 / Max: 4.99Min: 4.3 / Avg: 4.31 / Max: 4.33Min: 4.25 / Avg: 4.28 / Max: 4.3Min: 2.6 / Avg: 2.7 / Max: 3.4Min: 2.63 / Avg: 2.65 / Max: 2.67Min: 2.63 / Avg: 2.67 / Max: 2.741. (CXX) g++ options: -O3 -O2 -lpthread -ldl

OpenBenchmarking.orgSeconds, Fewer Is BetterBetsy GPU Compressor 1.1 BetaCodec: ETC2 RGB - Quality: HighestRTX 3060 Ti 1RTX 3060 Ti 2RTX 3060 Ti 3RTX 3080 1RTX 3080 2RTX 3080 3140280420560700SE +/- 338.614, N = 7SE +/- 0.013, N = 3SE +/- 0.001, N = 3SE +/- 657.300, N = 6SE +/- 0.006, N = 3SE +/- 0.002, N = 3345.4365.8245.866661.9463.4903.4981. (CXX) g++ options: -O3 -O2 -lpthread -ldl
OpenBenchmarking.orgSeconds, Fewer Is BetterBetsy GPU Compressor 1.1 BetaCodec: ETC2 RGB - Quality: HighestRTX 3060 Ti 1RTX 3060 Ti 2RTX 3060 Ti 3RTX 3080 1RTX 3080 2RTX 3080 3120240360480600Min: 5.83 / Avg: 345.44 / Max: 2377.12Min: 5.8 / Avg: 5.82 / Max: 5.84Min: 5.87 / Avg: 5.87 / Max: 5.87Min: 3.49 / Avg: 661.95 / Max: 3948.44Min: 3.48 / Avg: 3.49 / Max: 3.5Min: 3.5 / Avg: 3.5 / Max: 3.51. (CXX) g++ options: -O3 -O2 -lpthread -ldl

NCNN

NCNN is a high performance neural network inference framework optimized for mobile and other platforms developed by Tencent. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: Vulkan GPU - Model: squeezenetRTX 3060 Ti 1RTX 3060 Ti 2RTX 3060 Ti 3RTX 3080 1RTX 3080 2RTX 3080 30.83251.6652.49753.334.1625SE +/- 0.01, N = 3SE +/- 0.02, N = 3SE +/- 0.03, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 33.613.673.703.333.373.35MIN: 3.51 / MAX: 4.36MIN: 3.55 / MAX: 4.53MIN: 3.54 / MAX: 4.44MIN: 3.25 / MAX: 3.53MIN: 3.27 / MAX: 8.4MIN: 3.26 / MAX: 3.831. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: Vulkan GPU - Model: squeezenetRTX 3060 Ti 1RTX 3060 Ti 2RTX 3060 Ti 3RTX 3080 1RTX 3080 2RTX 3080 3246810Min: 3.6 / Avg: 3.61 / Max: 3.62Min: 3.65 / Avg: 3.67 / Max: 3.7Min: 3.65 / Avg: 3.7 / Max: 3.75Min: 3.32 / Avg: 3.33 / Max: 3.36Min: 3.35 / Avg: 3.37 / Max: 3.39Min: 3.34 / Avg: 3.35 / Max: 3.371. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: Vulkan GPU - Model: mobilenetRTX 3060 Ti 1RTX 3060 Ti 2RTX 3060 Ti 3RTX 3080 1RTX 3080 2RTX 3080 30.8731.7462.6193.4924.365SE +/- 0.03, N = 3SE +/- 0.05, N = 3SE +/- 0.02, N = 3SE +/- 0.00, N = 3SE +/- 0.01, N = 3SE +/- 0.02, N = 33.843.813.883.543.573.55MIN: 3.7 / MAX: 4.8MIN: 3.68 / MAX: 4.79MIN: 3.71 / MAX: 9.03MIN: 3.49 / MAX: 3.58MIN: 3.51 / MAX: 3.65MIN: 3.5 / MAX: 3.741. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: Vulkan GPU - Model: mobilenetRTX 3060 Ti 1RTX 3060 Ti 2RTX 3060 Ti 3RTX 3080 1RTX 3080 2RTX 3080 3246810Min: 3.8 / Avg: 3.84 / Max: 3.89Min: 3.72 / Avg: 3.81 / Max: 3.87Min: 3.86 / Avg: 3.88 / Max: 3.92Min: 3.54 / Avg: 3.54 / Max: 3.55Min: 3.55 / Avg: 3.57 / Max: 3.59Min: 3.52 / Avg: 3.55 / Max: 3.571. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: Vulkan GPU-v2-v2 - Model: mobilenet-v2RTX 3060 Ti 1RTX 3060 Ti 2RTX 3060 Ti 3RTX 3080 1RTX 3080 2RTX 3080 30.34650.6931.03951.3861.7325SE +/- 0.00, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.00, N = 3SE +/- 0.01, N = 3SE +/- 0.00, N = 31.541.541.541.411.441.42MIN: 1.51 / MAX: 2.48MIN: 1.51 / MAX: 2.22MIN: 1.51 / MAX: 2.69MIN: 1.39 / MAX: 1.48MIN: 1.41 / MAX: 5.04MIN: 1.41 / MAX: 2.341. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: Vulkan GPU-v2-v2 - Model: mobilenet-v2RTX 3060 Ti 1RTX 3060 Ti 2RTX 3060 Ti 3RTX 3080 1RTX 3080 2RTX 3080 3246810Min: 1.53 / Avg: 1.54 / Max: 1.54Min: 1.52 / Avg: 1.54 / Max: 1.55Min: 1.52 / Avg: 1.54 / Max: 1.55Min: 1.41 / Avg: 1.41 / Max: 1.41Min: 1.42 / Avg: 1.44 / Max: 1.46Min: 1.42 / Avg: 1.42 / Max: 1.431. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: Vulkan GPU-v3-v3 - Model: mobilenet-v3RTX 3060 Ti 1RTX 3060 Ti 2RTX 3060 Ti 3RTX 3080 1RTX 3080 2RTX 3080 30.39830.79661.19491.59321.9915SE +/- 0.00, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 31.761.761.771.661.671.67MIN: 1.73 / MAX: 2.31MIN: 1.74 / MAX: 2.33MIN: 1.73 / MAX: 2.93MIN: 1.65 / MAX: 1.7MIN: 1.66 / MAX: 1.76MIN: 1.66 / MAX: 1.71. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: Vulkan GPU-v3-v3 - Model: mobilenet-v3RTX 3060 Ti 1RTX 3060 Ti 2RTX 3060 Ti 3RTX 3080 1RTX 3080 2RTX 3080 3246810Min: 1.76 / Avg: 1.76 / Max: 1.76Min: 1.75 / Avg: 1.76 / Max: 1.77Min: 1.75 / Avg: 1.77 / Max: 1.78Min: 1.65 / Avg: 1.66 / Max: 1.66Min: 1.67 / Avg: 1.67 / Max: 1.68Min: 1.67 / Avg: 1.67 / Max: 1.671. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: Vulkan GPU - Model: shufflenet-v2RTX 3060 Ti 1RTX 3060 Ti 2RTX 3060 Ti 3RTX 3080 1RTX 3080 2RTX 3080 30.30150.6030.90451.2061.5075SE +/- 0.01, N = 3SE +/- 0.00, N = 3SE +/- 0.01, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 31.341.321.341.251.261.26MIN: 1.3 / MAX: 2.3MIN: 1.31 / MAX: 1.84MIN: 1.31 / MAX: 2.05MIN: 1.24 / MAX: 1.31MIN: 1.25 / MAX: 1.31MIN: 1.25 / MAX: 1.311. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: Vulkan GPU - Model: shufflenet-v2RTX 3060 Ti 1RTX 3060 Ti 2RTX 3060 Ti 3RTX 3080 1RTX 3080 2RTX 3080 3246810Min: 1.33 / Avg: 1.34 / Max: 1.35Min: 1.32 / Avg: 1.32 / Max: 1.33Min: 1.33 / Avg: 1.34 / Max: 1.35Min: 1.25 / Avg: 1.25 / Max: 1.25Min: 1.26 / Avg: 1.26 / Max: 1.26Min: 1.26 / Avg: 1.26 / Max: 1.261. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: Vulkan GPU - Model: mnasnetRTX 3060 Ti 1RTX 3060 Ti 2RTX 3060 Ti 3RTX 3080 1RTX 3080 2RTX 3080 30.3780.7561.1341.5121.89SE +/- 0.01, N = 3SE +/- 0.02, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.01, N = 3SE +/- 0.00, N = 31.681.641.671.511.541.52MIN: 1.61 / MAX: 12.17MIN: 1.6 / MAX: 2.68MIN: 1.61 / MAX: 2.88MIN: 1.5 / MAX: 1.61MIN: 1.52 / MAX: 4.44MIN: 1.51 / MAX: 2.531. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: Vulkan GPU - Model: mnasnetRTX 3060 Ti 1RTX 3060 Ti 2RTX 3060 Ti 3RTX 3080 1RTX 3080 2RTX 3080 3246810Min: 1.66 / Avg: 1.68 / Max: 1.7Min: 1.62 / Avg: 1.64 / Max: 1.67Min: 1.66 / Avg: 1.67 / Max: 1.67Min: 1.51 / Avg: 1.51 / Max: 1.51Min: 1.53 / Avg: 1.54 / Max: 1.55Min: 1.52 / Avg: 1.52 / Max: 1.531. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: Vulkan GPU - Model: efficientnet-b0RTX 3060 Ti 1RTX 3060 Ti 2RTX 3060 Ti 3RTX 3080 1RTX 3080 2RTX 3080 30.62551.2511.87652.5023.1275SE +/- 0.01, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.01, N = 3SE +/- 0.00, N = 32.782.782.782.622.662.64MIN: 2.73 / MAX: 5.72MIN: 2.74 / MAX: 6.93MIN: 2.73 / MAX: 3.97MIN: 2.61 / MAX: 4.19MIN: 2.63 / MAX: 10.73MIN: 2.63 / MAX: 2.81. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: Vulkan GPU - Model: efficientnet-b0RTX 3060 Ti 1RTX 3060 Ti 2RTX 3060 Ti 3RTX 3080 1RTX 3080 2RTX 3080 3246810Min: 2.77 / Avg: 2.78 / Max: 2.79Min: 2.78 / Avg: 2.78 / Max: 2.78Min: 2.78 / Avg: 2.78 / Max: 2.78Min: 2.62 / Avg: 2.62 / Max: 2.63Min: 2.65 / Avg: 2.66 / Max: 2.69Min: 2.64 / Avg: 2.64 / Max: 2.651. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: Vulkan GPU - Model: blazefaceRTX 3060 Ti 1RTX 3060 Ti 2RTX 3060 Ti 3RTX 3080 1RTX 3080 2RTX 3080 30.13950.2790.41850.5580.6975SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.00, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 30.610.600.620.530.560.53MIN: 0.58 / MAX: 1.1MIN: 0.58 / MAX: 1.56MIN: 0.58 / MAX: 1.7MIN: 0.51 / MAX: 0.6MIN: 0.53 / MAX: 2.06MIN: 0.51 / MAX: 1.361. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: Vulkan GPU - Model: blazefaceRTX 3060 Ti 1RTX 3060 Ti 2RTX 3060 Ti 3RTX 3080 1RTX 3080 2RTX 3080 3246810Min: 0.6 / Avg: 0.61 / Max: 0.62Min: 0.59 / Avg: 0.6 / Max: 0.62Min: 0.6 / Avg: 0.62 / Max: 0.63Min: 0.52 / Avg: 0.53 / Max: 0.53Min: 0.55 / Avg: 0.56 / Max: 0.57Min: 0.52 / Avg: 0.53 / Max: 0.541. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: Vulkan GPU - Model: googlenetRTX 3060 Ti 1RTX 3060 Ti 2RTX 3060 Ti 3RTX 3080 1RTX 3080 2RTX 3080 30.78081.56162.34243.12323.904SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 33.453.473.463.163.183.18MIN: 3.41 / MAX: 4.33MIN: 3.42 / MAX: 4.54MIN: 3.41 / MAX: 4.22MIN: 3.15 / MAX: 5.69MIN: 3.17 / MAX: 3.91MIN: 3.17 / MAX: 3.841. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: Vulkan GPU - Model: googlenetRTX 3060 Ti 1RTX 3060 Ti 2RTX 3060 Ti 3RTX 3080 1RTX 3080 2RTX 3080 3246810Min: 3.43 / Avg: 3.45 / Max: 3.47Min: 3.45 / Avg: 3.47 / Max: 3.48Min: 3.44 / Avg: 3.46 / Max: 3.47Min: 3.15 / Avg: 3.16 / Max: 3.17Min: 3.18 / Avg: 3.18 / Max: 3.19Min: 3.18 / Avg: 3.18 / Max: 3.191. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: Vulkan GPU - Model: vgg16RTX 3060 Ti 1RTX 3060 Ti 2RTX 3060 Ti 3RTX 3080 1RTX 3080 2RTX 3080 31.26232.52463.78695.04926.3115SE +/- 0.02, N = 3SE +/- 0.01, N = 3SE +/- 0.00, N = 3SE +/- 0.03, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 35.595.615.584.034.044.03MIN: 5.46 / MAX: 9.83MIN: 5.47 / MAX: 15.28MIN: 5.48 / MAX: 9.94MIN: 3.98 / MAX: 17.9MIN: 3.99 / MAX: 10.42MIN: 4 / MAX: 7.191. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: Vulkan GPU - Model: vgg16RTX 3060 Ti 1RTX 3060 Ti 2RTX 3060 Ti 3RTX 3080 1RTX 3080 2RTX 3080 3246810Min: 5.56 / Avg: 5.59 / Max: 5.62Min: 5.59 / Avg: 5.61 / Max: 5.62Min: 5.57 / Avg: 5.58 / Max: 5.58Min: 3.99 / Avg: 4.03 / Max: 4.08Min: 4.03 / Avg: 4.04 / Max: 4.06Min: 4.02 / Avg: 4.03 / Max: 4.041. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: Vulkan GPU - Model: resnet18RTX 3060 Ti 1RTX 3060 Ti 2RTX 3060 Ti 3RTX 3080 1RTX 3080 2RTX 3080 30.31730.63460.95191.26921.5865SE +/- 0.00, N = 3SE +/- 0.02, N = 3SE +/- 0.01, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.01, N = 31.391.411.401.191.211.20MIN: 1.36 / MAX: 3.28MIN: 1.36 / MAX: 14.39MIN: 1.37 / MAX: 6.18MIN: 1.16 / MAX: 1.23MIN: 1.18 / MAX: 2.33MIN: 1.18 / MAX: 2.331. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: Vulkan GPU - Model: resnet18RTX 3060 Ti 1RTX 3060 Ti 2RTX 3060 Ti 3RTX 3080 1RTX 3080 2RTX 3080 3246810Min: 1.39 / Avg: 1.39 / Max: 1.4Min: 1.39 / Avg: 1.41 / Max: 1.46Min: 1.39 / Avg: 1.4 / Max: 1.41Min: 1.18 / Avg: 1.19 / Max: 1.19Min: 1.2 / Avg: 1.21 / Max: 1.21Min: 1.19 / Avg: 1.2 / Max: 1.211. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: Vulkan GPU - Model: alexnetRTX 3060 Ti 1RTX 3060 Ti 2RTX 3060 Ti 3RTX 3080 1RTX 3080 2RTX 3080 30.35780.71561.07341.43121.789SE +/- 0.01, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.01, N = 31.591.591.591.401.421.41MIN: 1.56 / MAX: 3.28MIN: 1.55 / MAX: 2.51MIN: 1.55 / MAX: 2.03MIN: 1.39 / MAX: 1.47MIN: 1.4 / MAX: 1.85MIN: 1.4 / MAX: 1.481. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: Vulkan GPU - Model: alexnetRTX 3060 Ti 1RTX 3060 Ti 2RTX 3060 Ti 3RTX 3080 1RTX 3080 2RTX 3080 3246810Min: 1.58 / Avg: 1.59 / Max: 1.6Min: 1.59 / Avg: 1.59 / Max: 1.6Min: 1.58 / Avg: 1.59 / Max: 1.59Min: 1.41 / Avg: 1.42 / Max: 1.431. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: Vulkan GPU - Model: yolov4-tinyRTX 3060 Ti 1RTX 3060 Ti 2RTX 3060 Ti 3RTX 3080 1RTX 3080 2RTX 3080 3246810SE +/- 0.01, N = 3SE +/- 0.05, N = 3SE +/- 0.03, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 36.126.106.115.495.525.51MIN: 5.93 / MAX: 7.39MIN: 5.9 / MAX: 10.69MIN: 5.89 / MAX: 7.89MIN: 5.39 / MAX: 6.81MIN: 5.47 / MAX: 5.61MIN: 5.45 / MAX: 5.581. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: Vulkan GPU - Model: yolov4-tinyRTX 3060 Ti 1RTX 3060 Ti 2RTX 3060 Ti 3RTX 3080 1RTX 3080 2RTX 3080 3246810Min: 6.11 / Avg: 6.12 / Max: 6.14Min: 6.01 / Avg: 6.1 / Max: 6.15Min: 6.06 / Avg: 6.11 / Max: 6.16Min: 5.47 / Avg: 5.49 / Max: 5.5Min: 5.51 / Avg: 5.52 / Max: 5.54Min: 5.49 / Avg: 5.51 / Max: 5.521. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: Vulkan GPU - Model: resnet50RTX 3060 Ti 1RTX 3060 Ti 2RTX 3060 Ti 3RTX 3080 1RTX 3080 2RTX 3080 30.77851.5572.33553.1143.8925SE +/- 0.01, N = 2SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.00, N = 33.443.433.463.013.023.02MIN: 3.4 / MAX: 4.12MIN: 3.39 / MAX: 4.11MIN: 3.41 / MAX: 5.72MIN: 2.99 / MAX: 3.08MIN: 3 / MAX: 3.47MIN: 3 / MAX: 3.71. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: Vulkan GPU - Model: resnet50RTX 3060 Ti 1RTX 3060 Ti 2RTX 3060 Ti 3RTX 3080 1RTX 3080 2RTX 3080 3246810Min: 3.43 / Avg: 3.44 / Max: 3.45Min: 3.41 / Avg: 3.43 / Max: 3.44Min: 2.99 / Avg: 3.01 / Max: 3.03Min: 3.01 / Avg: 3.02 / Max: 3.03Min: 3.02 / Avg: 3.02 / Max: 3.021. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread