NVIDIA Linux GPU Performance Comptue RTX 30 RTX 20

Benchmarks by Michael Larabel for a future article.

HTML result view exported from: https://openbenchmarking.org/result/2012250-HA-NVIDIAGPU61.

NVIDIA Linux GPU Performance Comptue RTX 30 RTX 20ProcessorMotherboardChipsetMemoryDiskGraphicsAudioMonitorNetworkOSKernelDesktopDisplay ServerDisplay DriverOpenGLOpenCLVulkanCompilerFile-SystemScreen ResolutionRTX 2060RTX 2060 SUPERRTX 2070RTX 2070 SUPERRTX 2080RTX 2080 SUPERRTX 2080 TiTITAN RTXRTX 3060 TIRTX 3080AMD Ryzen 9 5950X 16-Core @ 3.40GHz (16 Cores / 32 Threads)ASUS ROG CROSSHAIR VIII HERO (WI-FI) (3003 BIOS)AMD Starship/Matisse16GB2000GB Corsair Force MP600NVIDIA GeForce RTX 2060 6GB (1365/7000MHz)NVIDIA TU106 HD AudioASUS MG28URealtek RTL8125 2.5GbE + Intel I211 + Intel Wi-Fi 6 AX200Ubuntu 20.045.4.0-58-generic (x86_64)GNOME Shell 3.36.4X Server 1.20.8NVIDIA 460.27.044.6.0OpenCL 1.2 CUDA 11.2.661.2.155GCC 9.3.0ext43840x2160NVIDIA GeForce RTX 2060 SUPER 8GB (1470/7000MHz)ASUS NVIDIA GeForce RTX 2070 8GB (435/405MHz)NVIDIA GeForce RTX 2070 SUPER 8GB (1605/7000MHz)NVIDIA TU104 HD AudioZotac NVIDIA GeForce RTX 2080 8GB (1515/7000MHz)NVIDIA GeForce RTX 2080 SUPER 8GB (1650/7750MHz)NVIDIA GeForce RTX 2080 Ti 11GB (1350/7000MHz)NVIDIA TU102 HD AudioNVIDIA TITAN RTX 24GB (1350/7000MHz)NVIDIA GeForce RTX 3060 Ti 8GB (1665/7000MHz)NVIDIA Device 228bNVIDIA GeForce RTX 3080 10GB (1710/9501MHz)NVIDIA Device 1aefOpenBenchmarking.orgCompiler Details- --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++,gm2 --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none=/build/gcc-9-HskZEa/gcc-9-9.3.0/debian/tmp-nvptx/usr,hsa --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v Processor Details- Scaling Governor: acpi-cpufreq ondemand (Boost: Enabled) - CPU Microcode: 0xa201009OpenCL Details- RTX 2060: GPU Compute Cores: 1920- RTX 2060 SUPER: GPU Compute Cores: 2176- RTX 2070: GPU Compute Cores: 2304- RTX 2070 SUPER: GPU Compute Cores: 2560- RTX 2080: GPU Compute Cores: 2944- RTX 2080 SUPER: GPU Compute Cores: 3072- RTX 2080 Ti: GPU Compute Cores: 4352- TITAN RTX: GPU Compute Cores: 4608- RTX 3060 TI: GPU Compute Cores: 4864- RTX 3080: GPU Compute Cores: 8704Python Details- Python 2.7.18 + Python 3.8.5Security Details- itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Full AMD retpoline IBPB: conditional IBRS_FW STIBP: always-on RSB filling + srbds: Not affected + tsx_async_abort: Not affected

NVIDIA Linux GPU Performance Comptue RTX 30 RTX 20realsr-ncnn: 4x - Norealsr-ncnn: 4x - Yeswaifu2x-ncnn: 2x - 3 - Yesvkfft: hashcat: MD5hashcat: SHA1hashcat: 7-Ziphashcat: SHA-512hashcat: TrueCrypt RIPEMD160 + XTSfinancebench: Black-Scholes OpenCLviennacl: OpenCL LU Factorizationcl-mem: Copycl-mem: Readcl-mem: Writebetsy: ETC1 - Highestbetsy: ETC2 RGB - Highestvkresample: 2x - Doublevkresample: 2x - Singleoctanebench: Total Scoreredshift: luxcorerender-cl: DLSCluxcorerender-cl: Foodluxcorerender-cl: LuxCore Benchmarkluxcorerender-cl: Rainbow Colors and Prismfahbench: lczero: OpenCLrodinia: OpenCL Particle Filterarrayfire: Conjugate Gradient OpenCLncnn: Vulkan GPU - mobilenetncnn: Vulkan GPU-v2-v2 - mobilenet-v2ncnn: Vulkan GPU-v3-v3 - mobilenet-v3ncnn: Vulkan GPU - shufflenet-v2ncnn: Vulkan GPU - mnasnetncnn: Vulkan GPU - efficientnet-b0ncnn: Vulkan GPU - blazefacencnn: Vulkan GPU - googlenetncnn: Vulkan GPU - vgg16ncnn: Vulkan GPU - resnet18ncnn: Vulkan GPU - alexnetncnn: Vulkan GPU - resnet50ncnn: Vulkan GPU - yolov4-tinyncnn: Vulkan GPU - squeezenet_ssdncnn: Vulkan GPU - regnety_400mplaidml: No - Training - VGG16 - OpenCLplaidml: No - Training - VGG19 - OpenCLplaidml: No - Inference - VGG16 - OpenCLplaidml: No - Inference - VGG19 - OpenCLplaidml: No - Inference - IMDB LSTM - OpenCLplaidml: No - Inference - Mobilenet - OpenCLplaidml: No - Inference - ResNet 50 - OpenCLplaidml: Yes - Inference - Mobilenet - OpenCLplaidml: No - Inference - DenseNet 201 - OpenCLplaidml: No - Inference - Inception V3 - OpenCLplaidml: No - Inference - NASNer Large - OpenCLblender: BMW27 - NVIDIA OptiXblender: Classroom - NVIDIA OptiXblender: Fishy Cat - NVIDIA OptiXblender: Barbershop - NVIDIA OptiXblender: Pabellon Barcelona - NVIDIA OptiXmandelgpu: GPUclpeak: Integer Compute INTclpeak: Single-Precision Floatclpeak: Double-Precision Doubleclpeak: Global Memory BandwidthRTX 2060RTX 2060 SUPERRTX 2070RTX 2070 SUPERRTX 2080RTX 2080 SUPERRTX 2080 TiTITAN RTXRTX 3060 TIRTX 308012.70785.9485.77922903259306333338248933333439000104936666731180012.56574.5062239.5297.5251.66.1898.748350.96127.195195.0098064693.301.212.807.98183.291397528.9602.65012.424.444.154.424.015.481.813.4356.9814.4711.6124.5821.4114.3218.2927.1222.04110.9688.38392.021282.27320.951720.24125.45171.7831.8136.27147.6567.131779.46206.86253858256.75224.685369.81231.27277.4011.54075.8925.31329585292720000009314900000490533118343333334960010.45474.0853288.3397.1340.15.4517.733309.61922.282244.2245533784.191.323.6311.41207.0770113997.9812.07313.044.674.344.474.335.701.9314.1857.2214.7711.5325.7122.8014.6318.4930.0024.58126.76100.61440.361581.85376.592011.99147.13203.7838.4230.90144.4058.941758.17194.41278640038.16956.556985.02261.53369.4211.18774.6545.31429546299555666679535466667500233121326666735670010.22574.1817285.7397.1323.95.3097.646302.84522.269243.2612183754.141.303.5610.94205.2322114957.8582.08612.664.604.194.454.155.591.8713.6057.1314.5511.7425.0521.4114.5118.6830.27129.65103.03447.471566.36379.702004.51148.04202.0539.0731.34148.1758.341826.30198.63283803060.17094.247190.53268.18369.149.97263.1784.76129427354660333331118336666759370014267333334237338.22475.7984292.3397.1320.64.8246.653261.96919.523264.5349433514.321.863.6710.04229.7600128416.9002.06012.774.644.304.464.225.601.8813.4857.1314.5311.3625.2521.7914.5518.5833.7527.78152.58121.35499.431701.99422.862300.01149.68220.4342.3225.4489.1248.03996.82132.73321637774.38551.578591.77309.27370.179.47359.4034.60528745384932333331220353333363736715595000004613677.62077.1727290.5397.1331.94.3756.153235.51219.024261.3295043414.231.883.559.27244.4171135766.2882.07212.694.504.254.484.105.561.8613.5657.2514.5811.3724.6221.8114.4518.7734.1328.32161.88128.62545.481726.88442.782333.79152.28242.5445.3926.2486.1345.51971.62132.90343080891.19330.838860.55344.68369.658.84254.0374.35830475431369666671365300000071196717341000005272876.74976.6869302.0437.8350.84.0045.507216.53917.507268.1143683254.321.973.609.19260.8957146345.8091.89312.724.654.304.504.215.681.8813.1257.0814.3611.2224.7322.1314.4718.6538.732.29180.23143.39588.041816.87468.602489.11160.48266.3949.1625.2281.1442.60911.32126.93368037096.610244.0810347.92373.96405.687.60544.1863.85634110554883333331775130000088530022417000006579676.01478.3244324.0545.6446.63.177152.85314.767354.8567692465.532.184.5812.14304.0362169524.5071.67012.644.744.434.484.566.021.9513.9656.6914.6511.4424.6921.4514.3618.3244.0236.9231.73185.09754.692414.96636.843316.31213.54351.1863.5321.6773.9932.80899.14103.97447272306.013432.8912677.18519.03508.007.36041.7313.82736216581043000001857640000093723323503666676881675.69181.3167320.8568.2495.43.0434.116149.20413.561383.4637392355.952.235.0313.56307.0348170094.2961.63712.774.494.204.434.026.031.8313.3256.5214.3611.2524.9521.8814.3518.2144.5137.56244.00194.50782.292551.38654.763392.96228.78359.1366.5018.6473.4031.72905.22102.51460475602.613791.9114109.68545.22530.488.78454.1444.37132556329276000001110373333358130014069000004271008.32875.7896294.1392.8384.34.3586.040264.87117.676383.4165832397.132.975.9117.11235.7167167997.0402.09212.544.544.254.474.115.551.8613.4157.1814.5111.4124.6921.3515.1118.5734.9829.38167.73133.11689.611875.37454.662428.74177.41236.4048.0420.1556.3336.74565.9984.95280941400.28365.8516033.64306.12389.186.34534.2063.51240997564291333331915110000098130024260333337232004.86979.3217354.7674.2645.32.7013.664148.28411.220565.0995121659.604.007.8421.91320.6571186684.2901.55712.784.564.344.524.205.611.9113.9556.9614.7411.7125.3422.1514.5018.4547.5040.88280.31223.641019.793062.00730.763623.82261.32398.6479.2311.4838.8521.48421.5155.63421918457.515586.0329490.81545.91662.24OpenBenchmarking.org

RealSR-NCNN

Scale: 4x - TAA: No

OpenBenchmarking.orgSeconds, Fewer Is BetterRealSR-NCNN 20200818Scale: 4x - TAA: NoRTX 2060RTX 2060 SUPERRTX 2070RTX 2070 SUPERRTX 2080RTX 2080 SUPERRTX 2080 TiTITAN RTXRTX 3060 TIRTX 30803691215SE +/- 0.091, N = 3SE +/- 0.111, N = 3SE +/- 0.096, N = 3SE +/- 0.110, N = 3SE +/- 0.131, N = 3SE +/- 0.101, N = 3SE +/- 0.108, N = 3SE +/- 0.105, N = 3SE +/- 0.056, N = 3SE +/- 0.093, N = 312.70711.54011.1879.9729.4738.8427.6057.3608.7846.345

RealSR-NCNN

Scale: 4x - TAA: Yes

OpenBenchmarking.orgSeconds, Fewer Is BetterRealSR-NCNN 20200818Scale: 4x - TAA: YesRTX 2060RTX 2060 SUPERRTX 2070RTX 2070 SUPERRTX 2080RTX 2080 SUPERRTX 2080 TiTITAN RTXRTX 3060 TIRTX 308020406080100SE +/- 0.35, N = 3SE +/- 0.37, N = 3SE +/- 0.45, N = 3SE +/- 0.29, N = 3SE +/- 0.38, N = 3SE +/- 0.27, N = 3SE +/- 0.21, N = 3SE +/- 0.22, N = 3SE +/- 0.09, N = 3SE +/- 0.07, N = 385.9575.8974.6563.1859.4054.0444.1941.7354.1434.21

Waifu2x-NCNN Vulkan

Scale: 2x - Denoise: 3 - TAA: Yes

OpenBenchmarking.orgSeconds, Fewer Is BetterWaifu2x-NCNN Vulkan 20200818Scale: 2x - Denoise: 3 - TAA: YesRTX 2060RTX 2060 SUPERRTX 2070RTX 2070 SUPERRTX 2080RTX 2080 SUPERRTX 2080 TiTITAN RTXRTX 3060 TIRTX 30801.30032.60063.90095.20126.5015SE +/- 0.064, N = 3SE +/- 0.055, N = 3SE +/- 0.049, N = 3SE +/- 0.067, N = 4SE +/- 0.053, N = 3SE +/- 0.060, N = 3SE +/- 0.057, N = 3SE +/- 0.056, N = 3SE +/- 0.008, N = 3SE +/- 0.047, N = 55.7795.3135.3144.7614.6054.3583.8563.8274.3713.512

VkFFT

OpenBenchmarking.orgBenchmark Score, More Is BetterVkFFT 1.1.1RTX 2060RTX 2060 SUPERRTX 2070RTX 2070 SUPERRTX 2080RTX 2080 SUPERRTX 2080 TiTITAN RTXRTX 3060 TIRTX 30809K18K27K36K45KSE +/- 44.06, N = 3SE +/- 257.75, N = 3SE +/- 149.21, N = 3SE +/- 213.44, N = 3SE +/- 95.96, N = 3SE +/- 51.40, N = 3SE +/- 78.30, N = 3SE +/- 413.34, N = 3SE +/- 86.88, N = 3SE +/- 284.10, N = 3229032958529546294272874530475341103621632556409971. (CXX) g++ options: -O3 -pthread

Hashcat

Benchmark: MD5

OpenBenchmarking.orgH/s, More Is BetterHashcat 6.1.1Benchmark: MD5RTX 2060RTX 2060 SUPERRTX 2070RTX 2070 SUPERRTX 2080RTX 2080 SUPERRTX 2080 TiTITAN RTXRTX 3060 TIRTX 308012000M24000M36000M48000M60000MSE +/- 11770207.21, N = 3SE +/- 8911415.90, N = 3SE +/- 9342079.24, N = 3SE +/- 41910871.04, N = 3SE +/- 30944592.06, N = 3SE +/- 13808974.54, N = 3SE +/- 63030953.60, N = 3SE +/- 33241139.17, N = 3SE +/- 23055223.56, N = 3SE +/- 39942305.61, N = 325930633333292720000002995556666735466033333384932333334313696666755488333333581043000003292760000056429133333

Hashcat

Benchmark: SHA1

OpenBenchmarking.orgH/s, More Is BetterHashcat 6.1.1Benchmark: SHA1RTX 2060RTX 2060 SUPERRTX 2070RTX 2070 SUPERRTX 2080RTX 2080 SUPERRTX 2080 TiTITAN RTXRTX 3060 TIRTX 30804000M8000M12000M16000M20000MSE +/- 2302414.19, N = 3SE +/- 7522189.40, N = 3SE +/- 2514844.82, N = 3SE +/- 1017076.42, N = 3SE +/- 14178073.84, N = 3SE +/- 3601851.38, N = 3SE +/- 20384389.45, N = 3SE +/- 24080351.60, N = 3SE +/- 16045802.50, N = 3SE +/- 13325289.24, N = 382489333339314900000953546666711183366667122035333331365300000017751300000185764000001110373333319151100000

Hashcat

Benchmark: 7-Zip

OpenBenchmarking.orgH/s, More Is BetterHashcat 6.1.1Benchmark: 7-ZipRTX 2060RTX 2060 SUPERRTX 2070RTX 2070 SUPERRTX 2080RTX 2080 SUPERRTX 2080 TiTITAN RTXRTX 3060 TIRTX 3080200K400K600K800K1000KSE +/- 1101.51, N = 3SE +/- 1192.10, N = 3SE +/- 726.48, N = 3SE +/- 435.89, N = 3SE +/- 1713.99, N = 3SE +/- 1963.27, N = 3SE +/- 3113.41, N = 3SE +/- 520.68, N = 3SE +/- 3659.23, N = 3SE +/- 503.32, N = 3439000490533500233593700637367711967885300937233581300981300

Hashcat

Benchmark: SHA-512

OpenBenchmarking.orgH/s, More Is BetterHashcat 6.1.1Benchmark: SHA-512RTX 2060RTX 2060 SUPERRTX 2070RTX 2070 SUPERRTX 2080RTX 2080 SUPERRTX 2080 TiTITAN RTXRTX 3060 TIRTX 3080500M1000M1500M2000M2500MSE +/- 635959.47, N = 3SE +/- 1281058.59, N = 3SE +/- 845248.16, N = 3SE +/- 933333.33, N = 3SE +/- 814452.78, N = 3SE +/- 2042873.79, N = 3SE +/- 1258305.74, N = 3SE +/- 3263093.28, N = 3SE +/- 750555.35, N = 3SE +/- 2669165.50, N = 31049366667118343333312132666671426733333155950000017341000002241700000235036666714069000002426033333

Hashcat

Benchmark: TrueCrypt RIPEMD160 + XTS

OpenBenchmarking.orgH/s, More Is BetterHashcat 6.1.1Benchmark: TrueCrypt RIPEMD160 + XTSRTX 2060RTX 2060 SUPERRTX 2070RTX 2070 SUPERRTX 2080RTX 2080 SUPERRTX 2080 TiTITAN RTXRTX 3060 TIRTX 3080150K300K450K600K750KSE +/- 57.74, N = 3SE +/- 57.74, N = 3SE +/- 556.78, N = 3SE +/- 66.67, N = 3SE +/- 133.33, N = 3SE +/- 4580.29, N = 15SE +/- 1591.99, N = 3SE +/- 1120.02, N = 3SE +/- 550.76, N = 3SE +/- 750.56, N = 3311800349600356700423733461367527287657967688167427100723200

FinanceBench

Benchmark: Black-Scholes OpenCL

OpenBenchmarking.orgms, Fewer Is BetterFinanceBench 2016-06-06Benchmark: Black-Scholes OpenCLRTX 2060RTX 2060 SUPERRTX 2070RTX 2070 SUPERRTX 2080RTX 2080 SUPERRTX 2080 TiTITAN RTXRTX 3060 TIRTX 30803691215SE +/- 0.001, N = 3SE +/- 0.010, N = 3SE +/- 0.017, N = 3SE +/- 0.003, N = 3SE +/- 0.019, N = 3SE +/- 0.022, N = 3SE +/- 0.007, N = 3SE +/- 0.005, N = 3SE +/- 0.000, N = 3SE +/- 0.020, N = 312.56510.45410.2258.2247.6206.7496.0145.6918.3284.8691. (CXX) g++ options: -O3 -lOpenCL

ViennaCL

OpenCL LU Factorization

OpenBenchmarking.orgGFLOPS, More Is BetterViennaCL 1.4.2OpenCL LU FactorizationRTX 2060RTX 2060 SUPERRTX 2070RTX 2070 SUPERRTX 2080RTX 2080 SUPERRTX 2080 TiTITAN RTXRTX 3060 TIRTX 308020406080100SE +/- 0.20, N = 3SE +/- 0.40, N = 3SE +/- 0.18, N = 3SE +/- 0.40, N = 3SE +/- 0.16, N = 3SE +/- 0.12, N = 3SE +/- 0.20, N = 3SE +/- 0.19, N = 3SE +/- 0.09, N = 3SE +/- 0.10, N = 374.5174.0974.1875.8077.1776.6978.3281.3275.7979.321. (CXX) g++ options: -rdynamic -lOpenCL

cl-mem

Benchmark: Copy

OpenBenchmarking.orgGB/s, More Is Bettercl-mem 2017-01-13Benchmark: CopyRTX 2060RTX 2060 SUPERRTX 2070RTX 2070 SUPERRTX 2080RTX 2080 SUPERRTX 2080 TiTITAN RTXRTX 3060 TIRTX 308080160240320400SE +/- 0.03, N = 3SE +/- 0.06, N = 3SE +/- 0.06, N = 3SE +/- 0.03, N = 3SE +/- 0.03, N = 3SE +/- 0.09, N = 3SE +/- 0.15, N = 3SE +/- 0.03, N = 3SE +/- 0.21, N = 3SE +/- 0.03, N = 3239.5288.3285.7292.3290.5302.0324.0320.8294.1354.71. (CC) gcc options: -O2 -flto -lOpenCL

cl-mem

Benchmark: Read

OpenBenchmarking.orgGB/s, More Is Bettercl-mem 2017-01-13Benchmark: ReadRTX 2060RTX 2060 SUPERRTX 2070RTX 2070 SUPERRTX 2080RTX 2080 SUPERRTX 2080 TiTITAN RTXRTX 3060 TIRTX 3080150300450600750SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.03, N = 3SE +/- 0.03, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.17, N = 3SE +/- 0.06, N = 3SE +/- 0.44, N = 3SE +/- 0.06, N = 3297.5397.1397.1397.1397.1437.8545.6568.2392.8674.21. (CC) gcc options: -O2 -flto -lOpenCL

cl-mem

Benchmark: Write

OpenBenchmarking.orgGB/s, More Is Bettercl-mem 2017-01-13Benchmark: WriteRTX 2060RTX 2060 SUPERRTX 2070RTX 2070 SUPERRTX 2080RTX 2080 SUPERRTX 2080 TiTITAN RTXRTX 3060 TIRTX 3080140280420560700SE +/- 0.12, N = 3SE +/- 0.20, N = 3SE +/- 0.13, N = 3SE +/- 0.23, N = 3SE +/- 0.79, N = 3SE +/- 0.17, N = 3SE +/- 0.38, N = 3SE +/- 1.30, N = 3SE +/- 0.19, N = 3SE +/- 0.03, N = 3251.6340.1323.9320.6331.9350.8446.6495.4384.3645.31. (CC) gcc options: -O2 -flto -lOpenCL

Betsy GPU Compressor

Codec: ETC1 - Quality: Highest

OpenBenchmarking.orgSeconds, Fewer Is BetterBetsy GPU Compressor 1.1 BetaCodec: ETC1 - Quality: HighestRTX 2060RTX 2060 SUPERRTX 2070RTX 2070 SUPERRTX 2080RTX 2080 SUPERRTX 2080 TiTITAN RTXRTX 3060 TIRTX 3080246810SE +/- 0.054, N = 13SE +/- 0.052, N = 13SE +/- 0.052, N = 13SE +/- 0.054, N = 13SE +/- 0.048, N = 14SE +/- 0.060, N = 14SE +/- 0.049, N = 14SE +/- 0.051, N = 14SE +/- 0.051, N = 14SE +/- 0.052, N = 146.1895.4515.3094.8244.3754.0043.1773.0434.3582.7011. (CXX) g++ options: -O3 -O2 -lpthread -ldl

Betsy GPU Compressor

Codec: ETC2 RGB - Quality: Highest

OpenBenchmarking.orgSeconds, Fewer Is BetterBetsy GPU Compressor 1.1 BetaCodec: ETC2 RGB - Quality: HighestRTX 2060RTX 2060 SUPERRTX 2070RTX 2070 SUPERRTX 2080RTX 2080 SUPERTITAN RTXRTX 3060 TIRTX 3080246810SE +/- 0.084, N = 9SE +/- 0.060, N = 13SE +/- 0.064, N = 12SE +/- 0.053, N = 15SE +/- 0.064, N = 12SE +/- 0.057, N = 14SE +/- 0.058, N = 13SE +/- 0.066, N = 13SE +/- 0.063, N = 138.7487.7337.6466.6536.1535.5074.1166.0403.6641. (CXX) g++ options: -O3 -O2 -lpthread -ldl

VkResample

Upscale: 2x - Precision: Double

OpenBenchmarking.orgms, Fewer Is BetterVkResample 1.0Upscale: 2x - Precision: DoubleRTX 2060RTX 2060 SUPERRTX 2070RTX 2070 SUPERRTX 2080RTX 2080 SUPERRTX 2080 TiTITAN RTXRTX 3060 TIRTX 308080160240320400SE +/- 0.05, N = 3SE +/- 0.28, N = 3SE +/- 0.78, N = 3SE +/- 0.26, N = 3SE +/- 0.63, N = 3SE +/- 0.01, N = 3SE +/- 0.12, N = 3SE +/- 0.10, N = 3SE +/- 0.88, N = 3SE +/- 0.30, N = 3350.96309.62302.85261.97235.51216.54152.85149.20264.87148.281. (CXX) g++ options: -O3 -pthread

VkResample

Upscale: 2x - Precision: Single

OpenBenchmarking.orgms, Fewer Is BetterVkResample 1.0Upscale: 2x - Precision: SingleRTX 2060RTX 2060 SUPERRTX 2070RTX 2070 SUPERRTX 2080RTX 2080 SUPERRTX 2080 TiTITAN RTXRTX 3060 TIRTX 3080612182430SE +/- 0.05, N = 3SE +/- 0.03, N = 3SE +/- 0.03, N = 3SE +/- 0.00, N = 3SE +/- 0.01, N = 3SE +/- 0.02, N = 3SE +/- 0.04, N = 3SE +/- 0.03, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 327.2022.2822.2719.5219.0217.5114.7713.5617.6811.221. (CXX) g++ options: -O3 -pthread

OctaneBench

Total Score

OpenBenchmarking.orgScore, More Is BetterOctaneBench 2020.1Total ScoreRTX 2060RTX 2060 SUPERRTX 2070RTX 2070 SUPERRTX 2080RTX 2080 SUPERRTX 2080 TiTITAN RTXRTX 3060 TIRTX 3080120240360480600195.01244.22243.26264.53261.33268.11354.86383.46383.42565.10

RedShift Demo

OpenBenchmarking.orgSeconds, Fewer Is BetterRedShift Demo 3.0RTX 2060RTX 2060 SUPERRTX 2070RTX 2070 SUPERRTX 2080RTX 2080 SUPERRTX 2080 TiTITAN RTXRTX 3060 TIRTX 3080100200300400500SE +/- 0.88, N = 3SE +/- 1.00, N = 3SE +/- 0.88, N = 3SE +/- 0.33, N = 3SE +/- 1.33, N = 3SE +/- 0.67, N = 3SE +/- 0.58, N = 3SE +/- 0.67, N = 3SE +/- 0.67, N = 3SE +/- 0.67, N = 3469378375351341325246235239165

LuxCoreRender OpenCL

Scene: DLSC

OpenBenchmarking.orgM samples/sec, More Is BetterLuxCoreRender OpenCL 2.3Scene: DLSCRTX 2060RTX 2060 SUPERRTX 2070RTX 2070 SUPERRTX 2080RTX 2080 SUPERRTX 2080 TiTITAN RTXRTX 3060 TIRTX 30803691215SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.01, N = 3SE +/- 0.06, N = 12SE +/- 0.01, N = 3SE +/- 0.00, N = 3SE +/- 0.08, N = 12SE +/- 0.01, N = 3SE +/- 0.10, N = 12SE +/- 0.14, N = 123.304.194.144.324.234.325.535.957.139.60MIN: 3.16 / MAX: 3.4MIN: 4.11 / MAX: 4.29MIN: 3.79 / MAX: 4.28MIN: 1.6 / MAX: 4.51MIN: 4.15 / MAX: 4.3MIN: 4.13 / MAX: 4.4MIN: 2.02 / MAX: 5.76MIN: 5.62 / MAX: 6.04MIN: 2.58 / MAX: 7.38MIN: 3.45 / MAX: 9.87

LuxCoreRender OpenCL

Scene: Food

OpenBenchmarking.orgM samples/sec, More Is BetterLuxCoreRender OpenCL 2.3Scene: FoodRTX 2060RTX 2060 SUPERRTX 2070RTX 2070 SUPERRTX 2080RTX 2080 SUPERRTX 2080 TiTITAN RTXRTX 3060 TIRTX 30800.91.82.73.64.5SE +/- 0.02, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.04, N = 12SE +/- 0.03, N = 4SE +/- 0.01, N = 3SE +/- 0.04, N = 12SE +/- 0.03, N = 5SE +/- 0.05, N = 12SE +/- 0.07, N = 141.211.321.301.861.881.972.182.232.974.00MIN: 0.24 / MAX: 1.44MIN: 0.23 / MAX: 1.59MIN: 0.23 / MAX: 1.55MIN: 0.18 / MAX: 2.3MIN: 0.23 / MAX: 2.29MIN: 0.27 / MAX: 2.37MIN: 0.15 / MAX: 2.71MIN: 0.23 / MAX: 2.76MIN: 0.19 / MAX: 3.74MIN: 0.17 / MAX: 5.07

LuxCoreRender OpenCL

Scene: LuxCore Benchmark

OpenBenchmarking.orgM samples/sec, More Is BetterLuxCoreRender OpenCL 2.3Scene: LuxCore BenchmarkRTX 2060RTX 2060 SUPERRTX 2070RTX 2070 SUPERRTX 2080RTX 2080 SUPERRTX 2080 TiTITAN RTXRTX 3060 TIRTX 3080246810SE +/- 0.01, N = 3SE +/- 0.00, N = 3SE +/- 0.01, N = 3SE +/- 0.05, N = 12SE +/- 0.02, N = 3SE +/- 0.03, N = 3SE +/- 0.04, N = 13SE +/- 0.02, N = 3SE +/- 0.07, N = 12SE +/- 0.10, N = 122.803.633.563.673.553.604.585.035.917.84MIN: 0.23 / MAX: 3.2MIN: 0.23 / MAX: 4.15MIN: 0.23 / MAX: 4.1MIN: 0.2 / MAX: 4.25MIN: 0.23 / MAX: 4.07MIN: 0.27 / MAX: 4.14MIN: 0.19 / MAX: 5.4MIN: 0.32 / MAX: 5.72MIN: 0.25 / MAX: 6.86MIN: 0.15 / MAX: 9.17

LuxCoreRender OpenCL

Scene: Rainbow Colors and Prism

OpenBenchmarking.orgM samples/sec, More Is BetterLuxCoreRender OpenCL 2.3Scene: Rainbow Colors and PrismRTX 2060RTX 2060 SUPERRTX 2070RTX 2070 SUPERRTX 2080RTX 2080 SUPERRTX 2080 TiTITAN RTXRTX 3060 TIRTX 3080510152025SE +/- 0.00, N = 3SE +/- 0.01, N = 3SE +/- 0.02, N = 3SE +/- 0.20, N = 12SE +/- 0.01, N = 3SE +/- 0.02, N = 3SE +/- 0.27, N = 12SE +/- 0.02, N = 3SE +/- 0.48, N = 12SE +/- 0.65, N = 127.9811.4110.9410.049.279.1912.1413.5617.1121.91MIN: 7.02 / MAX: 8.25MIN: 9.87 / MAX: 11.85MIN: 9.85 / MAX: 11.46MIN: 5.24 / MAX: 10.68MIN: 8.34 / MAX: 9.64MIN: 7.68 / MAX: 9.63MIN: 6.39 / MAX: 12.87MIN: 12.87 / MAX: 14.06MIN: 8.56 / MAX: 18.35MIN: 12.02 / MAX: 23.73

FAHBench

OpenBenchmarking.orgNs Per Day, More Is BetterFAHBench 2.3.2RTX 2060RTX 2060 SUPERRTX 2070RTX 2070 SUPERRTX 2080RTX 2080 SUPERRTX 2080 TiTITAN RTXRTX 3060 TIRTX 308070140210280350SE +/- 0.18, N = 3SE +/- 0.17, N = 3SE +/- 0.10, N = 3SE +/- 0.16, N = 3SE +/- 0.18, N = 3SE +/- 0.20, N = 3SE +/- 0.05, N = 3SE +/- 0.07, N = 3SE +/- 0.14, N = 3SE +/- 0.30, N = 3183.29207.08205.23229.76244.42260.90304.04307.03235.72320.66

LeelaChessZero

Backend: OpenCL

OpenBenchmarking.orgNodes Per Second, More Is BetterLeelaChessZero 0.26Backend: OpenCLRTX 2060RTX 2060 SUPERRTX 2070RTX 2070 SUPERRTX 2080RTX 2080 SUPERRTX 2080 TiTITAN RTXRTX 3060 TIRTX 30804K8K12K16K20KSE +/- 66.84, N = 3SE +/- 69.95, N = 3SE +/- 54.87, N = 3SE +/- 49.97, N = 3SE +/- 51.64, N = 3SE +/- 48.26, N = 3SE +/- 54.85, N = 3SE +/- 110.73, N = 3SE +/- 26.30, N = 3SE +/- 122.65, N = 397521139911495128411357614634169521700916799186681. (CXX) g++ options: -flto -pthread

Rodinia

Test: OpenCL Particle Filter

OpenBenchmarking.orgSeconds, Fewer Is BetterRodinia 3.1Test: OpenCL Particle FilterRTX 2060RTX 2060 SUPERRTX 2070RTX 2070 SUPERRTX 2080RTX 2080 SUPERRTX 2080 TiTITAN RTXRTX 3060 TIRTX 30803691215SE +/- 0.009, N = 3SE +/- 0.027, N = 3SE +/- 0.017, N = 3SE +/- 0.014, N = 3SE +/- 0.006, N = 3SE +/- 0.010, N = 3SE +/- 0.076, N = 3SE +/- 0.016, N = 3SE +/- 0.067, N = 3SE +/- 0.018, N = 38.9607.9817.8586.9006.2885.8094.5074.2967.0404.2901. (CXX) g++ options: -O2 -lOpenCL

ArrayFire

Test: Conjugate Gradient OpenCL

OpenBenchmarking.orgms, Fewer Is BetterArrayFire 3.7Test: Conjugate Gradient OpenCLRTX 2060RTX 2060 SUPERRTX 2070RTX 2070 SUPERRTX 2080RTX 2080 SUPERRTX 2080 TiTITAN RTXRTX 3060 TIRTX 30800.59631.19261.78892.38522.9815SE +/- 0.003, N = 3SE +/- 0.002, N = 3SE +/- 0.002, N = 3SE +/- 0.001, N = 3SE +/- 0.003, N = 3SE +/- 0.001, N = 3SE +/- 0.010, N = 3SE +/- 0.010, N = 3SE +/- 0.002, N = 3SE +/- 0.004, N = 32.6502.0732.0862.0602.0721.8931.6701.6372.0921.5571. (CXX) g++ options: -rdynamic

NCNN

Target: Vulkan GPU - Model: mobilenet

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: Vulkan GPU - Model: mobilenetRTX 2060RTX 2060 SUPERRTX 2070RTX 2070 SUPERRTX 2080RTX 2080 SUPERRTX 2080 TiTITAN RTXRTX 3060 TIRTX 30803691215SE +/- 0.14, N = 3SE +/- 0.17, N = 4SE +/- 0.17, N = 3SE +/- 0.14, N = 15SE +/- 0.16, N = 5SE +/- 0.11, N = 3SE +/- 0.18, N = 3SE +/- 0.16, N = 3SE +/- 0.17, N = 4SE +/- 0.12, N = 312.4213.0412.6612.7712.6912.7212.6412.7712.5412.78MIN: 11.98 / MAX: 24.63MIN: 12.34 / MAX: 24MIN: 12.23 / MAX: 24.28MIN: 11.98 / MAX: 34.45MIN: 11.97 / MAX: 24.76MIN: 12.26 / MAX: 13.5MIN: 12.22 / MAX: 14.36MIN: 12.01 / MAX: 24.52MIN: 11.94 / MAX: 15.69MIN: 12.35 / MAX: 20.471. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: Vulkan GPU-v2-v2 - Model: mobilenet-v2

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: Vulkan GPU-v2-v2 - Model: mobilenet-v2RTX 2060RTX 2060 SUPERRTX 2070RTX 2070 SUPERRTX 2080RTX 2080 SUPERRTX 2080 TiTITAN RTXRTX 3060 TIRTX 30801.06652.1333.19954.2665.3325SE +/- 0.03, N = 3SE +/- 0.07, N = 4SE +/- 0.02, N = 3SE +/- 0.07, N = 15SE +/- 0.04, N = 5SE +/- 0.23, N = 3SE +/- 0.21, N = 3SE +/- 0.02, N = 3SE +/- 0.05, N = 4SE +/- 0.05, N = 34.444.674.604.644.504.654.744.494.544.56MIN: 4.21 / MAX: 4.75MIN: 4.31 / MAX: 5.1MIN: 4.35 / MAX: 13.48MIN: 4.23 / MAX: 5.42MIN: 4.19 / MAX: 13.41MIN: 4.19 / MAX: 5.42MIN: 4.31 / MAX: 5.6MIN: 4.26 / MAX: 4.85MIN: 4.25 / MAX: 5.73MIN: 4.3 / MAX: 4.851. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: Vulkan GPU-v3-v3 - Model: mobilenet-v3

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: Vulkan GPU-v3-v3 - Model: mobilenet-v3RTX 2060RTX 2060 SUPERRTX 2070RTX 2070 SUPERRTX 2080RTX 2080 SUPERRTX 2080 TiTITAN RTXRTX 3060 TIRTX 30800.99681.99362.99043.98724.984SE +/- 0.03, N = 3SE +/- 0.08, N = 4SE +/- 0.01, N = 3SE +/- 0.04, N = 15SE +/- 0.05, N = 5SE +/- 0.10, N = 3SE +/- 0.11, N = 3SE +/- 0.00, N = 3SE +/- 0.06, N = 4SE +/- 0.09, N = 34.154.344.194.304.254.304.434.204.254.34MIN: 4.06 / MAX: 4.44MIN: 4.12 / MAX: 4.79MIN: 4.14 / MAX: 4.4MIN: 4.06 / MAX: 19.54MIN: 4.07 / MAX: 4.62MIN: 4.12 / MAX: 4.69MIN: 4.13 / MAX: 11.06MIN: 4.14 / MAX: 4.93MIN: 4.02 / MAX: 5.79MIN: 4.17 / MAX: 4.731. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: Vulkan GPU - Model: shufflenet-v2

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: Vulkan GPU - Model: shufflenet-v2RTX 2060RTX 2060 SUPERRTX 2070RTX 2070 SUPERRTX 2080RTX 2080 SUPERRTX 2080 TiTITAN RTXRTX 3060 TIRTX 30801.0172.0343.0514.0685.085SE +/- 0.02, N = 3SE +/- 0.01, N = 4SE +/- 0.03, N = 3SE +/- 0.01, N = 13SE +/- 0.01, N = 5SE +/- 0.07, N = 3SE +/- 0.02, N = 3SE +/- 0.03, N = 3SE +/- 0.03, N = 3SE +/- 0.02, N = 34.424.474.454.464.484.504.484.434.474.52MIN: 4.31 / MAX: 4.8MIN: 4.37 / MAX: 4.78MIN: 4.34 / MAX: 4.91MIN: 4.31 / MAX: 4.82MIN: 4.36 / MAX: 14.35MIN: 4.35 / MAX: 5.04MIN: 4.38 / MAX: 4.9MIN: 4.32 / MAX: 5.06MIN: 4.34 / MAX: 5.99MIN: 4.42 / MAX: 13.631. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: Vulkan GPU - Model: mnasnet

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: Vulkan GPU - Model: mnasnetRTX 2060RTX 2060 SUPERRTX 2070RTX 2070 SUPERRTX 2080RTX 2080 SUPERRTX 2080 TiTITAN RTXRTX 3060 TIRTX 30801.0262.0523.0784.1045.13SE +/- 0.04, N = 3SE +/- 0.10, N = 3SE +/- 0.05, N = 3SE +/- 0.07, N = 15SE +/- 0.06, N = 5SE +/- 0.21, N = 3SE +/- 0.26, N = 3SE +/- 0.02, N = 3SE +/- 0.06, N = 4SE +/- 0.13, N = 34.014.334.154.224.104.214.564.024.114.20MIN: 3.83 / MAX: 4.42MIN: 4.04 / MAX: 4.77MIN: 4 / MAX: 16.56MIN: 3.86 / MAX: 5.14MIN: 3.82 / MAX: 4.59MIN: 3.86 / MAX: 4.92MIN: 3.93 / MAX: 5.1MIN: 3.88 / MAX: 4.28MIN: 3.87 / MAX: 5.49MIN: 3.91 / MAX: 10.981. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: Vulkan GPU - Model: efficientnet-b0

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: Vulkan GPU - Model: efficientnet-b0RTX 2060RTX 2060 SUPERRTX 2070RTX 2070 SUPERRTX 2080RTX 2080 SUPERRTX 2080 TiTITAN RTXRTX 3060 TIRTX 3080246810SE +/- 0.03, N = 3SE +/- 0.06, N = 4SE +/- 0.02, N = 3SE +/- 0.06, N = 15SE +/- 0.04, N = 5SE +/- 0.21, N = 3SE +/- 0.26, N = 3SE +/- 0.57, N = 3SE +/- 0.05, N = 4SE +/- 0.06, N = 35.485.705.595.605.565.686.026.035.555.61MIN: 5.32 / MAX: 5.98MIN: 5.43 / MAX: 17.45MIN: 5.42 / MAX: 5.85MIN: 5.28 / MAX: 16.37MIN: 5.37 / MAX: 6.08MIN: 5.29 / MAX: 17.94MIN: 5.37 / MAX: 11.96MIN: 5.28 / MAX: 339.41MIN: 5.34 / MAX: 7.32MIN: 5.45 / MAX: 5.871. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: Vulkan GPU - Model: blazeface

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: Vulkan GPU - Model: blazefaceRTX 2060RTX 2060 SUPERRTX 2070RTX 2070 SUPERRTX 2080RTX 2080 SUPERRTX 2080 TiTITAN RTXRTX 3060 TIRTX 30800.43880.87761.31641.75522.194SE +/- 0.03, N = 3SE +/- 0.03, N = 4SE +/- 0.05, N = 3SE +/- 0.02, N = 15SE +/- 0.02, N = 5SE +/- 0.07, N = 3SE +/- 0.04, N = 3SE +/- 0.02, N = 3SE +/- 0.02, N = 4SE +/- 0.04, N = 31.801.931.871.881.861.881.951.831.861.91MIN: 1.79 / MAX: 1.96MIN: 1.85 / MAX: 2.11MIN: 1.8 / MAX: 2.15MIN: 1.78 / MAX: 2.2MIN: 1.81 / MAX: 2.28MIN: 1.77 / MAX: 2.21MIN: 1.85 / MAX: 2.39MIN: 1.78 / MAX: 2.03MIN: 1.78 / MAX: 2.03MIN: 1.82 / MAX: 2.141. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: Vulkan GPU - Model: googlenet

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: Vulkan GPU - Model: googlenetRTX 2060RTX 2060 SUPERRTX 2070RTX 2070 SUPERRTX 2080RTX 2080 SUPERRTX 2080 TiTITAN RTXRTX 3060 TIRTX 308048121620SE +/- 0.55, N = 3SE +/- 0.43, N = 4SE +/- 0.27, N = 3SE +/- 0.21, N = 14SE +/- 0.35, N = 5SE +/- 0.39, N = 3SE +/- 0.49, N = 3SE +/- 0.68, N = 2SE +/- 0.33, N = 4SE +/- 0.37, N = 313.4314.1813.6013.4813.5613.1213.9613.3213.4113.95MIN: 12.61 / MAX: 15.67MIN: 12.62 / MAX: 15.92MIN: 12.94 / MAX: 24.05MIN: 12.43 / MAX: 26.89MIN: 12.71 / MAX: 20.62MIN: 12.41 / MAX: 14.53MIN: 12.74 / MAX: 15.74MIN: 12.38 / MAX: 25.82MIN: 12.46 / MAX: 28.14MIN: 12.96 / MAX: 24.071. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: Vulkan GPU - Model: vgg16

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: Vulkan GPU - Model: vgg16RTX 2060RTX 2060 SUPERRTX 2070RTX 2070 SUPERRTX 2080RTX 2080 SUPERRTX 2080 TiTITAN RTXRTX 3060 TIRTX 30801326395265SE +/- 0.31, N = 3SE +/- 0.14, N = 4SE +/- 0.13, N = 3SE +/- 0.13, N = 15SE +/- 0.17, N = 5SE +/- 0.37, N = 3SE +/- 0.27, N = 3SE +/- 0.17, N = 3SE +/- 0.43, N = 4SE +/- 0.09, N = 356.9857.2257.1357.1357.2557.0856.6956.5257.1856.96MIN: 55.41 / MAX: 58.77MIN: 55.71 / MAX: 64.21MIN: 56.01 / MAX: 66.17MIN: 54.93 / MAX: 68.8MIN: 55.82 / MAX: 67.69MIN: 55.71 / MAX: 70.92MIN: 55.51 / MAX: 58.35MIN: 55.22 / MAX: 72.77MIN: 54.93 / MAX: 68.94MIN: 56.04 / MAX: 59.711. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: Vulkan GPU - Model: resnet18

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: Vulkan GPU - Model: resnet18RTX 2060RTX 2060 SUPERRTX 2070RTX 2070 SUPERRTX 2080RTX 2080 SUPERRTX 2080 TiTITAN RTXRTX 3060 TIRTX 308048121620SE +/- 0.26, N = 3SE +/- 0.19, N = 4SE +/- 0.19, N = 3SE +/- 0.07, N = 15SE +/- 0.12, N = 5SE +/- 0.14, N = 3SE +/- 0.19, N = 3SE +/- 0.25, N = 3SE +/- 0.21, N = 4SE +/- 0.25, N = 314.4714.7714.5514.5314.5814.3614.6514.3614.5114.74MIN: 14.01 / MAX: 23.82MIN: 14.08 / MAX: 16.79MIN: 14.18 / MAX: 15.25MIN: 14.06 / MAX: 27.16MIN: 14.21 / MAX: 16.27MIN: 14.01 / MAX: 15.12MIN: 14.13 / MAX: 15.56MIN: 13.96 / MAX: 17.74MIN: 13.97 / MAX: 25.49MIN: 14.13 / MAX: 15.81. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: Vulkan GPU - Model: alexnet

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: Vulkan GPU - Model: alexnetRTX 2060RTX 2060 SUPERRTX 2070RTX 2070 SUPERRTX 2080RTX 2080 SUPERRTX 2080 TiTITAN RTXRTX 3060 TIRTX 30803691215SE +/- 0.22, N = 3SE +/- 0.04, N = 4SE +/- 0.08, N = 3SE +/- 0.06, N = 15SE +/- 0.06, N = 5SE +/- 0.16, N = 3SE +/- 0.04, N = 3SE +/- 0.05, N = 3SE +/- 0.15, N = 4SE +/- 0.12, N = 311.6111.5311.7411.3611.3711.2211.4411.2511.4111.71MIN: 11.08 / MAX: 18.93MIN: 11.27 / MAX: 18.29MIN: 11.39 / MAX: 12.18MIN: 10.75 / MAX: 15.63MIN: 11.04 / MAX: 17.87MIN: 10.85 / MAX: 11.85MIN: 11.09 / MAX: 11.74MIN: 11 / MAX: 11.61MIN: 10.77 / MAX: 22.45MIN: 11.28 / MAX: 12.121. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: Vulkan GPU - Model: resnet50

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: Vulkan GPU - Model: resnet50RTX 2060RTX 2060 SUPERRTX 2070RTX 2070 SUPERRTX 2080RTX 2080 SUPERRTX 2080 TiTITAN RTXRTX 3060 TIRTX 3080612182430SE +/- 0.15, N = 3SE +/- 0.09, N = 4SE +/- 0.54, N = 3SE +/- 0.18, N = 15SE +/- 0.23, N = 5SE +/- 0.40, N = 3SE +/- 0.33, N = 3SE +/- 0.37, N = 3SE +/- 0.35, N = 4SE +/- 0.56, N = 324.5825.7125.0525.2524.6224.7324.6924.9524.6925.34MIN: 23.83 / MAX: 37.73MIN: 24.88 / MAX: 31.53MIN: 24.29 / MAX: 41.55MIN: 23.93 / MAX: 36.67MIN: 23.99 / MAX: 26.48MIN: 23.79 / MAX: 35.29MIN: 23.98 / MAX: 37.45MIN: 23.91 / MAX: 36.02MIN: 23.66 / MAX: 26.48MIN: 24.02 / MAX: 26.961. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: Vulkan GPU - Model: yolov4-tiny

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: Vulkan GPU - Model: yolov4-tinyRTX 2060RTX 2060 SUPERRTX 2070RTX 2070 SUPERRTX 2080RTX 2080 SUPERRTX 2080 TiTITAN RTXRTX 3060 TIRTX 3080510152025SE +/- 0.56, N = 3SE +/- 0.07, N = 4SE +/- 0.58, N = 3SE +/- 0.24, N = 15SE +/- 0.41, N = 5SE +/- 0.60, N = 3SE +/- 0.60, N = 3SE +/- 0.66, N = 3SE +/- 0.64, N = 4SE +/- 0.70, N = 321.4122.8021.4121.7921.8122.1321.4521.8821.3522.15MIN: 20.54 / MAX: 32.23MIN: 22.31 / MAX: 25.04MIN: 20.58 / MAX: 23.53MIN: 20.42 / MAX: 29.15MIN: 20.55 / MAX: 24.56MIN: 20.69 / MAX: 28.53MIN: 20.52 / MAX: 33.08MIN: 20.33 / MAX: 23.41MIN: 20.24 / MAX: 29.48MIN: 20.53 / MAX: 30.781. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: Vulkan GPU - Model: squeezenet_ssd

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: Vulkan GPU - Model: squeezenet_ssdRTX 2060RTX 2060 SUPERRTX 2070RTX 2070 SUPERRTX 2080RTX 2080 SUPERRTX 2080 TiTITAN RTXRTX 3060 TIRTX 308048121620SE +/- 0.05, N = 3SE +/- 0.12, N = 4SE +/- 0.14, N = 2SE +/- 0.06, N = 15SE +/- 0.24, N = 4SE +/- 0.02, N = 3SE +/- 0.03, N = 3SE +/- 0.19, N = 3SE +/- 0.73, N = 4SE +/- 0.09, N = 314.3214.6314.5114.5514.4514.4714.3614.3515.1114.50MIN: 14.04 / MAX: 14.98MIN: 14.15 / MAX: 16.53MIN: 14.12 / MAX: 15.9MIN: 13.96 / MAX: 25.49MIN: 13.6 / MAX: 27.41MIN: 14.11 / MAX: 24.43MIN: 13.91 / MAX: 27.4MIN: 13.84 / MAX: 22.5MIN: 13.72 / MAX: 369.11MIN: 14.11 / MAX: 14.971. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: Vulkan GPU - Model: regnety_400m

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: Vulkan GPU - Model: regnety_400mRTX 2060RTX 2060 SUPERRTX 2070RTX 2070 SUPERRTX 2080RTX 2080 SUPERRTX 2080 TiTITAN RTXRTX 3060 TIRTX 3080510152025SE +/- 0.08, N = 3SE +/- 0.15, N = 4SE +/- 0.06, N = 3SE +/- 0.07, N = 15SE +/- 0.09, N = 5SE +/- 0.19, N = 3SE +/- 0.20, N = 3SE +/- 0.09, N = 3SE +/- 0.28, N = 4SE +/- 0.35, N = 318.2918.4918.6818.5818.7718.6518.3218.2118.5718.45MIN: 17.99 / MAX: 28.28MIN: 18.01 / MAX: 28.46MIN: 18.38 / MAX: 19.17MIN: 17.91 / MAX: 28.99MIN: 18.01 / MAX: 30.34MIN: 18.24 / MAX: 19.54MIN: 17.72 / MAX: 19.14MIN: 17.88 / MAX: 20.03MIN: 17.78 / MAX: 20.78MIN: 17.4 / MAX: 28.561. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

PlaidML

FP16: No - Mode: Training - Network: VGG16 - Device: OpenCL

OpenBenchmarking.orgFPS, More Is BetterPlaidMLFP16: No - Mode: Training - Network: VGG16 - Device: OpenCLRTX 2060RTX 2060 SUPERRTX 2070RTX 2070 SUPERRTX 2080RTX 2080 SUPERRTX 2080 TiTITAN RTXRTX 3060 TIRTX 30801122334455SE +/- 0.20, N = 2SE +/- 0.33, N = 2SE +/- 0.18, N = 2SE +/- 0.36, N = 227.1230.0030.2733.7534.1338.7044.0244.5134.9847.50

PlaidML

FP16: No - Mode: Training - Network: VGG19 - Device: OpenCL

OpenBenchmarking.orgFPS, More Is BetterPlaidMLFP16: No - Mode: Training - Network: VGG19 - Device: OpenCLRTX 2060RTX 2060 SUPERRTX 2070 SUPERRTX 2080RTX 2080 SUPERRTX 2080 TiTITAN RTXRTX 3060 TIRTX 3080918273645SE +/- 0.04, N = 2SE +/- 0.05, N = 2SE +/- 0.15, N = 2SE +/- 0.08, N = 222.0424.5827.7828.3232.2936.9037.5629.3840.88

PlaidML

FP16: No - Mode: Inference - Network: VGG16 - Device: OpenCL

OpenBenchmarking.orgFPS, More Is BetterPlaidMLFP16: No - Mode: Inference - Network: VGG16 - Device: OpenCLRTX 2060RTX 2060 SUPERRTX 2070RTX 2070 SUPERRTX 2080RTX 2080 SUPERRTX 2080 TiTITAN RTXRTX 3060 TIRTX 308060120180240300SE +/- 0.02, N = 3SE +/- 0.06, N = 3SE +/- 0.05, N = 3SE +/- 0.08, N = 3SE +/- 0.18, N = 3SE +/- 0.00, N = 3SE +/- 0.10, N = 3SE +/- 0.10, N = 3SE +/- 0.11, N = 3SE +/- 0.06, N = 3110.96126.76129.65152.58161.88180.23231.73244.00167.73280.31

PlaidML

FP16: No - Mode: Inference - Network: VGG19 - Device: OpenCL

OpenBenchmarking.orgFPS, More Is BetterPlaidMLFP16: No - Mode: Inference - Network: VGG19 - Device: OpenCLRTX 2060RTX 2060 SUPERRTX 2070RTX 2070 SUPERRTX 2080RTX 2080 SUPERRTX 2080 TiTITAN RTXRTX 3060 TIRTX 308050100150200250SE +/- 0.08, N = 3SE +/- 0.08, N = 3SE +/- 0.10, N = 3SE +/- 0.05, N = 3SE +/- 0.27, N = 3SE +/- 0.20, N = 3SE +/- 0.15, N = 3SE +/- 0.14, N = 3SE +/- 0.08, N = 3SE +/- 0.28, N = 388.38100.61103.03121.35128.62143.39185.09194.50133.11223.64

PlaidML

FP16: No - Mode: Inference - Network: IMDB LSTM - Device: OpenCL

OpenBenchmarking.orgFPS, More Is BetterPlaidMLFP16: No - Mode: Inference - Network: IMDB LSTM - Device: OpenCLRTX 2060RTX 2060 SUPERRTX 2070RTX 2070 SUPERRTX 2080RTX 2080 SUPERRTX 2080 TiTITAN RTXRTX 3060 TIRTX 30802004006008001000SE +/- 0.58, N = 3SE +/- 0.53, N = 3SE +/- 1.13, N = 3SE +/- 0.23, N = 3SE +/- 1.14, N = 3SE +/- 0.10, N = 3SE +/- 1.36, N = 3SE +/- 1.34, N = 3SE +/- 0.42, N = 3SE +/- 1.56, N = 3392.02440.36447.47499.43545.48588.04754.69782.29689.611019.79

PlaidML

FP16: No - Mode: Inference - Network: Mobilenet - Device: OpenCL

OpenBenchmarking.orgFPS, More Is BetterPlaidMLFP16: No - Mode: Inference - Network: Mobilenet - Device: OpenCLRTX 2060RTX 2060 SUPERRTX 2070RTX 2070 SUPERRTX 2080RTX 2080 SUPERRTX 2080 TiTITAN RTXRTX 3060 TIRTX 30807001400210028003500SE +/- 1.88, N = 3SE +/- 2.50, N = 3SE +/- 3.57, N = 3SE +/- 3.23, N = 3SE +/- 0.70, N = 3SE +/- 1.68, N = 3SE +/- 4.12, N = 3SE +/- 2.13, N = 3SE +/- 4.77, N = 3SE +/- 8.25, N = 31282.271581.851566.361701.991726.881816.872414.962551.381875.373062.00

PlaidML

FP16: No - Mode: Inference - Network: ResNet 50 - Device: OpenCL

OpenBenchmarking.orgFPS, More Is BetterPlaidMLFP16: No - Mode: Inference - Network: ResNet 50 - Device: OpenCLRTX 2060RTX 2060 SUPERRTX 2070RTX 2070 SUPERRTX 2080RTX 2080 SUPERRTX 2080 TiTITAN RTXRTX 3060 TIRTX 3080160320480640800SE +/- 0.61, N = 3SE +/- 0.68, N = 3SE +/- 0.70, N = 3SE +/- 0.62, N = 3SE +/- 0.34, N = 3SE +/- 0.40, N = 3SE +/- 0.39, N = 3SE +/- 2.07, N = 3SE +/- 0.51, N = 3SE +/- 1.40, N = 3320.95376.59379.70422.86442.78468.60636.84654.76454.66730.76

PlaidML

FP16: Yes - Mode: Inference - Network: Mobilenet - Device: OpenCL

OpenBenchmarking.orgFPS, More Is BetterPlaidMLFP16: Yes - Mode: Inference - Network: Mobilenet - Device: OpenCLRTX 2060RTX 2060 SUPERRTX 2070RTX 2070 SUPERRTX 2080RTX 2080 SUPERRTX 2080 TiTITAN RTXRTX 3060 TIRTX 30808001600240032004000SE +/- 1.92, N = 3SE +/- 2.83, N = 3SE +/- 1.56, N = 3SE +/- 0.32, N = 3SE +/- 3.97, N = 3SE +/- 1.35, N = 3SE +/- 16.01, N = 3SE +/- 16.11, N = 3SE +/- 1.99, N = 3SE +/- 12.23, N = 31720.242011.992004.512300.012333.792489.113316.313392.962428.743623.82

PlaidML

FP16: No - Mode: Inference - Network: DenseNet 201 - Device: OpenCL

OpenBenchmarking.orgFPS, More Is BetterPlaidMLFP16: No - Mode: Inference - Network: DenseNet 201 - Device: OpenCLRTX 2060RTX 2060 SUPERRTX 2070RTX 2070 SUPERRTX 2080RTX 2080 SUPERRTX 2080 TiTITAN RTXRTX 3060 TIRTX 308060120180240300SE +/- 0.07, N = 3SE +/- 0.15, N = 3SE +/- 0.08, N = 3SE +/- 0.07, N = 3SE +/- 0.14, N = 3SE +/- 0.11, N = 3SE +/- 0.07, N = 3SE +/- 0.06, N = 3SE +/- 0.26, N = 3SE +/- 0.01, N = 3125.45147.13148.04149.68152.28160.48213.54228.78177.41261.32

PlaidML

FP16: No - Mode: Inference - Network: Inception V3 - Device: OpenCL

OpenBenchmarking.orgFPS, More Is BetterPlaidMLFP16: No - Mode: Inference - Network: Inception V3 - Device: OpenCLRTX 2060RTX 2060 SUPERRTX 2070RTX 2070 SUPERRTX 2080RTX 2080 SUPERRTX 2080 TiTITAN RTXRTX 3060 TIRTX 308090180270360450SE +/- 0.18, N = 3SE +/- 0.18, N = 3SE +/- 0.28, N = 3SE +/- 0.01, N = 3SE +/- 0.46, N = 3SE +/- 0.03, N = 3SE +/- 0.39, N = 3SE +/- 0.19, N = 3SE +/- 0.67, N = 3SE +/- 0.67, N = 3171.78203.78202.05220.43242.54266.39351.18359.13236.40398.64

PlaidML

FP16: No - Mode: Inference - Network: NASNer Large - Device: OpenCL

OpenBenchmarking.orgFPS, More Is BetterPlaidMLFP16: No - Mode: Inference - Network: NASNer Large - Device: OpenCLRTX 2060RTX 2060 SUPERRTX 2070RTX 2070 SUPERRTX 2080RTX 2080 SUPERRTX 2080 TiTITAN RTXRTX 3060 TIRTX 308020406080100SE +/- 0.03, N = 3SE +/- 0.08, N = 3SE +/- 0.10, N = 3SE +/- 0.04, N = 3SE +/- 0.09, N = 3SE +/- 0.04, N = 3SE +/- 0.14, N = 3SE +/- 0.18, N = 3SE +/- 0.05, N = 3SE +/- 0.12, N = 331.8138.4239.0742.3245.3949.1663.5366.5048.0479.23

Blender

Blend File: BMW27 - Compute: NVIDIA OptiX

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 2.90Blend File: BMW27 - Compute: NVIDIA OptiXRTX 2060RTX 2060 SUPERRTX 2070RTX 2070 SUPERRTX 2080RTX 2080 SUPERRTX 2080 TiTITAN RTXRTX 3060 TIRTX 3080816243240SE +/- 0.01, N = 3SE +/- 0.03, N = 3SE +/- 0.03, N = 3SE +/- 0.00, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 2.49, N = 15SE +/- 0.00, N = 3SE +/- 2.49, N = 15SE +/- 0.01, N = 336.2730.9031.3425.4426.2425.2221.6718.6420.1511.48

Blender

Blend File: Classroom - Compute: NVIDIA OptiX

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 2.90Blend File: Classroom - Compute: NVIDIA OptiXRTX 2060RTX 2060 SUPERRTX 2070RTX 2070 SUPERRTX 2080RTX 2080 SUPERRTX 2080 TiTITAN RTXRTX 3060 TIRTX 3080306090120150SE +/- 0.39, N = 3SE +/- 0.38, N = 3SE +/- 0.95, N = 3SE +/- 0.32, N = 3SE +/- 0.14, N = 3SE +/- 0.11, N = 3SE +/- 0.50, N = 3SE +/- 0.17, N = 3SE +/- 0.23, N = 3SE +/- 0.16, N = 3147.65144.40148.1789.1286.1381.1473.9973.4056.3338.85

Blender

Blend File: Fishy Cat - Compute: NVIDIA OptiX

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 2.90Blend File: Fishy Cat - Compute: NVIDIA OptiXRTX 2060RTX 2060 SUPERRTX 2070RTX 2070 SUPERRTX 2080RTX 2080 SUPERRTX 2080 TiTITAN RTXRTX 3060 TIRTX 30801530456075SE +/- 0.04, N = 3SE +/- 0.02, N = 3SE +/- 0.03, N = 3SE +/- 0.02, N = 3SE +/- 0.03, N = 3SE +/- 0.02, N = 3SE +/- 0.02, N = 3SE +/- 0.02, N = 3SE +/- 0.00, N = 3SE +/- 0.02, N = 367.1358.9458.3448.0345.5142.6032.8031.7236.7421.48

Blender

Blend File: Barbershop - Compute: NVIDIA OptiX

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 2.90Blend File: Barbershop - Compute: NVIDIA OptiXRTX 2060RTX 2060 SUPERRTX 2070RTX 2070 SUPERRTX 2080RTX 2080 SUPERRTX 2080 TiTITAN RTXRTX 3060 TIRTX 3080400800120016002000SE +/- 2.01, N = 3SE +/- 0.52, N = 3SE +/- 2.84, N = 3SE +/- 1.90, N = 3SE +/- 0.81, N = 3SE +/- 0.14, N = 3SE +/- 1.58, N = 3SE +/- 1.56, N = 3SE +/- 0.84, N = 3SE +/- 1.49, N = 31779.461758.171826.30996.82971.62911.32899.14905.22565.99421.51

Blender

Blend File: Pabellon Barcelona - Compute: NVIDIA OptiX

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 2.90Blend File: Pabellon Barcelona - Compute: NVIDIA OptiXRTX 2060RTX 2060 SUPERRTX 2070RTX 2070 SUPERRTX 2080RTX 2080 SUPERRTX 2080 TiTITAN RTXRTX 3060 TIRTX 308050100150200250SE +/- 0.04, N = 3SE +/- 0.26, N = 3SE +/- 0.06, N = 3SE +/- 0.07, N = 3SE +/- 0.01, N = 3SE +/- 0.00, N = 3SE +/- 0.10, N = 3SE +/- 0.08, N = 3SE +/- 0.08, N = 3SE +/- 0.04, N = 3206.86194.41198.63132.73132.90126.93103.97102.5184.9555.63

MandelGPU

OpenCL Device: GPU

OpenBenchmarking.orgSamples/sec, More Is BetterMandelGPU 1.3pts1OpenCL Device: GPURTX 2060RTX 2060 SUPERRTX 2070RTX 2070 SUPERRTX 2080RTX 2080 SUPERRTX 2080 TiTITAN RTXRTX 3060 TIRTX 3080100M200M300M400M500MSE +/- 1171800.01, N = 3SE +/- 1645708.79, N = 3SE +/- 776602.98, N = 3SE +/- 516930.54, N = 3SE +/- 1494897.42, N = 3SE +/- 774665.97, N = 3SE +/- 590928.34, N = 3SE +/- 2487384.16, N = 3SE +/- 805777.35, N = 3SE +/- 2886689.51, N = 3253858256.7278640038.1283803060.1321637774.3343080891.1368037096.6447272306.0460475602.6280941400.2421918457.51. (CC) gcc options: -O3 -lm -ftree-vectorize -funroll-loops -lglut -lOpenCL -lGL

clpeak

OpenCL Test: Integer Compute INT

OpenBenchmarking.orgGIOPS, More Is BetterclpeakOpenCL Test: Integer Compute INTRTX 2060RTX 2060 SUPERRTX 2070RTX 2070 SUPERRTX 2080RTX 2080 SUPERRTX 2080 TiTITAN RTXRTX 3060 TIRTX 30803K6K9K12K15KSE +/- 4.93, N = 3SE +/- 78.58, N = 15SE +/- 85.50, N = 15SE +/- 72.96, N = 15SE +/- 43.62, N = 3SE +/- 165.30, N = 3SE +/- 138.31, N = 15SE +/- 135.03, N = 15SE +/- 74.13, N = 15SE +/- 232.90, N = 35224.686956.557094.248551.579330.8310244.0813432.8913791.918365.8515586.031. (CXX) g++ options: -O3 -rdynamic -lOpenCL

clpeak

OpenCL Test: Single-Precision Float

OpenBenchmarking.orgGFLOPS, More Is BetterclpeakOpenCL Test: Single-Precision FloatRTX 2060RTX 2060 SUPERRTX 2070RTX 2070 SUPERRTX 2080RTX 2080 SUPERRTX 2080 TiTITAN RTXRTX 3060 TIRTX 30806K12K18K24K30KSE +/- 56.79, N = 15SE +/- 75.69, N = 15SE +/- 90.04, N = 15SE +/- 84.78, N = 15SE +/- 6.84, N = 3SE +/- 174.06, N = 3SE +/- 138.31, N = 3SE +/- 193.76, N = 15SE +/- 0.44, N = 3SE +/- 0.32, N = 35369.816985.027190.538591.778860.5510347.9212677.1814109.6816033.6429490.811. (CXX) g++ options: -O3 -rdynamic -lOpenCL

clpeak

OpenCL Test: Double-Precision Double

OpenBenchmarking.orgGFLOPS, More Is BetterclpeakOpenCL Test: Double-Precision DoubleRTX 2060RTX 2060 SUPERRTX 2070RTX 2070 SUPERRTX 2080RTX 2080 SUPERRTX 2080 TiTITAN RTXRTX 3060 TIRTX 3080120240360480600SE +/- 0.61, N = 3SE +/- 0.69, N = 3SE +/- 0.77, N = 3SE +/- 0.01, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 1.36, N = 3SE +/- 1.44, N = 3SE +/- 0.89, N = 3SE +/- 0.00, N = 3231.27261.53268.18309.27344.68373.96519.03545.22306.12545.911. (CXX) g++ options: -O3 -rdynamic -lOpenCL

clpeak

OpenCL Test: Global Memory Bandwidth

OpenBenchmarking.orgGBPS, More Is BetterclpeakOpenCL Test: Global Memory BandwidthRTX 2060RTX 2060 SUPERRTX 2070RTX 2070 SUPERRTX 2080RTX 2080 SUPERRTX 2080 TiTITAN RTXRTX 3060 TIRTX 3080140280420560700SE +/- 0.14, N = 3SE +/- 0.41, N = 3SE +/- 0.01, N = 3SE +/- 0.21, N = 3SE +/- 0.04, N = 3SE +/- 0.18, N = 3SE +/- 0.66, N = 3SE +/- 0.01, N = 3SE +/- 0.04, N = 3SE +/- 0.02, N = 3277.40369.42369.14370.17369.65405.68508.00530.48389.18662.241. (CXX) g++ options: -O3 -rdynamic -lOpenCL

Phoronix Test Suite v10.8.4