NVIDIA Compute Tests

Benchmarks for a future article.

HTML result view exported from: https://openbenchmarking.org/result/2011301-HA-NC792657606&sro&grt.

NVIDIA Compute TestsProcessorMotherboardChipsetMemoryDiskGraphicsAudioMonitorNetworkOSKernelDesktopDisplay ServerDisplay DriverOpenGLOpenCLVulkanCompilerFile-SystemScreen ResolutionGTX 1060GTX 1660 SUPERGTX 1660 TiRTX 2060RTX 2060 SUPERRTX 2070RTX 2070 SUPERRTX 2080RTX 2080 SUPERRTX 2080 TiTITAN RTXRTX 3060 TiRTX 3080AMD Ryzen 9 5950X 16-Core @ 3.40GHz (16 Cores / 32 Threads)ASUS ROG CROSSHAIR VIII HERO (WI-FI) (2311 BIOS)AMD Starship/Matisse16GB2000GB Corsair Force MP600 + 2000GBNVIDIA GeForce GTX 1060 6GB (1506/4006MHz)NVIDIA GP106 HD AudioASUS MG28URealtek RTL8125 2.5GbE + Intel I211 + Intel Wi-Fi 6 AX200Ubuntu 20.045.4.0-54-generic (x86_64)GNOME Shell 3.36.4X Server 1.20.8NVIDIA 455.45.014.6.0OpenCL 1.2 CUDA 11.1.1141.2.142GCC 9.3.0ext43840x2160eVGA NVIDIA GeForce GTX 1660 SUPER 6GB (1530/7000MHz)NVIDIA TU116 HD AudioeVGA NVIDIA GeForce GTX 1660 Ti 6GB (1500/6000MHz)NVIDIA GeForce RTX 2060 6GB (1365/7000MHz)NVIDIA TU106 HD AudioNVIDIA GeForce RTX 2060 SUPER 8GB (1470/7000MHz)ASUS NVIDIA GeForce RTX 2070 8GB (1410/7000MHz)NVIDIA GeForce RTX 2070 SUPER 8GB (1605/7000MHz)NVIDIA TU104 HD AudioZotac NVIDIA GeForce RTX 2080 8GB (1515/7000MHz)NVIDIA GeForce RTX 2080 SUPER 8GB (1650/7750MHz)NVIDIA GeForce RTX 2080 Ti 11GB (1350/7000MHz)NVIDIA TU102 HD AudioNVIDIA TITAN RTX 24GB (555/810MHz)NVIDIA GeForce RTX 3060 Ti 8GB (1665/7000MHz)NVIDIA Device 228bNVIDIA GeForce RTX 3080 10GB (1710/9501MHz)NVIDIA Device 1aefOpenBenchmarking.orgCompiler Details- --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++,gm2 --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none=/build/gcc-9-HskZEa/gcc-9-9.3.0/debian/tmp-nvptx/usr,hsa --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v Processor Details- Scaling Governor: acpi-cpufreq performance - CPU Microcode: 0xa201009OpenCL Details- GTX 1060: GPU Compute Cores: 1280- GTX 1660 SUPER: GPU Compute Cores: 1408- GTX 1660 Ti: GPU Compute Cores: 1536- RTX 2060: GPU Compute Cores: 1920- RTX 2060 SUPER: GPU Compute Cores: 2176- RTX 2070: GPU Compute Cores: 2304- RTX 2070 SUPER: GPU Compute Cores: 2560- RTX 2080: GPU Compute Cores: 2944- RTX 2080 SUPER: GPU Compute Cores: 3072- RTX 2080 Ti: GPU Compute Cores: 4352- TITAN RTX: GPU Compute Cores: 4608- RTX 3060 Ti: GPU Compute Cores: 4864- RTX 3080: GPU Compute Cores: 8704Python Details- Python 2.7.18 + Python 3.8.5Security Details- itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Full AMD retpoline IBPB: conditional IBRS_FW STIBP: always-on RSB filling + srbds: Not affected + tsx_async_abort: Not affected

NVIDIA Compute Testsarrayfire: Conjugate Gradient OpenCLblender: BMW27 - NVIDIA OptiXblender: Classroom - NVIDIA OptiXblender: Fishy Cat - NVIDIA OptiXblender: Pabellon Barcelona - NVIDIA OptiXblender: Barbershop - NVIDIA OptiXcl-mem: Readcl-mem: Writecl-mem: Copyclpeak: Global Memory Bandwidthclpeak: Single-Precision Floatclpeak: Double-Precision Doubleclpeak: Integer Compute INTfahbench: financebench: Black-Scholes OpenCLgeekbench: GPU OpenCLgeekbench: GPU NVIDIA CUDAgeekbench: GPU Vulkanhashcat: MD5hashcat: SHA1hashcat: SHA-512hashcat: 7-Ziphashcat: TrueCrypt RIPEMD160 + XTSindigobench: OpenCL GPU - Supercarindigobench: OpenCL GPU - Bedroomlczero: OpenCLluxcorerender-cl: LuxCore Benchmarkluxcorerender-cl: DLSCluxcorerender-cl: Rainbow Colors and Prismluxcorerender-cl: Foodmandelgpu: GPUncnn: Vulkan GPU - squeezenetncnn: Vulkan GPU - mobilenetncnn: Vulkan GPU-v2-v2 - mobilenet-v2ncnn: Vulkan GPU-v3-v3 - mobilenet-v3ncnn: Vulkan GPU - shufflenet-v2ncnn: Vulkan GPU - mnasnetncnn: Vulkan GPU - efficientnet-b0ncnn: Vulkan GPU - blazefacencnn: Vulkan GPU - googlenetncnn: Vulkan GPU - vgg16ncnn: Vulkan GPU - resnet18ncnn: Vulkan GPU - alexnetncnn: Vulkan GPU - resnet50ncnn: Vulkan GPU - yolov4-tinyoctanebench: Total Scoreplaidml: Yes - Inference - Mobilenet - OpenCLplaidml: No - Inference - Mobilenet - OpenCLplaidml: No - Inference - DenseNet 201 - OpenCLplaidml: No - Inference - IMDB LSTM - OpenCLrealsr-ncnn: 4x - Yesrealsr-ncnn: 4x - Noredshift: rodinia: OpenCL Particle Filterviennacl: OpenCL LU Factorizationvkfft: waifu2x-ncnn: 2x - 3 - YesGTX 1060GTX 1660 SUPERGTX 1660 TiRTX 2060RTX 2060 SUPERRTX 2070RTX 2070 SUPERRTX 2080RTX 2080 SUPERRTX 2080 TiTITAN RTXRTX 3060 TiRTX 30805.023170.15548.35344.25973.87152.8147.4137.8147.514095.43150.151226.28101.290213.46836798336713784412897400000440244285746527142919824214226410.2823.54759251.451.735.340.63128084240.37.705.762.112.471.782.293.760.805.3118.543.265.457.629.8780.90751982.70778.9978.97226.15144.62820.128106412.10561.7294127889.2512.67078.26270.19165.55476.552593.95293.5230.0239.0273.924543.04170.634308.23136.081315.36164680663876035117997700000617831428678451428633384723790015.2414.66273242.202.605.541.05198638055.85.354.671.531.821.331.662.880.643.9313.972.323.045.258.58131.8566781371.101075.0799.49296.82120.90717.21476411.61768.7053184507.0603.22883.09281.98168.18489.372732.32235.4207.4197.2222.014448.17173.674443.72129.497315.52506764871670035906318354814286621996000079474285733570023698814.3044.36070511.962.374.76416670.99197542242.76.055.301.842.101.561.813.630.724.3315.092.383.556.039.30124.7371611351.92985.9793.61299.07123.84817.73383311.74668.6087170977.2432.67137.35149.3168.22210.221783.16297.3251.2239.0275.125480.01229.295248.43180.969512.587807128353572689257304142868158285714103502857143334230682518.2525.534102492.763.317.831.17247283060.74.754.431.561.811.371.632.920.673.5710.321.982.564.437.84192.5980861696.451282.52124.27389.4586.60212.9364799.00472.8338208835.7922.19833.87154.2563.22209.051877.55372.2311.8270.4348.066758.49245.516753.79189.078311.492870769057275750274346142868747071429110484285745997332424021.6666.865112843.263.9610.451.17262260550.65.414.951.721.891.631.723.350.724.169.851.912.804.658.54225.4088221952.071509.02137.81416.1580.58712.3774028.65672.3343249755.5532.09431.96147.1658.17198.241803.97396.7328.4284.5368.847203.49267.767134.16205.493910.263938059966485125299966714299558914286121278571450410035993323.4307.394127233.514.1910.981.27280144899.14.584.231.541.641.261.562.790.583.438.961.742.143.937.27242.7253562008.991580.07148.07447.0674.80611.5373737.80475.0940266005.2112.07626.4190.5148.84135.341002.41394.2313.9288.2367.048537.01306.518494.99227.76618.318105899110450960823502697142910984400000139924285757794742359324.4907.677143323.574.299.861.78316276201.04.184.091.381.711.361.662.760.633.238.201.662.003.847.19258.4720712297.001707.65148.55498.2463.75410.2063526.98075.7433276824.7692.09429.5387.2645.98135.02974.80394.1334.2288.5368.919117.91343.499509.30242.55437.715114773121856984873858172857112195000000153541428663991545897124.8257.711157583.484.208.951.79341286781.74.294.161.461.751.371.502.660.613.297.691.552.213.727.02259.1629932340.011714.00150.94544.7260.0959.6113426.35576.1335285644.5821.91726.3982.6043.57130.28917.27434.4344.1298.9405.7710190.43373.0410455.18257.47676.9121242721282771083594256570000013467714286170530000070418052403325.4787.884179153.614.349.031.88363715438.94.204.061.371.761.321.522.610.633.127.441.521.963.527.07265.1499652480.881831.76159.34587.7254.7839.0313255.90477.1077307204.3681.67819.8373.9133.09104.80902.94540.7445.4320.8502.7313338.39516.5313253.58300.89356.1581525831678581324895574072857117840385714222312857188256065022933.19010.913232694.605.6512.082.11446864473.43.874.021.511.641.341.492.730.683.105.681.301.723.306.53349.4127083227.212405.89211.01747.5044.7257.7432474.49178.6120373843.8351.75621.2682.3135.12114.001002.97514.5456.0291.8484.4013604.68498.1413266.22270.68056.3721511481558671280035308631428616935833333211881666783742062555031.75710.588210844.425.4612.131.99443646920.95.054.661.752.111.621.893.330.813.736.281.731.963.887.47350.6624993284.452394.82208.22718.5145.5538.0092564.80576.2740369334.1242.09418.0655.9537.2486.20581.54393.5383.6298.2389.0216012.88302.828290.91234.55988.3741324211367971123213299200000011091171429140692857158691843406733.52011.394228425.797.1316.842.80278997773.13.964.271.741.761.361.773.030.633.446.021.701.653.726.56378.7130332439.191875.83177.04686.6652.4688.6332406.98875.8256320654.2361.62714.9641.2922.7359.14458.51634.1615.3339.9633.3428088.78514.4014574.47306.76714.9211972672083311587245403031428618345528571230670000093929069238843.58916.595283897.269.2920.823.54401282795.24.074.451.731.981.541.803.130.643.884.711.311.823.516.50537.2420473725.402995.56243.50975.5635.7206.5761724.85577.9536496313.519OpenBenchmarking.org

ArrayFire

Test: Conjugate Gradient OpenCL

OpenBenchmarking.orgms, Fewer Is BetterArrayFire 3.7Test: Conjugate Gradient OpenCLGTX 1060GTX 1660 SUPERGTX 1660 TiRTX 2060RTX 2060 SUPERRTX 2070RTX 2070 SUPERRTX 2080RTX 2080 SUPERRTX 2080 TiRTX 3060 TiRTX 3080TITAN RTX1.13022.26043.39064.52085.651SE +/- 0.015, N = 9SE +/- 0.014, N = 10SE +/- 0.003, N = 10SE +/- 0.009, N = 10SE +/- 0.004, N = 10SE +/- 0.002, N = 10SE +/- 0.008, N = 10SE +/- 0.009, N = 9SE +/- 0.011, N = 10SE +/- 0.003, N = 10SE +/- 0.003, N = 10SE +/- 0.009, N = 9SE +/- 0.006, N = 105.0232.6703.2282.6712.1982.0942.0762.0941.9171.6782.0941.6271.7561. (CXX) g++ options: -rdynamic

Blender

Blend File: BMW27 - Compute: NVIDIA OptiX

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 2.90Blend File: BMW27 - Compute: NVIDIA OptiXGTX 1060GTX 1660 SUPERGTX 1660 TiRTX 2060RTX 2060 SUPERRTX 2070RTX 2070 SUPERRTX 2080RTX 2080 SUPERRTX 2080 TiRTX 3060 TiRTX 3080TITAN RTX4080120160200SE +/- 3.22, N = 12SE +/- 0.04, N = 3SE +/- 2.63, N = 15SE +/- 0.01, N = 3SE +/- 0.06, N = 3SE +/- 0.01, N = 3SE +/- 0.00, N = 3SE +/- 2.52, N = 15SE +/- 0.02, N = 3SE +/- 0.02, N = 3SE +/- 0.02, N = 3SE +/- 2.61, N = 15SE +/- 0.05, N = 3170.1578.2683.0937.3533.8731.9626.4129.5326.3919.8318.0614.9621.26

Blender

Blend File: Classroom - Compute: NVIDIA OptiX

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 2.90Blend File: Classroom - Compute: NVIDIA OptiXGTX 1060GTX 1660 SUPERGTX 1660 TiRTX 2060RTX 2060 SUPERRTX 2070RTX 2070 SUPERRTX 2080RTX 2080 SUPERRTX 2080 TiRTX 3060 TiRTX 3080TITAN RTX120240360480600SE +/- 0.04, N = 3SE +/- 1.38, N = 3SE +/- 1.47, N = 3SE +/- 0.33, N = 3SE +/- 0.30, N = 3SE +/- 0.04, N = 3SE +/- 0.06, N = 3SE +/- 0.11, N = 3SE +/- 0.10, N = 3SE +/- 0.13, N = 3SE +/- 0.76, N = 3SE +/- 0.07, N = 3SE +/- 0.34, N = 3548.35270.19281.98149.31154.25147.1690.5187.2682.6073.9155.9541.2982.31

Blender

Blend File: Fishy Cat - Compute: NVIDIA OptiX

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 2.90Blend File: Fishy Cat - Compute: NVIDIA OptiXGTX 1060GTX 1660 SUPERGTX 1660 TiRTX 2060RTX 2060 SUPERRTX 2070RTX 2070 SUPERRTX 2080RTX 2080 SUPERRTX 2080 TiRTX 3060 TiRTX 3080TITAN RTX70140210280350SE +/- 0.09, N = 3SE +/- 0.11, N = 3SE +/- 0.09, N = 3SE +/- 0.04, N = 3SE +/- 0.16, N = 3SE +/- 0.04, N = 3SE +/- 0.01, N = 3SE +/- 0.02, N = 3SE +/- 0.03, N = 3SE +/- 0.02, N = 3SE +/- 0.01, N = 3SE +/- 0.05, N = 3SE +/- 0.13, N = 3344.25165.55168.1868.2263.2258.1748.8445.9843.5733.0937.2422.7335.12

Blender

Blend File: Pabellon Barcelona - Compute: NVIDIA OptiX

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 2.90Blend File: Pabellon Barcelona - Compute: NVIDIA OptiXGTX 1060GTX 1660 SUPERGTX 1660 TiRTX 2060RTX 2060 SUPERRTX 2070RTX 2070 SUPERRTX 2080RTX 2080 SUPERRTX 2080 TiRTX 3060 TiRTX 3080TITAN RTX2004006008001000SE +/- 0.11, N = 3SE +/- 0.67, N = 3SE +/- 0.18, N = 3SE +/- 0.17, N = 3SE +/- 0.20, N = 3SE +/- 0.10, N = 3SE +/- 0.07, N = 3SE +/- 0.06, N = 3SE +/- 0.06, N = 3SE +/- 0.19, N = 3SE +/- 0.06, N = 3SE +/- 0.06, N = 3SE +/- 0.68, N = 3973.87476.55489.37210.22209.05198.24135.34135.02130.28104.8086.2059.14114.00

Blender

Blend File: Barbershop - Compute: NVIDIA OptiX

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 2.90Blend File: Barbershop - Compute: NVIDIA OptiXGTX 1660 SUPERGTX 1660 TiRTX 2060RTX 2060 SUPERRTX 2070RTX 2070 SUPERRTX 2080RTX 2080 SUPERRTX 2080 TiRTX 3060 TiRTX 3080TITAN RTX6001200180024003000SE +/- 0.53, N = 3SE +/- 8.92, N = 3SE +/- 4.43, N = 3SE +/- 3.65, N = 3SE +/- 1.58, N = 3SE +/- 0.49, N = 3SE +/- 0.64, N = 3SE +/- 0.11, N = 3SE +/- 1.60, N = 3SE +/- 1.52, N = 3SE +/- 0.76, N = 3SE +/- 1.43, N = 32593.952732.321783.161877.551803.971002.41974.80917.27902.94581.54458.511002.97

cl-mem

Benchmark: Read

OpenBenchmarking.orgGB/s, More Is Bettercl-mem 2017-01-13Benchmark: ReadGTX 1060GTX 1660 SUPERGTX 1660 TiRTX 2060RTX 2060 SUPERRTX 2070RTX 2070 SUPERRTX 2080RTX 2080 SUPERRTX 2080 TiRTX 3060 TiRTX 3080TITAN RTX140280420560700SE +/- 0.02, N = 5SE +/- 1.52, N = 7SE +/- 0.50, N = 6SE +/- 0.07, N = 7SE +/- 0.23, N = 7SE +/- 0.10, N = 8SE +/- 1.82, N = 7SE +/- 1.61, N = 8SE +/- 2.29, N = 8SE +/- 3.54, N = 8SE +/- 0.06, N = 8SE +/- 5.82, N = 9SE +/- 2.07, N = 8152.8293.5235.4297.3372.2396.7394.2394.1434.4540.7393.5634.1514.51. (CC) gcc options: -O2 -flto -lOpenCL

cl-mem

Benchmark: Read

OpenBenchmarking.orgGB/s Per Watt, More Is Bettercl-mem 2017-01-13Benchmark: ReadGTX 1060GTX 1660 SUPERGTX 1660 TiRTX 2060RTX 2060 SUPERRTX 2070RTX 2070 SUPERRTX 2080RTX 2080 SUPERRTX 2080 TiRTX 3060 TiRTX 3080TITAN RTX1.19482.38963.58444.77925.9742.824.274.094.154.415.224.504.555.315.015.024.624.27

cl-mem

Benchmark: Write

OpenBenchmarking.orgGB/s, More Is Bettercl-mem 2017-01-13Benchmark: WriteGTX 1060GTX 1660 SUPERGTX 1660 TiRTX 2060RTX 2060 SUPERRTX 2070RTX 2070 SUPERRTX 2080RTX 2080 SUPERRTX 2080 TiRTX 3060 TiRTX 3080TITAN RTX130260390520650SE +/- 0.36, N = 5SE +/- 1.33, N = 7SE +/- 0.26, N = 6SE +/- 0.38, N = 7SE +/- 0.28, N = 7SE +/- 0.27, N = 8SE +/- 1.89, N = 7SE +/- 1.71, N = 8SE +/- 2.08, N = 8SE +/- 1.82, N = 8SE +/- 0.03, N = 8SE +/- 2.78, N = 9SE +/- 1.51, N = 8147.4230.0207.4251.2311.8328.4313.9334.2344.1445.4383.6615.3456.01. (CC) gcc options: -O2 -flto -lOpenCL

cl-mem

Benchmark: Write

OpenBenchmarking.orgGB/s Per Watt, More Is Bettercl-mem 2017-01-13Benchmark: WriteGTX 1060GTX 1660 SUPERGTX 1660 TiRTX 2060RTX 2060 SUPERRTX 2070RTX 2070 SUPERRTX 2080RTX 2080 SUPERRTX 2080 TiRTX 3060 TiRTX 3080TITAN RTX1.0892.1783.2674.3565.4452.743.373.583.633.804.433.663.964.313.914.844.533.90

cl-mem

Benchmark: Copy

OpenBenchmarking.orgGB/s, More Is Bettercl-mem 2017-01-13Benchmark: CopyGTX 1060GTX 1660 SUPERGTX 1660 TiRTX 2060RTX 2060 SUPERRTX 2070RTX 2070 SUPERRTX 2080RTX 2080 SUPERRTX 2080 TiRTX 3060 TiRTX 3080TITAN RTX70140210280350SE +/- 0.28, N = 5SE +/- 0.69, N = 7SE +/- 0.27, N = 6SE +/- 0.08, N = 7SE +/- 0.37, N = 7SE +/- 0.06, N = 8SE +/- 1.07, N = 7SE +/- 0.81, N = 8SE +/- 1.13, N = 8SE +/- 0.85, N = 8SE +/- 0.09, N = 8SE +/- 1.91, N = 9SE +/- 0.44, N = 8137.8239.0197.2239.0270.4284.5288.2288.5298.9320.8298.2339.9291.81. (CC) gcc options: -O2 -flto -lOpenCL

cl-mem

Benchmark: Copy

OpenBenchmarking.orgGB/s Per Watt, More Is Bettercl-mem 2017-01-13Benchmark: CopyGTX 1060GTX 1660 SUPERGTX 1660 TiRTX 2060RTX 2060 SUPERRTX 2070RTX 2070 SUPERRTX 2080RTX 2080 SUPERRTX 2080 TiRTX 3060 TiRTX 3080TITAN RTX0.86631.73262.59893.46524.33152.593.483.493.493.393.823.383.423.773.053.852.522.58

clpeak

OpenCL Test: Global Memory Bandwidth

OpenBenchmarking.orgGBPS, More Is BetterclpeakOpenCL Test: Global Memory BandwidthGTX 1060GTX 1660 SUPERGTX 1660 TiRTX 2060RTX 2060 SUPERRTX 2070RTX 2070 SUPERRTX 2080RTX 2080 SUPERRTX 2080 TiRTX 3060 TiRTX 3080TITAN RTX140280420560700SE +/- 0.06, N = 10SE +/- 1.52, N = 12SE +/- 0.45, N = 12SE +/- 1.44, N = 15SE +/- 0.50, N = 13SE +/- 0.21, N = 15SE +/- 2.10, N = 14SE +/- 0.09, N = 13SE +/- 0.07, N = 15SE +/- 3.38, N = 12SE +/- 0.15, N = 15SE +/- 4.38, N = 12SE +/- 2.39, N = 13147.51273.92222.01275.12348.06368.84367.04368.91405.77502.73389.02633.34484.401. (CXX) g++ options: -O3 -rdynamic -lOpenCL

clpeak

OpenCL Test: Global Memory Bandwidth

OpenBenchmarking.orgGBPS Per Watt, More Is BetterclpeakOpenCL Test: Global Memory BandwidthGTX 1060GTX 1660 SUPERGTX 1660 TiRTX 2060RTX 2060 SUPERRTX 2070RTX 2070 SUPERRTX 2080RTX 2080 SUPERRTX 2080 TiRTX 3060 TiRTX 3080TITAN RTX2468103.396.375.875.516.628.096.506.327.195.987.456.216.13

clpeak

OpenCL Test: Single-Precision Float

OpenBenchmarking.orgGFLOPS, More Is BetterclpeakOpenCL Test: Single-Precision FloatGTX 1060GTX 1660 SUPERGTX 1660 TiRTX 2060RTX 2060 SUPERRTX 2070RTX 2070 SUPERRTX 2080RTX 2080 SUPERRTX 2080 TiRTX 3060 TiRTX 3080TITAN RTX6K12K18K24K30KSE +/- 65.66, N = 15SE +/- 29.82, N = 12SE +/- 45.28, N = 15SE +/- 104.44, N = 15SE +/- 72.24, N = 15SE +/- 93.84, N = 15SE +/- 86.35, N = 15SE +/- 74.65, N = 12SE +/- 94.85, N = 15SE +/- 160.87, N = 15SE +/- 24.65, N = 13SE +/- 211.97, N = 13SE +/- 131.35, N = 154095.434543.044448.175480.016758.497203.498537.019117.9110190.4313338.3916012.8828088.7813604.681. (CXX) g++ options: -O3 -rdynamic -lOpenCL

clpeak

OpenCL Test: Single-Precision Float

OpenBenchmarking.orgGFLOPS Per Watt, More Is BetterclpeakOpenCL Test: Single-Precision FloatGTX 1060GTX 1660 SUPERGTX 1660 TiRTX 2060RTX 2060 SUPERRTX 2070RTX 2070 SUPERRTX 2080RTX 2080 SUPERRTX 2080 TiRTX 3060 TiRTX 3080TITAN RTX70140210280350101.60117.45142.17131.53124.64157.05144.93152.55179.85158.64327.99309.31132.66

clpeak

OpenCL Test: Double-Precision Double

OpenBenchmarking.orgGFLOPS, More Is BetterclpeakOpenCL Test: Double-Precision DoubleGTX 1060GTX 1660 SUPERGTX 1660 TiRTX 2060RTX 2060 SUPERRTX 2070RTX 2070 SUPERRTX 2080RTX 2080 SUPERRTX 2080 TiRTX 3060 TiRTX 3080TITAN RTX110220330440550SE +/- 0.30, N = 3SE +/- 0.26, N = 3SE +/- 0.50, N = 3SE +/- 0.32, N = 3SE +/- 0.38, N = 3SE +/- 0.79, N = 3SE +/- 0.34, N = 3SE +/- 1.04, N = 3SE +/- 0.26, N = 3SE +/- 2.16, N = 3SE +/- 0.58, N = 3SE +/- 1.61, N = 3SE +/- 2.49, N = 3150.15170.63173.67229.29245.51267.76306.51343.49373.04516.53302.82514.40498.141. (CXX) g++ options: -O3 -rdynamic -lOpenCL

clpeak

OpenCL Test: Double-Precision Double

OpenBenchmarking.orgGFLOPS Per Watt, More Is BetterclpeakOpenCL Test: Double-Precision DoubleGTX 1060GTX 1660 SUPERGTX 1660 TiRTX 2060RTX 2060 SUPERRTX 2070RTX 2070 SUPERRTX 2080RTX 2080 SUPERRTX 2080 TiRTX 3060 TiRTX 3080TITAN RTX0.96531.93062.89593.86124.82653.072.993.673.443.073.793.583.574.294.144.043.523.56

clpeak

OpenCL Test: Integer Compute INT

OpenBenchmarking.orgGIOPS, More Is BetterclpeakOpenCL Test: Integer Compute INTGTX 1060GTX 1660 SUPERGTX 1660 TiRTX 2060RTX 2060 SUPERRTX 2070RTX 2070 SUPERRTX 2080RTX 2080 SUPERRTX 2080 TiRTX 3060 TiRTX 3080TITAN RTX3K6K9K12K15KSE +/- 14.65, N = 15SE +/- 31.94, N = 12SE +/- 53.45, N = 15SE +/- 46.67, N = 15SE +/- 70.14, N = 15SE +/- 81.80, N = 15SE +/- 96.07, N = 15SE +/- 74.73, N = 12SE +/- 96.25, N = 15SE +/- 136.49, N = 15SE +/- 65.69, N = 14SE +/- 137.97, N = 15SE +/- 161.08, N = 151226.284308.234443.725248.436753.797134.168494.999509.3010455.1813253.588290.9114574.4713266.221. (CXX) g++ options: -O3 -rdynamic -lOpenCL

clpeak

OpenCL Test: Integer Compute INT

OpenBenchmarking.orgGIOPS Per Watt, More Is BetterclpeakOpenCL Test: Integer Compute INTGTX 1060GTX 1660 SUPERGTX 1660 TiRTX 2060RTX 2060 SUPERRTX 2070RTX 2070 SUPERRTX 2080RTX 2080 SUPERRTX 2080 TiRTX 3060 TiRTX 3080TITAN RTX30609012015019.3996.51112.27103.5499.10120.15119.43127.83152.30147.86128.32116.90118.27

FAHBench

OpenBenchmarking.orgNs Per Day, More Is BetterFAHBench 2.3.2GTX 1060GTX 1660 SUPERGTX 1660 TiRTX 2060RTX 2060 SUPERRTX 2070RTX 2070 SUPERRTX 2080RTX 2080 SUPERRTX 2080 TiRTX 3060 TiRTX 3080TITAN RTX70140210280350SE +/- 0.02, N = 3SE +/- 0.09, N = 3SE +/- 0.21, N = 3SE +/- 0.21, N = 3SE +/- 0.37, N = 3SE +/- 0.40, N = 3SE +/- 0.17, N = 3SE +/- 0.19, N = 3SE +/- 0.32, N = 3SE +/- 0.36, N = 3SE +/- 0.19, N = 3SE +/- 0.28, N = 3SE +/- 1.07, N = 3101.29136.08129.50180.97189.08205.49227.77242.55257.48300.89234.56306.77270.68

FAHBench

OpenBenchmarking.orgNs Per Day Per Watt, More Is BetterFAHBench 2.3.2GTX 1060GTX 1660 SUPERGTX 1660 TiRTX 2060RTX 2060 SUPERRTX 2070RTX 2070 SUPERRTX 2080RTX 2080 SUPERRTX 2080 TiRTX 3060 TiRTX 3080TITAN RTX0.47250.9451.41751.892.36251.511.631.831.771.731.881.891.801.981.842.101.681.66

FinanceBench

Benchmark: Black-Scholes OpenCL

OpenBenchmarking.orgms, Fewer Is BetterFinanceBench 2016-06-06Benchmark: Black-Scholes OpenCLGTX 1060GTX 1660 SUPERGTX 1660 TiRTX 2060RTX 2060 SUPERRTX 2070RTX 2070 SUPERRTX 2080RTX 2080 SUPERRTX 2080 TiRTX 3060 TiRTX 3080TITAN RTX48121620SE +/- 0.326577, N = 15SE +/- 0.069806, N = 15SE +/- 0.162363, N = 15SE +/- 0.035770, N = 15SE +/- 0.162802, N = 15SE +/- 0.009511, N = 14SE +/- 0.048730, N = 14SE +/- 0.040260, N = 14SE +/- 0.083219, N = 15SE +/- 0.094451, N = 15SE +/- 0.027743, N = 15SE +/- 0.043122, N = 15SE +/- 0.224039, N = 1513.46800015.36100015.52506712.58700011.49200010.2630008.3180007.7150006.9120006.1580008.3740004.9210006.3720001. (CXX) g++ options: -O3 -lOpenCL

Geekbench

Test: GPU OpenCL

OpenBenchmarking.orgScore, More Is BetterGeekbench 5Test: GPU OpenCLGTX 1060GTX 1660 SUPERGTX 1660 TiRTX 2060RTX 2060 SUPERRTX 2070RTX 2070 SUPERRTX 2080RTX 2080 SUPERRTX 2080 TiRTX 3060 TiRTX 3080TITAN RTX40K80K120K160K200KSE +/- 218.79, N = 3SE +/- 558.50, N = 3SE +/- 420.54, N = 3SE +/- 772.57, N = 3SE +/- 823.09, N = 3SE +/- 668.55, N = 3SE +/- 521.87, N = 3SE +/- 200.07, N = 3SE +/- 1025.87, N = 3SE +/- 303.84, N = 3SE +/- 1279.48, N = 3SE +/- 733.75, N = 3SE +/- 1711.48, N = 3367986468064871807128707693805105899114773124272152583132421197267151148

Geekbench

Test: GPU OpenCL

OpenBenchmarking.orgScore Per Watt, More Is BetterGeekbench 5Test: GPU OpenCLGTX 1060GTX 1660 SUPERGTX 1660 TiRTX 2060RTX 2060 SUPERRTX 2070RTX 2070 SUPERRTX 2080RTX 2080 SUPERRTX 2080 TiRTX 3060 TiRTX 3080TITAN RTX5001000150020002500766.731296.981730.981473.911457.661631.211658.791613.121855.401962.162278.181936.501557.54

Geekbench

Test: GPU NVIDIA CUDA

OpenBenchmarking.orgScore, More Is BetterGeekbench 5Test: GPU NVIDIA CUDAGTX 1060GTX 1660 SUPERGTX 1660 TiRTX 2060RTX 2060 SUPERRTX 2070RTX 2070 SUPERRTX 2080RTX 2080 SUPERRTX 2080 TiRTX 3060 TiRTX 3080TITAN RTX40K80K120K160K200KSE +/- 96.77, N = 3SE +/- 387.46, N = 3SE +/- 128.28, N = 3SE +/- 411.67, N = 3SE +/- 657.64, N = 3SE +/- 667.51, N = 3SE +/- 539.60, N = 3SE +/- 663.75, N = 3SE +/- 1753.98, N = 3SE +/- 1291.90, N = 3SE +/- 835.34, N = 3SE +/- 2347.00, N = 14SE +/- 1675.18, N = 15336716638767003835359057299664110450121856128277167858136797208331155867

Geekbench

Test: GPU NVIDIA CUDA

OpenBenchmarking.orgScore Per Watt, More Is BetterGeekbench 5Test: GPU NVIDIA CUDAGTX 1060GTX 1660 SUPERGTX 1660 TiRTX 2060RTX 2060 SUPERRTX 2070RTX 2070 SUPERRTX 2080RTX 2080 SUPERRTX 2080 TiRTX 3060 TiRTX 3080TITAN RTX5001000150020002500592.621207.711499.741314.211421.931523.731590.391751.841815.721927.382139.981916.201602.54

Geekbench

Test: GPU Vulkan

OpenBenchmarking.orgScore, More Is BetterGeekbench 5Test: GPU VulkanGTX 1060GTX 1660 SUPERGTX 1660 TiRTX 2060RTX 2060 SUPERRTX 2070RTX 2070 SUPERRTX 2080RTX 2080 SUPERRTX 2080 TiRTX 3060 TiRTX 3080TITAN RTX30K60K90K120K150KSE +/- 331.69, N = 3SE +/- 423.81, N = 3SE +/- 734.49, N = 3SE +/- 820.21, N = 3SE +/- 343.85, N = 3SE +/- 421.33, N = 3SE +/- 1315.57, N = 3SE +/- 1128.61, N = 3SE +/- 1145.26, N = 8SE +/- 1281.91, N = 15SE +/- 923.31, N = 15SE +/- 1286.56, N = 15SE +/- 1193.73, N = 153784460351590637268975750851259608298487108359132489112321158724128003

Geekbench

Test: GPU Vulkan

OpenBenchmarking.orgScore Per Watt, More Is BetterGeekbench 5Test: GPU VulkanGTX 1060GTX 1660 SUPERGTX 1660 TiRTX 2060RTX 2060 SUPERRTX 2070RTX 2070 SUPERRTX 2080RTX 2080 SUPERRTX 2080 TiRTX 3060 TiRTX 3080TITAN RTX400800120016002000715.071126.661281.071275.011116.651608.471469.221362.741486.191592.921806.211502.881301.46

Hashcat

Benchmark: MD5

OpenBenchmarking.orgH/s, More Is BetterHashcat 6.1.1Benchmark: MD5GTX 1060GTX 1660 SUPERGTX 1660 TiRTX 2060RTX 2060 SUPERRTX 2070RTX 2070 SUPERRTX 2080RTX 2080 SUPERRTX 2080 TiRTX 3060 TiRTX 3080TITAN RTX12000M24000M36000M48000M60000MSE +/- 29398291.17, N = 7SE +/- 46882020.11, N = 7SE +/- 40766579.62, N = 7SE +/- 34176226.97, N = 7SE +/- 41830567.71, N = 7SE +/- 181560574.59, N = 7SE +/- 41495700.95, N = 7SE +/- 109307854.28, N = 7SE +/- 63553325.94, N = 7SE +/- 98630343.33, N = 7SE +/- 53297878.10, N = 7SE +/- 102079526.49, N = 7SE +/- 147390714.04, N = 712897400000179977000001835481428625730414286274346142862999667142935026971429385817285714256570000055740728571329920000005403031428653086314286

Hashcat

Benchmark: MD5

OpenBenchmarking.orgH/s Per Watt, More Is BetterHashcat 6.1.1Benchmark: MD5GTX 1060GTX 1660 SUPERGTX 1660 TiRTX 2060RTX 2060 SUPERRTX 2070RTX 2070 SUPERRTX 2080RTX 2080 SUPERRTX 2080 TiRTX 3060 TiRTX 3080TITAN RTX80M160M240M320M400M184587919.24244831690.71286208945.71278488631.45275454497.06313223916.56288952169.21322401428.48311117905.89396354718.56311715797.43311017484.35341784951.41

Hashcat

Benchmark: SHA1

OpenBenchmarking.orgH/s, More Is BetterHashcat 6.1.1Benchmark: SHA1GTX 1060GTX 1660 SUPERGTX 1660 TiRTX 2060RTX 2060 SUPERRTX 2070RTX 2070 SUPERRTX 2080RTX 2080 SUPERRTX 2080 TiRTX 3060 TiRTX 3080TITAN RTX4000M8000M12000M16000M20000MSE +/- 6046717.22, N = 7SE +/- 10473604.66, N = 7SE +/- 43107894.32, N = 15SE +/- 12096446.32, N = 7SE +/- 13942803.47, N = 7SE +/- 9114520.82, N = 7SE +/- 7407910.83, N = 7SE +/- 10928839.09, N = 7SE +/- 40239943.60, N = 7SE +/- 26687552.20, N = 7SE +/- 8294912.79, N = 7SE +/- 36837886.26, N = 7SE +/- 31084579.96, N = 644024428576178314286621996000081582857148747071429955891428610984400000121950000001346771428617840385714110911714291834552857116935833333

Hashcat

Benchmark: SHA1

OpenBenchmarking.orgH/s Per Watt, More Is BetterHashcat 6.1.1Benchmark: SHA1GTX 1060GTX 1660 SUPERGTX 1660 TiRTX 2060RTX 2060 SUPERRTX 2070RTX 2070 SUPERRTX 2080RTX 2080 SUPERRTX 2080 TiRTX 3060 TiRTX 3080TITAN RTX30M60M90M120M150M60925712.5785534112.7294836299.4289207530.6284129215.9197164967.4994385776.1096128268.62102514995.64121618842.58103115175.84100535705.76104602759.10

Hashcat

Benchmark: SHA-512

OpenBenchmarking.orgH/s, More Is BetterHashcat 6.1.1Benchmark: SHA-512GTX 1060GTX 1660 SUPERGTX 1660 TiRTX 2060RTX 2060 SUPERRTX 2070RTX 2070 SUPERRTX 2080RTX 2080 SUPERRTX 2080 TiRTX 3060 TiRTX 3080TITAN RTX500M1000M1500M2000M2500MSE +/- 1680378.97, N = 7SE +/- 537821.25, N = 7SE +/- 824002.18, N = 7SE +/- 1478370.13, N = 7SE +/- 1642277.33, N = 7SE +/- 1566073.13, N = 7SE +/- 953653.91, N = 7SE +/- 2244509.55, N = 7SE +/- 900264.51, N = 7SE +/- 1585907.32, N = 7SE +/- 849289.42, N = 7SE +/- 3329521.63, N = 7SE +/- 4053921.28, N = 64652714297845142867947428571035028571110484285712127857141399242857153541428617053000002223128571140692857123067000002118816667

Hashcat

Benchmark: SHA-512

OpenBenchmarking.orgH/s Per Watt, More Is BetterHashcat 6.1.1Benchmark: SHA-512GTX 1060GTX 1660 SUPERGTX 1660 TiRTX 2060RTX 2060 SUPERRTX 2070RTX 2070 SUPERRTX 2080RTX 2080 SUPERRTX 2080 TiRTX 3060 TiRTX 3080TITAN RTX3M6M9M12M15M6439856.1510393151.8111525083.3711143378.5310630748.2712061400.8011496268.3312234041.6912407758.8414695988.6412797897.1912429064.1912848448.80

Hashcat

Benchmark: 7-Zip

OpenBenchmarking.orgH/s, More Is BetterHashcat 6.1.1Benchmark: 7-ZipGTX 1060GTX 1660 SUPERGTX 1660 TiRTX 2060RTX 2060 SUPERRTX 2070RTX 2070 SUPERRTX 2080RTX 2080 SUPERRTX 2080 TiRTX 3060 TiRTX 3080TITAN RTX200K400K600K800K1000KSE +/- 915.40, N = 12SE +/- 2811.01, N = 15SE +/- 2005.81, N = 11SE +/- 4365.82, N = 12SE +/- 2513.28, N = 11SE +/- 249.73, N = 11SE +/- 6166.48, N = 15SE +/- 4180.88, N = 13SE +/- 6880.46, N = 15SE +/- 6317.53, N = 10SE +/- 558.54, N = 11SE +/- 2622.40, N = 10SE +/- 6837.61, N = 10198242333847335700433342459973504100577947639915704180882560586918939290837420

Hashcat

Benchmark: 7-Zip

OpenBenchmarking.orgH/s Per Watt, More Is BetterHashcat 6.1.1Benchmark: 7-ZipGTX 1060GTX 1660 SUPERGTX 1660 TiRTX 2060RTX 2060 SUPERRTX 2070RTX 2070 SUPERRTX 2080RTX 2080 SUPERRTX 2080 TiRTX 3060 TiRTX 3080TITAN RTX2K4K6K8K10K3824.577098.628357.978031.647181.638840.468523.908699.019972.8311015.309708.438221.938110.58

Hashcat

Benchmark: TrueCrypt RIPEMD160 + XTS

OpenBenchmarking.orgH/s, More Is BetterHashcat 6.1.1Benchmark: TrueCrypt RIPEMD160 + XTSGTX 1060GTX 1660 SUPERGTX 1660 TiRTX 2060RTX 2060 SUPERRTX 2070RTX 2070 SUPERRTX 2080RTX 2080 SUPERRTX 2080 TiRTX 3060 TiRTX 3080TITAN RTX150K300K450K600K750KSE +/- 1264.28, N = 11SE +/- 2205.50, N = 10SE +/- 494.41, N = 8SE +/- 1010.44, N = 8SE +/- 2317.91, N = 10SE +/- 366.29, N = 9SE +/- 3357.49, N = 15SE +/- 1086.65, N = 7SE +/- 4540.66, N = 15SE +/- 1367.60, N = 7SE +/- 3786.64, N = 9SE +/- 2510.22, N = 8SE +/- 3170.74, N = 8142264237900236988306825324240359933423593458971524033650229434067692388625550

Hashcat

Benchmark: TrueCrypt RIPEMD160 + XTS

OpenBenchmarking.orgH/s Per Watt, More Is BetterHashcat 6.1.1Benchmark: TrueCrypt RIPEMD160 + XTSGTX 1060GTX 1660 SUPERGTX 1660 TiRTX 2060RTX 2060 SUPERRTX 2070RTX 2070 SUPERRTX 2080RTX 2080 SUPERRTX 2080 TiRTX 3060 TiRTX 3080TITAN RTX120024003600480060002915.073798.773963.533869.994691.054924.794726.824417.863899.844940.535389.755092.005053.52

IndigoBench

Acceleration: OpenCL GPU - Scene: Supercar

OpenBenchmarking.orgM samples/s, More Is BetterIndigoBench 4.4Acceleration: OpenCL GPU - Scene: SupercarGTX 1060GTX 1660 SUPERGTX 1660 TiRTX 2060RTX 2060 SUPERRTX 2070RTX 2070 SUPERRTX 2080RTX 2080 SUPERRTX 2080 TiRTX 3060 TiRTX 3080TITAN RTX1020304050SE +/- 0.01, N = 3SE +/- 0.03, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.09, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.07, N = 3SE +/- 0.13, N = 3SE +/- 0.03, N = 3SE +/- 0.23, N = 3SE +/- 0.14, N = 310.2815.2414.3018.2521.6723.4324.4924.8325.4833.1933.5243.5931.76

IndigoBench

Acceleration: OpenCL GPU - Scene: Supercar

OpenBenchmarking.orgM samples/s Per Watt, More Is BetterIndigoBench 4.4Acceleration: OpenCL GPU - Scene: SupercarGTX 1060GTX 1660 SUPERGTX 1660 TiRTX 2060RTX 2060 SUPERRTX 2070RTX 2070 SUPERRTX 2080RTX 2080 SUPERRTX 2080 TiRTX 3060 TiRTX 3080TITAN RTX0.05180.10360.15540.20720.2590.160.160.180.170.170.180.180.180.180.170.230.190.15

IndigoBench

Acceleration: OpenCL GPU - Scene: Bedroom

OpenBenchmarking.orgM samples/s, More Is BetterIndigoBench 4.4Acceleration: OpenCL GPU - Scene: BedroomGTX 1060GTX 1660 SUPERGTX 1660 TiRTX 2060RTX 2060 SUPERRTX 2070RTX 2070 SUPERRTX 2080RTX 2080 SUPERRTX 2080 TiRTX 3060 TiRTX 3080TITAN RTX48121620SE +/- 0.002, N = 3SE +/- 0.001, N = 3SE +/- 0.001, N = 3SE +/- 0.004, N = 3SE +/- 0.008, N = 3SE +/- 0.001, N = 3SE +/- 0.009, N = 3SE +/- 0.008, N = 3SE +/- 0.005, N = 3SE +/- 0.014, N = 3SE +/- 0.002, N = 3SE +/- 0.024, N = 3SE +/- 0.009, N = 33.5474.6624.3605.5346.8657.3947.6777.7117.88410.91311.39416.59510.588

IndigoBench

Acceleration: OpenCL GPU - Scene: Bedroom

OpenBenchmarking.orgM samples/s Per Watt, More Is BetterIndigoBench 4.4Acceleration: OpenCL GPU - Scene: BedroomGTX 1060GTX 1660 SUPERGTX 1660 TiRTX 2060RTX 2060 SUPERRTX 2070RTX 2070 SUPERRTX 2080RTX 2080 SUPERRTX 2080 TiRTX 3060 TiRTX 3080TITAN RTX0.01580.03160.04740.06320.0790.050.050.050.050.050.060.050.050.060.050.070.070.05

LeelaChessZero

Backend: OpenCL

OpenBenchmarking.orgNodes Per Second, More Is BetterLeelaChessZero 0.26Backend: OpenCLGTX 1060GTX 1660 SUPERGTX 1660 TiRTX 2060RTX 2060 SUPERRTX 2070RTX 2070 SUPERRTX 2080RTX 2080 SUPERRTX 2080 TiRTX 3060 TiRTX 3080TITAN RTX6K12K18K24K30KSE +/- 48.50, N = 3SE +/- 20.08, N = 3SE +/- 72.01, N = 3SE +/- 85.05, N = 3SE +/- 33.40, N = 3SE +/- 60.47, N = 3SE +/- 59.70, N = 3SE +/- 43.62, N = 3SE +/- 84.56, N = 3SE +/- 133.47, N = 3SE +/- 47.37, N = 3SE +/- 105.50, N = 3SE +/- 141.13, N = 3592573247051102491128412723143321575817915232692284228389210841. (CXX) g++ options: -flto -pthread

LeelaChessZero

Backend: OpenCL

OpenBenchmarking.orgNodes Per Second Per Watt, More Is BetterLeelaChessZero 0.26Backend: OpenCLGTX 1060GTX 1660 SUPERGTX 1660 TiRTX 2060RTX 2060 SUPERRTX 2070RTX 2070 SUPERRTX 2080RTX 2080 SUPERRTX 2080 TiRTX 3060 TiRTX 3080TITAN RTX30609012015055.1161.3360.9367.8768.8176.5077.6282.8791.4494.30120.64103.8582.37

LuxCoreRender OpenCL

Scene: LuxCore Benchmark

OpenBenchmarking.orgM samples/sec, More Is BetterLuxCoreRender OpenCL 2.3Scene: LuxCore BenchmarkGTX 1060GTX 1660 SUPERGTX 1660 TiRTX 2060RTX 2060 SUPERRTX 2070RTX 2070 SUPERRTX 2080RTX 2080 SUPERRTX 2080 TiRTX 3060 TiRTX 3080TITAN RTX246810SE +/- 0.03, N = 12SE +/- 0.01, N = 3SE +/- 0.02, N = 3SE +/- 0.01, N = 3SE +/- 0.02, N = 3SE +/- 0.01, N = 3SE +/- 0.06, N = 12SE +/- 0.04, N = 12SE +/- 0.01, N = 3SE +/- 0.02, N = 3SE +/- 0.11, N = 12SE +/- 0.07, N = 14SE +/- 0.05, N = 31.452.201.962.763.263.513.573.483.614.605.797.264.42MIN: 0.12 / MAX: 1.67MIN: 0.2 / MAX: 2.52MIN: 0.23 / MAX: 2.27MIN: 0.24 / MAX: 3.15MIN: 0.23 / MAX: 3.79MIN: 0.23 / MAX: 4.01MIN: 0.12 / MAX: 4.19MIN: 0.14 / MAX: 4.06MIN: 0.23 / MAX: 4.14MIN: 0.27 / MAX: 5.34MIN: 0.12 / MAX: 6.75MIN: 0.15 / MAX: 8.46MIN: 0.27 / MAX: 5.17

LuxCoreRender OpenCL

Scene: LuxCore Benchmark

OpenBenchmarking.orgM samples/sec Per Watt, More Is BetterLuxCoreRender OpenCL 2.3Scene: LuxCore BenchmarkGTX 1060GTX 1660 SUPERGTX 1660 TiRTX 2060RTX 2060 SUPERRTX 2070RTX 2070 SUPERRTX 2080RTX 2080 SUPERRTX 2080 TiRTX 3060 TiRTX 3080TITAN RTX0.0090.0180.0270.0360.0450.020.020.030.030.030.030.030.020.030.020.040.030.02

LuxCoreRender OpenCL

Scene: DLSC

OpenBenchmarking.orgM samples/sec, More Is BetterLuxCoreRender OpenCL 2.3Scene: DLSCGTX 1060GTX 1660 SUPERGTX 1660 TiRTX 2060RTX 2060 SUPERRTX 2070RTX 2070 SUPERRTX 2080RTX 2080 SUPERRTX 2080 TiRTX 3060 TiRTX 3080TITAN RTX3691215SE +/- 0.03, N = 12SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.00, N = 3SE +/- 0.08, N = 12SE +/- 0.06, N = 12SE +/- 0.02, N = 3SE +/- 0.01, N = 3SE +/- 0.14, N = 12SE +/- 0.15, N = 12SE +/- 0.01, N = 31.732.602.373.313.964.194.294.204.345.657.139.295.46MIN: 0.43 / MAX: 1.81MIN: 2.33 / MAX: 2.67MIN: 2.26 / MAX: 2.42MIN: 1.83 / MAX: 3.4MIN: 3.76 / MAX: 4.1MIN: 4.09 / MAX: 4.28MIN: 1.19 / MAX: 4.5MIN: 1.51 / MAX: 4.4MIN: 3.08 / MAX: 4.47MIN: 5.25 / MAX: 5.77MIN: 1.94 / MAX: 7.5MIN: 3.1 / MAX: 9.73MIN: 3.9 / MAX: 5.67

LuxCoreRender OpenCL

Scene: DLSC

OpenBenchmarking.orgM samples/sec Per Watt, More Is BetterLuxCoreRender OpenCL 2.3Scene: DLSCGTX 1060GTX 1660 SUPERGTX 1660 TiRTX 2060RTX 2060 SUPERRTX 2070RTX 2070 SUPERRTX 2080RTX 2080 SUPERRTX 2080 TiRTX 3060 TiRTX 3080TITAN RTX0.0090.0180.0270.0360.0450.020.030.030.030.030.030.030.030.030.030.040.040.03

LuxCoreRender OpenCL

Scene: Rainbow Colors and Prism

OpenBenchmarking.orgM samples/sec, More Is BetterLuxCoreRender OpenCL 2.3Scene: Rainbow Colors and PrismGTX 1060GTX 1660 SUPERGTX 1660 TiRTX 2060RTX 2060 SUPERRTX 2070RTX 2070 SUPERRTX 2080RTX 2080 SUPERRTX 2080 TiRTX 3060 TiRTX 3080TITAN RTX510152025SE +/- 0.1074070, N = 12SE +/- 0.0320724, N = 3SE +/- 0.0048958, N = 3SE +/- 0.0353073, N = 3SE +/- 0.0319774, N = 4SE +/- 0.0543537, N = 4SE +/- 0.2639327, N = 12SE +/- 0.1793871, N = 12SE +/- 0.0522772, N = 3SE +/- 0.0331742, N = 4SE +/- 0.5108456, N = 15SE +/- 0.4586334, N = 15SE +/- 0.0783102, N = 45.34000005.54000004.76416677.830000010.450000010.98000009.86000008.95000009.030000012.080000016.840000020.820000012.1300000MIN: 1.87 / MAX: 5.68MIN: 4.4 / MAX: 5.82MIN: 3.69 / MAX: 4.95MIN: 6.32 / MAX: 8.15MIN: 9.04 / MAX: 11.03MIN: 9.77 / MAX: 11.57MIN: 3.83 / MAX: 10.58MIN: 4.35 / MAX: 9.64MIN: 6.18 / MAX: 9.55MIN: 9.2 / MAX: 12.83MIN: 6.81 / MAX: 18.28MIN: 11.17 / MAX: 22.47MIN: 11.08 / MAX: 12.83

LuxCoreRender OpenCL

Scene: Rainbow Colors and Prism

OpenBenchmarking.orgM samples/sec Per Watt, More Is BetterLuxCoreRender OpenCL 2.3Scene: Rainbow Colors and PrismGTX 1060GTX 1660 SUPERGTX 1660 TiRTX 2060RTX 2060 SUPERRTX 2070RTX 2070 SUPERRTX 2080RTX 2080 SUPERRTX 2080 TiRTX 3060 TiRTX 3080TITAN RTX0.03380.06760.10140.13520.1690.080.070.070.080.090.100.090.080.080.080.150.110.07

LuxCoreRender OpenCL

Scene: Food

OpenBenchmarking.orgM samples/sec, More Is BetterLuxCoreRender OpenCL 2.3Scene: FoodGTX 1060GTX 1660 SUPERGTX 1660 TiRTX 2060RTX 2060 SUPERRTX 2070RTX 2070 SUPERRTX 2080RTX 2080 SUPERRTX 2080 TiRTX 3060 TiRTX 3080TITAN RTX0.79651.5932.38953.1863.9825SE +/- 0.01, N = 12SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.00, N = 3SE +/- 0.04, N = 12SE +/- 0.03, N = 12SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.06, N = 12SE +/- 0.06, N = 12SE +/- 0.01, N = 30.631.050.991.171.171.271.781.791.882.112.803.541.99MIN: 0.14 / MAX: 0.76MIN: 0.21 / MAX: 1.25MIN: 0.22 / MAX: 1.17MIN: 0.22 / MAX: 1.39MIN: 0.21 / MAX: 1.44MIN: 0.23 / MAX: 1.52MIN: 0.13 / MAX: 2.23MIN: 0.17 / MAX: 2.23MIN: 0.21 / MAX: 2.32MIN: 0.24 / MAX: 2.63MIN: 0.19 / MAX: 3.53MIN: 0.17 / MAX: 4.48MIN: 0.21 / MAX: 2.46

LuxCoreRender OpenCL

Scene: Food

OpenBenchmarking.orgM samples/sec Per Watt, More Is BetterLuxCoreRender OpenCL 2.3Scene: FoodGTX 1060GTX 1660 SUPERGTX 1660 TiRTX 2060RTX 2060 SUPERRTX 2070RTX 2070 SUPERRTX 2080RTX 2080 SUPERRTX 2080 TiRTX 3060 TiRTX 3080TITAN RTX0.00450.0090.01350.0180.02250.010.010.010.010.010.010.010.010.010.010.020.020.01

MandelGPU

OpenCL Device: GPU

OpenBenchmarking.orgSamples/sec, More Is BetterMandelGPU 1.3pts1OpenCL Device: GPUGTX 1060GTX 1660 SUPERGTX 1660 TiRTX 2060RTX 2060 SUPERRTX 2070RTX 2070 SUPERRTX 2080RTX 2080 SUPERRTX 2080 TiRTX 3060 TiRTX 3080TITAN RTX100M200M300M400M500MSE +/- 458649.89, N = 5SE +/- 545279.65, N = 7SE +/- 615153.65, N = 7SE +/- 387178.22, N = 8SE +/- 2576635.94, N = 9SE +/- 1098102.02, N = 8SE +/- 1273824.38, N = 9SE +/- 2274447.08, N = 9SE +/- 1757515.78, N = 9SE +/- 2727377.34, N = 10SE +/- 552442.28, N = 8SE +/- 1875555.71, N = 9SE +/- 2676982.40, N = 9128084240.3198638055.8197542242.7247283060.7262260550.6280144899.1316276201.0341286781.7363715438.9446864473.4278997773.1401282795.2443646920.91. (CC) gcc options: -O3 -lm -ftree-vectorize -funroll-loops -lglut -lOpenCL -lGL

MandelGPU

OpenCL Device: GPU

OpenBenchmarking.orgSamples/sec Per Watt, More Is BetterMandelGPU 1.3pts1OpenCL Device: GPUGTX 1060GTX 1660 SUPERGTX 1660 TiRTX 2060RTX 2060 SUPERRTX 2070RTX 2070 SUPERRTX 2080RTX 2080 SUPERRTX 2080 TiRTX 3060 TiRTX 3080TITAN RTX900K1800K2700K3600K4500K1890713.652676263.233061658.832826824.402790140.783316968.863284888.703349006.113682880.254140168.013434300.753127589.373502262.87

Meta Performance Per Watts

Performance Per Watts

OpenBenchmarking.orgPerformance Per Watts, More Is BetterMeta Performance Per WattsPerformance Per WattsGTX 1060GTX 1660 SUPERGTX 1660 TiRTX 2060RTX 2060 SUPERRTX 2070RTX 2070 SUPERRTX 2080RTX 2080 SUPERRTX 2080 TiRTX 3060 TiRTX 3080TITAN RTX2K4K6K8K10K2331.463523.293346.524332.554907.675278.845749.585999.926419.108097.456912.7110055.707834.12

NCNN

Target: Vulkan GPU - Model: squeezenet

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: Vulkan GPU - Model: squeezenetGTX 1060GTX 1660 SUPERGTX 1660 TiRTX 2060RTX 2060 SUPERRTX 2070RTX 2070 SUPERRTX 2080RTX 2080 SUPERRTX 2080 TiRTX 3060 TiRTX 3080TITAN RTX246810SE +/- 0.08, N = 3SE +/- 0.08, N = 15SE +/- 0.08, N = 3SE +/- 0.06, N = 15SE +/- 0.07, N = 3SE +/- 0.05, N = 3SE +/- 0.03, N = 3SE +/- 0.06, N = 15SE +/- 0.09, N = 15SE +/- 0.08, N = 15SE +/- 0.06, N = 3SE +/- 0.14, N = 12SE +/- 0.05, N = 157.705.356.054.755.414.584.184.294.203.873.964.075.05MIN: 6.82 / MAX: 48.71MIN: 4.46 / MAX: 45.32MIN: 4.56 / MAX: 53.55MIN: 4.19 / MAX: 44.66MIN: 4.02 / MAX: 50.12MIN: 4.01 / MAX: 44.45MIN: 3.93 / MAX: 24.5MIN: 3.78 / MAX: 44.36MIN: 3.67 / MAX: 44.19MIN: 3.51 / MAX: 45MIN: 3.54 / MAX: 39.83MIN: 3.22 / MAX: 44.48MIN: 3.57 / MAX: 45.51. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: Vulkan GPU - Model: mobilenet

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: Vulkan GPU - Model: mobilenetGTX 1060GTX 1660 SUPERGTX 1660 TiRTX 2060RTX 2060 SUPERRTX 2070RTX 2070 SUPERRTX 2080RTX 2080 SUPERRTX 2080 TiRTX 3060 TiRTX 3080TITAN RTX1.2962.5923.8885.1846.48SE +/- 0.10, N = 3SE +/- 0.09, N = 14SE +/- 0.08, N = 3SE +/- 0.05, N = 15SE +/- 0.09, N = 3SE +/- 0.05, N = 3SE +/- 0.25, N = 3SE +/- 0.06, N = 15SE +/- 0.08, N = 15SE +/- 0.06, N = 15SE +/- 0.01, N = 3SE +/- 0.07, N = 12SE +/- 0.06, N = 155.764.675.304.434.954.234.094.164.064.024.274.454.66MIN: 5 / MAX: 36.46MIN: 4.11 / MAX: 40.05MIN: 4.07 / MAX: 36.52MIN: 3.89 / MAX: 42.29MIN: 3.79 / MAX: 37.73MIN: 3.74 / MAX: 37.61MIN: 3.61 / MAX: 44.2MIN: 3.6 / MAX: 40.3MIN: 3.52 / MAX: 43.97MIN: 3.43 / MAX: 41.82MIN: 3.75 / MAX: 35.37MIN: 3.5 / MAX: 45.01MIN: 3.42 / MAX: 47.761. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: Vulkan GPU-v2-v2 - Model: mobilenet-v2

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: Vulkan GPU-v2-v2 - Model: mobilenet-v2GTX 1060GTX 1660 SUPERGTX 1660 TiRTX 2060RTX 2060 SUPERRTX 2070RTX 2070 SUPERRTX 2080RTX 2080 SUPERRTX 2080 TiRTX 3060 TiRTX 3080TITAN RTX0.47480.94961.42441.89922.374SE +/- 0.09, N = 3SE +/- 0.04, N = 15SE +/- 0.16, N = 3SE +/- 0.06, N = 15SE +/- 0.07, N = 3SE +/- 0.15, N = 3SE +/- 0.01, N = 3SE +/- 0.03, N = 15SE +/- 0.03, N = 15SE +/- 0.06, N = 15SE +/- 0.12, N = 3SE +/- 0.06, N = 12SE +/- 0.07, N = 152.111.531.841.561.721.541.381.461.371.511.741.731.75MIN: 1.91 / MAX: 19.43MIN: 1.42 / MAX: 21.24MIN: 1.44 / MAX: 19.14MIN: 1.39 / MAX: 19.37MIN: 1.36 / MAX: 15.12MIN: 1.38 / MAX: 17.92MIN: 1.31 / MAX: 5.51MIN: 1.33 / MAX: 17.85MIN: 1.28 / MAX: 18.03MIN: 1.29 / MAX: 18.36MIN: 1.5 / MAX: 17.99MIN: 1.4 / MAX: 22.34MIN: 1.3 / MAX: 20.671. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: Vulkan GPU-v3-v3 - Model: mobilenet-v3

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: Vulkan GPU-v3-v3 - Model: mobilenet-v3GTX 1060GTX 1660 SUPERGTX 1660 TiRTX 2060RTX 2060 SUPERRTX 2070RTX 2070 SUPERRTX 2080RTX 2080 SUPERRTX 2080 TiRTX 3060 TiRTX 3080TITAN RTX0.55581.11161.66742.22322.779SE +/- 0.13, N = 3SE +/- 0.05, N = 15SE +/- 0.13, N = 3SE +/- 0.06, N = 15SE +/- 0.04, N = 3SE +/- 0.01, N = 3SE +/- 0.12, N = 3SE +/- 0.04, N = 15SE +/- 0.05, N = 15SE +/- 0.04, N = 15SE +/- 0.01, N = 3SE +/- 0.07, N = 12SE +/- 0.07, N = 152.471.822.101.811.891.641.711.751.761.641.761.982.11MIN: 2.28 / MAX: 17.9MIN: 1.63 / MAX: 22.45MIN: 1.66 / MAX: 16.77MIN: 1.61 / MAX: 18.64MIN: 1.58 / MAX: 9.02MIN: 1.61 / MAX: 2.65MIN: 1.55 / MAX: 19.3MIN: 1.57 / MAX: 17.89MIN: 1.52 / MAX: 21.3MIN: 1.53 / MAX: 18.23MIN: 1.73 / MAX: 3.1MIN: 1.65 / MAX: 17.98MIN: 1.55 / MAX: 19.91. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: Vulkan GPU - Model: shufflenet-v2

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: Vulkan GPU - Model: shufflenet-v2GTX 1060GTX 1660 SUPERGTX 1660 TiRTX 2060RTX 2060 SUPERRTX 2070RTX 2070 SUPERRTX 2080RTX 2080 SUPERRTX 2080 TiRTX 3060 TiRTX 3080TITAN RTX0.40050.8011.20151.6022.0025SE +/- 0.10, N = 3SE +/- 0.03, N = 15SE +/- 0.03, N = 3SE +/- 0.04, N = 15SE +/- 0.22, N = 3SE +/- 0.01, N = 3SE +/- 0.14, N = 3SE +/- 0.05, N = 15SE +/- 0.06, N = 15SE +/- 0.06, N = 15SE +/- 0.04, N = 3SE +/- 0.06, N = 12SE +/- 0.07, N = 151.781.331.561.371.631.261.361.371.321.341.361.541.62MIN: 1.51 / MAX: 11.8MIN: 1.24 / MAX: 18.01MIN: 1.26 / MAX: 21.01MIN: 1.23 / MAX: 22.22MIN: 1.21 / MAX: 20.82MIN: 1.24 / MAX: 1.92MIN: 1.2 / MAX: 17.51MIN: 1.21 / MAX: 18.01MIN: 1.16 / MAX: 20.88MIN: 1.18 / MAX: 20.07MIN: 1.29 / MAX: 15.72MIN: 1.25 / MAX: 19.9MIN: 1.19 / MAX: 20.261. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: Vulkan GPU - Model: mnasnet

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: Vulkan GPU - Model: mnasnetGTX 1060GTX 1660 SUPERGTX 1660 TiRTX 2060RTX 2060 SUPERRTX 2070RTX 2070 SUPERRTX 2080RTX 2080 SUPERRTX 2080 TiRTX 3060 TiRTX 3080TITAN RTX0.51531.03061.54592.06122.5765SE +/- 0.17, N = 2SE +/- 0.06, N = 15SE +/- 0.04, N = 3SE +/- 0.07, N = 15SE +/- 0.02, N = 3SE +/- 0.11, N = 3SE +/- 0.13, N = 3SE +/- 0.03, N = 15SE +/- 0.05, N = 15SE +/- 0.03, N = 15SE +/- 0.14, N = 2SE +/- 0.06, N = 12SE +/- 0.05, N = 142.291.661.811.631.721.561.661.501.521.491.771.801.89MIN: 2.01 / MAX: 18.01MIN: 1.46 / MAX: 19.39MIN: 1.49 / MAX: 18.94MIN: 1.45 / MAX: 19.28MIN: 1.42 / MAX: 8.94MIN: 1.44 / MAX: 20.92MIN: 1.37 / MAX: 17.88MIN: 1.4 / MAX: 17.79MIN: 1.34 / MAX: 19.22MIN: 1.35 / MAX: 19.31MIN: 1.6 / MAX: 22.35MIN: 1.49 / MAX: 19.5MIN: 1.37 / MAX: 19.831. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: Vulkan GPU - Model: efficientnet-b0

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: Vulkan GPU - Model: efficientnet-b0GTX 1060GTX 1660 SUPERGTX 1660 TiRTX 2060RTX 2060 SUPERRTX 2070RTX 2070 SUPERRTX 2080RTX 2080 SUPERRTX 2080 TiRTX 3060 TiRTX 3080TITAN RTX0.8461.6922.5383.3844.23SE +/- 0.06, N = 3SE +/- 0.05, N = 15SE +/- 0.04, N = 3SE +/- 0.06, N = 15SE +/- 0.10, N = 3SE +/- 0.12, N = 3SE +/- 0.11, N = 3SE +/- 0.05, N = 15SE +/- 0.05, N = 15SE +/- 0.06, N = 15SE +/- 0.13, N = 3SE +/- 0.11, N = 12SE +/- 0.06, N = 153.762.883.632.923.352.792.762.662.612.733.033.133.33MIN: 3.48 / MAX: 21.65MIN: 2.62 / MAX: 21.44MIN: 2.65 / MAX: 22.19MIN: 2.59 / MAX: 22.74MIN: 2.54 / MAX: 22.25MIN: 2.6 / MAX: 19.01MIN: 2.48 / MAX: 17.56MIN: 2.53 / MAX: 22.5MIN: 2.42 / MAX: 20.41MIN: 2.45 / MAX: 21.05MIN: 2.72 / MAX: 20.75MIN: 2.61 / MAX: 20.61MIN: 2.48 / MAX: 22.51. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: Vulkan GPU - Model: blazeface

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: Vulkan GPU - Model: blazefaceGTX 1060GTX 1660 SUPERGTX 1660 TiRTX 2060RTX 2060 SUPERRTX 2070RTX 2070 SUPERRTX 2080RTX 2080 SUPERRTX 2080 TiRTX 3060 TiRTX 3080TITAN RTX0.18230.36460.54690.72920.9115SE +/- 0.13, N = 3SE +/- 0.04, N = 15SE +/- 0.00, N = 3SE +/- 0.04, N = 15SE +/- 0.02, N = 3SE +/- 0.01, N = 3SE +/- 0.04, N = 3SE +/- 0.01, N = 15SE +/- 0.03, N = 15SE +/- 0.05, N = 15SE +/- 0.02, N = 3SE +/- 0.02, N = 12SE +/- 0.06, N = 150.800.640.720.670.720.580.630.610.630.680.630.640.81MIN: 0.63 / MAX: 19.93MIN: 0.56 / MAX: 26.92MIN: 0.57 / MAX: 6.28MIN: 0.56 / MAX: 23.74MIN: 0.55 / MAX: 7.89MIN: 0.57 / MAX: 0.84MIN: 0.56 / MAX: 20.82MIN: 0.54 / MAX: 21.62MIN: 0.54 / MAX: 27.09MIN: 0.52 / MAX: 27.01MIN: 0.57 / MAX: 9MIN: 0.51 / MAX: 30.84MIN: 0.51 / MAX: 27.191. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: Vulkan GPU - Model: googlenet

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: Vulkan GPU - Model: googlenetGTX 1060GTX 1660 SUPERGTX 1660 TiRTX 2060RTX 2060 SUPERRTX 2070RTX 2070 SUPERRTX 2080RTX 2080 SUPERRTX 2080 TiRTX 3060 TiRTX 3080TITAN RTX1.19482.38963.58444.77925.974SE +/- 0.10, N = 3SE +/- 0.07, N = 15SE +/- 0.15, N = 3SE +/- 0.06, N = 15SE +/- 0.06, N = 3SE +/- 0.11, N = 3SE +/- 0.11, N = 3SE +/- 0.05, N = 15SE +/- 0.04, N = 15SE +/- 0.06, N = 15SE +/- 0.01, N = 3SE +/- 0.09, N = 12SE +/- 0.07, N = 155.313.934.333.574.163.433.233.293.123.103.443.883.73MIN: 4.95 / MAX: 24.26MIN: 3.5 / MAX: 21.95MIN: 3.53 / MAX: 24.2MIN: 3.3 / MAX: 22.32MIN: 3.15 / MAX: 21.29MIN: 3.19 / MAX: 21.25MIN: 3.02 / MAX: 18.59MIN: 3.03 / MAX: 22.52MIN: 2.89 / MAX: 20.85MIN: 2.84 / MAX: 21.01MIN: 3.41 / MAX: 3.96MIN: 3.16 / MAX: 22.34MIN: 2.87 / MAX: 23.311. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: Vulkan GPU - Model: vgg16

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: Vulkan GPU - Model: vgg16GTX 1060GTX 1660 SUPERGTX 1660 TiRTX 2060RTX 2060 SUPERRTX 2070RTX 2070 SUPERRTX 2080RTX 2080 SUPERRTX 2080 TiRTX 3060 TiRTX 3080TITAN RTX510152025SE +/- 0.04, N = 3SE +/- 0.04, N = 15SE +/- 0.14, N = 3SE +/- 0.05, N = 15SE +/- 0.11, N = 3SE +/- 0.07, N = 3SE +/- 0.04, N = 3SE +/- 0.05, N = 15SE +/- 0.06, N = 15SE +/- 0.04, N = 15SE +/- 0.04, N = 3SE +/- 0.07, N = 12SE +/- 0.03, N = 1518.5413.9715.0910.329.858.968.207.697.445.686.024.716.28MIN: 17.62 / MAX: 31.07MIN: 11.92 / MAX: 39.63MIN: 12.16 / MAX: 32.96MIN: 9.24 / MAX: 31.92MIN: 8.27 / MAX: 27.4MIN: 7.8 / MAX: 24.64MIN: 6.99 / MAX: 25.35MIN: 6.57 / MAX: 26.43MIN: 6.29 / MAX: 26.19MIN: 5 / MAX: 27.84MIN: 5.48 / MAX: 23.38MIN: 4 / MAX: 20.55MIN: 4.88 / MAX: 25.091. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: Vulkan GPU - Model: resnet18

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: Vulkan GPU - Model: resnet18GTX 1060GTX 1660 SUPERGTX 1660 TiRTX 2060RTX 2060 SUPERRTX 2070RTX 2070 SUPERRTX 2080RTX 2080 SUPERRTX 2080 TiRTX 3060 TiRTX 3080TITAN RTX0.73351.4672.20052.9343.6675SE +/- 0.19, N = 3SE +/- 0.04, N = 15SE +/- 0.02, N = 3SE +/- 0.04, N = 15SE +/- 0.02, N = 2SE +/- 0.06, N = 3SE +/- 0.03, N = 14SE +/- 0.04, N = 13SE +/- 0.02, N = 15SE +/- 0.16, N = 3SE +/- 0.01, N = 11SE +/- 0.08, N = 143.262.322.381.981.911.741.661.551.521.301.701.311.73MIN: 2.96 / MAX: 19.72MIN: 2.11 / MAX: 25.13MIN: 2.08 / MAX: 9.06MIN: 1.8 / MAX: 19.93MIN: 1.62 / MAX: 7.23MIN: 1.62 / MAX: 17.79MIN: 1.52 / MAX: 18.57MIN: 1.44 / MAX: 18.28MIN: 1.39 / MAX: 15.39MIN: 1.22 / MAX: 20.6MIN: 1.36 / MAX: 19.31MIN: 1.18 / MAX: 9.46MIN: 1.22 / MAX: 19.761. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: Vulkan GPU - Model: alexnet

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: Vulkan GPU - Model: alexnetGTX 1060GTX 1660 SUPERGTX 1660 TiRTX 2060RTX 2060 SUPERRTX 2070RTX 2070 SUPERRTX 2080RTX 2080 SUPERRTX 2080 TiRTX 3060 TiRTX 3080TITAN RTX1.22632.45263.67894.90526.1315SE +/- 0.08, N = 3SE +/- 0.06, N = 15SE +/- 0.18, N = 3SE +/- 0.07, N = 15SE +/- 0.20, N = 3SE +/- 0.04, N = 3SE +/- 0.01, N = 3SE +/- 0.08, N = 15SE +/- 0.03, N = 15SE +/- 0.07, N = 15SE +/- 0.03, N = 3SE +/- 0.11, N = 11SE +/- 0.06, N = 125.453.043.552.562.802.142.002.211.961.721.651.821.96MIN: 4.92 / MAX: 21.52MIN: 2.39 / MAX: 19.77MIN: 2.36 / MAX: 22.1MIN: 2.18 / MAX: 22.08MIN: 1.81 / MAX: 26MIN: 1.83 / MAX: 17.66MIN: 1.74 / MAX: 2.9MIN: 1.72 / MAX: 22.49MIN: 1.61 / MAX: 19.29MIN: 1.47 / MAX: 22.17MIN: 1.57 / MAX: 16.93MIN: 1.4 / MAX: 22.36MIN: 1.49 / MAX: 22.411. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: Vulkan GPU - Model: resnet50

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: Vulkan GPU - Model: resnet50GTX 1060GTX 1660 SUPERGTX 1660 TiRTX 2060RTX 2060 SUPERRTX 2070RTX 2070 SUPERRTX 2080RTX 2080 SUPERRTX 2080 TiRTX 3060 TiRTX 3080TITAN RTX246810SE +/- 0.15, N = 3SE +/- 0.04, N = 15SE +/- 0.07, N = 3SE +/- 0.06, N = 15SE +/- 0.04, N = 3SE +/- 0.07, N = 3SE +/- 0.24, N = 3SE +/- 0.07, N = 15SE +/- 0.07, N = 14SE +/- 0.08, N = 15SE +/- 0.09, N = 3SE +/- 0.07, N = 12SE +/- 0.08, N = 157.625.256.034.434.653.933.843.723.523.303.723.513.88MIN: 7.05 / MAX: 23.24MIN: 4.76 / MAX: 22.66MIN: 4.75 / MAX: 21.46MIN: 4.07 / MAX: 22.33MIN: 3.72 / MAX: 21.74MIN: 3.73 / MAX: 21.52MIN: 3.47 / MAX: 18.13MIN: 3.38 / MAX: 22.49MIN: 3.25 / MAX: 21.15MIN: 2.94 / MAX: 22.59MIN: 3.41 / MAX: 21.31MIN: 2.98 / MAX: 20.05MIN: 2.96 / MAX: 22.651. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: Vulkan GPU - Model: yolov4-tiny

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: Vulkan GPU - Model: yolov4-tinyGTX 1060GTX 1660 SUPERGTX 1660 TiRTX 2060RTX 2060 SUPERRTX 2070RTX 2070 SUPERRTX 2080RTX 2080 SUPERRTX 2080 TiRTX 3060 TiRTX 3080TITAN RTX3691215SE +/- 0.13, N = 3SE +/- 0.08, N = 15SE +/- 0.17, N = 3SE +/- 0.08, N = 15SE +/- 0.14, N = 3SE +/- 0.15, N = 3SE +/- 0.16, N = 3SE +/- 0.05, N = 15SE +/- 0.07, N = 15SE +/- 0.05, N = 15SE +/- 0.05, N = 3SE +/- 0.05, N = 12SE +/- 0.06, N = 159.878.589.307.848.547.277.197.027.076.536.566.507.47MIN: 8.6 / MAX: 40.07MIN: 7.66 / MAX: 46.65MIN: 7.65 / MAX: 39.63MIN: 6.94 / MAX: 43.56MIN: 6.69 / MAX: 41.56MIN: 6.66 / MAX: 39.39MIN: 6.45 / MAX: 39.21MIN: 6.22 / MAX: 40.65MIN: 6.15 / MAX: 40.21MIN: 5.8 / MAX: 39.76MIN: 5.89 / MAX: 39.85MIN: 5.43 / MAX: 43.21MIN: 5.76 / MAX: 49.681. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OctaneBench

Total Score

OpenBenchmarking.orgScore, More Is BetterOctaneBench 2020.1Total ScoreGTX 1060GTX 1660 SUPERGTX 1660 TiRTX 2060RTX 2060 SUPERRTX 2070RTX 2070 SUPERRTX 2080RTX 2080 SUPERRTX 2080 TiRTX 3060 TiRTX 3080TITAN RTX12024036048060080.91131.86124.74192.60225.41242.73258.47259.16265.15349.41378.71537.24350.66

OctaneBench

Total Score

OpenBenchmarking.orgScore Per Watt, More Is BetterOctaneBench 2020.1Total ScoreGTX 1060GTX 1660 SUPERGTX 1660 TiRTX 2060RTX 2060 SUPERRTX 2070RTX 2070 SUPERRTX 2080RTX 2080 SUPERRTX 2080 TiRTX 3060 TiRTX 3080TITAN RTX0.5131.0261.5392.0522.5651.061.211.281.631.571.721.681.591.731.552.281.871.50

PlaidML

FP16: Yes - Mode: Inference - Network: Mobilenet - Device: OpenCL

OpenBenchmarking.orgFPS, More Is BetterPlaidMLFP16: Yes - Mode: Inference - Network: Mobilenet - Device: OpenCLGTX 1060GTX 1660 SUPERGTX 1660 TiRTX 2060RTX 2060 SUPERRTX 2070RTX 2070 SUPERRTX 2080RTX 2080 SUPERRTX 2080 TiRTX 3060 TiRTX 3080TITAN RTX8001600240032004000SE +/- 1.08, N = 7SE +/- 4.66, N = 7SE +/- 1.98, N = 8SE +/- 20.43, N = 15SE +/- 9.97, N = 8SE +/- 3.85, N = 8SE +/- 11.50, N = 8SE +/- 7.50, N = 8SE +/- 7.43, N = 8SE +/- 9.32, N = 8SE +/- 1.48, N = 8SE +/- 17.78, N = 8SE +/- 19.10, N = 8982.701371.101351.921696.451952.072008.992297.002340.012480.883227.212439.193725.403284.45

PlaidML

FP16: Yes - Mode: Inference - Network: Mobilenet - Device: OpenCL

OpenBenchmarking.orgFPS Per Watt, More Is BetterPlaidMLFP16: Yes - Mode: Inference - Network: Mobilenet - Device: OpenCLGTX 1060GTX 1660 SUPERGTX 1660 TiRTX 2060RTX 2060 SUPERRTX 2070RTX 2070 SUPERRTX 2080RTX 2080 SUPERRTX 2080 TiRTX 3060 TiRTX 3080TITAN RTX112233445519.8528.5333.0333.1434.9541.2236.7836.2443.2749.6745.6643.2241.53

PlaidML

FP16: No - Mode: Inference - Network: Mobilenet - Device: OpenCL

OpenBenchmarking.orgFPS, More Is BetterPlaidMLFP16: No - Mode: Inference - Network: Mobilenet - Device: OpenCLGTX 1060GTX 1660 SUPERGTX 1660 TiRTX 2060RTX 2060 SUPERRTX 2070RTX 2070 SUPERRTX 2080RTX 2080 SUPERRTX 2080 TiRTX 3060 TiRTX 3080TITAN RTX6001200180024003000SE +/- 1.55, N = 7SE +/- 3.18, N = 7SE +/- 1.27, N = 8SE +/- 3.21, N = 8SE +/- 3.27, N = 8SE +/- 2.41, N = 9SE +/- 6.37, N = 9SE +/- 3.83, N = 8SE +/- 3.49, N = 8SE +/- 8.40, N = 9SE +/- 2.49, N = 8SE +/- 9.67, N = 9SE +/- 5.99, N = 9778.991075.07985.971282.521509.021580.071707.651714.001831.762405.891875.832995.562394.82

PlaidML

FP16: No - Mode: Inference - Network: Mobilenet - Device: OpenCL

OpenBenchmarking.orgFPS Per Watt, More Is BetterPlaidMLFP16: No - Mode: Inference - Network: Mobilenet - Device: OpenCLGTX 1060GTX 1660 SUPERGTX 1660 TiRTX 2060RTX 2060 SUPERRTX 2070RTX 2070 SUPERRTX 2080RTX 2080 SUPERRTX 2080 TiRTX 3060 TiRTX 3080TITAN RTX71421283514.0919.7020.9121.4923.5125.2425.0924.6928.1129.9031.5529.9026.40

PlaidML

FP16: No - Mode: Inference - Network: DenseNet 201 - Device: OpenCL

OpenBenchmarking.orgFPS, More Is BetterPlaidMLFP16: No - Mode: Inference - Network: DenseNet 201 - Device: OpenCLGTX 1060GTX 1660 SUPERGTX 1660 TiRTX 2060RTX 2060 SUPERRTX 2070RTX 2070 SUPERRTX 2080RTX 2080 SUPERRTX 2080 TiRTX 3060 TiRTX 3080TITAN RTX50100150200250SE +/- 0.00, N = 3SE +/- 0.04, N = 3SE +/- 0.13, N = 3SE +/- 0.08, N = 3SE +/- 0.20, N = 3SE +/- 0.16, N = 3SE +/- 0.09, N = 3SE +/- 0.24, N = 3SE +/- 0.16, N = 3SE +/- 0.21, N = 3SE +/- 0.22, N = 3SE +/- 0.38, N = 3SE +/- 0.27, N = 378.9799.4993.61124.27137.81148.07148.55150.94159.34211.01177.04243.50208.22

PlaidML

FP16: No - Mode: Inference - Network: DenseNet 201 - Device: OpenCL

OpenBenchmarking.orgFPS Per Watt, More Is BetterPlaidMLFP16: No - Mode: Inference - Network: DenseNet 201 - Device: OpenCLGTX 1060GTX 1660 SUPERGTX 1660 TiRTX 2060RTX 2060 SUPERRTX 2070RTX 2070 SUPERRTX 2080RTX 2080 SUPERRTX 2080 TiRTX 3060 TiRTX 3080TITAN RTX0.59851.1971.79552.3942.99251.491.741.321.491.371.551.461.642.091.652.661.941.53

PlaidML

FP16: No - Mode: Inference - Network: IMDB LSTM - Device: OpenCL

OpenBenchmarking.orgFPS, More Is BetterPlaidMLFP16: No - Mode: Inference - Network: IMDB LSTM - Device: OpenCLGTX 1060GTX 1660 SUPERGTX 1660 TiRTX 2060RTX 2060 SUPERRTX 2070RTX 2070 SUPERRTX 2080RTX 2080 SUPERRTX 2080 TiRTX 3060 TiRTX 3080TITAN RTX2004006008001000SE +/- 0.32, N = 4SE +/- 0.24, N = 4SE +/- 0.27, N = 5SE +/- 0.32, N = 5SE +/- 0.34, N = 5SE +/- 0.20, N = 5SE +/- 0.88, N = 6SE +/- 0.60, N = 5SE +/- 0.40, N = 6SE +/- 0.56, N = 6SE +/- 0.90, N = 6SE +/- 2.17, N = 6SE +/- 1.90, N = 6226.15296.82299.07389.45416.15447.06498.24544.72587.72747.50686.66975.56718.51

PlaidML

FP16: No - Mode: Inference - Network: IMDB LSTM - Device: OpenCL

OpenBenchmarking.orgFPS Per Watt, More Is BetterPlaidMLFP16: No - Mode: Inference - Network: IMDB LSTM - Device: OpenCLGTX 1060GTX 1660 SUPERGTX 1660 TiRTX 2060RTX 2060 SUPERRTX 2070RTX 2070 SUPERRTX 2080RTX 2080 SUPERRTX 2080 TiRTX 3060 TiRTX 3080TITAN RTX36912153.484.785.145.104.996.126.036.187.047.719.368.306.56

RealSR-NCNN

Scale: 4x - TAA: Yes

OpenBenchmarking.orgSeconds, Fewer Is BetterRealSR-NCNN 20200818Scale: 4x - TAA: YesGTX 1060GTX 1660 SUPERGTX 1660 TiRTX 2060RTX 2060 SUPERRTX 2070RTX 2070 SUPERRTX 2080RTX 2080 SUPERRTX 2080 TiRTX 3060 TiRTX 3080TITAN RTX306090120150SE +/- 0.24, N = 3SE +/- 0.11, N = 3SE +/- 0.17, N = 3SE +/- 0.26, N = 3SE +/- 0.34, N = 3SE +/- 0.43, N = 3SE +/- 0.18, N = 3SE +/- 0.31, N = 3SE +/- 0.14, N = 3SE +/- 0.16, N = 3SE +/- 0.07, N = 3SE +/- 0.17, N = 3SE +/- 0.18, N = 3144.63120.91123.8586.6080.5974.8163.7560.1054.7844.7352.4735.7245.55

RealSR-NCNN

Scale: 4x - TAA: No

OpenBenchmarking.orgSeconds, Fewer Is BetterRealSR-NCNN 20200818Scale: 4x - TAA: NoGTX 1060GTX 1660 SUPERGTX 1660 TiRTX 2060RTX 2060 SUPERRTX 2070RTX 2070 SUPERRTX 2080RTX 2080 SUPERRTX 2080 TiRTX 3060 TiRTX 3080TITAN RTX510152025SE +/- 0.017, N = 3SE +/- 0.026, N = 3SE +/- 0.034, N = 3SE +/- 0.015, N = 4SE +/- 0.021, N = 4SE +/- 0.014, N = 4SE +/- 0.031, N = 5SE +/- 0.033, N = 5SE +/- 0.029, N = 5SE +/- 0.011, N = 6SE +/- 0.025, N = 5SE +/- 0.012, N = 6SE +/- 0.028, N = 620.12817.21417.73312.93612.37711.53710.2069.6119.0317.7438.6336.5768.009

RedShift Demo

OpenBenchmarking.orgSeconds, Fewer Is BetterRedShift Demo 3.0GTX 1060GTX 1660 SUPERGTX 1660 TiRTX 2060RTX 2060 SUPERRTX 2070RTX 2070 SUPERRTX 2080RTX 2080 SUPERRTX 2080 TiRTX 3060 TiRTX 3080TITAN RTX2004006008001000SE +/- 1.20, N = 3SE +/- 0.33, N = 3SE +/- 1.86, N = 3SE +/- 0.67, N = 3SE +/- 0.33, N = 3SE +/- 0.33, N = 3SE +/- 0.58, N = 31064764833479402373352342325247240172256

Rodinia

Test: OpenCL Particle Filter

OpenBenchmarking.orgSeconds, Fewer Is BetterRodinia 3.1Test: OpenCL Particle FilterGTX 1060GTX 1660 SUPERGTX 1660 TiRTX 2060RTX 2060 SUPERRTX 2070RTX 2070 SUPERRTX 2080RTX 2080 SUPERRTX 2080 TiRTX 3060 TiRTX 3080TITAN RTX3691215SE +/- 0.068, N = 4SE +/- 0.014, N = 4SE +/- 0.022, N = 4SE +/- 0.020, N = 5SE +/- 0.021, N = 5SE +/- 0.006, N = 6SE +/- 0.018, N = 6SE +/- 0.045, N = 6SE +/- 0.014, N = 7SE +/- 0.007, N = 8SE +/- 0.008, N = 6SE +/- 0.035, N = 15SE +/- 0.008, N = 812.10511.61711.7469.0048.6567.8046.9806.3555.9044.4916.9884.8554.8051. (CXX) g++ options: -O2 -lOpenCL

ViennaCL

OpenCL LU Factorization

OpenBenchmarking.orgGFLOPS, More Is BetterViennaCL 1.4.2OpenCL LU FactorizationGTX 1060GTX 1660 SUPERGTX 1660 TiRTX 2060RTX 2060 SUPERRTX 2070RTX 2070 SUPERRTX 2080RTX 2080 SUPERRTX 2080 TiRTX 3060 TiRTX 3080TITAN RTX20406080100SE +/- 0.50, N = 11SE +/- 0.28, N = 11SE +/- 0.22, N = 11SE +/- 0.34, N = 11SE +/- 0.29, N = 11SE +/- 0.23, N = 11SE +/- 0.35, N = 11SE +/- 0.44, N = 11SE +/- 0.39, N = 12SE +/- 0.46, N = 12SE +/- 0.23, N = 12SE +/- 0.35, N = 15SE +/- 0.60, N = 1161.7368.7168.6172.8372.3375.0975.7476.1377.1178.6175.8377.9576.271. (CXX) g++ options: -rdynamic -lOpenCL

ViennaCL

OpenCL LU Factorization

OpenBenchmarking.orgGFLOPS Per Watt, More Is BetterViennaCL 1.4.2OpenCL LU FactorizationGTX 1060GTX 1660 SUPERGTX 1660 TiRTX 2060RTX 2060 SUPERRTX 2070RTX 2070 SUPERRTX 2080RTX 2080 SUPERRTX 2080 TiRTX 3060 TiRTX 3080TITAN RTX0.52651.0531.57952.1062.63251.582.142.342.031.782.311.771.711.741.851.941.201.13

VkFFT

OpenBenchmarking.orgBenchmark Score, More Is BetterVkFFT 2020-09-29GTX 1060GTX 1660 SUPERGTX 1660 TiRTX 2060RTX 2060 SUPERRTX 2070RTX 2070 SUPERRTX 2080RTX 2080 SUPERRTX 2080 TiRTX 3060 TiRTX 3080TITAN RTX11K22K33K44K55KSE +/- 4.67, N = 3SE +/- 34.18, N = 3SE +/- 14.84, N = 3SE +/- 27.14, N = 3SE +/- 51.26, N = 3SE +/- 10.04, N = 3SE +/- 58.08, N = 3SE +/- 62.43, N = 3SE +/- 53.90, N = 3SE +/- 82.79, N = 3SE +/- 25.15, N = 3SE +/- 166.79, N = 3SE +/- 118.84, N = 312788184501709720883249752660027682285643072037384320654963136933

VkFFT

OpenBenchmarking.orgBenchmark Score Per Watt, More Is BetterVkFFT 2020-09-29GTX 1060GTX 1660 SUPERGTX 1660 TiRTX 2060RTX 2060 SUPERRTX 2070RTX 2070 SUPERRTX 2080RTX 2080 SUPERRTX 2080 TiRTX 3060 TiRTX 3080TITAN RTX70140210280350188.54227.18241.67235.12250.53286.99264.03253.77281.33287.99328.58329.04261.32

Waifu2x-NCNN Vulkan

Scale: 2x - Denoise: 3 - TAA: Yes

OpenBenchmarking.orgSeconds, Fewer Is BetterWaifu2x-NCNN Vulkan 20200818Scale: 2x - Denoise: 3 - TAA: YesGTX 1060GTX 1660 SUPERGTX 1660 TiRTX 2060RTX 2060 SUPERRTX 2070RTX 2070 SUPERRTX 2080RTX 2080 SUPERRTX 2080 TiRTX 3060 TiRTX 3080TITAN RTX3691215SE +/- 0.036, N = 5SE +/- 0.026, N = 6SE +/- 0.030, N = 6SE +/- 0.029, N = 7SE +/- 0.030, N = 7SE +/- 0.022, N = 7SE +/- 0.028, N = 8SE +/- 0.020, N = 8SE +/- 0.020, N = 8SE +/- 0.021, N = 8SE +/- 0.032, N = 8SE +/- 0.028, N = 9SE +/- 0.023, N = 89.2517.0607.2435.7925.5535.2114.7694.5824.3683.8354.2363.5194.124


Phoronix Test Suite v10.8.4