NVIDIA Linux OpenCL CUDA RTX SUPER Compute

NVIDIA GeForce RTX SUPER Linux OpenCL/CUDA GPU compute benchmarks by Michael Larabel for a future article.

HTML result view exported from: https://openbenchmarking.org/result/1909299-AS-RTXSUPERC34&sor.

NVIDIA Linux OpenCL CUDA RTX SUPER ComputeProcessorMotherboardChipsetMemoryDiskGraphicsAudioMonitorNetworkOSKernelDesktopDisplay ServerDisplay DriverOpenGLCompilerFile-SystemScreen ResolutionGTX 970GTX 980GTX 980 TiGTX 1060GTX 1070GTX 1070 TiGTX 1080GTX 1080 TiGTX 1660GTX 1660 TiRTX 2060RTX 2060 SUPERRTX 2070RTX 2070 SUPERRTX 2080RTX 2080 SUPERRTX 2080 TiTITAN RTXIntel Core i9-9900K @ 5.00GHz (8 Cores / 16 Threads)ASUS PRIME Z390-A (0802 BIOS)Intel Cannon Lake PCH16384MBSamsung SSD 970 EVO 250GBeVGA NVIDIA GeForce GTX 970 4GB (1163/3505MHz)Realtek ALC1220Acer B286HKIntel I219-VUbuntu 19.045.0.0-29-generic (x86_64)GNOME Shell 3.32.2X Server 1.20.4NVIDIA 435.214.6.0GCC 8.3.0ext43840x2160NVIDIA GeForce GTX 980 4GB (1126/3505MHz)NVIDIA GeForce GTX 980 Ti 6GB (999/3505MHz)5.3.0-999-generic (x86_64) 20190914NVIDIA GeForce GTX 1060 6GB (1506/4006MHz)5.0.0-29-generic (x86_64)NVIDIA GeForce GTX 1070 8GB (1506/4006MHz)Zotac NVIDIA GeForce GTX 1070 Ti 8GB (1607/4006MHz)NVIDIA GeForce GTX 1080 8GB (1607/5005MHz)NVIDIA GeForce GTX 1080 Ti 11GB (1480/5508MHz)ASUS NVIDIA GeForce GTX 1660 6GB (1530/4001MHz)eVGA NVIDIA GeForce GTX 1660 Ti 6GB (1500/6000MHz)NVIDIA GeForce RTX 2060 6GB (1365/7000MHz)NVIDIA GeForce RTX 2060 SUPER 8GB (1470/7000MHz)5.3.0-999-generic (x86_64) 20190914ASUS NVIDIA GeForce RTX 2070 8GB (1410/7000MHz)5.0.0-29-generic (x86_64)NVIDIA GeForce RTX 2070 SUPER 8GB (1605/7000MHz)5.3.0-999-generic (x86_64) 20190914Zotac NVIDIA GeForce RTX 2080 8GB (795/810MHz)5.0.0-29-generic (x86_64)NVIDIA GeForce RTX 2080 SUPER 8GB (1650/7750MHz)5.3.0-999-generic (x86_64) 20190914NVIDIA GeForce RTX 2080 Ti 11GB (1350/7000MHz)5.0.0-29-generic (x86_64)NVIDIA TITAN RTX 24GB (1350/7000MHz)5.3.0-999-generic (x86_64) 20190914OpenBenchmarking.orgCompiler Details- --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-bootstrap --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++ --enable-libmpx --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib --with-tune=generic --without-cuda-driver -vProcessor Details- Scaling Governor: intel_pstate performanceOpenCL Details- GTX 970: GPU Compute Cores: 1664- GTX 980: GPU Compute Cores: 2048- GTX 980 Ti: GPU Compute Cores: 2816- GTX 1060: GPU Compute Cores: 1280- GTX 1070: GPU Compute Cores: 1920- GTX 1070 Ti: GPU Compute Cores: 2432- GTX 1080: GPU Compute Cores: 2560- GTX 1080 Ti: GPU Compute Cores: 3584- GTX 1660: GPU Compute Cores: 1408- GTX 1660 Ti: GPU Compute Cores: 1536- RTX 2060: GPU Compute Cores: 1920- RTX 2060 SUPER: GPU Compute Cores: 2176- RTX 2070: GPU Compute Cores: 2304- RTX 2070 SUPER: GPU Compute Cores: 2560- RTX 2080: GPU Compute Cores: 2944- RTX 2080 SUPER: GPU Compute Cores: 3072- RTX 2080 Ti: GPU Compute Cores: 4352- TITAN RTX: GPU Compute Cores: 4608Python Details- GTX 970, GTX 980, GTX 980 Ti, GTX 1060, GTX 1070, GTX 1070 Ti, GTX 1080, GTX 1080 Ti, GTX 1660, GTX 1660 Ti, RTX 2060, RTX 2070, RTX 2070 SUPER, RTX 2080, RTX 2080 SUPER, RTX 2080 Ti, TITAN RTX: Python 2.7.16 + Python 3.7.3Security Details- l1tf: Not affected + mds: Mitigation of Clear buffers; SMT vulnerable + meltdown: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Full generic retpoline IBPB: conditional IBRS_FW STIBP: conditional RSB filling

NVIDIA Linux OpenCL CUDA RTX SUPER Computefahbench: namd-cuda: ATPase Simulation - 327,506 Atomsluxmark: GPU - Luxball HDRluxmark: GPU - Microphoneluxmark: GPU - Hoteldarktable: Boat - OpenCLdarktable: Masskrug - OpenCLdarktable: Server Room - OpenCLrodinia: OpenCL Myocyterodinia: OpenCL Particle Filterviennacl: OpenCL LU Factorizationcl-mem: Copyshoc: OpenCL - Max SP Flopsshoc: OpenCL - FFT SPshoc: OpenCL - MD5 Hashjuliagpu: GPUclpeak: Global Memory Bandwidthclpeak: Single-Precision Floatclpeak: Double-Precision Doubleclpeak: Integer Compute INTcl-mem: Readcl-mem: Writeplaidml: Yes - Inference - Mobilenet - OpenCLplaidml: Yes - Inference - Inception V3 - OpenCLplaidml: Yes - Inference - ResNet 50 - OpenCLplaidml: Yes - Inference - NASNer Large - OpenCLplaidml: Yes - Inference - DenseNet 201 - OpenCLplaidml: Yes - Inference - VGG16 - OpenCLplaidml: Yes - Inference - VGG19 - OpenCLplaidml: No - Inference - Mobilenet - OpenCLplaidml: No - Inference - Inception V3 - OpenCLplaidml: No - Inference - ResNet 50 - OpenCLplaidml: No - Inference - IMDB LSTM - OpenCLplaidml: No - Inference - VGG16 - OpenCLplaidml: No - Inference - VGG19 - OpenCLlczero: OpenCLoctanebench: Total ScoreGTX 970GTX 980GTX 980 TiGTX 1060GTX 1070GTX 1070 TiGTX 1080GTX 1080 TiGTX 1660GTX 1660 TiRTX 2060RTX 2060 SUPERRTX 2070RTX 2070 SUPERRTX 2080RTX 2080 SUPERRTX 2080 TiTITAN RTX91.530.3636811732798527304.425.783.1645.4812.9956.95124.774362.31411.296.50169258044.90143.483888.16137.471140.29142.10132.60841.4888.16116.0521.4279.7149.7639.34671.4994.72181.87204.3260.3247.70207.8495.60102.860.3311013246891430483.925.743.1047.3811.6959.21143.405052.73458.357.49181882709.77164.254476.69159.681312.06164.50151.50973.39101.92142.1424.2492.9255.7043.63759.43105.64203.91231.6668.9553.49280.99109.70116.020.28675168711109638853.274.121.5152.139.9562.01216.836213.97725.989.22195653728.47263.225538.75196.601610.28265.33241.501202.77116.31162.6330.64111.4671.2656.13990.12135.14247.47270.0087.3968.47466.84142.20102.610.3178912245708626483.654.071.2834.6911.9358.67137.204788.92326.687.26182188318.67146.624199.71149.581267.89153.50144.57908.4397.83130.6423.1691.0756.0744.37726.30104.44196.00224.8969.3154.78262.4191.44140.290.2395717290998338702.893.921.1135.108.2663.86182.007115.39478.5410.61216942144.93196.476269.49223.911685.05205.27190.901288.94141.55196.0133.07127.0280.2763.56987.69147.17276.89315.3797.3276.89642.12132.86138.210.22269169251025941702.933.971.1738.707.8864.68182.707715.42525.8911.70220447755.87197.266770.97242.632076.93205.27190.031371.21147.04205.8535.41130.1592.0373.121009.26153.34294.36333.03114.0390.34753.69141.35155.220.2097813788871638072.723.941.0934.876.4966.67205.939407.75614.6914.25237914974.40222.098314.29297.942430.74228.80214.671544.50173.79240.6240.38143.53106.0983.831123.85184.80337.47399.00128.05101.001146.75147.98198.250.19669216891372156492.293.921.0535.914.9669.09283.2013230.77982.2319.72262248899.33328.9011720.57414.963301.89337.53340.272162.58228.68333.5456.64191.31145.42115.031672.73257.55496.24523.98175.37138.681886.30212.04126.640.2503115162979437333.354.011.1830.9711.8765.10145.375329.84452.8911.87230919642.13157.604610.01168.444657.79162.90148.871160.52137.66156.5028.99102.8366.2452.52814.65116.90228.14287.6884.8367.24335.86118.49139.810.23185161471100338052.924.021.1530.6710.8266.06208.505893.41665.6612.98239300837.60234.674793.66185.124775.45250.23208.671394.05161.33172.6834.12114.5873.1858.031002.00140.05259.43315.8392.4573.35420.04132.28183.410.20250216831375448332.223.730.8331.118.9067.92237.777320.73818.4416.04251925176.90275.865329.07231.445269.01296.20241.201694.07193.75220.4441.11154.1989.5571.071232.47167.87319.25389.40110.9388.04704.69164.52205.200.19336300931850961481.953.680.7530.427.8769.17287.808378.87971.2418.22264172441.47367.927089.50263.117023.07395.67333.201983.82219.76250.9848.96179.51102.5880.821531.01199.43374.71440.79128.22101.17998.17205.23204.710.19440300971844161501.933.670.7531.647.7569.41284.438528.70976.7818.77267086274.53368.967198.64268.327161.48395.70322.671969.50220.99251.0749.94176.49105.6083.561516.96198.03376.73446.23131.54103.89999.75206.88229.120.19501297342049965651.933.710.8030.766.8270.45291.879869.341088.1721.78275868151.17369.118502.71310.278570.60395.67319.572264.97239.61283.9855.24190.01123.2097.821649.17215.85421.58499.69154.64122.321604.21220.76242.750.19307291641991665901.903.710.8031.656.2270.96289.2010952.771100.0024.07280162469.67368.478883.90345.819660.92395.70331.502292.38268.33305.7658.47189.28133.20105.541663.87238.73441.24548.83164.05129.581879.99222.88256.830.19385301792016468391.823.690.7930.635.7471.47301.2312015.501203.5726.56286818331.27405.0010335.50378.9810404.71436.27345.772437.48301.11327.8064.80200.38145.65115.441762.00259.26468.70589.86180.45143.022105.26233.56301.890.18909429742863192151.643.660.7531.054.3972.71324.4016656.201485.7334.91299834728.80506.3313532.74521.9013609.33544.33441.232750.57363.16424.0784.97254.45194.83154.202335.46343.49634.09758.21234.65186.193032.10309.04301.930.18867465463075698361.643.660.7431.694.2472.96322.2017334.001578.2936.39303198573.97528.8914203.87547.9713841.25566.70495.372842.38373.71433.8187.17263.13204.67162.052466.66347.93648.36790.77247.83196.443126.48322.76OpenBenchmarking.org

FAHBench

OpenBenchmarking.orgNs Per Day, More Is BetterFAHBench 2.3.2TITAN RTXRTX 2080 TiRTX 2080 SUPERRTX 2080RTX 2070 SUPERRTX 2060 SUPERRTX 2070GTX 1080 TiRTX 2060GTX 1080GTX 1070GTX 1660 TiGTX 1070 TiGTX 1660GTX 980 TiGTX 980GTX 1060GTX 97070140210280350SE +/- 0.71, N = 3SE +/- 0.90, N = 3SE +/- 0.78, N = 3SE +/- 0.99, N = 3SE +/- 0.60, N = 3SE +/- 0.34, N = 3SE +/- 0.64, N = 3SE +/- 0.43, N = 3SE +/- 0.61, N = 3SE +/- 0.53, N = 3SE +/- 0.43, N = 3SE +/- 0.15, N = 3SE +/- 0.05, N = 3SE +/- 0.27, N = 3SE +/- 0.04, N = 3SE +/- 0.08, N = 3SE +/- 0.17, N = 3SE +/- 0.03, N = 3301.93301.89256.83242.75229.12205.20204.71198.25183.41155.22140.29139.81138.21126.64116.02102.86102.6191.53

FAHBench

OpenBenchmarking.orgNs Per Day Per Watt, More Is BetterFAHBench 2.3.2RTX 2080 SUPERRTX 2070 SUPERRTX 2080 TiRTX 2080TITAN RTXRTX 2070RTX 2060 SUPERRTX 2060GTX 1660GTX 1660 TiGTX 1070 TiGTX 1080 TiGTX 1080GTX 1070GTX 1060GTX 980GTX 980 TiGTX 9700.32630.65260.97891.30521.63151.451.421.381.381.331.291.271.211.111.101.101.021.000.960.830.650.620.62

FAHBench

System Power Consumption Monitor

OpenBenchmarking.orgWatts, Fewer Is BetterFAHBench 2.3.2System Power Consumption MonitorGTX 1660GTX 1060GTX 1070 TiGTX 1660 TiGTX 1070GTX 970RTX 2060GTX 1080RTX 2070GTX 980RTX 2060 SUPERRTX 2070 SUPERRTX 2080RTX 2080 SUPERGTX 980 TiGTX 1080 TiRTX 2080 TiTITAN RTX60120180240300Min: 46.5 / Avg: 114.3 / Max: 152.8Min: 66.3 / Avg: 124.04 / Max: 159.6Min: 49.1 / Avg: 125.16 / Max: 155Min: 47.6 / Avg: 127.19 / Max: 170.3Min: 43.8 / Avg: 145.58 / Max: 193.2Min: 48.8 / Avg: 147.69 / Max: 193Min: 45.7 / Avg: 151.46 / Max: 214.2Min: 44.9 / Avg: 154.62 / Max: 208.2Min: 46 / Avg: 158.7 / Max: 226.7Min: 49.8 / Avg: 159.19 / Max: 211.9Min: 48.5 / Avg: 161.35 / Max: 226.3Min: 46.6 / Avg: 161.4 / Max: 230Min: 47.5 / Avg: 176.01 / Max: 263Min: 64 / Avg: 177.55 / Max: 252.2Min: 56.3 / Avg: 186.17 / Max: 244.4Min: 77.6 / Avg: 195.24 / Max: 264.4Min: 49.7 / Avg: 218.05 / Max: 323.3Min: 52.5 / Avg: 226.18 / Max: 324.2

NAMD CUDA

ATPase Simulation - 327,506 Atoms

OpenBenchmarking.orgdays/ns, Fewer Is BetterNAMD CUDA 2.13ATPase Simulation - 327,506 AtomsTITAN RTXRTX 2080 TiRTX 2080RTX 2060 SUPERRTX 2080 SUPERRTX 2070RTX 2070 SUPERGTX 1080 TiRTX 2060GTX 1080GTX 1070 TiGTX 1660 TiGTX 1070GTX 1660GTX 980 TiGTX 1060GTX 980GTX 9700.08180.16360.24540.32720.409SE +/- 0.00297, N = 3SE +/- 0.00238, N = 3SE +/- 0.00199, N = 3SE +/- 0.00245, N = 3SE +/- 0.00233, N = 3SE +/- 0.00250, N = 3SE +/- 0.00245, N = 3SE +/- 0.00044, N = 3SE +/- 0.00147, N = 4SE +/- 0.00088, N = 5SE +/- 0.00075, N = 6SE +/- 0.00192, N = 3SE +/- 0.00195, N = 3SE +/- 0.00287, N = 3SE +/- 0.00105, N = 3SE +/- 0.00303, N = 3SE +/- 0.00159, N = 3SE +/- 0.00026, N = 40.188670.189090.193070.193360.193850.194400.195010.196690.202500.209780.222690.231850.239570.250310.286750.317890.331100.36368

NAMD CUDA

System Power Consumption Monitor

OpenBenchmarking.orgWatts, Fewer Is BetterNAMD CUDA 2.13System Power Consumption MonitorGTX 1660 TiGTX 1660RTX 2060RTX 2070 SUPERGTX 1060GTX 1070 TiRTX 2070GTX 1070TITAN RTXRTX 2080 SUPERRTX 2060 SUPERRTX 2080GTX 980RTX 2080 TiGTX 1080GTX 970GTX 1080 TiGTX 980 Ti70140210280350Min: 47.7 / Avg: 177.22 / Max: 273.9Min: 44.9 / Avg: 177.54 / Max: 262.4Min: 46.1 / Avg: 197.89 / Max: 303.8Min: 47.2 / Avg: 198.42 / Max: 323.3Min: 45.2 / Avg: 198.8 / Max: 269.5Min: 50.3 / Avg: 198.82 / Max: 259.9Min: 50 / Avg: 202.69 / Max: 321.3Min: 48.2 / Avg: 206.59 / Max: 286.9Min: 54.3 / Avg: 214.96 / Max: 367.7Min: 48.8 / Avg: 219.44 / Max: 330.5Min: 48.4 / Avg: 233.81 / Max: 312Min: 52.9 / Avg: 238.49 / Max: 342.9Min: 52.6 / Avg: 238.95 / Max: 329.4Min: 53.9 / Avg: 251.92 / Max: 374Min: 48.6 / Avg: 253.18 / Max: 326.9Min: 51.3 / Avg: 258.19 / Max: 306.3Min: 55.3 / Avg: 266.23 / Max: 380Min: 55.9 / Avg: 272.91 / Max: 370.3

LuxMark

OpenCL Device: GPU - Scene: Luxball HDR

OpenBenchmarking.orgScore, More Is BetterLuxMark 3.1OpenCL Device: GPU - Scene: Luxball HDRTITAN RTXRTX 2080 TiRTX 2080 SUPERRTX 2070RTX 2060 SUPERRTX 2070 SUPERRTX 2080GTX 1080 TiRTX 2060GTX 1070GTX 1070 TiGTX 980 TiGTX 1660 TiGTX 1660GTX 1080GTX 980GTX 1060GTX 97010K20K30K40K50KSE +/- 20.92, N = 3SE +/- 166.33, N = 3SE +/- 0.88, N = 3SE +/- 7.54, N = 3SE +/- 4.93, N = 3SE +/- 98.93, N = 3SE +/- 7.51, N = 3SE +/- 7.67, N = 3SE +/- 0.67, N = 3SE +/- 1.00, N = 3SE +/- 36.50, N = 3SE +/- 39.15, N = 3SE +/- 19.86, N = 3SE +/- 35.04, N = 3SE +/- 17.98, N = 3SE +/- 26.16, N = 3SE +/- 4.00, N = 3SE +/- 6.23, N = 3465464297430179300973009329734291642168921683172901692516871161471516213788132461224511732

LuxMark

OpenCL Device: GPU - Scene: Luxball HDR

OpenBenchmarking.orgScore Per Watt, More Is BetterLuxMark 3.1OpenCL Device: GPU - Scene: Luxball HDRTITAN RTXRTX 2070 SUPERRTX 2080 TiRTX 2060 SUPERRTX 2080 SUPERRTX 2070RTX 2080RTX 2060GTX 1070 TiGTX 1660GTX 1660 TiGTX 1070GTX 1080 TiGTX 1060GTX 1080GTX 980 TiGTX 980GTX 970306090120150137.34136.85131.66131.33130.92130.30119.09112.43111.54108.70102.7595.0388.2683.3476.5570.6467.8765.07

LuxMark

System Power Consumption Monitor

OpenBenchmarking.orgWatts, Fewer Is BetterLuxMark 3.1System Power Consumption MonitorGTX 1660GTX 1060GTX 1070 TiGTX 1660 TiGTX 1080GTX 970GTX 1070RTX 2060GTX 980RTX 2070 SUPERRTX 2060 SUPERRTX 2080 SUPERRTX 2070GTX 980 TiRTX 2080GTX 1080 TiRTX 2080 TiTITAN RTX60120180240300Min: 45.9 / Avg: 139.49 / Max: 144Min: 76 / Avg: 146.92 / Max: 152Min: 52.3 / Avg: 151.74 / Max: 155.9Min: 48.2 / Avg: 157.16 / Max: 163.8Min: 75.8 / Avg: 180.11 / Max: 185.5Min: 52.2 / Avg: 180.29 / Max: 185.6Min: 48.6 / Avg: 181.94 / Max: 188.2Min: 47.4 / Avg: 192.86 / Max: 200.8Min: 87.7 / Avg: 195.16 / Max: 205Min: 47.5 / Avg: 217.27 / Max: 227.7Min: 47.2 / Avg: 229.14 / Max: 241Min: 49.4 / Avg: 230.52 / Max: 238Min: 50.1 / Avg: 230.98 / Max: 243.5Min: 130.4 / Avg: 238.82 / Max: 247.5Min: 52.5 / Avg: 244.9 / Max: 255.3Min: 107.7 / Avg: 245.73 / Max: 254Min: 53.9 / Avg: 326.39 / Max: 340.7Min: 53.7 / Avg: 338.9 / Max: 360.6

LuxMark

OpenCL Device: GPU - Scene: Microphone

OpenBenchmarking.orgScore, More Is BetterLuxMark 3.1OpenCL Device: GPU - Scene: MicrophoneTITAN RTXRTX 2080 TiRTX 2070 SUPERRTX 2080 SUPERRTX 2080RTX 2060 SUPERRTX 2070RTX 2060GTX 1080 TiGTX 980 TiGTX 1660 TiGTX 1070 TiGTX 1070GTX 1660GTX 980GTX 1080GTX 970GTX 10607K14K21K28K35KSE +/- 168.12, N = 3SE +/- 21.50, N = 3SE +/- 16.84, N = 3SE +/- 108.17, N = 3SE +/- 11.68, N = 3SE +/- 43.34, N = 3SE +/- 26.44, N = 3SE +/- 3.84, N = 3SE +/- 19.33, N = 3SE +/- 49.74, N = 3SE +/- 2.33, N = 3SE +/- 15.50, N = 3SE +/- 4.91, N = 3SE +/- 1.33, N = 3SE +/- 18.25, N = 3SE +/- 1.20, N = 3SE +/- 2.00, N = 3SE +/- 1.53, N = 3307562863120499201641991618509184411375413721110961100310259998397948914871679857086

LuxMark

OpenCL Device: GPU - Scene: Microphone

OpenBenchmarking.orgScore Per Watt, More Is BetterLuxMark 3.1OpenCL Device: GPU - Scene: MicrophoneRTX 2070 SUPERTITAN RTXRTX 2080 TiRTX 2080 SUPERRTX 2070RTX 2060 SUPERRTX 2080RTX 2060GTX 1660GTX 1660 TiGTX 1070 TiGTX 1070GTX 1080 TiGTX 1060GTX 1080GTX 980 TiGTX 980GTX 9702040608010092.7891.0089.7789.5883.9283.0982.6072.1171.2270.3370.3258.6357.6851.1450.2947.2546.0844.91

LuxMark

System Power Consumption Monitor

OpenBenchmarking.orgWatts, Fewer Is BetterLuxMark 3.1System Power Consumption MonitorGTX 1660GTX 1060GTX 1070 TiGTX 1660 TiGTX 1070GTX 1080GTX 970RTX 2060GTX 980RTX 2070RTX 2070 SUPERRTX 2060 SUPERRTX 2080 SUPERGTX 980 TiGTX 1080 TiRTX 2080RTX 2080 TiTITAN RTX60120180240300Min: 46 / Avg: 137.52 / Max: 142.7Min: 45.6 / Avg: 138.57 / Max: 144.8Min: 50.1 / Avg: 145.89 / Max: 150.4Min: 48 / Avg: 156.46 / Max: 161.4Min: 49 / Avg: 170.27 / Max: 177.6Min: 49.1 / Avg: 173.32 / Max: 180.3Min: 51.9 / Avg: 177.8 / Max: 184.4Min: 48.6 / Avg: 190.73 / Max: 198.4Min: 51 / Avg: 193.46 / Max: 203.7Min: 51.5 / Avg: 219.74 / Max: 234.1Min: 47.6 / Avg: 220.93 / Max: 232.4Min: 49.8 / Avg: 222.76 / Max: 232.3Min: 47.8 / Avg: 225.09 / Max: 235.4Min: 112.5 / Avg: 234.81 / Max: 244.3Min: 52.7 / Avg: 237.89 / Max: 245.4Min: 53.8 / Avg: 241.11 / Max: 251.4Min: 55.9 / Avg: 318.95 / Max: 337.2Min: 60.2 / Avg: 337.98 / Max: 356.9

LuxMark

OpenCL Device: GPU - Scene: Hotel

OpenBenchmarking.orgScore, More Is BetterLuxMark 3.1OpenCL Device: GPU - Scene: HotelTITAN RTXRTX 2080 TiRTX 2080 SUPERRTX 2080RTX 2070 SUPERRTX 2070RTX 2060 SUPERGTX 1080 TiRTX 2060GTX 1070 TiGTX 980 TiGTX 1070GTX 1080GTX 1660 TiGTX 1660GTX 980GTX 970GTX 10602K4K6K8K10KSE +/- 1.73, N = 3SE +/- 4.37, N = 3SE +/- 0.58, N = 3SE +/- 0.88, N = 3SE +/- 1.86, N = 3SE +/- 0.67, N = 3SE +/- 7.09, N = 3SE +/- 0.67, N = 3SE +/- 3.51, N = 3SE +/- 8.00, N = 3SE +/- 1.20, N = 3SE +/- 0.67, N = 3SE +/- 0.58, N = 3SE +/- 2.73, N = 3SE +/- 1.86, N = 3SE +/- 3.76, N = 3983692156839659065656150614856494833417038853870380738053733304827302648

LuxMark

OpenCL Device: GPU - Scene: Hotel

OpenBenchmarking.orgScore Per Watt, More Is BetterLuxMark 3.1OpenCL Device: GPU - Scene: HotelTITAN RTXRTX 2080 SUPERRTX 2070 SUPERRTX 2080 TiRTX 2060 SUPERGTX 1070 TiRTX 2070RTX 2080GTX 1660RTX 2060GTX 1660 TiGTX 1080 TiGTX 1070GTX 1080GTX 1060GTX 980 TiGTX 980GTX 97061218243027.4627.4127.1826.9926.3825.6425.5224.5024.2222.9222.5020.0219.5918.5117.0015.2114.1613.72

LuxMark

System Power Consumption Monitor

OpenBenchmarking.orgWatts, Fewer Is BetterLuxMark 3.1System Power Consumption MonitorGTX 1660GTX 1060GTX 1070 TiGTX 1660 TiGTX 1070GTX 970GTX 1080RTX 2060GTX 980RTX 2060 SUPERRTX 2070RTX 2070 SUPERRTX 2080 SUPERGTX 980 TiRTX 2080GTX 1080 TiRTX 2080 TiTITAN RTX70140210280350Min: 46.7 / Avg: 154.16 / Max: 157.9Min: 45.7 / Avg: 155.74 / Max: 161.6Min: 51.1 / Avg: 162.66 / Max: 167.9Min: 47.2 / Avg: 169.1 / Max: 176.4Min: 48.8 / Avg: 197.56 / Max: 206Min: 50.9 / Avg: 198.98 / Max: 206.3Min: 47.9 / Avg: 205.71 / Max: 214.4Min: 50.4 / Avg: 210.86 / Max: 220.4Min: 51.4 / Avg: 215.19 / Max: 226.6Min: 47.9 / Avg: 233.07 / Max: 242.2Min: 51.8 / Avg: 241 / Max: 251.5Min: 47.6 / Avg: 241.53 / Max: 254.1Min: 50.8 / Avg: 249.5 / Max: 264.2Min: 57.2 / Avg: 255.39 / Max: 271.7Min: 52.6 / Avg: 269.03 / Max: 281.5Min: 55.9 / Avg: 282.16 / Max: 295.6Min: 54.2 / Avg: 341.41 / Max: 361Min: 57.7 / Avg: 358.16 / Max: 371

Darktable

Test: Boat - Acceleration: OpenCL

OpenBenchmarking.orgSeconds, Fewer Is BetterDarktable 2.6.0Test: Boat - Acceleration: OpenCLRTX 2080 TiTITAN RTXRTX 2080 SUPERRTX 2080RTX 2070RTX 2070 SUPERRTX 2060 SUPERRTX 2060GTX 1080 TiGTX 1080GTX 1070GTX 1660 TiGTX 1070 TiGTX 980 TiGTX 1660GTX 1060GTX 980GTX 9700.99451.9892.98353.9784.9725SE +/- 0.00, N = 3SE +/- 0.02, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.01, N = 3SE +/- 0.00, N = 3SE +/- 0.01, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.00, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 31.641.641.821.901.931.931.952.222.292.722.892.922.933.273.353.653.924.42

Darktable

Test: Masskrug - Acceleration: OpenCL

OpenBenchmarking.orgSeconds, Fewer Is BetterDarktable 2.6.0Test: Masskrug - Acceleration: OpenCLRTX 2080 TiTITAN RTXRTX 2070RTX 2060 SUPERRTX 2080 SUPERRTX 2070 SUPERRTX 2080RTX 2060GTX 1070GTX 1080 TiGTX 1080GTX 1070 TiGTX 1660GTX 1660 TiGTX 1060GTX 980 TiGTX 980GTX 9701.30052.6013.90155.2026.5025SE +/- 0.01, N = 3SE +/- 0.02, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.02, N = 3SE +/- 0.01, N = 3SE +/- 0.00, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.00, N = 3SE +/- 0.02, N = 3SE +/- 0.01, N = 3SE +/- 0.02, N = 3SE +/- 0.03, N = 33.663.663.673.683.693.713.713.733.923.923.943.974.014.024.074.125.745.78

Darktable

Test: Server Room - Acceleration: OpenCL

OpenBenchmarking.orgSeconds, Fewer Is BetterDarktable 2.6.0Test: Server Room - Acceleration: OpenCLTITAN RTXRTX 2060 SUPERRTX 2070RTX 2080 TiRTX 2080 SUPERRTX 2070 SUPERRTX 2080RTX 2060GTX 1080 TiGTX 1080GTX 1070GTX 1660 TiGTX 1070 TiGTX 1660GTX 1060GTX 980 TiGTX 980GTX 9700.7111.4222.1332.8443.555SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 8SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.01, N = 4SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.01, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.01, N = 30.740.750.750.750.790.800.800.831.051.091.111.151.171.181.281.513.103.16

Rodinia

Test: OpenCL Myocyte

OpenBenchmarking.orgSeconds, Fewer Is BetterRodinia 2.4Test: OpenCL MyocyteRTX 2060 SUPERRTX 2080 SUPERGTX 1660 TiRTX 2070 SUPERGTX 1660RTX 2080 TiRTX 2060RTX 2070RTX 2080TITAN RTXGTX 1060GTX 1080GTX 1070GTX 1080 TiGTX 1070 TiGTX 970GTX 980GTX 980 Ti1224364860SE +/- 0.04, N = 3SE +/- 0.04, N = 3SE +/- 0.05, N = 3SE +/- 0.15, N = 3SE +/- 0.08, N = 3SE +/- 0.07, N = 3SE +/- 0.05, N = 3SE +/- 0.03, N = 3SE +/- 0.04, N = 3SE +/- 0.04, N = 3SE +/- 0.10, N = 3SE +/- 0.04, N = 3SE +/- 0.08, N = 3SE +/- 0.03, N = 3SE +/- 0.14, N = 3SE +/- 0.06, N = 3SE +/- 0.05, N = 3SE +/- 0.18, N = 330.4230.6330.6730.7630.9731.0531.1131.6431.6531.6934.6934.8735.1035.9138.7045.4847.3852.131. (CXX) g++ options: -O2 -lOpenCL

Rodinia

System Power Consumption Monitor

OpenBenchmarking.orgWatts, Fewer Is BetterRodinia 2.4System Power Consumption MonitorGTX 1660GTX 1060GTX 1660 TiGTX 1070 TiGTX 1070RTX 2060GTX 1080RTX 2070 SUPERGTX 970GTX 980RTX 2060 SUPERRTX 2070RTX 2080 SUPERRTX 2080GTX 1080 TiRTX 2080 TiGTX 980 TiTITAN RTX306090120150Min: 45.5 / Avg: 90.35 / Max: 95.7Min: 62.8 / Avg: 97.17 / Max: 100.8Min: 45.9 / Avg: 98.53 / Max: 104.6Min: 49.1 / Avg: 105.1 / Max: 108.7Min: 70.9 / Avg: 107.97 / Max: 112.9Min: 46.6 / Avg: 112.18 / Max: 123.5Min: 47.4 / Avg: 113.6 / Max: 118.7Min: 46.4 / Avg: 116.19 / Max: 128.7Min: 85.4 / Avg: 117.57 / Max: 120.9Min: 88.8 / Avg: 119.77 / Max: 124.7Min: 46.3 / Avg: 122.27 / Max: 129.5Min: 48.1 / Avg: 122.39 / Max: 128.3Min: 46.6 / Avg: 123.16 / Max: 135.3Min: 49.5 / Avg: 131.08 / Max: 142Min: 53.3 / Avg: 137.65 / Max: 146.3Min: 51.1 / Avg: 152.87 / Max: 162.6Min: 110.1 / Avg: 153.24 / Max: 157.4Min: 51.9 / Avg: 158.82 / Max: 169.5

Rodinia

Test: OpenCL Particle Filter

OpenBenchmarking.orgSeconds, Fewer Is BetterRodinia 2.4Test: OpenCL Particle FilterTITAN RTXRTX 2080 TiGTX 1080 TiRTX 2080 SUPERRTX 2080GTX 1080RTX 2070 SUPERRTX 2070RTX 2060 SUPERGTX 1070 TiGTX 1070RTX 2060GTX 980 TiGTX 1660 TiGTX 980GTX 1660GTX 1060GTX 9703691215SE +/- 0.01, N = 3SE +/- 0.02, N = 3SE +/- 0.02, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.07, N = 3SE +/- 0.01, N = 3SE +/- 0.00, N = 3SE +/- 0.07, N = 3SE +/- 0.00, N = 3SE +/- 0.01, N = 3SE +/- 0.04, N = 3SE +/- 0.02, N = 3SE +/- 0.07, N = 3SE +/- 0.01, N = 3SE +/- 0.02, N = 3SE +/- 0.02, N = 34.244.394.965.746.226.496.827.757.877.888.268.909.9510.8211.6911.8711.9312.991. (CXX) g++ options: -O2 -lOpenCL

Rodinia

System Power Consumption Monitor

OpenBenchmarking.orgWatts, Fewer Is BetterRodinia 2.4System Power Consumption MonitorGTX 1660GTX 1070 TiRTX 2070 SUPERGTX 1660 TiGTX 1060RTX 2060GTX 970GTX 980GTX 980 Ti4080120160200Min: 45.1 / Avg: 88.85 / Max: 116.6Min: 50.3 / Avg: 101.74 / Max: 149.4Min: 47 / Avg: 103.36 / Max: 166Min: 46 / Avg: 107.04 / Max: 129.7Min: 44.7 / Avg: 111.27 / Max: 154.1Min: 47.6 / Avg: 121.91 / Max: 156.6Min: 50.5 / Avg: 141.83 / Max: 190Min: 52.6 / Avg: 156.47 / Max: 203.2Min: 54.7 / Avg: 167.04 / Max: 233.5

ViennaCL

OpenCL LU Factorization

OpenBenchmarking.orgGFLOPS, More Is BetterViennaCL 1.4.2OpenCL LU FactorizationTITAN RTXRTX 2080 TiRTX 2080 SUPERRTX 2080RTX 2070 SUPERRTX 2070RTX 2060 SUPERGTX 1080 TiRTX 2060GTX 1080GTX 1660 TiGTX 1660GTX 1070 TiGTX 1070GTX 980 TiGTX 980GTX 1060GTX 9701632486480SE +/- 0.60, N = 3SE +/- 0.72, N = 3SE +/- 0.26, N = 3SE +/- 0.07, N = 3SE +/- 0.05, N = 3SE +/- 0.03, N = 3SE +/- 0.06, N = 3SE +/- 0.31, N = 3SE +/- 0.21, N = 3SE +/- 0.20, N = 3SE +/- 0.05, N = 3SE +/- 0.02, N = 3SE +/- 0.01, N = 3SE +/- 0.03, N = 3SE +/- 0.02, N = 3SE +/- 0.04, N = 3SE +/- 0.05, N = 3SE +/- 0.11, N = 372.9672.7171.4770.9670.4569.4169.1769.0967.9266.6766.0665.1064.6863.8662.0159.2158.6756.951. (CXX) g++ options: -rdynamic -lOpenCL

ViennaCL

OpenCL LU Factorization

OpenBenchmarking.orgGFLOPS Per Watt, More Is BetterViennaCL 1.4.2OpenCL LU FactorizationRTX 2060 SUPERTITAN RTXRTX 2070RTX 2080 TiRTX 2080 SUPERGTX 1660 TiGTX 1660GTX 1060RTX 2070 SUPERGTX 1070GTX 980RTX 2060RTX 2080GTX 1070 TiGTX 1080GTX 970GTX 980 TiGTX 1080 Ti0.3150.630.9451.261.5751.401.351.351.311.181.101.081.000.900.800.790.730.710.710.700.660.600.59

cl-mem

Benchmark: Copy

OpenBenchmarking.orgGB/s, More Is Bettercl-mem 2017-01-13Benchmark: CopyRTX 2080 TiTITAN RTXRTX 2080 SUPERRTX 2070 SUPERRTX 2080RTX 2060 SUPERRTX 2070GTX 1080 TiRTX 2060GTX 980 TiGTX 1660 TiGTX 1080GTX 1070 TiGTX 1070GTX 1660GTX 980GTX 1060GTX 97070140210280350SE +/- 0.40, N = 3SE +/- 0.67, N = 3SE +/- 0.13, N = 3SE +/- 0.17, N = 3SE +/- 0.15, N = 3SE +/- 0.31, N = 3SE +/- 0.24, N = 3SE +/- 0.25, N = 3SE +/- 0.12, N = 3SE +/- 0.17, N = 3SE +/- 0.15, N = 3SE +/- 0.03, N = 3SE +/- 0.00, N = 3SE +/- 0.06, N = 3SE +/- 0.03, N = 3SE +/- 0.00, N = 3SE +/- 0.06, N = 3SE +/- 0.03, N = 3324.40322.20301.23291.87289.20287.80284.43283.20237.77216.83208.50205.93182.70182.00145.37143.40137.20124.771. (CC) gcc options: -O2 -flto -lOpenCL

cl-mem

Benchmark: Copy

OpenBenchmarking.orgGB/s Per Watt, More Is Bettercl-mem 2017-01-13Benchmark: CopyRTX 2080 TiRTX 2080 SUPERRTX 2070 SUPERRTX 2060RTX 2070RTX 2060 SUPERRTX 2080TITAN RTXGTX 1660 TiGTX 1080GTX 1080 TiGTX 1660GTX 1070 TiGTX 980 TiGTX 1070GTX 1060GTX 980GTX 9700.72681.45362.18042.90723.6343.232.832.822.662.442.432.282.171.961.651.621.581.531.451.351.251.040.96

SHOC Scalable HeterOgeneous Computing

Target: OpenCL - Benchmark: Max SP Flops

OpenBenchmarking.orgGFLOPS, More Is BetterSHOC Scalable HeterOgeneous Computing 2015-11-10Target: OpenCL - Benchmark: Max SP FlopsTITAN RTXRTX 2080 TiGTX 1080 TiRTX 2080 SUPERRTX 2080RTX 2070 SUPERGTX 1080RTX 2070RTX 2060 SUPERGTX 1070 TiRTX 2060GTX 1070GTX 980 TiGTX 1660 TiGTX 1660GTX 980GTX 1060GTX 9704K8K12K16K20KSE +/- 91.95, N = 3SE +/- 87.95, N = 3SE +/- 3.93, N = 3SE +/- 61.30, N = 3SE +/- 29.32, N = 3SE +/- 51.02, N = 3SE +/- 3.00, N = 3SE +/- 45.97, N = 3SE +/- 27.40, N = 3SE +/- 0.84, N = 3SE +/- 19.13, N = 3SE +/- 1.89, N = 3SE +/- 11.70, N = 3SE +/- 0.04, N = 3SE +/- 13.79, N = 3SE +/- 3.92, N = 3SE +/- 6.34, N = 3SE +/- 0.74, N = 317334.0016656.2013230.7712015.5010952.779869.349407.758528.708378.877715.427320.737115.396213.975893.415329.845052.734788.924362.311. (CXX) g++ options: -O2 -lSHOCCommonMPI -lSHOCCommonOpenCL -lSHOCCommon -lOpenCL -lrt -pthread -lmpi_cxx -lmpi

SHOC Scalable HeterOgeneous Computing

Target: OpenCL - Benchmark: Max SP Flops

OpenBenchmarking.orgGFLOPS Per Watt, More Is BetterSHOC Scalable HeterOgeneous Computing 2015-11-10Target: OpenCL - Benchmark: Max SP FlopsTITAN RTXRTX 2080 TiRTX 2080 SUPERGTX 1080 TiRTX 2070 SUPERRTX 2080GTX 1070 TiGTX 1080RTX 2070RTX 2060 SUPERRTX 2060GTX 1070GTX 1660GTX 1660 TiGTX 1060GTX 980 TiGTX 980GTX 9702040608010077.7276.6973.2366.2665.7663.9361.4359.8757.1356.3850.3650.3050.1749.6340.0632.0531.4029.29

SHOC Scalable HeterOgeneous Computing

System Power Consumption Monitor

OpenBenchmarking.orgWatts, Fewer Is BetterSHOC Scalable HeterOgeneous Computing 2015-11-10System Power Consumption MonitorGTX 1660GTX 1660 TiGTX 1060GTX 1070 TiGTX 1070RTX 2060RTX 2060 SUPERGTX 970RTX 2070RTX 2070 SUPERGTX 1080GTX 980RTX 2080 SUPERRTX 2080GTX 980 TiGTX 1080 TiRTX 2080 TiTITAN RTX70140210280350Min: 44.5 / Avg: 106.24 / Max: 161Min: 46.4 / Avg: 118.75 / Max: 170.7Min: 74.8 / Avg: 119.53 / Max: 184.8Min: 50.5 / Avg: 125.61 / Max: 179.8Min: 78 / Avg: 141.46 / Max: 206.4Min: 47 / Avg: 145.37 / Max: 229.5Min: 46.8 / Avg: 148.63 / Max: 238Min: 80.6 / Avg: 148.92 / Max: 222.7Min: 47.9 / Avg: 149.29 / Max: 251.7Min: 47.1 / Avg: 150.09 / Max: 265.5Min: 94 / Avg: 157.13 / Max: 259.6Min: 97.6 / Avg: 160.93 / Max: 243.5Min: 47 / Avg: 164.08 / Max: 318.6Min: 48.7 / Avg: 171.33 / Max: 292.2Min: 126.9 / Avg: 193.91 / Max: 298.6Min: 49.6 / Avg: 199.67 / Max: 326.6Min: 51.3 / Avg: 217.17 / Max: 360Min: 52 / Avg: 223.03 / Max: 367

SHOC Scalable HeterOgeneous Computing

Target: OpenCL - Benchmark: FFT SP

OpenBenchmarking.orgGFLOPS, More Is BetterSHOC Scalable HeterOgeneous Computing 2015-11-10Target: OpenCL - Benchmark: FFT SPTITAN RTXRTX 2080 TiRTX 2080 SUPERRTX 2080RTX 2070 SUPERGTX 1080 TiRTX 2070RTX 2060 SUPERRTX 2060GTX 980 TiGTX 1660 TiGTX 1080GTX 1070 TiGTX 1070GTX 980GTX 1660GTX 970GTX 106030060090012001500SE +/- 1.38, N = 3SE +/- 2.79, N = 3SE +/- 0.78, N = 3SE +/- 0.39, N = 3SE +/- 0.27, N = 3SE +/- 1.06, N = 3SE +/- 2.90, N = 3SE +/- 3.09, N = 3SE +/- 0.56, N = 3SE +/- 3.01, N = 3SE +/- 1.57, N = 3SE +/- 3.58, N = 3SE +/- 0.19, N = 3SE +/- 6.42, N = 4SE +/- 1.09, N = 3SE +/- 0.27, N = 3SE +/- 0.48, N = 3SE +/- 3.50, N = 71578.291485.731203.571100.001088.17982.23976.78971.24818.44725.98665.66614.69525.89478.54458.35452.89411.29326.681. (CXX) g++ options: -O2 -lSHOCCommonMPI -lSHOCCommonOpenCL -lSHOCCommon -lOpenCL -lrt -pthread -lmpi_cxx -lmpi

SHOC Scalable HeterOgeneous Computing

Target: OpenCL - Benchmark: FFT SP

OpenBenchmarking.orgGFLOPS Per Watt, More Is BetterSHOC Scalable HeterOgeneous Computing 2015-11-10Target: OpenCL - Benchmark: FFT SPRTX 2060 SUPERRTX 2070 SUPERRTX 2080RTX 2060GTX 1660 TiRTX 2080 TiRTX 2070GTX 1080 TiGTX 1080GTX 980 TiGTX 1070 TiGTX 1070GTX 1660GTX 980GTX 970GTX 10604812162017.5915.5815.4613.2312.2511.548.677.977.876.926.366.235.705.455.124.00

SHOC Scalable HeterOgeneous Computing

Target: OpenCL - Benchmark: MD5 Hash

OpenBenchmarking.orgGHash/s, More Is BetterSHOC Scalable HeterOgeneous Computing 2015-11-10Target: OpenCL - Benchmark: MD5 HashTITAN RTXRTX 2080 TiRTX 2080 SUPERRTX 2080RTX 2070 SUPERGTX 1080 TiRTX 2070RTX 2060 SUPERRTX 2060GTX 1080GTX 1660 TiGTX 1660GTX 1070 TiGTX 1070GTX 980 TiGTX 980GTX 1060GTX 970816243240SE +/- 0.06, N = 3SE +/- 0.12, N = 3SE +/- 0.02, N = 3SE +/- 0.01, N = 3SE +/- 0.05, N = 3SE +/- 0.04, N = 3SE +/- 0.03, N = 3SE +/- 0.02, N = 3SE +/- 0.03, N = 3SE +/- 0.02, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.02, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 336.3934.9126.5624.0721.7819.7218.7718.2216.0414.2512.9811.8711.7010.619.227.497.266.501. (CXX) g++ options: -O2 -lSHOCCommonMPI -lSHOCCommonOpenCL -lSHOCCommon -lOpenCL -lrt -pthread -lmpi_cxx -lmpi

SHOC Scalable HeterOgeneous Computing

Target: OpenCL - Benchmark: MD5 Hash

OpenBenchmarking.orgGHash/s Per Watt, More Is BetterSHOC Scalable HeterOgeneous Computing 2015-11-10Target: OpenCL - Benchmark: MD5 HashTITAN RTXRTX 2080 SUPERRTX 2070 SUPERGTX 1660 TiGTX 1660RTX 2080RTX 2070GTX 1080RTX 2060GTX 1060GTX 980GTX 970GTX 980 Ti0.08330.16660.24990.33320.41650.370.320.300.260.260.210.150.150.120.110.080.050.04

JuliaGPU

OpenCL Device: GPU

OpenBenchmarking.orgSamples/sec, More Is BetterJuliaGPU 1.2pts1OpenCL Device: GPUTITAN RTXRTX 2080 TiRTX 2080 SUPERRTX 2080RTX 2070 SUPERRTX 2070RTX 2060 SUPERGTX 1080 TiRTX 2060GTX 1660 TiGTX 1080GTX 1660GTX 1070 TiGTX 1070GTX 980 TiGTX 1060GTX 980GTX 97060M120M180M240M300MSE +/- 489061.14, N = 3SE +/- 78810.54, N = 3SE +/- 1165562.77, N = 3SE +/- 169596.23, N = 3SE +/- 389272.10, N = 3SE +/- 633693.84, N = 3SE +/- 369711.60, N = 3SE +/- 540298.84, N = 3SE +/- 121354.48, N = 3SE +/- 495295.96, N = 3SE +/- 341457.11, N = 3SE +/- 197521.26, N = 3SE +/- 97519.45, N = 3SE +/- 76295.47, N = 3SE +/- 78142.08, N = 3SE +/- 137674.47, N = 3SE +/- 52667.10, N = 3SE +/- 383961.59, N = 3303198573.97299834728.80286818331.27280162469.67275868151.17267086274.53264172441.47262248899.33251925176.90239300837.60237914974.40230919642.13220447755.87216942144.93195653728.47182188318.67181882709.77169258044.901. (CC) gcc options: -O3 -march=native -ftree-vectorize -funroll-loops -lglut -lOpenCL -lGL -lm

JuliaGPU

OpenCL Device: GPU

OpenBenchmarking.orgSamples/sec Per Watt, More Is BetterJuliaGPU 1.2pts1OpenCL Device: GPUGTX 1660 TiGTX 1660RTX 2080RTX 2060 SUPERRTX 2070 SUPERRTX 2060RTX 2080 SUPERRTX 2070GTX 1070 TiTITAN RTXRTX 2080 TiGTX 1080GTX 1070GTX 1080 TiGTX 1060GTX 980GTX 970GTX 980 Ti600K1200K1800K2400K3000K2880366.362790569.692691799.292670026.702632329.692469451.172379445.262271141.792260229.901923116.671910018.661906369.991809790.271682592.711658141.691325997.881275493.931099178.25

clpeak

OpenCL Test: Global Memory Bandwidth

OpenBenchmarking.orgGBPS, More Is BetterclpeakOpenCL Test: Global Memory BandwidthTITAN RTXRTX 2080 TiRTX 2080 SUPERRTX 2070 SUPERRTX 2070RTX 2080RTX 2060 SUPERGTX 1080 TiRTX 2060GTX 980 TiGTX 1660 TiGTX 1080GTX 1070 TiGTX 1070GTX 980GTX 1660GTX 1060GTX 970110220330440550SE +/- 0.66, N = 3SE +/- 0.44, N = 3SE +/- 0.08, N = 3SE +/- 0.33, N = 3SE +/- 0.07, N = 3SE +/- 0.22, N = 3SE +/- 0.11, N = 3SE +/- 0.71, N = 3SE +/- 0.24, N = 3SE +/- 0.52, N = 3SE +/- 0.17, N = 3SE +/- 0.09, N = 3SE +/- 0.00, N = 3SE +/- 0.18, N = 3SE +/- 0.03, N = 3SE +/- 0.00, N = 3SE +/- 0.06, N = 3SE +/- 0.06, N = 3528.89506.33405.00369.11368.96368.47367.92328.90275.86263.22234.67222.09197.26196.47164.25157.60146.62143.481. (CXX) g++ options: -O3 -rdynamic -lOpenCL

clpeak

OpenCL Test: Global Memory Bandwidth

OpenBenchmarking.orgGBPS Per Watt, More Is BetterclpeakOpenCL Test: Global Memory BandwidthRTX 2080 TiTITAN RTXRTX 2070 SUPERRTX 2080RTX 2060 SUPERRTX 2080 SUPERRTX 2070GTX 1660GTX 1080 TiGTX 1070GTX 1080GTX 1660 TiGTX 980 TiGTX 1070 TiGTX 1060GTX 980GTX 97036912159.156.185.415.094.884.863.333.162.732.632.262.242.021.921.841.651.52

clpeak

OpenCL Test: Single-Precision Float

OpenBenchmarking.orgGFLOPS, More Is BetterclpeakOpenCL Test: Single-Precision FloatTITAN RTXRTX 2080 TiGTX 1080 TiRTX 2080 SUPERRTX 2080RTX 2070 SUPERGTX 1080RTX 2070RTX 2060 SUPERGTX 1070 TiGTX 1070GTX 980 TiRTX 2060GTX 1660 TiGTX 1660GTX 980GTX 1060GTX 9703K6K9K12K15KSE +/- 228.75, N = 15SE +/- 207.30, N = 3SE +/- 5.50, N = 3SE +/- 124.22, N = 3SE +/- 7.41, N = 3SE +/- 76.18, N = 15SE +/- 3.14, N = 3SE +/- 81.15, N = 15SE +/- 84.87, N = 15SE +/- 7.63, N = 3SE +/- 3.03, N = 3SE +/- 44.36, N = 15SE +/- 77.72, N = 3SE +/- 61.47, N = 15SE +/- 7.83, N = 3SE +/- 46.38, N = 8SE +/- 1.88, N = 3SE +/- 40.24, N = 1514203.8713532.7411720.5710335.508883.908502.718314.297198.647089.506770.976269.495538.755329.074793.664610.014476.694199.713888.161. (CXX) g++ options: -O3 -rdynamic -lOpenCL

clpeak

OpenCL Test: Single-Precision Float

OpenBenchmarking.orgGFLOPS Per Watt, More Is BetterclpeakOpenCL Test: Single-Precision FloatRTX 2080 TiRTX 2070 SUPERRTX 2060 SUPERRTX 2060TITAN RTXGTX 1080RTX 2080 SUPERGTX 1070 TiRTX 2080RTX 2070GTX 1660 TiGTX 1070GTX 980 TiGTX 970GTX 98050100150200250222.09121.62111.74109.20103.6189.1184.4984.4679.2574.3271.3570.6342.0039.3636.49

clpeak

System Power Consumption Monitor

OpenBenchmarking.orgWatts, Fewer Is BetterclpeakSystem Power Consumption MonitorRTX 2060 SUPERGTX 1660 TiRTX 2070 SUPERRTX 2070GTX 970GTX 980GTX 980 TiTITAN RTX60120180240300Min: 46.6 / Avg: 63.45 / Max: 103Min: 45.5 / Avg: 67.18 / Max: 127.1Min: 47.5 / Avg: 69.91 / Max: 138.9Min: 48.2 / Avg: 96.86 / Max: 180.2Min: 51.4 / Avg: 98.78 / Max: 148.8Min: 52.5 / Avg: 122.69 / Max: 181.1Min: 54.9 / Avg: 131.87 / Max: 194.2Min: 50.6 / Avg: 137.09 / Max: 308.7

clpeak

OpenCL Test: Double-Precision Double

OpenBenchmarking.orgGFLOPS, More Is BetterclpeakOpenCL Test: Double-Precision DoubleTITAN RTXRTX 2080 TiGTX 1080 TiRTX 2080 SUPERRTX 2080RTX 2070 SUPERGTX 1080RTX 2070RTX 2060 SUPERGTX 1070 TiRTX 2060GTX 1070GTX 980 TiGTX 1660 TiGTX 1660GTX 980GTX 1060GTX 970120240360480600SE +/- 1.16, N = 3SE +/- 1.46, N = 3SE +/- 1.14, N = 3SE +/- 0.03, N = 3SE +/- 0.92, N = 3SE +/- 0.77, N = 3SE +/- 0.76, N = 3SE +/- 0.81, N = 3SE +/- 0.71, N = 3SE +/- 0.02, N = 3SE +/- 0.01, N = 3SE +/- 0.71, N = 3SE +/- 0.35, N = 3SE +/- 0.01, N = 3SE +/- 0.00, N = 3SE +/- 0.07, N = 3SE +/- 0.14, N = 3SE +/- 0.03, N = 3547.97521.90414.96378.98345.81310.27297.94268.32263.11242.63231.44223.91196.60185.12168.44159.68149.58137.471. (CXX) g++ options: -O3 -rdynamic -lOpenCL

clpeak

OpenCL Test: Double-Precision Double

OpenBenchmarking.orgGFLOPS Per Watt, More Is BetterclpeakOpenCL Test: Double-Precision DoubleTITAN RTXRTX 2080 TiRTX 2080 SUPERGTX 1080 TiRTX 2080RTX 2070 SUPERGTX 1080GTX 1070 TiRTX 2070GTX 1070RTX 2060 SUPERRTX 2060GTX 1660GTX 1660 TiGTX 1060GTX 980 TiGTX 980GTX 9700.60751.2151.82252.433.03752.702.652.502.492.252.252.202.141.951.901.851.841.731.721.461.091.090.98

clpeak

System Power Consumption Monitor

OpenBenchmarking.orgWatts, Fewer Is BetterclpeakSystem Power Consumption MonitorGTX 1660GTX 1060GTX 1660 TiGTX 1070 TiGTX 1070RTX 2060GTX 1080RTX 2070RTX 2070 SUPERGTX 970RTX 2060 SUPERGTX 980RTX 2080 SUPERRTX 2080GTX 1080 TiGTX 980 TiRTX 2080 TiTITAN RTX4080120160200Min: 43.9 / Avg: 97.25 / Max: 106.6Min: 44.7 / Avg: 102.22 / Max: 117.3Min: 46.4 / Avg: 107.92 / Max: 119.4Min: 51 / Avg: 113.26 / Max: 124.1Min: 46 / Avg: 117.77 / Max: 137.1Min: 47.9 / Avg: 126.06 / Max: 143Min: 46.2 / Avg: 135.52 / Max: 152.6Min: 46.9 / Avg: 137.5 / Max: 151.9Min: 47 / Avg: 137.66 / Max: 150.3Min: 93.6 / Avg: 140.29 / Max: 146.2Min: 47.1 / Avg: 142.14 / Max: 150.8Min: 51.6 / Avg: 146.12 / Max: 159.1Min: 47.6 / Avg: 151.43 / Max: 166.9Min: 49.8 / Avg: 153.89 / Max: 172.5Min: 51.6 / Avg: 166.5 / Max: 193Min: 128.4 / Avg: 179.97 / Max: 191.4Min: 50.3 / Avg: 197 / Max: 217.1Min: 51.5 / Avg: 203.24 / Max: 225.1

clpeak

OpenCL Test: Integer Compute INT

OpenBenchmarking.orgGIOPS, More Is BetterclpeakOpenCL Test: Integer Compute INTTITAN RTXRTX 2080 TiRTX 2080 SUPERRTX 2080RTX 2070 SUPERRTX 2070RTX 2060 SUPERRTX 2060GTX 1660 TiGTX 1660GTX 1080 TiGTX 1080GTX 1070 TiGTX 1070GTX 980 TiGTX 980GTX 1060GTX 9703K6K9K12K15KSE +/- 156.59, N = 15SE +/- 57.62, N = 3SE +/- 83.79, N = 15SE +/- 4.11, N = 3SE +/- 81.60, N = 15SE +/- 84.78, N = 15SE +/- 76.65, N = 15SE +/- 63.11, N = 3SE +/- 64.34, N = 15SE +/- 32.97, N = 3SE +/- 29.87, N = 15SE +/- 26.46, N = 3SE +/- 0.72, N = 3SE +/- 24.36, N = 3SE +/- 23.09, N = 3SE +/- 0.38, N = 3SE +/- 13.36, N = 15SE +/- 19.67, N = 313841.2513609.3310404.719660.928570.607161.487023.075269.014775.454657.793301.892430.742076.931685.051610.281312.061267.891140.291. (CXX) g++ options: -O3 -rdynamic -lOpenCL

clpeak

OpenCL Test: Integer Compute INT

OpenBenchmarking.orgGIOPS Per Watt, More Is BetterclpeakOpenCL Test: Integer Compute INTRTX 2080RTX 2060 SUPERGTX 1660RTX 2080 SUPERTITAN RTXRTX 2060GTX 1660 TiRTX 2070 SUPERRTX 2080 TiRTX 2070GTX 1080GTX 1070 TiGTX 1070GTX 1080 TiGTX 1060GTX 970GTX 980 TiGTX 980306090120150123.0780.7479.9472.1666.5863.2561.3860.3954.7652.7826.8225.5923.8916.5210.839.199.008.44

clpeak

System Power Consumption Monitor

OpenBenchmarking.orgWatts, Fewer Is BetterclpeakSystem Power Consumption MonitorGTX 1660 TiRTX 2060 SUPERGTX 1060RTX 2070RTX 2070 SUPERRTX 2080 SUPERGTX 1080 TiTITAN RTX70140210280350Min: 46.4 / Avg: 77.81 / Max: 158.1Min: 47.4 / Avg: 86.98 / Max: 242.5Min: 66.2 / Avg: 117.06 / Max: 191Min: 47.8 / Avg: 135.68 / Max: 254.5Min: 47.5 / Avg: 141.91 / Max: 279.4Min: 47.9 / Avg: 144.19 / Max: 288.8Min: 52.4 / Avg: 199.89 / Max: 328.7Min: 52.5 / Avg: 207.88 / Max: 366.7

cl-mem

Benchmark: Read

OpenBenchmarking.orgGB/s, More Is Bettercl-mem 2017-01-13Benchmark: ReadTITAN RTXRTX 2080 TiRTX 2080 SUPERRTX 2080RTX 2070RTX 2070 SUPERRTX 2060 SUPERGTX 1080 TiRTX 2060GTX 980 TiGTX 1660 TiGTX 1080GTX 1070 TiGTX 1070GTX 980GTX 1660GTX 1060GTX 970120240360480600SE +/- 0.40, N = 3SE +/- 0.38, N = 3SE +/- 0.27, N = 3SE +/- 0.25, N = 3SE +/- 0.25, N = 3SE +/- 0.22, N = 3SE +/- 0.22, N = 3SE +/- 0.20, N = 3SE +/- 0.20, N = 3SE +/- 0.12, N = 3SE +/- 0.07, N = 3SE +/- 0.12, N = 3SE +/- 0.07, N = 3SE +/- 0.03, N = 3SE +/- 0.10, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 1.50, N = 8566.70544.33436.27395.70395.70395.67395.67337.53296.20265.33250.23228.80205.27205.27164.50162.90153.50142.101. (CC) gcc options: -O2 -flto -lOpenCL

cl-mem

Benchmark: Read

OpenBenchmarking.orgGB/s Per Watt, More Is Bettercl-mem 2017-01-13Benchmark: ReadRTX 2080 SUPERRTX 2070 SUPERRTX 2080 TiTITAN RTXRTX 2070RTX 2080RTX 2060 SUPERRTX 2060GTX 1660 TiGTX 1080 TiGTX 1080GTX 1070 TiGTX 980 TiGTX 1660GTX 1070GTX 1060GTX 980GTX 9700.86631.73262.59893.46524.33153.853.473.383.373.283.263.092.762.672.101.901.861.761.691.681.341.191.05

cl-mem

Benchmark: Write

OpenBenchmarking.orgGB/s, More Is Bettercl-mem 2017-01-13Benchmark: WriteTITAN RTXRTX 2080 TiRTX 2080 SUPERGTX 1080 TiRTX 2060 SUPERRTX 2080RTX 2070RTX 2070 SUPERGTX 980 TiRTX 2060GTX 1080GTX 1660 TiGTX 1070GTX 1070 TiGTX 980GTX 1660GTX 1060GTX 970110220330440550SE +/- 1.39, N = 3SE +/- 0.35, N = 3SE +/- 0.54, N = 3SE +/- 0.28, N = 3SE +/- 0.82, N = 3SE +/- 0.15, N = 3SE +/- 1.00, N = 3SE +/- 0.43, N = 3SE +/- 0.06, N = 3SE +/- 0.40, N = 3SE +/- 0.03, N = 3SE +/- 0.12, N = 3SE +/- 0.00, N = 3SE +/- 0.03, N = 3SE +/- 0.00, N = 3SE +/- 0.03, N = 3SE +/- 0.03, N = 3SE +/- 0.00, N = 3495.37441.23345.77340.27333.20331.50322.67319.57241.50241.20214.67208.67190.90190.03151.50148.87144.57132.601. (CC) gcc options: -O2 -flto -lOpenCL

cl-mem

Benchmark: Write

OpenBenchmarking.orgGB/s Per Watt, More Is Bettercl-mem 2017-01-13Benchmark: WriteRTX 2070RTX 2080 TiTITAN RTXRTX 2080 SUPERRTX 2080RTX 2060 SUPERRTX 2070 SUPERGTX 1660 TiRTX 2060GTX 1080 TiGTX 1070 TiGTX 1080GTX 1660GTX 1070GTX 980 TiGTX 1060GTX 970GTX 9800.83481.66962.50443.33924.1743.713.463.132.852.742.612.602.332.242.021.761.641.611.541.481.441.071.03

PlaidML

FP16: Yes - Mode: Inference - Network: Mobilenet - Device: OpenCL

OpenBenchmarking.orgFPS, More Is BetterPlaidMLFP16: Yes - Mode: Inference - Network: Mobilenet - Device: OpenCLTITAN RTXRTX 2080 TiRTX 2080 SUPERRTX 2080RTX 2070 SUPERGTX 1080 TiRTX 2060 SUPERRTX 2070RTX 2060GTX 1080GTX 1660 TiGTX 1070 TiGTX 1070GTX 980 TiGTX 1660GTX 980GTX 1060GTX 9706001200180024003000SE +/- 4.02, N = 3SE +/- 13.82, N = 3SE +/- 6.75, N = 3SE +/- 4.68, N = 3SE +/- 4.73, N = 3SE +/- 7.35, N = 3SE +/- 10.89, N = 3SE +/- 5.21, N = 3SE +/- 3.62, N = 3SE +/- 4.27, N = 3SE +/- 2.77, N = 3SE +/- 0.80, N = 3SE +/- 4.57, N = 3SE +/- 1.24, N = 3SE +/- 1.34, N = 3SE +/- 2.37, N = 3SE +/- 2.37, N = 3SE +/- 1.43, N = 32842.382750.572437.482292.382264.972162.581983.821969.501694.071544.501394.051371.211288.941202.771160.52973.39908.43841.48

PlaidML

FP16: Yes - Mode: Inference - Network: Mobilenet - Device: OpenCL

OpenBenchmarking.orgFPS Per Watt, More Is BetterPlaidMLFP16: Yes - Mode: Inference - Network: Mobilenet - Device: OpenCLRTX 2080 TiRTX 2080RTX 2080 SUPERRTX 2070 SUPERTITAN RTXRTX 2070RTX 2060 SUPERRTX 2060GTX 1660 TiGTX 1080 TiGTX 1660GTX 1070 TiGTX 1080GTX 1070GTX 1060GTX 980 TiGTX 980GTX 97061218243026.7126.2125.0624.7522.1921.3520.6818.2016.0615.2114.7914.1614.0212.359.577.677.176.98

PlaidML

FP16: Yes - Mode: Inference - Network: Inception V3 - Device: OpenCL

OpenBenchmarking.orgFPS, More Is BetterPlaidMLFP16: Yes - Mode: Inference - Network: Inception V3 - Device: OpenCLTITAN RTXRTX 2080 TiRTX 2080 SUPERRTX 2080RTX 2070 SUPERGTX 1080 TiRTX 2070RTX 2060 SUPERRTX 2060GTX 1080GTX 1660 TiGTX 1070 TiGTX 1070GTX 1660GTX 980 TiGTX 980GTX 1060GTX 97080160240320400SE +/- 0.48, N = 3SE +/- 0.44, N = 3SE +/- 0.23, N = 3SE +/- 0.59, N = 3SE +/- 0.10, N = 3SE +/- 0.21, N = 3SE +/- 0.43, N = 3SE +/- 0.44, N = 3SE +/- 0.37, N = 3SE +/- 0.30, N = 3SE +/- 0.05, N = 3SE +/- 0.06, N = 3SE +/- 0.18, N = 3SE +/- 0.27, N = 3SE +/- 0.26, N = 3SE +/- 0.27, N = 3SE +/- 0.20, N = 3SE +/- 0.01, N = 3373.71363.16301.11268.33239.61228.68220.99219.76193.75173.79161.33147.04141.55137.66116.31101.9297.8388.16

PlaidML

FP16: Yes - Mode: Inference - Network: Inception V3 - Device: OpenCL

OpenBenchmarking.orgFPS Per Watt, More Is BetterPlaidMLFP16: Yes - Mode: Inference - Network: Inception V3 - Device: OpenCLTITAN RTXRTX 2080 TiRTX 2080 SUPERRTX 2080RTX 2070 SUPERRTX 2070RTX 2060 SUPERRTX 2060GTX 1660 TiGTX 1660GTX 1080 TiGTX 1070 TiGTX 1080GTX 1070GTX 1060GTX 980GTX 980 TiGTX 9700.4590.9181.3771.8362.2952.042.041.991.751.721.571.491.341.321.221.131.121.100.950.780.610.600.56

PlaidML

System Power Consumption Monitor

OpenBenchmarking.orgWatts, Fewer Is BetterPlaidMLSystem Power Consumption MonitorGTX 1660GTX 1660 TiGTX 1060GTX 1070 TiRTX 2070 SUPERRTX 2070RTX 2060RTX 2060 SUPERGTX 1070RTX 2080 SUPERRTX 2080GTX 1080GTX 970GTX 980RTX 2080 TiTITAN RTXGTX 980 TiGTX 1080 Ti50100150200250Min: 44.4 / Avg: 112.99 / Max: 143Min: 46.7 / Avg: 122.59 / Max: 164Min: 55.5 / Avg: 124.66 / Max: 155.7Min: 51 / Avg: 131.33 / Max: 154.1Min: 46.6 / Avg: 139.53 / Max: 205.1Min: 47.6 / Avg: 141.04 / Max: 207.9Min: 48.8 / Avg: 144.1 / Max: 197.4Min: 53 / Avg: 147.84 / Max: 203.6Min: 70.5 / Avg: 148.83 / Max: 185.2Min: 48.4 / Avg: 151.02 / Max: 226.9Min: 49 / Avg: 153.24 / Max: 230.1Min: 84.5 / Avg: 158.48 / Max: 204.6Min: 72.9 / Avg: 158.81 / Max: 190.7Min: 99.3 / Avg: 168.06 / Max: 211.7Min: 50.7 / Avg: 178.03 / Max: 280Min: 51.1 / Avg: 182.86 / Max: 282.6Min: 128.3 / Avg: 193.81 / Max: 239.9Min: 125.6 / Avg: 201.87 / Max: 257

PlaidML

FP16: Yes - Mode: Inference - Network: ResNet 50 - Device: OpenCL

OpenBenchmarking.orgFPS, More Is BetterPlaidMLFP16: Yes - Mode: Inference - Network: ResNet 50 - Device: OpenCLTITAN RTXRTX 2080 TiGTX 1080 TiRTX 2080 SUPERRTX 2080RTX 2070 SUPERRTX 2070RTX 2060 SUPERGTX 1080RTX 2060GTX 1070 TiGTX 1070GTX 1660 TiGTX 980 TiGTX 1660GTX 980GTX 1060GTX 97090180270360450SE +/- 0.70, N = 3SE +/- 1.04, N = 3SE +/- 0.42, N = 3SE +/- 0.12, N = 3SE +/- 0.60, N = 3SE +/- 0.71, N = 3SE +/- 0.53, N = 3SE +/- 0.48, N = 3SE +/- 0.11, N = 3SE +/- 0.16, N = 3SE +/- 0.08, N = 3SE +/- 0.28, N = 3SE +/- 0.06, N = 3SE +/- 0.06, N = 3SE +/- 0.31, N = 3SE +/- 0.26, N = 3SE +/- 0.16, N = 3SE +/- 0.00, N = 3433.81424.07333.54327.80305.76283.98251.07250.98240.62220.44205.85196.01172.68162.63156.50142.14130.64116.05

PlaidML

FP16: Yes - Mode: Inference - Network: ResNet 50 - Device: OpenCL

OpenBenchmarking.orgFPS Per Watt, More Is BetterPlaidMLFP16: Yes - Mode: Inference - Network: ResNet 50 - Device: OpenCLTITAN RTXRTX 2080 TiRTX 2080 SUPERRTX 2080RTX 2070 SUPERGTX 1080 TiRTX 2060 SUPERRTX 2070GTX 1070 TiRTX 2060GTX 1080GTX 1660 TiGTX 1660GTX 1070GTX 1060GTX 980 TiGTX 980GTX 9700.5761.1521.7282.3042.882.562.532.222.192.101.761.741.691.571.551.511.471.421.241.010.790.780.71

PlaidML

System Power Consumption Monitor

OpenBenchmarking.orgWatts, Fewer Is BetterPlaidMLSystem Power Consumption MonitorGTX 1660GTX 1660 TiGTX 1060GTX 1070 TiRTX 2070 SUPERRTX 2080RTX 2060RTX 2060 SUPERRTX 2080 SUPERRTX 2070GTX 1070GTX 1080GTX 970RTX 2080 TiTITAN RTXGTX 980GTX 1080 TiGTX 980 Ti50100150200250Min: 44.8 / Avg: 109.89 / Max: 143.5Min: 47.3 / Avg: 117.8 / Max: 162Min: 68.7 / Avg: 129.36 / Max: 164Min: 51.5 / Avg: 131.42 / Max: 162.8Min: 47.9 / Avg: 135.09 / Max: 211.7Min: 50.7 / Avg: 139.72 / Max: 234.8Min: 47.9 / Avg: 142.09 / Max: 199.4Min: 54.4 / Avg: 144.26 / Max: 207.2Min: 48.5 / Avg: 147.96 / Max: 225.2Min: 49 / Avg: 148.17 / Max: 210.6Min: 77.9 / Avg: 157.58 / Max: 202.6Min: 94.6 / Avg: 159.56 / Max: 227.4Min: 81.7 / Avg: 163.48 / Max: 201.2Min: 51.5 / Avg: 167.74 / Max: 291.7Min: 55.6 / Avg: 169.21 / Max: 293Min: 52.8 / Avg: 183.08 / Max: 228.8Min: 55.7 / Avg: 189.84 / Max: 284.9Min: 127.5 / Avg: 205.03 / Max: 260.5

PlaidML

FP16: Yes - Mode: Inference - Network: NASNer Large - Device: OpenCL

OpenBenchmarking.orgFPS, More Is BetterPlaidMLFP16: Yes - Mode: Inference - Network: NASNer Large - Device: OpenCLTITAN RTXRTX 2080 TiRTX 2080 SUPERRTX 2080GTX 1080 TiRTX 2070 SUPERRTX 2070RTX 2060 SUPERRTX 2060GTX 1080GTX 1070 TiGTX 1660 TiGTX 1070GTX 980 TiGTX 1660GTX 980GTX 1060GTX 97020406080100SE +/- 0.25, N = 3SE +/- 0.21, N = 3SE +/- 0.08, N = 3SE +/- 0.15, N = 3SE +/- 0.11, N = 3SE +/- 0.05, N = 3SE +/- 0.13, N = 3SE +/- 0.14, N = 3SE +/- 0.08, N = 3SE +/- 0.08, N = 3SE +/- 0.02, N = 3SE +/- 0.03, N = 3SE +/- 0.05, N = 3SE +/- 0.10, N = 3SE +/- 0.03, N = 3SE +/- 0.15, N = 3SE +/- 0.03, N = 3SE +/- 0.03, N = 387.1784.9764.8058.4756.6455.2449.9448.9641.1140.3835.4134.1233.0730.6428.9924.2423.1621.42

PlaidML

FP16: Yes - Mode: Inference - Network: NASNer Large - Device: OpenCL

OpenBenchmarking.orgFPS Per Watt, More Is BetterPlaidMLFP16: Yes - Mode: Inference - Network: NASNer Large - Device: OpenCLTITAN RTXRTX 2080 TiRTX 2080 SUPERRTX 2070 SUPERRTX 2080RTX 2070RTX 2060 SUPERGTX 1080 TiRTX 2060GTX 1070 TiGTX 1660 TiGTX 1660GTX 1080GTX 1070GTX 1060GTX 980 TiGTX 980GTX 9700.08330.16660.24990.33320.41650.370.370.320.300.290.260.250.240.230.230.220.210.200.180.150.130.120.11

PlaidML

System Power Consumption Monitor

OpenBenchmarking.orgWatts, Fewer Is BetterPlaidMLSystem Power Consumption MonitorGTX 1660GTX 1070 TiGTX 1660 TiGTX 1060RTX 2060GTX 1070RTX 2070 SUPERRTX 2070RTX 2060 SUPERGTX 970GTX 980RTX 2080GTX 1080RTX 2080 SUPERRTX 2080 TiTITAN RTXGTX 980 TiGTX 1080 Ti60120180240300Min: 44.8 / Avg: 135.27 / Max: 159.9Min: 51.4 / Avg: 151.49 / Max: 175.5Min: 46.5 / Avg: 154.44 / Max: 184.5Min: 75.4 / Avg: 157.49 / Max: 178.6Min: 48.1 / Avg: 176.3 / Max: 224.1Min: 83.7 / Avg: 182.29 / Max: 211.2Min: 46.5 / Avg: 184.51 / Max: 249.7Min: 48 / Avg: 190.9 / Max: 247Min: 54.2 / Avg: 192.58 / Max: 235.4Min: 94.8 / Avg: 192.64 / Max: 216.8Min: 99.4 / Avg: 199.9 / Max: 241.3Min: 49.7 / Avg: 201.32 / Max: 272.7Min: 48.2 / Avg: 203.49 / Max: 246Min: 46.7 / Avg: 204.84 / Max: 277Min: 50.4 / Avg: 231.53 / Max: 336Min: 51.3 / Avg: 235.38 / Max: 341.7Min: 124.3 / Avg: 237.03 / Max: 284.6Min: 107 / Avg: 238.78 / Max: 315.7

PlaidML

FP16: Yes - Mode: Inference - Network: DenseNet 201 - Device: OpenCL

OpenBenchmarking.orgFPS, More Is BetterPlaidMLFP16: Yes - Mode: Inference - Network: DenseNet 201 - Device: OpenCLTITAN RTXRTX 2080 TiRTX 2080 SUPERGTX 1080 TiRTX 2070 SUPERRTX 2080RTX 2060 SUPERRTX 2070RTX 2060GTX 1080GTX 1070 TiGTX 1070GTX 1660 TiGTX 980 TiGTX 1660GTX 980GTX 1060GTX 97060120180240300SE +/- 0.18, N = 3SE +/- 0.10, N = 3SE +/- 0.07, N = 3SE +/- 0.03, N = 3SE +/- 0.14, N = 3SE +/- 0.17, N = 3SE +/- 0.03, N = 3SE +/- 0.22, N = 3SE +/- 0.05, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.05, N = 3SE +/- 0.03, N = 3SE +/- 0.18, N = 3SE +/- 0.10, N = 3SE +/- 0.12, N = 3SE +/- 0.15, N = 3SE +/- 0.01, N = 3263.13254.45200.38191.31190.01189.28179.51176.49154.19143.53130.15127.02114.58111.46102.8392.9291.0779.71

PlaidML

FP16: Yes - Mode: Inference - Network: DenseNet 201 - Device: OpenCL

OpenBenchmarking.orgFPS Per Watt, More Is BetterPlaidMLFP16: Yes - Mode: Inference - Network: DenseNet 201 - Device: OpenCLRTX 2070 SUPERTITAN RTXRTX 2080 TiRTX 2080 SUPERRTX 2080RTX 2070RTX 2060 SUPERRTX 2060GTX 1070 TiGTX 1660 TiGTX 1660GTX 1080GTX 1080 TiGTX 1070GTX 1060GTX 980GTX 980 TiGTX 9700.34430.68861.03291.37721.72151.531.521.471.411.291.271.261.151.010.990.960.950.940.940.720.590.580.54

PlaidML

System Power Consumption Monitor

OpenBenchmarking.orgWatts, Fewer Is BetterPlaidMLSystem Power Consumption MonitorGTX 1660GTX 1660 TiRTX 2070 SUPERGTX 1060GTX 1070 TiRTX 2060GTX 1070RTX 2070RTX 2080 SUPERRTX 2060 SUPERRTX 2080GTX 970GTX 1080GTX 980RTX 2080 TiTITAN RTXGTX 980 TiGTX 1080 Ti50100150200250Min: 45.8 / Avg: 106.92 / Max: 138.1Min: 48.2 / Avg: 115.16 / Max: 152Min: 49.1 / Avg: 124.58 / Max: 203.3Min: 45.7 / Avg: 125.77 / Max: 157.6Min: 53.5 / Avg: 128.35 / Max: 157.6Min: 49 / Avg: 134.34 / Max: 190.3Min: 48.3 / Avg: 135.38 / Max: 188.6Min: 51.5 / Avg: 138.71 / Max: 203.8Min: 48.8 / Avg: 141.86 / Max: 214.3Min: 55.8 / Avg: 142.16 / Max: 204.9Min: 51.5 / Avg: 146.49 / Max: 216.5Min: 52.1 / Avg: 148.78 / Max: 190.2Min: 49.1 / Avg: 151.63 / Max: 200.9Min: 53.5 / Avg: 157.67 / Max: 213.1Min: 52.4 / Avg: 173.16 / Max: 273Min: 52.7 / Avg: 173.29 / Max: 277.5Min: 57 / Avg: 191.08 / Max: 247.4Min: 109.8 / Avg: 203.83 / Max: 255.3

PlaidML

FP16: Yes - Mode: Inference - Network: VGG16 - Device: OpenCL

OpenBenchmarking.orgFPS, More Is BetterPlaidMLFP16: Yes - Mode: Inference - Network: VGG16 - Device: OpenCLTITAN RTXRTX 2080 TiRTX 2080 SUPERGTX 1080 TiRTX 2080RTX 2070 SUPERGTX 1080RTX 2070RTX 2060 SUPERGTX 1070 TiRTX 2060GTX 1070GTX 1660 TiGTX 980 TiGTX 1660GTX 1060GTX 980GTX 9704080120160200SE +/- 0.57, N = 3SE +/- 0.51, N = 3SE +/- 0.29, N = 3SE +/- 0.62, N = 3SE +/- 0.57, N = 3SE +/- 0.28, N = 3SE +/- 0.40, N = 3SE +/- 0.39, N = 3SE +/- 0.35, N = 3SE +/- 0.08, N = 3SE +/- 0.23, N = 3SE +/- 0.30, N = 3SE +/- 0.14, N = 3SE +/- 1.12, N = 3SE +/- 0.17, N = 3SE +/- 0.18, N = 3SE +/- 0.83, N = 4SE +/- 0.21, N = 3204.67194.83145.65145.42133.20123.20106.09105.60102.5892.0389.5580.2773.1871.2666.2456.0755.7049.76

PlaidML

FP16: Yes - Mode: Inference - Network: VGG16 - Device: OpenCL

OpenBenchmarking.orgFPS Per Watt, More Is BetterPlaidMLFP16: Yes - Mode: Inference - Network: VGG16 - Device: OpenCLRTX 2080 TiTITAN RTXRTX 2080 SUPERRTX 2080RTX 2070 SUPERGTX 1080 TiRTX 2070GTX 1070 TiGTX 1080RTX 2060 SUPERRTX 2060GTX 1070GTX 1660 TiGTX 1660GTX 1060GTX 980 TiGTX 980GTX 9700.2340.4680.7020.9361.171.040.940.800.770.660.620.610.570.560.550.550.490.480.480.370.290.280.27

PlaidML

System Power Consumption Monitor

OpenBenchmarking.orgWatts, Fewer Is BetterPlaidMLSystem Power Consumption MonitorGTX 1660GTX 1660 TiGTX 1060GTX 1070 TiGTX 1070RTX 2060RTX 2080RTX 2070RTX 2080 SUPERGTX 970RTX 2070 SUPERRTX 2060 SUPERRTX 2080 TiGTX 1080GTX 980TITAN RTXGTX 1080 TiGTX 980 Ti60120180240300Min: 45.6 / Avg: 137.8 / Max: 169.2Min: 47.3 / Avg: 151.58 / Max: 191.5Min: 45.8 / Avg: 152.31 / Max: 187.6Min: 95.2 / Avg: 160.1 / Max: 191.4Min: 47.7 / Avg: 162.2 / Max: 207.3Min: 48.1 / Avg: 163.79 / Max: 226.4Min: 54.1 / Avg: 173.35 / Max: 273.1Min: 48.1 / Avg: 174.02 / Max: 249.3Min: 49.4 / Avg: 181.31 / Max: 274.6Min: 51.5 / Avg: 184.27 / Max: 233.4Min: 46.7 / Avg: 187.65 / Max: 267.6Min: 54 / Avg: 187.95 / Max: 233.7Min: 52.7 / Avg: 188.04 / Max: 345.4Min: 88.2 / Avg: 189.28 / Max: 251.8Min: 69.1 / Avg: 196.2 / Max: 247.2Min: 53.8 / Avg: 216.91 / Max: 353.5Min: 118 / Avg: 235.58 / Max: 316.5Min: 55.1 / Avg: 244.29 / Max: 316.2

PlaidML

FP16: Yes - Mode: Inference - Network: VGG19 - Device: OpenCL

OpenBenchmarking.orgFPS, More Is BetterPlaidMLFP16: Yes - Mode: Inference - Network: VGG19 - Device: OpenCLTITAN RTXRTX 2080 TiRTX 2080 SUPERGTX 1080 TiRTX 2080RTX 2070 SUPERGTX 1080RTX 2070RTX 2060 SUPERGTX 1070 TiRTX 2060GTX 1070GTX 1660 TiGTX 980 TiGTX 1660GTX 1060GTX 980GTX 9704080120160200SE +/- 0.48, N = 3SE +/- 0.36, N = 3SE +/- 0.21, N = 3SE +/- 0.44, N = 3SE +/- 0.44, N = 3SE +/- 0.16, N = 3SE +/- 0.28, N = 3SE +/- 0.35, N = 3SE +/- 0.23, N = 3SE +/- 0.03, N = 3SE +/- 0.19, N = 3SE +/- 0.19, N = 3SE +/- 0.12, N = 3SE +/- 0.77, N = 3SE +/- 0.08, N = 3SE +/- 0.12, N = 3SE +/- 0.62, N = 4SE +/- 0.18, N = 3162.05154.20115.44115.03105.5497.8283.8383.5680.8273.1271.0763.5658.0356.1352.5244.3743.6339.34

PlaidML

FP16: Yes - Mode: Inference - Network: VGG19 - Device: OpenCL

OpenBenchmarking.orgFPS Per Watt, More Is BetterPlaidMLFP16: Yes - Mode: Inference - Network: VGG19 - Device: OpenCLRTX 2080 TiTITAN RTXRTX 2080 SUPERRTX 2080RTX 2070 SUPERGTX 1080 TiGTX 1070 TiRTX 2070GTX 1080RTX 2060RTX 2060 SUPERGTX 1660 TiGTX 1660GTX 1070GTX 1060GTX 980 TiGTX 980GTX 9700.16430.32860.49290.65720.82150.730.710.590.580.490.490.460.440.430.400.390.380.380.370.280.230.220.20

PlaidML

System Power Consumption Monitor

OpenBenchmarking.orgWatts, Fewer Is BetterPlaidMLSystem Power Consumption MonitorGTX 1660GTX 1660 TiGTX 1060GTX 1070 TiGTX 1070RTX 2060RTX 2080RTX 2070GTX 970GTX 1080RTX 2080 SUPERRTX 2070 SUPERGTX 980RTX 2060 SUPERRTX 2080 TiTITAN RTXGTX 1080 TiGTX 980 Ti60120180240300Min: 45.5 / Avg: 136.67 / Max: 171.6Min: 48.2 / Avg: 154.23 / Max: 191.6Min: 45.9 / Avg: 157.15 / Max: 187.3Min: 51.9 / Avg: 158.16 / Max: 196.1Min: 70.7 / Avg: 170.23 / Max: 208.9Min: 48.9 / Avg: 179.62 / Max: 228Min: 52.6 / Avg: 181.66 / Max: 277.7Min: 48.7 / Avg: 189.06 / Max: 250.5Min: 89.6 / Avg: 193.7 / Max: 220.3Min: 91.2 / Avg: 194.23 / Max: 252.2Min: 49.1 / Avg: 194.92 / Max: 278.5Min: 47.2 / Avg: 198.27 / Max: 271.7Min: 53.3 / Avg: 201.25 / Max: 246.9Min: 57.1 / Avg: 209.61 / Max: 237.5Min: 52.9 / Avg: 210.77 / Max: 350.6Min: 52.8 / Avg: 227.24 / Max: 356.3Min: 120.6 / Avg: 236.48 / Max: 318.6Min: 71.2 / Avg: 244.52 / Max: 316.6

PlaidML

FP16: No - Mode: Inference - Network: Mobilenet - Device: OpenCL

OpenBenchmarking.orgFPS, More Is BetterPlaidMLFP16: No - Mode: Inference - Network: Mobilenet - Device: OpenCLTITAN RTXRTX 2080 TiRTX 2080 SUPERGTX 1080 TiRTX 2080RTX 2070 SUPERRTX 2060 SUPERRTX 2070RTX 2060GTX 1080GTX 1070 TiGTX 1660 TiGTX 980 TiGTX 1070GTX 1660GTX 980GTX 1060GTX 9705001000150020002500SE +/- 13.68, N = 3SE +/- 6.28, N = 3SE +/- 2.80, N = 3SE +/- 5.20, N = 3SE +/- 4.17, N = 3SE +/- 1.25, N = 3SE +/- 1.59, N = 3SE +/- 1.46, N = 3SE +/- 2.11, N = 3SE +/- 1.27, N = 3SE +/- 0.73, N = 3SE +/- 0.86, N = 3SE +/- 0.07, N = 3SE +/- 1.57, N = 3SE +/- 1.38, N = 3SE +/- 0.24, N = 3SE +/- 0.63, N = 3SE +/- 0.75, N = 32466.662335.461762.001672.731663.871649.171531.011516.961232.471123.851009.261002.00990.12987.69814.65759.43726.30671.49

PlaidML

FP16: No - Mode: Inference - Network: Mobilenet - Device: OpenCL

OpenBenchmarking.orgFPS Per Watt, More Is BetterPlaidMLFP16: No - Mode: Inference - Network: Mobilenet - Device: OpenCLTITAN RTXRTX 2080 TiRTX 2070 SUPERRTX 2080 SUPERRTX 2070RTX 2080RTX 2060 SUPERRTX 2060GTX 1070 TiGTX 1660 TiGTX 1080 TiGTX 1070GTX 1660GTX 1080GTX 1060GTX 980 TiGTX 980GTX 97061218243023.2322.6319.7016.6014.8414.1612.9811.6711.3011.2010.229.659.569.357.596.645.535.20

PlaidML

FP16: No - Mode: Inference - Network: Inception V3 - Device: OpenCL

OpenBenchmarking.orgFPS, More Is BetterPlaidMLFP16: No - Mode: Inference - Network: Inception V3 - Device: OpenCLTITAN RTXRTX 2080 TiRTX 2080 SUPERGTX 1080 TiRTX 2080RTX 2070 SUPERRTX 2060 SUPERRTX 2070GTX 1080RTX 2060GTX 1070 TiGTX 1070GTX 1660 TiGTX 980 TiGTX 1660GTX 980GTX 1060GTX 97080160240320400SE +/- 0.42, N = 3SE +/- 0.38, N = 3SE +/- 0.10, N = 3SE +/- 0.14, N = 3SE +/- 0.57, N = 3SE +/- 0.07, N = 3SE +/- 0.25, N = 3SE +/- 0.29, N = 3SE +/- 0.38, N = 3SE +/- 0.23, N = 3SE +/- 0.06, N = 3SE +/- 0.09, N = 3SE +/- 0.23, N = 3SE +/- 0.07, N = 3SE +/- 0.12, N = 3SE +/- 0.17, N = 3SE +/- 0.10, N = 3SE +/- 0.16, N = 3347.93343.49259.26257.55238.73215.85199.43198.03184.80167.87153.34147.17140.05135.14116.90105.64104.4494.72

PlaidML

FP16: No - Mode: Inference - Network: Inception V3 - Device: OpenCL

OpenBenchmarking.orgFPS Per Watt, More Is BetterPlaidMLFP16: No - Mode: Inference - Network: Inception V3 - Device: OpenCLTITAN RTXRTX 2080 TiRTX 2080 SUPERRTX 2080RTX 2070 SUPERGTX 1080 TiRTX 2060 SUPERRTX 2070RTX 2060GTX 1070 TiGTX 1660 TiGTX 1070GTX 1660GTX 1080GTX 1060GTX 980 TiGTX 980GTX 9700.43880.87761.31641.75522.1941.951.661.521.361.341.341.231.181.111.081.020.990.950.940.700.610.560.52

PlaidML

System Power Consumption Monitor

OpenBenchmarking.orgWatts, Fewer Is BetterPlaidMLSystem Power Consumption MonitorGTX 1660GTX 1660 TiGTX 1070 TiGTX 1070GTX 1060RTX 2060RTX 2070 SUPERRTX 2060 SUPERRTX 2070RTX 2080 SUPERRTX 2080TITAN RTXGTX 970GTX 980GTX 1080 TiGTX 1080RTX 2080 TiGTX 980 Ti60120180240300Min: 46.3 / Avg: 123.06 / Max: 152.7Min: 46.3 / Avg: 136.65 / Max: 177.5Min: 51.1 / Avg: 141.76 / Max: 172.5Min: 84.3 / Avg: 149.15 / Max: 206.1Min: 46.9 / Avg: 150.12 / Max: 180Min: 47.6 / Avg: 150.66 / Max: 214.3Min: 49.5 / Avg: 161.34 / Max: 234.9Min: 54.4 / Avg: 162.79 / Max: 223.8Min: 49.8 / Avg: 167.7 / Max: 230.4Min: 49.6 / Avg: 170.73 / Max: 255.1Min: 49.4 / Avg: 176.08 / Max: 254.9Min: 56.2 / Avg: 178.56 / Max: 327.6Min: 81.4 / Avg: 182.54 / Max: 219.9Min: 56.7 / Avg: 188.31 / Max: 242.7Min: 128 / Avg: 191.53 / Max: 304Min: 84.7 / Avg: 196.13 / Max: 242.5Min: 51.8 / Avg: 206.66 / Max: 321.6Min: 126.5 / Avg: 220.09 / Max: 281.6

PlaidML

FP16: No - Mode: Inference - Network: ResNet 50 - Device: OpenCL

OpenBenchmarking.orgFPS, More Is BetterPlaidMLFP16: No - Mode: Inference - Network: ResNet 50 - Device: OpenCLTITAN RTXRTX 2080 TiGTX 1080 TiRTX 2080 SUPERRTX 2080RTX 2070 SUPERRTX 2070RTX 2060 SUPERGTX 1080RTX 2060GTX 1070 TiGTX 1070GTX 1660 TiGTX 980 TiGTX 1660GTX 980GTX 1060GTX 970140280420560700SE +/- 0.75, N = 3SE +/- 0.63, N = 3SE +/- 0.72, N = 3SE +/- 0.61, N = 3SE +/- 0.25, N = 3SE +/- 0.19, N = 3SE +/- 0.27, N = 3SE +/- 0.53, N = 3SE +/- 0.32, N = 3SE +/- 0.39, N = 3SE +/- 0.09, N = 3SE +/- 0.15, N = 3SE +/- 0.47, N = 3SE +/- 0.58, N = 3SE +/- 0.16, N = 3SE +/- 0.02, N = 3SE +/- 0.07, N = 3SE +/- 0.06, N = 3648.36634.09496.24468.70441.24421.58376.73374.71337.47319.25294.36276.89259.43247.47228.14203.91196.00181.87

PlaidML

FP16: No - Mode: Inference - Network: ResNet 50 - Device: OpenCL

OpenBenchmarking.orgFPS Per Watt, More Is BetterPlaidMLFP16: No - Mode: Inference - Network: ResNet 50 - Device: OpenCLTITAN RTXRTX 2080 TiRTX 2080RTX 2080 SUPERRTX 2070RTX 2070 SUPERGTX 1080 TiRTX 2060 SUPERGTX 1080RTX 2060GTX 1070 TiGTX 1660GTX 1660 TiGTX 1070GTX 1060GTX 980GTX 980 TiGTX 9701.13182.26363.39544.52725.6595.033.703.213.183.092.892.662.592.252.162.101.901.841.801.481.151.061.05

PlaidML

System Power Consumption Monitor

OpenBenchmarking.orgWatts, Fewer Is BetterPlaidMLSystem Power Consumption MonitorGTX 1660RTX 2070TITAN RTXGTX 1060RTX 2080GTX 1070 TiGTX 1660 TiRTX 2060 SUPERRTX 2070 SUPERRTX 2060GTX 1080GTX 1070RTX 2080 SUPERGTX 970GTX 980GTX 1080 TiGTX 980 Ti60120180240300Min: 46.3 / Avg: 119.8 / Max: 159.7Min: 47.5 / Avg: 122.1 / Max: 239.9Min: 52.7 / Avg: 128.84 / Max: 167.9Min: 45.9 / Avg: 132.6 / Max: 182.3Min: 52 / Avg: 137.63 / Max: 231.8Min: 52.2 / Avg: 140.17 / Max: 177.3Min: 47.9 / Avg: 141.14 / Max: 182.8Min: 55.4 / Avg: 144.71 / Max: 231.4Min: 46.8 / Avg: 145.98 / Max: 249.6Min: 48.6 / Avg: 147.64 / Max: 221.8Min: 48.4 / Avg: 149.71 / Max: 246.6Min: 89.6 / Avg: 153.55 / Max: 208.4Min: 49.4 / Avg: 162.94 / Max: 270.3Min: 83.3 / Avg: 172.91 / Max: 233.2Min: 53 / Avg: 176.69 / Max: 244.6Min: 56.4 / Avg: 186.43 / Max: 312.7Min: 129.1 / Avg: 233.7 / Max: 292

PlaidML

FP16: No - Mode: Inference - Network: IMDB LSTM - Device: OpenCL

OpenBenchmarking.orgFPS, More Is BetterPlaidMLFP16: No - Mode: Inference - Network: IMDB LSTM - Device: OpenCLTITAN RTXRTX 2080 TiRTX 2080 SUPERRTX 2080GTX 1080 TiRTX 2070 SUPERRTX 2070RTX 2060 SUPERGTX 1080RTX 2060GTX 1070 TiGTX 1660 TiGTX 1070GTX 1660GTX 980 TiGTX 980GTX 1060GTX 9702004006008001000SE +/- 2.25, N = 3SE +/- 1.01, N = 3SE +/- 1.47, N = 3SE +/- 1.63, N = 3SE +/- 0.74, N = 3SE +/- 0.67, N = 3SE +/- 0.21, N = 3SE +/- 0.31, N = 3SE +/- 0.31, N = 3SE +/- 0.37, N = 3SE +/- 0.49, N = 3SE +/- 0.15, N = 3SE +/- 0.13, N = 3SE +/- 0.01, N = 3SE +/- 0.56, N = 3SE +/- 0.50, N = 3SE +/- 0.17, N = 3SE +/- 0.03, N = 3790.77758.21589.86548.83523.98499.69446.23440.79399.00389.40333.03315.83315.37287.68270.00231.66224.89204.32

PlaidML

FP16: No - Mode: Inference - Network: IMDB LSTM - Device: OpenCL

OpenBenchmarking.orgFPS Per Watt, More Is BetterPlaidMLFP16: No - Mode: Inference - Network: IMDB LSTM - Device: OpenCLTITAN RTXRTX 2080 TiRTX 2080 SUPERRTX 2080RTX 2070RTX 2070 SUPERRTX 2060 SUPERGTX 1660 TiRTX 2060GTX 1080 TiGTX 1660GTX 1080GTX 1070 TiGTX 1070GTX 1060GTX 980GTX 980 TiGTX 9701.14532.29063.43594.58125.72655.094.564.523.953.683.673.233.143.103.002.982.812.592.371.831.431.411.28

PlaidML

System Power Consumption Monitor

OpenBenchmarking.orgWatts, Fewer Is BetterPlaidMLSystem Power Consumption MonitorGTX 1660GTX 1660 TiGTX 1060RTX 2060GTX 1070 TiRTX 2080 SUPERGTX 1070RTX 2070 SUPERRTX 2060 SUPERRTX 2080GTX 1080GTX 970GTX 980RTX 2080 TiGTX 980 Ti50100150200250Min: 46.3 / Avg: 96.5 / Max: 135.8Min: 46.6 / Avg: 100.43 / Max: 150.5Min: 46.3 / Avg: 122.88 / Max: 159.6Min: 49.2 / Avg: 125.65 / Max: 186.5Min: 52.4 / Avg: 128.8 / Max: 152Min: 51.8 / Avg: 130.6 / Max: 207.8Min: 50.4 / Avg: 132.86 / Max: 187.3Min: 49.2 / Avg: 136.18 / Max: 192.6Min: 54.9 / Avg: 136.39 / Max: 187.2Min: 56.5 / Avg: 138.96 / Max: 215.1Min: 48.5 / Avg: 142.23 / Max: 208.8Min: 94.4 / Avg: 160.18 / Max: 203.4Min: 100 / Avg: 162.49 / Max: 218.7Min: 52.6 / Avg: 166.27 / Max: 275.3Min: 57.1 / Avg: 192.1 / Max: 249.1

PlaidML

FP16: No - Mode: Inference - Network: VGG16 - Device: OpenCL

OpenBenchmarking.orgFPS, More Is BetterPlaidMLFP16: No - Mode: Inference - Network: VGG16 - Device: OpenCLTITAN RTXRTX 2080 TiRTX 2080 SUPERGTX 1080 TiRTX 2080RTX 2070 SUPERRTX 2070RTX 2060 SUPERGTX 1080GTX 1070 TiRTX 2060GTX 1070GTX 1660 TiGTX 980 TiGTX 1660GTX 1060GTX 980GTX 97050100150200250SE +/- 0.40, N = 3SE +/- 0.50, N = 3SE +/- 0.28, N = 3SE +/- 0.62, N = 3SE +/- 0.73, N = 3SE +/- 0.29, N = 3SE +/- 0.43, N = 3SE +/- 0.34, N = 3SE +/- 0.38, N = 3SE +/- 0.06, N = 3SE +/- 0.32, N = 3SE +/- 0.17, N = 3SE +/- 0.24, N = 3SE +/- 1.36, N = 3SE +/- 0.21, N = 3SE +/- 0.12, N = 3SE +/- 0.79, N = 3SE +/- 0.05, N = 3247.83234.65180.45175.37164.05154.64131.54128.22128.05114.03110.9397.3292.4587.3984.8369.3168.9560.32

PlaidML

FP16: No - Mode: Inference - Network: VGG16 - Device: OpenCL

OpenBenchmarking.orgFPS Per Watt, More Is BetterPlaidMLFP16: No - Mode: Inference - Network: VGG16 - Device: OpenCLTITAN RTXRTX 2080 TiRTX 2080 SUPERRTX 2080RTX 2070 SUPERGTX 1080 TiRTX 2060 SUPERRTX 2070GTX 1070 TiRTX 2060GTX 1080GTX 1660GTX 1660 TiGTX 1070GTX 1060GTX 980 TiGTX 980GTX 9700.23180.46360.69540.92721.1591.030.980.820.820.810.750.710.680.670.620.610.580.560.560.420.320.320.31

PlaidML

System Power Consumption Monitor

OpenBenchmarking.orgWatts, Fewer Is BetterPlaidMLSystem Power Consumption MonitorGTX 1660GTX 1660 TiGTX 1060GTX 1070 TiGTX 1070RTX 2060RTX 2060 SUPERRTX 2070 SUPERRTX 2070GTX 970RTX 2080GTX 1080GTX 980RTX 2080 SUPERGTX 1080 TiRTX 2080 TiTITAN RTXGTX 980 Ti60120180240300Min: 45.6 / Avg: 146.27 / Max: 182Min: 46.4 / Avg: 163.81 / Max: 195.7Min: 69.4 / Avg: 166.46 / Max: 190Min: 52.3 / Avg: 169.99 / Max: 205.7Min: 50 / Avg: 172.78 / Max: 208.8Min: 48.4 / Avg: 179.22 / Max: 228.5Min: 53.3 / Avg: 181.51 / Max: 239.5Min: 47.2 / Avg: 191.71 / Max: 276.3Min: 48.4 / Avg: 193.79 / Max: 250.6Min: 94.5 / Avg: 195.88 / Max: 219.3Min: 48.9 / Avg: 201.23 / Max: 285.7Min: 46.2 / Avg: 209.24 / Max: 254.3Min: 90.4 / Avg: 213.83 / Max: 251.4Min: 47.7 / Avg: 218.91 / Max: 299.1Min: 51.8 / Avg: 234.29 / Max: 318.4Min: 52.7 / Avg: 239.16 / Max: 354.3Min: 52.4 / Avg: 239.94 / Max: 363Min: 56.5 / Avg: 270.73 / Max: 328.7

PlaidML

FP16: No - Mode: Inference - Network: VGG19 - Device: OpenCL

OpenBenchmarking.orgFPS, More Is BetterPlaidMLFP16: No - Mode: Inference - Network: VGG19 - Device: OpenCLTITAN RTXRTX 2080 TiRTX 2080 SUPERGTX 1080 TiRTX 2080RTX 2070 SUPERRTX 2070RTX 2060 SUPERGTX 1080GTX 1070 TiRTX 2060GTX 1070GTX 1660 TiGTX 980 TiGTX 1660GTX 1060GTX 980GTX 9704080120160200SE +/- 0.54, N = 3SE +/- 0.41, N = 3SE +/- 0.22, N = 3SE +/- 0.35, N = 3SE +/- 0.42, N = 3SE +/- 0.23, N = 3SE +/- 0.25, N = 3SE +/- 0.19, N = 3SE +/- 0.16, N = 3SE +/- 0.06, N = 3SE +/- 0.17, N = 3SE +/- 0.11, N = 3SE +/- 0.12, N = 3SE +/- 0.65, N = 3SE +/- 0.17, N = 3SE +/- 0.08, N = 3SE +/- 0.47, N = 3SE +/- 0.01, N = 3196.44186.19143.02138.68129.58122.32103.89101.17101.0090.3488.0476.8973.3568.4767.2454.7853.4947.70

PlaidML

FP16: No - Mode: Inference - Network: VGG19 - Device: OpenCL

OpenBenchmarking.orgFPS Per Watt, More Is BetterPlaidMLFP16: No - Mode: Inference - Network: VGG19 - Device: OpenCLTITAN RTXRTX 2080 TiRTX 2080 SUPERRTX 2070 SUPERRTX 2080GTX 1080 TiRTX 2070RTX 2060 SUPERGTX 1070 TiGTX 1080RTX 2060GTX 1660 TiGTX 1070GTX 1660GTX 1060GTX 980GTX 980 TiGTX 9700.16880.33760.50640.67520.8440.750.740.640.610.560.560.530.520.500.480.460.440.430.420.320.260.250.24

PlaidML

System Power Consumption Monitor

OpenBenchmarking.orgWatts, Fewer Is BetterPlaidMLSystem Power Consumption MonitorGTX 1660GTX 1660 TiGTX 1060GTX 1070 TiGTX 1070RTX 2060RTX 2060 SUPERRTX 2070RTX 2070 SUPERGTX 970GTX 980GTX 1080RTX 2080 SUPERRTX 2080GTX 1080 TiRTX 2080 TiTITAN RTXGTX 980 Ti60120180240300Min: 46 / Avg: 160.67 / Max: 185.8Min: 48.3 / Avg: 167.7 / Max: 196.3Min: 45.1 / Avg: 170.04 / Max: 188.8Min: 52.4 / Avg: 180.41 / Max: 207.7Min: 84.2 / Avg: 180.68 / Max: 209.8Min: 50.1 / Avg: 192.21 / Max: 230.7Min: 55 / Avg: 193.52 / Max: 240.6Min: 49.7 / Avg: 197.21 / Max: 252.5Min: 47.5 / Avg: 199.98 / Max: 276.8Min: 75.4 / Avg: 201.26 / Max: 220.7Min: 55.7 / Avg: 208.34 / Max: 246.7Min: 89.9 / Avg: 209.47 / Max: 253.5Min: 49.5 / Avg: 224.18 / Max: 302.6Min: 49.9 / Avg: 230.45 / Max: 288.2Min: 55.7 / Avg: 245.95 / Max: 321.1Min: 52.9 / Avg: 251.39 / Max: 354Min: 53.2 / Avg: 260.22 / Max: 361.7Min: 119.7 / Avg: 273.57 / Max: 330.8

LeelaChessZero

Backend: OpenCL

OpenBenchmarking.orgNodes Per Second, More Is BetterLeelaChessZero 0.22.0Backend: OpenCLTITAN RTXRTX 2080 TiRTX 2080 SUPERGTX 1080 TiRTX 2080RTX 2070 SUPERGTX 1080RTX 2070RTX 2060 SUPERGTX 1070 TiRTX 2060GTX 1070GTX 980 TiGTX 1660 TiGTX 1660GTX 980GTX 1060GTX 9707001400210028003500SE +/- 28.21, N = 3SE +/- 8.77, N = 3SE +/- 29.82, N = 3SE +/- 32.29, N = 3SE +/- 21.60, N = 3SE +/- 17.64, N = 7SE +/- 14.70, N = 3SE +/- 16.93, N = 15SE +/- 18.12, N = 15SE +/- 8.69, N = 6SE +/- 1.84, N = 3SE +/- 12.32, N = 15SE +/- 5.67, N = 15SE +/- 5.83, N = 15SE +/- 4.05, N = 15SE +/- 2.79, N = 3SE +/- 3.68, N = 4SE +/- 1.93, N = 153126.483032.102105.261886.301879.991604.211146.75999.75998.17753.69704.69642.12466.84420.04335.86280.99262.41207.841. (CXX) g++ options: -lpthread

LeelaChessZero

Backend: OpenCL

OpenBenchmarking.orgNodes Per Second Per Watt, More Is BetterLeelaChessZero 0.22.0Backend: OpenCLTITAN RTXRTX 2080 TiRTX 2080 SUPERRTX 2080RTX 2070 SUPERGTX 1080 TiGTX 1080RTX 2060 SUPERGTX 1070 TiRTX 2070RTX 2060GTX 1070GTX 1660 TiGTX 1660GTX 980 TiGTX 1060GTX 980GTX 9704812162015.8114.0012.3210.738.988.757.106.575.865.784.794.213.132.842.161.901.831.26

LeelaChessZero

System Power Consumption Monitor

OpenBenchmarking.orgWatts, Fewer Is BetterLeelaChessZero 0.22.0System Power Consumption MonitorGTX 1660GTX 1070 TiGTX 1660 TiGTX 1060RTX 2060RTX 2060 SUPERGTX 1070GTX 980GTX 1080GTX 970RTX 2080 SUPERRTX 2070RTX 2080RTX 2070 SUPERTITAN RTXGTX 1080 TiGTX 980 Ti70140210280350Min: 46.5 / Avg: 118.46 / Max: 180.4Min: 52 / Avg: 128.59 / Max: 197.7Min: 47.9 / Avg: 134.26 / Max: 195.9Min: 47.2 / Avg: 138.37 / Max: 187.2Min: 49.1 / Avg: 147.07 / Max: 231.4Min: 45.5 / Avg: 151.83 / Max: 241.9Min: 71.9 / Avg: 152.4 / Max: 214.7Min: 51.8 / Avg: 153.94 / Max: 247.5Min: 48.8 / Avg: 161.47 / Max: 252.9Min: 82.3 / Avg: 164.63 / Max: 252.9Min: 47.5 / Avg: 170.9 / Max: 315Min: 48.6 / Avg: 172.95 / Max: 253.7Min: 52.8 / Avg: 175.13 / Max: 286.6Min: 47.2 / Avg: 178.69 / Max: 276Min: 53.3 / Avg: 197.7 / Max: 371.4Min: 106.6 / Avg: 215.46 / Max: 320.5Min: 59.1 / Avg: 216.14 / Max: 319.4

OctaneBench

Total Score

OpenBenchmarking.orgScore, More Is BetterOctaneBench 4.00cTotal ScoreTITAN RTXRTX 2080 TiRTX 2080 SUPERRTX 2080RTX 2070 SUPERGTX 1080 TiRTX 2070RTX 2060 SUPERRTX 2060GTX 1080GTX 980 TiGTX 1070 TiGTX 1070GTX 1660 TiGTX 1660GTX 980GTX 970GTX 106070140210280350322.76309.04233.56222.88220.76212.04206.88205.23164.52147.98142.20141.35132.86132.28118.49109.7095.6091.44

OctaneBench

Total Score

OpenBenchmarking.orgScore Per Watt, More Is BetterOctaneBench 4.00cTotal ScoreGTX 1070 TiRTX 2080 SUPERRTX 2070 SUPERTITAN RTXRTX 2060 SUPERRTX 2080 TiRTX 2070RTX 2080GTX 1660GTX 1660 TiGTX 1080 TiGTX 1080RTX 2060GTX 1070GTX 1060GTX 980 TiGTX 980GTX 9700.24080.48160.72240.96321.2041.071.041.040.990.970.960.960.930.930.910.890.880.870.840.760.640.610.60

OctaneBench

System Power Consumption Monitor

OpenBenchmarking.orgWatts, Fewer Is BetterOctaneBench 4.00cSystem Power Consumption MonitorGTX 1060GTX 1660GTX 1070 TiGTX 1660 TiGTX 1070GTX 970GTX 1080GTX 980RTX 2060RTX 2060 SUPERRTX 2070 SUPERRTX 2070GTX 980 TiRTX 2080 SUPERGTX 1080 TiRTX 2080RTX 2080 TiTITAN RTX60120180240300Min: 44.9 / Avg: 120.33 / Max: 135.2Min: 46.3 / Avg: 127.11 / Max: 144.7Min: 52.2 / Avg: 132.45 / Max: 182.7Min: 47.1 / Avg: 145.79 / Max: 161.1Min: 86 / Avg: 157.88 / Max: 173.8Min: 50.8 / Avg: 160.22 / Max: 180Min: 48.3 / Avg: 167.77 / Max: 228.3Min: 53.6 / Avg: 178.66 / Max: 203.2Min: 49.8 / Avg: 188.5 / Max: 218.2Min: 46.5 / Avg: 210.53 / Max: 232.6Min: 49 / Avg: 211.57 / Max: 245.6Min: 47.1 / Avg: 215.17 / Max: 242.1Min: 128.3 / Avg: 220.62 / Max: 240Min: 47.8 / Avg: 225.1 / Max: 261.8Min: 130.6 / Avg: 236.94 / Max: 265Min: 50 / Avg: 239.21 / Max: 278.1Min: 51.7 / Avg: 322.94 / Max: 355.5Min: 55.3 / Avg: 326.69 / Max: 357.7

GPU Temperature Monitor

Phoronix Test Suite System Monitoring

OpenBenchmarking.orgCelsiusGPU Temperature MonitorPhoronix Test Suite System MonitoringRTX 2070 SUPERGTX 1070 TiGTX 1660 TiGTX 970RTX 2080 SUPERRTX 2060 SUPERGTX 1660RTX 2060GTX 1060RTX 2070RTX 2080 TiGTX 1070TITAN RTXGTX 1080RTX 2080GTX 1080 TiGTX 980GTX 980 Ti1632486480Min: 27 / Avg: 43.67 / Max: 69Min: 39 / Avg: 48.41 / Max: 61Min: 30 / Avg: 50.73 / Max: 65Min: 28 / Avg: 52.34 / Max: 68Min: 34 / Avg: 53.35 / Max: 70Min: 29 / Avg: 54.33 / Max: 75Min: 28 / Avg: 56.71 / Max: 77Min: 32 / Avg: 57.94 / Max: 72Min: 30 / Avg: 58.15 / Max: 74Min: 28 / Avg: 58.64 / Max: 77Min: 31 / Avg: 60.94 / Max: 77Min: 28 / Avg: 61.94 / Max: 76Min: 37 / Avg: 62.01 / Max: 80Min: 30 / Avg: 63.66 / Max: 77Min: 30 / Avg: 66.02 / Max: 83Min: 34 / Avg: 67.92 / Max: 84Min: 29 / Avg: 68.53 / Max: 81Min: 36 / Avg: 71.62 / Max: 85

System Power Consumption Monitor

Phoronix Test Suite System Monitoring

OpenBenchmarking.orgWattsSystem Power Consumption MonitorPhoronix Test Suite System MonitoringGTX 1660GTX 1660 TiGTX 1060GTX 1070 TiRTX 2070 SUPERGTX 1070RTX 2060GTX 970RTX 2060 SUPERGTX 1080RTX 2070GTX 980RTX 2080 SUPERRTX 2080GTX 980 TiGTX 1080 TiRTX 2080 TiTITAN RTX70140210280350Min: 43.1 / Avg: 115.15 / Max: 262.4Min: 45.4 / Avg: 127.55 / Max: 273.9Min: 44.3 / Avg: 128.45 / Max: 269.5Min: 48.6 / Avg: 131.89 / Max: 259.9Min: 45.5 / Avg: 134.05 / Max: 323.3Min: 43.8 / Avg: 150.54 / Max: 286.9Min: 46.1 / Avg: 153.75 / Max: 303.8Min: 48.8 / Avg: 157.71 / Max: 306.3Min: 45.4 / Avg: 158.95 / Max: 312Min: 44.9 / Avg: 162.99 / Max: 328.3Min: 46 / Avg: 164.53 / Max: 321.3Min: 49.8 / Avg: 167.77 / Max: 329.4Min: 46 / Avg: 173.42 / Max: 330.5Min: 47.5 / Avg: 181.54 / Max: 342.9Min: 53.6 / Avg: 199.07 / Max: 370.3Min: 49.6 / Avg: 207.86 / Max: 380Min: 49.7 / Avg: 227.4 / Max: 374Min: 50.6 / Avg: 227.86 / Max: 371.4

Phoronix Test Suite v10.8.5