NVIDIA TITAN RTX Linux GPU Compute Benchmarks

NVIDIA and AMD GPU Linux compute benchmarks December 2018 by Michael Larabel for a future article, review of the NVIDIA TITAN RTX.

HTML result view exported from: https://openbenchmarking.org/result/1812224-SP-GPUCOMPUT75&grs&sro.

NVIDIA TITAN RTX Linux GPU Compute BenchmarksProcessorMotherboardChipsetMemoryDiskGraphicsAudioMonitorNetworkOSKernelDesktopDisplay ServerDisplay DriverOpenGLOpenCLVulkanCompilerFile-SystemScreen ResolutionGTX 980GTX 980 TiGTX TITAN X GM200GTX 1070GTX 1070 TiGTX 1080GTX 1080 TiRTX 2070RTX 2080RTX 2080 TiTITAN RTXRX Vega 56RX Vega 64Intel Core i9-9900K @ 5.00GHz (8 Cores / 16 Threads)ASUS PRIME Z390-A (0602 BIOS)Intel Cannon Lake PCH Shared SRAM16384MB2000GB SABRENT + Samsung SSD 970 EVO 250GBNVIDIA GeForce GTX 980 4GB (1126/3505MHz)Realtek ALC1220Acer B286HKIntel ConnectionUbuntu 18.044.19.5-041905-generic (x86_64)GNOME Shell 3.28.3X Server 1.19.6NVIDIA 415.234.6.0OpenCL 1.2 CUDA 10.0.1321.1.84GCC 7.3.0 + CUDA 10.0ext43840x2160NVIDIA GeForce GTX 980 Ti 6GB (999/3505MHz)NVIDIA GeForce GTX TITAN X 12GB (1001/3505MHz)NVIDIA GeForce GTX 1070 8GB (1506/4006MHz)NVIDIA 415.22Zotac NVIDIA GeForce GTX 1070 Ti 8GB (1607/4006MHz)NVIDIA GeForce GTX 1080 8GB (1607/5005MHz)NVIDIA GeForce GTX 1080 Ti 11GB (1480/5508MHz)eVGA NVIDIA GeForce RTX 2070 8GB (1410/7000MHz)Zotac NVIDIA GeForce RTX 2080 8GB (1515/7000MHz)NVIDIA GeForce RTX 2080 Ti 11GB (1350/7000MHz)NVIDIA TITAN RTX 24GB (1350/7000MHz)NVIDIA 415.23AMD Radeon RX Vega 8GB (1590/800MHz)4.5 Mesa 19.0.0-devel padoka PPA (LLVM 8.0.0)OpenCL 2.1 AMD-APP (2679.0)1.1.70GCC 7.3.0AMD Radeon RX Vega 8GB (1630/945MHz)OpenBenchmarking.orgCompiler Details- --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++ --enable-libmpx --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib --with-tune=generic --without-cuda-driver -v Processor Details- Scaling Governor: intel_pstate performanceOpenCL Details- GTX 980: GPU Compute Cores: 2048- GTX 980 Ti: GPU Compute Cores: 2816- GTX TITAN X GM200: GPU Compute Cores: 3072- GTX 1070: GPU Compute Cores: 1920- GTX 1070 Ti: GPU Compute Cores: 2432- GTX 1080: GPU Compute Cores: 2560- GTX 1080 Ti: GPU Compute Cores: 3584- RTX 2070: GPU Compute Cores: 2304- RTX 2080: GPU Compute Cores: 2944- RTX 2080 Ti: GPU Compute Cores: 4352- TITAN RTX: GPU Compute Cores: 4608Security Details- __user pointer sanitization + Full generic retpoline IBPB IBRS_FW + SSB disabled via prctl and seccomp

NVIDIA TITAN RTX Linux GPU Compute Benchmarksngc-tensorflow: AlexNet, FP16ngc-tensorflow: Inception v4, FP16luxmark: GPU - Luxball HDRngc-tensorflow: ResNet-50, FP16shoc: OpenCL - FFT SPcl-mem: Copyngc-tensorflow: Googlenet, FP16ngc-tensorflow: VGG-16, FP16ngc-tensorflow: AlexNet, FP32ngc-tensorflow: ResNet-50, FP32ngc-tensorflow: VGG-16, FP32v-ray: CUDA GPUGTX 980GTX 980 TiGTX TITAN X GM200GTX 1070GTX 1070 TiGTX 1080GTX 1080 TiRTX 2070RTX 2080RTX 2080 TiTITAN RTXRX Vega 56RX Vega 641208132424681431154106.51155240.901691015072821735677.57150177.70166243.231729915672621837279.20158712572.7780.62156344.771728816045218737576.93151612571.5790.43168349.231688617549718841384.43159113376.4086.30187555.031382319357520945893.13176414382.90102.07267474.6321562271972317629131.372539210119.5066.4130091309998330217466.023153102.77296413351083328738153.332419205108.5772.074432135.904269344914434541015206.973344285152.4056.095032152.804593252015484841132244.403576299162.3350.0831179926203328151070221OpenBenchmarking.org

NVIDIA GPU Cloud TensorFlow

System Power Consumption Monitor

OpenBenchmarking.orgWatts, Fewer Is BetterNVIDIA GPU Cloud TensorFlow 18.09System Power Consumption MonitorGTX 1070GTX 1070 TiGTX 1080GTX 1080 TiGTX 980 TiGTX TITAN X GM200RTX 2080RTX 2080 TiTITAN RTX60120180240300Min: 43.4 / Avg: 181.99 / Max: 210.5Min: 46.8 / Avg: 163.6 / Max: 187.8Min: 76.2 / Avg: 215.22 / Max: 247Min: 64 / Avg: 257.4 / Max: 319.4Min: 124.1 / Avg: 260.98 / Max: 317Min: 102.1 / Avg: 265.29 / Max: 320.1Min: 47.7 / Avg: 229.8 / Max: 284.5Min: 49.5 / Avg: 249.29 / Max: 343.1Min: 50.7 / Avg: 275.3 / Max: 360

NVIDIA GPU Cloud TensorFlow

System Power Consumption Monitor

OpenBenchmarking.orgWatts, Fewer Is BetterNVIDIA GPU Cloud TensorFlow 18.09System Power Consumption MonitorGTX 1070GTX 1070 TiGTX 1080GTX 1080 TiGTX TITAN X GM200RTX 2080RTX 2080 TiTITAN RTX70140210280350Min: 45.9 / Avg: 172.02 / Max: 213.8Min: 48 / Avg: 157.29 / Max: 187.8Min: 44.1 / Avg: 196.38 / Max: 249.7Min: 79.7 / Avg: 234.81 / Max: 318.6Min: 56.2 / Avg: 255.72 / Max: 321Min: 48 / Avg: 206.72 / Max: 285Min: 50.5 / Avg: 248.25 / Max: 346.7Min: 50.5 / Avg: 252.59 / Max: 364.6

NVIDIA GPU Cloud TensorFlow

System Power Consumption Monitor

OpenBenchmarking.orgWatts, Fewer Is BetterNVIDIA GPU Cloud TensorFlow 18.09System Power Consumption MonitorGTX 1070GTX 1070 TiGTX 1080GTX 1080 TiGTX 980 TiGTX TITAN X GM200RTX 2070RTX 2080RTX 2080 TiTITAN RTX60120180240300Min: 42.7 / Avg: 174.04 / Max: 212.6Min: 47 / Avg: 153.76 / Max: 192.3Min: 44.7 / Avg: 189.85 / Max: 248.8Min: 54.6 / Avg: 222.3 / Max: 319.6Min: 52.8 / Avg: 244.09 / Max: 310.7Min: 55.5 / Avg: 252.42 / Max: 326.9Min: 71.1 / Avg: 162.36 / Max: 246.8Min: 47.3 / Avg: 179.59 / Max: 284.7Min: 56.1 / Avg: 213.62 / Max: 342.3Min: 51 / Avg: 203.63 / Max: 350.6

NVIDIA GPU Cloud TensorFlow

System Power Consumption Monitor

OpenBenchmarking.orgWatts, Fewer Is BetterNVIDIA GPU Cloud TensorFlow 18.09System Power Consumption MonitorGTX 1070GTX 1070 TiGTX 1080GTX 1080 TiGTX 980 TiGTX TITAN X GM200RTX 2080RTX 2080 TiTITAN RTX60120180240300Min: 43.7 / Avg: 168.53 / Max: 201.8Min: 46.8 / Avg: 160.44 / Max: 192Min: 90.8 / Avg: 194.86 / Max: 239.8Min: 51.7 / Avg: 242.51 / Max: 313.1Min: 52.4 / Avg: 254.36 / Max: 318.4Min: 81.5 / Avg: 277.12 / Max: 327.7Min: 48.1 / Avg: 223.76 / Max: 283.3Min: 51 / Avg: 219.66 / Max: 332.2Min: 49.3 / Avg: 256.56 / Max: 354.6

NVIDIA GPU Cloud TensorFlow

System Power Consumption Monitor

OpenBenchmarking.orgWatts, Fewer Is BetterNVIDIA GPU Cloud TensorFlow 18.09System Power Consumption MonitorGTX 1070GTX 1070 TiGTX 1080GTX 1080 TiGTX 980 TiGTX TITAN X GM200RTX 2080RTX 2080 TiTITAN RTX60120180240300Min: 44.1 / Avg: 157.87 / Max: 210.2Min: 47.2 / Avg: 146.22 / Max: 188.6Min: 71.3 / Avg: 185.89 / Max: 249.7Min: 52.2 / Avg: 211.84 / Max: 320.9Min: 52.9 / Avg: 226.01 / Max: 305.4Min: 55.1 / Avg: 232.58 / Max: 323Min: 47.6 / Avg: 177.11 / Max: 285.3Min: 50 / Avg: 183.11 / Max: 341.1Min: 58.3 / Avg: 196.21 / Max: 353.3

NVIDIA GPU Cloud TensorFlow

System Power Consumption Monitor

OpenBenchmarking.orgWatts, Fewer Is BetterNVIDIA GPU Cloud TensorFlow 18.09System Power Consumption MonitorGTX 1070GTX 1070 TiGTX 1080GTX 1080 TiGTX 980GTX 980 TiGTX TITAN X GM200RTX 2080RTX 2080 TiTITAN RTX60120180240300Min: 68.9 / Avg: 158.49 / Max: 192.3Min: 46.9 / Avg: 135.79 / Max: 175Min: 44.1 / Avg: 167.55 / Max: 234.8Min: 51.3 / Avg: 213.37 / Max: 303.2Min: 48.6 / Avg: 187.19 / Max: 240.4Min: 135.2 / Avg: 237.19 / Max: 295.5Min: 55.1 / Avg: 236.59 / Max: 321.2Min: 47.3 / Avg: 190.7 / Max: 270.1Min: 49.3 / Avg: 177.62 / Max: 332.6Min: 50.6 / Avg: 195.26 / Max: 352.6

NVIDIA GPU Cloud TensorFlow

System Power Consumption Monitor

OpenBenchmarking.orgWatts, Fewer Is BetterNVIDIA GPU Cloud TensorFlow 18.09System Power Consumption MonitorGTX 1070GTX 1070 TiGTX 1080GTX 1080 TiGTX TITAN X GM200RTX 2080RTX 2080 TiTITAN RTX60120180240300Min: 54.1 / Avg: 170.77 / Max: 203.5Min: 58.5 / Avg: 162.02 / Max: 191Min: 46.3 / Avg: 198.19 / Max: 236.2Min: 51.2 / Avg: 241.65 / Max: 309.7Min: 53 / Avg: 261.76 / Max: 321.8Min: 55.7 / Avg: 239.26 / Max: 287.8Min: 50.2 / Avg: 270.5 / Max: 342.3Min: 60 / Avg: 281.79 / Max: 357.7

NVIDIA GPU Cloud TensorFlow

System Power Consumption Monitor

OpenBenchmarking.orgWatts, Fewer Is BetterNVIDIA GPU Cloud TensorFlow 18.09System Power Consumption MonitorGTX 1070GTX 1070 TiGTX 1080GTX 1080 TiGTX 980GTX 980 TiGTX TITAN X GM200RTX 2070RTX 2080RTX 2080 TiTITAN RTX60120180240300Min: 87.1 / Avg: 157.65 / Max: 201.5Min: 48.2 / Avg: 144.76 / Max: 185.9Min: 100.9 / Avg: 178.22 / Max: 229Min: 126 / Avg: 208.21 / Max: 307.4Min: 101.5 / Avg: 186.05 / Max: 232.5Min: 122.8 / Avg: 227.61 / Max: 318.8Min: 136.3 / Avg: 252.18 / Max: 313.2Min: 64.2 / Avg: 185.45 / Max: 243.7Min: 48 / Avg: 211.46 / Max: 284.1Min: 48.9 / Avg: 257.45 / Max: 338.7Min: 78.6 / Avg: 243.91 / Max: 357

LuxMark

System Power Consumption Monitor

OpenBenchmarking.orgWatts, Fewer Is BetterLuxMark 3.1System Power Consumption MonitorGTX 1070GTX 1070 TiGTX 1080GTX 1080 TiGTX 980GTX 980 TiGTX TITAN X GM200RTX 2070RTX 2080RTX 2080 TiRX Vega 56RX Vega 64TITAN RTX60120180240300Min: 83.1 / Avg: 176.9 / Max: 181.3Min: 146.8 / Avg: 148.92 / Max: 149.4Min: 90.8 / Avg: 174.24 / Max: 176.2Min: 122.9 / Avg: 241.59 / Max: 247.8Min: 80.2 / Avg: 189.6 / Max: 196.9Min: 118.7 / Avg: 233.83 / Max: 241.4Min: 126.4 / Avg: 249.16 / Max: 256.8Min: 78 / Avg: 225.33 / Max: 232.6Min: 101.9 / Avg: 240.83 / Max: 247.3Min: 111.1 / Avg: 315.29 / Max: 328.4Min: 51.8 / Avg: 251.16 / Max: 263.3Min: 53 / Avg: 323.35 / Max: 337.9Min: 48.7 / Avg: 329.43 / Max: 344

Chaos Group V-RAY

System Power Consumption Monitor

OpenBenchmarking.orgWatts, Fewer Is BetterChaos Group V-RAY 1.1.0System Power Consumption MonitorGTX 1070GTX 1070 TiGTX 1080GTX 1080 TiGTX 980GTX 980 TiGTX TITAN X GM200RTX 2070RTX 2080RTX 2080 TiTITAN RTX50100150200250Min: 43.4 / Avg: 151.17 / Max: 164.2Min: 46.1 / Avg: 130.78 / Max: 135.6Min: 43.6 / Avg: 153.26 / Max: 165.9Min: 120.4 / Avg: 218.99 / Max: 231.8Min: 47.6 / Avg: 170.22 / Max: 175.3Min: 52.1 / Avg: 218.49 / Max: 231.5Min: 55.7 / Avg: 230.04 / Max: 248.4Min: 53.7 / Avg: 185.77 / Max: 199.3Min: 63 / Avg: 191.71 / Max: 202.8Min: 69.5 / Avg: 242.72 / Max: 272Min: 57.5 / Avg: 262.41 / Max: 287.8

SHOC Scalable HeterOgeneous Computing

System Power Consumption Monitor

OpenBenchmarking.orgWatts, Fewer Is BetterSHOC Scalable HeterOgeneous Computing 2015-11-10System Power Consumption MonitorGTX 1070GTX 1070 TiGTX 1080GTX 1080 TiRTX 2070RTX 2080RTX 2080 TiRX Vega 56RX Vega 64TITAN RTX50100150200250Min: 82.6 / Avg: 134.72 / Max: 155.3Min: 47 / Avg: 122.6 / Max: 141.5Min: 89.7 / Avg: 144.76 / Max: 164.6Min: 120.8 / Avg: 190.06 / Max: 216.8Min: 53.7 / Avg: 162.86 / Max: 198.7Min: 47.1 / Avg: 169.8 / Max: 202.9Min: 47.5 / Avg: 222.96 / Max: 282.7Min: 49.4 / Avg: 197.63 / Max: 234.4Min: 51.8 / Avg: 223.18 / Max: 249.9Min: 47.9 / Avg: 232.9 / Max: 281.3

NVIDIA GPU Cloud TensorFlow

Test: Inception v4, FP16

OpenBenchmarking.orgImages Per Second Per Watt, More Is BetterNVIDIA GPU Cloud TensorFlow 18.09Test: Inception v4, FP16GTX 1070GTX 1070 TiGTX 1080GTX 1080 TiGTX 980 TiGTX TITAN X GM200RTX 2080RTX 2080 TiTITAN RTX0.17550.3510.52650.7020.87750.280.340.300.350.180.190.580.740.78

NVIDIA GPU Cloud TensorFlow

Test: ResNet-50, FP16

OpenBenchmarking.orgImages Per Second Per Watt, More Is BetterNVIDIA GPU Cloud TensorFlow 18.09Test: ResNet-50, FP16GTX 1070GTX 1070 TiGTX 1080GTX 1080 TiGTX 980 TiGTX TITAN X GM200RTX 2070RTX 2080RTX 2080 TiTITAN RTX0.57381.14761.72142.29522.8690.921.141.021.220.610.621.901.862.102.55

NVIDIA GPU Cloud TensorFlow

Test: AlexNet, FP16

OpenBenchmarking.orgImages Per Second, More Is BetterNVIDIA GPU Cloud TensorFlow 18.09Test: AlexNet, FP16GTX 1070GTX 1070 TiGTX 1080GTX 1080 TiGTX 980GTX 980 TiGTX TITAN X GM200RTX 2080RTX 2080 TiTITAN RTX11002200330044005500SE +/- 2.26, N = 3SE +/- 0.50, N = 3SE +/- 2.60, N = 3SE +/- 1.32, N = 3SE +/- 2.04, N = 3SE +/- 6.83, N = 3SE +/- 2.24, N = 3SE +/- 3.35, N = 3SE +/- 2.27, N = 3SE +/- 4.39, N = 31563168318752674120815521662315344325032

NVIDIA GPU Cloud TensorFlow

Test: AlexNet, FP16

OpenBenchmarking.orgImages Per Second Per Watt, More Is BetterNVIDIA GPU Cloud TensorFlow 18.09Test: AlexNet, FP16GTX 1070GTX 1070 TiGTX 1080GTX 1080 TiGTX 980GTX 980 TiGTX TITAN X GM200RTX 2080RTX 2080 TiTITAN RTX6121824309.8612.3911.1912.536.456.547.0316.5324.9525.77

NVIDIA GPU Cloud TensorFlow

Test: Inception v4, FP16

OpenBenchmarking.orgImages Per Second, More Is BetterNVIDIA GPU Cloud TensorFlow 18.09Test: Inception v4, FP16GTX 1070GTX 1070 TiGTX 1080GTX 1080 TiGTX 980 TiGTX TITAN X GM200RTX 2080RTX 2080 TiTITAN RTX306090120150SE +/- 0.03, N = 3SE +/- 0.03, N = 3SE +/- 0.03, N = 3SE +/- 0.07, N = 3SE +/- 0.12, N = 3SE +/- 0.12, N = 3SE +/- 0.07, N = 3SE +/- 0.10, N = 3SE +/- 0.21, N = 344.7749.2355.0374.6340.9043.23102.77135.90152.80

LuxMark

OpenCL Device: GPU - Scene: Luxball HDR

OpenBenchmarking.orgScore, More Is BetterLuxMark 3.1OpenCL Device: GPU - Scene: Luxball HDRGTX 1070GTX 1070 TiGTX 1080GTX 1080 TiGTX 980GTX 980 TiGTX TITAN X GM200RTX 2070RTX 2080RTX 2080 TiRX Vega 56RX Vega 64TITAN RTX10K20K30K40K50KSE +/- 0.58, N = 3SE +/- 0.67, N = 3SE +/- 29.04, N = 3SE +/- 119.86, N = 3SE +/- 33.13, N = 3SE +/- 26.00, N = 3SE +/- 11.50, N = 3SE +/- 2.73, N = 3SE +/- 66.64, N = 3SE +/- 20.53, N = 3SE +/- 570.76, N = 3SE +/- 41.88, N = 317288168861382321562132421691017299300912964142693311793281545932

NVIDIA GPU Cloud TensorFlow

Test: ResNet-50, FP16

OpenBenchmarking.orgImages Per Second, More Is BetterNVIDIA GPU Cloud TensorFlow 18.09Test: ResNet-50, FP16GTX 1070GTX 1070 TiGTX 1080GTX 1080 TiGTX 980 TiGTX TITAN X GM200RTX 2070RTX 2080RTX 2080 TiTITAN RTX110220330440550SE +/- 0.03, N = 3SE +/- 0.07, N = 3SE +/- 0.10, N = 3SE +/- 0.15, N = 3SE +/- 1.68, N = 3SE +/- 4.74, N = 3SE +/- 0.85, N = 3SE +/- 0.28, N = 3SE +/- 0.06, N = 3160175193271150156309335449520

SHOC Scalable HeterOgeneous Computing

Target: OpenCL - Benchmark: FFT SP

OpenBenchmarking.orgGFLOPS, More Is BetterSHOC Scalable HeterOgeneous Computing 2015-11-10Target: OpenCL - Benchmark: FFT SPGTX 1070GTX 1070 TiGTX 1080GTX 1080 TiGTX 980GTX 980 TiGTX TITAN X GM200RTX 2070RTX 2080RTX 2080 TiRX Vega 56RX Vega 64TITAN RTX30060090012001500SE +/- 0.94, N = 3SE +/- 0.73, N = 3SE +/- 2.68, N = 3SE +/- 1.23, N = 3SE +/- 0.27, N = 3SE +/- 0.20, N = 3SE +/- 0.60, N = 3SE +/- 40.79, N = 3SE +/- 5.95, N = 3SE +/- 14.24, N = 3SE +/- 1.57, N = 3SE +/- 0.64, N = 3SE +/- 11.44, N = 34524975759724687287269981083144392610701548-std=c++14 -lcudadevrt -lcudart_static -lpthread -ldl -lcufft-std=c++14 -lcudadevrt -lcudart_static -lpthread -ldl -lcufft-std=c++14 -lcudadevrt -lcudart_static -lpthread -ldl -lcufft-std=c++14 -lcudadevrt -lcudart_static -lpthread -ldl -lcufft-std=c++14 -lcudadevrt -lcudart_static -lpthread -ldl -lcufft-std=c++14 -lcudadevrt -lcudart_static -lpthread -ldl -lcufft-std=c++14 -lcudadevrt -lcudart_static -lpthread -ldl -lcufft-std=c++14 -lcudadevrt -lcudart_static -lpthread -ldl -lcufft-std=c++14 -lcudadevrt -lcudart_static -lpthread -ldl -lcufft-std=c++14 -lcudadevrt -lcudart_static -lpthread -ldl -lcufft-lSHOCCommonOpenCL -lOpenCL-lSHOCCommonOpenCL -lOpenCL-std=c++14 -lcudadevrt -lcudart_static -lpthread -ldl -lcufft1. (CXX) g++ options: -O2 -lSHOCCommon -lrt

cl-mem

Benchmark: Copy

OpenBenchmarking.orgGB/s, More Is Bettercl-mem 2017-01-13Benchmark: CopyGTX 1070GTX 1070 TiGTX 1080GTX 1080 TiGTX 980GTX 980 TiGTX TITAN X GM200RTX 2070RTX 2080RTX 2080 TiRX Vega 56RX Vega 64TITAN RTX100200300400500SE +/- 0.07, N = 3SE +/- 0.07, N = 3SE +/- 0.07, N = 3SE +/- 0.07, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.03, N = 3SE +/- 0.12, N = 3SE +/- 0.09, N = 3SE +/- 0.39, N = 3SE +/- 0.21, N = 3SE +/- 0.07, N = 3SE +/- 0.24, N = 31871882093171432172183303284542032214841. (CC) gcc options: -O2 -flto -lOpenCL

NVIDIA GPU Cloud TensorFlow

Test: VGG-16, FP16

OpenBenchmarking.orgImages Per Second Per Watt, More Is BetterNVIDIA GPU Cloud TensorFlow 18.09Test: VGG-16, FP16GTX 1070GTX 1070 TiGTX 1080GTX 1080 TiGTX 980 TiGTX TITAN X GM200RTX 2080RTX 2080 TiTITAN RTX0.21380.42760.64140.85521.0690.460.530.480.540.300.290.690.940.95

NVIDIA GPU Cloud TensorFlow

Test: Googlenet, FP16

OpenBenchmarking.orgImages Per Second, More Is BetterNVIDIA GPU Cloud TensorFlow 18.09Test: Googlenet, FP16GTX 1070GTX 1070 TiGTX 1080GTX 1080 TiGTX 980 TiGTX TITAN X GM200RTX 2080RTX 2080 TiTITAN RTX2004006008001000SE +/- 0.35, N = 3SE +/- 0.09, N = 3SE +/- 0.21, N = 3SE +/- 2.49, N = 3SE +/- 1.37, N = 3SE +/- 1.00, N = 3SE +/- 0.58, N = 3SE +/- 0.49, N = 3SE +/- 0.35, N = 337541345862935637273810151132

NVIDIA GPU Cloud TensorFlow

Test: VGG-16, FP16

OpenBenchmarking.orgImages Per Second, More Is BetterNVIDIA GPU Cloud TensorFlow 18.09Test: VGG-16, FP16GTX 1070GTX 1070 TiGTX 1080GTX 1080 TiGTX 980 TiGTX TITAN X GM200RTX 2080RTX 2080 TiTITAN RTX50100150200250SE +/- 0.07, N = 3SE +/- 0.03, N = 3SE +/- 0.24, N = 3SE +/- 0.12, N = 3SE +/- 0.92, N = 3SE +/- 0.40, N = 3SE +/- 0.09, N = 3SE +/- 0.07, N = 3SE +/- 0.46, N = 376.9384.4393.13131.3777.5779.20153.33206.97244.40

NVIDIA GPU Cloud TensorFlow

Test: AlexNet, FP32

OpenBenchmarking.orgImages Per Second, More Is BetterNVIDIA GPU Cloud TensorFlow 18.09Test: AlexNet, FP32GTX 1070GTX 1070 TiGTX 1080GTX 1080 TiGTX 980GTX 980 TiGTX TITAN X GM200RTX 2070RTX 2080RTX 2080 TiTITAN RTX8001600240032004000SE +/- 0.44, N = 3SE +/- 0.32, N = 3SE +/- 1.62, N = 3SE +/- 1.83, N = 3SE +/- 1.06, N = 3SE +/- 4.76, N = 3SE +/- 0.78, N = 3SE +/- 1.84, N = 3SE +/- 6.99, N = 3SE +/- 1.48, N = 315161591176425391154150115872174241933443576

NVIDIA GPU Cloud TensorFlow

Test: Googlenet, FP16

OpenBenchmarking.orgImages Per Second Per Watt, More Is BetterNVIDIA GPU Cloud TensorFlow 18.09Test: Googlenet, FP16GTX 1070GTX 1070 TiGTX 1080GTX 1080 TiGTX 980 TiGTX TITAN X GM200RTX 2080RTX 2080 TiTITAN RTX0.92481.84962.77443.69924.6242.062.532.132.451.361.403.214.074.11

NVIDIA GPU Cloud TensorFlow

GPU Temperature Monitor

OpenBenchmarking.orgCelsius, Fewer Is BetterNVIDIA GPU Cloud TensorFlow 18.09GPU Temperature MonitorGTX 1070GTX 1070 TiGTX 1080GTX 1080 TiGTX 980 TiGTX TITAN X GM200RTX 2070RTX 2080RTX 2080 TiTITAN RTX1632486480Min: 58 / Avg: 65.55 / Max: 70Min: 46 / Avg: 50.94 / Max: 55Min: 61 / Avg: 68.3 / Max: 75Min: 61 / Avg: 68.17 / Max: 75Min: 65 / Avg: 76.82 / Max: 83Min: 66 / Avg: 77.41 / Max: 84Min: 32 / Avg: 45.47 / Max: 58Min: 60 / Avg: 67.05 / Max: 75Min: 55 / Avg: 59.52 / Max: 65Min: 57 / Avg: 61.37 / Max: 67

NVIDIA GPU Cloud TensorFlow

Test: ResNet-50, FP32

OpenBenchmarking.orgImages Per Second Per Watt, More Is BetterNVIDIA GPU Cloud TensorFlow 18.09Test: ResNet-50, FP32GTX 1070GTX 1070 TiGTX 1080GTX 1080 TiGTX TITAN X GM200RTX 2080RTX 2080 TiTITAN RTX0.26550.5310.79651.0621.32750.730.840.730.890.490.991.151.18

NVIDIA GPU Cloud TensorFlow

Test: ResNet-50, FP32

OpenBenchmarking.orgImages Per Second, More Is BetterNVIDIA GPU Cloud TensorFlow 18.09Test: ResNet-50, FP32GTX 1070GTX 1070 TiGTX 1080GTX 1080 TiGTX TITAN X GM200RTX 2080RTX 2080 TiTITAN RTX70140210280350SE +/- 0.09, N = 3SE +/- 0.06, N = 3SE +/- 0.07, N = 3SE +/- 0.19, N = 3SE +/- 0.20, N = 3SE +/- 0.28, N = 3SE +/- 0.44, N = 3SE +/- 0.31, N = 3125133143210125205285299

NVIDIA GPU Cloud TensorFlow

Test: AlexNet, FP32

OpenBenchmarking.orgImages Per Second Per Watt, More Is BetterNVIDIA GPU Cloud TensorFlow 18.09Test: AlexNet, FP32GTX 1070GTX 1070 TiGTX 1080GTX 1080 TiGTX 980GTX 980 TiGTX TITAN X GM200RTX 2070RTX 2080RTX 2080 TiTITAN RTX481216209.6110.999.9012.196.206.596.2911.7211.4412.9914.66

NVIDIA GPU Cloud TensorFlow

Test: VGG-16, FP32

OpenBenchmarking.orgImages Per Second, More Is BetterNVIDIA GPU Cloud TensorFlow 18.09Test: VGG-16, FP32GTX 1070GTX 1070 TiGTX 1080GTX 1080 TiGTX TITAN X GM200RTX 2080RTX 2080 TiTITAN RTX4080120160200SE +/- 0.13, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.12, N = 3SE +/- 0.64, N = 3SE +/- 0.07, N = 3SE +/- 0.12, N = 3SE +/- 0.19, N = 371.5776.4082.90119.5072.77108.57152.40162.33

Chaos Group V-RAY

GPU Temperature Monitor

OpenBenchmarking.orgCelsius, Fewer Is BetterChaos Group V-RAY 1.1.0GPU Temperature MonitorGTX 1070GTX 1070 TiGTX 1080GTX 1080 TiGTX 980GTX 980 TiGTX TITAN X GM200RTX 2070RTX 2080RTX 2080 TiTITAN RTX1632486480Min: 46 / Avg: 62.55 / Max: 68Min: 38 / Avg: 47.77 / Max: 50Min: 48 / Avg: 62.93 / Max: 67Min: 54 / Avg: 68.11 / Max: 73Min: 64 / Avg: 72.91 / Max: 75Min: 69 / Avg: 78.07 / Max: 81Min: 67 / Avg: 78.35 / Max: 82Min: 53 / Avg: 60.72 / Max: 62Min: 50 / Avg: 68.2 / Max: 74Min: 46 / Avg: 60.03 / Max: 68Min: 56 / Avg: 67.85 / Max: 72

Chaos Group V-RAY

Mode: CUDA GPU

OpenBenchmarking.orgSeconds, Fewer Is BetterChaos Group V-RAY 1.1.0Mode: CUDA GPUGTX 1070GTX 1070 TiGTX 1080GTX 1080 TiGTX 980GTX 980 TiGTX TITAN X GM200RTX 2070RTX 2080RTX 2080 TiTITAN RTX20406080100SE +/- 0.03, N = 3SE +/- 0.04, N = 3SE +/- 3.08, N = 3SE +/- 0.03, N = 3SE +/- 0.16, N = 3SE +/- 0.14, N = 3SE +/- 2.94, N = 3SE +/- 0.03, N = 3SE +/- 0.04, N = 3SE +/- 3.00, N = 3SE +/- 0.02, N = 390.4386.30102.0766.41106.5177.7080.6266.0272.0756.0950.08

NVIDIA GPU Cloud TensorFlow

Test: VGG-16, FP32

OpenBenchmarking.orgImages Per Second Per Watt, More Is BetterNVIDIA GPU Cloud TensorFlow 18.09Test: VGG-16, FP32GTX 1070GTX 1070 TiGTX 1080GTX 1080 TiGTX TITAN X GM200RTX 2080RTX 2080 TiTITAN RTX0.13050.2610.39150.5220.65250.420.470.420.490.280.450.560.58

NVIDIA GPU Cloud TensorFlow

GPU Temperature Monitor

OpenBenchmarking.orgCelsius, Fewer Is BetterNVIDIA GPU Cloud TensorFlow 18.09GPU Temperature MonitorGTX 1070GTX 1070 TiGTX 1080GTX 1080 TiGTX 980 TiGTX TITAN X GM200RTX 2080RTX 2080 TiTITAN RTX1632486480Min: 55 / Avg: 64.07 / Max: 72Min: 43 / Avg: 49.56 / Max: 55Min: 51 / Avg: 64.33 / Max: 76Min: 56 / Avg: 66.24 / Max: 77Min: 61 / Avg: 74.85 / Max: 84Min: 62 / Avg: 75.61 / Max: 85Min: 57 / Avg: 64.7 / Max: 74Min: 53 / Avg: 57.76 / Max: 65Min: 54 / Avg: 59.11 / Max: 66

NVIDIA GPU Cloud TensorFlow

GPU Temperature Monitor

OpenBenchmarking.orgCelsius, Fewer Is BetterNVIDIA GPU Cloud TensorFlow 18.09GPU Temperature MonitorGTX 1070GTX 1070 TiGTX 1080GTX 1080 TiGTX 980 TiGTX TITAN X GM200RTX 2080RTX 2080 TiTITAN RTX1632486480Min: 56 / Avg: 69 / Max: 74Min: 43 / Avg: 52.93 / Max: 56Min: 58 / Avg: 72.23 / Max: 79Min: 60 / Avg: 72.84 / Max: 80Min: 70 / Avg: 80.35 / Max: 84Min: 72 / Avg: 80.77 / Max: 85Min: 60 / Avg: 73.17 / Max: 80Min: 55 / Avg: 64.78 / Max: 71Min: 55 / Avg: 65.27 / Max: 72

NVIDIA GPU Cloud TensorFlow

GPU Temperature Monitor

OpenBenchmarking.orgCelsius, Fewer Is BetterNVIDIA GPU Cloud TensorFlow 18.09GPU Temperature MonitorGTX 1070GTX 1070 TiGTX 1080GTX 1080 TiGTX 980GTX 980 TiGTX TITAN X GM200RTX 2070RTX 2080RTX 2080 TiTITAN RTX1632486480Min: 61 / Avg: 64.2 / Max: 68Min: 44 / Avg: 49.07 / Max: 52Min: 63 / Avg: 66.8 / Max: 71Min: 64 / Avg: 67.58 / Max: 71Min: 63 / Avg: 72.44 / Max: 77Min: 71 / Avg: 77.5 / Max: 82Min: 72 / Avg: 78.81 / Max: 84Min: 46 / Avg: 55.88 / Max: 61Min: 59 / Avg: 69.81 / Max: 76Min: 53 / Avg: 61.36 / Max: 67Min: 55 / Avg: 61.71 / Max: 67

NVIDIA GPU Cloud TensorFlow

GPU Temperature Monitor

OpenBenchmarking.orgCelsius, Fewer Is BetterNVIDIA GPU Cloud TensorFlow 18.09GPU Temperature MonitorGTX 1070GTX 1070 TiGTX 1080GTX 1080 TiGTX TITAN X GM200RTX 2080RTX 2080 TiTITAN RTX1632486480Min: 57 / Avg: 65.61 / Max: 71Min: 44 / Avg: 50.85 / Max: 54Min: 60 / Avg: 68.77 / Max: 75Min: 62 / Avg: 70.04 / Max: 77Min: 65 / Avg: 77.91 / Max: 84Min: 59 / Avg: 70.41 / Max: 77Min: 54 / Avg: 61.16 / Max: 67Min: 54 / Avg: 62.76 / Max: 70

NVIDIA GPU Cloud TensorFlow

GPU Temperature Monitor

OpenBenchmarking.orgCelsius, Fewer Is BetterNVIDIA GPU Cloud TensorFlow 18.09GPU Temperature MonitorGTX 1070GTX 1070 TiGTX 1080GTX 1080 TiGTX 980 TiGTX TITAN X GM200RTX 2080RTX 2080 TiTITAN RTX1632486480Min: 59 / Avg: 66.13 / Max: 70Min: 45 / Avg: 52.18 / Max: 55Min: 50 / Avg: 65.84 / Max: 74Min: 61 / Avg: 70.1 / Max: 76Min: 67 / Avg: 79.22 / Max: 84Min: 67 / Avg: 79 / Max: 84Min: 59 / Avg: 69.86 / Max: 77Min: 54 / Avg: 61.56 / Max: 68Min: 55 / Avg: 62.56 / Max: 68

NVIDIA GPU Cloud TensorFlow

GPU Temperature Monitor

OpenBenchmarking.orgCelsius, Fewer Is BetterNVIDIA GPU Cloud TensorFlow 18.09GPU Temperature MonitorGTX 1070GTX 1070 TiGTX 1080GTX 1080 TiGTX 980GTX 980 TiGTX TITAN X GM200RTX 2080RTX 2080 TiTITAN RTX1632486480Min: 59 / Avg: 64.06 / Max: 67Min: 46 / Avg: 49.93 / Max: 53Min: 62 / Avg: 66.46 / Max: 70Min: 63 / Avg: 67.2 / Max: 70Min: 51 / Avg: 65.82 / Max: 74Min: 62 / Avg: 73.47 / Max: 81Min: 68 / Avg: 77.07 / Max: 85Min: 63 / Avg: 67.57 / Max: 72Min: 57 / Avg: 60.36 / Max: 64Min: 58 / Avg: 61.4 / Max: 65

NVIDIA GPU Cloud TensorFlow

GPU Temperature Monitor

OpenBenchmarking.orgCelsius, Fewer Is BetterNVIDIA GPU Cloud TensorFlow 18.09GPU Temperature MonitorGTX 1070GTX 1070 TiGTX 1080GTX 1080 TiGTX TITAN X GM200RTX 2080RTX 2080 TiTITAN RTX1632486480Min: 58 / Avg: 66.1 / Max: 70Min: 46 / Avg: 52.21 / Max: 55Min: 60 / Avg: 69.33 / Max: 74Min: 61 / Avg: 70.55 / Max: 77Min: 67 / Avg: 79.62 / Max: 84Min: 61 / Avg: 74.1 / Max: 80Min: 56 / Avg: 65.52 / Max: 71Min: 56 / Avg: 67.15 / Max: 73

System Power Consumption Monitor

Phoronix Test Suite System Monitoring

OpenBenchmarking.orgWattsSystem Power Consumption MonitorPhoronix Test Suite System MonitoringGTX 1070GTX 1070 TiGTX 1080GTX 1080 TiGTX 980GTX 980 TiGTX TITAN X GM200RTX 2070RTX 2080RTX 2080 TiRX Vega 56RX Vega 64TITAN RTX70140210280350Min: 41.9 / Avg: 143.92 / Max: 213.8Min: 45.9 / Avg: 127.84 / Max: 213.8Min: 42.2 / Avg: 154.56 / Max: 251.7Min: 43.4 / Avg: 200.91 / Max: 320.9Min: 45.1 / Avg: 126.87 / Max: 240.4Min: 52.1 / Avg: 218.82 / Max: 321.2Min: 48.8 / Avg: 240.32 / Max: 327.7Min: 42.1 / Avg: 146.13 / Max: 247.2Min: 43.9 / Avg: 175.16 / Max: 287.8Min: 45.5 / Avg: 208.03 / Max: 346.7Min: 48.8 / Avg: 143.52 / Max: 284.1Min: 48.4 / Avg: 169.45 / Max: 358.6Min: 47.9 / Avg: 242.09 / Max: 364.6

GPU Temperature Monitor

Phoronix Test Suite System Monitoring

OpenBenchmarking.orgCelsiusGPU Temperature MonitorPhoronix Test Suite System MonitoringGTX 1070GTX 1070 TiGTX 1080GTX 1080 TiGTX 980GTX 980 TiGTX TITAN X GM200RTX 2070RTX 2080RTX 2080 TiRX Vega 56RX Vega 64TITAN RTX1632486480Min: 31 / Avg: 61.13 / Max: 75Min: 36 / Avg: 46.92 / Max: 60Min: 45 / Avg: 63.06 / Max: 79Min: 33 / Avg: 66.46 / Max: 80Min: 34 / Avg: 58.36 / Max: 77Min: 38 / Avg: 74.74 / Max: 84Min: 35 / Avg: 76.87 / Max: 85Min: 33 / Avg: 54.57 / Max: 64Min: 35 / Avg: 66.5 / Max: 80Min: 34 / Avg: 60.3 / Max: 76Min: 31 / Avg: 51.02 / Max: 75Min: 28 / Avg: 52.98 / Max: 85Min: 38 / Avg: 63.55 / Max: 77

Phoronix Test Suite v10.8.5