NVIDIA TITAN RTX Linux GPU Compute Benchmarks

NVIDIA and AMD GPU Linux compute benchmarks December 2018 by Michael Larabel for a future article, review of the NVIDIA TITAN RTX.

HTML result view exported from: https://openbenchmarking.org/result/1812224-SP-GPUCOMPUT75&sor&grw.

NVIDIA TITAN RTX Linux GPU Compute BenchmarksProcessorMotherboardChipsetMemoryDiskGraphicsAudioMonitorNetworkOSKernelDesktopDisplay ServerDisplay DriverOpenGLOpenCLVulkanCompilerFile-SystemScreen ResolutionGTX 980GTX 980 TiGTX TITAN X GM200GTX 1070GTX 1070 TiGTX 1080GTX 1080 TiRTX 2070RTX 2080RTX 2080 TiTITAN RTXRX Vega 56RX Vega 64Intel Core i9-9900K @ 5.00GHz (8 Cores / 16 Threads)ASUS PRIME Z390-A (0602 BIOS)Intel Cannon Lake PCH Shared SRAM16384MB2000GB SABRENT + Samsung SSD 970 EVO 250GBNVIDIA GeForce GTX 980 4GB (1126/3505MHz)Realtek ALC1220Acer B286HKIntel ConnectionUbuntu 18.044.19.5-041905-generic (x86_64)GNOME Shell 3.28.3X Server 1.19.6NVIDIA 415.234.6.0OpenCL 1.2 CUDA 10.0.1321.1.84GCC 7.3.0 + CUDA 10.0ext43840x2160NVIDIA GeForce GTX 980 Ti 6GB (999/3505MHz)NVIDIA GeForce GTX TITAN X 12GB (1001/3505MHz)NVIDIA GeForce GTX 1070 8GB (1506/4006MHz)NVIDIA 415.22Zotac NVIDIA GeForce GTX 1070 Ti 8GB (1607/4006MHz)NVIDIA GeForce GTX 1080 8GB (1607/5005MHz)NVIDIA GeForce GTX 1080 Ti 11GB (1480/5508MHz)eVGA NVIDIA GeForce RTX 2070 8GB (1410/7000MHz)Zotac NVIDIA GeForce RTX 2080 8GB (1515/7000MHz)NVIDIA GeForce RTX 2080 Ti 11GB (1350/7000MHz)NVIDIA TITAN RTX 24GB (1350/7000MHz)NVIDIA 415.23AMD Radeon RX Vega 8GB (1590/800MHz)4.5 Mesa 19.0.0-devel padoka PPA (LLVM 8.0.0)OpenCL 2.1 AMD-APP (2679.0)1.1.70GCC 7.3.0AMD Radeon RX Vega 8GB (1630/945MHz)OpenBenchmarking.orgCompiler Details- --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++ --enable-libmpx --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib --with-tune=generic --without-cuda-driver -v Processor Details- Scaling Governor: intel_pstate performanceOpenCL Details- GTX 980: GPU Compute Cores: 2048- GTX 980 Ti: GPU Compute Cores: 2816- GTX TITAN X GM200: GPU Compute Cores: 3072- GTX 1070: GPU Compute Cores: 1920- GTX 1070 Ti: GPU Compute Cores: 2432- GTX 1080: GPU Compute Cores: 2560- GTX 1080 Ti: GPU Compute Cores: 3584- RTX 2070: GPU Compute Cores: 2304- RTX 2080: GPU Compute Cores: 2944- RTX 2080 Ti: GPU Compute Cores: 4352- TITAN RTX: GPU Compute Cores: 4608Security Details- __user pointer sanitization + Full generic retpoline IBPB IBRS_FW + SSB disabled via prctl and seccomp

NVIDIA TITAN RTX Linux GPU Compute Benchmarksshoc: OpenCL - FFT SPv-ray: CUDA GPUluxmark: GPU - Luxball HDRngc-tensorflow: ResNet-50, FP16ngc-tensorflow: VGG-16, FP32ngc-tensorflow: AlexNet, FP16ngc-tensorflow: ResNet-50, FP32ngc-tensorflow: VGG-16, FP16cl-mem: Copyngc-tensorflow: AlexNet, FP32ngc-tensorflow: Googlenet, FP16ngc-tensorflow: Inception v4, FP16GTX 980GTX 980 TiGTX TITAN X GM200GTX 1070GTX 1070 TiGTX 1080GTX 1080 TiRTX 2070RTX 2080RTX 2080 TiTITAN RTXRX Vega 56RX Vega 64468106.51132421208143115472877.7016910150155277.57217150135640.9072680.621729915672.77166212579.20218158737243.2345290.431728816071.57156312576.93187151637544.7749786.301688617576.40168313384.43188159141349.23575102.071382319382.90187514393.13209176445855.0397266.4121562271119.502674210131.37317253962974.6399866.02300913093302174108372.0729641335108.573153205153.333282419738102.77144356.0942693449152.404432285206.9745433441015135.90154850.0845932520162.335032299244.4048435761132152.8092631179203107032815221OpenBenchmarking.org

SHOC Scalable HeterOgeneous Computing

Target: OpenCL - Benchmark: FFT SP

OpenBenchmarking.orgGFLOPS, More Is BetterSHOC Scalable HeterOgeneous Computing 2015-11-10Target: OpenCL - Benchmark: FFT SPTITAN RTXRTX 2080 TiRTX 2080RX Vega 64RTX 2070GTX 1080 TiRX Vega 56GTX 980 TiGTX TITAN X GM200GTX 1080GTX 1070 TiGTX 980GTX 107030060090012001500SE +/- 11.44, N = 3SE +/- 14.24, N = 3SE +/- 5.95, N = 3SE +/- 0.64, N = 3SE +/- 40.79, N = 3SE +/- 1.23, N = 3SE +/- 1.57, N = 3SE +/- 0.20, N = 3SE +/- 0.60, N = 3SE +/- 2.68, N = 3SE +/- 0.73, N = 3SE +/- 0.27, N = 3SE +/- 0.94, N = 31548144310831070998972926728726575497468452-std=c++14 -lcudadevrt -lcudart_static -lpthread -ldl -lcufft-std=c++14 -lcudadevrt -lcudart_static -lpthread -ldl -lcufft-std=c++14 -lcudadevrt -lcudart_static -lpthread -ldl -lcufft-lSHOCCommonOpenCL -lOpenCL-std=c++14 -lcudadevrt -lcudart_static -lpthread -ldl -lcufft-std=c++14 -lcudadevrt -lcudart_static -lpthread -ldl -lcufft-lSHOCCommonOpenCL -lOpenCL-std=c++14 -lcudadevrt -lcudart_static -lpthread -ldl -lcufft-std=c++14 -lcudadevrt -lcudart_static -lpthread -ldl -lcufft-std=c++14 -lcudadevrt -lcudart_static -lpthread -ldl -lcufft-std=c++14 -lcudadevrt -lcudart_static -lpthread -ldl -lcufft-std=c++14 -lcudadevrt -lcudart_static -lpthread -ldl -lcufft-std=c++14 -lcudadevrt -lcudart_static -lpthread -ldl -lcufft1. (CXX) g++ options: -O2 -lSHOCCommon -lrt

Chaos Group V-RAY

Mode: CUDA GPU

OpenBenchmarking.orgSeconds, Fewer Is BetterChaos Group V-RAY 1.1.0Mode: CUDA GPUTITAN RTXRTX 2080 TiRTX 2070GTX 1080 TiRTX 2080GTX 980 TiGTX TITAN X GM200GTX 1070 TiGTX 1070GTX 1080GTX 98020406080100SE +/- 0.02, N = 3SE +/- 3.00, N = 3SE +/- 0.03, N = 3SE +/- 0.03, N = 3SE +/- 0.04, N = 3SE +/- 0.14, N = 3SE +/- 2.94, N = 3SE +/- 0.04, N = 3SE +/- 0.03, N = 3SE +/- 3.08, N = 3SE +/- 0.16, N = 350.0856.0966.0266.4172.0777.7080.6286.3090.43102.07106.51

LuxMark

OpenCL Device: GPU - Scene: Luxball HDR

OpenBenchmarking.orgScore, More Is BetterLuxMark 3.1OpenCL Device: GPU - Scene: Luxball HDRTITAN RTXRTX 2080 TiRX Vega 64RX Vega 56RTX 2070RTX 2080GTX 1080 TiGTX TITAN X GM200GTX 1070GTX 980 TiGTX 1070 TiGTX 1080GTX 98010K20K30K40K50KSE +/- 41.88, N = 3SE +/- 66.64, N = 3SE +/- 570.76, N = 3SE +/- 20.53, N = 3SE +/- 2.73, N = 3SE +/- 119.86, N = 3SE +/- 11.50, N = 3SE +/- 0.58, N = 3SE +/- 26.00, N = 3SE +/- 0.67, N = 3SE +/- 29.04, N = 3SE +/- 33.13, N = 345932426933281531179300912964121562172991728816910168861382313242

NVIDIA GPU Cloud TensorFlow

Test: ResNet-50, FP16

OpenBenchmarking.orgImages Per Second, More Is BetterNVIDIA GPU Cloud TensorFlow 18.09Test: ResNet-50, FP16TITAN RTXRTX 2080 TiRTX 2080RTX 2070GTX 1080 TiGTX 1080GTX 1070 TiGTX 1070GTX TITAN X GM200GTX 980 Ti110220330440550SE +/- 0.06, N = 3SE +/- 0.28, N = 3SE +/- 0.85, N = 3SE +/- 0.15, N = 3SE +/- 0.10, N = 3SE +/- 0.07, N = 3SE +/- 0.03, N = 3SE +/- 4.74, N = 3SE +/- 1.68, N = 3520449335309271193175160156150

NVIDIA GPU Cloud TensorFlow

Test: VGG-16, FP32

OpenBenchmarking.orgImages Per Second, More Is BetterNVIDIA GPU Cloud TensorFlow 18.09Test: VGG-16, FP32TITAN RTXRTX 2080 TiGTX 1080 TiRTX 2080GTX 1080GTX 1070 TiGTX TITAN X GM200GTX 10704080120160200SE +/- 0.19, N = 3SE +/- 0.12, N = 3SE +/- 0.12, N = 3SE +/- 0.07, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.64, N = 3SE +/- 0.13, N = 3162.33152.40119.50108.5782.9076.4072.7771.57

NVIDIA GPU Cloud TensorFlow

Test: AlexNet, FP16

OpenBenchmarking.orgImages Per Second, More Is BetterNVIDIA GPU Cloud TensorFlow 18.09Test: AlexNet, FP16TITAN RTXRTX 2080 TiRTX 2080GTX 1080 TiGTX 1080GTX 1070 TiGTX TITAN X GM200GTX 1070GTX 980 TiGTX 98011002200330044005500SE +/- 4.39, N = 3SE +/- 2.27, N = 3SE +/- 3.35, N = 3SE +/- 1.32, N = 3SE +/- 2.60, N = 3SE +/- 0.50, N = 3SE +/- 2.24, N = 3SE +/- 2.26, N = 3SE +/- 6.83, N = 3SE +/- 2.04, N = 35032443231532674187516831662156315521208

NVIDIA GPU Cloud TensorFlow

Test: ResNet-50, FP32

OpenBenchmarking.orgImages Per Second, More Is BetterNVIDIA GPU Cloud TensorFlow 18.09Test: ResNet-50, FP32TITAN RTXRTX 2080 TiGTX 1080 TiRTX 2080GTX 1080GTX 1070 TiGTX 1070GTX TITAN X GM20070140210280350SE +/- 0.31, N = 3SE +/- 0.44, N = 3SE +/- 0.19, N = 3SE +/- 0.28, N = 3SE +/- 0.07, N = 3SE +/- 0.06, N = 3SE +/- 0.09, N = 3SE +/- 0.20, N = 3299285210205143133125125

NVIDIA GPU Cloud TensorFlow

Test: VGG-16, FP16

OpenBenchmarking.orgImages Per Second, More Is BetterNVIDIA GPU Cloud TensorFlow 18.09Test: VGG-16, FP16TITAN RTXRTX 2080 TiRTX 2080GTX 1080 TiGTX 1080GTX 1070 TiGTX TITAN X GM200GTX 980 TiGTX 107050100150200250SE +/- 0.46, N = 3SE +/- 0.07, N = 3SE +/- 0.09, N = 3SE +/- 0.12, N = 3SE +/- 0.24, N = 3SE +/- 0.03, N = 3SE +/- 0.40, N = 3SE +/- 0.92, N = 3SE +/- 0.07, N = 3244.40206.97153.33131.3793.1384.4379.2077.5776.93

cl-mem

Benchmark: Copy

OpenBenchmarking.orgGB/s, More Is Bettercl-mem 2017-01-13Benchmark: CopyTITAN RTXRTX 2080 TiRTX 2070RTX 2080GTX 1080 TiRX Vega 64GTX TITAN X GM200GTX 980 TiGTX 1080RX Vega 56GTX 1070 TiGTX 1070GTX 980100200300400500SE +/- 0.24, N = 3SE +/- 0.39, N = 3SE +/- 0.12, N = 3SE +/- 0.09, N = 3SE +/- 0.07, N = 3SE +/- 0.07, N = 3SE +/- 0.03, N = 3SE +/- 0.00, N = 3SE +/- 0.07, N = 3SE +/- 0.21, N = 3SE +/- 0.07, N = 3SE +/- 0.07, N = 3SE +/- 0.00, N = 34844543303283172212182172092031881871431. (CC) gcc options: -O2 -flto -lOpenCL

NVIDIA GPU Cloud TensorFlow

Test: AlexNet, FP32

OpenBenchmarking.orgImages Per Second, More Is BetterNVIDIA GPU Cloud TensorFlow 18.09Test: AlexNet, FP32TITAN RTXRTX 2080 TiGTX 1080 TiRTX 2080RTX 2070GTX 1080GTX 1070 TiGTX TITAN X GM200GTX 1070GTX 980 TiGTX 9808001600240032004000SE +/- 1.48, N = 3SE +/- 6.99, N = 3SE +/- 1.83, N = 3SE +/- 1.84, N = 3SE +/- 1.62, N = 3SE +/- 0.32, N = 3SE +/- 0.78, N = 3SE +/- 0.44, N = 3SE +/- 4.76, N = 3SE +/- 1.06, N = 335763344253924192174176415911587151615011154

NVIDIA GPU Cloud TensorFlow

Test: Googlenet, FP16

OpenBenchmarking.orgImages Per Second, More Is BetterNVIDIA GPU Cloud TensorFlow 18.09Test: Googlenet, FP16TITAN RTXRTX 2080 TiRTX 2080GTX 1080 TiGTX 1080GTX 1070 TiGTX 1070GTX TITAN X GM200GTX 980 Ti2004006008001000SE +/- 0.35, N = 3SE +/- 0.49, N = 3SE +/- 0.58, N = 3SE +/- 2.49, N = 3SE +/- 0.21, N = 3SE +/- 0.09, N = 3SE +/- 0.35, N = 3SE +/- 1.00, N = 3SE +/- 1.37, N = 311321015738629458413375372356

NVIDIA GPU Cloud TensorFlow

Test: Inception v4, FP16

OpenBenchmarking.orgImages Per Second, More Is BetterNVIDIA GPU Cloud TensorFlow 18.09Test: Inception v4, FP16TITAN RTXRTX 2080 TiRTX 2080GTX 1080 TiGTX 1080GTX 1070 TiGTX 1070GTX TITAN X GM200GTX 980 Ti306090120150SE +/- 0.21, N = 3SE +/- 0.10, N = 3SE +/- 0.07, N = 3SE +/- 0.07, N = 3SE +/- 0.03, N = 3SE +/- 0.03, N = 3SE +/- 0.03, N = 3SE +/- 0.12, N = 3SE +/- 0.12, N = 3152.80135.90102.7774.6355.0349.2344.7743.2340.90

SHOC Scalable HeterOgeneous Computing

System Power Consumption Monitor

OpenBenchmarking.orgWatts, Fewer Is BetterSHOC Scalable HeterOgeneous Computing 2015-11-10System Power Consumption MonitorGTX 1070 TiGTX 1070GTX 1080RTX 2070RTX 2080GTX 1080 TiRX Vega 56RTX 2080 TiRX Vega 64TITAN RTX50100150200250Min: 47 / Avg: 122.6 / Max: 141.5Min: 82.6 / Avg: 134.72 / Max: 155.3Min: 89.7 / Avg: 144.76 / Max: 164.6Min: 53.7 / Avg: 162.86 / Max: 198.7Min: 47.1 / Avg: 169.8 / Max: 202.9Min: 120.8 / Avg: 190.06 / Max: 216.8Min: 49.4 / Avg: 197.63 / Max: 234.4Min: 47.5 / Avg: 222.96 / Max: 282.7Min: 51.8 / Avg: 223.18 / Max: 249.9Min: 47.9 / Avg: 232.9 / Max: 281.3

LuxMark

System Power Consumption Monitor

OpenBenchmarking.orgWatts, Fewer Is BetterLuxMark 3.1System Power Consumption MonitorGTX 1070 TiGTX 1080GTX 1070GTX 980RTX 2070GTX 980 TiRTX 2080GTX 1080 TiGTX TITAN X GM200RX Vega 56RTX 2080 TiRX Vega 64TITAN RTX60120180240300Min: 146.8 / Avg: 148.92 / Max: 149.4Min: 90.8 / Avg: 174.24 / Max: 176.2Min: 83.1 / Avg: 176.9 / Max: 181.3Min: 80.2 / Avg: 189.6 / Max: 196.9Min: 78 / Avg: 225.33 / Max: 232.6Min: 118.7 / Avg: 233.83 / Max: 241.4Min: 101.9 / Avg: 240.83 / Max: 247.3Min: 122.9 / Avg: 241.59 / Max: 247.8Min: 126.4 / Avg: 249.16 / Max: 256.8Min: 51.8 / Avg: 251.16 / Max: 263.3Min: 111.1 / Avg: 315.29 / Max: 328.4Min: 53 / Avg: 323.35 / Max: 337.9Min: 48.7 / Avg: 329.43 / Max: 344

GPU Temperature Monitor

Phoronix Test Suite System Monitoring

OpenBenchmarking.orgCelsiusGPU Temperature MonitorPhoronix Test Suite System MonitoringGTX 1070 TiRX Vega 56RX Vega 64RTX 2070GTX 980RTX 2080 TiGTX 1070GTX 1080TITAN RTXGTX 1080 TiRTX 2080GTX 980 TiGTX TITAN X GM2001632486480Min: 36 / Avg: 46.92 / Max: 60Min: 31 / Avg: 51.02 / Max: 75Min: 28 / Avg: 52.98 / Max: 85Min: 33 / Avg: 54.57 / Max: 64Min: 34 / Avg: 58.36 / Max: 77Min: 34 / Avg: 60.3 / Max: 76Min: 31 / Avg: 61.13 / Max: 75Min: 45 / Avg: 63.06 / Max: 79Min: 38 / Avg: 63.55 / Max: 77Min: 33 / Avg: 66.46 / Max: 80Min: 35 / Avg: 66.5 / Max: 80Min: 38 / Avg: 74.74 / Max: 84Min: 35 / Avg: 76.87 / Max: 85

System Power Consumption Monitor

Phoronix Test Suite System Monitoring

OpenBenchmarking.orgWattsSystem Power Consumption MonitorPhoronix Test Suite System MonitoringGTX 980GTX 1070 TiRX Vega 56GTX 1070RTX 2070GTX 1080RX Vega 64RTX 2080GTX 1080 TiRTX 2080 TiGTX 980 TiGTX TITAN X GM200TITAN RTX70140210280350Min: 45.1 / Avg: 126.87 / Max: 240.4Min: 45.9 / Avg: 127.84 / Max: 213.8Min: 48.8 / Avg: 143.52 / Max: 284.1Min: 41.9 / Avg: 143.92 / Max: 213.8Min: 42.1 / Avg: 146.13 / Max: 247.2Min: 42.2 / Avg: 154.56 / Max: 251.7Min: 48.4 / Avg: 169.45 / Max: 358.6Min: 43.9 / Avg: 175.16 / Max: 287.8Min: 43.4 / Avg: 200.91 / Max: 320.9Min: 45.5 / Avg: 208.03 / Max: 346.7Min: 52.1 / Avg: 218.82 / Max: 321.2Min: 48.8 / Avg: 240.32 / Max: 327.7Min: 47.9 / Avg: 242.09 / Max: 364.6

Chaos Group V-RAY

GPU Temperature Monitor

OpenBenchmarking.orgCelsius, Fewer Is BetterChaos Group V-RAY 1.1.0GPU Temperature MonitorGTX 1070 TiRTX 2080 TiRTX 2070GTX 1070GTX 1080TITAN RTXGTX 1080 TiRTX 2080GTX 980GTX 980 TiGTX TITAN X GM2001632486480Min: 38 / Avg: 47.77 / Max: 50Min: 46 / Avg: 60.03 / Max: 68Min: 53 / Avg: 60.72 / Max: 62Min: 46 / Avg: 62.55 / Max: 68Min: 48 / Avg: 62.93 / Max: 67Min: 56 / Avg: 67.85 / Max: 72Min: 54 / Avg: 68.11 / Max: 73Min: 50 / Avg: 68.2 / Max: 74Min: 64 / Avg: 72.91 / Max: 75Min: 69 / Avg: 78.07 / Max: 81Min: 67 / Avg: 78.35 / Max: 82

Chaos Group V-RAY

System Power Consumption Monitor

OpenBenchmarking.orgWatts, Fewer Is BetterChaos Group V-RAY 1.1.0System Power Consumption MonitorGTX 1070 TiGTX 1070GTX 1080GTX 980RTX 2070RTX 2080GTX 980 TiGTX 1080 TiGTX TITAN X GM200RTX 2080 TiTITAN RTX50100150200250Min: 46.1 / Avg: 130.78 / Max: 135.6Min: 43.4 / Avg: 151.17 / Max: 164.2Min: 43.6 / Avg: 153.26 / Max: 165.9Min: 47.6 / Avg: 170.22 / Max: 175.3Min: 53.7 / Avg: 185.77 / Max: 199.3Min: 63 / Avg: 191.71 / Max: 202.8Min: 52.1 / Avg: 218.49 / Max: 231.5Min: 120.4 / Avg: 218.99 / Max: 231.8Min: 55.7 / Avg: 230.04 / Max: 248.4Min: 69.5 / Avg: 242.72 / Max: 272Min: 57.5 / Avg: 262.41 / Max: 287.8

NVIDIA GPU Cloud TensorFlow

Test: ResNet-50, FP16

OpenBenchmarking.orgImages Per Second Per Watt, More Is BetterNVIDIA GPU Cloud TensorFlow 18.09Test: ResNet-50, FP16TITAN RTXRTX 2080 TiRTX 2070RTX 2080GTX 1080 TiGTX 1070 TiGTX 1080GTX 1070GTX TITAN X GM200GTX 980 Ti0.57381.14761.72142.29522.8692.552.101.901.861.221.141.020.920.620.61

NVIDIA GPU Cloud TensorFlow

GPU Temperature Monitor

OpenBenchmarking.orgCelsius, Fewer Is BetterNVIDIA GPU Cloud TensorFlow 18.09GPU Temperature MonitorRTX 2070GTX 1070 TiRTX 2080 TiTITAN RTXGTX 1070RTX 2080GTX 1080 TiGTX 1080GTX 980 TiGTX TITAN X GM2001632486480Min: 32 / Avg: 45.47 / Max: 58Min: 46 / Avg: 50.94 / Max: 55Min: 55 / Avg: 59.52 / Max: 65Min: 57 / Avg: 61.37 / Max: 67Min: 58 / Avg: 65.55 / Max: 70Min: 60 / Avg: 67.05 / Max: 75Min: 61 / Avg: 68.17 / Max: 75Min: 61 / Avg: 68.3 / Max: 75Min: 65 / Avg: 76.82 / Max: 83Min: 66 / Avg: 77.41 / Max: 84

NVIDIA GPU Cloud TensorFlow

System Power Consumption Monitor

OpenBenchmarking.orgWatts, Fewer Is BetterNVIDIA GPU Cloud TensorFlow 18.09System Power Consumption MonitorGTX 1070 TiRTX 2070GTX 1070RTX 2080GTX 1080TITAN RTXRTX 2080 TiGTX 1080 TiGTX 980 TiGTX TITAN X GM20060120180240300Min: 47 / Avg: 153.76 / Max: 192.3Min: 71.1 / Avg: 162.36 / Max: 246.8Min: 42.7 / Avg: 174.04 / Max: 212.6Min: 47.3 / Avg: 179.59 / Max: 284.7Min: 44.7 / Avg: 189.85 / Max: 248.8Min: 51 / Avg: 203.63 / Max: 350.6Min: 56.1 / Avg: 213.62 / Max: 342.3Min: 54.6 / Avg: 222.3 / Max: 319.6Min: 52.8 / Avg: 244.09 / Max: 310.7Min: 55.5 / Avg: 252.42 / Max: 326.9

NVIDIA GPU Cloud TensorFlow

Test: ResNet-50, FP32

OpenBenchmarking.orgImages Per Second Per Watt, More Is BetterNVIDIA GPU Cloud TensorFlow 18.09Test: ResNet-50, FP32TITAN RTXRTX 2080 TiRTX 2080GTX 1080 TiGTX 1070 TiGTX 1080GTX 1070GTX TITAN X GM2000.26550.5310.79651.0621.32751.181.150.990.890.840.730.730.49

NVIDIA GPU Cloud TensorFlow

GPU Temperature Monitor

OpenBenchmarking.orgCelsius, Fewer Is BetterNVIDIA GPU Cloud TensorFlow 18.09GPU Temperature MonitorGTX 1070 TiRTX 2080 TiTITAN RTXGTX 1070GTX 1080GTX 1080 TiRTX 2080GTX TITAN X GM2001632486480Min: 44 / Avg: 50.85 / Max: 54Min: 54 / Avg: 61.16 / Max: 67Min: 54 / Avg: 62.76 / Max: 70Min: 57 / Avg: 65.61 / Max: 71Min: 60 / Avg: 68.77 / Max: 75Min: 62 / Avg: 70.04 / Max: 77Min: 59 / Avg: 70.41 / Max: 77Min: 65 / Avg: 77.91 / Max: 84

NVIDIA GPU Cloud TensorFlow

System Power Consumption Monitor

OpenBenchmarking.orgWatts, Fewer Is BetterNVIDIA GPU Cloud TensorFlow 18.09System Power Consumption MonitorGTX 1070 TiGTX 1070GTX 1080RTX 2080GTX 1080 TiRTX 2080 TiTITAN RTXGTX TITAN X GM20070140210280350Min: 48 / Avg: 157.29 / Max: 187.8Min: 45.9 / Avg: 172.02 / Max: 213.8Min: 44.1 / Avg: 196.38 / Max: 249.7Min: 48 / Avg: 206.72 / Max: 285Min: 79.7 / Avg: 234.81 / Max: 318.6Min: 50.5 / Avg: 248.25 / Max: 346.7Min: 50.5 / Avg: 252.59 / Max: 364.6Min: 56.2 / Avg: 255.72 / Max: 321

NVIDIA GPU Cloud TensorFlow

Test: AlexNet, FP16

OpenBenchmarking.orgImages Per Second Per Watt, More Is BetterNVIDIA GPU Cloud TensorFlow 18.09Test: AlexNet, FP16TITAN RTXRTX 2080 TiRTX 2080GTX 1080 TiGTX 1070 TiGTX 1080GTX 1070GTX TITAN X GM200GTX 980 TiGTX 98061218243025.7724.9516.5312.5312.3911.199.867.036.546.45

NVIDIA GPU Cloud TensorFlow

GPU Temperature Monitor

OpenBenchmarking.orgCelsius, Fewer Is BetterNVIDIA GPU Cloud TensorFlow 18.09GPU Temperature MonitorGTX 1070 TiRTX 2080 TiTITAN RTXGTX 1070GTX 980GTX 1080GTX 1080 TiRTX 2080GTX 980 TiGTX TITAN X GM2001632486480Min: 46 / Avg: 49.93 / Max: 53Min: 57 / Avg: 60.36 / Max: 64Min: 58 / Avg: 61.4 / Max: 65Min: 59 / Avg: 64.06 / Max: 67Min: 51 / Avg: 65.82 / Max: 74Min: 62 / Avg: 66.46 / Max: 70Min: 63 / Avg: 67.2 / Max: 70Min: 63 / Avg: 67.57 / Max: 72Min: 62 / Avg: 73.47 / Max: 81Min: 68 / Avg: 77.07 / Max: 85

NVIDIA GPU Cloud TensorFlow

System Power Consumption Monitor

OpenBenchmarking.orgWatts, Fewer Is BetterNVIDIA GPU Cloud TensorFlow 18.09System Power Consumption MonitorGTX 1070 TiGTX 1070GTX 1080RTX 2080 TiGTX 980RTX 2080TITAN RTXGTX 1080 TiGTX TITAN X GM200GTX 980 Ti60120180240300Min: 46.9 / Avg: 135.79 / Max: 175Min: 68.9 / Avg: 158.49 / Max: 192.3Min: 44.1 / Avg: 167.55 / Max: 234.8Min: 49.3 / Avg: 177.62 / Max: 332.6Min: 48.6 / Avg: 187.19 / Max: 240.4Min: 47.3 / Avg: 190.7 / Max: 270.1Min: 50.6 / Avg: 195.26 / Max: 352.6Min: 51.3 / Avg: 213.37 / Max: 303.2Min: 55.1 / Avg: 236.59 / Max: 321.2Min: 135.2 / Avg: 237.19 / Max: 295.5

NVIDIA GPU Cloud TensorFlow

Test: AlexNet, FP32

OpenBenchmarking.orgImages Per Second Per Watt, More Is BetterNVIDIA GPU Cloud TensorFlow 18.09Test: AlexNet, FP32TITAN RTXRTX 2080 TiGTX 1080 TiRTX 2070RTX 2080GTX 1070 TiGTX 1080GTX 1070GTX 980 TiGTX TITAN X GM200GTX 9804812162014.6612.9912.1911.7211.4410.999.909.616.596.296.20

NVIDIA GPU Cloud TensorFlow

GPU Temperature Monitor

OpenBenchmarking.orgCelsius, Fewer Is BetterNVIDIA GPU Cloud TensorFlow 18.09GPU Temperature MonitorGTX 1070 TiRTX 2070RTX 2080 TiTITAN RTXGTX 1070GTX 1080GTX 1080 TiRTX 2080GTX 980GTX 980 TiGTX TITAN X GM2001632486480Min: 44 / Avg: 49.07 / Max: 52Min: 46 / Avg: 55.88 / Max: 61Min: 53 / Avg: 61.36 / Max: 67Min: 55 / Avg: 61.71 / Max: 67Min: 61 / Avg: 64.2 / Max: 68Min: 63 / Avg: 66.8 / Max: 71Min: 64 / Avg: 67.58 / Max: 71Min: 59 / Avg: 69.81 / Max: 76Min: 63 / Avg: 72.44 / Max: 77Min: 71 / Avg: 77.5 / Max: 82Min: 72 / Avg: 78.81 / Max: 84

NVIDIA GPU Cloud TensorFlow

System Power Consumption Monitor

OpenBenchmarking.orgWatts, Fewer Is BetterNVIDIA GPU Cloud TensorFlow 18.09System Power Consumption MonitorGTX 1070 TiGTX 1070GTX 1080RTX 2070GTX 980GTX 1080 TiRTX 2080GTX 980 TiTITAN RTXGTX TITAN X GM200RTX 2080 Ti60120180240300Min: 48.2 / Avg: 144.76 / Max: 185.9Min: 87.1 / Avg: 157.65 / Max: 201.5Min: 100.9 / Avg: 178.22 / Max: 229Min: 64.2 / Avg: 185.45 / Max: 243.7Min: 101.5 / Avg: 186.05 / Max: 232.5Min: 126 / Avg: 208.21 / Max: 307.4Min: 48 / Avg: 211.46 / Max: 284.1Min: 122.8 / Avg: 227.61 / Max: 318.8Min: 78.6 / Avg: 243.91 / Max: 357Min: 136.3 / Avg: 252.18 / Max: 313.2Min: 48.9 / Avg: 257.45 / Max: 338.7

NVIDIA GPU Cloud TensorFlow

Test: Googlenet, FP16

OpenBenchmarking.orgImages Per Second Per Watt, More Is BetterNVIDIA GPU Cloud TensorFlow 18.09Test: Googlenet, FP16TITAN RTXRTX 2080 TiRTX 2080GTX 1070 TiGTX 1080 TiGTX 1080GTX 1070GTX TITAN X GM200GTX 980 Ti0.92481.84962.77443.69924.6244.114.073.212.532.452.132.061.401.36

NVIDIA GPU Cloud TensorFlow

GPU Temperature Monitor

OpenBenchmarking.orgCelsius, Fewer Is BetterNVIDIA GPU Cloud TensorFlow 18.09GPU Temperature MonitorGTX 1070 TiRTX 2080 TiTITAN RTXGTX 1070GTX 1080GTX 1080 TiRTX 2080GTX 980 TiGTX TITAN X GM2001632486480Min: 43 / Avg: 52.93 / Max: 56Min: 55 / Avg: 64.78 / Max: 71Min: 55 / Avg: 65.27 / Max: 72Min: 56 / Avg: 69 / Max: 74Min: 58 / Avg: 72.23 / Max: 79Min: 60 / Avg: 72.84 / Max: 80Min: 60 / Avg: 73.17 / Max: 80Min: 70 / Avg: 80.35 / Max: 84Min: 72 / Avg: 80.77 / Max: 85

NVIDIA GPU Cloud TensorFlow

System Power Consumption Monitor

OpenBenchmarking.orgWatts, Fewer Is BetterNVIDIA GPU Cloud TensorFlow 18.09System Power Consumption MonitorGTX 1070 TiGTX 1070GTX 1080RTX 2080RTX 2080 TiGTX 1080 TiGTX 980 TiGTX TITAN X GM200TITAN RTX60120180240300Min: 46.8 / Avg: 163.6 / Max: 187.8Min: 43.4 / Avg: 181.99 / Max: 210.5Min: 76.2 / Avg: 215.22 / Max: 247Min: 47.7 / Avg: 229.8 / Max: 284.5Min: 49.5 / Avg: 249.29 / Max: 343.1Min: 64 / Avg: 257.4 / Max: 319.4Min: 124.1 / Avg: 260.98 / Max: 317Min: 102.1 / Avg: 265.29 / Max: 320.1Min: 50.7 / Avg: 275.3 / Max: 360

NVIDIA GPU Cloud TensorFlow

Test: Inception v4, FP16

OpenBenchmarking.orgImages Per Second Per Watt, More Is BetterNVIDIA GPU Cloud TensorFlow 18.09Test: Inception v4, FP16TITAN RTXRTX 2080 TiRTX 2080GTX 1080 TiGTX 1070 TiGTX 1080GTX 1070GTX TITAN X GM200GTX 980 Ti0.17550.3510.52650.7020.87750.780.740.580.350.340.300.280.190.18

NVIDIA GPU Cloud TensorFlow

GPU Temperature Monitor

OpenBenchmarking.orgCelsius, Fewer Is BetterNVIDIA GPU Cloud TensorFlow 18.09GPU Temperature MonitorGTX 1070 TiRTX 2080 TiTITAN RTXGTX 1070GTX 1080RTX 2080GTX 1080 TiGTX 980 TiGTX TITAN X GM2001632486480Min: 43 / Avg: 49.56 / Max: 55Min: 53 / Avg: 57.76 / Max: 65Min: 54 / Avg: 59.11 / Max: 66Min: 55 / Avg: 64.07 / Max: 72Min: 51 / Avg: 64.33 / Max: 76Min: 57 / Avg: 64.7 / Max: 74Min: 56 / Avg: 66.24 / Max: 77Min: 61 / Avg: 74.85 / Max: 84Min: 62 / Avg: 75.61 / Max: 85

NVIDIA GPU Cloud TensorFlow

System Power Consumption Monitor

OpenBenchmarking.orgWatts, Fewer Is BetterNVIDIA GPU Cloud TensorFlow 18.09System Power Consumption MonitorGTX 1070 TiGTX 1070RTX 2080RTX 2080 TiGTX 1080TITAN RTXGTX 1080 TiGTX 980 TiGTX TITAN X GM20060120180240300Min: 47.2 / Avg: 146.22 / Max: 188.6Min: 44.1 / Avg: 157.87 / Max: 210.2Min: 47.6 / Avg: 177.11 / Max: 285.3Min: 50 / Avg: 183.11 / Max: 341.1Min: 71.3 / Avg: 185.89 / Max: 249.7Min: 58.3 / Avg: 196.21 / Max: 353.3Min: 52.2 / Avg: 211.84 / Max: 320.9Min: 52.9 / Avg: 226.01 / Max: 305.4Min: 55.1 / Avg: 232.58 / Max: 323

NVIDIA GPU Cloud TensorFlow

Test: VGG-16, FP16

OpenBenchmarking.orgImages Per Second Per Watt, More Is BetterNVIDIA GPU Cloud TensorFlow 18.09Test: VGG-16, FP16TITAN RTXRTX 2080 TiRTX 2080GTX 1080 TiGTX 1070 TiGTX 1080GTX 1070GTX 980 TiGTX TITAN X GM2000.21380.42760.64140.85521.0690.950.940.690.540.530.480.460.300.29

NVIDIA GPU Cloud TensorFlow

GPU Temperature Monitor

OpenBenchmarking.orgCelsius, Fewer Is BetterNVIDIA GPU Cloud TensorFlow 18.09GPU Temperature MonitorGTX 1070 TiRTX 2080 TiTITAN RTXGTX 1080GTX 1070RTX 2080GTX 1080 TiGTX TITAN X GM200GTX 980 Ti1632486480Min: 45 / Avg: 52.18 / Max: 55Min: 54 / Avg: 61.56 / Max: 68Min: 55 / Avg: 62.56 / Max: 68Min: 50 / Avg: 65.84 / Max: 74Min: 59 / Avg: 66.13 / Max: 70Min: 59 / Avg: 69.86 / Max: 77Min: 61 / Avg: 70.1 / Max: 76Min: 67 / Avg: 79 / Max: 84Min: 67 / Avg: 79.22 / Max: 84

NVIDIA GPU Cloud TensorFlow

System Power Consumption Monitor

OpenBenchmarking.orgWatts, Fewer Is BetterNVIDIA GPU Cloud TensorFlow 18.09System Power Consumption MonitorGTX 1070 TiGTX 1070GTX 1080RTX 2080 TiRTX 2080GTX 1080 TiGTX 980 TiTITAN RTXGTX TITAN X GM20060120180240300Min: 46.8 / Avg: 160.44 / Max: 192Min: 43.7 / Avg: 168.53 / Max: 201.8Min: 90.8 / Avg: 194.86 / Max: 239.8Min: 51 / Avg: 219.66 / Max: 332.2Min: 48.1 / Avg: 223.76 / Max: 283.3Min: 51.7 / Avg: 242.51 / Max: 313.1Min: 52.4 / Avg: 254.36 / Max: 318.4Min: 49.3 / Avg: 256.56 / Max: 354.6Min: 81.5 / Avg: 277.12 / Max: 327.7

NVIDIA GPU Cloud TensorFlow

Test: VGG-16, FP32

OpenBenchmarking.orgImages Per Second Per Watt, More Is BetterNVIDIA GPU Cloud TensorFlow 18.09Test: VGG-16, FP32TITAN RTXRTX 2080 TiGTX 1080 TiGTX 1070 TiRTX 2080GTX 1080GTX 1070GTX TITAN X GM2000.13050.2610.39150.5220.65250.580.560.490.470.450.420.420.28

NVIDIA GPU Cloud TensorFlow

GPU Temperature Monitor

OpenBenchmarking.orgCelsius, Fewer Is BetterNVIDIA GPU Cloud TensorFlow 18.09GPU Temperature MonitorGTX 1070 TiRTX 2080 TiGTX 1070TITAN RTXGTX 1080GTX 1080 TiRTX 2080GTX TITAN X GM2001632486480Min: 46 / Avg: 52.21 / Max: 55Min: 56 / Avg: 65.52 / Max: 71Min: 58 / Avg: 66.1 / Max: 70Min: 56 / Avg: 67.15 / Max: 73Min: 60 / Avg: 69.33 / Max: 74Min: 61 / Avg: 70.55 / Max: 77Min: 61 / Avg: 74.1 / Max: 80Min: 67 / Avg: 79.62 / Max: 84

NVIDIA GPU Cloud TensorFlow

System Power Consumption Monitor

OpenBenchmarking.orgWatts, Fewer Is BetterNVIDIA GPU Cloud TensorFlow 18.09System Power Consumption MonitorGTX 1070 TiGTX 1070GTX 1080RTX 2080GTX 1080 TiGTX TITAN X GM200RTX 2080 TiTITAN RTX60120180240300Min: 58.5 / Avg: 162.02 / Max: 191Min: 54.1 / Avg: 170.77 / Max: 203.5Min: 46.3 / Avg: 198.19 / Max: 236.2Min: 55.7 / Avg: 239.26 / Max: 287.8Min: 51.2 / Avg: 241.65 / Max: 309.7Min: 53 / Avg: 261.76 / Max: 321.8Min: 50.2 / Avg: 270.5 / Max: 342.3Min: 60 / Avg: 281.79 / Max: 357.7

Phoronix Test Suite v10.8.4