NVIDIA TITAN RTX Linux GPU Compute Benchmarks

NVIDIA and AMD GPU Linux compute benchmarks December 2018 by Michael Larabel for a future article, review of the NVIDIA TITAN RTX.

HTML result view exported from: https://openbenchmarking.org/result/1812224-SP-GPUCOMPUT75.

NVIDIA TITAN RTX Linux GPU Compute BenchmarksProcessorMotherboardChipsetMemoryDiskGraphicsAudioMonitorNetworkOSKernelDesktopDisplay ServerDisplay DriverOpenGLOpenCLVulkanCompilerFile-SystemScreen ResolutionGTX 980GTX 980 TiGTX TITAN X GM200GTX 1070GTX 1070 TiGTX 1080GTX 1080 TiRTX 2070RTX 2080RTX 2080 TiTITAN RTXRX Vega 56RX Vega 64Intel Core i9-9900K @ 5.00GHz (8 Cores / 16 Threads)ASUS PRIME Z390-A (0602 BIOS)Intel Cannon Lake PCH Shared SRAM16384MB2000GB SABRENT + Samsung SSD 970 EVO 250GBNVIDIA GeForce GTX 980 4GB (1126/3505MHz)Realtek ALC1220Acer B286HKIntel ConnectionUbuntu 18.044.19.5-041905-generic (x86_64)GNOME Shell 3.28.3X Server 1.19.6NVIDIA 415.234.6.0OpenCL 1.2 CUDA 10.0.1321.1.84GCC 7.3.0 + CUDA 10.0ext43840x2160NVIDIA GeForce GTX 980 Ti 6GB (999/3505MHz)NVIDIA GeForce GTX TITAN X 12GB (1001/3505MHz)NVIDIA GeForce GTX 1070 8GB (1506/4006MHz)NVIDIA 415.22Zotac NVIDIA GeForce GTX 1070 Ti 8GB (1607/4006MHz)NVIDIA GeForce GTX 1080 8GB (1607/5005MHz)NVIDIA GeForce GTX 1080 Ti 11GB (1480/5508MHz)eVGA NVIDIA GeForce RTX 2070 8GB (1410/7000MHz)Zotac NVIDIA GeForce RTX 2080 8GB (1515/7000MHz)NVIDIA GeForce RTX 2080 Ti 11GB (1350/7000MHz)NVIDIA TITAN RTX 24GB (1350/7000MHz)NVIDIA 415.23AMD Radeon RX Vega 8GB (1590/800MHz)4.5 Mesa 19.0.0-devel padoka PPA (LLVM 8.0.0)OpenCL 2.1 AMD-APP (2679.0)1.1.70GCC 7.3.0AMD Radeon RX Vega 8GB (1630/945MHz)OpenBenchmarking.orgCompiler Details- --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++ --enable-libmpx --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib --with-tune=generic --without-cuda-driver -v Processor Details- Scaling Governor: intel_pstate performanceOpenCL Details- GTX 980: GPU Compute Cores: 2048- GTX 980 Ti: GPU Compute Cores: 2816- GTX TITAN X GM200: GPU Compute Cores: 3072- GTX 1070: GPU Compute Cores: 1920- GTX 1070 Ti: GPU Compute Cores: 2432- GTX 1080: GPU Compute Cores: 2560- GTX 1080 Ti: GPU Compute Cores: 3584- RTX 2070: GPU Compute Cores: 2304- RTX 2080: GPU Compute Cores: 2944- RTX 2080 Ti: GPU Compute Cores: 4352- TITAN RTX: GPU Compute Cores: 4608Security Details- __user pointer sanitization + Full generic retpoline IBPB IBRS_FW + SSB disabled via prctl and seccomp

NVIDIA TITAN RTX Linux GPU Compute Benchmarksshoc: OpenCL - FFT SPcl-mem: Copyluxmark: GPU - Luxball HDRv-ray: CUDA GPUngc-tensorflow: ResNet-50, FP16ngc-tensorflow: ResNet-50, FP32ngc-tensorflow: AlexNet, FP16ngc-tensorflow: AlexNet, FP32ngc-tensorflow: Googlenet, FP16ngc-tensorflow: Inception v4, FP16ngc-tensorflow: VGG-16, FP16ngc-tensorflow: VGG-16, FP32GTX 980GTX 980 TiGTX TITAN X GM200GTX 1070GTX 1070 TiGTX 1080GTX 1080 TiRTX 2070RTX 2080RTX 2080 TiTITAN RTXRX Vega 56RX Vega 6446814313242106.51120811547282171691077.701501552150135640.9077.577262181729980.621561251662158737243.2379.2072.774521871728890.431601251563151637544.7776.9371.574971881688686.301751331683159141349.2384.4376.4057520913823102.071931431875176445855.0393.1382.909723172156266.412712102674253962974.63131.37119.509983303009166.02309217410833282964172.0733520531532419738102.77153.33108.5714434544269356.09449285443233441015135.90206.97152.4015484844593250.08520299503235761132152.80244.40162.3392620331179107022132815OpenBenchmarking.org

SHOC Scalable HeterOgeneous Computing

Target: OpenCL - Benchmark: FFT SP

OpenBenchmarking.orgGFLOPS, More Is BetterSHOC Scalable HeterOgeneous Computing 2015-11-10Target: OpenCL - Benchmark: FFT SPGTX 980GTX 980 TiGTX TITAN X GM200GTX 1070GTX 1070 TiGTX 1080GTX 1080 TiRTX 2070RTX 2080RTX 2080 TiTITAN RTXRX Vega 56RX Vega 6430060090012001500SE +/- 0.27, N = 3SE +/- 0.20, N = 3SE +/- 0.60, N = 3SE +/- 0.94, N = 3SE +/- 0.73, N = 3SE +/- 2.68, N = 3SE +/- 1.23, N = 3SE +/- 40.79, N = 3SE +/- 5.95, N = 3SE +/- 14.24, N = 3SE +/- 11.44, N = 3SE +/- 1.57, N = 3SE +/- 0.64, N = 34687287264524975759729981083144315489261070-std=c++14 -lcudadevrt -lcudart_static -lpthread -ldl -lcufft-std=c++14 -lcudadevrt -lcudart_static -lpthread -ldl -lcufft-std=c++14 -lcudadevrt -lcudart_static -lpthread -ldl -lcufft-std=c++14 -lcudadevrt -lcudart_static -lpthread -ldl -lcufft-std=c++14 -lcudadevrt -lcudart_static -lpthread -ldl -lcufft-std=c++14 -lcudadevrt -lcudart_static -lpthread -ldl -lcufft-std=c++14 -lcudadevrt -lcudart_static -lpthread -ldl -lcufft-std=c++14 -lcudadevrt -lcudart_static -lpthread -ldl -lcufft-std=c++14 -lcudadevrt -lcudart_static -lpthread -ldl -lcufft-std=c++14 -lcudadevrt -lcudart_static -lpthread -ldl -lcufft-std=c++14 -lcudadevrt -lcudart_static -lpthread -ldl -lcufft-lSHOCCommonOpenCL -lOpenCL-lSHOCCommonOpenCL -lOpenCL1. (CXX) g++ options: -O2 -lSHOCCommon -lrt

cl-mem

Benchmark: Copy

OpenBenchmarking.orgGB/s, More Is Bettercl-mem 2017-01-13Benchmark: CopyGTX 980GTX 980 TiGTX TITAN X GM200GTX 1070GTX 1070 TiGTX 1080GTX 1080 TiRTX 2070RTX 2080RTX 2080 TiTITAN RTXRX Vega 56RX Vega 64100200300400500SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.03, N = 3SE +/- 0.07, N = 3SE +/- 0.07, N = 3SE +/- 0.07, N = 3SE +/- 0.07, N = 3SE +/- 0.12, N = 3SE +/- 0.09, N = 3SE +/- 0.39, N = 3SE +/- 0.24, N = 3SE +/- 0.21, N = 3SE +/- 0.07, N = 31432172181871882093173303284544842032211. (CC) gcc options: -O2 -flto -lOpenCL

LuxMark

OpenCL Device: GPU - Scene: Luxball HDR

OpenBenchmarking.orgScore, More Is BetterLuxMark 3.1OpenCL Device: GPU - Scene: Luxball HDRGTX 980GTX 980 TiGTX TITAN X GM200GTX 1070GTX 1070 TiGTX 1080GTX 1080 TiRTX 2070RTX 2080RTX 2080 TiTITAN RTXRX Vega 56RX Vega 6410K20K30K40K50KSE +/- 33.13, N = 3SE +/- 26.00, N = 3SE +/- 11.50, N = 3SE +/- 0.58, N = 3SE +/- 0.67, N = 3SE +/- 29.04, N = 3SE +/- 119.86, N = 3SE +/- 2.73, N = 3SE +/- 66.64, N = 3SE +/- 41.88, N = 3SE +/- 20.53, N = 3SE +/- 570.76, N = 313242169101729917288168861382321562300912964142693459323117932815

SHOC Scalable HeterOgeneous Computing

System Power Consumption Monitor

OpenBenchmarking.orgWatts, Fewer Is BetterSHOC Scalable HeterOgeneous Computing 2015-11-10System Power Consumption MonitorGTX 1070GTX 1070 TiGTX 1080GTX 1080 TiRTX 2070RTX 2080RTX 2080 TiTITAN RTXRX Vega 56RX Vega 6450100150200250Min: 82.6 / Avg: 134.72 / Max: 155.3Min: 47 / Avg: 122.6 / Max: 141.5Min: 89.7 / Avg: 144.76 / Max: 164.6Min: 120.8 / Avg: 190.06 / Max: 216.8Min: 53.7 / Avg: 162.86 / Max: 198.7Min: 47.1 / Avg: 169.8 / Max: 202.9Min: 47.5 / Avg: 222.96 / Max: 282.7Min: 47.9 / Avg: 232.9 / Max: 281.3Min: 49.4 / Avg: 197.63 / Max: 234.4Min: 51.8 / Avg: 223.18 / Max: 249.9

LuxMark

System Power Consumption Monitor

OpenBenchmarking.orgWatts, Fewer Is BetterLuxMark 3.1System Power Consumption MonitorGTX 980GTX 980 TiGTX TITAN X GM200GTX 1070GTX 1070 TiGTX 1080GTX 1080 TiRTX 2070RTX 2080RTX 2080 TiTITAN RTXRX Vega 56RX Vega 6460120180240300Min: 80.2 / Avg: 189.6 / Max: 196.9Min: 118.7 / Avg: 233.83 / Max: 241.4Min: 126.4 / Avg: 249.16 / Max: 256.8Min: 83.1 / Avg: 176.9 / Max: 181.3Min: 146.8 / Avg: 148.92 / Max: 149.4Min: 90.8 / Avg: 174.24 / Max: 176.2Min: 122.9 / Avg: 241.59 / Max: 247.8Min: 78 / Avg: 225.33 / Max: 232.6Min: 101.9 / Avg: 240.83 / Max: 247.3Min: 111.1 / Avg: 315.29 / Max: 328.4Min: 48.7 / Avg: 329.43 / Max: 344Min: 51.8 / Avg: 251.16 / Max: 263.3Min: 53 / Avg: 323.35 / Max: 337.9

GPU Temperature Monitor

Phoronix Test Suite System Monitoring

OpenBenchmarking.orgCelsiusGPU Temperature MonitorPhoronix Test Suite System MonitoringGTX 980GTX 980 TiGTX TITAN X GM200GTX 1070GTX 1070 TiGTX 1080GTX 1080 TiRTX 2070RTX 2080RTX 2080 TiTITAN RTXRX Vega 56RX Vega 641632486480Min: 34 / Avg: 58.36 / Max: 77Min: 38 / Avg: 74.74 / Max: 84Min: 35 / Avg: 76.87 / Max: 85Min: 31 / Avg: 61.13 / Max: 75Min: 36 / Avg: 46.92 / Max: 60Min: 45 / Avg: 63.06 / Max: 79Min: 33 / Avg: 66.46 / Max: 80Min: 33 / Avg: 54.57 / Max: 64Min: 35 / Avg: 66.5 / Max: 80Min: 34 / Avg: 60.3 / Max: 76Min: 38 / Avg: 63.55 / Max: 77Min: 31 / Avg: 51.02 / Max: 75Min: 28 / Avg: 52.98 / Max: 85

System Power Consumption Monitor

Phoronix Test Suite System Monitoring

OpenBenchmarking.orgWattsSystem Power Consumption MonitorPhoronix Test Suite System MonitoringGTX 980GTX 980 TiGTX TITAN X GM200GTX 1070GTX 1070 TiGTX 1080GTX 1080 TiRTX 2070RTX 2080RTX 2080 TiTITAN RTXRX Vega 56RX Vega 6470140210280350Min: 45.1 / Avg: 126.87 / Max: 240.4Min: 52.1 / Avg: 218.82 / Max: 321.2Min: 48.8 / Avg: 240.32 / Max: 327.7Min: 41.9 / Avg: 143.92 / Max: 213.8Min: 45.9 / Avg: 127.84 / Max: 213.8Min: 42.2 / Avg: 154.56 / Max: 251.7Min: 43.4 / Avg: 200.91 / Max: 320.9Min: 42.1 / Avg: 146.13 / Max: 247.2Min: 43.9 / Avg: 175.16 / Max: 287.8Min: 45.5 / Avg: 208.03 / Max: 346.7Min: 47.9 / Avg: 242.09 / Max: 364.6Min: 48.8 / Avg: 143.52 / Max: 284.1Min: 48.4 / Avg: 169.45 / Max: 358.6

Chaos Group V-RAY

Mode: CUDA GPU

OpenBenchmarking.orgSeconds, Fewer Is BetterChaos Group V-RAY 1.1.0Mode: CUDA GPUGTX 980GTX 980 TiGTX TITAN X GM200GTX 1070GTX 1070 TiGTX 1080GTX 1080 TiRTX 2070RTX 2080RTX 2080 TiTITAN RTX20406080100SE +/- 0.16, N = 3SE +/- 0.14, N = 3SE +/- 2.94, N = 3SE +/- 0.03, N = 3SE +/- 0.04, N = 3SE +/- 3.08, N = 3SE +/- 0.03, N = 3SE +/- 0.03, N = 3SE +/- 0.04, N = 3SE +/- 3.00, N = 3SE +/- 0.02, N = 3106.5177.7080.6290.4386.30102.0766.4166.0272.0756.0950.08

Chaos Group V-RAY

GPU Temperature Monitor

OpenBenchmarking.orgCelsius, Fewer Is BetterChaos Group V-RAY 1.1.0GPU Temperature MonitorGTX 980GTX 980 TiGTX TITAN X GM200GTX 1070GTX 1070 TiGTX 1080GTX 1080 TiRTX 2070RTX 2080RTX 2080 TiTITAN RTX1632486480Min: 64 / Avg: 72.91 / Max: 75Min: 69 / Avg: 78.07 / Max: 81Min: 67 / Avg: 78.35 / Max: 82Min: 46 / Avg: 62.55 / Max: 68Min: 38 / Avg: 47.77 / Max: 50Min: 48 / Avg: 62.93 / Max: 67Min: 54 / Avg: 68.11 / Max: 73Min: 53 / Avg: 60.72 / Max: 62Min: 50 / Avg: 68.2 / Max: 74Min: 46 / Avg: 60.03 / Max: 68Min: 56 / Avg: 67.85 / Max: 72

Chaos Group V-RAY

System Power Consumption Monitor

OpenBenchmarking.orgWatts, Fewer Is BetterChaos Group V-RAY 1.1.0System Power Consumption MonitorGTX 980GTX 980 TiGTX TITAN X GM200GTX 1070GTX 1070 TiGTX 1080GTX 1080 TiRTX 2070RTX 2080RTX 2080 TiTITAN RTX50100150200250Min: 47.6 / Avg: 170.22 / Max: 175.3Min: 52.1 / Avg: 218.49 / Max: 231.5Min: 55.7 / Avg: 230.04 / Max: 248.4Min: 43.4 / Avg: 151.17 / Max: 164.2Min: 46.1 / Avg: 130.78 / Max: 135.6Min: 43.6 / Avg: 153.26 / Max: 165.9Min: 120.4 / Avg: 218.99 / Max: 231.8Min: 53.7 / Avg: 185.77 / Max: 199.3Min: 63 / Avg: 191.71 / Max: 202.8Min: 69.5 / Avg: 242.72 / Max: 272Min: 57.5 / Avg: 262.41 / Max: 287.8

NVIDIA GPU Cloud TensorFlow

Test: ResNet-50, FP16

OpenBenchmarking.orgImages Per Second, More Is BetterNVIDIA GPU Cloud TensorFlow 18.09Test: ResNet-50, FP16GTX 980 TiGTX TITAN X GM200GTX 1070GTX 1070 TiGTX 1080GTX 1080 TiRTX 2070RTX 2080RTX 2080 TiTITAN RTX110220330440550SE +/- 1.68, N = 3SE +/- 4.74, N = 3SE +/- 0.03, N = 3SE +/- 0.07, N = 3SE +/- 0.10, N = 3SE +/- 0.15, N = 3SE +/- 0.85, N = 3SE +/- 0.28, N = 3SE +/- 0.06, N = 3150156160175193271309335449520

NVIDIA GPU Cloud TensorFlow

Test: ResNet-50, FP16

OpenBenchmarking.orgImages Per Second Per Watt, More Is BetterNVIDIA GPU Cloud TensorFlow 18.09Test: ResNet-50, FP16GTX 980 TiGTX TITAN X GM200GTX 1070GTX 1070 TiGTX 1080GTX 1080 TiRTX 2070RTX 2080RTX 2080 TiTITAN RTX0.57381.14761.72142.29522.8690.610.620.921.141.021.221.901.862.102.55

NVIDIA GPU Cloud TensorFlow

GPU Temperature Monitor

OpenBenchmarking.orgCelsius, Fewer Is BetterNVIDIA GPU Cloud TensorFlow 18.09GPU Temperature MonitorGTX 980 TiGTX TITAN X GM200GTX 1070GTX 1070 TiGTX 1080GTX 1080 TiRTX 2070RTX 2080RTX 2080 TiTITAN RTX1632486480Min: 65 / Avg: 76.82 / Max: 83Min: 66 / Avg: 77.41 / Max: 84Min: 58 / Avg: 65.55 / Max: 70Min: 46 / Avg: 50.94 / Max: 55Min: 61 / Avg: 68.3 / Max: 75Min: 61 / Avg: 68.17 / Max: 75Min: 32 / Avg: 45.47 / Max: 58Min: 60 / Avg: 67.05 / Max: 75Min: 55 / Avg: 59.52 / Max: 65Min: 57 / Avg: 61.37 / Max: 67

NVIDIA GPU Cloud TensorFlow

System Power Consumption Monitor

OpenBenchmarking.orgWatts, Fewer Is BetterNVIDIA GPU Cloud TensorFlow 18.09System Power Consumption MonitorGTX 980 TiGTX TITAN X GM200GTX 1070GTX 1070 TiGTX 1080GTX 1080 TiRTX 2070RTX 2080RTX 2080 TiTITAN RTX60120180240300Min: 52.8 / Avg: 244.09 / Max: 310.7Min: 55.5 / Avg: 252.42 / Max: 326.9Min: 42.7 / Avg: 174.04 / Max: 212.6Min: 47 / Avg: 153.76 / Max: 192.3Min: 44.7 / Avg: 189.85 / Max: 248.8Min: 54.6 / Avg: 222.3 / Max: 319.6Min: 71.1 / Avg: 162.36 / Max: 246.8Min: 47.3 / Avg: 179.59 / Max: 284.7Min: 56.1 / Avg: 213.62 / Max: 342.3Min: 51 / Avg: 203.63 / Max: 350.6

NVIDIA GPU Cloud TensorFlow

Test: ResNet-50, FP32

OpenBenchmarking.orgImages Per Second, More Is BetterNVIDIA GPU Cloud TensorFlow 18.09Test: ResNet-50, FP32GTX TITAN X GM200GTX 1070GTX 1070 TiGTX 1080GTX 1080 TiRTX 2080RTX 2080 TiTITAN RTX70140210280350SE +/- 0.20, N = 3SE +/- 0.09, N = 3SE +/- 0.06, N = 3SE +/- 0.07, N = 3SE +/- 0.19, N = 3SE +/- 0.28, N = 3SE +/- 0.44, N = 3SE +/- 0.31, N = 3125125133143210205285299

NVIDIA GPU Cloud TensorFlow

Test: ResNet-50, FP32

OpenBenchmarking.orgImages Per Second Per Watt, More Is BetterNVIDIA GPU Cloud TensorFlow 18.09Test: ResNet-50, FP32GTX TITAN X GM200GTX 1070GTX 1070 TiGTX 1080GTX 1080 TiRTX 2080RTX 2080 TiTITAN RTX0.26550.5310.79651.0621.32750.490.730.840.730.890.991.151.18

NVIDIA GPU Cloud TensorFlow

GPU Temperature Monitor

OpenBenchmarking.orgCelsius, Fewer Is BetterNVIDIA GPU Cloud TensorFlow 18.09GPU Temperature MonitorGTX TITAN X GM200GTX 1070GTX 1070 TiGTX 1080GTX 1080 TiRTX 2080RTX 2080 TiTITAN RTX1632486480Min: 65 / Avg: 77.91 / Max: 84Min: 57 / Avg: 65.61 / Max: 71Min: 44 / Avg: 50.85 / Max: 54Min: 60 / Avg: 68.77 / Max: 75Min: 62 / Avg: 70.04 / Max: 77Min: 59 / Avg: 70.41 / Max: 77Min: 54 / Avg: 61.16 / Max: 67Min: 54 / Avg: 62.76 / Max: 70

NVIDIA GPU Cloud TensorFlow

System Power Consumption Monitor

OpenBenchmarking.orgWatts, Fewer Is BetterNVIDIA GPU Cloud TensorFlow 18.09System Power Consumption MonitorGTX TITAN X GM200GTX 1070GTX 1070 TiGTX 1080GTX 1080 TiRTX 2080RTX 2080 TiTITAN RTX70140210280350Min: 56.2 / Avg: 255.72 / Max: 321Min: 45.9 / Avg: 172.02 / Max: 213.8Min: 48 / Avg: 157.29 / Max: 187.8Min: 44.1 / Avg: 196.38 / Max: 249.7Min: 79.7 / Avg: 234.81 / Max: 318.6Min: 48 / Avg: 206.72 / Max: 285Min: 50.5 / Avg: 248.25 / Max: 346.7Min: 50.5 / Avg: 252.59 / Max: 364.6

NVIDIA GPU Cloud TensorFlow

Test: AlexNet, FP16

OpenBenchmarking.orgImages Per Second, More Is BetterNVIDIA GPU Cloud TensorFlow 18.09Test: AlexNet, FP16GTX 980GTX 980 TiGTX TITAN X GM200GTX 1070GTX 1070 TiGTX 1080GTX 1080 TiRTX 2080RTX 2080 TiTITAN RTX11002200330044005500SE +/- 2.04, N = 3SE +/- 6.83, N = 3SE +/- 2.24, N = 3SE +/- 2.26, N = 3SE +/- 0.50, N = 3SE +/- 2.60, N = 3SE +/- 1.32, N = 3SE +/- 3.35, N = 3SE +/- 2.27, N = 3SE +/- 4.39, N = 31208155216621563168318752674315344325032

NVIDIA GPU Cloud TensorFlow

Test: AlexNet, FP16

OpenBenchmarking.orgImages Per Second Per Watt, More Is BetterNVIDIA GPU Cloud TensorFlow 18.09Test: AlexNet, FP16GTX 980GTX 980 TiGTX TITAN X GM200GTX 1070GTX 1070 TiGTX 1080GTX 1080 TiRTX 2080RTX 2080 TiTITAN RTX6121824306.456.547.039.8612.3911.1912.5316.5324.9525.77

NVIDIA GPU Cloud TensorFlow

GPU Temperature Monitor

OpenBenchmarking.orgCelsius, Fewer Is BetterNVIDIA GPU Cloud TensorFlow 18.09GPU Temperature MonitorGTX 980GTX 980 TiGTX TITAN X GM200GTX 1070GTX 1070 TiGTX 1080GTX 1080 TiRTX 2080RTX 2080 TiTITAN RTX1632486480Min: 51 / Avg: 65.82 / Max: 74Min: 62 / Avg: 73.47 / Max: 81Min: 68 / Avg: 77.07 / Max: 85Min: 59 / Avg: 64.06 / Max: 67Min: 46 / Avg: 49.93 / Max: 53Min: 62 / Avg: 66.46 / Max: 70Min: 63 / Avg: 67.2 / Max: 70Min: 63 / Avg: 67.57 / Max: 72Min: 57 / Avg: 60.36 / Max: 64Min: 58 / Avg: 61.4 / Max: 65

NVIDIA GPU Cloud TensorFlow

System Power Consumption Monitor

OpenBenchmarking.orgWatts, Fewer Is BetterNVIDIA GPU Cloud TensorFlow 18.09System Power Consumption MonitorGTX 980GTX 980 TiGTX TITAN X GM200GTX 1070GTX 1070 TiGTX 1080GTX 1080 TiRTX 2080RTX 2080 TiTITAN RTX60120180240300Min: 48.6 / Avg: 187.19 / Max: 240.4Min: 135.2 / Avg: 237.19 / Max: 295.5Min: 55.1 / Avg: 236.59 / Max: 321.2Min: 68.9 / Avg: 158.49 / Max: 192.3Min: 46.9 / Avg: 135.79 / Max: 175Min: 44.1 / Avg: 167.55 / Max: 234.8Min: 51.3 / Avg: 213.37 / Max: 303.2Min: 47.3 / Avg: 190.7 / Max: 270.1Min: 49.3 / Avg: 177.62 / Max: 332.6Min: 50.6 / Avg: 195.26 / Max: 352.6

NVIDIA GPU Cloud TensorFlow

Test: AlexNet, FP32

OpenBenchmarking.orgImages Per Second, More Is BetterNVIDIA GPU Cloud TensorFlow 18.09Test: AlexNet, FP32GTX 980GTX 980 TiGTX TITAN X GM200GTX 1070GTX 1070 TiGTX 1080GTX 1080 TiRTX 2070RTX 2080RTX 2080 TiTITAN RTX8001600240032004000SE +/- 1.06, N = 3SE +/- 4.76, N = 3SE +/- 0.78, N = 3SE +/- 0.44, N = 3SE +/- 0.32, N = 3SE +/- 1.62, N = 3SE +/- 1.83, N = 3SE +/- 1.84, N = 3SE +/- 6.99, N = 3SE +/- 1.48, N = 311541501158715161591176425392174241933443576

NVIDIA GPU Cloud TensorFlow

Test: AlexNet, FP32

OpenBenchmarking.orgImages Per Second Per Watt, More Is BetterNVIDIA GPU Cloud TensorFlow 18.09Test: AlexNet, FP32GTX 980GTX 980 TiGTX TITAN X GM200GTX 1070GTX 1070 TiGTX 1080GTX 1080 TiRTX 2070RTX 2080RTX 2080 TiTITAN RTX481216206.206.596.299.6110.999.9012.1911.7211.4412.9914.66

NVIDIA GPU Cloud TensorFlow

GPU Temperature Monitor

OpenBenchmarking.orgCelsius, Fewer Is BetterNVIDIA GPU Cloud TensorFlow 18.09GPU Temperature MonitorGTX 980GTX 980 TiGTX TITAN X GM200GTX 1070GTX 1070 TiGTX 1080GTX 1080 TiRTX 2070RTX 2080RTX 2080 TiTITAN RTX1632486480Min: 63 / Avg: 72.44 / Max: 77Min: 71 / Avg: 77.5 / Max: 82Min: 72 / Avg: 78.81 / Max: 84Min: 61 / Avg: 64.2 / Max: 68Min: 44 / Avg: 49.07 / Max: 52Min: 63 / Avg: 66.8 / Max: 71Min: 64 / Avg: 67.58 / Max: 71Min: 46 / Avg: 55.88 / Max: 61Min: 59 / Avg: 69.81 / Max: 76Min: 53 / Avg: 61.36 / Max: 67Min: 55 / Avg: 61.71 / Max: 67

NVIDIA GPU Cloud TensorFlow

System Power Consumption Monitor

OpenBenchmarking.orgWatts, Fewer Is BetterNVIDIA GPU Cloud TensorFlow 18.09System Power Consumption MonitorGTX 980GTX 980 TiGTX TITAN X GM200GTX 1070GTX 1070 TiGTX 1080GTX 1080 TiRTX 2070RTX 2080RTX 2080 TiTITAN RTX60120180240300Min: 101.5 / Avg: 186.05 / Max: 232.5Min: 122.8 / Avg: 227.61 / Max: 318.8Min: 136.3 / Avg: 252.18 / Max: 313.2Min: 87.1 / Avg: 157.65 / Max: 201.5Min: 48.2 / Avg: 144.76 / Max: 185.9Min: 100.9 / Avg: 178.22 / Max: 229Min: 126 / Avg: 208.21 / Max: 307.4Min: 64.2 / Avg: 185.45 / Max: 243.7Min: 48 / Avg: 211.46 / Max: 284.1Min: 48.9 / Avg: 257.45 / Max: 338.7Min: 78.6 / Avg: 243.91 / Max: 357

NVIDIA GPU Cloud TensorFlow

Test: Googlenet, FP16

OpenBenchmarking.orgImages Per Second, More Is BetterNVIDIA GPU Cloud TensorFlow 18.09Test: Googlenet, FP16GTX 980 TiGTX TITAN X GM200GTX 1070GTX 1070 TiGTX 1080GTX 1080 TiRTX 2080RTX 2080 TiTITAN RTX2004006008001000SE +/- 1.37, N = 3SE +/- 1.00, N = 3SE +/- 0.35, N = 3SE +/- 0.09, N = 3SE +/- 0.21, N = 3SE +/- 2.49, N = 3SE +/- 0.58, N = 3SE +/- 0.49, N = 3SE +/- 0.35, N = 335637237541345862973810151132

NVIDIA GPU Cloud TensorFlow

Test: Googlenet, FP16

OpenBenchmarking.orgImages Per Second Per Watt, More Is BetterNVIDIA GPU Cloud TensorFlow 18.09Test: Googlenet, FP16GTX 980 TiGTX TITAN X GM200GTX 1070GTX 1070 TiGTX 1080GTX 1080 TiRTX 2080RTX 2080 TiTITAN RTX0.92481.84962.77443.69924.6241.361.402.062.532.132.453.214.074.11

NVIDIA GPU Cloud TensorFlow

GPU Temperature Monitor

OpenBenchmarking.orgCelsius, Fewer Is BetterNVIDIA GPU Cloud TensorFlow 18.09GPU Temperature MonitorGTX 980 TiGTX TITAN X GM200GTX 1070GTX 1070 TiGTX 1080GTX 1080 TiRTX 2080RTX 2080 TiTITAN RTX1632486480Min: 70 / Avg: 80.35 / Max: 84Min: 72 / Avg: 80.77 / Max: 85Min: 56 / Avg: 69 / Max: 74Min: 43 / Avg: 52.93 / Max: 56Min: 58 / Avg: 72.23 / Max: 79Min: 60 / Avg: 72.84 / Max: 80Min: 60 / Avg: 73.17 / Max: 80Min: 55 / Avg: 64.78 / Max: 71Min: 55 / Avg: 65.27 / Max: 72

NVIDIA GPU Cloud TensorFlow

System Power Consumption Monitor

OpenBenchmarking.orgWatts, Fewer Is BetterNVIDIA GPU Cloud TensorFlow 18.09System Power Consumption MonitorGTX 980 TiGTX TITAN X GM200GTX 1070GTX 1070 TiGTX 1080GTX 1080 TiRTX 2080RTX 2080 TiTITAN RTX60120180240300Min: 124.1 / Avg: 260.98 / Max: 317Min: 102.1 / Avg: 265.29 / Max: 320.1Min: 43.4 / Avg: 181.99 / Max: 210.5Min: 46.8 / Avg: 163.6 / Max: 187.8Min: 76.2 / Avg: 215.22 / Max: 247Min: 64 / Avg: 257.4 / Max: 319.4Min: 47.7 / Avg: 229.8 / Max: 284.5Min: 49.5 / Avg: 249.29 / Max: 343.1Min: 50.7 / Avg: 275.3 / Max: 360

NVIDIA GPU Cloud TensorFlow

Test: Inception v4, FP16

OpenBenchmarking.orgImages Per Second, More Is BetterNVIDIA GPU Cloud TensorFlow 18.09Test: Inception v4, FP16GTX 980 TiGTX TITAN X GM200GTX 1070GTX 1070 TiGTX 1080GTX 1080 TiRTX 2080RTX 2080 TiTITAN RTX306090120150SE +/- 0.12, N = 3SE +/- 0.12, N = 3SE +/- 0.03, N = 3SE +/- 0.03, N = 3SE +/- 0.03, N = 3SE +/- 0.07, N = 3SE +/- 0.07, N = 3SE +/- 0.10, N = 3SE +/- 0.21, N = 340.9043.2344.7749.2355.0374.63102.77135.90152.80

NVIDIA GPU Cloud TensorFlow

Test: Inception v4, FP16

OpenBenchmarking.orgImages Per Second Per Watt, More Is BetterNVIDIA GPU Cloud TensorFlow 18.09Test: Inception v4, FP16GTX 980 TiGTX TITAN X GM200GTX 1070GTX 1070 TiGTX 1080GTX 1080 TiRTX 2080RTX 2080 TiTITAN RTX0.17550.3510.52650.7020.87750.180.190.280.340.300.350.580.740.78

NVIDIA GPU Cloud TensorFlow

GPU Temperature Monitor

OpenBenchmarking.orgCelsius, Fewer Is BetterNVIDIA GPU Cloud TensorFlow 18.09GPU Temperature MonitorGTX 980 TiGTX TITAN X GM200GTX 1070GTX 1070 TiGTX 1080GTX 1080 TiRTX 2080RTX 2080 TiTITAN RTX1632486480Min: 61 / Avg: 74.85 / Max: 84Min: 62 / Avg: 75.61 / Max: 85Min: 55 / Avg: 64.07 / Max: 72Min: 43 / Avg: 49.56 / Max: 55Min: 51 / Avg: 64.33 / Max: 76Min: 56 / Avg: 66.24 / Max: 77Min: 57 / Avg: 64.7 / Max: 74Min: 53 / Avg: 57.76 / Max: 65Min: 54 / Avg: 59.11 / Max: 66

NVIDIA GPU Cloud TensorFlow

System Power Consumption Monitor

OpenBenchmarking.orgWatts, Fewer Is BetterNVIDIA GPU Cloud TensorFlow 18.09System Power Consumption MonitorGTX 980 TiGTX TITAN X GM200GTX 1070GTX 1070 TiGTX 1080GTX 1080 TiRTX 2080RTX 2080 TiTITAN RTX60120180240300Min: 52.9 / Avg: 226.01 / Max: 305.4Min: 55.1 / Avg: 232.58 / Max: 323Min: 44.1 / Avg: 157.87 / Max: 210.2Min: 47.2 / Avg: 146.22 / Max: 188.6Min: 71.3 / Avg: 185.89 / Max: 249.7Min: 52.2 / Avg: 211.84 / Max: 320.9Min: 47.6 / Avg: 177.11 / Max: 285.3Min: 50 / Avg: 183.11 / Max: 341.1Min: 58.3 / Avg: 196.21 / Max: 353.3

NVIDIA GPU Cloud TensorFlow

Test: VGG-16, FP16

OpenBenchmarking.orgImages Per Second, More Is BetterNVIDIA GPU Cloud TensorFlow 18.09Test: VGG-16, FP16GTX 980 TiGTX TITAN X GM200GTX 1070GTX 1070 TiGTX 1080GTX 1080 TiRTX 2080RTX 2080 TiTITAN RTX50100150200250SE +/- 0.92, N = 3SE +/- 0.40, N = 3SE +/- 0.07, N = 3SE +/- 0.03, N = 3SE +/- 0.24, N = 3SE +/- 0.12, N = 3SE +/- 0.09, N = 3SE +/- 0.07, N = 3SE +/- 0.46, N = 377.5779.2076.9384.4393.13131.37153.33206.97244.40

NVIDIA GPU Cloud TensorFlow

Test: VGG-16, FP16

OpenBenchmarking.orgImages Per Second Per Watt, More Is BetterNVIDIA GPU Cloud TensorFlow 18.09Test: VGG-16, FP16GTX 980 TiGTX TITAN X GM200GTX 1070GTX 1070 TiGTX 1080GTX 1080 TiRTX 2080RTX 2080 TiTITAN RTX0.21380.42760.64140.85521.0690.300.290.460.530.480.540.690.940.95

NVIDIA GPU Cloud TensorFlow

GPU Temperature Monitor

OpenBenchmarking.orgCelsius, Fewer Is BetterNVIDIA GPU Cloud TensorFlow 18.09GPU Temperature MonitorGTX 980 TiGTX TITAN X GM200GTX 1070GTX 1070 TiGTX 1080GTX 1080 TiRTX 2080RTX 2080 TiTITAN RTX1632486480Min: 67 / Avg: 79.22 / Max: 84Min: 67 / Avg: 79 / Max: 84Min: 59 / Avg: 66.13 / Max: 70Min: 45 / Avg: 52.18 / Max: 55Min: 50 / Avg: 65.84 / Max: 74Min: 61 / Avg: 70.1 / Max: 76Min: 59 / Avg: 69.86 / Max: 77Min: 54 / Avg: 61.56 / Max: 68Min: 55 / Avg: 62.56 / Max: 68

NVIDIA GPU Cloud TensorFlow

System Power Consumption Monitor

OpenBenchmarking.orgWatts, Fewer Is BetterNVIDIA GPU Cloud TensorFlow 18.09System Power Consumption MonitorGTX 980 TiGTX TITAN X GM200GTX 1070GTX 1070 TiGTX 1080GTX 1080 TiRTX 2080RTX 2080 TiTITAN RTX60120180240300Min: 52.4 / Avg: 254.36 / Max: 318.4Min: 81.5 / Avg: 277.12 / Max: 327.7Min: 43.7 / Avg: 168.53 / Max: 201.8Min: 46.8 / Avg: 160.44 / Max: 192Min: 90.8 / Avg: 194.86 / Max: 239.8Min: 51.7 / Avg: 242.51 / Max: 313.1Min: 48.1 / Avg: 223.76 / Max: 283.3Min: 51 / Avg: 219.66 / Max: 332.2Min: 49.3 / Avg: 256.56 / Max: 354.6

NVIDIA GPU Cloud TensorFlow

Test: VGG-16, FP32

OpenBenchmarking.orgImages Per Second, More Is BetterNVIDIA GPU Cloud TensorFlow 18.09Test: VGG-16, FP32GTX TITAN X GM200GTX 1070GTX 1070 TiGTX 1080GTX 1080 TiRTX 2080RTX 2080 TiTITAN RTX4080120160200SE +/- 0.64, N = 3SE +/- 0.13, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.12, N = 3SE +/- 0.07, N = 3SE +/- 0.12, N = 3SE +/- 0.19, N = 372.7771.5776.4082.90119.50108.57152.40162.33

NVIDIA GPU Cloud TensorFlow

Test: VGG-16, FP32

OpenBenchmarking.orgImages Per Second Per Watt, More Is BetterNVIDIA GPU Cloud TensorFlow 18.09Test: VGG-16, FP32GTX TITAN X GM200GTX 1070GTX 1070 TiGTX 1080GTX 1080 TiRTX 2080RTX 2080 TiTITAN RTX0.13050.2610.39150.5220.65250.280.420.470.420.490.450.560.58

NVIDIA GPU Cloud TensorFlow

GPU Temperature Monitor

OpenBenchmarking.orgCelsius, Fewer Is BetterNVIDIA GPU Cloud TensorFlow 18.09GPU Temperature MonitorGTX TITAN X GM200GTX 1070GTX 1070 TiGTX 1080GTX 1080 TiRTX 2080RTX 2080 TiTITAN RTX1632486480Min: 67 / Avg: 79.62 / Max: 84Min: 58 / Avg: 66.1 / Max: 70Min: 46 / Avg: 52.21 / Max: 55Min: 60 / Avg: 69.33 / Max: 74Min: 61 / Avg: 70.55 / Max: 77Min: 61 / Avg: 74.1 / Max: 80Min: 56 / Avg: 65.52 / Max: 71Min: 56 / Avg: 67.15 / Max: 73

NVIDIA GPU Cloud TensorFlow

System Power Consumption Monitor

OpenBenchmarking.orgWatts, Fewer Is BetterNVIDIA GPU Cloud TensorFlow 18.09System Power Consumption MonitorGTX TITAN X GM200GTX 1070GTX 1070 TiGTX 1080GTX 1080 TiRTX 2080RTX 2080 TiTITAN RTX60120180240300Min: 53 / Avg: 261.76 / Max: 321.8Min: 54.1 / Avg: 170.77 / Max: 203.5Min: 58.5 / Avg: 162.02 / Max: 191Min: 46.3 / Avg: 198.19 / Max: 236.2Min: 51.2 / Avg: 241.65 / Max: 309.7Min: 55.7 / Avg: 239.26 / Max: 287.8Min: 50.2 / Avg: 270.5 / Max: 342.3Min: 60 / Avg: 281.79 / Max: 357.7

Phoronix Test Suite v10.8.4