NVIDIA TITAN RTX Linux GPU Compute Benchmarks

NVIDIA and AMD GPU Linux compute benchmarks December 2018 by Michael Larabel for a future article, review of the NVIDIA TITAN RTX.

HTML result view exported from: https://openbenchmarking.org/result/1812224-SP-GPUCOMPUT75&rdt.

NVIDIA TITAN RTX Linux GPU Compute BenchmarksProcessorMotherboardChipsetMemoryDiskGraphicsAudioMonitorNetworkOSKernelDesktopDisplay ServerOpenGLOpenCLVulkanCompilerFile-SystemScreen ResolutionDisplay DriverRX Vega 56RX Vega 64GTX 1080RTX 2080 TiRTX 2080RTX 2070GTX 1080 TiGTX 1070 TiGTX 1070TITAN RTXGTX TITAN X GM200GTX 980 TiGTX 980Intel Core i9-9900K @ 5.00GHz (8 Cores / 16 Threads)ASUS PRIME Z390-A (0602 BIOS)Intel Cannon Lake PCH Shared SRAM16384MB2000GB SABRENT + Samsung SSD 970 EVO 250GBAMD Radeon RX Vega 8GB (1590/800MHz)Realtek ALC1220Acer B286HKIntel ConnectionUbuntu 18.044.19.5-041905-generic (x86_64)GNOME Shell 3.28.3X Server 1.19.64.5 Mesa 19.0.0-devel padoka PPA (LLVM 8.0.0)OpenCL 2.1 AMD-APP (2679.0)1.1.70GCC 7.3.0ext43840x2160AMD Radeon RX Vega 8GB (1630/945MHz)NVIDIA GeForce GTX 1080 8GB (1607/5005MHz)NVIDIA 415.224.6.0OpenCL 1.2 CUDA 10.0.1321.1.84GCC 7.3.0 + CUDA 10.0NVIDIA GeForce RTX 2080 Ti 11GB (1350/7000MHz)Zotac NVIDIA GeForce RTX 2080 8GB (1515/7000MHz)eVGA NVIDIA GeForce RTX 2070 8GB (1410/7000MHz)NVIDIA GeForce GTX 1080 Ti 11GB (1480/5508MHz)Zotac NVIDIA GeForce GTX 1070 Ti 8GB (1607/4006MHz)NVIDIA GeForce GTX 1070 8GB (1506/4006MHz)NVIDIA TITAN RTX 24GB (1350/7000MHz)NVIDIA 415.23NVIDIA GeForce GTX TITAN X 12GB (1001/3505MHz)NVIDIA GeForce GTX 980 Ti 6GB (999/3505MHz)NVIDIA GeForce GTX 980 4GB (1126/3505MHz)OpenBenchmarking.orgCompiler Details- --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++ --enable-libmpx --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib --with-tune=generic --without-cuda-driver -v Processor Details- Scaling Governor: intel_pstate performanceSecurity Details- __user pointer sanitization + Full generic retpoline IBPB IBRS_FW + SSB disabled via prctl and seccompOpenCL Details- GTX 1080: GPU Compute Cores: 2560- RTX 2080 Ti: GPU Compute Cores: 4352- RTX 2080: GPU Compute Cores: 2944- RTX 2070: GPU Compute Cores: 2304- GTX 1080 Ti: GPU Compute Cores: 3584- GTX 1070 Ti: GPU Compute Cores: 2432- GTX 1070: GPU Compute Cores: 1920- TITAN RTX: GPU Compute Cores: 4608- GTX TITAN X GM200: GPU Compute Cores: 3072- GTX 980 Ti: GPU Compute Cores: 2816- GTX 980: GPU Compute Cores: 2048

NVIDIA TITAN RTX Linux GPU Compute Benchmarksshoc: OpenCL - FFT SPcl-mem: Copyluxmark: GPU - Luxball HDRv-ray: CUDA GPUngc-tensorflow: ResNet-50, FP16ngc-tensorflow: ResNet-50, FP32ngc-tensorflow: AlexNet, FP16ngc-tensorflow: AlexNet, FP32ngc-tensorflow: Googlenet, FP16ngc-tensorflow: Inception v4, FP16ngc-tensorflow: VGG-16, FP16ngc-tensorflow: VGG-16, FP32RX Vega 56RX Vega 64GTX 1080RTX 2080 TiRTX 2080RTX 2070GTX 1080 TiGTX 1070 TiGTX 1070TITAN RTXGTX TITAN X GM200GTX 980 TiGTX 9809262033117910702213281557520913823102.071931431875176445855.0393.1382.9014434544269356.09449285443233441015135.90206.97152.4010833282964172.0733520531532419738102.77153.33108.579983303009166.0230921749723172156266.412712102674253962974.63131.37119.504971881688686.301751331683159141349.2384.4376.404521871728890.431601251563151637544.7776.9371.5715484844593250.08520299503235761132152.80244.40162.337262181729980.621561251662158737243.2379.2072.777282171691077.701501552150135640.9077.5746814313242106.5112081154OpenBenchmarking.org

SHOC Scalable HeterOgeneous Computing

Target: OpenCL - Benchmark: FFT SP

OpenBenchmarking.orgGFLOPS, More Is BetterSHOC Scalable HeterOgeneous Computing 2015-11-10Target: OpenCL - Benchmark: FFT SPRX Vega 56RX Vega 64GTX 1080RTX 2080 TiRTX 2080RTX 2070GTX 1080 TiGTX 1070 TiGTX 1070TITAN RTXGTX TITAN X GM200GTX 980 TiGTX 98030060090012001500SE +/- 1.57, N = 3SE +/- 0.64, N = 3SE +/- 2.68, N = 3SE +/- 14.24, N = 3SE +/- 5.95, N = 3SE +/- 40.79, N = 3SE +/- 1.23, N = 3SE +/- 0.73, N = 3SE +/- 0.94, N = 3SE +/- 11.44, N = 3SE +/- 0.60, N = 3SE +/- 0.20, N = 3SE +/- 0.27, N = 39261070575144310839989724974521548726728468-lSHOCCommonOpenCL -lOpenCL-lSHOCCommonOpenCL -lOpenCL-std=c++14 -lcudadevrt -lcudart_static -lpthread -ldl -lcufft-std=c++14 -lcudadevrt -lcudart_static -lpthread -ldl -lcufft-std=c++14 -lcudadevrt -lcudart_static -lpthread -ldl -lcufft-std=c++14 -lcudadevrt -lcudart_static -lpthread -ldl -lcufft-std=c++14 -lcudadevrt -lcudart_static -lpthread -ldl -lcufft-std=c++14 -lcudadevrt -lcudart_static -lpthread -ldl -lcufft-std=c++14 -lcudadevrt -lcudart_static -lpthread -ldl -lcufft-std=c++14 -lcudadevrt -lcudart_static -lpthread -ldl -lcufft-std=c++14 -lcudadevrt -lcudart_static -lpthread -ldl -lcufft-std=c++14 -lcudadevrt -lcudart_static -lpthread -ldl -lcufft-std=c++14 -lcudadevrt -lcudart_static -lpthread -ldl -lcufft1. (CXX) g++ options: -O2 -lSHOCCommon -lrt

cl-mem

Benchmark: Copy

OpenBenchmarking.orgGB/s, More Is Bettercl-mem 2017-01-13Benchmark: CopyRX Vega 56RX Vega 64GTX 1080RTX 2080 TiRTX 2080RTX 2070GTX 1080 TiGTX 1070 TiGTX 1070TITAN RTXGTX TITAN X GM200GTX 980 TiGTX 980100200300400500SE +/- 0.21, N = 3SE +/- 0.07, N = 3SE +/- 0.07, N = 3SE +/- 0.39, N = 3SE +/- 0.09, N = 3SE +/- 0.12, N = 3SE +/- 0.07, N = 3SE +/- 0.07, N = 3SE +/- 0.07, N = 3SE +/- 0.24, N = 3SE +/- 0.03, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 32032212094543283303171881874842182171431. (CC) gcc options: -O2 -flto -lOpenCL

LuxMark

OpenCL Device: GPU - Scene: Luxball HDR

OpenBenchmarking.orgScore, More Is BetterLuxMark 3.1OpenCL Device: GPU - Scene: Luxball HDRRX Vega 56RX Vega 64GTX 1080RTX 2080 TiRTX 2080RTX 2070GTX 1080 TiGTX 1070 TiGTX 1070TITAN RTXGTX TITAN X GM200GTX 980 TiGTX 98010K20K30K40K50KSE +/- 20.53, N = 3SE +/- 570.76, N = 3SE +/- 29.04, N = 3SE +/- 66.64, N = 3SE +/- 2.73, N = 3SE +/- 119.86, N = 3SE +/- 0.67, N = 3SE +/- 0.58, N = 3SE +/- 41.88, N = 3SE +/- 11.50, N = 3SE +/- 26.00, N = 3SE +/- 33.13, N = 331179328151382342693296413009121562168861728845932172991691013242

SHOC Scalable HeterOgeneous Computing

System Power Consumption Monitor

OpenBenchmarking.orgWatts, Fewer Is BetterSHOC Scalable HeterOgeneous Computing 2015-11-10System Power Consumption MonitorRX Vega 56RX Vega 64GTX 1080RTX 2080 TiRTX 2080RTX 2070GTX 1080 TiGTX 1070 TiGTX 1070TITAN RTX50100150200250Min: 49.4 / Avg: 197.63 / Max: 234.4Min: 51.8 / Avg: 223.18 / Max: 249.9Min: 89.7 / Avg: 144.76 / Max: 164.6Min: 47.5 / Avg: 222.96 / Max: 282.7Min: 47.1 / Avg: 169.8 / Max: 202.9Min: 53.7 / Avg: 162.86 / Max: 198.7Min: 120.8 / Avg: 190.06 / Max: 216.8Min: 47 / Avg: 122.6 / Max: 141.5Min: 82.6 / Avg: 134.72 / Max: 155.3Min: 47.9 / Avg: 232.9 / Max: 281.3

LuxMark

System Power Consumption Monitor

OpenBenchmarking.orgWatts, Fewer Is BetterLuxMark 3.1System Power Consumption MonitorRX Vega 56RX Vega 64GTX 1080RTX 2080 TiRTX 2080RTX 2070GTX 1080 TiGTX 1070 TiGTX 1070TITAN RTXGTX TITAN X GM200GTX 980 TiGTX 98060120180240300Min: 51.8 / Avg: 251.16 / Max: 263.3Min: 53 / Avg: 323.35 / Max: 337.9Min: 90.8 / Avg: 174.24 / Max: 176.2Min: 111.1 / Avg: 315.29 / Max: 328.4Min: 101.9 / Avg: 240.83 / Max: 247.3Min: 78 / Avg: 225.33 / Max: 232.6Min: 122.9 / Avg: 241.59 / Max: 247.8Min: 146.8 / Avg: 148.92 / Max: 149.4Min: 83.1 / Avg: 176.9 / Max: 181.3Min: 48.7 / Avg: 329.43 / Max: 344Min: 126.4 / Avg: 249.16 / Max: 256.8Min: 118.7 / Avg: 233.83 / Max: 241.4Min: 80.2 / Avg: 189.6 / Max: 196.9

GPU Temperature Monitor

Phoronix Test Suite System Monitoring

OpenBenchmarking.orgCelsiusGPU Temperature MonitorPhoronix Test Suite System MonitoringRX Vega 56RX Vega 64GTX 1080RTX 2080 TiRTX 2080RTX 2070GTX 1080 TiGTX 1070 TiGTX 1070TITAN RTXGTX TITAN X GM200GTX 980 TiGTX 9801632486480Min: 31 / Avg: 51.02 / Max: 75Min: 28 / Avg: 52.98 / Max: 85Min: 45 / Avg: 63.06 / Max: 79Min: 34 / Avg: 60.3 / Max: 76Min: 35 / Avg: 66.5 / Max: 80Min: 33 / Avg: 54.57 / Max: 64Min: 33 / Avg: 66.46 / Max: 80Min: 36 / Avg: 46.92 / Max: 60Min: 31 / Avg: 61.13 / Max: 75Min: 38 / Avg: 63.55 / Max: 77Min: 35 / Avg: 76.87 / Max: 85Min: 38 / Avg: 74.74 / Max: 84Min: 34 / Avg: 58.36 / Max: 77

System Power Consumption Monitor

Phoronix Test Suite System Monitoring

OpenBenchmarking.orgWattsSystem Power Consumption MonitorPhoronix Test Suite System MonitoringRX Vega 56RX Vega 64GTX 1080RTX 2080 TiRTX 2080RTX 2070GTX 1080 TiGTX 1070 TiGTX 1070TITAN RTXGTX TITAN X GM200GTX 980 TiGTX 98070140210280350Min: 48.8 / Avg: 143.52 / Max: 284.1Min: 48.4 / Avg: 169.45 / Max: 358.6Min: 42.2 / Avg: 154.56 / Max: 251.7Min: 45.5 / Avg: 208.03 / Max: 346.7Min: 43.9 / Avg: 175.16 / Max: 287.8Min: 42.1 / Avg: 146.13 / Max: 247.2Min: 43.4 / Avg: 200.91 / Max: 320.9Min: 45.9 / Avg: 127.84 / Max: 213.8Min: 41.9 / Avg: 143.92 / Max: 213.8Min: 47.9 / Avg: 242.09 / Max: 364.6Min: 48.8 / Avg: 240.32 / Max: 327.7Min: 52.1 / Avg: 218.82 / Max: 321.2Min: 45.1 / Avg: 126.87 / Max: 240.4

Chaos Group V-RAY

Mode: CUDA GPU

OpenBenchmarking.orgSeconds, Fewer Is BetterChaos Group V-RAY 1.1.0Mode: CUDA GPUGTX 1080RTX 2080 TiRTX 2080RTX 2070GTX 1080 TiGTX 1070 TiGTX 1070TITAN RTXGTX TITAN X GM200GTX 980 TiGTX 98020406080100SE +/- 3.08, N = 3SE +/- 3.00, N = 3SE +/- 0.04, N = 3SE +/- 0.03, N = 3SE +/- 0.03, N = 3SE +/- 0.04, N = 3SE +/- 0.03, N = 3SE +/- 0.02, N = 3SE +/- 2.94, N = 3SE +/- 0.14, N = 3SE +/- 0.16, N = 3102.0756.0972.0766.0266.4186.3090.4350.0880.6277.70106.51

Chaos Group V-RAY

GPU Temperature Monitor

OpenBenchmarking.orgCelsius, Fewer Is BetterChaos Group V-RAY 1.1.0GPU Temperature MonitorGTX 1080RTX 2080 TiRTX 2080RTX 2070GTX 1080 TiGTX 1070 TiGTX 1070TITAN RTXGTX TITAN X GM200GTX 980 TiGTX 9801632486480Min: 48 / Avg: 62.93 / Max: 67Min: 46 / Avg: 60.03 / Max: 68Min: 50 / Avg: 68.2 / Max: 74Min: 53 / Avg: 60.72 / Max: 62Min: 54 / Avg: 68.11 / Max: 73Min: 38 / Avg: 47.77 / Max: 50Min: 46 / Avg: 62.55 / Max: 68Min: 56 / Avg: 67.85 / Max: 72Min: 67 / Avg: 78.35 / Max: 82Min: 69 / Avg: 78.07 / Max: 81Min: 64 / Avg: 72.91 / Max: 75

Chaos Group V-RAY

System Power Consumption Monitor

OpenBenchmarking.orgWatts, Fewer Is BetterChaos Group V-RAY 1.1.0System Power Consumption MonitorGTX 1080RTX 2080 TiRTX 2080RTX 2070GTX 1080 TiGTX 1070 TiGTX 1070TITAN RTXGTX TITAN X GM200GTX 980 TiGTX 98050100150200250Min: 43.6 / Avg: 153.26 / Max: 165.9Min: 69.5 / Avg: 242.72 / Max: 272Min: 63 / Avg: 191.71 / Max: 202.8Min: 53.7 / Avg: 185.77 / Max: 199.3Min: 120.4 / Avg: 218.99 / Max: 231.8Min: 46.1 / Avg: 130.78 / Max: 135.6Min: 43.4 / Avg: 151.17 / Max: 164.2Min: 57.5 / Avg: 262.41 / Max: 287.8Min: 55.7 / Avg: 230.04 / Max: 248.4Min: 52.1 / Avg: 218.49 / Max: 231.5Min: 47.6 / Avg: 170.22 / Max: 175.3

NVIDIA GPU Cloud TensorFlow

Test: ResNet-50, FP16

OpenBenchmarking.orgImages Per Second, More Is BetterNVIDIA GPU Cloud TensorFlow 18.09Test: ResNet-50, FP16GTX 1080RTX 2080 TiRTX 2080RTX 2070GTX 1080 TiGTX 1070 TiGTX 1070TITAN RTXGTX TITAN X GM200GTX 980 Ti110220330440550SE +/- 0.10, N = 3SE +/- 0.28, N = 3SE +/- 0.85, N = 3SE +/- 0.15, N = 3SE +/- 0.07, N = 3SE +/- 0.03, N = 3SE +/- 0.06, N = 3SE +/- 4.74, N = 3SE +/- 1.68, N = 3193449335309271175160520156150

NVIDIA GPU Cloud TensorFlow

Test: ResNet-50, FP16

OpenBenchmarking.orgImages Per Second Per Watt, More Is BetterNVIDIA GPU Cloud TensorFlow 18.09Test: ResNet-50, FP16GTX 1080RTX 2080 TiRTX 2080RTX 2070GTX 1080 TiGTX 1070 TiGTX 1070TITAN RTXGTX TITAN X GM200GTX 980 Ti0.57381.14761.72142.29522.8691.022.101.861.901.221.140.922.550.620.61

NVIDIA GPU Cloud TensorFlow

GPU Temperature Monitor

OpenBenchmarking.orgCelsius, Fewer Is BetterNVIDIA GPU Cloud TensorFlow 18.09GPU Temperature MonitorGTX 1080RTX 2080 TiRTX 2080RTX 2070GTX 1080 TiGTX 1070 TiGTX 1070TITAN RTXGTX TITAN X GM200GTX 980 Ti1632486480Min: 61 / Avg: 68.3 / Max: 75Min: 55 / Avg: 59.52 / Max: 65Min: 60 / Avg: 67.05 / Max: 75Min: 32 / Avg: 45.47 / Max: 58Min: 61 / Avg: 68.17 / Max: 75Min: 46 / Avg: 50.94 / Max: 55Min: 58 / Avg: 65.55 / Max: 70Min: 57 / Avg: 61.37 / Max: 67Min: 66 / Avg: 77.41 / Max: 84Min: 65 / Avg: 76.82 / Max: 83

NVIDIA GPU Cloud TensorFlow

System Power Consumption Monitor

OpenBenchmarking.orgWatts, Fewer Is BetterNVIDIA GPU Cloud TensorFlow 18.09System Power Consumption MonitorGTX 1080RTX 2080 TiRTX 2080RTX 2070GTX 1080 TiGTX 1070 TiGTX 1070TITAN RTXGTX TITAN X GM200GTX 980 Ti60120180240300Min: 44.7 / Avg: 189.85 / Max: 248.8Min: 56.1 / Avg: 213.62 / Max: 342.3Min: 47.3 / Avg: 179.59 / Max: 284.7Min: 71.1 / Avg: 162.36 / Max: 246.8Min: 54.6 / Avg: 222.3 / Max: 319.6Min: 47 / Avg: 153.76 / Max: 192.3Min: 42.7 / Avg: 174.04 / Max: 212.6Min: 51 / Avg: 203.63 / Max: 350.6Min: 55.5 / Avg: 252.42 / Max: 326.9Min: 52.8 / Avg: 244.09 / Max: 310.7

NVIDIA GPU Cloud TensorFlow

Test: ResNet-50, FP32

OpenBenchmarking.orgImages Per Second, More Is BetterNVIDIA GPU Cloud TensorFlow 18.09Test: ResNet-50, FP32GTX 1080RTX 2080 TiRTX 2080GTX 1080 TiGTX 1070 TiGTX 1070TITAN RTXGTX TITAN X GM20070140210280350SE +/- 0.07, N = 3SE +/- 0.44, N = 3SE +/- 0.28, N = 3SE +/- 0.19, N = 3SE +/- 0.06, N = 3SE +/- 0.09, N = 3SE +/- 0.31, N = 3SE +/- 0.20, N = 3143285205210133125299125

NVIDIA GPU Cloud TensorFlow

Test: ResNet-50, FP32

OpenBenchmarking.orgImages Per Second Per Watt, More Is BetterNVIDIA GPU Cloud TensorFlow 18.09Test: ResNet-50, FP32GTX 1080RTX 2080 TiRTX 2080GTX 1080 TiGTX 1070 TiGTX 1070TITAN RTXGTX TITAN X GM2000.26550.5310.79651.0621.32750.731.150.990.890.840.731.180.49

NVIDIA GPU Cloud TensorFlow

GPU Temperature Monitor

OpenBenchmarking.orgCelsius, Fewer Is BetterNVIDIA GPU Cloud TensorFlow 18.09GPU Temperature MonitorGTX 1080RTX 2080 TiRTX 2080GTX 1080 TiGTX 1070 TiGTX 1070TITAN RTXGTX TITAN X GM2001632486480Min: 60 / Avg: 68.77 / Max: 75Min: 54 / Avg: 61.16 / Max: 67Min: 59 / Avg: 70.41 / Max: 77Min: 62 / Avg: 70.04 / Max: 77Min: 44 / Avg: 50.85 / Max: 54Min: 57 / Avg: 65.61 / Max: 71Min: 54 / Avg: 62.76 / Max: 70Min: 65 / Avg: 77.91 / Max: 84

NVIDIA GPU Cloud TensorFlow

System Power Consumption Monitor

OpenBenchmarking.orgWatts, Fewer Is BetterNVIDIA GPU Cloud TensorFlow 18.09System Power Consumption MonitorGTX 1080RTX 2080 TiRTX 2080GTX 1080 TiGTX 1070 TiGTX 1070TITAN RTXGTX TITAN X GM20070140210280350Min: 44.1 / Avg: 196.38 / Max: 249.7Min: 50.5 / Avg: 248.25 / Max: 346.7Min: 48 / Avg: 206.72 / Max: 285Min: 79.7 / Avg: 234.81 / Max: 318.6Min: 48 / Avg: 157.29 / Max: 187.8Min: 45.9 / Avg: 172.02 / Max: 213.8Min: 50.5 / Avg: 252.59 / Max: 364.6Min: 56.2 / Avg: 255.72 / Max: 321

NVIDIA GPU Cloud TensorFlow

Test: AlexNet, FP16

OpenBenchmarking.orgImages Per Second, More Is BetterNVIDIA GPU Cloud TensorFlow 18.09Test: AlexNet, FP16GTX 1080RTX 2080 TiRTX 2080GTX 1080 TiGTX 1070 TiGTX 1070TITAN RTXGTX TITAN X GM200GTX 980 TiGTX 98011002200330044005500SE +/- 2.60, N = 3SE +/- 2.27, N = 3SE +/- 3.35, N = 3SE +/- 1.32, N = 3SE +/- 0.50, N = 3SE +/- 2.26, N = 3SE +/- 4.39, N = 3SE +/- 2.24, N = 3SE +/- 6.83, N = 3SE +/- 2.04, N = 31875443231532674168315635032166215521208

NVIDIA GPU Cloud TensorFlow

Test: AlexNet, FP16

OpenBenchmarking.orgImages Per Second Per Watt, More Is BetterNVIDIA GPU Cloud TensorFlow 18.09Test: AlexNet, FP16GTX 1080RTX 2080 TiRTX 2080GTX 1080 TiGTX 1070 TiGTX 1070TITAN RTXGTX TITAN X GM200GTX 980 TiGTX 98061218243011.1924.9516.5312.5312.399.8625.777.036.546.45

NVIDIA GPU Cloud TensorFlow

GPU Temperature Monitor

OpenBenchmarking.orgCelsius, Fewer Is BetterNVIDIA GPU Cloud TensorFlow 18.09GPU Temperature MonitorGTX 1080RTX 2080 TiRTX 2080GTX 1080 TiGTX 1070 TiGTX 1070TITAN RTXGTX TITAN X GM200GTX 980 TiGTX 9801632486480Min: 62 / Avg: 66.46 / Max: 70Min: 57 / Avg: 60.36 / Max: 64Min: 63 / Avg: 67.57 / Max: 72Min: 63 / Avg: 67.2 / Max: 70Min: 46 / Avg: 49.93 / Max: 53Min: 59 / Avg: 64.06 / Max: 67Min: 58 / Avg: 61.4 / Max: 65Min: 68 / Avg: 77.07 / Max: 85Min: 62 / Avg: 73.47 / Max: 81Min: 51 / Avg: 65.82 / Max: 74

NVIDIA GPU Cloud TensorFlow

System Power Consumption Monitor

OpenBenchmarking.orgWatts, Fewer Is BetterNVIDIA GPU Cloud TensorFlow 18.09System Power Consumption MonitorGTX 1080RTX 2080 TiRTX 2080GTX 1080 TiGTX 1070 TiGTX 1070TITAN RTXGTX TITAN X GM200GTX 980 TiGTX 98060120180240300Min: 44.1 / Avg: 167.55 / Max: 234.8Min: 49.3 / Avg: 177.62 / Max: 332.6Min: 47.3 / Avg: 190.7 / Max: 270.1Min: 51.3 / Avg: 213.37 / Max: 303.2Min: 46.9 / Avg: 135.79 / Max: 175Min: 68.9 / Avg: 158.49 / Max: 192.3Min: 50.6 / Avg: 195.26 / Max: 352.6Min: 55.1 / Avg: 236.59 / Max: 321.2Min: 135.2 / Avg: 237.19 / Max: 295.5Min: 48.6 / Avg: 187.19 / Max: 240.4

NVIDIA GPU Cloud TensorFlow

Test: AlexNet, FP32

OpenBenchmarking.orgImages Per Second, More Is BetterNVIDIA GPU Cloud TensorFlow 18.09Test: AlexNet, FP32GTX 1080RTX 2080 TiRTX 2080RTX 2070GTX 1080 TiGTX 1070 TiGTX 1070TITAN RTXGTX TITAN X GM200GTX 980 TiGTX 9808001600240032004000SE +/- 1.62, N = 3SE +/- 6.99, N = 3SE +/- 1.84, N = 3SE +/- 1.83, N = 3SE +/- 0.32, N = 3SE +/- 0.44, N = 3SE +/- 1.48, N = 3SE +/- 0.78, N = 3SE +/- 4.76, N = 3SE +/- 1.06, N = 317643344241921742539159115163576158715011154

NVIDIA GPU Cloud TensorFlow

Test: AlexNet, FP32

OpenBenchmarking.orgImages Per Second Per Watt, More Is BetterNVIDIA GPU Cloud TensorFlow 18.09Test: AlexNet, FP32GTX 1080RTX 2080 TiRTX 2080RTX 2070GTX 1080 TiGTX 1070 TiGTX 1070TITAN RTXGTX TITAN X GM200GTX 980 TiGTX 980481216209.9012.9911.4411.7212.1910.999.6114.666.296.596.20

NVIDIA GPU Cloud TensorFlow

GPU Temperature Monitor

OpenBenchmarking.orgCelsius, Fewer Is BetterNVIDIA GPU Cloud TensorFlow 18.09GPU Temperature MonitorGTX 1080RTX 2080 TiRTX 2080RTX 2070GTX 1080 TiGTX 1070 TiGTX 1070TITAN RTXGTX TITAN X GM200GTX 980 TiGTX 9801632486480Min: 63 / Avg: 66.8 / Max: 71Min: 53 / Avg: 61.36 / Max: 67Min: 59 / Avg: 69.81 / Max: 76Min: 46 / Avg: 55.88 / Max: 61Min: 64 / Avg: 67.58 / Max: 71Min: 44 / Avg: 49.07 / Max: 52Min: 61 / Avg: 64.2 / Max: 68Min: 55 / Avg: 61.71 / Max: 67Min: 72 / Avg: 78.81 / Max: 84Min: 71 / Avg: 77.5 / Max: 82Min: 63 / Avg: 72.44 / Max: 77

NVIDIA GPU Cloud TensorFlow

System Power Consumption Monitor

OpenBenchmarking.orgWatts, Fewer Is BetterNVIDIA GPU Cloud TensorFlow 18.09System Power Consumption MonitorGTX 1080RTX 2080 TiRTX 2080RTX 2070GTX 1080 TiGTX 1070 TiGTX 1070TITAN RTXGTX TITAN X GM200GTX 980 TiGTX 98060120180240300Min: 100.9 / Avg: 178.22 / Max: 229Min: 48.9 / Avg: 257.45 / Max: 338.7Min: 48 / Avg: 211.46 / Max: 284.1Min: 64.2 / Avg: 185.45 / Max: 243.7Min: 126 / Avg: 208.21 / Max: 307.4Min: 48.2 / Avg: 144.76 / Max: 185.9Min: 87.1 / Avg: 157.65 / Max: 201.5Min: 78.6 / Avg: 243.91 / Max: 357Min: 136.3 / Avg: 252.18 / Max: 313.2Min: 122.8 / Avg: 227.61 / Max: 318.8Min: 101.5 / Avg: 186.05 / Max: 232.5

NVIDIA GPU Cloud TensorFlow

Test: Googlenet, FP16

OpenBenchmarking.orgImages Per Second, More Is BetterNVIDIA GPU Cloud TensorFlow 18.09Test: Googlenet, FP16GTX 1080RTX 2080 TiRTX 2080GTX 1080 TiGTX 1070 TiGTX 1070TITAN RTXGTX TITAN X GM200GTX 980 Ti2004006008001000SE +/- 0.21, N = 3SE +/- 0.49, N = 3SE +/- 0.58, N = 3SE +/- 2.49, N = 3SE +/- 0.09, N = 3SE +/- 0.35, N = 3SE +/- 0.35, N = 3SE +/- 1.00, N = 3SE +/- 1.37, N = 345810157386294133751132372356

NVIDIA GPU Cloud TensorFlow

Test: Googlenet, FP16

OpenBenchmarking.orgImages Per Second Per Watt, More Is BetterNVIDIA GPU Cloud TensorFlow 18.09Test: Googlenet, FP16GTX 1080RTX 2080 TiRTX 2080GTX 1080 TiGTX 1070 TiGTX 1070TITAN RTXGTX TITAN X GM200GTX 980 Ti0.92481.84962.77443.69924.6242.134.073.212.452.532.064.111.401.36

NVIDIA GPU Cloud TensorFlow

GPU Temperature Monitor

OpenBenchmarking.orgCelsius, Fewer Is BetterNVIDIA GPU Cloud TensorFlow 18.09GPU Temperature MonitorGTX 1080RTX 2080 TiRTX 2080GTX 1080 TiGTX 1070 TiGTX 1070TITAN RTXGTX TITAN X GM200GTX 980 Ti1632486480Min: 58 / Avg: 72.23 / Max: 79Min: 55 / Avg: 64.78 / Max: 71Min: 60 / Avg: 73.17 / Max: 80Min: 60 / Avg: 72.84 / Max: 80Min: 43 / Avg: 52.93 / Max: 56Min: 56 / Avg: 69 / Max: 74Min: 55 / Avg: 65.27 / Max: 72Min: 72 / Avg: 80.77 / Max: 85Min: 70 / Avg: 80.35 / Max: 84

NVIDIA GPU Cloud TensorFlow

System Power Consumption Monitor

OpenBenchmarking.orgWatts, Fewer Is BetterNVIDIA GPU Cloud TensorFlow 18.09System Power Consumption MonitorGTX 1080RTX 2080 TiRTX 2080GTX 1080 TiGTX 1070 TiGTX 1070TITAN RTXGTX TITAN X GM200GTX 980 Ti60120180240300Min: 76.2 / Avg: 215.22 / Max: 247Min: 49.5 / Avg: 249.29 / Max: 343.1Min: 47.7 / Avg: 229.8 / Max: 284.5Min: 64 / Avg: 257.4 / Max: 319.4Min: 46.8 / Avg: 163.6 / Max: 187.8Min: 43.4 / Avg: 181.99 / Max: 210.5Min: 50.7 / Avg: 275.3 / Max: 360Min: 102.1 / Avg: 265.29 / Max: 320.1Min: 124.1 / Avg: 260.98 / Max: 317

NVIDIA GPU Cloud TensorFlow

Test: Inception v4, FP16

OpenBenchmarking.orgImages Per Second, More Is BetterNVIDIA GPU Cloud TensorFlow 18.09Test: Inception v4, FP16GTX 1080RTX 2080 TiRTX 2080GTX 1080 TiGTX 1070 TiGTX 1070TITAN RTXGTX TITAN X GM200GTX 980 Ti306090120150SE +/- 0.03, N = 3SE +/- 0.10, N = 3SE +/- 0.07, N = 3SE +/- 0.07, N = 3SE +/- 0.03, N = 3SE +/- 0.03, N = 3SE +/- 0.21, N = 3SE +/- 0.12, N = 3SE +/- 0.12, N = 355.03135.90102.7774.6349.2344.77152.8043.2340.90

NVIDIA GPU Cloud TensorFlow

Test: Inception v4, FP16

OpenBenchmarking.orgImages Per Second Per Watt, More Is BetterNVIDIA GPU Cloud TensorFlow 18.09Test: Inception v4, FP16GTX 1080RTX 2080 TiRTX 2080GTX 1080 TiGTX 1070 TiGTX 1070TITAN RTXGTX TITAN X GM200GTX 980 Ti0.17550.3510.52650.7020.87750.300.740.580.350.340.280.780.190.18

NVIDIA GPU Cloud TensorFlow

GPU Temperature Monitor

OpenBenchmarking.orgCelsius, Fewer Is BetterNVIDIA GPU Cloud TensorFlow 18.09GPU Temperature MonitorGTX 1080RTX 2080 TiRTX 2080GTX 1080 TiGTX 1070 TiGTX 1070TITAN RTXGTX TITAN X GM200GTX 980 Ti1632486480Min: 51 / Avg: 64.33 / Max: 76Min: 53 / Avg: 57.76 / Max: 65Min: 57 / Avg: 64.7 / Max: 74Min: 56 / Avg: 66.24 / Max: 77Min: 43 / Avg: 49.56 / Max: 55Min: 55 / Avg: 64.07 / Max: 72Min: 54 / Avg: 59.11 / Max: 66Min: 62 / Avg: 75.61 / Max: 85Min: 61 / Avg: 74.85 / Max: 84

NVIDIA GPU Cloud TensorFlow

System Power Consumption Monitor

OpenBenchmarking.orgWatts, Fewer Is BetterNVIDIA GPU Cloud TensorFlow 18.09System Power Consumption MonitorGTX 1080RTX 2080 TiRTX 2080GTX 1080 TiGTX 1070 TiGTX 1070TITAN RTXGTX TITAN X GM200GTX 980 Ti60120180240300Min: 71.3 / Avg: 185.89 / Max: 249.7Min: 50 / Avg: 183.11 / Max: 341.1Min: 47.6 / Avg: 177.11 / Max: 285.3Min: 52.2 / Avg: 211.84 / Max: 320.9Min: 47.2 / Avg: 146.22 / Max: 188.6Min: 44.1 / Avg: 157.87 / Max: 210.2Min: 58.3 / Avg: 196.21 / Max: 353.3Min: 55.1 / Avg: 232.58 / Max: 323Min: 52.9 / Avg: 226.01 / Max: 305.4

NVIDIA GPU Cloud TensorFlow

Test: VGG-16, FP16

OpenBenchmarking.orgImages Per Second, More Is BetterNVIDIA GPU Cloud TensorFlow 18.09Test: VGG-16, FP16GTX 1080RTX 2080 TiRTX 2080GTX 1080 TiGTX 1070 TiGTX 1070TITAN RTXGTX TITAN X GM200GTX 980 Ti50100150200250SE +/- 0.24, N = 3SE +/- 0.07, N = 3SE +/- 0.09, N = 3SE +/- 0.12, N = 3SE +/- 0.03, N = 3SE +/- 0.07, N = 3SE +/- 0.46, N = 3SE +/- 0.40, N = 3SE +/- 0.92, N = 393.13206.97153.33131.3784.4376.93244.4079.2077.57

NVIDIA GPU Cloud TensorFlow

Test: VGG-16, FP16

OpenBenchmarking.orgImages Per Second Per Watt, More Is BetterNVIDIA GPU Cloud TensorFlow 18.09Test: VGG-16, FP16GTX 1080RTX 2080 TiRTX 2080GTX 1080 TiGTX 1070 TiGTX 1070TITAN RTXGTX TITAN X GM200GTX 980 Ti0.21380.42760.64140.85521.0690.480.940.690.540.530.460.950.290.30

NVIDIA GPU Cloud TensorFlow

GPU Temperature Monitor

OpenBenchmarking.orgCelsius, Fewer Is BetterNVIDIA GPU Cloud TensorFlow 18.09GPU Temperature MonitorGTX 1080RTX 2080 TiRTX 2080GTX 1080 TiGTX 1070 TiGTX 1070TITAN RTXGTX TITAN X GM200GTX 980 Ti1632486480Min: 50 / Avg: 65.84 / Max: 74Min: 54 / Avg: 61.56 / Max: 68Min: 59 / Avg: 69.86 / Max: 77Min: 61 / Avg: 70.1 / Max: 76Min: 45 / Avg: 52.18 / Max: 55Min: 59 / Avg: 66.13 / Max: 70Min: 55 / Avg: 62.56 / Max: 68Min: 67 / Avg: 79 / Max: 84Min: 67 / Avg: 79.22 / Max: 84

NVIDIA GPU Cloud TensorFlow

System Power Consumption Monitor

OpenBenchmarking.orgWatts, Fewer Is BetterNVIDIA GPU Cloud TensorFlow 18.09System Power Consumption MonitorGTX 1080RTX 2080 TiRTX 2080GTX 1080 TiGTX 1070 TiGTX 1070TITAN RTXGTX TITAN X GM200GTX 980 Ti60120180240300Min: 90.8 / Avg: 194.86 / Max: 239.8Min: 51 / Avg: 219.66 / Max: 332.2Min: 48.1 / Avg: 223.76 / Max: 283.3Min: 51.7 / Avg: 242.51 / Max: 313.1Min: 46.8 / Avg: 160.44 / Max: 192Min: 43.7 / Avg: 168.53 / Max: 201.8Min: 49.3 / Avg: 256.56 / Max: 354.6Min: 81.5 / Avg: 277.12 / Max: 327.7Min: 52.4 / Avg: 254.36 / Max: 318.4

NVIDIA GPU Cloud TensorFlow

Test: VGG-16, FP32

OpenBenchmarking.orgImages Per Second, More Is BetterNVIDIA GPU Cloud TensorFlow 18.09Test: VGG-16, FP32GTX 1080RTX 2080 TiRTX 2080GTX 1080 TiGTX 1070 TiGTX 1070TITAN RTXGTX TITAN X GM2004080120160200SE +/- 0.00, N = 3SE +/- 0.12, N = 3SE +/- 0.07, N = 3SE +/- 0.12, N = 3SE +/- 0.00, N = 3SE +/- 0.13, N = 3SE +/- 0.19, N = 3SE +/- 0.64, N = 382.90152.40108.57119.5076.4071.57162.3372.77

NVIDIA GPU Cloud TensorFlow

Test: VGG-16, FP32

OpenBenchmarking.orgImages Per Second Per Watt, More Is BetterNVIDIA GPU Cloud TensorFlow 18.09Test: VGG-16, FP32GTX 1080RTX 2080 TiRTX 2080GTX 1080 TiGTX 1070 TiGTX 1070TITAN RTXGTX TITAN X GM2000.13050.2610.39150.5220.65250.420.560.450.490.470.420.580.28

NVIDIA GPU Cloud TensorFlow

GPU Temperature Monitor

OpenBenchmarking.orgCelsius, Fewer Is BetterNVIDIA GPU Cloud TensorFlow 18.09GPU Temperature MonitorGTX 1080RTX 2080 TiRTX 2080GTX 1080 TiGTX 1070 TiGTX 1070TITAN RTXGTX TITAN X GM2001632486480Min: 60 / Avg: 69.33 / Max: 74Min: 56 / Avg: 65.52 / Max: 71Min: 61 / Avg: 74.1 / Max: 80Min: 61 / Avg: 70.55 / Max: 77Min: 46 / Avg: 52.21 / Max: 55Min: 58 / Avg: 66.1 / Max: 70Min: 56 / Avg: 67.15 / Max: 73Min: 67 / Avg: 79.62 / Max: 84

NVIDIA GPU Cloud TensorFlow

System Power Consumption Monitor

OpenBenchmarking.orgWatts, Fewer Is BetterNVIDIA GPU Cloud TensorFlow 18.09System Power Consumption MonitorGTX 1080RTX 2080 TiRTX 2080GTX 1080 TiGTX 1070 TiGTX 1070TITAN RTXGTX TITAN X GM20060120180240300Min: 46.3 / Avg: 198.19 / Max: 236.2Min: 50.2 / Avg: 270.5 / Max: 342.3Min: 55.7 / Avg: 239.26 / Max: 287.8Min: 51.2 / Avg: 241.65 / Max: 309.7Min: 58.5 / Avg: 162.02 / Max: 191Min: 54.1 / Avg: 170.77 / Max: 203.5Min: 60 / Avg: 281.79 / Max: 357.7Min: 53 / Avg: 261.76 / Max: 321.8

Phoronix Test Suite v10.8.5