NVIDIA TITAN RTX Linux GPU Compute Benchmarks NVIDIA and AMD GPU Linux compute benchmarks December 2018 by Michael Larabel for a future article, review of the NVIDIA TITAN RTX. GTX 980: Processor: Intel Core i9-9900K @ 5.00GHz (8 Cores / 16 Threads), Motherboard: ASUS PRIME Z390-A (0602 BIOS), Chipset: Intel Cannon Lake PCH Shared SRAM, Memory: 16384MB, Disk: 2000GB SABRENT + Samsung SSD 970 EVO 250GB, Graphics: NVIDIA GeForce GTX 980 4GB (1126/3505MHz), Audio: Realtek ALC1220, Monitor: Acer B286HK, Network: Intel Connection OS: Ubuntu 18.04, Kernel: 4.19.5-041905-generic (x86_64), Desktop: GNOME Shell 3.28.3, Display Server: X Server 1.19.6, Display Driver: NVIDIA 415.23, OpenGL: 4.6.0, OpenCL: OpenCL 1.2 CUDA 10.0.132, Vulkan: 1.1.84, Compiler: GCC 7.3.0 + CUDA 10.0, File-System: ext4, Screen Resolution: 3840x2160 GTX 980 Ti: Processor: Intel Core i9-9900K @ 5.00GHz (8 Cores / 16 Threads), Motherboard: ASUS PRIME Z390-A (0602 BIOS), Chipset: Intel Cannon Lake PCH Shared SRAM, Memory: 16384MB, Disk: 2000GB SABRENT + Samsung SSD 970 EVO 250GB, Graphics: NVIDIA GeForce GTX 980 Ti 6GB (999/3505MHz), Audio: Realtek ALC1220, Monitor: Acer B286HK, Network: Intel Connection OS: Ubuntu 18.04, Kernel: 4.19.5-041905-generic (x86_64), Desktop: GNOME Shell 3.28.3, Display Server: X Server 1.19.6, Display Driver: NVIDIA 415.23, OpenGL: 4.6.0, OpenCL: OpenCL 1.2 CUDA 10.0.132, Vulkan: 1.1.84, Compiler: GCC 7.3.0 + CUDA 10.0, File-System: ext4, Screen Resolution: 3840x2160 GTX TITAN X GM200: Processor: Intel Core i9-9900K @ 5.00GHz (8 Cores / 16 Threads), Motherboard: ASUS PRIME Z390-A (0602 BIOS), Chipset: Intel Cannon Lake PCH Shared SRAM, Memory: 16384MB, Disk: 2000GB SABRENT + Samsung SSD 970 EVO 250GB, Graphics: NVIDIA GeForce GTX TITAN X 12GB (1001/3505MHz), Audio: Realtek ALC1220, Monitor: Acer B286HK, Network: Intel Connection OS: Ubuntu 18.04, Kernel: 4.19.5-041905-generic (x86_64), Desktop: GNOME Shell 3.28.3, Display Server: X Server 1.19.6, Display Driver: NVIDIA 415.23, OpenGL: 4.6.0, OpenCL: OpenCL 1.2 CUDA 10.0.132, Vulkan: 1.1.84, Compiler: GCC 7.3.0 + CUDA 10.0, File-System: ext4, Screen Resolution: 3840x2160 GTX 1070: Processor: Intel Core i9-9900K @ 5.00GHz (8 Cores / 16 Threads), Motherboard: ASUS PRIME Z390-A (0602 BIOS), Chipset: Intel Cannon Lake PCH Shared SRAM, Memory: 16384MB, Disk: 2000GB SABRENT + Samsung SSD 970 EVO 250GB, Graphics: NVIDIA GeForce GTX 1070 8GB (1506/4006MHz), Audio: Realtek ALC1220, Monitor: Acer B286HK, Network: Intel Connection OS: Ubuntu 18.04, Kernel: 4.19.5-041905-generic (x86_64), Desktop: GNOME Shell 3.28.3, Display Server: X Server 1.19.6, Display Driver: NVIDIA 415.22, OpenGL: 4.6.0, OpenCL: OpenCL 1.2 CUDA 10.0.132, Vulkan: 1.1.84, Compiler: GCC 7.3.0 + CUDA 10.0, File-System: ext4, Screen Resolution: 3840x2160 GTX 1070 Ti: Processor: Intel Core i9-9900K @ 5.00GHz (8 Cores / 16 Threads), Motherboard: ASUS PRIME Z390-A (0602 BIOS), Chipset: Intel Cannon Lake PCH Shared SRAM, Memory: 16384MB, Disk: 2000GB SABRENT + Samsung SSD 970 EVO 250GB, Graphics: Zotac NVIDIA GeForce GTX 1070 Ti 8GB (1607/4006MHz), Audio: Realtek ALC1220, Monitor: Acer B286HK, Network: Intel Connection OS: Ubuntu 18.04, Kernel: 4.19.5-041905-generic (x86_64), Desktop: GNOME Shell 3.28.3, Display Server: X Server 1.19.6, Display Driver: NVIDIA 415.22, OpenGL: 4.6.0, OpenCL: OpenCL 1.2 CUDA 10.0.132, Vulkan: 1.1.84, Compiler: GCC 7.3.0 + CUDA 10.0, File-System: ext4, Screen Resolution: 3840x2160 GTX 1080: Processor: Intel Core i9-9900K @ 5.00GHz (8 Cores / 16 Threads), Motherboard: ASUS PRIME Z390-A (0602 BIOS), Chipset: Intel Cannon Lake PCH Shared SRAM, Memory: 16384MB, Disk: 2000GB SABRENT + Samsung SSD 970 EVO 250GB, Graphics: NVIDIA GeForce GTX 1080 8GB (1607/5005MHz), Audio: Realtek ALC1220, Monitor: Acer B286HK, Network: Intel Connection OS: Ubuntu 18.04, Kernel: 4.19.5-041905-generic (x86_64), Desktop: GNOME Shell 3.28.3, Display Server: X Server 1.19.6, Display Driver: NVIDIA 415.22, OpenGL: 4.6.0, OpenCL: OpenCL 1.2 CUDA 10.0.132, Vulkan: 1.1.84, Compiler: GCC 7.3.0 + CUDA 10.0, File-System: ext4, Screen Resolution: 3840x2160 GTX 1080 Ti: Processor: Intel Core i9-9900K @ 5.00GHz (8 Cores / 16 Threads), Motherboard: ASUS PRIME Z390-A (0602 BIOS), Chipset: Intel Cannon Lake PCH Shared SRAM, Memory: 16384MB, Disk: 2000GB SABRENT + Samsung SSD 970 EVO 250GB, Graphics: NVIDIA GeForce GTX 1080 Ti 11GB (1480/5508MHz), Audio: Realtek ALC1220, Monitor: Acer B286HK, Network: Intel Connection OS: Ubuntu 18.04, Kernel: 4.19.5-041905-generic (x86_64), Desktop: GNOME Shell 3.28.3, Display Server: X Server 1.19.6, Display Driver: NVIDIA 415.22, OpenGL: 4.6.0, OpenCL: OpenCL 1.2 CUDA 10.0.132, Vulkan: 1.1.84, Compiler: GCC 7.3.0 + CUDA 10.0, File-System: ext4, Screen Resolution: 3840x2160 RTX 2070: Processor: Intel Core i9-9900K @ 5.00GHz (8 Cores / 16 Threads), Motherboard: ASUS PRIME Z390-A (0602 BIOS), Chipset: Intel Cannon Lake PCH Shared SRAM, Memory: 16384MB, Disk: 2000GB SABRENT + Samsung SSD 970 EVO 250GB, Graphics: eVGA NVIDIA GeForce RTX 2070 8GB (1410/7000MHz), Audio: Realtek ALC1220, Monitor: Acer B286HK, Network: Intel Connection OS: Ubuntu 18.04, Kernel: 4.19.5-041905-generic (x86_64), Desktop: GNOME Shell 3.28.3, Display Server: X Server 1.19.6, Display Driver: NVIDIA 415.22, OpenGL: 4.6.0, OpenCL: OpenCL 1.2 CUDA 10.0.132, Vulkan: 1.1.84, Compiler: GCC 7.3.0 + CUDA 10.0, File-System: ext4, Screen Resolution: 3840x2160 RTX 2080: Processor: Intel Core i9-9900K @ 5.00GHz (8 Cores / 16 Threads), Motherboard: ASUS PRIME Z390-A (0602 BIOS), Chipset: Intel Cannon Lake PCH Shared SRAM, Memory: 16384MB, Disk: 2000GB SABRENT + Samsung SSD 970 EVO 250GB, Graphics: Zotac NVIDIA GeForce RTX 2080 8GB (1515/7000MHz), Audio: Realtek ALC1220, Monitor: Acer B286HK, Network: Intel Connection OS: Ubuntu 18.04, Kernel: 4.19.5-041905-generic (x86_64), Desktop: GNOME Shell 3.28.3, Display Server: X Server 1.19.6, Display Driver: NVIDIA 415.22, OpenGL: 4.6.0, OpenCL: OpenCL 1.2 CUDA 10.0.132, Vulkan: 1.1.84, Compiler: GCC 7.3.0 + CUDA 10.0, File-System: ext4, Screen Resolution: 3840x2160 RTX 2080 Ti: Processor: Intel Core i9-9900K @ 5.00GHz (8 Cores / 16 Threads), Motherboard: ASUS PRIME Z390-A (0602 BIOS), Chipset: Intel Cannon Lake PCH Shared SRAM, Memory: 16384MB, Disk: 2000GB SABRENT + Samsung SSD 970 EVO 250GB, Graphics: NVIDIA GeForce RTX 2080 Ti 11GB (1350/7000MHz), Audio: Realtek ALC1220, Monitor: Acer B286HK, Network: Intel Connection OS: Ubuntu 18.04, Kernel: 4.19.5-041905-generic (x86_64), Desktop: GNOME Shell 3.28.3, Display Server: X Server 1.19.6, Display Driver: NVIDIA 415.22, OpenGL: 4.6.0, OpenCL: OpenCL 1.2 CUDA 10.0.132, Vulkan: 1.1.84, Compiler: GCC 7.3.0 + CUDA 10.0, File-System: ext4, Screen Resolution: 3840x2160 TITAN RTX: Processor: Intel Core i9-9900K @ 5.00GHz (8 Cores / 16 Threads), Motherboard: ASUS PRIME Z390-A (0602 BIOS), Chipset: Intel Cannon Lake PCH Shared SRAM, Memory: 16384MB, Disk: 2000GB SABRENT + Samsung SSD 970 EVO 250GB, Graphics: NVIDIA TITAN RTX 24GB (1350/7000MHz), Audio: Realtek ALC1220, Monitor: Acer B286HK, Network: Intel Connection OS: Ubuntu 18.04, Kernel: 4.19.5-041905-generic (x86_64), Desktop: GNOME Shell 3.28.3, Display Server: X Server 1.19.6, Display Driver: NVIDIA 415.23, OpenGL: 4.6.0, OpenCL: OpenCL 1.2 CUDA 10.0.132, Vulkan: 1.1.84, Compiler: GCC 7.3.0 + CUDA 10.0, File-System: ext4, Screen Resolution: 3840x2160 RX Vega 56: Processor: Intel Core i9-9900K @ 5.00GHz (8 Cores / 16 Threads), Motherboard: ASUS PRIME Z390-A (0602 BIOS), Chipset: Intel Cannon Lake PCH Shared SRAM, Memory: 16384MB, Disk: 2000GB SABRENT + Samsung SSD 970 EVO 250GB, Graphics: AMD Radeon RX Vega 8GB (1590/800MHz), Audio: Realtek ALC1220, Monitor: Acer B286HK, Network: Intel Connection OS: Ubuntu 18.04, Kernel: 4.19.5-041905-generic (x86_64), Desktop: GNOME Shell 3.28.3, Display Server: X Server 1.19.6, OpenGL: 4.5 Mesa 19.0.0-devel padoka PPA (LLVM 8.0.0), OpenCL: OpenCL 2.1 AMD-APP (2679.0), Vulkan: 1.1.70, Compiler: GCC 7.3.0, File-System: ext4, Screen Resolution: 3840x2160 RX Vega 64: Processor: Intel Core i9-9900K @ 5.00GHz (8 Cores / 16 Threads), Motherboard: ASUS PRIME Z390-A (0602 BIOS), Chipset: Intel Cannon Lake PCH Shared SRAM, Memory: 16384MB, Disk: 2000GB SABRENT + Samsung SSD 970 EVO 250GB, Graphics: AMD Radeon RX Vega 8GB (1630/945MHz), Audio: Realtek ALC1220, Monitor: Acer B286HK, Network: Intel Connection OS: Ubuntu 18.04, Kernel: 4.19.5-041905-generic (x86_64), Desktop: GNOME Shell 3.28.3, Display Server: X Server 1.19.6, OpenGL: 4.5 Mesa 19.0.0-devel padoka PPA (LLVM 8.0.0), OpenCL: OpenCL 2.1 AMD-APP (2679.0), Vulkan: 1.1.70, Compiler: GCC 7.3.0, File-System: ext4, Screen Resolution: 3840x2160 SHOC Scalable HeterOgeneous Computing 2015-11-10 Target: OpenCL - Benchmark: FFT SP GFLOPS > Higher Is Better GTX 980 ........... 468 |================ GTX 980 Ti ........ 728 |========================= GTX TITAN X GM200 . 726 |========================= GTX 1070 .......... 452 |=============== GTX 1070 Ti ....... 497 |================= GTX 1080 .......... 575 |==================== GTX 1080 Ti ....... 972 |================================= RTX 2070 .......... 998 |================================== RTX 2080 .......... 1083 |===================================== RTX 2080 Ti ....... 1443 |================================================= TITAN RTX ......... 1548 |===================================================== RX Vega 56 ........ 926 |================================ RX Vega 64 ........ 1070 |===================================== cl-mem 2017-01-13 Benchmark: Copy GB/s > Higher Is Better GTX 980 ........... 143 |================ GTX 980 Ti ........ 217 |======================== GTX TITAN X GM200 . 218 |======================== GTX 1070 .......... 187 |===================== GTX 1070 Ti ....... 188 |===================== GTX 1080 .......... 209 |======================= GTX 1080 Ti ....... 317 |=================================== RTX 2070 .......... 330 |===================================== RTX 2080 .......... 328 |===================================== RTX 2080 Ti ....... 454 |=================================================== TITAN RTX ......... 484 |====================================================== RX Vega 56 ........ 203 |======================= RX Vega 64 ........ 221 |========================= LuxMark 3.1 OpenCL Device: GPU - Scene: Luxball HDR Score > Higher Is Better GTX 980 ........... 13242 |=============== GTX 980 Ti ........ 16910 |=================== GTX TITAN X GM200 . 17299 |==================== GTX 1070 .......... 17288 |==================== GTX 1070 Ti ....... 16886 |=================== GTX 1080 .......... 13823 |================ GTX 1080 Ti ....... 21562 |======================== RTX 2070 .......... 30091 |================================== RTX 2080 .......... 29641 |================================== RTX 2080 Ti ....... 42693 |================================================ TITAN RTX ......... 45932 |==================================================== RX Vega 56 ........ 31179 |=================================== RX Vega 64 ........ 32815 |===================================== SHOC Scalable HeterOgeneous Computing 2015-11-10 System Power Consumption Monitor Watts < Lower Is Better GTX 1070 .... MIN: 83 AVG: 135 MAX: 155 GTX 1070 Ti . MIN: 47 AVG: 123 MAX: 142 GTX 1080 .... MIN: 90 AVG: 145 MAX: 165 GTX 1080 Ti . MIN: 121 AVG: 190 MAX: 217 RTX 2070 .... MIN: 54 AVG: 163 MAX: 199 RTX 2080 .... MIN: 47 AVG: 170 MAX: 203 RTX 2080 Ti . MIN: 48 AVG: 223 MAX: 283 TITAN RTX ... MIN: 48 AVG: 233 MAX: 281 RX Vega 56 .. MIN: 49 AVG: 198 MAX: 234 RX Vega 64 .. MIN: 52 AVG: 223 MAX: 250 LuxMark 3.1 System Power Consumption Monitor Watts < Lower Is Better GTX 980 ........... MIN: 80 AVG: 190 MAX: 197 GTX 980 Ti ........ MIN: 119 AVG: 234 MAX: 241 GTX TITAN X GM200 . MIN: 126 AVG: 249 MAX: 257 GTX 1070 .......... MIN: 83 AVG: 177 MAX: 181 GTX 1070 Ti ....... MIN: 147 AVG: 149 MAX: 149 GTX 1080 .......... MIN: 91 AVG: 174 MAX: 176 GTX 1080 Ti ....... MIN: 123 AVG: 242 MAX: 248 RTX 2070 .......... MIN: 78 AVG: 225 MAX: 233 RTX 2080 .......... MIN: 102 AVG: 241 MAX: 247 RTX 2080 Ti ....... MIN: 111 AVG: 315 MAX: 328 TITAN RTX ......... MIN: 49 AVG: 329 MAX: 344 RX Vega 56 ........ MIN: 52 AVG: 251 MAX: 263 RX Vega 64 ........ MIN: 53 AVG: 323 MAX: 338 GPU Temperature Monitor Phoronix Test Suite System Monitoring Celsius GTX 980 ........... MIN: 34.0 AVG: 58.4 MAX: 77.0 GTX 980 Ti ........ MIN: 38.0 AVG: 74.7 MAX: 84.0 GTX TITAN X GM200 . MIN: 35.0 AVG: 76.9 MAX: 85.0 GTX 1070 .......... MIN: 31.0 AVG: 61.1 MAX: 75.0 GTX 1070 Ti ....... MIN: 36.0 AVG: 46.9 MAX: 60.0 GTX 1080 .......... MIN: 45.0 AVG: 63.1 MAX: 79.0 GTX 1080 Ti ....... MIN: 33.0 AVG: 66.5 MAX: 80.0 RTX 2070 .......... MIN: 33.0 AVG: 54.6 MAX: 64.0 RTX 2080 .......... MIN: 35.0 AVG: 66.5 MAX: 80.0 RTX 2080 Ti ....... MIN: 34.0 AVG: 60.3 MAX: 76.0 TITAN RTX ......... MIN: 38.0 AVG: 63.6 MAX: 77.0 RX Vega 56 ........ MIN: 31.0 AVG: 51.0 MAX: 75.0 RX Vega 64 ........ MIN: 28.0 AVG: 53.0 MAX: 85.0 System Power Consumption Monitor Phoronix Test Suite System Monitoring Watts GTX 980 ........... MIN: 45 AVG: 127 MAX: 240 GTX 980 Ti ........ MIN: 52 AVG: 219 MAX: 321 GTX TITAN X GM200 . MIN: 49 AVG: 240 MAX: 328 GTX 1070 .......... MIN: 42 AVG: 144 MAX: 214 GTX 1070 Ti ....... MIN: 46 AVG: 128 MAX: 214 GTX 1080 .......... MIN: 42 AVG: 155 MAX: 252 GTX 1080 Ti ....... MIN: 43 AVG: 201 MAX: 321 RTX 2070 .......... MIN: 42 AVG: 146 MAX: 247 RTX 2080 .......... MIN: 44 AVG: 175 MAX: 288 RTX 2080 Ti ....... MIN: 46 AVG: 208 MAX: 347 TITAN RTX ......... MIN: 48 AVG: 242 MAX: 365 RX Vega 56 ........ MIN: 49 AVG: 144 MAX: 284 RX Vega 64 ........ MIN: 48 AVG: 169 MAX: 359 Chaos Group V-RAY 1.1.0 Mode: CUDA GPU Seconds < Lower Is Better GTX 980 ........... 106.51 |=================================================== GTX 980 Ti ........ 77.70 |===================================== GTX TITAN X GM200 . 80.62 |======================================= GTX 1070 .......... 90.43 |=========================================== GTX 1070 Ti ....... 86.30 |========================================= GTX 1080 .......... 102.07 |================================================= GTX 1080 Ti ....... 66.41 |================================ RTX 2070 .......... 66.02 |================================ RTX 2080 .......... 72.07 |=================================== RTX 2080 Ti ....... 56.09 |=========================== TITAN RTX ......... 50.08 |======================== Chaos Group V-RAY 1.1.0 GPU Temperature Monitor Celsius < Lower Is Better GTX 980 ........... MIN: 64 AVG: 73 MAX: 75 GTX 980 Ti ........ MIN: 69 AVG: 78 MAX: 81 GTX TITAN X GM200 . MIN: 67 AVG: 78 MAX: 82 GTX 1070 .......... MIN: 46 AVG: 63 MAX: 68 GTX 1070 Ti ....... MIN: 38 AVG: 48 MAX: 50 GTX 1080 .......... MIN: 48 AVG: 63 MAX: 67 GTX 1080 Ti ....... MIN: 54 AVG: 68 MAX: 73 RTX 2070 .......... MIN: 53 AVG: 61 MAX: 62 RTX 2080 .......... MIN: 50 AVG: 68 MAX: 74 RTX 2080 Ti ....... MIN: 46 AVG: 60 MAX: 68 TITAN RTX ......... MIN: 56 AVG: 68 MAX: 72 Chaos Group V-RAY 1.1.0 System Power Consumption Monitor Watts < Lower Is Better GTX 980 ........... MIN: 48 AVG: 170 MAX: 175 GTX 980 Ti ........ MIN: 52 AVG: 218 MAX: 232 GTX TITAN X GM200 . MIN: 56 AVG: 230 MAX: 248 GTX 1070 .......... MIN: 43 AVG: 151 MAX: 164 GTX 1070 Ti ....... MIN: 46 AVG: 131 MAX: 136 GTX 1080 .......... MIN: 44 AVG: 153 MAX: 166 GTX 1080 Ti ....... MIN: 120 AVG: 219 MAX: 232 RTX 2070 .......... MIN: 54 AVG: 186 MAX: 199 RTX 2080 .......... MIN: 63 AVG: 192 MAX: 203 RTX 2080 Ti ....... MIN: 70 AVG: 243 MAX: 272 TITAN RTX ......... MIN: 58 AVG: 262 MAX: 288 NVIDIA GPU Cloud TensorFlow 18.09 Test: ResNet-50, FP16 Images Per Second > Higher Is Better GTX 980 Ti ........ 150 |================ GTX TITAN X GM200 . 156 |================ GTX 1070 .......... 160 |================= GTX 1070 Ti ....... 175 |================== GTX 1080 .......... 193 |==================== GTX 1080 Ti ....... 271 |============================ RTX 2070 .......... 309 |================================ RTX 2080 .......... 335 |=================================== RTX 2080 Ti ....... 449 |=============================================== TITAN RTX ......... 520 |====================================================== NVIDIA GPU Cloud TensorFlow 18.09 Test: ResNet-50, FP16 Images Per Second Per Watt > Higher Is Better GTX 980 Ti ........ 0.61 |============= GTX TITAN X GM200 . 0.62 |============= GTX 1070 .......... 0.92 |=================== GTX 1070 Ti ....... 1.14 |======================== GTX 1080 .......... 1.02 |===================== GTX 1080 Ti ....... 1.22 |========================= RTX 2070 .......... 1.90 |======================================= RTX 2080 .......... 1.86 |======================================= RTX 2080 Ti ....... 2.10 |============================================ TITAN RTX ......... 2.55 |===================================================== NVIDIA GPU Cloud TensorFlow 18.09 GPU Temperature Monitor Celsius < Lower Is Better GTX 980 Ti ........ MIN: 65 AVG: 77 MAX: 83 GTX TITAN X GM200 . MIN: 66 AVG: 77 MAX: 84 GTX 1070 .......... MIN: 58 AVG: 66 MAX: 70 GTX 1070 Ti ....... MIN: 46 AVG: 51 MAX: 55 GTX 1080 .......... MIN: 61 AVG: 68 MAX: 75 GTX 1080 Ti ....... MIN: 61 AVG: 68 MAX: 75 RTX 2070 .......... MIN: 32 AVG: 45 MAX: 58 RTX 2080 .......... MIN: 60 AVG: 67 MAX: 75 RTX 2080 Ti ....... MIN: 55 AVG: 60 MAX: 65 TITAN RTX ......... MIN: 57 AVG: 61 MAX: 67 NVIDIA GPU Cloud TensorFlow 18.09 System Power Consumption Monitor Watts < Lower Is Better GTX 980 Ti ........ MIN: 53 AVG: 244 MAX: 311 GTX TITAN X GM200 . MIN: 56 AVG: 252 MAX: 327 GTX 1070 .......... MIN: 43 AVG: 174 MAX: 213 GTX 1070 Ti ....... MIN: 47 AVG: 154 MAX: 192 GTX 1080 .......... MIN: 45 AVG: 190 MAX: 249 GTX 1080 Ti ....... MIN: 55 AVG: 222 MAX: 320 RTX 2070 .......... MIN: 71 AVG: 162 MAX: 247 RTX 2080 .......... MIN: 47 AVG: 180 MAX: 285 RTX 2080 Ti ....... MIN: 56 AVG: 214 MAX: 342 TITAN RTX ......... MIN: 51 AVG: 204 MAX: 351 NVIDIA GPU Cloud TensorFlow 18.09 Test: ResNet-50, FP32 Images Per Second > Higher Is Better GTX TITAN X GM200 . 125 |======================= GTX 1070 .......... 125 |======================= GTX 1070 Ti ....... 133 |======================== GTX 1080 .......... 143 |========================== GTX 1080 Ti ....... 210 |====================================== RTX 2080 .......... 205 |===================================== RTX 2080 Ti ....... 285 |=================================================== TITAN RTX ......... 299 |====================================================== NVIDIA GPU Cloud TensorFlow 18.09 Test: ResNet-50, FP32 Images Per Second Per Watt > Higher Is Better GTX TITAN X GM200 . 0.49 |====================== GTX 1070 .......... 0.73 |================================= GTX 1070 Ti ....... 0.84 |====================================== GTX 1080 .......... 0.73 |================================= GTX 1080 Ti ....... 0.89 |======================================== RTX 2080 .......... 0.99 |============================================ RTX 2080 Ti ....... 1.15 |==================================================== TITAN RTX ......... 1.18 |===================================================== NVIDIA GPU Cloud TensorFlow 18.09 GPU Temperature Monitor Celsius < Lower Is Better GTX TITAN X GM200 . MIN: 65 AVG: 78 MAX: 84 GTX 1070 .......... MIN: 57 AVG: 66 MAX: 71 GTX 1070 Ti ....... MIN: 44 AVG: 51 MAX: 54 GTX 1080 .......... MIN: 60 AVG: 69 MAX: 75 GTX 1080 Ti ....... MIN: 62 AVG: 70 MAX: 77 RTX 2080 .......... MIN: 59 AVG: 70 MAX: 77 RTX 2080 Ti ....... MIN: 54 AVG: 61 MAX: 67 TITAN RTX ......... MIN: 54 AVG: 63 MAX: 70 NVIDIA GPU Cloud TensorFlow 18.09 System Power Consumption Monitor Watts < Lower Is Better GTX TITAN X GM200 . MIN: 56 AVG: 256 MAX: 321 GTX 1070 .......... MIN: 46 AVG: 172 MAX: 214 GTX 1070 Ti ....... MIN: 48 AVG: 157 MAX: 188 GTX 1080 .......... MIN: 44 AVG: 196 MAX: 250 GTX 1080 Ti ....... MIN: 80 AVG: 235 MAX: 319 RTX 2080 .......... MIN: 48 AVG: 207 MAX: 285 RTX 2080 Ti ....... MIN: 51 AVG: 248 MAX: 347 TITAN RTX ......... MIN: 51 AVG: 253 MAX: 365 NVIDIA GPU Cloud TensorFlow 18.09 Test: AlexNet, FP16 Images Per Second > Higher Is Better GTX 980 ........... 1208 |============= GTX 980 Ti ........ 1552 |================ GTX TITAN X GM200 . 1662 |================== GTX 1070 .......... 1563 |================ GTX 1070 Ti ....... 1683 |================== GTX 1080 .......... 1875 |==================== GTX 1080 Ti ....... 2674 |============================ RTX 2080 .......... 3153 |================================= RTX 2080 Ti ....... 4432 |=============================================== TITAN RTX ......... 5032 |===================================================== NVIDIA GPU Cloud TensorFlow 18.09 Test: AlexNet, FP16 Images Per Second Per Watt > Higher Is Better GTX 980 ........... 6.45 |============= GTX 980 Ti ........ 6.54 |============= GTX TITAN X GM200 . 7.03 |============== GTX 1070 .......... 9.86 |==================== GTX 1070 Ti ....... 12.39 |========================= GTX 1080 .......... 11.19 |======================= GTX 1080 Ti ....... 12.53 |========================= RTX 2080 .......... 16.53 |================================= RTX 2080 Ti ....... 24.95 |================================================== TITAN RTX ......... 25.77 |==================================================== NVIDIA GPU Cloud TensorFlow 18.09 GPU Temperature Monitor Celsius < Lower Is Better GTX 980 ........... MIN: 51 AVG: 66 MAX: 74 GTX 980 Ti ........ MIN: 62 AVG: 73 MAX: 81 GTX TITAN X GM200 . MIN: 68 AVG: 77 MAX: 85 GTX 1070 .......... MIN: 59 AVG: 64 MAX: 67 GTX 1070 Ti ....... MIN: 46 AVG: 50 MAX: 53 GTX 1080 .......... MIN: 62 AVG: 66 MAX: 70 GTX 1080 Ti ....... MIN: 63 AVG: 67 MAX: 70 RTX 2080 .......... MIN: 63 AVG: 68 MAX: 72 RTX 2080 Ti ....... MIN: 57 AVG: 60 MAX: 64 TITAN RTX ......... MIN: 58 AVG: 61 MAX: 65 NVIDIA GPU Cloud TensorFlow 18.09 System Power Consumption Monitor Watts < Lower Is Better GTX 980 ........... MIN: 49 AVG: 187 MAX: 240 GTX 980 Ti ........ MIN: 135 AVG: 237 MAX: 296 GTX TITAN X GM200 . MIN: 55 AVG: 237 MAX: 321 GTX 1070 .......... MIN: 69 AVG: 158 MAX: 192 GTX 1070 Ti ....... MIN: 47 AVG: 136 MAX: 175 GTX 1080 .......... MIN: 44 AVG: 168 MAX: 235 GTX 1080 Ti ....... MIN: 51 AVG: 213 MAX: 303 RTX 2080 .......... MIN: 47 AVG: 191 MAX: 270 RTX 2080 Ti ....... MIN: 49 AVG: 178 MAX: 333 TITAN RTX ......... MIN: 51 AVG: 195 MAX: 353 NVIDIA GPU Cloud TensorFlow 18.09 Test: AlexNet, FP32 Images Per Second > Higher Is Better GTX 980 ........... 1154 |================= GTX 980 Ti ........ 1501 |====================== GTX TITAN X GM200 . 1587 |======================== GTX 1070 .......... 1516 |====================== GTX 1070 Ti ....... 1591 |======================== GTX 1080 .......... 1764 |========================== GTX 1080 Ti ....... 2539 |====================================== RTX 2070 .......... 2174 |================================ RTX 2080 .......... 2419 |==================================== RTX 2080 Ti ....... 3344 |================================================== TITAN RTX ......... 3576 |===================================================== NVIDIA GPU Cloud TensorFlow 18.09 Test: AlexNet, FP32 Images Per Second Per Watt > Higher Is Better GTX 980 ........... 6.20 |====================== GTX 980 Ti ........ 6.59 |======================= GTX TITAN X GM200 . 6.29 |====================== GTX 1070 .......... 9.61 |================================== GTX 1070 Ti ....... 10.99 |======================================= GTX 1080 .......... 9.90 |=================================== GTX 1080 Ti ....... 12.19 |=========================================== RTX 2070 .......... 11.72 |========================================== RTX 2080 .......... 11.44 |========================================= RTX 2080 Ti ....... 12.99 |============================================== TITAN RTX ......... 14.66 |==================================================== NVIDIA GPU Cloud TensorFlow 18.09 GPU Temperature Monitor Celsius < Lower Is Better GTX 980 ........... MIN: 63 AVG: 72 MAX: 77 GTX 980 Ti ........ MIN: 71 AVG: 78 MAX: 82 GTX TITAN X GM200 . MIN: 72 AVG: 79 MAX: 84 GTX 1070 .......... MIN: 61 AVG: 64 MAX: 68 GTX 1070 Ti ....... MIN: 44 AVG: 49 MAX: 52 GTX 1080 .......... MIN: 63 AVG: 67 MAX: 71 GTX 1080 Ti ....... MIN: 64 AVG: 68 MAX: 71 RTX 2070 .......... MIN: 46 AVG: 56 MAX: 61 RTX 2080 .......... MIN: 59 AVG: 70 MAX: 76 RTX 2080 Ti ....... MIN: 53 AVG: 61 MAX: 67 TITAN RTX ......... MIN: 55 AVG: 62 MAX: 67 NVIDIA GPU Cloud TensorFlow 18.09 System Power Consumption Monitor Watts < Lower Is Better GTX 980 ........... MIN: 102 AVG: 186 MAX: 233 GTX 980 Ti ........ MIN: 123 AVG: 228 MAX: 319 GTX TITAN X GM200 . MIN: 136 AVG: 252 MAX: 313 GTX 1070 .......... MIN: 87 AVG: 158 MAX: 202 GTX 1070 Ti ....... MIN: 48 AVG: 145 MAX: 186 GTX 1080 .......... MIN: 101 AVG: 178 MAX: 229 GTX 1080 Ti ....... MIN: 126 AVG: 208 MAX: 307 RTX 2070 .......... MIN: 64 AVG: 185 MAX: 244 RTX 2080 .......... MIN: 48 AVG: 211 MAX: 284 RTX 2080 Ti ....... MIN: 49 AVG: 257 MAX: 339 TITAN RTX ......... MIN: 79 AVG: 244 MAX: 357 NVIDIA GPU Cloud TensorFlow 18.09 Test: Googlenet, FP16 Images Per Second > Higher Is Better GTX 980 Ti ........ 356 |================= GTX TITAN X GM200 . 372 |================= GTX 1070 .......... 375 |================== GTX 1070 Ti ....... 413 |=================== GTX 1080 .......... 458 |===================== GTX 1080 Ti ....... 629 |============================= RTX 2080 .......... 738 |=================================== RTX 2080 Ti ....... 1015 |================================================ TITAN RTX ......... 1132 |===================================================== NVIDIA GPU Cloud TensorFlow 18.09 Test: Googlenet, FP16 Images Per Second Per Watt > Higher Is Better GTX 980 Ti ........ 1.36 |================== GTX TITAN X GM200 . 1.40 |================== GTX 1070 .......... 2.06 |=========================== GTX 1070 Ti ....... 2.53 |================================= GTX 1080 .......... 2.13 |=========================== GTX 1080 Ti ....... 2.45 |================================ RTX 2080 .......... 3.21 |========================================= RTX 2080 Ti ....... 4.07 |==================================================== TITAN RTX ......... 4.11 |===================================================== NVIDIA GPU Cloud TensorFlow 18.09 GPU Temperature Monitor Celsius < Lower Is Better GTX 980 Ti ........ MIN: 70 AVG: 80 MAX: 84 GTX TITAN X GM200 . MIN: 72 AVG: 81 MAX: 85 GTX 1070 .......... MIN: 56 AVG: 69 MAX: 74 GTX 1070 Ti ....... MIN: 43 AVG: 53 MAX: 56 GTX 1080 .......... MIN: 58 AVG: 72 MAX: 79 GTX 1080 Ti ....... MIN: 60 AVG: 73 MAX: 80 RTX 2080 .......... MIN: 60 AVG: 73 MAX: 80 RTX 2080 Ti ....... MIN: 55 AVG: 65 MAX: 71 TITAN RTX ......... MIN: 55 AVG: 65 MAX: 72 NVIDIA GPU Cloud TensorFlow 18.09 System Power Consumption Monitor Watts < Lower Is Better GTX 980 Ti ........ MIN: 124 AVG: 261 MAX: 317 GTX TITAN X GM200 . MIN: 102 AVG: 265 MAX: 320 GTX 1070 .......... MIN: 43 AVG: 182 MAX: 211 GTX 1070 Ti ....... MIN: 47 AVG: 164 MAX: 188 GTX 1080 .......... MIN: 76 AVG: 215 MAX: 247 GTX 1080 Ti ....... MIN: 64 AVG: 257 MAX: 319 RTX 2080 .......... MIN: 48 AVG: 230 MAX: 285 RTX 2080 Ti ....... MIN: 50 AVG: 249 MAX: 343 TITAN RTX ......... MIN: 51 AVG: 275 MAX: 360 NVIDIA GPU Cloud TensorFlow 18.09 Test: Inception v4, FP16 Images Per Second > Higher Is Better GTX 980 Ti ........ 40.90 |============== GTX TITAN X GM200 . 43.23 |============== GTX 1070 .......... 44.77 |=============== GTX 1070 Ti ....... 49.23 |================ GTX 1080 .......... 55.03 |================== GTX 1080 Ti ....... 74.63 |========================= RTX 2080 .......... 102.77 |================================== RTX 2080 Ti ....... 135.90 |============================================= TITAN RTX ......... 152.80 |=================================================== NVIDIA GPU Cloud TensorFlow 18.09 Test: Inception v4, FP16 Images Per Second Per Watt > Higher Is Better GTX 980 Ti ........ 0.18 |============ GTX TITAN X GM200 . 0.19 |============= GTX 1070 .......... 0.28 |=================== GTX 1070 Ti ....... 0.34 |======================= GTX 1080 .......... 0.30 |==================== GTX 1080 Ti ....... 0.35 |======================== RTX 2080 .......... 0.58 |======================================= RTX 2080 Ti ....... 0.74 |================================================== TITAN RTX ......... 0.78 |===================================================== NVIDIA GPU Cloud TensorFlow 18.09 GPU Temperature Monitor Celsius < Lower Is Better GTX 980 Ti ........ MIN: 61 AVG: 75 MAX: 84 GTX TITAN X GM200 . MIN: 62 AVG: 76 MAX: 85 GTX 1070 .......... MIN: 55 AVG: 64 MAX: 72 GTX 1070 Ti ....... MIN: 43 AVG: 50 MAX: 55 GTX 1080 .......... MIN: 51 AVG: 64 MAX: 76 GTX 1080 Ti ....... MIN: 56 AVG: 66 MAX: 77 RTX 2080 .......... MIN: 57 AVG: 65 MAX: 74 RTX 2080 Ti ....... MIN: 53 AVG: 58 MAX: 65 TITAN RTX ......... MIN: 54 AVG: 59 MAX: 66 NVIDIA GPU Cloud TensorFlow 18.09 System Power Consumption Monitor Watts < Lower Is Better GTX 980 Ti ........ MIN: 53 AVG: 226 MAX: 305 GTX TITAN X GM200 . MIN: 55 AVG: 233 MAX: 323 GTX 1070 .......... MIN: 44 AVG: 158 MAX: 210 GTX 1070 Ti ....... MIN: 47 AVG: 146 MAX: 189 GTX 1080 .......... MIN: 71 AVG: 186 MAX: 250 GTX 1080 Ti ....... MIN: 52 AVG: 212 MAX: 321 RTX 2080 .......... MIN: 48 AVG: 177 MAX: 285 RTX 2080 Ti ....... MIN: 50 AVG: 183 MAX: 341 TITAN RTX ......... MIN: 58 AVG: 196 MAX: 353 NVIDIA GPU Cloud TensorFlow 18.09 Test: VGG-16, FP16 Images Per Second > Higher Is Better GTX 980 Ti ........ 77.57 |================ GTX TITAN X GM200 . 79.20 |================= GTX 1070 .......... 76.93 |================ GTX 1070 Ti ....... 84.43 |================== GTX 1080 .......... 93.13 |=================== GTX 1080 Ti ....... 131.37 |=========================== RTX 2080 .......... 153.33 |================================ RTX 2080 Ti ....... 206.97 |=========================================== TITAN RTX ......... 244.40 |=================================================== NVIDIA GPU Cloud TensorFlow 18.09 Test: VGG-16, FP16 Images Per Second Per Watt > Higher Is Better GTX 980 Ti ........ 0.30 |================= GTX TITAN X GM200 . 0.29 |================ GTX 1070 .......... 0.46 |========================== GTX 1070 Ti ....... 0.53 |============================== GTX 1080 .......... 0.48 |=========================== GTX 1080 Ti ....... 0.54 |============================== RTX 2080 .......... 0.69 |====================================== RTX 2080 Ti ....... 0.94 |==================================================== TITAN RTX ......... 0.95 |===================================================== NVIDIA GPU Cloud TensorFlow 18.09 GPU Temperature Monitor Celsius < Lower Is Better GTX 980 Ti ........ MIN: 67 AVG: 79 MAX: 84 GTX TITAN X GM200 . MIN: 67 AVG: 79 MAX: 84 GTX 1070 .......... MIN: 59 AVG: 66 MAX: 70 GTX 1070 Ti ....... MIN: 45 AVG: 52 MAX: 55 GTX 1080 .......... MIN: 50 AVG: 66 MAX: 74 GTX 1080 Ti ....... MIN: 61 AVG: 70 MAX: 76 RTX 2080 .......... MIN: 59 AVG: 70 MAX: 77 RTX 2080 Ti ....... MIN: 54 AVG: 62 MAX: 68 TITAN RTX ......... MIN: 55 AVG: 63 MAX: 68 NVIDIA GPU Cloud TensorFlow 18.09 System Power Consumption Monitor Watts < Lower Is Better GTX 980 Ti ........ MIN: 52 AVG: 254 MAX: 318 GTX TITAN X GM200 . MIN: 82 AVG: 277 MAX: 328 GTX 1070 .......... MIN: 44 AVG: 169 MAX: 202 GTX 1070 Ti ....... MIN: 47 AVG: 160 MAX: 192 GTX 1080 .......... MIN: 91 AVG: 195 MAX: 240 GTX 1080 Ti ....... MIN: 52 AVG: 243 MAX: 313 RTX 2080 .......... MIN: 48 AVG: 224 MAX: 283 RTX 2080 Ti ....... MIN: 51 AVG: 220 MAX: 332 TITAN RTX ......... MIN: 49 AVG: 257 MAX: 355 NVIDIA GPU Cloud TensorFlow 18.09 Test: VGG-16, FP32 Images Per Second > Higher Is Better GTX TITAN X GM200 . 72.77 |======================= GTX 1070 .......... 71.57 |====================== GTX 1070 Ti ....... 76.40 |======================== GTX 1080 .......... 82.90 |========================== GTX 1080 Ti ....... 119.50 |====================================== RTX 2080 .......... 108.57 |================================== RTX 2080 Ti ....... 152.40 |================================================ TITAN RTX ......... 162.33 |=================================================== NVIDIA GPU Cloud TensorFlow 18.09 Test: VGG-16, FP32 Images Per Second Per Watt > Higher Is Better GTX TITAN X GM200 . 0.28 |========================== GTX 1070 .......... 0.42 |====================================== GTX 1070 Ti ....... 0.47 |=========================================== GTX 1080 .......... 0.42 |====================================== GTX 1080 Ti ....... 0.49 |============================================= RTX 2080 .......... 0.45 |========================================= RTX 2080 Ti ....... 0.56 |=================================================== TITAN RTX ......... 0.58 |===================================================== NVIDIA GPU Cloud TensorFlow 18.09 GPU Temperature Monitor Celsius < Lower Is Better GTX TITAN X GM200 . MIN: 67 AVG: 80 MAX: 84 GTX 1070 .......... MIN: 58 AVG: 66 MAX: 70 GTX 1070 Ti ....... MIN: 46 AVG: 52 MAX: 55 GTX 1080 .......... MIN: 60 AVG: 69 MAX: 74 GTX 1080 Ti ....... MIN: 61 AVG: 71 MAX: 77 RTX 2080 .......... MIN: 61 AVG: 74 MAX: 80 RTX 2080 Ti ....... MIN: 56 AVG: 66 MAX: 71 TITAN RTX ......... MIN: 56 AVG: 67 MAX: 73 NVIDIA GPU Cloud TensorFlow 18.09 System Power Consumption Monitor Watts < Lower Is Better GTX TITAN X GM200 . MIN: 53 AVG: 262 MAX: 322 GTX 1070 .......... MIN: 54 AVG: 171 MAX: 204 GTX 1070 Ti ....... MIN: 59 AVG: 162 MAX: 191 GTX 1080 .......... MIN: 46 AVG: 198 MAX: 236 GTX 1080 Ti ....... MIN: 51 AVG: 242 MAX: 310 RTX 2080 .......... MIN: 56 AVG: 239 MAX: 288 RTX 2080 Ti ....... MIN: 50 AVG: 270 MAX: 342 TITAN RTX ......... MIN: 60 AVG: 282 MAX: 358