NVIDIA TITAN RTX Linux GPU Compute Benchmarks NVIDIA and AMD GPU Linux compute benchmarks December 2018 by Michael Larabel for a future article, review of the NVIDIA TITAN RTX. RX Vega 56: Processor: Intel Core i9-9900K @ 5.00GHz (8 Cores / 16 Threads), Motherboard: ASUS PRIME Z390-A (0602 BIOS), Chipset: Intel Cannon Lake PCH Shared SRAM, Memory: 16384MB, Disk: 2000GB SABRENT + Samsung SSD 970 EVO 250GB, Graphics: AMD Radeon RX Vega 8GB (1590/800MHz), Audio: Realtek ALC1220, Monitor: Acer B286HK, Network: Intel Connection OS: Ubuntu 18.04, Kernel: 4.19.5-041905-generic (x86_64), Desktop: GNOME Shell 3.28.3, Display Server: X Server 1.19.6, OpenGL: 4.5 Mesa 19.0.0-devel padoka PPA (LLVM 8.0.0), OpenCL: OpenCL 2.1 AMD-APP (2679.0), Vulkan: 1.1.70, Compiler: GCC 7.3.0, File-System: ext4, Screen Resolution: 3840x2160 RX Vega 64: Processor: Intel Core i9-9900K @ 5.00GHz (8 Cores / 16 Threads), Motherboard: ASUS PRIME Z390-A (0602 BIOS), Chipset: Intel Cannon Lake PCH Shared SRAM, Memory: 16384MB, Disk: 2000GB SABRENT + Samsung SSD 970 EVO 250GB, Graphics: AMD Radeon RX Vega 8GB (1630/945MHz), Audio: Realtek ALC1220, Monitor: Acer B286HK, Network: Intel Connection OS: Ubuntu 18.04, Kernel: 4.19.5-041905-generic (x86_64), Desktop: GNOME Shell 3.28.3, Display Server: X Server 1.19.6, OpenGL: 4.5 Mesa 19.0.0-devel padoka PPA (LLVM 8.0.0), OpenCL: OpenCL 2.1 AMD-APP (2679.0), Vulkan: 1.1.70, Compiler: GCC 7.3.0, File-System: ext4, Screen Resolution: 3840x2160 GTX 1080: Processor: Intel Core i9-9900K @ 5.00GHz (8 Cores / 16 Threads), Motherboard: ASUS PRIME Z390-A (0602 BIOS), Chipset: Intel Cannon Lake PCH Shared SRAM, Memory: 16384MB, Disk: 2000GB SABRENT + Samsung SSD 970 EVO 250GB, Graphics: NVIDIA GeForce GTX 1080 8GB (1607/5005MHz), Audio: Realtek ALC1220, Monitor: Acer B286HK, Network: Intel Connection OS: Ubuntu 18.04, Kernel: 4.19.5-041905-generic (x86_64), Desktop: GNOME Shell 3.28.3, Display Server: X Server 1.19.6, Display Driver: NVIDIA 415.22, OpenGL: 4.6.0, OpenCL: OpenCL 1.2 CUDA 10.0.132, Vulkan: 1.1.84, Compiler: GCC 7.3.0 + CUDA 10.0, File-System: ext4, Screen Resolution: 3840x2160 RTX 2080 Ti: Processor: Intel Core i9-9900K @ 5.00GHz (8 Cores / 16 Threads), Motherboard: ASUS PRIME Z390-A (0602 BIOS), Chipset: Intel Cannon Lake PCH Shared SRAM, Memory: 16384MB, Disk: 2000GB SABRENT + Samsung SSD 970 EVO 250GB, Graphics: NVIDIA GeForce RTX 2080 Ti 11GB (1350/7000MHz), Audio: Realtek ALC1220, Monitor: Acer B286HK, Network: Intel Connection OS: Ubuntu 18.04, Kernel: 4.19.5-041905-generic (x86_64), Desktop: GNOME Shell 3.28.3, Display Server: X Server 1.19.6, Display Driver: NVIDIA 415.22, OpenGL: 4.6.0, OpenCL: OpenCL 1.2 CUDA 10.0.132, Vulkan: 1.1.84, Compiler: GCC 7.3.0 + CUDA 10.0, File-System: ext4, Screen Resolution: 3840x2160 RTX 2080: Processor: Intel Core i9-9900K @ 5.00GHz (8 Cores / 16 Threads), Motherboard: ASUS PRIME Z390-A (0602 BIOS), Chipset: Intel Cannon Lake PCH Shared SRAM, Memory: 16384MB, Disk: 2000GB SABRENT + Samsung SSD 970 EVO 250GB, Graphics: Zotac NVIDIA GeForce RTX 2080 8GB (1515/7000MHz), Audio: Realtek ALC1220, Monitor: Acer B286HK, Network: Intel Connection OS: Ubuntu 18.04, Kernel: 4.19.5-041905-generic (x86_64), Desktop: GNOME Shell 3.28.3, Display Server: X Server 1.19.6, Display Driver: NVIDIA 415.22, OpenGL: 4.6.0, OpenCL: OpenCL 1.2 CUDA 10.0.132, Vulkan: 1.1.84, Compiler: GCC 7.3.0 + CUDA 10.0, File-System: ext4, Screen Resolution: 3840x2160 RTX 2070: Processor: Intel Core i9-9900K @ 5.00GHz (8 Cores / 16 Threads), Motherboard: ASUS PRIME Z390-A (0602 BIOS), Chipset: Intel Cannon Lake PCH Shared SRAM, Memory: 16384MB, Disk: 2000GB SABRENT + Samsung SSD 970 EVO 250GB, Graphics: eVGA NVIDIA GeForce RTX 2070 8GB (1410/7000MHz), Audio: Realtek ALC1220, Monitor: Acer B286HK, Network: Intel Connection OS: Ubuntu 18.04, Kernel: 4.19.5-041905-generic (x86_64), Desktop: GNOME Shell 3.28.3, Display Server: X Server 1.19.6, Display Driver: NVIDIA 415.22, OpenGL: 4.6.0, OpenCL: OpenCL 1.2 CUDA 10.0.132, Vulkan: 1.1.84, Compiler: GCC 7.3.0 + CUDA 10.0, File-System: ext4, Screen Resolution: 3840x2160 GTX 1080 Ti: Processor: Intel Core i9-9900K @ 5.00GHz (8 Cores / 16 Threads), Motherboard: ASUS PRIME Z390-A (0602 BIOS), Chipset: Intel Cannon Lake PCH Shared SRAM, Memory: 16384MB, Disk: 2000GB SABRENT + Samsung SSD 970 EVO 250GB, Graphics: NVIDIA GeForce GTX 1080 Ti 11GB (1480/5508MHz), Audio: Realtek ALC1220, Monitor: Acer B286HK, Network: Intel Connection OS: Ubuntu 18.04, Kernel: 4.19.5-041905-generic (x86_64), Desktop: GNOME Shell 3.28.3, Display Server: X Server 1.19.6, Display Driver: NVIDIA 415.22, OpenGL: 4.6.0, OpenCL: OpenCL 1.2 CUDA 10.0.132, Vulkan: 1.1.84, Compiler: GCC 7.3.0 + CUDA 10.0, File-System: ext4, Screen Resolution: 3840x2160 GTX 1070 Ti: Processor: Intel Core i9-9900K @ 5.00GHz (8 Cores / 16 Threads), Motherboard: ASUS PRIME Z390-A (0602 BIOS), Chipset: Intel Cannon Lake PCH Shared SRAM, Memory: 16384MB, Disk: 2000GB SABRENT + Samsung SSD 970 EVO 250GB, Graphics: Zotac NVIDIA GeForce GTX 1070 Ti 8GB (1607/4006MHz), Audio: Realtek ALC1220, Monitor: Acer B286HK, Network: Intel Connection OS: Ubuntu 18.04, Kernel: 4.19.5-041905-generic (x86_64), Desktop: GNOME Shell 3.28.3, Display Server: X Server 1.19.6, Display Driver: NVIDIA 415.22, OpenGL: 4.6.0, OpenCL: OpenCL 1.2 CUDA 10.0.132, Vulkan: 1.1.84, Compiler: GCC 7.3.0 + CUDA 10.0, File-System: ext4, Screen Resolution: 3840x2160 GTX 1070: Processor: Intel Core i9-9900K @ 5.00GHz (8 Cores / 16 Threads), Motherboard: ASUS PRIME Z390-A (0602 BIOS), Chipset: Intel Cannon Lake PCH Shared SRAM, Memory: 16384MB, Disk: 2000GB SABRENT + Samsung SSD 970 EVO 250GB, Graphics: NVIDIA GeForce GTX 1070 8GB (1506/4006MHz), Audio: Realtek ALC1220, Monitor: Acer B286HK, Network: Intel Connection OS: Ubuntu 18.04, Kernel: 4.19.5-041905-generic (x86_64), Desktop: GNOME Shell 3.28.3, Display Server: X Server 1.19.6, Display Driver: NVIDIA 415.22, OpenGL: 4.6.0, OpenCL: OpenCL 1.2 CUDA 10.0.132, Vulkan: 1.1.84, Compiler: GCC 7.3.0 + CUDA 10.0, File-System: ext4, Screen Resolution: 3840x2160 TITAN RTX: Processor: Intel Core i9-9900K @ 5.00GHz (8 Cores / 16 Threads), Motherboard: ASUS PRIME Z390-A (0602 BIOS), Chipset: Intel Cannon Lake PCH Shared SRAM, Memory: 16384MB, Disk: 2000GB SABRENT + Samsung SSD 970 EVO 250GB, Graphics: NVIDIA TITAN RTX 24GB (1350/7000MHz), Audio: Realtek ALC1220, Monitor: Acer B286HK, Network: Intel Connection OS: Ubuntu 18.04, Kernel: 4.19.5-041905-generic (x86_64), Desktop: GNOME Shell 3.28.3, Display Server: X Server 1.19.6, Display Driver: NVIDIA 415.23, OpenGL: 4.6.0, OpenCL: OpenCL 1.2 CUDA 10.0.132, Vulkan: 1.1.84, Compiler: GCC 7.3.0 + CUDA 10.0, File-System: ext4, Screen Resolution: 3840x2160 GTX TITAN X GM200: Processor: Intel Core i9-9900K @ 5.00GHz (8 Cores / 16 Threads), Motherboard: ASUS PRIME Z390-A (0602 BIOS), Chipset: Intel Cannon Lake PCH Shared SRAM, Memory: 16384MB, Disk: 2000GB SABRENT + Samsung SSD 970 EVO 250GB, Graphics: NVIDIA GeForce GTX TITAN X 12GB (1001/3505MHz), Audio: Realtek ALC1220, Monitor: Acer B286HK, Network: Intel Connection OS: Ubuntu 18.04, Kernel: 4.19.5-041905-generic (x86_64), Desktop: GNOME Shell 3.28.3, Display Server: X Server 1.19.6, Display Driver: NVIDIA 415.23, OpenGL: 4.6.0, OpenCL: OpenCL 1.2 CUDA 10.0.132, Vulkan: 1.1.84, Compiler: GCC 7.3.0 + CUDA 10.0, File-System: ext4, Screen Resolution: 3840x2160 GTX 980 Ti: Processor: Intel Core i9-9900K @ 5.00GHz (8 Cores / 16 Threads), Motherboard: ASUS PRIME Z390-A (0602 BIOS), Chipset: Intel Cannon Lake PCH Shared SRAM, Memory: 16384MB, Disk: 2000GB SABRENT + Samsung SSD 970 EVO 250GB, Graphics: NVIDIA GeForce GTX 980 Ti 6GB (999/3505MHz), Audio: Realtek ALC1220, Monitor: Acer B286HK, Network: Intel Connection OS: Ubuntu 18.04, Kernel: 4.19.5-041905-generic (x86_64), Desktop: GNOME Shell 3.28.3, Display Server: X Server 1.19.6, Display Driver: NVIDIA 415.23, OpenGL: 4.6.0, OpenCL: OpenCL 1.2 CUDA 10.0.132, Vulkan: 1.1.84, Compiler: GCC 7.3.0 + CUDA 10.0, File-System: ext4, Screen Resolution: 3840x2160 GTX 980: Processor: Intel Core i9-9900K @ 5.00GHz (8 Cores / 16 Threads), Motherboard: ASUS PRIME Z390-A (0602 BIOS), Chipset: Intel Cannon Lake PCH Shared SRAM, Memory: 16384MB, Disk: 2000GB SABRENT + Samsung SSD 970 EVO 250GB, Graphics: NVIDIA GeForce GTX 980 4GB (1126/3505MHz), Audio: Realtek ALC1220, Monitor: Acer B286HK, Network: Intel Connection OS: Ubuntu 18.04, Kernel: 4.19.5-041905-generic (x86_64), Desktop: GNOME Shell 3.28.3, Display Server: X Server 1.19.6, Display Driver: NVIDIA 415.23, OpenGL: 4.6.0, OpenCL: OpenCL 1.2 CUDA 10.0.132, Vulkan: 1.1.84, Compiler: GCC 7.3.0 + CUDA 10.0, File-System: ext4, Screen Resolution: 3840x2160 NVIDIA GPU Cloud TensorFlow 18.09 System Power Consumption Monitor Watts < Lower Is Better GTX 1080 .......... MIN: 76 AVG: 215 MAX: 247 RTX 2080 Ti ....... MIN: 50 AVG: 249 MAX: 343 RTX 2080 .......... MIN: 48 AVG: 230 MAX: 285 GTX 1080 Ti ....... MIN: 64 AVG: 257 MAX: 319 GTX 1070 Ti ....... MIN: 47 AVG: 164 MAX: 188 GTX 1070 .......... MIN: 43 AVG: 182 MAX: 211 TITAN RTX ......... MIN: 51 AVG: 275 MAX: 360 GTX TITAN X GM200 . MIN: 102 AVG: 265 MAX: 320 GTX 980 Ti ........ MIN: 124 AVG: 261 MAX: 317 NVIDIA GPU Cloud TensorFlow 18.09 System Power Consumption Monitor Watts < Lower Is Better GTX 1080 .......... MIN: 44 AVG: 196 MAX: 250 RTX 2080 Ti ....... MIN: 51 AVG: 248 MAX: 347 RTX 2080 .......... MIN: 48 AVG: 207 MAX: 285 GTX 1080 Ti ....... MIN: 80 AVG: 235 MAX: 319 GTX 1070 Ti ....... MIN: 48 AVG: 157 MAX: 188 GTX 1070 .......... MIN: 46 AVG: 172 MAX: 214 TITAN RTX ......... MIN: 51 AVG: 253 MAX: 365 GTX TITAN X GM200 . MIN: 56 AVG: 256 MAX: 321 NVIDIA GPU Cloud TensorFlow 18.09 System Power Consumption Monitor Watts < Lower Is Better GTX 1080 .......... MIN: 45 AVG: 190 MAX: 249 RTX 2080 Ti ....... MIN: 56 AVG: 214 MAX: 342 RTX 2080 .......... MIN: 47 AVG: 180 MAX: 285 RTX 2070 .......... MIN: 71 AVG: 162 MAX: 247 GTX 1080 Ti ....... MIN: 55 AVG: 222 MAX: 320 GTX 1070 Ti ....... MIN: 47 AVG: 154 MAX: 192 GTX 1070 .......... MIN: 43 AVG: 174 MAX: 213 TITAN RTX ......... MIN: 51 AVG: 204 MAX: 351 GTX TITAN X GM200 . MIN: 56 AVG: 252 MAX: 327 GTX 980 Ti ........ MIN: 53 AVG: 244 MAX: 311 NVIDIA GPU Cloud TensorFlow 18.09 System Power Consumption Monitor Watts < Lower Is Better GTX 1080 .......... MIN: 91 AVG: 195 MAX: 240 RTX 2080 Ti ....... MIN: 51 AVG: 220 MAX: 332 RTX 2080 .......... MIN: 48 AVG: 224 MAX: 283 GTX 1080 Ti ....... MIN: 52 AVG: 243 MAX: 313 GTX 1070 Ti ....... MIN: 47 AVG: 160 MAX: 192 GTX 1070 .......... MIN: 44 AVG: 169 MAX: 202 TITAN RTX ......... MIN: 49 AVG: 257 MAX: 355 GTX TITAN X GM200 . MIN: 82 AVG: 277 MAX: 328 GTX 980 Ti ........ MIN: 52 AVG: 254 MAX: 318 NVIDIA GPU Cloud TensorFlow 18.09 System Power Consumption Monitor Watts < Lower Is Better GTX 1080 .......... MIN: 71 AVG: 186 MAX: 250 RTX 2080 Ti ....... MIN: 50 AVG: 183 MAX: 341 RTX 2080 .......... MIN: 48 AVG: 177 MAX: 285 GTX 1080 Ti ....... MIN: 52 AVG: 212 MAX: 321 GTX 1070 Ti ....... MIN: 47 AVG: 146 MAX: 189 GTX 1070 .......... MIN: 44 AVG: 158 MAX: 210 TITAN RTX ......... MIN: 58 AVG: 196 MAX: 353 GTX TITAN X GM200 . MIN: 55 AVG: 233 MAX: 323 GTX 980 Ti ........ MIN: 53 AVG: 226 MAX: 305 NVIDIA GPU Cloud TensorFlow 18.09 System Power Consumption Monitor Watts < Lower Is Better GTX 1080 .......... MIN: 44 AVG: 168 MAX: 235 RTX 2080 Ti ....... MIN: 49 AVG: 178 MAX: 333 RTX 2080 .......... MIN: 47 AVG: 191 MAX: 270 GTX 1080 Ti ....... MIN: 51 AVG: 213 MAX: 303 GTX 1070 Ti ....... MIN: 47 AVG: 136 MAX: 175 GTX 1070 .......... MIN: 69 AVG: 158 MAX: 192 TITAN RTX ......... MIN: 51 AVG: 195 MAX: 353 GTX TITAN X GM200 . MIN: 55 AVG: 237 MAX: 321 GTX 980 Ti ........ MIN: 135 AVG: 237 MAX: 296 GTX 980 ........... MIN: 49 AVG: 187 MAX: 240 NVIDIA GPU Cloud TensorFlow 18.09 System Power Consumption Monitor Watts < Lower Is Better GTX 1080 .......... MIN: 46 AVG: 198 MAX: 236 RTX 2080 Ti ....... MIN: 50 AVG: 270 MAX: 342 RTX 2080 .......... MIN: 56 AVG: 239 MAX: 288 GTX 1080 Ti ....... MIN: 51 AVG: 242 MAX: 310 GTX 1070 Ti ....... MIN: 59 AVG: 162 MAX: 191 GTX 1070 .......... MIN: 54 AVG: 171 MAX: 204 TITAN RTX ......... MIN: 60 AVG: 282 MAX: 358 GTX TITAN X GM200 . MIN: 53 AVG: 262 MAX: 322 NVIDIA GPU Cloud TensorFlow 18.09 System Power Consumption Monitor Watts < Lower Is Better GTX 1080 .......... MIN: 101 AVG: 178 MAX: 229 RTX 2080 Ti ....... MIN: 49 AVG: 257 MAX: 339 RTX 2080 .......... MIN: 48 AVG: 211 MAX: 284 RTX 2070 .......... MIN: 64 AVG: 185 MAX: 244 GTX 1080 Ti ....... MIN: 126 AVG: 208 MAX: 307 GTX 1070 Ti ....... MIN: 48 AVG: 145 MAX: 186 GTX 1070 .......... MIN: 87 AVG: 158 MAX: 202 TITAN RTX ......... MIN: 79 AVG: 244 MAX: 357 GTX TITAN X GM200 . MIN: 136 AVG: 252 MAX: 313 GTX 980 Ti ........ MIN: 123 AVG: 228 MAX: 319 GTX 980 ........... MIN: 102 AVG: 186 MAX: 233 LuxMark 3.1 System Power Consumption Monitor Watts < Lower Is Better RX Vega 56 ........ MIN: 52 AVG: 251 MAX: 263 RX Vega 64 ........ MIN: 53 AVG: 323 MAX: 338 GTX 1080 .......... MIN: 91 AVG: 174 MAX: 176 RTX 2080 Ti ....... MIN: 111 AVG: 315 MAX: 328 RTX 2080 .......... MIN: 102 AVG: 241 MAX: 247 RTX 2070 .......... MIN: 78 AVG: 225 MAX: 233 GTX 1080 Ti ....... MIN: 123 AVG: 242 MAX: 248 GTX 1070 Ti ....... MIN: 147 AVG: 149 MAX: 149 GTX 1070 .......... MIN: 83 AVG: 177 MAX: 181 TITAN RTX ......... MIN: 49 AVG: 329 MAX: 344 GTX TITAN X GM200 . MIN: 126 AVG: 249 MAX: 257 GTX 980 Ti ........ MIN: 119 AVG: 234 MAX: 241 GTX 980 ........... MIN: 80 AVG: 190 MAX: 197 Chaos Group V-RAY 1.1.0 System Power Consumption Monitor Watts < Lower Is Better GTX 1080 .......... MIN: 44 AVG: 153 MAX: 166 RTX 2080 Ti ....... MIN: 70 AVG: 243 MAX: 272 RTX 2080 .......... MIN: 63 AVG: 192 MAX: 203 RTX 2070 .......... MIN: 54 AVG: 186 MAX: 199 GTX 1080 Ti ....... MIN: 120 AVG: 219 MAX: 232 GTX 1070 Ti ....... MIN: 46 AVG: 131 MAX: 136 GTX 1070 .......... MIN: 43 AVG: 151 MAX: 164 TITAN RTX ......... MIN: 58 AVG: 262 MAX: 288 GTX TITAN X GM200 . MIN: 56 AVG: 230 MAX: 248 GTX 980 Ti ........ MIN: 52 AVG: 218 MAX: 232 GTX 980 ........... MIN: 48 AVG: 170 MAX: 175 SHOC Scalable HeterOgeneous Computing 2015-11-10 System Power Consumption Monitor Watts < Lower Is Better RX Vega 56 .. MIN: 49 AVG: 198 MAX: 234 RX Vega 64 .. MIN: 52 AVG: 223 MAX: 250 GTX 1080 .... MIN: 90 AVG: 145 MAX: 165 RTX 2080 Ti . MIN: 48 AVG: 223 MAX: 283 RTX 2080 .... MIN: 47 AVG: 170 MAX: 203 RTX 2070 .... MIN: 54 AVG: 163 MAX: 199 GTX 1080 Ti . MIN: 121 AVG: 190 MAX: 217 GTX 1070 Ti . MIN: 47 AVG: 123 MAX: 142 GTX 1070 .... MIN: 83 AVG: 135 MAX: 155 TITAN RTX ... MIN: 48 AVG: 233 MAX: 281 NVIDIA GPU Cloud TensorFlow 18.09 Test: Inception v4, FP16 Images Per Second Per Watt > Higher Is Better GTX 1080 .......... 0.30 |==================== RTX 2080 Ti ....... 0.74 |================================================== RTX 2080 .......... 0.58 |======================================= GTX 1080 Ti ....... 0.35 |======================== GTX 1070 Ti ....... 0.34 |======================= GTX 1070 .......... 0.28 |=================== TITAN RTX ......... 0.78 |===================================================== GTX TITAN X GM200 . 0.19 |============= GTX 980 Ti ........ 0.18 |============ NVIDIA GPU Cloud TensorFlow 18.09 Test: ResNet-50, FP16 Images Per Second Per Watt > Higher Is Better GTX 1080 .......... 1.02 |===================== RTX 2080 Ti ....... 2.10 |============================================ RTX 2080 .......... 1.86 |======================================= RTX 2070 .......... 1.90 |======================================= GTX 1080 Ti ....... 1.22 |========================= GTX 1070 Ti ....... 1.14 |======================== GTX 1070 .......... 0.92 |=================== TITAN RTX ......... 2.55 |===================================================== GTX TITAN X GM200 . 0.62 |============= GTX 980 Ti ........ 0.61 |============= NVIDIA GPU Cloud TensorFlow 18.09 Test: AlexNet, FP16 Images Per Second > Higher Is Better GTX 1080 .......... 1875 |==================== RTX 2080 Ti ....... 4432 |=============================================== RTX 2080 .......... 3153 |================================= GTX 1080 Ti ....... 2674 |============================ GTX 1070 Ti ....... 1683 |================== GTX 1070 .......... 1563 |================ TITAN RTX ......... 5032 |===================================================== GTX TITAN X GM200 . 1662 |================== GTX 980 Ti ........ 1552 |================ GTX 980 ........... 1208 |============= NVIDIA GPU Cloud TensorFlow 18.09 Test: AlexNet, FP16 Images Per Second Per Watt > Higher Is Better GTX 1080 .......... 11.19 |======================= RTX 2080 Ti ....... 24.95 |================================================== RTX 2080 .......... 16.53 |================================= GTX 1080 Ti ....... 12.53 |========================= GTX 1070 Ti ....... 12.39 |========================= GTX 1070 .......... 9.86 |==================== TITAN RTX ......... 25.77 |==================================================== GTX TITAN X GM200 . 7.03 |============== GTX 980 Ti ........ 6.54 |============= GTX 980 ........... 6.45 |============= NVIDIA GPU Cloud TensorFlow 18.09 Test: Inception v4, FP16 Images Per Second > Higher Is Better GTX 1080 .......... 55.03 |================== RTX 2080 Ti ....... 135.90 |============================================= RTX 2080 .......... 102.77 |================================== GTX 1080 Ti ....... 74.63 |========================= GTX 1070 Ti ....... 49.23 |================ GTX 1070 .......... 44.77 |=============== TITAN RTX ......... 152.80 |=================================================== GTX TITAN X GM200 . 43.23 |============== GTX 980 Ti ........ 40.90 |============== LuxMark 3.1 OpenCL Device: GPU - Scene: Luxball HDR Score > Higher Is Better RX Vega 56 ........ 31179 |=================================== RX Vega 64 ........ 32815 |===================================== GTX 1080 .......... 13823 |================ RTX 2080 Ti ....... 42693 |================================================ RTX 2080 .......... 29641 |================================== RTX 2070 .......... 30091 |================================== GTX 1080 Ti ....... 21562 |======================== GTX 1070 Ti ....... 16886 |=================== GTX 1070 .......... 17288 |==================== TITAN RTX ......... 45932 |==================================================== GTX TITAN X GM200 . 17299 |==================== GTX 980 Ti ........ 16910 |=================== GTX 980 ........... 13242 |=============== NVIDIA GPU Cloud TensorFlow 18.09 Test: ResNet-50, FP16 Images Per Second > Higher Is Better GTX 1080 .......... 193 |==================== RTX 2080 Ti ....... 449 |=============================================== RTX 2080 .......... 335 |=================================== RTX 2070 .......... 309 |================================ GTX 1080 Ti ....... 271 |============================ GTX 1070 Ti ....... 175 |================== GTX 1070 .......... 160 |================= TITAN RTX ......... 520 |====================================================== GTX TITAN X GM200 . 156 |================ GTX 980 Ti ........ 150 |================ SHOC Scalable HeterOgeneous Computing 2015-11-10 Target: OpenCL - Benchmark: FFT SP GFLOPS > Higher Is Better RX Vega 56 ........ 926 |================================ RX Vega 64 ........ 1070 |===================================== GTX 1080 .......... 575 |==================== RTX 2080 Ti ....... 1443 |================================================= RTX 2080 .......... 1083 |===================================== RTX 2070 .......... 998 |================================== GTX 1080 Ti ....... 972 |================================= GTX 1070 Ti ....... 497 |================= GTX 1070 .......... 452 |=============== TITAN RTX ......... 1548 |===================================================== GTX TITAN X GM200 . 726 |========================= GTX 980 Ti ........ 728 |========================= GTX 980 ........... 468 |================ cl-mem 2017-01-13 Benchmark: Copy GB/s > Higher Is Better RX Vega 56 ........ 203 |======================= RX Vega 64 ........ 221 |========================= GTX 1080 .......... 209 |======================= RTX 2080 Ti ....... 454 |=================================================== RTX 2080 .......... 328 |===================================== RTX 2070 .......... 330 |===================================== GTX 1080 Ti ....... 317 |=================================== GTX 1070 Ti ....... 188 |===================== GTX 1070 .......... 187 |===================== TITAN RTX ......... 484 |====================================================== GTX TITAN X GM200 . 218 |======================== GTX 980 Ti ........ 217 |======================== GTX 980 ........... 143 |================ NVIDIA GPU Cloud TensorFlow 18.09 Test: VGG-16, FP16 Images Per Second Per Watt > Higher Is Better GTX 1080 .......... 0.48 |=========================== RTX 2080 Ti ....... 0.94 |==================================================== RTX 2080 .......... 0.69 |====================================== GTX 1080 Ti ....... 0.54 |============================== GTX 1070 Ti ....... 0.53 |============================== GTX 1070 .......... 0.46 |========================== TITAN RTX ......... 0.95 |===================================================== GTX TITAN X GM200 . 0.29 |================ GTX 980 Ti ........ 0.30 |================= NVIDIA GPU Cloud TensorFlow 18.09 Test: Googlenet, FP16 Images Per Second > Higher Is Better GTX 1080 .......... 458 |===================== RTX 2080 Ti ....... 1015 |================================================ RTX 2080 .......... 738 |=================================== GTX 1080 Ti ....... 629 |============================= GTX 1070 Ti ....... 413 |=================== GTX 1070 .......... 375 |================== TITAN RTX ......... 1132 |===================================================== GTX TITAN X GM200 . 372 |================= GTX 980 Ti ........ 356 |================= NVIDIA GPU Cloud TensorFlow 18.09 Test: VGG-16, FP16 Images Per Second > Higher Is Better GTX 1080 .......... 93.13 |=================== RTX 2080 Ti ....... 206.97 |=========================================== RTX 2080 .......... 153.33 |================================ GTX 1080 Ti ....... 131.37 |=========================== GTX 1070 Ti ....... 84.43 |================== GTX 1070 .......... 76.93 |================ TITAN RTX ......... 244.40 |=================================================== GTX TITAN X GM200 . 79.20 |================= GTX 980 Ti ........ 77.57 |================ NVIDIA GPU Cloud TensorFlow 18.09 Test: AlexNet, FP32 Images Per Second > Higher Is Better GTX 1080 .......... 1764 |========================== RTX 2080 Ti ....... 3344 |================================================== RTX 2080 .......... 2419 |==================================== RTX 2070 .......... 2174 |================================ GTX 1080 Ti ....... 2539 |====================================== GTX 1070 Ti ....... 1591 |======================== GTX 1070 .......... 1516 |====================== TITAN RTX ......... 3576 |===================================================== GTX TITAN X GM200 . 1587 |======================== GTX 980 Ti ........ 1501 |====================== GTX 980 ........... 1154 |================= NVIDIA GPU Cloud TensorFlow 18.09 Test: Googlenet, FP16 Images Per Second Per Watt > Higher Is Better GTX 1080 .......... 2.13 |=========================== RTX 2080 Ti ....... 4.07 |==================================================== RTX 2080 .......... 3.21 |========================================= GTX 1080 Ti ....... 2.45 |================================ GTX 1070 Ti ....... 2.53 |================================= GTX 1070 .......... 2.06 |=========================== TITAN RTX ......... 4.11 |===================================================== GTX TITAN X GM200 . 1.40 |================== GTX 980 Ti ........ 1.36 |================== NVIDIA GPU Cloud TensorFlow 18.09 GPU Temperature Monitor Celsius < Lower Is Better GTX 1080 .......... MIN: 61 AVG: 68 MAX: 75 RTX 2080 Ti ....... MIN: 55 AVG: 60 MAX: 65 RTX 2080 .......... MIN: 60 AVG: 67 MAX: 75 RTX 2070 .......... MIN: 32 AVG: 45 MAX: 58 GTX 1080 Ti ....... MIN: 61 AVG: 68 MAX: 75 GTX 1070 Ti ....... MIN: 46 AVG: 51 MAX: 55 GTX 1070 .......... MIN: 58 AVG: 66 MAX: 70 TITAN RTX ......... MIN: 57 AVG: 61 MAX: 67 GTX TITAN X GM200 . MIN: 66 AVG: 77 MAX: 84 GTX 980 Ti ........ MIN: 65 AVG: 77 MAX: 83 NVIDIA GPU Cloud TensorFlow 18.09 Test: ResNet-50, FP32 Images Per Second Per Watt > Higher Is Better GTX 1080 .......... 0.73 |================================= RTX 2080 Ti ....... 1.15 |==================================================== RTX 2080 .......... 0.99 |============================================ GTX 1080 Ti ....... 0.89 |======================================== GTX 1070 Ti ....... 0.84 |====================================== GTX 1070 .......... 0.73 |================================= TITAN RTX ......... 1.18 |===================================================== GTX TITAN X GM200 . 0.49 |====================== NVIDIA GPU Cloud TensorFlow 18.09 Test: ResNet-50, FP32 Images Per Second > Higher Is Better GTX 1080 .......... 143 |========================== RTX 2080 Ti ....... 285 |=================================================== RTX 2080 .......... 205 |===================================== GTX 1080 Ti ....... 210 |====================================== GTX 1070 Ti ....... 133 |======================== GTX 1070 .......... 125 |======================= TITAN RTX ......... 299 |====================================================== GTX TITAN X GM200 . 125 |======================= NVIDIA GPU Cloud TensorFlow 18.09 Test: AlexNet, FP32 Images Per Second Per Watt > Higher Is Better GTX 1080 .......... 9.90 |=================================== RTX 2080 Ti ....... 12.99 |============================================== RTX 2080 .......... 11.44 |========================================= RTX 2070 .......... 11.72 |========================================== GTX 1080 Ti ....... 12.19 |=========================================== GTX 1070 Ti ....... 10.99 |======================================= GTX 1070 .......... 9.61 |================================== TITAN RTX ......... 14.66 |==================================================== GTX TITAN X GM200 . 6.29 |====================== GTX 980 Ti ........ 6.59 |======================= GTX 980 ........... 6.20 |====================== NVIDIA GPU Cloud TensorFlow 18.09 Test: VGG-16, FP32 Images Per Second > Higher Is Better GTX 1080 .......... 82.90 |========================== RTX 2080 Ti ....... 152.40 |================================================ RTX 2080 .......... 108.57 |================================== GTX 1080 Ti ....... 119.50 |====================================== GTX 1070 Ti ....... 76.40 |======================== GTX 1070 .......... 71.57 |====================== TITAN RTX ......... 162.33 |=================================================== GTX TITAN X GM200 . 72.77 |======================= Chaos Group V-RAY 1.1.0 GPU Temperature Monitor Celsius < Lower Is Better GTX 1080 .......... MIN: 48 AVG: 63 MAX: 67 RTX 2080 Ti ....... MIN: 46 AVG: 60 MAX: 68 RTX 2080 .......... MIN: 50 AVG: 68 MAX: 74 RTX 2070 .......... MIN: 53 AVG: 61 MAX: 62 GTX 1080 Ti ....... MIN: 54 AVG: 68 MAX: 73 GTX 1070 Ti ....... MIN: 38 AVG: 48 MAX: 50 GTX 1070 .......... MIN: 46 AVG: 63 MAX: 68 TITAN RTX ......... MIN: 56 AVG: 68 MAX: 72 GTX TITAN X GM200 . MIN: 67 AVG: 78 MAX: 82 GTX 980 Ti ........ MIN: 69 AVG: 78 MAX: 81 GTX 980 ........... MIN: 64 AVG: 73 MAX: 75 Chaos Group V-RAY 1.1.0 Mode: CUDA GPU Seconds < Lower Is Better GTX 1080 .......... 102.07 |================================================= RTX 2080 Ti ....... 56.09 |=========================== RTX 2080 .......... 72.07 |=================================== RTX 2070 .......... 66.02 |================================ GTX 1080 Ti ....... 66.41 |================================ GTX 1070 Ti ....... 86.30 |========================================= GTX 1070 .......... 90.43 |=========================================== TITAN RTX ......... 50.08 |======================== GTX TITAN X GM200 . 80.62 |======================================= GTX 980 Ti ........ 77.70 |===================================== GTX 980 ........... 106.51 |=================================================== NVIDIA GPU Cloud TensorFlow 18.09 Test: VGG-16, FP32 Images Per Second Per Watt > Higher Is Better GTX 1080 .......... 0.42 |====================================== RTX 2080 Ti ....... 0.56 |=================================================== RTX 2080 .......... 0.45 |========================================= GTX 1080 Ti ....... 0.49 |============================================= GTX 1070 Ti ....... 0.47 |=========================================== GTX 1070 .......... 0.42 |====================================== TITAN RTX ......... 0.58 |===================================================== GTX TITAN X GM200 . 0.28 |========================== NVIDIA GPU Cloud TensorFlow 18.09 GPU Temperature Monitor Celsius < Lower Is Better GTX 1080 .......... MIN: 51 AVG: 64 MAX: 76 RTX 2080 Ti ....... MIN: 53 AVG: 58 MAX: 65 RTX 2080 .......... MIN: 57 AVG: 65 MAX: 74 GTX 1080 Ti ....... MIN: 56 AVG: 66 MAX: 77 GTX 1070 Ti ....... MIN: 43 AVG: 50 MAX: 55 GTX 1070 .......... MIN: 55 AVG: 64 MAX: 72 TITAN RTX ......... MIN: 54 AVG: 59 MAX: 66 GTX TITAN X GM200 . MIN: 62 AVG: 76 MAX: 85 GTX 980 Ti ........ MIN: 61 AVG: 75 MAX: 84 NVIDIA GPU Cloud TensorFlow 18.09 GPU Temperature Monitor Celsius < Lower Is Better GTX 1080 .......... MIN: 58 AVG: 72 MAX: 79 RTX 2080 Ti ....... MIN: 55 AVG: 65 MAX: 71 RTX 2080 .......... MIN: 60 AVG: 73 MAX: 80 GTX 1080 Ti ....... MIN: 60 AVG: 73 MAX: 80 GTX 1070 Ti ....... MIN: 43 AVG: 53 MAX: 56 GTX 1070 .......... MIN: 56 AVG: 69 MAX: 74 TITAN RTX ......... MIN: 55 AVG: 65 MAX: 72 GTX TITAN X GM200 . MIN: 72 AVG: 81 MAX: 85 GTX 980 Ti ........ MIN: 70 AVG: 80 MAX: 84 NVIDIA GPU Cloud TensorFlow 18.09 GPU Temperature Monitor Celsius < Lower Is Better GTX 1080 .......... MIN: 63 AVG: 67 MAX: 71 RTX 2080 Ti ....... MIN: 53 AVG: 61 MAX: 67 RTX 2080 .......... MIN: 59 AVG: 70 MAX: 76 RTX 2070 .......... MIN: 46 AVG: 56 MAX: 61 GTX 1080 Ti ....... MIN: 64 AVG: 68 MAX: 71 GTX 1070 Ti ....... MIN: 44 AVG: 49 MAX: 52 GTX 1070 .......... MIN: 61 AVG: 64 MAX: 68 TITAN RTX ......... MIN: 55 AVG: 62 MAX: 67 GTX TITAN X GM200 . MIN: 72 AVG: 79 MAX: 84 GTX 980 Ti ........ MIN: 71 AVG: 78 MAX: 82 GTX 980 ........... MIN: 63 AVG: 72 MAX: 77 NVIDIA GPU Cloud TensorFlow 18.09 GPU Temperature Monitor Celsius < Lower Is Better GTX 1080 .......... MIN: 60 AVG: 69 MAX: 75 RTX 2080 Ti ....... MIN: 54 AVG: 61 MAX: 67 RTX 2080 .......... MIN: 59 AVG: 70 MAX: 77 GTX 1080 Ti ....... MIN: 62 AVG: 70 MAX: 77 GTX 1070 Ti ....... MIN: 44 AVG: 51 MAX: 54 GTX 1070 .......... MIN: 57 AVG: 66 MAX: 71 TITAN RTX ......... MIN: 54 AVG: 63 MAX: 70 GTX TITAN X GM200 . MIN: 65 AVG: 78 MAX: 84 NVIDIA GPU Cloud TensorFlow 18.09 GPU Temperature Monitor Celsius < Lower Is Better GTX 1080 .......... MIN: 50 AVG: 66 MAX: 74 RTX 2080 Ti ....... MIN: 54 AVG: 62 MAX: 68 RTX 2080 .......... MIN: 59 AVG: 70 MAX: 77 GTX 1080 Ti ....... MIN: 61 AVG: 70 MAX: 76 GTX 1070 Ti ....... MIN: 45 AVG: 52 MAX: 55 GTX 1070 .......... MIN: 59 AVG: 66 MAX: 70 TITAN RTX ......... MIN: 55 AVG: 63 MAX: 68 GTX TITAN X GM200 . MIN: 67 AVG: 79 MAX: 84 GTX 980 Ti ........ MIN: 67 AVG: 79 MAX: 84 NVIDIA GPU Cloud TensorFlow 18.09 GPU Temperature Monitor Celsius < Lower Is Better GTX 1080 .......... MIN: 62 AVG: 66 MAX: 70 RTX 2080 Ti ....... MIN: 57 AVG: 60 MAX: 64 RTX 2080 .......... MIN: 63 AVG: 68 MAX: 72 GTX 1080 Ti ....... MIN: 63 AVG: 67 MAX: 70 GTX 1070 Ti ....... MIN: 46 AVG: 50 MAX: 53 GTX 1070 .......... MIN: 59 AVG: 64 MAX: 67 TITAN RTX ......... MIN: 58 AVG: 61 MAX: 65 GTX TITAN X GM200 . MIN: 68 AVG: 77 MAX: 85 GTX 980 Ti ........ MIN: 62 AVG: 73 MAX: 81 GTX 980 ........... MIN: 51 AVG: 66 MAX: 74 NVIDIA GPU Cloud TensorFlow 18.09 GPU Temperature Monitor Celsius < Lower Is Better GTX 1080 .......... MIN: 60 AVG: 69 MAX: 74 RTX 2080 Ti ....... MIN: 56 AVG: 66 MAX: 71 RTX 2080 .......... MIN: 61 AVG: 74 MAX: 80 GTX 1080 Ti ....... MIN: 61 AVG: 71 MAX: 77 GTX 1070 Ti ....... MIN: 46 AVG: 52 MAX: 55 GTX 1070 .......... MIN: 58 AVG: 66 MAX: 70 TITAN RTX ......... MIN: 56 AVG: 67 MAX: 73 GTX TITAN X GM200 . MIN: 67 AVG: 80 MAX: 84 System Power Consumption Monitor Phoronix Test Suite System Monitoring Watts RX Vega 56 ........ MIN: 49 AVG: 144 MAX: 284 RX Vega 64 ........ MIN: 48 AVG: 169 MAX: 359 GTX 1080 .......... MIN: 42 AVG: 155 MAX: 252 RTX 2080 Ti ....... MIN: 46 AVG: 208 MAX: 347 RTX 2080 .......... MIN: 44 AVG: 175 MAX: 288 RTX 2070 .......... MIN: 42 AVG: 146 MAX: 247 GTX 1080 Ti ....... MIN: 43 AVG: 201 MAX: 321 GTX 1070 Ti ....... MIN: 46 AVG: 128 MAX: 214 GTX 1070 .......... MIN: 42 AVG: 144 MAX: 214 TITAN RTX ......... MIN: 48 AVG: 242 MAX: 365 GTX TITAN X GM200 . MIN: 49 AVG: 240 MAX: 328 GTX 980 Ti ........ MIN: 52 AVG: 219 MAX: 321 GTX 980 ........... MIN: 45 AVG: 127 MAX: 240 GPU Temperature Monitor Phoronix Test Suite System Monitoring Celsius RX Vega 56 ........ MIN: 31.0 AVG: 51.0 MAX: 75.0 RX Vega 64 ........ MIN: 28.0 AVG: 53.0 MAX: 85.0 GTX 1080 .......... MIN: 45.0 AVG: 63.1 MAX: 79.0 RTX 2080 Ti ....... MIN: 34.0 AVG: 60.3 MAX: 76.0 RTX 2080 .......... MIN: 35.0 AVG: 66.5 MAX: 80.0 RTX 2070 .......... MIN: 33.0 AVG: 54.6 MAX: 64.0 GTX 1080 Ti ....... MIN: 33.0 AVG: 66.5 MAX: 80.0 GTX 1070 Ti ....... MIN: 36.0 AVG: 46.9 MAX: 60.0 GTX 1070 .......... MIN: 31.0 AVG: 61.1 MAX: 75.0 TITAN RTX ......... MIN: 38.0 AVG: 63.6 MAX: 77.0 GTX TITAN X GM200 . MIN: 35.0 AVG: 76.9 MAX: 85.0 GTX 980 Ti ........ MIN: 38.0 AVG: 74.7 MAX: 84.0 GTX 980 ........... MIN: 34.0 AVG: 58.4 MAX: 77.0