NGC TensorFlow NVIDIA GeForce RTX 2080 Ti NVIDIA GPU Cloud TensorFlow benchmarks with ResNet-50, AlexNet, Googlenet, Inception V4, VGG-16. NVIDIA GPU benchmarks on Ubuntu Linux by Michael Larabel for a future article on Phoronix.com. GeForce RTX 2080 Ti: Processor: Intel Core i7-8086K @ 5.00GHz (6 Cores / 12 Threads), Motherboard: ASUS PRIME Z370-A (1002 BIOS), Chipset: Intel Device 3ec2, Memory: 16384MB, Disk: 525GB SABRENT + 118GB INTEL SSDPEK1W120GA, Graphics: NVIDIA GeForce RTX 2080 Ti 11GB (1350/7000MHz), Audio: Realtek ALC1220, Monitor: Acer B286HK, Network: Intel Connection OS: Ubuntu 18.04, Kernel: 4.19.0-041900rc6-generic (x86_64) 20180930, Desktop: GNOME Shell 3.28.3, Display Server: X Server 1.19.6, Display Driver: NVIDIA 410.57, OpenGL: 4.6.0, Compiler: GCC 7.3.0 + CUDA 10.0, File-System: ext4, Screen Resolution: 3840x2160 GeForce GTX 1080 Ti: Processor: Intel Core i7-8086K @ 5.00GHz (6 Cores / 12 Threads), Motherboard: ASUS PRIME Z370-A (1002 BIOS), Chipset: Intel Device 3ec2, Memory: 16384MB, Disk: 525GB SABRENT + 118GB INTEL SSDPEK1W120GA, Graphics: NVIDIA GeForce GTX 1080 Ti 11GB (1480/5508MHz), Audio: Realtek ALC1220, Monitor: Acer B286HK, Network: Intel Connection OS: Ubuntu 18.04, Kernel: 4.19.0-041900rc6-generic (x86_64) 20180930, Desktop: GNOME Shell 3.28.3, Display Server: X Server 1.19.6, Display Driver: NVIDIA 410.57, OpenGL: 4.6.0, Compiler: GCC 7.3.0 + CUDA 10.0, File-System: ext4, Screen Resolution: 3840x2160 GeForce GTX 1060: Processor: Intel Core i7-8086K @ 5.00GHz (6 Cores / 12 Threads), Motherboard: ASUS PRIME Z370-A (1002 BIOS), Chipset: Intel Device 3ec2, Memory: 16384MB, Disk: 525GB SABRENT + 118GB INTEL SSDPEK1W120GA, Graphics: NVIDIA GeForce GTX 1060 6GB (1506/4006MHz), Audio: Realtek ALC1220, Monitor: Acer B286HK, Network: Intel Connection OS: Ubuntu 18.04, Kernel: 4.19.0-041900rc6-generic (x86_64) 20180930, Desktop: GNOME Shell 3.28.3, Display Server: X Server 1.19.6, Display Driver: NVIDIA 410.57, OpenGL: 4.6.0, Compiler: GCC 7.3.0 + CUDA 10.0, File-System: ext4, Screen Resolution: 3840x2160 GeForce GTX 1070: Processor: Intel Core i7-8086K @ 5.00GHz (6 Cores / 12 Threads), Motherboard: ASUS PRIME Z370-A (1002 BIOS), Chipset: Intel Device 3ec2, Memory: 16384MB, Disk: 525GB SABRENT + 118GB INTEL SSDPEK1W120GA, Graphics: NVIDIA GeForce GTX 1070 8GB (1506/4006MHz), Audio: Realtek ALC1220, Monitor: Acer B286HK, Network: Intel Connection OS: Ubuntu 18.04, Kernel: 4.19.0-041900rc6-generic (x86_64) 20180930, Desktop: GNOME Shell 3.28.3, Display Server: X Server 1.19.6, Display Driver: NVIDIA 410.57, OpenGL: 4.6.0, Compiler: GCC 7.3.0 + CUDA 10.0, File-System: ext4, Screen Resolution: 3840x2160 GeForce GTX 980 Ti: Processor: Intel Core i7-8086K @ 5.00GHz (6 Cores / 12 Threads), Motherboard: ASUS PRIME Z370-A (1002 BIOS), Chipset: Intel Device 3ec2, Memory: 16384MB, Disk: 525GB SABRENT + 118GB INTEL SSDPEK1W120GA, Graphics: NVIDIA GeForce GTX 980 Ti 6GB (999/3505MHz), Audio: Realtek ALC1220, Monitor: Acer B286HK, Network: Intel Connection OS: Ubuntu 18.04, Kernel: 4.19.0-041900rc6-generic (x86_64) 20180930, Desktop: GNOME Shell 3.28.3, Display Server: X Server 1.19.6, Display Driver: NVIDIA 410.57, OpenGL: 4.6.0, Compiler: GCC 7.3.0 + CUDA 10.0, File-System: ext4, Screen Resolution: 3840x2160 GeForce GTX 1080: Processor: Intel Core i7-8086K @ 5.00GHz (6 Cores / 12 Threads), Motherboard: ASUS PRIME Z370-A (1002 BIOS), Chipset: Intel Device 3ec2, Memory: 16384MB, Disk: 525GB SABRENT + 118GB INTEL SSDPEK1W120GA, Graphics: NVIDIA GeForce GTX 1080 8GB (1607/5005MHz), Audio: Realtek ALC1220, Monitor: Acer B286HK, Network: Intel Connection OS: Ubuntu 18.04, Kernel: 4.19.0-041900rc6-generic (x86_64) 20180930, Desktop: GNOME Shell 3.28.3, Display Server: X Server 1.19.6, Display Driver: NVIDIA 410.57, OpenGL: 4.6.0, Compiler: GCC 7.3.0 + CUDA 10.0, File-System: ext4, Screen Resolution: 3840x2160 GeForce GTX 1070 Ti: Processor: Intel Core i7-8086K @ 5.00GHz (6 Cores / 12 Threads), Motherboard: ASUS PRIME Z370-A (1002 BIOS), Chipset: Intel Device 3ec2, Memory: 16384MB, Disk: 525GB SABRENT + 118GB INTEL SSDPEK1W120GA, Graphics: Zotac NVIDIA GeForce GTX 1070 Ti 8GB (1607/4006MHz), Audio: Realtek ALC1220, Monitor: Acer B286HK, Network: Intel Connection OS: Ubuntu 18.04, Kernel: 4.19.0-041900rc6-generic (x86_64) 20180930, Desktop: GNOME Shell 3.28.3, Display Server: X Server 1.19.6, Display Driver: NVIDIA 410.57, OpenGL: 4.6.0, Compiler: GCC 7.3.0 + CUDA 10.0, File-System: ext4, Screen Resolution: 3840x2160 NVIDIA GPU Cloud TensorFlow 18.09 Test: Inception v4, FP16 Images Per Second > Higher Is Better GeForce RTX 2080 Ti . 134.20 |================================================= GeForce GTX 1080 Ti . 74.50 |=========================== GeForce GTX 1060 .... 32.03 |============ GeForce GTX 1070 .... 44.70 |================ GeForce GTX 980 Ti .. 40.93 |=============== GeForce GTX 1080 .... 54.97 |==================== GeForce GTX 1070 Ti . 54.00 |==================== NVIDIA GPU Cloud TensorFlow 18.09 Test: Inception v4, FP32 Images Per Second > Higher Is Better GeForce RTX 2080 Ti . 89.23 |================================================== GeForce GTX 1080 Ti . 65.97 |===================================== NVIDIA GPU Cloud TensorFlow 18.09 Test: Googlenet, FP16 Images Per Second > Higher Is Better GeForce RTX 2080 Ti . 1009 |=================================================== GeForce GTX 1080 Ti . 631 |================================ GeForce GTX 1060 .... 261 |============= GeForce GTX 1070 .... 375 |=================== GeForce GTX 980 Ti .. 358 |================== GeForce GTX 1080 .... 458 |======================= GeForce GTX 1070 Ti . 452 |======================= NVIDIA GPU Cloud TensorFlow 18.09 Test: Googlenet, FP32 Images Per Second > Higher Is Better GeForce RTX 2080 Ti . 761 |==================================================== GeForce GTX 1080 Ti . 552 |====================================== NVIDIA GPU Cloud TensorFlow 18.09 Test: ResNet-50, FP32 Images Per Second > Higher Is Better GeForce RTX 2080 Ti . 284 |==================================================== GeForce GTX 1080 Ti . 210 |====================================== GeForce GTX 1070 .... 125 |======================= GeForce GTX 1080 .... 143 |========================== GeForce GTX 1070 Ti . 138 |========================= NVIDIA GPU Cloud TensorFlow 18.09 Test: ResNet-50, FP16 Images Per Second > Higher Is Better GeForce RTX 2080 Ti . 455 |==================================================== GeForce GTX 1080 Ti . 272 |=============================== GeForce GTX 1060 .... 116 |============= GeForce GTX 1070 .... 162 |=================== GeForce GTX 980 Ti .. 153 |================= GeForce GTX 1080 .... 194 |====================== GeForce GTX 1070 Ti . 187 |===================== NVIDIA GPU Cloud TensorFlow 18.09 Test: VGG-16, FP16 Images Per Second > Higher Is Better GeForce RTX 2080 Ti . 206.00 |================================================= GeForce GTX 1080 Ti . 131.00 |=============================== GeForce GTX 1060 .... 55.50 |============= GeForce GTX 1070 .... 77.30 |================== GeForce GTX 980 Ti .. 78.50 |=================== GeForce GTX 1080 .... 93.20 |====================== GeForce GTX 1070 Ti . 89.47 |===================== NVIDIA GPU Cloud TensorFlow 18.09 Test: VGG-16, FP32 Images Per Second > Higher Is Better GeForce RTX 2080 Ti . 152.00 |================================================= GeForce GTX 1080 Ti . 119.00 |====================================== GeForce GTX 1070 .... 71.73 |======================= GeForce GTX 1080 .... 82.93 |=========================== GeForce GTX 1070 Ti . 79.27 |========================== NVIDIA GPU Cloud TensorFlow 18.09 Test: AlexNet, FP16 Images Per Second > Higher Is Better GeForce RTX 2080 Ti . 4410 |=================================================== GeForce GTX 1080 Ti . 2674 |=============================== GeForce GTX 1060 .... 1090 |============= GeForce GTX 1070 .... 1566 |================== GeForce GTX 980 Ti .. 1558 |================== GeForce GTX 1080 .... 1875 |====================== GeForce GTX 1070 Ti . 1794 |===================== NVIDIA GPU Cloud TensorFlow 18.09 Performance / Cost - Test: Inception v4, FP32 Images Per Second Per Dollar > Higher Is Better GeForce RTX 2080 Ti . 0.07 |======================================== GeForce GTX 1080 Ti . 0.09 |=================================================== NVIDIA GPU Cloud TensorFlow 18.09 Performance / Cost - Test: Googlenet, FP32 Images Per Second Per Dollar > Higher Is Better GeForce RTX 2080 Ti . 0.63 |========================================= GeForce GTX 1080 Ti . 0.79 |=================================================== NVIDIA GPU Cloud TensorFlow 18.09 Performance / Cost - Test: VGG-16, FP32 Images Per Second Per Dollar > Higher Is Better GeForce RTX 2080 Ti . 0.13 |=================================== GeForce GTX 1080 Ti . 0.17 |============================================== GeForce GTX 1080 .... 0.15 |======================================== GeForce GTX 1070 Ti . 0.19 |=================================================== NVIDIA GPU Cloud TensorFlow 18.09 Performance / Cost - Test: VGG-16, FP16 Images Per Second Per Dollar > Higher Is Better GeForce RTX 2080 Ti . 0.17 |========================================= GeForce GTX 1080 Ti . 0.19 |============================================== GeForce GTX 1080 .... 0.17 |========================================= GeForce GTX 1070 Ti . 0.21 |=================================================== NVIDIA GPU Cloud TensorFlow 18.09 Performance / Cost - Test: Inception v4, FP16 Images Per Second Per Dollar > Higher Is Better GeForce RTX 2080 Ti . 0.11 |=========================================== GeForce GTX 1080 Ti . 0.11 |=========================================== GeForce GTX 1080 .... 0.10 |======================================= GeForce GTX 1070 Ti . 0.13 |=================================================== NVIDIA GPU Cloud TensorFlow 18.09 Performance / Cost - Test: Googlenet, FP16 Images Per Second Per Dollar > Higher Is Better GeForce RTX 2080 Ti . 0.84 |======================================== GeForce GTX 1080 Ti . 0.90 |=========================================== GeForce GTX 1080 .... 0.83 |======================================= GeForce GTX 1070 Ti . 1.08 |=================================================== NVIDIA GPU Cloud TensorFlow 18.09 Performance / Cost - Test: AlexNet, FP16 Images Per Second Per Dollar > Higher Is Better GeForce RTX 2080 Ti . 3.68 |============================================ GeForce GTX 1080 Ti . 3.83 |============================================== GeForce GTX 1080 .... 3.42 |========================================= GeForce GTX 1070 Ti . 4.28 |=================================================== NVIDIA GPU Cloud TensorFlow 18.09 Performance / Cost - Test: ResNet-50, FP32 Images Per Second Per Dollar > Higher Is Better GeForce RTX 2080 Ti . 0.24 |===================================== GeForce GTX 1080 Ti . 0.30 |============================================== GeForce GTX 1080 .... 0.26 |======================================== GeForce GTX 1070 Ti . 0.33 |=================================================== NVIDIA GPU Cloud TensorFlow 18.09 Performance / Cost - Test: ResNet-50, FP16 Images Per Second Per Dollar > Higher Is Better GeForce RTX 2080 Ti . 0.38 |=========================================== GeForce GTX 1080 Ti . 0.39 |============================================ GeForce GTX 1080 .... 0.35 |======================================== GeForce GTX 1070 Ti . 0.45 |=================================================== System Power Consumption Monitor Phoronix Test Suite System Monitoring Watts GeForce RTX 2080 Ti . MIN: 57 AVG: 224 MAX: 344 GeForce GTX 1080 Ti . MIN: 48 AVG: 221 MAX: 322 GeForce GTX 1060 .... MIN: 41 AVG: 131 MAX: 185 GeForce GTX 1070 .... MIN: 44 AVG: 151 MAX: 209 GeForce GTX 980 Ti .. MIN: 50 AVG: 198 MAX: 318 GeForce GTX 1080 .... MIN: 41 AVG: 166 MAX: 250 GeForce GTX 1070 Ti . MIN: 47 AVG: 165 MAX: 248 GPU Temperature Monitor Phoronix Test Suite System Monitoring Celsius GeForce RTX 2080 Ti . MIN: 37 AVG: 60 MAX: 73 GeForce GTX 1080 Ti . MIN: 40 AVG: 69 MAX: 81 GeForce GTX 1060 .... MIN: 32 AVG: 57 MAX: 71 GeForce GTX 1070 .... MIN: 36 AVG: 62 MAX: 74 GeForce GTX 980 Ti .. MIN: 38 AVG: 71 MAX: 84 GeForce GTX 1080 .... MIN: 31 AVG: 62 MAX: 77 GeForce GTX 1070 Ti . MIN: 36 AVG: 54 MAX: 65 NVIDIA GPU Cloud TensorFlow 18.09 System Power Consumption Monitor Watts < Lower Is Better GeForce RTX 2080 Ti . MIN: 59 AVG: 265 MAX: 341 GeForce GTX 1080 Ti . MIN: 124 AVG: 234 MAX: 304 GeForce GTX 1070 .... MIN: 44 AVG: 160 MAX: 198 GeForce GTX 1080 .... MIN: 43 AVG: 188 MAX: 231 GeForce GTX 1070 Ti . MIN: 48 AVG: 188 MAX: 232 NVIDIA GPU Cloud TensorFlow 18.09 GPU Temperature Monitor Celsius < Lower Is Better GeForce RTX 2080 Ti . MIN: 57 AVG: 66 MAX: 71 GeForce GTX 1080 Ti . MIN: 65 AVG: 73 MAX: 79 GeForce GTX 1070 .... MIN: 57 AVG: 65 MAX: 70 GeForce GTX 1080 .... MIN: 59 AVG: 68 MAX: 73 GeForce GTX 1070 Ti . MIN: 48 AVG: 57 MAX: 62 NVIDIA GPU Cloud TensorFlow 18.09 Test: VGG-16, FP32 Images Per Second Per Watt > Higher Is Better GeForce RTX 2080 Ti . 0.57 |=================================================== GeForce GTX 1080 Ti . 0.51 |============================================== GeForce GTX 1070 .... 0.45 |======================================== GeForce GTX 1080 .... 0.44 |======================================= GeForce GTX 1070 Ti . 0.42 |====================================== NVIDIA GPU Cloud TensorFlow 18.09 System Power Consumption Monitor Watts < Lower Is Better GeForce RTX 2080 Ti . MIN: 60 AVG: 243 MAX: 340 GeForce GTX 1080 Ti . MIN: 51 AVG: 223 MAX: 303 GeForce GTX 1060 .... MIN: 64 AVG: 155 MAX: 180 GeForce GTX 1070 .... MIN: 83 AVG: 165 MAX: 199 GeForce GTX 980 Ti .. MIN: 80 AVG: 247 MAX: 315 GeForce GTX 1080 .... MIN: 82 AVG: 198 MAX: 241 GeForce GTX 1070 Ti . MIN: 95 AVG: 193 MAX: 239 NVIDIA GPU Cloud TensorFlow 18.09 GPU Temperature Monitor Celsius < Lower Is Better GeForce RTX 2080 Ti . MIN: 57 AVG: 63 MAX: 67 GeForce GTX 1080 Ti . MIN: 63 AVG: 72 MAX: 78 GeForce GTX 1060 .... MIN: 43 AVG: 60 MAX: 67 GeForce GTX 1070 .... MIN: 49 AVG: 62 MAX: 69 GeForce GTX 980 Ti .. MIN: 63 AVG: 78 MAX: 83 GeForce GTX 1080 .... MIN: 50 AVG: 64 MAX: 72 GeForce GTX 1070 Ti . MIN: 43 AVG: 55 MAX: 62 NVIDIA GPU Cloud TensorFlow 18.09 Test: VGG-16, FP16 Images Per Second Per Watt > Higher Is Better GeForce RTX 2080 Ti . 0.85 |=================================================== GeForce GTX 1080 Ti . 0.59 |=================================== GeForce GTX 1060 .... 0.36 |====================== GeForce GTX 1070 .... 0.47 |============================ GeForce GTX 980 Ti .. 0.32 |=================== GeForce GTX 1080 .... 0.47 |============================ GeForce GTX 1070 Ti . 0.46 |============================ NVIDIA GPU Cloud TensorFlow 18.09 System Power Consumption Monitor Watts < Lower Is Better GeForce RTX 2080 Ti . MIN: 59 AVG: 228 MAX: 344 GeForce GTX 1080 Ti . MIN: 56 AVG: 220 MAX: 322 NVIDIA GPU Cloud TensorFlow 18.09 GPU Temperature Monitor Celsius < Lower Is Better GeForce RTX 2080 Ti . MIN: 51 AVG: 60 MAX: 68 GeForce GTX 1080 Ti . MIN: 55 AVG: 68 MAX: 79 NVIDIA GPU Cloud TensorFlow 18.09 Test: Inception v4, FP32 Images Per Second Per Watt > Higher Is Better GeForce RTX 2080 Ti . 0.39 |=================================================== GeForce GTX 1080 Ti . 0.30 |======================================= NVIDIA GPU Cloud TensorFlow 18.09 System Power Consumption Monitor Watts < Lower Is Better GeForce RTX 2080 Ti . MIN: 60 AVG: 196 MAX: 337 GeForce GTX 1080 Ti . MIN: 53 AVG: 201 MAX: 315 GeForce GTX 1060 .... MIN: 69 AVG: 148 MAX: 185 GeForce GTX 1070 .... MIN: 66 AVG: 161 MAX: 208 GeForce GTX 980 Ti .. MIN: 75 AVG: 224 MAX: 317 GeForce GTX 1080 .... MIN: 65 AVG: 177 MAX: 250 GeForce GTX 1070 Ti . MIN: 77 AVG: 177 MAX: 248 NVIDIA GPU Cloud TensorFlow 18.09 GPU Temperature Monitor Celsius < Lower Is Better GeForce RTX 2080 Ti . MIN: 54 AVG: 59 MAX: 65 GeForce GTX 1080 Ti . MIN: 58 AVG: 68 MAX: 78 GeForce GTX 1060 .... MIN: 44 AVG: 61 MAX: 70 GeForce GTX 1070 .... MIN: 49 AVG: 62 MAX: 71 GeForce GTX 980 Ti .. MIN: 59 AVG: 74 MAX: 84 GeForce GTX 1080 .... MIN: 49 AVG: 63 MAX: 75 GeForce GTX 1070 Ti . MIN: 41 AVG: 54 MAX: 64 NVIDIA GPU Cloud TensorFlow 18.09 Test: Inception v4, FP16 Images Per Second Per Watt > Higher Is Better GeForce RTX 2080 Ti . 0.69 |=================================================== GeForce GTX 1080 Ti . 0.37 |=========================== GeForce GTX 1060 .... 0.22 |================ GeForce GTX 1070 .... 0.28 |===================== GeForce GTX 980 Ti .. 0.18 |============= GeForce GTX 1080 .... 0.31 |======================= GeForce GTX 1070 Ti . 0.30 |====================== NVIDIA GPU Cloud TensorFlow 18.09 System Power Consumption Monitor Watts < Lower Is Better GeForce RTX 2080 Ti . MIN: 61 AVG: 273 MAX: 341 GeForce GTX 1080 Ti . MIN: 52 AVG: 257 MAX: 310 NVIDIA GPU Cloud TensorFlow 18.09 GPU Temperature Monitor Celsius < Lower Is Better GeForce RTX 2080 Ti . MIN: 58 AVG: 67 MAX: 73 GeForce GTX 1080 Ti . MIN: 63 AVG: 74 MAX: 81 NVIDIA GPU Cloud TensorFlow 18.09 Test: Googlenet, FP32 Images Per Second Per Watt > Higher Is Better GeForce RTX 2080 Ti . 2.79 |=================================================== GeForce GTX 1080 Ti . 2.15 |======================================= NVIDIA GPU Cloud TensorFlow 18.09 System Power Consumption Monitor Watts < Lower Is Better GeForce RTX 2080 Ti . MIN: 60 AVG: 245 MAX: 337 GeForce GTX 1080 Ti . MIN: 48 AVG: 260 MAX: 314 GeForce GTX 1060 .... MIN: 41 AVG: 160 MAX: 181 GeForce GTX 1070 .... MIN: 86 AVG: 183 MAX: 208 GeForce GTX 980 Ti .. MIN: 85 AVG: 250 MAX: 313 GeForce GTX 1080 .... MIN: 42 AVG: 204 MAX: 246 GeForce GTX 1070 Ti . MIN: 47 AVG: 205 MAX: 246 NVIDIA GPU Cloud TensorFlow 18.09 GPU Temperature Monitor Celsius < Lower Is Better GeForce RTX 2080 Ti . MIN: 54 AVG: 64 MAX: 70 GeForce GTX 1080 Ti . MIN: 58 AVG: 72 MAX: 80 GeForce GTX 1060 .... MIN: 51 AVG: 66 MAX: 71 GeForce GTX 1070 .... MIN: 58 AVG: 69 MAX: 74 GeForce GTX 980 Ti .. MIN: 68 AVG: 80 MAX: 84 GeForce GTX 1080 .... MIN: 57 AVG: 71 MAX: 77 GeForce GTX 1070 Ti . MIN: 46 AVG: 60 MAX: 65 NVIDIA GPU Cloud TensorFlow 18.09 Test: Googlenet, FP16 Images Per Second Per Watt > Higher Is Better GeForce RTX 2080 Ti . 4.12 |=================================================== GeForce GTX 1080 Ti . 2.43 |============================== GeForce GTX 1060 .... 1.63 |==================== GeForce GTX 1070 .... 2.05 |========================= GeForce GTX 980 Ti .. 1.43 |================== GeForce GTX 1080 .... 2.25 |============================ GeForce GTX 1070 Ti . 2.21 |=========================== NVIDIA GPU Cloud TensorFlow 18.09 System Power Consumption Monitor Watts < Lower Is Better GeForce RTX 2080 Ti . MIN: 59 AVG: 194 MAX: 331 GeForce GTX 1080 Ti . MIN: 69 AVG: 204 MAX: 298 GeForce GTX 1060 .... MIN: 69 AVG: 142 MAX: 177 GeForce GTX 1070 .... MIN: 45 AVG: 150 MAX: 200 GeForce GTX 980 Ti .. MIN: 111 AVG: 229 MAX: 305 GeForce GTX 1080 .... MIN: 44 AVG: 173 MAX: 228 GeForce GTX 1070 Ti . MIN: 57 AVG: 169 MAX: 228 NVIDIA GPU Cloud TensorFlow 18.09 GPU Temperature Monitor Celsius < Lower Is Better GeForce RTX 2080 Ti . MIN: 55 AVG: 59 MAX: 63 GeForce GTX 1080 Ti . MIN: 61 AVG: 65 MAX: 68 GeForce GTX 1060 .... MIN: 45 AVG: 55 MAX: 62 GeForce GTX 1070 .... MIN: 59 AVG: 63 MAX: 66 GeForce GTX 980 Ti .. MIN: 62 AVG: 73 MAX: 80 GeForce GTX 1080 .... MIN: 60 AVG: 64 MAX: 67 GeForce GTX 1070 Ti . MIN: 49 AVG: 55 MAX: 59 NVIDIA GPU Cloud TensorFlow 18.09 Test: AlexNet, FP16 Images Per Second Per Watt > Higher Is Better GeForce RTX 2080 Ti . 22.74 |================================================== GeForce GTX 1080 Ti . 13.12 |============================= GeForce GTX 1060 .... 7.67 |================= GeForce GTX 1070 .... 10.47 |======================= GeForce GTX 980 Ti .. 6.81 |=============== GeForce GTX 1080 .... 10.85 |======================== GeForce GTX 1070 Ti . 10.60 |======================= NVIDIA GPU Cloud TensorFlow 18.09 System Power Consumption Monitor Watts < Lower Is Better GeForce RTX 2080 Ti . MIN: 57 AVG: 238 MAX: 340 GeForce GTX 1080 Ti . MIN: 75 AVG: 230 MAX: 313 GeForce GTX 1070 .... MIN: 44 AVG: 170 MAX: 208 GeForce GTX 1080 .... MIN: 66 AVG: 193 MAX: 241 GeForce GTX 1070 Ti . MIN: 48 AVG: 183 MAX: 237 NVIDIA GPU Cloud TensorFlow 18.09 GPU Temperature Monitor Celsius < Lower Is Better GeForce RTX 2080 Ti . MIN: 47.0 AVG: 56.9 MAX: 66.0 GeForce GTX 1080 Ti . MIN: 57.0 AVG: 65.8 MAX: 74.0 GeForce GTX 1070 .... MIN: 53.0 AVG: 63.3 MAX: 70.0 GeForce GTX 1080 .... MIN: 55.0 AVG: 64.9 MAX: 72.0 GeForce GTX 1070 Ti . MIN: 46.0 AVG: 56.6 MAX: 62.0 NVIDIA GPU Cloud TensorFlow 18.09 Test: ResNet-50, FP32 Images Per Second Per Watt > Higher Is Better GeForce RTX 2080 Ti . 1.19 |=================================================== GeForce GTX 1080 Ti . 0.91 |======================================= GeForce GTX 1070 .... 0.74 |================================ GeForce GTX 1080 .... 0.74 |================================ GeForce GTX 1070 Ti . 0.75 |================================ NVIDIA GPU Cloud TensorFlow 18.09 System Power Consumption Monitor Watts < Lower Is Better GeForce RTX 2080 Ti . MIN: 57 AVG: 208 MAX: 336 GeForce GTX 1080 Ti . MIN: 99 AVG: 229 MAX: 312 GeForce GTX 1060 .... MIN: 61 AVG: 153 MAX: 184 GeForce GTX 1070 .... MIN: 69 AVG: 166 MAX: 209 GeForce GTX 980 Ti .. MIN: 83 AVG: 232 MAX: 304 GeForce GTX 1080 .... MIN: 41 AVG: 178 MAX: 242 GeForce GTX 1070 Ti . MIN: 77 AVG: 182 MAX: 241 NVIDIA GPU Cloud TensorFlow 18.09 GPU Temperature Monitor Celsius < Lower Is Better GeForce RTX 2080 Ti . MIN: 37 AVG: 47 MAX: 56 GeForce GTX 1080 Ti . MIN: 40 AVG: 58 MAX: 69 GeForce GTX 1060 .... MIN: 32 AVG: 53 MAX: 65 GeForce GTX 1070 .... MIN: 36 AVG: 54 MAX: 66 GeForce GTX 980 Ti .. MIN: 38 AVG: 67 MAX: 82 GeForce GTX 1080 .... MIN: 31 AVG: 54 MAX: 68 GeForce GTX 1070 Ti . MIN: 36 AVG: 51 MAX: 60 NVIDIA GPU Cloud TensorFlow 18.09 Test: ResNet-50, FP16 Images Per Second Per Watt > Higher Is Better GeForce RTX 2080 Ti . 2.18 |=================================================== GeForce GTX 1080 Ti . 1.19 |============================ GeForce GTX 1060 .... 0.76 |================== GeForce GTX 1070 .... 0.98 |======================= GeForce GTX 980 Ti .. 0.66 |=============== GeForce GTX 1080 .... 1.09 |========================== GeForce GTX 1070 Ti . 1.03 |========================