NGC TensorFlow NVIDIA GeForce RTX 2080 Ti NVIDIA GPU Cloud TensorFlow benchmarks with ResNet-50, AlexNet, Googlenet, Inception V4, VGG-16. NVIDIA GPU benchmarks on Ubuntu Linux by Michael Larabel for a future article on Phoronix.com.
HTML result view exported from: https://openbenchmarking.org/result/1810070-PTS-NVIDIANG57&sro&grr .
NGC TensorFlow NVIDIA GeForce RTX 2080 Ti Processor Motherboard Chipset Memory Disk Graphics Audio Monitor Network OS Kernel Desktop Display Server Display Driver OpenGL Compiler File-System Screen Resolution GeForce GTX 980 Ti GeForce GTX 1060 GeForce GTX 1070 GeForce GTX 1070 Ti GeForce GTX 1080 GeForce GTX 1080 Ti GeForce RTX 2080 Ti Intel Core i7-8086K @ 5.00GHz (6 Cores / 12 Threads) ASUS PRIME Z370-A (1002 BIOS) Intel Device 3ec2 16384MB 525GB SABRENT + 118GB INTEL SSDPEK1W120GA NVIDIA GeForce GTX 980 Ti 6GB (999/3505MHz) Realtek ALC1220 Acer B286HK Intel Connection Ubuntu 18.04 4.19.0-041900rc6-generic (x86_64) 20180930 GNOME Shell 3.28.3 X Server 1.19.6 NVIDIA 410.57 4.6.0 GCC 7.3.0 + CUDA 10.0 ext4 3840x2160 NVIDIA GeForce GTX 1060 6GB (1506/4006MHz) NVIDIA GeForce GTX 1070 8GB (1506/4006MHz) Zotac NVIDIA GeForce GTX 1070 Ti 8GB (1607/4006MHz) NVIDIA GeForce GTX 1080 8GB (1607/5005MHz) NVIDIA GeForce GTX 1080 Ti 11GB (1480/5508MHz) NVIDIA GeForce RTX 2080 Ti 11GB (1350/7000MHz) OpenBenchmarking.org Processor Details - Scaling Governor: intel_pstate performance Security Details - KPTI + __user pointer sanitization + Full generic retpoline IBPB IBRS_FW + SSB disabled via prctl and seccomp + PTE Inversion; VMX: conditional cache flushes SMT vulnerable
NGC TensorFlow NVIDIA GeForce RTX 2080 Ti ngc-tensorflow: Inception v4, FP16 ngc-tensorflow: Inception v4, FP32 ngc-tensorflow: Googlenet, FP16 ngc-tensorflow: Googlenet, FP32 ngc-tensorflow: ResNet-50, FP32 ngc-tensorflow: ResNet-50, FP16 ngc-tensorflow: VGG-16, FP16 ngc-tensorflow: VGG-16, FP32 ngc-tensorflow: AlexNet, FP16 GeForce GTX 980 Ti GeForce GTX 1060 GeForce GTX 1070 GeForce GTX 1070 Ti GeForce GTX 1080 GeForce GTX 1080 Ti GeForce RTX 2080 Ti 40.93 358 153 78.50 1558 32.03 261 116 55.50 1090 44.70 375 125 162 77.30 71.73 1566 54 452 138 187 89.47 79.27 1794 54.97 458 143 194 93.20 82.93 1875 74.50 65.97 631 552 210 272 131 119 2674 134.20 89.23 1009 761 284 455 206 152 4410 OpenBenchmarking.org
NVIDIA GPU Cloud TensorFlow Test: Inception v4, FP16 OpenBenchmarking.org Images Per Second, More Is Better NVIDIA GPU Cloud TensorFlow 18.09 Test: Inception v4, FP16 GeForce GTX 1060 GeForce GTX 1070 GeForce GTX 1070 Ti GeForce GTX 1080 GeForce GTX 1080 Ti GeForce GTX 980 Ti GeForce RTX 2080 Ti 30 60 90 120 150 SE +/- 0.03, N = 3 SE +/- 0.00, N = 3 SE +/- 0.03, N = 3 SE +/- 0.10, N = 3 SE +/- 0.03, N = 3 SE +/- 0.23, N = 3 32.03 44.70 54.00 54.97 74.50 40.93 134.20
NVIDIA GPU Cloud TensorFlow Test: Inception v4, FP32 OpenBenchmarking.org Images Per Second, More Is Better NVIDIA GPU Cloud TensorFlow 18.09 Test: Inception v4, FP32 GeForce GTX 1080 Ti GeForce RTX 2080 Ti 20 40 60 80 100 SE +/- 0.03, N = 3 SE +/- 0.09, N = 3 65.97 89.23
NVIDIA GPU Cloud TensorFlow Test: Googlenet, FP16 OpenBenchmarking.org Images Per Second, More Is Better NVIDIA GPU Cloud TensorFlow 18.09 Test: Googlenet, FP16 GeForce GTX 1060 GeForce GTX 1070 GeForce GTX 1070 Ti GeForce GTX 1080 GeForce GTX 1080 Ti GeForce GTX 980 Ti GeForce RTX 2080 Ti 200 400 600 800 1000 SE +/- 0.40, N = 3 SE +/- 0.22, N = 3 SE +/- 0.32, N = 3 SE +/- 0.15, N = 3 SE +/- 2.54, N = 3 SE +/- 1.85, N = 3 SE +/- 1.58, N = 3 261 375 452 458 631 358 1009
NVIDIA GPU Cloud TensorFlow Test: Googlenet, FP32 OpenBenchmarking.org Images Per Second, More Is Better NVIDIA GPU Cloud TensorFlow 18.09 Test: Googlenet, FP32 GeForce GTX 1080 Ti GeForce RTX 2080 Ti 160 320 480 640 800 SE +/- 0.37, N = 3 SE +/- 0.45, N = 3 552 761
NVIDIA GPU Cloud TensorFlow Test: ResNet-50, FP32 OpenBenchmarking.org Images Per Second, More Is Better NVIDIA GPU Cloud TensorFlow 18.09 Test: ResNet-50, FP32 GeForce GTX 1070 GeForce GTX 1070 Ti GeForce GTX 1080 GeForce GTX 1080 Ti GeForce RTX 2080 Ti 60 120 180 240 300 SE +/- 0.15, N = 3 SE +/- 0.03, N = 3 SE +/- 0.06, N = 3 SE +/- 0.19, N = 3 SE +/- 0.27, N = 3 125 138 143 210 284
NVIDIA GPU Cloud TensorFlow Test: ResNet-50, FP16 OpenBenchmarking.org Images Per Second, More Is Better NVIDIA GPU Cloud TensorFlow 18.09 Test: ResNet-50, FP16 GeForce GTX 1060 GeForce GTX 1070 GeForce GTX 1070 Ti GeForce GTX 1080 GeForce GTX 1080 Ti GeForce GTX 980 Ti GeForce RTX 2080 Ti 100 200 300 400 500 SE +/- 0.23, N = 3 SE +/- 0.32, N = 3 SE +/- 0.32, N = 3 SE +/- 0.44, N = 3 SE +/- 0.39, N = 3 SE +/- 0.76, N = 3 SE +/- 4.02, N = 3 116 162 187 194 272 153 455
NVIDIA GPU Cloud TensorFlow Test: VGG-16, FP16 OpenBenchmarking.org Images Per Second, More Is Better NVIDIA GPU Cloud TensorFlow 18.09 Test: VGG-16, FP16 GeForce GTX 1060 GeForce GTX 1070 GeForce GTX 1070 Ti GeForce GTX 1080 GeForce GTX 1080 Ti GeForce GTX 980 Ti GeForce RTX 2080 Ti 50 100 150 200 250 SE +/- 0.10, N = 3 SE +/- 0.15, N = 3 SE +/- 0.12, N = 3 SE +/- 0.15, N = 3 SE +/- 0.07, N = 3 SE +/- 0.31, N = 3 SE +/- 0.12, N = 3 55.50 77.30 89.47 93.20 131.00 78.50 206.00
NVIDIA GPU Cloud TensorFlow Test: VGG-16, FP32 OpenBenchmarking.org Images Per Second, More Is Better NVIDIA GPU Cloud TensorFlow 18.09 Test: VGG-16, FP32 GeForce GTX 1070 GeForce GTX 1070 Ti GeForce GTX 1080 GeForce GTX 1080 Ti GeForce RTX 2080 Ti 30 60 90 120 150 SE +/- 0.09, N = 3 SE +/- 0.03, N = 3 SE +/- 0.03, N = 3 SE +/- 0.09, N = 3 SE +/- 0.23, N = 3 71.73 79.27 82.93 119.00 152.00
NVIDIA GPU Cloud TensorFlow Test: AlexNet, FP16 OpenBenchmarking.org Images Per Second, More Is Better NVIDIA GPU Cloud TensorFlow 18.09 Test: AlexNet, FP16 GeForce GTX 1060 GeForce GTX 1070 GeForce GTX 1070 Ti GeForce GTX 1080 GeForce GTX 1080 Ti GeForce GTX 980 Ti GeForce RTX 2080 Ti 900 1800 2700 3600 4500 SE +/- 1.46, N = 3 SE +/- 2.52, N = 3 SE +/- 0.85, N = 3 SE +/- 2.46, N = 3 SE +/- 2.58, N = 3 SE +/- 6.45, N = 3 SE +/- 4.74, N = 3 1090 1566 1794 1875 2674 1558 4410
NVIDIA GPU Cloud TensorFlow Performance / Cost - Test: Inception v4, FP32 OpenBenchmarking.org Images Per Second Per Dollar, More Is Better NVIDIA GPU Cloud TensorFlow 18.09 Performance / Cost - Test: Inception v4, FP32 GeForce GTX 1080 Ti GeForce RTX 2080 Ti 0.0203 0.0406 0.0609 0.0812 0.1015 0.09 0.07 1. GeForce GTX 1080 Ti: $699 reported cost. 2. GeForce RTX 2080 Ti: $1199 reported cost.
NVIDIA GPU Cloud TensorFlow Performance / Cost - Test: Googlenet, FP32 OpenBenchmarking.org Images Per Second Per Dollar, More Is Better NVIDIA GPU Cloud TensorFlow 18.09 Performance / Cost - Test: Googlenet, FP32 GeForce GTX 1080 Ti GeForce RTX 2080 Ti 0.1778 0.3556 0.5334 0.7112 0.889 0.79 0.63 1. GeForce GTX 1080 Ti: $699 reported cost. 2. GeForce RTX 2080 Ti: $1199 reported cost.
NVIDIA GPU Cloud TensorFlow Performance / Cost - Test: VGG-16, FP32 OpenBenchmarking.org Images Per Second Per Dollar, More Is Better NVIDIA GPU Cloud TensorFlow 18.09 Performance / Cost - Test: VGG-16, FP32 GeForce GTX 1070 Ti GeForce GTX 1080 GeForce GTX 1080 Ti GeForce RTX 2080 Ti 0.0428 0.0856 0.1284 0.1712 0.214 0.19 0.15 0.17 0.13 1. GeForce GTX 1070 Ti: $419 reported cost. 2. GeForce GTX 1080: $549 reported cost. 3. GeForce GTX 1080 Ti: $699 reported cost. 4. GeForce RTX 2080 Ti: $1199 reported cost.
NVIDIA GPU Cloud TensorFlow Performance / Cost - Test: VGG-16, FP16 OpenBenchmarking.org Images Per Second Per Dollar, More Is Better NVIDIA GPU Cloud TensorFlow 18.09 Performance / Cost - Test: VGG-16, FP16 GeForce GTX 1070 Ti GeForce GTX 1080 GeForce GTX 1080 Ti GeForce RTX 2080 Ti 0.0473 0.0946 0.1419 0.1892 0.2365 0.21 0.17 0.19 0.17 1. GeForce GTX 1070 Ti: $419 reported cost. 2. GeForce GTX 1080: $549 reported cost. 3. GeForce GTX 1080 Ti: $699 reported cost. 4. GeForce RTX 2080 Ti: $1199 reported cost.
NVIDIA GPU Cloud TensorFlow Performance / Cost - Test: Inception v4, FP16 OpenBenchmarking.org Images Per Second Per Dollar, More Is Better NVIDIA GPU Cloud TensorFlow 18.09 Performance / Cost - Test: Inception v4, FP16 GeForce GTX 1070 Ti GeForce GTX 1080 GeForce GTX 1080 Ti GeForce RTX 2080 Ti 0.0293 0.0586 0.0879 0.1172 0.1465 0.13 0.10 0.11 0.11 1. GeForce GTX 1070 Ti: $419 reported cost. 2. GeForce GTX 1080: $549 reported cost. 3. GeForce GTX 1080 Ti: $699 reported cost. 4. GeForce RTX 2080 Ti: $1199 reported cost.
NVIDIA GPU Cloud TensorFlow Performance / Cost - Test: Googlenet, FP16 OpenBenchmarking.org Images Per Second Per Dollar, More Is Better NVIDIA GPU Cloud TensorFlow 18.09 Performance / Cost - Test: Googlenet, FP16 GeForce GTX 1070 Ti GeForce GTX 1080 GeForce GTX 1080 Ti GeForce RTX 2080 Ti 0.243 0.486 0.729 0.972 1.215 1.08 0.83 0.90 0.84 1. GeForce GTX 1070 Ti: $419 reported cost. 2. GeForce GTX 1080: $549 reported cost. 3. GeForce GTX 1080 Ti: $699 reported cost. 4. GeForce RTX 2080 Ti: $1199 reported cost.
NVIDIA GPU Cloud TensorFlow Performance / Cost - Test: AlexNet, FP16 OpenBenchmarking.org Images Per Second Per Dollar, More Is Better NVIDIA GPU Cloud TensorFlow 18.09 Performance / Cost - Test: AlexNet, FP16 GeForce GTX 1070 Ti GeForce GTX 1080 GeForce GTX 1080 Ti GeForce RTX 2080 Ti 0.963 1.926 2.889 3.852 4.815 4.28 3.42 3.83 3.68 1. GeForce GTX 1070 Ti: $419 reported cost. 2. GeForce GTX 1080: $549 reported cost. 3. GeForce GTX 1080 Ti: $699 reported cost. 4. GeForce RTX 2080 Ti: $1199 reported cost.
NVIDIA GPU Cloud TensorFlow Performance / Cost - Test: ResNet-50, FP32 OpenBenchmarking.org Images Per Second Per Dollar, More Is Better NVIDIA GPU Cloud TensorFlow 18.09 Performance / Cost - Test: ResNet-50, FP32 GeForce GTX 1070 Ti GeForce GTX 1080 GeForce GTX 1080 Ti GeForce RTX 2080 Ti 0.0743 0.1486 0.2229 0.2972 0.3715 0.33 0.26 0.30 0.24 1. GeForce GTX 1070 Ti: $419 reported cost. 2. GeForce GTX 1080: $549 reported cost. 3. GeForce GTX 1080 Ti: $699 reported cost. 4. GeForce RTX 2080 Ti: $1199 reported cost.
NVIDIA GPU Cloud TensorFlow Performance / Cost - Test: ResNet-50, FP16 OpenBenchmarking.org Images Per Second Per Dollar, More Is Better NVIDIA GPU Cloud TensorFlow 18.09 Performance / Cost - Test: ResNet-50, FP16 GeForce GTX 1070 Ti GeForce GTX 1080 GeForce GTX 1080 Ti GeForce RTX 2080 Ti 0.1013 0.2026 0.3039 0.4052 0.5065 0.45 0.35 0.39 0.38 1. GeForce GTX 1070 Ti: $419 reported cost. 2. GeForce GTX 1080: $549 reported cost. 3. GeForce GTX 1080 Ti: $699 reported cost. 4. GeForce RTX 2080 Ti: $1199 reported cost.
System Power Consumption Monitor Phoronix Test Suite System Monitoring Min Avg Max GeForce GTX 1060 40.9 130.9 184.9 GeForce GTX 1070 43.6 151.0 209.3 GeForce GTX 1070 Ti 47.2 165.3 247.8 GeForce GTX 1080 41.4 166.1 250.2 GeForce GTX 1080 Ti 47.8 220.9 322.2 GeForce GTX 980 Ti 50.4 198.2 318.0 GeForce RTX 2080 Ti 56.8 224.0 343.5 OpenBenchmarking.org Watts System Power Consumption Monitor Phoronix Test Suite System Monitoring 80 160 240 320 400
GPU Temperature Monitor Phoronix Test Suite System Monitoring Min Avg Max GeForce GTX 1060 32.0 57.1 71.0 GeForce GTX 1070 36.0 61.6 74.0 GeForce GTX 1070 Ti 36.0 53.7 65.0 GeForce GTX 1080 31.0 62.4 77.0 GeForce GTX 1080 Ti 40.0 68.6 81.0 GeForce GTX 980 Ti 38.0 71.2 84.0 GeForce RTX 2080 Ti 37.0 60.5 73.0 OpenBenchmarking.org Celsius GPU Temperature Monitor Phoronix Test Suite System Monitoring 20 40 60 80 100
NVIDIA GPU Cloud TensorFlow System Power Consumption Monitor Min Avg Max GeForce GTX 1070 44.4 159.8 198.1 GeForce GTX 1070 Ti 47.9 188.5 232.2 GeForce GTX 1080 43.1 188.3 231.2 GeForce GTX 1080 Ti 124.1 233.8 303.8 GeForce RTX 2080 Ti 59.1 264.7 341.2 OpenBenchmarking.org Watts, Fewer Is Better NVIDIA GPU Cloud TensorFlow 18.09 System Power Consumption Monitor 80 160 240 320 400
NVIDIA GPU Cloud TensorFlow GPU Temperature Monitor Min Avg Max GeForce GTX 1070 57.0 65.4 70.0 GeForce GTX 1070 Ti 48.0 57.3 62.0 GeForce GTX 1080 59.0 67.7 73.0 GeForce GTX 1080 Ti 65.0 73.2 79.0 GeForce RTX 2080 Ti 57.0 65.5 71.0 OpenBenchmarking.org Celsius, Fewer Is Better NVIDIA GPU Cloud TensorFlow 18.09 GPU Temperature Monitor 20 40 60 80 100
NVIDIA GPU Cloud TensorFlow Test: VGG-16, FP32 OpenBenchmarking.org Images Per Second Per Watt, More Is Better NVIDIA GPU Cloud TensorFlow 18.09 Test: VGG-16, FP32 GeForce GTX 1070 GeForce GTX 1070 Ti GeForce GTX 1080 GeForce GTX 1080 Ti GeForce RTX 2080 Ti 0.1283 0.2566 0.3849 0.5132 0.6415 0.45 0.42 0.44 0.51 0.57
NVIDIA GPU Cloud TensorFlow System Power Consumption Monitor Min Avg Max GeForce GTX 1060 63.5 155.4 180.2 GeForce GTX 1070 82.9 164.7 198.5 GeForce GTX 1070 Ti 95.0 193.1 238.7 GeForce GTX 1080 81.9 197.5 241.1 GeForce GTX 1080 Ti 51.2 223.1 303.0 GeForce GTX 980 Ti 79.6 247.2 314.7 GeForce RTX 2080 Ti 60.4 243.5 339.6 OpenBenchmarking.org Watts, Fewer Is Better NVIDIA GPU Cloud TensorFlow 18.09 System Power Consumption Monitor 80 160 240 320 400
NVIDIA GPU Cloud TensorFlow GPU Temperature Monitor Min Avg Max GeForce GTX 1060 43.0 60.1 67.0 GeForce GTX 1070 49.0 62.5 69.0 GeForce GTX 1070 Ti 43.0 55.2 62.0 GeForce GTX 1080 50.0 64.1 72.0 GeForce GTX 1080 Ti 63.0 72.0 78.0 GeForce GTX 980 Ti 63.0 78.3 83.0 GeForce RTX 2080 Ti 57.0 62.7 67.0 OpenBenchmarking.org Celsius, Fewer Is Better NVIDIA GPU Cloud TensorFlow 18.09 GPU Temperature Monitor 20 40 60 80 100
NVIDIA GPU Cloud TensorFlow Test: VGG-16, FP16 OpenBenchmarking.org Images Per Second Per Watt, More Is Better NVIDIA GPU Cloud TensorFlow 18.09 Test: VGG-16, FP16 GeForce GTX 1060 GeForce GTX 1070 GeForce GTX 1070 Ti GeForce GTX 1080 GeForce GTX 1080 Ti GeForce GTX 980 Ti GeForce RTX 2080 Ti 0.1913 0.3826 0.5739 0.7652 0.9565 0.36 0.47 0.46 0.47 0.59 0.32 0.85
NVIDIA GPU Cloud TensorFlow System Power Consumption Monitor Min Avg Max GeForce GTX 1080 Ti 55.5 220.0 322.2 GeForce RTX 2080 Ti 58.7 227.6 343.5 OpenBenchmarking.org Watts, Fewer Is Better NVIDIA GPU Cloud TensorFlow 18.09 System Power Consumption Monitor 80 160 240 320 400
NVIDIA GPU Cloud TensorFlow GPU Temperature Monitor Min Avg Max GeForce GTX 1080 Ti 55.0 67.8 79.0 GeForce RTX 2080 Ti 51.0 59.9 68.0 OpenBenchmarking.org Celsius, Fewer Is Better NVIDIA GPU Cloud TensorFlow 18.09 GPU Temperature Monitor 20 40 60 80 100
NVIDIA GPU Cloud TensorFlow Test: Inception v4, FP32 OpenBenchmarking.org Images Per Second Per Watt, More Is Better NVIDIA GPU Cloud TensorFlow 18.09 Test: Inception v4, FP32 GeForce GTX 1080 Ti GeForce RTX 2080 Ti 0.0878 0.1756 0.2634 0.3512 0.439 0.30 0.39
NVIDIA GPU Cloud TensorFlow System Power Consumption Monitor Min Avg Max GeForce GTX 1060 68.9 148.3 184.9 GeForce GTX 1070 66.4 161.2 208.3 GeForce GTX 1070 Ti 77.2 177.3 247.8 GeForce GTX 1080 65.2 177.0 250.2 GeForce GTX 1080 Ti 53.4 201.0 314.9 GeForce GTX 980 Ti 75.2 223.6 316.6 GeForce RTX 2080 Ti 60.3 195.7 336.9 OpenBenchmarking.org Watts, Fewer Is Better NVIDIA GPU Cloud TensorFlow 18.09 System Power Consumption Monitor 80 160 240 320 400
NVIDIA GPU Cloud TensorFlow GPU Temperature Monitor Min Avg Max GeForce GTX 1060 44.0 60.8 70.0 GeForce GTX 1070 49.0 62.1 71.0 GeForce GTX 1070 Ti 41.0 53.7 64.0 GeForce GTX 1080 49.0 62.7 75.0 GeForce GTX 1080 Ti 58.0 67.8 78.0 GeForce GTX 980 Ti 59.0 74.1 84.0 GeForce RTX 2080 Ti 54.0 59.2 65.0 OpenBenchmarking.org Celsius, Fewer Is Better NVIDIA GPU Cloud TensorFlow 18.09 GPU Temperature Monitor 20 40 60 80 100
NVIDIA GPU Cloud TensorFlow Test: Inception v4, FP16 OpenBenchmarking.org Images Per Second Per Watt, More Is Better NVIDIA GPU Cloud TensorFlow 18.09 Test: Inception v4, FP16 GeForce GTX 1060 GeForce GTX 1070 GeForce GTX 1070 Ti GeForce GTX 1080 GeForce GTX 1080 Ti GeForce GTX 980 Ti GeForce RTX 2080 Ti 0.1553 0.3106 0.4659 0.6212 0.7765 0.22 0.28 0.30 0.31 0.37 0.18 0.69
NVIDIA GPU Cloud TensorFlow System Power Consumption Monitor Min Avg Max GeForce GTX 1080 Ti 52.3 256.7 309.5 GeForce RTX 2080 Ti 61.2 272.8 341.0 OpenBenchmarking.org Watts, Fewer Is Better NVIDIA GPU Cloud TensorFlow 18.09 System Power Consumption Monitor 80 160 240 320 400
NVIDIA GPU Cloud TensorFlow GPU Temperature Monitor Min Avg Max GeForce GTX 1080 Ti 63.0 74.2 81.0 GeForce RTX 2080 Ti 58.0 67.4 73.0 OpenBenchmarking.org Celsius, Fewer Is Better NVIDIA GPU Cloud TensorFlow 18.09 GPU Temperature Monitor 20 40 60 80 100
NVIDIA GPU Cloud TensorFlow Test: Googlenet, FP32 OpenBenchmarking.org Images Per Second Per Watt, More Is Better NVIDIA GPU Cloud TensorFlow 18.09 Test: Googlenet, FP32 GeForce GTX 1080 Ti GeForce RTX 2080 Ti 0.6278 1.2556 1.8834 2.5112 3.139 2.15 2.79
NVIDIA GPU Cloud TensorFlow System Power Consumption Monitor Min Avg Max GeForce GTX 1060 40.9 160.4 180.8 GeForce GTX 1070 85.6 183.0 207.8 GeForce GTX 1070 Ti 47.2 205.0 246.4 GeForce GTX 1080 41.5 203.8 245.6 GeForce GTX 1080 Ti 47.8 259.7 313.5 GeForce GTX 980 Ti 84.5 249.8 313.1 GeForce RTX 2080 Ti 59.6 244.7 336.9 OpenBenchmarking.org Watts, Fewer Is Better NVIDIA GPU Cloud TensorFlow 18.09 System Power Consumption Monitor 80 160 240 320 400
NVIDIA GPU Cloud TensorFlow GPU Temperature Monitor Min Avg Max GeForce GTX 1060 51.0 65.9 71.0 GeForce GTX 1070 58.0 69.4 74.0 GeForce GTX 1070 Ti 46.0 60.1 65.0 GeForce GTX 1080 57.0 70.8 77.0 GeForce GTX 1080 Ti 58.0 72.3 80.0 GeForce GTX 980 Ti 68.0 79.6 84.0 GeForce RTX 2080 Ti 54.0 64.3 70.0 OpenBenchmarking.org Celsius, Fewer Is Better NVIDIA GPU Cloud TensorFlow 18.09 GPU Temperature Monitor 20 40 60 80 100
NVIDIA GPU Cloud TensorFlow Test: Googlenet, FP16 OpenBenchmarking.org Images Per Second Per Watt, More Is Better NVIDIA GPU Cloud TensorFlow 18.09 Test: Googlenet, FP16 GeForce GTX 1060 GeForce GTX 1070 GeForce GTX 1070 Ti GeForce GTX 1080 GeForce GTX 1080 Ti GeForce GTX 980 Ti GeForce RTX 2080 Ti 0.927 1.854 2.781 3.708 4.635 1.63 2.05 2.21 2.25 2.43 1.43 4.12
NVIDIA GPU Cloud TensorFlow System Power Consumption Monitor Min Avg Max GeForce GTX 1060 69.2 142.1 176.5 GeForce GTX 1070 44.7 149.6 199.7 GeForce GTX 1070 Ti 56.9 169.3 228.0 GeForce GTX 1080 43.7 172.8 228.0 GeForce GTX 1080 Ti 68.7 203.8 298.4 GeForce GTX 980 Ti 110.7 228.6 304.8 GeForce RTX 2080 Ti 59.4 193.9 330.8 OpenBenchmarking.org Watts, Fewer Is Better NVIDIA GPU Cloud TensorFlow 18.09 System Power Consumption Monitor 80 160 240 320 400
NVIDIA GPU Cloud TensorFlow GPU Temperature Monitor Min Avg Max GeForce GTX 1060 45.0 55.2 62.0 GeForce GTX 1070 59.0 63.4 66.0 GeForce GTX 1070 Ti 49.0 55.3 59.0 GeForce GTX 1080 60.0 64.4 67.0 GeForce GTX 1080 Ti 61.0 64.9 68.0 GeForce GTX 980 Ti 62.0 73.1 80.0 GeForce RTX 2080 Ti 55.0 58.8 63.0 OpenBenchmarking.org Celsius, Fewer Is Better NVIDIA GPU Cloud TensorFlow 18.09 GPU Temperature Monitor 20 40 60 80 100
NVIDIA GPU Cloud TensorFlow Test: AlexNet, FP16 OpenBenchmarking.org Images Per Second Per Watt, More Is Better NVIDIA GPU Cloud TensorFlow 18.09 Test: AlexNet, FP16 GeForce GTX 1060 GeForce GTX 1070 GeForce GTX 1070 Ti GeForce GTX 1080 GeForce GTX 1080 Ti GeForce GTX 980 Ti GeForce RTX 2080 Ti 5 10 15 20 25 7.67 10.47 10.60 10.85 13.12 6.81 22.74
NVIDIA GPU Cloud TensorFlow System Power Consumption Monitor Min Avg Max GeForce GTX 1070 43.6 170.0 208.2 GeForce GTX 1070 Ti 48.0 183.0 236.8 GeForce GTX 1080 65.8 192.5 240.7 GeForce GTX 1080 Ti 74.8 230.1 312.5 GeForce RTX 2080 Ti 57.1 238.2 339.5 OpenBenchmarking.org Watts, Fewer Is Better NVIDIA GPU Cloud TensorFlow 18.09 System Power Consumption Monitor 80 160 240 320 400
NVIDIA GPU Cloud TensorFlow GPU Temperature Monitor Min Avg Max GeForce GTX 1070 53.0 63.3 70.0 GeForce GTX 1070 Ti 46.0 56.6 62.0 GeForce GTX 1080 55.0 64.9 72.0 GeForce GTX 1080 Ti 57.0 65.8 74.0 GeForce RTX 2080 Ti 47.0 56.9 66.0 OpenBenchmarking.org Celsius, Fewer Is Better NVIDIA GPU Cloud TensorFlow 18.09 GPU Temperature Monitor 20 40 60 80 100
NVIDIA GPU Cloud TensorFlow Test: ResNet-50, FP32 OpenBenchmarking.org Images Per Second Per Watt, More Is Better NVIDIA GPU Cloud TensorFlow 18.09 Test: ResNet-50, FP32 GeForce GTX 1070 GeForce GTX 1070 Ti GeForce GTX 1080 GeForce GTX 1080 Ti GeForce RTX 2080 Ti 0.2678 0.5356 0.8034 1.0712 1.339 0.74 0.75 0.74 0.91 1.19
NVIDIA GPU Cloud TensorFlow System Power Consumption Monitor Min Avg Max GeForce GTX 1060 60.5 153.4 184.1 GeForce GTX 1070 69.0 165.6 209.3 GeForce GTX 1070 Ti 77.1 182.3 240.6 GeForce GTX 1080 41.4 178.0 241.8 GeForce GTX 1080 Ti 99.4 229.4 312.0 GeForce GTX 980 Ti 83.0 232.1 304.2 GeForce RTX 2080 Ti 57.3 208.5 336.0 OpenBenchmarking.org Watts, Fewer Is Better NVIDIA GPU Cloud TensorFlow 18.09 System Power Consumption Monitor 80 160 240 320 400
NVIDIA GPU Cloud TensorFlow GPU Temperature Monitor Min Avg Max GeForce GTX 1060 32.0 53.3 65.0 GeForce GTX 1070 36.0 54.0 66.0 GeForce GTX 1070 Ti 36.0 51.1 60.0 GeForce GTX 1080 31.0 54.0 68.0 GeForce GTX 1080 Ti 40.0 57.8 69.0 GeForce GTX 980 Ti 38.0 66.7 82.0 GeForce RTX 2080 Ti 37.0 47.0 56.0 OpenBenchmarking.org Celsius, Fewer Is Better NVIDIA GPU Cloud TensorFlow 18.09 GPU Temperature Monitor 20 40 60 80 100
NVIDIA GPU Cloud TensorFlow Test: ResNet-50, FP16 OpenBenchmarking.org Images Per Second Per Watt, More Is Better NVIDIA GPU Cloud TensorFlow 18.09 Test: ResNet-50, FP16 GeForce GTX 1060 GeForce GTX 1070 GeForce GTX 1070 Ti GeForce GTX 1080 GeForce GTX 1080 Ti GeForce GTX 980 Ti GeForce RTX 2080 Ti 0.4905 0.981 1.4715 1.962 2.4525 0.76 0.98 1.03 1.09 1.19 0.66 2.18
Phoronix Test Suite v10.8.4