NGC TensorFlow NVIDIA GeForce RTX 2080 Ti NVIDIA GPU Cloud TensorFlow benchmarks with ResNet-50, AlexNet, Googlenet, Inception V4, VGG-16. NVIDIA GPU benchmarks on Ubuntu Linux by Michael Larabel for a future article on Phoronix.com.
HTML result view exported from: https://openbenchmarking.org/result/1810085-SKEE-181007067&grr&sor .
NGC TensorFlow NVIDIA GeForce RTX 2080 Ti Processor Motherboard Chipset Memory Disk Graphics Audio Monitor Network OS Kernel Desktop Display Server Display Driver OpenGL Compiler File-System Screen Resolution GeForce GTX 980 Ti GeForce GTX 1060 GeForce GTX 1070 GeForce GTX 1070 Ti GeForce GTX 1080 GeForce GTX 1080 Ti GeForce RTX 2080 Ti Zotac RTX 2080 Amp Intel Core i7-8086K @ 5.00GHz (6 Cores / 12 Threads) ASUS PRIME Z370-A (1002 BIOS) Intel Device 3ec2 16384MB 525GB SABRENT + 118GB INTEL SSDPEK1W120GA NVIDIA GeForce GTX 980 Ti 6GB (999/3505MHz) Realtek ALC1220 Acer B286HK Intel Connection Ubuntu 18.04 4.19.0-041900rc6-generic (x86_64) 20180930 GNOME Shell 3.28.3 X Server 1.19.6 NVIDIA 410.57 4.6.0 GCC 7.3.0 + CUDA 10.0 ext4 3840x2160 NVIDIA GeForce GTX 1060 6GB (1506/4006MHz) NVIDIA GeForce GTX 1070 8GB (1506/4006MHz) Zotac NVIDIA GeForce GTX 1070 Ti 8GB (1607/4006MHz) NVIDIA GeForce GTX 1080 8GB (1607/5005MHz) NVIDIA GeForce GTX 1080 Ti 11GB (1480/5508MHz) NVIDIA GeForce RTX 2080 Ti 11GB (1350/7000MHz) Intel Core i7-8086K @ 5.10GHz (6 Cores / 12 Threads) ASRock Z370 Extreme4 (P3.10 BIOS) 4001GB Western Digital WD40EMRX-82U + 1500GB EARS-00Z5B1 + 240GB Force MP300 + 1000GB Samsung SSD 970 EVO 1TB Zotac NVIDIA GeForce RTX 2080 8192MB (1515/7489MHz) VX2439wm LinuxMint 19 4.19.0-rc7-vhm (x86_64) 20181008 Cinnamon 3.8.9 GCC 8.2.0 1920x1080 OpenBenchmarking.org Processor Details - Scaling Governor: intel_pstate performance Security Details - GeForce GTX 980 Ti: KPTI + __user pointer sanitization + Full generic retpoline IBPB IBRS_FW + SSB disabled via prctl and seccomp + PTE Inversion; VMX: conditional cache flushes SMT vulnerable - GeForce GTX 1060: KPTI + __user pointer sanitization + Full generic retpoline IBPB IBRS_FW + SSB disabled via prctl and seccomp + PTE Inversion; VMX: conditional cache flushes SMT vulnerable - GeForce GTX 1070: KPTI + __user pointer sanitization + Full generic retpoline IBPB IBRS_FW + SSB disabled via prctl and seccomp + PTE Inversion; VMX: conditional cache flushes SMT vulnerable - GeForce GTX 1070 Ti: KPTI + __user pointer sanitization + Full generic retpoline IBPB IBRS_FW + SSB disabled via prctl and seccomp + PTE Inversion; VMX: conditional cache flushes SMT vulnerable - GeForce GTX 1080: KPTI + __user pointer sanitization + Full generic retpoline IBPB IBRS_FW + SSB disabled via prctl and seccomp + PTE Inversion; VMX: conditional cache flushes SMT vulnerable - GeForce GTX 1080 Ti: KPTI + __user pointer sanitization + Full generic retpoline IBPB IBRS_FW + SSB disabled via prctl and seccomp + PTE Inversion; VMX: conditional cache flushes SMT vulnerable - GeForce RTX 2080 Ti: KPTI + __user pointer sanitization + Full generic retpoline IBPB IBRS_FW + SSB disabled via prctl and seccomp + PTE Inversion; VMX: conditional cache flushes SMT vulnerable - Zotac RTX 2080 Amp: KPTI + __user pointer sanitization + Full generic retpoline IBPB IBRS_FW + SSB disabled via prctl and seccomp + PTE Inversion
NGC TensorFlow NVIDIA GeForce RTX 2080 Ti ngc-tensorflow: Inception v4, FP16 ngc-tensorflow: Inception v4, FP32 ngc-tensorflow: Googlenet, FP16 ngc-tensorflow: Googlenet, FP32 ngc-tensorflow: ResNet-50, FP32 ngc-tensorflow: ResNet-50, FP16 ngc-tensorflow: VGG-16, FP16 ngc-tensorflow: VGG-16, FP32 ngc-tensorflow: AlexNet, FP16 GeForce GTX 980 Ti GeForce GTX 1060 GeForce GTX 1070 GeForce GTX 1070 Ti GeForce GTX 1080 GeForce GTX 1080 Ti GeForce RTX 2080 Ti Zotac RTX 2080 Amp 40.93 358 153 78.50 1558 32.03 261 116 55.50 1090 44.70 375 125 162 77.30 71.73 1566 54 452 138 187 89.47 79.27 1794 54.97 458 143 194 93.20 82.93 1875 74.50 65.97 631 552 210 272 131 119 2674 134.20 89.23 1009 761 284 455 206 152 4410 OpenBenchmarking.org
NVIDIA GPU Cloud TensorFlow Test: Inception v4, FP16 OpenBenchmarking.org Images Per Second, More Is Better NVIDIA GPU Cloud TensorFlow 18.09 Test: Inception v4, FP16 GeForce RTX 2080 Ti GeForce GTX 1080 Ti GeForce GTX 1080 GeForce GTX 1070 Ti GeForce GTX 1070 GeForce GTX 980 Ti GeForce GTX 1060 30 60 90 120 150 SE +/- 0.23, N = 3 SE +/- 0.10, N = 3 SE +/- 0.03, N = 3 SE +/- 0.00, N = 3 SE +/- 0.03, N = 3 SE +/- 0.03, N = 3 134.20 74.50 54.97 54.00 44.70 40.93 32.03
NVIDIA GPU Cloud TensorFlow Test: Inception v4, FP32 OpenBenchmarking.org Images Per Second, More Is Better NVIDIA GPU Cloud TensorFlow 18.09 Test: Inception v4, FP32 GeForce RTX 2080 Ti GeForce GTX 1080 Ti 20 40 60 80 100 SE +/- 0.09, N = 3 SE +/- 0.03, N = 3 89.23 65.97
NVIDIA GPU Cloud TensorFlow Test: Googlenet, FP16 OpenBenchmarking.org Images Per Second, More Is Better NVIDIA GPU Cloud TensorFlow 18.09 Test: Googlenet, FP16 GeForce RTX 2080 Ti GeForce GTX 1080 Ti GeForce GTX 1080 GeForce GTX 1070 Ti GeForce GTX 1070 GeForce GTX 980 Ti GeForce GTX 1060 200 400 600 800 1000 SE +/- 1.58, N = 3 SE +/- 2.54, N = 3 SE +/- 0.15, N = 3 SE +/- 0.32, N = 3 SE +/- 0.22, N = 3 SE +/- 1.85, N = 3 SE +/- 0.40, N = 3 1009 631 458 452 375 358 261
NVIDIA GPU Cloud TensorFlow Test: Googlenet, FP32 OpenBenchmarking.org Images Per Second, More Is Better NVIDIA GPU Cloud TensorFlow 18.09 Test: Googlenet, FP32 GeForce RTX 2080 Ti GeForce GTX 1080 Ti 160 320 480 640 800 SE +/- 0.45, N = 3 SE +/- 0.37, N = 3 761 552
NVIDIA GPU Cloud TensorFlow Test: ResNet-50, FP32 OpenBenchmarking.org Images Per Second, More Is Better NVIDIA GPU Cloud TensorFlow 18.09 Test: ResNet-50, FP32 GeForce RTX 2080 Ti GeForce GTX 1080 Ti GeForce GTX 1080 GeForce GTX 1070 Ti GeForce GTX 1070 60 120 180 240 300 SE +/- 0.27, N = 3 SE +/- 0.19, N = 3 SE +/- 0.06, N = 3 SE +/- 0.03, N = 3 SE +/- 0.15, N = 3 284 210 143 138 125
NVIDIA GPU Cloud TensorFlow Test: ResNet-50, FP16 OpenBenchmarking.org Images Per Second, More Is Better NVIDIA GPU Cloud TensorFlow 18.09 Test: ResNet-50, FP16 GeForce RTX 2080 Ti GeForce GTX 1080 Ti GeForce GTX 1080 GeForce GTX 1070 Ti GeForce GTX 1070 GeForce GTX 980 Ti GeForce GTX 1060 100 200 300 400 500 SE +/- 4.02, N = 3 SE +/- 0.39, N = 3 SE +/- 0.44, N = 3 SE +/- 0.32, N = 3 SE +/- 0.32, N = 3 SE +/- 0.76, N = 3 SE +/- 0.23, N = 3 455 272 194 187 162 153 116
NVIDIA GPU Cloud TensorFlow Test: VGG-16, FP16 OpenBenchmarking.org Images Per Second, More Is Better NVIDIA GPU Cloud TensorFlow 18.09 Test: VGG-16, FP16 GeForce RTX 2080 Ti GeForce GTX 1080 Ti GeForce GTX 1080 GeForce GTX 1070 Ti GeForce GTX 980 Ti GeForce GTX 1070 GeForce GTX 1060 50 100 150 200 250 SE +/- 0.12, N = 3 SE +/- 0.07, N = 3 SE +/- 0.15, N = 3 SE +/- 0.12, N = 3 SE +/- 0.31, N = 3 SE +/- 0.15, N = 3 SE +/- 0.10, N = 3 206.00 131.00 93.20 89.47 78.50 77.30 55.50
NVIDIA GPU Cloud TensorFlow Test: VGG-16, FP32 OpenBenchmarking.org Images Per Second, More Is Better NVIDIA GPU Cloud TensorFlow 18.09 Test: VGG-16, FP32 GeForce RTX 2080 Ti GeForce GTX 1080 Ti GeForce GTX 1080 GeForce GTX 1070 Ti GeForce GTX 1070 30 60 90 120 150 SE +/- 0.23, N = 3 SE +/- 0.09, N = 3 SE +/- 0.03, N = 3 SE +/- 0.03, N = 3 SE +/- 0.09, N = 3 152.00 119.00 82.93 79.27 71.73
NVIDIA GPU Cloud TensorFlow Test: AlexNet, FP16 OpenBenchmarking.org Images Per Second, More Is Better NVIDIA GPU Cloud TensorFlow 18.09 Test: AlexNet, FP16 GeForce RTX 2080 Ti GeForce GTX 1080 Ti GeForce GTX 1080 GeForce GTX 1070 Ti GeForce GTX 1070 GeForce GTX 980 Ti GeForce GTX 1060 900 1800 2700 3600 4500 SE +/- 4.74, N = 3 SE +/- 2.58, N = 3 SE +/- 2.46, N = 3 SE +/- 0.85, N = 3 SE +/- 2.52, N = 3 SE +/- 6.45, N = 3 SE +/- 1.46, N = 3 4410 2674 1875 1794 1566 1558 1090
NVIDIA GPU Cloud TensorFlow Performance / Cost - Test: Inception v4, FP32 OpenBenchmarking.org Images Per Second Per Dollar, More Is Better NVIDIA GPU Cloud TensorFlow 18.09 Performance / Cost - Test: Inception v4, FP32 GeForce GTX 1080 Ti GeForce RTX 2080 Ti 0.0203 0.0406 0.0609 0.0812 0.1015 0.09 0.07 1. GeForce GTX 1080 Ti: $699 reported cost. 2. GeForce RTX 2080 Ti: $1199 reported cost.
NVIDIA GPU Cloud TensorFlow Performance / Cost - Test: Googlenet, FP32 OpenBenchmarking.org Images Per Second Per Dollar, More Is Better NVIDIA GPU Cloud TensorFlow 18.09 Performance / Cost - Test: Googlenet, FP32 GeForce GTX 1080 Ti GeForce RTX 2080 Ti 0.1778 0.3556 0.5334 0.7112 0.889 0.79 0.63 1. GeForce GTX 1080 Ti: $699 reported cost. 2. GeForce RTX 2080 Ti: $1199 reported cost.
NVIDIA GPU Cloud TensorFlow Performance / Cost - Test: VGG-16, FP32 OpenBenchmarking.org Images Per Second Per Dollar, More Is Better NVIDIA GPU Cloud TensorFlow 18.09 Performance / Cost - Test: VGG-16, FP32 GeForce GTX 1070 Ti GeForce GTX 1080 Ti GeForce GTX 1080 GeForce RTX 2080 Ti 0.0428 0.0856 0.1284 0.1712 0.214 0.19 0.17 0.15 0.13 1. GeForce GTX 1070 Ti: $419 reported cost. 2. GeForce GTX 1080 Ti: $699 reported cost. 3. GeForce GTX 1080: $549 reported cost. 4. GeForce RTX 2080 Ti: $1199 reported cost.
NVIDIA GPU Cloud TensorFlow Performance / Cost - Test: VGG-16, FP16 OpenBenchmarking.org Images Per Second Per Dollar, More Is Better NVIDIA GPU Cloud TensorFlow 18.09 Performance / Cost - Test: VGG-16, FP16 GeForce GTX 1070 Ti GeForce GTX 1080 Ti GeForce RTX 2080 Ti GeForce GTX 1080 0.0473 0.0946 0.1419 0.1892 0.2365 0.21 0.19 0.17 0.17 1. GeForce GTX 1070 Ti: $419 reported cost. 2. GeForce GTX 1080 Ti: $699 reported cost. 3. GeForce RTX 2080 Ti: $1199 reported cost. 4. GeForce GTX 1080: $549 reported cost.
NVIDIA GPU Cloud TensorFlow Performance / Cost - Test: Inception v4, FP16 OpenBenchmarking.org Images Per Second Per Dollar, More Is Better NVIDIA GPU Cloud TensorFlow 18.09 Performance / Cost - Test: Inception v4, FP16 GeForce GTX 1070 Ti GeForce RTX 2080 Ti GeForce GTX 1080 Ti GeForce GTX 1080 0.0293 0.0586 0.0879 0.1172 0.1465 0.13 0.11 0.11 0.10 1. GeForce GTX 1070 Ti: $419 reported cost. 2. GeForce RTX 2080 Ti: $1199 reported cost. 3. GeForce GTX 1080 Ti: $699 reported cost. 4. GeForce GTX 1080: $549 reported cost.
NVIDIA GPU Cloud TensorFlow Performance / Cost - Test: Googlenet, FP16 OpenBenchmarking.org Images Per Second Per Dollar, More Is Better NVIDIA GPU Cloud TensorFlow 18.09 Performance / Cost - Test: Googlenet, FP16 GeForce GTX 1070 Ti GeForce GTX 1080 Ti GeForce RTX 2080 Ti GeForce GTX 1080 0.243 0.486 0.729 0.972 1.215 1.08 0.90 0.84 0.83 1. GeForce GTX 1070 Ti: $419 reported cost. 2. GeForce GTX 1080 Ti: $699 reported cost. 3. GeForce RTX 2080 Ti: $1199 reported cost. 4. GeForce GTX 1080: $549 reported cost.
NVIDIA GPU Cloud TensorFlow Performance / Cost - Test: AlexNet, FP16 OpenBenchmarking.org Images Per Second Per Dollar, More Is Better NVIDIA GPU Cloud TensorFlow 18.09 Performance / Cost - Test: AlexNet, FP16 GeForce GTX 1070 Ti GeForce GTX 1080 Ti GeForce RTX 2080 Ti GeForce GTX 1080 0.963 1.926 2.889 3.852 4.815 4.28 3.83 3.68 3.42 1. GeForce GTX 1070 Ti: $419 reported cost. 2. GeForce GTX 1080 Ti: $699 reported cost. 3. GeForce RTX 2080 Ti: $1199 reported cost. 4. GeForce GTX 1080: $549 reported cost.
NVIDIA GPU Cloud TensorFlow Performance / Cost - Test: ResNet-50, FP32 OpenBenchmarking.org Images Per Second Per Dollar, More Is Better NVIDIA GPU Cloud TensorFlow 18.09 Performance / Cost - Test: ResNet-50, FP32 GeForce GTX 1070 Ti GeForce GTX 1080 Ti GeForce GTX 1080 GeForce RTX 2080 Ti 0.0743 0.1486 0.2229 0.2972 0.3715 0.33 0.30 0.26 0.24 1. GeForce GTX 1070 Ti: $419 reported cost. 2. GeForce GTX 1080 Ti: $699 reported cost. 3. GeForce GTX 1080: $549 reported cost. 4. GeForce RTX 2080 Ti: $1199 reported cost.
NVIDIA GPU Cloud TensorFlow Performance / Cost - Test: ResNet-50, FP16 OpenBenchmarking.org Images Per Second Per Dollar, More Is Better NVIDIA GPU Cloud TensorFlow 18.09 Performance / Cost - Test: ResNet-50, FP16 GeForce GTX 1070 Ti GeForce GTX 1080 Ti GeForce RTX 2080 Ti GeForce GTX 1080 0.1013 0.2026 0.3039 0.4052 0.5065 0.45 0.39 0.38 0.35 1. GeForce GTX 1070 Ti: $419 reported cost. 2. GeForce GTX 1080 Ti: $699 reported cost. 3. GeForce RTX 2080 Ti: $1199 reported cost. 4. GeForce GTX 1080: $549 reported cost.
System Power Consumption Monitor Phoronix Test Suite System Monitoring OpenBenchmarking.org Watts System Power Consumption Monitor Phoronix Test Suite System Monitoring GeForce GTX 1060 GeForce GTX 1070 GeForce GTX 1070 Ti GeForce GTX 1080 GeForce GTX 980 Ti GeForce GTX 1080 Ti GeForce RTX 2080 Ti 60 120 180 240 300 Min: 40.9 / Avg: 130.9 / Max: 184.9 Min: 43.6 / Avg: 151 / Max: 209.3 Min: 47.2 / Avg: 165.34 / Max: 247.8 Min: 41.4 / Avg: 166.09 / Max: 250.2 Min: 50.4 / Avg: 198.17 / Max: 318 Min: 47.8 / Avg: 220.88 / Max: 322.2 Min: 56.8 / Avg: 224.04 / Max: 343.5
GPU Temperature Monitor Phoronix Test Suite System Monitoring OpenBenchmarking.org Celsius GPU Temperature Monitor Phoronix Test Suite System Monitoring GeForce GTX 1070 Ti GeForce GTX 1060 GeForce RTX 2080 Ti GeForce GTX 1070 GeForce GTX 1080 GeForce GTX 1080 Ti GeForce GTX 980 Ti 16 32 48 64 80 Min: 36 / Avg: 53.74 / Max: 65 Min: 32 / Avg: 57.12 / Max: 71 Min: 37 / Avg: 60.46 / Max: 73 Min: 36 / Avg: 61.58 / Max: 74 Min: 31 / Avg: 62.45 / Max: 77 Min: 40 / Avg: 68.6 / Max: 81 Min: 38 / Avg: 71.24 / Max: 84
NVIDIA GPU Cloud TensorFlow System Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better NVIDIA GPU Cloud TensorFlow 18.09 System Power Consumption Monitor GeForce GTX 1070 GeForce GTX 1080 GeForce GTX 1070 Ti GeForce GTX 1080 Ti GeForce RTX 2080 Ti 60 120 180 240 300 Min: 44.4 / Avg: 159.81 / Max: 198.1 Min: 43.1 / Avg: 188.27 / Max: 231.2 Min: 47.9 / Avg: 188.49 / Max: 232.2 Min: 124.1 / Avg: 233.77 / Max: 303.8 Min: 59.1 / Avg: 264.67 / Max: 341.2
NVIDIA GPU Cloud TensorFlow GPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better NVIDIA GPU Cloud TensorFlow 18.09 GPU Temperature Monitor GeForce GTX 1070 Ti GeForce GTX 1070 GeForce RTX 2080 Ti GeForce GTX 1080 GeForce GTX 1080 Ti 15 30 45 60 75 Min: 48 / Avg: 57.32 / Max: 62 Min: 57 / Avg: 65.39 / Max: 70 Min: 57 / Avg: 65.5 / Max: 71 Min: 59 / Avg: 67.66 / Max: 73 Min: 65 / Avg: 73.23 / Max: 79
NVIDIA GPU Cloud TensorFlow Test: VGG-16, FP32 OpenBenchmarking.org Images Per Second Per Watt, More Is Better NVIDIA GPU Cloud TensorFlow 18.09 Test: VGG-16, FP32 GeForce RTX 2080 Ti GeForce GTX 1080 Ti GeForce GTX 1070 GeForce GTX 1080 GeForce GTX 1070 Ti 0.1283 0.2566 0.3849 0.5132 0.6415 0.57 0.51 0.45 0.44 0.42
NVIDIA GPU Cloud TensorFlow System Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better NVIDIA GPU Cloud TensorFlow 18.09 System Power Consumption Monitor GeForce GTX 1060 GeForce GTX 1070 GeForce GTX 1070 Ti GeForce GTX 1080 GeForce GTX 1080 Ti GeForce RTX 2080 Ti GeForce GTX 980 Ti 60 120 180 240 300 Min: 63.5 / Avg: 155.42 / Max: 180.2 Min: 82.9 / Avg: 164.74 / Max: 198.5 Min: 95 / Avg: 193.14 / Max: 238.7 Min: 81.9 / Avg: 197.54 / Max: 241.1 Min: 51.2 / Avg: 223.09 / Max: 303 Min: 60.4 / Avg: 243.47 / Max: 339.6 Min: 79.6 / Avg: 247.19 / Max: 314.7
NVIDIA GPU Cloud TensorFlow GPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better NVIDIA GPU Cloud TensorFlow 18.09 GPU Temperature Monitor GeForce GTX 1070 Ti GeForce GTX 1060 GeForce GTX 1070 GeForce RTX 2080 Ti GeForce GTX 1080 GeForce GTX 1080 Ti GeForce GTX 980 Ti 16 32 48 64 80 Min: 43 / Avg: 55.17 / Max: 62 Min: 43 / Avg: 60.05 / Max: 67 Min: 49 / Avg: 62.45 / Max: 69 Min: 57 / Avg: 62.74 / Max: 67 Min: 50 / Avg: 64.14 / Max: 72 Min: 63 / Avg: 71.95 / Max: 78 Min: 63 / Avg: 78.28 / Max: 83
NVIDIA GPU Cloud TensorFlow Test: VGG-16, FP16 OpenBenchmarking.org Images Per Second Per Watt, More Is Better NVIDIA GPU Cloud TensorFlow 18.09 Test: VGG-16, FP16 GeForce RTX 2080 Ti GeForce GTX 1080 Ti GeForce GTX 1080 GeForce GTX 1070 GeForce GTX 1070 Ti GeForce GTX 1060 GeForce GTX 980 Ti 0.1913 0.3826 0.5739 0.7652 0.9565 0.85 0.59 0.47 0.47 0.46 0.36 0.32
NVIDIA GPU Cloud TensorFlow System Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better NVIDIA GPU Cloud TensorFlow 18.09 System Power Consumption Monitor GeForce GTX 1080 Ti GeForce RTX 2080 Ti 60 120 180 240 300 Min: 55.5 / Avg: 220.04 / Max: 322.2 Min: 58.7 / Avg: 227.62 / Max: 343.5
NVIDIA GPU Cloud TensorFlow GPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better NVIDIA GPU Cloud TensorFlow 18.09 GPU Temperature Monitor GeForce RTX 2080 Ti GeForce GTX 1080 Ti 15 30 45 60 75 Min: 51 / Avg: 59.85 / Max: 68 Min: 55 / Avg: 67.82 / Max: 79
NVIDIA GPU Cloud TensorFlow Test: Inception v4, FP32 OpenBenchmarking.org Images Per Second Per Watt, More Is Better NVIDIA GPU Cloud TensorFlow 18.09 Test: Inception v4, FP32 GeForce RTX 2080 Ti GeForce GTX 1080 Ti 0.0878 0.1756 0.2634 0.3512 0.439 0.39 0.30
NVIDIA GPU Cloud TensorFlow System Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better NVIDIA GPU Cloud TensorFlow 18.09 System Power Consumption Monitor GeForce GTX 1060 GeForce GTX 1070 GeForce GTX 1080 GeForce GTX 1070 Ti GeForce RTX 2080 Ti GeForce GTX 1080 Ti GeForce GTX 980 Ti 60 120 180 240 300 Min: 68.9 / Avg: 148.31 / Max: 184.9 Min: 66.4 / Avg: 161.19 / Max: 208.3 Min: 65.2 / Avg: 177.05 / Max: 250.2 Min: 77.2 / Avg: 177.34 / Max: 247.8 Min: 60.3 / Avg: 195.66 / Max: 336.9 Min: 53.4 / Avg: 200.96 / Max: 314.9 Min: 75.2 / Avg: 223.6 / Max: 316.6
NVIDIA GPU Cloud TensorFlow GPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better NVIDIA GPU Cloud TensorFlow 18.09 GPU Temperature Monitor GeForce GTX 1070 Ti GeForce RTX 2080 Ti GeForce GTX 1060 GeForce GTX 1070 GeForce GTX 1080 GeForce GTX 1080 Ti GeForce GTX 980 Ti 16 32 48 64 80 Min: 41 / Avg: 53.71 / Max: 64 Min: 54 / Avg: 59.24 / Max: 65 Min: 44 / Avg: 60.77 / Max: 70 Min: 49 / Avg: 62.1 / Max: 71 Min: 49 / Avg: 62.75 / Max: 75 Min: 58 / Avg: 67.77 / Max: 78 Min: 59 / Avg: 74.06 / Max: 84
NVIDIA GPU Cloud TensorFlow Test: Inception v4, FP16 OpenBenchmarking.org Images Per Second Per Watt, More Is Better NVIDIA GPU Cloud TensorFlow 18.09 Test: Inception v4, FP16 GeForce RTX 2080 Ti GeForce GTX 1080 Ti GeForce GTX 1080 GeForce GTX 1070 Ti GeForce GTX 1070 GeForce GTX 1060 GeForce GTX 980 Ti 0.1553 0.3106 0.4659 0.6212 0.7765 0.69 0.37 0.31 0.30 0.28 0.22 0.18
NVIDIA GPU Cloud TensorFlow System Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better NVIDIA GPU Cloud TensorFlow 18.09 System Power Consumption Monitor GeForce GTX 1080 Ti GeForce RTX 2080 Ti 60 120 180 240 300 Min: 52.3 / Avg: 256.65 / Max: 309.5 Min: 61.2 / Avg: 272.84 / Max: 341
NVIDIA GPU Cloud TensorFlow GPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better NVIDIA GPU Cloud TensorFlow 18.09 GPU Temperature Monitor GeForce RTX 2080 Ti GeForce GTX 1080 Ti 15 30 45 60 75 Min: 58 / Avg: 67.42 / Max: 73 Min: 63 / Avg: 74.18 / Max: 81
NVIDIA GPU Cloud TensorFlow Test: Googlenet, FP32 OpenBenchmarking.org Images Per Second Per Watt, More Is Better NVIDIA GPU Cloud TensorFlow 18.09 Test: Googlenet, FP32 GeForce RTX 2080 Ti GeForce GTX 1080 Ti 0.6278 1.2556 1.8834 2.5112 3.139 2.79 2.15
NVIDIA GPU Cloud TensorFlow System Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better NVIDIA GPU Cloud TensorFlow 18.09 System Power Consumption Monitor GeForce GTX 1060 GeForce GTX 1070 GeForce GTX 1080 GeForce GTX 1070 Ti GeForce RTX 2080 Ti GeForce GTX 980 Ti GeForce GTX 1080 Ti 60 120 180 240 300 Min: 40.9 / Avg: 160.4 / Max: 180.8 Min: 85.6 / Avg: 182.97 / Max: 207.8 Min: 41.5 / Avg: 203.76 / Max: 245.6 Min: 47.2 / Avg: 204.99 / Max: 246.4 Min: 59.6 / Avg: 244.65 / Max: 336.9 Min: 84.5 / Avg: 249.77 / Max: 313.1 Min: 47.8 / Avg: 259.74 / Max: 313.5
NVIDIA GPU Cloud TensorFlow GPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better NVIDIA GPU Cloud TensorFlow 18.09 GPU Temperature Monitor GeForce GTX 1070 Ti GeForce RTX 2080 Ti GeForce GTX 1060 GeForce GTX 1070 GeForce GTX 1080 GeForce GTX 1080 Ti GeForce GTX 980 Ti 16 32 48 64 80 Min: 46 / Avg: 60.1 / Max: 65 Min: 54 / Avg: 64.32 / Max: 70 Min: 51 / Avg: 65.92 / Max: 71 Min: 58 / Avg: 69.45 / Max: 74 Min: 57 / Avg: 70.78 / Max: 77 Min: 58 / Avg: 72.34 / Max: 80 Min: 68 / Avg: 79.63 / Max: 84
NVIDIA GPU Cloud TensorFlow Test: Googlenet, FP16 OpenBenchmarking.org Images Per Second Per Watt, More Is Better NVIDIA GPU Cloud TensorFlow 18.09 Test: Googlenet, FP16 GeForce RTX 2080 Ti GeForce GTX 1080 Ti GeForce GTX 1080 GeForce GTX 1070 Ti GeForce GTX 1070 GeForce GTX 1060 GeForce GTX 980 Ti 0.927 1.854 2.781 3.708 4.635 4.12 2.43 2.25 2.21 2.05 1.63 1.43
NVIDIA GPU Cloud TensorFlow System Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better NVIDIA GPU Cloud TensorFlow 18.09 System Power Consumption Monitor GeForce GTX 1060 GeForce GTX 1070 GeForce GTX 1070 Ti GeForce GTX 1080 GeForce RTX 2080 Ti GeForce GTX 1080 Ti GeForce GTX 980 Ti 60 120 180 240 300 Min: 69.2 / Avg: 142.13 / Max: 176.5 Min: 44.7 / Avg: 149.56 / Max: 199.7 Min: 56.9 / Avg: 169.31 / Max: 228 Min: 43.7 / Avg: 172.75 / Max: 228 Min: 59.4 / Avg: 193.94 / Max: 330.8 Min: 68.7 / Avg: 203.79 / Max: 298.4 Min: 110.7 / Avg: 228.63 / Max: 304.8
NVIDIA GPU Cloud TensorFlow GPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better NVIDIA GPU Cloud TensorFlow 18.09 GPU Temperature Monitor GeForce GTX 1060 GeForce GTX 1070 Ti GeForce RTX 2080 Ti GeForce GTX 1070 GeForce GTX 1080 GeForce GTX 1080 Ti GeForce GTX 980 Ti 15 30 45 60 75 Min: 45 / Avg: 55.2 / Max: 62 Min: 49 / Avg: 55.27 / Max: 59 Min: 55 / Avg: 58.82 / Max: 63 Min: 59 / Avg: 63.4 / Max: 66 Min: 60 / Avg: 64.38 / Max: 67 Min: 61 / Avg: 64.91 / Max: 68 Min: 62 / Avg: 73.06 / Max: 80
NVIDIA GPU Cloud TensorFlow Test: AlexNet, FP16 OpenBenchmarking.org Images Per Second Per Watt, More Is Better NVIDIA GPU Cloud TensorFlow 18.09 Test: AlexNet, FP16 GeForce RTX 2080 Ti GeForce GTX 1080 Ti GeForce GTX 1080 GeForce GTX 1070 Ti GeForce GTX 1070 GeForce GTX 1060 GeForce GTX 980 Ti 5 10 15 20 25 22.74 13.12 10.85 10.60 10.47 7.67 6.81
NVIDIA GPU Cloud TensorFlow System Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better NVIDIA GPU Cloud TensorFlow 18.09 System Power Consumption Monitor GeForce GTX 1070 GeForce GTX 1070 Ti GeForce GTX 1080 GeForce GTX 1080 Ti GeForce RTX 2080 Ti 60 120 180 240 300 Min: 43.6 / Avg: 170.02 / Max: 208.2 Min: 48 / Avg: 182.99 / Max: 236.8 Min: 65.8 / Avg: 192.52 / Max: 240.7 Min: 74.8 / Avg: 230.1 / Max: 312.5 Min: 57.1 / Avg: 238.23 / Max: 339.5
NVIDIA GPU Cloud TensorFlow GPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better NVIDIA GPU Cloud TensorFlow 18.09 GPU Temperature Monitor GeForce GTX 1070 Ti GeForce RTX 2080 Ti GeForce GTX 1070 GeForce GTX 1080 GeForce GTX 1080 Ti 14 28 42 56 70 Min: 46 / Avg: 56.59 / Max: 62 Min: 47 / Avg: 56.88 / Max: 66 Min: 53 / Avg: 63.25 / Max: 70 Min: 55 / Avg: 64.85 / Max: 72 Min: 57 / Avg: 65.78 / Max: 74
NVIDIA GPU Cloud TensorFlow Test: ResNet-50, FP32 OpenBenchmarking.org Images Per Second Per Watt, More Is Better NVIDIA GPU Cloud TensorFlow 18.09 Test: ResNet-50, FP32 GeForce RTX 2080 Ti GeForce GTX 1080 Ti GeForce GTX 1070 Ti GeForce GTX 1080 GeForce GTX 1070 0.2678 0.5356 0.8034 1.0712 1.339 1.19 0.91 0.75 0.74 0.74
NVIDIA GPU Cloud TensorFlow System Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better NVIDIA GPU Cloud TensorFlow 18.09 System Power Consumption Monitor GeForce GTX 1060 GeForce GTX 1070 GeForce GTX 1080 GeForce GTX 1070 Ti GeForce RTX 2080 Ti GeForce GTX 1080 Ti GeForce GTX 980 Ti 60 120 180 240 300 Min: 60.5 / Avg: 153.42 / Max: 184.1 Min: 69 / Avg: 165.58 / Max: 209.3 Min: 41.4 / Avg: 178.02 / Max: 241.8 Min: 77.1 / Avg: 182.32 / Max: 240.6 Min: 57.3 / Avg: 208.46 / Max: 336 Min: 99.4 / Avg: 229.38 / Max: 312 Min: 83 / Avg: 232.07 / Max: 304.2
NVIDIA GPU Cloud TensorFlow GPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better NVIDIA GPU Cloud TensorFlow 18.09 GPU Temperature Monitor GeForce RTX 2080 Ti GeForce GTX 1070 Ti GeForce GTX 1060 GeForce GTX 1080 GeForce GTX 1070 GeForce GTX 1080 Ti GeForce GTX 980 Ti 16 32 48 64 80 Min: 37 / Avg: 46.95 / Max: 56 Min: 36 / Avg: 51.14 / Max: 60 Min: 32 / Avg: 53.28 / Max: 65 Min: 31 / Avg: 53.96 / Max: 68 Min: 36 / Avg: 54 / Max: 66 Min: 40 / Avg: 57.78 / Max: 69 Min: 38 / Avg: 66.72 / Max: 82
NVIDIA GPU Cloud TensorFlow Test: ResNet-50, FP16 OpenBenchmarking.org Images Per Second Per Watt, More Is Better NVIDIA GPU Cloud TensorFlow 18.09 Test: ResNet-50, FP16 GeForce RTX 2080 Ti GeForce GTX 1080 Ti GeForce GTX 1080 GeForce GTX 1070 Ti GeForce GTX 1070 GeForce GTX 1060 GeForce GTX 980 Ti 0.4905 0.981 1.4715 1.962 2.4525 2.18 1.19 1.09 1.03 0.98 0.76 0.66
Phoronix Test Suite v10.8.5