NGC TensorFlow NVIDIA GeForce RTX 2080 Ti NVIDIA GPU Cloud TensorFlow benchmarks with ResNet-50, AlexNet, Googlenet, Inception V4, VGG-16. NVIDIA GPU benchmarks on Ubuntu Linux by Michael Larabel for a future article on Phoronix.com.
HTML result view exported from: https://openbenchmarking.org/result/1810085-SKEE-181007067&rdt .
NGC TensorFlow NVIDIA GeForce RTX 2080 Ti Processor Motherboard Chipset Memory Disk Graphics Audio Monitor Network OS Kernel Desktop Display Server Display Driver OpenGL Compiler File-System Screen Resolution GeForce RTX 2080 Ti GeForce GTX 1080 Ti GeForce GTX 1060 GeForce GTX 1070 GeForce GTX 980 Ti GeForce GTX 1080 GeForce GTX 1070 Ti Zotac RTX 2080 Amp Intel Core i7-8086K @ 5.00GHz (6 Cores / 12 Threads) ASUS PRIME Z370-A (1002 BIOS) Intel Device 3ec2 16384MB 525GB SABRENT + 118GB INTEL SSDPEK1W120GA NVIDIA GeForce RTX 2080 Ti 11GB (1350/7000MHz) Realtek ALC1220 Acer B286HK Intel Connection Ubuntu 18.04 4.19.0-041900rc6-generic (x86_64) 20180930 GNOME Shell 3.28.3 X Server 1.19.6 NVIDIA 410.57 4.6.0 GCC 7.3.0 + CUDA 10.0 ext4 3840x2160 NVIDIA GeForce GTX 1080 Ti 11GB (1480/5508MHz) NVIDIA GeForce GTX 1060 6GB (1506/4006MHz) NVIDIA GeForce GTX 1070 8GB (1506/4006MHz) NVIDIA GeForce GTX 980 Ti 6GB (999/3505MHz) NVIDIA GeForce GTX 1080 8GB (1607/5005MHz) Zotac NVIDIA GeForce GTX 1070 Ti 8GB (1607/4006MHz) Intel Core i7-8086K @ 5.10GHz (6 Cores / 12 Threads) ASRock Z370 Extreme4 (P3.10 BIOS) 4001GB Western Digital WD40EMRX-82U + 1500GB EARS-00Z5B1 + 240GB Force MP300 + 1000GB Samsung SSD 970 EVO 1TB Zotac NVIDIA GeForce RTX 2080 8192MB (1515/7489MHz) VX2439wm LinuxMint 19 4.19.0-rc7-vhm (x86_64) 20181008 Cinnamon 3.8.9 GCC 8.2.0 1920x1080 OpenBenchmarking.org Processor Details - Scaling Governor: intel_pstate performance Security Details - GeForce RTX 2080 Ti: KPTI + __user pointer sanitization + Full generic retpoline IBPB IBRS_FW + SSB disabled via prctl and seccomp + PTE Inversion; VMX: conditional cache flushes SMT vulnerable - GeForce GTX 1080 Ti: KPTI + __user pointer sanitization + Full generic retpoline IBPB IBRS_FW + SSB disabled via prctl and seccomp + PTE Inversion; VMX: conditional cache flushes SMT vulnerable - GeForce GTX 1060: KPTI + __user pointer sanitization + Full generic retpoline IBPB IBRS_FW + SSB disabled via prctl and seccomp + PTE Inversion; VMX: conditional cache flushes SMT vulnerable - GeForce GTX 1070: KPTI + __user pointer sanitization + Full generic retpoline IBPB IBRS_FW + SSB disabled via prctl and seccomp + PTE Inversion; VMX: conditional cache flushes SMT vulnerable - GeForce GTX 980 Ti: KPTI + __user pointer sanitization + Full generic retpoline IBPB IBRS_FW + SSB disabled via prctl and seccomp + PTE Inversion; VMX: conditional cache flushes SMT vulnerable - GeForce GTX 1080: KPTI + __user pointer sanitization + Full generic retpoline IBPB IBRS_FW + SSB disabled via prctl and seccomp + PTE Inversion; VMX: conditional cache flushes SMT vulnerable - GeForce GTX 1070 Ti: KPTI + __user pointer sanitization + Full generic retpoline IBPB IBRS_FW + SSB disabled via prctl and seccomp + PTE Inversion; VMX: conditional cache flushes SMT vulnerable - Zotac RTX 2080 Amp: KPTI + __user pointer sanitization + Full generic retpoline IBPB IBRS_FW + SSB disabled via prctl and seccomp + PTE Inversion
NGC TensorFlow NVIDIA GeForce RTX 2080 Ti ngc-tensorflow: ResNet-50, FP16 ngc-tensorflow: ResNet-50, FP32 ngc-tensorflow: AlexNet, FP16 ngc-tensorflow: Googlenet, FP16 ngc-tensorflow: Googlenet, FP32 ngc-tensorflow: Inception v4, FP16 ngc-tensorflow: Inception v4, FP32 ngc-tensorflow: VGG-16, FP16 ngc-tensorflow: VGG-16, FP32 GeForce RTX 2080 Ti GeForce GTX 1080 Ti GeForce GTX 1060 GeForce GTX 1070 GeForce GTX 980 Ti GeForce GTX 1080 GeForce GTX 1070 Ti Zotac RTX 2080 Amp 455 284 4410 1009 761 134.20 89.23 206 152 272 210 2674 631 552 74.50 65.97 131 119 116 1090 261 32.03 55.50 162 125 1566 375 44.70 77.30 71.73 153 1558 358 40.93 78.50 194 143 1875 458 54.97 93.20 82.93 187 138 1794 452 54 89.47 79.27 OpenBenchmarking.org
NVIDIA GPU Cloud TensorFlow Test: ResNet-50, FP16 OpenBenchmarking.org Images Per Second, More Is Better NVIDIA GPU Cloud TensorFlow 18.09 Test: ResNet-50, FP16 GeForce RTX 2080 Ti GeForce GTX 1080 Ti GeForce GTX 1060 GeForce GTX 1070 GeForce GTX 980 Ti GeForce GTX 1080 GeForce GTX 1070 Ti 100 200 300 400 500 SE +/- 4.02, N = 3 SE +/- 0.39, N = 3 SE +/- 0.23, N = 3 SE +/- 0.32, N = 3 SE +/- 0.76, N = 3 SE +/- 0.44, N = 3 SE +/- 0.32, N = 3 455 272 116 162 153 194 187
NVIDIA GPU Cloud TensorFlow Test: ResNet-50, FP16 OpenBenchmarking.org Images Per Second Per Watt, More Is Better NVIDIA GPU Cloud TensorFlow 18.09 Test: ResNet-50, FP16 GeForce RTX 2080 Ti GeForce GTX 1080 Ti GeForce GTX 1060 GeForce GTX 1070 GeForce GTX 980 Ti GeForce GTX 1080 GeForce GTX 1070 Ti 0.4905 0.981 1.4715 1.962 2.4525 2.18 1.19 0.76 0.98 0.66 1.09 1.03
NVIDIA GPU Cloud TensorFlow GPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better NVIDIA GPU Cloud TensorFlow 18.09 GPU Temperature Monitor GeForce RTX 2080 Ti GeForce GTX 1080 Ti GeForce GTX 1060 GeForce GTX 1070 GeForce GTX 980 Ti GeForce GTX 1080 GeForce GTX 1070 Ti 16 32 48 64 80 Min: 37 / Avg: 46.95 / Max: 56 Min: 40 / Avg: 57.78 / Max: 69 Min: 32 / Avg: 53.28 / Max: 65 Min: 36 / Avg: 54 / Max: 66 Min: 38 / Avg: 66.72 / Max: 82 Min: 31 / Avg: 53.96 / Max: 68 Min: 36 / Avg: 51.14 / Max: 60
NVIDIA GPU Cloud TensorFlow System Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better NVIDIA GPU Cloud TensorFlow 18.09 System Power Consumption Monitor GeForce RTX 2080 Ti GeForce GTX 1080 Ti GeForce GTX 1060 GeForce GTX 1070 GeForce GTX 980 Ti GeForce GTX 1080 GeForce GTX 1070 Ti 60 120 180 240 300 Min: 57.3 / Avg: 208.46 / Max: 336 Min: 99.4 / Avg: 229.38 / Max: 312 Min: 60.5 / Avg: 153.42 / Max: 184.1 Min: 69 / Avg: 165.58 / Max: 209.3 Min: 83 / Avg: 232.07 / Max: 304.2 Min: 41.4 / Avg: 178.02 / Max: 241.8 Min: 77.1 / Avg: 182.32 / Max: 240.6
NVIDIA GPU Cloud TensorFlow Test: ResNet-50, FP32 OpenBenchmarking.org Images Per Second, More Is Better NVIDIA GPU Cloud TensorFlow 18.09 Test: ResNet-50, FP32 GeForce RTX 2080 Ti GeForce GTX 1080 Ti GeForce GTX 1070 GeForce GTX 1080 GeForce GTX 1070 Ti 60 120 180 240 300 SE +/- 0.27, N = 3 SE +/- 0.19, N = 3 SE +/- 0.15, N = 3 SE +/- 0.06, N = 3 SE +/- 0.03, N = 3 284 210 125 143 138
NVIDIA GPU Cloud TensorFlow Test: ResNet-50, FP32 OpenBenchmarking.org Images Per Second Per Watt, More Is Better NVIDIA GPU Cloud TensorFlow 18.09 Test: ResNet-50, FP32 GeForce RTX 2080 Ti GeForce GTX 1080 Ti GeForce GTX 1070 GeForce GTX 1080 GeForce GTX 1070 Ti 0.2678 0.5356 0.8034 1.0712 1.339 1.19 0.91 0.74 0.74 0.75
NVIDIA GPU Cloud TensorFlow GPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better NVIDIA GPU Cloud TensorFlow 18.09 GPU Temperature Monitor GeForce RTX 2080 Ti GeForce GTX 1080 Ti GeForce GTX 1070 GeForce GTX 1080 GeForce GTX 1070 Ti 14 28 42 56 70 Min: 47 / Avg: 56.88 / Max: 66 Min: 57 / Avg: 65.78 / Max: 74 Min: 53 / Avg: 63.25 / Max: 70 Min: 55 / Avg: 64.85 / Max: 72 Min: 46 / Avg: 56.59 / Max: 62
NVIDIA GPU Cloud TensorFlow System Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better NVIDIA GPU Cloud TensorFlow 18.09 System Power Consumption Monitor GeForce RTX 2080 Ti GeForce GTX 1080 Ti GeForce GTX 1070 GeForce GTX 1080 GeForce GTX 1070 Ti 60 120 180 240 300 Min: 57.1 / Avg: 238.23 / Max: 339.5 Min: 74.8 / Avg: 230.1 / Max: 312.5 Min: 43.6 / Avg: 170.02 / Max: 208.2 Min: 65.8 / Avg: 192.52 / Max: 240.7 Min: 48 / Avg: 182.99 / Max: 236.8
NVIDIA GPU Cloud TensorFlow Test: AlexNet, FP16 OpenBenchmarking.org Images Per Second, More Is Better NVIDIA GPU Cloud TensorFlow 18.09 Test: AlexNet, FP16 GeForce RTX 2080 Ti GeForce GTX 1080 Ti GeForce GTX 1060 GeForce GTX 1070 GeForce GTX 980 Ti GeForce GTX 1080 GeForce GTX 1070 Ti 900 1800 2700 3600 4500 SE +/- 4.74, N = 3 SE +/- 2.58, N = 3 SE +/- 1.46, N = 3 SE +/- 2.52, N = 3 SE +/- 6.45, N = 3 SE +/- 2.46, N = 3 SE +/- 0.85, N = 3 4410 2674 1090 1566 1558 1875 1794
NVIDIA GPU Cloud TensorFlow Test: AlexNet, FP16 OpenBenchmarking.org Images Per Second Per Watt, More Is Better NVIDIA GPU Cloud TensorFlow 18.09 Test: AlexNet, FP16 GeForce RTX 2080 Ti GeForce GTX 1080 Ti GeForce GTX 1060 GeForce GTX 1070 GeForce GTX 980 Ti GeForce GTX 1080 GeForce GTX 1070 Ti 5 10 15 20 25 22.74 13.12 7.67 10.47 6.81 10.85 10.60
NVIDIA GPU Cloud TensorFlow GPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better NVIDIA GPU Cloud TensorFlow 18.09 GPU Temperature Monitor GeForce RTX 2080 Ti GeForce GTX 1080 Ti GeForce GTX 1060 GeForce GTX 1070 GeForce GTX 980 Ti GeForce GTX 1080 GeForce GTX 1070 Ti 15 30 45 60 75 Min: 55 / Avg: 58.82 / Max: 63 Min: 61 / Avg: 64.91 / Max: 68 Min: 45 / Avg: 55.2 / Max: 62 Min: 59 / Avg: 63.4 / Max: 66 Min: 62 / Avg: 73.06 / Max: 80 Min: 60 / Avg: 64.38 / Max: 67 Min: 49 / Avg: 55.27 / Max: 59
NVIDIA GPU Cloud TensorFlow System Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better NVIDIA GPU Cloud TensorFlow 18.09 System Power Consumption Monitor GeForce RTX 2080 Ti GeForce GTX 1080 Ti GeForce GTX 1060 GeForce GTX 1070 GeForce GTX 980 Ti GeForce GTX 1080 GeForce GTX 1070 Ti 60 120 180 240 300 Min: 59.4 / Avg: 193.94 / Max: 330.8 Min: 68.7 / Avg: 203.79 / Max: 298.4 Min: 69.2 / Avg: 142.13 / Max: 176.5 Min: 44.7 / Avg: 149.56 / Max: 199.7 Min: 110.7 / Avg: 228.63 / Max: 304.8 Min: 43.7 / Avg: 172.75 / Max: 228 Min: 56.9 / Avg: 169.31 / Max: 228
NVIDIA GPU Cloud TensorFlow Test: Googlenet, FP16 OpenBenchmarking.org Images Per Second, More Is Better NVIDIA GPU Cloud TensorFlow 18.09 Test: Googlenet, FP16 GeForce RTX 2080 Ti GeForce GTX 1080 Ti GeForce GTX 1060 GeForce GTX 1070 GeForce GTX 980 Ti GeForce GTX 1080 GeForce GTX 1070 Ti 200 400 600 800 1000 SE +/- 1.58, N = 3 SE +/- 2.54, N = 3 SE +/- 0.40, N = 3 SE +/- 0.22, N = 3 SE +/- 1.85, N = 3 SE +/- 0.15, N = 3 SE +/- 0.32, N = 3 1009 631 261 375 358 458 452
NVIDIA GPU Cloud TensorFlow Test: Googlenet, FP16 OpenBenchmarking.org Images Per Second Per Watt, More Is Better NVIDIA GPU Cloud TensorFlow 18.09 Test: Googlenet, FP16 GeForce RTX 2080 Ti GeForce GTX 1080 Ti GeForce GTX 1060 GeForce GTX 1070 GeForce GTX 980 Ti GeForce GTX 1080 GeForce GTX 1070 Ti 0.927 1.854 2.781 3.708 4.635 4.12 2.43 1.63 2.05 1.43 2.25 2.21
NVIDIA GPU Cloud TensorFlow GPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better NVIDIA GPU Cloud TensorFlow 18.09 GPU Temperature Monitor GeForce RTX 2080 Ti GeForce GTX 1080 Ti GeForce GTX 1060 GeForce GTX 1070 GeForce GTX 980 Ti GeForce GTX 1080 GeForce GTX 1070 Ti 16 32 48 64 80 Min: 54 / Avg: 64.32 / Max: 70 Min: 58 / Avg: 72.34 / Max: 80 Min: 51 / Avg: 65.92 / Max: 71 Min: 58 / Avg: 69.45 / Max: 74 Min: 68 / Avg: 79.63 / Max: 84 Min: 57 / Avg: 70.78 / Max: 77 Min: 46 / Avg: 60.1 / Max: 65
NVIDIA GPU Cloud TensorFlow System Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better NVIDIA GPU Cloud TensorFlow 18.09 System Power Consumption Monitor GeForce RTX 2080 Ti GeForce GTX 1080 Ti GeForce GTX 1060 GeForce GTX 1070 GeForce GTX 980 Ti GeForce GTX 1080 GeForce GTX 1070 Ti 60 120 180 240 300 Min: 59.6 / Avg: 244.65 / Max: 336.9 Min: 47.8 / Avg: 259.74 / Max: 313.5 Min: 40.9 / Avg: 160.4 / Max: 180.8 Min: 85.6 / Avg: 182.97 / Max: 207.8 Min: 84.5 / Avg: 249.77 / Max: 313.1 Min: 41.5 / Avg: 203.76 / Max: 245.6 Min: 47.2 / Avg: 204.99 / Max: 246.4
NVIDIA GPU Cloud TensorFlow Test: Googlenet, FP32 OpenBenchmarking.org Images Per Second, More Is Better NVIDIA GPU Cloud TensorFlow 18.09 Test: Googlenet, FP32 GeForce RTX 2080 Ti GeForce GTX 1080 Ti 160 320 480 640 800 SE +/- 0.45, N = 3 SE +/- 0.37, N = 3 761 552
NVIDIA GPU Cloud TensorFlow Test: Googlenet, FP32 OpenBenchmarking.org Images Per Second Per Watt, More Is Better NVIDIA GPU Cloud TensorFlow 18.09 Test: Googlenet, FP32 GeForce RTX 2080 Ti GeForce GTX 1080 Ti 0.6278 1.2556 1.8834 2.5112 3.139 2.79 2.15
NVIDIA GPU Cloud TensorFlow GPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better NVIDIA GPU Cloud TensorFlow 18.09 GPU Temperature Monitor GeForce RTX 2080 Ti GeForce GTX 1080 Ti 15 30 45 60 75 Min: 58 / Avg: 67.42 / Max: 73 Min: 63 / Avg: 74.18 / Max: 81
NVIDIA GPU Cloud TensorFlow System Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better NVIDIA GPU Cloud TensorFlow 18.09 System Power Consumption Monitor GeForce RTX 2080 Ti GeForce GTX 1080 Ti 60 120 180 240 300 Min: 61.2 / Avg: 272.84 / Max: 341 Min: 52.3 / Avg: 256.65 / Max: 309.5
NVIDIA GPU Cloud TensorFlow Test: Inception v4, FP16 OpenBenchmarking.org Images Per Second, More Is Better NVIDIA GPU Cloud TensorFlow 18.09 Test: Inception v4, FP16 GeForce RTX 2080 Ti GeForce GTX 1080 Ti GeForce GTX 1060 GeForce GTX 1070 GeForce GTX 980 Ti GeForce GTX 1080 GeForce GTX 1070 Ti 30 60 90 120 150 SE +/- 0.23, N = 3 SE +/- 0.10, N = 3 SE +/- 0.03, N = 3 SE +/- 0.00, N = 3 SE +/- 0.03, N = 3 SE +/- 0.03, N = 3 134.20 74.50 32.03 44.70 40.93 54.97 54.00
NVIDIA GPU Cloud TensorFlow Test: Inception v4, FP16 OpenBenchmarking.org Images Per Second Per Watt, More Is Better NVIDIA GPU Cloud TensorFlow 18.09 Test: Inception v4, FP16 GeForce RTX 2080 Ti GeForce GTX 1080 Ti GeForce GTX 1060 GeForce GTX 1070 GeForce GTX 980 Ti GeForce GTX 1080 GeForce GTX 1070 Ti 0.1553 0.3106 0.4659 0.6212 0.7765 0.69 0.37 0.22 0.28 0.18 0.31 0.30
NVIDIA GPU Cloud TensorFlow GPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better NVIDIA GPU Cloud TensorFlow 18.09 GPU Temperature Monitor GeForce RTX 2080 Ti GeForce GTX 1080 Ti GeForce GTX 1060 GeForce GTX 1070 GeForce GTX 980 Ti GeForce GTX 1080 GeForce GTX 1070 Ti 16 32 48 64 80 Min: 54 / Avg: 59.24 / Max: 65 Min: 58 / Avg: 67.77 / Max: 78 Min: 44 / Avg: 60.77 / Max: 70 Min: 49 / Avg: 62.1 / Max: 71 Min: 59 / Avg: 74.06 / Max: 84 Min: 49 / Avg: 62.75 / Max: 75 Min: 41 / Avg: 53.71 / Max: 64
NVIDIA GPU Cloud TensorFlow System Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better NVIDIA GPU Cloud TensorFlow 18.09 System Power Consumption Monitor GeForce RTX 2080 Ti GeForce GTX 1080 Ti GeForce GTX 1060 GeForce GTX 1070 GeForce GTX 980 Ti GeForce GTX 1080 GeForce GTX 1070 Ti 60 120 180 240 300 Min: 60.3 / Avg: 195.66 / Max: 336.9 Min: 53.4 / Avg: 200.96 / Max: 314.9 Min: 68.9 / Avg: 148.31 / Max: 184.9 Min: 66.4 / Avg: 161.19 / Max: 208.3 Min: 75.2 / Avg: 223.6 / Max: 316.6 Min: 65.2 / Avg: 177.05 / Max: 250.2 Min: 77.2 / Avg: 177.34 / Max: 247.8
NVIDIA GPU Cloud TensorFlow Test: Inception v4, FP32 OpenBenchmarking.org Images Per Second, More Is Better NVIDIA GPU Cloud TensorFlow 18.09 Test: Inception v4, FP32 GeForce RTX 2080 Ti GeForce GTX 1080 Ti 20 40 60 80 100 SE +/- 0.09, N = 3 SE +/- 0.03, N = 3 89.23 65.97
NVIDIA GPU Cloud TensorFlow Test: Inception v4, FP32 OpenBenchmarking.org Images Per Second Per Watt, More Is Better NVIDIA GPU Cloud TensorFlow 18.09 Test: Inception v4, FP32 GeForce RTX 2080 Ti GeForce GTX 1080 Ti 0.0878 0.1756 0.2634 0.3512 0.439 0.39 0.30
NVIDIA GPU Cloud TensorFlow GPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better NVIDIA GPU Cloud TensorFlow 18.09 GPU Temperature Monitor GeForce RTX 2080 Ti GeForce GTX 1080 Ti 15 30 45 60 75 Min: 51 / Avg: 59.85 / Max: 68 Min: 55 / Avg: 67.82 / Max: 79
NVIDIA GPU Cloud TensorFlow System Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better NVIDIA GPU Cloud TensorFlow 18.09 System Power Consumption Monitor GeForce RTX 2080 Ti GeForce GTX 1080 Ti 60 120 180 240 300 Min: 58.7 / Avg: 227.62 / Max: 343.5 Min: 55.5 / Avg: 220.04 / Max: 322.2
NVIDIA GPU Cloud TensorFlow Test: VGG-16, FP16 OpenBenchmarking.org Images Per Second, More Is Better NVIDIA GPU Cloud TensorFlow 18.09 Test: VGG-16, FP16 GeForce RTX 2080 Ti GeForce GTX 1080 Ti GeForce GTX 1060 GeForce GTX 1070 GeForce GTX 980 Ti GeForce GTX 1080 GeForce GTX 1070 Ti 50 100 150 200 250 SE +/- 0.12, N = 3 SE +/- 0.07, N = 3 SE +/- 0.10, N = 3 SE +/- 0.15, N = 3 SE +/- 0.31, N = 3 SE +/- 0.15, N = 3 SE +/- 0.12, N = 3 206.00 131.00 55.50 77.30 78.50 93.20 89.47
NVIDIA GPU Cloud TensorFlow Test: VGG-16, FP16 OpenBenchmarking.org Images Per Second Per Watt, More Is Better NVIDIA GPU Cloud TensorFlow 18.09 Test: VGG-16, FP16 GeForce RTX 2080 Ti GeForce GTX 1080 Ti GeForce GTX 1060 GeForce GTX 1070 GeForce GTX 980 Ti GeForce GTX 1080 GeForce GTX 1070 Ti 0.1913 0.3826 0.5739 0.7652 0.9565 0.85 0.59 0.36 0.47 0.32 0.47 0.46
NVIDIA GPU Cloud TensorFlow GPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better NVIDIA GPU Cloud TensorFlow 18.09 GPU Temperature Monitor GeForce RTX 2080 Ti GeForce GTX 1080 Ti GeForce GTX 1060 GeForce GTX 1070 GeForce GTX 980 Ti GeForce GTX 1080 GeForce GTX 1070 Ti 16 32 48 64 80 Min: 57 / Avg: 62.74 / Max: 67 Min: 63 / Avg: 71.95 / Max: 78 Min: 43 / Avg: 60.05 / Max: 67 Min: 49 / Avg: 62.45 / Max: 69 Min: 63 / Avg: 78.28 / Max: 83 Min: 50 / Avg: 64.14 / Max: 72 Min: 43 / Avg: 55.17 / Max: 62
NVIDIA GPU Cloud TensorFlow System Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better NVIDIA GPU Cloud TensorFlow 18.09 System Power Consumption Monitor GeForce RTX 2080 Ti GeForce GTX 1080 Ti GeForce GTX 1060 GeForce GTX 1070 GeForce GTX 980 Ti GeForce GTX 1080 GeForce GTX 1070 Ti 60 120 180 240 300 Min: 60.4 / Avg: 243.47 / Max: 339.6 Min: 51.2 / Avg: 223.09 / Max: 303 Min: 63.5 / Avg: 155.42 / Max: 180.2 Min: 82.9 / Avg: 164.74 / Max: 198.5 Min: 79.6 / Avg: 247.19 / Max: 314.7 Min: 81.9 / Avg: 197.54 / Max: 241.1 Min: 95 / Avg: 193.14 / Max: 238.7
NVIDIA GPU Cloud TensorFlow Test: VGG-16, FP32 OpenBenchmarking.org Images Per Second, More Is Better NVIDIA GPU Cloud TensorFlow 18.09 Test: VGG-16, FP32 GeForce RTX 2080 Ti GeForce GTX 1080 Ti GeForce GTX 1070 GeForce GTX 1080 GeForce GTX 1070 Ti 30 60 90 120 150 SE +/- 0.23, N = 3 SE +/- 0.09, N = 3 SE +/- 0.09, N = 3 SE +/- 0.03, N = 3 SE +/- 0.03, N = 3 152.00 119.00 71.73 82.93 79.27
NVIDIA GPU Cloud TensorFlow Test: VGG-16, FP32 OpenBenchmarking.org Images Per Second Per Watt, More Is Better NVIDIA GPU Cloud TensorFlow 18.09 Test: VGG-16, FP32 GeForce RTX 2080 Ti GeForce GTX 1080 Ti GeForce GTX 1070 GeForce GTX 1080 GeForce GTX 1070 Ti 0.1283 0.2566 0.3849 0.5132 0.6415 0.57 0.51 0.45 0.44 0.42
NVIDIA GPU Cloud TensorFlow GPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better NVIDIA GPU Cloud TensorFlow 18.09 GPU Temperature Monitor GeForce RTX 2080 Ti GeForce GTX 1080 Ti GeForce GTX 1070 GeForce GTX 1080 GeForce GTX 1070 Ti 15 30 45 60 75 Min: 57 / Avg: 65.5 / Max: 71 Min: 65 / Avg: 73.23 / Max: 79 Min: 57 / Avg: 65.39 / Max: 70 Min: 59 / Avg: 67.66 / Max: 73 Min: 48 / Avg: 57.32 / Max: 62
NVIDIA GPU Cloud TensorFlow System Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better NVIDIA GPU Cloud TensorFlow 18.09 System Power Consumption Monitor GeForce RTX 2080 Ti GeForce GTX 1080 Ti GeForce GTX 1070 GeForce GTX 1080 GeForce GTX 1070 Ti 60 120 180 240 300 Min: 59.1 / Avg: 264.67 / Max: 341.2 Min: 124.1 / Avg: 233.77 / Max: 303.8 Min: 44.4 / Avg: 159.81 / Max: 198.1 Min: 43.1 / Avg: 188.27 / Max: 231.2 Min: 47.9 / Avg: 188.49 / Max: 232.2
GPU Temperature Monitor Phoronix Test Suite System Monitoring OpenBenchmarking.org Celsius GPU Temperature Monitor Phoronix Test Suite System Monitoring GeForce RTX 2080 Ti GeForce GTX 1080 Ti GeForce GTX 1060 GeForce GTX 1070 GeForce GTX 980 Ti GeForce GTX 1080 GeForce GTX 1070 Ti 16 32 48 64 80 Min: 37 / Avg: 60.46 / Max: 73 Min: 40 / Avg: 68.6 / Max: 81 Min: 32 / Avg: 57.12 / Max: 71 Min: 36 / Avg: 61.58 / Max: 74 Min: 38 / Avg: 71.24 / Max: 84 Min: 31 / Avg: 62.45 / Max: 77 Min: 36 / Avg: 53.74 / Max: 65
System Power Consumption Monitor Phoronix Test Suite System Monitoring OpenBenchmarking.org Watts System Power Consumption Monitor Phoronix Test Suite System Monitoring GeForce RTX 2080 Ti GeForce GTX 1080 Ti GeForce GTX 1060 GeForce GTX 1070 GeForce GTX 980 Ti GeForce GTX 1080 GeForce GTX 1070 Ti 60 120 180 240 300 Min: 56.8 / Avg: 224.04 / Max: 343.5 Min: 47.8 / Avg: 220.88 / Max: 322.2 Min: 40.9 / Avg: 130.9 / Max: 184.9 Min: 43.6 / Avg: 151 / Max: 209.3 Min: 50.4 / Avg: 198.17 / Max: 318 Min: 41.4 / Avg: 166.09 / Max: 250.2 Min: 47.2 / Avg: 165.34 / Max: 247.8
NVIDIA GPU Cloud TensorFlow Performance / Cost - Test: ResNet-50, FP16 OpenBenchmarking.org Images Per Second Per Dollar, More Is Better NVIDIA GPU Cloud TensorFlow 18.09 Performance / Cost - Test: ResNet-50, FP16 GeForce RTX 2080 Ti GeForce GTX 1080 Ti GeForce GTX 1080 GeForce GTX 1070 Ti 0.1013 0.2026 0.3039 0.4052 0.5065 0.38 0.39 0.35 0.45 1. GeForce RTX 2080 Ti: $1199 reported cost. 2. GeForce GTX 1080 Ti: $699 reported cost. 3. GeForce GTX 1080: $549 reported cost. 4. GeForce GTX 1070 Ti: $419 reported cost.
NVIDIA GPU Cloud TensorFlow Performance / Cost - Test: ResNet-50, FP32 OpenBenchmarking.org Images Per Second Per Dollar, More Is Better NVIDIA GPU Cloud TensorFlow 18.09 Performance / Cost - Test: ResNet-50, FP32 GeForce RTX 2080 Ti GeForce GTX 1080 Ti GeForce GTX 1080 GeForce GTX 1070 Ti 0.0743 0.1486 0.2229 0.2972 0.3715 0.24 0.30 0.26 0.33 1. GeForce RTX 2080 Ti: $1199 reported cost. 2. GeForce GTX 1080 Ti: $699 reported cost. 3. GeForce GTX 1080: $549 reported cost. 4. GeForce GTX 1070 Ti: $419 reported cost.
NVIDIA GPU Cloud TensorFlow Performance / Cost - Test: AlexNet, FP16 OpenBenchmarking.org Images Per Second Per Dollar, More Is Better NVIDIA GPU Cloud TensorFlow 18.09 Performance / Cost - Test: AlexNet, FP16 GeForce RTX 2080 Ti GeForce GTX 1080 Ti GeForce GTX 1080 GeForce GTX 1070 Ti 0.963 1.926 2.889 3.852 4.815 3.68 3.83 3.42 4.28 1. GeForce RTX 2080 Ti: $1199 reported cost. 2. GeForce GTX 1080 Ti: $699 reported cost. 3. GeForce GTX 1080: $549 reported cost. 4. GeForce GTX 1070 Ti: $419 reported cost.
NVIDIA GPU Cloud TensorFlow Performance / Cost - Test: Googlenet, FP16 OpenBenchmarking.org Images Per Second Per Dollar, More Is Better NVIDIA GPU Cloud TensorFlow 18.09 Performance / Cost - Test: Googlenet, FP16 GeForce RTX 2080 Ti GeForce GTX 1080 Ti GeForce GTX 1080 GeForce GTX 1070 Ti 0.243 0.486 0.729 0.972 1.215 0.84 0.90 0.83 1.08 1. GeForce RTX 2080 Ti: $1199 reported cost. 2. GeForce GTX 1080 Ti: $699 reported cost. 3. GeForce GTX 1080: $549 reported cost. 4. GeForce GTX 1070 Ti: $419 reported cost.
NVIDIA GPU Cloud TensorFlow Performance / Cost - Test: Inception v4, FP16 OpenBenchmarking.org Images Per Second Per Dollar, More Is Better NVIDIA GPU Cloud TensorFlow 18.09 Performance / Cost - Test: Inception v4, FP16 GeForce RTX 2080 Ti GeForce GTX 1080 Ti GeForce GTX 1080 GeForce GTX 1070 Ti 0.0293 0.0586 0.0879 0.1172 0.1465 0.11 0.11 0.10 0.13 1. GeForce RTX 2080 Ti: $1199 reported cost. 2. GeForce GTX 1080 Ti: $699 reported cost. 3. GeForce GTX 1080: $549 reported cost. 4. GeForce GTX 1070 Ti: $419 reported cost.
NVIDIA GPU Cloud TensorFlow Performance / Cost - Test: VGG-16, FP16 OpenBenchmarking.org Images Per Second Per Dollar, More Is Better NVIDIA GPU Cloud TensorFlow 18.09 Performance / Cost - Test: VGG-16, FP16 GeForce RTX 2080 Ti GeForce GTX 1080 Ti GeForce GTX 1080 GeForce GTX 1070 Ti 0.0473 0.0946 0.1419 0.1892 0.2365 0.17 0.19 0.17 0.21 1. GeForce RTX 2080 Ti: $1199 reported cost. 2. GeForce GTX 1080 Ti: $699 reported cost. 3. GeForce GTX 1080: $549 reported cost. 4. GeForce GTX 1070 Ti: $419 reported cost.
NVIDIA GPU Cloud TensorFlow Performance / Cost - Test: VGG-16, FP32 OpenBenchmarking.org Images Per Second Per Dollar, More Is Better NVIDIA GPU Cloud TensorFlow 18.09 Performance / Cost - Test: VGG-16, FP32 GeForce RTX 2080 Ti GeForce GTX 1080 Ti GeForce GTX 1080 GeForce GTX 1070 Ti 0.0428 0.0856 0.1284 0.1712 0.214 0.13 0.17 0.15 0.19 1. GeForce RTX 2080 Ti: $1199 reported cost. 2. GeForce GTX 1080 Ti: $699 reported cost. 3. GeForce GTX 1080: $549 reported cost. 4. GeForce GTX 1070 Ti: $419 reported cost.
NVIDIA GPU Cloud TensorFlow Performance / Cost - Test: Googlenet, FP32 OpenBenchmarking.org Images Per Second Per Dollar, More Is Better NVIDIA GPU Cloud TensorFlow 18.09 Performance / Cost - Test: Googlenet, FP32 GeForce RTX 2080 Ti GeForce GTX 1080 Ti 0.1778 0.3556 0.5334 0.7112 0.889 0.63 0.79 1. GeForce RTX 2080 Ti: $1199 reported cost. 2. GeForce GTX 1080 Ti: $699 reported cost.
NVIDIA GPU Cloud TensorFlow Performance / Cost - Test: Inception v4, FP32 OpenBenchmarking.org Images Per Second Per Dollar, More Is Better NVIDIA GPU Cloud TensorFlow 18.09 Performance / Cost - Test: Inception v4, FP32 GeForce RTX 2080 Ti GeForce GTX 1080 Ti 0.0203 0.0406 0.0609 0.0812 0.1015 0.07 0.09 1. GeForce RTX 2080 Ti: $1199 reported cost. 2. GeForce GTX 1080 Ti: $699 reported cost.
Phoronix Test Suite v10.8.4