NGC TensorFlow NVIDIA GeForce RTX 2080 Ti NVIDIA GPU Cloud TensorFlow benchmarks with ResNet-50, AlexNet, Googlenet, Inception V4, VGG-16. NVIDIA GPU benchmarks on Ubuntu Linux by Michael Larabel for a future article on Phoronix.com.
HTML result view exported from: https://openbenchmarking.org/result/1810085-SKEE-181007067 .
NGC TensorFlow NVIDIA GeForce RTX 2080 Ti Processor Motherboard Chipset Memory Disk Graphics Audio Monitor Network OS Kernel Desktop Display Server Display Driver OpenGL Compiler File-System Screen Resolution GeForce GTX 980 Ti GeForce GTX 1060 GeForce GTX 1070 GeForce GTX 1070 Ti GeForce GTX 1080 GeForce GTX 1080 Ti GeForce RTX 2080 Ti Zotac RTX 2080 Amp Intel Core i7-8086K @ 5.00GHz (6 Cores / 12 Threads) ASUS PRIME Z370-A (1002 BIOS) Intel Device 3ec2 16384MB 525GB SABRENT + 118GB INTEL SSDPEK1W120GA NVIDIA GeForce GTX 980 Ti 6GB (999/3505MHz) Realtek ALC1220 Acer B286HK Intel Connection Ubuntu 18.04 4.19.0-041900rc6-generic (x86_64) 20180930 GNOME Shell 3.28.3 X Server 1.19.6 NVIDIA 410.57 4.6.0 GCC 7.3.0 + CUDA 10.0 ext4 3840x2160 NVIDIA GeForce GTX 1060 6GB (1506/4006MHz) NVIDIA GeForce GTX 1070 8GB (1506/4006MHz) Zotac NVIDIA GeForce GTX 1070 Ti 8GB (1607/4006MHz) NVIDIA GeForce GTX 1080 8GB (1607/5005MHz) NVIDIA GeForce GTX 1080 Ti 11GB (1480/5508MHz) NVIDIA GeForce RTX 2080 Ti 11GB (1350/7000MHz) Intel Core i7-8086K @ 5.10GHz (6 Cores / 12 Threads) ASRock Z370 Extreme4 (P3.10 BIOS) 4001GB Western Digital WD40EMRX-82U + 1500GB EARS-00Z5B1 + 240GB Force MP300 + 1000GB Samsung SSD 970 EVO 1TB Zotac NVIDIA GeForce RTX 2080 8192MB (1515/7489MHz) VX2439wm LinuxMint 19 4.19.0-rc7-vhm (x86_64) 20181008 Cinnamon 3.8.9 GCC 8.2.0 1920x1080 OpenBenchmarking.org Processor Details - Scaling Governor: intel_pstate performance Security Details - GeForce GTX 980 Ti: KPTI + __user pointer sanitization + Full generic retpoline IBPB IBRS_FW + SSB disabled via prctl and seccomp + PTE Inversion; VMX: conditional cache flushes SMT vulnerable - GeForce GTX 1060: KPTI + __user pointer sanitization + Full generic retpoline IBPB IBRS_FW + SSB disabled via prctl and seccomp + PTE Inversion; VMX: conditional cache flushes SMT vulnerable - GeForce GTX 1070: KPTI + __user pointer sanitization + Full generic retpoline IBPB IBRS_FW + SSB disabled via prctl and seccomp + PTE Inversion; VMX: conditional cache flushes SMT vulnerable - GeForce GTX 1070 Ti: KPTI + __user pointer sanitization + Full generic retpoline IBPB IBRS_FW + SSB disabled via prctl and seccomp + PTE Inversion; VMX: conditional cache flushes SMT vulnerable - GeForce GTX 1080: KPTI + __user pointer sanitization + Full generic retpoline IBPB IBRS_FW + SSB disabled via prctl and seccomp + PTE Inversion; VMX: conditional cache flushes SMT vulnerable - GeForce GTX 1080 Ti: KPTI + __user pointer sanitization + Full generic retpoline IBPB IBRS_FW + SSB disabled via prctl and seccomp + PTE Inversion; VMX: conditional cache flushes SMT vulnerable - GeForce RTX 2080 Ti: KPTI + __user pointer sanitization + Full generic retpoline IBPB IBRS_FW + SSB disabled via prctl and seccomp + PTE Inversion; VMX: conditional cache flushes SMT vulnerable - Zotac RTX 2080 Amp: KPTI + __user pointer sanitization + Full generic retpoline IBPB IBRS_FW + SSB disabled via prctl and seccomp + PTE Inversion
NGC TensorFlow NVIDIA GeForce RTX 2080 Ti ngc-tensorflow: ResNet-50, FP16 ngc-tensorflow: ResNet-50, FP32 ngc-tensorflow: AlexNet, FP16 ngc-tensorflow: Googlenet, FP16 ngc-tensorflow: Googlenet, FP32 ngc-tensorflow: Inception v4, FP16 ngc-tensorflow: Inception v4, FP32 ngc-tensorflow: VGG-16, FP16 ngc-tensorflow: VGG-16, FP32 GeForce GTX 980 Ti GeForce GTX 1060 GeForce GTX 1070 GeForce GTX 1070 Ti GeForce GTX 1080 GeForce GTX 1080 Ti GeForce RTX 2080 Ti Zotac RTX 2080 Amp 153 1558 358 40.93 78.50 116 1090 261 32.03 55.50 162 125 1566 375 44.70 77.30 71.73 187 138 1794 452 54 89.47 79.27 194 143 1875 458 54.97 93.20 82.93 272 210 2674 631 552 74.50 65.97 131 119 455 284 4410 1009 761 134.20 89.23 206 152 OpenBenchmarking.org
NVIDIA GPU Cloud TensorFlow Test: ResNet-50, FP16 OpenBenchmarking.org Images Per Second, More Is Better NVIDIA GPU Cloud TensorFlow 18.09 Test: ResNet-50, FP16 GeForce GTX 980 Ti GeForce GTX 1060 GeForce GTX 1070 GeForce GTX 1070 Ti GeForce GTX 1080 GeForce GTX 1080 Ti GeForce RTX 2080 Ti 100 200 300 400 500 SE +/- 0.76, N = 3 SE +/- 0.23, N = 3 SE +/- 0.32, N = 3 SE +/- 0.32, N = 3 SE +/- 0.44, N = 3 SE +/- 0.39, N = 3 SE +/- 4.02, N = 3 153 116 162 187 194 272 455
NVIDIA GPU Cloud TensorFlow Test: ResNet-50, FP16 OpenBenchmarking.org Images Per Second Per Watt, More Is Better NVIDIA GPU Cloud TensorFlow 18.09 Test: ResNet-50, FP16 GeForce GTX 980 Ti GeForce GTX 1060 GeForce GTX 1070 GeForce GTX 1070 Ti GeForce GTX 1080 GeForce GTX 1080 Ti GeForce RTX 2080 Ti 0.4905 0.981 1.4715 1.962 2.4525 0.66 0.76 0.98 1.03 1.09 1.19 2.18
NVIDIA GPU Cloud TensorFlow GPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better NVIDIA GPU Cloud TensorFlow 18.09 GPU Temperature Monitor GeForce GTX 980 Ti GeForce GTX 1060 GeForce GTX 1070 GeForce GTX 1070 Ti GeForce GTX 1080 GeForce GTX 1080 Ti GeForce RTX 2080 Ti 16 32 48 64 80 Min: 38 / Avg: 66.72 / Max: 82 Min: 32 / Avg: 53.28 / Max: 65 Min: 36 / Avg: 54 / Max: 66 Min: 36 / Avg: 51.14 / Max: 60 Min: 31 / Avg: 53.96 / Max: 68 Min: 40 / Avg: 57.78 / Max: 69 Min: 37 / Avg: 46.95 / Max: 56
NVIDIA GPU Cloud TensorFlow System Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better NVIDIA GPU Cloud TensorFlow 18.09 System Power Consumption Monitor GeForce GTX 980 Ti GeForce GTX 1060 GeForce GTX 1070 GeForce GTX 1070 Ti GeForce GTX 1080 GeForce GTX 1080 Ti GeForce RTX 2080 Ti 60 120 180 240 300 Min: 83 / Avg: 232.07 / Max: 304.2 Min: 60.5 / Avg: 153.42 / Max: 184.1 Min: 69 / Avg: 165.58 / Max: 209.3 Min: 77.1 / Avg: 182.32 / Max: 240.6 Min: 41.4 / Avg: 178.02 / Max: 241.8 Min: 99.4 / Avg: 229.38 / Max: 312 Min: 57.3 / Avg: 208.46 / Max: 336
NVIDIA GPU Cloud TensorFlow Test: ResNet-50, FP32 OpenBenchmarking.org Images Per Second, More Is Better NVIDIA GPU Cloud TensorFlow 18.09 Test: ResNet-50, FP32 GeForce GTX 1070 GeForce GTX 1070 Ti GeForce GTX 1080 GeForce GTX 1080 Ti GeForce RTX 2080 Ti 60 120 180 240 300 SE +/- 0.15, N = 3 SE +/- 0.03, N = 3 SE +/- 0.06, N = 3 SE +/- 0.19, N = 3 SE +/- 0.27, N = 3 125 138 143 210 284
NVIDIA GPU Cloud TensorFlow Test: ResNet-50, FP32 OpenBenchmarking.org Images Per Second Per Watt, More Is Better NVIDIA GPU Cloud TensorFlow 18.09 Test: ResNet-50, FP32 GeForce GTX 1070 GeForce GTX 1070 Ti GeForce GTX 1080 GeForce GTX 1080 Ti GeForce RTX 2080 Ti 0.2678 0.5356 0.8034 1.0712 1.339 0.74 0.75 0.74 0.91 1.19
NVIDIA GPU Cloud TensorFlow GPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better NVIDIA GPU Cloud TensorFlow 18.09 GPU Temperature Monitor GeForce GTX 1070 GeForce GTX 1070 Ti GeForce GTX 1080 GeForce GTX 1080 Ti GeForce RTX 2080 Ti 14 28 42 56 70 Min: 53 / Avg: 63.25 / Max: 70 Min: 46 / Avg: 56.59 / Max: 62 Min: 55 / Avg: 64.85 / Max: 72 Min: 57 / Avg: 65.78 / Max: 74 Min: 47 / Avg: 56.88 / Max: 66
NVIDIA GPU Cloud TensorFlow System Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better NVIDIA GPU Cloud TensorFlow 18.09 System Power Consumption Monitor GeForce GTX 1070 GeForce GTX 1070 Ti GeForce GTX 1080 GeForce GTX 1080 Ti GeForce RTX 2080 Ti 60 120 180 240 300 Min: 43.6 / Avg: 170.02 / Max: 208.2 Min: 48 / Avg: 182.99 / Max: 236.8 Min: 65.8 / Avg: 192.52 / Max: 240.7 Min: 74.8 / Avg: 230.1 / Max: 312.5 Min: 57.1 / Avg: 238.23 / Max: 339.5
NVIDIA GPU Cloud TensorFlow Test: AlexNet, FP16 OpenBenchmarking.org Images Per Second, More Is Better NVIDIA GPU Cloud TensorFlow 18.09 Test: AlexNet, FP16 GeForce GTX 980 Ti GeForce GTX 1060 GeForce GTX 1070 GeForce GTX 1070 Ti GeForce GTX 1080 GeForce GTX 1080 Ti GeForce RTX 2080 Ti 900 1800 2700 3600 4500 SE +/- 6.45, N = 3 SE +/- 1.46, N = 3 SE +/- 2.52, N = 3 SE +/- 0.85, N = 3 SE +/- 2.46, N = 3 SE +/- 2.58, N = 3 SE +/- 4.74, N = 3 1558 1090 1566 1794 1875 2674 4410
NVIDIA GPU Cloud TensorFlow Test: AlexNet, FP16 OpenBenchmarking.org Images Per Second Per Watt, More Is Better NVIDIA GPU Cloud TensorFlow 18.09 Test: AlexNet, FP16 GeForce GTX 980 Ti GeForce GTX 1060 GeForce GTX 1070 GeForce GTX 1070 Ti GeForce GTX 1080 GeForce GTX 1080 Ti GeForce RTX 2080 Ti 5 10 15 20 25 6.81 7.67 10.47 10.60 10.85 13.12 22.74
NVIDIA GPU Cloud TensorFlow GPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better NVIDIA GPU Cloud TensorFlow 18.09 GPU Temperature Monitor GeForce GTX 980 Ti GeForce GTX 1060 GeForce GTX 1070 GeForce GTX 1070 Ti GeForce GTX 1080 GeForce GTX 1080 Ti GeForce RTX 2080 Ti 15 30 45 60 75 Min: 62 / Avg: 73.06 / Max: 80 Min: 45 / Avg: 55.2 / Max: 62 Min: 59 / Avg: 63.4 / Max: 66 Min: 49 / Avg: 55.27 / Max: 59 Min: 60 / Avg: 64.38 / Max: 67 Min: 61 / Avg: 64.91 / Max: 68 Min: 55 / Avg: 58.82 / Max: 63
NVIDIA GPU Cloud TensorFlow System Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better NVIDIA GPU Cloud TensorFlow 18.09 System Power Consumption Monitor GeForce GTX 980 Ti GeForce GTX 1060 GeForce GTX 1070 GeForce GTX 1070 Ti GeForce GTX 1080 GeForce GTX 1080 Ti GeForce RTX 2080 Ti 60 120 180 240 300 Min: 110.7 / Avg: 228.63 / Max: 304.8 Min: 69.2 / Avg: 142.13 / Max: 176.5 Min: 44.7 / Avg: 149.56 / Max: 199.7 Min: 56.9 / Avg: 169.31 / Max: 228 Min: 43.7 / Avg: 172.75 / Max: 228 Min: 68.7 / Avg: 203.79 / Max: 298.4 Min: 59.4 / Avg: 193.94 / Max: 330.8
NVIDIA GPU Cloud TensorFlow Test: Googlenet, FP16 OpenBenchmarking.org Images Per Second, More Is Better NVIDIA GPU Cloud TensorFlow 18.09 Test: Googlenet, FP16 GeForce GTX 980 Ti GeForce GTX 1060 GeForce GTX 1070 GeForce GTX 1070 Ti GeForce GTX 1080 GeForce GTX 1080 Ti GeForce RTX 2080 Ti 200 400 600 800 1000 SE +/- 1.85, N = 3 SE +/- 0.40, N = 3 SE +/- 0.22, N = 3 SE +/- 0.32, N = 3 SE +/- 0.15, N = 3 SE +/- 2.54, N = 3 SE +/- 1.58, N = 3 358 261 375 452 458 631 1009
NVIDIA GPU Cloud TensorFlow Test: Googlenet, FP16 OpenBenchmarking.org Images Per Second Per Watt, More Is Better NVIDIA GPU Cloud TensorFlow 18.09 Test: Googlenet, FP16 GeForce GTX 980 Ti GeForce GTX 1060 GeForce GTX 1070 GeForce GTX 1070 Ti GeForce GTX 1080 GeForce GTX 1080 Ti GeForce RTX 2080 Ti 0.927 1.854 2.781 3.708 4.635 1.43 1.63 2.05 2.21 2.25 2.43 4.12
NVIDIA GPU Cloud TensorFlow GPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better NVIDIA GPU Cloud TensorFlow 18.09 GPU Temperature Monitor GeForce GTX 980 Ti GeForce GTX 1060 GeForce GTX 1070 GeForce GTX 1070 Ti GeForce GTX 1080 GeForce GTX 1080 Ti GeForce RTX 2080 Ti 16 32 48 64 80 Min: 68 / Avg: 79.63 / Max: 84 Min: 51 / Avg: 65.92 / Max: 71 Min: 58 / Avg: 69.45 / Max: 74 Min: 46 / Avg: 60.1 / Max: 65 Min: 57 / Avg: 70.78 / Max: 77 Min: 58 / Avg: 72.34 / Max: 80 Min: 54 / Avg: 64.32 / Max: 70
NVIDIA GPU Cloud TensorFlow System Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better NVIDIA GPU Cloud TensorFlow 18.09 System Power Consumption Monitor GeForce GTX 980 Ti GeForce GTX 1060 GeForce GTX 1070 GeForce GTX 1070 Ti GeForce GTX 1080 GeForce GTX 1080 Ti GeForce RTX 2080 Ti 60 120 180 240 300 Min: 84.5 / Avg: 249.77 / Max: 313.1 Min: 40.9 / Avg: 160.4 / Max: 180.8 Min: 85.6 / Avg: 182.97 / Max: 207.8 Min: 47.2 / Avg: 204.99 / Max: 246.4 Min: 41.5 / Avg: 203.76 / Max: 245.6 Min: 47.8 / Avg: 259.74 / Max: 313.5 Min: 59.6 / Avg: 244.65 / Max: 336.9
NVIDIA GPU Cloud TensorFlow Test: Googlenet, FP32 OpenBenchmarking.org Images Per Second, More Is Better NVIDIA GPU Cloud TensorFlow 18.09 Test: Googlenet, FP32 GeForce GTX 1080 Ti GeForce RTX 2080 Ti 160 320 480 640 800 SE +/- 0.37, N = 3 SE +/- 0.45, N = 3 552 761
NVIDIA GPU Cloud TensorFlow Test: Googlenet, FP32 OpenBenchmarking.org Images Per Second Per Watt, More Is Better NVIDIA GPU Cloud TensorFlow 18.09 Test: Googlenet, FP32 GeForce GTX 1080 Ti GeForce RTX 2080 Ti 0.6278 1.2556 1.8834 2.5112 3.139 2.15 2.79
NVIDIA GPU Cloud TensorFlow GPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better NVIDIA GPU Cloud TensorFlow 18.09 GPU Temperature Monitor GeForce GTX 1080 Ti GeForce RTX 2080 Ti 15 30 45 60 75 Min: 63 / Avg: 74.18 / Max: 81 Min: 58 / Avg: 67.42 / Max: 73
NVIDIA GPU Cloud TensorFlow System Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better NVIDIA GPU Cloud TensorFlow 18.09 System Power Consumption Monitor GeForce GTX 1080 Ti GeForce RTX 2080 Ti 60 120 180 240 300 Min: 52.3 / Avg: 256.65 / Max: 309.5 Min: 61.2 / Avg: 272.84 / Max: 341
NVIDIA GPU Cloud TensorFlow Test: Inception v4, FP16 OpenBenchmarking.org Images Per Second, More Is Better NVIDIA GPU Cloud TensorFlow 18.09 Test: Inception v4, FP16 GeForce GTX 980 Ti GeForce GTX 1060 GeForce GTX 1070 GeForce GTX 1070 Ti GeForce GTX 1080 GeForce GTX 1080 Ti GeForce RTX 2080 Ti 30 60 90 120 150 SE +/- 0.03, N = 3 SE +/- 0.03, N = 3 SE +/- 0.00, N = 3 SE +/- 0.03, N = 3 SE +/- 0.10, N = 3 SE +/- 0.23, N = 3 40.93 32.03 44.70 54.00 54.97 74.50 134.20
NVIDIA GPU Cloud TensorFlow Test: Inception v4, FP16 OpenBenchmarking.org Images Per Second Per Watt, More Is Better NVIDIA GPU Cloud TensorFlow 18.09 Test: Inception v4, FP16 GeForce GTX 980 Ti GeForce GTX 1060 GeForce GTX 1070 GeForce GTX 1070 Ti GeForce GTX 1080 GeForce GTX 1080 Ti GeForce RTX 2080 Ti 0.1553 0.3106 0.4659 0.6212 0.7765 0.18 0.22 0.28 0.30 0.31 0.37 0.69
NVIDIA GPU Cloud TensorFlow GPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better NVIDIA GPU Cloud TensorFlow 18.09 GPU Temperature Monitor GeForce GTX 980 Ti GeForce GTX 1060 GeForce GTX 1070 GeForce GTX 1070 Ti GeForce GTX 1080 GeForce GTX 1080 Ti GeForce RTX 2080 Ti 16 32 48 64 80 Min: 59 / Avg: 74.06 / Max: 84 Min: 44 / Avg: 60.77 / Max: 70 Min: 49 / Avg: 62.1 / Max: 71 Min: 41 / Avg: 53.71 / Max: 64 Min: 49 / Avg: 62.75 / Max: 75 Min: 58 / Avg: 67.77 / Max: 78 Min: 54 / Avg: 59.24 / Max: 65
NVIDIA GPU Cloud TensorFlow System Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better NVIDIA GPU Cloud TensorFlow 18.09 System Power Consumption Monitor GeForce GTX 980 Ti GeForce GTX 1060 GeForce GTX 1070 GeForce GTX 1070 Ti GeForce GTX 1080 GeForce GTX 1080 Ti GeForce RTX 2080 Ti 60 120 180 240 300 Min: 75.2 / Avg: 223.6 / Max: 316.6 Min: 68.9 / Avg: 148.31 / Max: 184.9 Min: 66.4 / Avg: 161.19 / Max: 208.3 Min: 77.2 / Avg: 177.34 / Max: 247.8 Min: 65.2 / Avg: 177.05 / Max: 250.2 Min: 53.4 / Avg: 200.96 / Max: 314.9 Min: 60.3 / Avg: 195.66 / Max: 336.9
NVIDIA GPU Cloud TensorFlow Test: Inception v4, FP32 OpenBenchmarking.org Images Per Second, More Is Better NVIDIA GPU Cloud TensorFlow 18.09 Test: Inception v4, FP32 GeForce GTX 1080 Ti GeForce RTX 2080 Ti 20 40 60 80 100 SE +/- 0.03, N = 3 SE +/- 0.09, N = 3 65.97 89.23
NVIDIA GPU Cloud TensorFlow Test: Inception v4, FP32 OpenBenchmarking.org Images Per Second Per Watt, More Is Better NVIDIA GPU Cloud TensorFlow 18.09 Test: Inception v4, FP32 GeForce GTX 1080 Ti GeForce RTX 2080 Ti 0.0878 0.1756 0.2634 0.3512 0.439 0.30 0.39
NVIDIA GPU Cloud TensorFlow GPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better NVIDIA GPU Cloud TensorFlow 18.09 GPU Temperature Monitor GeForce GTX 1080 Ti GeForce RTX 2080 Ti 15 30 45 60 75 Min: 55 / Avg: 67.82 / Max: 79 Min: 51 / Avg: 59.85 / Max: 68
NVIDIA GPU Cloud TensorFlow System Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better NVIDIA GPU Cloud TensorFlow 18.09 System Power Consumption Monitor GeForce GTX 1080 Ti GeForce RTX 2080 Ti 60 120 180 240 300 Min: 55.5 / Avg: 220.04 / Max: 322.2 Min: 58.7 / Avg: 227.62 / Max: 343.5
NVIDIA GPU Cloud TensorFlow Test: VGG-16, FP16 OpenBenchmarking.org Images Per Second, More Is Better NVIDIA GPU Cloud TensorFlow 18.09 Test: VGG-16, FP16 GeForce GTX 980 Ti GeForce GTX 1060 GeForce GTX 1070 GeForce GTX 1070 Ti GeForce GTX 1080 GeForce GTX 1080 Ti GeForce RTX 2080 Ti 50 100 150 200 250 SE +/- 0.31, N = 3 SE +/- 0.10, N = 3 SE +/- 0.15, N = 3 SE +/- 0.12, N = 3 SE +/- 0.15, N = 3 SE +/- 0.07, N = 3 SE +/- 0.12, N = 3 78.50 55.50 77.30 89.47 93.20 131.00 206.00
NVIDIA GPU Cloud TensorFlow Test: VGG-16, FP16 OpenBenchmarking.org Images Per Second Per Watt, More Is Better NVIDIA GPU Cloud TensorFlow 18.09 Test: VGG-16, FP16 GeForce GTX 980 Ti GeForce GTX 1060 GeForce GTX 1070 GeForce GTX 1070 Ti GeForce GTX 1080 GeForce GTX 1080 Ti GeForce RTX 2080 Ti 0.1913 0.3826 0.5739 0.7652 0.9565 0.32 0.36 0.47 0.46 0.47 0.59 0.85
NVIDIA GPU Cloud TensorFlow GPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better NVIDIA GPU Cloud TensorFlow 18.09 GPU Temperature Monitor GeForce GTX 980 Ti GeForce GTX 1060 GeForce GTX 1070 GeForce GTX 1070 Ti GeForce GTX 1080 GeForce GTX 1080 Ti GeForce RTX 2080 Ti 16 32 48 64 80 Min: 63 / Avg: 78.28 / Max: 83 Min: 43 / Avg: 60.05 / Max: 67 Min: 49 / Avg: 62.45 / Max: 69 Min: 43 / Avg: 55.17 / Max: 62 Min: 50 / Avg: 64.14 / Max: 72 Min: 63 / Avg: 71.95 / Max: 78 Min: 57 / Avg: 62.74 / Max: 67
NVIDIA GPU Cloud TensorFlow System Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better NVIDIA GPU Cloud TensorFlow 18.09 System Power Consumption Monitor GeForce GTX 980 Ti GeForce GTX 1060 GeForce GTX 1070 GeForce GTX 1070 Ti GeForce GTX 1080 GeForce GTX 1080 Ti GeForce RTX 2080 Ti 60 120 180 240 300 Min: 79.6 / Avg: 247.19 / Max: 314.7 Min: 63.5 / Avg: 155.42 / Max: 180.2 Min: 82.9 / Avg: 164.74 / Max: 198.5 Min: 95 / Avg: 193.14 / Max: 238.7 Min: 81.9 / Avg: 197.54 / Max: 241.1 Min: 51.2 / Avg: 223.09 / Max: 303 Min: 60.4 / Avg: 243.47 / Max: 339.6
NVIDIA GPU Cloud TensorFlow Test: VGG-16, FP32 OpenBenchmarking.org Images Per Second, More Is Better NVIDIA GPU Cloud TensorFlow 18.09 Test: VGG-16, FP32 GeForce GTX 1070 GeForce GTX 1070 Ti GeForce GTX 1080 GeForce GTX 1080 Ti GeForce RTX 2080 Ti 30 60 90 120 150 SE +/- 0.09, N = 3 SE +/- 0.03, N = 3 SE +/- 0.03, N = 3 SE +/- 0.09, N = 3 SE +/- 0.23, N = 3 71.73 79.27 82.93 119.00 152.00
NVIDIA GPU Cloud TensorFlow Test: VGG-16, FP32 OpenBenchmarking.org Images Per Second Per Watt, More Is Better NVIDIA GPU Cloud TensorFlow 18.09 Test: VGG-16, FP32 GeForce GTX 1070 GeForce GTX 1070 Ti GeForce GTX 1080 GeForce GTX 1080 Ti GeForce RTX 2080 Ti 0.1283 0.2566 0.3849 0.5132 0.6415 0.45 0.42 0.44 0.51 0.57
NVIDIA GPU Cloud TensorFlow GPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better NVIDIA GPU Cloud TensorFlow 18.09 GPU Temperature Monitor GeForce GTX 1070 GeForce GTX 1070 Ti GeForce GTX 1080 GeForce GTX 1080 Ti GeForce RTX 2080 Ti 15 30 45 60 75 Min: 57 / Avg: 65.39 / Max: 70 Min: 48 / Avg: 57.32 / Max: 62 Min: 59 / Avg: 67.66 / Max: 73 Min: 65 / Avg: 73.23 / Max: 79 Min: 57 / Avg: 65.5 / Max: 71
NVIDIA GPU Cloud TensorFlow System Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better NVIDIA GPU Cloud TensorFlow 18.09 System Power Consumption Monitor GeForce GTX 1070 GeForce GTX 1070 Ti GeForce GTX 1080 GeForce GTX 1080 Ti GeForce RTX 2080 Ti 60 120 180 240 300 Min: 44.4 / Avg: 159.81 / Max: 198.1 Min: 47.9 / Avg: 188.49 / Max: 232.2 Min: 43.1 / Avg: 188.27 / Max: 231.2 Min: 124.1 / Avg: 233.77 / Max: 303.8 Min: 59.1 / Avg: 264.67 / Max: 341.2
GPU Temperature Monitor Phoronix Test Suite System Monitoring OpenBenchmarking.org Celsius GPU Temperature Monitor Phoronix Test Suite System Monitoring GeForce GTX 980 Ti GeForce GTX 1060 GeForce GTX 1070 GeForce GTX 1070 Ti GeForce GTX 1080 GeForce GTX 1080 Ti GeForce RTX 2080 Ti 16 32 48 64 80 Min: 38 / Avg: 71.24 / Max: 84 Min: 32 / Avg: 57.12 / Max: 71 Min: 36 / Avg: 61.58 / Max: 74 Min: 36 / Avg: 53.74 / Max: 65 Min: 31 / Avg: 62.45 / Max: 77 Min: 40 / Avg: 68.6 / Max: 81 Min: 37 / Avg: 60.46 / Max: 73
System Power Consumption Monitor Phoronix Test Suite System Monitoring OpenBenchmarking.org Watts System Power Consumption Monitor Phoronix Test Suite System Monitoring GeForce GTX 980 Ti GeForce GTX 1060 GeForce GTX 1070 GeForce GTX 1070 Ti GeForce GTX 1080 GeForce GTX 1080 Ti GeForce RTX 2080 Ti 60 120 180 240 300 Min: 50.4 / Avg: 198.17 / Max: 318 Min: 40.9 / Avg: 130.9 / Max: 184.9 Min: 43.6 / Avg: 151 / Max: 209.3 Min: 47.2 / Avg: 165.34 / Max: 247.8 Min: 41.4 / Avg: 166.09 / Max: 250.2 Min: 47.8 / Avg: 220.88 / Max: 322.2 Min: 56.8 / Avg: 224.04 / Max: 343.5
NVIDIA GPU Cloud TensorFlow Performance / Cost - Test: ResNet-50, FP16 OpenBenchmarking.org Images Per Second Per Dollar, More Is Better NVIDIA GPU Cloud TensorFlow 18.09 Performance / Cost - Test: ResNet-50, FP16 GeForce GTX 1070 Ti GeForce GTX 1080 GeForce GTX 1080 Ti GeForce RTX 2080 Ti 0.1013 0.2026 0.3039 0.4052 0.5065 0.45 0.35 0.39 0.38 1. GeForce GTX 1070 Ti: $419 reported cost. 2. GeForce GTX 1080: $549 reported cost. 3. GeForce GTX 1080 Ti: $699 reported cost. 4. GeForce RTX 2080 Ti: $1199 reported cost.
NVIDIA GPU Cloud TensorFlow Performance / Cost - Test: ResNet-50, FP32 OpenBenchmarking.org Images Per Second Per Dollar, More Is Better NVIDIA GPU Cloud TensorFlow 18.09 Performance / Cost - Test: ResNet-50, FP32 GeForce GTX 1070 Ti GeForce GTX 1080 GeForce GTX 1080 Ti GeForce RTX 2080 Ti 0.0743 0.1486 0.2229 0.2972 0.3715 0.33 0.26 0.30 0.24 1. GeForce GTX 1070 Ti: $419 reported cost. 2. GeForce GTX 1080: $549 reported cost. 3. GeForce GTX 1080 Ti: $699 reported cost. 4. GeForce RTX 2080 Ti: $1199 reported cost.
NVIDIA GPU Cloud TensorFlow Performance / Cost - Test: AlexNet, FP16 OpenBenchmarking.org Images Per Second Per Dollar, More Is Better NVIDIA GPU Cloud TensorFlow 18.09 Performance / Cost - Test: AlexNet, FP16 GeForce GTX 1070 Ti GeForce GTX 1080 GeForce GTX 1080 Ti GeForce RTX 2080 Ti 0.963 1.926 2.889 3.852 4.815 4.28 3.42 3.83 3.68 1. GeForce GTX 1070 Ti: $419 reported cost. 2. GeForce GTX 1080: $549 reported cost. 3. GeForce GTX 1080 Ti: $699 reported cost. 4. GeForce RTX 2080 Ti: $1199 reported cost.
NVIDIA GPU Cloud TensorFlow Performance / Cost - Test: Googlenet, FP16 OpenBenchmarking.org Images Per Second Per Dollar, More Is Better NVIDIA GPU Cloud TensorFlow 18.09 Performance / Cost - Test: Googlenet, FP16 GeForce GTX 1070 Ti GeForce GTX 1080 GeForce GTX 1080 Ti GeForce RTX 2080 Ti 0.243 0.486 0.729 0.972 1.215 1.08 0.83 0.90 0.84 1. GeForce GTX 1070 Ti: $419 reported cost. 2. GeForce GTX 1080: $549 reported cost. 3. GeForce GTX 1080 Ti: $699 reported cost. 4. GeForce RTX 2080 Ti: $1199 reported cost.
NVIDIA GPU Cloud TensorFlow Performance / Cost - Test: Inception v4, FP16 OpenBenchmarking.org Images Per Second Per Dollar, More Is Better NVIDIA GPU Cloud TensorFlow 18.09 Performance / Cost - Test: Inception v4, FP16 GeForce GTX 1070 Ti GeForce GTX 1080 GeForce GTX 1080 Ti GeForce RTX 2080 Ti 0.0293 0.0586 0.0879 0.1172 0.1465 0.13 0.10 0.11 0.11 1. GeForce GTX 1070 Ti: $419 reported cost. 2. GeForce GTX 1080: $549 reported cost. 3. GeForce GTX 1080 Ti: $699 reported cost. 4. GeForce RTX 2080 Ti: $1199 reported cost.
NVIDIA GPU Cloud TensorFlow Performance / Cost - Test: VGG-16, FP16 OpenBenchmarking.org Images Per Second Per Dollar, More Is Better NVIDIA GPU Cloud TensorFlow 18.09 Performance / Cost - Test: VGG-16, FP16 GeForce GTX 1070 Ti GeForce GTX 1080 GeForce GTX 1080 Ti GeForce RTX 2080 Ti 0.0473 0.0946 0.1419 0.1892 0.2365 0.21 0.17 0.19 0.17 1. GeForce GTX 1070 Ti: $419 reported cost. 2. GeForce GTX 1080: $549 reported cost. 3. GeForce GTX 1080 Ti: $699 reported cost. 4. GeForce RTX 2080 Ti: $1199 reported cost.
NVIDIA GPU Cloud TensorFlow Performance / Cost - Test: VGG-16, FP32 OpenBenchmarking.org Images Per Second Per Dollar, More Is Better NVIDIA GPU Cloud TensorFlow 18.09 Performance / Cost - Test: VGG-16, FP32 GeForce GTX 1070 Ti GeForce GTX 1080 GeForce GTX 1080 Ti GeForce RTX 2080 Ti 0.0428 0.0856 0.1284 0.1712 0.214 0.19 0.15 0.17 0.13 1. GeForce GTX 1070 Ti: $419 reported cost. 2. GeForce GTX 1080: $549 reported cost. 3. GeForce GTX 1080 Ti: $699 reported cost. 4. GeForce RTX 2080 Ti: $1199 reported cost.
NVIDIA GPU Cloud TensorFlow Performance / Cost - Test: Googlenet, FP32 OpenBenchmarking.org Images Per Second Per Dollar, More Is Better NVIDIA GPU Cloud TensorFlow 18.09 Performance / Cost - Test: Googlenet, FP32 GeForce GTX 1080 Ti GeForce RTX 2080 Ti 0.1778 0.3556 0.5334 0.7112 0.889 0.79 0.63 1. GeForce GTX 1080 Ti: $699 reported cost. 2. GeForce RTX 2080 Ti: $1199 reported cost.
NVIDIA GPU Cloud TensorFlow Performance / Cost - Test: Inception v4, FP32 OpenBenchmarking.org Images Per Second Per Dollar, More Is Better NVIDIA GPU Cloud TensorFlow 18.09 Performance / Cost - Test: Inception v4, FP32 GeForce GTX 1080 Ti GeForce RTX 2080 Ti 0.0203 0.0406 0.0609 0.0812 0.1015 0.09 0.07 1. GeForce GTX 1080 Ti: $699 reported cost. 2. GeForce RTX 2080 Ti: $1199 reported cost.
Phoronix Test Suite v10.8.4