NGC TensorFlow NVIDIA GeForce RTX 2080 Ti

NVIDIA GPU Cloud TensorFlow benchmarks with ResNet-50, AlexNet, Googlenet, Inception V4, VGG-16. NVIDIA GPU benchmarks on Ubuntu Linux by Michael Larabel for a future article on Phoronix.com.

Compare your own system(s) to this result file with the Phoronix Test Suite by running the command: phoronix-test-suite benchmark 1810085-SKEE-181007067
Jump To Table - Results

View

Do Not Show Noisy Results
Do Not Show Results With Incomplete Data
Do Not Show Results With Little Change/Spread
List Notable Results

Statistics

Show Overall Harmonic Mean(s)
Show Overall Geometric Mean
Show Wins / Losses Counts (Pie Chart)
Normalize Results
Remove Outliers Before Calculating Averages

Graph Settings

Force Line Graphs Where Applicable
Convert To Scalar Where Applicable
Disable Color Branding
Prefer Vertical Bar Graphs
No Box Plots
On Line Graphs With Missing Data, Connect The Line Gaps

Additional Graphs

Show Perf Per Clock Calculation Graphs Where Applicable

Multi-Way Comparison

Condense Multi-Option Tests Into Single Result Graphs
Condense Test Profiles With Multiple Version Results Into Single Result Graphs

Table

Show Detailed System Result Table

Run Management

Highlight
Result
Hide
Result
Result
Identifier
Performance Per
Dollar
Date
Run
  Test
  Duration
GeForce GTX 980 Ti
October 07 2018
  18 Minutes
GeForce GTX 1060
October 07 2018
  22 Minutes
GeForce GTX 1070
October 07 2018
  24 Minutes
GeForce GTX 1070 Ti
October 07 2018
  22 Minutes
GeForce GTX 1080
October 07 2018
  21 Minutes
GeForce GTX 1080 Ti
October 07 2018
  25 Minutes
GeForce RTX 2080 Ti
October 07 2018
  24 Minutes
Zotac RTX 2080 Amp
October 08 2018
 
Invert Hiding All Results Option
  20 Minutes

Only show results where is faster than
Only show results matching title/arguments (delimit multiple options with a comma):
Do not show results matching title/arguments (delimit multiple options with a comma):


NGC TensorFlow NVIDIA GeForce RTX 2080 TiProcessorMotherboardChipsetMemoryDiskGraphicsAudioMonitorNetworkOSKernelDesktopDisplay ServerDisplay DriverOpenGLCompilerFile-SystemScreen ResolutionGeForce GTX 980 TiGeForce GTX 1060GeForce GTX 1070GeForce GTX 1070 TiGeForce GTX 1080GeForce GTX 1080 TiGeForce RTX 2080 TiZotac RTX 2080 AmpIntel Core i7-8086K @ 5.00GHz (6 Cores / 12 Threads)ASUS PRIME Z370-A (1002 BIOS)Intel Device 3ec216384MB525GB SABRENT + 118GB INTEL SSDPEK1W120GANVIDIA GeForce GTX 980 Ti 6GB (999/3505MHz)Realtek ALC1220Acer B286HKIntel ConnectionUbuntu 18.044.19.0-041900rc6-generic (x86_64) 20180930GNOME Shell 3.28.3X Server 1.19.6NVIDIA 410.574.6.0GCC 7.3.0 + CUDA 10.0ext43840x2160NVIDIA GeForce GTX 1060 6GB (1506/4006MHz)NVIDIA GeForce GTX 1070 8GB (1506/4006MHz)Zotac NVIDIA GeForce GTX 1070 Ti 8GB (1607/4006MHz)NVIDIA GeForce GTX 1080 8GB (1607/5005MHz)NVIDIA GeForce GTX 1080 Ti 11GB (1480/5508MHz)NVIDIA GeForce RTX 2080 Ti 11GB (1350/7000MHz)Intel Core i7-8086K @ 5.10GHz (6 Cores / 12 Threads)ASRock Z370 Extreme4 (P3.10 BIOS)4001GB Western Digital WD40EMRX-82U + 1500GB EARS-00Z5B1 + 240GB Force MP300 + 1000GB Samsung SSD 970 EVO 1TBZotac NVIDIA GeForce RTX 2080 8192MB (1515/7489MHz)VX2439wmLinuxMint 194.19.0-rc7-vhm (x86_64) 20181008Cinnamon 3.8.9GCC 8.2.01920x1080OpenBenchmarking.orgProcessor Details- Scaling Governor: intel_pstate performanceSecurity Details- GeForce GTX 980 Ti: KPTI + __user pointer sanitization + Full generic retpoline IBPB IBRS_FW + SSB disabled via prctl and seccomp + PTE Inversion; VMX: conditional cache flushes SMT vulnerable- GeForce GTX 1060: KPTI + __user pointer sanitization + Full generic retpoline IBPB IBRS_FW + SSB disabled via prctl and seccomp + PTE Inversion; VMX: conditional cache flushes SMT vulnerable- GeForce GTX 1070: KPTI + __user pointer sanitization + Full generic retpoline IBPB IBRS_FW + SSB disabled via prctl and seccomp + PTE Inversion; VMX: conditional cache flushes SMT vulnerable- GeForce GTX 1070 Ti: KPTI + __user pointer sanitization + Full generic retpoline IBPB IBRS_FW + SSB disabled via prctl and seccomp + PTE Inversion; VMX: conditional cache flushes SMT vulnerable- GeForce GTX 1080: KPTI + __user pointer sanitization + Full generic retpoline IBPB IBRS_FW + SSB disabled via prctl and seccomp + PTE Inversion; VMX: conditional cache flushes SMT vulnerable- GeForce GTX 1080 Ti: KPTI + __user pointer sanitization + Full generic retpoline IBPB IBRS_FW + SSB disabled via prctl and seccomp + PTE Inversion; VMX: conditional cache flushes SMT vulnerable- GeForce RTX 2080 Ti: KPTI + __user pointer sanitization + Full generic retpoline IBPB IBRS_FW + SSB disabled via prctl and seccomp + PTE Inversion; VMX: conditional cache flushes SMT vulnerable- Zotac RTX 2080 Amp: KPTI + __user pointer sanitization + Full generic retpoline IBPB IBRS_FW + SSB disabled via prctl and seccomp + PTE Inversion

NGC TensorFlow NVIDIA GeForce RTX 2080 Tingc-tensorflow: ResNet-50, FP16ngc-tensorflow: ResNet-50, FP32ngc-tensorflow: AlexNet, FP16ngc-tensorflow: Googlenet, FP16ngc-tensorflow: Googlenet, FP32ngc-tensorflow: Inception v4, FP16ngc-tensorflow: Inception v4, FP32ngc-tensorflow: VGG-16, FP16ngc-tensorflow: VGG-16, FP32GeForce GTX 980 TiGeForce GTX 1060GeForce GTX 1070GeForce GTX 1070 TiGeForce GTX 1080GeForce GTX 1080 TiGeForce RTX 2080 TiZotac RTX 2080 Amp153155835840.9378.50116109026132.0355.50162125156637544.7077.3071.7318713817944525489.4779.27194143187545854.9793.2082.93272210267463155274.5065.9713111945528444101009761134.2089.23206152OpenBenchmarking.org

NVIDIA GPU Cloud TensorFlow

This test profile uses the NVIDIA GPU Cloud (NGC/nvcr.io) for running the TensorFlow image inside Docker for benchmarking. You must have already signed into NGC for this test profile to work. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgImages Per Second, More Is BetterNVIDIA GPU Cloud TensorFlow 18.09Test: ResNet-50, FP16GeForce GTX 980 TiGeForce GTX 1060GeForce GTX 1070GeForce GTX 1070 TiGeForce GTX 1080GeForce GTX 1080 TiGeForce RTX 2080 Ti100200300400500SE +/- 0.76, N = 3SE +/- 0.23, N = 3SE +/- 0.32, N = 3SE +/- 0.32, N = 3SE +/- 0.44, N = 3SE +/- 0.39, N = 3SE +/- 4.02, N = 3153116162187194272455
OpenBenchmarking.orgImages Per Second, More Is BetterNVIDIA GPU Cloud TensorFlow 18.09Test: ResNet-50, FP16GeForce GTX 980 TiGeForce GTX 1060GeForce GTX 1070GeForce GTX 1070 TiGeForce GTX 1080GeForce GTX 1080 TiGeForce RTX 2080 Ti80160240320400Min: 151.4 / Avg: 152.57 / Max: 154Min: 115.5 / Avg: 115.87 / Max: 116.3Min: 161.3 / Avg: 161.67 / Max: 162.3Min: 187.1 / Avg: 187.47 / Max: 188.1Min: 193.1 / Avg: 193.77 / Max: 194.6Min: 271.5 / Avg: 272.03 / Max: 272.8Min: 449.8 / Avg: 454.5 / Max: 462.5

OpenBenchmarking.orgImages Per Second Per Watt, More Is BetterNVIDIA GPU Cloud TensorFlow 18.09Test: ResNet-50, FP16GeForce GTX 980 TiGeForce GTX 1060GeForce GTX 1070GeForce GTX 1070 TiGeForce GTX 1080GeForce GTX 1080 TiGeForce RTX 2080 Ti0.49050.9811.47151.9622.45250.660.760.981.031.091.192.18

OpenBenchmarking.orgCelsius, Fewer Is BetterNVIDIA GPU Cloud TensorFlow 18.09GPU Temperature MonitorGeForce GTX 980 TiGeForce GTX 1060GeForce GTX 1070GeForce GTX 1070 TiGeForce GTX 1080GeForce GTX 1080 TiGeForce RTX 2080 Ti1632486480Min: 38 / Avg: 66.72 / Max: 82Min: 32 / Avg: 53.28 / Max: 65Min: 36 / Avg: 54 / Max: 66Min: 36 / Avg: 51.14 / Max: 60Min: 31 / Avg: 53.96 / Max: 68Min: 40 / Avg: 57.78 / Max: 69Min: 37 / Avg: 46.95 / Max: 56

OpenBenchmarking.orgWatts, Fewer Is BetterNVIDIA GPU Cloud TensorFlow 18.09System Power Consumption MonitorGeForce GTX 980 TiGeForce GTX 1060GeForce GTX 1070GeForce GTX 1070 TiGeForce GTX 1080GeForce GTX 1080 TiGeForce RTX 2080 Ti60120180240300Min: 83 / Avg: 232.07 / Max: 304.2Min: 60.5 / Avg: 153.42 / Max: 184.1Min: 69 / Avg: 165.58 / Max: 209.3Min: 77.1 / Avg: 182.32 / Max: 240.6Min: 41.4 / Avg: 178.02 / Max: 241.8Min: 99.4 / Avg: 229.38 / Max: 312Min: 57.3 / Avg: 208.46 / Max: 336

OpenBenchmarking.orgImages Per Second, More Is BetterNVIDIA GPU Cloud TensorFlow 18.09Test: ResNet-50, FP32GeForce GTX 1070GeForce GTX 1070 TiGeForce GTX 1080GeForce GTX 1080 TiGeForce RTX 2080 Ti60120180240300SE +/- 0.15, N = 3SE +/- 0.03, N = 3SE +/- 0.06, N = 3SE +/- 0.19, N = 3SE +/- 0.27, N = 3125138143210284
OpenBenchmarking.orgImages Per Second, More Is BetterNVIDIA GPU Cloud TensorFlow 18.09Test: ResNet-50, FP32GeForce GTX 1070GeForce GTX 1070 TiGeForce GTX 1080GeForce GTX 1080 TiGeForce RTX 2080 Ti50100150200250Min: 124.7 / Avg: 124.97 / Max: 125.2Min: 137.7 / Avg: 137.73 / Max: 137.8Min: 142.5 / Avg: 142.6 / Max: 142.7Min: 210.1 / Avg: 210.33 / Max: 210.7Min: 283.5 / Avg: 284.03 / Max: 284.3

OpenBenchmarking.orgImages Per Second Per Watt, More Is BetterNVIDIA GPU Cloud TensorFlow 18.09Test: ResNet-50, FP32GeForce GTX 1070GeForce GTX 1070 TiGeForce GTX 1080GeForce GTX 1080 TiGeForce RTX 2080 Ti0.26780.53560.80341.07121.3390.740.750.740.911.19

OpenBenchmarking.orgCelsius, Fewer Is BetterNVIDIA GPU Cloud TensorFlow 18.09GPU Temperature MonitorGeForce GTX 1070GeForce GTX 1070 TiGeForce GTX 1080GeForce GTX 1080 TiGeForce RTX 2080 Ti1428425670Min: 53 / Avg: 63.25 / Max: 70Min: 46 / Avg: 56.59 / Max: 62Min: 55 / Avg: 64.85 / Max: 72Min: 57 / Avg: 65.78 / Max: 74Min: 47 / Avg: 56.88 / Max: 66

OpenBenchmarking.orgWatts, Fewer Is BetterNVIDIA GPU Cloud TensorFlow 18.09System Power Consumption MonitorGeForce GTX 1070GeForce GTX 1070 TiGeForce GTX 1080GeForce GTX 1080 TiGeForce RTX 2080 Ti60120180240300Min: 43.6 / Avg: 170.02 / Max: 208.2Min: 48 / Avg: 182.99 / Max: 236.8Min: 65.8 / Avg: 192.52 / Max: 240.7Min: 74.8 / Avg: 230.1 / Max: 312.5Min: 57.1 / Avg: 238.23 / Max: 339.5

OpenBenchmarking.orgImages Per Second, More Is BetterNVIDIA GPU Cloud TensorFlow 18.09Test: AlexNet, FP16GeForce GTX 980 TiGeForce GTX 1060GeForce GTX 1070GeForce GTX 1070 TiGeForce GTX 1080GeForce GTX 1080 TiGeForce RTX 2080 Ti9001800270036004500SE +/- 6.45, N = 3SE +/- 1.46, N = 3SE +/- 2.52, N = 3SE +/- 0.85, N = 3SE +/- 2.46, N = 3SE +/- 2.58, N = 3SE +/- 4.74, N = 31558109015661794187526744410
OpenBenchmarking.orgImages Per Second, More Is BetterNVIDIA GPU Cloud TensorFlow 18.09Test: AlexNet, FP16GeForce GTX 980 TiGeForce GTX 1060GeForce GTX 1070GeForce GTX 1070 TiGeForce GTX 1080GeForce GTX 1080 TiGeForce RTX 2080 Ti8001600240032004000Min: 1545 / Avg: 1557.87 / Max: 1565.2Min: 1087.9 / Avg: 1089.83 / Max: 1092.7Min: 1561.9 / Avg: 1566.03 / Max: 1570.6Min: 1792.7 / Avg: 1793.83 / Max: 1795.5Min: 1871.7 / Avg: 1874.6 / Max: 1879.5Min: 2669.3 / Avg: 2673.5 / Max: 2678.2Min: 4404.6 / Avg: 4410.3 / Max: 4419.7

OpenBenchmarking.orgImages Per Second Per Watt, More Is BetterNVIDIA GPU Cloud TensorFlow 18.09Test: AlexNet, FP16GeForce GTX 980 TiGeForce GTX 1060GeForce GTX 1070GeForce GTX 1070 TiGeForce GTX 1080GeForce GTX 1080 TiGeForce RTX 2080 Ti5101520256.817.6710.4710.6010.8513.1222.74

OpenBenchmarking.orgCelsius, Fewer Is BetterNVIDIA GPU Cloud TensorFlow 18.09GPU Temperature MonitorGeForce GTX 980 TiGeForce GTX 1060GeForce GTX 1070GeForce GTX 1070 TiGeForce GTX 1080GeForce GTX 1080 TiGeForce RTX 2080 Ti1530456075Min: 62 / Avg: 73.06 / Max: 80Min: 45 / Avg: 55.2 / Max: 62Min: 59 / Avg: 63.4 / Max: 66Min: 49 / Avg: 55.27 / Max: 59Min: 60 / Avg: 64.38 / Max: 67Min: 61 / Avg: 64.91 / Max: 68Min: 55 / Avg: 58.82 / Max: 63

OpenBenchmarking.orgWatts, Fewer Is BetterNVIDIA GPU Cloud TensorFlow 18.09System Power Consumption MonitorGeForce GTX 980 TiGeForce GTX 1060GeForce GTX 1070GeForce GTX 1070 TiGeForce GTX 1080GeForce GTX 1080 TiGeForce RTX 2080 Ti60120180240300Min: 110.7 / Avg: 228.63 / Max: 304.8Min: 69.2 / Avg: 142.13 / Max: 176.5Min: 44.7 / Avg: 149.56 / Max: 199.7Min: 56.9 / Avg: 169.31 / Max: 228Min: 43.7 / Avg: 172.75 / Max: 228Min: 68.7 / Avg: 203.79 / Max: 298.4Min: 59.4 / Avg: 193.94 / Max: 330.8

OpenBenchmarking.orgImages Per Second, More Is BetterNVIDIA GPU Cloud TensorFlow 18.09Test: Googlenet, FP16GeForce GTX 980 TiGeForce GTX 1060GeForce GTX 1070GeForce GTX 1070 TiGeForce GTX 1080GeForce GTX 1080 TiGeForce RTX 2080 Ti2004006008001000SE +/- 1.85, N = 3SE +/- 0.40, N = 3SE +/- 0.22, N = 3SE +/- 0.32, N = 3SE +/- 0.15, N = 3SE +/- 2.54, N = 3SE +/- 1.58, N = 33582613754524586311009
OpenBenchmarking.orgImages Per Second, More Is BetterNVIDIA GPU Cloud TensorFlow 18.09Test: Googlenet, FP16GeForce GTX 980 TiGeForce GTX 1060GeForce GTX 1070GeForce GTX 1070 TiGeForce GTX 1080GeForce GTX 1080 TiGeForce RTX 2080 Ti2004006008001000Min: 354.6 / Avg: 358.3 / Max: 360.2Min: 260.4 / Avg: 261.2 / Max: 261.6Min: 374.9 / Avg: 375.17 / Max: 375.6Min: 452 / Avg: 452.37 / Max: 453Min: 458.1 / Avg: 458.33 / Max: 458.6Min: 626 / Avg: 631.03 / Max: 634.2Min: 1006.8 / Avg: 1008.77 / Max: 1011.9

OpenBenchmarking.orgImages Per Second Per Watt, More Is BetterNVIDIA GPU Cloud TensorFlow 18.09Test: Googlenet, FP16GeForce GTX 980 TiGeForce GTX 1060GeForce GTX 1070GeForce GTX 1070 TiGeForce GTX 1080GeForce GTX 1080 TiGeForce RTX 2080 Ti0.9271.8542.7813.7084.6351.431.632.052.212.252.434.12

OpenBenchmarking.orgCelsius, Fewer Is BetterNVIDIA GPU Cloud TensorFlow 18.09GPU Temperature MonitorGeForce GTX 980 TiGeForce GTX 1060GeForce GTX 1070GeForce GTX 1070 TiGeForce GTX 1080GeForce GTX 1080 TiGeForce RTX 2080 Ti1632486480Min: 68 / Avg: 79.63 / Max: 84Min: 51 / Avg: 65.92 / Max: 71Min: 58 / Avg: 69.45 / Max: 74Min: 46 / Avg: 60.1 / Max: 65Min: 57 / Avg: 70.78 / Max: 77Min: 58 / Avg: 72.34 / Max: 80Min: 54 / Avg: 64.32 / Max: 70

OpenBenchmarking.orgWatts, Fewer Is BetterNVIDIA GPU Cloud TensorFlow 18.09System Power Consumption MonitorGeForce GTX 980 TiGeForce GTX 1060GeForce GTX 1070GeForce GTX 1070 TiGeForce GTX 1080GeForce GTX 1080 TiGeForce RTX 2080 Ti60120180240300Min: 84.5 / Avg: 249.77 / Max: 313.1Min: 40.9 / Avg: 160.4 / Max: 180.8Min: 85.6 / Avg: 182.97 / Max: 207.8Min: 47.2 / Avg: 204.99 / Max: 246.4Min: 41.5 / Avg: 203.76 / Max: 245.6Min: 47.8 / Avg: 259.74 / Max: 313.5Min: 59.6 / Avg: 244.65 / Max: 336.9

OpenBenchmarking.orgImages Per Second, More Is BetterNVIDIA GPU Cloud TensorFlow 18.09Test: Googlenet, FP32GeForce GTX 1080 TiGeForce RTX 2080 Ti160320480640800SE +/- 0.37, N = 3SE +/- 0.45, N = 3552761
OpenBenchmarking.orgImages Per Second, More Is BetterNVIDIA GPU Cloud TensorFlow 18.09Test: Googlenet, FP32GeForce GTX 1080 TiGeForce RTX 2080 Ti130260390520650Min: 550.9 / Avg: 551.63 / Max: 552.1Min: 760.6 / Avg: 761.1 / Max: 762

OpenBenchmarking.orgImages Per Second Per Watt, More Is BetterNVIDIA GPU Cloud TensorFlow 18.09Test: Googlenet, FP32GeForce GTX 1080 TiGeForce RTX 2080 Ti0.62781.25561.88342.51123.1392.152.79

OpenBenchmarking.orgCelsius, Fewer Is BetterNVIDIA GPU Cloud TensorFlow 18.09GPU Temperature MonitorGeForce GTX 1080 TiGeForce RTX 2080 Ti1530456075Min: 63 / Avg: 74.18 / Max: 81Min: 58 / Avg: 67.42 / Max: 73

OpenBenchmarking.orgWatts, Fewer Is BetterNVIDIA GPU Cloud TensorFlow 18.09System Power Consumption MonitorGeForce GTX 1080 TiGeForce RTX 2080 Ti60120180240300Min: 52.3 / Avg: 256.65 / Max: 309.5Min: 61.2 / Avg: 272.84 / Max: 341

OpenBenchmarking.orgImages Per Second, More Is BetterNVIDIA GPU Cloud TensorFlow 18.09Test: Inception v4, FP16GeForce GTX 980 TiGeForce GTX 1060GeForce GTX 1070GeForce GTX 1070 TiGeForce GTX 1080GeForce GTX 1080 TiGeForce RTX 2080 Ti306090120150SE +/- 0.03, N = 3SE +/- 0.03, N = 3SE +/- 0.00, N = 3SE +/- 0.03, N = 3SE +/- 0.10, N = 3SE +/- 0.23, N = 340.9332.0344.7054.0054.9774.50134.20
OpenBenchmarking.orgImages Per Second, More Is BetterNVIDIA GPU Cloud TensorFlow 18.09Test: Inception v4, FP16GeForce GTX 980 TiGeForce GTX 1060GeForce GTX 1070GeForce GTX 1070 TiGeForce GTX 1080GeForce GTX 1080 TiGeForce RTX 2080 Ti306090120150Min: 40.9 / Avg: 40.93 / Max: 41Min: 32 / Avg: 32.03 / Max: 32.1Min: 44.7 / Avg: 44.7 / Max: 44.7Min: 54.9 / Avg: 54.97 / Max: 55Min: 74.4 / Avg: 74.5 / Max: 74.7Min: 133.8 / Avg: 134.2 / Max: 134.6

OpenBenchmarking.orgImages Per Second Per Watt, More Is BetterNVIDIA GPU Cloud TensorFlow 18.09Test: Inception v4, FP16GeForce GTX 980 TiGeForce GTX 1060GeForce GTX 1070GeForce GTX 1070 TiGeForce GTX 1080GeForce GTX 1080 TiGeForce RTX 2080 Ti0.15530.31060.46590.62120.77650.180.220.280.300.310.370.69

OpenBenchmarking.orgCelsius, Fewer Is BetterNVIDIA GPU Cloud TensorFlow 18.09GPU Temperature MonitorGeForce GTX 980 TiGeForce GTX 1060GeForce GTX 1070GeForce GTX 1070 TiGeForce GTX 1080GeForce GTX 1080 TiGeForce RTX 2080 Ti1632486480Min: 59 / Avg: 74.06 / Max: 84Min: 44 / Avg: 60.77 / Max: 70Min: 49 / Avg: 62.1 / Max: 71Min: 41 / Avg: 53.71 / Max: 64Min: 49 / Avg: 62.75 / Max: 75Min: 58 / Avg: 67.77 / Max: 78Min: 54 / Avg: 59.24 / Max: 65

OpenBenchmarking.orgWatts, Fewer Is BetterNVIDIA GPU Cloud TensorFlow 18.09System Power Consumption MonitorGeForce GTX 980 TiGeForce GTX 1060GeForce GTX 1070GeForce GTX 1070 TiGeForce GTX 1080GeForce GTX 1080 TiGeForce RTX 2080 Ti60120180240300Min: 75.2 / Avg: 223.6 / Max: 316.6Min: 68.9 / Avg: 148.31 / Max: 184.9Min: 66.4 / Avg: 161.19 / Max: 208.3Min: 77.2 / Avg: 177.34 / Max: 247.8Min: 65.2 / Avg: 177.05 / Max: 250.2Min: 53.4 / Avg: 200.96 / Max: 314.9Min: 60.3 / Avg: 195.66 / Max: 336.9

OpenBenchmarking.orgImages Per Second, More Is BetterNVIDIA GPU Cloud TensorFlow 18.09Test: Inception v4, FP32GeForce GTX 1080 TiGeForce RTX 2080 Ti20406080100SE +/- 0.03, N = 3SE +/- 0.09, N = 365.9789.23
OpenBenchmarking.orgImages Per Second, More Is BetterNVIDIA GPU Cloud TensorFlow 18.09Test: Inception v4, FP32GeForce GTX 1080 TiGeForce RTX 2080 Ti20406080100Min: 65.9 / Avg: 65.97 / Max: 66Min: 89.1 / Avg: 89.23 / Max: 89.4

OpenBenchmarking.orgImages Per Second Per Watt, More Is BetterNVIDIA GPU Cloud TensorFlow 18.09Test: Inception v4, FP32GeForce GTX 1080 TiGeForce RTX 2080 Ti0.08780.17560.26340.35120.4390.300.39

OpenBenchmarking.orgCelsius, Fewer Is BetterNVIDIA GPU Cloud TensorFlow 18.09GPU Temperature MonitorGeForce GTX 1080 TiGeForce RTX 2080 Ti1530456075Min: 55 / Avg: 67.82 / Max: 79Min: 51 / Avg: 59.85 / Max: 68

OpenBenchmarking.orgWatts, Fewer Is BetterNVIDIA GPU Cloud TensorFlow 18.09System Power Consumption MonitorGeForce GTX 1080 TiGeForce RTX 2080 Ti60120180240300Min: 55.5 / Avg: 220.04 / Max: 322.2Min: 58.7 / Avg: 227.62 / Max: 343.5

OpenBenchmarking.orgImages Per Second, More Is BetterNVIDIA GPU Cloud TensorFlow 18.09Test: VGG-16, FP16GeForce GTX 980 TiGeForce GTX 1060GeForce GTX 1070GeForce GTX 1070 TiGeForce GTX 1080GeForce GTX 1080 TiGeForce RTX 2080 Ti50100150200250SE +/- 0.31, N = 3SE +/- 0.10, N = 3SE +/- 0.15, N = 3SE +/- 0.12, N = 3SE +/- 0.15, N = 3SE +/- 0.07, N = 3SE +/- 0.12, N = 378.5055.5077.3089.4793.20131.00206.00
OpenBenchmarking.orgImages Per Second, More Is BetterNVIDIA GPU Cloud TensorFlow 18.09Test: VGG-16, FP16GeForce GTX 980 TiGeForce GTX 1060GeForce GTX 1070GeForce GTX 1070 TiGeForce GTX 1080GeForce GTX 1080 TiGeForce RTX 2080 Ti4080120160200Min: 77.9 / Avg: 78.5 / Max: 78.9Min: 55.4 / Avg: 55.5 / Max: 55.7Min: 77.1 / Avg: 77.3 / Max: 77.6Min: 89.3 / Avg: 89.47 / Max: 89.7Min: 93 / Avg: 93.2 / Max: 93.5Min: 131.3 / Avg: 131.43 / Max: 131.5Min: 205.6 / Avg: 205.8 / Max: 206

OpenBenchmarking.orgImages Per Second Per Watt, More Is BetterNVIDIA GPU Cloud TensorFlow 18.09Test: VGG-16, FP16GeForce GTX 980 TiGeForce GTX 1060GeForce GTX 1070GeForce GTX 1070 TiGeForce GTX 1080GeForce GTX 1080 TiGeForce RTX 2080 Ti0.19130.38260.57390.76520.95650.320.360.470.460.470.590.85

OpenBenchmarking.orgCelsius, Fewer Is BetterNVIDIA GPU Cloud TensorFlow 18.09GPU Temperature MonitorGeForce GTX 980 TiGeForce GTX 1060GeForce GTX 1070GeForce GTX 1070 TiGeForce GTX 1080GeForce GTX 1080 TiGeForce RTX 2080 Ti1632486480Min: 63 / Avg: 78.28 / Max: 83Min: 43 / Avg: 60.05 / Max: 67Min: 49 / Avg: 62.45 / Max: 69Min: 43 / Avg: 55.17 / Max: 62Min: 50 / Avg: 64.14 / Max: 72Min: 63 / Avg: 71.95 / Max: 78Min: 57 / Avg: 62.74 / Max: 67

OpenBenchmarking.orgWatts, Fewer Is BetterNVIDIA GPU Cloud TensorFlow 18.09System Power Consumption MonitorGeForce GTX 980 TiGeForce GTX 1060GeForce GTX 1070GeForce GTX 1070 TiGeForce GTX 1080GeForce GTX 1080 TiGeForce RTX 2080 Ti60120180240300Min: 79.6 / Avg: 247.19 / Max: 314.7Min: 63.5 / Avg: 155.42 / Max: 180.2Min: 82.9 / Avg: 164.74 / Max: 198.5Min: 95 / Avg: 193.14 / Max: 238.7Min: 81.9 / Avg: 197.54 / Max: 241.1Min: 51.2 / Avg: 223.09 / Max: 303Min: 60.4 / Avg: 243.47 / Max: 339.6

OpenBenchmarking.orgImages Per Second, More Is BetterNVIDIA GPU Cloud TensorFlow 18.09Test: VGG-16, FP32GeForce GTX 1070GeForce GTX 1070 TiGeForce GTX 1080GeForce GTX 1080 TiGeForce RTX 2080 Ti306090120150SE +/- 0.09, N = 3SE +/- 0.03, N = 3SE +/- 0.03, N = 3SE +/- 0.09, N = 3SE +/- 0.23, N = 371.7379.2782.93119.00152.00
OpenBenchmarking.orgImages Per Second, More Is BetterNVIDIA GPU Cloud TensorFlow 18.09Test: VGG-16, FP32GeForce GTX 1070GeForce GTX 1070 TiGeForce GTX 1080GeForce GTX 1080 TiGeForce RTX 2080 Ti306090120150Min: 71.6 / Avg: 71.73 / Max: 71.9Min: 79.2 / Avg: 79.27 / Max: 79.3Min: 82.9 / Avg: 82.93 / Max: 83Min: 119.2 / Avg: 119.37 / Max: 119.5Min: 151.5 / Avg: 151.87 / Max: 152.3

OpenBenchmarking.orgImages Per Second Per Watt, More Is BetterNVIDIA GPU Cloud TensorFlow 18.09Test: VGG-16, FP32GeForce GTX 1070GeForce GTX 1070 TiGeForce GTX 1080GeForce GTX 1080 TiGeForce RTX 2080 Ti0.12830.25660.38490.51320.64150.450.420.440.510.57

OpenBenchmarking.orgCelsius, Fewer Is BetterNVIDIA GPU Cloud TensorFlow 18.09GPU Temperature MonitorGeForce GTX 1070GeForce GTX 1070 TiGeForce GTX 1080GeForce GTX 1080 TiGeForce RTX 2080 Ti1530456075Min: 57 / Avg: 65.39 / Max: 70Min: 48 / Avg: 57.32 / Max: 62Min: 59 / Avg: 67.66 / Max: 73Min: 65 / Avg: 73.23 / Max: 79Min: 57 / Avg: 65.5 / Max: 71

OpenBenchmarking.orgWatts, Fewer Is BetterNVIDIA GPU Cloud TensorFlow 18.09System Power Consumption MonitorGeForce GTX 1070GeForce GTX 1070 TiGeForce GTX 1080GeForce GTX 1080 TiGeForce RTX 2080 Ti60120180240300Min: 44.4 / Avg: 159.81 / Max: 198.1Min: 47.9 / Avg: 188.49 / Max: 232.2Min: 43.1 / Avg: 188.27 / Max: 231.2Min: 124.1 / Avg: 233.77 / Max: 303.8Min: 59.1 / Avg: 264.67 / Max: 341.2

GPU Temperature Monitor

OpenBenchmarking.orgCelsiusGPU Temperature MonitorPhoronix Test Suite System MonitoringGeForce GTX 980 TiGeForce GTX 1060GeForce GTX 1070GeForce GTX 1070 TiGeForce GTX 1080GeForce GTX 1080 TiGeForce RTX 2080 Ti1632486480Min: 38 / Avg: 71.24 / Max: 84Min: 32 / Avg: 57.12 / Max: 71Min: 36 / Avg: 61.58 / Max: 74Min: 36 / Avg: 53.74 / Max: 65Min: 31 / Avg: 62.45 / Max: 77Min: 40 / Avg: 68.6 / Max: 81Min: 37 / Avg: 60.46 / Max: 73

System Power Consumption Monitor

OpenBenchmarking.orgWattsSystem Power Consumption MonitorPhoronix Test Suite System MonitoringGeForce GTX 980 TiGeForce GTX 1060GeForce GTX 1070GeForce GTX 1070 TiGeForce GTX 1080GeForce GTX 1080 TiGeForce RTX 2080 Ti60120180240300Min: 50.4 / Avg: 198.17 / Max: 318Min: 40.9 / Avg: 130.9 / Max: 184.9Min: 43.6 / Avg: 151 / Max: 209.3Min: 47.2 / Avg: 165.34 / Max: 247.8Min: 41.4 / Avg: 166.09 / Max: 250.2Min: 47.8 / Avg: 220.88 / Max: 322.2Min: 56.8 / Avg: 224.04 / Max: 343.5

NVIDIA GPU Cloud TensorFlow

OpenBenchmarking.orgImages Per Second Per Dollar, More Is BetterNVIDIA GPU Cloud TensorFlow 18.09Performance / Cost - Test: ResNet-50, FP16GeForce GTX 1070 TiGeForce GTX 1080GeForce GTX 1080 TiGeForce RTX 2080 Ti0.10130.20260.30390.40520.50650.450.350.390.381. GeForce GTX 1070 Ti: $419 reported cost.2. GeForce GTX 1080: $549 reported cost.3. GeForce GTX 1080 Ti: $699 reported cost.4. GeForce RTX 2080 Ti: $1199 reported cost.

OpenBenchmarking.orgImages Per Second Per Dollar, More Is BetterNVIDIA GPU Cloud TensorFlow 18.09Performance / Cost - Test: ResNet-50, FP32GeForce GTX 1070 TiGeForce GTX 1080GeForce GTX 1080 TiGeForce RTX 2080 Ti0.07430.14860.22290.29720.37150.330.260.300.241. GeForce GTX 1070 Ti: $419 reported cost.2. GeForce GTX 1080: $549 reported cost.3. GeForce GTX 1080 Ti: $699 reported cost.4. GeForce RTX 2080 Ti: $1199 reported cost.

OpenBenchmarking.orgImages Per Second Per Dollar, More Is BetterNVIDIA GPU Cloud TensorFlow 18.09Performance / Cost - Test: AlexNet, FP16GeForce GTX 1070 TiGeForce GTX 1080GeForce GTX 1080 TiGeForce RTX 2080 Ti0.9631.9262.8893.8524.8154.283.423.833.681. GeForce GTX 1070 Ti: $419 reported cost.2. GeForce GTX 1080: $549 reported cost.3. GeForce GTX 1080 Ti: $699 reported cost.4. GeForce RTX 2080 Ti: $1199 reported cost.

OpenBenchmarking.orgImages Per Second Per Dollar, More Is BetterNVIDIA GPU Cloud TensorFlow 18.09Performance / Cost - Test: Googlenet, FP16GeForce GTX 1070 TiGeForce GTX 1080GeForce GTX 1080 TiGeForce RTX 2080 Ti0.2430.4860.7290.9721.2151.080.830.900.841. GeForce GTX 1070 Ti: $419 reported cost.2. GeForce GTX 1080: $549 reported cost.3. GeForce GTX 1080 Ti: $699 reported cost.4. GeForce RTX 2080 Ti: $1199 reported cost.

OpenBenchmarking.orgImages Per Second Per Dollar, More Is BetterNVIDIA GPU Cloud TensorFlow 18.09Performance / Cost - Test: Inception v4, FP16GeForce GTX 1070 TiGeForce GTX 1080GeForce GTX 1080 TiGeForce RTX 2080 Ti0.02930.05860.08790.11720.14650.130.100.110.111. GeForce GTX 1070 Ti: $419 reported cost.2. GeForce GTX 1080: $549 reported cost.3. GeForce GTX 1080 Ti: $699 reported cost.4. GeForce RTX 2080 Ti: $1199 reported cost.

OpenBenchmarking.orgImages Per Second Per Dollar, More Is BetterNVIDIA GPU Cloud TensorFlow 18.09Performance / Cost - Test: VGG-16, FP16GeForce GTX 1070 TiGeForce GTX 1080GeForce GTX 1080 TiGeForce RTX 2080 Ti0.04730.09460.14190.18920.23650.210.170.190.171. GeForce GTX 1070 Ti: $419 reported cost.2. GeForce GTX 1080: $549 reported cost.3. GeForce GTX 1080 Ti: $699 reported cost.4. GeForce RTX 2080 Ti: $1199 reported cost.

OpenBenchmarking.orgImages Per Second Per Dollar, More Is BetterNVIDIA GPU Cloud TensorFlow 18.09Performance / Cost - Test: VGG-16, FP32GeForce GTX 1070 TiGeForce GTX 1080GeForce GTX 1080 TiGeForce RTX 2080 Ti0.04280.08560.12840.17120.2140.190.150.170.131. GeForce GTX 1070 Ti: $419 reported cost.2. GeForce GTX 1080: $549 reported cost.3. GeForce GTX 1080 Ti: $699 reported cost.4. GeForce RTX 2080 Ti: $1199 reported cost.

OpenBenchmarking.orgImages Per Second Per Dollar, More Is BetterNVIDIA GPU Cloud TensorFlow 18.09Performance / Cost - Test: Googlenet, FP32GeForce GTX 1080 TiGeForce RTX 2080 Ti0.17780.35560.53340.71120.8890.790.631. GeForce GTX 1080 Ti: $699 reported cost.2. GeForce RTX 2080 Ti: $1199 reported cost.

OpenBenchmarking.orgImages Per Second Per Dollar, More Is BetterNVIDIA GPU Cloud TensorFlow 18.09Performance / Cost - Test: Inception v4, FP32GeForce GTX 1080 TiGeForce RTX 2080 Ti0.02030.04060.06090.08120.10150.090.071. GeForce GTX 1080 Ti: $699 reported cost.2. GeForce RTX 2080 Ti: $1199 reported cost.

47 Results Shown

NVIDIA GPU Cloud TensorFlow
NVIDIA GPU Cloud TensorFlow:
  ResNet-50, FP16
  GPU Temp Monitor
  System Power Consumption Monitor
NVIDIA GPU Cloud TensorFlow
NVIDIA GPU Cloud TensorFlow:
  ResNet-50, FP32
  GPU Temp Monitor
  System Power Consumption Monitor
NVIDIA GPU Cloud TensorFlow
NVIDIA GPU Cloud TensorFlow:
  AlexNet, FP16
  GPU Temp Monitor
  System Power Consumption Monitor
NVIDIA GPU Cloud TensorFlow
NVIDIA GPU Cloud TensorFlow:
  Googlenet, FP16
  GPU Temp Monitor
  System Power Consumption Monitor
NVIDIA GPU Cloud TensorFlow
NVIDIA GPU Cloud TensorFlow:
  Googlenet, FP32
  GPU Temp Monitor
  System Power Consumption Monitor
NVIDIA GPU Cloud TensorFlow
NVIDIA GPU Cloud TensorFlow:
  Inception v4, FP16
  GPU Temp Monitor
  System Power Consumption Monitor
NVIDIA GPU Cloud TensorFlow
NVIDIA GPU Cloud TensorFlow:
  Inception v4, FP32
  GPU Temp Monitor
  System Power Consumption Monitor
NVIDIA GPU Cloud TensorFlow
NVIDIA GPU Cloud TensorFlow:
  VGG-16, FP16
  GPU Temp Monitor
  System Power Consumption Monitor
NVIDIA GPU Cloud TensorFlow
NVIDIA GPU Cloud TensorFlow:
  VGG-16, FP32
  GPU Temp Monitor
  System Power Consumption Monitor
  Phoronix Test Suite System Monitoring
  Phoronix Test Suite System Monitoring
  Performance / Cost - ResNet-50, FP16
  Performance / Cost - ResNet-50, FP32
  Performance / Cost - AlexNet, FP16
  Performance / Cost - Googlenet, FP16
  Performance / Cost - Inception v4, FP16
  Performance / Cost - VGG-16, FP16
  Performance / Cost - VGG-16, FP32
  Performance / Cost - Googlenet, FP32
  Performance / Cost - Inception v4, FP32