NGC TensorFlow NVIDIA GeForce RTX 2080 Ti

NVIDIA GPU Cloud TensorFlow benchmarks with ResNet-50, AlexNet, Googlenet, Inception V4, VGG-16. NVIDIA GPU benchmarks on Ubuntu Linux by Michael Larabel for a future article on Phoronix.com.

Compare your own system(s) to this result file with the Phoronix Test Suite by running the command: phoronix-test-suite benchmark 1810070-PTS-NVIDIANG57
Jump To Table - Results

View

Do Not Show Noisy Results
Do Not Show Results With Incomplete Data
Do Not Show Results With Little Change/Spread
List Notable Results

Statistics

Show Overall Harmonic Mean(s)
Show Overall Geometric Mean
Show Wins / Losses Counts (Pie Chart)
Normalize Results
Remove Outliers Before Calculating Averages

Graph Settings

Force Line Graphs Where Applicable
Convert To Scalar Where Applicable
Disable Color Branding
Prefer Vertical Bar Graphs
No Box Plots
On Line Graphs With Missing Data, Connect The Line Gaps

Multi-Way Comparison

Condense Multi-Option Tests Into Single Result Graphs
Condense Test Profiles With Multiple Version Results Into Single Result Graphs

Table

Show Detailed System Result Table

Run Management

Highlight
Result
Hide
Result
Result
Identifier
Performance Per
Dollar
Date
Run
  Test
  Duration
GeForce GTX 980 Ti
October 07 2018
  18 Minutes
GeForce GTX 1060
October 07 2018
  22 Minutes
GeForce GTX 1070
October 07 2018
  24 Minutes
GeForce GTX 1070 Ti
October 07 2018
  22 Minutes
GeForce GTX 1080
October 07 2018
  21 Minutes
GeForce GTX 1080 Ti
October 07 2018
  25 Minutes
GeForce RTX 2080 Ti
October 07 2018
  24 Minutes
Invert Hiding All Results Option
  22 Minutes

Only show results where is faster than
Only show results matching title/arguments (delimit multiple options with a comma):
Do not show results matching title/arguments (delimit multiple options with a comma):

GeForce GTX 980 Ti

Processor: Intel Core i7-8086K @ 5.00GHz (6 Cores / 12 Threads), Motherboard: ASUS PRIME Z370-A (1002 BIOS), Chipset: Intel Device 3ec2, Memory: 16384MB, Disk: 525GB SABRENT + 118GB INTEL SSDPEK1W120GA, Graphics: NVIDIA GeForce GTX 980 Ti 6GB (999/3505MHz), Audio: Realtek ALC1220, Monitor: Acer B286HK, Network: Intel Connection

OS: Ubuntu 18.04, Kernel: 4.19.0-041900rc6-generic (x86_64) 20180930, Desktop: GNOME Shell 3.28.3, Display Server: X Server 1.19.6, Display Driver: NVIDIA 410.57, OpenGL: 4.6.0, Compiler: GCC 7.3.0 + CUDA 10.0, File-System: ext4, Screen Resolution: 3840x2160

Processor Notes: Scaling Governor: intel_pstate performance
Security Notes: KPTI + __user pointer sanitization + Full generic retpoline IBPB IBRS_FW + SSB disabled via prctl and seccomp + PTE Inversion; VMX: conditional cache flushes SMT vulnerable

GeForce GTX 1060

Changed Graphics to NVIDIA GeForce GTX 1060 6GB (1506/4006MHz).

GeForce GTX 1070

Changed Graphics to NVIDIA GeForce GTX 1070 8GB (1506/4006MHz).

GeForce GTX 1070 Ti

Changed Graphics to Zotac NVIDIA GeForce GTX 1070 Ti 8GB (1607/4006MHz).

GeForce GTX 1080

Changed Graphics to NVIDIA GeForce GTX 1080 8GB (1607/5005MHz).

GeForce GTX 1080 Ti

Changed Graphics to NVIDIA GeForce GTX 1080 Ti 11GB (1480/5508MHz).

GeForce RTX 2080 Ti

Changed Graphics to NVIDIA GeForce RTX 2080 Ti 11GB (1350/7000MHz).

NGC TensorFlow NVIDIA GeForce RTX 2080 TiOpenBenchmarking.orgPhoronix Test SuiteIntel Core i7-8086K @ 5.00GHz (6 Cores / 12 Threads)ASUS PRIME Z370-A (1002 BIOS)Intel Device 3ec216384MB525GB SABRENT + 118GB INTEL SSDPEK1W120GANVIDIA GeForce GTX 980 Ti 6GB (999/3505MHz)NVIDIA GeForce GTX 1060 6GB (1506/4006MHz)NVIDIA GeForce GTX 1070 8GB (1506/4006MHz)Zotac NVIDIA GeForce GTX 1070 Ti 8GB (1607/4006MHz)NVIDIA GeForce GTX 1080 8GB (1607/5005MHz)NVIDIA GeForce GTX 1080 Ti 11GB (1480/5508MHz)NVIDIA GeForce RTX 2080 Ti 11GB (1350/7000MHz)Realtek ALC1220Acer B286HKIntel ConnectionUbuntu 18.044.19.0-041900rc6-generic (x86_64) 20180930GNOME Shell 3.28.3X Server 1.19.6NVIDIA 410.574.6.0GCC 7.3.0 + CUDA 10.0ext43840x2160ProcessorMotherboardChipsetMemoryDiskGraphicsAudioMonitorNetworkOSKernelDesktopDisplay ServerDisplay DriverOpenGLCompilerFile-SystemScreen ResolutionNGC TensorFlow NVIDIA GeForce RTX 2080 Ti BenchmarksSystem Logs- Scaling Governor: intel_pstate performance- KPTI + __user pointer sanitization + Full generic retpoline IBPB IBRS_FW + SSB disabled via prctl and seccomp + PTE Inversion; VMX: conditional cache flushes SMT vulnerable

GeForce GTX 980 TiGeForce GTX 1060GeForce GTX 1070GeForce GTX 1070 TiGeForce GTX 1080GeForce GTX 1080 TiGeForce RTX 2080 TiResult OverviewPhoronix Test Suite100%180%260%339%419%NVIDIA GPU Cloud TensorFlowNVIDIA GPU Cloud TensorFlowNVIDIA GPU Cloud TensorFlowNVIDIA GPU Cloud TensorFlowNVIDIA GPU Cloud TensorFlowInception v4, FP16AlexNet, FP16ResNet-50, FP16Googlenet, FP16VGG-16, FP16

GeForce GTX 980 TiGeForce GTX 1060GeForce GTX 1070GeForce GTX 1070 TiGeForce GTX 1080GeForce GTX 1080 TiGeForce RTX 2080 TiPer Watt Result OverviewPhoronix Test Suite100%171%242%312%383%NVIDIA GPU Cloud TensorFlowNVIDIA GPU Cloud TensorFlowNVIDIA GPU Cloud TensorFlowNVIDIA GPU Cloud TensorFlowNVIDIA GPU Cloud TensorFlowInception v4, FP16AlexNet, FP16ResNet-50, FP16Googlenet, FP16VGG-16, FP16

NGC TensorFlow NVIDIA GeForce RTX 2080 Tingc-tensorflow: ResNet-50, FP16ngc-tensorflow: ResNet-50, FP32ngc-tensorflow: AlexNet, FP16ngc-tensorflow: Googlenet, FP16ngc-tensorflow: Googlenet, FP32ngc-tensorflow: Inception v4, FP16ngc-tensorflow: Inception v4, FP32ngc-tensorflow: VGG-16, FP16ngc-tensorflow: VGG-16, FP32GeForce GTX 980 TiGeForce GTX 1060GeForce GTX 1070GeForce GTX 1070 TiGeForce GTX 1080GeForce GTX 1080 TiGeForce RTX 2080 Ti153155835840.9378.50116109026132.0355.50162125156637544.7077.3071.7318713817944525489.4779.27194143187545854.9793.2082.93272210267463155274.5065.9713111945528444101009761134.2089.23206152OpenBenchmarking.org

NVIDIA GPU Cloud TensorFlow

This test profile uses the NVIDIA GPU Cloud (NGC/nvcr.io) for running the TensorFlow image inside Docker for benchmarking. You must have already signed into NGC for this test profile to work. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgImages Per Second, More Is BetterNVIDIA GPU Cloud TensorFlow 18.09Test: ResNet-50, FP16GeForce GTX 980 TiGeForce GTX 1060GeForce GTX 1070GeForce GTX 1070 TiGeForce GTX 1080GeForce GTX 1080 TiGeForce RTX 2080 Ti100200300400500SE +/- 0.76, N = 3SE +/- 0.23, N = 3SE +/- 0.32, N = 3SE +/- 0.32, N = 3SE +/- 0.44, N = 3SE +/- 0.39, N = 3SE +/- 4.02, N = 3153116162187194272455
OpenBenchmarking.orgImages Per Second, More Is BetterNVIDIA GPU Cloud TensorFlow 18.09Test: ResNet-50, FP16GeForce GTX 980 TiGeForce GTX 1060GeForce GTX 1070GeForce GTX 1070 TiGeForce GTX 1080GeForce GTX 1080 TiGeForce RTX 2080 Ti80160240320400Min: 151.4 / Avg: 152.57 / Max: 154Min: 115.5 / Avg: 115.87 / Max: 116.3Min: 161.3 / Avg: 161.67 / Max: 162.3Min: 187.1 / Avg: 187.47 / Max: 188.1Min: 193.1 / Avg: 193.77 / Max: 194.6Min: 271.5 / Avg: 272.03 / Max: 272.8Min: 449.8 / Avg: 454.5 / Max: 462.5

OpenBenchmarking.orgImages Per Second Per Watt, More Is BetterNVIDIA GPU Cloud TensorFlow 18.09Test: ResNet-50, FP16GeForce GTX 980 TiGeForce GTX 1060GeForce GTX 1070GeForce GTX 1070 TiGeForce GTX 1080GeForce GTX 1080 TiGeForce RTX 2080 Ti0.49050.9811.47151.9622.45250.660.760.981.031.091.192.18

MinAvgMaxGeForce GTX 980 Ti38.066.782.0GeForce GTX 106032.053.365.0GeForce GTX 107036.054.066.0GeForce GTX 1070 Ti36.051.160.0GeForce GTX 108031.054.068.0GeForce GTX 1080 Ti40.057.869.0GeForce RTX 2080 Ti37.047.056.0OpenBenchmarking.orgCelsius, Fewer Is BetterNVIDIA GPU Cloud TensorFlow 18.09GPU Temperature Monitor20406080100

MinAvgMaxGeForce GTX 980 Ti83.0232.1304.2GeForce GTX 106060.5153.4184.1GeForce GTX 107069.0165.6209.3GeForce GTX 1070 Ti77.1182.3240.6GeForce GTX 108041.4178.0241.8GeForce GTX 1080 Ti99.4229.4312.0GeForce RTX 2080 Ti57.3208.5336.0OpenBenchmarking.orgWatts, Fewer Is BetterNVIDIA GPU Cloud TensorFlow 18.09System Power Consumption Monitor80160240320400

OpenBenchmarking.orgImages Per Second, More Is BetterNVIDIA GPU Cloud TensorFlow 18.09Test: ResNet-50, FP32GeForce GTX 1070GeForce GTX 1070 TiGeForce GTX 1080GeForce GTX 1080 TiGeForce RTX 2080 Ti60120180240300SE +/- 0.15, N = 3SE +/- 0.03, N = 3SE +/- 0.06, N = 3SE +/- 0.19, N = 3SE +/- 0.27, N = 3125138143210284
OpenBenchmarking.orgImages Per Second, More Is BetterNVIDIA GPU Cloud TensorFlow 18.09Test: ResNet-50, FP32GeForce GTX 1070GeForce GTX 1070 TiGeForce GTX 1080GeForce GTX 1080 TiGeForce RTX 2080 Ti50100150200250Min: 124.7 / Avg: 124.97 / Max: 125.2Min: 137.7 / Avg: 137.73 / Max: 137.8Min: 142.5 / Avg: 142.6 / Max: 142.7Min: 210.1 / Avg: 210.33 / Max: 210.7Min: 283.5 / Avg: 284.03 / Max: 284.3

OpenBenchmarking.orgImages Per Second Per Watt, More Is BetterNVIDIA GPU Cloud TensorFlow 18.09Test: ResNet-50, FP32GeForce GTX 1070GeForce GTX 1070 TiGeForce GTX 1080GeForce GTX 1080 TiGeForce RTX 2080 Ti0.26780.53560.80341.07121.3390.740.750.740.911.19

MinAvgMaxGeForce GTX 107053.063.370.0GeForce GTX 1070 Ti46.056.662.0GeForce GTX 108055.064.972.0GeForce GTX 1080 Ti57.065.874.0GeForce RTX 2080 Ti47.056.966.0OpenBenchmarking.orgCelsius, Fewer Is BetterNVIDIA GPU Cloud TensorFlow 18.09GPU Temperature Monitor20406080100

MinAvgMaxGeForce GTX 107043.6170.0208.2GeForce GTX 1070 Ti48.0183.0236.8GeForce GTX 108065.8192.5240.7GeForce GTX 1080 Ti74.8230.1312.5GeForce RTX 2080 Ti57.1238.2339.5OpenBenchmarking.orgWatts, Fewer Is BetterNVIDIA GPU Cloud TensorFlow 18.09System Power Consumption Monitor80160240320400

OpenBenchmarking.orgImages Per Second, More Is BetterNVIDIA GPU Cloud TensorFlow 18.09Test: AlexNet, FP16GeForce GTX 980 TiGeForce GTX 1060GeForce GTX 1070GeForce GTX 1070 TiGeForce GTX 1080GeForce GTX 1080 TiGeForce RTX 2080 Ti9001800270036004500SE +/- 6.45, N = 3SE +/- 1.46, N = 3SE +/- 2.52, N = 3SE +/- 0.85, N = 3SE +/- 2.46, N = 3SE +/- 2.58, N = 3SE +/- 4.74, N = 31558109015661794187526744410
OpenBenchmarking.orgImages Per Second, More Is BetterNVIDIA GPU Cloud TensorFlow 18.09Test: AlexNet, FP16GeForce GTX 980 TiGeForce GTX 1060GeForce GTX 1070GeForce GTX 1070 TiGeForce GTX 1080GeForce GTX 1080 TiGeForce RTX 2080 Ti8001600240032004000Min: 1545 / Avg: 1557.87 / Max: 1565.2Min: 1087.9 / Avg: 1089.83 / Max: 1092.7Min: 1561.9 / Avg: 1566.03 / Max: 1570.6Min: 1792.7 / Avg: 1793.83 / Max: 1795.5Min: 1871.7 / Avg: 1874.6 / Max: 1879.5Min: 2669.3 / Avg: 2673.5 / Max: 2678.2Min: 4404.6 / Avg: 4410.3 / Max: 4419.7

OpenBenchmarking.orgImages Per Second Per Watt, More Is BetterNVIDIA GPU Cloud TensorFlow 18.09Test: AlexNet, FP16GeForce GTX 980 TiGeForce GTX 1060GeForce GTX 1070GeForce GTX 1070 TiGeForce GTX 1080GeForce GTX 1080 TiGeForce RTX 2080 Ti5101520256.817.6710.4710.6010.8513.1222.74

MinAvgMaxGeForce GTX 980 Ti62.073.180.0GeForce GTX 106045.055.262.0GeForce GTX 107059.063.466.0GeForce GTX 1070 Ti49.055.359.0GeForce GTX 108060.064.467.0GeForce GTX 1080 Ti61.064.968.0GeForce RTX 2080 Ti55.058.863.0OpenBenchmarking.orgCelsius, Fewer Is BetterNVIDIA GPU Cloud TensorFlow 18.09GPU Temperature Monitor20406080100

MinAvgMaxGeForce GTX 980 Ti110.7228.6304.8GeForce GTX 106069.2142.1176.5GeForce GTX 107044.7149.6199.7GeForce GTX 1070 Ti56.9169.3228.0GeForce GTX 108043.7172.8228.0GeForce GTX 1080 Ti68.7203.8298.4GeForce RTX 2080 Ti59.4193.9330.8OpenBenchmarking.orgWatts, Fewer Is BetterNVIDIA GPU Cloud TensorFlow 18.09System Power Consumption Monitor80160240320400

OpenBenchmarking.orgImages Per Second, More Is BetterNVIDIA GPU Cloud TensorFlow 18.09Test: Googlenet, FP16GeForce GTX 980 TiGeForce GTX 1060GeForce GTX 1070GeForce GTX 1070 TiGeForce GTX 1080GeForce GTX 1080 TiGeForce RTX 2080 Ti2004006008001000SE +/- 1.85, N = 3SE +/- 0.40, N = 3SE +/- 0.22, N = 3SE +/- 0.32, N = 3SE +/- 0.15, N = 3SE +/- 2.54, N = 3SE +/- 1.58, N = 33582613754524586311009
OpenBenchmarking.orgImages Per Second, More Is BetterNVIDIA GPU Cloud TensorFlow 18.09Test: Googlenet, FP16GeForce GTX 980 TiGeForce GTX 1060GeForce GTX 1070GeForce GTX 1070 TiGeForce GTX 1080GeForce GTX 1080 TiGeForce RTX 2080 Ti2004006008001000Min: 354.6 / Avg: 358.3 / Max: 360.2Min: 260.4 / Avg: 261.2 / Max: 261.6Min: 374.9 / Avg: 375.17 / Max: 375.6Min: 452 / Avg: 452.37 / Max: 453Min: 458.1 / Avg: 458.33 / Max: 458.6Min: 626 / Avg: 631.03 / Max: 634.2Min: 1006.8 / Avg: 1008.77 / Max: 1011.9

OpenBenchmarking.orgImages Per Second Per Watt, More Is BetterNVIDIA GPU Cloud TensorFlow 18.09Test: Googlenet, FP16GeForce GTX 980 TiGeForce GTX 1060GeForce GTX 1070GeForce GTX 1070 TiGeForce GTX 1080GeForce GTX 1080 TiGeForce RTX 2080 Ti0.9271.8542.7813.7084.6351.431.632.052.212.252.434.12

MinAvgMaxGeForce GTX 980 Ti68.079.684.0GeForce GTX 106051.065.971.0GeForce GTX 107058.069.474.0GeForce GTX 1070 Ti46.060.165.0GeForce GTX 108057.070.877.0GeForce GTX 1080 Ti58.072.380.0GeForce RTX 2080 Ti54.064.370.0OpenBenchmarking.orgCelsius, Fewer Is BetterNVIDIA GPU Cloud TensorFlow 18.09GPU Temperature Monitor20406080100

MinAvgMaxGeForce GTX 980 Ti84.5249.8313.1GeForce GTX 106040.9160.4180.8GeForce GTX 107085.6183.0207.8GeForce GTX 1070 Ti47.2205.0246.4GeForce GTX 108041.5203.8245.6GeForce GTX 1080 Ti47.8259.7313.5GeForce RTX 2080 Ti59.6244.7336.9OpenBenchmarking.orgWatts, Fewer Is BetterNVIDIA GPU Cloud TensorFlow 18.09System Power Consumption Monitor80160240320400

OpenBenchmarking.orgImages Per Second, More Is BetterNVIDIA GPU Cloud TensorFlow 18.09Test: Googlenet, FP32GeForce GTX 1080 TiGeForce RTX 2080 Ti160320480640800SE +/- 0.37, N = 3SE +/- 0.45, N = 3552761
OpenBenchmarking.orgImages Per Second, More Is BetterNVIDIA GPU Cloud TensorFlow 18.09Test: Googlenet, FP32GeForce GTX 1080 TiGeForce RTX 2080 Ti130260390520650Min: 550.9 / Avg: 551.63 / Max: 552.1Min: 760.6 / Avg: 761.1 / Max: 762

OpenBenchmarking.orgImages Per Second Per Watt, More Is BetterNVIDIA GPU Cloud TensorFlow 18.09Test: Googlenet, FP32GeForce GTX 1080 TiGeForce RTX 2080 Ti0.62781.25561.88342.51123.1392.152.79

MinAvgMaxGeForce GTX 1080 Ti63.074.281.0GeForce RTX 2080 Ti58.067.473.0OpenBenchmarking.orgCelsius, Fewer Is BetterNVIDIA GPU Cloud TensorFlow 18.09GPU Temperature Monitor20406080100

MinAvgMaxGeForce GTX 1080 Ti52.3256.7309.5GeForce RTX 2080 Ti61.2272.8341.0OpenBenchmarking.orgWatts, Fewer Is BetterNVIDIA GPU Cloud TensorFlow 18.09System Power Consumption Monitor80160240320400

OpenBenchmarking.orgImages Per Second, More Is BetterNVIDIA GPU Cloud TensorFlow 18.09Test: Inception v4, FP16GeForce GTX 980 TiGeForce GTX 1060GeForce GTX 1070GeForce GTX 1070 TiGeForce GTX 1080GeForce GTX 1080 TiGeForce RTX 2080 Ti306090120150SE +/- 0.03, N = 3SE +/- 0.03, N = 3SE +/- 0.00, N = 3SE +/- 0.03, N = 3SE +/- 0.10, N = 3SE +/- 0.23, N = 340.9332.0344.7054.0054.9774.50134.20
OpenBenchmarking.orgImages Per Second, More Is BetterNVIDIA GPU Cloud TensorFlow 18.09Test: Inception v4, FP16GeForce GTX 980 TiGeForce GTX 1060GeForce GTX 1070GeForce GTX 1070 TiGeForce GTX 1080GeForce GTX 1080 TiGeForce RTX 2080 Ti306090120150Min: 40.9 / Avg: 40.93 / Max: 41Min: 32 / Avg: 32.03 / Max: 32.1Min: 44.7 / Avg: 44.7 / Max: 44.7Min: 54.9 / Avg: 54.97 / Max: 55Min: 74.4 / Avg: 74.5 / Max: 74.7Min: 133.8 / Avg: 134.2 / Max: 134.6

OpenBenchmarking.orgImages Per Second Per Watt, More Is BetterNVIDIA GPU Cloud TensorFlow 18.09Test: Inception v4, FP16GeForce GTX 980 TiGeForce GTX 1060GeForce GTX 1070GeForce GTX 1070 TiGeForce GTX 1080GeForce GTX 1080 TiGeForce RTX 2080 Ti0.15530.31060.46590.62120.77650.180.220.280.300.310.370.69

MinAvgMaxGeForce GTX 980 Ti59.074.184.0GeForce GTX 106044.060.870.0GeForce GTX 107049.062.171.0GeForce GTX 1070 Ti41.053.764.0GeForce GTX 108049.062.775.0GeForce GTX 1080 Ti58.067.878.0GeForce RTX 2080 Ti54.059.265.0OpenBenchmarking.orgCelsius, Fewer Is BetterNVIDIA GPU Cloud TensorFlow 18.09GPU Temperature Monitor20406080100

MinAvgMaxGeForce GTX 980 Ti75.2223.6316.6GeForce GTX 106068.9148.3184.9GeForce GTX 107066.4161.2208.3GeForce GTX 1070 Ti77.2177.3247.8GeForce GTX 108065.2177.0250.2GeForce GTX 1080 Ti53.4201.0314.9GeForce RTX 2080 Ti60.3195.7336.9OpenBenchmarking.orgWatts, Fewer Is BetterNVIDIA GPU Cloud TensorFlow 18.09System Power Consumption Monitor80160240320400

OpenBenchmarking.orgImages Per Second, More Is BetterNVIDIA GPU Cloud TensorFlow 18.09Test: Inception v4, FP32GeForce GTX 1080 TiGeForce RTX 2080 Ti20406080100SE +/- 0.03, N = 3SE +/- 0.09, N = 365.9789.23
OpenBenchmarking.orgImages Per Second, More Is BetterNVIDIA GPU Cloud TensorFlow 18.09Test: Inception v4, FP32GeForce GTX 1080 TiGeForce RTX 2080 Ti20406080100Min: 65.9 / Avg: 65.97 / Max: 66Min: 89.1 / Avg: 89.23 / Max: 89.4

OpenBenchmarking.orgImages Per Second Per Watt, More Is BetterNVIDIA GPU Cloud TensorFlow 18.09Test: Inception v4, FP32GeForce GTX 1080 TiGeForce RTX 2080 Ti0.08780.17560.26340.35120.4390.300.39

MinAvgMaxGeForce GTX 1080 Ti55.067.879.0GeForce RTX 2080 Ti51.059.968.0OpenBenchmarking.orgCelsius, Fewer Is BetterNVIDIA GPU Cloud TensorFlow 18.09GPU Temperature Monitor20406080100

MinAvgMaxGeForce GTX 1080 Ti55.5220.0322.2GeForce RTX 2080 Ti58.7227.6343.5OpenBenchmarking.orgWatts, Fewer Is BetterNVIDIA GPU Cloud TensorFlow 18.09System Power Consumption Monitor80160240320400

OpenBenchmarking.orgImages Per Second, More Is BetterNVIDIA GPU Cloud TensorFlow 18.09Test: VGG-16, FP16GeForce GTX 980 TiGeForce GTX 1060GeForce GTX 1070GeForce GTX 1070 TiGeForce GTX 1080GeForce GTX 1080 TiGeForce RTX 2080 Ti50100150200250SE +/- 0.31, N = 3SE +/- 0.10, N = 3SE +/- 0.15, N = 3SE +/- 0.12, N = 3SE +/- 0.15, N = 3SE +/- 0.07, N = 3SE +/- 0.12, N = 378.5055.5077.3089.4793.20131.00206.00
OpenBenchmarking.orgImages Per Second, More Is BetterNVIDIA GPU Cloud TensorFlow 18.09Test: VGG-16, FP16GeForce GTX 980 TiGeForce GTX 1060GeForce GTX 1070GeForce GTX 1070 TiGeForce GTX 1080GeForce GTX 1080 TiGeForce RTX 2080 Ti4080120160200Min: 77.9 / Avg: 78.5 / Max: 78.9Min: 55.4 / Avg: 55.5 / Max: 55.7Min: 77.1 / Avg: 77.3 / Max: 77.6Min: 89.3 / Avg: 89.47 / Max: 89.7Min: 93 / Avg: 93.2 / Max: 93.5Min: 131.3 / Avg: 131.43 / Max: 131.5Min: 205.6 / Avg: 205.8 / Max: 206

OpenBenchmarking.orgImages Per Second Per Watt, More Is BetterNVIDIA GPU Cloud TensorFlow 18.09Test: VGG-16, FP16GeForce GTX 980 TiGeForce GTX 1060GeForce GTX 1070GeForce GTX 1070 TiGeForce GTX 1080GeForce GTX 1080 TiGeForce RTX 2080 Ti0.19130.38260.57390.76520.95650.320.360.470.460.470.590.85

MinAvgMaxGeForce GTX 980 Ti63.078.383.0GeForce GTX 106043.060.167.0GeForce GTX 107049.062.569.0GeForce GTX 1070 Ti43.055.262.0GeForce GTX 108050.064.172.0GeForce GTX 1080 Ti63.072.078.0GeForce RTX 2080 Ti57.062.767.0OpenBenchmarking.orgCelsius, Fewer Is BetterNVIDIA GPU Cloud TensorFlow 18.09GPU Temperature Monitor20406080100

MinAvgMaxGeForce GTX 980 Ti79.6247.2314.7GeForce GTX 106063.5155.4180.2GeForce GTX 107082.9164.7198.5GeForce GTX 1070 Ti95.0193.1238.7GeForce GTX 108081.9197.5241.1GeForce GTX 1080 Ti51.2223.1303.0GeForce RTX 2080 Ti60.4243.5339.6OpenBenchmarking.orgWatts, Fewer Is BetterNVIDIA GPU Cloud TensorFlow 18.09System Power Consumption Monitor80160240320400

OpenBenchmarking.orgImages Per Second, More Is BetterNVIDIA GPU Cloud TensorFlow 18.09Test: VGG-16, FP32GeForce GTX 1070GeForce GTX 1070 TiGeForce GTX 1080GeForce GTX 1080 TiGeForce RTX 2080 Ti306090120150SE +/- 0.09, N = 3SE +/- 0.03, N = 3SE +/- 0.03, N = 3SE +/- 0.09, N = 3SE +/- 0.23, N = 371.7379.2782.93119.00152.00
OpenBenchmarking.orgImages Per Second, More Is BetterNVIDIA GPU Cloud TensorFlow 18.09Test: VGG-16, FP32GeForce GTX 1070GeForce GTX 1070 TiGeForce GTX 1080GeForce GTX 1080 TiGeForce RTX 2080 Ti306090120150Min: 71.6 / Avg: 71.73 / Max: 71.9Min: 79.2 / Avg: 79.27 / Max: 79.3Min: 82.9 / Avg: 82.93 / Max: 83Min: 119.2 / Avg: 119.37 / Max: 119.5Min: 151.5 / Avg: 151.87 / Max: 152.3

OpenBenchmarking.orgImages Per Second Per Watt, More Is BetterNVIDIA GPU Cloud TensorFlow 18.09Test: VGG-16, FP32GeForce GTX 1070GeForce GTX 1070 TiGeForce GTX 1080GeForce GTX 1080 TiGeForce RTX 2080 Ti0.12830.25660.38490.51320.64150.450.420.440.510.57

MinAvgMaxGeForce GTX 107057.065.470.0GeForce GTX 1070 Ti48.057.362.0GeForce GTX 108059.067.773.0GeForce GTX 1080 Ti65.073.279.0GeForce RTX 2080 Ti57.065.571.0OpenBenchmarking.orgCelsius, Fewer Is BetterNVIDIA GPU Cloud TensorFlow 18.09GPU Temperature Monitor20406080100

MinAvgMaxGeForce GTX 107044.4159.8198.1GeForce GTX 1070 Ti47.9188.5232.2GeForce GTX 108043.1188.3231.2GeForce GTX 1080 Ti124.1233.8303.8GeForce RTX 2080 Ti59.1264.7341.2OpenBenchmarking.orgWatts, Fewer Is BetterNVIDIA GPU Cloud TensorFlow 18.09System Power Consumption Monitor80160240320400

GPU Temperature Monitor

MinAvgMaxGeForce GTX 980 Ti38.071.284.0GeForce GTX 106032.057.171.0GeForce GTX 107036.061.674.0GeForce GTX 1070 Ti36.053.765.0GeForce GTX 108031.062.477.0GeForce GTX 1080 Ti40.068.681.0GeForce RTX 2080 Ti37.060.573.0OpenBenchmarking.orgCelsiusGPU Temperature MonitorPhoronix Test Suite System Monitoring20406080100

System Power Consumption Monitor

MinAvgMaxGeForce GTX 980 Ti50.4198.2318.0GeForce GTX 106040.9130.9184.9GeForce GTX 107043.6151.0209.3GeForce GTX 1070 Ti47.2165.3247.8GeForce GTX 108041.4166.1250.2GeForce GTX 1080 Ti47.8220.9322.2GeForce RTX 2080 Ti56.8224.0343.5OpenBenchmarking.orgWattsSystem Power Consumption MonitorPhoronix Test Suite System Monitoring80160240320400

NVIDIA GPU Cloud TensorFlow

OpenBenchmarking.orgImages Per Second Per Dollar, More Is BetterNVIDIA GPU Cloud TensorFlow 18.09Performance / Cost - Test: ResNet-50, FP16GeForce GTX 1070 TiGeForce GTX 1080GeForce GTX 1080 TiGeForce RTX 2080 Ti0.10130.20260.30390.40520.50650.450.350.390.381. GeForce GTX 1070 Ti: $419 reported cost.2. GeForce GTX 1080: $549 reported cost.3. GeForce GTX 1080 Ti: $699 reported cost.4. GeForce RTX 2080 Ti: $1199 reported cost.

OpenBenchmarking.orgImages Per Second Per Dollar, More Is BetterNVIDIA GPU Cloud TensorFlow 18.09Performance / Cost - Test: ResNet-50, FP32GeForce GTX 1070 TiGeForce GTX 1080GeForce GTX 1080 TiGeForce RTX 2080 Ti0.07430.14860.22290.29720.37150.330.260.300.241. GeForce GTX 1070 Ti: $419 reported cost.2. GeForce GTX 1080: $549 reported cost.3. GeForce GTX 1080 Ti: $699 reported cost.4. GeForce RTX 2080 Ti: $1199 reported cost.

OpenBenchmarking.orgImages Per Second Per Dollar, More Is BetterNVIDIA GPU Cloud TensorFlow 18.09Performance / Cost - Test: AlexNet, FP16GeForce GTX 1070 TiGeForce GTX 1080GeForce GTX 1080 TiGeForce RTX 2080 Ti0.9631.9262.8893.8524.8154.283.423.833.681. GeForce GTX 1070 Ti: $419 reported cost.2. GeForce GTX 1080: $549 reported cost.3. GeForce GTX 1080 Ti: $699 reported cost.4. GeForce RTX 2080 Ti: $1199 reported cost.

OpenBenchmarking.orgImages Per Second Per Dollar, More Is BetterNVIDIA GPU Cloud TensorFlow 18.09Performance / Cost - Test: Googlenet, FP16GeForce GTX 1070 TiGeForce GTX 1080GeForce GTX 1080 TiGeForce RTX 2080 Ti0.2430.4860.7290.9721.2151.080.830.900.841. GeForce GTX 1070 Ti: $419 reported cost.2. GeForce GTX 1080: $549 reported cost.3. GeForce GTX 1080 Ti: $699 reported cost.4. GeForce RTX 2080 Ti: $1199 reported cost.

OpenBenchmarking.orgImages Per Second Per Dollar, More Is BetterNVIDIA GPU Cloud TensorFlow 18.09Performance / Cost - Test: Inception v4, FP16GeForce GTX 1070 TiGeForce GTX 1080GeForce GTX 1080 TiGeForce RTX 2080 Ti0.02930.05860.08790.11720.14650.130.100.110.111. GeForce GTX 1070 Ti: $419 reported cost.2. GeForce GTX 1080: $549 reported cost.3. GeForce GTX 1080 Ti: $699 reported cost.4. GeForce RTX 2080 Ti: $1199 reported cost.

OpenBenchmarking.orgImages Per Second Per Dollar, More Is BetterNVIDIA GPU Cloud TensorFlow 18.09Performance / Cost - Test: VGG-16, FP16GeForce GTX 1070 TiGeForce GTX 1080GeForce GTX 1080 TiGeForce RTX 2080 Ti0.04730.09460.14190.18920.23650.210.170.190.171. GeForce GTX 1070 Ti: $419 reported cost.2. GeForce GTX 1080: $549 reported cost.3. GeForce GTX 1080 Ti: $699 reported cost.4. GeForce RTX 2080 Ti: $1199 reported cost.

OpenBenchmarking.orgImages Per Second Per Dollar, More Is BetterNVIDIA GPU Cloud TensorFlow 18.09Performance / Cost - Test: VGG-16, FP32GeForce GTX 1070 TiGeForce GTX 1080GeForce GTX 1080 TiGeForce RTX 2080 Ti0.04280.08560.12840.17120.2140.190.150.170.131. GeForce GTX 1070 Ti: $419 reported cost.2. GeForce GTX 1080: $549 reported cost.3. GeForce GTX 1080 Ti: $699 reported cost.4. GeForce RTX 2080 Ti: $1199 reported cost.

OpenBenchmarking.orgImages Per Second Per Dollar, More Is BetterNVIDIA GPU Cloud TensorFlow 18.09Performance / Cost - Test: Googlenet, FP32GeForce GTX 1080 TiGeForce RTX 2080 Ti0.17780.35560.53340.71120.8890.790.631. GeForce GTX 1080 Ti: $699 reported cost.2. GeForce RTX 2080 Ti: $1199 reported cost.

OpenBenchmarking.orgImages Per Second Per Dollar, More Is BetterNVIDIA GPU Cloud TensorFlow 18.09Performance / Cost - Test: Inception v4, FP32GeForce GTX 1080 TiGeForce RTX 2080 Ti0.02030.04060.06090.08120.10150.090.071. GeForce GTX 1080 Ti: $699 reported cost.2. GeForce RTX 2080 Ti: $1199 reported cost.

47 Results Shown

NVIDIA GPU Cloud TensorFlow
NVIDIA GPU Cloud TensorFlow:
  ResNet-50, FP16
  GPU Temp Monitor
  System Power Consumption Monitor
NVIDIA GPU Cloud TensorFlow
NVIDIA GPU Cloud TensorFlow:
  ResNet-50, FP32
  GPU Temp Monitor
  System Power Consumption Monitor
NVIDIA GPU Cloud TensorFlow
NVIDIA GPU Cloud TensorFlow:
  AlexNet, FP16
  GPU Temp Monitor
  System Power Consumption Monitor
NVIDIA GPU Cloud TensorFlow
NVIDIA GPU Cloud TensorFlow:
  Googlenet, FP16
  GPU Temp Monitor
  System Power Consumption Monitor
NVIDIA GPU Cloud TensorFlow
NVIDIA GPU Cloud TensorFlow:
  Googlenet, FP32
  GPU Temp Monitor
  System Power Consumption Monitor
NVIDIA GPU Cloud TensorFlow
NVIDIA GPU Cloud TensorFlow:
  Inception v4, FP16
  GPU Temp Monitor
  System Power Consumption Monitor
NVIDIA GPU Cloud TensorFlow
NVIDIA GPU Cloud TensorFlow:
  Inception v4, FP32
  GPU Temp Monitor
  System Power Consumption Monitor
NVIDIA GPU Cloud TensorFlow
NVIDIA GPU Cloud TensorFlow:
  VGG-16, FP16
  GPU Temp Monitor
  System Power Consumption Monitor
NVIDIA GPU Cloud TensorFlow
NVIDIA GPU Cloud TensorFlow:
  VGG-16, FP32
  GPU Temp Monitor
  System Power Consumption Monitor
  Phoronix Test Suite System Monitoring
  Phoronix Test Suite System Monitoring
  Performance / Cost - ResNet-50, FP16
  Performance / Cost - ResNet-50, FP32
  Performance / Cost - AlexNet, FP16
  Performance / Cost - Googlenet, FP16
  Performance / Cost - Inception v4, FP16
  Performance / Cost - VGG-16, FP16
  Performance / Cost - VGG-16, FP32
  Performance / Cost - Googlenet, FP32
  Performance / Cost - Inception v4, FP32

GeForce GTX 980 Ti

Processor: Intel Core i7-8086K @ 5.00GHz (6 Cores / 12 Threads), Motherboard: ASUS PRIME Z370-A (1002 BIOS), Chipset: Intel Device 3ec2, Memory: 16384MB, Disk: 525GB SABRENT + 118GB INTEL SSDPEK1W120GA, Graphics: NVIDIA GeForce GTX 980 Ti 6GB (999/3505MHz), Audio: Realtek ALC1220, Monitor: Acer B286HK, Network: Intel Connection

OS: Ubuntu 18.04, Kernel: 4.19.0-041900rc6-generic (x86_64) 20180930, Desktop: GNOME Shell 3.28.3, Display Server: X Server 1.19.6, Display Driver: NVIDIA 410.57, OpenGL: 4.6.0, Compiler: GCC 7.3.0 + CUDA 10.0, File-System: ext4, Screen Resolution: 3840x2160

Processor Notes: Scaling Governor: intel_pstate performance
Security Notes: KPTI + __user pointer sanitization + Full generic retpoline IBPB IBRS_FW + SSB disabled via prctl and seccomp + PTE Inversion; VMX: conditional cache flushes SMT vulnerable

Testing initiated at 7 October 2018 13:11 by user pts.

GeForce GTX 1060

Processor: Intel Core i7-8086K @ 5.00GHz (6 Cores / 12 Threads), Motherboard: ASUS PRIME Z370-A (1002 BIOS), Chipset: Intel Device 3ec2, Memory: 16384MB, Disk: 525GB SABRENT + 118GB INTEL SSDPEK1W120GA, Graphics: NVIDIA GeForce GTX 1060 6GB (1506/4006MHz), Audio: Realtek ALC1220, Monitor: Acer B286HK, Network: Intel Connection

OS: Ubuntu 18.04, Kernel: 4.19.0-041900rc6-generic (x86_64) 20180930, Desktop: GNOME Shell 3.28.3, Display Server: X Server 1.19.6, Display Driver: NVIDIA 410.57, OpenGL: 4.6.0, Compiler: GCC 7.3.0 + CUDA 10.0, File-System: ext4, Screen Resolution: 3840x2160

Processor Notes: Scaling Governor: intel_pstate performance
Security Notes: KPTI + __user pointer sanitization + Full generic retpoline IBPB IBRS_FW + SSB disabled via prctl and seccomp + PTE Inversion; VMX: conditional cache flushes SMT vulnerable

Testing initiated at 7 October 2018 11:37 by user pts.

GeForce GTX 1070

Processor: Intel Core i7-8086K @ 5.00GHz (6 Cores / 12 Threads), Motherboard: ASUS PRIME Z370-A (1002 BIOS), Chipset: Intel Device 3ec2, Memory: 16384MB, Disk: 525GB SABRENT + 118GB INTEL SSDPEK1W120GA, Graphics: NVIDIA GeForce GTX 1070 8GB (1506/4006MHz), Audio: Realtek ALC1220, Monitor: Acer B286HK, Network: Intel Connection

OS: Ubuntu 18.04, Kernel: 4.19.0-041900rc6-generic (x86_64) 20180930, Desktop: GNOME Shell 3.28.3, Display Server: X Server 1.19.6, Display Driver: NVIDIA 410.57, OpenGL: 4.6.0, Compiler: GCC 7.3.0 + CUDA 10.0, File-System: ext4, Screen Resolution: 3840x2160

Processor Notes: Scaling Governor: intel_pstate performance
Security Notes: KPTI + __user pointer sanitization + Full generic retpoline IBPB IBRS_FW + SSB disabled via prctl and seccomp + PTE Inversion; VMX: conditional cache flushes SMT vulnerable

Testing initiated at 7 October 2018 12:33 by user pts.

GeForce GTX 1070 Ti

Processor: Intel Core i7-8086K @ 5.00GHz (6 Cores / 12 Threads), Motherboard: ASUS PRIME Z370-A (1002 BIOS), Chipset: Intel Device 3ec2, Memory: 16384MB, Disk: 525GB SABRENT + 118GB INTEL SSDPEK1W120GA, Graphics: Zotac NVIDIA GeForce GTX 1070 Ti 8GB (1607/4006MHz), Audio: Realtek ALC1220, Monitor: Acer B286HK, Network: Intel Connection

OS: Ubuntu 18.04, Kernel: 4.19.0-041900rc6-generic (x86_64) 20180930, Desktop: GNOME Shell 3.28.3, Display Server: X Server 1.19.6, Display Driver: NVIDIA 410.57, OpenGL: 4.6.0, Compiler: GCC 7.3.0 + CUDA 10.0, File-System: ext4, Screen Resolution: 3840x2160

Processor Notes: Scaling Governor: intel_pstate performance
Security Notes: KPTI + __user pointer sanitization + Full generic retpoline IBPB IBRS_FW + SSB disabled via prctl and seccomp + PTE Inversion; VMX: conditional cache flushes SMT vulnerable

Testing initiated at 7 October 2018 15:58 by user pts.

GeForce GTX 1080

Processor: Intel Core i7-8086K @ 5.00GHz (6 Cores / 12 Threads), Motherboard: ASUS PRIME Z370-A (1002 BIOS), Chipset: Intel Device 3ec2, Memory: 16384MB, Disk: 525GB SABRENT + 118GB INTEL SSDPEK1W120GA, Graphics: NVIDIA GeForce GTX 1080 8GB (1607/5005MHz), Audio: Realtek ALC1220, Monitor: Acer B286HK, Network: Intel Connection

OS: Ubuntu 18.04, Kernel: 4.19.0-041900rc6-generic (x86_64) 20180930, Desktop: GNOME Shell 3.28.3, Display Server: X Server 1.19.6, Display Driver: NVIDIA 410.57, OpenGL: 4.6.0, Compiler: GCC 7.3.0 + CUDA 10.0, File-System: ext4, Screen Resolution: 3840x2160

Processor Notes: Scaling Governor: intel_pstate performance
Security Notes: KPTI + __user pointer sanitization + Full generic retpoline IBPB IBRS_FW + SSB disabled via prctl and seccomp + PTE Inversion; VMX: conditional cache flushes SMT vulnerable

Testing initiated at 7 October 2018 13:47 by user pts.

GeForce GTX 1080 Ti

Processor: Intel Core i7-8086K @ 5.00GHz (6 Cores / 12 Threads), Motherboard: ASUS PRIME Z370-A (1002 BIOS), Chipset: Intel Device 3ec2, Memory: 16384MB, Disk: 525GB SABRENT + 118GB INTEL SSDPEK1W120GA, Graphics: NVIDIA GeForce GTX 1080 Ti 11GB (1480/5508MHz), Audio: Realtek ALC1220, Monitor: Acer B286HK, Network: Intel Connection

OS: Ubuntu 18.04, Kernel: 4.19.0-041900rc6-generic (x86_64) 20180930, Desktop: GNOME Shell 3.28.3, Display Server: X Server 1.19.6, Display Driver: NVIDIA 410.57, OpenGL: 4.6.0, Compiler: GCC 7.3.0 + CUDA 10.0, File-System: ext4, Screen Resolution: 3840x2160

Processor Notes: Scaling Governor: intel_pstate performance
Security Notes: KPTI + __user pointer sanitization + Full generic retpoline IBPB IBRS_FW + SSB disabled via prctl and seccomp + PTE Inversion; VMX: conditional cache flushes SMT vulnerable

Testing initiated at 7 October 2018 11:03 by user pts.

GeForce RTX 2080 Ti

Processor: Intel Core i7-8086K @ 5.00GHz (6 Cores / 12 Threads), Motherboard: ASUS PRIME Z370-A (1002 BIOS), Chipset: Intel Device 3ec2, Memory: 16384MB, Disk: 525GB SABRENT + 118GB INTEL SSDPEK1W120GA, Graphics: NVIDIA GeForce RTX 2080 Ti 11GB (1350/7000MHz), Audio: Realtek ALC1220, Monitor: Acer B286HK, Network: Intel Connection

OS: Ubuntu 18.04, Kernel: 4.19.0-041900rc6-generic (x86_64) 20180930, Desktop: GNOME Shell 3.28.3, Display Server: X Server 1.19.6, Display Driver: NVIDIA 410.57, OpenGL: 4.6.0, Compiler: GCC 7.3.0 + CUDA 10.0, File-System: ext4, Screen Resolution: 3840x2160

Processor Notes: Scaling Governor: intel_pstate performance
Security Notes: KPTI + __user pointer sanitization + Full generic retpoline IBPB IBRS_FW + SSB disabled via prctl and seccomp + PTE Inversion; VMX: conditional cache flushes SMT vulnerable

Testing initiated at 7 October 2018 09:50 by user pts.