NVIDIA TITAN RTX Linux GPU Compute Benchmarks

NVIDIA and AMD GPU Linux compute benchmarks December 2018 by Michael Larabel for a future article, review of the NVIDIA TITAN RTX.

Compare your own system(s) to this result file with the Phoronix Test Suite by running the command: phoronix-test-suite benchmark 1812224-SP-GPUCOMPUT75
Jump To Table - Results

View

Do Not Show Noisy Results
Do Not Show Results With Incomplete Data
Do Not Show Results With Little Change/Spread
List Notable Results
Show Result Confidence Charts
Allow Limiting Results To Certain Suite(s)

Statistics

Show Overall Harmonic Mean(s)
Show Overall Geometric Mean
Show Wins / Losses Counts (Pie Chart)
Normalize Results
Remove Outliers Before Calculating Averages

Graph Settings

Force Line Graphs Where Applicable
Convert To Scalar Where Applicable
Disable Color Branding
Prefer Vertical Bar Graphs
No Box Plots
On Line Graphs With Missing Data, Connect The Line Gaps

Multi-Way Comparison

Condense Multi-Option Tests Into Single Result Graphs
Condense Test Profiles With Multiple Version Results Into Single Result Graphs

Table

Show Detailed System Result Table

Run Management

Highlight
Result
Toggle/Hide
Result
Result
Identifier
Performance Per
Dollar
Date
Run
  Test
  Duration
GTX 980
December 21 2018
  16 Minutes
GTX 980 Ti
December 21 2018
  30 Minutes
GTX TITAN X GM200
December 21 2018
  35 Minutes
GTX 1070
December 08 2018
  36 Minutes
GTX 1070 Ti
December 08 2018
  34 Minutes
GTX 1080
December 07 2018
  34 Minutes
GTX 1080 Ti
December 08 2018
  28 Minutes
RTX 2070
December 07 2018
  11 Minutes
RTX 2080
December 07 2018
  30 Minutes
RTX 2080 Ti
December 07 2018
  26 Minutes
TITAN RTX
December 21 2018
  25 Minutes
RX Vega 56
December 07 2018
  7 Minutes
RX Vega 64
December 07 2018
  7 Minutes
Invert Behavior (Only Show Selected Data)
  25 Minutes

Only show results where is faster than
Only show results matching title/arguments (delimit multiple options with a comma):
Do not show results matching title/arguments (delimit multiple options with a comma):


NVIDIA TITAN RTX Linux GPU Compute BenchmarksProcessorMotherboardChipsetMemoryDiskGraphicsAudioMonitorNetworkOSKernelDesktopDisplay ServerOpenGLOpenCLVulkanCompilerFile-SystemScreen ResolutionDisplay DriverRX Vega 56RX Vega 64GTX 1080RTX 2080 TiRTX 2080RTX 2070GTX 1080 TiGTX 1070 TiGTX 1070TITAN RTXGTX TITAN X GM200GTX 980 TiGTX 980Intel Core i9-9900K @ 5.00GHz (8 Cores / 16 Threads)ASUS PRIME Z390-A (0602 BIOS)Intel Cannon Lake PCH Shared SRAM16384MB2000GB SABRENT + Samsung SSD 970 EVO 250GBAMD Radeon RX Vega 8GB (1590/800MHz)Realtek ALC1220Acer B286HKIntel ConnectionUbuntu 18.044.19.5-041905-generic (x86_64)GNOME Shell 3.28.3X Server 1.19.64.5 Mesa 19.0.0-devel padoka PPA (LLVM 8.0.0)OpenCL 2.1 AMD-APP (2679.0)1.1.70GCC 7.3.0ext43840x2160AMD Radeon RX Vega 8GB (1630/945MHz)NVIDIA GeForce GTX 1080 8GB (1607/5005MHz)NVIDIA 415.224.6.0OpenCL 1.2 CUDA 10.0.1321.1.84GCC 7.3.0 + CUDA 10.0NVIDIA GeForce RTX 2080 Ti 11GB (1350/7000MHz)Zotac NVIDIA GeForce RTX 2080 8GB (1515/7000MHz)eVGA NVIDIA GeForce RTX 2070 8GB (1410/7000MHz)NVIDIA GeForce GTX 1080 Ti 11GB (1480/5508MHz)Zotac NVIDIA GeForce GTX 1070 Ti 8GB (1607/4006MHz)NVIDIA GeForce GTX 1070 8GB (1506/4006MHz)NVIDIA TITAN RTX 24GB (1350/7000MHz)NVIDIA 415.23NVIDIA GeForce GTX TITAN X 12GB (1001/3505MHz)NVIDIA GeForce GTX 980 Ti 6GB (999/3505MHz)NVIDIA GeForce GTX 980 4GB (1126/3505MHz)OpenBenchmarking.orgCompiler Details- --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++ --enable-libmpx --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib --with-tune=generic --without-cuda-driver -v Processor Details- Scaling Governor: intel_pstate performanceSecurity Details- __user pointer sanitization + Full generic retpoline IBPB IBRS_FW + SSB disabled via prctl and seccompOpenCL Details- GTX 1080: GPU Compute Cores: 2560- RTX 2080 Ti: GPU Compute Cores: 4352- RTX 2080: GPU Compute Cores: 2944- RTX 2070: GPU Compute Cores: 2304- GTX 1080 Ti: GPU Compute Cores: 3584- GTX 1070 Ti: GPU Compute Cores: 2432- GTX 1070: GPU Compute Cores: 1920- TITAN RTX: GPU Compute Cores: 4608- GTX TITAN X GM200: GPU Compute Cores: 3072- GTX 980 Ti: GPU Compute Cores: 2816- GTX 980: GPU Compute Cores: 2048

RX Vega 56RX Vega 64GTX 1080RTX 2080 TiRTX 2080RTX 2070GTX 1080 TiGTX 1070 TiGTX 1070TITAN RTXGTX TITAN X GM200GTX 980 TiGTX 980Result OverviewPhoronix Test Suite100%162%223%285%347%LuxMarkSHOC Scalable HeterOgeneous Computingcl-mem

NVIDIA TITAN RTX Linux GPU Compute Benchmarksshoc: OpenCL - FFT SPv-ray: CUDA GPUluxmark: GPU - Luxball HDRngc-tensorflow: ResNet-50, FP16ngc-tensorflow: VGG-16, FP32ngc-tensorflow: AlexNet, FP16ngc-tensorflow: ResNet-50, FP32ngc-tensorflow: VGG-16, FP16cl-mem: Copyngc-tensorflow: AlexNet, FP32ngc-tensorflow: Googlenet, FP16ngc-tensorflow: Inception v4, FP16RX Vega 56RX Vega 64GTX 1080RTX 2080 TiRTX 2080RTX 2070GTX 1080 TiGTX 1070 TiGTX 1070TITAN RTXGTX TITAN X GM200GTX 980 TiGTX 98092631179203107032815221575102.071382319382.90187514393.13209176445855.03144356.0942693449152.404432285206.9745433441015135.90108372.0729641335108.573153205153.333282419738102.7799866.0230091309330217497266.4121562271119.502674210131.37317253962974.6349786.301688617576.40168313384.43188159141349.2345290.431728816071.57156312576.93187151637544.77154850.0845932520162.335032299244.4048435761132152.8072680.621729915672.77166212579.20218158737243.2372877.7016910150155277.57217150135640.90468106.511324212081431154OpenBenchmarking.org

SHOC Scalable HeterOgeneous Computing

The CUDA and OpenCL version of Vetter's Scalable HeterOgeneous Computing benchmark suite. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgGFLOPS, More Is BetterSHOC Scalable HeterOgeneous Computing 2015-11-10Target: OpenCL - Benchmark: FFT SPRX Vega 56RX Vega 64GTX 1080RTX 2080 TiRTX 2080RTX 2070GTX 1080 TiGTX 1070 TiGTX 1070TITAN RTXGTX TITAN X GM200GTX 980 TiGTX 98030060090012001500SE +/- 1.57, N = 3SE +/- 0.64, N = 3SE +/- 2.68, N = 3SE +/- 14.24, N = 3SE +/- 5.95, N = 3SE +/- 40.79, N = 3SE +/- 1.23, N = 3SE +/- 0.73, N = 3SE +/- 0.94, N = 3SE +/- 11.44, N = 3SE +/- 0.60, N = 3SE +/- 0.20, N = 3SE +/- 0.27, N = 39261070575144310839989724974521548726728468-lSHOCCommonOpenCL -lOpenCL-lSHOCCommonOpenCL -lOpenCL-std=c++14 -lcudadevrt -lcudart_static -lpthread -ldl -lcufft-std=c++14 -lcudadevrt -lcudart_static -lpthread -ldl -lcufft-std=c++14 -lcudadevrt -lcudart_static -lpthread -ldl -lcufft-std=c++14 -lcudadevrt -lcudart_static -lpthread -ldl -lcufft-std=c++14 -lcudadevrt -lcudart_static -lpthread -ldl -lcufft-std=c++14 -lcudadevrt -lcudart_static -lpthread -ldl -lcufft-std=c++14 -lcudadevrt -lcudart_static -lpthread -ldl -lcufft-std=c++14 -lcudadevrt -lcudart_static -lpthread -ldl -lcufft-std=c++14 -lcudadevrt -lcudart_static -lpthread -ldl -lcufft-std=c++14 -lcudadevrt -lcudart_static -lpthread -ldl -lcufft-std=c++14 -lcudadevrt -lcudart_static -lpthread -ldl -lcufft1. (CXX) g++ options: -O2 -lSHOCCommon -lrt

Chaos Group V-RAY

This is a test of Chaos Group's V-RAY benchmark. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterChaos Group V-RAY 1.1.0Mode: CUDA GPUGTX 1080RTX 2080 TiRTX 2080RTX 2070GTX 1080 TiGTX 1070 TiGTX 1070TITAN RTXGTX TITAN X GM200GTX 980 TiGTX 98020406080100SE +/- 3.08, N = 3SE +/- 3.00, N = 3SE +/- 0.04, N = 3SE +/- 0.03, N = 3SE +/- 0.03, N = 3SE +/- 0.04, N = 3SE +/- 0.03, N = 3SE +/- 0.02, N = 3SE +/- 2.94, N = 3SE +/- 0.14, N = 3SE +/- 0.16, N = 3102.0756.0972.0766.0266.4186.3090.4350.0880.6277.70106.51

LuxMark

LuxMark is a multi-platform OpenGL benchmark using LuxRender. LuxMark supports targeting different OpenCL devices and has multiple scenes available for rendering. LuxMark is a fully open-source OpenCL program with real-world rendering examples. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgScore, More Is BetterLuxMark 3.1OpenCL Device: GPU - Scene: Luxball HDRRX Vega 56RX Vega 64GTX 1080RTX 2080 TiRTX 2080RTX 2070GTX 1080 TiGTX 1070 TiGTX 1070TITAN RTXGTX TITAN X GM200GTX 980 TiGTX 98010K20K30K40K50KSE +/- 20.53, N = 3SE +/- 570.76, N = 3SE +/- 29.04, N = 3SE +/- 66.64, N = 3SE +/- 2.73, N = 3SE +/- 119.86, N = 3SE +/- 0.67, N = 3SE +/- 0.58, N = 3SE +/- 41.88, N = 3SE +/- 11.50, N = 3SE +/- 26.00, N = 3SE +/- 33.13, N = 331179328151382342693296413009121562168861728845932172991691013242

NVIDIA GPU Cloud TensorFlow

This test profile uses the NVIDIA GPU Cloud (NGC/nvcr.io) for running the TensorFlow image inside Docker for benchmarking. You must have already signed into NGC for this test profile to work. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgImages Per Second, More Is BetterNVIDIA GPU Cloud TensorFlow 18.09Test: ResNet-50, FP16GTX 1080RTX 2080 TiRTX 2080RTX 2070GTX 1080 TiGTX 1070 TiGTX 1070TITAN RTXGTX TITAN X GM200GTX 980 Ti110220330440550SE +/- 0.10, N = 3SE +/- 0.28, N = 3SE +/- 0.85, N = 3SE +/- 0.15, N = 3SE +/- 0.07, N = 3SE +/- 0.03, N = 3SE +/- 0.06, N = 3SE +/- 4.74, N = 3SE +/- 1.68, N = 3193449335309271175160520156150

OpenBenchmarking.orgImages Per Second, More Is BetterNVIDIA GPU Cloud TensorFlow 18.09Test: VGG-16, FP32GTX 1080RTX 2080 TiRTX 2080GTX 1080 TiGTX 1070 TiGTX 1070TITAN RTXGTX TITAN X GM2004080120160200SE +/- 0.00, N = 3SE +/- 0.12, N = 3SE +/- 0.07, N = 3SE +/- 0.12, N = 3SE +/- 0.00, N = 3SE +/- 0.13, N = 3SE +/- 0.19, N = 3SE +/- 0.64, N = 382.90152.40108.57119.5076.4071.57162.3372.77

OpenBenchmarking.orgImages Per Second, More Is BetterNVIDIA GPU Cloud TensorFlow 18.09Test: AlexNet, FP16GTX 1080RTX 2080 TiRTX 2080GTX 1080 TiGTX 1070 TiGTX 1070TITAN RTXGTX TITAN X GM200GTX 980 TiGTX 98011002200330044005500SE +/- 2.60, N = 3SE +/- 2.27, N = 3SE +/- 3.35, N = 3SE +/- 1.32, N = 3SE +/- 0.50, N = 3SE +/- 2.26, N = 3SE +/- 4.39, N = 3SE +/- 2.24, N = 3SE +/- 6.83, N = 3SE +/- 2.04, N = 31875443231532674168315635032166215521208

OpenBenchmarking.orgImages Per Second, More Is BetterNVIDIA GPU Cloud TensorFlow 18.09Test: ResNet-50, FP32GTX 1080RTX 2080 TiRTX 2080GTX 1080 TiGTX 1070 TiGTX 1070TITAN RTXGTX TITAN X GM20070140210280350SE +/- 0.07, N = 3SE +/- 0.44, N = 3SE +/- 0.28, N = 3SE +/- 0.19, N = 3SE +/- 0.06, N = 3SE +/- 0.09, N = 3SE +/- 0.31, N = 3SE +/- 0.20, N = 3143285205210133125299125

OpenBenchmarking.orgImages Per Second, More Is BetterNVIDIA GPU Cloud TensorFlow 18.09Test: VGG-16, FP16GTX 1080RTX 2080 TiRTX 2080GTX 1080 TiGTX 1070 TiGTX 1070TITAN RTXGTX TITAN X GM200GTX 980 Ti50100150200250SE +/- 0.24, N = 3SE +/- 0.07, N = 3SE +/- 0.09, N = 3SE +/- 0.12, N = 3SE +/- 0.03, N = 3SE +/- 0.07, N = 3SE +/- 0.46, N = 3SE +/- 0.40, N = 3SE +/- 0.92, N = 393.13206.97153.33131.3784.4376.93244.4079.2077.57

cl-mem

A basic OpenCL memory benchmark. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgGB/s, More Is Bettercl-mem 2017-01-13Benchmark: CopyRX Vega 56RX Vega 64GTX 1080RTX 2080 TiRTX 2080RTX 2070GTX 1080 TiGTX 1070 TiGTX 1070TITAN RTXGTX TITAN X GM200GTX 980 TiGTX 980100200300400500SE +/- 0.21, N = 3SE +/- 0.07, N = 3SE +/- 0.07, N = 3SE +/- 0.39, N = 3SE +/- 0.09, N = 3SE +/- 0.12, N = 3SE +/- 0.07, N = 3SE +/- 0.07, N = 3SE +/- 0.07, N = 3SE +/- 0.24, N = 3SE +/- 0.03, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 32032212094543283303171881874842182171431. (CC) gcc options: -O2 -flto -lOpenCL

NVIDIA GPU Cloud TensorFlow

This test profile uses the NVIDIA GPU Cloud (NGC/nvcr.io) for running the TensorFlow image inside Docker for benchmarking. You must have already signed into NGC for this test profile to work. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgImages Per Second, More Is BetterNVIDIA GPU Cloud TensorFlow 18.09Test: AlexNet, FP32GTX 1080RTX 2080 TiRTX 2080RTX 2070GTX 1080 TiGTX 1070 TiGTX 1070TITAN RTXGTX TITAN X GM200GTX 980 TiGTX 9808001600240032004000SE +/- 1.62, N = 3SE +/- 6.99, N = 3SE +/- 1.84, N = 3SE +/- 1.83, N = 3SE +/- 0.32, N = 3SE +/- 0.44, N = 3SE +/- 1.48, N = 3SE +/- 0.78, N = 3SE +/- 4.76, N = 3SE +/- 1.06, N = 317643344241921742539159115163576158715011154

OpenBenchmarking.orgImages Per Second, More Is BetterNVIDIA GPU Cloud TensorFlow 18.09Test: Googlenet, FP16GTX 1080RTX 2080 TiRTX 2080GTX 1080 TiGTX 1070 TiGTX 1070TITAN RTXGTX TITAN X GM200GTX 980 Ti2004006008001000SE +/- 0.21, N = 3SE +/- 0.49, N = 3SE +/- 0.58, N = 3SE +/- 2.49, N = 3SE +/- 0.09, N = 3SE +/- 0.35, N = 3SE +/- 0.35, N = 3SE +/- 1.00, N = 3SE +/- 1.37, N = 345810157386294133751132372356

OpenBenchmarking.orgImages Per Second, More Is BetterNVIDIA GPU Cloud TensorFlow 18.09Test: Inception v4, FP16GTX 1080RTX 2080 TiRTX 2080GTX 1080 TiGTX 1070 TiGTX 1070TITAN RTXGTX TITAN X GM200GTX 980 Ti306090120150SE +/- 0.03, N = 3SE +/- 0.10, N = 3SE +/- 0.07, N = 3SE +/- 0.07, N = 3SE +/- 0.03, N = 3SE +/- 0.03, N = 3SE +/- 0.21, N = 3SE +/- 0.12, N = 3SE +/- 0.12, N = 355.03135.90102.7774.6349.2344.77152.8043.2340.90

SHOC Scalable HeterOgeneous Computing

OpenBenchmarking.orgWatts, Fewer Is BetterSHOC Scalable HeterOgeneous Computing 2015-11-10System Power Consumption MonitorRX Vega 56RX Vega 64GTX 1080RTX 2080 TiRTX 2080RTX 2070GTX 1080 TiGTX 1070 TiGTX 1070TITAN RTX50100150200250Min: 49.4 / Avg: 197.63 / Max: 234.4Min: 51.8 / Avg: 223.18 / Max: 249.9Min: 89.7 / Avg: 144.76 / Max: 164.6Min: 47.5 / Avg: 222.96 / Max: 282.7Min: 47.1 / Avg: 169.8 / Max: 202.9Min: 53.7 / Avg: 162.86 / Max: 198.7Min: 120.8 / Avg: 190.06 / Max: 216.8Min: 47 / Avg: 122.6 / Max: 141.5Min: 82.6 / Avg: 134.72 / Max: 155.3Min: 47.9 / Avg: 232.9 / Max: 281.3

LuxMark

OpenBenchmarking.orgWatts, Fewer Is BetterLuxMark 3.1System Power Consumption MonitorRX Vega 56RX Vega 64GTX 1080RTX 2080 TiRTX 2080RTX 2070GTX 1080 TiGTX 1070 TiGTX 1070TITAN RTXGTX TITAN X GM200GTX 980 TiGTX 98060120180240300Min: 51.8 / Avg: 251.16 / Max: 263.3Min: 53 / Avg: 323.35 / Max: 337.9Min: 90.8 / Avg: 174.24 / Max: 176.2Min: 111.1 / Avg: 315.29 / Max: 328.4Min: 101.9 / Avg: 240.83 / Max: 247.3Min: 78 / Avg: 225.33 / Max: 232.6Min: 122.9 / Avg: 241.59 / Max: 247.8Min: 146.8 / Avg: 148.92 / Max: 149.4Min: 83.1 / Avg: 176.9 / Max: 181.3Min: 48.7 / Avg: 329.43 / Max: 344Min: 126.4 / Avg: 249.16 / Max: 256.8Min: 118.7 / Avg: 233.83 / Max: 241.4Min: 80.2 / Avg: 189.6 / Max: 196.9

GPU Temperature Monitor

OpenBenchmarking.orgCelsiusGPU Temperature MonitorPhoronix Test Suite System MonitoringRX Vega 56RX Vega 64GTX 1080RTX 2080 TiRTX 2080RTX 2070GTX 1080 TiGTX 1070 TiGTX 1070TITAN RTXGTX TITAN X GM200GTX 980 TiGTX 9801632486480Min: 31 / Avg: 51.02 / Max: 75Min: 28 / Avg: 52.98 / Max: 85Min: 45 / Avg: 63.06 / Max: 79Min: 34 / Avg: 60.3 / Max: 76Min: 35 / Avg: 66.5 / Max: 80Min: 33 / Avg: 54.57 / Max: 64Min: 33 / Avg: 66.46 / Max: 80Min: 36 / Avg: 46.92 / Max: 60Min: 31 / Avg: 61.13 / Max: 75Min: 38 / Avg: 63.55 / Max: 77Min: 35 / Avg: 76.87 / Max: 85Min: 38 / Avg: 74.74 / Max: 84Min: 34 / Avg: 58.36 / Max: 77

System Power Consumption Monitor

OpenBenchmarking.orgWattsSystem Power Consumption MonitorPhoronix Test Suite System MonitoringRX Vega 56RX Vega 64GTX 1080RTX 2080 TiRTX 2080RTX 2070GTX 1080 TiGTX 1070 TiGTX 1070TITAN RTXGTX TITAN X GM200GTX 980 TiGTX 98070140210280350Min: 48.8 / Avg: 143.52 / Max: 284.1Min: 48.4 / Avg: 169.45 / Max: 358.6Min: 42.2 / Avg: 154.56 / Max: 251.7Min: 45.5 / Avg: 208.03 / Max: 346.7Min: 43.9 / Avg: 175.16 / Max: 287.8Min: 42.1 / Avg: 146.13 / Max: 247.2Min: 43.4 / Avg: 200.91 / Max: 320.9Min: 45.9 / Avg: 127.84 / Max: 213.8Min: 41.9 / Avg: 143.92 / Max: 213.8Min: 47.9 / Avg: 242.09 / Max: 364.6Min: 48.8 / Avg: 240.32 / Max: 327.7Min: 52.1 / Avg: 218.82 / Max: 321.2Min: 45.1 / Avg: 126.87 / Max: 240.4

Chaos Group V-RAY

OpenBenchmarking.orgCelsius, Fewer Is BetterChaos Group V-RAY 1.1.0GPU Temperature MonitorGTX 1080RTX 2080 TiRTX 2080RTX 2070GTX 1080 TiGTX 1070 TiGTX 1070TITAN RTXGTX TITAN X GM200GTX 980 TiGTX 9801632486480Min: 48 / Avg: 62.93 / Max: 67Min: 46 / Avg: 60.03 / Max: 68Min: 50 / Avg: 68.2 / Max: 74Min: 53 / Avg: 60.72 / Max: 62Min: 54 / Avg: 68.11 / Max: 73Min: 38 / Avg: 47.77 / Max: 50Min: 46 / Avg: 62.55 / Max: 68Min: 56 / Avg: 67.85 / Max: 72Min: 67 / Avg: 78.35 / Max: 82Min: 69 / Avg: 78.07 / Max: 81Min: 64 / Avg: 72.91 / Max: 75

OpenBenchmarking.orgWatts, Fewer Is BetterChaos Group V-RAY 1.1.0System Power Consumption MonitorGTX 1080RTX 2080 TiRTX 2080RTX 2070GTX 1080 TiGTX 1070 TiGTX 1070TITAN RTXGTX TITAN X GM200GTX 980 TiGTX 98050100150200250Min: 43.6 / Avg: 153.26 / Max: 165.9Min: 69.5 / Avg: 242.72 / Max: 272Min: 63 / Avg: 191.71 / Max: 202.8Min: 53.7 / Avg: 185.77 / Max: 199.3Min: 120.4 / Avg: 218.99 / Max: 231.8Min: 46.1 / Avg: 130.78 / Max: 135.6Min: 43.4 / Avg: 151.17 / Max: 164.2Min: 57.5 / Avg: 262.41 / Max: 287.8Min: 55.7 / Avg: 230.04 / Max: 248.4Min: 52.1 / Avg: 218.49 / Max: 231.5Min: 47.6 / Avg: 170.22 / Max: 175.3

NVIDIA GPU Cloud TensorFlow

OpenBenchmarking.orgImages Per Second Per Watt, More Is BetterNVIDIA GPU Cloud TensorFlow 18.09Test: ResNet-50, FP16GTX 1080RTX 2080 TiRTX 2080RTX 2070GTX 1080 TiGTX 1070 TiGTX 1070TITAN RTXGTX TITAN X GM200GTX 980 Ti0.57381.14761.72142.29522.8691.022.101.861.901.221.140.922.550.620.61

OpenBenchmarking.orgCelsius, Fewer Is BetterNVIDIA GPU Cloud TensorFlow 18.09GPU Temperature MonitorGTX 1080RTX 2080 TiRTX 2080RTX 2070GTX 1080 TiGTX 1070 TiGTX 1070TITAN RTXGTX TITAN X GM200GTX 980 Ti1632486480Min: 61 / Avg: 68.3 / Max: 75Min: 55 / Avg: 59.52 / Max: 65Min: 60 / Avg: 67.05 / Max: 75Min: 32 / Avg: 45.47 / Max: 58Min: 61 / Avg: 68.17 / Max: 75Min: 46 / Avg: 50.94 / Max: 55Min: 58 / Avg: 65.55 / Max: 70Min: 57 / Avg: 61.37 / Max: 67Min: 66 / Avg: 77.41 / Max: 84Min: 65 / Avg: 76.82 / Max: 83

OpenBenchmarking.orgWatts, Fewer Is BetterNVIDIA GPU Cloud TensorFlow 18.09System Power Consumption MonitorGTX 1080RTX 2080 TiRTX 2080RTX 2070GTX 1080 TiGTX 1070 TiGTX 1070TITAN RTXGTX TITAN X GM200GTX 980 Ti60120180240300Min: 44.7 / Avg: 189.85 / Max: 248.8Min: 56.1 / Avg: 213.62 / Max: 342.3Min: 47.3 / Avg: 179.59 / Max: 284.7Min: 71.1 / Avg: 162.36 / Max: 246.8Min: 54.6 / Avg: 222.3 / Max: 319.6Min: 47 / Avg: 153.76 / Max: 192.3Min: 42.7 / Avg: 174.04 / Max: 212.6Min: 51 / Avg: 203.63 / Max: 350.6Min: 55.5 / Avg: 252.42 / Max: 326.9Min: 52.8 / Avg: 244.09 / Max: 310.7

OpenBenchmarking.orgImages Per Second Per Watt, More Is BetterNVIDIA GPU Cloud TensorFlow 18.09Test: ResNet-50, FP32GTX 1080RTX 2080 TiRTX 2080GTX 1080 TiGTX 1070 TiGTX 1070TITAN RTXGTX TITAN X GM2000.26550.5310.79651.0621.32750.731.150.990.890.840.731.180.49

OpenBenchmarking.orgCelsius, Fewer Is BetterNVIDIA GPU Cloud TensorFlow 18.09GPU Temperature MonitorGTX 1080RTX 2080 TiRTX 2080GTX 1080 TiGTX 1070 TiGTX 1070TITAN RTXGTX TITAN X GM2001632486480Min: 60 / Avg: 68.77 / Max: 75Min: 54 / Avg: 61.16 / Max: 67Min: 59 / Avg: 70.41 / Max: 77Min: 62 / Avg: 70.04 / Max: 77Min: 44 / Avg: 50.85 / Max: 54Min: 57 / Avg: 65.61 / Max: 71Min: 54 / Avg: 62.76 / Max: 70Min: 65 / Avg: 77.91 / Max: 84

OpenBenchmarking.orgWatts, Fewer Is BetterNVIDIA GPU Cloud TensorFlow 18.09System Power Consumption MonitorGTX 1080RTX 2080 TiRTX 2080GTX 1080 TiGTX 1070 TiGTX 1070TITAN RTXGTX TITAN X GM20070140210280350Min: 44.1 / Avg: 196.38 / Max: 249.7Min: 50.5 / Avg: 248.25 / Max: 346.7Min: 48 / Avg: 206.72 / Max: 285Min: 79.7 / Avg: 234.81 / Max: 318.6Min: 48 / Avg: 157.29 / Max: 187.8Min: 45.9 / Avg: 172.02 / Max: 213.8Min: 50.5 / Avg: 252.59 / Max: 364.6Min: 56.2 / Avg: 255.72 / Max: 321

OpenBenchmarking.orgImages Per Second Per Watt, More Is BetterNVIDIA GPU Cloud TensorFlow 18.09Test: AlexNet, FP16GTX 1080RTX 2080 TiRTX 2080GTX 1080 TiGTX 1070 TiGTX 1070TITAN RTXGTX TITAN X GM200GTX 980 TiGTX 98061218243011.1924.9516.5312.5312.399.8625.777.036.546.45

OpenBenchmarking.orgCelsius, Fewer Is BetterNVIDIA GPU Cloud TensorFlow 18.09GPU Temperature MonitorGTX 1080RTX 2080 TiRTX 2080GTX 1080 TiGTX 1070 TiGTX 1070TITAN RTXGTX TITAN X GM200GTX 980 TiGTX 9801632486480Min: 62 / Avg: 66.46 / Max: 70Min: 57 / Avg: 60.36 / Max: 64Min: 63 / Avg: 67.57 / Max: 72Min: 63 / Avg: 67.2 / Max: 70Min: 46 / Avg: 49.93 / Max: 53Min: 59 / Avg: 64.06 / Max: 67Min: 58 / Avg: 61.4 / Max: 65Min: 68 / Avg: 77.07 / Max: 85Min: 62 / Avg: 73.47 / Max: 81Min: 51 / Avg: 65.82 / Max: 74

OpenBenchmarking.orgWatts, Fewer Is BetterNVIDIA GPU Cloud TensorFlow 18.09System Power Consumption MonitorGTX 1080RTX 2080 TiRTX 2080GTX 1080 TiGTX 1070 TiGTX 1070TITAN RTXGTX TITAN X GM200GTX 980 TiGTX 98060120180240300Min: 44.1 / Avg: 167.55 / Max: 234.8Min: 49.3 / Avg: 177.62 / Max: 332.6Min: 47.3 / Avg: 190.7 / Max: 270.1Min: 51.3 / Avg: 213.37 / Max: 303.2Min: 46.9 / Avg: 135.79 / Max: 175Min: 68.9 / Avg: 158.49 / Max: 192.3Min: 50.6 / Avg: 195.26 / Max: 352.6Min: 55.1 / Avg: 236.59 / Max: 321.2Min: 135.2 / Avg: 237.19 / Max: 295.5Min: 48.6 / Avg: 187.19 / Max: 240.4

OpenBenchmarking.orgImages Per Second Per Watt, More Is BetterNVIDIA GPU Cloud TensorFlow 18.09Test: AlexNet, FP32GTX 1080RTX 2080 TiRTX 2080RTX 2070GTX 1080 TiGTX 1070 TiGTX 1070TITAN RTXGTX TITAN X GM200GTX 980 TiGTX 980481216209.9012.9911.4411.7212.1910.999.6114.666.296.596.20

OpenBenchmarking.orgCelsius, Fewer Is BetterNVIDIA GPU Cloud TensorFlow 18.09GPU Temperature MonitorGTX 1080RTX 2080 TiRTX 2080RTX 2070GTX 1080 TiGTX 1070 TiGTX 1070TITAN RTXGTX TITAN X GM200GTX 980 TiGTX 9801632486480Min: 63 / Avg: 66.8 / Max: 71Min: 53 / Avg: 61.36 / Max: 67Min: 59 / Avg: 69.81 / Max: 76Min: 46 / Avg: 55.88 / Max: 61Min: 64 / Avg: 67.58 / Max: 71Min: 44 / Avg: 49.07 / Max: 52Min: 61 / Avg: 64.2 / Max: 68Min: 55 / Avg: 61.71 / Max: 67Min: 72 / Avg: 78.81 / Max: 84Min: 71 / Avg: 77.5 / Max: 82Min: 63 / Avg: 72.44 / Max: 77

OpenBenchmarking.orgWatts, Fewer Is BetterNVIDIA GPU Cloud TensorFlow 18.09System Power Consumption MonitorGTX 1080RTX 2080 TiRTX 2080RTX 2070GTX 1080 TiGTX 1070 TiGTX 1070TITAN RTXGTX TITAN X GM200GTX 980 TiGTX 98060120180240300Min: 100.9 / Avg: 178.22 / Max: 229Min: 48.9 / Avg: 257.45 / Max: 338.7Min: 48 / Avg: 211.46 / Max: 284.1Min: 64.2 / Avg: 185.45 / Max: 243.7Min: 126 / Avg: 208.21 / Max: 307.4Min: 48.2 / Avg: 144.76 / Max: 185.9Min: 87.1 / Avg: 157.65 / Max: 201.5Min: 78.6 / Avg: 243.91 / Max: 357Min: 136.3 / Avg: 252.18 / Max: 313.2Min: 122.8 / Avg: 227.61 / Max: 318.8Min: 101.5 / Avg: 186.05 / Max: 232.5

OpenBenchmarking.orgImages Per Second Per Watt, More Is BetterNVIDIA GPU Cloud TensorFlow 18.09Test: Googlenet, FP16GTX 1080RTX 2080 TiRTX 2080GTX 1080 TiGTX 1070 TiGTX 1070TITAN RTXGTX TITAN X GM200GTX 980 Ti0.92481.84962.77443.69924.6242.134.073.212.452.532.064.111.401.36

OpenBenchmarking.orgCelsius, Fewer Is BetterNVIDIA GPU Cloud TensorFlow 18.09GPU Temperature MonitorGTX 1080RTX 2080 TiRTX 2080GTX 1080 TiGTX 1070 TiGTX 1070TITAN RTXGTX TITAN X GM200GTX 980 Ti1632486480Min: 58 / Avg: 72.23 / Max: 79Min: 55 / Avg: 64.78 / Max: 71Min: 60 / Avg: 73.17 / Max: 80Min: 60 / Avg: 72.84 / Max: 80Min: 43 / Avg: 52.93 / Max: 56Min: 56 / Avg: 69 / Max: 74Min: 55 / Avg: 65.27 / Max: 72Min: 72 / Avg: 80.77 / Max: 85Min: 70 / Avg: 80.35 / Max: 84

OpenBenchmarking.orgWatts, Fewer Is BetterNVIDIA GPU Cloud TensorFlow 18.09System Power Consumption MonitorGTX 1080RTX 2080 TiRTX 2080GTX 1080 TiGTX 1070 TiGTX 1070TITAN RTXGTX TITAN X GM200GTX 980 Ti60120180240300Min: 76.2 / Avg: 215.22 / Max: 247Min: 49.5 / Avg: 249.29 / Max: 343.1Min: 47.7 / Avg: 229.8 / Max: 284.5Min: 64 / Avg: 257.4 / Max: 319.4Min: 46.8 / Avg: 163.6 / Max: 187.8Min: 43.4 / Avg: 181.99 / Max: 210.5Min: 50.7 / Avg: 275.3 / Max: 360Min: 102.1 / Avg: 265.29 / Max: 320.1Min: 124.1 / Avg: 260.98 / Max: 317

OpenBenchmarking.orgImages Per Second Per Watt, More Is BetterNVIDIA GPU Cloud TensorFlow 18.09Test: Inception v4, FP16GTX 1080RTX 2080 TiRTX 2080GTX 1080 TiGTX 1070 TiGTX 1070TITAN RTXGTX TITAN X GM200GTX 980 Ti0.17550.3510.52650.7020.87750.300.740.580.350.340.280.780.190.18

OpenBenchmarking.orgCelsius, Fewer Is BetterNVIDIA GPU Cloud TensorFlow 18.09GPU Temperature MonitorGTX 1080RTX 2080 TiRTX 2080GTX 1080 TiGTX 1070 TiGTX 1070TITAN RTXGTX TITAN X GM200GTX 980 Ti1632486480Min: 51 / Avg: 64.33 / Max: 76Min: 53 / Avg: 57.76 / Max: 65Min: 57 / Avg: 64.7 / Max: 74Min: 56 / Avg: 66.24 / Max: 77Min: 43 / Avg: 49.56 / Max: 55Min: 55 / Avg: 64.07 / Max: 72Min: 54 / Avg: 59.11 / Max: 66Min: 62 / Avg: 75.61 / Max: 85Min: 61 / Avg: 74.85 / Max: 84

OpenBenchmarking.orgWatts, Fewer Is BetterNVIDIA GPU Cloud TensorFlow 18.09System Power Consumption MonitorGTX 1080RTX 2080 TiRTX 2080GTX 1080 TiGTX 1070 TiGTX 1070TITAN RTXGTX TITAN X GM200GTX 980 Ti60120180240300Min: 71.3 / Avg: 185.89 / Max: 249.7Min: 50 / Avg: 183.11 / Max: 341.1Min: 47.6 / Avg: 177.11 / Max: 285.3Min: 52.2 / Avg: 211.84 / Max: 320.9Min: 47.2 / Avg: 146.22 / Max: 188.6Min: 44.1 / Avg: 157.87 / Max: 210.2Min: 58.3 / Avg: 196.21 / Max: 353.3Min: 55.1 / Avg: 232.58 / Max: 323Min: 52.9 / Avg: 226.01 / Max: 305.4

OpenBenchmarking.orgImages Per Second Per Watt, More Is BetterNVIDIA GPU Cloud TensorFlow 18.09Test: VGG-16, FP16GTX 1080RTX 2080 TiRTX 2080GTX 1080 TiGTX 1070 TiGTX 1070TITAN RTXGTX TITAN X GM200GTX 980 Ti0.21380.42760.64140.85521.0690.480.940.690.540.530.460.950.290.30

OpenBenchmarking.orgCelsius, Fewer Is BetterNVIDIA GPU Cloud TensorFlow 18.09GPU Temperature MonitorGTX 1080RTX 2080 TiRTX 2080GTX 1080 TiGTX 1070 TiGTX 1070TITAN RTXGTX TITAN X GM200GTX 980 Ti1632486480Min: 50 / Avg: 65.84 / Max: 74Min: 54 / Avg: 61.56 / Max: 68Min: 59 / Avg: 69.86 / Max: 77Min: 61 / Avg: 70.1 / Max: 76Min: 45 / Avg: 52.18 / Max: 55Min: 59 / Avg: 66.13 / Max: 70Min: 55 / Avg: 62.56 / Max: 68Min: 67 / Avg: 79 / Max: 84Min: 67 / Avg: 79.22 / Max: 84

OpenBenchmarking.orgWatts, Fewer Is BetterNVIDIA GPU Cloud TensorFlow 18.09System Power Consumption MonitorGTX 1080RTX 2080 TiRTX 2080GTX 1080 TiGTX 1070 TiGTX 1070TITAN RTXGTX TITAN X GM200GTX 980 Ti60120180240300Min: 90.8 / Avg: 194.86 / Max: 239.8Min: 51 / Avg: 219.66 / Max: 332.2Min: 48.1 / Avg: 223.76 / Max: 283.3Min: 51.7 / Avg: 242.51 / Max: 313.1Min: 46.8 / Avg: 160.44 / Max: 192Min: 43.7 / Avg: 168.53 / Max: 201.8Min: 49.3 / Avg: 256.56 / Max: 354.6Min: 81.5 / Avg: 277.12 / Max: 327.7Min: 52.4 / Avg: 254.36 / Max: 318.4

OpenBenchmarking.orgImages Per Second Per Watt, More Is BetterNVIDIA GPU Cloud TensorFlow 18.09Test: VGG-16, FP32GTX 1080RTX 2080 TiRTX 2080GTX 1080 TiGTX 1070 TiGTX 1070TITAN RTXGTX TITAN X GM2000.13050.2610.39150.5220.65250.420.560.450.490.470.420.580.28

OpenBenchmarking.orgCelsius, Fewer Is BetterNVIDIA GPU Cloud TensorFlow 18.09GPU Temperature MonitorGTX 1080RTX 2080 TiRTX 2080GTX 1080 TiGTX 1070 TiGTX 1070TITAN RTXGTX TITAN X GM2001632486480Min: 60 / Avg: 69.33 / Max: 74Min: 56 / Avg: 65.52 / Max: 71Min: 61 / Avg: 74.1 / Max: 80Min: 61 / Avg: 70.55 / Max: 77Min: 46 / Avg: 52.21 / Max: 55Min: 58 / Avg: 66.1 / Max: 70Min: 56 / Avg: 67.15 / Max: 73Min: 67 / Avg: 79.62 / Max: 84

OpenBenchmarking.orgWatts, Fewer Is BetterNVIDIA GPU Cloud TensorFlow 18.09System Power Consumption MonitorGTX 1080RTX 2080 TiRTX 2080GTX 1080 TiGTX 1070 TiGTX 1070TITAN RTXGTX TITAN X GM20060120180240300Min: 46.3 / Avg: 198.19 / Max: 236.2Min: 50.2 / Avg: 270.5 / Max: 342.3Min: 55.7 / Avg: 239.26 / Max: 287.8Min: 51.2 / Avg: 241.65 / Max: 309.7Min: 58.5 / Avg: 162.02 / Max: 191Min: 54.1 / Avg: 170.77 / Max: 203.5Min: 60 / Avg: 281.79 / Max: 357.7Min: 53 / Avg: 261.76 / Max: 321.8

42 Results Shown

SHOC Scalable HeterOgeneous Computing
Chaos Group V-RAY
LuxMark
NVIDIA GPU Cloud TensorFlow:
  ResNet-50, FP16
  VGG-16, FP32
  AlexNet, FP16
  ResNet-50, FP32
  VGG-16, FP16
cl-mem
NVIDIA GPU Cloud TensorFlow:
  AlexNet, FP32
  Googlenet, FP16
  Inception v4, FP16
SHOC Scalable HeterOgeneous Computing:
  System Power Consumption Monitor:
    Watts
    Watts
  Phoronix Test Suite System Monitoring:
    Celsius
    Watts
  GPU Temp Monitor:
    Celsius
  System Power Consumption Monitor:
    Watts
  ResNet-50, FP16:
    Images Per Second Per Watt
  GPU Temp Monitor:
    Celsius
  System Power Consumption Monitor:
    Watts
  ResNet-50, FP32:
    Images Per Second Per Watt
  GPU Temp Monitor:
    Celsius
  System Power Consumption Monitor:
    Watts
  AlexNet, FP16:
    Images Per Second Per Watt
  GPU Temp Monitor:
    Celsius
  System Power Consumption Monitor:
    Watts
  AlexNet, FP32:
    Images Per Second Per Watt
  GPU Temp Monitor:
    Celsius
  System Power Consumption Monitor:
    Watts
  Googlenet, FP16:
    Images Per Second Per Watt
  GPU Temp Monitor:
    Celsius
  System Power Consumption Monitor:
    Watts
  Inception v4, FP16:
    Images Per Second Per Watt
  GPU Temp Monitor:
    Celsius
  System Power Consumption Monitor:
    Watts
  VGG-16, FP16:
    Images Per Second Per Watt
  GPU Temp Monitor:
    Celsius
  System Power Consumption Monitor:
    Watts
  VGG-16, FP32:
    Images Per Second Per Watt
  GPU Temp Monitor:
    Celsius
  System Power Consumption Monitor:
    Watts