Benchmarks for Radeon VII launch day by Michael Larabel for a future article. Radeon tests with ROCm 2.0 on Linux 5.0 kernel.
Compare your own system(s) to this result file with the
Phoronix Test Suite by running the command:
phoronix-test-suite benchmark 1902066-SP-VIICOMPUT16 AMD Radeon VII OpenCL GPU Compute Benchmarks - Phoronix Test Suite AMD Radeon VII OpenCL GPU Compute Benchmarks Benchmarks for Radeon VII launch day by Michael Larabel for a future article. Radeon tests with ROCm 2.0 on Linux 5.0 kernel.
HTML result view exported from: https://openbenchmarking.org/result/1902066-SP-VIICOMPUT16&sro&grw .
AMD Radeon VII OpenCL GPU Compute Benchmarks Processor Motherboard Chipset Memory Disk Graphics Audio Monitor Network OS Kernel Desktop Display Server OpenGL OpenCL Vulkan Compiler File-System Screen Resolution Display Driver RX 580 RX 590 RX Vega 56 RX Vega 64 Radeon VII GTX 1060 GTX 1070 GTX 1070 Ti GTX 1080 GTX 1080 Ti RTX 2060 RTX 2070 RTX 2080 RTX 2080 Ti TITAN RTX Intel Core i9-9900K @ 5.00GHz (8 Cores / 16 Threads) ASUS PRIME Z390-A (0602 BIOS) Intel Cannon Lake PCH Shared SRAM 16384MB Samsung SSD 970 EVO 250GB + 2000GB SABRENT MSI AMD Radeon RX 470/480/570/570X/580/580X 8GB (1366/2000MHz) Realtek ALC1220 Acer B286HK Intel I219-V Ubuntu 18.10 5.0.0-050000rc4-generic (x86_64) 20190127 GNOME Shell 3.30.1 X Server 1.20.1 4.5 Mesa 19.0.0-devel padoka PPA (LLVM 9.0.0) OpenCL 2.1 AMD-APP (2783.0) 1.1.90 GCC 8.2.0 ext4 3840x2160 Sapphire AMD Radeon RX 470/480/570/570X/580/580X 8GB (1560/2100MHz) AMD Radeon RX 64 8GB (1590/800MHz) AMD Radeon RX 64 8GB (1630/945MHz) AMD Vega 20 16GB (1801/1000MHz) NVIDIA GeForce GTX 1060 6GB (1506/4006MHz) 4.20.3-042003-generic (x86_64) NVIDIA 415.27 4.6.0 OpenCL 1.2 CUDA 10.0.132 1.1.84 NVIDIA GeForce GTX 1070 8GB (1506/4006MHz) Zotac NVIDIA GeForce GTX 1070 Ti 8GB (1607/4006MHz) NVIDIA GeForce GTX 1080 8GB (1607/5005MHz) NVIDIA GeForce GTX 1080 Ti 11GB (1480/5508MHz) NVIDIA GeForce RTX 2060 6GB (1365/7000MHz) ASUS NVIDIA GeForce RTX 2070 8GB (1410/7000MHz) Zotac NVIDIA GeForce RTX 2080 8GB (1515/7000MHz) NVIDIA GeForce RTX 2080 Ti 11GB (1350/7000MHz) NVIDIA TITAN RTX 24GB (1350/7000MHz) OpenBenchmarking.org Compiler Details - --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++ --enable-libmpx --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib --with-tune=generic --without-cuda-driver -v Processor Details - Scaling Governor: intel_pstate performance Python Details - Python 2.7.15+ + Python 3.6.7 Security Details - __user pointer sanitization + Full generic retpoline IBPB: conditional IBRS_FW STIBP: conditional RSB filling + SSB disabled via prctl and seccomp OpenCL Details - GTX 1060: GPU Compute Cores: 1280 - GTX 1070: GPU Compute Cores: 1920 - GTX 1070 Ti: GPU Compute Cores: 2432 - GTX 1080: GPU Compute Cores: 2560 - GTX 1080 Ti: GPU Compute Cores: 3584 - RTX 2060: GPU Compute Cores: 1920 - RTX 2070: GPU Compute Cores: 2304 - RTX 2080: GPU Compute Cores: 2944 - RTX 2080 Ti: GPU Compute Cores: 4352 - TITAN RTX: GPU Compute Cores: 4608
AMD Radeon VII OpenCL GPU Compute Benchmarks plaidml: Yes - Inference - Mobilenet - OpenCL plaidml: Yes - Inference - Inception V3 - OpenCL plaidml: Yes - Inference - ResNet 50 - OpenCL plaidml: Yes - Inference - VGG16 - OpenCL plaidml: No - Training - IMDB LSTM - OpenCL plaidml: No - Inference - Mobilenet - OpenCL plaidml: No - Inference - ResNet 50 - OpenCL plaidml: No - Inference - VGG16 - OpenCL lczero: OpenCL clpeak: Global Memory Bandwidth clpeak: Single-Precision Float luxmark: GPU - Luxball HDR RX 580 RX 590 RX Vega 56 RX Vega 64 Radeon VII GTX 1060 GTX 1070 GTX 1070 Ti GTX 1080 GTX 1080 Ti RTX 2060 RTX 2070 RTX 2080 RTX 2080 Ti TITAN RTX 563 76.59 128 60.98 130 414 133 65.18 640 206 6202 15271 599 82.71 137 64.04 144 453 142 68.69 683 217 7069 17221 575 109.03 195 106.66 178 720 228 120.44 758 317 10357 31079 587 120.03 213 119.99 184 835 270 137.62 856 362 12469 32565 904 166.30 353 197.63 200 1233 403 224.77 1391 807 13453 55570 552 88.85 183 94.62 134 592 194 94.08 899 145 4239 12256 664 117 237 126 156 764 257 129 1430 196 5878 17287 645 120 237 128 153 755 262 131 1478 197 6776 16776 686 132 264 139 167 801 292 143 1750 222 7934 13803 774 167 334 194 187 883 339 189 2333 329 10853 21682 779 134 282 148 188 863 309 150 1484 276 6630 21356 830 157 333 179 198 1008 376 189 1729 365 7968 29532 893 168 354 192 216 1045 400 203 2259 368 10270 29146 971 211 458 250 246 1291 537 273 3107 505 15352 42787 977 215 474 264 244 1336 556 289 3275 525 16386 46022 OpenBenchmarking.org
PlaidML FP16: Yes - Mode: Inference - Network: Mobilenet - Device: OpenCL OpenBenchmarking.org Examples Per Second, More Is Better PlaidML FP16: Yes - Mode: Inference - Network: Mobilenet - Device: OpenCL GTX 1060 GTX 1070 GTX 1070 Ti GTX 1080 GTX 1080 Ti RTX 2060 RTX 2070 RTX 2080 RTX 2080 Ti RX 580 RX 590 RX Vega 56 RX Vega 64 Radeon VII TITAN RTX 200 400 600 800 1000 SE +/- 0.87, N = 3 SE +/- 4.06, N = 3 SE +/- 3.15, N = 3 SE +/- 5.02, N = 3 SE +/- 3.70, N = 3 SE +/- 1.27, N = 3 SE +/- 1.07, N = 3 SE +/- 1.63, N = 3 SE +/- 2.70, N = 3 SE +/- 1.03, N = 3 SE +/- 1.00, N = 3 SE +/- 6.73, N = 3 SE +/- 9.53, N = 3 SE +/- 4.52, N = 3 SE +/- 3.45, N = 3 552 664 645 686 774 779 830 893 971 563 599 575 587 904 977
PlaidML FP16: Yes - Mode: Inference - Network: Inception V3 - Device: OpenCL OpenBenchmarking.org Examples Per Second, More Is Better PlaidML FP16: Yes - Mode: Inference - Network: Inception V3 - Device: OpenCL GTX 1060 GTX 1070 GTX 1070 Ti GTX 1080 GTX 1080 Ti RTX 2060 RTX 2070 RTX 2080 RTX 2080 Ti RX 580 RX 590 RX Vega 56 RX Vega 64 Radeon VII TITAN RTX 50 100 150 200 250 SE +/- 0.05, N = 3 SE +/- 0.07, N = 3 SE +/- 0.30, N = 3 SE +/- 0.07, N = 3 SE +/- 0.58, N = 3 SE +/- 0.44, N = 3 SE +/- 0.18, N = 3 SE +/- 0.40, N = 3 SE +/- 0.48, N = 3 SE +/- 0.04, N = 3 SE +/- 0.11, N = 3 SE +/- 0.06, N = 3 SE +/- 0.02, N = 3 SE +/- 0.20, N = 3 SE +/- 1.30, N = 3 88.85 117.00 120.00 132.00 167.00 134.00 157.00 168.00 211.00 76.59 82.71 109.03 120.03 166.30 215.00
PlaidML FP16: Yes - Mode: Inference - Network: ResNet 50 - Device: OpenCL OpenBenchmarking.org Examples Per Second, More Is Better PlaidML FP16: Yes - Mode: Inference - Network: ResNet 50 - Device: OpenCL GTX 1060 GTX 1070 GTX 1070 Ti GTX 1080 GTX 1080 Ti RTX 2060 RTX 2070 RTX 2080 RTX 2080 Ti RX 580 RX 590 RX Vega 56 RX Vega 64 Radeon VII TITAN RTX 100 200 300 400 500 SE +/- 0.17, N = 3 SE +/- 0.38, N = 3 SE +/- 0.16, N = 3 SE +/- 0.24, N = 3 SE +/- 0.34, N = 3 SE +/- 0.26, N = 3 SE +/- 0.76, N = 3 SE +/- 0.40, N = 3 SE +/- 1.03, N = 3 SE +/- 0.01, N = 3 SE +/- 0.04, N = 3 SE +/- 0.07, N = 3 SE +/- 0.13, N = 3 SE +/- 0.96, N = 3 SE +/- 1.16, N = 3 183 237 237 264 334 282 333 354 458 128 137 195 213 353 474
PlaidML FP16: Yes - Mode: Inference - Network: VGG16 - Device: OpenCL OpenBenchmarking.org Examples Per Second, More Is Better PlaidML FP16: Yes - Mode: Inference - Network: VGG16 - Device: OpenCL GTX 1060 GTX 1070 GTX 1070 Ti GTX 1080 GTX 1080 Ti RTX 2060 RTX 2070 RTX 2080 RTX 2080 Ti RX 580 RX 590 RX Vega 56 RX Vega 64 Radeon VII TITAN RTX 60 120 180 240 300 SE +/- 0.03, N = 3 SE +/- 0.12, N = 3 SE +/- 0.06, N = 3 SE +/- 0.09, N = 3 SE +/- 0.32, N = 3 SE +/- 0.15, N = 3 SE +/- 0.26, N = 3 SE +/- 0.32, N = 3 SE +/- 0.20, N = 3 SE +/- 0.02, N = 3 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.03, N = 3 SE +/- 0.43, N = 3 94.62 126.00 128.00 139.00 194.00 148.00 179.00 192.00 250.00 60.98 64.04 106.66 119.99 197.63 264.00
PlaidML FP16: No - Mode: Training - Network: IMDB LSTM - Device: OpenCL OpenBenchmarking.org Examples Per Second, More Is Better PlaidML FP16: No - Mode: Training - Network: IMDB LSTM - Device: OpenCL GTX 1060 GTX 1070 GTX 1070 Ti GTX 1080 GTX 1080 Ti RTX 2060 RTX 2070 RTX 2080 RTX 2080 Ti RX 580 RX 590 RX Vega 56 RX Vega 64 Radeon VII TITAN RTX 50 100 150 200 250 SE +/- 0.17, N = 3 SE +/- 0.50, N = 3 SE +/- 0.03, N = 3 SE +/- 0.60, N = 3 SE +/- 0.49, N = 3 SE +/- 0.38, N = 3 SE +/- 0.82, N = 3 SE +/- 0.27, N = 3 SE +/- 0.72, N = 3 SE +/- 0.25, N = 3 SE +/- 0.19, N = 3 SE +/- 0.24, N = 3 SE +/- 0.19, N = 3 SE +/- 0.32, N = 3 SE +/- 0.96, N = 3 134 156 153 167 187 188 198 216 246 130 144 178 184 200 244
PlaidML FP16: No - Mode: Inference - Network: Mobilenet - Device: OpenCL OpenBenchmarking.org Examples Per Second, More Is Better PlaidML FP16: No - Mode: Inference - Network: Mobilenet - Device: OpenCL GTX 1060 GTX 1070 GTX 1070 Ti GTX 1080 GTX 1080 Ti RTX 2060 RTX 2070 RTX 2080 RTX 2080 Ti RX 580 RX 590 RX Vega 56 RX Vega 64 Radeon VII TITAN RTX 300 600 900 1200 1500 SE +/- 3.04, N = 3 SE +/- 1.02, N = 3 SE +/- 0.31, N = 3 SE +/- 0.61, N = 3 SE +/- 4.51, N = 3 SE +/- 1.86, N = 3 SE +/- 1.43, N = 3 SE +/- 0.31, N = 3 SE +/- 1.39, N = 3 SE +/- 0.26, N = 3 SE +/- 0.24, N = 3 SE +/- 9.70, N = 3 SE +/- 7.40, N = 3 SE +/- 3.74, N = 3 SE +/- 3.01, N = 3 592 764 755 801 883 863 1008 1045 1291 414 453 720 835 1233 1336
PlaidML FP16: No - Mode: Inference - Network: ResNet 50 - Device: OpenCL OpenBenchmarking.org Examples Per Second, More Is Better PlaidML FP16: No - Mode: Inference - Network: ResNet 50 - Device: OpenCL GTX 1060 GTX 1070 GTX 1070 Ti GTX 1080 GTX 1080 Ti RTX 2060 RTX 2070 RTX 2080 RTX 2080 Ti RX 580 RX 590 RX Vega 56 RX Vega 64 Radeon VII TITAN RTX 120 240 360 480 600 SE +/- 0.11, N = 3 SE +/- 0.45, N = 3 SE +/- 0.24, N = 3 SE +/- 0.41, N = 3 SE +/- 0.55, N = 3 SE +/- 0.26, N = 3 SE +/- 0.33, N = 3 SE +/- 0.45, N = 3 SE +/- 0.31, N = 3 SE +/- 0.04, N = 3 SE +/- 0.07, N = 3 SE +/- 2.52, N = 3 SE +/- 1.40, N = 3 SE +/- 0.30, N = 3 SE +/- 1.67, N = 3 194 257 262 292 339 309 376 400 537 133 142 228 270 403 556
PlaidML FP16: No - Mode: Inference - Network: VGG16 - Device: OpenCL OpenBenchmarking.org Examples Per Second, More Is Better PlaidML FP16: No - Mode: Inference - Network: VGG16 - Device: OpenCL GTX 1060 GTX 1070 GTX 1070 Ti GTX 1080 GTX 1080 Ti RTX 2060 RTX 2070 RTX 2080 RTX 2080 Ti RX 580 RX 590 RX Vega 56 RX Vega 64 Radeon VII TITAN RTX 60 120 180 240 300 SE +/- 0.04, N = 3 SE +/- 0.04, N = 3 SE +/- 0.01, N = 3 SE +/- 0.06, N = 3 SE +/- 0.12, N = 3 SE +/- 0.16, N = 3 SE +/- 0.27, N = 3 SE +/- 0.17, N = 3 SE +/- 0.36, N = 3 SE +/- 0.05, N = 3 SE +/- 0.01, N = 3 SE +/- 0.18, N = 3 SE +/- 0.11, N = 3 SE +/- 0.38, N = 3 SE +/- 0.72, N = 3 94.08 129.00 131.00 143.00 189.00 150.00 189.00 203.00 273.00 65.18 68.69 120.44 137.62 224.77 289.00
LeelaChessZero Backend: OpenCL OpenBenchmarking.org Nodes Per Second, More Is Better LeelaChessZero 0.20.1 Backend: OpenCL GTX 1060 GTX 1070 GTX 1070 Ti GTX 1080 GTX 1080 Ti RTX 2060 RTX 2070 RTX 2080 RTX 2080 Ti RX 580 RX 590 RX Vega 56 RX Vega 64 Radeon VII TITAN RTX 700 1400 2100 2800 3500 SE +/- 6.27, N = 3 SE +/- 9.63, N = 3 SE +/- 13.26, N = 3 SE +/- 32.06, N = 3 SE +/- 25.14, N = 3 SE +/- 13.06, N = 3 SE +/- 20.57, N = 3 SE +/- 22.18, N = 3 SE +/- 20.98, N = 3 SE +/- 2.68, N = 3 SE +/- 2.57, N = 3 SE +/- 2.66, N = 3 SE +/- 5.51, N = 3 SE +/- 8.64, N = 3 SE +/- 28.14, N = 3 899 1430 1478 1750 2333 1484 1729 2259 3107 640 683 758 856 1391 3275 1. (CXX) g++ options: -lpthread
clpeak OpenCL Test: Global Memory Bandwidth OpenBenchmarking.org GBPS, More Is Better clpeak OpenCL Test: Global Memory Bandwidth GTX 1060 GTX 1070 GTX 1070 Ti GTX 1080 GTX 1080 Ti RTX 2060 RTX 2070 RTX 2080 RTX 2080 Ti RX 580 RX 590 RX Vega 56 RX Vega 64 Radeon VII TITAN RTX 200 400 600 800 1000 SE +/- 0.95, N = 3 SE +/- 0.02, N = 3 SE +/- 0.22, N = 3 SE +/- 0.05, N = 3 SE +/- 0.68, N = 3 SE +/- 0.19, N = 3 SE +/- 2.69, N = 3 SE +/- 0.37, N = 3 SE +/- 0.48, N = 3 SE +/- 1.46, N = 3 SE +/- 1.82, N = 3 SE +/- 0.01, N = 3 SE +/- 0.05, N = 3 SE +/- 0.10, N = 3 SE +/- 1.70, N = 3 145 196 197 222 329 276 365 368 505 206 217 317 362 807 525 1. (CXX) g++ options: -O3 -rdynamic -lOpenCL
clpeak OpenCL Test: Single-Precision Float OpenBenchmarking.org GFLOPS, More Is Better clpeak OpenCL Test: Single-Precision Float GTX 1060 GTX 1070 GTX 1070 Ti GTX 1080 GTX 1080 Ti RTX 2060 RTX 2070 RTX 2080 RTX 2080 Ti RX 580 RX 590 RX Vega 56 RX Vega 64 Radeon VII TITAN RTX 4K 8K 12K 16K 20K SE +/- 3.56, N = 3 SE +/- 393.27, N = 3 SE +/- 14.43, N = 3 SE +/- 396.02, N = 3 SE +/- 782.31, N = 3 SE +/- 657.16, N = 3 SE +/- 495.99, N = 3 SE +/- 732.21, N = 3 SE +/- 1065.18, N = 3 SE +/- 1.21, N = 3 SE +/- 15.75, N = 3 SE +/- 38.50, N = 3 SE +/- 41.13, N = 3 SE +/- 1.83, N = 3 SE +/- 688.69, N = 3 4239 5878 6776 7934 10853 6630 7968 10270 15352 6202 7069 10357 12469 13453 16386 1. (CXX) g++ options: -O3 -rdynamic -lOpenCL
LuxMark OpenCL Device: GPU - Scene: Luxball HDR OpenBenchmarking.org Score, More Is Better LuxMark 3.1 OpenCL Device: GPU - Scene: Luxball HDR GTX 1060 GTX 1070 GTX 1070 Ti GTX 1080 GTX 1080 Ti RTX 2060 RTX 2070 RTX 2080 RTX 2080 Ti RX 580 RX 590 RX Vega 56 RX Vega 64 Radeon VII TITAN RTX 12K 24K 36K 48K 60K SE +/- 46.58, N = 3 SE +/- 1.33, N = 3 SE +/- 14.90, N = 3 SE +/- 42.00, N = 3 SE +/- 8.33, N = 3 SE +/- 31.58, N = 3 SE +/- 107.00, N = 3 SE +/- 25.12, N = 3 SE +/- 155.67, N = 3 SE +/- 17.84, N = 3 SE +/- 74.83, N = 3 SE +/- 65.67, N = 3 SE +/- 583.87, N = 3 SE +/- 258.00, N = 3 SE +/- 103.04, N = 3 12256 17287 16776 13803 21682 21356 29532 29146 42787 15271 17221 31079 32565 55570 46022
LeelaChessZero Backend: OpenCL OpenBenchmarking.org Nodes Per Second Per Watt, More Is Better LeelaChessZero 0.20.1 Backend: OpenCL GTX 1060 GTX 1070 GTX 1070 Ti GTX 1080 GTX 1080 Ti RTX 2060 RTX 2070 RTX 2080 RTX 2080 Ti RX 580 RX 590 RX Vega 56 RX Vega 64 Radeon VII TITAN RTX 5 10 15 20 25 5.97 7.77 9.45 11.81 8.80 7.57 9.27 10.13 15.10 3.74 3.62 4.38 2.73 9.38 22.11
LeelaChessZero System Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better LeelaChessZero 0.20.1 System Power Consumption Monitor GTX 1060 GTX 1070 GTX 1070 Ti GTX 1080 GTX 1080 Ti RTX 2060 RTX 2070 RTX 2080 RTX 2080 Ti RX 580 RX 590 RX Vega 56 RX Vega 64 Radeon VII TITAN RTX 60 120 180 240 300 Min: 41.9 / Avg: 150.59 / Max: 180 Min: 42.6 / Avg: 184.04 / Max: 213.3 Min: 80 / Avg: 156.39 / Max: 189.7 Min: 40.2 / Avg: 148.14 / Max: 249.5 Min: 96.9 / Avg: 265.17 / Max: 323.1 Min: 69.4 / Avg: 196.01 / Max: 230 Min: 75.1 / Avg: 186.61 / Max: 251.7 Min: 88.3 / Avg: 222.99 / Max: 288.3 Min: 48.2 / Avg: 205.76 / Max: 349.4 Min: 69.3 / Avg: 171.21 / Max: 229.5 Min: 75.2 / Avg: 188.72 / Max: 253.3 Min: 47.2 / Avg: 173.2 / Max: 262.2 Min: 50.2 / Avg: 313.27 / Max: 342.7 Min: 56 / Avg: 148.33 / Max: 269 Min: 97.7 / Avg: 148.16 / Max: 357.7
PlaidML FP16: Yes - Mode: Inference - Network: Mobilenet - Device: OpenCL OpenBenchmarking.org Examples Per Second Per Watt, More Is Better PlaidML FP16: Yes - Mode: Inference - Network: Mobilenet - Device: OpenCL GTX 1060 GTX 1070 GTX 1070 Ti GTX 1080 GTX 1080 Ti RTX 2060 RTX 2070 RTX 2080 RTX 2080 Ti RX 580 RX 590 RX Vega 56 RX Vega 64 Radeon VII TITAN RTX 3 6 9 12 15 5.12 7.22 6.57 7.34 5.19 6.41 8.87 6.82 10.28 5.14 4.74 6.23 8.48 11.54 8.82
PlaidML System Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better PlaidML System Power Consumption Monitor GTX 1060 GTX 1070 GTX 1070 Ti GTX 1080 GTX 1080 Ti RTX 2060 RTX 2070 RTX 2080 RTX 2080 Ti RX 580 RX 590 RX Vega 56 RX Vega 64 Radeon VII TITAN RTX 40 80 120 160 200 Min: 42.1 / Avg: 107.84 / Max: 141.6 Min: 42.8 / Avg: 91.98 / Max: 117.4 Min: 48.7 / Avg: 98.18 / Max: 132.6 Min: 43.7 / Avg: 93.48 / Max: 127.3 Min: 91.6 / Avg: 149.17 / Max: 203.2 Min: 45.5 / Avg: 121.65 / Max: 166.1 Min: 46 / Avg: 93.68 / Max: 129.3 Min: 56.3 / Avg: 130.87 / Max: 184.7 Min: 48.4 / Avg: 94.48 / Max: 113.3 Min: 75.6 / Avg: 109.4 / Max: 179 Min: 82.3 / Avg: 126.56 / Max: 194.9 Min: 49.6 / Avg: 92.35 / Max: 157.7 Min: 54 / Avg: 69.27 / Max: 82.4 Min: 58.1 / Avg: 78.39 / Max: 92.6 Min: 52.9 / Avg: 110.8 / Max: 140.2
PlaidML FP16: Yes - Mode: Inference - Network: Inception V3 - Device: OpenCL OpenBenchmarking.org Examples Per Second Per Watt, More Is Better PlaidML FP16: Yes - Mode: Inference - Network: Inception V3 - Device: OpenCL GTX 1060 GTX 1070 GTX 1070 Ti GTX 1080 GTX 1080 Ti RTX 2060 RTX 2070 RTX 2080 RTX 2080 Ti RX 580 RX 590 RX Vega 56 RX Vega 64 Radeon VII TITAN RTX 0.288 0.576 0.864 1.152 1.44 0.67 0.76 0.90 0.78 0.82 0.92 1.07 1.08 1.12 0.52 0.51 0.74 0.66 1.24 1.28
PlaidML System Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better PlaidML System Power Consumption Monitor GTX 1060 GTX 1070 GTX 1070 Ti GTX 1080 GTX 1080 Ti RTX 2060 RTX 2070 RTX 2080 RTX 2080 Ti RX 580 RX 590 RX Vega 56 RX Vega 64 Radeon VII TITAN RTX 50 100 150 200 250 Min: 87.5 / Avg: 132.19 / Max: 156.7 Min: 81.8 / Avg: 153.87 / Max: 183 Min: 56.1 / Avg: 132.15 / Max: 155 Min: 89.5 / Avg: 168.75 / Max: 202.8 Min: 120.7 / Avg: 202.56 / Max: 256.6 Min: 45 / Avg: 144.95 / Max: 190.7 Min: 45.8 / Avg: 146.81 / Max: 206.6 Min: 47.5 / Avg: 155.97 / Max: 224.6 Min: 48.4 / Avg: 188.73 / Max: 275.6 Min: 73.1 / Avg: 146.45 / Max: 195.4 Min: 91.8 / Avg: 163.54 / Max: 221.5 Min: 58.9 / Avg: 147.82 / Max: 249.5 Min: 50.6 / Avg: 181.52 / Max: 296 Min: 69.7 / Avg: 134.1 / Max: 228.1 Min: 51.5 / Avg: 168.92 / Max: 275.4
PlaidML FP16: Yes - Mode: Inference - Network: ResNet 50 - Device: OpenCL OpenBenchmarking.org Examples Per Second Per Watt, More Is Better PlaidML FP16: Yes - Mode: Inference - Network: ResNet 50 - Device: OpenCL GTX 1060 GTX 1070 GTX 1070 Ti GTX 1080 GTX 1080 Ti RTX 2060 RTX 2070 RTX 2080 RTX 2080 Ti RX 580 RX 590 RX Vega 56 RX Vega 64 Radeon VII TITAN RTX 0.6638 1.3276 1.9914 2.6552 3.319 1.49 1.76 2.08 1.62 1.78 1.96 2.51 2.39 2.95 0.91 0.89 1.38 1.24 2.75 2.92
PlaidML System Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better PlaidML System Power Consumption Monitor GTX 1060 GTX 1070 GTX 1070 Ti GTX 1080 GTX 1080 Ti RTX 2060 RTX 2070 RTX 2080 RTX 2080 Ti RX 580 RX 590 RX Vega 56 RX Vega 64 Radeon VII TITAN RTX 60 120 180 240 300 Min: 60.4 / Avg: 122.52 / Max: 164.5 Min: 83.8 / Avg: 134.85 / Max: 189.4 Min: 48.5 / Avg: 113.89 / Max: 160.8 Min: 91.6 / Avg: 162.7 / Max: 211.1 Min: 122.3 / Avg: 187.68 / Max: 270.3 Min: 86.5 / Avg: 143.68 / Max: 202.9 Min: 78.4 / Avg: 132.98 / Max: 222.4 Min: 47.4 / Avg: 148.19 / Max: 240.2 Min: 48.4 / Avg: 155.12 / Max: 292.5 Min: 73.6 / Avg: 141.5 / Max: 187.8 Min: 81.1 / Avg: 153.59 / Max: 208.6 Min: 50.5 / Avg: 141.19 / Max: 254.3 Min: 82.4 / Avg: 172.03 / Max: 313.6 Min: 70.1 / Avg: 128.33 / Max: 243.5 Min: 52.6 / Avg: 162.76 / Max: 301.7
PlaidML FP16: Yes - Mode: Inference - Network: VGG16 - Device: OpenCL OpenBenchmarking.org Examples Per Second Per Watt, More Is Better PlaidML FP16: Yes - Mode: Inference - Network: VGG16 - Device: OpenCL GTX 1060 GTX 1070 GTX 1070 Ti GTX 1080 GTX 1080 Ti RTX 2060 RTX 2070 RTX 2080 RTX 2080 Ti RX 580 RX 590 RX Vega 56 RX Vega 64 Radeon VII TITAN RTX 0.3488 0.6976 1.0464 1.3952 1.744 0.72 0.92 1.02 0.80 1.08 1.08 1.27 1.21 1.38 0.41 0.39 0.70 0.55 1.55 1.50
PlaidML System Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better PlaidML System Power Consumption Monitor GTX 1060 GTX 1070 GTX 1070 Ti GTX 1080 GTX 1080 Ti RTX 2060 RTX 2070 RTX 2080 RTX 2080 Ti RX 580 RX 590 RX Vega 56 RX Vega 64 Radeon VII TITAN RTX 60 120 180 240 300 Min: 58.2 / Avg: 131.14 / Max: 167.2 Min: 43.1 / Avg: 136.92 / Max: 191.2 Min: 48.4 / Avg: 125.32 / Max: 169.8 Min: 70.3 / Avg: 172.91 / Max: 216.6 Min: 65.2 / Avg: 179.46 / Max: 287.9 Min: 62.3 / Avg: 137.76 / Max: 208 Min: 47.2 / Avg: 141.31 / Max: 234 Min: 49.8 / Avg: 158.89 / Max: 252.8 Min: 47.7 / Avg: 180.78 / Max: 312 Min: 73.2 / Avg: 147.27 / Max: 187.1 Min: 79.7 / Avg: 162.83 / Max: 210.1 Min: 50.2 / Avg: 151.48 / Max: 258.1 Min: 53.4 / Avg: 217.55 / Max: 319.8 Min: 57.5 / Avg: 127.89 / Max: 264.7 Min: 58.3 / Avg: 176.01 / Max: 322.5
PlaidML FP16: No - Mode: Training - Network: IMDB LSTM - Device: OpenCL OpenBenchmarking.org Examples Per Second Per Watt, More Is Better PlaidML FP16: No - Mode: Training - Network: IMDB LSTM - Device: OpenCL GTX 1060 GTX 1070 GTX 1070 Ti GTX 1080 GTX 1080 Ti RTX 2060 RTX 2070 RTX 2080 RTX 2080 Ti RX 580 RX 590 RX Vega 56 RX Vega 64 Radeon VII TITAN RTX 0.3645 0.729 1.0935 1.458 1.8225 1.08 1.14 1.24 1.14 1.14 1.62 1.56 1.56 1.54 0.89 0.95 1.07 1.11 1.45 1.60
PlaidML System Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better PlaidML System Power Consumption Monitor GTX 1060 GTX 1070 GTX 1070 Ti GTX 1080 GTX 1080 Ti RTX 2060 RTX 2070 RTX 2080 RTX 2080 Ti RX 580 RX 590 RX Vega 56 RX Vega 64 Radeon VII TITAN RTX 50 100 150 200 250 Min: 70.1 / Avg: 124.21 / Max: 145 Min: 82.2 / Avg: 136.83 / Max: 164.9 Min: 104.8 / Avg: 123.57 / Max: 135.6 Min: 90.8 / Avg: 146.71 / Max: 176.8 Min: 50.4 / Avg: 165.05 / Max: 214.8 Min: 44.3 / Avg: 116.14 / Max: 162.7 Min: 47.1 / Avg: 127.27 / Max: 169.5 Min: 46.4 / Avg: 138.03 / Max: 185.4 Min: 48.6 / Avg: 159.87 / Max: 223.7 Min: 71.3 / Avg: 146.11 / Max: 185.3 Min: 80.2 / Avg: 152.62 / Max: 212.4 Min: 74.8 / Avg: 165.69 / Max: 271.3 Min: 52.2 / Avg: 165.89 / Max: 305.6 Min: 87.3 / Avg: 137.45 / Max: 192.4 Min: 57.5 / Avg: 152.07 / Max: 231.9
PlaidML FP16: No - Mode: Inference - Network: Mobilenet - Device: OpenCL OpenBenchmarking.org Examples Per Second Per Watt, More Is Better PlaidML FP16: No - Mode: Inference - Network: Mobilenet - Device: OpenCL GTX 1060 GTX 1070 GTX 1070 Ti GTX 1080 GTX 1080 Ti RTX 2060 RTX 2070 RTX 2080 RTX 2080 Ti RX 580 RX 590 RX Vega 56 RX Vega 64 Radeon VII TITAN RTX 3 6 9 12 15 7.72 7.12 8.06 5.42 7.02 9.00 8.70 10.67 8.45 3.62 3.29 5.82 7.47 9.34 6.67
PlaidML System Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better PlaidML System Power Consumption Monitor GTX 1060 GTX 1070 GTX 1070 Ti GTX 1080 GTX 1080 Ti RTX 2060 RTX 2070 RTX 2080 RTX 2080 Ti RX 580 RX 590 RX Vega 56 RX Vega 64 Radeon VII TITAN RTX 50 100 150 200 250 Min: 41.8 / Avg: 76.7 / Max: 94.4 Min: 45.9 / Avg: 107.3 / Max: 155.1 Min: 49.7 / Avg: 93.67 / Max: 125.7 Min: 44.3 / Avg: 147.75 / Max: 195.1 Min: 53.3 / Avg: 125.73 / Max: 165.2 Min: 43.1 / Avg: 95.9 / Max: 118.8 Min: 115.1 / Avg: 115.83 / Max: 116.5 Min: 52 / Avg: 97.93 / Max: 121 Min: 48.2 / Avg: 152.87 / Max: 274.6 Min: 71.7 / Avg: 114.33 / Max: 178.6 Min: 82.4 / Avg: 137.7 / Max: 205.5 Min: 72.5 / Avg: 123.7 / Max: 259.6 Min: 52.5 / Avg: 111.85 / Max: 223.9 Min: 92.8 / Avg: 132.03 / Max: 241.7 Min: 54 / Avg: 200.17 / Max: 274.2
PlaidML FP16: No - Mode: Inference - Network: ResNet 50 - Device: OpenCL OpenBenchmarking.org Examples Per Second Per Watt, More Is Better PlaidML FP16: No - Mode: Inference - Network: ResNet 50 - Device: OpenCL GTX 1060 GTX 1070 GTX 1070 Ti GTX 1080 GTX 1080 Ti RTX 2060 RTX 2070 RTX 2080 RTX 2080 Ti RX 580 RX 590 RX Vega 56 RX Vega 64 Radeon VII TITAN RTX 0.6998 1.3996 2.0994 2.7992 3.499 1.59 1.77 1.94 1.92 1.82 2.30 2.44 2.51 3.11 0.92 0.88 1.51 1.52 2.97 2.86
PlaidML System Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better PlaidML System Power Consumption Monitor GTX 1060 GTX 1070 GTX 1070 Ti GTX 1080 GTX 1080 Ti RTX 2060 RTX 2070 RTX 2080 RTX 2080 Ti RX 580 RX 590 RX Vega 56 RX Vega 64 Radeon VII TITAN RTX 60 120 180 240 300 Min: 71.4 / Avg: 121.65 / Max: 172.6 Min: 45.2 / Avg: 145.44 / Max: 201.2 Min: 48.6 / Avg: 134.71 / Max: 168.9 Min: 91.9 / Avg: 152.34 / Max: 225.3 Min: 61.2 / Avg: 185.7 / Max: 280.5 Min: 65 / Avg: 134.41 / Max: 208.9 Min: 49.8 / Avg: 153.92 / Max: 242.3 Min: 48.4 / Avg: 158.95 / Max: 257.5 Min: 100.3 / Avg: 172.57 / Max: 323.3 Min: 73 / Avg: 145.33 / Max: 194.5 Min: 81 / Avg: 162.42 / Max: 220 Min: 50.1 / Avg: 150.39 / Max: 271.1 Min: 81.5 / Avg: 177.38 / Max: 338.2 Min: 58.8 / Avg: 135.42 / Max: 277 Min: 102.3 / Avg: 194.3 / Max: 332.7
PlaidML FP16: No - Mode: Inference - Network: VGG16 - Device: OpenCL OpenBenchmarking.org Examples Per Second Per Watt, More Is Better PlaidML FP16: No - Mode: Inference - Network: VGG16 - Device: OpenCL GTX 1060 GTX 1070 GTX 1070 Ti GTX 1080 GTX 1080 Ti RTX 2060 RTX 2070 RTX 2080 RTX 2080 Ti RX 580 RX 590 RX Vega 56 RX Vega 64 Radeon VII TITAN RTX 0.2925 0.585 0.8775 1.17 1.4625 0.65 0.79 0.89 0.79 0.82 0.90 1.03 1.08 1.28 0.40 0.37 0.64 0.64 1.30 1.29
PlaidML System Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better PlaidML System Power Consumption Monitor GTX 1060 GTX 1070 GTX 1070 Ti GTX 1080 GTX 1080 Ti RTX 2060 RTX 2070 RTX 2080 RTX 2080 Ti RX 580 RX 590 RX Vega 56 RX Vega 64 Radeon VII TITAN RTX 60 120 180 240 300 Min: 72.7 / Avg: 144.61 / Max: 170.9 Min: 43.1 / Avg: 162.78 / Max: 197.9 Min: 47.9 / Avg: 146.58 / Max: 171.7 Min: 45.1 / Avg: 180.6 / Max: 225 Min: 127.7 / Avg: 231.45 / Max: 296.9 Min: 44 / Avg: 167.51 / Max: 215.1 Min: 68.7 / Avg: 183.65 / Max: 245.5 Min: 50.9 / Avg: 188.45 / Max: 269.3 Min: 47.6 / Avg: 212.98 / Max: 331.1 Min: 73 / Avg: 163.55 / Max: 194.8 Min: 86.9 / Avg: 184.98 / Max: 216.4 Min: 78.5 / Avg: 188.36 / Max: 262.2 Min: 52.7 / Avg: 216.48 / Max: 338.1 Min: 58.2 / Avg: 172.91 / Max: 296.6 Min: 55.4 / Avg: 223.68 / Max: 345.8
LuxMark OpenCL Device: GPU - Scene: Luxball HDR OpenBenchmarking.org Score Per Watt, More Is Better LuxMark 3.1 OpenCL Device: GPU - Scene: Luxball HDR GTX 1060 GTX 1070 GTX 1070 Ti GTX 1080 GTX 1080 Ti RTX 2060 RTX 2070 RTX 2080 RTX 2080 Ti RX 580 RX 590 RX Vega 56 RX Vega 64 Radeon VII TITAN RTX 40 80 120 160 200 85.53 98.48 114.16 79.42 89.34 110.80 131.09 123.99 133.42 80.53 78.90 120.58 98.89 188.36 137.54
LuxMark System Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better LuxMark 3.1 System Power Consumption Monitor GTX 1060 GTX 1070 GTX 1070 Ti GTX 1080 GTX 1080 Ti RTX 2060 RTX 2070 RTX 2080 RTX 2080 Ti RX 580 RX 590 RX Vega 56 RX Vega 64 Radeon VII TITAN RTX 60 120 180 240 300 Min: 111.3 / Avg: 143.3 / Max: 145.4 Min: 82.6 / Avg: 175.54 / Max: 179.2 Min: 47.6 / Avg: 146.95 / Max: 149.7 Min: 89.3 / Avg: 173.79 / Max: 175.8 Min: 161.6 / Avg: 242.69 / Max: 248.1 Min: 44 / Avg: 192.74 / Max: 197.4 Min: 46 / Avg: 225.28 / Max: 233.2 Min: 48.9 / Avg: 235.08 / Max: 244.1 Min: 47.7 / Avg: 320.7 / Max: 332 Min: 71.5 / Avg: 189.63 / Max: 196.7 Min: 82.1 / Avg: 218.27 / Max: 228.9 Min: 60.2 / Avg: 257.74 / Max: 269.1 Min: 49.5 / Avg: 329.31 / Max: 338.6 Min: 87.3 / Avg: 295.02 / Max: 302.2 Min: 50.6 / Avg: 334.61 / Max: 351.7
GPU Temperature Monitor Phoronix Test Suite System Monitoring OpenBenchmarking.org Celsius GPU Temperature Monitor Phoronix Test Suite System Monitoring GTX 1070 GTX 1070 Ti GTX 1080 GTX 1080 Ti RTX 2060 RTX 2070 RTX 2080 RTX 2080 Ti RX 580 RX 590 RX Vega 56 RX Vega 64 Radeon VII TITAN RTX 20 40 60 80 100 Min: 32 / Avg: 61.66 / Max: 76 Min: 38 / Avg: 45.88 / Max: 53 Min: 31 / Avg: 60.14 / Max: 74 Min: 39 / Avg: 66.36 / Max: 82 Min: 37 / Avg: 55.81 / Max: 70 Min: 32 / Avg: 56.83 / Max: 74 Min: 48 / Avg: 67.06 / Max: 83 Min: 43 / Avg: 61.88 / Max: 77 Min: 26 / Avg: 39.71 / Max: 61 Min: 35 / Avg: 46.18 / Max: 73 Min: 28 / Avg: 47.45 / Max: 74 Min: 45 / Avg: 52.93 / Max: 65 Min: 36 / Avg: 52.37 / Max: 101 Min: 33 / Avg: 62.56 / Max: 79
System Power Consumption Monitor Phoronix Test Suite System Monitoring OpenBenchmarking.org Watts System Power Consumption Monitor Phoronix Test Suite System Monitoring GTX 1070 GTX 1070 Ti GTX 1080 GTX 1080 Ti RTX 2060 RTX 2070 RTX 2080 RTX 2080 Ti RX 580 RX 590 RX Vega 56 RX Vega 64 Radeon VII TITAN RTX 70 140 210 280 350 Min: 42.3 / Avg: 142.19 / Max: 280.5 Min: 47.2 / Avg: 123.43 / Max: 255.8 Min: 40.2 / Avg: 143.79 / Max: 318.2 Min: 47.2 / Avg: 198.85 / Max: 370.3 Min: 42.5 / Avg: 144.37 / Max: 300.1 Min: 43.9 / Avg: 160.13 / Max: 317.6 Min: 46 / Avg: 176.62 / Max: 334.5 Min: 47.2 / Avg: 220.83 / Max: 367.7 Min: 69 / Avg: 125.65 / Max: 229.5 Min: 75 / Avg: 138.2 / Max: 253.3 Min: 47.1 / Avg: 125.63 / Max: 271.3 Min: 49.7 / Avg: 129.09 / Max: 305.4 Min: 55.7 / Avg: 125.32 / Max: 337.5 Min: 49.4 / Avg: 228.34 / Max: 363.1
Phoronix Test Suite v10.8.4