AMD Radeon VII OpenCL GPU Compute Benchmarks Benchmarks for Radeon VII launch day by Michael Larabel for a future article. Radeon tests with ROCm 2.0 on Linux 5.0 kernel. GTX 1080: Processor: Intel Core i9-9900K @ 5.00GHz (8 Cores / 16 Threads), Motherboard: ASUS PRIME Z390-A (0602 BIOS), Chipset: Intel Cannon Lake PCH Shared SRAM, Memory: 16384MB, Disk: Samsung SSD 970 EVO 250GB + 2000GB SABRENT, Graphics: NVIDIA GeForce GTX 1080 8GB (1607/5005MHz), Audio: Realtek ALC1220, Monitor: Acer B286HK, Network: Intel I219-V OS: Ubuntu 18.10, Kernel: 4.20.3-042003-generic (x86_64), Desktop: GNOME Shell 3.30.1, Display Server: X Server 1.20.1, Display Driver: NVIDIA 415.27, OpenGL: 4.6.0, OpenCL: OpenCL 1.2 CUDA 10.0.132, Vulkan: 1.1.84, Compiler: GCC 8.2.0, File-System: ext4, Screen Resolution: 3840x2160 GTX 1070: Processor: Intel Core i9-9900K @ 5.00GHz (8 Cores / 16 Threads), Motherboard: ASUS PRIME Z390-A (0602 BIOS), Chipset: Intel Cannon Lake PCH Shared SRAM, Memory: 16384MB, Disk: Samsung SSD 970 EVO 250GB + 2000GB SABRENT, Graphics: NVIDIA GeForce GTX 1070 8GB (1506/4006MHz), Audio: Realtek ALC1220, Monitor: Acer B286HK, Network: Intel I219-V OS: Ubuntu 18.10, Kernel: 4.20.3-042003-generic (x86_64), Desktop: GNOME Shell 3.30.1, Display Server: X Server 1.20.1, Display Driver: NVIDIA 415.27, OpenGL: 4.6.0, OpenCL: OpenCL 1.2 CUDA 10.0.132, Vulkan: 1.1.84, Compiler: GCC 8.2.0, File-System: ext4, Screen Resolution: 3840x2160 GTX 1070 Ti: Processor: Intel Core i9-9900K @ 5.00GHz (8 Cores / 16 Threads), Motherboard: ASUS PRIME Z390-A (0602 BIOS), Chipset: Intel Cannon Lake PCH Shared SRAM, Memory: 16384MB, Disk: Samsung SSD 970 EVO 250GB + 2000GB SABRENT, Graphics: Zotac NVIDIA GeForce GTX 1070 Ti 8GB (1607/4006MHz), Audio: Realtek ALC1220, Monitor: Acer B286HK, Network: Intel I219-V OS: Ubuntu 18.10, Kernel: 4.20.3-042003-generic (x86_64), Desktop: GNOME Shell 3.30.1, Display Server: X Server 1.20.1, Display Driver: NVIDIA 415.27, OpenGL: 4.6.0, OpenCL: OpenCL 1.2 CUDA 10.0.132, Vulkan: 1.1.84, Compiler: GCC 8.2.0, File-System: ext4, Screen Resolution: 3840x2160 GTX 1080 Ti: Processor: Intel Core i9-9900K @ 5.00GHz (8 Cores / 16 Threads), Motherboard: ASUS PRIME Z390-A (0602 BIOS), Chipset: Intel Cannon Lake PCH Shared SRAM, Memory: 16384MB, Disk: Samsung SSD 970 EVO 250GB + 2000GB SABRENT, Graphics: NVIDIA GeForce GTX 1080 Ti 11GB (1480/5508MHz), Audio: Realtek ALC1220, Monitor: Acer B286HK, Network: Intel I219-V OS: Ubuntu 18.10, Kernel: 4.20.3-042003-generic (x86_64), Desktop: GNOME Shell 3.30.1, Display Server: X Server 1.20.1, Display Driver: NVIDIA 415.27, OpenGL: 4.6.0, OpenCL: OpenCL 1.2 CUDA 10.0.132, Vulkan: 1.1.84, Compiler: GCC 8.2.0, File-System: ext4, Screen Resolution: 3840x2160 TITAN RTX: Processor: Intel Core i9-9900K @ 5.00GHz (8 Cores / 16 Threads), Motherboard: ASUS PRIME Z390-A (0602 BIOS), Chipset: Intel Cannon Lake PCH Shared SRAM, Memory: 16384MB, Disk: Samsung SSD 970 EVO 250GB + 2000GB SABRENT, Graphics: NVIDIA TITAN RTX 24GB (1350/7000MHz), Audio: Realtek ALC1220, Monitor: Acer B286HK, Network: Intel I219-V OS: Ubuntu 18.10, Kernel: 4.20.3-042003-generic (x86_64), Desktop: GNOME Shell 3.30.1, Display Server: X Server 1.20.1, Display Driver: NVIDIA 415.27, OpenGL: 4.6.0, OpenCL: OpenCL 1.2 CUDA 10.0.132, Vulkan: 1.1.84, Compiler: GCC 8.2.0, File-System: ext4, Screen Resolution: 3840x2160 RTX 2080 Ti: Processor: Intel Core i9-9900K @ 5.00GHz (8 Cores / 16 Threads), Motherboard: ASUS PRIME Z390-A (0602 BIOS), Chipset: Intel Cannon Lake PCH Shared SRAM, Memory: 16384MB, Disk: Samsung SSD 970 EVO 250GB + 2000GB SABRENT, Graphics: NVIDIA GeForce RTX 2080 Ti 11GB (1350/7000MHz), Audio: Realtek ALC1220, Monitor: Acer B286HK, Network: Intel I219-V OS: Ubuntu 18.10, Kernel: 4.20.3-042003-generic (x86_64), Desktop: GNOME Shell 3.30.1, Display Server: X Server 1.20.1, Display Driver: NVIDIA 415.27, OpenGL: 4.6.0, OpenCL: OpenCL 1.2 CUDA 10.0.132, Vulkan: 1.1.84, Compiler: GCC 8.2.0, File-System: ext4, Screen Resolution: 3840x2160 RTX 2080: Processor: Intel Core i9-9900K @ 5.00GHz (8 Cores / 16 Threads), Motherboard: ASUS PRIME Z390-A (0602 BIOS), Chipset: Intel Cannon Lake PCH Shared SRAM, Memory: 16384MB, Disk: Samsung SSD 970 EVO 250GB + 2000GB SABRENT, Graphics: Zotac NVIDIA GeForce RTX 2080 8GB (1515/7000MHz), Audio: Realtek ALC1220, Monitor: Acer B286HK, Network: Intel I219-V OS: Ubuntu 18.10, Kernel: 4.20.3-042003-generic (x86_64), Desktop: GNOME Shell 3.30.1, Display Server: X Server 1.20.1, Display Driver: NVIDIA 415.27, OpenGL: 4.6.0, OpenCL: OpenCL 1.2 CUDA 10.0.132, Vulkan: 1.1.84, Compiler: GCC 8.2.0, File-System: ext4, Screen Resolution: 3840x2160 RTX 2060: Processor: Intel Core i9-9900K @ 5.00GHz (8 Cores / 16 Threads), Motherboard: ASUS PRIME Z390-A (0602 BIOS), Chipset: Intel Cannon Lake PCH Shared SRAM, Memory: 16384MB, Disk: Samsung SSD 970 EVO 250GB + 2000GB SABRENT, Graphics: NVIDIA GeForce RTX 2060 6GB (1365/7000MHz), Audio: Realtek ALC1220, Monitor: Acer B286HK, Network: Intel I219-V OS: Ubuntu 18.10, Kernel: 4.20.3-042003-generic (x86_64), Desktop: GNOME Shell 3.30.1, Display Server: X Server 1.20.1, Display Driver: NVIDIA 415.27, OpenGL: 4.6.0, OpenCL: OpenCL 1.2 CUDA 10.0.132, Vulkan: 1.1.84, Compiler: GCC 8.2.0, File-System: ext4, Screen Resolution: 3840x2160 RTX 2070: Processor: Intel Core i9-9900K @ 5.00GHz (8 Cores / 16 Threads), Motherboard: ASUS PRIME Z390-A (0602 BIOS), Chipset: Intel Cannon Lake PCH Shared SRAM, Memory: 16384MB, Disk: Samsung SSD 970 EVO 250GB + 2000GB SABRENT, Graphics: ASUS NVIDIA GeForce RTX 2070 8GB (1410/7000MHz), Audio: Realtek ALC1220, Monitor: Acer B286HK, Network: Intel I219-V OS: Ubuntu 18.10, Kernel: 4.20.3-042003-generic (x86_64), Desktop: GNOME Shell 3.30.1, Display Server: X Server 1.20.1, Display Driver: NVIDIA 415.27, OpenGL: 4.6.0, OpenCL: OpenCL 1.2 CUDA 10.0.132, Vulkan: 1.1.84, Compiler: GCC 8.2.0, File-System: ext4, Screen Resolution: 3840x2160 GTX 1060: Processor: Intel Core i9-9900K @ 5.00GHz (8 Cores / 16 Threads), Motherboard: ASUS PRIME Z390-A (0602 BIOS), Chipset: Intel Cannon Lake PCH Shared SRAM, Memory: 16384MB, Disk: Samsung SSD 970 EVO 250GB + 2000GB SABRENT, Graphics: NVIDIA GeForce GTX 1060 6GB (1506/4006MHz), Audio: Realtek ALC1220, Monitor: Acer B286HK, Network: Intel I219-V OS: Ubuntu 18.10, Kernel: 4.20.3-042003-generic (x86_64), Desktop: GNOME Shell 3.30.1, Display Server: X Server 1.20.1, Display Driver: NVIDIA 415.27, OpenGL: 4.6.0, OpenCL: OpenCL 1.2 CUDA 10.0.132, Vulkan: 1.1.84, Compiler: GCC 8.2.0, File-System: ext4, Screen Resolution: 3840x2160 RX Vega 64: Processor: Intel Core i9-9900K @ 5.00GHz (8 Cores / 16 Threads), Motherboard: ASUS PRIME Z390-A (0602 BIOS), Chipset: Intel Cannon Lake PCH Shared SRAM, Memory: 16384MB, Disk: Samsung SSD 970 EVO 250GB + 2000GB SABRENT, Graphics: AMD Radeon RX 64 8GB (1630/945MHz), Audio: Realtek ALC1220, Monitor: Acer B286HK, Network: Intel I219-V OS: Ubuntu 18.10, Kernel: 5.0.0-050000rc4-generic (x86_64) 20190127, Desktop: GNOME Shell 3.30.1, Display Server: X Server 1.20.1, OpenGL: 4.5 Mesa 19.0.0-devel padoka PPA (LLVM 9.0.0), OpenCL: OpenCL 2.1 AMD-APP (2783.0), Vulkan: 1.1.90, Compiler: GCC 8.2.0, File-System: ext4, Screen Resolution: 3840x2160 RX Vega 56: Processor: Intel Core i9-9900K @ 5.00GHz (8 Cores / 16 Threads), Motherboard: ASUS PRIME Z390-A (0602 BIOS), Chipset: Intel Cannon Lake PCH Shared SRAM, Memory: 16384MB, Disk: Samsung SSD 970 EVO 250GB + 2000GB SABRENT, Graphics: AMD Radeon RX 64 8GB (1590/800MHz), Audio: Realtek ALC1220, Monitor: Acer B286HK, Network: Intel I219-V OS: Ubuntu 18.10, Kernel: 5.0.0-050000rc4-generic (x86_64) 20190127, Desktop: GNOME Shell 3.30.1, Display Server: X Server 1.20.1, OpenGL: 4.5 Mesa 19.0.0-devel padoka PPA (LLVM 9.0.0), OpenCL: OpenCL 2.1 AMD-APP (2783.0), Vulkan: 1.1.90, Compiler: GCC 8.2.0, File-System: ext4, Screen Resolution: 3840x2160 RX 580: Processor: Intel Core i9-9900K @ 5.00GHz (8 Cores / 16 Threads), Motherboard: ASUS PRIME Z390-A (0602 BIOS), Chipset: Intel Cannon Lake PCH Shared SRAM, Memory: 16384MB, Disk: Samsung SSD 970 EVO 250GB + 2000GB SABRENT, Graphics: MSI AMD Radeon RX 470/480/570/570X/580/580X 8GB (1366/2000MHz), Audio: Realtek ALC1220, Monitor: Acer B286HK, Network: Intel I219-V OS: Ubuntu 18.10, Kernel: 5.0.0-050000rc4-generic (x86_64) 20190127, Desktop: GNOME Shell 3.30.1, Display Server: X Server 1.20.1, OpenGL: 4.5 Mesa 19.0.0-devel padoka PPA (LLVM 9.0.0), OpenCL: OpenCL 2.1 AMD-APP (2783.0), Vulkan: 1.1.90, Compiler: GCC 8.2.0, File-System: ext4, Screen Resolution: 3840x2160 RX 590: Processor: Intel Core i9-9900K @ 5.00GHz (8 Cores / 16 Threads), Motherboard: ASUS PRIME Z390-A (0602 BIOS), Chipset: Intel Cannon Lake PCH Shared SRAM, Memory: 16384MB, Disk: Samsung SSD 970 EVO 250GB + 2000GB SABRENT, Graphics: Sapphire AMD Radeon RX 470/480/570/570X/580/580X 8GB (1560/2100MHz), Audio: Realtek ALC1220, Monitor: Acer B286HK, Network: Intel I219-V OS: Ubuntu 18.10, Kernel: 5.0.0-050000rc4-generic (x86_64) 20190127, Desktop: GNOME Shell 3.30.1, Display Server: X Server 1.20.1, OpenGL: 4.5 Mesa 19.0.0-devel padoka PPA (LLVM 9.0.0), OpenCL: OpenCL 2.1 AMD-APP (2783.0), Vulkan: 1.1.90, Compiler: GCC 8.2.0, File-System: ext4, Screen Resolution: 3840x2160 Radeon VII: Processor: Intel Core i9-9900K @ 5.00GHz (8 Cores / 16 Threads), Motherboard: ASUS PRIME Z390-A (0602 BIOS), Chipset: Intel Cannon Lake PCH Shared SRAM, Memory: 16384MB, Disk: Samsung SSD 970 EVO 250GB + 2000GB SABRENT, Graphics: AMD Vega 20 16GB (1801/1000MHz), Audio: Realtek ALC1220, Monitor: Acer B286HK, Network: Intel I219-V OS: Ubuntu 18.10, Kernel: 5.0.0-050000rc4-generic (x86_64) 20190127, Desktop: GNOME Shell 3.30.1, Display Server: X Server 1.20.1, OpenGL: 4.5 Mesa 19.0.0-devel padoka PPA (LLVM 9.0.0), OpenCL: OpenCL 2.1 AMD-APP (2783.0), Vulkan: 1.1.90, Compiler: GCC 8.2.0, File-System: ext4, Screen Resolution: 3840x2160 LeelaChessZero 0.20.1 Backend: OpenCL Nodes Per Second > Higher Is Better GTX 1080 .... 1750 |================================ GTX 1070 .... 1430 |========================== GTX 1070 Ti . 1478 |=========================== GTX 1080 Ti . 2333 |========================================== TITAN RTX ... 3275 |=========================================================== RTX 2080 Ti . 3107 |======================================================== RTX 2080 .... 2259 |========================================= RTX 2060 .... 1484 |=========================== RTX 2070 .... 1729 |=============================== GTX 1060 .... 899 |================ RX Vega 64 .. 856 |=============== RX Vega 56 .. 758 |============== RX 580 ...... 640 |============ RX 590 ...... 683 |============ Radeon VII .. 1391 |========================= LeelaChessZero 0.20.1 Backend: OpenCL Nodes Per Second Per Watt > Higher Is Better GTX 1080 .... 11.81 |=============================== GTX 1070 .... 7.77 |==================== GTX 1070 Ti . 9.45 |========================= GTX 1080 Ti . 8.80 |======================= TITAN RTX ... 22.11 |========================================================== RTX 2080 Ti . 15.10 |======================================== RTX 2080 .... 10.13 |=========================== RTX 2060 .... 7.57 |==================== RTX 2070 .... 9.27 |======================== GTX 1060 .... 5.97 |================ RX Vega 64 .. 2.73 |======= RX Vega 56 .. 4.38 |=========== RX 580 ...... 3.74 |========== RX 590 ...... 3.62 |========= Radeon VII .. 9.38 |========================= LeelaChessZero 0.20.1 System Power Consumption Monitor Watts < Lower Is Better GTX 1080 .... MIN: 40 AVG: 148 MAX: 250 GTX 1070 .... MIN: 43 AVG: 184 MAX: 213 GTX 1070 Ti . MIN: 80 AVG: 156 MAX: 190 GTX 1080 Ti . MIN: 97 AVG: 265 MAX: 323 TITAN RTX ... MIN: 98 AVG: 148 MAX: 358 RTX 2080 Ti . MIN: 48 AVG: 206 MAX: 349 RTX 2080 .... MIN: 88 AVG: 223 MAX: 288 RTX 2060 .... MIN: 69 AVG: 196 MAX: 230 RTX 2070 .... MIN: 75 AVG: 187 MAX: 252 GTX 1060 .... MIN: 42 AVG: 151 MAX: 180 RX Vega 64 .. MIN: 50 AVG: 313 MAX: 343 RX Vega 56 .. MIN: 47 AVG: 173 MAX: 262 RX 580 ...... MIN: 69 AVG: 171 MAX: 230 RX 590 ...... MIN: 75 AVG: 189 MAX: 253 Radeon VII .. MIN: 56 AVG: 148 MAX: 269 PlaidML FP16: Yes - Mode: Inference - Network: Mobilenet - Device: OpenCL Examples Per Second > Higher Is Better GTX 1080 .... 686 |========================================== GTX 1070 .... 664 |========================================= GTX 1070 Ti . 645 |======================================== GTX 1080 Ti . 774 |================================================ TITAN RTX ... 977 |============================================================ RTX 2080 Ti . 971 |============================================================ RTX 2080 .... 893 |======================================================= RTX 2060 .... 779 |================================================ RTX 2070 .... 830 |=================================================== GTX 1060 .... 552 |================================== RX Vega 64 .. 587 |==================================== RX Vega 56 .. 575 |=================================== RX 580 ...... 563 |=================================== RX 590 ...... 599 |===================================== Radeon VII .. 904 |======================================================== PlaidML FP16: Yes - Mode: Inference - Network: Mobilenet - Device: OpenCL Examples Per Second Per Watt > Higher Is Better GTX 1080 .... 7.34 |===================================== GTX 1070 .... 7.22 |==================================== GTX 1070 Ti . 6.57 |================================= GTX 1080 Ti . 5.19 |========================== TITAN RTX ... 8.82 |============================================ RTX 2080 Ti . 10.28 |==================================================== RTX 2080 .... 6.82 |================================== RTX 2060 .... 6.41 |================================ RTX 2070 .... 8.87 |============================================= GTX 1060 .... 5.12 |========================== RX Vega 64 .. 8.48 |=========================================== RX Vega 56 .. 6.23 |=============================== RX 580 ...... 5.14 |========================== RX 590 ...... 4.74 |======================== Radeon VII .. 11.54 |========================================================== PlaidML System Power Consumption Monitor Watts < Lower Is Better GTX 1080 .... MIN: 44 AVG: 93 MAX: 127 GTX 1070 .... MIN: 43 AVG: 92 MAX: 117 GTX 1070 Ti . MIN: 49 AVG: 98 MAX: 133 GTX 1080 Ti . MIN: 92 AVG: 149 MAX: 203 TITAN RTX ... MIN: 53 AVG: 111 MAX: 140 RTX 2080 Ti . MIN: 48 AVG: 94 MAX: 113 RTX 2080 .... MIN: 56 AVG: 131 MAX: 185 RTX 2060 .... MIN: 46 AVG: 122 MAX: 166 RTX 2070 .... MIN: 46 AVG: 94 MAX: 129 GTX 1060 .... MIN: 42 AVG: 108 MAX: 142 RX Vega 64 .. MIN: 54 AVG: 69 MAX: 82 RX Vega 56 .. MIN: 50 AVG: 92 MAX: 158 RX 580 ...... MIN: 76 AVG: 109 MAX: 179 RX 590 ...... MIN: 82 AVG: 127 MAX: 195 Radeon VII .. MIN: 58 AVG: 78 MAX: 93 PlaidML FP16: Yes - Mode: Inference - Network: Inception V3 - Device: OpenCL Examples Per Second > Higher Is Better GTX 1080 .... 132.00 |=================================== GTX 1070 .... 117.00 |=============================== GTX 1070 Ti . 120.00 |================================ GTX 1080 Ti . 167.00 |============================================ TITAN RTX ... 215.00 |========================================================= RTX 2080 Ti . 211.00 |======================================================== RTX 2080 .... 168.00 |============================================= RTX 2060 .... 134.00 |==================================== RTX 2070 .... 157.00 |========================================== GTX 1060 .... 88.85 |======================== RX Vega 64 .. 120.03 |================================ RX Vega 56 .. 109.03 |============================= RX 580 ...... 76.59 |==================== RX 590 ...... 82.71 |====================== Radeon VII .. 166.30 |============================================ PlaidML FP16: Yes - Mode: Inference - Network: Inception V3 - Device: OpenCL Examples Per Second Per Watt > Higher Is Better GTX 1080 .... 0.78 |==================================== GTX 1070 .... 0.76 |=================================== GTX 1070 Ti . 0.90 |========================================= GTX 1080 Ti . 0.82 |====================================== TITAN RTX ... 1.28 |=========================================================== RTX 2080 Ti . 1.12 |==================================================== RTX 2080 .... 1.08 |================================================== RTX 2060 .... 0.92 |========================================== RTX 2070 .... 1.07 |================================================= GTX 1060 .... 0.67 |=============================== RX Vega 64 .. 0.66 |============================== RX Vega 56 .. 0.74 |================================== RX 580 ...... 0.52 |======================== RX 590 ...... 0.51 |======================== Radeon VII .. 1.24 |========================================================= PlaidML System Power Consumption Monitor Watts < Lower Is Better GTX 1080 .... MIN: 90 AVG: 169 MAX: 203 GTX 1070 .... MIN: 82 AVG: 154 MAX: 183 GTX 1070 Ti . MIN: 56 AVG: 132 MAX: 155 GTX 1080 Ti . MIN: 121 AVG: 203 MAX: 257 TITAN RTX ... MIN: 52 AVG: 169 MAX: 275 RTX 2080 Ti . MIN: 48 AVG: 189 MAX: 276 RTX 2080 .... MIN: 48 AVG: 156 MAX: 225 RTX 2060 .... MIN: 45 AVG: 145 MAX: 191 RTX 2070 .... MIN: 46 AVG: 147 MAX: 207 GTX 1060 .... MIN: 88 AVG: 132 MAX: 157 RX Vega 64 .. MIN: 51 AVG: 182 MAX: 296 RX Vega 56 .. MIN: 59 AVG: 148 MAX: 250 RX 580 ...... MIN: 73 AVG: 146 MAX: 195 RX 590 ...... MIN: 92 AVG: 164 MAX: 222 Radeon VII .. MIN: 70 AVG: 134 MAX: 228 PlaidML FP16: Yes - Mode: Inference - Network: ResNet 50 - Device: OpenCL Examples Per Second > Higher Is Better GTX 1080 .... 264 |================================= GTX 1070 .... 237 |============================== GTX 1070 Ti . 237 |============================== GTX 1080 Ti . 334 |========================================== TITAN RTX ... 474 |============================================================ RTX 2080 Ti . 458 |========================================================== RTX 2080 .... 354 |============================================= RTX 2060 .... 282 |==================================== RTX 2070 .... 333 |========================================== GTX 1060 .... 183 |======================= RX Vega 64 .. 213 |=========================== RX Vega 56 .. 195 |========================= RX 580 ...... 128 |================ RX 590 ...... 137 |================= Radeon VII .. 353 |============================================= PlaidML FP16: Yes - Mode: Inference - Network: ResNet 50 - Device: OpenCL Examples Per Second Per Watt > Higher Is Better GTX 1080 .... 1.62 |================================ GTX 1070 .... 1.76 |=================================== GTX 1070 Ti . 2.08 |========================================== GTX 1080 Ti . 1.78 |==================================== TITAN RTX ... 2.92 |========================================================== RTX 2080 Ti . 2.95 |=========================================================== RTX 2080 .... 2.39 |================================================ RTX 2060 .... 1.96 |======================================= RTX 2070 .... 2.51 |================================================== GTX 1060 .... 1.49 |============================== RX Vega 64 .. 1.24 |========================= RX Vega 56 .. 1.38 |============================ RX 580 ...... 0.91 |================== RX 590 ...... 0.89 |================== Radeon VII .. 2.75 |======================================================= PlaidML System Power Consumption Monitor Watts < Lower Is Better GTX 1080 .... MIN: 92 AVG: 163 MAX: 211 GTX 1070 .... MIN: 84 AVG: 135 MAX: 189 GTX 1070 Ti . MIN: 49 AVG: 114 MAX: 161 GTX 1080 Ti . MIN: 122 AVG: 188 MAX: 270 TITAN RTX ... MIN: 53 AVG: 163 MAX: 302 RTX 2080 Ti . MIN: 48 AVG: 155 MAX: 293 RTX 2080 .... MIN: 47 AVG: 148 MAX: 240 RTX 2060 .... MIN: 87 AVG: 144 MAX: 203 RTX 2070 .... MIN: 78 AVG: 133 MAX: 222 GTX 1060 .... MIN: 60 AVG: 123 MAX: 165 RX Vega 64 .. MIN: 82 AVG: 172 MAX: 314 RX Vega 56 .. MIN: 51 AVG: 141 MAX: 254 RX 580 ...... MIN: 74 AVG: 142 MAX: 188 RX 590 ...... MIN: 81 AVG: 154 MAX: 209 Radeon VII .. MIN: 70 AVG: 128 MAX: 244 PlaidML FP16: Yes - Mode: Inference - Network: VGG16 - Device: OpenCL Examples Per Second > Higher Is Better GTX 1080 .... 139.00 |============================== GTX 1070 .... 126.00 |=========================== GTX 1070 Ti . 128.00 |============================ GTX 1080 Ti . 194.00 |========================================== TITAN RTX ... 264.00 |========================================================= RTX 2080 Ti . 250.00 |====================================================== RTX 2080 .... 192.00 |========================================= RTX 2060 .... 148.00 |================================ RTX 2070 .... 179.00 |======================================= GTX 1060 .... 94.62 |==================== RX Vega 64 .. 119.99 |========================== RX Vega 56 .. 106.66 |======================= RX 580 ...... 60.98 |============= RX 590 ...... 64.04 |============== Radeon VII .. 197.63 |=========================================== PlaidML FP16: Yes - Mode: Inference - Network: VGG16 - Device: OpenCL Examples Per Second Per Watt > Higher Is Better GTX 1080 .... 0.80 |============================== GTX 1070 .... 0.92 |=================================== GTX 1070 Ti . 1.02 |======================================= GTX 1080 Ti . 1.08 |========================================= TITAN RTX ... 1.50 |========================================================= RTX 2080 Ti . 1.38 |===================================================== RTX 2080 .... 1.21 |============================================== RTX 2060 .... 1.08 |========================================= RTX 2070 .... 1.27 |================================================ GTX 1060 .... 0.72 |=========================== RX Vega 64 .. 0.55 |===================== RX Vega 56 .. 0.70 |=========================== RX 580 ...... 0.41 |================ RX 590 ...... 0.39 |=============== Radeon VII .. 1.55 |=========================================================== PlaidML System Power Consumption Monitor Watts < Lower Is Better GTX 1080 .... MIN: 70 AVG: 173 MAX: 217 GTX 1070 .... MIN: 43 AVG: 137 MAX: 191 GTX 1070 Ti . MIN: 48 AVG: 125 MAX: 170 GTX 1080 Ti . MIN: 65 AVG: 179 MAX: 288 TITAN RTX ... MIN: 58 AVG: 176 MAX: 323 RTX 2080 Ti . MIN: 48 AVG: 181 MAX: 312 RTX 2080 .... MIN: 50 AVG: 159 MAX: 253 RTX 2060 .... MIN: 62 AVG: 138 MAX: 208 RTX 2070 .... MIN: 47 AVG: 141 MAX: 234 GTX 1060 .... MIN: 58 AVG: 131 MAX: 167 RX Vega 64 .. MIN: 53 AVG: 218 MAX: 320 RX Vega 56 .. MIN: 50 AVG: 151 MAX: 258 RX 580 ...... MIN: 73 AVG: 147 MAX: 187 RX 590 ...... MIN: 80 AVG: 163 MAX: 210 Radeon VII .. MIN: 58 AVG: 128 MAX: 265 PlaidML FP16: No - Mode: Training - Network: IMDB LSTM - Device: OpenCL Examples Per Second > Higher Is Better GTX 1080 .... 167 |========================================= GTX 1070 .... 156 |====================================== GTX 1070 Ti . 153 |===================================== GTX 1080 Ti . 187 |============================================== TITAN RTX ... 244 |============================================================ RTX 2080 Ti . 246 |============================================================ RTX 2080 .... 216 |===================================================== RTX 2060 .... 188 |============================================== RTX 2070 .... 198 |================================================ GTX 1060 .... 134 |================================= RX Vega 64 .. 184 |============================================= RX Vega 56 .. 178 |=========================================== RX 580 ...... 130 |================================ RX 590 ...... 144 |=================================== Radeon VII .. 200 |================================================= PlaidML FP16: No - Mode: Training - Network: IMDB LSTM - Device: OpenCL Examples Per Second Per Watt > Higher Is Better GTX 1080 .... 1.14 |========================================== GTX 1070 .... 1.14 |========================================== GTX 1070 Ti . 1.24 |============================================= GTX 1080 Ti . 1.14 |========================================== TITAN RTX ... 1.60 |========================================================== RTX 2080 Ti . 1.54 |======================================================== RTX 2080 .... 1.56 |========================================================= RTX 2060 .... 1.62 |=========================================================== RTX 2070 .... 1.56 |========================================================= GTX 1060 .... 1.08 |======================================= RX Vega 64 .. 1.11 |======================================== RX Vega 56 .. 1.07 |======================================= RX 580 ...... 0.89 |================================ RX 590 ...... 0.95 |=================================== Radeon VII .. 1.45 |===================================================== PlaidML System Power Consumption Monitor Watts < Lower Is Better GTX 1080 .... MIN: 91 AVG: 147 MAX: 177 GTX 1070 .... MIN: 82 AVG: 137 MAX: 165 GTX 1070 Ti . MIN: 105 AVG: 124 MAX: 136 GTX 1080 Ti . MIN: 50 AVG: 165 MAX: 215 TITAN RTX ... MIN: 58 AVG: 152 MAX: 232 RTX 2080 Ti . MIN: 49 AVG: 160 MAX: 224 RTX 2080 .... MIN: 46 AVG: 138 MAX: 185 RTX 2060 .... MIN: 44 AVG: 116 MAX: 163 RTX 2070 .... MIN: 47 AVG: 127 MAX: 170 GTX 1060 .... MIN: 70 AVG: 124 MAX: 145 RX Vega 64 .. MIN: 52 AVG: 166 MAX: 306 RX Vega 56 .. MIN: 75 AVG: 166 MAX: 271 RX 580 ...... MIN: 71 AVG: 146 MAX: 185 RX 590 ...... MIN: 80 AVG: 153 MAX: 212 Radeon VII .. MIN: 87 AVG: 137 MAX: 192 PlaidML FP16: No - Mode: Inference - Network: Mobilenet - Device: OpenCL Examples Per Second > Higher Is Better GTX 1080 .... 801 |=================================== GTX 1070 .... 764 |================================== GTX 1070 Ti . 755 |================================= GTX 1080 Ti . 883 |======================================= TITAN RTX ... 1336 |=========================================================== RTX 2080 Ti . 1291 |========================================================= RTX 2080 .... 1045 |============================================== RTX 2060 .... 863 |====================================== RTX 2070 .... 1008 |============================================= GTX 1060 .... 592 |========================== RX Vega 64 .. 835 |===================================== RX Vega 56 .. 720 |================================ RX 580 ...... 414 |================== RX 590 ...... 453 |==================== Radeon VII .. 1233 |====================================================== PlaidML FP16: No - Mode: Inference - Network: Mobilenet - Device: OpenCL Examples Per Second Per Watt > Higher Is Better GTX 1080 .... 5.42 |============================= GTX 1070 .... 7.12 |======================================= GTX 1070 Ti . 8.06 |============================================ GTX 1080 Ti . 7.02 |====================================== TITAN RTX ... 6.67 |==================================== RTX 2080 Ti . 8.45 |============================================== RTX 2080 .... 10.67 |========================================================== RTX 2060 .... 9.00 |================================================= RTX 2070 .... 8.70 |=============================================== GTX 1060 .... 7.72 |========================================== RX Vega 64 .. 7.47 |========================================= RX Vega 56 .. 5.82 |================================ RX 580 ...... 3.62 |==================== RX 590 ...... 3.29 |================== Radeon VII .. 9.34 |=================================================== PlaidML System Power Consumption Monitor Watts < Lower Is Better GTX 1080 .... MIN: 44 AVG: 148 MAX: 195 GTX 1070 .... MIN: 46 AVG: 107 MAX: 155 GTX 1070 Ti . MIN: 50 AVG: 94 MAX: 126 GTX 1080 Ti . MIN: 53 AVG: 126 MAX: 165 TITAN RTX ... MIN: 54 AVG: 200 MAX: 274 RTX 2080 Ti . MIN: 48 AVG: 153 MAX: 275 RTX 2080 .... MIN: 52 AVG: 98 MAX: 121 RTX 2060 .... MIN: 43 AVG: 96 MAX: 119 RTX 2070 .... MIN: 115 AVG: 116 MAX: 117 GTX 1060 .... MIN: 42 AVG: 77 MAX: 94 RX Vega 64 .. MIN: 53 AVG: 112 MAX: 224 RX Vega 56 .. MIN: 73 AVG: 124 MAX: 260 RX 580 ...... MIN: 72 AVG: 114 MAX: 179 RX 590 ...... MIN: 82 AVG: 138 MAX: 206 Radeon VII .. MIN: 93 AVG: 132 MAX: 242 PlaidML FP16: No - Mode: Inference - Network: ResNet 50 - Device: OpenCL Examples Per Second > Higher Is Better GTX 1080 .... 292 |================================ GTX 1070 .... 257 |============================ GTX 1070 Ti . 262 |============================ GTX 1080 Ti . 339 |===================================== TITAN RTX ... 556 |============================================================ RTX 2080 Ti . 537 |========================================================== RTX 2080 .... 400 |=========================================== RTX 2060 .... 309 |================================= RTX 2070 .... 376 |========================================= GTX 1060 .... 194 |===================== RX Vega 64 .. 270 |============================= RX Vega 56 .. 228 |========================= RX 580 ...... 133 |============== RX 590 ...... 142 |=============== Radeon VII .. 403 |=========================================== PlaidML FP16: No - Mode: Inference - Network: ResNet 50 - Device: OpenCL Examples Per Second Per Watt > Higher Is Better GTX 1080 .... 1.92 |==================================== GTX 1070 .... 1.77 |================================== GTX 1070 Ti . 1.94 |===================================== GTX 1080 Ti . 1.82 |=================================== TITAN RTX ... 2.86 |====================================================== RTX 2080 Ti . 3.11 |=========================================================== RTX 2080 .... 2.51 |================================================ RTX 2060 .... 2.30 |============================================ RTX 2070 .... 2.44 |============================================== GTX 1060 .... 1.59 |============================== RX Vega 64 .. 1.52 |============================= RX Vega 56 .. 1.51 |============================= RX 580 ...... 0.92 |================= RX 590 ...... 0.88 |================= Radeon VII .. 2.97 |======================================================== PlaidML System Power Consumption Monitor Watts < Lower Is Better GTX 1080 .... MIN: 92 AVG: 152 MAX: 225 GTX 1070 .... MIN: 45 AVG: 145 MAX: 201 GTX 1070 Ti . MIN: 49 AVG: 135 MAX: 169 GTX 1080 Ti . MIN: 61 AVG: 186 MAX: 281 TITAN RTX ... MIN: 102 AVG: 194 MAX: 333 RTX 2080 Ti . MIN: 100 AVG: 173 MAX: 323 RTX 2080 .... MIN: 48 AVG: 159 MAX: 258 RTX 2060 .... MIN: 65 AVG: 134 MAX: 209 RTX 2070 .... MIN: 50 AVG: 154 MAX: 242 GTX 1060 .... MIN: 71 AVG: 122 MAX: 173 RX Vega 64 .. MIN: 82 AVG: 177 MAX: 338 RX Vega 56 .. MIN: 50 AVG: 150 MAX: 271 RX 580 ...... MIN: 73 AVG: 145 MAX: 195 RX 590 ...... MIN: 81 AVG: 162 MAX: 220 Radeon VII .. MIN: 59 AVG: 135 MAX: 277 PlaidML FP16: No - Mode: Inference - Network: VGG16 - Device: OpenCL Examples Per Second > Higher Is Better GTX 1080 .... 143.00 |============================ GTX 1070 .... 129.00 |========================= GTX 1070 Ti . 131.00 |========================== GTX 1080 Ti . 189.00 |===================================== TITAN RTX ... 289.00 |========================================================= RTX 2080 Ti . 273.00 |====================================================== RTX 2080 .... 203.00 |======================================== RTX 2060 .... 150.00 |============================== RTX 2070 .... 189.00 |===================================== GTX 1060 .... 94.08 |=================== RX Vega 64 .. 137.62 |=========================== RX Vega 56 .. 120.44 |======================== RX 580 ...... 65.18 |============= RX 590 ...... 68.69 |============== Radeon VII .. 224.77 |============================================ PlaidML FP16: No - Mode: Inference - Network: VGG16 - Device: OpenCL Examples Per Second Per Watt > Higher Is Better GTX 1080 .... 0.79 |==================================== GTX 1070 .... 0.79 |==================================== GTX 1070 Ti . 0.89 |======================================== GTX 1080 Ti . 0.82 |===================================== TITAN RTX ... 1.29 |=========================================================== RTX 2080 Ti . 1.28 |========================================================== RTX 2080 .... 1.08 |================================================= RTX 2060 .... 0.90 |========================================= RTX 2070 .... 1.03 |=============================================== GTX 1060 .... 0.65 |============================== RX Vega 64 .. 0.64 |============================= RX Vega 56 .. 0.64 |============================= RX 580 ...... 0.40 |================== RX 590 ...... 0.37 |================= Radeon VII .. 1.30 |=========================================================== PlaidML System Power Consumption Monitor Watts < Lower Is Better GTX 1080 .... MIN: 45 AVG: 181 MAX: 225 GTX 1070 .... MIN: 43 AVG: 163 MAX: 198 GTX 1070 Ti . MIN: 48 AVG: 147 MAX: 172 GTX 1080 Ti . MIN: 128 AVG: 231 MAX: 297 TITAN RTX ... MIN: 55 AVG: 224 MAX: 346 RTX 2080 Ti . MIN: 48 AVG: 213 MAX: 331 RTX 2080 .... MIN: 51 AVG: 188 MAX: 269 RTX 2060 .... MIN: 44 AVG: 168 MAX: 215 RTX 2070 .... MIN: 69 AVG: 184 MAX: 246 GTX 1060 .... MIN: 73 AVG: 145 MAX: 171 RX Vega 64 .. MIN: 53 AVG: 216 MAX: 338 RX Vega 56 .. MIN: 79 AVG: 188 MAX: 262 RX 580 ...... MIN: 73 AVG: 164 MAX: 195 RX 590 ...... MIN: 87 AVG: 185 MAX: 216 Radeon VII .. MIN: 58 AVG: 173 MAX: 297 LuxMark 3.1 OpenCL Device: GPU - Scene: Luxball HDR Score > Higher Is Better GTX 1080 .... 13803 |============== GTX 1070 .... 17287 |================== GTX 1070 Ti . 16776 |================== GTX 1080 Ti . 21682 |======================= TITAN RTX ... 46022 |================================================ RTX 2080 Ti . 42787 |============================================= RTX 2080 .... 29146 |============================== RTX 2060 .... 21356 |====================== RTX 2070 .... 29532 |=============================== GTX 1060 .... 12256 |============= RX Vega 64 .. 32565 |================================== RX Vega 56 .. 31079 |================================ RX 580 ...... 15271 |================ RX 590 ...... 17221 |================== Radeon VII .. 55570 |========================================================== LuxMark 3.1 OpenCL Device: GPU - Scene: Luxball HDR Score Per Watt > Higher Is Better GTX 1080 .... 79.42 |======================== GTX 1070 .... 98.48 |============================== GTX 1070 Ti . 114.16 |=================================== GTX 1080 Ti . 89.34 |=========================== TITAN RTX ... 137.54 |========================================== RTX 2080 Ti . 133.42 |======================================== RTX 2080 .... 123.99 |====================================== RTX 2060 .... 110.80 |================================== RTX 2070 .... 131.09 |======================================== GTX 1060 .... 85.53 |========================== RX Vega 64 .. 98.89 |============================== RX Vega 56 .. 120.58 |==================================== RX 580 ...... 80.53 |======================== RX 590 ...... 78.90 |======================== Radeon VII .. 188.36 |========================================================= LuxMark 3.1 System Power Consumption Monitor Watts < Lower Is Better GTX 1080 .... MIN: 89 AVG: 174 MAX: 176 GTX 1070 .... MIN: 83 AVG: 176 MAX: 179 GTX 1070 Ti . MIN: 48 AVG: 147 MAX: 150 GTX 1080 Ti . MIN: 162 AVG: 243 MAX: 248 TITAN RTX ... MIN: 51 AVG: 335 MAX: 352 RTX 2080 Ti . MIN: 48 AVG: 321 MAX: 332 RTX 2080 .... MIN: 49 AVG: 235 MAX: 244 RTX 2060 .... MIN: 44 AVG: 193 MAX: 197 RTX 2070 .... MIN: 46 AVG: 225 MAX: 233 GTX 1060 .... MIN: 111 AVG: 143 MAX: 145 RX Vega 64 .. MIN: 50 AVG: 329 MAX: 339 RX Vega 56 .. MIN: 60 AVG: 258 MAX: 269 RX 580 ...... MIN: 72 AVG: 190 MAX: 197 RX 590 ...... MIN: 82 AVG: 218 MAX: 229 Radeon VII .. MIN: 87 AVG: 295 MAX: 302 clpeak OpenCL Test: Global Memory Bandwidth GBPS > Higher Is Better GTX 1080 .... 222 |================= GTX 1070 .... 196 |=============== GTX 1070 Ti . 197 |=============== GTX 1080 Ti . 329 |======================== TITAN RTX ... 525 |======================================= RTX 2080 Ti . 505 |====================================== RTX 2080 .... 368 |=========================== RTX 2060 .... 276 |===================== RTX 2070 .... 365 |=========================== GTX 1060 .... 145 |=========== RX Vega 64 .. 362 |=========================== RX Vega 56 .. 317 |======================== RX 580 ...... 206 |=============== RX 590 ...... 217 |================ Radeon VII .. 807 |============================================================ clpeak OpenCL Test: Single-Precision Float GFLOPS > Higher Is Better GTX 1080 .... 7934 |============================ GTX 1070 .... 5878 |===================== GTX 1070 Ti . 6776 |======================== GTX 1080 Ti . 10853 |====================================== TITAN RTX ... 16386 |========================================================== RTX 2080 Ti . 15352 |====================================================== RTX 2080 .... 10270 |==================================== RTX 2060 .... 6630 |======================= RTX 2070 .... 7968 |============================ GTX 1060 .... 4239 |=============== RX Vega 64 .. 12469 |============================================ RX Vega 56 .. 10357 |===================================== RX 580 ...... 6202 |====================== RX 590 ...... 7069 |========================= Radeon VII .. 13453 |================================================ GPU Temperature Monitor Phoronix Test Suite System Monitoring Celsius GTX 1080 .... MIN: 31 AVG: 60 MAX: 74 GTX 1070 .... MIN: 32 AVG: 62 MAX: 76 GTX 1070 Ti . MIN: 38 AVG: 46 MAX: 53 GTX 1080 Ti . MIN: 39 AVG: 66 MAX: 82 TITAN RTX ... MIN: 33 AVG: 63 MAX: 79 RTX 2080 Ti . MIN: 43 AVG: 62 MAX: 77 RTX 2080 .... MIN: 48 AVG: 67 MAX: 83 RTX 2060 .... MIN: 37 AVG: 56 MAX: 70 RTX 2070 .... MIN: 32 AVG: 57 MAX: 74 RX Vega 64 .. MIN: 45 AVG: 53 MAX: 65 RX Vega 56 .. MIN: 28 AVG: 47 MAX: 74 RX 580 ...... MIN: 26 AVG: 40 MAX: 61 RX 590 ...... MIN: 35 AVG: 46 MAX: 73 Radeon VII .. MIN: 36 AVG: 52 MAX: 101 System Power Consumption Monitor Phoronix Test Suite System Monitoring Watts GTX 1080 .... MIN: 40 AVG: 144 MAX: 318 GTX 1070 .... MIN: 42 AVG: 142 MAX: 281 GTX 1070 Ti . MIN: 47 AVG: 123 MAX: 256 GTX 1080 Ti . MIN: 47 AVG: 199 MAX: 370 TITAN RTX ... MIN: 49 AVG: 228 MAX: 363 RTX 2080 Ti . MIN: 47 AVG: 221 MAX: 368 RTX 2080 .... MIN: 46 AVG: 177 MAX: 335 RTX 2060 .... MIN: 43 AVG: 144 MAX: 300 RTX 2070 .... MIN: 44 AVG: 160 MAX: 318 RX Vega 64 .. MIN: 50 AVG: 129 MAX: 305 RX Vega 56 .. MIN: 47 AVG: 126 MAX: 271 RX 580 ...... MIN: 69 AVG: 126 MAX: 230 RX 590 ...... MIN: 75 AVG: 138 MAX: 253 Radeon VII .. MIN: 56 AVG: 125 MAX: 338