PlaidML OpenCL Linux GPU Benchmarks AMD Radeon + NVIDIA GeForce PlaidML Linux benchmarks for a future article on Phoronix.com by Michael Larabel. RX Vega 56: Processor: AMD Ryzen Threadripper 2990WX 32-Core @ 3.00GHz (32 Cores / 64 Threads), Motherboard: ASUS ROG ZENITH EXTREME (1601 BIOS), Chipset: AMD Family 17h, Memory: 32768MB, Disk: Samsung SSD 970 EVO 500GB, Graphics: AMD Radeon RX 64 8GB (1590/800MHz), Audio: Realtek ALC1220, Monitor: ASUS VP28U, Network: Intel I211 Gigabit + Qualcomm Atheros QCA6174 802.11ac + Wilocity Wil6200 802.11ad OS: Ubuntu 18.10, Kernel: 4.19.0-041900-generic (x86_64), Desktop: GNOME Shell 3.30.1, Display Server: X Server 1.20.1, Display Driver: amdgpu 18.1.0, OpenGL: 4.5 Mesa 18.2.2 (LLVM 7.0.0), Compiler: GCC 8.2.0, File-System: ext4, Screen Resolution: 3840x2160 RX Vega 64: Processor: AMD Ryzen Threadripper 2990WX 32-Core @ 3.00GHz (32 Cores / 64 Threads), Motherboard: ASUS ROG ZENITH EXTREME (1601 BIOS), Chipset: AMD Family 17h, Memory: 32768MB, Disk: Samsung SSD 970 EVO 500GB, Graphics: AMD Radeon RX 64 8GB (1630/945MHz), Audio: Realtek ALC1220, Monitor: ASUS VP28U, Network: Intel I211 Gigabit + Qualcomm Atheros QCA6174 802.11ac + Wilocity Wil6200 802.11ad OS: Ubuntu 18.10, Kernel: 4.19.0-041900-generic (x86_64), Desktop: GNOME Shell 3.30.1, Display Server: X Server 1.20.1, Display Driver: amdgpu 18.1.0, OpenGL: 4.5 Mesa 18.2.2 (LLVM 7.0.0), Compiler: GCC 8.2.0, File-System: ext4, Screen Resolution: 3840x2160 RX 580: Processor: AMD Ryzen Threadripper 2990WX 32-Core @ 3.00GHz (32 Cores / 64 Threads), Motherboard: ASUS ROG ZENITH EXTREME (1601 BIOS), Chipset: AMD Family 17h, Memory: 32768MB, Disk: Samsung SSD 970 EVO 500GB, Graphics: MSI AMD Radeon RX 470/480/570/570X/580/580X 8GB (1366/2000MHz), Audio: Realtek ALC1220, Monitor: ASUS VP28U, Network: Intel I211 Gigabit + Qualcomm Atheros QCA6174 802.11ac + Wilocity Wil6200 802.11ad OS: Ubuntu 18.10, Kernel: 4.19.0-041900-generic (x86_64), Desktop: GNOME Shell 3.30.1, Display Server: X Server 1.20.1, Display Driver: modesetting 1.20.1, OpenGL: 4.5 Mesa 18.2.2 (LLVM 7.0.0), Compiler: GCC 8.2.0, File-System: ext4, Screen Resolution: 3840x2160 RX 590: Processor: AMD Ryzen Threadripper 2990WX 32-Core @ 3.00GHz (32 Cores / 64 Threads), Motherboard: ASUS ROG ZENITH EXTREME (1601 BIOS), Chipset: AMD Family 17h, Memory: 32768MB, Disk: Samsung SSD 970 EVO 500GB, Graphics: Sapphire AMD Radeon RX 470/480/570/570X/580/580X 8GB (1560/2100MHz), Audio: Realtek ALC1220, Monitor: ASUS VP28U, Network: Intel I211 Gigabit + Qualcomm Atheros QCA6174 802.11ac + Wilocity Wil6200 802.11ad OS: Ubuntu 18.10, Kernel: 4.20.0-042000-generic (x86_64), Desktop: GNOME Shell 3.30.1, Display Server: X Server 1.20.1, Display Driver: modesetting 1.20.1, OpenGL: 4.5 Mesa 18.2.2 (LLVM 7.0.0), Compiler: GCC 8.2.0, File-System: ext4, Screen Resolution: 3840x2160 RTX 2080 Ti: Processor: AMD Ryzen Threadripper 2990WX 32-Core @ 3.00GHz (32 Cores / 64 Threads), Motherboard: ASUS ROG ZENITH EXTREME (1601 BIOS), Chipset: AMD Family 17h, Memory: 32768MB, Disk: Samsung SSD 970 EVO 500GB, Graphics: NVIDIA GeForce RTX 2080 Ti 11GB (1350/7000MHz), Audio: Realtek ALC1220, Monitor: ASUS VP28U, Network: Intel I211 Gigabit + Qualcomm Atheros QCA6174 802.11ac + Wilocity Wil6200 802.11ad OS: Ubuntu 18.10, Kernel: 4.20.0-042000-generic (x86_64), Desktop: GNOME Shell 3.30.1, Display Server: X Server 1.20.1, Display Driver: NVIDIA 415.25, OpenGL: 4.6.0, Vulkan: 1.1.84, Compiler: GCC 8.2.0, File-System: ext4, Screen Resolution: 3840x2160 TITAN RTX: Processor: AMD Ryzen Threadripper 2990WX 32-Core @ 3.00GHz (32 Cores / 64 Threads), Motherboard: ASUS ROG ZENITH EXTREME (1601 BIOS), Chipset: AMD Family 17h, Memory: 32768MB, Disk: Samsung SSD 970 EVO 500GB, Graphics: NVIDIA TITAN RTX 24GB (1350/7000MHz), Audio: Realtek ALC1220, Monitor: ASUS VP28U, Network: Intel I211 + Qualcomm Atheros QCA6174 802.11ac + Wilocity Wil6200 802.11ad OS: Ubuntu 18.10, Kernel: 4.20.0-042000-generic (x86_64), Desktop: GNOME Shell 3.30.1, Display Server: X Server 1.20.1, Display Driver: NVIDIA 415.25, OpenGL: 4.6.0, Vulkan: 1.1.84, Compiler: GCC 8.2.0, File-System: ext4, Screen Resolution: 3840x2160 RTX 2080: Processor: AMD Ryzen Threadripper 2990WX 32-Core @ 3.00GHz (32 Cores / 64 Threads), Motherboard: ASUS ROG ZENITH EXTREME (1601 BIOS), Chipset: AMD Family 17h, Memory: 32768MB, Disk: Samsung SSD 970 EVO 500GB, Graphics: Zotac NVIDIA GeForce RTX 2080 8GB (1515/7000MHz), Audio: Realtek ALC1220, Monitor: ASUS VP28U, Network: Intel I211 + Qualcomm Atheros QCA6174 802.11ac + Wilocity Wil6200 802.11ad OS: Ubuntu 18.10, Kernel: 4.20.0-042000-generic (x86_64), Desktop: GNOME Shell 3.30.1, Display Server: X Server 1.20.1, Display Driver: NVIDIA 415.25, OpenGL: 4.6.0, Vulkan: 1.1.84, Compiler: GCC 8.2.0, File-System: ext4, Screen Resolution: 3840x2160 RTX 2070: Processor: AMD Ryzen Threadripper 2990WX 32-Core @ 3.00GHz (32 Cores / 64 Threads), Motherboard: ASUS ROG ZENITH EXTREME (1601 BIOS), Chipset: AMD Family 17h, Memory: 32768MB, Disk: Samsung SSD 970 EVO 500GB, Graphics: ASUS NVIDIA GeForce RTX 2070 8GB (1410/7000MHz), Audio: Realtek ALC1220, Monitor: ASUS VP28U, Network: Intel I211 + Qualcomm Atheros QCA6174 802.11ac + Wilocity Wil6200 802.11ad OS: Ubuntu 18.10, Kernel: 4.20.0-042000-generic (x86_64), Desktop: GNOME Shell 3.30.1, Display Server: X Server 1.20.1, Display Driver: NVIDIA 415.25, OpenGL: 4.6.0, Vulkan: 1.1.84, Compiler: GCC 8.2.0, File-System: ext4, Screen Resolution: 3840x2160 RTX 2060: Processor: AMD Ryzen Threadripper 2990WX 32-Core @ 3.00GHz (32 Cores / 64 Threads), Motherboard: ASUS ROG ZENITH EXTREME (1601 BIOS), Chipset: AMD Family 17h, Memory: 32768MB, Disk: Samsung SSD 970 EVO 500GB, Graphics: Device 6GB (1365/7000MHz), Audio: Realtek ALC1220, Monitor: ASUS VP28U, Network: Intel I211 + Qualcomm Atheros QCA6174 802.11ac + Wilocity Wil6200 802.11ad OS: Ubuntu 18.10, Kernel: 4.20.0-042000-generic (x86_64), Desktop: GNOME Shell 3.30.1, Display Server: X Server 1.20.1, Display Driver: NVIDIA 415.25, OpenGL: 4.6.0, Vulkan: 1.1.84, Compiler: GCC 8.2.0, File-System: ext4, Screen Resolution: 3840x2160 GTX 1080: Processor: AMD Ryzen Threadripper 2990WX 32-Core @ 3.00GHz (32 Cores / 64 Threads), Motherboard: ASUS ROG ZENITH EXTREME (1601 BIOS), Chipset: AMD Family 17h, Memory: 32768MB, Disk: Samsung SSD 970 EVO 500GB, Graphics: NVIDIA GeForce GTX 1080 8GB (1607/5005MHz), Audio: Realtek ALC1220, Monitor: ASUS VP28U, Network: Intel I211 + Qualcomm Atheros QCA6174 802.11ac + Wilocity Wil6200 802.11ad OS: Ubuntu 18.10, Kernel: 4.20.0-042000-generic (x86_64), Desktop: GNOME Shell 3.30.1, Display Server: X Server 1.20.1, Display Driver: NVIDIA 415.25, OpenGL: 4.6.0, Vulkan: 1.1.84, Compiler: GCC 8.2.0, File-System: ext4, Screen Resolution: 3840x2160 GTX 1060: Processor: AMD Ryzen Threadripper 2990WX 32-Core @ 3.00GHz (32 Cores / 64 Threads), Motherboard: ASUS ROG ZENITH EXTREME (1601 BIOS), Chipset: AMD Family 17h, Memory: 32768MB, Disk: Samsung SSD 970 EVO 500GB, Graphics: NVIDIA GeForce GTX 1060 6GB (1506/4006MHz), Audio: Realtek ALC1220, Monitor: ASUS VP28U, Network: Intel I211 + Qualcomm Atheros QCA6174 802.11ac + Wilocity Wil6200 802.11ad OS: Ubuntu 18.10, Kernel: 4.20.0-042000-generic (x86_64), Desktop: GNOME Shell 3.30.1, Display Server: X Server 1.20.1, Display Driver: NVIDIA 415.25, OpenGL: 4.6.0, Vulkan: 1.1.84, Compiler: GCC 8.2.0, File-System: ext4, Screen Resolution: 3840x2160 GTX 1070: Processor: AMD Ryzen Threadripper 2990WX 32-Core @ 3.00GHz (32 Cores / 64 Threads), Motherboard: ASUS ROG ZENITH EXTREME (1601 BIOS), Chipset: AMD Family 17h, Memory: 32768MB, Disk: Samsung SSD 970 EVO 500GB, Graphics: NVIDIA GeForce GTX 1070 8GB (1506/4006MHz), Audio: Realtek ALC1220, Monitor: ASUS VP28U, Network: Intel I211 + Qualcomm Atheros QCA6174 802.11ac + Wilocity Wil6200 802.11ad OS: Ubuntu 18.10, Kernel: 4.20.0-042000-generic (x86_64), Desktop: GNOME Shell 3.30.1, Display Server: X Server 1.20.1, Display Driver: NVIDIA 415.25, OpenGL: 4.6.0, Vulkan: 1.1.84, Compiler: GCC 8.2.0, File-System: ext4, Screen Resolution: 3840x2160 GTX 1070 Ti: Processor: AMD Ryzen Threadripper 2990WX 32-Core @ 3.00GHz (32 Cores / 64 Threads), Motherboard: ASUS ROG ZENITH EXTREME (1601 BIOS), Chipset: AMD Family 17h, Memory: 32768MB, Disk: Samsung SSD 970 EVO 500GB, Graphics: Zotac NVIDIA GeForce GTX 1070 Ti 8GB (1607/4006MHz), Audio: Realtek ALC1220, Monitor: ASUS VP28U, Network: Intel I211 + Qualcomm Atheros QCA6174 802.11ac + Wilocity Wil6200 802.11ad OS: Ubuntu 18.10, Kernel: 4.20.0-042000-generic (x86_64), Desktop: GNOME Shell 3.30.1, Display Server: X Server 1.20.1, Display Driver: NVIDIA 415.25, OpenGL: 4.6.0, Vulkan: 1.1.84, Compiler: GCC 8.2.0, File-System: ext4, Screen Resolution: 3840x2160 GTX 1080 Ti: Processor: AMD Ryzen Threadripper 2990WX 32-Core @ 3.00GHz (32 Cores / 64 Threads), Motherboard: ASUS ROG ZENITH EXTREME (1601 BIOS), Chipset: AMD Family 17h, Memory: 32768MB, Disk: Samsung SSD 970 EVO 500GB, Graphics: NVIDIA GeForce GTX 1080 Ti 11GB (1480/5508MHz), Audio: Realtek ALC1220, Monitor: ASUS VP28U, Network: Intel I211 + Qualcomm Atheros QCA6174 802.11ac + Wilocity Wil6200 802.11ad OS: Ubuntu 18.10, Kernel: 4.20.0-042000-generic (x86_64), Desktop: GNOME Shell 3.30.1, Display Server: X Server 1.20.1, Display Driver: NVIDIA 415.25, OpenGL: 4.6.0, Vulkan: 1.1.84, Compiler: GCC 8.2.0, File-System: ext4, Screen Resolution: 3840x2160 GTX 980 Ti: Processor: AMD Ryzen Threadripper 2990WX 32-Core @ 3.00GHz (32 Cores / 64 Threads), Motherboard: ASUS ROG ZENITH EXTREME (1601 BIOS), Chipset: AMD Family 17h, Memory: 32768MB, Disk: Samsung SSD 970 EVO 500GB, Graphics: NVIDIA GeForce GTX 980 Ti 6GB (999/3505MHz), Audio: Realtek ALC1220, Monitor: ASUS VP28U, Network: Intel I211 + Qualcomm Atheros QCA6174 802.11ac + Wilocity Wil6200 802.11ad OS: Ubuntu 18.10, Kernel: 4.20.0-042000-generic (x86_64), Desktop: GNOME Shell 3.30.1, Display Server: X Server 1.20.1, Display Driver: NVIDIA 415.25, OpenGL: 4.6.0, Vulkan: 1.1.84, Compiler: GCC 8.2.0, File-System: ext4, Screen Resolution: 3840x2160 GTX 980: Processor: AMD Ryzen Threadripper 2990WX 32-Core @ 3.00GHz (32 Cores / 64 Threads), Motherboard: ASUS ROG ZENITH EXTREME (1601 BIOS), Chipset: AMD Family 17h, Memory: 32768MB, Disk: Samsung SSD 970 EVO 500GB, Graphics: NVIDIA GeForce GTX 980 4GB (1126/3505MHz), Audio: Realtek ALC1220, Monitor: ASUS VP28U, Network: Intel I211 + Qualcomm Atheros QCA6174 802.11ac + Wilocity Wil6200 802.11ad OS: Ubuntu 18.10, Kernel: 4.20.0-042000-generic (x86_64), Desktop: GNOME Shell 3.30.1, Display Server: X Server 1.20.1, Display Driver: NVIDIA 415.25, OpenGL: 4.6.0, Vulkan: 1.1.84, Compiler: GCC 8.2.0, File-System: ext4, Screen Resolution: 3840x2160 PlaidML FP16: No - Mode: Training - Network: VGG16 - Device: OpenCL Examples Per Second > Higher Is Better RX Vega 56 .. 28.78 |================== RX Vega 64 .. 30.85 |==================== RX 580 ...... 10.42 |======= RX 590 ...... 9.52 |====== RTX 2080 Ti . 85.45 |======================================================= TITAN RTX ... 90.84 |========================================================== RTX 2080 .... 67.59 |=========================================== RTX 2070 .... 63.71 |========================================= GTX 1080 .... 50.09 |================================ GTX 1060 .... 34.07 |====================== GTX 1070 .... 45.97 |============================= GTX 1070 Ti . 46.73 |============================== GTX 1080 Ti . 66.55 |========================================== GTX 980 Ti .. 40.14 |========================== PlaidML FP16: No - Mode: Training - Network: VGG19 - Device: OpenCL Examples Per Second > Higher Is Better RX Vega 56 .. 25.66 |=================== RX Vega 64 .. 28.15 |===================== RX 580 ...... 9.67 |======= RX 590 ...... 8.92 |======= RTX 2080 Ti . 74.75 |====================================================== TITAN RTX ... 79.58 |========================================================== RTX 2080 .... 58.55 |=========================================== RTX 2070 .... 54.76 |======================================== GTX 1080 .... 42.92 |=============================== GTX 1070 .... 39.22 |============================= GTX 1070 Ti . 40.33 |============================= GTX 1080 Ti . 57.60 |========================================== PlaidML FP16: No - Mode: Inference - Network: VGG16 - Device: OpenCL Examples Per Second > Higher Is Better RX Vega 56 .. 109.00 |======================= RX Vega 64 .. 123.00 |========================== RX 580 ...... 64.55 |============= RX 590 ...... 67.71 |============== RTX 2080 Ti . 258.50 |====================================================== TITAN RTX ... 274.89 |========================================================= RTX 2080 .... 197.52 |========================================= RTX 2070 .... 183.95 |====================================== RTX 2060 .... 147.16 |=============================== GTX 1080 .... 138.78 |============================= GTX 1060 .... 93.00 |=================== GTX 1070 .... 125.37 |========================== GTX 1070 Ti . 128.85 |=========================== GTX 1080 Ti . 181.25 |====================================== GTX 980 Ti .. 119.20 |========================= GTX 980 ..... 94.84 |==================== PlaidML FP16: No - Mode: Inference - Network: VGG19 - Device: OpenCL Examples Per Second > Higher Is Better RX Vega 56 .. 94.41 |======================= RX Vega 64 .. 107.32 |========================== RX 580 ...... 55.26 |============= RX 590 ...... 58.31 |============== RTX 2080 Ti . 221.88 |===================================================== TITAN RTX ... 237.71 |========================================================= RTX 2080 .... 168.53 |======================================== RTX 2070 .... 155.08 |===================================== RTX 2060 .... 124.18 |============================== GTX 1080 .... 117.24 |============================ GTX 1060 .... 78.13 |=================== GTX 1070 .... 106.35 |========================== GTX 1070 Ti . 109.40 |========================== GTX 1080 Ti . 156.28 |===================================== GTX 980 Ti .. 101.40 |======================== GTX 980 ..... 80.37 |=================== PlaidML FP16: Yes - Mode: Inference - Network: VGG16 - Device: OpenCL Examples Per Second > Higher Is Better RX Vega 56 .. 107.00 |======================== RX Vega 64 .. 120.00 |=========================== RX 580 ...... 58.92 |============= RX 590 ...... 61.65 |============== RTX 2080 Ti . 236.13 |====================================================== TITAN RTX ... 250.30 |========================================================= RTX 2080 .... 185.76 |========================================== RTX 2070 .... 172.84 |======================================= RTX 2060 .... 143.80 |================================= GTX 1080 .... 134.68 |=============================== GTX 1060 .... 92.19 |===================== GTX 1070 .... 122.54 |============================ GTX 1070 Ti . 125.60 |============================= GTX 1080 Ti . 180.71 |========================================= GTX 980 Ti .. 121.68 |============================ GTX 980 ..... 96.82 |====================== PlaidML FP16: Yes - Mode: Inference - Network: VGG19 - Device: OpenCL Examples Per Second > Higher Is Better RX Vega 56 .. 91.32 |======================== RX Vega 64 .. 103.93 |=========================== RX 580 ...... 51.59 |============= RX 590 ...... 53.85 |============== RTX 2080 Ti . 207.30 |===================================================== TITAN RTX ... 220.89 |========================================================= RTX 2080 .... 161.16 |========================================== RTX 2070 .... 148.93 |====================================== RTX 2060 .... 121.98 |=============================== GTX 1080 .... 115.90 |============================== GTX 1060 .... 79.29 |==================== GTX 1070 .... 105.77 |=========================== GTX 1070 Ti . 108.85 |============================ GTX 1080 Ti . 159.02 |========================================= GTX 980 Ti .. 104.74 |=========================== GTX 980 ..... 83.19 |===================== PlaidML FP16: No - Mode: Training - Network: IMDB LSTM - Device: OpenCL Examples Per Second > Higher Is Better RX Vega 56 .. 164 |=================================================== RX Vega 64 .. 169 |===================================================== RX 580 ...... 119 |===================================== RX 590 ...... 133 |========================================== RTX 2080 Ti . 192 |============================================================ TITAN RTX ... 191 |============================================================ RTX 2080 .... 175 |======================================================= RTX 2070 .... 164 |=================================================== RTX 2060 .... 157 |================================================= GTX 1080 .... 142 |============================================ GTX 1060 .... 119 |===================================== GTX 1070 .... 135 |========================================== GTX 1070 Ti . 133 |========================================== GTX 1080 Ti . 165 |==================================================== GTX 980 Ti .. 122 |====================================== GTX 980 ..... 108 |================================== PlaidML FP16: No - Mode: Training - Network: Mobilenet - Device: OpenCL Examples Per Second > Higher Is Better RX Vega 56 .. 71.29 |============================= RX Vega 64 .. 75.23 |============================== RX 580 ...... 41.64 |================= RX 590 ...... 45.21 |================== RTX 2080 Ti . 138.11 |======================================================= TITAN RTX ... 142.36 |========================================================= RTX 2080 .... 120.24 |================================================ RTX 2070 .... 119.84 |================================================ RTX 2060 .... 103.30 |========================================= GTX 1080 .... 94.47 |====================================== GTX 1060 .... 81.65 |================================= GTX 1070 .... 98.45 |======================================= GTX 1070 Ti . 95.52 |====================================== GTX 1080 Ti . 113.55 |============================================= GTX 980 Ti .. 83.66 |================================= GTX 980 ..... 78.47 |=============================== PlaidML FP16: No - Mode: Inference - Network: IMDB LSTM - Device: OpenCL Examples Per Second > Higher Is Better RX Vega 56 .. 240 |=========================== RX Vega 64 .. 240 |=========================== RX 580 ...... 182 |==================== RX 590 ...... 205 |======================= RTX 2080 Ti . 525 |=========================================================== TITAN RTX ... 535 |============================================================ RTX 2080 .... 418 |=============================================== RTX 2070 .... 356 |======================================== RTX 2060 .... 324 |==================================== GTX 1080 .... 247 |============================ GTX 1060 .... 175 |==================== GTX 1070 .... 218 |======================== GTX 1070 Ti . 215 |======================== GTX 1080 Ti . 298 |================================= GTX 980 Ti .. 174 |==================== GTX 980 ..... 155 |================= PlaidML FP16: No - Mode: Inference - Network: Mobilenet - Device: OpenCL Examples Per Second > Higher Is Better RX Vega 56 .. 531 |================================ RX Vega 64 .. 546 |================================= RX 580 ...... 390 |======================== RX 590 ...... 424 |========================== RTX 2080 Ti . 962 |========================================================== TITAN RTX ... 988 |============================================================ RTX 2080 .... 794 |================================================ RTX 2070 .... 767 |=============================================== RTX 2060 .... 671 |========================================= GTX 1080 .... 621 |====================================== GTX 1060 .... 485 |============================= GTX 1070 .... 593 |==================================== GTX 1070 Ti . 594 |==================================== GTX 1080 Ti . 687 |========================================== GTX 980 Ti .. 485 |============================= GTX 980 ..... 458 |============================ PlaidML FP16: No - Mode: Inference - Network: ResNet 50 - Device: OpenCL Examples Per Second > Higher Is Better RX Vega 56 .. 213 |========================== RX Vega 64 .. 226 |=========================== RX 580 ...... 131 |================ RX 590 ...... 139 |================= RTX 2080 Ti . 478 |========================================================= TITAN RTX ... 499 |============================================================ RTX 2080 .... 373 |============================================= RTX 2070 .... 351 |========================================== RTX 2060 .... 293 |=================================== GTX 1080 .... 275 |================================= GTX 1060 .... 187 |====================== GTX 1070 .... 241 |============================= GTX 1070 Ti . 249 |============================== GTX 1080 Ti . 315 |====================================== GTX 980 Ti .. 199 |======================== GTX 980 ..... 172 |===================== PlaidML FP16: Yes - Mode: Inference - Network: Mobilenet - Device: OpenCL Examples Per Second > Higher Is Better RX Vega 56 .. 480 |========================================= RX Vega 64 .. 481 |========================================= RX 580 ...... 435 |===================================== RX 590 ...... 455 |======================================= RTX 2080 Ti . 695 |============================================================ TITAN RTX ... 698 |============================================================ RTX 2080 .... 612 |===================================================== RTX 2070 .... 533 |============================================== RTX 2060 .... 538 |============================================== GTX 1080 .... 510 |============================================ GTX 1060 .... 426 |===================================== GTX 1070 .... 476 |========================================= GTX 1070 Ti . 473 |========================================= GTX 1080 Ti . 555 |================================================ GTX 980 Ti .. 421 |==================================== GTX 980 ..... 407 |=================================== PlaidML FP16: Yes - Mode: Inference - Network: ResNet 50 - Device: OpenCL Examples Per Second > Higher Is Better RX Vega 56 .. 192 |=========================== RX Vega 64 .. 212 |============================== RX 580 ...... 121 |================= RX 590 ...... 129 |================== RTX 2080 Ti . 417 |========================================================== TITAN RTX ... 428 |============================================================ RTX 2080 .... 330 |============================================== RTX 2070 .... 311 |============================================ RTX 2060 .... 259 |==================================== GTX 1080 .... 248 |=================================== GTX 1060 .... 173 |======================== GTX 1070 .... 221 |=============================== GTX 1070 Ti . 226 |================================ GTX 1080 Ti . 311 |============================================ GTX 980 Ti .. 199 |============================ GTX 980 ..... 175 |========================= PlaidML FP16: No - Mode: Training - Network: Inception V3 - Device: OpenCL Examples Per Second > Higher Is Better RX Vega 56 .. 19.86 |=============================== RX Vega 64 .. 20.98 |================================ RX 580 ...... 13.15 |==================== RX 590 ...... 14.59 |====================== RTX 2080 Ti . 37.67 |========================================================== TITAN RTX ... 37.41 |========================================================== RTX 2080 .... 32.80 |=================================================== RTX 2070 .... 31.44 |================================================ GTX 1080 .... 28.44 |============================================ GTX 1060 .... 21.58 |================================= GTX 1070 .... 26.21 |======================================== GTX 1070 Ti . 26.00 |======================================== GTX 1080 Ti . 33.10 |=================================================== PlaidML FP16: No - Mode: Inference - Network: DenseNet 201 - Device: OpenCL Examples Per Second > Higher Is Better RX Vega 56 .. 95.87 |================================== RX Vega 64 .. 106.44 |====================================== RX 580 ...... 62.34 |====================== RX 590 ...... 67.50 |======================== RTX 2080 Ti . 150.01 |===================================================== TITAN RTX ... 161.32 |========================================================= RTX 2080 .... 118.65 |========================================== RTX 2070 .... 115.65 |========================================= RTX 2060 .... 95.88 |================================== GTX 1080 .... 90.83 |================================ GTX 1060 .... 62.27 |====================== GTX 1070 .... 83.89 |============================== GTX 1070 Ti . 83.55 |============================== GTX 1080 Ti . 119.80 |========================================== GTX 980 Ti .. 78.88 |============================ GTX 980 ..... 63.96 |======================= PlaidML FP16: No - Mode: Inference - Network: Inception V3 - Device: OpenCL Examples Per Second > Higher Is Better RX Vega 56 .. 104.00 |============================ RX Vega 64 .. 118.00 |================================ RX 580 ...... 66.19 |================== RX 590 ...... 71.42 |=================== RTX 2080 Ti . 197.56 |===================================================== TITAN RTX ... 211.69 |========================================================= RTX 2080 .... 161.94 |============================================ RTX 2070 .... 147.39 |======================================== RTX 2060 .... 124.84 |================================== GTX 1080 .... 124.65 |================================== GTX 1060 .... 82.03 |====================== GTX 1070 .... 108.50 |============================= GTX 1070 Ti . 113.61 |=============================== GTX 1080 Ti . 158.20 |=========================================== GTX 980 Ti .. 96.69 |========================== GTX 980 ..... 81.03 |====================== PlaidML FP16: No - Mode: Inference - Network: NASNer Large - Device: OpenCL Examples Per Second > Higher Is Better RX Vega 56 .. 31.08 |============================== RX Vega 64 .. 35.89 |=================================== RX 580 ...... 18.08 |================== RX 590 ...... 20.01 |==================== RTX 2080 Ti . 56.77 |======================================================== TITAN RTX ... 59.13 |========================================================== RTX 2080 .... 41.57 |========================================= RTX 2070 .... 36.01 |=================================== RTX 2060 .... 29.42 |============================= GTX 1080 .... 30.92 |============================== GTX 1060 .... 18.27 |================== GTX 1070 .... 25.31 |========================= GTX 1070 Ti . 26.57 |========================== GTX 1080 Ti . 42.75 |========================================== GTX 980 Ti .. 24.32 |======================== GTX 980 ..... 18.89 |=================== PlaidML FP16: Yes - Mode: Inference - Network: DenseNet 201 - Device: OpenCL Examples Per Second > Higher Is Better RTX 2080 Ti . 139.00 |====================================================== TITAN RTX ... 148.00 |========================================================= RTX 2080 .... 111.00 |=========================================== RTX 2070 .... 108.00 |========================================== RTX 2060 .... 89.02 |================================== GTX 1080 .... 85.60 |================================= GTX 1060 .... 58.76 |======================= GTX 1070 .... 79.08 |============================== GTX 1070 Ti . 78.45 |============================== GTX 1080 Ti . 114.97 |============================================ GTX 980 Ti .. 76.15 |============================= GTX 980 ..... 61.38 |======================== PlaidML FP16: Yes - Mode: Inference - Network: Inception V3 - Device: OpenCL Examples Per Second > Higher Is Better RTX 2080 Ti . 192.00 |====================================================== TITAN RTX ... 203.00 |========================================================= RTX 2080 .... 153.00 |=========================================== RTX 2070 .... 142.00 |======================================== RTX 2060 .... 126.00 |=================================== GTX 1080 .... 130.00 |===================================== GTX 1060 .... 86.75 |======================== GTX 1070 .... 112.31 |================================ GTX 1070 Ti . 114.33 |================================ GTX 1080 Ti . 160.18 |============================================= GTX 980 Ti .. 104.10 |============================= GTX 980 ..... 89.26 |========================= PlaidML FP16: Yes - Mode: Inference - Network: NASNer Large - Device: OpenCL Examples Per Second > Higher Is Better RTX 2080 Ti . 69.70 |======================================================== TITAN RTX ... 72.61 |========================================================== RTX 2080 .... 51.54 |========================================= RTX 2070 .... 44.34 |=================================== RTX 2060 .... 37.60 |============================== GTX 1080 .... 37.02 |============================== GTX 1060 .... 22.17 |================== GTX 1070 .... 30.20 |======================== GTX 1070 Ti . 32.65 |========================== GTX 1080 Ti . 47.63 |====================================== GTX 980 Ti .. 26.90 |===================== GTX 980 ..... 23.22 |===================