PlaidML Linux benchmarks for a future article on Phoronix.com by Michael Larabel.
Compare your own system(s) to this result file with the
Phoronix Test Suite by running the command:
phoronix-test-suite benchmark 1901122-PTS-PLAIDMLG16 PlaidML OpenCL Linux GPU Benchmarks AMD Radeon + NVIDIA GeForce - Phoronix Test Suite PlaidML OpenCL Linux GPU Benchmarks AMD Radeon + NVIDIA GeForce PlaidML Linux benchmarks for a future article on Phoronix.com by Michael Larabel.
HTML result view exported from: https://openbenchmarking.org/result/1901122-PTS-PLAIDMLG16&gru&sor .
PlaidML OpenCL Linux GPU Benchmarks AMD Radeon + NVIDIA GeForce Processor Motherboard Chipset Memory Disk Graphics Audio Monitor Network OS Kernel Desktop Display Server Display Driver OpenGL Compiler File-System Screen Resolution Vulkan RX 580 RX 590 RX Vega 56 RX Vega 64 GTX 980 GTX 980 Ti GTX 1060 GTX 1070 GTX 1070 Ti GTX 1080 GTX 1080 Ti RTX 2060 RTX 2070 RTX 2080 RTX 2080 Ti TITAN RTX AMD Ryzen Threadripper 2990WX 32-Core @ 3.00GHz (32 Cores / 64 Threads) ASUS ROG ZENITH EXTREME (1601 BIOS) AMD Family 17h 32768MB Samsung SSD 970 EVO 500GB MSI AMD Radeon RX 470/480/570/570X/580/580X 8GB (1366/2000MHz) Realtek ALC1220 ASUS VP28U Intel I211 Gigabit + Qualcomm Atheros QCA6174 802.11ac + Wilocity Wil6200 802.11ad Ubuntu 18.10 4.19.0-041900-generic (x86_64) GNOME Shell 3.30.1 X Server 1.20.1 modesetting 1.20.1 4.5 Mesa 18.2.2 (LLVM 7.0.0) GCC 8.2.0 ext4 3840x2160 Sapphire AMD Radeon RX 470/480/570/570X/580/580X 8GB (1560/2100MHz) 4.20.0-042000-generic (x86_64) AMD Radeon RX 64 8GB (1590/800MHz) 4.19.0-041900-generic (x86_64) amdgpu 18.1.0 AMD Radeon RX 64 8GB (1630/945MHz) NVIDIA GeForce GTX 980 4GB (1126/3505MHz) Intel I211 + Qualcomm Atheros QCA6174 802.11ac + Wilocity Wil6200 802.11ad 4.20.0-042000-generic (x86_64) NVIDIA 415.25 4.6.0 1.1.84 NVIDIA GeForce GTX 980 Ti 6GB (999/3505MHz) NVIDIA GeForce GTX 1060 6GB (1506/4006MHz) NVIDIA GeForce GTX 1070 8GB (1506/4006MHz) Zotac NVIDIA GeForce GTX 1070 Ti 8GB (1607/4006MHz) NVIDIA GeForce GTX 1080 8GB (1607/5005MHz) NVIDIA GeForce GTX 1080 Ti 11GB (1480/5508MHz) Device 6GB (1365/7000MHz) ASUS NVIDIA GeForce RTX 2070 8GB (1410/7000MHz) Zotac NVIDIA GeForce RTX 2080 8GB (1515/7000MHz) NVIDIA GeForce RTX 2080 Ti 11GB (1350/7000MHz) Intel I211 Gigabit + Qualcomm Atheros QCA6174 802.11ac + Wilocity Wil6200 802.11ad NVIDIA TITAN RTX 24GB (1350/7000MHz) Intel I211 + Qualcomm Atheros QCA6174 802.11ac + Wilocity Wil6200 802.11ad OpenBenchmarking.org Processor Details - Scaling Governor: acpi-cpufreq ondemand Graphics Details - RX 580, RX 590, RX Vega 56, RX Vega 64: GLAMOR Python Details - Python 2.7.15+ + Python 3.6.7 Security Details - RX 580: __user pointer sanitization + Full AMD retpoline IBPB + SSB disabled via prctl and seccomp - RX 590: __user pointer sanitization + Full AMD retpoline IBPB: conditional STIBP: disabled RSB filling + SSB disabled via prctl and seccomp - RX Vega 56: __user pointer sanitization + Full AMD retpoline IBPB + SSB disabled via prctl and seccomp - RX Vega 64: __user pointer sanitization + Full AMD retpoline IBPB + SSB disabled via prctl and seccomp - GTX 980: __user pointer sanitization + Full AMD retpoline IBPB: conditional STIBP: disabled RSB filling + SSB disabled via prctl and seccomp - GTX 980 Ti: __user pointer sanitization + Full AMD retpoline IBPB: conditional STIBP: disabled RSB filling + SSB disabled via prctl and seccomp - GTX 1060: __user pointer sanitization + Full AMD retpoline IBPB: conditional STIBP: disabled RSB filling + SSB disabled via prctl and seccomp - GTX 1070: __user pointer sanitization + Full AMD retpoline IBPB: conditional STIBP: disabled RSB filling + SSB disabled via prctl and seccomp - GTX 1070 Ti: __user pointer sanitization + Full AMD retpoline IBPB: conditional STIBP: disabled RSB filling + SSB disabled via prctl and seccomp - GTX 1080: __user pointer sanitization + Full AMD retpoline IBPB: conditional STIBP: disabled RSB filling + SSB disabled via prctl and seccomp - GTX 1080 Ti: __user pointer sanitization + Full AMD retpoline IBPB: conditional STIBP: disabled RSB filling + SSB disabled via prctl and seccomp - RTX 2060: __user pointer sanitization + Full AMD retpoline IBPB: conditional STIBP: disabled RSB filling + SSB disabled via prctl and seccomp - RTX 2070: __user pointer sanitization + Full AMD retpoline IBPB: conditional STIBP: disabled RSB filling + SSB disabled via prctl and seccomp - RTX 2080: __user pointer sanitization + Full AMD retpoline IBPB: conditional STIBP: disabled RSB filling + SSB disabled via prctl and seccomp - RTX 2080 Ti: __user pointer sanitization + Full AMD retpoline IBPB: conditional STIBP: disabled RSB filling + SSB disabled via prctl and seccomp - TITAN RTX: __user pointer sanitization + Full AMD retpoline IBPB: conditional STIBP: disabled RSB filling + SSB disabled via prctl and seccomp OpenCL Details - GTX 980: GPU Compute Cores: 2048 - GTX 980 Ti: GPU Compute Cores: 2816 - GTX 1060: GPU Compute Cores: 1280 - GTX 1070: GPU Compute Cores: 1920 - GTX 1070 Ti: GPU Compute Cores: 2432 - GTX 1080: GPU Compute Cores: 2560 - GTX 1080 Ti: GPU Compute Cores: 3584 - RTX 2060: GPU Compute Cores: 1920 - RTX 2070: GPU Compute Cores: 2304 - RTX 2080: GPU Compute Cores: 2944 - RTX 2080 Ti: GPU Compute Cores: 4352 - TITAN RTX: GPU Compute Cores: 4608
PlaidML OpenCL Linux GPU Benchmarks AMD Radeon + NVIDIA GeForce plaidml: No - Training - VGG16 - OpenCL plaidml: No - Training - VGG19 - OpenCL plaidml: No - Inference - VGG16 - OpenCL plaidml: No - Inference - VGG19 - OpenCL plaidml: Yes - Inference - VGG16 - OpenCL plaidml: Yes - Inference - VGG19 - OpenCL plaidml: No - Training - IMDB LSTM - OpenCL plaidml: No - Training - Mobilenet - OpenCL plaidml: No - Inference - IMDB LSTM - OpenCL plaidml: No - Inference - Mobilenet - OpenCL plaidml: No - Inference - ResNet 50 - OpenCL plaidml: Yes - Inference - Mobilenet - OpenCL plaidml: Yes - Inference - ResNet 50 - OpenCL plaidml: No - Training - Inception V3 - OpenCL plaidml: No - Inference - DenseNet 201 - OpenCL plaidml: No - Inference - Inception V3 - OpenCL plaidml: No - Inference - NASNer Large - OpenCL plaidml: Yes - Inference - DenseNet 201 - OpenCL plaidml: Yes - Inference - Inception V3 - OpenCL plaidml: Yes - Inference - NASNer Large - OpenCL RX 580 RX 590 RX Vega 56 RX Vega 64 GTX 980 GTX 980 Ti GTX 1060 GTX 1070 GTX 1070 Ti GTX 1080 GTX 1080 Ti RTX 2060 RTX 2070 RTX 2080 RTX 2080 Ti TITAN RTX 10.42 9.67 64.55 55.26 58.92 51.59 119 41.64 182 390 131 435 121 13.15 62.34 66.19 18.08 9.52 8.92 67.71 58.31 61.65 53.85 133 45.21 205 424 139 455 129 14.59 67.50 71.42 20.01 28.78 25.66 109 94.41 107 91.32 164 71.29 240 531 213 480 192 19.86 95.87 104 31.08 30.85 28.15 123 107.32 120 103.93 169 75.23 240 546 226 481 212 20.98 106.44 118 35.89 94.84 80.37 96.82 83.19 108 78.47 155 458 172 407 175 63.96 81.03 18.89 61.38 89.26 23.22 40.14 119.20 101.40 121.68 104.74 122 83.66 174 485 199 421 199 78.88 96.69 24.32 76.15 104.10 26.90 34.07 93.00 78.13 92.19 79.29 119 81.65 175 485 187 426 173 21.58 62.27 82.03 18.27 58.76 86.75 22.17 45.97 39.22 125.37 106.35 122.54 105.77 135 98.45 218 593 241 476 221 26.21 83.89 108.50 25.31 79.08 112.31 30.20 46.73 40.33 128.85 109.40 125.60 108.85 133 95.52 215 594 249 473 226 26.00 83.55 113.61 26.57 78.45 114.33 32.65 50.09 42.92 138.78 117.24 134.68 115.90 142 94.47 247 621 275 510 248 28.44 90.83 124.65 30.92 85.60 130 37.02 66.55 57.60 181.25 156.28 180.71 159.02 165 113.55 298 687 315 555 311 33.10 119.80 158.20 42.75 114.97 160.18 47.63 147.16 124.18 143.80 121.98 157 103.30 324 671 293 538 259 95.88 124.84 29.42 89.02 126 37.60 63.71 54.76 183.95 155.08 172.84 148.93 164 119.84 356 767 351 533 311 31.44 115.65 147.39 36.01 108 142 44.34 67.59 58.55 197.52 168.53 185.76 161.16 175 120.24 418 794 373 612 330 32.80 118.65 161.94 41.57 111 153 51.54 85.45 74.75 258.50 221.88 236.13 207.30 192 138.11 525 962 478 695 417 37.67 150.01 197.56 56.77 139 192 69.70 90.84 79.58 274.89 237.71 250.30 220.89 191 142.36 535 988 499 698 428 37.41 161.32 211.69 59.13 148 203 72.61 OpenBenchmarking.org
PlaidML FP16: No - Mode: Training - Network: VGG16 - Device: OpenCL OpenBenchmarking.org Examples Per Second, More Is Better PlaidML FP16: No - Mode: Training - Network: VGG16 - Device: OpenCL TITAN RTX RTX 2080 Ti RTX 2080 GTX 1080 Ti RTX 2070 GTX 1080 GTX 1070 Ti GTX 1070 GTX 980 Ti GTX 1060 RX Vega 64 RX Vega 56 RX 580 RX 590 20 40 60 80 100 SE +/- 0.18, N = 3 SE +/- 0.13, N = 3 SE +/- 0.26, N = 3 SE +/- 0.15, N = 3 SE +/- 0.21, N = 3 SE +/- 0.04, N = 3 SE +/- 0.05, N = 3 SE +/- 0.06, N = 3 SE +/- 0.28, N = 3 SE +/- 0.04, N = 3 SE +/- 0.13, N = 3 SE +/- 0.02, N = 3 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 90.84 85.45 67.59 66.55 63.71 50.09 46.73 45.97 40.14 34.07 30.85 28.78 10.42 9.52
PlaidML FP16: No - Mode: Training - Network: VGG19 - Device: OpenCL OpenBenchmarking.org Examples Per Second, More Is Better PlaidML FP16: No - Mode: Training - Network: VGG19 - Device: OpenCL TITAN RTX RTX 2080 Ti RTX 2080 GTX 1080 Ti RTX 2070 GTX 1080 GTX 1070 Ti GTX 1070 RX Vega 64 RX Vega 56 RX 580 RX 590 20 40 60 80 100 SE +/- 0.16, N = 3 SE +/- 0.09, N = 3 SE +/- 0.07, N = 3 SE +/- 0.07, N = 3 SE +/- 0.12, N = 3 SE +/- 0.08, N = 3 SE +/- 0.03, N = 3 SE +/- 0.07, N = 3 SE +/- 0.02, N = 3 SE +/- 0.19, N = 3 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 79.58 74.75 58.55 57.60 54.76 42.92 40.33 39.22 28.15 25.66 9.67 8.92
PlaidML FP16: No - Mode: Inference - Network: VGG16 - Device: OpenCL OpenBenchmarking.org Examples Per Second, More Is Better PlaidML FP16: No - Mode: Inference - Network: VGG16 - Device: OpenCL TITAN RTX RTX 2080 Ti RTX 2080 RTX 2070 GTX 1080 Ti RTX 2060 GTX 1080 GTX 1070 Ti GTX 1070 RX Vega 64 GTX 980 Ti RX Vega 56 GTX 980 GTX 1060 RX 590 RX 580 60 120 180 240 300 SE +/- 1.45, N = 3 SE +/- 0.25, N = 3 SE +/- 0.14, N = 3 SE +/- 0.03, N = 3 SE +/- 0.45, N = 3 SE +/- 0.18, N = 3 SE +/- 0.09, N = 3 SE +/- 0.06, N = 3 SE +/- 0.40, N = 3 SE +/- 1.73, N = 3 SE +/- 0.14, N = 3 SE +/- 0.77, N = 3 SE +/- 0.06, N = 3 SE +/- 0.06, N = 3 SE +/- 0.51, N = 3 SE +/- 0.03, N = 3 274.89 258.50 197.52 183.95 181.25 147.16 138.78 128.85 125.37 123.00 119.20 109.00 94.84 93.00 67.71 64.55
PlaidML FP16: No - Mode: Inference - Network: VGG19 - Device: OpenCL OpenBenchmarking.org Examples Per Second, More Is Better PlaidML FP16: No - Mode: Inference - Network: VGG19 - Device: OpenCL TITAN RTX RTX 2080 Ti RTX 2080 GTX 1080 Ti RTX 2070 RTX 2060 GTX 1080 GTX 1070 Ti RX Vega 64 GTX 1070 GTX 980 Ti RX Vega 56 GTX 980 GTX 1060 RX 590 RX 580 50 100 150 200 250 SE +/- 0.16, N = 3 SE +/- 0.15, N = 3 SE +/- 0.12, N = 3 SE +/- 0.11, N = 3 SE +/- 0.13, N = 3 SE +/- 0.08, N = 3 SE +/- 0.03, N = 3 SE +/- 0.03, N = 3 SE +/- 0.89, N = 3 SE +/- 0.00, N = 3 SE +/- 0.19, N = 3 SE +/- 1.43, N = 4 SE +/- 0.07, N = 3 SE +/- 0.01, N = 3 SE +/- 0.34, N = 3 SE +/- 0.06, N = 3 237.71 221.88 168.53 156.28 155.08 124.18 117.24 109.40 107.32 106.35 101.40 94.41 80.37 78.13 58.31 55.26
PlaidML FP16: Yes - Mode: Inference - Network: VGG16 - Device: OpenCL OpenBenchmarking.org Examples Per Second, More Is Better PlaidML FP16: Yes - Mode: Inference - Network: VGG16 - Device: OpenCL TITAN RTX RTX 2080 Ti RTX 2080 GTX 1080 Ti RTX 2070 RTX 2060 GTX 1080 GTX 1070 Ti GTX 1070 GTX 980 Ti RX Vega 64 RX Vega 56 GTX 980 GTX 1060 RX 590 RX 580 50 100 150 200 250 SE +/- 0.14, N = 3 SE +/- 1.48, N = 3 SE +/- 0.06, N = 3 SE +/- 0.26, N = 3 SE +/- 0.05, N = 3 SE +/- 0.02, N = 3 SE +/- 0.05, N = 3 SE +/- 0.36, N = 3 SE +/- 0.04, N = 3 SE +/- 0.07, N = 3 SE +/- 0.39, N = 3 SE +/- 0.06, N = 3 SE +/- 0.00, N = 3 SE +/- 0.82, N = 3 SE +/- 0.27, N = 3 SE +/- 0.06, N = 3 250.30 236.13 185.76 180.71 172.84 143.80 134.68 125.60 122.54 121.68 120.00 107.00 96.82 92.19 61.65 58.92
PlaidML FP16: Yes - Mode: Inference - Network: VGG19 - Device: OpenCL OpenBenchmarking.org Examples Per Second, More Is Better PlaidML FP16: Yes - Mode: Inference - Network: VGG19 - Device: OpenCL TITAN RTX RTX 2080 Ti RTX 2080 GTX 1080 Ti RTX 2070 RTX 2060 GTX 1080 GTX 1070 Ti GTX 1070 GTX 980 Ti RX Vega 64 RX Vega 56 GTX 980 GTX 1060 RX 590 RX 580 50 100 150 200 250 SE +/- 0.04, N = 3 SE +/- 0.21, N = 3 SE +/- 0.17, N = 3 SE +/- 0.10, N = 3 SE +/- 0.15, N = 3 SE +/- 1.40, N = 3 SE +/- 0.07, N = 3 SE +/- 0.03, N = 3 SE +/- 0.07, N = 3 SE +/- 0.18, N = 3 SE +/- 0.71, N = 3 SE +/- 0.06, N = 3 SE +/- 0.01, N = 3 SE +/- 0.06, N = 3 SE +/- 0.38, N = 3 SE +/- 0.06, N = 3 220.89 207.30 161.16 159.02 148.93 121.98 115.90 108.85 105.77 104.74 103.93 91.32 83.19 79.29 53.85 51.59
PlaidML FP16: No - Mode: Training - Network: IMDB LSTM - Device: OpenCL OpenBenchmarking.org Examples Per Second, More Is Better PlaidML FP16: No - Mode: Training - Network: IMDB LSTM - Device: OpenCL RTX 2080 Ti TITAN RTX RTX 2080 RX Vega 64 GTX 1080 Ti RTX 2070 RX Vega 56 RTX 2060 GTX 1080 GTX 1070 GTX 1070 Ti RX 590 GTX 980 Ti GTX 1060 RX 580 GTX 980 40 80 120 160 200 SE +/- 1.21, N = 3 SE +/- 1.98, N = 3 SE +/- 1.03, N = 3 SE +/- 0.49, N = 3 SE +/- 0.42, N = 3 SE +/- 1.14, N = 3 SE +/- 0.44, N = 3 SE +/- 0.59, N = 3 SE +/- 0.45, N = 3 SE +/- 0.09, N = 3 SE +/- 0.09, N = 3 SE +/- 1.06, N = 3 SE +/- 0.66, N = 3 SE +/- 0.30, N = 3 SE +/- 1.28, N = 3 SE +/- 0.08, N = 3 192 191 175 169 165 164 164 157 142 135 133 133 122 119 119 108
PlaidML FP16: No - Mode: Training - Network: Mobilenet - Device: OpenCL OpenBenchmarking.org Examples Per Second, More Is Better PlaidML FP16: No - Mode: Training - Network: Mobilenet - Device: OpenCL TITAN RTX RTX 2080 Ti RTX 2080 RTX 2070 GTX 1080 Ti RTX 2060 GTX 1070 GTX 1070 Ti GTX 1080 GTX 980 Ti GTX 1060 GTX 980 RX Vega 64 RX Vega 56 RX 590 RX 580 30 60 90 120 150 SE +/- 0.40, N = 3 SE +/- 0.32, N = 3 SE +/- 0.24, N = 3 SE +/- 0.13, N = 3 SE +/- 0.14, N = 3 SE +/- 0.12, N = 3 SE +/- 0.04, N = 3 SE +/- 0.19, N = 3 SE +/- 0.17, N = 3 SE +/- 0.19, N = 3 SE +/- 0.01, N = 3 SE +/- 0.03, N = 3 SE +/- 0.13, N = 3 SE +/- 0.15, N = 3 SE +/- 0.03, N = 3 SE +/- 0.03, N = 3 142.36 138.11 120.24 119.84 113.55 103.30 98.45 95.52 94.47 83.66 81.65 78.47 75.23 71.29 45.21 41.64
PlaidML FP16: No - Mode: Inference - Network: IMDB LSTM - Device: OpenCL OpenBenchmarking.org Examples Per Second, More Is Better PlaidML FP16: No - Mode: Inference - Network: IMDB LSTM - Device: OpenCL TITAN RTX RTX 2080 Ti RTX 2080 RTX 2070 RTX 2060 GTX 1080 Ti GTX 1080 RX Vega 64 RX Vega 56 GTX 1070 GTX 1070 Ti RX 590 RX 580 GTX 1060 GTX 980 Ti GTX 980 120 240 360 480 600 SE +/- 0.33, N = 3 SE +/- 1.04, N = 3 SE +/- 1.05, N = 3 SE +/- 1.24, N = 3 SE +/- 0.23, N = 3 SE +/- 0.26, N = 3 SE +/- 0.99, N = 3 SE +/- 0.02, N = 3 SE +/- 0.14, N = 3 SE +/- 0.54, N = 3 SE +/- 0.09, N = 3 SE +/- 1.28, N = 3 SE +/- 0.68, N = 3 SE +/- 0.26, N = 3 SE +/- 0.33, N = 3 SE +/- 0.37, N = 3 535 525 418 356 324 298 247 240 240 218 215 205 182 175 174 155
PlaidML FP16: No - Mode: Inference - Network: Mobilenet - Device: OpenCL OpenBenchmarking.org Examples Per Second, More Is Better PlaidML FP16: No - Mode: Inference - Network: Mobilenet - Device: OpenCL TITAN RTX RTX 2080 Ti RTX 2080 RTX 2070 GTX 1080 Ti RTX 2060 GTX 1080 GTX 1070 Ti GTX 1070 RX Vega 64 RX Vega 56 GTX 1060 GTX 980 Ti GTX 980 RX 590 RX 580 200 400 600 800 1000 SE +/- 1.87, N = 3 SE +/- 9.03, N = 3 SE +/- 3.51, N = 3 SE +/- 2.10, N = 3 SE +/- 4.02, N = 3 SE +/- 1.48, N = 3 SE +/- 0.30, N = 3 SE +/- 0.56, N = 3 SE +/- 2.92, N = 3 SE +/- 11.08, N = 12 SE +/- 5.93, N = 3 SE +/- 0.64, N = 3 SE +/- 2.78, N = 3 SE +/- 1.99, N = 3 SE +/- 0.16, N = 3 SE +/- 0.73, N = 3 988 962 794 767 687 671 621 594 593 546 531 485 485 458 424 390
PlaidML FP16: No - Mode: Inference - Network: ResNet 50 - Device: OpenCL OpenBenchmarking.org Examples Per Second, More Is Better PlaidML FP16: No - Mode: Inference - Network: ResNet 50 - Device: OpenCL TITAN RTX RTX 2080 Ti RTX 2080 RTX 2070 GTX 1080 Ti RTX 2060 GTX 1080 GTX 1070 Ti GTX 1070 RX Vega 64 RX Vega 56 GTX 980 Ti GTX 1060 GTX 980 RX 590 RX 580 110 220 330 440 550 SE +/- 0.22, N = 3 SE +/- 4.66, N = 3 SE +/- 0.08, N = 3 SE +/- 0.35, N = 3 SE +/- 0.05, N = 3 SE +/- 0.35, N = 3 SE +/- 0.28, N = 3 SE +/- 0.51, N = 3 SE +/- 1.62, N = 3 SE +/- 4.02, N = 3 SE +/- 1.86, N = 3 SE +/- 0.34, N = 3 SE +/- 0.15, N = 3 SE +/- 0.53, N = 3 SE +/- 0.64, N = 3 SE +/- 0.49, N = 3 499 478 373 351 315 293 275 249 241 226 213 199 187 172 139 131
PlaidML FP16: Yes - Mode: Inference - Network: Mobilenet - Device: OpenCL OpenBenchmarking.org Examples Per Second, More Is Better PlaidML FP16: Yes - Mode: Inference - Network: Mobilenet - Device: OpenCL TITAN RTX RTX 2080 Ti RTX 2080 GTX 1080 Ti RTX 2060 RTX 2070 GTX 1080 RX Vega 64 RX Vega 56 GTX 1070 GTX 1070 Ti RX 590 RX 580 GTX 1060 GTX 980 Ti GTX 980 150 300 450 600 750 SE +/- 5.84, N = 3 SE +/- 1.64, N = 3 SE +/- 6.97, N = 12 SE +/- 5.47, N = 3 SE +/- 7.50, N = 6 SE +/- 6.98, N = 3 SE +/- 4.10, N = 3 SE +/- 0.64, N = 3 SE +/- 0.30, N = 3 SE +/- 1.57, N = 3 SE +/- 8.00, N = 4 SE +/- 0.50, N = 3 SE +/- 1.39, N = 3 SE +/- 5.36, N = 3 SE +/- 2.96, N = 3 SE +/- 4.97, N = 3 698 695 612 555 538 533 510 481 480 476 473 455 435 426 421 407
PlaidML FP16: Yes - Mode: Inference - Network: ResNet 50 - Device: OpenCL OpenBenchmarking.org Examples Per Second, More Is Better PlaidML FP16: Yes - Mode: Inference - Network: ResNet 50 - Device: OpenCL TITAN RTX RTX 2080 Ti RTX 2080 RTX 2070 GTX 1080 Ti RTX 2060 GTX 1080 GTX 1070 Ti GTX 1070 RX Vega 64 GTX 980 Ti RX Vega 56 GTX 980 GTX 1060 RX 590 RX 580 90 180 270 360 450 SE +/- 0.23, N = 3 SE +/- 0.30, N = 3 SE +/- 0.43, N = 3 SE +/- 0.17, N = 3 SE +/- 0.73, N = 3 SE +/- 6.28, N = 11 SE +/- 0.31, N = 3 SE +/- 0.17, N = 3 SE +/- 0.06, N = 3 SE +/- 0.88, N = 3 SE +/- 0.23, N = 3 SE +/- 0.02, N = 3 SE +/- 0.19, N = 3 SE +/- 2.69, N = 3 SE +/- 0.04, N = 3 SE +/- 0.32, N = 3 428 417 330 311 311 259 248 226 221 212 199 192 175 173 129 121
PlaidML FP16: No - Mode: Training - Network: Inception V3 - Device: OpenCL OpenBenchmarking.org Examples Per Second, More Is Better PlaidML FP16: No - Mode: Training - Network: Inception V3 - Device: OpenCL RTX 2080 Ti TITAN RTX GTX 1080 Ti RTX 2080 RTX 2070 GTX 1080 GTX 1070 GTX 1070 Ti GTX 1060 RX Vega 64 RX Vega 56 RX 590 RX 580 9 18 27 36 45 SE +/- 0.14, N = 3 SE +/- 0.29, N = 3 SE +/- 0.03, N = 3 SE +/- 0.07, N = 3 SE +/- 0.05, N = 3 SE +/- 0.02, N = 3 SE +/- 0.02, N = 3 SE +/- 0.10, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.04, N = 3 SE +/- 0.03, N = 3 37.67 37.41 33.10 32.80 31.44 28.44 26.21 26.00 21.58 20.98 19.86 14.59 13.15
PlaidML FP16: No - Mode: Inference - Network: DenseNet 201 - Device: OpenCL OpenBenchmarking.org Examples Per Second, More Is Better PlaidML FP16: No - Mode: Inference - Network: DenseNet 201 - Device: OpenCL TITAN RTX RTX 2080 Ti GTX 1080 Ti RTX 2080 RTX 2070 RX Vega 64 RTX 2060 RX Vega 56 GTX 1080 GTX 1070 GTX 1070 Ti GTX 980 Ti RX 590 GTX 980 RX 580 GTX 1060 40 80 120 160 200 SE +/- 0.42, N = 3 SE +/- 2.09, N = 3 SE +/- 0.13, N = 3 SE +/- 0.13, N = 3 SE +/- 0.11, N = 3 SE +/- 0.03, N = 3 SE +/- 0.04, N = 3 SE +/- 0.02, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.04, N = 3 SE +/- 0.11, N = 3 SE +/- 0.02, N = 3 SE +/- 0.04, N = 3 SE +/- 0.08, N = 3 SE +/- 0.00, N = 3 161.32 150.01 119.80 118.65 115.65 106.44 95.88 95.87 90.83 83.89 83.55 78.88 67.50 63.96 62.34 62.27
PlaidML FP16: No - Mode: Inference - Network: Inception V3 - Device: OpenCL OpenBenchmarking.org Examples Per Second, More Is Better PlaidML FP16: No - Mode: Inference - Network: Inception V3 - Device: OpenCL TITAN RTX RTX 2080 Ti RTX 2080 GTX 1080 Ti RTX 2070 RTX 2060 GTX 1080 RX Vega 64 GTX 1070 Ti GTX 1070 RX Vega 56 GTX 980 Ti GTX 1060 GTX 980 RX 590 RX 580 50 100 150 200 250 SE +/- 0.31, N = 3 SE +/- 3.98, N = 12 SE +/- 0.12, N = 3 SE +/- 0.42, N = 3 SE +/- 0.61, N = 3 SE +/- 1.89, N = 3 SE +/- 1.75, N = 12 SE +/- 0.77, N = 3 SE +/- 0.05, N = 3 SE +/- 1.68, N = 5 SE +/- 1.56, N = 3 SE +/- 1.44, N = 5 SE +/- 1.04, N = 7 SE +/- 1.08, N = 3 SE +/- 1.29, N = 3 SE +/- 0.95, N = 3 211.69 197.56 161.94 158.20 147.39 124.84 124.65 118.00 113.61 108.50 104.00 96.69 82.03 81.03 71.42 66.19
PlaidML FP16: No - Mode: Inference - Network: NASNer Large - Device: OpenCL OpenBenchmarking.org Examples Per Second, More Is Better PlaidML FP16: No - Mode: Inference - Network: NASNer Large - Device: OpenCL TITAN RTX RTX 2080 Ti GTX 1080 Ti RTX 2080 RTX 2070 RX Vega 64 RX Vega 56 GTX 1080 RTX 2060 GTX 1070 Ti GTX 1070 GTX 980 Ti RX 590 GTX 980 GTX 1060 RX 580 13 26 39 52 65 SE +/- 0.10, N = 3 SE +/- 0.11, N = 3 SE +/- 0.10, N = 3 SE +/- 0.06, N = 3 SE +/- 0.07, N = 3 SE +/- 0.13, N = 3 SE +/- 0.02, N = 3 SE +/- 0.02, N = 3 SE +/- 0.04, N = 3 SE +/- 0.00, N = 3 SE +/- 0.03, N = 3 SE +/- 0.03, N = 3 SE +/- 0.01, N = 3 SE +/- 0.05, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 59.13 56.77 42.75 41.57 36.01 35.89 31.08 30.92 29.42 26.57 25.31 24.32 20.01 18.89 18.27 18.08
PlaidML FP16: Yes - Mode: Inference - Network: DenseNet 201 - Device: OpenCL OpenBenchmarking.org Examples Per Second, More Is Better PlaidML FP16: Yes - Mode: Inference - Network: DenseNet 201 - Device: OpenCL TITAN RTX RTX 2080 Ti GTX 1080 Ti RTX 2080 RTX 2070 RTX 2060 GTX 1080 GTX 1070 GTX 1070 Ti GTX 980 Ti GTX 980 GTX 1060 30 60 90 120 150 SE +/- 2.16, N = 3 SE +/- 1.79, N = 7 SE +/- 0.11, N = 3 SE +/- 0.10, N = 3 SE +/- 0.17, N = 3 SE +/- 0.18, N = 3 SE +/- 0.02, N = 3 SE +/- 0.06, N = 3 SE +/- 0.03, N = 3 SE +/- 0.09, N = 3 SE +/- 0.03, N = 3 SE +/- 0.02, N = 3 148.00 139.00 114.97 111.00 108.00 89.02 85.60 79.08 78.45 76.15 61.38 58.76
PlaidML FP16: Yes - Mode: Inference - Network: Inception V3 - Device: OpenCL OpenBenchmarking.org Examples Per Second, More Is Better PlaidML FP16: Yes - Mode: Inference - Network: Inception V3 - Device: OpenCL TITAN RTX RTX 2080 Ti GTX 1080 Ti RTX 2080 RTX 2070 GTX 1080 RTX 2060 GTX 1070 Ti GTX 1070 GTX 980 Ti GTX 980 GTX 1060 40 80 120 160 200 SE +/- 0.41, N = 3 SE +/- 3.75, N = 12 SE +/- 0.55, N = 3 SE +/- 2.75, N = 12 SE +/- 2.27, N = 12 SE +/- 0.17, N = 3 SE +/- 2.35, N = 3 SE +/- 1.45, N = 7 SE +/- 0.16, N = 3 SE +/- 1.04, N = 12 SE +/- 0.15, N = 3 SE +/- 0.27, N = 3 203.00 192.00 160.18 153.00 142.00 130.00 126.00 114.33 112.31 104.10 89.26 86.75
PlaidML FP16: Yes - Mode: Inference - Network: NASNer Large - Device: OpenCL OpenBenchmarking.org Examples Per Second, More Is Better PlaidML FP16: Yes - Mode: Inference - Network: NASNer Large - Device: OpenCL TITAN RTX RTX 2080 Ti RTX 2080 GTX 1080 Ti RTX 2070 RTX 2060 GTX 1080 GTX 1070 Ti GTX 1070 GTX 980 Ti GTX 980 GTX 1060 16 32 48 64 80 SE +/- 0.16, N = 3 SE +/- 0.89, N = 3 SE +/- 0.06, N = 3 SE +/- 0.08, N = 3 SE +/- 0.09, N = 3 SE +/- 0.07, N = 3 SE +/- 0.10, N = 3 SE +/- 0.06, N = 3 SE +/- 0.03, N = 3 SE +/- 0.04, N = 3 SE +/- 0.08, N = 3 SE +/- 0.02, N = 3 72.61 69.70 51.54 47.63 44.34 37.60 37.02 32.65 30.20 26.90 23.22 22.17
Phoronix Test Suite v10.8.4