PlaidML OpenCL Linux GPU Benchmarks AMD Radeon + NVIDIA GeForce

PlaidML Linux benchmarks for a future article on Phoronix.com by Michael Larabel.

Compare your own system(s) to this result file with the Phoronix Test Suite by running the command: phoronix-test-suite benchmark 1901122-PTS-PLAIDMLG16
Jump To Table - Results

View

Do Not Show Noisy Results
Do Not Show Results With Incomplete Data
Do Not Show Results With Little Change/Spread
List Notable Results

Statistics

Show Overall Harmonic Mean(s)
Show Overall Geometric Mean
Show Wins / Losses Counts (Pie Chart)
Normalize Results
Remove Outliers Before Calculating Averages

Graph Settings

Force Line Graphs Where Applicable
Convert To Scalar Where Applicable
Disable Color Branding
Prefer Vertical Bar Graphs

Multi-Way Comparison

Condense Multi-Option Tests Into Single Result Graphs

Table

Show Detailed System Result Table

Run Management

Highlight
Result
Hide
Result
Result
Identifier
Performance Per
Dollar
Date
Run
  Test
  Duration
RX 580
January 10 2019
  1 Hour, 18 Minutes
RX 590
January 11 2019
  1 Hour, 18 Minutes
RX Vega 56
January 10 2019
  53 Minutes
RX Vega 64
January 10 2019
  53 Minutes
GTX 980
January 12 2019
  37 Minutes
GTX 980 Ti
January 12 2019
  45 Minutes
GTX 1060
January 11 2019
  52 Minutes
GTX 1070
January 11 2019
  47 Minutes
GTX 1070 Ti
January 11 2019
  47 Minutes
GTX 1080
January 11 2019
  50 Minutes
GTX 1080 Ti
January 12 2019
  37 Minutes
RTX 2060
January 11 2019
  31 Minutes
RTX 2070
January 11 2019
  41 Minutes
RTX 2080
January 11 2019
  43 Minutes
RTX 2080 Ti
January 11 2019
  44 Minutes
TITAN RTX
January 11 2019
  35 Minutes
Invert Hiding All Results Option
  48 Minutes

Only show results where is faster than
Only show results matching title/arguments (delimit multiple options with a comma):
Do not show results matching title/arguments (delimit multiple options with a comma):


PlaidML OpenCL Linux GPU Benchmarks AMD Radeon + NVIDIA GeForceProcessorMotherboardChipsetMemoryDiskGraphicsAudioMonitorNetworkOSKernelDesktopDisplay ServerDisplay DriverOpenGLCompilerFile-SystemScreen ResolutionVulkanRX 580RX 590RX Vega 56RX Vega 64GTX 980GTX 980 TiGTX 1060GTX 1070GTX 1070 TiGTX 1080GTX 1080 TiRTX 2060RTX 2070RTX 2080RTX 2080 TiTITAN RTXAMD Ryzen Threadripper 2990WX 32-Core @ 3.00GHz (32 Cores / 64 Threads)ASUS ROG ZENITH EXTREME (1601 BIOS)AMD Family 17h32768MBSamsung SSD 970 EVO 500GBMSI AMD Radeon RX 470/480/570/570X/580/580X 8GB (1366/2000MHz)Realtek ALC1220ASUS VP28UIntel I211 Gigabit + Qualcomm Atheros QCA6174 802.11ac + Wilocity Wil6200 802.11adUbuntu 18.104.19.0-041900-generic (x86_64)GNOME Shell 3.30.1X Server 1.20.1modesetting 1.20.14.5 Mesa 18.2.2 (LLVM 7.0.0)GCC 8.2.0ext43840x2160Sapphire AMD Radeon RX 470/480/570/570X/580/580X 8GB (1560/2100MHz)4.20.0-042000-generic (x86_64)AMD Radeon RX 64 8GB (1590/800MHz)4.19.0-041900-generic (x86_64)amdgpu 18.1.0AMD Radeon RX 64 8GB (1630/945MHz)NVIDIA GeForce GTX 980 4GB (1126/3505MHz)Intel I211 + Qualcomm Atheros QCA6174 802.11ac + Wilocity Wil6200 802.11ad4.20.0-042000-generic (x86_64)NVIDIA 415.254.6.01.1.84NVIDIA GeForce GTX 980 Ti 6GB (999/3505MHz)NVIDIA GeForce GTX 1060 6GB (1506/4006MHz)NVIDIA GeForce GTX 1070 8GB (1506/4006MHz)Zotac NVIDIA GeForce GTX 1070 Ti 8GB (1607/4006MHz)NVIDIA GeForce GTX 1080 8GB (1607/5005MHz)NVIDIA GeForce GTX 1080 Ti 11GB (1480/5508MHz)Device 6GB (1365/7000MHz)ASUS NVIDIA GeForce RTX 2070 8GB (1410/7000MHz)Zotac NVIDIA GeForce RTX 2080 8GB (1515/7000MHz)NVIDIA GeForce RTX 2080 Ti 11GB (1350/7000MHz)Intel I211 Gigabit + Qualcomm Atheros QCA6174 802.11ac + Wilocity Wil6200 802.11adNVIDIA TITAN RTX 24GB (1350/7000MHz)Intel I211 + Qualcomm Atheros QCA6174 802.11ac + Wilocity Wil6200 802.11adOpenBenchmarking.orgProcessor Details- Scaling Governor: acpi-cpufreq ondemandGraphics Details- RX 580, RX 590, RX Vega 56, RX Vega 64: GLAMORPython Details- Python 2.7.15+ + Python 3.6.7Security Details- RX 580: __user pointer sanitization + Full AMD retpoline IBPB + SSB disabled via prctl and seccomp- RX 590: __user pointer sanitization + Full AMD retpoline IBPB: conditional STIBP: disabled RSB filling + SSB disabled via prctl and seccomp- RX Vega 56: __user pointer sanitization + Full AMD retpoline IBPB + SSB disabled via prctl and seccomp- RX Vega 64: __user pointer sanitization + Full AMD retpoline IBPB + SSB disabled via prctl and seccomp- GTX 980: __user pointer sanitization + Full AMD retpoline IBPB: conditional STIBP: disabled RSB filling + SSB disabled via prctl and seccomp- GTX 980 Ti: __user pointer sanitization + Full AMD retpoline IBPB: conditional STIBP: disabled RSB filling + SSB disabled via prctl and seccomp- GTX 1060: __user pointer sanitization + Full AMD retpoline IBPB: conditional STIBP: disabled RSB filling + SSB disabled via prctl and seccomp- GTX 1070: __user pointer sanitization + Full AMD retpoline IBPB: conditional STIBP: disabled RSB filling + SSB disabled via prctl and seccomp- GTX 1070 Ti: __user pointer sanitization + Full AMD retpoline IBPB: conditional STIBP: disabled RSB filling + SSB disabled via prctl and seccomp- GTX 1080: __user pointer sanitization + Full AMD retpoline IBPB: conditional STIBP: disabled RSB filling + SSB disabled via prctl and seccomp- GTX 1080 Ti: __user pointer sanitization + Full AMD retpoline IBPB: conditional STIBP: disabled RSB filling + SSB disabled via prctl and seccomp- RTX 2060: __user pointer sanitization + Full AMD retpoline IBPB: conditional STIBP: disabled RSB filling + SSB disabled via prctl and seccomp- RTX 2070: __user pointer sanitization + Full AMD retpoline IBPB: conditional STIBP: disabled RSB filling + SSB disabled via prctl and seccomp- RTX 2080: __user pointer sanitization + Full AMD retpoline IBPB: conditional STIBP: disabled RSB filling + SSB disabled via prctl and seccomp- RTX 2080 Ti: __user pointer sanitization + Full AMD retpoline IBPB: conditional STIBP: disabled RSB filling + SSB disabled via prctl and seccomp- TITAN RTX: __user pointer sanitization + Full AMD retpoline IBPB: conditional STIBP: disabled RSB filling + SSB disabled via prctl and seccompOpenCL Details- GTX 980: GPU Compute Cores: 2048- GTX 980 Ti: GPU Compute Cores: 2816- GTX 1060: GPU Compute Cores: 1280- GTX 1070: GPU Compute Cores: 1920- GTX 1070 Ti: GPU Compute Cores: 2432- GTX 1080: GPU Compute Cores: 2560- GTX 1080 Ti: GPU Compute Cores: 3584- RTX 2060: GPU Compute Cores: 1920- RTX 2070: GPU Compute Cores: 2304- RTX 2080: GPU Compute Cores: 2944- RTX 2080 Ti: GPU Compute Cores: 4352- TITAN RTX: GPU Compute Cores: 4608

RX 580RX 590RX Vega 56RX Vega 64GTX 980GTX 980 TiGTX 1060GTX 1070GTX 1070 TiGTX 1080GTX 1080 TiRTX 2060RTX 2070RTX 2080RTX 2080 TiTITAN RTXResult OverviewPhoronix Test Suite100%183%265%348%430%PlaidMLPlaidMLPlaidMLPlaidMLPlaidMLPlaidMLPlaidMLPlaidMLPlaidMLPlaidMLPlaidMLPlaidMLPlaidMLPlaidMLNo - Inference - VGG19 - OpenCLYes - Inference - VGG19 - OpenCLNo - Inference - VGG16 - OpenCLYes - Inference - VGG16 - OpenCLNo - Inference - ResNet 50 - OpenCLYes - Inference - ResNet 50 - OpenCLNo - Inference - IMDB LSTM - OpenCLNo - Training - Mobilenet - OpenCLNo - Inference - NASNer Large - OpenCLNo - Inference - Inception V3 - OpenCLNo - Inference - DenseNet 201 - OpenCLNo - Inference - Mobilenet - OpenCLNo - Training - IMDB LSTM - OpenCLYes - Inference - Mobilenet - OpenCL

PlaidML OpenCL Linux GPU Benchmarks AMD Radeon + NVIDIA GeForceplaidml: No - Training - VGG16 - OpenCLplaidml: No - Training - VGG19 - OpenCLplaidml: No - Inference - VGG16 - OpenCLplaidml: No - Inference - VGG19 - OpenCLplaidml: Yes - Inference - VGG16 - OpenCLplaidml: Yes - Inference - VGG19 - OpenCLplaidml: No - Training - IMDB LSTM - OpenCLplaidml: No - Training - Mobilenet - OpenCLplaidml: No - Inference - IMDB LSTM - OpenCLplaidml: No - Inference - Mobilenet - OpenCLplaidml: No - Inference - ResNet 50 - OpenCLplaidml: Yes - Inference - Mobilenet - OpenCLplaidml: Yes - Inference - ResNet 50 - OpenCLplaidml: No - Training - Inception V3 - OpenCLplaidml: No - Inference - DenseNet 201 - OpenCLplaidml: No - Inference - Inception V3 - OpenCLplaidml: No - Inference - NASNer Large - OpenCLplaidml: Yes - Inference - DenseNet 201 - OpenCLplaidml: Yes - Inference - Inception V3 - OpenCLplaidml: Yes - Inference - NASNer Large - OpenCLRX 580RX 590RX Vega 56RX Vega 64GTX 980GTX 980 TiGTX 1060GTX 1070GTX 1070 TiGTX 1080GTX 1080 TiRTX 2060RTX 2070RTX 2080RTX 2080 TiTITAN RTX10.429.6764.5555.2658.9251.5911941.6418239013143512113.1562.3466.1918.089.528.9267.7158.3161.6553.8513345.2120542413945512914.5967.5071.4220.0128.7825.6610994.4110791.3216471.2924053121348019219.8695.8710431.0830.8528.15123107.32120103.9316975.2324054622648121220.98106.4411835.8994.8480.3796.8283.1910878.4715545817240717563.9681.0318.8961.3889.2623.2240.14119.20101.40121.68104.7412283.6617448519942119978.8896.6924.3276.15104.1026.9034.0793.0078.1392.1979.2911981.6517548518742617321.5862.2782.0318.2758.7686.7522.1745.9739.22125.37106.35122.54105.7713598.4521859324147622126.2183.89108.5025.3179.08112.3130.2046.7340.33128.85109.40125.60108.8513395.5221559424947322626.0083.55113.6126.5778.45114.3332.6550.0942.92138.78117.24134.68115.9014294.4724762127551024828.4490.83124.6530.9285.6013037.0266.5557.60181.25156.28180.71159.02165113.5529868731555531133.10119.80158.2042.75114.97160.1847.63147.16124.18143.80121.98157103.3032467129353825995.88124.8429.4289.0212637.6063.7154.76183.95155.08172.84148.93164119.8435676735153331131.44115.65147.3936.0110814244.3467.5958.55197.52168.53185.76161.16175120.2441879437361233032.80118.65161.9441.5711115351.5485.4574.75258.50221.88236.13207.30192138.1152596247869541737.67150.01197.5656.7713919269.7090.8479.58274.89237.71250.30220.89191142.3653598849969842837.41161.32211.6959.1314820372.61OpenBenchmarking.org

PlaidML

This test profile uses PlaidML deep learning framework for offering up various benchmarks. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgExamples Per Second, More Is BetterPlaidMLFP16: No - Mode: Training - Network: VGG16 - Device: OpenCLTITAN RTXRTX 2080 TiRTX 2080GTX 1080 TiRTX 2070GTX 1080GTX 1070 TiGTX 1070GTX 980 TiGTX 1060RX Vega 64RX Vega 56RX 580RX 59020406080100SE +/- 0.18, N = 3SE +/- 0.13, N = 3SE +/- 0.26, N = 3SE +/- 0.15, N = 3SE +/- 0.21, N = 3SE +/- 0.04, N = 3SE +/- 0.05, N = 3SE +/- 0.06, N = 3SE +/- 0.28, N = 3SE +/- 0.04, N = 3SE +/- 0.13, N = 3SE +/- 0.02, N = 3SE +/- 0.00, N = 3SE +/- 0.01, N = 390.8485.4567.5966.5563.7150.0946.7345.9740.1434.0730.8528.7810.429.52
OpenBenchmarking.orgExamples Per Second, More Is BetterPlaidMLFP16: No - Mode: Training - Network: VGG16 - Device: OpenCLTITAN RTXRTX 2080 TiRTX 2080GTX 1080 TiRTX 2070GTX 1080GTX 1070 TiGTX 1070GTX 980 TiGTX 1060RX Vega 64RX Vega 56RX 580RX 59020406080100Min: 90.57 / Avg: 90.84 / Max: 91.19Min: 85.3 / Avg: 85.45 / Max: 85.7Min: 67.17 / Avg: 67.59 / Max: 68.06Min: 66.32 / Avg: 66.55 / Max: 66.82Min: 63.39 / Avg: 63.71 / Max: 64.09Min: 50.02 / Avg: 50.09 / Max: 50.15Min: 46.63 / Avg: 46.73 / Max: 46.78Min: 45.88 / Avg: 45.97 / Max: 46.09Min: 39.58 / Avg: 40.14 / Max: 40.43Min: 34.03 / Avg: 34.07 / Max: 34.15Min: 30.61 / Avg: 30.85 / Max: 31.04Min: 28.76 / Avg: 28.78 / Max: 28.82Min: 10.41 / Avg: 10.42 / Max: 10.43Min: 9.51 / Avg: 9.52 / Max: 9.52

OpenBenchmarking.orgExamples Per Second, More Is BetterPlaidMLFP16: No - Mode: Training - Network: VGG19 - Device: OpenCLTITAN RTXRTX 2080 TiRTX 2080GTX 1080 TiRTX 2070GTX 1080GTX 1070 TiGTX 1070RX Vega 64RX Vega 56RX 580RX 59020406080100SE +/- 0.16, N = 3SE +/- 0.09, N = 3SE +/- 0.07, N = 3SE +/- 0.07, N = 3SE +/- 0.12, N = 3SE +/- 0.08, N = 3SE +/- 0.03, N = 3SE +/- 0.07, N = 3SE +/- 0.02, N = 3SE +/- 0.19, N = 3SE +/- 0.00, N = 3SE +/- 0.01, N = 379.5874.7558.5557.6054.7642.9240.3339.2228.1525.669.678.92
OpenBenchmarking.orgExamples Per Second, More Is BetterPlaidMLFP16: No - Mode: Training - Network: VGG19 - Device: OpenCLTITAN RTXRTX 2080 TiRTX 2080GTX 1080 TiRTX 2070GTX 1080GTX 1070 TiGTX 1070RX Vega 64RX Vega 56RX 580RX 5901530456075Min: 79.41 / Avg: 79.58 / Max: 79.9Min: 74.64 / Avg: 74.75 / Max: 74.92Min: 58.46 / Avg: 58.55 / Max: 58.69Min: 57.49 / Avg: 57.6 / Max: 57.72Min: 54.63 / Avg: 54.76 / Max: 55.01Min: 42.82 / Avg: 42.92 / Max: 43.08Min: 40.27 / Avg: 40.33 / Max: 40.38Min: 39.09 / Avg: 39.22 / Max: 39.33Min: 28.11 / Avg: 28.15 / Max: 28.17Min: 25.31 / Avg: 25.66 / Max: 25.95Min: 9.67 / Avg: 9.67 / Max: 9.68Min: 8.9 / Avg: 8.92 / Max: 8.92

OpenBenchmarking.orgExamples Per Second, More Is BetterPlaidMLFP16: No - Mode: Inference - Network: VGG16 - Device: OpenCLTITAN RTXRTX 2080 TiRTX 2080RTX 2070GTX 1080 TiRTX 2060GTX 1080GTX 1070 TiGTX 1070RX Vega 64GTX 980 TiRX Vega 56GTX 980GTX 1060RX 590RX 58060120180240300SE +/- 1.45, N = 3SE +/- 0.25, N = 3SE +/- 0.14, N = 3SE +/- 0.03, N = 3SE +/- 0.45, N = 3SE +/- 0.18, N = 3SE +/- 0.09, N = 3SE +/- 0.06, N = 3SE +/- 0.40, N = 3SE +/- 1.73, N = 3SE +/- 0.14, N = 3SE +/- 0.77, N = 3SE +/- 0.06, N = 3SE +/- 0.06, N = 3SE +/- 0.51, N = 3SE +/- 0.03, N = 3274.89258.50197.52183.95181.25147.16138.78128.85125.37123.00119.20109.0094.8493.0067.7164.55
OpenBenchmarking.orgExamples Per Second, More Is BetterPlaidMLFP16: No - Mode: Inference - Network: VGG16 - Device: OpenCLTITAN RTXRTX 2080 TiRTX 2080RTX 2070GTX 1080 TiRTX 2060GTX 1080GTX 1070 TiGTX 1070RX Vega 64GTX 980 TiRX Vega 56GTX 980GTX 1060RX 590RX 58050100150200250Min: 272 / Avg: 274.89 / Max: 276.54Min: 258.23 / Avg: 258.5 / Max: 259Min: 197.29 / Avg: 197.52 / Max: 197.78Min: 183.91 / Avg: 183.95 / Max: 184.01Min: 180.38 / Avg: 181.25 / Max: 181.85Min: 146.96 / Avg: 147.16 / Max: 147.53Min: 138.62 / Avg: 138.78 / Max: 138.92Min: 128.75 / Avg: 128.85 / Max: 128.96Min: 124.57 / Avg: 125.37 / Max: 125.78Min: 120.86 / Avg: 122.61 / Max: 126.08Min: 118.99 / Avg: 119.2 / Max: 119.45Min: 107.54 / Avg: 108.73 / Max: 110.16Min: 94.72 / Avg: 94.84 / Max: 94.91Min: 92.93 / Avg: 93 / Max: 93.12Min: 66.7 / Avg: 67.71 / Max: 68.23Min: 64.5 / Avg: 64.55 / Max: 64.61

OpenBenchmarking.orgExamples Per Second, More Is BetterPlaidMLFP16: No - Mode: Inference - Network: VGG19 - Device: OpenCLTITAN RTXRTX 2080 TiRTX 2080GTX 1080 TiRTX 2070RTX 2060GTX 1080GTX 1070 TiRX Vega 64GTX 1070GTX 980 TiRX Vega 56GTX 980GTX 1060RX 590RX 58050100150200250SE +/- 0.16, N = 3SE +/- 0.15, N = 3SE +/- 0.12, N = 3SE +/- 0.11, N = 3SE +/- 0.13, N = 3SE +/- 0.08, N = 3SE +/- 0.03, N = 3SE +/- 0.03, N = 3SE +/- 0.89, N = 3SE +/- 0.00, N = 3SE +/- 0.19, N = 3SE +/- 1.43, N = 4SE +/- 0.07, N = 3SE +/- 0.01, N = 3SE +/- 0.34, N = 3SE +/- 0.06, N = 3237.71221.88168.53156.28155.08124.18117.24109.40107.32106.35101.4094.4180.3778.1358.3155.26
OpenBenchmarking.orgExamples Per Second, More Is BetterPlaidMLFP16: No - Mode: Inference - Network: VGG19 - Device: OpenCLTITAN RTXRTX 2080 TiRTX 2080GTX 1080 TiRTX 2070RTX 2060GTX 1080GTX 1070 TiRX Vega 64GTX 1070GTX 980 TiRX Vega 56GTX 980GTX 1060RX 590RX 5804080120160200Min: 237.51 / Avg: 237.71 / Max: 238.04Min: 221.61 / Avg: 221.88 / Max: 222.14Min: 168.34 / Avg: 168.53 / Max: 168.76Min: 156.06 / Avg: 156.28 / Max: 156.44Min: 154.9 / Avg: 155.08 / Max: 155.34Min: 124.06 / Avg: 124.18 / Max: 124.33Min: 117.19 / Avg: 117.24 / Max: 117.31Min: 109.35 / Avg: 109.4 / Max: 109.45Min: 106.21 / Avg: 107.32 / Max: 109.09Min: 106.34 / Avg: 106.35 / Max: 106.35Min: 101.03 / Avg: 101.4 / Max: 101.65Min: 90.88 / Avg: 94.41 / Max: 97.23Min: 80.29 / Avg: 80.37 / Max: 80.52Min: 78.11 / Avg: 78.13 / Max: 78.16Min: 57.62 / Avg: 58.31 / Max: 58.67Min: 55.16 / Avg: 55.26 / Max: 55.36

OpenBenchmarking.orgExamples Per Second, More Is BetterPlaidMLFP16: Yes - Mode: Inference - Network: VGG16 - Device: OpenCLTITAN RTXRTX 2080 TiRTX 2080GTX 1080 TiRTX 2070RTX 2060GTX 1080GTX 1070 TiGTX 1070GTX 980 TiRX Vega 64RX Vega 56GTX 980GTX 1060RX 590RX 58050100150200250SE +/- 0.14, N = 3SE +/- 1.48, N = 3SE +/- 0.06, N = 3SE +/- 0.26, N = 3SE +/- 0.05, N = 3SE +/- 0.02, N = 3SE +/- 0.05, N = 3SE +/- 0.36, N = 3SE +/- 0.04, N = 3SE +/- 0.07, N = 3SE +/- 0.39, N = 3SE +/- 0.06, N = 3SE +/- 0.00, N = 3SE +/- 0.82, N = 3SE +/- 0.27, N = 3SE +/- 0.06, N = 3250.30236.13185.76180.71172.84143.80134.68125.60122.54121.68120.00107.0096.8292.1961.6558.92
OpenBenchmarking.orgExamples Per Second, More Is BetterPlaidMLFP16: Yes - Mode: Inference - Network: VGG16 - Device: OpenCLTITAN RTXRTX 2080 TiRTX 2080GTX 1080 TiRTX 2070RTX 2060GTX 1080GTX 1070 TiGTX 1070GTX 980 TiRX Vega 64RX Vega 56GTX 980GTX 1060RX 590RX 58050100150200250Min: 250.02 / Avg: 250.3 / Max: 250.45Min: 233.18 / Avg: 236.13 / Max: 237.68Min: 185.63 / Avg: 185.76 / Max: 185.83Min: 180.23 / Avg: 180.71 / Max: 181.14Min: 172.79 / Avg: 172.84 / Max: 172.93Min: 143.76 / Avg: 143.8 / Max: 143.84Min: 134.61 / Avg: 134.68 / Max: 134.77Min: 124.88 / Avg: 125.6 / Max: 126Min: 122.47 / Avg: 122.54 / Max: 122.6Min: 121.55 / Avg: 121.68 / Max: 121.8Min: 118.82 / Avg: 119.6 / Max: 119.99Min: 106.47 / Avg: 106.53 / Max: 106.66Min: 96.82 / Avg: 96.82 / Max: 96.83Min: 90.55 / Avg: 92.19 / Max: 93.05Min: 61.17 / Avg: 61.65 / Max: 62.09Min: 58.84 / Avg: 58.92 / Max: 59.05

OpenBenchmarking.orgExamples Per Second, More Is BetterPlaidMLFP16: Yes - Mode: Inference - Network: VGG19 - Device: OpenCLTITAN RTXRTX 2080 TiRTX 2080GTX 1080 TiRTX 2070RTX 2060GTX 1080GTX 1070 TiGTX 1070GTX 980 TiRX Vega 64RX Vega 56GTX 980GTX 1060RX 590RX 58050100150200250SE +/- 0.04, N = 3SE +/- 0.21, N = 3SE +/- 0.17, N = 3SE +/- 0.10, N = 3SE +/- 0.15, N = 3SE +/- 1.40, N = 3SE +/- 0.07, N = 3SE +/- 0.03, N = 3SE +/- 0.07, N = 3SE +/- 0.18, N = 3SE +/- 0.71, N = 3SE +/- 0.06, N = 3SE +/- 0.01, N = 3SE +/- 0.06, N = 3SE +/- 0.38, N = 3SE +/- 0.06, N = 3220.89207.30161.16159.02148.93121.98115.90108.85105.77104.74103.9391.3283.1979.2953.8551.59
OpenBenchmarking.orgExamples Per Second, More Is BetterPlaidMLFP16: Yes - Mode: Inference - Network: VGG19 - Device: OpenCLTITAN RTXRTX 2080 TiRTX 2080GTX 1080 TiRTX 2070RTX 2060GTX 1080GTX 1070 TiGTX 1070GTX 980 TiRX Vega 64RX Vega 56GTX 980GTX 1060RX 590RX 5804080120160200Min: 220.81 / Avg: 220.89 / Max: 220.95Min: 206.9 / Avg: 207.3 / Max: 207.64Min: 160.94 / Avg: 161.16 / Max: 161.5Min: 158.82 / Avg: 159.02 / Max: 159.16Min: 148.71 / Avg: 148.93 / Max: 149.21Min: 119.18 / Avg: 121.98 / Max: 123.41Min: 115.77 / Avg: 115.9 / Max: 115.99Min: 108.78 / Avg: 108.85 / Max: 108.89Min: 105.65 / Avg: 105.77 / Max: 105.89Min: 104.39 / Avg: 104.74 / Max: 104.99Min: 102.56 / Avg: 103.93 / Max: 104.91Min: 91.22 / Avg: 91.32 / Max: 91.43Min: 83.17 / Avg: 83.19 / Max: 83.21Min: 79.2 / Avg: 79.29 / Max: 79.41Min: 53.19 / Avg: 53.85 / Max: 54.52Min: 51.46 / Avg: 51.59 / Max: 51.66

OpenBenchmarking.orgExamples Per Second, More Is BetterPlaidMLFP16: No - Mode: Training - Network: IMDB LSTM - Device: OpenCLRTX 2080 TiTITAN RTXRTX 2080RX Vega 64GTX 1080 TiRTX 2070RX Vega 56RTX 2060GTX 1080GTX 1070GTX 1070 TiRX 590GTX 980 TiGTX 1060RX 580GTX 9804080120160200SE +/- 1.21, N = 3SE +/- 1.98, N = 3SE +/- 1.03, N = 3SE +/- 0.49, N = 3SE +/- 0.42, N = 3SE +/- 1.14, N = 3SE +/- 0.44, N = 3SE +/- 0.59, N = 3SE +/- 0.45, N = 3SE +/- 0.09, N = 3SE +/- 0.09, N = 3SE +/- 1.06, N = 3SE +/- 0.66, N = 3SE +/- 0.30, N = 3SE +/- 1.28, N = 3SE +/- 0.08, N = 3192191175169165164164157142135133133122119119108
OpenBenchmarking.orgExamples Per Second, More Is BetterPlaidMLFP16: No - Mode: Training - Network: IMDB LSTM - Device: OpenCLRTX 2080 TiTITAN RTXRTX 2080RX Vega 64GTX 1080 TiRTX 2070RX Vega 56RTX 2060GTX 1080GTX 1070GTX 1070 TiRX 590GTX 980 TiGTX 1060RX 580GTX 9804080120160200Min: 189.41 / Avg: 191.82 / Max: 193.17Min: 186.93 / Avg: 190.69 / Max: 193.64Min: 173.1 / Avg: 175.14 / Max: 176.46Min: 167.76 / Avg: 168.75 / Max: 169.28Min: 164.13 / Avg: 164.78 / Max: 165.55Min: 161.94 / Avg: 163.91 / Max: 165.88Min: 163.32 / Avg: 163.93 / Max: 164.8Min: 155.98 / Avg: 156.77 / Max: 157.92Min: 140.93 / Avg: 141.69 / Max: 142.5Min: 134.44 / Avg: 134.58 / Max: 134.75Min: 132.67 / Avg: 132.77 / Max: 132.95Min: 130.97 / Avg: 133.05 / Max: 134.39Min: 120.71 / Avg: 121.72 / Max: 122.95Min: 118.63 / Avg: 119.05 / Max: 119.63Min: 116.71 / Avg: 119.27 / Max: 120.67Min: 107.8 / Avg: 107.9 / Max: 108.06

OpenBenchmarking.orgExamples Per Second, More Is BetterPlaidMLFP16: No - Mode: Training - Network: Mobilenet - Device: OpenCLTITAN RTXRTX 2080 TiRTX 2080RTX 2070GTX 1080 TiRTX 2060GTX 1070GTX 1070 TiGTX 1080GTX 980 TiGTX 1060GTX 980RX Vega 64RX Vega 56RX 590RX 580306090120150SE +/- 0.40, N = 3SE +/- 0.32, N = 3SE +/- 0.24, N = 3SE +/- 0.13, N = 3SE +/- 0.14, N = 3SE +/- 0.12, N = 3SE +/- 0.04, N = 3SE +/- 0.19, N = 3SE +/- 0.17, N = 3SE +/- 0.19, N = 3SE +/- 0.01, N = 3SE +/- 0.03, N = 3SE +/- 0.13, N = 3SE +/- 0.15, N = 3SE +/- 0.03, N = 3SE +/- 0.03, N = 3142.36138.11120.24119.84113.55103.3098.4595.5294.4783.6681.6578.4775.2371.2945.2141.64
OpenBenchmarking.orgExamples Per Second, More Is BetterPlaidMLFP16: No - Mode: Training - Network: Mobilenet - Device: OpenCLTITAN RTXRTX 2080 TiRTX 2080RTX 2070GTX 1080 TiRTX 2060GTX 1070GTX 1070 TiGTX 1080GTX 980 TiGTX 1060GTX 980RX Vega 64RX Vega 56RX 590RX 580306090120150Min: 141.96 / Avg: 142.36 / Max: 143.15Min: 137.46 / Avg: 138.11 / Max: 138.48Min: 119.77 / Avg: 120.24 / Max: 120.51Min: 119.59 / Avg: 119.84 / Max: 120.03Min: 113.33 / Avg: 113.55 / Max: 113.81Min: 103.09 / Avg: 103.3 / Max: 103.51Min: 98.39 / Avg: 98.45 / Max: 98.52Min: 95.2 / Avg: 95.52 / Max: 95.85Min: 94.27 / Avg: 94.47 / Max: 94.8Min: 83.36 / Avg: 83.66 / Max: 84Min: 81.64 / Avg: 81.65 / Max: 81.66Min: 78.42 / Avg: 78.47 / Max: 78.5Min: 74.98 / Avg: 75.23 / Max: 75.43Min: 71.06 / Avg: 71.29 / Max: 71.58Min: 45.15 / Avg: 45.21 / Max: 45.26Min: 41.6 / Avg: 41.64 / Max: 41.7

OpenBenchmarking.orgExamples Per Second, More Is BetterPlaidMLFP16: No - Mode: Inference - Network: IMDB LSTM - Device: OpenCLTITAN RTXRTX 2080 TiRTX 2080RTX 2070RTX 2060GTX 1080 TiGTX 1080RX Vega 64RX Vega 56GTX 1070GTX 1070 TiRX 590RX 580GTX 1060GTX 980 TiGTX 980120240360480600SE +/- 0.33, N = 3SE +/- 1.04, N = 3SE +/- 1.05, N = 3SE +/- 1.24, N = 3SE +/- 0.23, N = 3SE +/- 0.26, N = 3SE +/- 0.99, N = 3SE +/- 0.02, N = 3SE +/- 0.14, N = 3SE +/- 0.54, N = 3SE +/- 0.09, N = 3SE +/- 1.28, N = 3SE +/- 0.68, N = 3SE +/- 0.26, N = 3SE +/- 0.33, N = 3SE +/- 0.37, N = 3535525418356324298247240240218215205182175174155
OpenBenchmarking.orgExamples Per Second, More Is BetterPlaidMLFP16: No - Mode: Inference - Network: IMDB LSTM - Device: OpenCLTITAN RTXRTX 2080 TiRTX 2080RTX 2070RTX 2060GTX 1080 TiGTX 1080RX Vega 64RX Vega 56GTX 1070GTX 1070 TiRX 590RX 580GTX 1060GTX 980 TiGTX 98090180270360450Min: 534.04 / Avg: 534.69 / Max: 535.14Min: 523.33 / Avg: 525.27 / Max: 526.88Min: 415.85 / Avg: 417.86 / Max: 419.38Min: 353.29 / Avg: 355.67 / Max: 357.5Min: 323.76 / Avg: 324.16 / Max: 324.54Min: 297.64 / Avg: 298.11 / Max: 298.54Min: 245.93 / Avg: 247.4 / Max: 249.28Min: 240.02 / Avg: 240.05 / Max: 240.1Min: 239.51 / Avg: 239.65 / Max: 239.92Min: 216.83 / Avg: 217.66 / Max: 218.66Min: 214.93 / Avg: 215.11 / Max: 215.23Min: 202.53 / Avg: 204.83 / Max: 206.95Min: 180.53 / Avg: 181.78 / Max: 182.84Min: 174.54 / Avg: 174.91 / Max: 175.41Min: 172.95 / Avg: 173.57 / Max: 174.1Min: 154.5 / Avg: 155.12 / Max: 155.76

OpenBenchmarking.orgExamples Per Second, More Is BetterPlaidMLFP16: No - Mode: Inference - Network: Mobilenet - Device: OpenCLTITAN RTXRTX 2080 TiRTX 2080RTX 2070GTX 1080 TiRTX 2060GTX 1080GTX 1070 TiGTX 1070RX Vega 64RX Vega 56GTX 1060GTX 980 TiGTX 980RX 590RX 5802004006008001000SE +/- 1.87, N = 3SE +/- 9.03, N = 3SE +/- 3.51, N = 3SE +/- 2.10, N = 3SE +/- 4.02, N = 3SE +/- 1.48, N = 3SE +/- 0.30, N = 3SE +/- 0.56, N = 3SE +/- 2.92, N = 3SE +/- 11.08, N = 12SE +/- 5.93, N = 3SE +/- 0.64, N = 3SE +/- 2.78, N = 3SE +/- 1.99, N = 3SE +/- 0.16, N = 3SE +/- 0.73, N = 3988962794767687671621594593546531485485458424390
OpenBenchmarking.orgExamples Per Second, More Is BetterPlaidMLFP16: No - Mode: Inference - Network: Mobilenet - Device: OpenCLTITAN RTXRTX 2080 TiRTX 2080RTX 2070GTX 1080 TiRTX 2060GTX 1080GTX 1070 TiGTX 1070RX Vega 64RX Vega 56GTX 1060GTX 980 TiGTX 980RX 590RX 5802004006008001000Min: 984.02 / Avg: 987.68 / Max: 990.14Min: 944.44 / Avg: 962.46 / Max: 972.36Min: 787.94 / Avg: 794.27 / Max: 800.04Min: 764.26 / Avg: 767.48 / Max: 771.42Min: 682.81 / Avg: 687.08 / Max: 695.11Min: 668.46 / Avg: 671.34 / Max: 673.35Min: 621.01 / Avg: 621.36 / Max: 621.96Min: 593.07 / Avg: 594.18 / Max: 594.86Min: 589.01 / Avg: 593.11 / Max: 598.77Min: 481.03 / Avg: 545.94 / Max: 613.95Min: 521.51 / Avg: 530.93 / Max: 541.88Min: 483.69 / Avg: 484.83 / Max: 485.92Min: 481 / Avg: 484.95 / Max: 490.32Min: 453.78 / Avg: 457.51 / Max: 460.57Min: 424.03 / Avg: 424.23 / Max: 424.54Min: 389.42 / Avg: 390.19 / Max: 391.65

OpenBenchmarking.orgExamples Per Second, More Is BetterPlaidMLFP16: No - Mode: Inference - Network: ResNet 50 - Device: OpenCLTITAN RTXRTX 2080 TiRTX 2080RTX 2070GTX 1080 TiRTX 2060GTX 1080GTX 1070 TiGTX 1070RX Vega 64RX Vega 56GTX 980 TiGTX 1060GTX 980RX 590RX 580110220330440550SE +/- 0.22, N = 3SE +/- 4.66, N = 3SE +/- 0.08, N = 3SE +/- 0.35, N = 3SE +/- 0.05, N = 3SE +/- 0.35, N = 3SE +/- 0.28, N = 3SE +/- 0.51, N = 3SE +/- 1.62, N = 3SE +/- 4.02, N = 3SE +/- 1.86, N = 3SE +/- 0.34, N = 3SE +/- 0.15, N = 3SE +/- 0.53, N = 3SE +/- 0.64, N = 3SE +/- 0.49, N = 3499478373351315293275249241226213199187172139131
OpenBenchmarking.orgExamples Per Second, More Is BetterPlaidMLFP16: No - Mode: Inference - Network: ResNet 50 - Device: OpenCLTITAN RTXRTX 2080 TiRTX 2080RTX 2070GTX 1080 TiRTX 2060GTX 1080GTX 1070 TiGTX 1070RX Vega 64RX Vega 56GTX 980 TiGTX 1060GTX 980RX 590RX 58090180270360450Min: 498.54 / Avg: 498.95 / Max: 499.3Min: 468.71 / Avg: 477.9 / Max: 483.85Min: 372.98 / Avg: 373.08 / Max: 373.23Min: 350.24 / Avg: 350.68 / Max: 351.38Min: 314.91 / Avg: 314.97 / Max: 315.07Min: 292.41 / Avg: 293.1 / Max: 293.54Min: 275.2 / Avg: 275.49 / Max: 276.05Min: 248.88 / Avg: 249.43 / Max: 250.45Min: 238.31 / Avg: 241.31 / Max: 243.87Min: 218.09 / Avg: 226.07 / Max: 230.8Min: 209.03 / Avg: 212.72 / Max: 215.05Min: 197.99 / Avg: 198.55 / Max: 199.17Min: 187.21 / Avg: 187.38 / Max: 187.67Min: 170.81 / Avg: 171.87 / Max: 172.41Min: 138.08 / Avg: 138.88 / Max: 140.14Min: 129.61 / Avg: 130.59 / Max: 131.14

OpenBenchmarking.orgExamples Per Second, More Is BetterPlaidMLFP16: Yes - Mode: Inference - Network: Mobilenet - Device: OpenCLTITAN RTXRTX 2080 TiRTX 2080GTX 1080 TiRTX 2060RTX 2070GTX 1080RX Vega 64RX Vega 56GTX 1070GTX 1070 TiRX 590RX 580GTX 1060GTX 980 TiGTX 980150300450600750SE +/- 5.84, N = 3SE +/- 1.64, N = 3SE +/- 6.97, N = 12SE +/- 5.47, N = 3SE +/- 7.50, N = 6SE +/- 6.98, N = 3SE +/- 4.10, N = 3SE +/- 0.64, N = 3SE +/- 0.30, N = 3SE +/- 1.57, N = 3SE +/- 8.00, N = 4SE +/- 0.50, N = 3SE +/- 1.39, N = 3SE +/- 5.36, N = 3SE +/- 2.96, N = 3SE +/- 4.97, N = 3698695612555538533510481480476473455435426421407
OpenBenchmarking.orgExamples Per Second, More Is BetterPlaidMLFP16: Yes - Mode: Inference - Network: Mobilenet - Device: OpenCLTITAN RTXRTX 2080 TiRTX 2080GTX 1080 TiRTX 2060RTX 2070GTX 1080RX Vega 64RX Vega 56GTX 1070GTX 1070 TiRX 590RX 580GTX 1060GTX 980 TiGTX 980120240360480600Min: 686.09 / Avg: 697.54 / Max: 705.24Min: 692.49 / Avg: 694.72 / Max: 697.91Min: 588.63 / Avg: 611.54 / Max: 659.5Min: 543.87 / Avg: 554.81 / Max: 560.66Min: 519.27 / Avg: 538.23 / Max: 568.52Min: 520.24 / Avg: 532.63 / Max: 544.4Min: 501.95 / Avg: 509.88 / Max: 515.62Min: 480.06 / Avg: 481.28 / Max: 482.18Min: 479.17 / Avg: 479.78 / Max: 480.1Min: 472.58 / Avg: 475.72 / Max: 477.47Min: 456.19 / Avg: 473.42 / Max: 493.34Min: 454.38 / Avg: 455.07 / Max: 456.05Min: 432.75 / Avg: 435.25 / Max: 437.56Min: 414.95 / Avg: 425.54 / Max: 432.25Min: 415.83 / Avg: 420.97 / Max: 426.07Min: 400.68 / Avg: 407.08 / Max: 416.86

OpenBenchmarking.orgExamples Per Second, More Is BetterPlaidMLFP16: Yes - Mode: Inference - Network: ResNet 50 - Device: OpenCLTITAN RTXRTX 2080 TiRTX 2080RTX 2070GTX 1080 TiRTX 2060GTX 1080GTX 1070 TiGTX 1070RX Vega 64GTX 980 TiRX Vega 56GTX 980GTX 1060RX 590RX 58090180270360450SE +/- 0.23, N = 3SE +/- 0.30, N = 3SE +/- 0.43, N = 3SE +/- 0.17, N = 3SE +/- 0.73, N = 3SE +/- 6.28, N = 11SE +/- 0.31, N = 3SE +/- 0.17, N = 3SE +/- 0.06, N = 3SE +/- 0.88, N = 3SE +/- 0.23, N = 3SE +/- 0.02, N = 3SE +/- 0.19, N = 3SE +/- 2.69, N = 3SE +/- 0.04, N = 3SE +/- 0.32, N = 3428417330311311259248226221212199192175173129121
OpenBenchmarking.orgExamples Per Second, More Is BetterPlaidMLFP16: Yes - Mode: Inference - Network: ResNet 50 - Device: OpenCLTITAN RTXRTX 2080 TiRTX 2080RTX 2070GTX 1080 TiRTX 2060GTX 1080GTX 1070 TiGTX 1070RX Vega 64GTX 980 TiRX Vega 56GTX 980GTX 1060RX 590RX 58080160240320400Min: 427.82 / Avg: 428.25 / Max: 428.61Min: 416.12 / Avg: 416.71 / Max: 417.01Min: 329.66 / Avg: 330.33 / Max: 331.14Min: 311.02 / Avg: 311.35 / Max: 311.6Min: 309.41 / Avg: 310.67 / Max: 311.95Min: 196.07 / Avg: 258.7 / Max: 265.83Min: 247.79 / Avg: 248.32 / Max: 248.85Min: 226.18 / Avg: 226.4 / Max: 226.73Min: 221.11 / Avg: 221.23 / Max: 221.32Min: 210.32 / Avg: 211.6 / Max: 213.3Min: 198.18 / Avg: 198.51 / Max: 198.95Min: 191.93 / Avg: 191.95 / Max: 191.98Min: 174.35 / Avg: 174.63 / Max: 174.98Min: 167.6 / Avg: 172.99 / Max: 175.75Min: 128.74 / Avg: 128.81 / Max: 128.86Min: 120.23 / Avg: 120.87 / Max: 121.25

OpenBenchmarking.orgExamples Per Second, More Is BetterPlaidMLFP16: No - Mode: Training - Network: Inception V3 - Device: OpenCLRTX 2080 TiTITAN RTXGTX 1080 TiRTX 2080RTX 2070GTX 1080GTX 1070GTX 1070 TiGTX 1060RX Vega 64RX Vega 56RX 590RX 580918273645SE +/- 0.14, N = 3SE +/- 0.29, N = 3SE +/- 0.03, N = 3SE +/- 0.07, N = 3SE +/- 0.05, N = 3SE +/- 0.02, N = 3SE +/- 0.02, N = 3SE +/- 0.10, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.04, N = 3SE +/- 0.03, N = 337.6737.4133.1032.8031.4428.4426.2126.0021.5820.9819.8614.5913.15
OpenBenchmarking.orgExamples Per Second, More Is BetterPlaidMLFP16: No - Mode: Training - Network: Inception V3 - Device: OpenCLRTX 2080 TiTITAN RTXGTX 1080 TiRTX 2080RTX 2070GTX 1080GTX 1070GTX 1070 TiGTX 1060RX Vega 64RX Vega 56RX 590RX 580816243240Min: 37.44 / Avg: 37.67 / Max: 37.92Min: 36.84 / Avg: 37.41 / Max: 37.82Min: 33.05 / Avg: 33.1 / Max: 33.14Min: 32.71 / Avg: 32.8 / Max: 32.94Min: 28.37 / Avg: 28.44 / Max: 28.55Min: 26.18 / Avg: 26.21 / Max: 26.25Min: 25.98 / Avg: 26 / Max: 26.03Min: 21.4 / Avg: 21.58 / Max: 21.72Min: 20.95 / Avg: 20.98 / Max: 20.99Min: 19.85 / Avg: 19.86 / Max: 19.89Min: 14.55 / Avg: 14.59 / Max: 14.67Min: 13.11 / Avg: 13.15 / Max: 13.2

OpenBenchmarking.orgExamples Per Second, More Is BetterPlaidMLFP16: No - Mode: Inference - Network: DenseNet 201 - Device: OpenCLTITAN RTXRTX 2080 TiGTX 1080 TiRTX 2080RTX 2070RX Vega 64RTX 2060RX Vega 56GTX 1080GTX 1070GTX 1070 TiGTX 980 TiRX 590GTX 980RX 580GTX 10604080120160200SE +/- 0.42, N = 3SE +/- 2.09, N = 3SE +/- 0.13, N = 3SE +/- 0.13, N = 3SE +/- 0.11, N = 3SE +/- 0.03, N = 3SE +/- 0.04, N = 3SE +/- 0.02, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.04, N = 3SE +/- 0.11, N = 3SE +/- 0.02, N = 3SE +/- 0.04, N = 3SE +/- 0.08, N = 3SE +/- 0.00, N = 3161.32150.01119.80118.65115.65106.4495.8895.8790.8383.8983.5578.8867.5063.9662.3462.27
OpenBenchmarking.orgExamples Per Second, More Is BetterPlaidMLFP16: No - Mode: Inference - Network: DenseNet 201 - Device: OpenCLTITAN RTXRTX 2080 TiGTX 1080 TiRTX 2080RTX 2070RX Vega 64RTX 2060RX Vega 56GTX 1080GTX 1070GTX 1070 TiGTX 980 TiRX 590GTX 980RX 580GTX 1060306090120150Min: 160.6 / Avg: 161.32 / Max: 162.06Min: 145.82 / Avg: 150.01 / Max: 152.13Min: 119.54 / Avg: 119.8 / Max: 119.97Min: 118.51 / Avg: 118.65 / Max: 118.9Min: 115.46 / Avg: 115.65 / Max: 115.85Min: 106.38 / Avg: 106.44 / Max: 106.47Min: 95.8 / Avg: 95.88 / Max: 95.94Min: 95.84 / Avg: 95.87 / Max: 95.92Min: 90.81 / Avg: 90.83 / Max: 90.86Min: 83.88 / Avg: 83.89 / Max: 83.91Min: 83.48 / Avg: 83.55 / Max: 83.59Min: 78.7 / Avg: 78.88 / Max: 79.09Min: 67.46 / Avg: 67.5 / Max: 67.54Min: 63.88 / Avg: 63.96 / Max: 64.01Min: 62.19 / Avg: 62.34 / Max: 62.43Min: 62.27 / Avg: 62.27 / Max: 62.28

OpenBenchmarking.orgExamples Per Second, More Is BetterPlaidMLFP16: No - Mode: Inference - Network: Inception V3 - Device: OpenCLTITAN RTXRTX 2080 TiRTX 2080GTX 1080 TiRTX 2070RTX 2060GTX 1080RX Vega 64GTX 1070 TiGTX 1070RX Vega 56GTX 980 TiGTX 1060GTX 980RX 590RX 58050100150200250SE +/- 0.31, N = 3SE +/- 3.98, N = 12SE +/- 0.12, N = 3SE +/- 0.42, N = 3SE +/- 0.61, N = 3SE +/- 1.89, N = 3SE +/- 1.75, N = 12SE +/- 0.77, N = 3SE +/- 0.05, N = 3SE +/- 1.68, N = 5SE +/- 1.56, N = 3SE +/- 1.44, N = 5SE +/- 1.04, N = 7SE +/- 1.08, N = 3SE +/- 1.29, N = 3SE +/- 0.95, N = 3211.69197.56161.94158.20147.39124.84124.65118.00113.61108.50104.0096.6982.0381.0371.4266.19
OpenBenchmarking.orgExamples Per Second, More Is BetterPlaidMLFP16: No - Mode: Inference - Network: Inception V3 - Device: OpenCLTITAN RTXRTX 2080 TiRTX 2080GTX 1080 TiRTX 2070RTX 2060GTX 1080RX Vega 64GTX 1070 TiGTX 1070RX Vega 56GTX 980 TiGTX 1060GTX 980RX 590RX 5804080120160200Min: 211.24 / Avg: 211.69 / Max: 212.29Min: 176.08 / Avg: 197.56 / Max: 207.85Min: 161.73 / Avg: 161.94 / Max: 162.16Min: 157.46 / Avg: 158.2 / Max: 158.93Min: 146.5 / Avg: 147.39 / Max: 148.55Min: 121.06 / Avg: 124.84 / Max: 126.92Min: 116.74 / Avg: 124.65 / Max: 131.35Min: 116.45 / Avg: 117.91 / Max: 119.04Min: 113.5 / Avg: 113.61 / Max: 113.66Min: 101.79 / Avg: 108.5 / Max: 110.47Min: 101.28 / Avg: 104.11 / Max: 106.65Min: 91.04 / Avg: 96.69 / Max: 98.59Min: 77.93 / Avg: 82.03 / Max: 83.83Min: 78.91 / Avg: 81.03 / Max: 82.47Min: 69.11 / Avg: 71.42 / Max: 73.56Min: 64.3 / Avg: 66.19 / Max: 67.27

OpenBenchmarking.orgExamples Per Second, More Is BetterPlaidMLFP16: No - Mode: Inference - Network: NASNer Large - Device: OpenCLTITAN RTXRTX 2080 TiGTX 1080 TiRTX 2080RTX 2070RX Vega 64RX Vega 56GTX 1080RTX 2060GTX 1070 TiGTX 1070GTX 980 TiRX 590GTX 980GTX 1060RX 5801326395265SE +/- 0.10, N = 3SE +/- 0.11, N = 3SE +/- 0.10, N = 3SE +/- 0.06, N = 3SE +/- 0.07, N = 3SE +/- 0.13, N = 3SE +/- 0.02, N = 3SE +/- 0.02, N = 3SE +/- 0.04, N = 3SE +/- 0.00, N = 3SE +/- 0.03, N = 3SE +/- 0.03, N = 3SE +/- 0.01, N = 3SE +/- 0.05, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 359.1356.7742.7541.5736.0135.8931.0830.9229.4226.5725.3124.3220.0118.8918.2718.08
OpenBenchmarking.orgExamples Per Second, More Is BetterPlaidMLFP16: No - Mode: Inference - Network: NASNer Large - Device: OpenCLTITAN RTXRTX 2080 TiGTX 1080 TiRTX 2080RTX 2070RX Vega 64RX Vega 56GTX 1080RTX 2060GTX 1070 TiGTX 1070GTX 980 TiRX 590GTX 980GTX 1060RX 5801224364860Min: 59 / Avg: 59.13 / Max: 59.32Min: 56.66 / Avg: 56.77 / Max: 56.98Min: 42.57 / Avg: 42.75 / Max: 42.9Min: 41.49 / Avg: 41.57 / Max: 41.68Min: 35.92 / Avg: 36.01 / Max: 36.14Min: 35.65 / Avg: 35.89 / Max: 36.08Min: 31.05 / Avg: 31.08 / Max: 31.13Min: 30.89 / Avg: 30.92 / Max: 30.97Min: 29.37 / Avg: 29.42 / Max: 29.5Min: 26.56 / Avg: 26.57 / Max: 26.57Min: 25.28 / Avg: 25.31 / Max: 25.37Min: 24.25 / Avg: 24.32 / Max: 24.36Min: 20.01 / Avg: 20.01 / Max: 20.03Min: 18.82 / Avg: 18.89 / Max: 19Min: 18.25 / Avg: 18.27 / Max: 18.29Min: 18.06 / Avg: 18.08 / Max: 18.08

OpenBenchmarking.orgExamples Per Second, More Is BetterPlaidMLFP16: Yes - Mode: Inference - Network: DenseNet 201 - Device: OpenCLTITAN RTXRTX 2080 TiGTX 1080 TiRTX 2080RTX 2070RTX 2060GTX 1080GTX 1070GTX 1070 TiGTX 980 TiGTX 980GTX 1060306090120150SE +/- 2.16, N = 3SE +/- 1.79, N = 7SE +/- 0.11, N = 3SE +/- 0.10, N = 3SE +/- 0.17, N = 3SE +/- 0.18, N = 3SE +/- 0.02, N = 3SE +/- 0.06, N = 3SE +/- 0.03, N = 3SE +/- 0.09, N = 3SE +/- 0.03, N = 3SE +/- 0.02, N = 3148.00139.00114.97111.00108.0089.0285.6079.0878.4576.1561.3858.76
OpenBenchmarking.orgExamples Per Second, More Is BetterPlaidMLFP16: Yes - Mode: Inference - Network: DenseNet 201 - Device: OpenCLTITAN RTXRTX 2080 TiGTX 1080 TiRTX 2080RTX 2070RTX 2060GTX 1080GTX 1070GTX 1070 TiGTX 980 TiGTX 980GTX 1060306090120150Min: 143.57 / Avg: 147.89 / Max: 150.34Min: 128.05 / Avg: 138.73 / Max: 141.26Min: 114.86 / Avg: 114.97 / Max: 115.2Min: 111.12 / Avg: 111.26 / Max: 111.46Min: 108.18 / Avg: 108.37 / Max: 108.7Min: 88.69 / Avg: 89.02 / Max: 89.32Min: 85.58 / Avg: 85.6 / Max: 85.64Min: 78.98 / Avg: 79.08 / Max: 79.18Min: 78.4 / Avg: 78.45 / Max: 78.48Min: 76.01 / Avg: 76.15 / Max: 76.32Min: 61.32 / Avg: 61.38 / Max: 61.44Min: 58.73 / Avg: 58.76 / Max: 58.8

OpenBenchmarking.orgExamples Per Second, More Is BetterPlaidMLFP16: Yes - Mode: Inference - Network: Inception V3 - Device: OpenCLTITAN RTXRTX 2080 TiGTX 1080 TiRTX 2080RTX 2070GTX 1080RTX 2060GTX 1070 TiGTX 1070GTX 980 TiGTX 980GTX 10604080120160200SE +/- 0.41, N = 3SE +/- 3.75, N = 12SE +/- 0.55, N = 3SE +/- 2.75, N = 12SE +/- 2.27, N = 12SE +/- 0.17, N = 3SE +/- 2.35, N = 3SE +/- 1.45, N = 7SE +/- 0.16, N = 3SE +/- 1.04, N = 12SE +/- 0.15, N = 3SE +/- 0.27, N = 3203.00192.00160.18153.00142.00130.00126.00114.33112.31104.1089.2686.75
OpenBenchmarking.orgExamples Per Second, More Is BetterPlaidMLFP16: Yes - Mode: Inference - Network: Inception V3 - Device: OpenCLTITAN RTXRTX 2080 TiGTX 1080 TiRTX 2080RTX 2070GTX 1080RTX 2060GTX 1070 TiGTX 1070GTX 980 TiGTX 980GTX 10604080120160200Min: 201.81 / Avg: 202.62 / Max: 203.14Min: 170.33 / Avg: 192.24 / Max: 201.99Min: 159.36 / Avg: 160.18 / Max: 161.24Min: 140.65 / Avg: 152.61 / Max: 161.23Min: 131.81 / Avg: 142.23 / Max: 148.96Min: 129.37 / Avg: 129.63 / Max: 129.95Min: 121.42 / Avg: 126.11 / Max: 128.68Min: 105.61 / Avg: 114.33 / Max: 115.95Min: 112.02 / Avg: 112.31 / Max: 112.57Min: 95.65 / Avg: 104.1 / Max: 106.64Min: 88.96 / Avg: 89.26 / Max: 89.46Min: 86.21 / Avg: 86.75 / Max: 87.08

OpenBenchmarking.orgExamples Per Second, More Is BetterPlaidMLFP16: Yes - Mode: Inference - Network: NASNer Large - Device: OpenCLTITAN RTXRTX 2080 TiRTX 2080GTX 1080 TiRTX 2070RTX 2060GTX 1080GTX 1070 TiGTX 1070GTX 980 TiGTX 980GTX 10601632486480SE +/- 0.16, N = 3SE +/- 0.89, N = 3SE +/- 0.06, N = 3SE +/- 0.08, N = 3SE +/- 0.09, N = 3SE +/- 0.07, N = 3SE +/- 0.10, N = 3SE +/- 0.06, N = 3SE +/- 0.03, N = 3SE +/- 0.04, N = 3SE +/- 0.08, N = 3SE +/- 0.02, N = 372.6169.7051.5447.6344.3437.6037.0232.6530.2026.9023.2222.17
OpenBenchmarking.orgExamples Per Second, More Is BetterPlaidMLFP16: Yes - Mode: Inference - Network: NASNer Large - Device: OpenCLTITAN RTXRTX 2080 TiRTX 2080GTX 1080 TiRTX 2070RTX 2060GTX 1080GTX 1070 TiGTX 1070GTX 980 TiGTX 980GTX 10601428425670Min: 72.3 / Avg: 72.61 / Max: 72.85Min: 67.94 / Avg: 69.7 / Max: 70.84Min: 51.48 / Avg: 51.54 / Max: 51.65Min: 47.48 / Avg: 47.63 / Max: 47.72Min: 44.24 / Avg: 44.34 / Max: 44.51Min: 37.53 / Avg: 37.6 / Max: 37.73Min: 36.85 / Avg: 37.02 / Max: 37.2Min: 32.54 / Avg: 32.65 / Max: 32.75Min: 30.16 / Avg: 30.2 / Max: 30.26Min: 26.85 / Avg: 26.9 / Max: 26.98Min: 23.1 / Avg: 23.22 / Max: 23.36Min: 22.15 / Avg: 22.17 / Max: 22.21