PlaidML OpenCL Linux GPU Benchmarks AMD Radeon + NVIDIA GeForce

PlaidML Linux benchmarks for a future article on Phoronix.com by Michael Larabel.

Compare your own system(s) to this result file with the Phoronix Test Suite by running the command: phoronix-test-suite benchmark 1901122-PTS-PLAIDMLG16
Jump To Table - Results

View

Do Not Show Noisy Results
Do Not Show Results With Incomplete Data
Do Not Show Results With Little Change/Spread
List Notable Results

Statistics

Show Overall Harmonic Mean(s)
Show Overall Geometric Mean
Show Wins / Losses Counts (Pie Chart)
Normalize Results
Remove Outliers Before Calculating Averages

Graph Settings

Force Line Graphs Where Applicable
Convert To Scalar Where Applicable
Disable Color Branding
Prefer Vertical Bar Graphs

Multi-Way Comparison

Condense Multi-Option Tests Into Single Result Graphs

Table

Show Detailed System Result Table

Run Management

Highlight
Result
Hide
Result
Result
Identifier
Performance Per
Dollar
Date
Run
  Test
  Duration
RX 580
January 10 2019
  1 Hour, 18 Minutes
RX 590
January 11 2019
  1 Hour, 18 Minutes
RX Vega 56
January 10 2019
  53 Minutes
RX Vega 64
January 10 2019
  53 Minutes
GTX 980
January 12 2019
  37 Minutes
GTX 980 Ti
January 12 2019
  45 Minutes
GTX 1060
January 11 2019
  52 Minutes
GTX 1070
January 11 2019
  47 Minutes
GTX 1070 Ti
January 11 2019
  47 Minutes
GTX 1080
January 11 2019
  50 Minutes
GTX 1080 Ti
January 12 2019
  37 Minutes
RTX 2060
January 11 2019
  31 Minutes
RTX 2070
January 11 2019
  41 Minutes
RTX 2080
January 11 2019
  43 Minutes
RTX 2080 Ti
January 11 2019
  44 Minutes
TITAN RTX
January 11 2019
  35 Minutes
Invert Hiding All Results Option
  48 Minutes

Only show results where is faster than
Only show results matching title/arguments (delimit multiple options with a comma):
Do not show results matching title/arguments (delimit multiple options with a comma):


PlaidML OpenCL Linux GPU Benchmarks AMD Radeon + NVIDIA GeForceProcessorMotherboardChipsetMemoryDiskGraphicsAudioMonitorNetworkOSKernelDesktopDisplay ServerDisplay DriverOpenGLCompilerFile-SystemScreen ResolutionVulkanRX 580RX 590RX Vega 56RX Vega 64GTX 980GTX 980 TiGTX 1060GTX 1070GTX 1070 TiGTX 1080GTX 1080 TiRTX 2060RTX 2070RTX 2080RTX 2080 TiTITAN RTXAMD Ryzen Threadripper 2990WX 32-Core @ 3.00GHz (32 Cores / 64 Threads)ASUS ROG ZENITH EXTREME (1601 BIOS)AMD Family 17h32768MBSamsung SSD 970 EVO 500GBMSI AMD Radeon RX 470/480/570/570X/580/580X 8GB (1366/2000MHz)Realtek ALC1220ASUS VP28UIntel I211 Gigabit + Qualcomm Atheros QCA6174 802.11ac + Wilocity Wil6200 802.11adUbuntu 18.104.19.0-041900-generic (x86_64)GNOME Shell 3.30.1X Server 1.20.1modesetting 1.20.14.5 Mesa 18.2.2 (LLVM 7.0.0)GCC 8.2.0ext43840x2160Sapphire AMD Radeon RX 470/480/570/570X/580/580X 8GB (1560/2100MHz)4.20.0-042000-generic (x86_64)AMD Radeon RX 64 8GB (1590/800MHz)4.19.0-041900-generic (x86_64)amdgpu 18.1.0AMD Radeon RX 64 8GB (1630/945MHz)NVIDIA GeForce GTX 980 4GB (1126/3505MHz)Intel I211 + Qualcomm Atheros QCA6174 802.11ac + Wilocity Wil6200 802.11ad4.20.0-042000-generic (x86_64)NVIDIA 415.254.6.01.1.84NVIDIA GeForce GTX 980 Ti 6GB (999/3505MHz)NVIDIA GeForce GTX 1060 6GB (1506/4006MHz)NVIDIA GeForce GTX 1070 8GB (1506/4006MHz)Zotac NVIDIA GeForce GTX 1070 Ti 8GB (1607/4006MHz)NVIDIA GeForce GTX 1080 8GB (1607/5005MHz)NVIDIA GeForce GTX 1080 Ti 11GB (1480/5508MHz)Device 6GB (1365/7000MHz)ASUS NVIDIA GeForce RTX 2070 8GB (1410/7000MHz)Zotac NVIDIA GeForce RTX 2080 8GB (1515/7000MHz)NVIDIA GeForce RTX 2080 Ti 11GB (1350/7000MHz)Intel I211 Gigabit + Qualcomm Atheros QCA6174 802.11ac + Wilocity Wil6200 802.11adNVIDIA TITAN RTX 24GB (1350/7000MHz)Intel I211 + Qualcomm Atheros QCA6174 802.11ac + Wilocity Wil6200 802.11adOpenBenchmarking.orgProcessor Details- Scaling Governor: acpi-cpufreq ondemandGraphics Details- RX 580, RX 590, RX Vega 56, RX Vega 64: GLAMORPython Details- Python 2.7.15+ + Python 3.6.7Security Details- RX 580: __user pointer sanitization + Full AMD retpoline IBPB + SSB disabled via prctl and seccomp- RX 590: __user pointer sanitization + Full AMD retpoline IBPB: conditional STIBP: disabled RSB filling + SSB disabled via prctl and seccomp- RX Vega 56: __user pointer sanitization + Full AMD retpoline IBPB + SSB disabled via prctl and seccomp- RX Vega 64: __user pointer sanitization + Full AMD retpoline IBPB + SSB disabled via prctl and seccomp- GTX 980: __user pointer sanitization + Full AMD retpoline IBPB: conditional STIBP: disabled RSB filling + SSB disabled via prctl and seccomp- GTX 980 Ti: __user pointer sanitization + Full AMD retpoline IBPB: conditional STIBP: disabled RSB filling + SSB disabled via prctl and seccomp- GTX 1060: __user pointer sanitization + Full AMD retpoline IBPB: conditional STIBP: disabled RSB filling + SSB disabled via prctl and seccomp- GTX 1070: __user pointer sanitization + Full AMD retpoline IBPB: conditional STIBP: disabled RSB filling + SSB disabled via prctl and seccomp- GTX 1070 Ti: __user pointer sanitization + Full AMD retpoline IBPB: conditional STIBP: disabled RSB filling + SSB disabled via prctl and seccomp- GTX 1080: __user pointer sanitization + Full AMD retpoline IBPB: conditional STIBP: disabled RSB filling + SSB disabled via prctl and seccomp- GTX 1080 Ti: __user pointer sanitization + Full AMD retpoline IBPB: conditional STIBP: disabled RSB filling + SSB disabled via prctl and seccomp- RTX 2060: __user pointer sanitization + Full AMD retpoline IBPB: conditional STIBP: disabled RSB filling + SSB disabled via prctl and seccomp- RTX 2070: __user pointer sanitization + Full AMD retpoline IBPB: conditional STIBP: disabled RSB filling + SSB disabled via prctl and seccomp- RTX 2080: __user pointer sanitization + Full AMD retpoline IBPB: conditional STIBP: disabled RSB filling + SSB disabled via prctl and seccomp- RTX 2080 Ti: __user pointer sanitization + Full AMD retpoline IBPB: conditional STIBP: disabled RSB filling + SSB disabled via prctl and seccomp- TITAN RTX: __user pointer sanitization + Full AMD retpoline IBPB: conditional STIBP: disabled RSB filling + SSB disabled via prctl and seccompOpenCL Details- GTX 980: GPU Compute Cores: 2048- GTX 980 Ti: GPU Compute Cores: 2816- GTX 1060: GPU Compute Cores: 1280- GTX 1070: GPU Compute Cores: 1920- GTX 1070 Ti: GPU Compute Cores: 2432- GTX 1080: GPU Compute Cores: 2560- GTX 1080 Ti: GPU Compute Cores: 3584- RTX 2060: GPU Compute Cores: 1920- RTX 2070: GPU Compute Cores: 2304- RTX 2080: GPU Compute Cores: 2944- RTX 2080 Ti: GPU Compute Cores: 4352- TITAN RTX: GPU Compute Cores: 4608

RX 580RX 590RX Vega 56RX Vega 64GTX 980GTX 980 TiGTX 1060GTX 1070GTX 1070 TiGTX 1080GTX 1080 TiRTX 2060RTX 2070RTX 2080RTX 2080 TiTITAN RTXResult OverviewPhoronix Test Suite100%183%265%348%430%PlaidMLPlaidMLPlaidMLPlaidMLPlaidMLPlaidMLPlaidMLPlaidMLPlaidMLPlaidMLPlaidMLPlaidMLPlaidMLPlaidMLNo - Inference - VGG19 - OpenCLYes - Inference - VGG19 - OpenCLNo - Inference - VGG16 - OpenCLYes - Inference - VGG16 - OpenCLNo - Inference - ResNet 50 - OpenCLYes - Inference - ResNet 50 - OpenCLNo - Inference - IMDB LSTM - OpenCLNo - Training - Mobilenet - OpenCLNo - Inference - NASNer Large - OpenCLNo - Inference - Inception V3 - OpenCLNo - Inference - DenseNet 201 - OpenCLNo - Inference - Mobilenet - OpenCLNo - Training - IMDB LSTM - OpenCLYes - Inference - Mobilenet - OpenCL

PlaidML OpenCL Linux GPU Benchmarks AMD Radeon + NVIDIA GeForceplaidml: No - Training - VGG16 - OpenCLplaidml: No - Training - VGG19 - OpenCLplaidml: No - Inference - VGG16 - OpenCLplaidml: No - Inference - VGG19 - OpenCLplaidml: Yes - Inference - VGG16 - OpenCLplaidml: Yes - Inference - VGG19 - OpenCLplaidml: No - Training - IMDB LSTM - OpenCLplaidml: No - Training - Mobilenet - OpenCLplaidml: No - Inference - IMDB LSTM - OpenCLplaidml: No - Inference - Mobilenet - OpenCLplaidml: No - Inference - ResNet 50 - OpenCLplaidml: Yes - Inference - Mobilenet - OpenCLplaidml: Yes - Inference - ResNet 50 - OpenCLplaidml: No - Training - Inception V3 - OpenCLplaidml: No - Inference - DenseNet 201 - OpenCLplaidml: No - Inference - Inception V3 - OpenCLplaidml: No - Inference - NASNer Large - OpenCLplaidml: Yes - Inference - DenseNet 201 - OpenCLplaidml: Yes - Inference - Inception V3 - OpenCLplaidml: Yes - Inference - NASNer Large - OpenCLRX 580RX 590RX Vega 56RX Vega 64GTX 980GTX 980 TiGTX 1060GTX 1070GTX 1070 TiGTX 1080GTX 1080 TiRTX 2060RTX 2070RTX 2080RTX 2080 TiTITAN RTX10.429.6764.5555.2658.9251.5911941.6418239013143512113.1562.3466.1918.089.528.9267.7158.3161.6553.8513345.2120542413945512914.5967.5071.4220.0128.7825.6610994.4110791.3216471.2924053121348019219.8695.8710431.0830.8528.15123107.32120103.9316975.2324054622648121220.98106.4411835.8994.8480.3796.8283.1910878.4715545817240717563.9681.0318.8961.3889.2623.2240.14119.20101.40121.68104.7412283.6617448519942119978.8896.6924.3276.15104.1026.9034.0793.0078.1392.1979.2911981.6517548518742617321.5862.2782.0318.2758.7686.7522.1745.9739.22125.37106.35122.54105.7713598.4521859324147622126.2183.89108.5025.3179.08112.3130.2046.7340.33128.85109.40125.60108.8513395.5221559424947322626.0083.55113.6126.5778.45114.3332.6550.0942.92138.78117.24134.68115.9014294.4724762127551024828.4490.83124.6530.9285.6013037.0266.5557.60181.25156.28180.71159.02165113.5529868731555531133.10119.80158.2042.75114.97160.1847.63147.16124.18143.80121.98157103.3032467129353825995.88124.8429.4289.0212637.6063.7154.76183.95155.08172.84148.93164119.8435676735153331131.44115.65147.3936.0110814244.3467.5958.55197.52168.53185.76161.16175120.2441879437361233032.80118.65161.9441.5711115351.5485.4574.75258.50221.88236.13207.30192138.1152596247869541737.67150.01197.5656.7713919269.7090.8479.58274.89237.71250.30220.89191142.3653598849969842837.41161.32211.6959.1314820372.61OpenBenchmarking.org

PlaidML

This test profile uses PlaidML deep learning framework for offering up various benchmarks. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgExamples Per Second, More Is BetterPlaidMLFP16: No - Mode: Training - Network: VGG16 - Device: OpenCLTITAN RTXRX Vega 64RX Vega 56RX 590RX 580RTX 2080 TiRTX 2080RTX 2070GTX 980 TiGTX 1080 TiGTX 1080GTX 1070 TiGTX 1070GTX 106020406080100SE +/- 0.18, N = 3SE +/- 0.13, N = 3SE +/- 0.02, N = 3SE +/- 0.01, N = 3SE +/- 0.00, N = 3SE +/- 0.13, N = 3SE +/- 0.26, N = 3SE +/- 0.21, N = 3SE +/- 0.28, N = 3SE +/- 0.15, N = 3SE +/- 0.04, N = 3SE +/- 0.05, N = 3SE +/- 0.06, N = 3SE +/- 0.04, N = 390.8430.8528.789.5210.4285.4567.5963.7140.1466.5550.0946.7345.9734.07
OpenBenchmarking.orgExamples Per Second, More Is BetterPlaidMLFP16: No - Mode: Training - Network: VGG16 - Device: OpenCLTITAN RTXRX Vega 64RX Vega 56RX 590RX 580RTX 2080 TiRTX 2080RTX 2070GTX 980 TiGTX 1080 TiGTX 1080GTX 1070 TiGTX 1070GTX 106020406080100Min: 90.57 / Avg: 90.84 / Max: 91.19Min: 30.61 / Avg: 30.85 / Max: 31.04Min: 28.76 / Avg: 28.78 / Max: 28.82Min: 9.51 / Avg: 9.52 / Max: 9.52Min: 10.41 / Avg: 10.42 / Max: 10.43Min: 85.3 / Avg: 85.45 / Max: 85.7Min: 67.17 / Avg: 67.59 / Max: 68.06Min: 63.39 / Avg: 63.71 / Max: 64.09Min: 39.58 / Avg: 40.14 / Max: 40.43Min: 66.32 / Avg: 66.55 / Max: 66.82Min: 50.02 / Avg: 50.09 / Max: 50.15Min: 46.63 / Avg: 46.73 / Max: 46.78Min: 45.88 / Avg: 45.97 / Max: 46.09Min: 34.03 / Avg: 34.07 / Max: 34.15

OpenBenchmarking.orgExamples Per Second, More Is BetterPlaidMLFP16: No - Mode: Training - Network: VGG19 - Device: OpenCLTITAN RTXRX Vega 64RX Vega 56RX 590RX 580RTX 2080 TiRTX 2080RTX 2070GTX 1080 TiGTX 1080GTX 1070 TiGTX 107020406080100SE +/- 0.16, N = 3SE +/- 0.02, N = 3SE +/- 0.19, N = 3SE +/- 0.01, N = 3SE +/- 0.00, N = 3SE +/- 0.09, N = 3SE +/- 0.07, N = 3SE +/- 0.12, N = 3SE +/- 0.07, N = 3SE +/- 0.08, N = 3SE +/- 0.03, N = 3SE +/- 0.07, N = 379.5828.1525.668.929.6774.7558.5554.7657.6042.9240.3339.22
OpenBenchmarking.orgExamples Per Second, More Is BetterPlaidMLFP16: No - Mode: Training - Network: VGG19 - Device: OpenCLTITAN RTXRX Vega 64RX Vega 56RX 590RX 580RTX 2080 TiRTX 2080RTX 2070GTX 1080 TiGTX 1080GTX 1070 TiGTX 10701530456075Min: 79.41 / Avg: 79.58 / Max: 79.9Min: 28.11 / Avg: 28.15 / Max: 28.17Min: 25.31 / Avg: 25.66 / Max: 25.95Min: 8.9 / Avg: 8.92 / Max: 8.92Min: 9.67 / Avg: 9.67 / Max: 9.68Min: 74.64 / Avg: 74.75 / Max: 74.92Min: 58.46 / Avg: 58.55 / Max: 58.69Min: 54.63 / Avg: 54.76 / Max: 55.01Min: 57.49 / Avg: 57.6 / Max: 57.72Min: 42.82 / Avg: 42.92 / Max: 43.08Min: 40.27 / Avg: 40.33 / Max: 40.38Min: 39.09 / Avg: 39.22 / Max: 39.33

OpenBenchmarking.orgExamples Per Second, More Is BetterPlaidMLFP16: No - Mode: Inference - Network: VGG16 - Device: OpenCLTITAN RTXRX Vega 64RX Vega 56RX 590RX 580RTX 2080 TiRTX 2080RTX 2070RTX 2060GTX 980 TiGTX 980GTX 1080 TiGTX 1080GTX 1070 TiGTX 1070GTX 106060120180240300SE +/- 1.45, N = 3SE +/- 1.73, N = 3SE +/- 0.77, N = 3SE +/- 0.51, N = 3SE +/- 0.03, N = 3SE +/- 0.25, N = 3SE +/- 0.14, N = 3SE +/- 0.03, N = 3SE +/- 0.18, N = 3SE +/- 0.14, N = 3SE +/- 0.06, N = 3SE +/- 0.45, N = 3SE +/- 0.09, N = 3SE +/- 0.06, N = 3SE +/- 0.40, N = 3SE +/- 0.06, N = 3274.89123.00109.0067.7164.55258.50197.52183.95147.16119.2094.84181.25138.78128.85125.3793.00
OpenBenchmarking.orgExamples Per Second, More Is BetterPlaidMLFP16: No - Mode: Inference - Network: VGG16 - Device: OpenCLTITAN RTXRX Vega 64RX Vega 56RX 590RX 580RTX 2080 TiRTX 2080RTX 2070RTX 2060GTX 980 TiGTX 980GTX 1080 TiGTX 1080GTX 1070 TiGTX 1070GTX 106050100150200250Min: 272 / Avg: 274.89 / Max: 276.54Min: 120.86 / Avg: 122.61 / Max: 126.08Min: 107.54 / Avg: 108.73 / Max: 110.16Min: 66.7 / Avg: 67.71 / Max: 68.23Min: 64.5 / Avg: 64.55 / Max: 64.61Min: 258.23 / Avg: 258.5 / Max: 259Min: 197.29 / Avg: 197.52 / Max: 197.78Min: 183.91 / Avg: 183.95 / Max: 184.01Min: 146.96 / Avg: 147.16 / Max: 147.53Min: 118.99 / Avg: 119.2 / Max: 119.45Min: 94.72 / Avg: 94.84 / Max: 94.91Min: 180.38 / Avg: 181.25 / Max: 181.85Min: 138.62 / Avg: 138.78 / Max: 138.92Min: 128.75 / Avg: 128.85 / Max: 128.96Min: 124.57 / Avg: 125.37 / Max: 125.78Min: 92.93 / Avg: 93 / Max: 93.12

OpenBenchmarking.orgExamples Per Second, More Is BetterPlaidMLFP16: No - Mode: Inference - Network: VGG19 - Device: OpenCLTITAN RTXRX Vega 64RX Vega 56RX 590RX 580RTX 2080 TiRTX 2080RTX 2070RTX 2060GTX 980 TiGTX 980GTX 1080 TiGTX 1080GTX 1070 TiGTX 1070GTX 106050100150200250SE +/- 0.16, N = 3SE +/- 0.89, N = 3SE +/- 1.43, N = 4SE +/- 0.34, N = 3SE +/- 0.06, N = 3SE +/- 0.15, N = 3SE +/- 0.12, N = 3SE +/- 0.13, N = 3SE +/- 0.08, N = 3SE +/- 0.19, N = 3SE +/- 0.07, N = 3SE +/- 0.11, N = 3SE +/- 0.03, N = 3SE +/- 0.03, N = 3SE +/- 0.00, N = 3SE +/- 0.01, N = 3237.71107.3294.4158.3155.26221.88168.53155.08124.18101.4080.37156.28117.24109.40106.3578.13
OpenBenchmarking.orgExamples Per Second, More Is BetterPlaidMLFP16: No - Mode: Inference - Network: VGG19 - Device: OpenCLTITAN RTXRX Vega 64RX Vega 56RX 590RX 580RTX 2080 TiRTX 2080RTX 2070RTX 2060GTX 980 TiGTX 980GTX 1080 TiGTX 1080GTX 1070 TiGTX 1070GTX 10604080120160200Min: 237.51 / Avg: 237.71 / Max: 238.04Min: 106.21 / Avg: 107.32 / Max: 109.09Min: 90.88 / Avg: 94.41 / Max: 97.23Min: 57.62 / Avg: 58.31 / Max: 58.67Min: 55.16 / Avg: 55.26 / Max: 55.36Min: 221.61 / Avg: 221.88 / Max: 222.14Min: 168.34 / Avg: 168.53 / Max: 168.76Min: 154.9 / Avg: 155.08 / Max: 155.34Min: 124.06 / Avg: 124.18 / Max: 124.33Min: 101.03 / Avg: 101.4 / Max: 101.65Min: 80.29 / Avg: 80.37 / Max: 80.52Min: 156.06 / Avg: 156.28 / Max: 156.44Min: 117.19 / Avg: 117.24 / Max: 117.31Min: 109.35 / Avg: 109.4 / Max: 109.45Min: 106.34 / Avg: 106.35 / Max: 106.35Min: 78.11 / Avg: 78.13 / Max: 78.16

OpenBenchmarking.orgExamples Per Second, More Is BetterPlaidMLFP16: Yes - Mode: Inference - Network: VGG16 - Device: OpenCLTITAN RTXRX Vega 64RX Vega 56RX 590RX 580RTX 2080 TiRTX 2080RTX 2070RTX 2060GTX 980 TiGTX 980GTX 1080 TiGTX 1080GTX 1070 TiGTX 1070GTX 106050100150200250SE +/- 0.14, N = 3SE +/- 0.39, N = 3SE +/- 0.06, N = 3SE +/- 0.27, N = 3SE +/- 0.06, N = 3SE +/- 1.48, N = 3SE +/- 0.06, N = 3SE +/- 0.05, N = 3SE +/- 0.02, N = 3SE +/- 0.07, N = 3SE +/- 0.00, N = 3SE +/- 0.26, N = 3SE +/- 0.05, N = 3SE +/- 0.36, N = 3SE +/- 0.04, N = 3SE +/- 0.82, N = 3250.30120.00107.0061.6558.92236.13185.76172.84143.80121.6896.82180.71134.68125.60122.5492.19
OpenBenchmarking.orgExamples Per Second, More Is BetterPlaidMLFP16: Yes - Mode: Inference - Network: VGG16 - Device: OpenCLTITAN RTXRX Vega 64RX Vega 56RX 590RX 580RTX 2080 TiRTX 2080RTX 2070RTX 2060GTX 980 TiGTX 980GTX 1080 TiGTX 1080GTX 1070 TiGTX 1070GTX 106050100150200250Min: 250.02 / Avg: 250.3 / Max: 250.45Min: 118.82 / Avg: 119.6 / Max: 119.99Min: 106.47 / Avg: 106.53 / Max: 106.66Min: 61.17 / Avg: 61.65 / Max: 62.09Min: 58.84 / Avg: 58.92 / Max: 59.05Min: 233.18 / Avg: 236.13 / Max: 237.68Min: 185.63 / Avg: 185.76 / Max: 185.83Min: 172.79 / Avg: 172.84 / Max: 172.93Min: 143.76 / Avg: 143.8 / Max: 143.84Min: 121.55 / Avg: 121.68 / Max: 121.8Min: 96.82 / Avg: 96.82 / Max: 96.83Min: 180.23 / Avg: 180.71 / Max: 181.14Min: 134.61 / Avg: 134.68 / Max: 134.77Min: 124.88 / Avg: 125.6 / Max: 126Min: 122.47 / Avg: 122.54 / Max: 122.6Min: 90.55 / Avg: 92.19 / Max: 93.05

OpenBenchmarking.orgExamples Per Second, More Is BetterPlaidMLFP16: Yes - Mode: Inference - Network: VGG19 - Device: OpenCLTITAN RTXRX Vega 64RX Vega 56RX 590RX 580RTX 2080 TiRTX 2080RTX 2070RTX 2060GTX 980 TiGTX 980GTX 1080 TiGTX 1080GTX 1070 TiGTX 1070GTX 106050100150200250SE +/- 0.04, N = 3SE +/- 0.71, N = 3SE +/- 0.06, N = 3SE +/- 0.38, N = 3SE +/- 0.06, N = 3SE +/- 0.21, N = 3SE +/- 0.17, N = 3SE +/- 0.15, N = 3SE +/- 1.40, N = 3SE +/- 0.18, N = 3SE +/- 0.01, N = 3SE +/- 0.10, N = 3SE +/- 0.07, N = 3SE +/- 0.03, N = 3SE +/- 0.07, N = 3SE +/- 0.06, N = 3220.89103.9391.3253.8551.59207.30161.16148.93121.98104.7483.19159.02115.90108.85105.7779.29
OpenBenchmarking.orgExamples Per Second, More Is BetterPlaidMLFP16: Yes - Mode: Inference - Network: VGG19 - Device: OpenCLTITAN RTXRX Vega 64RX Vega 56RX 590RX 580RTX 2080 TiRTX 2080RTX 2070RTX 2060GTX 980 TiGTX 980GTX 1080 TiGTX 1080GTX 1070 TiGTX 1070GTX 10604080120160200Min: 220.81 / Avg: 220.89 / Max: 220.95Min: 102.56 / Avg: 103.93 / Max: 104.91Min: 91.22 / Avg: 91.32 / Max: 91.43Min: 53.19 / Avg: 53.85 / Max: 54.52Min: 51.46 / Avg: 51.59 / Max: 51.66Min: 206.9 / Avg: 207.3 / Max: 207.64Min: 160.94 / Avg: 161.16 / Max: 161.5Min: 148.71 / Avg: 148.93 / Max: 149.21Min: 119.18 / Avg: 121.98 / Max: 123.41Min: 104.39 / Avg: 104.74 / Max: 104.99Min: 83.17 / Avg: 83.19 / Max: 83.21Min: 158.82 / Avg: 159.02 / Max: 159.16Min: 115.77 / Avg: 115.9 / Max: 115.99Min: 108.78 / Avg: 108.85 / Max: 108.89Min: 105.65 / Avg: 105.77 / Max: 105.89Min: 79.2 / Avg: 79.29 / Max: 79.41

OpenBenchmarking.orgExamples Per Second, More Is BetterPlaidMLFP16: No - Mode: Training - Network: IMDB LSTM - Device: OpenCLTITAN RTXRX Vega 64RX Vega 56RX 590RX 580RTX 2080 TiRTX 2080RTX 2070RTX 2060GTX 980 TiGTX 980GTX 1080 TiGTX 1080GTX 1070 TiGTX 1070GTX 10604080120160200SE +/- 1.98, N = 3SE +/- 0.49, N = 3SE +/- 0.44, N = 3SE +/- 1.06, N = 3SE +/- 1.28, N = 3SE +/- 1.21, N = 3SE +/- 1.03, N = 3SE +/- 1.14, N = 3SE +/- 0.59, N = 3SE +/- 0.66, N = 3SE +/- 0.08, N = 3SE +/- 0.42, N = 3SE +/- 0.45, N = 3SE +/- 0.09, N = 3SE +/- 0.09, N = 3SE +/- 0.30, N = 3191169164133119192175164157122108165142133135119
OpenBenchmarking.orgExamples Per Second, More Is BetterPlaidMLFP16: No - Mode: Training - Network: IMDB LSTM - Device: OpenCLTITAN RTXRX Vega 64RX Vega 56RX 590RX 580RTX 2080 TiRTX 2080RTX 2070RTX 2060GTX 980 TiGTX 980GTX 1080 TiGTX 1080GTX 1070 TiGTX 1070GTX 10604080120160200Min: 186.93 / Avg: 190.69 / Max: 193.64Min: 167.76 / Avg: 168.75 / Max: 169.28Min: 163.32 / Avg: 163.93 / Max: 164.8Min: 130.97 / Avg: 133.05 / Max: 134.39Min: 116.71 / Avg: 119.27 / Max: 120.67Min: 189.41 / Avg: 191.82 / Max: 193.17Min: 173.1 / Avg: 175.14 / Max: 176.46Min: 161.94 / Avg: 163.91 / Max: 165.88Min: 155.98 / Avg: 156.77 / Max: 157.92Min: 120.71 / Avg: 121.72 / Max: 122.95Min: 107.8 / Avg: 107.9 / Max: 108.06Min: 164.13 / Avg: 164.78 / Max: 165.55Min: 140.93 / Avg: 141.69 / Max: 142.5Min: 132.67 / Avg: 132.77 / Max: 132.95Min: 134.44 / Avg: 134.58 / Max: 134.75Min: 118.63 / Avg: 119.05 / Max: 119.63

OpenBenchmarking.orgExamples Per Second, More Is BetterPlaidMLFP16: No - Mode: Training - Network: Mobilenet - Device: OpenCLTITAN RTXRX Vega 64RX Vega 56RX 590RX 580RTX 2080 TiRTX 2080RTX 2070RTX 2060GTX 980 TiGTX 980GTX 1080 TiGTX 1080GTX 1070 TiGTX 1070GTX 1060306090120150SE +/- 0.40, N = 3SE +/- 0.13, N = 3SE +/- 0.15, N = 3SE +/- 0.03, N = 3SE +/- 0.03, N = 3SE +/- 0.32, N = 3SE +/- 0.24, N = 3SE +/- 0.13, N = 3SE +/- 0.12, N = 3SE +/- 0.19, N = 3SE +/- 0.03, N = 3SE +/- 0.14, N = 3SE +/- 0.17, N = 3SE +/- 0.19, N = 3SE +/- 0.04, N = 3SE +/- 0.01, N = 3142.3675.2371.2945.2141.64138.11120.24119.84103.3083.6678.47113.5594.4795.5298.4581.65
OpenBenchmarking.orgExamples Per Second, More Is BetterPlaidMLFP16: No - Mode: Training - Network: Mobilenet - Device: OpenCLTITAN RTXRX Vega 64RX Vega 56RX 590RX 580RTX 2080 TiRTX 2080RTX 2070RTX 2060GTX 980 TiGTX 980GTX 1080 TiGTX 1080GTX 1070 TiGTX 1070GTX 1060306090120150Min: 141.96 / Avg: 142.36 / Max: 143.15Min: 74.98 / Avg: 75.23 / Max: 75.43Min: 71.06 / Avg: 71.29 / Max: 71.58Min: 45.15 / Avg: 45.21 / Max: 45.26Min: 41.6 / Avg: 41.64 / Max: 41.7Min: 137.46 / Avg: 138.11 / Max: 138.48Min: 119.77 / Avg: 120.24 / Max: 120.51Min: 119.59 / Avg: 119.84 / Max: 120.03Min: 103.09 / Avg: 103.3 / Max: 103.51Min: 83.36 / Avg: 83.66 / Max: 84Min: 78.42 / Avg: 78.47 / Max: 78.5Min: 113.33 / Avg: 113.55 / Max: 113.81Min: 94.27 / Avg: 94.47 / Max: 94.8Min: 95.2 / Avg: 95.52 / Max: 95.85Min: 98.39 / Avg: 98.45 / Max: 98.52Min: 81.64 / Avg: 81.65 / Max: 81.66

OpenBenchmarking.orgExamples Per Second, More Is BetterPlaidMLFP16: No - Mode: Inference - Network: IMDB LSTM - Device: OpenCLTITAN RTXRX Vega 64RX Vega 56RX 590RX 580RTX 2080 TiRTX 2080RTX 2070RTX 2060GTX 980 TiGTX 980GTX 1080 TiGTX 1080GTX 1070 TiGTX 1070GTX 1060120240360480600SE +/- 0.33, N = 3SE +/- 0.02, N = 3SE +/- 0.14, N = 3SE +/- 1.28, N = 3SE +/- 0.68, N = 3SE +/- 1.04, N = 3SE +/- 1.05, N = 3SE +/- 1.24, N = 3SE +/- 0.23, N = 3SE +/- 0.33, N = 3SE +/- 0.37, N = 3SE +/- 0.26, N = 3SE +/- 0.99, N = 3SE +/- 0.09, N = 3SE +/- 0.54, N = 3SE +/- 0.26, N = 3535240240205182525418356324174155298247215218175
OpenBenchmarking.orgExamples Per Second, More Is BetterPlaidMLFP16: No - Mode: Inference - Network: IMDB LSTM - Device: OpenCLTITAN RTXRX Vega 64RX Vega 56RX 590RX 580RTX 2080 TiRTX 2080RTX 2070RTX 2060GTX 980 TiGTX 980GTX 1080 TiGTX 1080GTX 1070 TiGTX 1070GTX 106090180270360450Min: 534.04 / Avg: 534.69 / Max: 535.14Min: 240.02 / Avg: 240.05 / Max: 240.1Min: 239.51 / Avg: 239.65 / Max: 239.92Min: 202.53 / Avg: 204.83 / Max: 206.95Min: 180.53 / Avg: 181.78 / Max: 182.84Min: 523.33 / Avg: 525.27 / Max: 526.88Min: 415.85 / Avg: 417.86 / Max: 419.38Min: 353.29 / Avg: 355.67 / Max: 357.5Min: 323.76 / Avg: 324.16 / Max: 324.54Min: 172.95 / Avg: 173.57 / Max: 174.1Min: 154.5 / Avg: 155.12 / Max: 155.76Min: 297.64 / Avg: 298.11 / Max: 298.54Min: 245.93 / Avg: 247.4 / Max: 249.28Min: 214.93 / Avg: 215.11 / Max: 215.23Min: 216.83 / Avg: 217.66 / Max: 218.66Min: 174.54 / Avg: 174.91 / Max: 175.41

OpenBenchmarking.orgExamples Per Second, More Is BetterPlaidMLFP16: No - Mode: Inference - Network: Mobilenet - Device: OpenCLTITAN RTXRX Vega 64RX Vega 56RX 590RX 580RTX 2080 TiRTX 2080RTX 2070RTX 2060GTX 980 TiGTX 980GTX 1080 TiGTX 1080GTX 1070 TiGTX 1070GTX 10602004006008001000SE +/- 1.87, N = 3SE +/- 11.08, N = 12SE +/- 5.93, N = 3SE +/- 0.16, N = 3SE +/- 0.73, N = 3SE +/- 9.03, N = 3SE +/- 3.51, N = 3SE +/- 2.10, N = 3SE +/- 1.48, N = 3SE +/- 2.78, N = 3SE +/- 1.99, N = 3SE +/- 4.02, N = 3SE +/- 0.30, N = 3SE +/- 0.56, N = 3SE +/- 2.92, N = 3SE +/- 0.64, N = 3988546531424390962794767671485458687621594593485
OpenBenchmarking.orgExamples Per Second, More Is BetterPlaidMLFP16: No - Mode: Inference - Network: Mobilenet - Device: OpenCLTITAN RTXRX Vega 64RX Vega 56RX 590RX 580RTX 2080 TiRTX 2080RTX 2070RTX 2060GTX 980 TiGTX 980GTX 1080 TiGTX 1080GTX 1070 TiGTX 1070GTX 10602004006008001000Min: 984.02 / Avg: 987.68 / Max: 990.14Min: 481.03 / Avg: 545.94 / Max: 613.95Min: 521.51 / Avg: 530.93 / Max: 541.88Min: 424.03 / Avg: 424.23 / Max: 424.54Min: 389.42 / Avg: 390.19 / Max: 391.65Min: 944.44 / Avg: 962.46 / Max: 972.36Min: 787.94 / Avg: 794.27 / Max: 800.04Min: 764.26 / Avg: 767.48 / Max: 771.42Min: 668.46 / Avg: 671.34 / Max: 673.35Min: 481 / Avg: 484.95 / Max: 490.32Min: 453.78 / Avg: 457.51 / Max: 460.57Min: 682.81 / Avg: 687.08 / Max: 695.11Min: 621.01 / Avg: 621.36 / Max: 621.96Min: 593.07 / Avg: 594.18 / Max: 594.86Min: 589.01 / Avg: 593.11 / Max: 598.77Min: 483.69 / Avg: 484.83 / Max: 485.92

OpenBenchmarking.orgExamples Per Second, More Is BetterPlaidMLFP16: No - Mode: Inference - Network: ResNet 50 - Device: OpenCLTITAN RTXRX Vega 64RX Vega 56RX 590RX 580RTX 2080 TiRTX 2080RTX 2070RTX 2060GTX 980 TiGTX 980GTX 1080 TiGTX 1080GTX 1070 TiGTX 1070GTX 1060110220330440550SE +/- 0.22, N = 3SE +/- 4.02, N = 3SE +/- 1.86, N = 3SE +/- 0.64, N = 3SE +/- 0.49, N = 3SE +/- 4.66, N = 3SE +/- 0.08, N = 3SE +/- 0.35, N = 3SE +/- 0.35, N = 3SE +/- 0.34, N = 3SE +/- 0.53, N = 3SE +/- 0.05, N = 3SE +/- 0.28, N = 3SE +/- 0.51, N = 3SE +/- 1.62, N = 3SE +/- 0.15, N = 3499226213139131478373351293199172315275249241187
OpenBenchmarking.orgExamples Per Second, More Is BetterPlaidMLFP16: No - Mode: Inference - Network: ResNet 50 - Device: OpenCLTITAN RTXRX Vega 64RX Vega 56RX 590RX 580RTX 2080 TiRTX 2080RTX 2070RTX 2060GTX 980 TiGTX 980GTX 1080 TiGTX 1080GTX 1070 TiGTX 1070GTX 106090180270360450Min: 498.54 / Avg: 498.95 / Max: 499.3Min: 218.09 / Avg: 226.07 / Max: 230.8Min: 209.03 / Avg: 212.72 / Max: 215.05Min: 138.08 / Avg: 138.88 / Max: 140.14Min: 129.61 / Avg: 130.59 / Max: 131.14Min: 468.71 / Avg: 477.9 / Max: 483.85Min: 372.98 / Avg: 373.08 / Max: 373.23Min: 350.24 / Avg: 350.68 / Max: 351.38Min: 292.41 / Avg: 293.1 / Max: 293.54Min: 197.99 / Avg: 198.55 / Max: 199.17Min: 170.81 / Avg: 171.87 / Max: 172.41Min: 314.91 / Avg: 314.97 / Max: 315.07Min: 275.2 / Avg: 275.49 / Max: 276.05Min: 248.88 / Avg: 249.43 / Max: 250.45Min: 238.31 / Avg: 241.31 / Max: 243.87Min: 187.21 / Avg: 187.38 / Max: 187.67

OpenBenchmarking.orgExamples Per Second, More Is BetterPlaidMLFP16: Yes - Mode: Inference - Network: Mobilenet - Device: OpenCLTITAN RTXRX Vega 64RX Vega 56RX 590RX 580RTX 2080 TiRTX 2080RTX 2070RTX 2060GTX 980 TiGTX 980GTX 1080 TiGTX 1080GTX 1070 TiGTX 1070GTX 1060150300450600750SE +/- 5.84, N = 3SE +/- 0.64, N = 3SE +/- 0.30, N = 3SE +/- 0.50, N = 3SE +/- 1.39, N = 3SE +/- 1.64, N = 3SE +/- 6.97, N = 12SE +/- 6.98, N = 3SE +/- 7.50, N = 6SE +/- 2.96, N = 3SE +/- 4.97, N = 3SE +/- 5.47, N = 3SE +/- 4.10, N = 3SE +/- 8.00, N = 4SE +/- 1.57, N = 3SE +/- 5.36, N = 3698481480455435695612533538421407555510473476426
OpenBenchmarking.orgExamples Per Second, More Is BetterPlaidMLFP16: Yes - Mode: Inference - Network: Mobilenet - Device: OpenCLTITAN RTXRX Vega 64RX Vega 56RX 590RX 580RTX 2080 TiRTX 2080RTX 2070RTX 2060GTX 980 TiGTX 980GTX 1080 TiGTX 1080GTX 1070 TiGTX 1070GTX 1060120240360480600Min: 686.09 / Avg: 697.54 / Max: 705.24Min: 480.06 / Avg: 481.28 / Max: 482.18Min: 479.17 / Avg: 479.78 / Max: 480.1Min: 454.38 / Avg: 455.07 / Max: 456.05Min: 432.75 / Avg: 435.25 / Max: 437.56Min: 692.49 / Avg: 694.72 / Max: 697.91Min: 588.63 / Avg: 611.54 / Max: 659.5Min: 520.24 / Avg: 532.63 / Max: 544.4Min: 519.27 / Avg: 538.23 / Max: 568.52Min: 415.83 / Avg: 420.97 / Max: 426.07Min: 400.68 / Avg: 407.08 / Max: 416.86Min: 543.87 / Avg: 554.81 / Max: 560.66Min: 501.95 / Avg: 509.88 / Max: 515.62Min: 456.19 / Avg: 473.42 / Max: 493.34Min: 472.58 / Avg: 475.72 / Max: 477.47Min: 414.95 / Avg: 425.54 / Max: 432.25

OpenBenchmarking.orgExamples Per Second, More Is BetterPlaidMLFP16: Yes - Mode: Inference - Network: ResNet 50 - Device: OpenCLTITAN RTXRX Vega 64RX Vega 56RX 590RX 580RTX 2080 TiRTX 2080RTX 2070RTX 2060GTX 980 TiGTX 980GTX 1080 TiGTX 1080GTX 1070 TiGTX 1070GTX 106090180270360450SE +/- 0.23, N = 3SE +/- 0.88, N = 3SE +/- 0.02, N = 3SE +/- 0.04, N = 3SE +/- 0.32, N = 3SE +/- 0.30, N = 3SE +/- 0.43, N = 3SE +/- 0.17, N = 3SE +/- 6.28, N = 11SE +/- 0.23, N = 3SE +/- 0.19, N = 3SE +/- 0.73, N = 3SE +/- 0.31, N = 3SE +/- 0.17, N = 3SE +/- 0.06, N = 3SE +/- 2.69, N = 3428212192129121417330311259199175311248226221173
OpenBenchmarking.orgExamples Per Second, More Is BetterPlaidMLFP16: Yes - Mode: Inference - Network: ResNet 50 - Device: OpenCLTITAN RTXRX Vega 64RX Vega 56RX 590RX 580RTX 2080 TiRTX 2080RTX 2070RTX 2060GTX 980 TiGTX 980GTX 1080 TiGTX 1080GTX 1070 TiGTX 1070GTX 106080160240320400Min: 427.82 / Avg: 428.25 / Max: 428.61Min: 210.32 / Avg: 211.6 / Max: 213.3Min: 191.93 / Avg: 191.95 / Max: 191.98Min: 128.74 / Avg: 128.81 / Max: 128.86Min: 120.23 / Avg: 120.87 / Max: 121.25Min: 416.12 / Avg: 416.71 / Max: 417.01Min: 329.66 / Avg: 330.33 / Max: 331.14Min: 311.02 / Avg: 311.35 / Max: 311.6Min: 196.07 / Avg: 258.7 / Max: 265.83Min: 198.18 / Avg: 198.51 / Max: 198.95Min: 174.35 / Avg: 174.63 / Max: 174.98Min: 309.41 / Avg: 310.67 / Max: 311.95Min: 247.79 / Avg: 248.32 / Max: 248.85Min: 226.18 / Avg: 226.4 / Max: 226.73Min: 221.11 / Avg: 221.23 / Max: 221.32Min: 167.6 / Avg: 172.99 / Max: 175.75

OpenBenchmarking.orgExamples Per Second, More Is BetterPlaidMLFP16: No - Mode: Training - Network: Inception V3 - Device: OpenCLTITAN RTXRX Vega 64RX Vega 56RX 590RX 580RTX 2080 TiRTX 2080RTX 2070GTX 1080 TiGTX 1080GTX 1070 TiGTX 1070GTX 1060918273645SE +/- 0.29, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.04, N = 3SE +/- 0.03, N = 3SE +/- 0.14, N = 3SE +/- 0.07, N = 3SE +/- 0.03, N = 3SE +/- 0.05, N = 3SE +/- 0.02, N = 3SE +/- 0.02, N = 3SE +/- 0.10, N = 337.4120.9819.8614.5913.1537.6732.8031.4433.1028.4426.0026.2121.58
OpenBenchmarking.orgExamples Per Second, More Is BetterPlaidMLFP16: No - Mode: Training - Network: Inception V3 - Device: OpenCLTITAN RTXRX Vega 64RX Vega 56RX 590RX 580RTX 2080 TiRTX 2080RTX 2070GTX 1080 TiGTX 1080GTX 1070 TiGTX 1070GTX 1060816243240Min: 36.84 / Avg: 37.41 / Max: 37.82Min: 20.95 / Avg: 20.98 / Max: 20.99Min: 19.85 / Avg: 19.86 / Max: 19.89Min: 14.55 / Avg: 14.59 / Max: 14.67Min: 13.11 / Avg: 13.15 / Max: 13.2Min: 37.44 / Avg: 37.67 / Max: 37.92Min: 32.71 / Avg: 32.8 / Max: 32.94Min: 33.05 / Avg: 33.1 / Max: 33.14Min: 28.37 / Avg: 28.44 / Max: 28.55Min: 25.98 / Avg: 26 / Max: 26.03Min: 26.18 / Avg: 26.21 / Max: 26.25Min: 21.4 / Avg: 21.58 / Max: 21.72

OpenBenchmarking.orgExamples Per Second, More Is BetterPlaidMLFP16: No - Mode: Inference - Network: DenseNet 201 - Device: OpenCLTITAN RTXRX Vega 64RX Vega 56RX 590RX 580RTX 2080 TiRTX 2080RTX 2070RTX 2060GTX 980 TiGTX 980GTX 1080 TiGTX 1080GTX 1070 TiGTX 1070GTX 10604080120160200SE +/- 0.42, N = 3SE +/- 0.03, N = 3SE +/- 0.02, N = 3SE +/- 0.02, N = 3SE +/- 0.08, N = 3SE +/- 2.09, N = 3SE +/- 0.13, N = 3SE +/- 0.11, N = 3SE +/- 0.04, N = 3SE +/- 0.11, N = 3SE +/- 0.04, N = 3SE +/- 0.13, N = 3SE +/- 0.01, N = 3SE +/- 0.04, N = 3SE +/- 0.01, N = 3SE +/- 0.00, N = 3161.32106.4495.8767.5062.34150.01118.65115.6595.8878.8863.96119.8090.8383.5583.8962.27
OpenBenchmarking.orgExamples Per Second, More Is BetterPlaidMLFP16: No - Mode: Inference - Network: DenseNet 201 - Device: OpenCLTITAN RTXRX Vega 64RX Vega 56RX 590RX 580RTX 2080 TiRTX 2080RTX 2070RTX 2060GTX 980 TiGTX 980GTX 1080 TiGTX 1080GTX 1070 TiGTX 1070GTX 1060306090120150Min: 160.6 / Avg: 161.32 / Max: 162.06Min: 106.38 / Avg: 106.44 / Max: 106.47Min: 95.84 / Avg: 95.87 / Max: 95.92Min: 67.46 / Avg: 67.5 / Max: 67.54Min: 62.19 / Avg: 62.34 / Max: 62.43Min: 145.82 / Avg: 150.01 / Max: 152.13Min: 118.51 / Avg: 118.65 / Max: 118.9Min: 115.46 / Avg: 115.65 / Max: 115.85Min: 95.8 / Avg: 95.88 / Max: 95.94Min: 78.7 / Avg: 78.88 / Max: 79.09Min: 63.88 / Avg: 63.96 / Max: 64.01Min: 119.54 / Avg: 119.8 / Max: 119.97Min: 90.81 / Avg: 90.83 / Max: 90.86Min: 83.48 / Avg: 83.55 / Max: 83.59Min: 83.88 / Avg: 83.89 / Max: 83.91Min: 62.27 / Avg: 62.27 / Max: 62.28

OpenBenchmarking.orgExamples Per Second, More Is BetterPlaidMLFP16: No - Mode: Inference - Network: Inception V3 - Device: OpenCLTITAN RTXRX Vega 64RX Vega 56RX 590RX 580RTX 2080 TiRTX 2080RTX 2070RTX 2060GTX 980 TiGTX 980GTX 1080 TiGTX 1080GTX 1070 TiGTX 1070GTX 106050100150200250SE +/- 0.31, N = 3SE +/- 0.77, N = 3SE +/- 1.56, N = 3SE +/- 1.29, N = 3SE +/- 0.95, N = 3SE +/- 3.98, N = 12SE +/- 0.12, N = 3SE +/- 0.61, N = 3SE +/- 1.89, N = 3SE +/- 1.44, N = 5SE +/- 1.08, N = 3SE +/- 0.42, N = 3SE +/- 1.75, N = 12SE +/- 0.05, N = 3SE +/- 1.68, N = 5SE +/- 1.04, N = 7211.69118.00104.0071.4266.19197.56161.94147.39124.8496.6981.03158.20124.65113.61108.5082.03
OpenBenchmarking.orgExamples Per Second, More Is BetterPlaidMLFP16: No - Mode: Inference - Network: Inception V3 - Device: OpenCLTITAN RTXRX Vega 64RX Vega 56RX 590RX 580RTX 2080 TiRTX 2080RTX 2070RTX 2060GTX 980 TiGTX 980GTX 1080 TiGTX 1080GTX 1070 TiGTX 1070GTX 10604080120160200Min: 211.24 / Avg: 211.69 / Max: 212.29Min: 116.45 / Avg: 117.91 / Max: 119.04Min: 101.28 / Avg: 104.11 / Max: 106.65Min: 69.11 / Avg: 71.42 / Max: 73.56Min: 64.3 / Avg: 66.19 / Max: 67.27Min: 176.08 / Avg: 197.56 / Max: 207.85Min: 161.73 / Avg: 161.94 / Max: 162.16Min: 146.5 / Avg: 147.39 / Max: 148.55Min: 121.06 / Avg: 124.84 / Max: 126.92Min: 91.04 / Avg: 96.69 / Max: 98.59Min: 78.91 / Avg: 81.03 / Max: 82.47Min: 157.46 / Avg: 158.2 / Max: 158.93Min: 116.74 / Avg: 124.65 / Max: 131.35Min: 113.5 / Avg: 113.61 / Max: 113.66Min: 101.79 / Avg: 108.5 / Max: 110.47Min: 77.93 / Avg: 82.03 / Max: 83.83

OpenBenchmarking.orgExamples Per Second, More Is BetterPlaidMLFP16: No - Mode: Inference - Network: NASNer Large - Device: OpenCLTITAN RTXRX Vega 64RX Vega 56RX 590RX 580RTX 2080 TiRTX 2080RTX 2070RTX 2060GTX 980 TiGTX 980GTX 1080 TiGTX 1080GTX 1070 TiGTX 1070GTX 10601326395265SE +/- 0.10, N = 3SE +/- 0.13, N = 3SE +/- 0.02, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.11, N = 3SE +/- 0.06, N = 3SE +/- 0.07, N = 3SE +/- 0.04, N = 3SE +/- 0.03, N = 3SE +/- 0.05, N = 3SE +/- 0.10, N = 3SE +/- 0.02, N = 3SE +/- 0.00, N = 3SE +/- 0.03, N = 3SE +/- 0.01, N = 359.1335.8931.0820.0118.0856.7741.5736.0129.4224.3218.8942.7530.9226.5725.3118.27
OpenBenchmarking.orgExamples Per Second, More Is BetterPlaidMLFP16: No - Mode: Inference - Network: NASNer Large - Device: OpenCLTITAN RTXRX Vega 64RX Vega 56RX 590RX 580RTX 2080 TiRTX 2080RTX 2070RTX 2060GTX 980 TiGTX 980GTX 1080 TiGTX 1080GTX 1070 TiGTX 1070GTX 10601224364860Min: 59 / Avg: 59.13 / Max: 59.32Min: 35.65 / Avg: 35.89 / Max: 36.08Min: 31.05 / Avg: 31.08 / Max: 31.13Min: 20.01 / Avg: 20.01 / Max: 20.03Min: 18.06 / Avg: 18.08 / Max: 18.08Min: 56.66 / Avg: 56.77 / Max: 56.98Min: 41.49 / Avg: 41.57 / Max: 41.68Min: 35.92 / Avg: 36.01 / Max: 36.14Min: 29.37 / Avg: 29.42 / Max: 29.5Min: 24.25 / Avg: 24.32 / Max: 24.36Min: 18.82 / Avg: 18.89 / Max: 19Min: 42.57 / Avg: 42.75 / Max: 42.9Min: 30.89 / Avg: 30.92 / Max: 30.97Min: 26.56 / Avg: 26.57 / Max: 26.57Min: 25.28 / Avg: 25.31 / Max: 25.37Min: 18.25 / Avg: 18.27 / Max: 18.29

OpenBenchmarking.orgExamples Per Second, More Is BetterPlaidMLFP16: Yes - Mode: Inference - Network: DenseNet 201 - Device: OpenCLTITAN RTXRTX 2080 TiRTX 2080RTX 2070RTX 2060GTX 980 TiGTX 980GTX 1080 TiGTX 1080GTX 1070 TiGTX 1070GTX 1060306090120150SE +/- 2.16, N = 3SE +/- 1.79, N = 7SE +/- 0.10, N = 3SE +/- 0.17, N = 3SE +/- 0.18, N = 3SE +/- 0.09, N = 3SE +/- 0.03, N = 3SE +/- 0.11, N = 3SE +/- 0.02, N = 3SE +/- 0.03, N = 3SE +/- 0.06, N = 3SE +/- 0.02, N = 3148.00139.00111.00108.0089.0276.1561.38114.9785.6078.4579.0858.76
OpenBenchmarking.orgExamples Per Second, More Is BetterPlaidMLFP16: Yes - Mode: Inference - Network: DenseNet 201 - Device: OpenCLTITAN RTXRTX 2080 TiRTX 2080RTX 2070RTX 2060GTX 980 TiGTX 980GTX 1080 TiGTX 1080GTX 1070 TiGTX 1070GTX 1060306090120150Min: 143.57 / Avg: 147.89 / Max: 150.34Min: 128.05 / Avg: 138.73 / Max: 141.26Min: 111.12 / Avg: 111.26 / Max: 111.46Min: 108.18 / Avg: 108.37 / Max: 108.7Min: 88.69 / Avg: 89.02 / Max: 89.32Min: 76.01 / Avg: 76.15 / Max: 76.32Min: 61.32 / Avg: 61.38 / Max: 61.44Min: 114.86 / Avg: 114.97 / Max: 115.2Min: 85.58 / Avg: 85.6 / Max: 85.64Min: 78.4 / Avg: 78.45 / Max: 78.48Min: 78.98 / Avg: 79.08 / Max: 79.18Min: 58.73 / Avg: 58.76 / Max: 58.8

OpenBenchmarking.orgExamples Per Second, More Is BetterPlaidMLFP16: Yes - Mode: Inference - Network: Inception V3 - Device: OpenCLTITAN RTXRTX 2080 TiRTX 2080RTX 2070RTX 2060GTX 980 TiGTX 980GTX 1080 TiGTX 1080GTX 1070 TiGTX 1070GTX 10604080120160200SE +/- 0.41, N = 3SE +/- 3.75, N = 12SE +/- 2.75, N = 12SE +/- 2.27, N = 12SE +/- 2.35, N = 3SE +/- 1.04, N = 12SE +/- 0.15, N = 3SE +/- 0.55, N = 3SE +/- 0.17, N = 3SE +/- 1.45, N = 7SE +/- 0.16, N = 3SE +/- 0.27, N = 3203.00192.00153.00142.00126.00104.1089.26160.18130.00114.33112.3186.75
OpenBenchmarking.orgExamples Per Second, More Is BetterPlaidMLFP16: Yes - Mode: Inference - Network: Inception V3 - Device: OpenCLTITAN RTXRTX 2080 TiRTX 2080RTX 2070RTX 2060GTX 980 TiGTX 980GTX 1080 TiGTX 1080GTX 1070 TiGTX 1070GTX 10604080120160200Min: 201.81 / Avg: 202.62 / Max: 203.14Min: 170.33 / Avg: 192.24 / Max: 201.99Min: 140.65 / Avg: 152.61 / Max: 161.23Min: 131.81 / Avg: 142.23 / Max: 148.96Min: 121.42 / Avg: 126.11 / Max: 128.68Min: 95.65 / Avg: 104.1 / Max: 106.64Min: 88.96 / Avg: 89.26 / Max: 89.46Min: 159.36 / Avg: 160.18 / Max: 161.24Min: 129.37 / Avg: 129.63 / Max: 129.95Min: 105.61 / Avg: 114.33 / Max: 115.95Min: 112.02 / Avg: 112.31 / Max: 112.57Min: 86.21 / Avg: 86.75 / Max: 87.08

OpenBenchmarking.orgExamples Per Second, More Is BetterPlaidMLFP16: Yes - Mode: Inference - Network: NASNer Large - Device: OpenCLTITAN RTXRTX 2080 TiRTX 2080RTX 2070RTX 2060GTX 980 TiGTX 980GTX 1080 TiGTX 1080GTX 1070 TiGTX 1070GTX 10601632486480SE +/- 0.16, N = 3SE +/- 0.89, N = 3SE +/- 0.06, N = 3SE +/- 0.09, N = 3SE +/- 0.07, N = 3SE +/- 0.04, N = 3SE +/- 0.08, N = 3SE +/- 0.08, N = 3SE +/- 0.10, N = 3SE +/- 0.06, N = 3SE +/- 0.03, N = 3SE +/- 0.02, N = 372.6169.7051.5444.3437.6026.9023.2247.6337.0232.6530.2022.17
OpenBenchmarking.orgExamples Per Second, More Is BetterPlaidMLFP16: Yes - Mode: Inference - Network: NASNer Large - Device: OpenCLTITAN RTXRTX 2080 TiRTX 2080RTX 2070RTX 2060GTX 980 TiGTX 980GTX 1080 TiGTX 1080GTX 1070 TiGTX 1070GTX 10601428425670Min: 72.3 / Avg: 72.61 / Max: 72.85Min: 67.94 / Avg: 69.7 / Max: 70.84Min: 51.48 / Avg: 51.54 / Max: 51.65Min: 44.24 / Avg: 44.34 / Max: 44.51Min: 37.53 / Avg: 37.6 / Max: 37.73Min: 26.85 / Avg: 26.9 / Max: 26.98Min: 23.1 / Avg: 23.22 / Max: 23.36Min: 47.48 / Avg: 47.63 / Max: 47.72Min: 36.85 / Avg: 37.02 / Max: 37.2Min: 32.54 / Avg: 32.65 / Max: 32.75Min: 30.16 / Avg: 30.2 / Max: 30.26Min: 22.15 / Avg: 22.17 / Max: 22.21