PlaidML OpenCL Linux GPU Benchmarks AMD Radeon + NVIDIA GeForce

PlaidML Linux benchmarks for a future article on Phoronix.com by Michael Larabel.

Compare your own system(s) to this result file with the Phoronix Test Suite by running the command: phoronix-test-suite benchmark 1901122-PTS-PLAIDMLG16
Jump To Table - Results

View

Do Not Show Noisy Results
Do Not Show Results With Incomplete Data
Do Not Show Results With Little Change/Spread
List Notable Results

Statistics

Show Overall Harmonic Mean(s)
Show Overall Geometric Mean
Show Wins / Losses Counts (Pie Chart)
Normalize Results
Remove Outliers Before Calculating Averages

Graph Settings

Force Line Graphs Where Applicable
Convert To Scalar Where Applicable
Disable Color Branding
Prefer Vertical Bar Graphs

Multi-Way Comparison

Condense Multi-Option Tests Into Single Result Graphs

Table

Show Detailed System Result Table

Run Management

Highlight
Result
Hide
Result
Result
Identifier
Performance Per
Dollar
Date
Run
  Test
  Duration
RX 580
January 10 2019
  1 Hour, 18 Minutes
RX 590
January 11 2019
  1 Hour, 18 Minutes
RX Vega 56
January 10 2019
  53 Minutes
RX Vega 64
January 10 2019
  53 Minutes
GTX 980
January 12 2019
  37 Minutes
GTX 980 Ti
January 12 2019
  45 Minutes
GTX 1060
January 11 2019
  52 Minutes
GTX 1070
January 11 2019
  47 Minutes
GTX 1070 Ti
January 11 2019
  47 Minutes
GTX 1080
January 11 2019
  50 Minutes
GTX 1080 Ti
January 12 2019
  37 Minutes
RTX 2060
January 11 2019
  31 Minutes
RTX 2070
January 11 2019
  41 Minutes
RTX 2080
January 11 2019
  43 Minutes
RTX 2080 Ti
January 11 2019
  44 Minutes
TITAN RTX
January 11 2019
  35 Minutes
Invert Hiding All Results Option
  48 Minutes

Only show results where is faster than
Only show results matching title/arguments (delimit multiple options with a comma):
Do not show results matching title/arguments (delimit multiple options with a comma):


PlaidML OpenCL Linux GPU Benchmarks AMD Radeon + NVIDIA GeForceProcessorMotherboardChipsetMemoryDiskGraphicsAudioMonitorNetworkOSKernelDesktopDisplay ServerDisplay DriverOpenGLCompilerFile-SystemScreen ResolutionVulkanRX Vega 56RX Vega 64RX 580RX 590RTX 2080 TiTITAN RTXRTX 2080RTX 2070RTX 2060GTX 1080GTX 1060GTX 1070GTX 1070 TiGTX 1080 TiGTX 980 TiGTX 980AMD Ryzen Threadripper 2990WX 32-Core @ 3.00GHz (32 Cores / 64 Threads)ASUS ROG ZENITH EXTREME (1601 BIOS)AMD Family 17h32768MBSamsung SSD 970 EVO 500GBAMD Radeon RX 64 8GB (1590/800MHz)Realtek ALC1220ASUS VP28UIntel I211 Gigabit + Qualcomm Atheros QCA6174 802.11ac + Wilocity Wil6200 802.11adUbuntu 18.104.19.0-041900-generic (x86_64)GNOME Shell 3.30.1X Server 1.20.1amdgpu 18.1.04.5 Mesa 18.2.2 (LLVM 7.0.0)GCC 8.2.0ext43840x2160AMD Radeon RX 64 8GB (1630/945MHz)MSI AMD Radeon RX 470/480/570/570X/580/580X 8GB (1366/2000MHz)modesetting 1.20.1Sapphire AMD Radeon RX 470/480/570/570X/580/580X 8GB (1560/2100MHz)4.20.0-042000-generic (x86_64)NVIDIA GeForce RTX 2080 Ti 11GB (1350/7000MHz)NVIDIA 415.254.6.01.1.84NVIDIA TITAN RTX 24GB (1350/7000MHz)Intel I211 + Qualcomm Atheros QCA6174 802.11ac + Wilocity Wil6200 802.11adZotac NVIDIA GeForce RTX 2080 8GB (1515/7000MHz)ASUS NVIDIA GeForce RTX 2070 8GB (1410/7000MHz)Device 6GB (1365/7000MHz)NVIDIA GeForce GTX 1080 8GB (1607/5005MHz)NVIDIA GeForce GTX 1060 6GB (1506/4006MHz)NVIDIA GeForce GTX 1070 8GB (1506/4006MHz)Zotac NVIDIA GeForce GTX 1070 Ti 8GB (1607/4006MHz)NVIDIA GeForce GTX 1080 Ti 11GB (1480/5508MHz)NVIDIA GeForce GTX 980 Ti 6GB (999/3505MHz)NVIDIA GeForce GTX 980 4GB (1126/3505MHz)OpenBenchmarking.orgProcessor Details- Scaling Governor: acpi-cpufreq ondemandGraphics Details- RX Vega 56, RX Vega 64, RX 580, RX 590: GLAMORPython Details- Python 2.7.15+ + Python 3.6.7Security Details- RX Vega 56: __user pointer sanitization + Full AMD retpoline IBPB + SSB disabled via prctl and seccomp- RX Vega 64: __user pointer sanitization + Full AMD retpoline IBPB + SSB disabled via prctl and seccomp- RX 580: __user pointer sanitization + Full AMD retpoline IBPB + SSB disabled via prctl and seccomp- RX 590: __user pointer sanitization + Full AMD retpoline IBPB: conditional STIBP: disabled RSB filling + SSB disabled via prctl and seccomp- RTX 2080 Ti: __user pointer sanitization + Full AMD retpoline IBPB: conditional STIBP: disabled RSB filling + SSB disabled via prctl and seccomp- TITAN RTX: __user pointer sanitization + Full AMD retpoline IBPB: conditional STIBP: disabled RSB filling + SSB disabled via prctl and seccomp- RTX 2080: __user pointer sanitization + Full AMD retpoline IBPB: conditional STIBP: disabled RSB filling + SSB disabled via prctl and seccomp- RTX 2070: __user pointer sanitization + Full AMD retpoline IBPB: conditional STIBP: disabled RSB filling + SSB disabled via prctl and seccomp- RTX 2060: __user pointer sanitization + Full AMD retpoline IBPB: conditional STIBP: disabled RSB filling + SSB disabled via prctl and seccomp- GTX 1080: __user pointer sanitization + Full AMD retpoline IBPB: conditional STIBP: disabled RSB filling + SSB disabled via prctl and seccomp- GTX 1060: __user pointer sanitization + Full AMD retpoline IBPB: conditional STIBP: disabled RSB filling + SSB disabled via prctl and seccomp- GTX 1070: __user pointer sanitization + Full AMD retpoline IBPB: conditional STIBP: disabled RSB filling + SSB disabled via prctl and seccomp- GTX 1070 Ti: __user pointer sanitization + Full AMD retpoline IBPB: conditional STIBP: disabled RSB filling + SSB disabled via prctl and seccomp- GTX 1080 Ti: __user pointer sanitization + Full AMD retpoline IBPB: conditional STIBP: disabled RSB filling + SSB disabled via prctl and seccomp- GTX 980 Ti: __user pointer sanitization + Full AMD retpoline IBPB: conditional STIBP: disabled RSB filling + SSB disabled via prctl and seccomp- GTX 980: __user pointer sanitization + Full AMD retpoline IBPB: conditional STIBP: disabled RSB filling + SSB disabled via prctl and seccompOpenCL Details- RTX 2080 Ti: GPU Compute Cores: 4352- TITAN RTX: GPU Compute Cores: 4608- RTX 2080: GPU Compute Cores: 2944- RTX 2070: GPU Compute Cores: 2304- RTX 2060: GPU Compute Cores: 1920- GTX 1080: GPU Compute Cores: 2560- GTX 1060: GPU Compute Cores: 1280- GTX 1070: GPU Compute Cores: 1920- GTX 1070 Ti: GPU Compute Cores: 2432- GTX 1080 Ti: GPU Compute Cores: 3584- GTX 980 Ti: GPU Compute Cores: 2816- GTX 980: GPU Compute Cores: 2048

RX Vega 56RX Vega 64RX 580RX 590RTX 2080 TiTITAN RTXRTX 2080RTX 2070RTX 2060GTX 1080GTX 1060GTX 1070GTX 1070 TiGTX 1080 TiGTX 980 TiGTX 980Result OverviewPhoronix Test Suite100%183%265%348%430%PlaidMLPlaidMLPlaidMLPlaidMLPlaidMLPlaidMLPlaidMLPlaidMLPlaidMLPlaidMLPlaidMLPlaidMLPlaidMLPlaidMLNo - Inference - VGG19 - OpenCLYes - Inference - VGG19 - OpenCLNo - Inference - VGG16 - OpenCLYes - Inference - VGG16 - OpenCLNo - Inference - ResNet 50 - OpenCLYes - Inference - ResNet 50 - OpenCLNo - Inference - IMDB LSTM - OpenCLNo - Training - Mobilenet - OpenCLNo - Inference - NASNer Large - OpenCLNo - Inference - Inception V3 - OpenCLNo - Inference - DenseNet 201 - OpenCLNo - Inference - Mobilenet - OpenCLNo - Training - IMDB LSTM - OpenCLYes - Inference - Mobilenet - OpenCL

PlaidML OpenCL Linux GPU Benchmarks AMD Radeon + NVIDIA GeForceplaidml: No - Training - VGG16 - OpenCLplaidml: No - Training - VGG19 - OpenCLplaidml: No - Inference - VGG16 - OpenCLplaidml: No - Inference - VGG19 - OpenCLplaidml: Yes - Inference - VGG16 - OpenCLplaidml: Yes - Inference - VGG19 - OpenCLplaidml: No - Training - IMDB LSTM - OpenCLplaidml: No - Training - Mobilenet - OpenCLplaidml: No - Inference - IMDB LSTM - OpenCLplaidml: No - Inference - Mobilenet - OpenCLplaidml: No - Inference - ResNet 50 - OpenCLplaidml: Yes - Inference - Mobilenet - OpenCLplaidml: Yes - Inference - ResNet 50 - OpenCLplaidml: No - Training - Inception V3 - OpenCLplaidml: No - Inference - DenseNet 201 - OpenCLplaidml: No - Inference - Inception V3 - OpenCLplaidml: No - Inference - NASNer Large - OpenCLplaidml: Yes - Inference - DenseNet 201 - OpenCLplaidml: Yes - Inference - Inception V3 - OpenCLplaidml: Yes - Inference - NASNer Large - OpenCLRX Vega 56RX Vega 64RX 580RX 590RTX 2080 TiTITAN RTXRTX 2080RTX 2070RTX 2060GTX 1080GTX 1060GTX 1070GTX 1070 TiGTX 1080 TiGTX 980 TiGTX 98028.7825.6610994.4110791.3216471.2924053121348019219.8695.8710431.0830.8528.15123107.32120103.9316975.2324054622648121220.98106.4411835.8910.429.6764.5555.2658.9251.5911941.6418239013143512113.1562.3466.1918.089.528.9267.7158.3161.6553.8513345.2120542413945512914.5967.5071.4220.0185.4574.75258.50221.88236.13207.30192138.1152596247869541737.67150.01197.5656.7713919269.7090.8479.58274.89237.71250.30220.89191142.3653598849969842837.41161.32211.6959.1314820372.6167.5958.55197.52168.53185.76161.16175120.2441879437361233032.80118.65161.9441.5711115351.5463.7154.76183.95155.08172.84148.93164119.8435676735153331131.44115.65147.3936.0110814244.34147.16124.18143.80121.98157103.3032467129353825995.88124.8429.4289.0212637.6050.0942.92138.78117.24134.68115.9014294.4724762127551024828.4490.83124.6530.9285.6013037.0234.0793.0078.1392.1979.2911981.6517548518742617321.5862.2782.0318.2758.7686.7522.1745.9739.22125.37106.35122.54105.7713598.4521859324147622126.2183.89108.5025.3179.08112.3130.2046.7340.33128.85109.40125.60108.8513395.5221559424947322626.0083.55113.6126.5778.45114.3332.6566.5557.60181.25156.28180.71159.02165113.5529868731555531133.10119.80158.2042.75114.97160.1847.6340.14119.20101.40121.68104.7412283.6617448519942119978.8896.6924.3276.15104.1026.9094.8480.3796.8283.1910878.4715545817240717563.9681.0318.8961.3889.2623.22OpenBenchmarking.org

PlaidML

This test profile uses PlaidML deep learning framework for offering up various benchmarks. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgExamples Per Second, More Is BetterPlaidMLFP16: No - Mode: Training - Network: VGG16 - Device: OpenCLRX Vega 56RX Vega 64RX 580RX 590RTX 2080 TiTITAN RTXRTX 2080RTX 2070GTX 1080GTX 1060GTX 1070GTX 1070 TiGTX 1080 TiGTX 980 Ti20406080100SE +/- 0.02, N = 3SE +/- 0.13, N = 3SE +/- 0.00, N = 3SE +/- 0.01, N = 3SE +/- 0.13, N = 3SE +/- 0.18, N = 3SE +/- 0.26, N = 3SE +/- 0.21, N = 3SE +/- 0.04, N = 3SE +/- 0.04, N = 3SE +/- 0.06, N = 3SE +/- 0.05, N = 3SE +/- 0.15, N = 3SE +/- 0.28, N = 328.7830.8510.429.5285.4590.8467.5963.7150.0934.0745.9746.7366.5540.14
OpenBenchmarking.orgExamples Per Second, More Is BetterPlaidMLFP16: No - Mode: Training - Network: VGG16 - Device: OpenCLRX Vega 56RX Vega 64RX 580RX 590RTX 2080 TiTITAN RTXRTX 2080RTX 2070GTX 1080GTX 1060GTX 1070GTX 1070 TiGTX 1080 TiGTX 980 Ti20406080100Min: 28.76 / Avg: 28.78 / Max: 28.82Min: 30.61 / Avg: 30.85 / Max: 31.04Min: 10.41 / Avg: 10.42 / Max: 10.43Min: 9.51 / Avg: 9.52 / Max: 9.52Min: 85.3 / Avg: 85.45 / Max: 85.7Min: 90.57 / Avg: 90.84 / Max: 91.19Min: 67.17 / Avg: 67.59 / Max: 68.06Min: 63.39 / Avg: 63.71 / Max: 64.09Min: 50.02 / Avg: 50.09 / Max: 50.15Min: 34.03 / Avg: 34.07 / Max: 34.15Min: 45.88 / Avg: 45.97 / Max: 46.09Min: 46.63 / Avg: 46.73 / Max: 46.78Min: 66.32 / Avg: 66.55 / Max: 66.82Min: 39.58 / Avg: 40.14 / Max: 40.43

OpenBenchmarking.orgExamples Per Second, More Is BetterPlaidMLFP16: No - Mode: Training - Network: VGG19 - Device: OpenCLRX Vega 56RX Vega 64RX 580RX 590RTX 2080 TiTITAN RTXRTX 2080RTX 2070GTX 1080GTX 1070GTX 1070 TiGTX 1080 Ti20406080100SE +/- 0.19, N = 3SE +/- 0.02, N = 3SE +/- 0.00, N = 3SE +/- 0.01, N = 3SE +/- 0.09, N = 3SE +/- 0.16, N = 3SE +/- 0.07, N = 3SE +/- 0.12, N = 3SE +/- 0.08, N = 3SE +/- 0.07, N = 3SE +/- 0.03, N = 3SE +/- 0.07, N = 325.6628.159.678.9274.7579.5858.5554.7642.9239.2240.3357.60
OpenBenchmarking.orgExamples Per Second, More Is BetterPlaidMLFP16: No - Mode: Training - Network: VGG19 - Device: OpenCLRX Vega 56RX Vega 64RX 580RX 590RTX 2080 TiTITAN RTXRTX 2080RTX 2070GTX 1080GTX 1070GTX 1070 TiGTX 1080 Ti1530456075Min: 25.31 / Avg: 25.66 / Max: 25.95Min: 28.11 / Avg: 28.15 / Max: 28.17Min: 9.67 / Avg: 9.67 / Max: 9.68Min: 8.9 / Avg: 8.92 / Max: 8.92Min: 74.64 / Avg: 74.75 / Max: 74.92Min: 79.41 / Avg: 79.58 / Max: 79.9Min: 58.46 / Avg: 58.55 / Max: 58.69Min: 54.63 / Avg: 54.76 / Max: 55.01Min: 42.82 / Avg: 42.92 / Max: 43.08Min: 39.09 / Avg: 39.22 / Max: 39.33Min: 40.27 / Avg: 40.33 / Max: 40.38Min: 57.49 / Avg: 57.6 / Max: 57.72

OpenBenchmarking.orgExamples Per Second, More Is BetterPlaidMLFP16: No - Mode: Inference - Network: VGG16 - Device: OpenCLRX Vega 56RX Vega 64RX 580RX 590RTX 2080 TiTITAN RTXRTX 2080RTX 2070RTX 2060GTX 1080GTX 1060GTX 1070GTX 1070 TiGTX 1080 TiGTX 980 TiGTX 98060120180240300SE +/- 0.77, N = 3SE +/- 1.73, N = 3SE +/- 0.03, N = 3SE +/- 0.51, N = 3SE +/- 0.25, N = 3SE +/- 1.45, N = 3SE +/- 0.14, N = 3SE +/- 0.03, N = 3SE +/- 0.18, N = 3SE +/- 0.09, N = 3SE +/- 0.06, N = 3SE +/- 0.40, N = 3SE +/- 0.06, N = 3SE +/- 0.45, N = 3SE +/- 0.14, N = 3SE +/- 0.06, N = 3109.00123.0064.5567.71258.50274.89197.52183.95147.16138.7893.00125.37128.85181.25119.2094.84
OpenBenchmarking.orgExamples Per Second, More Is BetterPlaidMLFP16: No - Mode: Inference - Network: VGG16 - Device: OpenCLRX Vega 56RX Vega 64RX 580RX 590RTX 2080 TiTITAN RTXRTX 2080RTX 2070RTX 2060GTX 1080GTX 1060GTX 1070GTX 1070 TiGTX 1080 TiGTX 980 TiGTX 98050100150200250Min: 107.54 / Avg: 108.73 / Max: 110.16Min: 120.86 / Avg: 122.61 / Max: 126.08Min: 64.5 / Avg: 64.55 / Max: 64.61Min: 66.7 / Avg: 67.71 / Max: 68.23Min: 258.23 / Avg: 258.5 / Max: 259Min: 272 / Avg: 274.89 / Max: 276.54Min: 197.29 / Avg: 197.52 / Max: 197.78Min: 183.91 / Avg: 183.95 / Max: 184.01Min: 146.96 / Avg: 147.16 / Max: 147.53Min: 138.62 / Avg: 138.78 / Max: 138.92Min: 92.93 / Avg: 93 / Max: 93.12Min: 124.57 / Avg: 125.37 / Max: 125.78Min: 128.75 / Avg: 128.85 / Max: 128.96Min: 180.38 / Avg: 181.25 / Max: 181.85Min: 118.99 / Avg: 119.2 / Max: 119.45Min: 94.72 / Avg: 94.84 / Max: 94.91

OpenBenchmarking.orgExamples Per Second, More Is BetterPlaidMLFP16: No - Mode: Inference - Network: VGG19 - Device: OpenCLRX Vega 56RX Vega 64RX 580RX 590RTX 2080 TiTITAN RTXRTX 2080RTX 2070RTX 2060GTX 1080GTX 1060GTX 1070GTX 1070 TiGTX 1080 TiGTX 980 TiGTX 98050100150200250SE +/- 1.43, N = 4SE +/- 0.89, N = 3SE +/- 0.06, N = 3SE +/- 0.34, N = 3SE +/- 0.15, N = 3SE +/- 0.16, N = 3SE +/- 0.12, N = 3SE +/- 0.13, N = 3SE +/- 0.08, N = 3SE +/- 0.03, N = 3SE +/- 0.01, N = 3SE +/- 0.00, N = 3SE +/- 0.03, N = 3SE +/- 0.11, N = 3SE +/- 0.19, N = 3SE +/- 0.07, N = 394.41107.3255.2658.31221.88237.71168.53155.08124.18117.2478.13106.35109.40156.28101.4080.37
OpenBenchmarking.orgExamples Per Second, More Is BetterPlaidMLFP16: No - Mode: Inference - Network: VGG19 - Device: OpenCLRX Vega 56RX Vega 64RX 580RX 590RTX 2080 TiTITAN RTXRTX 2080RTX 2070RTX 2060GTX 1080GTX 1060GTX 1070GTX 1070 TiGTX 1080 TiGTX 980 TiGTX 9804080120160200Min: 90.88 / Avg: 94.41 / Max: 97.23Min: 106.21 / Avg: 107.32 / Max: 109.09Min: 55.16 / Avg: 55.26 / Max: 55.36Min: 57.62 / Avg: 58.31 / Max: 58.67Min: 221.61 / Avg: 221.88 / Max: 222.14Min: 237.51 / Avg: 237.71 / Max: 238.04Min: 168.34 / Avg: 168.53 / Max: 168.76Min: 154.9 / Avg: 155.08 / Max: 155.34Min: 124.06 / Avg: 124.18 / Max: 124.33Min: 117.19 / Avg: 117.24 / Max: 117.31Min: 78.11 / Avg: 78.13 / Max: 78.16Min: 106.34 / Avg: 106.35 / Max: 106.35Min: 109.35 / Avg: 109.4 / Max: 109.45Min: 156.06 / Avg: 156.28 / Max: 156.44Min: 101.03 / Avg: 101.4 / Max: 101.65Min: 80.29 / Avg: 80.37 / Max: 80.52

OpenBenchmarking.orgExamples Per Second, More Is BetterPlaidMLFP16: Yes - Mode: Inference - Network: VGG16 - Device: OpenCLRX Vega 56RX Vega 64RX 580RX 590RTX 2080 TiTITAN RTXRTX 2080RTX 2070RTX 2060GTX 1080GTX 1060GTX 1070GTX 1070 TiGTX 1080 TiGTX 980 TiGTX 98050100150200250SE +/- 0.06, N = 3SE +/- 0.39, N = 3SE +/- 0.06, N = 3SE +/- 0.27, N = 3SE +/- 1.48, N = 3SE +/- 0.14, N = 3SE +/- 0.06, N = 3SE +/- 0.05, N = 3SE +/- 0.02, N = 3SE +/- 0.05, N = 3SE +/- 0.82, N = 3SE +/- 0.04, N = 3SE +/- 0.36, N = 3SE +/- 0.26, N = 3SE +/- 0.07, N = 3SE +/- 0.00, N = 3107.00120.0058.9261.65236.13250.30185.76172.84143.80134.6892.19122.54125.60180.71121.6896.82
OpenBenchmarking.orgExamples Per Second, More Is BetterPlaidMLFP16: Yes - Mode: Inference - Network: VGG16 - Device: OpenCLRX Vega 56RX Vega 64RX 580RX 590RTX 2080 TiTITAN RTXRTX 2080RTX 2070RTX 2060GTX 1080GTX 1060GTX 1070GTX 1070 TiGTX 1080 TiGTX 980 TiGTX 98050100150200250Min: 106.47 / Avg: 106.53 / Max: 106.66Min: 118.82 / Avg: 119.6 / Max: 119.99Min: 58.84 / Avg: 58.92 / Max: 59.05Min: 61.17 / Avg: 61.65 / Max: 62.09Min: 233.18 / Avg: 236.13 / Max: 237.68Min: 250.02 / Avg: 250.3 / Max: 250.45Min: 185.63 / Avg: 185.76 / Max: 185.83Min: 172.79 / Avg: 172.84 / Max: 172.93Min: 143.76 / Avg: 143.8 / Max: 143.84Min: 134.61 / Avg: 134.68 / Max: 134.77Min: 90.55 / Avg: 92.19 / Max: 93.05Min: 122.47 / Avg: 122.54 / Max: 122.6Min: 124.88 / Avg: 125.6 / Max: 126Min: 180.23 / Avg: 180.71 / Max: 181.14Min: 121.55 / Avg: 121.68 / Max: 121.8Min: 96.82 / Avg: 96.82 / Max: 96.83

OpenBenchmarking.orgExamples Per Second, More Is BetterPlaidMLFP16: Yes - Mode: Inference - Network: VGG19 - Device: OpenCLRX Vega 56RX Vega 64RX 580RX 590RTX 2080 TiTITAN RTXRTX 2080RTX 2070RTX 2060GTX 1080GTX 1060GTX 1070GTX 1070 TiGTX 1080 TiGTX 980 TiGTX 98050100150200250SE +/- 0.06, N = 3SE +/- 0.71, N = 3SE +/- 0.06, N = 3SE +/- 0.38, N = 3SE +/- 0.21, N = 3SE +/- 0.04, N = 3SE +/- 0.17, N = 3SE +/- 0.15, N = 3SE +/- 1.40, N = 3SE +/- 0.07, N = 3SE +/- 0.06, N = 3SE +/- 0.07, N = 3SE +/- 0.03, N = 3SE +/- 0.10, N = 3SE +/- 0.18, N = 3SE +/- 0.01, N = 391.32103.9351.5953.85207.30220.89161.16148.93121.98115.9079.29105.77108.85159.02104.7483.19
OpenBenchmarking.orgExamples Per Second, More Is BetterPlaidMLFP16: Yes - Mode: Inference - Network: VGG19 - Device: OpenCLRX Vega 56RX Vega 64RX 580RX 590RTX 2080 TiTITAN RTXRTX 2080RTX 2070RTX 2060GTX 1080GTX 1060GTX 1070GTX 1070 TiGTX 1080 TiGTX 980 TiGTX 9804080120160200Min: 91.22 / Avg: 91.32 / Max: 91.43Min: 102.56 / Avg: 103.93 / Max: 104.91Min: 51.46 / Avg: 51.59 / Max: 51.66Min: 53.19 / Avg: 53.85 / Max: 54.52Min: 206.9 / Avg: 207.3 / Max: 207.64Min: 220.81 / Avg: 220.89 / Max: 220.95Min: 160.94 / Avg: 161.16 / Max: 161.5Min: 148.71 / Avg: 148.93 / Max: 149.21Min: 119.18 / Avg: 121.98 / Max: 123.41Min: 115.77 / Avg: 115.9 / Max: 115.99Min: 79.2 / Avg: 79.29 / Max: 79.41Min: 105.65 / Avg: 105.77 / Max: 105.89Min: 108.78 / Avg: 108.85 / Max: 108.89Min: 158.82 / Avg: 159.02 / Max: 159.16Min: 104.39 / Avg: 104.74 / Max: 104.99Min: 83.17 / Avg: 83.19 / Max: 83.21

OpenBenchmarking.orgExamples Per Second, More Is BetterPlaidMLFP16: No - Mode: Training - Network: IMDB LSTM - Device: OpenCLRX Vega 56RX Vega 64RX 580RX 590RTX 2080 TiTITAN RTXRTX 2080RTX 2070RTX 2060GTX 1080GTX 1060GTX 1070GTX 1070 TiGTX 1080 TiGTX 980 TiGTX 9804080120160200SE +/- 0.44, N = 3SE +/- 0.49, N = 3SE +/- 1.28, N = 3SE +/- 1.06, N = 3SE +/- 1.21, N = 3SE +/- 1.98, N = 3SE +/- 1.03, N = 3SE +/- 1.14, N = 3SE +/- 0.59, N = 3SE +/- 0.45, N = 3SE +/- 0.30, N = 3SE +/- 0.09, N = 3SE +/- 0.09, N = 3SE +/- 0.42, N = 3SE +/- 0.66, N = 3SE +/- 0.08, N = 3164169119133192191175164157142119135133165122108
OpenBenchmarking.orgExamples Per Second, More Is BetterPlaidMLFP16: No - Mode: Training - Network: IMDB LSTM - Device: OpenCLRX Vega 56RX Vega 64RX 580RX 590RTX 2080 TiTITAN RTXRTX 2080RTX 2070RTX 2060GTX 1080GTX 1060GTX 1070GTX 1070 TiGTX 1080 TiGTX 980 TiGTX 9804080120160200Min: 163.32 / Avg: 163.93 / Max: 164.8Min: 167.76 / Avg: 168.75 / Max: 169.28Min: 116.71 / Avg: 119.27 / Max: 120.67Min: 130.97 / Avg: 133.05 / Max: 134.39Min: 189.41 / Avg: 191.82 / Max: 193.17Min: 186.93 / Avg: 190.69 / Max: 193.64Min: 173.1 / Avg: 175.14 / Max: 176.46Min: 161.94 / Avg: 163.91 / Max: 165.88Min: 155.98 / Avg: 156.77 / Max: 157.92Min: 140.93 / Avg: 141.69 / Max: 142.5Min: 118.63 / Avg: 119.05 / Max: 119.63Min: 134.44 / Avg: 134.58 / Max: 134.75Min: 132.67 / Avg: 132.77 / Max: 132.95Min: 164.13 / Avg: 164.78 / Max: 165.55Min: 120.71 / Avg: 121.72 / Max: 122.95Min: 107.8 / Avg: 107.9 / Max: 108.06

OpenBenchmarking.orgExamples Per Second, More Is BetterPlaidMLFP16: No - Mode: Training - Network: Mobilenet - Device: OpenCLRX Vega 56RX Vega 64RX 580RX 590RTX 2080 TiTITAN RTXRTX 2080RTX 2070RTX 2060GTX 1080GTX 1060GTX 1070GTX 1070 TiGTX 1080 TiGTX 980 TiGTX 980306090120150SE +/- 0.15, N = 3SE +/- 0.13, N = 3SE +/- 0.03, N = 3SE +/- 0.03, N = 3SE +/- 0.32, N = 3SE +/- 0.40, N = 3SE +/- 0.24, N = 3SE +/- 0.13, N = 3SE +/- 0.12, N = 3SE +/- 0.17, N = 3SE +/- 0.01, N = 3SE +/- 0.04, N = 3SE +/- 0.19, N = 3SE +/- 0.14, N = 3SE +/- 0.19, N = 3SE +/- 0.03, N = 371.2975.2341.6445.21138.11142.36120.24119.84103.3094.4781.6598.4595.52113.5583.6678.47
OpenBenchmarking.orgExamples Per Second, More Is BetterPlaidMLFP16: No - Mode: Training - Network: Mobilenet - Device: OpenCLRX Vega 56RX Vega 64RX 580RX 590RTX 2080 TiTITAN RTXRTX 2080RTX 2070RTX 2060GTX 1080GTX 1060GTX 1070GTX 1070 TiGTX 1080 TiGTX 980 TiGTX 980306090120150Min: 71.06 / Avg: 71.29 / Max: 71.58Min: 74.98 / Avg: 75.23 / Max: 75.43Min: 41.6 / Avg: 41.64 / Max: 41.7Min: 45.15 / Avg: 45.21 / Max: 45.26Min: 137.46 / Avg: 138.11 / Max: 138.48Min: 141.96 / Avg: 142.36 / Max: 143.15Min: 119.77 / Avg: 120.24 / Max: 120.51Min: 119.59 / Avg: 119.84 / Max: 120.03Min: 103.09 / Avg: 103.3 / Max: 103.51Min: 94.27 / Avg: 94.47 / Max: 94.8Min: 81.64 / Avg: 81.65 / Max: 81.66Min: 98.39 / Avg: 98.45 / Max: 98.52Min: 95.2 / Avg: 95.52 / Max: 95.85Min: 113.33 / Avg: 113.55 / Max: 113.81Min: 83.36 / Avg: 83.66 / Max: 84Min: 78.42 / Avg: 78.47 / Max: 78.5

OpenBenchmarking.orgExamples Per Second, More Is BetterPlaidMLFP16: No - Mode: Inference - Network: IMDB LSTM - Device: OpenCLRX Vega 56RX Vega 64RX 580RX 590RTX 2080 TiTITAN RTXRTX 2080RTX 2070RTX 2060GTX 1080GTX 1060GTX 1070GTX 1070 TiGTX 1080 TiGTX 980 TiGTX 980120240360480600SE +/- 0.14, N = 3SE +/- 0.02, N = 3SE +/- 0.68, N = 3SE +/- 1.28, N = 3SE +/- 1.04, N = 3SE +/- 0.33, N = 3SE +/- 1.05, N = 3SE +/- 1.24, N = 3SE +/- 0.23, N = 3SE +/- 0.99, N = 3SE +/- 0.26, N = 3SE +/- 0.54, N = 3SE +/- 0.09, N = 3SE +/- 0.26, N = 3SE +/- 0.33, N = 3SE +/- 0.37, N = 3240240182205525535418356324247175218215298174155
OpenBenchmarking.orgExamples Per Second, More Is BetterPlaidMLFP16: No - Mode: Inference - Network: IMDB LSTM - Device: OpenCLRX Vega 56RX Vega 64RX 580RX 590RTX 2080 TiTITAN RTXRTX 2080RTX 2070RTX 2060GTX 1080GTX 1060GTX 1070GTX 1070 TiGTX 1080 TiGTX 980 TiGTX 98090180270360450Min: 239.51 / Avg: 239.65 / Max: 239.92Min: 240.02 / Avg: 240.05 / Max: 240.1Min: 180.53 / Avg: 181.78 / Max: 182.84Min: 202.53 / Avg: 204.83 / Max: 206.95Min: 523.33 / Avg: 525.27 / Max: 526.88Min: 534.04 / Avg: 534.69 / Max: 535.14Min: 415.85 / Avg: 417.86 / Max: 419.38Min: 353.29 / Avg: 355.67 / Max: 357.5Min: 323.76 / Avg: 324.16 / Max: 324.54Min: 245.93 / Avg: 247.4 / Max: 249.28Min: 174.54 / Avg: 174.91 / Max: 175.41Min: 216.83 / Avg: 217.66 / Max: 218.66Min: 214.93 / Avg: 215.11 / Max: 215.23Min: 297.64 / Avg: 298.11 / Max: 298.54Min: 172.95 / Avg: 173.57 / Max: 174.1Min: 154.5 / Avg: 155.12 / Max: 155.76

OpenBenchmarking.orgExamples Per Second, More Is BetterPlaidMLFP16: No - Mode: Inference - Network: Mobilenet - Device: OpenCLRX Vega 56RX Vega 64RX 580RX 590RTX 2080 TiTITAN RTXRTX 2080RTX 2070RTX 2060GTX 1080GTX 1060GTX 1070GTX 1070 TiGTX 1080 TiGTX 980 TiGTX 9802004006008001000SE +/- 5.93, N = 3SE +/- 11.08, N = 12SE +/- 0.73, N = 3SE +/- 0.16, N = 3SE +/- 9.03, N = 3SE +/- 1.87, N = 3SE +/- 3.51, N = 3SE +/- 2.10, N = 3SE +/- 1.48, N = 3SE +/- 0.30, N = 3SE +/- 0.64, N = 3SE +/- 2.92, N = 3SE +/- 0.56, N = 3SE +/- 4.02, N = 3SE +/- 2.78, N = 3SE +/- 1.99, N = 3531546390424962988794767671621485593594687485458
OpenBenchmarking.orgExamples Per Second, More Is BetterPlaidMLFP16: No - Mode: Inference - Network: Mobilenet - Device: OpenCLRX Vega 56RX Vega 64RX 580RX 590RTX 2080 TiTITAN RTXRTX 2080RTX 2070RTX 2060GTX 1080GTX 1060GTX 1070GTX 1070 TiGTX 1080 TiGTX 980 TiGTX 9802004006008001000Min: 521.51 / Avg: 530.93 / Max: 541.88Min: 481.03 / Avg: 545.94 / Max: 613.95Min: 389.42 / Avg: 390.19 / Max: 391.65Min: 424.03 / Avg: 424.23 / Max: 424.54Min: 944.44 / Avg: 962.46 / Max: 972.36Min: 984.02 / Avg: 987.68 / Max: 990.14Min: 787.94 / Avg: 794.27 / Max: 800.04Min: 764.26 / Avg: 767.48 / Max: 771.42Min: 668.46 / Avg: 671.34 / Max: 673.35Min: 621.01 / Avg: 621.36 / Max: 621.96Min: 483.69 / Avg: 484.83 / Max: 485.92Min: 589.01 / Avg: 593.11 / Max: 598.77Min: 593.07 / Avg: 594.18 / Max: 594.86Min: 682.81 / Avg: 687.08 / Max: 695.11Min: 481 / Avg: 484.95 / Max: 490.32Min: 453.78 / Avg: 457.51 / Max: 460.57

OpenBenchmarking.orgExamples Per Second, More Is BetterPlaidMLFP16: No - Mode: Inference - Network: ResNet 50 - Device: OpenCLRX Vega 56RX Vega 64RX 580RX 590RTX 2080 TiTITAN RTXRTX 2080RTX 2070RTX 2060GTX 1080GTX 1060GTX 1070GTX 1070 TiGTX 1080 TiGTX 980 TiGTX 980110220330440550SE +/- 1.86, N = 3SE +/- 4.02, N = 3SE +/- 0.49, N = 3SE +/- 0.64, N = 3SE +/- 4.66, N = 3SE +/- 0.22, N = 3SE +/- 0.08, N = 3SE +/- 0.35, N = 3SE +/- 0.35, N = 3SE +/- 0.28, N = 3SE +/- 0.15, N = 3SE +/- 1.62, N = 3SE +/- 0.51, N = 3SE +/- 0.05, N = 3SE +/- 0.34, N = 3SE +/- 0.53, N = 3213226131139478499373351293275187241249315199172
OpenBenchmarking.orgExamples Per Second, More Is BetterPlaidMLFP16: No - Mode: Inference - Network: ResNet 50 - Device: OpenCLRX Vega 56RX Vega 64RX 580RX 590RTX 2080 TiTITAN RTXRTX 2080RTX 2070RTX 2060GTX 1080GTX 1060GTX 1070GTX 1070 TiGTX 1080 TiGTX 980 TiGTX 98090180270360450Min: 209.03 / Avg: 212.72 / Max: 215.05Min: 218.09 / Avg: 226.07 / Max: 230.8Min: 129.61 / Avg: 130.59 / Max: 131.14Min: 138.08 / Avg: 138.88 / Max: 140.14Min: 468.71 / Avg: 477.9 / Max: 483.85Min: 498.54 / Avg: 498.95 / Max: 499.3Min: 372.98 / Avg: 373.08 / Max: 373.23Min: 350.24 / Avg: 350.68 / Max: 351.38Min: 292.41 / Avg: 293.1 / Max: 293.54Min: 275.2 / Avg: 275.49 / Max: 276.05Min: 187.21 / Avg: 187.38 / Max: 187.67Min: 238.31 / Avg: 241.31 / Max: 243.87Min: 248.88 / Avg: 249.43 / Max: 250.45Min: 314.91 / Avg: 314.97 / Max: 315.07Min: 197.99 / Avg: 198.55 / Max: 199.17Min: 170.81 / Avg: 171.87 / Max: 172.41

OpenBenchmarking.orgExamples Per Second, More Is BetterPlaidMLFP16: Yes - Mode: Inference - Network: Mobilenet - Device: OpenCLRX Vega 56RX Vega 64RX 580RX 590RTX 2080 TiTITAN RTXRTX 2080RTX 2070RTX 2060GTX 1080GTX 1060GTX 1070GTX 1070 TiGTX 1080 TiGTX 980 TiGTX 980150300450600750SE +/- 0.30, N = 3SE +/- 0.64, N = 3SE +/- 1.39, N = 3SE +/- 0.50, N = 3SE +/- 1.64, N = 3SE +/- 5.84, N = 3SE +/- 6.97, N = 12SE +/- 6.98, N = 3SE +/- 7.50, N = 6SE +/- 4.10, N = 3SE +/- 5.36, N = 3SE +/- 1.57, N = 3SE +/- 8.00, N = 4SE +/- 5.47, N = 3SE +/- 2.96, N = 3SE +/- 4.97, N = 3480481435455695698612533538510426476473555421407
OpenBenchmarking.orgExamples Per Second, More Is BetterPlaidMLFP16: Yes - Mode: Inference - Network: Mobilenet - Device: OpenCLRX Vega 56RX Vega 64RX 580RX 590RTX 2080 TiTITAN RTXRTX 2080RTX 2070RTX 2060GTX 1080GTX 1060GTX 1070GTX 1070 TiGTX 1080 TiGTX 980 TiGTX 980120240360480600Min: 479.17 / Avg: 479.78 / Max: 480.1Min: 480.06 / Avg: 481.28 / Max: 482.18Min: 432.75 / Avg: 435.25 / Max: 437.56Min: 454.38 / Avg: 455.07 / Max: 456.05Min: 692.49 / Avg: 694.72 / Max: 697.91Min: 686.09 / Avg: 697.54 / Max: 705.24Min: 588.63 / Avg: 611.54 / Max: 659.5Min: 520.24 / Avg: 532.63 / Max: 544.4Min: 519.27 / Avg: 538.23 / Max: 568.52Min: 501.95 / Avg: 509.88 / Max: 515.62Min: 414.95 / Avg: 425.54 / Max: 432.25Min: 472.58 / Avg: 475.72 / Max: 477.47Min: 456.19 / Avg: 473.42 / Max: 493.34Min: 543.87 / Avg: 554.81 / Max: 560.66Min: 415.83 / Avg: 420.97 / Max: 426.07Min: 400.68 / Avg: 407.08 / Max: 416.86

OpenBenchmarking.orgExamples Per Second, More Is BetterPlaidMLFP16: Yes - Mode: Inference - Network: ResNet 50 - Device: OpenCLRX Vega 56RX Vega 64RX 580RX 590RTX 2080 TiTITAN RTXRTX 2080RTX 2070RTX 2060GTX 1080GTX 1060GTX 1070GTX 1070 TiGTX 1080 TiGTX 980 TiGTX 98090180270360450SE +/- 0.02, N = 3SE +/- 0.88, N = 3SE +/- 0.32, N = 3SE +/- 0.04, N = 3SE +/- 0.30, N = 3SE +/- 0.23, N = 3SE +/- 0.43, N = 3SE +/- 0.17, N = 3SE +/- 6.28, N = 11SE +/- 0.31, N = 3SE +/- 2.69, N = 3SE +/- 0.06, N = 3SE +/- 0.17, N = 3SE +/- 0.73, N = 3SE +/- 0.23, N = 3SE +/- 0.19, N = 3192212121129417428330311259248173221226311199175
OpenBenchmarking.orgExamples Per Second, More Is BetterPlaidMLFP16: Yes - Mode: Inference - Network: ResNet 50 - Device: OpenCLRX Vega 56RX Vega 64RX 580RX 590RTX 2080 TiTITAN RTXRTX 2080RTX 2070RTX 2060GTX 1080GTX 1060GTX 1070GTX 1070 TiGTX 1080 TiGTX 980 TiGTX 98080160240320400Min: 191.93 / Avg: 191.95 / Max: 191.98Min: 210.32 / Avg: 211.6 / Max: 213.3Min: 120.23 / Avg: 120.87 / Max: 121.25Min: 128.74 / Avg: 128.81 / Max: 128.86Min: 416.12 / Avg: 416.71 / Max: 417.01Min: 427.82 / Avg: 428.25 / Max: 428.61Min: 329.66 / Avg: 330.33 / Max: 331.14Min: 311.02 / Avg: 311.35 / Max: 311.6Min: 196.07 / Avg: 258.7 / Max: 265.83Min: 247.79 / Avg: 248.32 / Max: 248.85Min: 167.6 / Avg: 172.99 / Max: 175.75Min: 221.11 / Avg: 221.23 / Max: 221.32Min: 226.18 / Avg: 226.4 / Max: 226.73Min: 309.41 / Avg: 310.67 / Max: 311.95Min: 198.18 / Avg: 198.51 / Max: 198.95Min: 174.35 / Avg: 174.63 / Max: 174.98

OpenBenchmarking.orgExamples Per Second, More Is BetterPlaidMLFP16: No - Mode: Training - Network: Inception V3 - Device: OpenCLRX Vega 56RX Vega 64RX 580RX 590RTX 2080 TiTITAN RTXRTX 2080RTX 2070GTX 1080GTX 1060GTX 1070GTX 1070 TiGTX 1080 Ti918273645SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.03, N = 3SE +/- 0.04, N = 3SE +/- 0.14, N = 3SE +/- 0.29, N = 3SE +/- 0.07, N = 3SE +/- 0.05, N = 3SE +/- 0.10, N = 3SE +/- 0.02, N = 3SE +/- 0.02, N = 3SE +/- 0.03, N = 319.8620.9813.1514.5937.6737.4132.8031.4428.4421.5826.2126.0033.10
OpenBenchmarking.orgExamples Per Second, More Is BetterPlaidMLFP16: No - Mode: Training - Network: Inception V3 - Device: OpenCLRX Vega 56RX Vega 64RX 580RX 590RTX 2080 TiTITAN RTXRTX 2080RTX 2070GTX 1080GTX 1060GTX 1070GTX 1070 TiGTX 1080 Ti816243240Min: 19.85 / Avg: 19.86 / Max: 19.89Min: 20.95 / Avg: 20.98 / Max: 20.99Min: 13.11 / Avg: 13.15 / Max: 13.2Min: 14.55 / Avg: 14.59 / Max: 14.67Min: 37.44 / Avg: 37.67 / Max: 37.92Min: 36.84 / Avg: 37.41 / Max: 37.82Min: 32.71 / Avg: 32.8 / Max: 32.94Min: 28.37 / Avg: 28.44 / Max: 28.55Min: 21.4 / Avg: 21.58 / Max: 21.72Min: 26.18 / Avg: 26.21 / Max: 26.25Min: 25.98 / Avg: 26 / Max: 26.03Min: 33.05 / Avg: 33.1 / Max: 33.14

OpenBenchmarking.orgExamples Per Second, More Is BetterPlaidMLFP16: No - Mode: Inference - Network: DenseNet 201 - Device: OpenCLRX Vega 56RX Vega 64RX 580RX 590RTX 2080 TiTITAN RTXRTX 2080RTX 2070RTX 2060GTX 1080GTX 1060GTX 1070GTX 1070 TiGTX 1080 TiGTX 980 TiGTX 9804080120160200SE +/- 0.02, N = 3SE +/- 0.03, N = 3SE +/- 0.08, N = 3SE +/- 0.02, N = 3SE +/- 2.09, N = 3SE +/- 0.42, N = 3SE +/- 0.13, N = 3SE +/- 0.11, N = 3SE +/- 0.04, N = 3SE +/- 0.01, N = 3SE +/- 0.00, N = 3SE +/- 0.01, N = 3SE +/- 0.04, N = 3SE +/- 0.13, N = 3SE +/- 0.11, N = 3SE +/- 0.04, N = 395.87106.4462.3467.50150.01161.32118.65115.6595.8890.8362.2783.8983.55119.8078.8863.96
OpenBenchmarking.orgExamples Per Second, More Is BetterPlaidMLFP16: No - Mode: Inference - Network: DenseNet 201 - Device: OpenCLRX Vega 56RX Vega 64RX 580RX 590RTX 2080 TiTITAN RTXRTX 2080RTX 2070RTX 2060GTX 1080GTX 1060GTX 1070GTX 1070 TiGTX 1080 TiGTX 980 TiGTX 980306090120150Min: 95.84 / Avg: 95.87 / Max: 95.92Min: 106.38 / Avg: 106.44 / Max: 106.47Min: 62.19 / Avg: 62.34 / Max: 62.43Min: 67.46 / Avg: 67.5 / Max: 67.54Min: 145.82 / Avg: 150.01 / Max: 152.13Min: 160.6 / Avg: 161.32 / Max: 162.06Min: 118.51 / Avg: 118.65 / Max: 118.9Min: 115.46 / Avg: 115.65 / Max: 115.85Min: 95.8 / Avg: 95.88 / Max: 95.94Min: 90.81 / Avg: 90.83 / Max: 90.86Min: 62.27 / Avg: 62.27 / Max: 62.28Min: 83.88 / Avg: 83.89 / Max: 83.91Min: 83.48 / Avg: 83.55 / Max: 83.59Min: 119.54 / Avg: 119.8 / Max: 119.97Min: 78.7 / Avg: 78.88 / Max: 79.09Min: 63.88 / Avg: 63.96 / Max: 64.01

OpenBenchmarking.orgExamples Per Second, More Is BetterPlaidMLFP16: No - Mode: Inference - Network: Inception V3 - Device: OpenCLRX Vega 56RX Vega 64RX 580RX 590RTX 2080 TiTITAN RTXRTX 2080RTX 2070RTX 2060GTX 1080GTX 1060GTX 1070GTX 1070 TiGTX 1080 TiGTX 980 TiGTX 98050100150200250SE +/- 1.56, N = 3SE +/- 0.77, N = 3SE +/- 0.95, N = 3SE +/- 1.29, N = 3SE +/- 3.98, N = 12SE +/- 0.31, N = 3SE +/- 0.12, N = 3SE +/- 0.61, N = 3SE +/- 1.89, N = 3SE +/- 1.75, N = 12SE +/- 1.04, N = 7SE +/- 1.68, N = 5SE +/- 0.05, N = 3SE +/- 0.42, N = 3SE +/- 1.44, N = 5SE +/- 1.08, N = 3104.00118.0066.1971.42197.56211.69161.94147.39124.84124.6582.03108.50113.61158.2096.6981.03
OpenBenchmarking.orgExamples Per Second, More Is BetterPlaidMLFP16: No - Mode: Inference - Network: Inception V3 - Device: OpenCLRX Vega 56RX Vega 64RX 580RX 590RTX 2080 TiTITAN RTXRTX 2080RTX 2070RTX 2060GTX 1080GTX 1060GTX 1070GTX 1070 TiGTX 1080 TiGTX 980 TiGTX 9804080120160200Min: 101.28 / Avg: 104.11 / Max: 106.65Min: 116.45 / Avg: 117.91 / Max: 119.04Min: 64.3 / Avg: 66.19 / Max: 67.27Min: 69.11 / Avg: 71.42 / Max: 73.56Min: 176.08 / Avg: 197.56 / Max: 207.85Min: 211.24 / Avg: 211.69 / Max: 212.29Min: 161.73 / Avg: 161.94 / Max: 162.16Min: 146.5 / Avg: 147.39 / Max: 148.55Min: 121.06 / Avg: 124.84 / Max: 126.92Min: 116.74 / Avg: 124.65 / Max: 131.35Min: 77.93 / Avg: 82.03 / Max: 83.83Min: 101.79 / Avg: 108.5 / Max: 110.47Min: 113.5 / Avg: 113.61 / Max: 113.66Min: 157.46 / Avg: 158.2 / Max: 158.93Min: 91.04 / Avg: 96.69 / Max: 98.59Min: 78.91 / Avg: 81.03 / Max: 82.47

OpenBenchmarking.orgExamples Per Second, More Is BetterPlaidMLFP16: No - Mode: Inference - Network: NASNer Large - Device: OpenCLRX Vega 56RX Vega 64RX 580RX 590RTX 2080 TiTITAN RTXRTX 2080RTX 2070RTX 2060GTX 1080GTX 1060GTX 1070GTX 1070 TiGTX 1080 TiGTX 980 TiGTX 9801326395265SE +/- 0.02, N = 3SE +/- 0.13, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.11, N = 3SE +/- 0.10, N = 3SE +/- 0.06, N = 3SE +/- 0.07, N = 3SE +/- 0.04, N = 3SE +/- 0.02, N = 3SE +/- 0.01, N = 3SE +/- 0.03, N = 3SE +/- 0.00, N = 3SE +/- 0.10, N = 3SE +/- 0.03, N = 3SE +/- 0.05, N = 331.0835.8918.0820.0156.7759.1341.5736.0129.4230.9218.2725.3126.5742.7524.3218.89
OpenBenchmarking.orgExamples Per Second, More Is BetterPlaidMLFP16: No - Mode: Inference - Network: NASNer Large - Device: OpenCLRX Vega 56RX Vega 64RX 580RX 590RTX 2080 TiTITAN RTXRTX 2080RTX 2070RTX 2060GTX 1080GTX 1060GTX 1070GTX 1070 TiGTX 1080 TiGTX 980 TiGTX 9801224364860Min: 31.05 / Avg: 31.08 / Max: 31.13Min: 35.65 / Avg: 35.89 / Max: 36.08Min: 18.06 / Avg: 18.08 / Max: 18.08Min: 20.01 / Avg: 20.01 / Max: 20.03Min: 56.66 / Avg: 56.77 / Max: 56.98Min: 59 / Avg: 59.13 / Max: 59.32Min: 41.49 / Avg: 41.57 / Max: 41.68Min: 35.92 / Avg: 36.01 / Max: 36.14Min: 29.37 / Avg: 29.42 / Max: 29.5Min: 30.89 / Avg: 30.92 / Max: 30.97Min: 18.25 / Avg: 18.27 / Max: 18.29Min: 25.28 / Avg: 25.31 / Max: 25.37Min: 26.56 / Avg: 26.57 / Max: 26.57Min: 42.57 / Avg: 42.75 / Max: 42.9Min: 24.25 / Avg: 24.32 / Max: 24.36Min: 18.82 / Avg: 18.89 / Max: 19

OpenBenchmarking.orgExamples Per Second, More Is BetterPlaidMLFP16: Yes - Mode: Inference - Network: DenseNet 201 - Device: OpenCLRTX 2080 TiTITAN RTXRTX 2080RTX 2070RTX 2060GTX 1080GTX 1060GTX 1070GTX 1070 TiGTX 1080 TiGTX 980 TiGTX 980306090120150SE +/- 1.79, N = 7SE +/- 2.16, N = 3SE +/- 0.10, N = 3SE +/- 0.17, N = 3SE +/- 0.18, N = 3SE +/- 0.02, N = 3SE +/- 0.02, N = 3SE +/- 0.06, N = 3SE +/- 0.03, N = 3SE +/- 0.11, N = 3SE +/- 0.09, N = 3SE +/- 0.03, N = 3139.00148.00111.00108.0089.0285.6058.7679.0878.45114.9776.1561.38
OpenBenchmarking.orgExamples Per Second, More Is BetterPlaidMLFP16: Yes - Mode: Inference - Network: DenseNet 201 - Device: OpenCLRTX 2080 TiTITAN RTXRTX 2080RTX 2070RTX 2060GTX 1080GTX 1060GTX 1070GTX 1070 TiGTX 1080 TiGTX 980 TiGTX 980306090120150Min: 128.05 / Avg: 138.73 / Max: 141.26Min: 143.57 / Avg: 147.89 / Max: 150.34Min: 111.12 / Avg: 111.26 / Max: 111.46Min: 108.18 / Avg: 108.37 / Max: 108.7Min: 88.69 / Avg: 89.02 / Max: 89.32Min: 85.58 / Avg: 85.6 / Max: 85.64Min: 58.73 / Avg: 58.76 / Max: 58.8Min: 78.98 / Avg: 79.08 / Max: 79.18Min: 78.4 / Avg: 78.45 / Max: 78.48Min: 114.86 / Avg: 114.97 / Max: 115.2Min: 76.01 / Avg: 76.15 / Max: 76.32Min: 61.32 / Avg: 61.38 / Max: 61.44

OpenBenchmarking.orgExamples Per Second, More Is BetterPlaidMLFP16: Yes - Mode: Inference - Network: Inception V3 - Device: OpenCLRTX 2080 TiTITAN RTXRTX 2080RTX 2070RTX 2060GTX 1080GTX 1060GTX 1070GTX 1070 TiGTX 1080 TiGTX 980 TiGTX 9804080120160200SE +/- 3.75, N = 12SE +/- 0.41, N = 3SE +/- 2.75, N = 12SE +/- 2.27, N = 12SE +/- 2.35, N = 3SE +/- 0.17, N = 3SE +/- 0.27, N = 3SE +/- 0.16, N = 3SE +/- 1.45, N = 7SE +/- 0.55, N = 3SE +/- 1.04, N = 12SE +/- 0.15, N = 3192.00203.00153.00142.00126.00130.0086.75112.31114.33160.18104.1089.26
OpenBenchmarking.orgExamples Per Second, More Is BetterPlaidMLFP16: Yes - Mode: Inference - Network: Inception V3 - Device: OpenCLRTX 2080 TiTITAN RTXRTX 2080RTX 2070RTX 2060GTX 1080GTX 1060GTX 1070GTX 1070 TiGTX 1080 TiGTX 980 TiGTX 9804080120160200Min: 170.33 / Avg: 192.24 / Max: 201.99Min: 201.81 / Avg: 202.62 / Max: 203.14Min: 140.65 / Avg: 152.61 / Max: 161.23Min: 131.81 / Avg: 142.23 / Max: 148.96Min: 121.42 / Avg: 126.11 / Max: 128.68Min: 129.37 / Avg: 129.63 / Max: 129.95Min: 86.21 / Avg: 86.75 / Max: 87.08Min: 112.02 / Avg: 112.31 / Max: 112.57Min: 105.61 / Avg: 114.33 / Max: 115.95Min: 159.36 / Avg: 160.18 / Max: 161.24Min: 95.65 / Avg: 104.1 / Max: 106.64Min: 88.96 / Avg: 89.26 / Max: 89.46

OpenBenchmarking.orgExamples Per Second, More Is BetterPlaidMLFP16: Yes - Mode: Inference - Network: NASNer Large - Device: OpenCLRTX 2080 TiTITAN RTXRTX 2080RTX 2070RTX 2060GTX 1080GTX 1060GTX 1070GTX 1070 TiGTX 1080 TiGTX 980 TiGTX 9801632486480SE +/- 0.89, N = 3SE +/- 0.16, N = 3SE +/- 0.06, N = 3SE +/- 0.09, N = 3SE +/- 0.07, N = 3SE +/- 0.10, N = 3SE +/- 0.02, N = 3SE +/- 0.03, N = 3SE +/- 0.06, N = 3SE +/- 0.08, N = 3SE +/- 0.04, N = 3SE +/- 0.08, N = 369.7072.6151.5444.3437.6037.0222.1730.2032.6547.6326.9023.22
OpenBenchmarking.orgExamples Per Second, More Is BetterPlaidMLFP16: Yes - Mode: Inference - Network: NASNer Large - Device: OpenCLRTX 2080 TiTITAN RTXRTX 2080RTX 2070RTX 2060GTX 1080GTX 1060GTX 1070GTX 1070 TiGTX 1080 TiGTX 980 TiGTX 9801428425670Min: 67.94 / Avg: 69.7 / Max: 70.84Min: 72.3 / Avg: 72.61 / Max: 72.85Min: 51.48 / Avg: 51.54 / Max: 51.65Min: 44.24 / Avg: 44.34 / Max: 44.51Min: 37.53 / Avg: 37.6 / Max: 37.73Min: 36.85 / Avg: 37.02 / Max: 37.2Min: 22.15 / Avg: 22.17 / Max: 22.21Min: 30.16 / Avg: 30.2 / Max: 30.26Min: 32.54 / Avg: 32.65 / Max: 32.75Min: 47.48 / Avg: 47.63 / Max: 47.72Min: 26.85 / Avg: 26.9 / Max: 26.98Min: 23.1 / Avg: 23.22 / Max: 23.36