PlaidML OpenCL Linux GPU Benchmarks AMD Radeon + NVIDIA GeForce

PlaidML Linux benchmarks for a future article on Phoronix.com by Michael Larabel.

Compare your own system(s) to this result file with the Phoronix Test Suite by running the command: phoronix-test-suite benchmark 1901122-PTS-PLAIDMLG16
Jump To Table - Results

View

Do Not Show Noisy Results
Do Not Show Results With Incomplete Data
Do Not Show Results With Little Change/Spread
List Notable Results

Statistics

Show Overall Harmonic Mean(s)
Show Overall Geometric Mean
Show Wins / Losses Counts (Pie Chart)
Normalize Results
Remove Outliers Before Calculating Averages

Graph Settings

Force Line Graphs Where Applicable
Convert To Scalar Where Applicable
Disable Color Branding
Prefer Vertical Bar Graphs

Multi-Way Comparison

Condense Multi-Option Tests Into Single Result Graphs

Table

Show Detailed System Result Table

Run Management

Highlight
Result
Hide
Result
Result
Identifier
Performance Per
Dollar
Date
Run
  Test
  Duration
RX 580
January 10 2019
  1 Hour, 18 Minutes
RX 590
January 11 2019
  1 Hour, 18 Minutes
RX Vega 56
January 10 2019
  53 Minutes
RX Vega 64
January 10 2019
  53 Minutes
GTX 980
January 12 2019
  37 Minutes
GTX 980 Ti
January 12 2019
  45 Minutes
GTX 1060
January 11 2019
  52 Minutes
GTX 1070
January 11 2019
  47 Minutes
GTX 1070 Ti
January 11 2019
  47 Minutes
GTX 1080
January 11 2019
  50 Minutes
GTX 1080 Ti
January 12 2019
  37 Minutes
RTX 2060
January 11 2019
  31 Minutes
RTX 2070
January 11 2019
  41 Minutes
RTX 2080
January 11 2019
  43 Minutes
RTX 2080 Ti
January 11 2019
  44 Minutes
TITAN RTX
January 11 2019
  35 Minutes
Invert Hiding All Results Option
  48 Minutes

Only show results where is faster than
Only show results matching title/arguments (delimit multiple options with a comma):
Do not show results matching title/arguments (delimit multiple options with a comma):


PlaidML OpenCL Linux GPU Benchmarks AMD Radeon + NVIDIA GeForceProcessorMotherboardChipsetMemoryDiskGraphicsAudioMonitorNetworkOSKernelDesktopDisplay ServerDisplay DriverOpenGLCompilerFile-SystemScreen ResolutionVulkanRX 580RX 590RX Vega 56RX Vega 64GTX 980GTX 980 TiGTX 1060GTX 1070GTX 1070 TiGTX 1080GTX 1080 TiRTX 2060RTX 2070RTX 2080RTX 2080 TiTITAN RTXAMD Ryzen Threadripper 2990WX 32-Core @ 3.00GHz (32 Cores / 64 Threads)ASUS ROG ZENITH EXTREME (1601 BIOS)AMD Family 17h32768MBSamsung SSD 970 EVO 500GBMSI AMD Radeon RX 470/480/570/570X/580/580X 8GB (1366/2000MHz)Realtek ALC1220ASUS VP28UIntel I211 Gigabit + Qualcomm Atheros QCA6174 802.11ac + Wilocity Wil6200 802.11adUbuntu 18.104.19.0-041900-generic (x86_64)GNOME Shell 3.30.1X Server 1.20.1modesetting 1.20.14.5 Mesa 18.2.2 (LLVM 7.0.0)GCC 8.2.0ext43840x2160Sapphire AMD Radeon RX 470/480/570/570X/580/580X 8GB (1560/2100MHz)4.20.0-042000-generic (x86_64)AMD Radeon RX 64 8GB (1590/800MHz)4.19.0-041900-generic (x86_64)amdgpu 18.1.0AMD Radeon RX 64 8GB (1630/945MHz)NVIDIA GeForce GTX 980 4GB (1126/3505MHz)Intel I211 + Qualcomm Atheros QCA6174 802.11ac + Wilocity Wil6200 802.11ad4.20.0-042000-generic (x86_64)NVIDIA 415.254.6.01.1.84NVIDIA GeForce GTX 980 Ti 6GB (999/3505MHz)NVIDIA GeForce GTX 1060 6GB (1506/4006MHz)NVIDIA GeForce GTX 1070 8GB (1506/4006MHz)Zotac NVIDIA GeForce GTX 1070 Ti 8GB (1607/4006MHz)NVIDIA GeForce GTX 1080 8GB (1607/5005MHz)NVIDIA GeForce GTX 1080 Ti 11GB (1480/5508MHz)Device 6GB (1365/7000MHz)ASUS NVIDIA GeForce RTX 2070 8GB (1410/7000MHz)Zotac NVIDIA GeForce RTX 2080 8GB (1515/7000MHz)NVIDIA GeForce RTX 2080 Ti 11GB (1350/7000MHz)Intel I211 Gigabit + Qualcomm Atheros QCA6174 802.11ac + Wilocity Wil6200 802.11adNVIDIA TITAN RTX 24GB (1350/7000MHz)Intel I211 + Qualcomm Atheros QCA6174 802.11ac + Wilocity Wil6200 802.11adOpenBenchmarking.orgProcessor Details- Scaling Governor: acpi-cpufreq ondemandGraphics Details- RX 580, RX 590, RX Vega 56, RX Vega 64: GLAMORPython Details- Python 2.7.15+ + Python 3.6.7Security Details- RX 580: __user pointer sanitization + Full AMD retpoline IBPB + SSB disabled via prctl and seccomp- RX 590: __user pointer sanitization + Full AMD retpoline IBPB: conditional STIBP: disabled RSB filling + SSB disabled via prctl and seccomp- RX Vega 56: __user pointer sanitization + Full AMD retpoline IBPB + SSB disabled via prctl and seccomp- RX Vega 64: __user pointer sanitization + Full AMD retpoline IBPB + SSB disabled via prctl and seccomp- GTX 980: __user pointer sanitization + Full AMD retpoline IBPB: conditional STIBP: disabled RSB filling + SSB disabled via prctl and seccomp- GTX 980 Ti: __user pointer sanitization + Full AMD retpoline IBPB: conditional STIBP: disabled RSB filling + SSB disabled via prctl and seccomp- GTX 1060: __user pointer sanitization + Full AMD retpoline IBPB: conditional STIBP: disabled RSB filling + SSB disabled via prctl and seccomp- GTX 1070: __user pointer sanitization + Full AMD retpoline IBPB: conditional STIBP: disabled RSB filling + SSB disabled via prctl and seccomp- GTX 1070 Ti: __user pointer sanitization + Full AMD retpoline IBPB: conditional STIBP: disabled RSB filling + SSB disabled via prctl and seccomp- GTX 1080: __user pointer sanitization + Full AMD retpoline IBPB: conditional STIBP: disabled RSB filling + SSB disabled via prctl and seccomp- GTX 1080 Ti: __user pointer sanitization + Full AMD retpoline IBPB: conditional STIBP: disabled RSB filling + SSB disabled via prctl and seccomp- RTX 2060: __user pointer sanitization + Full AMD retpoline IBPB: conditional STIBP: disabled RSB filling + SSB disabled via prctl and seccomp- RTX 2070: __user pointer sanitization + Full AMD retpoline IBPB: conditional STIBP: disabled RSB filling + SSB disabled via prctl and seccomp- RTX 2080: __user pointer sanitization + Full AMD retpoline IBPB: conditional STIBP: disabled RSB filling + SSB disabled via prctl and seccomp- RTX 2080 Ti: __user pointer sanitization + Full AMD retpoline IBPB: conditional STIBP: disabled RSB filling + SSB disabled via prctl and seccomp- TITAN RTX: __user pointer sanitization + Full AMD retpoline IBPB: conditional STIBP: disabled RSB filling + SSB disabled via prctl and seccompOpenCL Details- GTX 980: GPU Compute Cores: 2048- GTX 980 Ti: GPU Compute Cores: 2816- GTX 1060: GPU Compute Cores: 1280- GTX 1070: GPU Compute Cores: 1920- GTX 1070 Ti: GPU Compute Cores: 2432- GTX 1080: GPU Compute Cores: 2560- GTX 1080 Ti: GPU Compute Cores: 3584- RTX 2060: GPU Compute Cores: 1920- RTX 2070: GPU Compute Cores: 2304- RTX 2080: GPU Compute Cores: 2944- RTX 2080 Ti: GPU Compute Cores: 4352- TITAN RTX: GPU Compute Cores: 4608

RX 580RX 590RX Vega 56RX Vega 64GTX 980GTX 980 TiGTX 1060GTX 1070GTX 1070 TiGTX 1080GTX 1080 TiRTX 2060RTX 2070RTX 2080RTX 2080 TiTITAN RTXResult OverviewPhoronix Test Suite100%183%265%348%430%PlaidMLPlaidMLPlaidMLPlaidMLPlaidMLPlaidMLPlaidMLPlaidMLPlaidMLPlaidMLPlaidMLPlaidMLPlaidMLPlaidMLNo - Inference - VGG19 - OpenCLYes - Inference - VGG19 - OpenCLNo - Inference - VGG16 - OpenCLYes - Inference - VGG16 - OpenCLNo - Inference - ResNet 50 - OpenCLYes - Inference - ResNet 50 - OpenCLNo - Inference - IMDB LSTM - OpenCLNo - Training - Mobilenet - OpenCLNo - Inference - NASNer Large - OpenCLNo - Inference - Inception V3 - OpenCLNo - Inference - DenseNet 201 - OpenCLNo - Inference - Mobilenet - OpenCLNo - Training - IMDB LSTM - OpenCLYes - Inference - Mobilenet - OpenCL

PlaidML OpenCL Linux GPU Benchmarks AMD Radeon + NVIDIA GeForceplaidml: No - Training - VGG16 - OpenCLplaidml: No - Training - VGG19 - OpenCLplaidml: No - Inference - VGG16 - OpenCLplaidml: No - Inference - VGG19 - OpenCLplaidml: Yes - Inference - VGG16 - OpenCLplaidml: Yes - Inference - VGG19 - OpenCLplaidml: No - Training - IMDB LSTM - OpenCLplaidml: No - Training - Mobilenet - OpenCLplaidml: No - Inference - IMDB LSTM - OpenCLplaidml: No - Inference - Mobilenet - OpenCLplaidml: No - Inference - ResNet 50 - OpenCLplaidml: Yes - Inference - Mobilenet - OpenCLplaidml: Yes - Inference - ResNet 50 - OpenCLplaidml: No - Training - Inception V3 - OpenCLplaidml: No - Inference - DenseNet 201 - OpenCLplaidml: No - Inference - Inception V3 - OpenCLplaidml: No - Inference - NASNer Large - OpenCLplaidml: Yes - Inference - DenseNet 201 - OpenCLplaidml: Yes - Inference - Inception V3 - OpenCLplaidml: Yes - Inference - NASNer Large - OpenCLRX 580RX 590RX Vega 56RX Vega 64GTX 980GTX 980 TiGTX 1060GTX 1070GTX 1070 TiGTX 1080GTX 1080 TiRTX 2060RTX 2070RTX 2080RTX 2080 TiTITAN RTX10.429.6764.5555.2658.9251.5911941.6418239013143512113.1562.3466.1918.089.528.9267.7158.3161.6553.8513345.2120542413945512914.5967.5071.4220.0128.7825.6610994.4110791.3216471.2924053121348019219.8695.8710431.0830.8528.15123107.32120103.9316975.2324054622648121220.98106.4411835.8994.8480.3796.8283.1910878.4715545817240717563.9681.0318.8961.3889.2623.2240.14119.20101.40121.68104.7412283.6617448519942119978.8896.6924.3276.15104.1026.9034.0793.0078.1392.1979.2911981.6517548518742617321.5862.2782.0318.2758.7686.7522.1745.9739.22125.37106.35122.54105.7713598.4521859324147622126.2183.89108.5025.3179.08112.3130.2046.7340.33128.85109.40125.60108.8513395.5221559424947322626.0083.55113.6126.5778.45114.3332.6550.0942.92138.78117.24134.68115.9014294.4724762127551024828.4490.83124.6530.9285.6013037.0266.5557.60181.25156.28180.71159.02165113.5529868731555531133.10119.80158.2042.75114.97160.1847.63147.16124.18143.80121.98157103.3032467129353825995.88124.8429.4289.0212637.6063.7154.76183.95155.08172.84148.93164119.8435676735153331131.44115.65147.3936.0110814244.3467.5958.55197.52168.53185.76161.16175120.2441879437361233032.80118.65161.9441.5711115351.5485.4574.75258.50221.88236.13207.30192138.1152596247869541737.67150.01197.5656.7713919269.7090.8479.58274.89237.71250.30220.89191142.3653598849969842837.41161.32211.6959.1314820372.61OpenBenchmarking.org

PlaidML

This test profile uses PlaidML deep learning framework for offering up various benchmarks. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgExamples Per Second, More Is BetterPlaidMLFP16: No - Mode: Training - Network: VGG16 - Device: OpenCLRX 580RX 590RX Vega 56RX Vega 64GTX 980 TiGTX 1060GTX 1070GTX 1070 TiGTX 1080GTX 1080 TiRTX 2070RTX 2080RTX 2080 TiTITAN RTX20406080100SE +/- 0.00, N = 3SE +/- 0.01, N = 3SE +/- 0.02, N = 3SE +/- 0.13, N = 3SE +/- 0.28, N = 3SE +/- 0.04, N = 3SE +/- 0.06, N = 3SE +/- 0.05, N = 3SE +/- 0.04, N = 3SE +/- 0.15, N = 3SE +/- 0.21, N = 3SE +/- 0.26, N = 3SE +/- 0.13, N = 3SE +/- 0.18, N = 310.429.5228.7830.8540.1434.0745.9746.7350.0966.5563.7167.5985.4590.84
OpenBenchmarking.orgExamples Per Second, More Is BetterPlaidMLFP16: No - Mode: Training - Network: VGG16 - Device: OpenCLRX 580RX 590RX Vega 56RX Vega 64GTX 980 TiGTX 1060GTX 1070GTX 1070 TiGTX 1080GTX 1080 TiRTX 2070RTX 2080RTX 2080 TiTITAN RTX20406080100Min: 10.41 / Avg: 10.42 / Max: 10.43Min: 9.51 / Avg: 9.52 / Max: 9.52Min: 28.76 / Avg: 28.78 / Max: 28.82Min: 30.61 / Avg: 30.85 / Max: 31.04Min: 39.58 / Avg: 40.14 / Max: 40.43Min: 34.03 / Avg: 34.07 / Max: 34.15Min: 45.88 / Avg: 45.97 / Max: 46.09Min: 46.63 / Avg: 46.73 / Max: 46.78Min: 50.02 / Avg: 50.09 / Max: 50.15Min: 66.32 / Avg: 66.55 / Max: 66.82Min: 63.39 / Avg: 63.71 / Max: 64.09Min: 67.17 / Avg: 67.59 / Max: 68.06Min: 85.3 / Avg: 85.45 / Max: 85.7Min: 90.57 / Avg: 90.84 / Max: 91.19

OpenBenchmarking.orgExamples Per Second, More Is BetterPlaidMLFP16: No - Mode: Training - Network: VGG19 - Device: OpenCLRX 580RX 590RX Vega 56RX Vega 64GTX 1070GTX 1070 TiGTX 1080GTX 1080 TiRTX 2070RTX 2080RTX 2080 TiTITAN RTX20406080100SE +/- 0.00, N = 3SE +/- 0.01, N = 3SE +/- 0.19, N = 3SE +/- 0.02, N = 3SE +/- 0.07, N = 3SE +/- 0.03, N = 3SE +/- 0.08, N = 3SE +/- 0.07, N = 3SE +/- 0.12, N = 3SE +/- 0.07, N = 3SE +/- 0.09, N = 3SE +/- 0.16, N = 39.678.9225.6628.1539.2240.3342.9257.6054.7658.5574.7579.58
OpenBenchmarking.orgExamples Per Second, More Is BetterPlaidMLFP16: No - Mode: Training - Network: VGG19 - Device: OpenCLRX 580RX 590RX Vega 56RX Vega 64GTX 1070GTX 1070 TiGTX 1080GTX 1080 TiRTX 2070RTX 2080RTX 2080 TiTITAN RTX1530456075Min: 9.67 / Avg: 9.67 / Max: 9.68Min: 8.9 / Avg: 8.92 / Max: 8.92Min: 25.31 / Avg: 25.66 / Max: 25.95Min: 28.11 / Avg: 28.15 / Max: 28.17Min: 39.09 / Avg: 39.22 / Max: 39.33Min: 40.27 / Avg: 40.33 / Max: 40.38Min: 42.82 / Avg: 42.92 / Max: 43.08Min: 57.49 / Avg: 57.6 / Max: 57.72Min: 54.63 / Avg: 54.76 / Max: 55.01Min: 58.46 / Avg: 58.55 / Max: 58.69Min: 74.64 / Avg: 74.75 / Max: 74.92Min: 79.41 / Avg: 79.58 / Max: 79.9

OpenBenchmarking.orgExamples Per Second, More Is BetterPlaidMLFP16: No - Mode: Inference - Network: VGG16 - Device: OpenCLRX 580RX 590RX Vega 56RX Vega 64GTX 980GTX 980 TiGTX 1060GTX 1070GTX 1070 TiGTX 1080GTX 1080 TiRTX 2060RTX 2070RTX 2080RTX 2080 TiTITAN RTX60120180240300SE +/- 0.03, N = 3SE +/- 0.51, N = 3SE +/- 0.77, N = 3SE +/- 1.73, N = 3SE +/- 0.06, N = 3SE +/- 0.14, N = 3SE +/- 0.06, N = 3SE +/- 0.40, N = 3SE +/- 0.06, N = 3SE +/- 0.09, N = 3SE +/- 0.45, N = 3SE +/- 0.18, N = 3SE +/- 0.03, N = 3SE +/- 0.14, N = 3SE +/- 0.25, N = 3SE +/- 1.45, N = 364.5567.71109.00123.0094.84119.2093.00125.37128.85138.78181.25147.16183.95197.52258.50274.89
OpenBenchmarking.orgExamples Per Second, More Is BetterPlaidMLFP16: No - Mode: Inference - Network: VGG16 - Device: OpenCLRX 580RX 590RX Vega 56RX Vega 64GTX 980GTX 980 TiGTX 1060GTX 1070GTX 1070 TiGTX 1080GTX 1080 TiRTX 2060RTX 2070RTX 2080RTX 2080 TiTITAN RTX50100150200250Min: 64.5 / Avg: 64.55 / Max: 64.61Min: 66.7 / Avg: 67.71 / Max: 68.23Min: 107.54 / Avg: 108.73 / Max: 110.16Min: 120.86 / Avg: 122.61 / Max: 126.08Min: 94.72 / Avg: 94.84 / Max: 94.91Min: 118.99 / Avg: 119.2 / Max: 119.45Min: 92.93 / Avg: 93 / Max: 93.12Min: 124.57 / Avg: 125.37 / Max: 125.78Min: 128.75 / Avg: 128.85 / Max: 128.96Min: 138.62 / Avg: 138.78 / Max: 138.92Min: 180.38 / Avg: 181.25 / Max: 181.85Min: 146.96 / Avg: 147.16 / Max: 147.53Min: 183.91 / Avg: 183.95 / Max: 184.01Min: 197.29 / Avg: 197.52 / Max: 197.78Min: 258.23 / Avg: 258.5 / Max: 259Min: 272 / Avg: 274.89 / Max: 276.54

OpenBenchmarking.orgExamples Per Second, More Is BetterPlaidMLFP16: No - Mode: Inference - Network: VGG19 - Device: OpenCLRX 580RX 590RX Vega 56RX Vega 64GTX 980GTX 980 TiGTX 1060GTX 1070GTX 1070 TiGTX 1080GTX 1080 TiRTX 2060RTX 2070RTX 2080RTX 2080 TiTITAN RTX50100150200250SE +/- 0.06, N = 3SE +/- 0.34, N = 3SE +/- 1.43, N = 4SE +/- 0.89, N = 3SE +/- 0.07, N = 3SE +/- 0.19, N = 3SE +/- 0.01, N = 3SE +/- 0.00, N = 3SE +/- 0.03, N = 3SE +/- 0.03, N = 3SE +/- 0.11, N = 3SE +/- 0.08, N = 3SE +/- 0.13, N = 3SE +/- 0.12, N = 3SE +/- 0.15, N = 3SE +/- 0.16, N = 355.2658.3194.41107.3280.37101.4078.13106.35109.40117.24156.28124.18155.08168.53221.88237.71
OpenBenchmarking.orgExamples Per Second, More Is BetterPlaidMLFP16: No - Mode: Inference - Network: VGG19 - Device: OpenCLRX 580RX 590RX Vega 56RX Vega 64GTX 980GTX 980 TiGTX 1060GTX 1070GTX 1070 TiGTX 1080GTX 1080 TiRTX 2060RTX 2070RTX 2080RTX 2080 TiTITAN RTX4080120160200Min: 55.16 / Avg: 55.26 / Max: 55.36Min: 57.62 / Avg: 58.31 / Max: 58.67Min: 90.88 / Avg: 94.41 / Max: 97.23Min: 106.21 / Avg: 107.32 / Max: 109.09Min: 80.29 / Avg: 80.37 / Max: 80.52Min: 101.03 / Avg: 101.4 / Max: 101.65Min: 78.11 / Avg: 78.13 / Max: 78.16Min: 106.34 / Avg: 106.35 / Max: 106.35Min: 109.35 / Avg: 109.4 / Max: 109.45Min: 117.19 / Avg: 117.24 / Max: 117.31Min: 156.06 / Avg: 156.28 / Max: 156.44Min: 124.06 / Avg: 124.18 / Max: 124.33Min: 154.9 / Avg: 155.08 / Max: 155.34Min: 168.34 / Avg: 168.53 / Max: 168.76Min: 221.61 / Avg: 221.88 / Max: 222.14Min: 237.51 / Avg: 237.71 / Max: 238.04

OpenBenchmarking.orgExamples Per Second, More Is BetterPlaidMLFP16: Yes - Mode: Inference - Network: VGG16 - Device: OpenCLRX 580RX 590RX Vega 56RX Vega 64GTX 980GTX 980 TiGTX 1060GTX 1070GTX 1070 TiGTX 1080GTX 1080 TiRTX 2060RTX 2070RTX 2080RTX 2080 TiTITAN RTX50100150200250SE +/- 0.06, N = 3SE +/- 0.27, N = 3SE +/- 0.06, N = 3SE +/- 0.39, N = 3SE +/- 0.00, N = 3SE +/- 0.07, N = 3SE +/- 0.82, N = 3SE +/- 0.04, N = 3SE +/- 0.36, N = 3SE +/- 0.05, N = 3SE +/- 0.26, N = 3SE +/- 0.02, N = 3SE +/- 0.05, N = 3SE +/- 0.06, N = 3SE +/- 1.48, N = 3SE +/- 0.14, N = 358.9261.65107.00120.0096.82121.6892.19122.54125.60134.68180.71143.80172.84185.76236.13250.30
OpenBenchmarking.orgExamples Per Second, More Is BetterPlaidMLFP16: Yes - Mode: Inference - Network: VGG16 - Device: OpenCLRX 580RX 590RX Vega 56RX Vega 64GTX 980GTX 980 TiGTX 1060GTX 1070GTX 1070 TiGTX 1080GTX 1080 TiRTX 2060RTX 2070RTX 2080RTX 2080 TiTITAN RTX50100150200250Min: 58.84 / Avg: 58.92 / Max: 59.05Min: 61.17 / Avg: 61.65 / Max: 62.09Min: 106.47 / Avg: 106.53 / Max: 106.66Min: 118.82 / Avg: 119.6 / Max: 119.99Min: 96.82 / Avg: 96.82 / Max: 96.83Min: 121.55 / Avg: 121.68 / Max: 121.8Min: 90.55 / Avg: 92.19 / Max: 93.05Min: 122.47 / Avg: 122.54 / Max: 122.6Min: 124.88 / Avg: 125.6 / Max: 126Min: 134.61 / Avg: 134.68 / Max: 134.77Min: 180.23 / Avg: 180.71 / Max: 181.14Min: 143.76 / Avg: 143.8 / Max: 143.84Min: 172.79 / Avg: 172.84 / Max: 172.93Min: 185.63 / Avg: 185.76 / Max: 185.83Min: 233.18 / Avg: 236.13 / Max: 237.68Min: 250.02 / Avg: 250.3 / Max: 250.45

OpenBenchmarking.orgExamples Per Second, More Is BetterPlaidMLFP16: Yes - Mode: Inference - Network: VGG19 - Device: OpenCLRX 580RX 590RX Vega 56RX Vega 64GTX 980GTX 980 TiGTX 1060GTX 1070GTX 1070 TiGTX 1080GTX 1080 TiRTX 2060RTX 2070RTX 2080RTX 2080 TiTITAN RTX50100150200250SE +/- 0.06, N = 3SE +/- 0.38, N = 3SE +/- 0.06, N = 3SE +/- 0.71, N = 3SE +/- 0.01, N = 3SE +/- 0.18, N = 3SE +/- 0.06, N = 3SE +/- 0.07, N = 3SE +/- 0.03, N = 3SE +/- 0.07, N = 3SE +/- 0.10, N = 3SE +/- 1.40, N = 3SE +/- 0.15, N = 3SE +/- 0.17, N = 3SE +/- 0.21, N = 3SE +/- 0.04, N = 351.5953.8591.32103.9383.19104.7479.29105.77108.85115.90159.02121.98148.93161.16207.30220.89
OpenBenchmarking.orgExamples Per Second, More Is BetterPlaidMLFP16: Yes - Mode: Inference - Network: VGG19 - Device: OpenCLRX 580RX 590RX Vega 56RX Vega 64GTX 980GTX 980 TiGTX 1060GTX 1070GTX 1070 TiGTX 1080GTX 1080 TiRTX 2060RTX 2070RTX 2080RTX 2080 TiTITAN RTX4080120160200Min: 51.46 / Avg: 51.59 / Max: 51.66Min: 53.19 / Avg: 53.85 / Max: 54.52Min: 91.22 / Avg: 91.32 / Max: 91.43Min: 102.56 / Avg: 103.93 / Max: 104.91Min: 83.17 / Avg: 83.19 / Max: 83.21Min: 104.39 / Avg: 104.74 / Max: 104.99Min: 79.2 / Avg: 79.29 / Max: 79.41Min: 105.65 / Avg: 105.77 / Max: 105.89Min: 108.78 / Avg: 108.85 / Max: 108.89Min: 115.77 / Avg: 115.9 / Max: 115.99Min: 158.82 / Avg: 159.02 / Max: 159.16Min: 119.18 / Avg: 121.98 / Max: 123.41Min: 148.71 / Avg: 148.93 / Max: 149.21Min: 160.94 / Avg: 161.16 / Max: 161.5Min: 206.9 / Avg: 207.3 / Max: 207.64Min: 220.81 / Avg: 220.89 / Max: 220.95

OpenBenchmarking.orgExamples Per Second, More Is BetterPlaidMLFP16: No - Mode: Training - Network: IMDB LSTM - Device: OpenCLRX 580RX 590RX Vega 56RX Vega 64GTX 980GTX 980 TiGTX 1060GTX 1070GTX 1070 TiGTX 1080GTX 1080 TiRTX 2060RTX 2070RTX 2080RTX 2080 TiTITAN RTX4080120160200SE +/- 1.28, N = 3SE +/- 1.06, N = 3SE +/- 0.44, N = 3SE +/- 0.49, N = 3SE +/- 0.08, N = 3SE +/- 0.66, N = 3SE +/- 0.30, N = 3SE +/- 0.09, N = 3SE +/- 0.09, N = 3SE +/- 0.45, N = 3SE +/- 0.42, N = 3SE +/- 0.59, N = 3SE +/- 1.14, N = 3SE +/- 1.03, N = 3SE +/- 1.21, N = 3SE +/- 1.98, N = 3119133164169108122119135133142165157164175192191
OpenBenchmarking.orgExamples Per Second, More Is BetterPlaidMLFP16: No - Mode: Training - Network: IMDB LSTM - Device: OpenCLRX 580RX 590RX Vega 56RX Vega 64GTX 980GTX 980 TiGTX 1060GTX 1070GTX 1070 TiGTX 1080GTX 1080 TiRTX 2060RTX 2070RTX 2080RTX 2080 TiTITAN RTX4080120160200Min: 116.71 / Avg: 119.27 / Max: 120.67Min: 130.97 / Avg: 133.05 / Max: 134.39Min: 163.32 / Avg: 163.93 / Max: 164.8Min: 167.76 / Avg: 168.75 / Max: 169.28Min: 107.8 / Avg: 107.9 / Max: 108.06Min: 120.71 / Avg: 121.72 / Max: 122.95Min: 118.63 / Avg: 119.05 / Max: 119.63Min: 134.44 / Avg: 134.58 / Max: 134.75Min: 132.67 / Avg: 132.77 / Max: 132.95Min: 140.93 / Avg: 141.69 / Max: 142.5Min: 164.13 / Avg: 164.78 / Max: 165.55Min: 155.98 / Avg: 156.77 / Max: 157.92Min: 161.94 / Avg: 163.91 / Max: 165.88Min: 173.1 / Avg: 175.14 / Max: 176.46Min: 189.41 / Avg: 191.82 / Max: 193.17Min: 186.93 / Avg: 190.69 / Max: 193.64

OpenBenchmarking.orgExamples Per Second, More Is BetterPlaidMLFP16: No - Mode: Training - Network: Mobilenet - Device: OpenCLRX 580RX 590RX Vega 56RX Vega 64GTX 980GTX 980 TiGTX 1060GTX 1070GTX 1070 TiGTX 1080GTX 1080 TiRTX 2060RTX 2070RTX 2080RTX 2080 TiTITAN RTX306090120150SE +/- 0.03, N = 3SE +/- 0.03, N = 3SE +/- 0.15, N = 3SE +/- 0.13, N = 3SE +/- 0.03, N = 3SE +/- 0.19, N = 3SE +/- 0.01, N = 3SE +/- 0.04, N = 3SE +/- 0.19, N = 3SE +/- 0.17, N = 3SE +/- 0.14, N = 3SE +/- 0.12, N = 3SE +/- 0.13, N = 3SE +/- 0.24, N = 3SE +/- 0.32, N = 3SE +/- 0.40, N = 341.6445.2171.2975.2378.4783.6681.6598.4595.5294.47113.55103.30119.84120.24138.11142.36
OpenBenchmarking.orgExamples Per Second, More Is BetterPlaidMLFP16: No - Mode: Training - Network: Mobilenet - Device: OpenCLRX 580RX 590RX Vega 56RX Vega 64GTX 980GTX 980 TiGTX 1060GTX 1070GTX 1070 TiGTX 1080GTX 1080 TiRTX 2060RTX 2070RTX 2080RTX 2080 TiTITAN RTX306090120150Min: 41.6 / Avg: 41.64 / Max: 41.7Min: 45.15 / Avg: 45.21 / Max: 45.26Min: 71.06 / Avg: 71.29 / Max: 71.58Min: 74.98 / Avg: 75.23 / Max: 75.43Min: 78.42 / Avg: 78.47 / Max: 78.5Min: 83.36 / Avg: 83.66 / Max: 84Min: 81.64 / Avg: 81.65 / Max: 81.66Min: 98.39 / Avg: 98.45 / Max: 98.52Min: 95.2 / Avg: 95.52 / Max: 95.85Min: 94.27 / Avg: 94.47 / Max: 94.8Min: 113.33 / Avg: 113.55 / Max: 113.81Min: 103.09 / Avg: 103.3 / Max: 103.51Min: 119.59 / Avg: 119.84 / Max: 120.03Min: 119.77 / Avg: 120.24 / Max: 120.51Min: 137.46 / Avg: 138.11 / Max: 138.48Min: 141.96 / Avg: 142.36 / Max: 143.15

OpenBenchmarking.orgExamples Per Second, More Is BetterPlaidMLFP16: No - Mode: Inference - Network: IMDB LSTM - Device: OpenCLRX 580RX 590RX Vega 56RX Vega 64GTX 980GTX 980 TiGTX 1060GTX 1070GTX 1070 TiGTX 1080GTX 1080 TiRTX 2060RTX 2070RTX 2080RTX 2080 TiTITAN RTX120240360480600SE +/- 0.68, N = 3SE +/- 1.28, N = 3SE +/- 0.14, N = 3SE +/- 0.02, N = 3SE +/- 0.37, N = 3SE +/- 0.33, N = 3SE +/- 0.26, N = 3SE +/- 0.54, N = 3SE +/- 0.09, N = 3SE +/- 0.99, N = 3SE +/- 0.26, N = 3SE +/- 0.23, N = 3SE +/- 1.24, N = 3SE +/- 1.05, N = 3SE +/- 1.04, N = 3SE +/- 0.33, N = 3182205240240155174175218215247298324356418525535
OpenBenchmarking.orgExamples Per Second, More Is BetterPlaidMLFP16: No - Mode: Inference - Network: IMDB LSTM - Device: OpenCLRX 580RX 590RX Vega 56RX Vega 64GTX 980GTX 980 TiGTX 1060GTX 1070GTX 1070 TiGTX 1080GTX 1080 TiRTX 2060RTX 2070RTX 2080RTX 2080 TiTITAN RTX90180270360450Min: 180.53 / Avg: 181.78 / Max: 182.84Min: 202.53 / Avg: 204.83 / Max: 206.95Min: 239.51 / Avg: 239.65 / Max: 239.92Min: 240.02 / Avg: 240.05 / Max: 240.1Min: 154.5 / Avg: 155.12 / Max: 155.76Min: 172.95 / Avg: 173.57 / Max: 174.1Min: 174.54 / Avg: 174.91 / Max: 175.41Min: 216.83 / Avg: 217.66 / Max: 218.66Min: 214.93 / Avg: 215.11 / Max: 215.23Min: 245.93 / Avg: 247.4 / Max: 249.28Min: 297.64 / Avg: 298.11 / Max: 298.54Min: 323.76 / Avg: 324.16 / Max: 324.54Min: 353.29 / Avg: 355.67 / Max: 357.5Min: 415.85 / Avg: 417.86 / Max: 419.38Min: 523.33 / Avg: 525.27 / Max: 526.88Min: 534.04 / Avg: 534.69 / Max: 535.14

OpenBenchmarking.orgExamples Per Second, More Is BetterPlaidMLFP16: No - Mode: Inference - Network: Mobilenet - Device: OpenCLRX 580RX 590RX Vega 56RX Vega 64GTX 980GTX 980 TiGTX 1060GTX 1070GTX 1070 TiGTX 1080GTX 1080 TiRTX 2060RTX 2070RTX 2080RTX 2080 TiTITAN RTX2004006008001000SE +/- 0.73, N = 3SE +/- 0.16, N = 3SE +/- 5.93, N = 3SE +/- 11.08, N = 12SE +/- 1.99, N = 3SE +/- 2.78, N = 3SE +/- 0.64, N = 3SE +/- 2.92, N = 3SE +/- 0.56, N = 3SE +/- 0.30, N = 3SE +/- 4.02, N = 3SE +/- 1.48, N = 3SE +/- 2.10, N = 3SE +/- 3.51, N = 3SE +/- 9.03, N = 3SE +/- 1.87, N = 3390424531546458485485593594621687671767794962988
OpenBenchmarking.orgExamples Per Second, More Is BetterPlaidMLFP16: No - Mode: Inference - Network: Mobilenet - Device: OpenCLRX 580RX 590RX Vega 56RX Vega 64GTX 980GTX 980 TiGTX 1060GTX 1070GTX 1070 TiGTX 1080GTX 1080 TiRTX 2060RTX 2070RTX 2080RTX 2080 TiTITAN RTX2004006008001000Min: 389.42 / Avg: 390.19 / Max: 391.65Min: 424.03 / Avg: 424.23 / Max: 424.54Min: 521.51 / Avg: 530.93 / Max: 541.88Min: 481.03 / Avg: 545.94 / Max: 613.95Min: 453.78 / Avg: 457.51 / Max: 460.57Min: 481 / Avg: 484.95 / Max: 490.32Min: 483.69 / Avg: 484.83 / Max: 485.92Min: 589.01 / Avg: 593.11 / Max: 598.77Min: 593.07 / Avg: 594.18 / Max: 594.86Min: 621.01 / Avg: 621.36 / Max: 621.96Min: 682.81 / Avg: 687.08 / Max: 695.11Min: 668.46 / Avg: 671.34 / Max: 673.35Min: 764.26 / Avg: 767.48 / Max: 771.42Min: 787.94 / Avg: 794.27 / Max: 800.04Min: 944.44 / Avg: 962.46 / Max: 972.36Min: 984.02 / Avg: 987.68 / Max: 990.14

OpenBenchmarking.orgExamples Per Second, More Is BetterPlaidMLFP16: No - Mode: Inference - Network: ResNet 50 - Device: OpenCLRX 580RX 590RX Vega 56RX Vega 64GTX 980GTX 980 TiGTX 1060GTX 1070GTX 1070 TiGTX 1080GTX 1080 TiRTX 2060RTX 2070RTX 2080RTX 2080 TiTITAN RTX110220330440550SE +/- 0.49, N = 3SE +/- 0.64, N = 3SE +/- 1.86, N = 3SE +/- 4.02, N = 3SE +/- 0.53, N = 3SE +/- 0.34, N = 3SE +/- 0.15, N = 3SE +/- 1.62, N = 3SE +/- 0.51, N = 3SE +/- 0.28, N = 3SE +/- 0.05, N = 3SE +/- 0.35, N = 3SE +/- 0.35, N = 3SE +/- 0.08, N = 3SE +/- 4.66, N = 3SE +/- 0.22, N = 3131139213226172199187241249275315293351373478499
OpenBenchmarking.orgExamples Per Second, More Is BetterPlaidMLFP16: No - Mode: Inference - Network: ResNet 50 - Device: OpenCLRX 580RX 590RX Vega 56RX Vega 64GTX 980GTX 980 TiGTX 1060GTX 1070GTX 1070 TiGTX 1080GTX 1080 TiRTX 2060RTX 2070RTX 2080RTX 2080 TiTITAN RTX90180270360450Min: 129.61 / Avg: 130.59 / Max: 131.14Min: 138.08 / Avg: 138.88 / Max: 140.14Min: 209.03 / Avg: 212.72 / Max: 215.05Min: 218.09 / Avg: 226.07 / Max: 230.8Min: 170.81 / Avg: 171.87 / Max: 172.41Min: 197.99 / Avg: 198.55 / Max: 199.17Min: 187.21 / Avg: 187.38 / Max: 187.67Min: 238.31 / Avg: 241.31 / Max: 243.87Min: 248.88 / Avg: 249.43 / Max: 250.45Min: 275.2 / Avg: 275.49 / Max: 276.05Min: 314.91 / Avg: 314.97 / Max: 315.07Min: 292.41 / Avg: 293.1 / Max: 293.54Min: 350.24 / Avg: 350.68 / Max: 351.38Min: 372.98 / Avg: 373.08 / Max: 373.23Min: 468.71 / Avg: 477.9 / Max: 483.85Min: 498.54 / Avg: 498.95 / Max: 499.3

OpenBenchmarking.orgExamples Per Second, More Is BetterPlaidMLFP16: Yes - Mode: Inference - Network: Mobilenet - Device: OpenCLRX 580RX 590RX Vega 56RX Vega 64GTX 980GTX 980 TiGTX 1060GTX 1070GTX 1070 TiGTX 1080GTX 1080 TiRTX 2060RTX 2070RTX 2080RTX 2080 TiTITAN RTX150300450600750SE +/- 1.39, N = 3SE +/- 0.50, N = 3SE +/- 0.30, N = 3SE +/- 0.64, N = 3SE +/- 4.97, N = 3SE +/- 2.96, N = 3SE +/- 5.36, N = 3SE +/- 1.57, N = 3SE +/- 8.00, N = 4SE +/- 4.10, N = 3SE +/- 5.47, N = 3SE +/- 7.50, N = 6SE +/- 6.98, N = 3SE +/- 6.97, N = 12SE +/- 1.64, N = 3SE +/- 5.84, N = 3435455480481407421426476473510555538533612695698
OpenBenchmarking.orgExamples Per Second, More Is BetterPlaidMLFP16: Yes - Mode: Inference - Network: Mobilenet - Device: OpenCLRX 580RX 590RX Vega 56RX Vega 64GTX 980GTX 980 TiGTX 1060GTX 1070GTX 1070 TiGTX 1080GTX 1080 TiRTX 2060RTX 2070RTX 2080RTX 2080 TiTITAN RTX120240360480600Min: 432.75 / Avg: 435.25 / Max: 437.56Min: 454.38 / Avg: 455.07 / Max: 456.05Min: 479.17 / Avg: 479.78 / Max: 480.1Min: 480.06 / Avg: 481.28 / Max: 482.18Min: 400.68 / Avg: 407.08 / Max: 416.86Min: 415.83 / Avg: 420.97 / Max: 426.07Min: 414.95 / Avg: 425.54 / Max: 432.25Min: 472.58 / Avg: 475.72 / Max: 477.47Min: 456.19 / Avg: 473.42 / Max: 493.34Min: 501.95 / Avg: 509.88 / Max: 515.62Min: 543.87 / Avg: 554.81 / Max: 560.66Min: 519.27 / Avg: 538.23 / Max: 568.52Min: 520.24 / Avg: 532.63 / Max: 544.4Min: 588.63 / Avg: 611.54 / Max: 659.5Min: 692.49 / Avg: 694.72 / Max: 697.91Min: 686.09 / Avg: 697.54 / Max: 705.24

OpenBenchmarking.orgExamples Per Second, More Is BetterPlaidMLFP16: Yes - Mode: Inference - Network: ResNet 50 - Device: OpenCLRX 580RX 590RX Vega 56RX Vega 64GTX 980GTX 980 TiGTX 1060GTX 1070GTX 1070 TiGTX 1080GTX 1080 TiRTX 2060RTX 2070RTX 2080RTX 2080 TiTITAN RTX90180270360450SE +/- 0.32, N = 3SE +/- 0.04, N = 3SE +/- 0.02, N = 3SE +/- 0.88, N = 3SE +/- 0.19, N = 3SE +/- 0.23, N = 3SE +/- 2.69, N = 3SE +/- 0.06, N = 3SE +/- 0.17, N = 3SE +/- 0.31, N = 3SE +/- 0.73, N = 3SE +/- 6.28, N = 11SE +/- 0.17, N = 3SE +/- 0.43, N = 3SE +/- 0.30, N = 3SE +/- 0.23, N = 3121129192212175199173221226248311259311330417428
OpenBenchmarking.orgExamples Per Second, More Is BetterPlaidMLFP16: Yes - Mode: Inference - Network: ResNet 50 - Device: OpenCLRX 580RX 590RX Vega 56RX Vega 64GTX 980GTX 980 TiGTX 1060GTX 1070GTX 1070 TiGTX 1080GTX 1080 TiRTX 2060RTX 2070RTX 2080RTX 2080 TiTITAN RTX80160240320400Min: 120.23 / Avg: 120.87 / Max: 121.25Min: 128.74 / Avg: 128.81 / Max: 128.86Min: 191.93 / Avg: 191.95 / Max: 191.98Min: 210.32 / Avg: 211.6 / Max: 213.3Min: 174.35 / Avg: 174.63 / Max: 174.98Min: 198.18 / Avg: 198.51 / Max: 198.95Min: 167.6 / Avg: 172.99 / Max: 175.75Min: 221.11 / Avg: 221.23 / Max: 221.32Min: 226.18 / Avg: 226.4 / Max: 226.73Min: 247.79 / Avg: 248.32 / Max: 248.85Min: 309.41 / Avg: 310.67 / Max: 311.95Min: 196.07 / Avg: 258.7 / Max: 265.83Min: 311.02 / Avg: 311.35 / Max: 311.6Min: 329.66 / Avg: 330.33 / Max: 331.14Min: 416.12 / Avg: 416.71 / Max: 417.01Min: 427.82 / Avg: 428.25 / Max: 428.61

OpenBenchmarking.orgExamples Per Second, More Is BetterPlaidMLFP16: No - Mode: Training - Network: Inception V3 - Device: OpenCLRX 580RX 590RX Vega 56RX Vega 64GTX 1060GTX 1070GTX 1070 TiGTX 1080GTX 1080 TiRTX 2070RTX 2080RTX 2080 TiTITAN RTX918273645SE +/- 0.03, N = 3SE +/- 0.04, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.10, N = 3SE +/- 0.02, N = 3SE +/- 0.02, N = 3SE +/- 0.05, N = 3SE +/- 0.03, N = 3SE +/- 0.07, N = 3SE +/- 0.14, N = 3SE +/- 0.29, N = 313.1514.5919.8620.9821.5826.2126.0028.4433.1031.4432.8037.6737.41
OpenBenchmarking.orgExamples Per Second, More Is BetterPlaidMLFP16: No - Mode: Training - Network: Inception V3 - Device: OpenCLRX 580RX 590RX Vega 56RX Vega 64GTX 1060GTX 1070GTX 1070 TiGTX 1080GTX 1080 TiRTX 2070RTX 2080RTX 2080 TiTITAN RTX816243240Min: 13.11 / Avg: 13.15 / Max: 13.2Min: 14.55 / Avg: 14.59 / Max: 14.67Min: 19.85 / Avg: 19.86 / Max: 19.89Min: 20.95 / Avg: 20.98 / Max: 20.99Min: 21.4 / Avg: 21.58 / Max: 21.72Min: 26.18 / Avg: 26.21 / Max: 26.25Min: 25.98 / Avg: 26 / Max: 26.03Min: 28.37 / Avg: 28.44 / Max: 28.55Min: 33.05 / Avg: 33.1 / Max: 33.14Min: 32.71 / Avg: 32.8 / Max: 32.94Min: 37.44 / Avg: 37.67 / Max: 37.92Min: 36.84 / Avg: 37.41 / Max: 37.82

OpenBenchmarking.orgExamples Per Second, More Is BetterPlaidMLFP16: No - Mode: Inference - Network: DenseNet 201 - Device: OpenCLRX 580RX 590RX Vega 56RX Vega 64GTX 980GTX 980 TiGTX 1060GTX 1070GTX 1070 TiGTX 1080GTX 1080 TiRTX 2060RTX 2070RTX 2080RTX 2080 TiTITAN RTX4080120160200SE +/- 0.08, N = 3SE +/- 0.02, N = 3SE +/- 0.02, N = 3SE +/- 0.03, N = 3SE +/- 0.04, N = 3SE +/- 0.11, N = 3SE +/- 0.00, N = 3SE +/- 0.01, N = 3SE +/- 0.04, N = 3SE +/- 0.01, N = 3SE +/- 0.13, N = 3SE +/- 0.04, N = 3SE +/- 0.11, N = 3SE +/- 0.13, N = 3SE +/- 2.09, N = 3SE +/- 0.42, N = 362.3467.5095.87106.4463.9678.8862.2783.8983.5590.83119.8095.88115.65118.65150.01161.32
OpenBenchmarking.orgExamples Per Second, More Is BetterPlaidMLFP16: No - Mode: Inference - Network: DenseNet 201 - Device: OpenCLRX 580RX 590RX Vega 56RX Vega 64GTX 980GTX 980 TiGTX 1060GTX 1070GTX 1070 TiGTX 1080GTX 1080 TiRTX 2060RTX 2070RTX 2080RTX 2080 TiTITAN RTX306090120150Min: 62.19 / Avg: 62.34 / Max: 62.43Min: 67.46 / Avg: 67.5 / Max: 67.54Min: 95.84 / Avg: 95.87 / Max: 95.92Min: 106.38 / Avg: 106.44 / Max: 106.47Min: 63.88 / Avg: 63.96 / Max: 64.01Min: 78.7 / Avg: 78.88 / Max: 79.09Min: 62.27 / Avg: 62.27 / Max: 62.28Min: 83.88 / Avg: 83.89 / Max: 83.91Min: 83.48 / Avg: 83.55 / Max: 83.59Min: 90.81 / Avg: 90.83 / Max: 90.86Min: 119.54 / Avg: 119.8 / Max: 119.97Min: 95.8 / Avg: 95.88 / Max: 95.94Min: 115.46 / Avg: 115.65 / Max: 115.85Min: 118.51 / Avg: 118.65 / Max: 118.9Min: 145.82 / Avg: 150.01 / Max: 152.13Min: 160.6 / Avg: 161.32 / Max: 162.06

OpenBenchmarking.orgExamples Per Second, More Is BetterPlaidMLFP16: No - Mode: Inference - Network: Inception V3 - Device: OpenCLRX 580RX 590RX Vega 56RX Vega 64GTX 980GTX 980 TiGTX 1060GTX 1070GTX 1070 TiGTX 1080GTX 1080 TiRTX 2060RTX 2070RTX 2080RTX 2080 TiTITAN RTX50100150200250SE +/- 0.95, N = 3SE +/- 1.29, N = 3SE +/- 1.56, N = 3SE +/- 0.77, N = 3SE +/- 1.08, N = 3SE +/- 1.44, N = 5SE +/- 1.04, N = 7SE +/- 1.68, N = 5SE +/- 0.05, N = 3SE +/- 1.75, N = 12SE +/- 0.42, N = 3SE +/- 1.89, N = 3SE +/- 0.61, N = 3SE +/- 0.12, N = 3SE +/- 3.98, N = 12SE +/- 0.31, N = 366.1971.42104.00118.0081.0396.6982.03108.50113.61124.65158.20124.84147.39161.94197.56211.69
OpenBenchmarking.orgExamples Per Second, More Is BetterPlaidMLFP16: No - Mode: Inference - Network: Inception V3 - Device: OpenCLRX 580RX 590RX Vega 56RX Vega 64GTX 980GTX 980 TiGTX 1060GTX 1070GTX 1070 TiGTX 1080GTX 1080 TiRTX 2060RTX 2070RTX 2080RTX 2080 TiTITAN RTX4080120160200Min: 64.3 / Avg: 66.19 / Max: 67.27Min: 69.11 / Avg: 71.42 / Max: 73.56Min: 101.28 / Avg: 104.11 / Max: 106.65Min: 116.45 / Avg: 117.91 / Max: 119.04Min: 78.91 / Avg: 81.03 / Max: 82.47Min: 91.04 / Avg: 96.69 / Max: 98.59Min: 77.93 / Avg: 82.03 / Max: 83.83Min: 101.79 / Avg: 108.5 / Max: 110.47Min: 113.5 / Avg: 113.61 / Max: 113.66Min: 116.74 / Avg: 124.65 / Max: 131.35Min: 157.46 / Avg: 158.2 / Max: 158.93Min: 121.06 / Avg: 124.84 / Max: 126.92Min: 146.5 / Avg: 147.39 / Max: 148.55Min: 161.73 / Avg: 161.94 / Max: 162.16Min: 176.08 / Avg: 197.56 / Max: 207.85Min: 211.24 / Avg: 211.69 / Max: 212.29

OpenBenchmarking.orgExamples Per Second, More Is BetterPlaidMLFP16: No - Mode: Inference - Network: NASNer Large - Device: OpenCLRX 580RX 590RX Vega 56RX Vega 64GTX 980GTX 980 TiGTX 1060GTX 1070GTX 1070 TiGTX 1080GTX 1080 TiRTX 2060RTX 2070RTX 2080RTX 2080 TiTITAN RTX1326395265SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.02, N = 3SE +/- 0.13, N = 3SE +/- 0.05, N = 3SE +/- 0.03, N = 3SE +/- 0.01, N = 3SE +/- 0.03, N = 3SE +/- 0.00, N = 3SE +/- 0.02, N = 3SE +/- 0.10, N = 3SE +/- 0.04, N = 3SE +/- 0.07, N = 3SE +/- 0.06, N = 3SE +/- 0.11, N = 3SE +/- 0.10, N = 318.0820.0131.0835.8918.8924.3218.2725.3126.5730.9242.7529.4236.0141.5756.7759.13
OpenBenchmarking.orgExamples Per Second, More Is BetterPlaidMLFP16: No - Mode: Inference - Network: NASNer Large - Device: OpenCLRX 580RX 590RX Vega 56RX Vega 64GTX 980GTX 980 TiGTX 1060GTX 1070GTX 1070 TiGTX 1080GTX 1080 TiRTX 2060RTX 2070RTX 2080RTX 2080 TiTITAN RTX1224364860Min: 18.06 / Avg: 18.08 / Max: 18.08Min: 20.01 / Avg: 20.01 / Max: 20.03Min: 31.05 / Avg: 31.08 / Max: 31.13Min: 35.65 / Avg: 35.89 / Max: 36.08Min: 18.82 / Avg: 18.89 / Max: 19Min: 24.25 / Avg: 24.32 / Max: 24.36Min: 18.25 / Avg: 18.27 / Max: 18.29Min: 25.28 / Avg: 25.31 / Max: 25.37Min: 26.56 / Avg: 26.57 / Max: 26.57Min: 30.89 / Avg: 30.92 / Max: 30.97Min: 42.57 / Avg: 42.75 / Max: 42.9Min: 29.37 / Avg: 29.42 / Max: 29.5Min: 35.92 / Avg: 36.01 / Max: 36.14Min: 41.49 / Avg: 41.57 / Max: 41.68Min: 56.66 / Avg: 56.77 / Max: 56.98Min: 59 / Avg: 59.13 / Max: 59.32

OpenBenchmarking.orgExamples Per Second, More Is BetterPlaidMLFP16: Yes - Mode: Inference - Network: DenseNet 201 - Device: OpenCLGTX 980GTX 980 TiGTX 1060GTX 1070GTX 1070 TiGTX 1080GTX 1080 TiRTX 2060RTX 2070RTX 2080RTX 2080 TiTITAN RTX306090120150SE +/- 0.03, N = 3SE +/- 0.09, N = 3SE +/- 0.02, N = 3SE +/- 0.06, N = 3SE +/- 0.03, N = 3SE +/- 0.02, N = 3SE +/- 0.11, N = 3SE +/- 0.18, N = 3SE +/- 0.17, N = 3SE +/- 0.10, N = 3SE +/- 1.79, N = 7SE +/- 2.16, N = 361.3876.1558.7679.0878.4585.60114.9789.02108.00111.00139.00148.00
OpenBenchmarking.orgExamples Per Second, More Is BetterPlaidMLFP16: Yes - Mode: Inference - Network: DenseNet 201 - Device: OpenCLGTX 980GTX 980 TiGTX 1060GTX 1070GTX 1070 TiGTX 1080GTX 1080 TiRTX 2060RTX 2070RTX 2080RTX 2080 TiTITAN RTX306090120150Min: 61.32 / Avg: 61.38 / Max: 61.44Min: 76.01 / Avg: 76.15 / Max: 76.32Min: 58.73 / Avg: 58.76 / Max: 58.8Min: 78.98 / Avg: 79.08 / Max: 79.18Min: 78.4 / Avg: 78.45 / Max: 78.48Min: 85.58 / Avg: 85.6 / Max: 85.64Min: 114.86 / Avg: 114.97 / Max: 115.2Min: 88.69 / Avg: 89.02 / Max: 89.32Min: 108.18 / Avg: 108.37 / Max: 108.7Min: 111.12 / Avg: 111.26 / Max: 111.46Min: 128.05 / Avg: 138.73 / Max: 141.26Min: 143.57 / Avg: 147.89 / Max: 150.34

OpenBenchmarking.orgExamples Per Second, More Is BetterPlaidMLFP16: Yes - Mode: Inference - Network: Inception V3 - Device: OpenCLGTX 980GTX 980 TiGTX 1060GTX 1070GTX 1070 TiGTX 1080GTX 1080 TiRTX 2060RTX 2070RTX 2080RTX 2080 TiTITAN RTX4080120160200SE +/- 0.15, N = 3SE +/- 1.04, N = 12SE +/- 0.27, N = 3SE +/- 0.16, N = 3SE +/- 1.45, N = 7SE +/- 0.17, N = 3SE +/- 0.55, N = 3SE +/- 2.35, N = 3SE +/- 2.27, N = 12SE +/- 2.75, N = 12SE +/- 3.75, N = 12SE +/- 0.41, N = 389.26104.1086.75112.31114.33130.00160.18126.00142.00153.00192.00203.00
OpenBenchmarking.orgExamples Per Second, More Is BetterPlaidMLFP16: Yes - Mode: Inference - Network: Inception V3 - Device: OpenCLGTX 980GTX 980 TiGTX 1060GTX 1070GTX 1070 TiGTX 1080GTX 1080 TiRTX 2060RTX 2070RTX 2080RTX 2080 TiTITAN RTX4080120160200Min: 88.96 / Avg: 89.26 / Max: 89.46Min: 95.65 / Avg: 104.1 / Max: 106.64Min: 86.21 / Avg: 86.75 / Max: 87.08Min: 112.02 / Avg: 112.31 / Max: 112.57Min: 105.61 / Avg: 114.33 / Max: 115.95Min: 129.37 / Avg: 129.63 / Max: 129.95Min: 159.36 / Avg: 160.18 / Max: 161.24Min: 121.42 / Avg: 126.11 / Max: 128.68Min: 131.81 / Avg: 142.23 / Max: 148.96Min: 140.65 / Avg: 152.61 / Max: 161.23Min: 170.33 / Avg: 192.24 / Max: 201.99Min: 201.81 / Avg: 202.62 / Max: 203.14

OpenBenchmarking.orgExamples Per Second, More Is BetterPlaidMLFP16: Yes - Mode: Inference - Network: NASNer Large - Device: OpenCLGTX 980GTX 980 TiGTX 1060GTX 1070GTX 1070 TiGTX 1080GTX 1080 TiRTX 2060RTX 2070RTX 2080RTX 2080 TiTITAN RTX1632486480SE +/- 0.08, N = 3SE +/- 0.04, N = 3SE +/- 0.02, N = 3SE +/- 0.03, N = 3SE +/- 0.06, N = 3SE +/- 0.10, N = 3SE +/- 0.08, N = 3SE +/- 0.07, N = 3SE +/- 0.09, N = 3SE +/- 0.06, N = 3SE +/- 0.89, N = 3SE +/- 0.16, N = 323.2226.9022.1730.2032.6537.0247.6337.6044.3451.5469.7072.61
OpenBenchmarking.orgExamples Per Second, More Is BetterPlaidMLFP16: Yes - Mode: Inference - Network: NASNer Large - Device: OpenCLGTX 980GTX 980 TiGTX 1060GTX 1070GTX 1070 TiGTX 1080GTX 1080 TiRTX 2060RTX 2070RTX 2080RTX 2080 TiTITAN RTX1428425670Min: 23.1 / Avg: 23.22 / Max: 23.36Min: 26.85 / Avg: 26.9 / Max: 26.98Min: 22.15 / Avg: 22.17 / Max: 22.21Min: 30.16 / Avg: 30.2 / Max: 30.26Min: 32.54 / Avg: 32.65 / Max: 32.75Min: 36.85 / Avg: 37.02 / Max: 37.2Min: 47.48 / Avg: 47.63 / Max: 47.72Min: 37.53 / Avg: 37.6 / Max: 37.73Min: 44.24 / Avg: 44.34 / Max: 44.51Min: 51.48 / Avg: 51.54 / Max: 51.65Min: 67.94 / Avg: 69.7 / Max: 70.84Min: 72.3 / Avg: 72.61 / Max: 72.85