PlaidML Inference On AMD Threadripper 2 CPU

AMD Ryzen Threadripper 2990WX 32-Core testing with a ASUS ROG ZENITH EXTREME (1601 BIOS) and AMD Radeon RX Vega 8GB on Ubuntu 18.04 via the Phoronix Test Suite.

HTML result view exported from: https://openbenchmarking.org/result/1901281-PTS-PLAIDMLI93.

PlaidML Inference On AMD Threadripper 2 CPUProcessorMotherboardChipsetMemoryDiskGraphicsAudioMonitorNetworkOSKernelDesktopDisplay ServerDisplay DriverOpenGLVulkanCompilerFile-SystemScreen ResolutionThreadripper 2990WXAMD Ryzen Threadripper 2990WX 32-Core @ 3.00GHz (32 Cores / 64 Threads)ASUS ROG ZENITH EXTREME (1601 BIOS)AMD Family 17h32768MBSamsung SSD 970 EVO 500GBAMD Radeon RX Vega 8GB (1630/945MHz)Realtek ALC1220ASUS VP28UIntel I211 + Qualcomm Atheros QCA6174 802.11ac + Wilocity Wil6200 802.11adUbuntu 18.045.0.0-rc1-amdgpu-drm-next (x86_64) 20190127GNOME Shell 3.28.3X Server 1.19.6amdgpu 18.0.14.5 Mesa 18.0.5 (LLVM 6.0.0)1.1.90GCC 7.3.0ext43840x2160OpenBenchmarking.org- Scaling Governor: acpi-cpufreq ondemand- GLAMOR- Python 2.7.15rc1 + Python 3.6.7- __user pointer sanitization + Full AMD retpoline IBPB: conditional STIBP: disabled RSB filling + SSB disabled via prctl and seccomp

PlaidML Inference On AMD Threadripper 2 CPUplaidml: No - Inference - VGG16 - CPUplaidml: No - Inference - VGG19 - CPUplaidml: Yes - Inference - VGG16 - CPUplaidml: Yes - Inference - VGG19 - CPUplaidml: No - Inference - IMDB LSTM - CPUplaidml: No - Inference - Mobilenet - CPUplaidml: No - Inference - ResNet 50 - CPUplaidml: No - Inference - DenseNet 201 - CPUplaidml: No - Inference - Inception V3 - CPUplaidml: No - Inference - NASNer Large - CPUThreadripper 2990WX3.542.993.272.972.4829.248.422.202.890.82OpenBenchmarking.org

PlaidML

FP16: No - Mode: Inference - Network: VGG16 - Device: CPU

OpenBenchmarking.orgExamples Per Second, More Is BetterPlaidMLFP16: No - Mode: Inference - Network: VGG16 - Device: CPUThreadripper 2990WX0.79651.5932.38953.1863.9825SE +/- 0.05, N = 33.54

PlaidML

FP16: No - Mode: Inference - Network: VGG19 - Device: CPU

OpenBenchmarking.orgExamples Per Second, More Is BetterPlaidMLFP16: No - Mode: Inference - Network: VGG19 - Device: CPUThreadripper 2990WX0.67281.34562.01842.69123.364SE +/- 0.04, N = 92.99

PlaidML

FP16: Yes - Mode: Inference - Network: VGG16 - Device: CPU

OpenBenchmarking.orgExamples Per Second, More Is BetterPlaidMLFP16: Yes - Mode: Inference - Network: VGG16 - Device: CPUThreadripper 2990WX0.73581.47162.20742.94323.679SE +/- 0.04, N = 83.27

PlaidML

FP16: Yes - Mode: Inference - Network: VGG19 - Device: CPU

OpenBenchmarking.orgExamples Per Second, More Is BetterPlaidMLFP16: Yes - Mode: Inference - Network: VGG19 - Device: CPUThreadripper 2990WX0.66831.33662.00492.67323.3415SE +/- 0.03, N = 32.97

PlaidML

FP16: No - Mode: Inference - Network: IMDB LSTM - Device: CPU

OpenBenchmarking.orgExamples Per Second, More Is BetterPlaidMLFP16: No - Mode: Inference - Network: IMDB LSTM - Device: CPUThreadripper 2990WX0.5581.1161.6742.2322.79SE +/- 0.00, N = 32.48

PlaidML

FP16: No - Mode: Inference - Network: Mobilenet - Device: CPU

OpenBenchmarking.orgExamples Per Second, More Is BetterPlaidMLFP16: No - Mode: Inference - Network: Mobilenet - Device: CPUThreadripper 2990WX714212835SE +/- 0.19, N = 329.24

PlaidML

FP16: No - Mode: Inference - Network: ResNet 50 - Device: CPU

OpenBenchmarking.orgExamples Per Second, More Is BetterPlaidMLFP16: No - Mode: Inference - Network: ResNet 50 - Device: CPUThreadripper 2990WX246810SE +/- 0.03, N = 38.42

PlaidML

FP16: No - Mode: Inference - Network: DenseNet 201 - Device: CPU

OpenBenchmarking.orgExamples Per Second, More Is BetterPlaidMLFP16: No - Mode: Inference - Network: DenseNet 201 - Device: CPUThreadripper 2990WX0.4950.991.4851.982.475SE +/- 0.00, N = 32.20

PlaidML

FP16: No - Mode: Inference - Network: Inception V3 - Device: CPU

OpenBenchmarking.orgExamples Per Second, More Is BetterPlaidMLFP16: No - Mode: Inference - Network: Inception V3 - Device: CPUThreadripper 2990WX0.65031.30061.95092.60123.2515SE +/- 0.00, N = 22.89

PlaidML

FP16: No - Mode: Inference - Network: NASNer Large - Device: CPU

OpenBenchmarking.orgExamples Per Second, More Is BetterPlaidMLFP16: No - Mode: Inference - Network: NASNer Large - Device: CPUThreadripper 2990WX0.18450.3690.55350.7380.9225SE +/- 0.00, N = 30.82

Phoronix Test Suite v10.8.4