CPU PlaidML Linux Benchmarks

Intel Core i9-7980XE testing with a ASUS PRIME X299-A (1602 BIOS) and NVIDIA NV120 12GB on CentOS Linux 7 via the Phoronix Test Suite.

HTML result view exported from: https://openbenchmarking.org/result/1901143-SP-1901134SP96.

CPU PlaidML Linux BenchmarksProcessorMotherboardChipsetMemoryDiskGraphicsAudioMonitorNetworkOSKernelDesktopDisplay ServerDisplay DriverOpenGLCompilerFile-SystemScreen ResolutionUbuntu 18.10openSUSE TumbleweedFedora Workstation 29Debian 9.6Antergos 19.1Clear Linux 27180CentOS 7Intel Core i9-7980XE @ 4.20GHz (18 Cores / 36 Threads)ASUS PRIME X299-A (1602 BIOS)Intel Sky Lake-E DMI3 Registers16384MBSamsung SSD 970 EVO 500GBNVIDIA NV120 12GBRealtek ALC1220ASUS PB278Intel I219-VUbuntu 18.104.18.0-13-generic (x86_64)GNOME Shell 3.30.1X Server 1.20.1modesetting 1.20.14.3 Mesa 18.2.2GCC 8.2.0ext42560x1440NVIDIA GeForce GTX TITAN X 12GBopenSUSE Tumbleweed 201901084.19.12-1-default (x86_64)KDE PlasmaX Server 1.20.3modesetting 1.20.34.3 Mesa 18.3.1btrfsNVIDIA NV120 12GBFedora 294.19.13-300.fc29.x86_64 (x86_64)GNOME Shell 3.30.2X Server + Wayland4.3 Mesa 18.2.8GCC 8.2.1 20181215ext4Intel Core i9-7980XE @ 4.40GHz (18 Cores / 36 Threads)Intel Device 20204 x 4096 MB DDR4-3200MHz Corsair CMK16GX4M4C3200C16NVIDIA GeForce GTX TITAN XRealtek GenericDebian 9.64.9.0-8-amd64 (x86_64)GNOME Shell 3.22.3X Server 1.19.2modesetting 1.19.2GCC 6.3.0 201705161024x768Intel Core i9-7980XE @ 4.20GHz (18 Cores / 36 Threads)Intel Sky Lake-E DMI3 Registers16384MBNVIDIA GeForce GTX TITAN X 12GBRealtek ALC1220ASUS PB278Antergos Linux 19.1-ISO-Rolling4.20.0-arch1-1-ARCH (x86_64)GNOME Shell 3.30.2X Server 1.20.3nouveau 1.0.154.3 Mesa 18.3.1GCC 8.2.1 201811272560x1440NVIDIA NV120 12GBClear Linux OS 271804.19.14-682.native (x86_64)4.3 Mesa 19.0.0-develGCC 8.2.1 20180502 + Clang 7.0.1 + LLVM 7.0.1Intel Core i9-7980XE @ 4.40GHz (18 Cores / 36 Threads)CentOS Linux 73.10.0-957.1.3.el7.x86_64 (x86_64)GNOME Shell 3.28.3X Server 1.20.1modesetting 1.20.14.3 Mesa 18.0.5xfsOpenBenchmarking.orgProcessor Details- Ubuntu 18.10: Scaling Governor: intel_pstate powersave- openSUSE Tumbleweed: Scaling Governor: intel_pstate powersave- Fedora Workstation 29: Scaling Governor: intel_pstate powersave- Debian 9.6: Scaling Governor: intel_pstate powersave- Antergos 19.1: Scaling Governor: intel_pstate powersave- Clear Linux 27180: Scaling Governor: intel_pstate performance- CentOS 7: Scaling Governor: intel_pstate powersavePython Details- Ubuntu 18.10: Python 2.7.15+ + Python 3.6.7- openSUSE Tumbleweed: Python 2.7.15 + Python 3.6.5- Fedora Workstation 29: Python 2.7.15 + Python 3.7.2- Debian 9.6: Python 2.7.13 + Python 3.5.3- Antergos 19.1: Python 3.7.2- Clear Linux 27180: Python 3.7.2- CentOS 7: Python 2.7.5 + Python 3.6.7Security Details- Ubuntu 18.10: KPTI + __user pointer sanitization + Full generic retpoline IBPB IBRS_FW + SSB disabled via prctl and seccomp + PTE Inversion; VMX: conditional cache flushes SMT vulnerable- openSUSE Tumbleweed: KPTI + __user pointer sanitization + Indirect Branch Restricted Speculation IBPB: conditional IBRS_FW STIBP: conditional RSB filling + SSB disabled via prctl and seccomp + PTE Inversion; VMX: conditional cache flushes SMT vulnerable- Fedora Workstation 29: SELinux + KPTI + __user pointer sanitization + Full generic retpoline IBPB: conditional IBRS_FW STIBP: conditional RSB filling + SSB disabled via prctl and seccomp + PTE Inversion; VMX: conditional cache flushes SMT vulnerable- Debian 9.6: KPTI + __user pointer sanitization + Full generic retpoline IBPB IBRS_FW + SSB disabled via prctl and seccomp + PTE Inversion; VMX: conditional cache flushes SMT vulnerable- Antergos 19.1: KPTI + __user pointer sanitization + Full generic retpoline IBPB: conditional IBRS_FW STIBP: conditional RSB filling + SSB disabled via prctl and seccomp + PTE Inversion; VMX: conditional cache flushes SMT vulnerable- Clear Linux 27180: KPTI + __user pointer sanitization + Full generic retpoline IBPB: conditional IBRS_FW STIBP: conditional RSB filling + SSB disabled via prctl and seccomp + PTE Inversion; VMX: conditional cache flushes SMT vulnerable- CentOS 7: SELinuxGraphics Details- openSUSE Tumbleweed, Antergos 19.1, Clear Linux 27180: EXAEnvironment Details- Clear Linux 27180: CFFLAGS=-g-O3-feliminate-unused-debug-types-pipe-Wall-Wp-D_FORTIFY_SOURCE=2-fexceptions-fstack-protector--param=ssp-buffer-size=32-Wl--copy-dt-needed-entries-m64-fasynchronous-unwind-tables-Wp-D_REENTRANT-ftree-loop-distribute-patterns-Wl-z-Wl now-Wl-z-Wl relro-malign-data=abi-fno-semantic-interposition-ftree-vectorize-ftree-loop-vectorize-Wl-sort-common-Wl--enable-new-dtags FFLAGS=-g-O3-feliminate-unused-debug-types-pipe-Wall-Wp-D_FORTIFY_SOURCE=2-fexceptions-fstack-protector--param=ssp-buffer-size=32-Wl--copy-dt-needed-entries-m64-fasynchronous-unwind-tables-Wp-D_REENTRANT-ftree-loop-distribute-patterns-Wl-z-Wl relro-malign-data=abi-fno-semantic-interposition-ftree-vectorize-ftree-loop-vectorize-Wl--enable-new-dtags CXXFLAGS=-g-O3-feliminate-unused-debug-types-pipe-Wall-Wp-D_FORTIFY_SOURCE=2-fexceptions-fstack-protector--param=ssp-buffer-size=32-Wformat-Wformat-security-Wl--copy-dt-needed-entries-m64-fasynchronous-unwind-tables-Wp-D_REENTRANT-ftree-loop-distribute-patterns-Wl-z-Wl relro-fno-semantic-interposition-ffat-lto-objects-fno-signed-zeros-fno-trapping-math-fassociative-math-Wl-sort-common-Wl--enable-new-dtags-mtune=skylake-fvisibility-inlines-hidden-Wl--enable-new-dtags MESA_GLSL_CACHE_DISABLE=0 CFLAGS=-g-O3-feliminate-unused-debug-types-pipe-Wall-Wp-D_FORTIFY_SOURCE=2-fexceptions-fstack-protector--param=ssp-buffer-size=32-Wformat-Wformat-security-Wl--copy-dt-needed-entries-m64-fasynchronous-unwind-tables-Wp-D_REENTRANT-ftree-loop-distribute-patterns-Wl-z-Wl relro-fno-semantic-interposition-ffat-lto-objects-fno-signed-zeros-fno-trapping-math-fassociative-math-Wl-sort-common-Wl--enable-new-dtags-mtune=skylake THEANO_FLAGS=floatX=float32 openmp=true gcc.cxxflags="-ftree-vectorize-mavx"

CPU PlaidML Linux Benchmarksplaidml: No - Training - VGG16 - CPUplaidml: No - Training - VGG19 - CPUplaidml: No - Inference - VGG16 - CPUplaidml: No - Inference - VGG19 - CPUplaidml: Yes - Inference - VGG16 - CPUplaidml: Yes - Inference - VGG19 - CPUplaidml: No - Training - IMDB LSTM - CPUplaidml: No - Inference - IMDB LSTM - CPUplaidml: No - Inference - Mobilenet - CPUplaidml: No - Inference - ResNet 50 - CPUplaidml: No - Inference - DenseNet 201 - CPUplaidml: No - Inference - NASNer Large - CPUUbuntu 18.10openSUSE TumbleweedFedora Workstation 29Debian 9.6Antergos 19.1Clear Linux 27180CentOS 71.231.005.734.863.933.492.172.5226.048.242.711.161.481.217.456.354.584.152.082.3846.5112.062.871.411.271.036.165.234.203.752.282.5930.129.593.141.241.431.167.496.354.884.402.242.5352.813.651.351.291.056.495.504.363.912.102.4030.663.121.261.391.127.136.064.754.252.492.7051.4515.114.381.411.481.217.576.424.994.482.251.8051.9812.373.921.32OpenBenchmarking.org

PlaidML

FP16: No - Mode: Training - Network: VGG16 - Device: CPU

OpenBenchmarking.orgExamples Per Second, More Is BetterPlaidMLFP16: No - Mode: Training - Network: VGG16 - Device: CPUUbuntu 18.10openSUSE TumbleweedFedora Workstation 29Debian 9.6Antergos 19.1Clear Linux 27180CentOS 70.3330.6660.9991.3321.665SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 31.231.481.271.431.291.391.48

PlaidML

FP16: No - Mode: Training - Network: VGG19 - Device: CPU

OpenBenchmarking.orgExamples Per Second, More Is BetterPlaidMLFP16: No - Mode: Training - Network: VGG19 - Device: CPUUbuntu 18.10openSUSE TumbleweedFedora Workstation 29Debian 9.6Antergos 19.1Clear Linux 27180CentOS 70.27230.54460.81691.08921.3615SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 31.001.211.031.161.051.121.21

PlaidML

FP16: No - Mode: Inference - Network: VGG16 - Device: CPU

OpenBenchmarking.orgExamples Per Second, More Is BetterPlaidMLFP16: No - Mode: Inference - Network: VGG16 - Device: CPUUbuntu 18.10openSUSE TumbleweedFedora Workstation 29Debian 9.6Antergos 19.1Clear Linux 27180CentOS 7246810SE +/- 0.00, N = 3SE +/- 0.04, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.00, N = 3SE +/- 0.01, N = 3SE +/- 0.03, N = 35.737.456.167.496.497.137.57

PlaidML

FP16: No - Mode: Inference - Network: VGG19 - Device: CPU

OpenBenchmarking.orgExamples Per Second, More Is BetterPlaidMLFP16: No - Mode: Inference - Network: VGG19 - Device: CPUUbuntu 18.10openSUSE TumbleweedFedora Workstation 29Debian 9.6Antergos 19.1Clear Linux 27180CentOS 7246810SE +/- 0.00, N = 3SE +/- 0.04, N = 3SE +/- 0.01, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.02, N = 34.866.355.236.355.506.066.42

PlaidML

FP16: Yes - Mode: Inference - Network: VGG16 - Device: CPU

OpenBenchmarking.orgExamples Per Second, More Is BetterPlaidMLFP16: Yes - Mode: Inference - Network: VGG16 - Device: CPUUbuntu 18.10openSUSE TumbleweedFedora Workstation 29Debian 9.6Antergos 19.1Clear Linux 27180CentOS 71.12282.24563.36844.49125.614SE +/- 0.01, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.01, N = 3SE +/- 0.02, N = 3SE +/- 0.02, N = 3SE +/- 0.02, N = 33.934.584.204.884.364.754.99

PlaidML

FP16: Yes - Mode: Inference - Network: VGG19 - Device: CPU

OpenBenchmarking.orgExamples Per Second, More Is BetterPlaidMLFP16: Yes - Mode: Inference - Network: VGG19 - Device: CPUUbuntu 18.10openSUSE TumbleweedFedora Workstation 29Debian 9.6Antergos 19.1Clear Linux 27180CentOS 71.0082.0163.0244.0325.04SE +/- 0.00, N = 3SE +/- 0.01, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.01, N = 3SE +/- 0.02, N = 3SE +/- 0.02, N = 33.494.153.754.403.914.254.48

PlaidML

FP16: No - Mode: Training - Network: IMDB LSTM - Device: CPU

OpenBenchmarking.orgExamples Per Second, More Is BetterPlaidMLFP16: No - Mode: Training - Network: IMDB LSTM - Device: CPUUbuntu 18.10openSUSE TumbleweedFedora Workstation 29Debian 9.6Antergos 19.1Clear Linux 27180CentOS 70.56031.12061.68092.24122.8015SE +/- 0.00, N = 3SE +/- 0.03, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.03, N = 3SE +/- 0.01, N = 32.172.082.282.242.102.492.25

PlaidML

FP16: No - Mode: Inference - Network: IMDB LSTM - Device: CPU

OpenBenchmarking.orgExamples Per Second, More Is BetterPlaidMLFP16: No - Mode: Inference - Network: IMDB LSTM - Device: CPUUbuntu 18.10openSUSE TumbleweedFedora Workstation 29Debian 9.6Antergos 19.1Clear Linux 27180CentOS 70.60751.2151.82252.433.0375SE +/- 0.00, N = 3SE +/- 0.03, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 32.522.382.592.532.402.701.80

PlaidML

FP16: No - Mode: Inference - Network: Mobilenet - Device: CPU

OpenBenchmarking.orgExamples Per Second, More Is BetterPlaidMLFP16: No - Mode: Inference - Network: Mobilenet - Device: CPUUbuntu 18.10openSUSE TumbleweedFedora Workstation 29Debian 9.6Antergos 19.1Clear Linux 27180CentOS 71224364860SE +/- 0.10, N = 3SE +/- 1.08, N = 12SE +/- 0.03, N = 3SE +/- 0.92, N = 3SE +/- 0.10, N = 3SE +/- 0.71, N = 3SE +/- 1.40, N = 1226.0446.5130.1252.8130.6651.4551.98

PlaidML

FP16: No - Mode: Inference - Network: ResNet 50 - Device: CPU

OpenBenchmarking.orgExamples Per Second, More Is BetterPlaidMLFP16: No - Mode: Inference - Network: ResNet 50 - Device: CPUUbuntu 18.10openSUSE TumbleweedFedora Workstation 29Clear Linux 27180CentOS 748121620SE +/- 0.00, N = 2SE +/- 0.12, N = 2SE +/- 0.02, N = 3SE +/- 0.06, N = 2SE +/- 0.05, N = 28.2412.069.5915.1112.37

PlaidML

FP16: No - Mode: Inference - Network: DenseNet 201 - Device: CPU

OpenBenchmarking.orgExamples Per Second, More Is BetterPlaidMLFP16: No - Mode: Inference - Network: DenseNet 201 - Device: CPUUbuntu 18.10openSUSE TumbleweedFedora Workstation 29Debian 9.6Antergos 19.1Clear Linux 27180CentOS 70.98551.9712.95653.9424.9275SE +/- 0.00, N = 3SE +/- 0.05, N = 9SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.06, N = 5SE +/- 0.12, N = 92.712.873.143.653.124.383.92

PlaidML

FP16: No - Mode: Inference - Network: NASNer Large - Device: CPU

OpenBenchmarking.orgExamples Per Second, More Is BetterPlaidMLFP16: No - Mode: Inference - Network: NASNer Large - Device: CPUUbuntu 18.10openSUSE TumbleweedFedora Workstation 29Debian 9.6Antergos 19.1Clear Linux 27180CentOS 70.31730.63460.95191.26921.5865SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 31.161.411.241.351.261.411.32

Phoronix Test Suite v10.8.4