AMD EPYC PlaidML AMD EPYC PlaidML. 2 x EPYC 7252: Processor: 2 x AMD EPYC 7252 8-Core @ 3.10GHz (16 Cores / 32 Threads), Motherboard: Supermicro H11DSi-NT v2.00 (2.1 BIOS), Chipset: AMD Starship/Matisse, Memory: 504GB, Disk: 280GB INTEL SSDPE21D280GA, Graphics: ASPEED, Monitor: VE228, Network: 2 x Intel 10G X550T OS: Ubuntu 20.04, Kernel: 5.8.0-050800rc6daily20200721-generic (x86_64) 20200720, Desktop: GNOME Shell 3.36.1, Display Server: X Server 1.20.8, Display Driver: modesetting 1.20.8, Compiler: GCC 9.3.0, File-System: ext4, Screen Resolution: 1920x1080 2 x EPYC 7262: Processor: 2 x AMD EPYC 7262 8-Core @ 3.20GHz (16 Cores / 32 Threads), Motherboard: Supermicro H11DSi-NT v2.00 (2.1 BIOS), Chipset: AMD Starship/Matisse, Memory: 504GB, Disk: 280GB INTEL SSDPE21D280GA, Graphics: ASPEED, Monitor: VE228, Network: 2 x Intel 10G X550T OS: Ubuntu 20.04, Kernel: 5.8.0-050800rc6daily20200721-generic (x86_64) 20200720, Desktop: GNOME Shell 3.36.1, Display Server: X Server 1.20.8, Display Driver: modesetting 1.20.8, Compiler: GCC 9.3.0, File-System: ext4, Screen Resolution: 1920x1080 2 x EPYC 7272: Processor: 2 x AMD EPYC 7272 12-Core @ 2.90GHz (24 Cores / 48 Threads), Motherboard: Supermicro H11DSi-NT v2.00 (2.1 BIOS), Chipset: AMD Starship/Matisse, Memory: 504GB, Disk: 280GB INTEL SSDPE21D280GA, Graphics: ASPEED, Monitor: VE228, Network: 2 x Intel 10G X550T OS: Ubuntu 20.04, Kernel: 5.8.0-050800rc6daily20200721-generic (x86_64) 20200720, Desktop: GNOME Shell 3.36.1, Display Server: X Server 1.20.8, Display Driver: modesetting 1.20.8, Compiler: GCC 9.3.0, File-System: ext4, Screen Resolution: 1920x1080 2 x EPYC 7452: Processor: 2 x AMD EPYC 7452 32-Core @ 2.35GHz (64 Cores / 128 Threads), Motherboard: Supermicro H11DSi-NT v2.00 (2.1 BIOS), Chipset: AMD Starship/Matisse, Memory: 504GB, Disk: 280GB INTEL SSDPE21D280GA, Graphics: llvmpipe 504GB, Monitor: VGA HDMI, Network: 2 x Intel 10G X550T OS: Ubuntu 20.04, Kernel: 5.8.0-050800rc6daily20200721-generic (x86_64) 20200720, Desktop: GNOME Shell 3.36.1, Display Server: X Server 1.20.8, Display Driver: modesetting 1.20.8, OpenGL: 3.3 Mesa 20.0.4 (LLVM 9.0.1 128 bits), Compiler: GCC 9.3.0, File-System: ext4, Screen Resolution: 1920x1080 2 x EPYC 7742: Processor: 2 x AMD EPYC 7742 64-Core @ 2.25GHz (128 Cores / 256 Threads), Motherboard: Supermicro H11DSi-NT v2.00 (2.1 BIOS), Chipset: AMD Starship/Matisse, Memory: 504GB, Disk: 280GB INTEL SSDPE21D280GA, Graphics: llvmpipe 504GB, Monitor: VGA HDMI, Network: 2 x Intel 10G X550T OS: Ubuntu 20.04, Kernel: 5.8.0-050800rc6daily20200721-generic (x86_64) 20200720, Desktop: GNOME Shell 3.36.1, Display Server: X Server 1.20.8, Display Driver: modesetting 1.20.8, OpenGL: 3.3 Mesa 20.0.4 (LLVM 9.0.1 128 bits), Compiler: GCC 9.3.0, File-System: ext4, Screen Resolution: 1920x1080 2 x EPYC 7F32: Processor: 2 x AMD EPYC 7F32 8-Core @ 3.70GHz (16 Cores / 32 Threads), Motherboard: Supermicro H11DSi-NT v2.00 (2.1 BIOS), Chipset: AMD Starship/Matisse, Memory: 504GB, Disk: 280GB INTEL SSDPE21D280GA, Graphics: llvmpipe, Monitor: VGA HDMI, Network: 2 x Intel 10G X550T OS: Ubuntu 20.04, Kernel: 5.8.0-050800rc6daily20200721-generic (x86_64) 20200720, Desktop: GNOME Shell 3.36.1, Display Server: X Server 1.20.8, Display Driver: modesetting 1.20.8, OpenGL: 3.3 Mesa 20.0.4 (LLVM 9.0.1 128 bits), Compiler: GCC 9.3.0, File-System: ext4, Screen Resolution: 1920x1080 2 x EPYC 7F72: Processor: 2 x AMD EPYC 7F72 24-Core @ 3.20GHz (48 Cores / 96 Threads), Motherboard: Supermicro H11DSi-NT v2.00 (2.1 BIOS), Chipset: AMD Starship/Matisse, Memory: 504GB, Disk: 280GB INTEL SSDPE21D280GA, Graphics: llvmpipe, Monitor: VGA HDMI, Network: 2 x Intel 10G X550T OS: Ubuntu 20.04, Kernel: 5.8.0-050800rc6daily20200721-generic (x86_64) 20200720, Desktop: GNOME Shell 3.36.1, Display Server: X Server 1.20.8, Display Driver: modesetting 1.20.8, OpenGL: 3.3 Mesa 20.0.4 (LLVM 9.0.1 128 bits), Compiler: GCC 9.3.0, File-System: ext4, Screen Resolution: 1920x1080 2 x Xeon Gold 6230R: Processor: 2 x Intel Xeon Gold 6230R @ 4.00GHz (52 Cores / 104 Threads), Motherboard: GIGABYTE MD61-SC2-00 v01000100 (T15 BIOS), Chipset: Intel Sky Lake-E DMI3 Registers, Memory: 378GB, Disk: 280GB INTEL SSDPE21D280GA, Graphics: ASPEED, Monitor: VE228, Network: 2 x Intel X722 for 1GbE + 2 x QLogic FastLinQ QL41000 10/25/40/50GbE OS: Ubuntu 20.04, Kernel: 5.8.0-050800rc6daily20200721-generic (x86_64) 20200720, Desktop: GNOME Shell 3.36.1, Display Server: X Server 1.20.8, Display Driver: modesetting 1.20.8, Compiler: GCC 9.3.0, File-System: ext4, Screen Resolution: 1920x1080 2 x Xeon Silver 4210R: Processor: 2 x Intel Xeon Silver 4210R @ 3.20GHz (20 Cores / 40 Threads), Motherboard: GIGABYTE MD61-SC2-00 v01000100 (T15 BIOS), Chipset: Intel Sky Lake-E DMI3 Registers, Memory: 378GB, Disk: 280GB INTEL SSDPE21D280GA, Graphics: ASPEED, Monitor: VE228, Network: 2 x Intel X722 for 1GbE + 2 x QLogic FastLinQ QL41000 10/25/40/50GbE OS: Ubuntu 20.04, Kernel: 5.8.0-050800rc6daily20200721-generic (x86_64) 20200720, Desktop: GNOME Shell 3.36.1, Display Server: X Server 1.20.8, Display Driver: modesetting 1.20.8, Compiler: GCC 9.3.0, File-System: ext4, Screen Resolution: 1920x1080 EPYC 7232P: Processor: AMD EPYC 7232P 8-Core @ 3.10GHz (8 Cores / 16 Threads), Motherboard: Supermicro H11DSi-NT v2.00 (2.1 BIOS), Chipset: AMD Starship/Matisse, Memory: 252GB, Disk: 280GB INTEL SSDPE21D280GA, Graphics: ASPEED, Monitor: VE228, Network: 2 x Intel 10G X550T OS: Ubuntu 20.04, Kernel: 5.8.0-050800rc6daily20200721-generic (x86_64) 20200720, Desktop: GNOME Shell 3.36.1, Display Server: X Server 1.20.8, Display Driver: modesetting 1.20.8, Compiler: GCC 9.3.0, File-System: ext4, Screen Resolution: 1920x1080 EPYC 7302P: Processor: AMD EPYC 7302P 16-Core @ 3.00GHz (16 Cores / 32 Threads), Motherboard: Supermicro H11DSi-NT v2.00 (2.1 BIOS), Chipset: AMD Starship/Matisse, Memory: 252GB, Disk: 280GB INTEL SSDPE21D280GA, Graphics: ASPEED, Monitor: VE228, Network: 2 x Intel 10G X550T OS: Ubuntu 20.04, Kernel: 5.8.0-050800rc6daily20200721-generic (x86_64) 20200720, Desktop: GNOME Shell 3.36.1, Display Server: X Server 1.20.8, Display Driver: modesetting 1.20.8, Compiler: GCC 9.3.0, File-System: ext4, Screen Resolution: 1920x1080 EPYC 7402P: Processor: AMD EPYC 7402P 24-Core @ 2.80GHz (24 Cores / 48 Threads), Motherboard: Supermicro H11DSi-NT v2.00 (2.1 BIOS), Chipset: AMD Starship/Matisse, Memory: 252GB, Disk: 280GB INTEL SSDPE21D280GA, Graphics: ASPEED, Monitor: VE228, Network: 2 x Intel 10G X550T OS: Ubuntu 20.04, Kernel: 5.8.0-050800rc6daily20200721-generic (x86_64) 20200720, Desktop: GNOME Shell 3.36.1, Display Server: X Server 1.20.8, Display Driver: modesetting 1.20.8, Compiler: GCC 9.3.0, File-System: ext4, Screen Resolution: 1920x1080 EPYC 7502P: Processor: AMD EPYC 7502P 32-Core @ 2.50GHz (32 Cores / 64 Threads), Motherboard: Supermicro H11DSi-NT v2.00 (2.1 BIOS), Chipset: AMD Starship/Matisse, Memory: 252GB, Disk: 280GB INTEL SSDPE21D280GA, Graphics: ASPEED, Monitor: VE228, Network: 2 x Intel 10G X550T OS: Ubuntu 20.04, Kernel: 5.8.0-050800rc6daily20200721-generic (x86_64) 20200720, Desktop: GNOME Shell 3.36.1, Display Server: X Server 1.20.8, Display Driver: modesetting 1.20.8, Compiler: GCC 9.3.0, File-System: ext4, Screen Resolution: 1920x1080 Xeon Platinum 8280: Processor: Intel Xeon Platinum 8280 @ 4.00GHz (28 Cores / 56 Threads), Motherboard: GIGABYTE MD61-SC2-00 v01000100 (T15 BIOS), Chipset: Intel Sky Lake-E DMI3 Registers, Memory: 188GB, Disk: 280GB INTEL SSDPE21D280GA, Graphics: ASPEED, Network: 2 x Intel X722 for 1GbE + 2 x QLogic FastLinQ QL41000 10/25/40/50GbE OS: Ubuntu 20.04, Kernel: 5.8.0-050800rc6daily20200721-generic (x86_64) 20200720, Desktop: GNOME Shell 3.36.1, Display Server: X Server 1.20.8, Display Driver: modesetting 1.20.8, Compiler: GCC 9.3.0, File-System: ext4, Screen Resolution: 1024x768 PlaidML FP16: No - Mode: Inference - Network: VGG16 - Device: CPU FPS > Higher Is Better 2 x EPYC 7252 ......... 20.16 |============================== 2 x EPYC 7262 ......... 20.17 |============================== 2 x EPYC 7272 ......... 23.46 |=================================== 2 x EPYC 7452 ......... 27.87 |========================================== 2 x EPYC 7742 ......... 29.37 |============================================ 2 x EPYC 7F32 ......... 22.49 |================================== 2 x EPYC 7F72 ......... 27.94 |========================================== 2 x Xeon Gold 6230R ... 25.08 |===================================== 2 x Xeon Silver 4210R . 15.31 |======================= EPYC 7232P ............ 11.83 |================== EPYC 7302P ............ 22.51 |================================== EPYC 7402P ............ 27.37 |========================================= EPYC 7502P ............ 32.19 |================================================ Xeon Platinum 8280 .... 31.91 |================================================ PlaidML FP16: No - Mode: Inference - Network: VGG19 - Device: CPU FPS > Higher Is Better 2 x EPYC 7252 ......... 16.33 |============================= 2 x EPYC 7262 ......... 16.55 |============================== 2 x EPYC 7272 ......... 19.48 |=================================== 2 x EPYC 7452 ......... 24.50 |============================================ 2 x EPYC 7742 ......... 25.20 |============================================= 2 x EPYC 7F32 ......... 18.73 |================================== 2 x EPYC 7F72 ......... 24.23 |============================================ 2 x Xeon Gold 6230R ... 22.73 |========================================= 2 x Xeon Silver 4210R . 12.70 |======================= EPYC 7232P ............ 9.43 |================= EPYC 7302P ............ 18.20 |================================= EPYC 7402P ............ 22.76 |========================================= EPYC 7502P ............ 26.61 |================================================ Xeon Platinum 8280 .... 26.61 |================================================ PlaidML FP16: No - Mode: Inference - Network: IMDB LSTM - Device: CPU FPS > Higher Is Better 2 x EPYC 7252 ......... 428.60 |================ 2 x EPYC 7262 ......... 388.48 |=============== 2 x EPYC 7272 ......... 435.56 |================= 2 x EPYC 7452 ......... 462.45 |================== 2 x EPYC 7742 ......... 334.98 |============= 2 x EPYC 7F32 ......... 419.15 |================ 2 x EPYC 7F72 ......... 449.52 |================= 2 x Xeon Gold 6230R ... 644.51 |========================= 2 x Xeon Silver 4210R . 506.36 |=================== EPYC 7232P ............ 1197.26 |============================================== EPYC 7302P ............ 615.19 |======================== EPYC 7402P ............ 634.28 |======================== EPYC 7502P ............ 1019.49 |======================================= Xeon Platinum 8280 .... 637.84 |========================= PlaidML FP16: No - Mode: Inference - Network: Mobilenet - Device: CPU FPS > Higher Is Better 2 x EPYC 7252 ......... 11.32 |==================================== 2 x EPYC 7262 ......... 11.31 |==================================== 2 x EPYC 7272 ......... 11.57 |===================================== 2 x EPYC 7452 ......... 11.46 |==================================== 2 x EPYC 7742 ......... 11.38 |==================================== 2 x EPYC 7F32 ......... 12.21 |======================================= 2 x EPYC 7F72 ......... 11.93 |====================================== 2 x Xeon Gold 6230R ... 12.01 |====================================== 2 x Xeon Silver 4210R . 8.45 |=========================== EPYC 7232P ............ 12.18 |======================================= EPYC 7302P ............ 13.61 |=========================================== EPYC 7402P ............ 14.24 |============================================= EPYC 7502P ............ 14.54 |============================================== Xeon Platinum 8280 .... 15.18 |================================================ PlaidML FP16: No - Mode: Inference - Network: ResNet 50 - Device: CPU FPS > Higher Is Better 2 x EPYC 7252 ......... 4.45 |=================================== 2 x EPYC 7262 ......... 4.53 |=================================== 2 x EPYC 7272 ......... 4.51 |=================================== 2 x EPYC 7452 ......... 4.45 |=================================== 2 x EPYC 7742 ......... 4.50 |=================================== 2 x EPYC 7F32 ......... 4.82 |====================================== 2 x EPYC 7F72 ......... 4.76 |===================================== 2 x Xeon Gold 6230R ... 4.79 |===================================== 2 x Xeon Silver 4210R . 3.65 |============================ EPYC 7232P ............ 5.17 |======================================== EPYC 7302P ............ 5.67 |============================================ EPYC 7402P ............ 5.77 |============================================= EPYC 7502P ............ 5.97 |=============================================== Xeon Platinum 8280 .... 6.28 |================================================= PlaidML FP16: No - Mode: Inference - Network: DenseNet 201 - Device: CPU FPS > Higher Is Better 2 x EPYC 7252 ......... 2.70 |=========================================== 2 x EPYC 7262 ......... 2.73 |============================================ 2 x EPYC 7272 ......... 2.71 |=========================================== 2 x EPYC 7452 ......... 2.67 |=========================================== 2 x EPYC 7742 ......... 2.59 |========================================= 2 x EPYC 7F32 ......... 2.99 |================================================ 2 x EPYC 7F72 ......... 2.88 |============================================== 2 x Xeon Silver 4210R . 1.63 |========================== EPYC 7232P ............ 2.62 |========================================== EPYC 7302P ............ 3.00 |================================================ EPYC 7402P ............ 3.00 |================================================ EPYC 7502P ............ 3.07 |================================================= Xeon Platinum 8280 .... 2.57 |========================================= PlaidML FP16: No - Mode: Inference - Network: Inception V3 - Device: CPU FPS > Higher Is Better 2 x EPYC 7252 ......... 8.18 |==================================== 2 x EPYC 7262 ......... 7.97 |=================================== 2 x EPYC 7272 ......... 8.55 |===================================== 2 x EPYC 7452 ......... 8.22 |==================================== 2 x EPYC 7742 ......... 7.78 |================================== 2 x EPYC 7F32 ......... 8.67 |====================================== 2 x EPYC 7F72 ......... 8.75 |====================================== 2 x Xeon Silver 4210R . 4.68 |==================== EPYC 7232P ............ 7.78 |================================== EPYC 7302P ............ 9.97 |=========================================== EPYC 7402P ............ 10.86 |=============================================== EPYC 7502P ............ 11.03 |================================================ Xeon Platinum 8280 .... 7.35 |================================