TFLite Xeon 2 x AMD EPYC 7282 16-Core testing with a Supermicro H11DSi-NT v2.00 (2.1 BIOS) and ASPEED on Ubuntu 20.04 via the Phoronix Test Suite. 4210R v1: Processor: 2 x Intel Xeon Silver 4210R @ 3.20GHz (20 Cores / 40 Threads), Motherboard: GIGABYTE MD61-SC2-00 v01000100 (T15 BIOS), Chipset: Intel Sky Lake-E DMI3 Registers, Memory: 378GB, Disk: 280GB INTEL SSDPE21D280GA, Graphics: ASPEED, Monitor: VE228, Network: 2 x Intel X722 for 1GbE + 2 x QLogic FastLinQ QL41000 10/25/40/50GbE OS: Ubuntu 20.04, Kernel: 5.8.0-050800rc6daily20200721-generic (x86_64) 20200720, Desktop: GNOME Shell 3.36.1, Display Server: X Server 1.20.8, Display Driver: modesetting 1.20.8, Compiler: GCC 9.3.0, File-System: ext4, Screen Resolution: 1920x1080 4210R v2: Processor: 2 x Intel Xeon Silver 4210R @ 3.20GHz (20 Cores / 40 Threads), Motherboard: GIGABYTE MD61-SC2-00 v01000100 (T15 BIOS), Chipset: Intel Sky Lake-E DMI3 Registers, Memory: 378GB, Disk: 280GB INTEL SSDPE21D280GA, Graphics: ASPEED, Monitor: VE228, Network: 2 x Intel X722 for 1GbE + 2 x QLogic FastLinQ QL41000 10/25/40/50GbE OS: Ubuntu 20.04, Kernel: 5.8.0-050800rc6daily20200721-generic (x86_64) 20200720, Desktop: GNOME Shell 3.36.1, Display Server: X Server 1.20.8, Display Driver: modesetting 1.20.8, Compiler: GCC 9.3.0, File-System: ext4, Screen Resolution: 1920x1080 8280 v1: Processor: Intel Xeon Platinum 8280 @ 4.00GHz (28 Cores / 56 Threads), Motherboard: GIGABYTE MD61-SC2-00 v01000100 (T15 BIOS), Chipset: Intel Sky Lake-E DMI3 Registers, Memory: 188GB, Disk: 280GB INTEL SSDPE21D280GA, Graphics: ASPEED, Network: 2 x Intel X722 for 1GbE + 2 x QLogic FastLinQ QL41000 10/25/40/50GbE OS: Ubuntu 20.04, Kernel: 5.8.0-050800rc6daily20200721-generic (x86_64) 20200720, Desktop: GNOME Shell 3.36.1, Display Server: X Server 1.20.8, Display Driver: modesetting 1.20.8, Compiler: GCC 9.3.0, File-System: ext4, Screen Resolution: 1024x768 8280 v2: Processor: Intel Xeon Platinum 8280 @ 4.00GHz (28 Cores / 56 Threads), Motherboard: GIGABYTE MD61-SC2-00 v01000100 (T15 BIOS), Chipset: Intel Sky Lake-E DMI3 Registers, Memory: 188GB, Disk: 280GB INTEL SSDPE21D280GA, Graphics: ASPEED, Network: 2 x Intel X722 for 1GbE + 2 x QLogic FastLinQ QL41000 10/25/40/50GbE OS: Ubuntu 20.04, Kernel: 5.8.0-050800rc6daily20200721-generic (x86_64) 20200720, Desktop: GNOME Shell 3.36.1, Display Server: X Server 1.20.8, Display Driver: modesetting 1.20.8, Compiler: GCC 9.3.0, File-System: ext4, Screen Resolution: 1024x768 8280 v3: Processor: Intel Xeon Platinum 8280 @ 4.00GHz (28 Cores / 56 Threads), Motherboard: GIGABYTE MD61-SC2-00 v01000100 (T15 BIOS), Chipset: Intel Sky Lake-E DMI3 Registers, Memory: 188GB, Disk: 280GB INTEL SSDPE21D280GA, Graphics: ASPEED, Network: 2 x Intel X722 for 1GbE + 2 x QLogic FastLinQ QL41000 10/25/40/50GbE OS: Ubuntu 20.04, Kernel: 5.8.0-050800rc6daily20200721-generic (x86_64) 20200720, Desktop: GNOME Shell 3.36.1, Display Server: X Server 1.20.8, Display Driver: modesetting 1.20.8, Compiler: GCC 9.3.0, File-System: ext4, Screen Resolution: 1024x768 8280 2P v1: Processor: 2 x Intel Xeon Platinum 8280 @ 4.00GHz (56 Cores / 112 Threads), Motherboard: GIGABYTE MD61-SC2-00 v01000100 (T15 BIOS), Chipset: Intel Sky Lake-E DMI3 Registers, Memory: 378GB, Disk: 280GB INTEL SSDPE21D280GA, Graphics: ASPEED, Network: 2 x Intel X722 for 1GbE + 2 x QLogic FastLinQ QL41000 10/25/40/50GbE OS: Ubuntu 20.04, Kernel: 5.8.0-050800rc6daily20200721-generic (x86_64) 20200720, Desktop: GNOME Shell 3.36.1, Display Server: X Server 1.20.8, Display Driver: modesetting 1.20.8, Compiler: GCC 9.3.0, File-System: ext4, Screen Resolution: 1024x768 8280 2P v2: Processor: 2 x Intel Xeon Platinum 8280 @ 4.00GHz (56 Cores / 112 Threads), Motherboard: GIGABYTE MD61-SC2-00 v01000100 (T15 BIOS), Chipset: Intel Sky Lake-E DMI3 Registers, Memory: 378GB, Disk: 280GB INTEL SSDPE21D280GA, Graphics: ASPEED, Network: 2 x Intel X722 for 1GbE + 2 x QLogic FastLinQ QL41000 10/25/40/50GbE OS: Ubuntu 20.04, Kernel: 5.8.0-050800rc6daily20200721-generic (x86_64) 20200720, Desktop: GNOME Shell 3.36.1, Display Server: X Server 1.20.8, Display Driver: modesetting 1.20.8, Compiler: GCC 9.3.0, File-System: ext4, Screen Resolution: 1920x1080 8280 2P v3: Processor: 2 x Intel Xeon Platinum 8280 @ 4.00GHz (56 Cores / 112 Threads), Motherboard: GIGABYTE MD61-SC2-00 v01000100 (T15 BIOS), Chipset: Intel Sky Lake-E DMI3 Registers, Memory: 378GB, Disk: 280GB INTEL SSDPE21D280GA, Graphics: ASPEED, Network: 2 x Intel X722 for 1GbE + 2 x QLogic FastLinQ QL41000 10/25/40/50GbE OS: Ubuntu 20.04, Kernel: 5.8.0-050800rc6daily20200721-generic (x86_64) 20200720, Desktop: GNOME Shell 3.36.1, Display Server: X Server 1.20.8, Display Driver: modesetting 1.20.8, Compiler: GCC 9.3.0, File-System: ext4, Screen Resolution: 1920x1080 7282 2P: Processor: 2 x AMD EPYC 7282 16-Core @ 2.80GHz (32 Cores / 64 Threads), Motherboard: Supermicro H11DSi-NT v2.00 (2.1 BIOS), Chipset: AMD Starship/Matisse, Memory: 474GB, Disk: 280GB INTEL SSDPE21D280GA, Graphics: ASPEED, Monitor: VE228, Network: 2 x Intel 10G X550T OS: Ubuntu 20.04, Kernel: 5.8.0-050800rc6daily20200721-generic (x86_64) 20200720, Desktop: GNOME Shell 3.36.1, Display Server: X Server 1.20.8, Display Driver: modesetting 1.20.8, Compiler: GCC 9.3.0, File-System: ext4, Screen Resolution: 1920x1080 TensorFlow Lite 2020-08-23 Model: SqueezeNet Microseconds < Lower Is Better 4210R v1 ... 154716.0 |======================================================== 4210R v2 ... 154582.0 |======================================================== 8280 v1 .... 105743.0 |====================================== 8280 v2 .... 102800.0 |===================================== 8280 v3 .... 102847.0 |===================================== 8280 2P v1 . 67472.4 |======================== 8280 2P v2 . 76156.0 |============================ 8280 2P v3 . 89144.4 |================================ 7282 2P .... 80937.2 |============================= TensorFlow Lite 2020-08-23 Model: Inception V4 Microseconds < Lower Is Better 4210R v1 ... 2319593 |========================================================= 4210R v2 ... 2314640 |========================================================= 8280 v1 .... 1554937 |====================================== 8280 v2 .... 1541103 |====================================== 8280 v3 .... 1538290 |====================================== 8280 2P v1 . 1069320 |========================== 8280 2P v2 . 1005991 |========================= 8280 2P v3 . 1055833 |========================== 7282 2P .... 1054153 |========================== TensorFlow Lite 2020-08-23 Model: NASNet Mobile Microseconds < Lower Is Better 4210R v1 ... 155227.0 |======================================================== 4210R v2 ... 154476.0 |======================================================== 8280 v1 .... 122684.0 |============================================ 8280 v2 .... 119507.0 |=========================================== 8280 v3 .... 118559.0 |=========================================== 8280 2P v1 . 114202.3 |========================================= 8280 2P v2 . 153434.0 |======================================================= 8280 2P v3 . 153902.0 |======================================================== 7282 2P .... 108799.0 |======================================= TensorFlow Lite 2020-08-23 Model: Mobilenet Float Microseconds < Lower Is Better 4210R v1 ... 109921.0 |======================================================== 4210R v2 ... 110052.0 |======================================================== 8280 v1 .... 74575.1 |====================================== 8280 v2 .... 74240.6 |====================================== 8280 v3 .... 73976.2 |====================================== 8280 2P v1 . 62934.7 |================================ 8280 2P v2 . 72332.6 |===================================== 8280 2P v3 . 69538.9 |=================================== 7282 2P .... 48021.9 |======================== TensorFlow Lite 2020-08-23 Model: Mobilenet Quant Microseconds < Lower Is Better 4210R v1 ... 113742.0 |======================================================== 4210R v2 ... 113566.0 |======================================================== 8280 v1 .... 76579.2 |====================================== 8280 v2 .... 76592.0 |====================================== 8280 v3 .... 75997.2 |===================================== 8280 2P v1 . 64430.1 |================================ 8280 2P v2 . 69941.6 |================================== 8280 2P v3 . 67326.2 |================================= 7282 2P .... 49668.3 |======================== TensorFlow Lite 2020-08-23 Model: Inception ResNet V2 Microseconds < Lower Is Better 4210R v1 ... 2053580 |========================================================= 4210R v2 ... 2041053 |========================================================= 8280 v1 .... 1390553 |======================================= 8280 v2 .... 1387610 |======================================= 8280 v3 .... 1386137 |====================================== 8280 2P v1 . 935544 |========================== 8280 2P v2 . 973260 |=========================== 8280 2P v3 . 980449 |=========================== 7282 2P .... 936345 |==========================