TFLite Xeon 2 x Intel Xeon Platinum 8280 testing with a GIGABYTE MD61-SC2-00 v01000100 (T15 BIOS) and ASPEED on Ubuntu 20.04 via the Phoronix Test Suite. 4210R v1: Processor: 2 x Intel Xeon Silver 4210R @ 3.20GHz (20 Cores / 40 Threads), Motherboard: GIGABYTE MD61-SC2-00 v01000100 (T15 BIOS), Chipset: Intel Sky Lake-E DMI3 Registers, Memory: 378GB, Disk: 280GB INTEL SSDPE21D280GA, Graphics: ASPEED, Monitor: VE228, Network: 2 x Intel X722 for 1GbE + 2 x QLogic FastLinQ QL41000 10/25/40/50GbE OS: Ubuntu 20.04, Kernel: 5.8.0-050800rc6daily20200721-generic (x86_64) 20200720, Desktop: GNOME Shell 3.36.1, Display Server: X Server 1.20.8, Display Driver: modesetting 1.20.8, Compiler: GCC 9.3.0, File-System: ext4, Screen Resolution: 1920x1080 4210R v2: Processor: 2 x Intel Xeon Silver 4210R @ 3.20GHz (20 Cores / 40 Threads), Motherboard: GIGABYTE MD61-SC2-00 v01000100 (T15 BIOS), Chipset: Intel Sky Lake-E DMI3 Registers, Memory: 378GB, Disk: 280GB INTEL SSDPE21D280GA, Graphics: ASPEED, Monitor: VE228, Network: 2 x Intel X722 for 1GbE + 2 x QLogic FastLinQ QL41000 10/25/40/50GbE OS: Ubuntu 20.04, Kernel: 5.8.0-050800rc6daily20200721-generic (x86_64) 20200720, Desktop: GNOME Shell 3.36.1, Display Server: X Server 1.20.8, Display Driver: modesetting 1.20.8, Compiler: GCC 9.3.0, File-System: ext4, Screen Resolution: 1920x1080 8280 v1: Processor: Intel Xeon Platinum 8280 @ 4.00GHz (28 Cores / 56 Threads), Motherboard: GIGABYTE MD61-SC2-00 v01000100 (T15 BIOS), Chipset: Intel Sky Lake-E DMI3 Registers, Memory: 188GB, Disk: 280GB INTEL SSDPE21D280GA, Graphics: ASPEED, Network: 2 x Intel X722 for 1GbE + 2 x QLogic FastLinQ QL41000 10/25/40/50GbE OS: Ubuntu 20.04, Kernel: 5.8.0-050800rc6daily20200721-generic (x86_64) 20200720, Desktop: GNOME Shell 3.36.1, Display Server: X Server 1.20.8, Display Driver: modesetting 1.20.8, Compiler: GCC 9.3.0, File-System: ext4, Screen Resolution: 1024x768 8280 v2: Processor: Intel Xeon Platinum 8280 @ 4.00GHz (28 Cores / 56 Threads), Motherboard: GIGABYTE MD61-SC2-00 v01000100 (T15 BIOS), Chipset: Intel Sky Lake-E DMI3 Registers, Memory: 188GB, Disk: 280GB INTEL SSDPE21D280GA, Graphics: ASPEED, Network: 2 x Intel X722 for 1GbE + 2 x QLogic FastLinQ QL41000 10/25/40/50GbE OS: Ubuntu 20.04, Kernel: 5.8.0-050800rc6daily20200721-generic (x86_64) 20200720, Desktop: GNOME Shell 3.36.1, Display Server: X Server 1.20.8, Display Driver: modesetting 1.20.8, Compiler: GCC 9.3.0, File-System: ext4, Screen Resolution: 1024x768 8280 v3: Processor: Intel Xeon Platinum 8280 @ 4.00GHz (28 Cores / 56 Threads), Motherboard: GIGABYTE MD61-SC2-00 v01000100 (T15 BIOS), Chipset: Intel Sky Lake-E DMI3 Registers, Memory: 188GB, Disk: 280GB INTEL SSDPE21D280GA, Graphics: ASPEED, Network: 2 x Intel X722 for 1GbE + 2 x QLogic FastLinQ QL41000 10/25/40/50GbE OS: Ubuntu 20.04, Kernel: 5.8.0-050800rc6daily20200721-generic (x86_64) 20200720, Desktop: GNOME Shell 3.36.1, Display Server: X Server 1.20.8, Display Driver: modesetting 1.20.8, Compiler: GCC 9.3.0, File-System: ext4, Screen Resolution: 1024x768 8280 2P v1: Processor: 2 x Intel Xeon Platinum 8280 @ 4.00GHz (56 Cores / 112 Threads), Motherboard: GIGABYTE MD61-SC2-00 v01000100 (T15 BIOS), Chipset: Intel Sky Lake-E DMI3 Registers, Memory: 378GB, Disk: 280GB INTEL SSDPE21D280GA, Graphics: ASPEED, Network: 2 x Intel X722 for 1GbE + 2 x QLogic FastLinQ QL41000 10/25/40/50GbE OS: Ubuntu 20.04, Kernel: 5.8.0-050800rc6daily20200721-generic (x86_64) 20200720, Desktop: GNOME Shell 3.36.1, Display Server: X Server 1.20.8, Display Driver: modesetting 1.20.8, Compiler: GCC 9.3.0, File-System: ext4, Screen Resolution: 1024x768 TensorFlow Lite 2020-08-23 Model: SqueezeNet Microseconds < Lower Is Better 4210R v1 ... 154716.0 |======================================================== 4210R v2 ... 154582.0 |======================================================== 8280 v1 .... 105743.0 |====================================== 8280 v2 .... 102800.0 |===================================== 8280 v3 .... 102847.0 |===================================== 8280 2P v1 . 67472.4 |======================== TensorFlow Lite 2020-08-23 Model: Inception V4 Microseconds < Lower Is Better 4210R v1 ... 2319593 |========================================================= 4210R v2 ... 2314640 |========================================================= 8280 v1 .... 1554937 |====================================== 8280 v2 .... 1541103 |====================================== 8280 v3 .... 1538290 |====================================== 8280 2P v1 . 1069320 |========================== TensorFlow Lite 2020-08-23 Model: NASNet Mobile Microseconds < Lower Is Better 4210R v1 ... 155227.0 |======================================================== 4210R v2 ... 154476.0 |======================================================== 8280 v1 .... 122684.0 |============================================ 8280 v2 .... 119507.0 |=========================================== 8280 v3 .... 118559.0 |=========================================== 8280 2P v1 . 114202.3 |========================================= TensorFlow Lite 2020-08-23 Model: Mobilenet Float Microseconds < Lower Is Better 4210R v1 ... 109921.0 |======================================================== 4210R v2 ... 110052.0 |======================================================== 8280 v1 .... 74575.1 |====================================== 8280 v2 .... 74240.6 |====================================== 8280 v3 .... 73976.2 |====================================== 8280 2P v1 . 62934.7 |================================ TensorFlow Lite 2020-08-23 Model: Mobilenet Quant Microseconds < Lower Is Better 4210R v1 ... 113742.0 |======================================================== 4210R v2 ... 113566.0 |======================================================== 8280 v1 .... 76579.2 |====================================== 8280 v2 .... 76592.0 |====================================== 8280 v3 .... 75997.2 |===================================== 8280 2P v1 . 64430.1 |================================ TensorFlow Lite 2020-08-23 Model: Inception ResNet V2 Microseconds < Lower Is Better 4210R v1 ... 2053580 |========================================================= 4210R v2 ... 2041053 |========================================================= 8280 v1 .... 1390553 |======================================= 8280 v2 .... 1387610 |======================================= 8280 v3 .... 1386137 |====================================== 8280 2P v1 . 935544 |==========================