Xeon Silver ONNX
Intel Xeon Silver 4216 testing with a TYAN S7100AG2NR (V4.02 BIOS) and ASPEED on Debian 10 via the Phoronix Test Suite.


1: 

	Processor: Intel Xeon Silver 4216 @ 3.20GHz (16 Cores / 32 Threads), Motherboard: TYAN S7100AG2NR (V4.02 BIOS), Chipset: Intel Sky Lake-E DMI3 Registers, Memory: 24GB, Disk: 240GB Corsair Force MP500, Graphics: ASPEED, Audio: Realtek ALC892, Network: 2 x Intel I350

	OS: Debian 10, Kernel: 4.19.0-9-amd64 (x86_64), Desktop: GNOME Shell 3.30.2, Display Server: X Server, Compiler: GCC 8.3.0, File-System: ext4, Screen Resolution: 1024x768

2: 

	Processor: Intel Xeon Silver 4216 @ 3.20GHz (16 Cores / 32 Threads), Motherboard: TYAN S7100AG2NR (V4.02 BIOS), Chipset: Intel Sky Lake-E DMI3 Registers, Memory: 24GB, Disk: 240GB Corsair Force MP500, Graphics: ASPEED, Audio: Realtek ALC892, Network: 2 x Intel I350

	OS: Debian 10, Kernel: 4.19.0-9-amd64 (x86_64), Desktop: GNOME Shell 3.30.2, Display Server: X Server, Compiler: GCC 8.3.0, File-System: ext4, Screen Resolution: 1024x768

3: 

	Processor: Intel Xeon Silver 4216 @ 3.20GHz (16 Cores / 32 Threads), Motherboard: TYAN S7100AG2NR (V4.02 BIOS), Chipset: Intel Sky Lake-E DMI3 Registers, Memory: 24GB, Disk: 240GB Corsair Force MP500, Graphics: ASPEED, Audio: Realtek ALC892, Network: 2 x Intel I350

	OS: Debian 10, Kernel: 4.19.0-9-amd64 (x86_64), Desktop: GNOME Shell 3.30.2, Display Server: X Server, Compiler: GCC 8.3.0, File-System: ext4, Screen Resolution: 1024x768


ONNX Runtime 1.6
Model: yolov4 - Device: OpenMP CPU
Inferences Per Minute > Higher Is Better
1 . 314 |=====================================================================
2 . 317 |======================================================================
3 . 314 |=====================================================================


ONNX Runtime 1.6
Model: bertsquad-10 - Device: OpenMP CPU
Inferences Per Minute > Higher Is Better
1 . 367 |======================================================================
2 . 359 |====================================================================
3 . 347 |==================================================================


ONNX Runtime 1.6
Model: fcn-resnet101-11 - Device: OpenMP CPU
Inferences Per Minute > Higher Is Better
1 . 68 |=======================================================================
2 . 67 |======================================================================
3 . 67 |======================================================================


ONNX Runtime 1.6
Model: shufflenet-v2-10 - Device: OpenMP CPU
Inferences Per Minute > Higher Is Better
1 . 5411 |=====================================================================
2 . 5426 |=====================================================================
3 . 5419 |=====================================================================


ONNX Runtime 1.6
Model: super-resolution-10 - Device: OpenMP CPU
Inferences Per Minute > Higher Is Better
1 . 4043 |=====================================================================
2 . 4045 |=====================================================================
3 . 4042 |=====================================================================