xeon onnx
Intel Xeon Silver 4216 testing with a TYAN S7100AG2NR (V4.02 BIOS) and ASPEED on Debian 11 via the Phoronix Test Suite.


A: 

	Processor: Intel Xeon Silver 4216 @ 3.20GHz (16 Cores / 32 Threads), Motherboard: TYAN S7100AG2NR (V4.02 BIOS), Chipset: Intel Sky Lake-E DMI3 Registers, Memory: 46GB, Disk: 240GB Corsair Force MP500, Graphics: ASPEED, Audio: Realtek ALC892, Network: 2 x Intel I350

	OS: Debian 11, Kernel: 5.10.0-10-amd64 (x86_64), Display Server: X Server, Vulkan: 1.0.2, Compiler: GCC 10.2.1 20210110, File-System: ext4, Screen Resolution: 1024x768

B: 

	Processor: Intel Xeon Silver 4216 @ 3.20GHz (16 Cores / 32 Threads), Motherboard: TYAN S7100AG2NR (V4.02 BIOS), Chipset: Intel Sky Lake-E DMI3 Registers, Memory: 46GB, Disk: 240GB Corsair Force MP500, Graphics: ASPEED, Audio: Realtek ALC892, Network: 2 x Intel I350

	OS: Debian 11, Kernel: 5.10.0-10-amd64 (x86_64), Display Server: X Server, Vulkan: 1.0.2, Compiler: GCC 10.2.1 20210110, File-System: ext4, Screen Resolution: 1024x768

C: 

	Processor: Intel Xeon Silver 4216 @ 3.20GHz (16 Cores / 32 Threads), Motherboard: TYAN S7100AG2NR (V4.02 BIOS), Chipset: Intel Sky Lake-E DMI3 Registers, Memory: 46GB, Disk: 240GB Corsair Force MP500, Graphics: ASPEED, Audio: Realtek ALC892, Network: 2 x Intel I350

	OS: Debian 11, Kernel: 5.10.0-10-amd64 (x86_64), Display Server: X Server, Vulkan: 1.0.2, Compiler: GCC 10.2.1 20210110, File-System: ext4, Screen Resolution: 1024x768


ONNX Runtime 1.11
Model: GPT-2 - Device: CPU
Inferences Per Minute > Higher Is Better
A . 5334 |=====================================================================
B . 5310 |=====================================================================
C . 5327 |=====================================================================


ONNX Runtime 1.11
Model: yolov4 - Device: CPU
Inferences Per Minute > Higher Is Better
A . 276 |======================================================================
B . 277 |======================================================================
C . 277 |======================================================================


ONNX Runtime 1.11
Model: bertsquad-12 - Device: CPU
Inferences Per Minute > Higher Is Better
A . 432 |======================================================================
B . 432 |======================================================================
C . 434 |======================================================================


ONNX Runtime 1.11
Model: fcn-resnet101-11 - Device: CPU
Inferences Per Minute > Higher Is Better
A . 53 |=======================================================================
B . 52 |======================================================================
C . 52 |======================================================================


ONNX Runtime 1.11
Model: ArcFace ResNet-100 - Device: CPU
Inferences Per Minute > Higher Is Better
A . 738 |======================================================================
B . 734 |======================================================================
C . 733 |======================================================================


ONNX Runtime 1.11
Model: super-resolution-10 - Device: CPU
Inferences Per Minute > Higher Is Better
A . 2828 |=====================================================================
B . 2845 |=====================================================================
C . 2841 |=====================================================================