onnx comet
Intel Core i7-10700T testing with a Logic Supply RXM-181 (Z01-0002A026 BIOS) and Intel UHD 630 CML GT2 3GB on Ubuntu 21.10 via the Phoronix Test Suite.


A: 

	Processor: Intel Core i7-10700T @ 4.50GHz (8 Cores / 16 Threads), Motherboard: Logic Supply RXM-181 (Z01-0002A026 BIOS), Chipset: Intel Comet Lake PCH, Memory: 32GB, Disk: 256GB TS256GMTS800, Graphics: Intel UHD 630 CML GT2 3GB (1200MHz), Audio: Realtek ALC233, Monitor: DELL P2415Q, Network: Intel I219-LM + Intel I210

	OS: Ubuntu 21.10, Kernel: 5.13.0-35-generic (x86_64), Desktop: GNOME Shell 40.5, Display Server: X Server + Wayland, OpenGL: 4.6 Mesa 21.2.2, Vulkan: 1.2.182, Compiler: GCC 11.2.0, File-System: ext4, Screen Resolution: 1920x1080

B: 

	Processor: Intel Core i7-10700T @ 4.50GHz (8 Cores / 16 Threads), Motherboard: Logic Supply RXM-181 (Z01-0002A026 BIOS), Chipset: Intel Comet Lake PCH, Memory: 32GB, Disk: 256GB TS256GMTS800, Graphics: Intel UHD 630 CML GT2 3GB (1200MHz), Audio: Realtek ALC233, Monitor: DELL P2415Q, Network: Intel I219-LM + Intel I210

	OS: Ubuntu 21.10, Kernel: 5.13.0-35-generic (x86_64), Desktop: GNOME Shell 40.5, Display Server: X Server + Wayland, OpenGL: 4.6 Mesa 21.2.2, Vulkan: 1.2.182, Compiler: GCC 11.2.0, File-System: ext4, Screen Resolution: 1920x1080

C: 

	Processor: Intel Core i7-10700T @ 4.50GHz (8 Cores / 16 Threads), Motherboard: Logic Supply RXM-181 (Z01-0002A026 BIOS), Chipset: Intel Comet Lake PCH, Memory: 32GB, Disk: 256GB TS256GMTS800, Graphics: Intel UHD 630 CML GT2 3GB (1200MHz), Audio: Realtek ALC233, Monitor: DELL P2415Q, Network: Intel I219-LM + Intel I210

	OS: Ubuntu 21.10, Kernel: 5.13.0-35-generic (x86_64), Desktop: GNOME Shell 40.5, Display Server: X Server + Wayland, OpenGL: 4.6 Mesa 21.2.2, Vulkan: 1.2.182, Compiler: GCC 11.2.0, File-System: ext4, Screen Resolution: 1920x1080


ONNX Runtime 1.11
Model: GPT-2 - Device: CPU - Executor: Parallel
Inferences Per Minute > Higher Is Better
A . 3658 |==================================================================
B . 3841 |=====================================================================
C . 3842 |=====================================================================


ONNX Runtime 1.11
Model: GPT-2 - Device: CPU - Executor: Standard
Inferences Per Minute > Higher Is Better
A . 4242 |===================================================================
B . 4347 |=====================================================================
C . 4365 |=====================================================================


ONNX Runtime 1.11
Model: yolov4 - Device: CPU - Executor: Parallel
Inferences Per Minute > Higher Is Better
A . 202 |===================================================================
B . 210 |======================================================================
C . 209 |======================================================================


ONNX Runtime 1.11
Model: yolov4 - Device: CPU - Executor: Standard
Inferences Per Minute > Higher Is Better
A . 254 |==========================================================
B . 296 |===================================================================
C . 308 |======================================================================


ONNX Runtime 1.11
Model: bertsquad-12 - Device: CPU - Executor: Parallel
Inferences Per Minute > Higher Is Better
A . 302 |====================================================================
B . 313 |======================================================================
C . 312 |======================================================================


ONNX Runtime 1.11
Model: bertsquad-12 - Device: CPU - Executor: Standard
Inferences Per Minute > Higher Is Better
A . 376 |========================================================
B . 471 |======================================================================
C . 461 |=====================================================================


ONNX Runtime 1.11
Model: fcn-resnet101-11 - Device: CPU - Executor: Parallel
Inferences Per Minute > Higher Is Better
A . 39 |=====================================================================
B . 40 |=======================================================================
C . 39 |=====================================================================


ONNX Runtime 1.11
Model: fcn-resnet101-11 - Device: CPU - Executor: Standard
Inferences Per Minute > Higher Is Better
A . 42 |============================================================
B . 50 |=======================================================================
C . 50 |=======================================================================


ONNX Runtime 1.11
Model: ArcFace ResNet-100 - Device: CPU - Executor: Parallel
Inferences Per Minute > Higher Is Better
A . 698 |=====================================================================
B . 708 |======================================================================
C . 703 |======================================================================


ONNX Runtime 1.11
Model: ArcFace ResNet-100 - Device: CPU - Executor: Standard
Inferences Per Minute > Higher Is Better
A . 965 |======================================================================
B . 955 |=====================================================================
C . 682 |=================================================


ONNX Runtime 1.11
Model: super-resolution-10 - Device: CPU - Executor: Parallel
Inferences Per Minute > Higher Is Better
A . 2171 |====================================================================
B . 2203 |=====================================================================
C . 2185 |====================================================================


ONNX Runtime 1.11
Model: super-resolution-10 - Device: CPU - Executor: Standard
Inferences Per Minute > Higher Is Better
A . 3025 |====================================================================
B . 2054 |==============================================
C . 3057 |=====================================================================