onnx e5
Intel Xeon E3-1280 v5 testing with a MSI Z170A SLI PLUS (MS-7998) v1.0 (2.A0 BIOS) and ASUS AMD Radeon HD 7850 / R7 265 R9 270 1024SP on Ubuntu 20.04 via the Phoronix Test Suite.


1: 

	Processor: Intel Xeon E3-1280 v5 @ 4.00GHz (4 Cores / 8 Threads), Motherboard: MSI Z170A SLI PLUS (MS-7998) v1.0 (2.A0 BIOS), Chipset: Intel Xeon E3-1200 v5/E3-1500, Memory: 32GB, Disk: 256GB TOSHIBA RD400, Graphics: ASUS AMD Radeon HD 7850 / R7 265 R9 270 1024SP, Audio: Realtek ALC1150, Monitor: DELL S2409W, Network: Intel I219-V

	OS: Ubuntu 20.04, Kernel: 5.9.0-050900rc2daily20200826-generic (x86_64) 20200825, Desktop: GNOME Shell 3.36.4, Display Server: X Server 1.20.8, Display Driver: modesetting 1.20.8, OpenGL: 4.5 Mesa 20.0.8 (LLVM 10.0.0), Compiler: GCC 9.3.0, File-System: ext4, Screen Resolution: 1920x1080

2: 

	Processor: Intel Xeon E3-1280 v5 @ 4.00GHz (4 Cores / 8 Threads), Motherboard: MSI Z170A SLI PLUS (MS-7998) v1.0 (2.A0 BIOS), Chipset: Intel Xeon E3-1200 v5/E3-1500, Memory: 32GB, Disk: 256GB TOSHIBA RD400, Graphics: ASUS AMD Radeon HD 7850 / R7 265 R9 270 1024SP, Audio: Realtek ALC1150, Monitor: DELL S2409W, Network: Intel I219-V

	OS: Ubuntu 20.04, Kernel: 5.9.0-050900rc2daily20200826-generic (x86_64) 20200825, Desktop: GNOME Shell 3.36.4, Display Server: X Server 1.20.8, Display Driver: modesetting 1.20.8, OpenGL: 4.5 Mesa 20.0.8 (LLVM 10.0.0), Compiler: GCC 9.3.0, File-System: ext4, Screen Resolution: 1920x1080

3: 

	Processor: Intel Xeon E3-1280 v5 @ 4.00GHz (4 Cores / 8 Threads), Motherboard: MSI Z170A SLI PLUS (MS-7998) v1.0 (2.A0 BIOS), Chipset: Intel Xeon E3-1200 v5/E3-1500, Memory: 32GB, Disk: 256GB TOSHIBA RD400, Graphics: ASUS AMD Radeon HD 7850 / R7 265 R9 270 1024SP, Audio: Realtek ALC1150, Monitor: DELL S2409W, Network: Intel I219-V

	OS: Ubuntu 20.04, Kernel: 5.9.0-050900rc2daily20200826-generic (x86_64) 20200825, Desktop: GNOME Shell 3.36.4, Display Server: X Server 1.20.8, Display Driver: modesetting 1.20.8, OpenGL: 4.5 Mesa 20.0.8 (LLVM 10.0.0), Compiler: GCC 9.3.0, File-System: ext4, Screen Resolution: 1920x1080

4: 

	Processor: Intel Xeon E3-1280 v5 @ 4.00GHz (4 Cores / 8 Threads), Motherboard: MSI Z170A SLI PLUS (MS-7998) v1.0 (2.A0 BIOS), Chipset: Intel Xeon E3-1200 v5/E3-1500, Memory: 32GB, Disk: 256GB TOSHIBA RD400, Graphics: ASUS AMD Radeon HD 7850 / R7 265 R9 270 1024SP, Audio: Realtek ALC1150, Monitor: DELL S2409W, Network: Intel I219-V

	OS: Ubuntu 20.04, Kernel: 5.9.0-050900rc2daily20200826-generic (x86_64) 20200825, Desktop: GNOME Shell 3.36.4, Display Server: X Server 1.20.8, Display Driver: modesetting 1.20.8, OpenGL: 4.5 Mesa 20.0.8 (LLVM 10.0.0), Compiler: GCC 9.3.0, File-System: ext4, Screen Resolution: 1920x1080

5: 

	Processor: Intel Xeon E3-1280 v5 @ 4.00GHz (4 Cores / 8 Threads), Motherboard: MSI Z170A SLI PLUS (MS-7998) v1.0 (2.A0 BIOS), Chipset: Intel Xeon E3-1200 v5/E3-1500, Memory: 32GB, Disk: 256GB TOSHIBA RD400, Graphics: ASUS AMD Radeon HD 7850 / R7 265 R9 270 1024SP, Audio: Realtek ALC1150, Monitor: DELL S2409W, Network: Intel I219-V

	OS: Ubuntu 20.04, Kernel: 5.9.0-050900rc2daily20200826-generic (x86_64) 20200825, Desktop: GNOME Shell 3.36.4, Display Server: X Server 1.20.8, Display Driver: modesetting 1.20.8, OpenGL: 4.5 Mesa 20.0.8 (LLVM 10.0.0), Compiler: GCC 9.3.0, File-System: ext4, Screen Resolution: 1920x1080


ONNX Runtime 1.6
Model: yolov4 - Device: OpenMP CPU
Inferences Per Minute > Higher Is Better
1 . 233 |======================================================================
2 . 233 |======================================================================
3 . 233 |======================================================================
4 . 234 |======================================================================
5 . 233 |======================================================================


ONNX Runtime 1.6
Model: bertsquad-10 - Device: OpenMP CPU
Inferences Per Minute > Higher Is Better
1 . 362 |======================================================================
2 . 362 |======================================================================
3 . 360 |======================================================================
4 . 360 |======================================================================
5 . 362 |======================================================================


ONNX Runtime 1.6
Model: fcn-resnet101-11 - Device: OpenMP CPU
Inferences Per Minute > Higher Is Better
1 . 38 |=======================================================================
2 . 38 |=======================================================================
3 . 38 |=======================================================================
4 . 38 |=======================================================================
5 . 38 |=======================================================================


ONNX Runtime 1.6
Model: shufflenet-v2-10 - Device: OpenMP CPU
Inferences Per Minute > Higher Is Better
1 . 12738 |================================================================
2 . 13444 |====================================================================
3 . 13415 |====================================================================
4 . 13465 |====================================================================
5 . 13440 |====================================================================


ONNX Runtime 1.6
Model: super-resolution-10 - Device: OpenMP CPU
Inferences Per Minute > Higher Is Better
1 . 2803 |====================================================================
2 . 2819 |=====================================================================
3 . 2831 |=====================================================================
4 . 2831 |=====================================================================
5 . 2813 |=====================================================================