OpenVINO Xeon Platinum 8280 2P Intel Xeon Gold 5218R testing with a Supermicro X11SPL-F v1.02 (3.1 BIOS) and llvmpipe on Ubuntu 20.04 via the Phoronix Test Suite. 1: Processor: 2 x Intel Xeon Platinum 8280 @ 4.00GHz (56 Cores / 112 Threads), Motherboard: GIGABYTE MD61-SC2-00 v01000100 (T15 BIOS), Chipset: Intel Sky Lake-E DMI3 Registers, Memory: 378GB, Disk: 280GB INTEL SSDPED1D280GA, Graphics: llvmpipe, Network: 2 x Intel X722 for 1GbE + 2 x QLogic FastLinQ QL41000 10/25/40/50GbE OS: Ubuntu 20.04, Kernel: 5.9.0-050900rc4daily20200912-generic (x86_64) 20200911, Desktop: GNOME Shell 3.36.1, Display Server: X Server 1.20.8, Display Driver: modesetting 1.20.8, OpenGL: 3.3 Mesa 20.0.4 (LLVM 9.0.1 256 bits), Compiler: GCC 9.3.0, File-System: ext4, Screen Resolution: 1920x1080 2: Processor: 2 x Intel Xeon Platinum 8280 @ 4.00GHz (56 Cores / 112 Threads), Motherboard: GIGABYTE MD61-SC2-00 v01000100 (T15 BIOS), Chipset: Intel Sky Lake-E DMI3 Registers, Memory: 378GB, Disk: 280GB INTEL SSDPED1D280GA, Graphics: llvmpipe, Monitor: VE228, Network: 2 x Intel X722 for 1GbE + 2 x QLogic FastLinQ QL41000 10/25/40/50GbE OS: Ubuntu 20.04, Kernel: 5.9.0-050900rc4daily20200912-generic (x86_64) 20200911, Desktop: GNOME Shell 3.36.1, Display Server: X Server 1.20.8, Display Driver: modesetting 1.20.8, OpenGL: 3.3 Mesa 20.0.4 (LLVM 9.0.1 256 bits), Compiler: GCC 9.3.0, File-System: ext4, Screen Resolution: 1920x1080 3: Processor: 2 x Intel Xeon Platinum 8280 @ 4.00GHz (56 Cores / 112 Threads), Motherboard: GIGABYTE MD61-SC2-00 v01000100 (T15 BIOS), Chipset: Intel Sky Lake-E DMI3 Registers, Memory: 378GB, Disk: 280GB INTEL SSDPED1D280GA, Graphics: llvmpipe, Monitor: VE228, Network: 2 x Intel X722 for 1GbE + 2 x QLogic FastLinQ QL41000 10/25/40/50GbE OS: Ubuntu 20.04, Kernel: 5.9.0-050900rc4daily20200912-generic (x86_64) 20200911, Desktop: GNOME Shell 3.36.1, Display Server: X Server 1.20.8, Display Driver: modesetting 1.20.8, OpenGL: 3.3 Mesa 20.0.4 (LLVM 9.0.1 256 bits), Compiler: GCC 9.3.0, File-System: ext4, Screen Resolution: 1920x1080 gold 1: Processor: Intel Xeon Gold 5218R @ 4.00GHz (20 Cores / 40 Threads), Motherboard: Supermicro X11SPL-F v1.02 (3.1 BIOS), Chipset: Intel Sky Lake-E DMI3 Registers, Memory: 188GB, Disk: 280GB INTEL SSDPED1D280GA, Graphics: llvmpipe, Monitor: VE228, Network: 2 x Intel I210 OS: Ubuntu 20.04, Kernel: 5.4.0-21-generic (x86_64), Desktop: GNOME Shell 3.36.1, Display Server: X Server 1.20.8, Display Driver: modesetting 1.20.8, OpenGL: 3.3 Mesa 20.0.4 (LLVM 9.0.1 256 bits), Compiler: GCC 9.3.0, File-System: ext4, Screen Resolution: 1920x1080 gold 2: Processor: Intel Xeon Gold 5218R @ 4.00GHz (20 Cores / 40 Threads), Motherboard: Supermicro X11SPL-F v1.02 (3.1 BIOS), Chipset: Intel Sky Lake-E DMI3 Registers, Memory: 188GB, Disk: 280GB INTEL SSDPED1D280GA, Graphics: llvmpipe, Monitor: VE228, Network: 2 x Intel I210 OS: Ubuntu 20.04, Kernel: 5.4.0-21-generic (x86_64), Desktop: GNOME Shell 3.36.1, Display Server: X Server 1.20.8, Display Driver: modesetting 1.20.8, OpenGL: 3.3 Mesa 20.0.4 (LLVM 9.0.1 256 bits), Compiler: GCC 9.3.0, File-System: ext4, Screen Resolution: 1920x1080 gold 3: Processor: Intel Xeon Gold 5218R @ 4.00GHz (20 Cores / 40 Threads), Motherboard: Supermicro X11SPL-F v1.02 (3.1 BIOS), Chipset: Intel Sky Lake-E DMI3 Registers, Memory: 188GB, Disk: 280GB INTEL SSDPED1D280GA, Graphics: llvmpipe, Monitor: VE228, Network: 2 x Intel I210 OS: Ubuntu 20.04, Kernel: 5.4.0-21-generic (x86_64), Desktop: GNOME Shell 3.36.1, Display Server: X Server 1.20.8, Display Driver: modesetting 1.20.8, OpenGL: 3.3 Mesa 20.0.4 (LLVM 9.0.1 256 bits), Compiler: GCC 9.3.0, File-System: ext4, Screen Resolution: 1920x1080 RNNoise 2020-06-28 Seconds < Lower Is Better 1 ...... 28.41 |=============================================================== 2 ...... 28.49 |=============================================================== 3 ...... 28.50 |=============================================================== gold 1 . 28.32 |=============================================================== gold 2 . 28.33 |=============================================================== gold 3 . 28.34 |=============================================================== OpenVINO 2021.1 Model: Face Detection 0106 FP16 - Device: CPU FPS > Higher Is Better 1 ...... 15.51 |=============================================================== 2 ...... 15.49 |=============================================================== 3 ...... 15.49 |=============================================================== gold 1 . 3.89 |================ gold 2 . 3.90 |================ gold 3 . 3.90 |================ OpenVINO 2021.1 Model: Face Detection 0106 FP16 - Device: CPU ms < Lower Is Better 1 ...... 1783.91 |=========================================== 2 ...... 1787.03 |=========================================== 3 ...... 1784.64 |=========================================== gold 1 . 2548.92 |============================================================= gold 2 . 2544.91 |============================================================= gold 3 . 2542.20 |============================================================= OpenVINO 2021.1 Model: Face Detection 0106 FP32 - Device: CPU FPS > Higher Is Better 1 ...... 15.31 |=============================================================== 2 ...... 15.28 |=============================================================== 3 ...... 15.29 |=============================================================== gold 1 . 3.88 |================ gold 2 . 3.88 |================ gold 3 . 3.86 |================ OpenVINO 2021.1 Model: Face Detection 0106 FP32 - Device: CPU ms < Lower Is Better 1 ...... 1807.42 |=========================================== 2 ...... 1812.85 |=========================================== 3 ...... 1811.16 |=========================================== gold 1 . 2559.02 |============================================================= gold 2 . 2563.01 |============================================================= gold 3 . 2566.25 |============================================================= OpenVINO 2021.1 Model: Person Detection 0106 FP16 - Device: CPU FPS > Higher Is Better 1 ...... 8.81 |================================================================ 2 ...... 8.82 |================================================================ 3 ...... 8.85 |================================================================ gold 1 . 2.36 |================= gold 2 . 2.37 |================= gold 3 . 2.37 |================= OpenVINO 2021.1 Model: Person Detection 0106 FP16 - Device: CPU ms < Lower Is Better 1 ...... 3112.29 |============================================= 2 ...... 3105.79 |============================================= 3 ...... 3099.95 |============================================= gold 1 . 4209.86 |============================================================= gold 2 . 4189.98 |============================================================= gold 3 . 4206.29 |============================================================= OpenVINO 2021.1 Model: Person Detection 0106 FP32 - Device: CPU FPS > Higher Is Better 1 ...... 8.72 |================================================================ 2 ...... 8.71 |================================================================ 3 ...... 8.70 |================================================================ gold 1 . 2.32 |================= gold 2 . 2.35 |================= gold 3 . 2.36 |================= OpenVINO 2021.1 Model: Person Detection 0106 FP32 - Device: CPU ms < Lower Is Better 1 ...... 3134.27 |============================================= 2 ...... 3134.96 |============================================= 3 ...... 3132.49 |============================================= gold 1 . 4236.19 |============================================================= gold 2 . 4216.72 |============================================================= gold 3 . 4205.72 |============================================================= OpenVINO 2021.1 Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU FPS > Higher Is Better 1 ...... 37412.38 |============================================================ 2 ...... 37277.56 |============================================================ 3 ...... 37385.39 |============================================================ gold 1 . 12654.88 |==================== gold 2 . 12635.41 |==================== gold 3 . 12649.27 |==================== OpenVINO 2021.1 Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU ms < Lower Is Better 1 ...... 0.63 |===================================================== 2 ...... 0.63 |===================================================== 3 ...... 0.63 |===================================================== gold 1 . 0.76 |================================================================ gold 2 . 0.76 |================================================================ gold 3 . 0.76 |================================================================ OpenVINO 2021.1 Model: Age Gender Recognition Retail 0013 FP32 - Device: CPU FPS > Higher Is Better 1 ...... 37425.68 |============================================================ 2 ...... 37422.38 |============================================================ 3 ...... 37321.78 |============================================================ gold 1 . 12476.95 |==================== gold 2 . 12504.09 |==================== gold 3 . 12445.16 |==================== OpenVINO 2021.1 Model: Age Gender Recognition Retail 0013 FP32 - Device: CPU ms < Lower Is Better 1 ...... 0.63 |==================================================== 2 ...... 0.63 |==================================================== 3 ...... 0.63 |==================================================== gold 1 . 0.77 |================================================================ gold 2 . 0.77 |================================================================ gold 3 . 0.77 |================================================================ Kvazaar 2.0 Video Input: Bosphorus 1080p - Video Preset: Slow Frames Per Second > Higher Is Better gold 1 . 24.53 |=============================================================== gold 2 . 24.55 |=============================================================== gold 3 . 24.56 |=============================================================== Kvazaar 2.0 Video Input: Bosphorus 1080p - Video Preset: Medium Frames Per Second > Higher Is Better gold 1 . 25.34 |=============================================================== gold 2 . 25.31 |=============================================================== gold 3 . 25.33 |=============================================================== Kvazaar 2.0 Video Input: Bosphorus 1080p - Video Preset: Very Fast Frames Per Second > Higher Is Better gold 1 . 60.19 |=============================================================== gold 2 . 60.20 |=============================================================== gold 3 . 60.13 |=============================================================== Kvazaar 2.0 Video Input: Bosphorus 1080p - Video Preset: Ultra Fast Frames Per Second > Higher Is Better gold 1 . 109.42 |============================================================== gold 2 . 109.18 |============================================================== gold 3 . 109.16 |============================================================== Kvazaar 2.0 Video Input: Bosphorus 4K - Video Preset: Slow Frames Per Second > Higher Is Better gold 1 . 6.93 |================================================================ gold 2 . 6.93 |================================================================ gold 3 . 6.91 |================================================================ Kvazaar 2.0 Video Input: Bosphorus 4K - Video Preset: Medium Frames Per Second > Higher Is Better gold 1 . 7.10 |================================================================ gold 2 . 7.09 |================================================================ gold 3 . 7.10 |================================================================ Kvazaar 2.0 Video Input: Bosphorus 4K - Video Preset: Very Fast Frames Per Second > Higher Is Better gold 1 . 17.95 |=============================================================== gold 2 . 17.88 |=============================================================== gold 3 . 17.91 |=============================================================== Kvazaar 2.0 Video Input: Bosphorus 4K - Video Preset: Ultra Fast Frames Per Second > Higher Is Better gold 1 . 32.42 |=============================================================== gold 2 . 32.52 |=============================================================== gold 3 . 32.43 |=============================================================== x265 3.4 Video Input: Bosphorus 1080p Frames Per Second > Higher Is Better gold 1 . 55.51 |=============================================================== gold 2 . 55.61 |=============================================================== gold 3 . 55.84 |=============================================================== x265 3.4 Video Input: Bosphorus 4K Frames Per Second > Higher Is Better gold 1 . 20.14 |=============================================================== gold 2 . 20.16 |=============================================================== gold 3 . 20.12 |===============================================================