xeon silv jan Intel Xeon Silver 4216 testing with a TYAN S7100AG2NR (V4.02 BIOS) and ASPEED on Debian 11 via the Phoronix Test Suite. a: Processor: Intel Xeon Silver 4216 @ 3.20GHz (16 Cores / 32 Threads), Motherboard: TYAN S7100AG2NR (V4.02 BIOS), Chipset: Intel Sky Lake-E DMI3 Registers, Memory: 46GB, Disk: 240GB Corsair Force MP500, Graphics: ASPEED, Audio: Realtek ALC892, Network: 2 x Intel I350 OS: Debian 11, Kernel: 5.10.0-10-amd64 (x86_64), Display Server: X Server, Vulkan: 1.0.2, Compiler: GCC 10.2.1 20210110, File-System: ext4, Screen Resolution: 1024x768 b: Processor: Intel Xeon Silver 4216 @ 3.20GHz (16 Cores / 32 Threads), Motherboard: TYAN S7100AG2NR (V4.02 BIOS), Chipset: Intel Sky Lake-E DMI3 Registers, Memory: 46GB, Disk: 240GB Corsair Force MP500, Graphics: ASPEED, Audio: Realtek ALC892, Network: 2 x Intel I350 OS: Debian 11, Kernel: 5.10.0-10-amd64 (x86_64), Display Server: X Server, Vulkan: 1.0.2, Compiler: GCC 10.2.1 20210110, File-System: ext4, Screen Resolution: 1024x768 f: Processor: Intel Xeon Silver 4216 @ 3.20GHz (16 Cores / 32 Threads), Motherboard: TYAN S7100AG2NR (V4.02 BIOS), Chipset: Intel Sky Lake-E DMI3 Registers, Memory: 46GB, Disk: 240GB Corsair Force MP500, Graphics: ASPEED, Audio: Realtek ALC892, Network: 2 x Intel I350 OS: Debian 11, Kernel: 5.10.0-10-amd64 (x86_64), Display Server: X Server, Vulkan: 1.0.2, Compiler: GCC 10.2.1 20210110, File-System: ext4, Screen Resolution: 1024x768 BRL-CAD 7.34 VGR Performance Metric VGR Performance Metric > Higher Is Better a . 144388 |================================================================== b . 143587 |================================================================== f . 146013 |=================================================================== oneDNN 3.0 Harness: IP Shapes 1D - Data Type: f32 - Engine: CPU ms < Lower Is Better a . 4.67337 |============================================================= b . 5.07197 |================================================================== f . 4.67940 |============================================================= oneDNN 3.0 Harness: IP Shapes 3D - Data Type: f32 - Engine: CPU ms < Lower Is Better a . 4.29932 |================================================================== b . 3.90404 |============================================================ f . 4.00633 |============================================================== oneDNN 3.0 Harness: IP Shapes 1D - Data Type: u8s8f32 - Engine: CPU ms < Lower Is Better a . 1.04095 |========================================================= b . 1.04315 |========================================================= f . 1.20568 |================================================================== oneDNN 3.0 Harness: IP Shapes 3D - Data Type: u8s8f32 - Engine: CPU ms < Lower Is Better a . 1.44297 |===================================================== b . 1.80443 |================================================================== f . 1.47041 |====================================================== oneDNN 3.0 Harness: IP Shapes 1D - Data Type: bf16bf16bf16 - Engine: CPU ms < Lower Is Better a . 10.82 |==================================================================== b . 10.56 |================================================================== f . 10.56 |================================================================== oneDNN 3.0 Harness: IP Shapes 3D - Data Type: bf16bf16bf16 - Engine: CPU ms < Lower Is Better a . 3.12817 |================================================================= b . 3.15345 |================================================================== f . 3.13626 |================================================================== oneDNN 3.0 Harness: Convolution Batch Shapes Auto - Data Type: f32 - Engine: CPU ms < Lower Is Better a . 6.71633 |================================================================== b . 6.70139 |================================================================== f . 6.63520 |================================================================= oneDNN 3.0 Harness: Deconvolution Batch shapes_1d - Data Type: f32 - Engine: CPU ms < Lower Is Better a . 11.00 |================================================================== b . 11.04 |================================================================== f . 11.30 |==================================================================== oneDNN 3.0 Harness: Deconvolution Batch shapes_3d - Data Type: f32 - Engine: CPU ms < Lower Is Better a . 7.71637 |================================================================== b . 7.71625 |================================================================== f . 7.71695 |================================================================== oneDNN 3.0 Harness: Convolution Batch Shapes Auto - Data Type: u8s8f32 - Engine: CPU ms < Lower Is Better a . 6.26813 |================================================ b . 8.69640 |================================================================== f . 6.20538 |=============================================== oneDNN 3.0 Harness: Deconvolution Batch shapes_1d - Data Type: u8s8f32 - Engine: CPU ms < Lower Is Better a . 1.27830 |================================================================== b . 1.27892 |================================================================== f . 1.27736 |================================================================== oneDNN 3.0 Harness: Deconvolution Batch shapes_3d - Data Type: u8s8f32 - Engine: CPU ms < Lower Is Better a . 2.04830 |================================================================== b . 1.88444 |============================================================= f . 1.88462 |============================================================= oneDNN 3.0 Harness: Recurrent Neural Network Training - Data Type: f32 - Engine: CPU ms < Lower Is Better a . 3554.45 |=============================================================== b . 3746.00 |================================================================== f . 3670.26 |================================================================= oneDNN 3.0 Harness: Recurrent Neural Network Inference - Data Type: f32 - Engine: CPU ms < Lower Is Better a . 1814.88 |============================================================= b . 1807.32 |============================================================= f . 1951.06 |================================================================== oneDNN 3.0 Harness: Recurrent Neural Network Training - Data Type: u8s8f32 - Engine: CPU ms < Lower Is Better a . 3752.45 |================================================================== b . 3491.29 |============================================================= f . 3548.42 |============================================================== oneDNN 3.0 Harness: Convolution Batch Shapes Auto - Data Type: bf16bf16bf16 - Engine: CPU ms < Lower Is Better a . 16.29 |==================================================================== b . 16.28 |==================================================================== f . 16.29 |==================================================================== oneDNN 3.0 Harness: Deconvolution Batch shapes_1d - Data Type: bf16bf16bf16 - Engine: CPU ms < Lower Is Better a . 22.03 |================================================================= b . 23.17 |==================================================================== f . 20.67 |============================================================= oneDNN 3.0 Harness: Deconvolution Batch shapes_3d - Data Type: bf16bf16bf16 - Engine: CPU ms < Lower Is Better a . 21.86 |==================================================================== b . 21.83 |==================================================================== f . 21.83 |==================================================================== oneDNN 3.0 Harness: Recurrent Neural Network Inference - Data Type: u8s8f32 - Engine: CPU ms < Lower Is Better a . 1814.23 |================================================================== b . 1822.41 |================================================================== f . 1813.84 |================================================================== oneDNN 3.0 Harness: Matrix Multiply Batch Shapes Transformer - Data Type: f32 - Engine: CPU ms < Lower Is Better a . 1.59626 |================================================================== b . 1.58974 |================================================================= f . 1.60801 |================================================================== oneDNN 3.0 Harness: Recurrent Neural Network Training - Data Type: bf16bf16bf16 - Engine: CPU ms < Lower Is Better a . 3521.16 |================================================================ b . 3488.00 |=============================================================== f . 3633.06 |================================================================== oneDNN 3.0 Harness: Recurrent Neural Network Inference - Data Type: bf16bf16bf16 - Engine: CPU ms < Lower Is Better a . 2092.76 |================================================================== b . 1797.79 |========================================================= f . 1795.46 |========================================================= oneDNN 3.0 Harness: Matrix Multiply Batch Shapes Transformer - Data Type: u8s8f32 - Engine: CPU ms < Lower Is Better a . 0.418551 |================================================================= b . 0.412316 |================================================================ f . 0.418732 |================================================================= oneDNN 3.0 Harness: Matrix Multiply Batch Shapes Transformer - Data Type: bf16bf16bf16 - Engine: CPU ms < Lower Is Better a . 3.65110 |========================================================== b . 3.63276 |========================================================= f . 4.17830 |================================================================== OpenVINO 2022.3 Model: Face Detection FP16 - Device: CPU FPS > Higher Is Better a . 2.29 |===================================================================== b . 2.30 |===================================================================== f . 2.29 |===================================================================== OpenVINO 2022.3 Model: Face Detection FP16 - Device: CPU ms < Lower Is Better a . 3478.43 |================================================================== b . 3469.66 |================================================================== f . 3471.02 |================================================================== OpenVINO 2022.3 Model: Person Detection FP16 - Device: CPU FPS > Higher Is Better a . 1.46 |===================================================================== b . 1.46 |===================================================================== f . 1.45 |===================================================================== OpenVINO 2022.3 Model: Person Detection FP16 - Device: CPU ms < Lower Is Better a . 5459.22 |================================================================== b . 5468.18 |================================================================== f . 5477.37 |================================================================== OpenVINO 2022.3 Model: Person Detection FP32 - Device: CPU FPS > Higher Is Better a . 1.46 |===================================================================== b . 1.46 |===================================================================== f . 1.45 |===================================================================== OpenVINO 2022.3 Model: Person Detection FP32 - Device: CPU ms < Lower Is Better a . 5464.52 |================================================================== b . 5463.10 |================================================================== f . 5465.44 |================================================================== OpenVINO 2022.3 Model: Vehicle Detection FP16 - Device: CPU FPS > Higher Is Better a . 173.68 |=================================================================== b . 172.21 |================================================================== f . 172.13 |================================================================== OpenVINO 2022.3 Model: Vehicle Detection FP16 - Device: CPU ms < Lower Is Better a . 46.02 |=================================================================== b . 46.42 |==================================================================== f . 46.44 |==================================================================== OpenVINO 2022.3 Model: Face Detection FP16-INT8 - Device: CPU FPS > Higher Is Better a . 8.51 |==================================================================== b . 8.58 |===================================================================== f . 8.48 |==================================================================== OpenVINO 2022.3 Model: Face Detection FP16-INT8 - Device: CPU ms < Lower Is Better a . 931.13 |================================================================== b . 927.46 |================================================================== f . 941.46 |=================================================================== OpenVINO 2022.3 Model: Vehicle Detection FP16-INT8 - Device: CPU FPS > Higher Is Better a . 488.51 |================================================================= b . 489.27 |================================================================== f . 499.92 |=================================================================== OpenVINO 2022.3 Model: Vehicle Detection FP16-INT8 - Device: CPU ms < Lower Is Better a . 16.35 |==================================================================== b . 16.33 |==================================================================== f . 15.98 |================================================================== OpenVINO 2022.3 Model: Weld Porosity Detection FP16 - Device: CPU FPS > Higher Is Better a . 234.80 |=================================================================== b . 234.23 |=================================================================== f . 234.59 |=================================================================== OpenVINO 2022.3 Model: Weld Porosity Detection FP16 - Device: CPU ms < Lower Is Better a . 68.10 |==================================================================== b . 68.23 |==================================================================== f . 68.11 |==================================================================== OpenVINO 2022.3 Model: Machine Translation EN To DE FP16 - Device: CPU FPS > Higher Is Better a . 31.21 |==================================================================== b . 30.62 |================================================================== f . 31.35 |==================================================================== OpenVINO 2022.3 Model: Machine Translation EN To DE FP16 - Device: CPU ms < Lower Is Better a . 255.93 |================================================================== b . 260.84 |=================================================================== f . 254.73 |================================================================= OpenVINO 2022.3 Model: Weld Porosity Detection FP16-INT8 - Device: CPU FPS > Higher Is Better a . 854.92 |=================================================================== b . 856.48 |=================================================================== f . 856.58 |=================================================================== OpenVINO 2022.3 Model: Weld Porosity Detection FP16-INT8 - Device: CPU ms < Lower Is Better a . 18.70 |==================================================================== b . 18.66 |==================================================================== f . 18.66 |==================================================================== OpenVINO 2022.3 Model: Person Vehicle Bike Detection FP16 - Device: CPU FPS > Higher Is Better a . 298.34 |================================================================== b . 295.77 |================================================================= f . 303.24 |=================================================================== OpenVINO 2022.3 Model: Person Vehicle Bike Detection FP16 - Device: CPU ms < Lower Is Better a . 26.79 |=================================================================== b . 27.02 |==================================================================== f . 26.35 |================================================================== OpenVINO 2022.3 Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU FPS > Higher Is Better a . 7471.26 |================================================================== b . 7514.39 |================================================================== f . 7497.01 |================================================================== OpenVINO 2022.3 Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU ms < Lower Is Better a . 2.13 |===================================================================== b . 2.12 |===================================================================== f . 2.12 |===================================================================== OpenVINO 2022.3 Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU FPS > Higher Is Better a . 8053.12 |================================================================== b . 7993.20 |================================================================== f . 8034.84 |================================================================== OpenVINO 2022.3 Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU ms < Lower Is Better a . 1.98 |===================================================================== b . 1.99 |===================================================================== f . 1.98 |===================================================================== Kvazaar 2.2 Video Input: Bosphorus 4K - Video Preset: Slow Frames Per Second > Higher Is Better a . 6.48 |===================================================================== b . 6.48 |===================================================================== f . 6.46 |===================================================================== Kvazaar 2.2 Video Input: Bosphorus 4K - Video Preset: Medium Frames Per Second > Higher Is Better a . 6.68 |===================================================================== b . 6.71 |===================================================================== f . 6.67 |===================================================================== Kvazaar 2.2 Video Input: Bosphorus 1080p - Video Preset: Slow Frames Per Second > Higher Is Better a . 20.04 |==================================================================== b . 19.88 |=================================================================== f . 20.02 |==================================================================== Kvazaar 2.2 Video Input: Bosphorus 1080p - Video Preset: Medium Frames Per Second > Higher Is Better a . 21.08 |==================================================================== b . 20.78 |=================================================================== f . 21.02 |==================================================================== Kvazaar 2.2 Video Input: Bosphorus 4K - Video Preset: Very Fast Frames Per Second > Higher Is Better a . 13.07 |==================================================================== b . 13.13 |==================================================================== f . 13.14 |==================================================================== Kvazaar 2.2 Video Input: Bosphorus 4K - Video Preset: Super Fast Frames Per Second > Higher Is Better a . 17.56 |==================================================================== b . 17.40 |=================================================================== f . 17.45 |==================================================================== Kvazaar 2.2 Video Input: Bosphorus 4K - Video Preset: Ultra Fast Frames Per Second > Higher Is Better a . 23.74 |==================================================================== b . 23.60 |==================================================================== f . 23.70 |==================================================================== Kvazaar 2.2 Video Input: Bosphorus 1080p - Video Preset: Very Fast Frames Per Second > Higher Is Better a . 38.48 |==================================================================== b . 38.60 |==================================================================== f . 38.33 |==================================================================== Kvazaar 2.2 Video Input: Bosphorus 1080p - Video Preset: Super Fast Frames Per Second > Higher Is Better a . 55.05 |==================================================================== b . 52.77 |================================================================= f . 54.25 |=================================================================== Kvazaar 2.2 Video Input: Bosphorus 1080p - Video Preset: Ultra Fast Frames Per Second > Higher Is Better a . 55.42 |=================================================================== b . 56.00 |==================================================================== f . 54.91 |=================================================================== uvg266 0.4.1 Video Input: Bosphorus 4K - Video Preset: Slow Frames Per Second > Higher Is Better a . 4.51 |===================================================================== b . 4.52 |===================================================================== f . 4.52 |===================================================================== uvg266 0.4.1 Video Input: Bosphorus 4K - Video Preset: Medium Frames Per Second > Higher Is Better a . 5.08 |===================================================================== b . 5.10 |===================================================================== f . 5.09 |===================================================================== uvg266 0.4.1 Video Input: Bosphorus 1080p - Video Preset: Slow Frames Per Second > Higher Is Better a . 15.47 |==================================================================== b . 15.44 |==================================================================== f . 15.38 |==================================================================== uvg266 0.4.1 Video Input: Bosphorus 1080p - Video Preset: Medium Frames Per Second > Higher Is Better a . 17.32 |==================================================================== b . 17.08 |=================================================================== f . 17.25 |==================================================================== uvg266 0.4.1 Video Input: Bosphorus 4K - Video Preset: Very Fast Frames Per Second > Higher Is Better a . 13.67 |==================================================================== b . 13.60 |==================================================================== f . 13.53 |=================================================================== uvg266 0.4.1 Video Input: Bosphorus 4K - Video Preset: Super Fast Frames Per Second > Higher Is Better a . 14.80 |==================================================================== b . 14.70 |==================================================================== f . 14.76 |==================================================================== uvg266 0.4.1 Video Input: Bosphorus 4K - Video Preset: Ultra Fast Frames Per Second > Higher Is Better a . 17.98 |==================================================================== b . 18.01 |==================================================================== f . 18.00 |==================================================================== uvg266 0.4.1 Video Input: Bosphorus 1080p - Video Preset: Very Fast Frames Per Second > Higher Is Better a . 46.22 |==================================================================== b . 46.27 |==================================================================== f . 46.33 |==================================================================== uvg266 0.4.1 Video Input: Bosphorus 1080p - Video Preset: Super Fast Frames Per Second > Higher Is Better a . 49.86 |=================================================================== b . 50.41 |==================================================================== f . 49.50 |=================================================================== uvg266 0.4.1 Video Input: Bosphorus 1080p - Video Preset: Ultra Fast Frames Per Second > Higher Is Better a . 51.26 |================================================================= b . 53.27 |==================================================================== f . 52.19 |===================================================================