xeon platinum 8380 january 2 x Intel Xeon Platinum 8380 testing with a Intel M50CYP2SB2U (SE5C6200.86B.0022.D08.2103221623 BIOS) and ASPEED on Ubuntu 22.04 via the Phoronix Test Suite. a: Processor: 2 x Intel Xeon Platinum 8380 @ 3.40GHz (80 Cores / 160 Threads), Motherboard: Intel M50CYP2SB2U (SE5C6200.86B.0022.D08.2103221623 BIOS), Chipset: Intel Device 0998, Memory: 512GB, Disk: 3841GB Micron_9300_MTFDHAL3T8TDP, Graphics: ASPEED, Monitor: VE228, Network: 2 x Intel X710 for 10GBASE-T + 2 x Intel E810-C for QSFP OS: Ubuntu 22.04, Kernel: 5.15.0-47-generic (x86_64), Desktop: GNOME Shell 42.4, Display Server: X Server 1.21.1.3, Vulkan: 1.2.204, Compiler: GCC 11.2.0, File-System: ext4, Screen Resolution: 1920x1080 b: Processor: 2 x Intel Xeon Platinum 8380 @ 3.40GHz (80 Cores / 160 Threads), Motherboard: Intel M50CYP2SB2U (SE5C6200.86B.0022.D08.2103221623 BIOS), Chipset: Intel Device 0998, Memory: 512GB, Disk: 3841GB Micron_9300_MTFDHAL3T8TDP, Graphics: ASPEED, Monitor: VE228, Network: 2 x Intel X710 for 10GBASE-T + 2 x Intel E810-C for QSFP OS: Ubuntu 22.04, Kernel: 5.15.0-47-generic (x86_64), Desktop: GNOME Shell 42.4, Display Server: X Server 1.21.1.3, Vulkan: 1.2.204, Compiler: GCC 11.2.0, File-System: ext4, Screen Resolution: 1920x1080 c: Processor: 2 x Intel Xeon Platinum 8380 @ 3.40GHz (80 Cores / 160 Threads), Motherboard: Intel M50CYP2SB2U (SE5C6200.86B.0022.D08.2103221623 BIOS), Chipset: Intel Device 0998, Memory: 512GB, Disk: 3841GB Micron_9300_MTFDHAL3T8TDP, Graphics: ASPEED, Monitor: VE228, Network: 2 x Intel X710 for 10GBASE-T + 2 x Intel E810-C for QSFP OS: Ubuntu 22.04, Kernel: 5.15.0-47-generic (x86_64), Desktop: GNOME Shell 42.4, Display Server: X Server 1.21.1.3, Vulkan: 1.2.204, Compiler: GCC 11.2.0, File-System: ext4, Screen Resolution: 1920x1080 OpenVINO 2022.3 Model: Face Detection FP16 - Device: CPU FPS > Higher Is Better a . 22.95 |==================================================================== b . 22.98 |==================================================================== c . 22.95 |==================================================================== OpenVINO 2022.3 Model: Person Detection FP16 - Device: CPU FPS > Higher Is Better a . 13.42 |==================================================================== b . 13.40 |==================================================================== c . 13.21 |=================================================================== OpenVINO 2022.3 Model: Person Detection FP32 - Device: CPU FPS > Higher Is Better a . 13.09 |==================================================================== b . 13.15 |==================================================================== c . 13.14 |==================================================================== OpenVINO 2022.3 Model: Vehicle Detection FP16 - Device: CPU FPS > Higher Is Better a . 1047.87 |================================================================== b . 1047.10 |================================================================== c . 1048.40 |================================================================== OpenVINO 2022.3 Model: Face Detection FP16-INT8 - Device: CPU FPS > Higher Is Better a . 92.95 |==================================================================== b . 92.83 |==================================================================== c . 92.93 |==================================================================== OpenVINO 2022.3 Model: Vehicle Detection FP16-INT8 - Device: CPU FPS > Higher Is Better a . 4354.14 |================================================================== b . 4366.10 |================================================================== c . 4360.70 |================================================================== OpenVINO 2022.3 Model: Weld Porosity Detection FP16 - Device: CPU FPS > Higher Is Better a . 2379.62 |================================================================== b . 2376.32 |================================================================== c . 2380.57 |================================================================== OpenVINO 2022.3 Model: Machine Translation EN To DE FP16 - Device: CPU FPS > Higher Is Better a . 259.74 |================================================================ b . 268.94 |=================================================================== c . 270.50 |=================================================================== OpenVINO 2022.3 Model: Weld Porosity Detection FP16-INT8 - Device: CPU FPS > Higher Is Better a . 8849.01 |================================================================== b . 8843.72 |================================================================== c . 8870.43 |================================================================== OpenVINO 2022.3 Model: Person Vehicle Bike Detection FP16 - Device: CPU FPS > Higher Is Better a . 2157.13 |================================================================== b . 2154.54 |================================================================== c . 2156.73 |================================================================== OpenVINO 2022.3 Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU FPS > Higher Is Better a . 47089.49 |================================================================= b . 47321.79 |================================================================= c . 47285.92 |================================================================= OpenVINO 2022.3 Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU FPS > Higher Is Better a . 51056.58 |================================================================= b . 51048.88 |================================================================= c . 51211.85 |================================================================= Kvazaar 2.2 Video Input: Bosphorus 4K - Video Preset: Slow Frames Per Second > Higher Is Better a . 20.06 |==================================================================== b . 19.94 |==================================================================== c . 20.06 |==================================================================== Kvazaar 2.2 Video Input: Bosphorus 4K - Video Preset: Medium Frames Per Second > Higher Is Better a . 20.65 |==================================================================== b . 20.65 |==================================================================== c . 20.57 |==================================================================== Kvazaar 2.2 Video Input: Bosphorus 1080p - Video Preset: Slow Frames Per Second > Higher Is Better a . 83.36 |==================================================================== b . 81.99 |=================================================================== c . 83.49 |==================================================================== Kvazaar 2.2 Video Input: Bosphorus 1080p - Video Preset: Medium Frames Per Second > Higher Is Better a . 85.78 |==================================================================== b . 85.35 |==================================================================== c . 84.56 |=================================================================== Kvazaar 2.2 Video Input: Bosphorus 4K - Video Preset: Very Fast Frames Per Second > Higher Is Better a . 44.16 |==================================================================== b . 44.16 |==================================================================== c . 44.19 |==================================================================== Kvazaar 2.2 Video Input: Bosphorus 4K - Video Preset: Super Fast Frames Per Second > Higher Is Better a . 46.81 |=================================================================== b . 47.30 |==================================================================== c . 47.58 |==================================================================== Kvazaar 2.2 Video Input: Bosphorus 4K - Video Preset: Ultra Fast Frames Per Second > Higher Is Better a . 48.64 |=================================================================== b . 47.98 |================================================================== c . 49.69 |==================================================================== Kvazaar 2.2 Video Input: Bosphorus 1080p - Video Preset: Very Fast Frames Per Second > Higher Is Better a . 177.06 |================================================================== b . 179.03 |================================================================== c . 180.91 |=================================================================== Kvazaar 2.2 Video Input: Bosphorus 1080p - Video Preset: Super Fast Frames Per Second > Higher Is Better a . 183.22 |=============================================================== b . 176.22 |============================================================ c . 195.56 |=================================================================== Kvazaar 2.2 Video Input: Bosphorus 1080p - Video Preset: Ultra Fast Frames Per Second > Higher Is Better a . 189.93 |=================================================================== b . 183.20 |================================================================= c . 181.68 |================================================================ uvg266 0.4.1 Video Input: Bosphorus 4K - Video Preset: Slow Frames Per Second > Higher Is Better a . 14.82 |==================================================================== b . 14.82 |==================================================================== c . 14.78 |==================================================================== uvg266 0.4.1 Video Input: Bosphorus 4K - Video Preset: Medium Frames Per Second > Higher Is Better a . 16.71 |==================================================================== b . 16.71 |==================================================================== c . 16.71 |==================================================================== uvg266 0.4.1 Video Input: Bosphorus 1080p - Video Preset: Slow Frames Per Second > Higher Is Better a . 50.56 |==================================================================== b . 50.64 |==================================================================== c . 50.32 |==================================================================== uvg266 0.4.1 Video Input: Bosphorus 1080p - Video Preset: Medium Frames Per Second > Higher Is Better a . 55.89 |==================================================================== b . 55.72 |==================================================================== c . 55.50 |==================================================================== uvg266 0.4.1 Video Input: Bosphorus 4K - Video Preset: Very Fast Frames Per Second > Higher Is Better a . 41.76 |==================================================================== b . 41.69 |=================================================================== c . 42.04 |==================================================================== uvg266 0.4.1 Video Input: Bosphorus 4K - Video Preset: Super Fast Frames Per Second > Higher Is Better a . 43.09 |=================================================================== b . 43.67 |==================================================================== c . 43.63 |==================================================================== uvg266 0.4.1 Video Input: Bosphorus 4K - Video Preset: Ultra Fast Frames Per Second > Higher Is Better a . 42.96 |=================================================================== b . 41.72 |================================================================= c . 43.32 |==================================================================== uvg266 0.4.1 Video Input: Bosphorus 1080p - Video Preset: Very Fast Frames Per Second > Higher Is Better a . 147.71 |=================================================================== b . 145.05 |================================================================== c . 146.66 |=================================================================== uvg266 0.4.1 Video Input: Bosphorus 1080p - Video Preset: Super Fast Frames Per Second > Higher Is Better a . 148.14 |=================================================================== b . 146.01 |================================================================== c . 148.56 |=================================================================== uvg266 0.4.1 Video Input: Bosphorus 1080p - Video Preset: Ultra Fast Frames Per Second > Higher Is Better a . 151.35 |================================================================== b . 152.75 |=================================================================== c . 149.16 |================================================================= OpenVKL 1.3.1 Benchmark: vklBenchmark ISPC Items / Sec > Higher Is Better a . 921 |====================================================================== b . 915 |===================================================================== c . 922 |====================================================================== OpenVKL 1.3.1 Benchmark: vklBenchmark Scalar Items / Sec > Higher Is Better a . 438 |====================================================================== b . 441 |====================================================================== c . 441 |====================================================================== CockroachDB 22.2 Workload: MoVR - Concurrency: 128 ops/s > Higher Is Better a . 1005.3 |================================================================= b . 1034.4 |=================================================================== c . 1036.0 |=================================================================== CockroachDB 22.2 Workload: MoVR - Concurrency: 256 ops/s > Higher Is Better a . 978.3 |==================================================================== b . 946.3 |================================================================== c . 956.1 |================================================================== CockroachDB 22.2 Workload: MoVR - Concurrency: 512 ops/s > Higher Is Better a . 1004.6 |================================================================ b . 1051.3 |=================================================================== c . 948.9 |============================================================ CockroachDB 22.2 Workload: MoVR - Concurrency: 1024 ops/s > Higher Is Better a . 995.0 |==================================================================== b . 980.1 |=================================================================== c . 982.2 |=================================================================== CockroachDB 22.2 Workload: KV, 10% Reads - Concurrency: 128 ops/s > Higher Is Better a . 81692.1 |================================================================== b . 79813.8 |================================================================ c . 78523.6 |=============================================================== CockroachDB 22.2 Workload: KV, 10% Reads - Concurrency: 256 ops/s > Higher Is Better a . 85831.0 |================================================================= b . 83364.9 |=============================================================== c . 87542.9 |================================================================== CockroachDB 22.2 Workload: KV, 10% Reads - Concurrency: 512 ops/s > Higher Is Better a . 81929.6 |================================================================= b . 78488.4 |=============================================================== c . 82853.0 |================================================================== CockroachDB 22.2 Workload: KV, 50% Reads - Concurrency: 128 ops/s > Higher Is Better a . 101191.6 |================================================================ b . 91347.7 |========================================================== c . 103180.8 |================================================================= CockroachDB 22.2 Workload: KV, 50% Reads - Concurrency: 256 ops/s > Higher Is Better a . 103724.9 |============================================================== b . 95363.3 |========================================================= c . 108532.6 |================================================================= CockroachDB 22.2 Workload: KV, 50% Reads - Concurrency: 512 ops/s > Higher Is Better a . 102949.9 |================================================================= b . 90463.4 |========================================================= c . 98677.7 |============================================================== CockroachDB 22.2 Workload: KV, 60% Reads - Concurrency: 128 ops/s > Higher Is Better a . 96257.5 |============================================================ b . 97956.1 |============================================================== c . 103471.9 |================================================================= CockroachDB 22.2 Workload: KV, 60% Reads - Concurrency: 256 ops/s > Higher Is Better a . 104879.0 |============================================================ b . 112692.4 |================================================================= c . 96996.9 |======================================================== CockroachDB 22.2 Workload: KV, 60% Reads - Concurrency: 512 ops/s > Higher Is Better a . 103167.1 |=============================================================== b . 102734.7 |=============================================================== c . 105826.5 |================================================================= CockroachDB 22.2 Workload: KV, 95% Reads - Concurrency: 128 ops/s > Higher Is Better a . 115235.9 |========================================================== b . 128914.0 |================================================================= c . 129287.8 |================================================================= CockroachDB 22.2 Workload: KV, 95% Reads - Concurrency: 256 ops/s > Higher Is Better a . 109396.8 |====================================================== b . 132576.0 |================================================================= c . 114216.8 |======================================================== CockroachDB 22.2 Workload: KV, 95% Reads - Concurrency: 512 ops/s > Higher Is Better a . 124770.8 |============================================================== b . 130818.8 |================================================================= c . 104051.6 |==================================================== CockroachDB 22.2 Workload: KV, 10% Reads - Concurrency: 1024 ops/s > Higher Is Better a . 75439.3 |============================================================= b . 80303.3 |================================================================= c . 81526.5 |================================================================== CockroachDB 22.2 Workload: KV, 50% Reads - Concurrency: 1024 ops/s > Higher Is Better a . 95936.8 |================================================================== b . 87162.1 |============================================================ c . 91821.1 |=============================================================== CockroachDB 22.2 Workload: KV, 60% Reads - Concurrency: 1024 ops/s > Higher Is Better a . 102024.5 |================================================================= b . 89996.2 |========================================================= c . 97814.8 |============================================================== CockroachDB 22.2 Workload: KV, 95% Reads - Concurrency: 1024 ops/s > Higher Is Better a . 114587.7 |=========================================================== b . 109363.0 |======================================================== c . 126309.9 |================================================================= BRL-CAD 7.34 VGR Performance Metric VGR Performance Metric > Higher Is Better a . 2460090 |================================================================== b . 2441642 |================================================================= c . 2462204 |================================================================== oneDNN 3.0 Harness: IP Shapes 1D - Data Type: f32 - Engine: CPU ms < Lower Is Better a . 1.40653 |================================================================== b . 1.31674 |============================================================== c . 1.13240 |===================================================== oneDNN 3.0 Harness: IP Shapes 3D - Data Type: f32 - Engine: CPU ms < Lower Is Better a . 2.02641 |============================================================= b . 2.05187 |============================================================== c . 2.18165 |================================================================== oneDNN 3.0 Harness: IP Shapes 1D - Data Type: u8s8f32 - Engine: CPU ms < Lower Is Better a . 2.80808 |=========================================================== b . 3.13206 |================================================================== c . 2.13509 |============================================= oneDNN 3.0 Harness: IP Shapes 3D - Data Type: u8s8f32 - Engine: CPU ms < Lower Is Better a . 0.566395 |===================================================== b . 0.697435 |================================================================= c . 0.634303 |=========================================================== oneDNN 3.0 Harness: IP Shapes 1D - Data Type: bf16bf16bf16 - Engine: CPU ms < Lower Is Better a . 4.99822 |========================================================= b . 5.50365 |=============================================================== c . 5.76784 |================================================================== oneDNN 3.0 Harness: IP Shapes 3D - Data Type: bf16bf16bf16 - Engine: CPU ms < Lower Is Better a . 2.78657 |=============================================================== b . 2.90967 |================================================================== c . 2.79006 |=============================================================== oneDNN 3.0 Harness: Convolution Batch Shapes Auto - Data Type: f32 - Engine: CPU ms < Lower Is Better a . 1.43378 |================================================================== b . 1.40769 |================================================================= c . 1.40601 |================================================================= oneDNN 3.0 Harness: Deconvolution Batch shapes_1d - Data Type: f32 - Engine: CPU ms < Lower Is Better a . 6.94506 |================================================================= b . 6.94982 |================================================================= c . 7.07135 |================================================================== oneDNN 3.0 Harness: Deconvolution Batch shapes_3d - Data Type: f32 - Engine: CPU ms < Lower Is Better a . 0.875625 |================================================================= b . 0.866728 |================================================================ c . 0.870342 |================================================================= oneDNN 3.0 Harness: Convolution Batch Shapes Auto - Data Type: u8s8f32 - Engine: CPU ms < Lower Is Better a . 1.15870 |================================================================== b . 1.16066 |================================================================== c . 1.16132 |================================================================== oneDNN 3.0 Harness: Deconvolution Batch shapes_1d - Data Type: u8s8f32 - Engine: CPU ms < Lower Is Better a . 0.370879 |================================================================ b . 0.369915 |================================================================ c . 0.374184 |================================================================= oneDNN 3.0 Harness: Deconvolution Batch shapes_3d - Data Type: u8s8f32 - Engine: CPU ms < Lower Is Better a . 0.201735 |================================================================= b . 0.197708 |================================================================ c . 0.196388 |=============================================================== oneDNN 3.0 Harness: Recurrent Neural Network Training - Data Type: f32 - Engine: CPU ms < Lower Is Better a . 755.37 |============================================================== b . 812.45 |=================================================================== c . 736.40 |============================================================= oneDNN 3.0 Harness: Recurrent Neural Network Inference - Data Type: f32 - Engine: CPU ms < Lower Is Better a . 485.54 |================================================================= b . 482.72 |================================================================= c . 499.92 |=================================================================== oneDNN 3.0 Harness: Recurrent Neural Network Training - Data Type: u8s8f32 - Engine: CPU ms < Lower Is Better a . 755.61 |============================================================= b . 835.13 |=================================================================== c . 767.00 |============================================================== oneDNN 3.0 Harness: Convolution Batch Shapes Auto - Data Type: bf16bf16bf16 - Engine: CPU ms < Lower Is Better a . 2.08794 |================================================================= b . 2.09255 |================================================================== c . 2.10535 |================================================================== oneDNN 3.0 Harness: Deconvolution Batch shapes_1d - Data Type: bf16bf16bf16 - Engine: CPU ms < Lower Is Better a . 3.73078 |================================================================== b . 3.75292 |================================================================== c . 3.73148 |================================================================== oneDNN 3.0 Harness: Deconvolution Batch shapes_3d - Data Type: bf16bf16bf16 - Engine: CPU ms < Lower Is Better a . 3.59352 |================================================================== b . 3.61988 |================================================================== c . 3.58534 |================================================================= oneDNN 3.0 Harness: Recurrent Neural Network Inference - Data Type: u8s8f32 - Engine: CPU ms < Lower Is Better a . 516.70 |=================================================================== b . 496.95 |================================================================ c . 474.18 |============================================================= oneDNN 3.0 Harness: Matrix Multiply Batch Shapes Transformer - Data Type: f32 - Engine: CPU ms < Lower Is Better a . 0.232192 |=============================================================== b . 0.235762 |================================================================ c . 0.238500 |================================================================= oneDNN 3.0 Harness: Recurrent Neural Network Training - Data Type: bf16bf16bf16 - Engine: CPU ms < Lower Is Better a . 736.73 |=================================================================== b . 713.11 |================================================================= c . 716.12 |================================================================= oneDNN 3.0 Harness: Recurrent Neural Network Inference - Data Type: bf16bf16bf16 - Engine: CPU ms < Lower Is Better a . 504.67 |=================================================================== b . 484.34 |================================================================ c . 463.13 |============================================================= oneDNN 3.0 Harness: Matrix Multiply Batch Shapes Transformer - Data Type: u8s8f32 - Engine: CPU ms < Lower Is Better a . 0.170641 |================================================================= b . 0.167326 |================================================================ c . 0.170187 |================================================================= oneDNN 3.0 Harness: Matrix Multiply Batch Shapes Transformer - Data Type: bf16bf16bf16 - Engine: CPU ms < Lower Is Better a . 11.55603 |============================================================== b . 12.16560 |================================================================= c . 8.11091 |=========================================== OpenVINO 2022.3 Model: Face Detection FP16 - Device: CPU ms < Lower Is Better a . 1726.75 |================================================================== b . 1729.69 |================================================================== c . 1726.31 |================================================================== OpenVINO 2022.3 Model: Person Detection FP16 - Device: CPU ms < Lower Is Better a . 2942.97 |================================================================= b . 2944.02 |================================================================= c . 2977.64 |================================================================== OpenVINO 2022.3 Model: Person Detection FP32 - Device: CPU ms < Lower Is Better a . 3007.88 |================================================================== b . 2999.57 |================================================================== c . 3005.19 |================================================================== OpenVINO 2022.3 Model: Vehicle Detection FP16 - Device: CPU ms < Lower Is Better a . 38.10 |==================================================================== b . 38.13 |==================================================================== c . 38.08 |==================================================================== OpenVINO 2022.3 Model: Face Detection FP16-INT8 - Device: CPU ms < Lower Is Better a . 429.25 |=================================================================== b . 429.89 |=================================================================== c . 429.47 |=================================================================== OpenVINO 2022.3 Model: Vehicle Detection FP16-INT8 - Device: CPU ms < Lower Is Better a . 9.16 |===================================================================== b . 9.14 |===================================================================== c . 9.15 |===================================================================== OpenVINO 2022.3 Model: Weld Porosity Detection FP16 - Device: CPU ms < Lower Is Better a . 33.52 |==================================================================== b . 33.57 |==================================================================== c . 33.50 |==================================================================== OpenVINO 2022.3 Model: Machine Translation EN To DE FP16 - Device: CPU ms < Lower Is Better a . 153.57 |=================================================================== b . 148.47 |================================================================= c . 147.66 |================================================================ OpenVINO 2022.3 Model: Weld Porosity Detection FP16-INT8 - Device: CPU ms < Lower Is Better a . 9.01 |===================================================================== b . 9.02 |===================================================================== c . 8.99 |===================================================================== OpenVINO 2022.3 Model: Person Vehicle Bike Detection FP16 - Device: CPU ms < Lower Is Better a . 18.50 |==================================================================== b . 18.52 |==================================================================== c . 18.50 |==================================================================== OpenVINO 2022.3 Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU ms < Lower Is Better a . 1.54 |===================================================================== b . 1.53 |===================================================================== c . 1.53 |===================================================================== OpenVINO 2022.3 Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU ms < Lower Is Better a . 1.41 |===================================================================== b . 1.41 |===================================================================== c . 1.41 |===================================================================== Timed Linux Kernel Compilation 6.1 Build: defconfig Seconds < Lower Is Better a . 26.78 |================================================================== b . 27.68 |==================================================================== c . 27.78 |==================================================================== Timed Linux Kernel Compilation 6.1 Build: allmodconfig Seconds < Lower Is Better a . 238.74 |=================================================================== b . 240.39 |=================================================================== c . 239.63 |=================================================================== Numenta Anomaly Benchmark 1.1 Detector: KNN CAD Seconds < Lower Is Better a . 117.92 |=================================================================== b . 111.16 |=============================================================== c . 116.76 |================================================================== Numenta Anomaly Benchmark 1.1 Detector: Relative Entropy Seconds < Lower Is Better a . 12.95 |=================================================================== b . 13.11 |==================================================================== c . 12.98 |=================================================================== Numenta Anomaly Benchmark 1.1 Detector: Windowed Gaussian Seconds < Lower Is Better a . 6.417 |==================================================================== b . 6.264 |================================================================== c . 6.197 |================================================================== Numenta Anomaly Benchmark 1.1 Detector: Earthgecko Skyline Seconds < Lower Is Better a . 81.03 |================================================================== b . 83.18 |==================================================================== c . 81.08 |================================================================== Numenta Anomaly Benchmark 1.1 Detector: Bayesian Changepoint Seconds < Lower Is Better a . 24.13 |==================================================================== b . 23.83 |=================================================================== c . 23.82 |=================================================================== Numenta Anomaly Benchmark 1.1 Detector: Contextual Anomaly Detector OSE Seconds < Lower Is Better a . 42.18 |================================================================== b . 42.69 |=================================================================== c . 43.51 |====================================================================