hpc-xeon 2 x Intel Xeon Platinum 8380 testing with a Intel M50CYP2SB2U (SE5C6200.86B.0022.D08.2103221623 BIOS) and ASPEED on Ubuntu 20.04 via the Phoronix Test Suite. 1: Processor: 2 x Intel Xeon Platinum 8380 @ 3.40GHz (80 Cores / 160 Threads), Motherboard: Intel M50CYP2SB2U (SE5C6200.86B.0022.D08.2103221623 BIOS), Chipset: Intel Device 0998, Memory: 16 x 32 GB DDR4-3200MT/s Hynix HMA84GR7CJR4N-XN, Disk: 2 x 7682GB INTEL SSDPF2KX076TZ + 2 x 800GB INTEL SSDPF21Q800GB + 3841GB Micron_9300_MTFDHAL3T8TDP + 960GB INTEL SSDSC2KG96, Graphics: ASPEED, Network: 2 x Intel X710 for 10GBASE-T + 2 x Intel E810-C for QSFP OS: Ubuntu 20.04, Kernel: 5.11.0-051100-generic (x86_64), Desktop: GNOME Shell 3.36.4, Display Server: X Server 1.20.8, Compiler: GCC 9.3.0, File-System: ext4, Screen Resolution: 1024x768 1a: Processor: 2 x Intel Xeon Platinum 8380 @ 3.40GHz (80 Cores / 160 Threads), Motherboard: Intel M50CYP2SB2U (SE5C6200.86B.0022.D08.2103221623 BIOS), Chipset: Intel Device 0998, Memory: 16 x 32 GB DDR4-3200MT/s Hynix HMA84GR7CJR4N-XN, Disk: 2 x 7682GB INTEL SSDPF2KX076TZ + 2 x 800GB INTEL SSDPF21Q800GB + 3841GB Micron_9300_MTFDHAL3T8TDP + 960GB INTEL SSDSC2KG96, Graphics: ASPEED, Network: 2 x Intel X710 for 10GBASE-T + 2 x Intel E810-C for QSFP OS: Ubuntu 20.04, Kernel: 5.11.0-051100-generic (x86_64), Desktop: GNOME Shell 3.36.4, Display Server: X Server 1.20.8, Compiler: GCC 9.3.0, File-System: ext4, Screen Resolution: 1024x768 2: Processor: 2 x Intel Xeon Platinum 8380 @ 3.40GHz (80 Cores / 160 Threads), Motherboard: Intel M50CYP2SB2U (SE5C6200.86B.0022.D08.2103221623 BIOS), Chipset: Intel Device 0998, Memory: 16 x 32 GB DDR4-3200MT/s Hynix HMA84GR7CJR4N-XN, Disk: 2 x 7682GB INTEL SSDPF2KX076TZ + 2 x 800GB INTEL SSDPF21Q800GB + 3841GB Micron_9300_MTFDHAL3T8TDP + 960GB INTEL SSDSC2KG96, Graphics: ASPEED, Network: 2 x Intel X710 for 10GBASE-T + 2 x Intel E810-C for QSFP OS: Ubuntu 20.04, Kernel: 5.11.0-051100-generic (x86_64), Desktop: GNOME Shell 3.36.4, Display Server: X Server 1.20.8, Compiler: GCC 9.3.0, File-System: ext4, Screen Resolution: 1024x768 2a: Processor: 2 x Intel Xeon Platinum 8380 @ 3.40GHz (80 Cores / 160 Threads), Motherboard: Intel M50CYP2SB2U (SE5C6200.86B.0022.D08.2103221623 BIOS), Chipset: Intel Device 0998, Memory: 16 x 32 GB DDR4-3200MT/s Hynix HMA84GR7CJR4N-XN, Disk: 2 x 7682GB INTEL SSDPF2KX076TZ + 2 x 800GB INTEL SSDPF21Q800GB + 3841GB Micron_9300_MTFDHAL3T8TDP + 960GB INTEL SSDSC2KG96, Graphics: ASPEED, Network: 2 x Intel X710 for 10GBASE-T + 2 x Intel E810-C for QSFP OS: Ubuntu 20.04, Kernel: 5.11.0-051100-generic (x86_64), Desktop: GNOME Shell 3.36.4, Display Server: X Server 1.20.8, Compiler: GCC 9.3.0, File-System: ext4, Screen Resolution: 1024x768 4: Processor: 2 x Intel Xeon Platinum 8380 @ 3.40GHz (80 Cores / 160 Threads), Motherboard: Intel M50CYP2SB2U (SE5C6200.86B.0022.D08.2103221623 BIOS), Chipset: Intel Device 0998, Memory: 16 x 32 GB DDR4-3200MT/s Hynix HMA84GR7CJR4N-XN, Disk: 2 x 7682GB INTEL SSDPF2KX076TZ + 2 x 800GB INTEL SSDPF21Q800GB + 3841GB Micron_9300_MTFDHAL3T8TDP + 960GB INTEL SSDSC2KG96, Graphics: ASPEED, Network: 2 x Intel X710 for 10GBASE-T + 2 x Intel E810-C for QSFP OS: Ubuntu 20.04, Kernel: 5.11.0-051100-generic (x86_64), Desktop: GNOME Shell 3.36.4, Display Server: X Server 1.20.8, Compiler: GCC 9.3.0, File-System: ext4, Screen Resolution: 1024x768 Parboil 2.5 Test: OpenMP MRI Gridding Seconds < Lower Is Better 1a . 415.58 |============================================================ 2 .. 458.38 |================================================================== 2a . 443.17 |================================================================ 4 .. 408.71 |=========================================================== ECP-CANDLE 0.3 Benchmark: P3B2 Seconds < Lower Is Better 1a . 3201.12 |================================================================= 2a . 3185.07 |================================================================= 4 .. 3188.63 |================================================================= DeepSpeech 0.6 Acceleration: CPU Seconds < Lower Is Better 1a . 240.08 |================================================================== 2 .. 179.72 |================================================= 2a . 182.43 |================================================== 4 .. 186.67 |=================================================== AI Benchmark Alpha 0.1.2 Device AI Score Score > Higher Is Better 1a . 1711 |=================================================================== 2a . 1728 |==================================================================== 4 .. 1712 |=================================================================== AI Benchmark Alpha 0.1.2 Device Training Score Score > Higher Is Better 1a . 572 |==================================================================== 2a . 582 |===================================================================== 4 .. 577 |==================================================================== AI Benchmark Alpha 0.1.2 Device Inference Score Score > Higher Is Better 1a . 1139 |==================================================================== 2a . 1146 |==================================================================== 4 .. 1135 |=================================================================== Darmstadt Automotive Parallel Heterogeneous Suite Backend: OpenMP - Kernel: Points2Image Test Cases Per Minute > Higher Is Better 1a . 6515.63 |================================================================ 2 .. 6616.65 |================================================================= 2a . 6393.69 |=============================================================== 4 .. 6495.99 |================================================================ ECP-CANDLE 0.3 Benchmark: P3B1 Seconds < Lower Is Better 1a . 1282.47 |================================================================= 2a . 1292.22 |================================================================= 4 .. 1281.03 |================================================================ NCNN 20201218 Target: CPU - Model: regnety_400m ms < Lower Is Better 1a . 90.90 |=================================================================== 2 .. 91.14 |=================================================================== 2a . 89.61 |================================================================== 4 .. 90.84 |=================================================================== NCNN 20201218 Target: CPU - Model: squeezenet_ssd ms < Lower Is Better 1a . 32.96 |================================================================ 2 .. 34.73 |=================================================================== 2a . 30.90 |============================================================ 4 .. 33.16 |================================================================ NCNN 20201218 Target: CPU - Model: yolov4-tiny ms < Lower Is Better 1a . 41.38 |================================================================= 2 .. 42.91 |=================================================================== 2a . 40.14 |=============================================================== 4 .. 40.37 |=============================================================== NCNN 20201218 Target: CPU - Model: resnet50 ms < Lower Is Better 1a . 47.38 |================================================================== 2 .. 48.24 |=================================================================== 2a . 41.65 |========================================================== 4 .. 46.98 |================================================================= NCNN 20201218 Target: CPU - Model: alexnet ms < Lower Is Better 1a . 8.65 |================================================================== 2 .. 8.62 |================================================================== 2a . 8.27 |=============================================================== 4 .. 8.89 |==================================================================== NCNN 20201218 Target: CPU - Model: resnet18 ms < Lower Is Better 1a . 18.18 |=================================================================== 2 .. 18.02 |================================================================== 2a . 16.78 |============================================================== 4 .. 17.42 |================================================================ NCNN 20201218 Target: CPU - Model: vgg16 ms < Lower Is Better 1a . 50.93 |================================================================ 2 .. 51.92 |================================================================== 2a . 50.10 |=============================================================== 4 .. 52.95 |=================================================================== NCNN 20201218 Target: CPU - Model: googlenet ms < Lower Is Better 1a . 30.60 |=================================================================== 2 .. 30.38 |=================================================================== 2a . 28.40 |============================================================== 4 .. 29.62 |================================================================= NCNN 20201218 Target: CPU - Model: blazeface ms < Lower Is Better 1a . 5.96 |================================================================== 2 .. 6.11 |==================================================================== 2a . 5.79 |================================================================ 4 .. 5.77 |================================================================ NCNN 20201218 Target: CPU - Model: efficientnet-b0 ms < Lower Is Better 1a . 19.28 |================================================================ 2 .. 20.15 |=================================================================== 2a . 18.22 |============================================================= 4 .. 19.14 |================================================================ NCNN 20201218 Target: CPU - Model: mnasnet ms < Lower Is Better 1a . 16.08 |=================================================================== 2 .. 15.71 |================================================================= 2a . 15.18 |=============================================================== 4 .. 15.74 |================================================================== NCNN 20201218 Target: CPU - Model: shufflenet-v2 ms < Lower Is Better 1a . 10.34 |================================================================ 2 .. 10.82 |=================================================================== 2a . 10.01 |============================================================== 4 .. 10.27 |================================================================ NCNN 20201218 Target: CPU-v3-v3 - Model: mobilenet-v3 ms < Lower Is Better 1a . 14.42 |================================================================== 2 .. 14.33 |================================================================= 2a . 13.93 |================================================================ 4 .. 14.68 |=================================================================== NCNN 20201218 Target: CPU-v2-v2 - Model: mobilenet-v2 ms < Lower Is Better 1a . 18.22 |=================================================================== 2 .. 18.17 |=================================================================== 2a . 17.11 |=============================================================== 4 .. 18.00 |================================================================== NCNN 20201218 Target: CPU - Model: mobilenet ms < Lower Is Better 1a . 41.39 |================================================================ 2 .. 43.17 |=================================================================== 2a . 39.28 |============================================================= 4 .. 41.05 |================================================================ Mlpack Benchmark Benchmark: scikit_linearridgeregression Seconds < Lower Is Better 1a . 3.50 |==================================================================== 2a . 3.50 |==================================================================== 4 .. 3.41 |================================================================== Mlpack Benchmark Benchmark: scikit_ica Seconds < Lower Is Better 1a . 65.57 |================================================================ 2a . 69.04 |=================================================================== 4 .. 66.04 |================================================================ High Performance Conjugate Gradient 3.1 GFLOP/s > Higher Is Better 1a . 24.27 |=================================================================== 2 .. 24.25 |=================================================================== 2a . 24.22 |=================================================================== 4 .. 24.22 |=================================================================== ONNX Runtime 1.6 Model: bertsquad-10 - Device: OpenMP CPU Inferences Per Minute > Higher Is Better 1a . 441 |===================================================================== 2a . 443 |===================================================================== 4 .. 434 |==================================================================== ONNX Runtime 1.6 Model: super-resolution-10 - Device: OpenMP CPU Inferences Per Minute > Higher Is Better 1a . 6153 |============================================================= 2a . 6771 |==================================================================== 4 .. 6810 |==================================================================== Monte Carlo Simulations of Ionised Nebulae 2019-03-24 Input: Dust 2D tau100.0 Seconds < Lower Is Better 1a . 193 |===================================================================== 2 .. 194 |===================================================================== 2a . 193 |===================================================================== 4 .. 194 |===================================================================== IOR 3.3.0 Block Size: 4MB - Disk Target: Default Test Directory MB/s > Higher Is Better 1 .. 343.81 |============================================================== 2 .. 362.28 |================================================================= 2a . 357.00 |================================================================ 4 .. 365.79 |================================================================== Darmstadt Automotive Parallel Heterogeneous Suite Backend: OpenMP - Kernel: Euclidean Cluster Test Cases Per Minute > Higher Is Better 1a . 442.63 |================================================================== 2 .. 441.37 |================================================================== 2a . 432.65 |================================================================= 4 .. 430.14 |================================================================ Mlpack Benchmark Benchmark: scikit_svm Seconds < Lower Is Better 1a . 31.47 |================================================================== 2a . 31.13 |================================================================= 4 .. 32.12 |=================================================================== miniFE 2.2 Problem Size: Small CG Mflops > Higher Is Better 1a . 16991.1 |============================================================== 2 .. 17878.6 |================================================================= 2a . 17815.5 |================================================================= 4 .. 17495.6 |================================================================ ONNX Runtime 1.6 Model: fcn-resnet101-11 - Device: OpenMP CPU Inferences Per Minute > Higher Is Better 1a . 114 |===================================================================== 2a . 113 |==================================================================== 4 .. 113 |==================================================================== ONNX Runtime 1.6 Model: yolov4 - Device: OpenMP CPU Inferences Per Minute > Higher Is Better 1a . 305 |===================================================================== 2a . 301 |==================================================================== 4 .. 300 |==================================================================== ONNX Runtime 1.6 Model: shufflenet-v2-10 - Device: OpenMP CPU Inferences Per Minute > Higher Is Better 1a . 7399 |==================================================================== 2a . 7328 |=================================================================== 4 .. 7393 |==================================================================== Darmstadt Automotive Parallel Heterogeneous Suite Backend: OpenMP - Kernel: NDT Mapping Test Cases Per Minute > Higher Is Better 1a . 433.03 |================================================================= 2 .. 421.38 |=============================================================== 2a . 405.38 |============================================================= 4 .. 440.88 |================================================================== Mlpack Benchmark Benchmark: scikit_qda Seconds < Lower Is Better 1a . 30.66 |============================================================= 2a . 33.88 |=================================================================== 4 .. 32.57 |================================================================ GNU Octave Benchmark 5.2.0 Seconds < Lower Is Better 1a . 13.13 |================================================================== 2 .. 12.93 |================================================================= 2a . 12.82 |================================================================= 4 .. 13.26 |=================================================================== IOR 3.3.0 Block Size: 2MB - Disk Target: Default Test Directory MB/s > Higher Is Better 1 .. 356.14 |================================================================= 2 .. 358.60 |================================================================= 2a . 363.19 |================================================================== 4 .. 359.89 |================================================================= Nebular Empirical Analysis Tool 2020-02-29 Seconds < Lower Is Better 1a . 22.92 |================================================================== 2 .. 22.37 |================================================================= 2a . 22.91 |================================================================== 4 .. 23.15 |=================================================================== OpenVINO 2021.1 Model: Face Detection 0106 FP16 - Device: CPU ms < Lower Is Better 1a . 2100.58 |================================================================= 2 .. 2097.44 |================================================================= 2a . 2102.66 |================================================================= 4 .. 2100.78 |================================================================= OpenVINO 2021.1 Model: Face Detection 0106 FP16 - Device: CPU FPS > Higher Is Better 1a . 18.76 |=================================================================== 2 .. 18.79 |=================================================================== 2a . 18.78 |=================================================================== 4 .. 18.83 |=================================================================== OpenVINO 2021.1 Model: Face Detection 0106 FP32 - Device: CPU ms < Lower Is Better 1a . 2131.30 |================================================================= 2 .. 2138.44 |================================================================= 2a . 2136.83 |================================================================= 4 .. 2138.20 |================================================================= OpenVINO 2021.1 Model: Face Detection 0106 FP32 - Device: CPU FPS > Higher Is Better 1a . 18.46 |=================================================================== 2 .. 18.44 |=================================================================== 2a . 18.45 |=================================================================== 4 .. 18.40 |=================================================================== OpenVINO 2021.1 Model: Person Detection 0106 FP16 - Device: CPU ms < Lower Is Better 1a . 3567.46 |================================================================= 2 .. 3524.64 |================================================================ 2a . 3538.09 |================================================================ 4 .. 3533.40 |================================================================ OpenVINO 2021.1 Model: Person Detection 0106 FP16 - Device: CPU FPS > Higher Is Better 1a . 10.89 |================================================================== 2 .. 11.02 |=================================================================== 2a . 11.02 |=================================================================== 4 .. 11.00 |=================================================================== OpenVINO 2021.1 Model: Person Detection 0106 FP32 - Device: CPU ms < Lower Is Better 1a . 3555.17 |================================================================ 2a . 3563.66 |================================================================= 4 .. 3585.49 |================================================================= OpenVINO 2021.1 Model: Person Detection 0106 FP32 - Device: CPU FPS > Higher Is Better 1a . 10.97 |=================================================================== 2a . 10.91 |=================================================================== 4 .. 10.84 |================================================================== OpenVINO 2021.1 Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU ms < Lower Is Better 1a . 0.79 |======================================================== 2a . 0.96 |==================================================================== 4 .. 0.96 |==================================================================== OpenVINO 2021.1 Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU FPS > Higher Is Better 1a . 43169.99 |================================================================ 2a . 30539.47 |============================================= 4 .. 30845.88 |============================================== OpenVINO 2021.1 Model: Age Gender Recognition Retail 0013 FP32 - Device: CPU ms < Lower Is Better 1a . 0.8 |===================================================================== 2a . 0.8 |===================================================================== 4 .. 0.8 |===================================================================== OpenVINO 2021.1 Model: Age Gender Recognition Retail 0013 FP32 - Device: CPU FPS > Higher Is Better 1a . 42475.84 |================================================================ 2a . 42412.47 |================================================================ 4 .. 42558.09 |================================================================ Parboil 2.5 Test: OpenMP LBM Seconds < Lower Is Better 1a . 13.41 |=================================================================== 2 .. 13.13 |================================================================== 2a . 13.39 |=================================================================== 4 .. 12.95 |================================================================= ECP-CANDLE 0.3 Benchmark: P1B2 Seconds < Lower Is Better 1a . 47.09 |=================================================================== 2a . 44.98 |================================================================ 4 .. 45.52 |================================================================= ArrayFire 3.7 Test: Conjugate Gradient CPU ms < Lower Is Better 1a . 4.101 |========================================================== 2 .. 4.696 |================================================================== 2a . 4.759 |=================================================================== 4 .. 4.370 |============================================================== ArrayFire 3.7 Test: BLAS CPU GFLOPS > Higher Is Better 1a . 4730.45 |================================================================= 2 .. 4673.13 |================================================================ 2a . 4678.03 |================================================================ 4 .. 4684.87 |================================================================ Parboil 2.5 Test: OpenMP Stencil Seconds < Lower Is Better 1a . 1.653598 |=============================================================== 2 .. 1.644848 |=============================================================== 2a . 1.671065 |================================================================ 4 .. 1.664530 |================================================================ Parboil 2.5 Test: OpenMP CUTCP Seconds < Lower Is Better 1a . 1.409518 |=============================================================== 2 .. 1.430858 |================================================================ 2a . 1.438047 |================================================================ 4 .. 1.407187 |===============================================================