mnn ncnn xeon 2 x Intel Xeon Platinum 8380 testing with a Intel M50CYP2SB2U (SE5C6200.86B.0022.D08.2103221623 BIOS) and ASPEED on CentOS Stream 9 via the Phoronix Test Suite. A: Processor: 2 x Intel Xeon Platinum 8380 @ 3.40GHz (80 Cores / 160 Threads), Motherboard: Intel M50CYP2SB2U (SE5C6200.86B.0022.D08.2103221623 BIOS), Chipset: Intel Device 0998, Memory: 512GB, Disk: 7682GB INTEL SSDPF2KX076TZ, Graphics: ASPEED, Monitor: VE228, Network: 2 x Intel X710 for 10GBASE-T + 2 x Intel E810-C for QSFP OS: CentOS Stream 9, Kernel: 5.14.0-142.el9.x86_64 (x86_64), Desktop: GNOME Shell 40.10, Display Server: X Server, Compiler: GCC 11.3.1 20220421, File-System: xfs, Screen Resolution: 1920x1080 B: Processor: 2 x Intel Xeon Platinum 8380 @ 3.40GHz (80 Cores / 160 Threads), Motherboard: Intel M50CYP2SB2U (SE5C6200.86B.0022.D08.2103221623 BIOS), Chipset: Intel Device 0998, Memory: 512GB, Disk: 7682GB INTEL SSDPF2KX076TZ, Graphics: ASPEED, Monitor: VE228, Network: 2 x Intel X710 for 10GBASE-T + 2 x Intel E810-C for QSFP OS: CentOS Stream 9, Kernel: 5.14.0-142.el9.x86_64 (x86_64), Desktop: GNOME Shell 40.10, Display Server: X Server, Compiler: GCC 11.3.1 20220421, File-System: xfs, Screen Resolution: 1920x1080 C: Processor: 2 x Intel Xeon Platinum 8380 @ 3.40GHz (80 Cores / 160 Threads), Motherboard: Intel M50CYP2SB2U (SE5C6200.86B.0022.D08.2103221623 BIOS), Chipset: Intel Device 0998, Memory: 512GB, Disk: 7682GB INTEL SSDPF2KX076TZ, Graphics: ASPEED, Monitor: VE228, Network: 2 x Intel X710 for 10GBASE-T + 2 x Intel E810-C for QSFP OS: CentOS Stream 9, Kernel: 5.14.0-142.el9.x86_64 (x86_64), Desktop: GNOME Shell 40.10, Display Server: X Server, Compiler: GCC 11.3.1 20220421, File-System: xfs, Screen Resolution: 1920x1080 D: Processor: 2 x Intel Xeon Platinum 8380 @ 3.40GHz (80 Cores / 160 Threads), Motherboard: Intel M50CYP2SB2U (SE5C6200.86B.0022.D08.2103221623 BIOS), Chipset: Intel Device 0998, Memory: 512GB, Disk: 7682GB INTEL SSDPF2KX076TZ, Graphics: ASPEED, Monitor: VE228, Network: 2 x Intel X710 for 10GBASE-T + 2 x Intel E810-C for QSFP OS: CentOS Stream 9, Kernel: 5.14.0-142.el9.x86_64 (x86_64), Desktop: GNOME Shell 40.10, Display Server: X Server, Compiler: GCC 11.3.1 20220421, File-System: xfs, Screen Resolution: 1920x1080 E: Processor: 2 x Intel Xeon Platinum 8380 @ 3.40GHz (80 Cores / 160 Threads), Motherboard: Intel M50CYP2SB2U (SE5C6200.86B.0022.D08.2103221623 BIOS), Chipset: Intel Device 0998, Memory: 512GB, Disk: 7682GB INTEL SSDPF2KX076TZ, Graphics: ASPEED, Monitor: VE228, Network: 2 x Intel X710 for 10GBASE-T + 2 x Intel E810-C for QSFP OS: CentOS Stream 9, Kernel: 5.14.0-142.el9.x86_64 (x86_64), Desktop: GNOME Shell 40.10, Display Server: X Server, Compiler: GCC 11.3.1 20220421, File-System: xfs, Screen Resolution: 1920x1080 Mobile Neural Network 2.0 Model: mobilenetV3 ms < Lower Is Better A . 1.807 |================================================================== B . 1.837 |=================================================================== C . 1.823 |================================================================== D . 1.865 |==================================================================== E . 1.865 |==================================================================== Mobile Neural Network 2.0 Model: squeezenetv1.1 ms < Lower Is Better A . 2.317 |=============================================================== B . 2.395 |================================================================= C . 2.425 |================================================================= D . 2.447 |================================================================== E . 2.520 |==================================================================== Mobile Neural Network 2.0 Model: resnet-v2-50 ms < Lower Is Better A . 8.782 |================================================================= B . 9.081 |=================================================================== C . 8.766 |================================================================= D . 8.886 |================================================================== E . 9.199 |==================================================================== Mobile Neural Network 2.0 Model: SqueezeNetV1.0 ms < Lower Is Better A . 4.121 |================================================================= B . 4.213 |================================================================== C . 4.295 |==================================================================== D . 4.219 |================================================================== E . 4.321 |==================================================================== Mobile Neural Network 2.0 Model: MobileNetV2_224 ms < Lower Is Better A . 3.415 |==================================================================== B . 3.151 |=============================================================== C . 3.217 |================================================================ D . 3.229 |================================================================ E . 3.136 |============================================================== Mobile Neural Network 2.0 Model: mobilenet-v1-1.0 ms < Lower Is Better A . 2.228 |==================================================================== B . 2.198 |=================================================================== C . 2.167 |================================================================== D . 2.211 |=================================================================== E . 2.217 |==================================================================== Mobile Neural Network 2.0 Model: inception-v3 ms < Lower Is Better A . 20.69 |================================================================== B . 20.81 |================================================================== C . 20.85 |================================================================== D . 20.83 |================================================================== E . 21.35 |==================================================================== NCNN 20220729 Target: CPU - Model: mobilenet ms < Lower Is Better A . 21.91 |================================================================= B . 21.68 |================================================================= C . 22.35 |=================================================================== D . 22.85 |==================================================================== E . 21.85 |================================================================= NCNN 20220729 Target: CPU-v2-v2 - Model: mobilenet-v2 ms < Lower Is Better A . 12.99 |================================================================== B . 12.81 |================================================================= C . 12.79 |================================================================= D . 12.81 |================================================================= E . 13.31 |==================================================================== NCNN 20220729 Target: CPU-v3-v3 - Model: mobilenet-v3 ms < Lower Is Better A . 12.03 |=================================================================== B . 12.21 |==================================================================== C . 12.25 |==================================================================== D . 12.12 |=================================================================== E . 12.21 |==================================================================== NCNN 20220729 Target: CPU - Model: shufflenet-v2 ms < Lower Is Better A . 13.47 |=================================================================== B . 13.72 |==================================================================== C . 13.47 |=================================================================== D . 13.45 |=================================================================== E . 13.63 |==================================================================== NCNN 20220729 Target: CPU - Model: mnasnet ms < Lower Is Better A . 11.92 |=================================================================== B . 12.05 |==================================================================== C . 11.91 |=================================================================== D . 11.74 |================================================================== E . 11.79 |=================================================================== NCNN 20220729 Target: CPU - Model: efficientnet-b0 ms < Lower Is Better A . 16.89 |================================================================= B . 16.67 |================================================================ C . 17.75 |==================================================================== D . 16.54 |=============================================================== E . 16.50 |=============================================================== NCNN 20220729 Target: CPU - Model: blazeface ms < Lower Is Better A . 7.15 |=================================================================== B . 7.34 |===================================================================== C . 7.28 |==================================================================== D . 7.06 |================================================================== E . 7.23 |==================================================================== NCNN 20220729 Target: CPU - Model: googlenet ms < Lower Is Better A . 23.74 |==================================================================== B . 22.53 |================================================================= C . 23.11 |================================================================== D . 23.52 |=================================================================== E . 22.64 |================================================================= NCNN 20220729 Target: CPU - Model: vgg16 ms < Lower Is Better A . 30.91 |=================================================================== B . 29.05 |=============================================================== C . 29.63 |================================================================= D . 31.20 |==================================================================== E . 28.68 |=============================================================== NCNN 20220729 Target: CPU - Model: resnet18 ms < Lower Is Better A . 13.37 |================================================================== B . 13.18 |================================================================= C . 13.51 |================================================================== D . 13.87 |==================================================================== E . 13.20 |================================================================= NCNN 20220729 Target: CPU - Model: alexnet ms < Lower Is Better A . 8.89 |=================================================================== B . 8.51 |================================================================ C . 8.53 |================================================================= D . 9.12 |===================================================================== E . 8.62 |================================================================= NCNN 20220729 Target: CPU - Model: resnet50 ms < Lower Is Better A . 24.75 |=================================================================== B . 24.49 |================================================================== C . 25.14 |==================================================================== D . 25.27 |==================================================================== E . 24.34 |================================================================= NCNN 20220729 Target: CPU - Model: yolov4-tiny ms < Lower Is Better A . 27.80 |==================================================================== B . 27.25 |=================================================================== C . 27.28 |=================================================================== D . 27.38 |=================================================================== E . 26.74 |================================================================= NCNN 20220729 Target: CPU - Model: squeezenet_ssd ms < Lower Is Better A . 26.34 |================================================================== B . 26.36 |================================================================== C . 27.17 |==================================================================== D . 26.66 |=================================================================== E . 25.96 |================================================================= NCNN 20220729 Target: CPU - Model: regnety_400m ms < Lower Is Better A . 57.14 |================================================================== B . 57.76 |=================================================================== C . 57.92 |=================================================================== D . 56.90 |================================================================== E . 58.68 |==================================================================== NCNN 20220729 Target: CPU - Model: vision_transformer ms < Lower Is Better A . 151.78 |================================================================= B . 152.63 |================================================================== C . 152.79 |================================================================== D . 155.31 |=================================================================== E . 155.90 |=================================================================== NCNN 20220729 Target: CPU - Model: FastestDet ms < Lower Is Better A . 15.33 |=================================================================== B . 14.98 |================================================================= C . 15.56 |==================================================================== D . 14.92 |================================================================= E . 14.93 |=================================================================