centos stream extra 2 x Intel Xeon Max 9480 testing with a Supermicro X13DEM v1.10 (1.3 BIOS) and ASPEED on CentOS Stream 9 via the Phoronix Test Suite. 2 x Intel Xeon Max 9480: Processor: 2 x Intel Xeon Max 9480 @ 3.50GHz (112 Cores / 224 Threads), Motherboard: Supermicro X13DEM v1.10 (1.3 BIOS), Chipset: Intel Device 1bce, Memory: 512GB, Disk: 2 x 7682GB INTEL SSDPF2KX076TZ, Graphics: ASPEED, Monitor: VE228, Network: 2 x Broadcom BCM57508 NetXtreme-E 10Gb/25Gb/40Gb/50Gb/100Gb/200Gb OS: CentOS Stream 9, Kernel: 5.14.0-373.el9.x86_64 (x86_64), Desktop: GNOME Shell 40.10, Display Server: X Server, Compiler: GCC 11.4.1 20230605, File-System: xfs, Screen Resolution: 1920x1080 b: Processor: 2 x Intel Xeon Max 9480 @ 3.50GHz (112 Cores / 224 Threads), Motherboard: Supermicro X13DEM v1.10 (1.3 BIOS), Chipset: Intel Device 1bce, Memory: 512GB, Disk: 2 x 7682GB INTEL SSDPF2KX076TZ, Graphics: ASPEED, Monitor: VE228, Network: 2 x Broadcom BCM57508 NetXtreme-E 10Gb/25Gb/40Gb/50Gb/100Gb/200Gb OS: CentOS Stream 9, Kernel: 5.14.0-373.el9.x86_64 (x86_64), Desktop: GNOME Shell 40.10, Display Server: X Server, Compiler: GCC 11.4.1 20230605, File-System: xfs, Screen Resolution: 1920x1080 c: Processor: 2 x Intel Xeon Max 9480 @ 3.50GHz (112 Cores / 224 Threads), Motherboard: Supermicro X13DEM v1.10 (1.3 BIOS), Chipset: Intel Device 1bce, Memory: 512GB, Disk: 2 x 7682GB INTEL SSDPF2KX076TZ, Graphics: ASPEED, Monitor: VE228, Network: 2 x Broadcom BCM57508 NetXtreme-E 10Gb/25Gb/40Gb/50Gb/100Gb/200Gb OS: CentOS Stream 9, Kernel: 5.14.0-373.el9.x86_64 (x86_64), Desktop: GNOME Shell 40.10, Display Server: X Server, Compiler: GCC 11.4.1 20230605, File-System: xfs, Screen Resolution: 1920x1080 Embree 4.3 Binary: Pathtracer - Model: Crown Frames Per Second > Higher Is Better Embree 4.3 Binary: Pathtracer ISPC - Model: Crown Frames Per Second > Higher Is Better Embree 4.3 Binary: Pathtracer - Model: Asian Dragon Frames Per Second > Higher Is Better Embree 4.3 Binary: Pathtracer - Model: Asian Dragon Obj Frames Per Second > Higher Is Better Embree 4.3 Binary: Pathtracer ISPC - Model: Asian Dragon Frames Per Second > Higher Is Better Embree 4.3 Binary: Pathtracer ISPC - Model: Asian Dragon Obj Frames Per Second > Higher Is Better Intel Open Image Denoise 2.1 Run: RT.hdr_alb_nrm.3840x2160 - Device: CPU-Only Images / Sec > Higher Is Better 2 x Intel Xeon Max 9480 . 1.38 |============================================= b ....................... 1.32 |=========================================== c ....................... 1.44 |=============================================== Intel Open Image Denoise 2.1 Run: RT.ldr_alb_nrm.3840x2160 - Device: CPU-Only Images / Sec > Higher Is Better 2 x Intel Xeon Max 9480 . 1.20 |==================================== b ....................... 1.58 |=============================================== c ....................... 1.41 |========================================== Intel Open Image Denoise 2.1 Run: RTLightmap.hdr.4096x4096 - Device: CPU-Only Images / Sec > Higher Is Better 2 x Intel Xeon Max 9480 . 0.94 |=============================================== b ....................... 0.50 |========================= c ....................... 0.70 |=================================== OpenVKL 2.0.0 Benchmark: vklBenchmarkCPU ISPC Items / Sec > Higher Is Better 2 x Intel Xeon Max 9480 . 982 |============================================ b ....................... 1058 |=============================================== c ....................... 1046 |============================================== OpenVKL 2.0.0 Benchmark: vklBenchmarkCPU Scalar Items / Sec > Higher Is Better 2 x Intel Xeon Max 9480 . 484 |============================================= b ....................... 516 |================================================ c ....................... 488 |============================================= oneDNN 3.3 Harness: IP Shapes 1D - Data Type: f32 - Engine: CPU ms < Lower Is Better 2 x Intel Xeon Max 9480 . 6.39867 |============================================ b ....................... 3.44345 |======================== c ....................... 5.42410 |===================================== oneDNN 3.3 Harness: IP Shapes 3D - Data Type: f32 - Engine: CPU ms < Lower Is Better 2 x Intel Xeon Max 9480 . 8.18813 |============================================ b ....................... 7.48884 |======================================== c ....................... 7.91051 |=========================================== oneDNN 3.3 Harness: IP Shapes 1D - Data Type: u8s8f32 - Engine: CPU ms < Lower Is Better 2 x Intel Xeon Max 9480 . 6.90661 |============================================ b ....................... 6.50478 |========================================= c ....................... 3.76885 |======================== oneDNN 3.3 Harness: IP Shapes 3D - Data Type: u8s8f32 - Engine: CPU ms < Lower Is Better 2 x Intel Xeon Max 9480 . 5.24744 |============================================ b ....................... 5.30718 |============================================ c ....................... 4.22247 |=================================== oneDNN 3.3 Harness: IP Shapes 1D - Data Type: bf16bf16bf16 - Engine: CPU ms < Lower Is Better 2 x Intel Xeon Max 9480 . 8.02865 |========================================== b ....................... 8.37883 |=========================================== c ....................... 8.47846 |============================================ oneDNN 3.3 Harness: IP Shapes 3D - Data Type: bf16bf16bf16 - Engine: CPU ms < Lower Is Better 2 x Intel Xeon Max 9480 . 80.95 |============================================ b ....................... 84.30 |============================================== c ....................... 81.85 |============================================= oneDNN 3.3 Harness: Convolution Batch Shapes Auto - Data Type: f32 - Engine: CPU ms < Lower Is Better 2 x Intel Xeon Max 9480 . 9.07183 |=========================================== b ....................... 8.85383 |========================================== c ....................... 9.18192 |============================================ oneDNN 3.3 Harness: Deconvolution Batch shapes_1d - Data Type: f32 - Engine: CPU ms < Lower Is Better 2 x Intel Xeon Max 9480 . 14.81 |============================================== b ....................... 14.75 |============================================== c ....................... 14.21 |============================================ oneDNN 3.3 Harness: Deconvolution Batch shapes_3d - Data Type: f32 - Engine: CPU ms < Lower Is Better 2 x Intel Xeon Max 9480 . 4.27423 |============================================ b ....................... 4.06129 |========================================== c ....................... 3.93714 |========================================= oneDNN 3.3 Harness: Convolution Batch Shapes Auto - Data Type: u8s8f32 - Engine: CPU ms < Lower Is Better 2 x Intel Xeon Max 9480 . 7.11116 |============================================ b ....................... 7.01769 |=========================================== c ....................... 6.90576 |=========================================== oneDNN 3.3 Harness: Deconvolution Batch shapes_1d - Data Type: u8s8f32 - Engine: CPU ms < Lower Is Better 2 x Intel Xeon Max 9480 . 0.609168 |=========================================== b ....................... 0.570467 |======================================== c ....................... 0.595536 |========================================== oneDNN 3.3 Harness: Deconvolution Batch shapes_3d - Data Type: u8s8f32 - Engine: CPU ms < Lower Is Better 2 x Intel Xeon Max 9480 . 0.816029 |======================================= b ....................... 0.895853 |=========================================== c ....................... 0.814304 |======================================= oneDNN 3.3 Harness: Recurrent Neural Network Training - Data Type: f32 - Engine: CPU ms < Lower Is Better 2 x Intel Xeon Max 9480 . 13799.3 |=========================================== b ....................... 8774.0 |=========================== c ....................... 14073.0 |============================================ oneDNN 3.3 Harness: Recurrent Neural Network Inference - Data Type: f32 - Engine: CPU ms < Lower Is Better 2 x Intel Xeon Max 9480 . 1389.60 |=========================================== b ....................... 1415.42 |============================================ c ....................... 1303.30 |========================================= oneDNN 3.3 Harness: Recurrent Neural Network Training - Data Type: u8s8f32 - Engine: CPU ms < Lower Is Better 2 x Intel Xeon Max 9480 . 16878.5 |============================================ b ....................... 14404.0 |====================================== c ....................... 15467.0 |======================================== oneDNN 3.3 Harness: Convolution Batch Shapes Auto - Data Type: bf16bf16bf16 - Engine: CPU ms < Lower Is Better 2 x Intel Xeon Max 9480 . 3.88111 |=========================================== b ....................... 3.85134 |=========================================== c ....................... 3.93910 |============================================ oneDNN 3.3 Harness: Deconvolution Batch shapes_1d - Data Type: bf16bf16bf16 - Engine: CPU ms < Lower Is Better 2 x Intel Xeon Max 9480 . 0.647092 |========================================== b ....................... 0.667091 |=========================================== c ....................... 0.605543 |======================================= oneDNN 3.3 Harness: Deconvolution Batch shapes_3d - Data Type: bf16bf16bf16 - Engine: CPU ms < Lower Is Better 2 x Intel Xeon Max 9480 . 2.87581 |============================================ b ....................... 2.68958 |========================================= c ....................... 2.66555 |========================================= oneDNN 3.3 Harness: Recurrent Neural Network Inference - Data Type: u8s8f32 - Engine: CPU ms < Lower Is Better 2 x Intel Xeon Max 9480 . 1358.56 |========================================== b ....................... 1421.14 |============================================ c ....................... 1432.04 |============================================ oneDNN 3.3 Harness: Recurrent Neural Network Training - Data Type: bf16bf16bf16 - Engine: CPU ms < Lower Is Better 2 x Intel Xeon Max 9480 . 15485.1 |======================================= b ....................... 17354.5 |============================================ c ....................... 13214.9 |================================== oneDNN 3.3 Harness: Recurrent Neural Network Inference - Data Type: bf16bf16bf16 - Engine: CPU ms < Lower Is Better 2 x Intel Xeon Max 9480 . 1233.21 |======================================= b ....................... 1395.16 |============================================ c ....................... 1339.74 |========================================== OpenVINO 2023.1 Model: Face Detection FP16 - Device: CPU FPS > Higher Is Better 2 x Intel Xeon Max 9480 . 99.50 |============================================ b ....................... 102.16 |============================================= c ....................... 100.58 |============================================ OpenVINO 2023.1 Model: Face Detection FP16 - Device: CPU ms < Lower Is Better 2 x Intel Xeon Max 9480 . 370.41 |============================================= b ....................... 360.67 |============================================ c ....................... 366.12 |============================================ OpenVINO 2023.1 Model: Person Detection FP16 - Device: CPU FPS > Higher Is Better 2 x Intel Xeon Max 9480 . 402.19 |============================================= b ....................... 396.12 |============================================ c ....................... 387.61 |=========================================== OpenVINO 2023.1 Model: Person Detection FP16 - Device: CPU ms < Lower Is Better 2 x Intel Xeon Max 9480 . 91.89 |============================================ b ....................... 93.25 |============================================= c ....................... 95.29 |============================================== OpenVINO 2023.1 Model: Person Detection FP32 - Device: CPU FPS > Higher Is Better 2 x Intel Xeon Max 9480 . 397.31 |============================================= b ....................... 389.31 |============================================ c ....................... 391.02 |============================================ OpenVINO 2023.1 Model: Person Detection FP32 - Device: CPU ms < Lower Is Better 2 x Intel Xeon Max 9480 . 93.01 |============================================= b ....................... 94.90 |============================================== c ....................... 94.46 |============================================== OpenVINO 2023.1 Model: Vehicle Detection FP16 - Device: CPU FPS > Higher Is Better 2 x Intel Xeon Max 9480 . 2083.79 |============================================ b ....................... 2054.36 |=========================================== c ....................... 1914.54 |======================================== OpenVINO 2023.1 Model: Vehicle Detection FP16 - Device: CPU ms < Lower Is Better 2 x Intel Xeon Max 9480 . 17.71 |========================================== b ....................... 17.96 |=========================================== c ....................... 19.27 |============================================== OpenVINO 2023.1 Model: Face Detection FP16-INT8 - Device: CPU FPS > Higher Is Better 2 x Intel Xeon Max 9480 . 324.92 |============================================= b ....................... 324.12 |============================================= c ....................... 325.04 |============================================= OpenVINO 2023.1 Model: Face Detection FP16-INT8 - Device: CPU ms < Lower Is Better 2 x Intel Xeon Max 9480 . 343.57 |============================================= b ....................... 344.50 |============================================= c ....................... 343.60 |============================================= OpenVINO 2023.1 Model: Face Detection Retail FP16 - Device: CPU FPS > Higher Is Better 2 x Intel Xeon Max 9480 . 10933.63 |=========================================== b ....................... 10917.91 |========================================== c ....................... 11057.32 |=========================================== OpenVINO 2023.1 Model: Face Detection Retail FP16 - Device: CPU ms < Lower Is Better 2 x Intel Xeon Max 9480 . 10.22 |============================================== b ....................... 10.23 |============================================== c ....................... 10.11 |============================================= OpenVINO 2023.1 Model: Road Segmentation ADAS FP16 - Device: CPU FPS > Higher Is Better 2 x Intel Xeon Max 9480 . 909.89 |========================================== b ....................... 966.99 |============================================= c ....................... 947.32 |============================================ OpenVINO 2023.1 Model: Road Segmentation ADAS FP16 - Device: CPU ms < Lower Is Better 2 x Intel Xeon Max 9480 . 40.58 |============================================== b ....................... 38.20 |=========================================== c ....................... 38.99 |============================================ OpenVINO 2023.1 Model: Vehicle Detection FP16-INT8 - Device: CPU FPS > Higher Is Better 2 x Intel Xeon Max 9480 . 5108.28 |============================================ b ....................... 5114.40 |============================================ c ....................... 5121.05 |============================================ OpenVINO 2023.1 Model: Vehicle Detection FP16-INT8 - Device: CPU ms < Lower Is Better 2 x Intel Xeon Max 9480 . 21.90 |============================================== b ....................... 21.86 |============================================== c ....................... 21.83 |============================================== OpenVINO 2023.1 Model: Weld Porosity Detection FP16 - Device: CPU FPS > Higher Is Better 2 x Intel Xeon Max 9480 . 15569.86 |========================================= b ....................... 16043.36 |========================================== c ....................... 16509.91 |=========================================== OpenVINO 2023.1 Model: Weld Porosity Detection FP16 - Device: CPU ms < Lower Is Better 2 x Intel Xeon Max 9480 . 7.11 |=============================================== b ....................... 6.90 |============================================== c ....................... 6.70 |============================================ OpenVINO 2023.1 Model: Face Detection Retail FP16-INT8 - Device: CPU FPS > Higher Is Better 2 x Intel Xeon Max 9480 . 15732.26 |=========================================== b ....................... 15673.54 |=========================================== c ....................... 15741.68 |=========================================== OpenVINO 2023.1 Model: Face Detection Retail FP16-INT8 - Device: CPU ms < Lower Is Better 2 x Intel Xeon Max 9480 . 7.10 |=============================================== b ....................... 7.12 |=============================================== c ....................... 7.07 |=============================================== OpenVINO 2023.1 Model: Road Segmentation ADAS FP16-INT8 - Device: CPU FPS > Higher Is Better 2 x Intel Xeon Max 9480 . 1438.58 |=========================================== b ....................... 1447.80 |=========================================== c ....................... 1465.99 |============================================ OpenVINO 2023.1 Model: Road Segmentation ADAS FP16-INT8 - Device: CPU ms < Lower Is Better 2 x Intel Xeon Max 9480 . 77.76 |============================================== b ....................... 77.27 |============================================== c ....................... 76.33 |============================================= OpenVINO 2023.1 Model: Machine Translation EN To DE FP16 - Device: CPU FPS > Higher Is Better 2 x Intel Xeon Max 9480 . 279.73 |======================================== b ....................... 317.24 |============================================= c ....................... 303.33 |=========================================== OpenVINO 2023.1 Model: Machine Translation EN To DE FP16 - Device: CPU ms < Lower Is Better 2 x Intel Xeon Max 9480 . 132.15 |============================================= b ....................... 116.51 |======================================== c ....................... 121.86 |========================================= OpenVINO 2023.1 Model: Weld Porosity Detection FP16-INT8 - Device: CPU FPS > Higher Is Better 2 x Intel Xeon Max 9480 . 25154.51 |========================================== b ....................... 24505.40 |========================================= c ....................... 25725.95 |=========================================== OpenVINO 2023.1 Model: Weld Porosity Detection FP16-INT8 - Device: CPU ms < Lower Is Better 2 x Intel Xeon Max 9480 . 4.30 |============================================== b ....................... 4.41 |=============================================== c ....................... 4.19 |============================================= OpenVINO 2023.1 Model: Person Vehicle Bike Detection FP16 - Device: CPU FPS > Higher Is Better 2 x Intel Xeon Max 9480 . 6126.49 |=========================================== b ....................... 6150.01 |============================================ c ....................... 6200.74 |============================================ OpenVINO 2023.1 Model: Person Vehicle Bike Detection FP16 - Device: CPU ms < Lower Is Better 2 x Intel Xeon Max 9480 . 18.25 |============================================== b ....................... 18.18 |============================================== c ....................... 18.04 |============================================= OpenVINO 2023.1 Model: Handwritten English Recognition FP16 - Device: CPU FPS > Higher Is Better 2 x Intel Xeon Max 9480 . 3506.92 |=========================================== b ....................... 3522.96 |============================================ c ....................... 3558.58 |============================================ OpenVINO 2023.1 Model: Handwritten English Recognition FP16 - Device: CPU ms < Lower Is Better 2 x Intel Xeon Max 9480 . 31.90 |============================================== b ....................... 31.77 |============================================== c ....................... 31.44 |============================================= OpenVINO 2023.1 Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU FPS > Higher Is Better 2 x Intel Xeon Max 9480 . 68584.85 |======================================== b ....................... 73923.61 |=========================================== c ....................... 73632.17 |=========================================== OpenVINO 2023.1 Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU ms < Lower Is Better 2 x Intel Xeon Max 9480 . 0.64 |=============================================== b ....................... 0.61 |============================================= c ....................... 0.55 |======================================== OpenVINO 2023.1 Model: Handwritten English Recognition FP16-INT8 - Device: CPU FPS > Higher Is Better 2 x Intel Xeon Max 9480 . 2330.76 |============================================ b ....................... 2332.98 |============================================ c ....................... 2329.65 |============================================ OpenVINO 2023.1 Model: Handwritten English Recognition FP16-INT8 - Device: CPU ms < Lower Is Better 2 x Intel Xeon Max 9480 . 48.02 |============================================== b ....................... 47.97 |============================================== c ....................... 48.04 |============================================== OpenVINO 2023.1 Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU FPS > Higher Is Better 2 x Intel Xeon Max 9480 . 114066.70 |========================================= b ....................... 115792.65 |========================================== c ....................... 110854.06 |======================================== OpenVINO 2023.1 Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU ms < Lower Is Better 2 x Intel Xeon Max 9480 . 0.34 |=============================================== b ....................... 0.34 |=============================================== c ....................... 0.33 |==============================================