Intel Xeon Platinum 8490H Linux Benchmarks Tests for a future article on Phoronix of Sapphire Rapids launch day review using the Intel Xeon Platinum 8490H processors. More benchmarks to come by Michael Larabel. Xeon Platinum 8490H: Processor: Intel Xeon Platinum 8490H @ 3.50GHz (60 Cores / 120 Threads), Motherboard: Quanta Cloud S6Q-MB-MPS (3A10.uh BIOS), Chipset: Intel Device 1bce, Memory: 512GB, Disk: 3841GB Micron_9300_MTFDHAL3T8TDP, Graphics: ASPEED, Monitor: VGA HDMI, Network: 4 x Intel E810-C for QSFP OS: Ubuntu 22.10, Kernel: 6.0.0-060000rc3daily20220904-generic (x86_64), Desktop: GNOME Shell, Display Server: X Server 1.21.1.3, Vulkan: 1.3.211, Compiler: GCC 12.2.0, File-System: ext4, Screen Resolution: 1920x1080 Xeon Platinum 8490H 2P: Processor: 2 x Intel Xeon Platinum 8490H @ 3.50GHz (120 Cores / 240 Threads), Motherboard: Quanta Cloud S6Q-MB-MPS (3A10.uh BIOS), Chipset: Intel Device 1bce, Memory: 1008GB, Disk: 3841GB Micron_9300_MTFDHAL3T8TDP, Graphics: ASPEED, Monitor: VGA HDMI, Network: 4 x Intel E810-C for QSFP + 2 x Intel X710 for 10GBASE-T OS: Ubuntu 22.10, Kernel: 6.0.0-060000rc3daily20220904-generic (x86_64), Desktop: GNOME Shell, Display Server: X Server 1.21.1.3, Vulkan: 1.3.211, Compiler: GCC 12.2.0, File-System: ext4, Screen Resolution: 1920x1080 OpenVINO 2022.2.dev Model: Face Detection FP16 - Device: CPU FPS > Higher Is Better Xeon Platinum 8490H .... 70.58 |================ Xeon Platinum 8490H 2P . 197.81 |============================================== OpenVINO 2022.2.dev Model: Face Detection FP16 - Device: CPU ms < Lower Is Better Xeon Platinum 8490H .... 424.67 |============================================== Xeon Platinum 8490H 2P . 151.49 |================ OpenVINO 2022.2.dev CPU Power Consumption Monitor Watts < Lower Is Better Xeon Platinum 8490H .... MIN: 80 AVG: 324 MAX: 377 Xeon Platinum 8490H 2P . MIN: 206 AVG: 645 MAX: 752 OpenVINO 2022.2.dev Model: Face Detection FP16-INT8 - Device: CPU FPS > Higher Is Better Xeon Platinum 8490H .... 150.87 |================== Xeon Platinum 8490H 2P . 376.67 |============================================== OpenVINO 2022.2.dev Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU FPS > Higher Is Better Xeon Platinum 8490H .... 82929.06 |======================= Xeon Platinum 8490H 2P . 152169.33 |=========================================== OpenVINO 2022.2.dev Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU ms < Lower Is Better Xeon Platinum 8490H .... 0.62 |================================================ Xeon Platinum 8490H 2P . 0.45 |=================================== OpenVINO 2022.2.dev CPU Power Consumption Monitor Watts < Lower Is Better Xeon Platinum 8490H .... MIN: 83 AVG: 331 MAX: 376 Xeon Platinum 8490H 2P . MIN: 205 AVG: 646 MAX: 698 OpenVINO 2022.2.dev Model: Person Detection FP16 - Device: CPU FPS > Higher Is Better Xeon Platinum 8490H .... 25.55 |============================== Xeon Platinum 8490H 2P . 40.14 |=============================================== OpenVINO 2022.2.dev Model: Person Detection FP16 - Device: CPU ms < Lower Is Better Xeon Platinum 8490H .... 1167.83 |============================================= Xeon Platinum 8490H 2P . 744.65 |============================= OpenVINO 2022.2.dev CPU Power Consumption Monitor Watts < Lower Is Better Xeon Platinum 8490H .... MIN: 82 AVG: 323 MAX: 369 Xeon Platinum 8490H 2P . MIN: 208 AVG: 627 MAX: 703 OpenVINO 2022.2.dev Model: Person Detection FP32 - Device: CPU FPS > Higher Is Better Xeon Platinum 8490H .... 25.53 |============================== Xeon Platinum 8490H 2P . 40.08 |=============================================== OpenVINO 2022.2.dev Model: Person Detection FP32 - Device: CPU ms < Lower Is Better Xeon Platinum 8490H .... 1169.15 |============================================= Xeon Platinum 8490H 2P . 745.86 |============================= OpenVINO 2022.2.dev CPU Power Consumption Monitor Watts < Lower Is Better Xeon Platinum 8490H .... MIN: 81 AVG: 326 MAX: 366 Xeon Platinum 8490H 2P . MIN: 201 AVG: 633 MAX: 710 OpenVINO 2022.2.dev Model: Weld Porosity Detection FP16-INT8 - Device: CPU FPS > Higher Is Better Xeon Platinum 8490H .... 16703.64 |================ Xeon Platinum 8490H 2P . 45149.75 |============================================ OpenVINO 2022.2.dev Model: Weld Porosity Detection FP16 - Device: CPU FPS > Higher Is Better Xeon Platinum 8490H .... 7839.51 |=============== Xeon Platinum 8490H 2P . 22725.25 |============================================ OpenVINO 2022.2.dev Model: Weld Porosity Detection FP16 - Device: CPU ms < Lower Is Better Xeon Platinum 8490H .... 7.52 |================================================ Xeon Platinum 8490H 2P . 5.16 |================================= OpenVINO 2022.2.dev CPU Power Consumption Monitor Watts < Lower Is Better Xeon Platinum 8490H .... MIN: 79 AVG: 332 MAX: 377 Xeon Platinum 8490H 2P . MIN: 200 AVG: 661 MAX: 754 OpenVINO 2022.2.dev Model: Person Vehicle Bike Detection FP16 - Device: CPU FPS > Higher Is Better Xeon Platinum 8490H .... 3656.94 |====================== Xeon Platinum 8490H 2P . 7533.49 |============================================= OpenVINO 2022.2.dev Model: Machine Translation EN To DE FP16 - Device: CPU FPS > Higher Is Better Xeon Platinum 8490H .... 448.59 |============================= Xeon Platinum 8490H 2P . 719.22 |============================================== OpenVINO 2022.2.dev Model: Machine Translation EN To DE FP16 - Device: CPU ms < Lower Is Better Xeon Platinum 8490H .... 66.66 |=============================================== Xeon Platinum 8490H 2P . 41.51 |============================= OpenVINO 2022.2.dev CPU Power Consumption Monitor Watts < Lower Is Better Xeon Platinum 8490H .... MIN: 82 AVG: 328 MAX: 376 Xeon Platinum 8490H 2P . MIN: 202 AVG: 655 MAX: 749 LeelaChessZero 0.28 Backend: Eigen Nodes Per Second > Higher Is Better Xeon Platinum 8490H .... 10513 |========================================= Xeon Platinum 8490H 2P . 11976 |=============================================== LeelaChessZero 0.28 Backend: Eigen Nodes Per Second Per Watt > Higher Is Better Xeon Platinum 8490H .... 31.74 |=============================================== Xeon Platinum 8490H 2P . 22.12 |================================= LeelaChessZero 0.28 CPU Power Consumption Monitor Watts < Lower Is Better Xeon Platinum 8490H .... MIN: 85 AVG: 331 MAX: 379 Xeon Platinum 8490H 2P . MIN: 203 AVG: 541 MAX: 740 oneDNN 2.6 Harness: Convolution Batch Shapes Auto - Data Type: f32 - Engine: CPU ms < Lower Is Better Xeon Platinum 8490H .... 0.636394 |============================================ Xeon Platinum 8490H 2P . 0.435654 |============================== oneDNN 2.6 CPU Power Consumption Monitor Watts < Lower Is Better Xeon Platinum 8490H .... MIN: 80 AVG: 238 MAX: 377 Xeon Platinum 8490H 2P . MIN: 201 AVG: 477 MAX: 753 oneDNN 2.6 Harness: Convolution Batch Shapes Auto - Data Type: u8s8f32 - Engine: CPU ms < Lower Is Better Xeon Platinum 8490H .... 0.492516 |============================================ Xeon Platinum 8490H 2P . 0.267939 |======================== oneDNN 2.6 CPU Power Consumption Monitor Watts < Lower Is Better Xeon Platinum 8490H .... MIN: 83 AVG: 249 MAX: 377 Xeon Platinum 8490H 2P . MIN: 196 AVG: 497 MAX: 735 oneDNN 2.6 Harness: Deconvolution Batch shapes_3d - Data Type: f32 - Engine: CPU ms < Lower Is Better Xeon Platinum 8490H .... 1.108120 |============================================ Xeon Platinum 8490H 2P . 0.744021 |============================== oneDNN 2.6 CPU Power Consumption Monitor Watts < Lower Is Better Xeon Platinum 8490H .... MIN: 83 AVG: 208 MAX: 368 Xeon Platinum 8490H 2P . MIN: 202 AVG: 432 MAX: 729 oneDNN 2.7 Harness: Convolution Batch Shapes Auto - Data Type: f32 - Engine: CPU ms < Lower Is Better Xeon Platinum 8490H .... 0.645779 |============================================ Xeon Platinum 8490H 2P . 0.431788 |============================= oneDNN 2.7 CPU Power Consumption Monitor Watts < Lower Is Better Xeon Platinum 8490H .... MIN: 82 AVG: 238 MAX: 378 Xeon Platinum 8490H 2P . MIN: 201 AVG: 479 MAX: 752 oneDNN 2.7 Harness: Convolution Batch Shapes Auto - Data Type: u8s8f32 - Engine: CPU ms < Lower Is Better Xeon Platinum 8490H .... 0.519451 |============================================ Xeon Platinum 8490H 2P . 0.262114 |====================== oneDNN 2.7 CPU Power Consumption Monitor Watts < Lower Is Better Xeon Platinum 8490H .... MIN: 84 AVG: 250 MAX: 377 Xeon Platinum 8490H 2P . MIN: 194 AVG: 502 MAX: 738 oneDNN 2.7 Harness: Convolution Batch Shapes Auto - Data Type: bf16bf16bf16 - Engine: CPU ms < Lower Is Better Xeon Platinum 8490H .... 0.281812 |============================================ Xeon Platinum 8490H 2P . 0.264160 |========================================= oneDNN 2.7 CPU Power Consumption Monitor Watts < Lower Is Better Xeon Platinum 8490H .... MIN: 82 AVG: 241 MAX: 372 Xeon Platinum 8490H 2P . MIN: 199 AVG: 473 MAX: 694 Neural Magic DeepSparse 1.1 Model: CV Classification, ResNet-50 ImageNet - Scenario: Synchronous Single-Stream items/sec > Higher Is Better Xeon Platinum 8490H .... 279.46 |============================================== Xeon Platinum 8490H 2P . 281.82 |============================================== Neural Magic DeepSparse 1.1 Model: CV Classification, ResNet-50 ImageNet - Scenario: Synchronous Single-Stream ms/batch < Lower Is Better Xeon Platinum 8490H .... 3.5734 |============================================== Xeon Platinum 8490H 2P . 3.5434 |============================================== Neural Magic DeepSparse 1.1 CPU Power Consumption Monitor Watts < Lower Is Better Xeon Platinum 8490H .... MIN: 84 AVG: 284 MAX: 326 Xeon Platinum 8490H 2P . MIN: 203 AVG: 470 MAX: 517 Neural Magic DeepSparse 1.1 Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream items/sec > Higher Is Better Xeon Platinum 8490H .... 769.78 |======================= Xeon Platinum 8490H 2P . 1499.50 |============================================= Neural Magic DeepSparse 1.1 Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Stream items/sec > Higher Is Better Xeon Platinum 8490H .... 47.45 |======================== Xeon Platinum 8490H 2P . 92.16 |=============================================== Neural Magic DeepSparse 1.1 Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-Stream items/sec > Higher Is Better Xeon Platinum 8490H .... 192.99 |======================== Xeon Platinum 8490H 2P . 364.80 |============================================== Neural Magic DeepSparse 1.1 Model: CV Detection,YOLOv5s COCO - Scenario: Asynchronous Multi-Stream items/sec > Higher Is Better Xeon Platinum 8490H .... 318.93 |========================= Xeon Platinum 8490H 2P . 594.02 |============================================== Neural Magic DeepSparse 1.1 Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Stream items/sec > Higher Is Better Xeon Platinum 8490H .... 47.29 |======================== Xeon Platinum 8490H 2P . 92.17 |=============================================== Geometric Mean Of All Test Results Result Composite - Intel Xeon Platinum 8490H Linux Benchmarks Geometric Mean > Higher Is Better Xeon Platinum 8490H .... 110.54 |=========================== Xeon Platinum 8490H 2P . 190.28 |==============================================