Intel Xeon Max AMX HBM2e Performance Benchmark Benchmarks for a future article on Phoronix by Michael Larabel. Xeon Max 9480 2P, No HBM, Max AVX512 FP16: Processor: 2 x Intel Xeon Max 9480 @ 3.50GHz (112 Cores / 224 Threads), Motherboard: Supermicro X13DEM v1.10 (1.3 BIOS), Chipset: Intel Device 1bce, Memory: 512GB, Disk: 7682GB INTEL SSDPF2KX076TZ, Graphics: ASPEED, Monitor: VE228, Network: 2 x Broadcom BCM57508 NetXtreme-E 10Gb/25Gb/40Gb/50Gb/100Gb/200Gb OS: Ubuntu 23.04, Kernel: 6.2.0-20-generic (x86_64), Desktop: GNOME Shell 44.0, Display Server: X Server 1.21.1.7, Compiler: GCC 12.2.0, File-System: ext4, Screen Resolution: 1920x1080 Xeon Max 9480 2P, No HBM: Processor: 2 x Intel Xeon Max 9480 @ 3.50GHz (112 Cores / 224 Threads), Motherboard: Supermicro X13DEM v1.10 (1.3 BIOS), Chipset: Intel Device 1bce, Memory: 512GB, Disk: 7682GB INTEL SSDPF2KX076TZ, Graphics: ASPEED, Monitor: VE228, Network: 2 x Broadcom BCM57508 NetXtreme-E 10Gb/25Gb/40Gb/50Gb/100Gb/200Gb OS: Ubuntu 23.04, Kernel: 6.2.0-20-generic (x86_64), Desktop: GNOME Shell 44.0, Display Server: X Server 1.21.1.7, Compiler: GCC 12.2.0, File-System: ext4, Screen Resolution: 1920x1080 Xeon Max 9480 2P, HBM Caching: Processor: 2 x Intel Xeon Max 9480 @ 3.50GHz (112 Cores / 224 Threads), Motherboard: Supermicro X13DEM v1.10 (1.3 BIOS), Chipset: Intel Device 1bce, Memory: 512GB, Disk: 7682GB INTEL SSDPF2KX076TZ, Graphics: ASPEED, Monitor: VE228, Network: 2 x Broadcom BCM57508 NetXtreme-E 10Gb/25Gb/40Gb/50Gb/100Gb/200Gb OS: Ubuntu 23.04, Kernel: 6.2.0-20-generic (x86_64), Desktop: GNOME Shell 44.0, Display Server: X Server 1.21.1.7, Compiler: GCC 12.2.0, File-System: ext4, Screen Resolution: 1920x1080 Xeon Max 9480 2P, HBM Only: Processor: 2 x Intel Xeon Max 9480 @ 3.50GHz (112 Cores / 224 Threads), Motherboard: Supermicro X13DEM v1.10 (1.3 BIOS), Chipset: Intel Device 1bce, Memory: 128GB, Disk: 7682GB INTEL SSDPF2KX076TZ, Graphics: ASPEED, Monitor: VE228, Network: 2 x Broadcom BCM57508 NetXtreme-E 10Gb/25Gb/40Gb/50Gb/100Gb/200Gb OS: Ubuntu 23.04, Kernel: 6.2.0-20-generic (x86_64), Desktop: GNOME Shell 44.0, Display Server: X Server 1.21.1.7, Compiler: GCC 12.2.0, File-System: ext4, Screen Resolution: 1920x1080 EPYC 9554 2P: Processor: 2 x AMD EPYC 9554 64-Core @ 3.10GHz (128 Cores / 256 Threads), Motherboard: AMD Titanite_4G (RTI1007B BIOS), Chipset: AMD Device 14a4, Memory: 1520GB, Disk: 7682GB INTEL SSDPF2KX076TZ, Graphics: ASPEED, Monitor: VGA HDMI, Network: Broadcom NetXtreme BCM5720 PCIe OS: Ubuntu 23.04, Kernel: 6.2.0-20-generic (x86_64), Desktop: GNOME Shell 44.0, Display Server: X Server 1.21.1.7, Compiler: GCC 12.2.0, File-System: ext4, Screen Resolution: 1920x1080 EPYC 9654 2P: Processor: 2 x AMD EPYC 9654 96-Core @ 2.40GHz (192 Cores / 384 Threads), Motherboard: AMD Titanite_4G (RTI1007B BIOS), Chipset: AMD Device 14a4, Memory: 1520GB, Disk: 7682GB INTEL SSDPF2KX076TZ, Graphics: ASPEED, Monitor: VGA HDMI, Network: Broadcom NetXtreme BCM5720 PCIe OS: Ubuntu 23.04, Kernel: 6.2.0-20-generic (x86_64), Desktop: GNOME Shell 44.0, Display Server: X Server 1.21.1.7, Compiler: GCC 12.2.0, File-System: ext4, Screen Resolution: 1920x1080 OpenVINO 2022.3 Model: Face Detection FP16 - Device: CPU FPS > Higher Is Better Xeon Max 9480 2P, No HBM, Max AVX512 FP16 . 19.83 |=== Xeon Max 9480 2P, No HBM .................. 115.20 |================== Xeon Max 9480 2P, HBM Caching ............. 120.40 |================== Xeon Max 9480 2P, HBM Only ................ 175.74 |=========================== EPYC 9554 2P .............................. 82.04 |============= EPYC 9654 2P .............................. 101.56 |================ OpenVINO 2022.3 Model: Face Detection FP16 - Device: CPU ms < Lower Is Better Xeon Max 9480 2P, No HBM, Max AVX512 FP16 . 1398.32 |========================== Xeon Max 9480 2P, No HBM .................. 242.64 |===== Xeon Max 9480 2P, HBM Caching ............. 232.01 |==== Xeon Max 9480 2P, HBM Only ................ 159.13 |=== EPYC 9554 2P .............................. 389.53 |======= EPYC 9654 2P .............................. 471.82 |========= OpenVINO 2022.3 CPU Power Consumption Monitor Watts < Lower Is Better Xeon Max 9480 2P, No HBM, Max AVX512 FP16 . MIN: 259 AVG: 561 MAX: 637 Xeon Max 9480 2P, No HBM .................. MIN: 163 AVG: 519 MAX: 586 Xeon Max 9480 2P, HBM Caching ............. MIN: 136 AVG: 533 MAX: 628 Xeon Max 9480 2P, HBM Only ................ MIN: 256 AVG: 574 MAX: 649 EPYC 9554 2P .............................. MIN: 49 AVG: 638 MAX: 711 EPYC 9654 2P .............................. MIN: 58 AVG: 646 MAX: 726 OpenVINO 2022.3 Model: Person Detection FP16 - Device: CPU FPS > Higher Is Better Xeon Max 9480 2P, No HBM, Max AVX512 FP16 . 11.31 |======= Xeon Max 9480 2P, No HBM .................. 32.52 |===================== Xeon Max 9480 2P, HBM Caching ............. 33.40 |===================== Xeon Max 9480 2P, HBM Only ................ 39.47 |========================= EPYC 9554 2P .............................. 38.24 |========================= EPYC 9654 2P .............................. 43.64 |============================ OpenVINO 2022.3 Model: Person Detection FP16 - Device: CPU ms < Lower Is Better Xeon Max 9480 2P, No HBM, Max AVX512 FP16 . 2445.49 |========================== Xeon Max 9480 2P, No HBM .................. 857.32 |========= Xeon Max 9480 2P, HBM Caching ............. 834.97 |========= Xeon Max 9480 2P, HBM Only ................ 706.83 |======== EPYC 9554 2P .............................. 832.02 |========= EPYC 9654 2P .............................. 1092.97 |============ OpenVINO 2022.3 CPU Power Consumption Monitor Watts < Lower Is Better Xeon Max 9480 2P, No HBM, Max AVX512 FP16 . MIN: 267 AVG: 546 MAX: 628 Xeon Max 9480 2P, No HBM .................. MIN: 205 AVG: 515 MAX: 616 Xeon Max 9480 2P, HBM Caching ............. MIN: 204 AVG: 538 MAX: 618 Xeon Max 9480 2P, HBM Only ................ MIN: 252 AVG: 563 MAX: 639 EPYC 9554 2P .............................. MIN: 49 AVG: 596 MAX: 683 EPYC 9654 2P .............................. MIN: 60 AVG: 608 MAX: 699 OpenVINO 2022.3 Model: Person Detection FP32 - Device: CPU FPS > Higher Is Better Xeon Max 9480 2P, No HBM, Max AVX512 FP16 . 11.26 |======= Xeon Max 9480 2P, No HBM .................. 33.79 |====================== Xeon Max 9480 2P, HBM Caching ............. 33.97 |====================== Xeon Max 9480 2P, HBM Only ................ 38.77 |========================= EPYC 9554 2P .............................. 38.53 |========================= EPYC 9654 2P .............................. 43.40 |============================ OpenVINO 2022.3 Model: Person Detection FP32 - Device: CPU ms < Lower Is Better Xeon Max 9480 2P, No HBM, Max AVX512 FP16 . 2449.29 |========================== Xeon Max 9480 2P, No HBM .................. 824.93 |========= Xeon Max 9480 2P, HBM Caching ............. 819.76 |========= Xeon Max 9480 2P, HBM Only ................ 719.49 |======== EPYC 9554 2P .............................. 825.52 |========= EPYC 9654 2P .............................. 1098.96 |============ OpenVINO 2022.3 CPU Power Consumption Monitor Watts < Lower Is Better Xeon Max 9480 2P, No HBM, Max AVX512 FP16 . MIN: 241 AVG: 553 MAX: 629 Xeon Max 9480 2P, No HBM .................. MIN: 245 AVG: 531 MAX: 618 Xeon Max 9480 2P, HBM Caching ............. MIN: 228 AVG: 547 MAX: 624 Xeon Max 9480 2P, HBM Only ................ MIN: 223 AVG: 567 MAX: 643 EPYC 9554 2P .............................. MIN: 49 AVG: 600 MAX: 684 EPYC 9654 2P .............................. MIN: 60 AVG: 606 MAX: 703 OpenVINO 2022.3 Model: Face Detection FP16-INT8 - Device: CPU FPS > Higher Is Better Xeon Max 9480 2P, No HBM, Max AVX512 FP16 . 106.27 |======== Xeon Max 9480 2P, No HBM .................. 293.49 |===================== Xeon Max 9480 2P, HBM Caching ............. 334.89 |======================== Xeon Max 9480 2P, HBM Only ................ 369.64 |=========================== EPYC 9554 2P .............................. 155.28 |=========== EPYC 9654 2P .............................. 191.41 |============== OpenVINO 2022.3 Model: Face Detection FP16-INT8 - Device: CPU ms < Lower Is Better Xeon Max 9480 2P, No HBM, Max AVX512 FP16 . 262.84 |=================== Xeon Max 9480 2P, No HBM .................. 380.60 |=========================== Xeon Max 9480 2P, HBM Caching ............. 333.51 |======================== Xeon Max 9480 2P, HBM Only ................ 302.45 |===================== EPYC 9554 2P .............................. 205.71 |=============== EPYC 9654 2P .............................. 250.39 |================== OpenVINO 2022.3 CPU Power Consumption Monitor Watts < Lower Is Better Xeon Max 9480 2P, No HBM, Max AVX512 FP16 . MIN: 184 AVG: 553 MAX: 616 Xeon Max 9480 2P, No HBM .................. MIN: 157 AVG: 500 MAX: 632 Xeon Max 9480 2P, HBM Caching ............. MIN: 168 AVG: 531 MAX: 616 Xeon Max 9480 2P, HBM Only ................ MIN: 249 AVG: 561 MAX: 682 EPYC 9554 2P .............................. MIN: 50 AVG: 606 MAX: 675 EPYC 9654 2P .............................. MIN: 59 AVG: 613 MAX: 687 OpenVINO 2022.3 Model: Weld Porosity Detection FP16 - Device: CPU FPS > Higher Is Better Xeon Max 9480 2P, No HBM, Max AVX512 FP16 . 1977.08 |=== Xeon Max 9480 2P, No HBM .................. 16532.40 |====================== Xeon Max 9480 2P, HBM Caching ............. 16941.99 |======================= Xeon Max 9480 2P, HBM Only ................ 18452.02 |========================= EPYC 9554 2P .............................. 8039.57 |=========== EPYC 9654 2P .............................. 9843.03 |============= OpenVINO 2022.3 Model: Weld Porosity Detection FP16 - Device: CPU ms < Lower Is Better Xeon Max 9480 2P, No HBM, Max AVX512 FP16 . 56.60 |============================ Xeon Max 9480 2P, No HBM .................. 6.65 |=== Xeon Max 9480 2P, HBM Caching ............. 6.44 |=== Xeon Max 9480 2P, HBM Only ................ 5.92 |=== EPYC 9554 2P .............................. 3.97 |== EPYC 9654 2P .............................. 4.86 |== OpenVINO 2022.3 CPU Power Consumption Monitor Watts < Lower Is Better Xeon Max 9480 2P, No HBM, Max AVX512 FP16 . MIN: 268 AVG: 564 MAX: 605 Xeon Max 9480 2P, No HBM .................. MIN: 165 AVG: 538 MAX: 595 Xeon Max 9480 2P, HBM Caching ............. MIN: 163 AVG: 557 MAX: 629 Xeon Max 9480 2P, HBM Only ................ MIN: 235 AVG: 582 MAX: 661 EPYC 9554 2P .............................. MIN: 48 AVG: 648 MAX: 698 EPYC 9654 2P .............................. MIN: 57 AVG: 655 MAX: 705 OpenVINO 2022.3 Model: Weld Porosity Detection FP16-INT8 - Device: CPU FPS > Higher Is Better Xeon Max 9480 2P, No HBM, Max AVX512 FP16 . 10680.95 |======= Xeon Max 9480 2P, No HBM .................. 31482.78 |====================== Xeon Max 9480 2P, HBM Caching ............. 30938.50 |====================== Xeon Max 9480 2P, HBM Only ................ 35643.79 |========================= EPYC 9554 2P .............................. 15659.32 |=========== EPYC 9654 2P .............................. 19170.61 |============= OpenVINO 2022.3 Model: Weld Porosity Detection FP16-INT8 - Device: CPU ms < Lower Is Better Xeon Max 9480 2P, No HBM, Max AVX512 FP16 . 10.47 |============================ Xeon Max 9480 2P, No HBM .................. 3.45 |========= Xeon Max 9480 2P, HBM Caching ............. 3.47 |========= Xeon Max 9480 2P, HBM Only ................ 3.07 |======== EPYC 9554 2P .............................. 8.09 |====================== EPYC 9654 2P .............................. 9.95 |=========================== OpenVINO 2022.3 CPU Power Consumption Monitor Watts < Lower Is Better Xeon Max 9480 2P, No HBM, Max AVX512 FP16 . MIN: 168 AVG: 556 MAX: 603 Xeon Max 9480 2P, No HBM .................. MIN: 161 AVG: 541 MAX: 594 Xeon Max 9480 2P, HBM Caching ............. MIN: 137 AVG: 552 MAX: 614 Xeon Max 9480 2P, HBM Only ................ MIN: 256 AVG: 583 MAX: 675 EPYC 9554 2P .............................. MIN: 49 AVG: 623 MAX: 675 EPYC 9654 2P .............................. MIN: 59 AVG: 632 MAX: 685 ONNX Runtime 1.14 Model: GPT-2 - Device: CPU - Executor: Standard Inferences Per Second > Higher Is Better Xeon Max 9480 2P, No HBM, Max AVX512 FP16 . 157.76 |================= Xeon Max 9480 2P, No HBM .................. 155.16 |================= Xeon Max 9480 2P, HBM Caching ............. 218.69 |======================== Xeon Max 9480 2P, HBM Only ................ 246.70 |=========================== EPYC 9554 2P .............................. 132.72 |=============== EPYC 9654 2P .............................. 103.18 |=========== ONNX Runtime 1.14 Model: GPT-2 - Device: CPU - Executor: Standard Inference Time Cost (ms) < Lower Is Better Xeon Max 9480 2P, No HBM, Max AVX512 FP16 . 6.41692 |================= Xeon Max 9480 2P, No HBM .................. 6.50889 |================= Xeon Max 9480 2P, HBM Caching ............. 4.70849 |============= Xeon Max 9480 2P, HBM Only ................ 4.05237 |=========== EPYC 9554 2P .............................. 7.64735 |===================== EPYC 9654 2P .............................. 9.68904 |========================== ONNX Runtime 1.14 Model: CaffeNet 12-int8 - Device: CPU - Executor: Standard Inferences Per Second > Higher Is Better Xeon Max 9480 2P, No HBM, Max AVX512 FP16 . 543.81 |========================= Xeon Max 9480 2P, No HBM .................. 537.82 |======================== Xeon Max 9480 2P, HBM Caching ............. 562.22 |========================= Xeon Max 9480 2P, HBM Only ................ 596.91 |=========================== EPYC 9554 2P .............................. 495.24 |====================== EPYC 9654 2P .............................. 435.19 |==================== ONNX Runtime 1.14 Model: CaffeNet 12-int8 - Device: CPU - Executor: Standard Inference Time Cost (ms) < Lower Is Better Xeon Max 9480 2P, No HBM, Max AVX512 FP16 . 1.83797 |===================== Xeon Max 9480 2P, No HBM .................. 1.86415 |===================== Xeon Max 9480 2P, HBM Caching ............. 1.78296 |==================== Xeon Max 9480 2P, HBM Only ................ 1.68307 |=================== EPYC 9554 2P .............................. 2.01949 |======================= EPYC 9654 2P .............................. 2.30611 |========================== CPU Power Consumption Monitor Phoronix Test Suite System Monitoring Watts Xeon Max 9480 2P, No HBM, Max AVX512 FP16 . MIN: 167 AVG: 528 MAX: 637 Xeon Max 9480 2P, No HBM .................. MIN: 93 AVG: 523 MAX: 664 Xeon Max 9480 2P, HBM Caching ............. MIN: 87 AVG: 548 MAX: 900 Xeon Max 9480 2P, HBM Only ................ MIN: 129 AVG: 564 MAX: 1027 EPYC 9554 2P .............................. MIN: 34 AVG: 414 MAX: 711 EPYC 9654 2P .............................. MIN: 32 AVG: 449 MAX: 726 OpenVINO 2022.3 CPU Peak Freq (Highest CPU Core Frequency) Monitor Megahertz > Higher Is Better Xeon Max 9480 2P, No HBM, Max AVX512 FP16 . MIN: 3500 AVG: 3500 MAX: 3512 Xeon Max 9480 2P, No HBM .................. MIN: 1100 AVG: 1654 MAX: 3503 Xeon Max 9480 2P, HBM Caching ............. MIN: 1200 AVG: 1740 MAX: 3505 Xeon Max 9480 2P, HBM Only ................ MIN: 2000 AVG: 3493 MAX: 3508 OpenVINO 2022.3 System Power Consumption Monitor Watts < Lower Is Better Xeon Max 9480 2P, No HBM, Max AVX512 FP16 . MIN: 399 AVG: 769 MAX: 937 Xeon Max 9480 2P, No HBM .................. MIN: 274 AVG: 734 MAX: 840 Xeon Max 9480 2P, HBM Caching ............. MIN: 281 AVG: 724 MAX: 839 Xeon Max 9480 2P, HBM Only ................ MIN: 362 AVG: 757 MAX: 833 OpenVINO 2022.3 CPU Peak Freq (Highest CPU Core Frequency) Monitor Megahertz > Higher Is Better Xeon Max 9480 2P, No HBM, Max AVX512 FP16 . MIN: 2200 AVG: 3481 MAX: 3515 Xeon Max 9480 2P, No HBM .................. MIN: 1800 AVG: 3313 MAX: 3518 Xeon Max 9480 2P, HBM Caching ............. MIN: 1900 AVG: 3023 MAX: 3512 Xeon Max 9480 2P, HBM Only ................ MIN: 3500 AVG: 3500 MAX: 3517 OpenVINO 2022.3 System Power Consumption Monitor Watts < Lower Is Better Xeon Max 9480 2P, No HBM, Max AVX512 FP16 . MIN: 408 AVG: 757 MAX: 822 Xeon Max 9480 2P, No HBM .................. MIN: 295 AVG: 737 MAX: 874 Xeon Max 9480 2P, HBM Caching ............. MIN: 298 AVG: 736 MAX: 817 Xeon Max 9480 2P, HBM Only ................ MIN: 360 AVG: 745 MAX: 835 OpenVINO 2022.3 CPU Peak Freq (Highest CPU Core Frequency) Monitor Megahertz > Higher Is Better Xeon Max 9480 2P, No HBM, Max AVX512 FP16 . MIN: 3500 AVG: 3500 MAX: 3511 Xeon Max 9480 2P, No HBM .................. MIN: 2087 AVG: 3396 MAX: 3518 Xeon Max 9480 2P, HBM Caching ............. MIN: 1900 AVG: 3074 MAX: 3506 Xeon Max 9480 2P, HBM Only ................ MIN: 2646 AVG: 3496 MAX: 3508 OpenVINO 2022.3 System Power Consumption Monitor Watts < Lower Is Better Xeon Max 9480 2P, No HBM, Max AVX512 FP16 . MIN: 413 AVG: 768 MAX: 860 Xeon Max 9480 2P, No HBM .................. MIN: 378 AVG: 758 MAX: 872 Xeon Max 9480 2P, HBM Caching ............. MIN: 369 AVG: 748 MAX: 857 Xeon Max 9480 2P, HBM Only ................ MIN: 373 AVG: 752 MAX: 832 OpenVINO 2022.3 CPU Peak Freq (Highest CPU Core Frequency) Monitor Megahertz > Higher Is Better Xeon Max 9480 2P, No HBM, Max AVX512 FP16 . MIN: 1800 AVG: 2492 MAX: 3510 Xeon Max 9480 2P, No HBM .................. MIN: 1500 AVG: 2195 MAX: 3515 Xeon Max 9480 2P, HBM Caching ............. MIN: 1700 AVG: 2370 MAX: 3505 Xeon Max 9480 2P, HBM Only ................ MIN: 1900 AVG: 3359 MAX: 3505 OpenVINO 2022.3 System Power Consumption Monitor Watts < Lower Is Better Xeon Max 9480 2P, No HBM, Max AVX512 FP16 . MIN: 307 AVG: 762 MAX: 847 Xeon Max 9480 2P, No HBM .................. MIN: 256 AVG: 717 MAX: 841 Xeon Max 9480 2P, HBM Caching ............. MIN: 270 AVG: 722 MAX: 818 Xeon Max 9480 2P, HBM Only ................ MIN: 365 AVG: 742 MAX: 888 OpenVINO 2022.3 CPU Peak Freq (Highest CPU Core Frequency) Monitor Megahertz > Higher Is Better Xeon Max 9480 2P, No HBM, Max AVX512 FP16 . MIN: 3500 AVG: 3500 MAX: 3509 Xeon Max 9480 2P, No HBM .................. MIN: 1600 AVG: 1846 MAX: 3500 Xeon Max 9480 2P, HBM Caching ............. MIN: 1700 AVG: 1900 MAX: 3500 Xeon Max 9480 2P, HBM Only ................ MIN: 1900 AVG: 2618 MAX: 3506 OpenVINO 2022.3 System Power Consumption Monitor Watts < Lower Is Better Xeon Max 9480 2P, No HBM, Max AVX512 FP16 . MIN: 420 AVG: 774 MAX: 811 Xeon Max 9480 2P, No HBM .................. MIN: 268 AVG: 759 MAX: 840 Xeon Max 9480 2P, HBM Caching ............. MIN: 279 AVG: 756 MAX: 840 Xeon Max 9480 2P, HBM Only ................ MIN: 342 AVG: 768 MAX: 875 OpenVINO 2022.3 CPU Peak Freq (Highest CPU Core Frequency) Monitor Megahertz > Higher Is Better Xeon Max 9480 2P, No HBM, Max AVX512 FP16 . MIN: 1800 AVG: 2023 MAX: 3500 Xeon Max 9480 2P, No HBM .................. MIN: 1600 AVG: 1934 MAX: 3502 Xeon Max 9480 2P, HBM Caching ............. MIN: 1500 AVG: 1902 MAX: 3504 Xeon Max 9480 2P, HBM Only ................ MIN: 1800 AVG: 2932 MAX: 3508 OpenVINO 2022.3 System Power Consumption Monitor Watts < Lower Is Better Xeon Max 9480 2P, No HBM, Max AVX512 FP16 . MIN: 276 AVG: 765 MAX: 811 Xeon Max 9480 2P, No HBM .................. MIN: 284 AVG: 753 MAX: 808 Xeon Max 9480 2P, HBM Caching ............. MIN: 275 AVG: 752 MAX: 830 Xeon Max 9480 2P, HBM Only ................ MIN: 370 AVG: 768 MAX: 854 CPU Peak Freq (Highest CPU Core Frequency) Monitor Phoronix Test Suite System Monitoring Megahertz Xeon Max 9480 2P, No HBM, Max AVX512 FP16 . MIN: 1800 AVG: 3337 MAX: 3518 Xeon Max 9480 2P, No HBM .................. MIN: 1000 AVG: 3057 MAX: 3576 Xeon Max 9480 2P, HBM Caching ............. MIN: 1100 AVG: 3208 MAX: 3577 Xeon Max 9480 2P, HBM Only ................ MIN: 1566 AVG: 3309 MAX: 3551 System Power Consumption Monitor Phoronix Test Suite System Monitoring Watts Xeon Max 9480 2P, No HBM, Max AVX512 FP16 . MIN: 276 AVG: 733 MAX: 937 Xeon Max 9480 2P, No HBM .................. MIN: 251 AVG: 736 MAX: 904 Xeon Max 9480 2P, HBM Caching ............. MIN: 260 AVG: 752 MAX: 907 Xeon Max 9480 2P, HBM Only ................ MIN: 250 AVG: 752 MAX: 929 ONNX Runtime 1.14 CPU Peak Freq (Highest CPU Core Frequency) Monitor Megahertz > Higher Is Better Xeon Max 9480 2P, No HBM, Max AVX512 FP16 . MIN: 3500 AVG: 3501 MAX: 3518 ONNX Runtime 1.14 System Power Consumption Monitor Watts < Lower Is Better Xeon Max 9480 2P, No HBM, Max AVX512 FP16 . MIN: 386 AVG: 718 MAX: 749 ONNX Runtime 1.14 CPU Peak Freq (Highest CPU Core Frequency) Monitor Megahertz > Higher Is Better Xeon Max 9480 2P, No HBM, Max AVX512 FP16 . MIN: 3500 AVG: 3500 MAX: 3500 ONNX Runtime 1.14 System Power Consumption Monitor Watts < Lower Is Better Xeon Max 9480 2P, No HBM, Max AVX512 FP16 . MIN: 416 AVG: 765 MAX: 857