Xeon Max AMX HBM2e Benchmarks for a future article on Phoronix. EPYC 9654 2P: Processor: 2 x AMD EPYC 9654 96-Core @ 2.40GHz (192 Cores / 384 Threads), Motherboard: AMD Titanite_4G (RTI1007B BIOS), Chipset: AMD Device 14a4, Memory: 1520GB, Disk: 7682GB INTEL SSDPF2KX076TZ, Graphics: ASPEED, Monitor: VGA HDMI, Network: Broadcom NetXtreme BCM5720 PCIe OS: Ubuntu 23.04, Kernel: 6.2.0-20-generic (x86_64), Desktop: GNOME Shell 44.0, Display Server: X Server 1.21.1.7, Compiler: GCC 12.2.0, File-System: ext4, Screen Resolution: 1920x1080 EPYC 9554 2P: Processor: 2 x AMD EPYC 9554 64-Core @ 3.10GHz (128 Cores / 256 Threads), Motherboard: AMD Titanite_4G (RTI1007B BIOS), Chipset: AMD Device 14a4, Memory: 1520GB, Disk: 7682GB INTEL SSDPF2KX076TZ, Graphics: ASPEED, Monitor: VGA HDMI, Network: Broadcom NetXtreme BCM5720 PCIe OS: Ubuntu 23.04, Kernel: 6.2.0-20-generic (x86_64), Desktop: GNOME Shell 44.0, Display Server: X Server 1.21.1.7, Compiler: GCC 12.2.0, File-System: ext4, Screen Resolution: 1920x1080 Xeon Max 9480 2P, HBM Caching: Processor: 2 x Intel Xeon Max 9480 @ 3.50GHz (112 Cores / 224 Threads), Motherboard: Supermicro X13DEM v1.10 (1.3 BIOS), Chipset: Intel Device 1bce, Memory: 512GB, Disk: 7682GB INTEL SSDPF2KX076TZ, Graphics: ASPEED, Monitor: VE228, Network: 2 x Broadcom BCM57508 NetXtreme-E 10Gb/25Gb/40Gb/50Gb/100Gb/200Gb OS: Ubuntu 23.04, Kernel: 6.2.0-20-generic (x86_64), Desktop: GNOME Shell 44.0, Display Server: X Server 1.21.1.7, Compiler: GCC 12.2.0, File-System: ext4, Screen Resolution: 1920x1080 oneDNN 3.1 Harness: Deconvolution Batch shapes_3d - Data Type: bf16bf16bf16 - Engine: CPU ms < Lower Is Better EPYC 9654 2P .................. 0.732100 |======== EPYC 9554 2P .................. 0.457272 |===== Xeon Max 9480 2P, HBM Caching . 3.535250 |===================================== OpenVINO 2022.3 Model: Vehicle Detection FP16-INT8 - Device: CPU ms < Lower Is Better EPYC 9654 2P .................. 4.36 |========= EPYC 9554 2P .................. 3.54 |======= Xeon Max 9480 2P, HBM Caching . 20.23 |======================================== oneDNN 3.1 Harness: IP Shapes 3D - Data Type: bf16bf16bf16 - Engine: CPU ms < Lower Is Better EPYC 9654 2P .................. 3.80209 |== EPYC 9554 2P .................. 2.20596 |= Xeon Max 9480 2P, HBM Caching . 91.98140 |===================================== OpenVINO 2022.3 Model: Person Vehicle Bike Detection FP16 - Device: CPU ms < Lower Is Better EPYC 9654 2P .................. 5.25 |============ EPYC 9554 2P .................. 4.29 |========== Xeon Max 9480 2P, HBM Caching . 17.83 |======================================== TensorFlow 2.12 Device: CPU - Batch Size: 512 - Model: VGG-16 images/sec > Higher Is Better EPYC 9654 2P .................. 120.62 |======================================= EPYC 9554 2P .................. 109.89 |==================================== Xeon Max 9480 2P, HBM Caching . 30.19 |========== OpenVINO 2022.3 Model: Vehicle Detection FP16 - Device: CPU FPS > Higher Is Better EPYC 9654 2P .................. 7390.97 |====================================== EPYC 9554 2P .................. 5981.57 |=============================== Xeon Max 9480 2P, HBM Caching . 2315.12 |============ oneDNN 3.1 Harness: Recurrent Neural Network Inference - Data Type: bf16bf16bf16 - Engine: CPU ms < Lower Is Better EPYC 9654 2P .................. 2790.90 |====================================== EPYC 9554 2P .................. 925.77 |============= Xeon Max 9480 2P, HBM Caching . 1325.45 |================== OpenVINO 2022.3 Model: Weld Porosity Detection FP16-INT8 - Device: CPU ms < Lower Is Better EPYC 9654 2P .................. 9.95 |========================================= EPYC 9554 2P .................. 8.09 |================================= Xeon Max 9480 2P, HBM Caching . 3.47 |============== TensorFlow 2.12 Device: CPU - Batch Size: 512 - Model: AlexNet images/sec > Higher Is Better EPYC 9654 2P .................. 1757.16 |===================================== EPYC 9554 2P .................. 1813.68 |====================================== Xeon Max 9480 2P, HBM Caching . 718.54 |=============== TensorFlow 2.12 Device: CPU - Batch Size: 512 - Model: GoogLeNet images/sec > Higher Is Better EPYC 9654 2P .................. 535.52 |=================================== EPYC 9554 2P .................. 593.20 |======================================= Xeon Max 9480 2P, HBM Caching . 236.44 |================ TensorFlow 2.12 Device: CPU - Batch Size: 512 - Model: ResNet-50 images/sec > Higher Is Better EPYC 9654 2P .................. 171.56 |==================================== EPYC 9554 2P .................. 188.17 |======================================= Xeon Max 9480 2P, HBM Caching . 76.93 |================ libxsmm 2-1.17-3645 M N K: 128 GFLOPS/s > Higher Is Better EPYC 9654 2P .................. 3426.1 |================================ EPYC 9554 2P .................. 4112.9 |======================================= Xeon Max 9480 2P, HBM Caching . 1814.3 |================= OpenVINO 2022.3 Model: Vehicle Detection FP16 - Device: CPU ms < Lower Is Better EPYC 9654 2P .................. 6.49 |====================== EPYC 9554 2P .................. 5.34 |================== Xeon Max 9480 2P, HBM Caching . 12.07 |======================================== OpenVINO 2022.3 Model: Face Detection FP16-INT8 - Device: CPU FPS > Higher Is Better EPYC 9654 2P .................. 191.41 |====================== EPYC 9554 2P .................. 155.28 |================== Xeon Max 9480 2P, HBM Caching . 334.89 |======================================= OpenVINO 2022.3 Model: Weld Porosity Detection FP16 - Device: CPU FPS > Higher Is Better EPYC 9654 2P .................. 9843.03 |===================== EPYC 9554 2P .................. 8039.57 |================== Xeon Max 9480 2P, HBM Caching . 16941.99 |===================================== OpenVINO 2022.3 Model: Face Detection FP16 - Device: CPU ms < Lower Is Better EPYC 9654 2P .................. 471.82 |======================================= EPYC 9554 2P .................. 389.53 |================================ Xeon Max 9480 2P, HBM Caching . 232.01 |=================== oneDNN 3.1 Harness: Convolution Batch Shapes Auto - Data Type: bf16bf16bf16 - Engine: CPU ms < Lower Is Better EPYC 9654 2P .................. 0.461053 |===== EPYC 9554 2P .................. 0.311378 |=== Xeon Max 9480 2P, HBM Caching . 3.673560 |===================================== OpenVINO 2022.3 Model: Vehicle Detection FP16-INT8 - Device: CPU FPS > Higher Is Better EPYC 9654 2P .................. 10985.17 |===================================== EPYC 9554 2P .................. 9010.45 |============================== Xeon Max 9480 2P, HBM Caching . 5528.03 |=================== OpenVINO 2022.3 Model: Weld Porosity Detection FP16-INT8 - Device: CPU FPS > Higher Is Better EPYC 9654 2P .................. 19170.61 |======================= EPYC 9554 2P .................. 15659.32 |=================== Xeon Max 9480 2P, HBM Caching . 30938.50 |===================================== OpenVINO 2022.3 Model: Weld Porosity Detection FP16 - Device: CPU ms < Lower Is Better EPYC 9654 2P .................. 4.86 |=============================== EPYC 9554 2P .................. 3.97 |========================= Xeon Max 9480 2P, HBM Caching . 6.44 |========================================= OpenVINO 2022.3 Model: Face Detection FP16-INT8 - Device: CPU ms < Lower Is Better EPYC 9654 2P .................. 250.39 |============================= EPYC 9554 2P .................. 205.71 |======================== Xeon Max 9480 2P, HBM Caching . 333.51 |======================================= OpenVINO 2022.3 Model: Machine Translation EN To DE FP16 - Device: CPU FPS > Higher Is Better EPYC 9654 2P .................. 950.94 |======================================= EPYC 9554 2P .................. 786.01 |================================ Xeon Max 9480 2P, HBM Caching . 590.92 |======================== TensorFlow 2.12 Device: CPU - Batch Size: 16 - Model: ResNet-50 images/sec > Higher Is Better EPYC 9654 2P .................. 25.25 |========================= EPYC 9554 2P .................. 33.40 |================================= Xeon Max 9480 2P, HBM Caching . 40.15 |======================================== OpenVINO 2022.3 Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU FPS > Higher Is Better EPYC 9654 2P .................. 146867.48 |================================= EPYC 9554 2P .................. 162207.97 |==================================== Xeon Max 9480 2P, HBM Caching . 108515.12 |======================== OpenVINO 2022.3 Model: Face Detection FP16 - Device: CPU FPS > Higher Is Better EPYC 9654 2P .................. 101.56 |================================= EPYC 9554 2P .................. 82.04 |=========================== Xeon Max 9480 2P, HBM Caching . 120.40 |======================================= OpenVINO 2022.3 Model: Person Vehicle Bike Detection FP16 - Device: CPU FPS > Higher Is Better EPYC 9654 2P .................. 9133.22 |====================================== EPYC 9554 2P .................. 7447.60 |=============================== Xeon Max 9480 2P, HBM Caching . 6265.77 |========================== OpenVINO 2022.3 Model: Person Detection FP32 - Device: CPU ms < Lower Is Better EPYC 9654 2P .................. 1098.96 |====================================== EPYC 9554 2P .................. 825.52 |============================= Xeon Max 9480 2P, HBM Caching . 819.76 |============================ OpenVINO 2022.3 Model: Person Detection FP16 - Device: CPU ms < Lower Is Better EPYC 9654 2P .................. 1092.97 |====================================== EPYC 9554 2P .................. 832.02 |============================= Xeon Max 9480 2P, HBM Caching . 834.97 |============================= OpenVINO 2022.3 Model: Person Detection FP16 - Device: CPU FPS > Higher Is Better EPYC 9654 2P .................. 43.64 |======================================== EPYC 9554 2P .................. 38.24 |=================================== Xeon Max 9480 2P, HBM Caching . 33.40 |=============================== OpenVINO 2022.3 Model: Person Detection FP32 - Device: CPU FPS > Higher Is Better EPYC 9654 2P .................. 43.40 |======================================== EPYC 9554 2P .................. 38.53 |==================================== Xeon Max 9480 2P, HBM Caching . 33.97 |=============================== OpenVINO 2022.3 Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU ms < Lower Is Better EPYC 9654 2P .................. 0.55 |========================================= EPYC 9554 2P .................. 0.52 |======================================= Xeon Max 9480 2P, HBM Caching . 0.44 |================================= ONNX Runtime 1.14 Model: ArcFace ResNet-100 - Device: CPU - Executor: Standard Inferences Per Second > Higher Is Better EPYC 9654 2P .................. 19.31 |================================ EPYC 9554 2P .................. 24.01 |======================================== Xeon Max 9480 2P, HBM Caching . 23.77 |======================================== OpenVINO 2022.3 Model: Machine Translation EN To DE FP16 - Device: CPU ms < Lower Is Better EPYC 9654 2P .................. 50.42 |======================================== EPYC 9554 2P .................. 40.67 |================================ Xeon Max 9480 2P, HBM Caching . 47.29 |====================================== libxsmm 2-1.17-3645 M N K: 64 GFLOPS/s > Higher Is Better EPYC 9654 2P . 2270.2 |=============================================== EPYC 9554 2P . 2692.7 |======================================================== libxsmm 2-1.17-3645 M N K: 32 GFLOPS/s > Higher Is Better EPYC 9654 2P . 1298.0 |==================================================== EPYC 9554 2P . 1402.2 |======================================================== libxsmm 2-1.17-3645 M N K: 256 GFLOPS/s > Higher Is Better EPYC 9654 2P . 4379.6 |===================================================== EPYC 9554 2P . 4603.3 |======================================================== System Power Consumption Monitor Phoronix Test Suite System Monitoring Watts Xeon Max 9480 2P, HBM Caching . MIN: 260 AVG: 752 MAX: 907 CPU Peak Freq (Highest CPU Core Frequency) Monitor Phoronix Test Suite System Monitoring Megahertz Xeon Max 9480 2P, HBM Caching . MIN: 1100 AVG: 3208 MAX: 3577 ONNX Runtime 1.14 System Power Consumption Monitor Watts < Lower Is Better Xeon Max 9480 2P, HBM Caching . MIN: 410 AVG: 784 MAX: 830 ONNX Runtime 1.14 CPU Peak Freq (Highest CPU Core Frequency) Monitor Megahertz > Higher Is Better Xeon Max 9480 2P, HBM Caching . MIN: 2006 AVG: 3497 MAX: 3509 ONNX Runtime 1.14 System Power Consumption Monitor Watts < Lower Is Better Xeon Max 9480 2P, HBM Caching . MIN: 405 AVG: 784 MAX: 821 ONNX Runtime 1.14 CPU Peak Freq (Highest CPU Core Frequency) Monitor Megahertz > Higher Is Better Xeon Max 9480 2P, HBM Caching . MIN: 3500 AVG: 3500 MAX: 3508 ONNX Runtime 1.14 System Power Consumption Monitor Watts < Lower Is Better Xeon Max 9480 2P, HBM Caching . MIN: 400 AVG: 778 MAX: 853 ONNX Runtime 1.14 CPU Peak Freq (Highest CPU Core Frequency) Monitor Megahertz > Higher Is Better Xeon Max 9480 2P, HBM Caching . MIN: 1900 AVG: 3483 MAX: 3511 ONNX Runtime 1.14 System Power Consumption Monitor Watts < Lower Is Better Xeon Max 9480 2P, HBM Caching . MIN: 410 AVG: 785 MAX: 844 ONNX Runtime 1.14 CPU Peak Freq (Highest CPU Core Frequency) Monitor Megahertz > Higher Is Better Xeon Max 9480 2P, HBM Caching . MIN: 3500 AVG: 3500 MAX: 3507 ONNX Runtime 1.14 System Power Consumption Monitor Watts < Lower Is Better Xeon Max 9480 2P, HBM Caching . MIN: 399 AVG: 783 MAX: 828 ONNX Runtime 1.14 CPU Peak Freq (Highest CPU Core Frequency) Monitor Megahertz > Higher Is Better Xeon Max 9480 2P, HBM Caching . MIN: 3111 AVG: 3500 MAX: 3508 ONNX Runtime 1.14 System Power Consumption Monitor Watts < Lower Is Better Xeon Max 9480 2P, HBM Caching . MIN: 390 AVG: 783 MAX: 827 ONNX Runtime 1.14 CPU Peak Freq (Highest CPU Core Frequency) Monitor Megahertz > Higher Is Better Xeon Max 9480 2P, HBM Caching . MIN: 3500 AVG: 3500 MAX: 3507 ONNX Runtime 1.14 System Power Consumption Monitor Watts < Lower Is Better Xeon Max 9480 2P, HBM Caching . MIN: 281 AVG: 720 MAX: 770 ONNX Runtime 1.14 CPU Peak Freq (Highest CPU Core Frequency) Monitor Megahertz > Higher Is Better Xeon Max 9480 2P, HBM Caching . MIN: 3500 AVG: 3501 MAX: 3517 OpenVINO 2022.3 System Power Consumption Monitor Watts < Lower Is Better Xeon Max 9480 2P, HBM Caching . MIN: 268 AVG: 742 MAX: 856 OpenVINO 2022.3 CPU Peak Freq (Highest CPU Core Frequency) Monitor Megahertz > Higher Is Better Xeon Max 9480 2P, HBM Caching . MIN: 1100 AVG: 2099 MAX: 3500 OpenVINO 2022.3 System Power Consumption Monitor Watts < Lower Is Better Xeon Max 9480 2P, HBM Caching . MIN: 392 AVG: 772 MAX: 837 OpenVINO 2022.3 CPU Peak Freq (Highest CPU Core Frequency) Monitor Megahertz > Higher Is Better Xeon Max 9480 2P, HBM Caching . MIN: 1900 AVG: 3426 MAX: 3501 OpenVINO 2022.3 System Power Consumption Monitor Watts < Lower Is Better Xeon Max 9480 2P, HBM Caching . MIN: 284 AVG: 724 MAX: 867 OpenVINO 2022.3 CPU Peak Freq (Highest CPU Core Frequency) Monitor Megahertz > Higher Is Better Xeon Max 9480 2P, HBM Caching . MIN: 1600 AVG: 2125 MAX: 3502 OpenVINO 2022.3 System Power Consumption Monitor Watts < Lower Is Better Xeon Max 9480 2P, HBM Caching . MIN: 275 AVG: 752 MAX: 830 OpenVINO 2022.3 CPU Peak Freq (Highest CPU Core Frequency) Monitor Megahertz > Higher Is Better Xeon Max 9480 2P, HBM Caching . MIN: 1500 AVG: 1902 MAX: 3504 OpenVINO 2022.3 System Power Consumption Monitor Watts < Lower Is Better Xeon Max 9480 2P, HBM Caching . MIN: 274 AVG: 752 MAX: 852 OpenVINO 2022.3 CPU Peak Freq (Highest CPU Core Frequency) Monitor Megahertz > Higher Is Better Xeon Max 9480 2P, HBM Caching . MIN: 1700 AVG: 2089 MAX: 3501 OpenVINO 2022.3 System Power Consumption Monitor Watts < Lower Is Better Xeon Max 9480 2P, HBM Caching . MIN: 279 AVG: 756 MAX: 840 OpenVINO 2022.3 CPU Peak Freq (Highest CPU Core Frequency) Monitor Megahertz > Higher Is Better Xeon Max 9480 2P, HBM Caching . MIN: 1700 AVG: 1900 MAX: 3500 OpenVINO 2022.3 System Power Consumption Monitor Watts < Lower Is Better Xeon Max 9480 2P, HBM Caching . MIN: 262 AVG: 755 MAX: 817 OpenVINO 2022.3 CPU Peak Freq (Highest CPU Core Frequency) Monitor Megahertz > Higher Is Better Xeon Max 9480 2P, HBM Caching . MIN: 1300 AVG: 1685 MAX: 3500 OpenVINO 2022.3 System Power Consumption Monitor Watts < Lower Is Better Xeon Max 9480 2P, HBM Caching . MIN: 270 AVG: 722 MAX: 818 OpenVINO 2022.3 CPU Peak Freq (Highest CPU Core Frequency) Monitor Megahertz > Higher Is Better Xeon Max 9480 2P, HBM Caching . MIN: 1700 AVG: 2370 MAX: 3505 OpenVINO 2022.3 System Power Consumption Monitor Watts < Lower Is Better Xeon Max 9480 2P, HBM Caching . MIN: 272 AVG: 742 MAX: 868 OpenVINO 2022.3 CPU Peak Freq (Highest CPU Core Frequency) Monitor Megahertz > Higher Is Better Xeon Max 9480 2P, HBM Caching . MIN: 1300 AVG: 1738 MAX: 3501 OpenVINO 2022.3 System Power Consumption Monitor Watts < Lower Is Better Xeon Max 9480 2P, HBM Caching . MIN: 369 AVG: 748 MAX: 857 OpenVINO 2022.3 CPU Peak Freq (Highest CPU Core Frequency) Monitor Megahertz > Higher Is Better Xeon Max 9480 2P, HBM Caching . MIN: 1900 AVG: 3074 MAX: 3506 OpenVINO 2022.3 System Power Consumption Monitor Watts < Lower Is Better Xeon Max 9480 2P, HBM Caching . MIN: 298 AVG: 736 MAX: 817 OpenVINO 2022.3 CPU Peak Freq (Highest CPU Core Frequency) Monitor Megahertz > Higher Is Better Xeon Max 9480 2P, HBM Caching . MIN: 1900 AVG: 3023 MAX: 3512 OpenVINO 2022.3 System Power Consumption Monitor Watts < Lower Is Better Xeon Max 9480 2P, HBM Caching . MIN: 281 AVG: 724 MAX: 839 OpenVINO 2022.3 CPU Peak Freq (Highest CPU Core Frequency) Monitor Megahertz > Higher Is Better Xeon Max 9480 2P, HBM Caching . MIN: 1200 AVG: 1740 MAX: 3505 TensorFlow 2.12 System Power Consumption Monitor Watts < Lower Is Better Xeon Max 9480 2P, HBM Caching . MIN: 401 AVG: 776 MAX: 850 TensorFlow 2.12 CPU Peak Freq (Highest CPU Core Frequency) Monitor Megahertz > Higher Is Better Xeon Max 9480 2P, HBM Caching . MIN: 1900 AVG: 3482 MAX: 3577 TensorFlow 2.12 System Power Consumption Monitor Watts < Lower Is Better Xeon Max 9480 2P, HBM Caching . MIN: 425 AVG: 771 MAX: 850 TensorFlow 2.12 CPU Peak Freq (Highest CPU Core Frequency) Monitor Megahertz > Higher Is Better Xeon Max 9480 2P, HBM Caching . MIN: 1958 AVG: 3336 MAX: 3515 TensorFlow 2.12 System Power Consumption Monitor Watts < Lower Is Better Xeon Max 9480 2P, HBM Caching . MIN: 415 AVG: 733 MAX: 808 TensorFlow 2.12 CPU Peak Freq (Highest CPU Core Frequency) Monitor Megahertz > Higher Is Better Xeon Max 9480 2P, HBM Caching . MIN: 3500 AVG: 3500 MAX: 3510 TensorFlow 2.12 System Power Consumption Monitor Watts < Lower Is Better Xeon Max 9480 2P, HBM Caching . MIN: 405 AVG: 693 MAX: 801 TensorFlow 2.12 CPU Peak Freq (Highest CPU Core Frequency) Monitor Megahertz > Higher Is Better Xeon Max 9480 2P, HBM Caching . MIN: 2666 AVG: 3489 MAX: 3505 TensorFlow 2.12 System Power Consumption Monitor Watts < Lower Is Better Xeon Max 9480 2P, HBM Caching . MIN: 307 AVG: 752 MAX: 824 TensorFlow 2.12 CPU Peak Freq (Highest CPU Core Frequency) Monitor Megahertz > Higher Is Better Xeon Max 9480 2P, HBM Caching . MIN: 2600 AVG: 3474 MAX: 3512 TensorFlow 2.12 System Power Consumption Monitor Watts < Lower Is Better Xeon Max 9480 2P, HBM Caching . MIN: 275 AVG: 740 MAX: 907 TensorFlow 2.12 CPU Peak Freq (Highest CPU Core Frequency) Monitor Megahertz > Higher Is Better Xeon Max 9480 2P, HBM Caching . MIN: 1671 AVG: 3335 MAX: 3571 TensorFlow 2.12 System Power Consumption Monitor Watts < Lower Is Better Xeon Max 9480 2P, HBM Caching . MIN: 408 AVG: 636 MAX: 785 TensorFlow 2.12 CPU Peak Freq (Highest CPU Core Frequency) Monitor Megahertz > Higher Is Better Xeon Max 9480 2P, HBM Caching . MIN: 2600 AVG: 3306 MAX: 3511 TensorFlow 2.12 System Power Consumption Monitor Watts < Lower Is Better Xeon Max 9480 2P, HBM Caching . MIN: 410 AVG: 756 MAX: 822 TensorFlow 2.12 CPU Peak Freq (Highest CPU Core Frequency) Monitor Megahertz > Higher Is Better Xeon Max 9480 2P, HBM Caching . MIN: 2600 AVG: 3476 MAX: 3555 oneDNN 3.1 System Power Consumption Monitor Watts < Lower Is Better Xeon Max 9480 2P, HBM Caching . MIN: 402 AVG: 767 MAX: 901 oneDNN 3.1 CPU Peak Freq (Highest CPU Core Frequency) Monitor Megahertz > Higher Is Better Xeon Max 9480 2P, HBM Caching . MIN: 2300 AVG: 2702 MAX: 3507 oneDNN 3.1 System Power Consumption Monitor Watts < Lower Is Better Xeon Max 9480 2P, HBM Caching . MIN: 410 AVG: 782 MAX: 889 oneDNN 3.1 CPU Peak Freq (Highest CPU Core Frequency) Monitor Megahertz > Higher Is Better Xeon Max 9480 2P, HBM Caching . MIN: 1951 AVG: 2982 MAX: 3514 oneDNN 3.1 System Power Consumption Monitor Watts < Lower Is Better Xeon Max 9480 2P, HBM Caching . MIN: 404 AVG: 592 MAX: 897 oneDNN 3.1 CPU Peak Freq (Highest CPU Core Frequency) Monitor Megahertz > Higher Is Better Xeon Max 9480 2P, HBM Caching . MIN: 1900 AVG: 3107 MAX: 3507 oneDNN 3.1 System Power Consumption Monitor Watts < Lower Is Better Xeon Max 9480 2P, HBM Caching . MIN: 404 AVG: 727 MAX: 850 oneDNN 3.1 CPU Peak Freq (Highest CPU Core Frequency) Monitor Megahertz > Higher Is Better Xeon Max 9480 2P, HBM Caching . MIN: 2166 AVG: 2651 MAX: 3508 oneDNN 3.1 System Power Consumption Monitor Watts < Lower Is Better Xeon Max 9480 2P, HBM Caching . MIN: 400 AVG: 642 MAX: 881 oneDNN 3.1 CPU Peak Freq (Highest CPU Core Frequency) Monitor Megahertz > Higher Is Better Xeon Max 9480 2P, HBM Caching . MIN: 2096 AVG: 2951 MAX: 3506 oneDNN 3.1 System Power Consumption Monitor Watts < Lower Is Better Xeon Max 9480 2P, HBM Caching . MIN: 400 AVG: 678 MAX: 830 oneDNN 3.1 CPU Peak Freq (Highest CPU Core Frequency) Monitor Megahertz > Higher Is Better Xeon Max 9480 2P, HBM Caching . MIN: 2600 AVG: 3087 MAX: 3508 oneDNN 3.1 System Power Consumption Monitor Watts < Lower Is Better Xeon Max 9480 2P, HBM Caching . MIN: 385 AVG: 721 MAX: 838 oneDNN 3.1 CPU Peak Freq (Highest CPU Core Frequency) Monitor Megahertz > Higher Is Better Xeon Max 9480 2P, HBM Caching . MIN: 2600 AVG: 2797 MAX: 3507 libxsmm 2-1.17-3645 System Power Consumption Monitor Watts < Lower Is Better Xeon Max 9480 2P, HBM Caching . MIN: 395 AVG: 776 MAX: 832 libxsmm 2-1.17-3645 CPU Peak Freq (Highest CPU Core Frequency) Monitor Megahertz > Higher Is Better Xeon Max 9480 2P, HBM Caching . MIN: 1122 AVG: 3487 MAX: 3507 CPU Power Consumption Monitor Phoronix Test Suite System Monitoring Watts EPYC 9654 2P .................. MIN: 32 AVG: 449 MAX: 726 EPYC 9554 2P .................. MIN: 34 AVG: 414 MAX: 711 Xeon Max 9480 2P, HBM Caching . MIN: 87 AVG: 548 MAX: 900 ONNX Runtime 1.14 CPU Power Consumption Monitor Watts < Lower Is Better EPYC 9654 2P .................. MIN: 32 AVG: 465 MAX: 490 EPYC 9554 2P .................. MIN: 48 AVG: 369 MAX: 387 Xeon Max 9480 2P, HBM Caching . MIN: 271 AVG: 569 MAX: 613 ONNX Runtime 1.14 Model: ResNet50 v1-12-int8 - Device: CPU - Executor: Standard Inference Time Cost (ms) < Lower Is Better EPYC 9654 2P .................. 6.87053 |================================= EPYC 9554 2P .................. 6.55989 |=============================== Xeon Max 9480 2P, HBM Caching . 8.02166 |====================================== ONNX Runtime 1.14 Model: ResNet50 v1-12-int8 - Device: CPU - Executor: Standard Inferences Per Second > Higher Is Better EPYC 9654 2P .................. 146.56 |===================================== EPYC 9554 2P .................. 152.44 |======================================= Xeon Max 9480 2P, HBM Caching . 125.28 |================================ ONNX Runtime 1.14 CPU Power Consumption Monitor Watts < Lower Is Better EPYC 9654 2P .................. MIN: 58 AVG: 465 MAX: 494 EPYC 9554 2P .................. MIN: 47 AVG: 374 MAX: 394 Xeon Max 9480 2P, HBM Caching . MIN: 261 AVG: 570 MAX: 613 ONNX Runtime 1.14 Model: ArcFace ResNet-100 - Device: CPU - Executor: Standard Inference Time Cost (ms) < Lower Is Better EPYC 9654 2P .................. 51.79 |======================================== EPYC 9554 2P .................. 41.64 |================================ Xeon Max 9480 2P, HBM Caching . 42.18 |================================= ONNX Runtime 1.14 CPU Power Consumption Monitor Watts < Lower Is Better EPYC 9654 2P .................. MIN: 57 AVG: 514 MAX: 546 EPYC 9554 2P .................. MIN: 47 AVG: 420 MAX: 447 Xeon Max 9480 2P, HBM Caching . MIN: 244 AVG: 569 MAX: 665 ONNX Runtime 1.14 Model: fcn-resnet101-11 - Device: CPU - Executor: Standard Inference Time Cost (ms) < Lower Is Better EPYC 9654 2P .................. 212.86 |======================================= EPYC 9554 2P .................. 214.61 |======================================= Xeon Max 9480 2P, HBM Caching . 191.62 |=================================== ONNX Runtime 1.14 Model: fcn-resnet101-11 - Device: CPU - Executor: Standard Inferences Per Second > Higher Is Better EPYC 9654 2P .................. 4.69797 |================================= EPYC 9554 2P .................. 4.65982 |================================= Xeon Max 9480 2P, HBM Caching . 5.33514 |====================================== ONNX Runtime 1.14 CPU Power Consumption Monitor Watts < Lower Is Better EPYC 9654 2P .................. MIN: 57 AVG: 454 MAX: 478 EPYC 9554 2P .................. MIN: 47 AVG: 358 MAX: 375 Xeon Max 9480 2P, HBM Caching . MIN: 262 AVG: 574 MAX: 607 ONNX Runtime 1.14 Model: CaffeNet 12-int8 - Device: CPU - Executor: Standard Inference Time Cost (ms) < Lower Is Better EPYC 9654 2P .................. 2.30611 |====================================== EPYC 9554 2P .................. 2.01949 |================================= Xeon Max 9480 2P, HBM Caching . 1.78296 |============================= ONNX Runtime 1.14 Model: CaffeNet 12-int8 - Device: CPU - Executor: Standard Inferences Per Second > Higher Is Better EPYC 9654 2P .................. 435.19 |============================== EPYC 9554 2P .................. 495.24 |================================== Xeon Max 9480 2P, HBM Caching . 562.22 |======================================= ONNX Runtime 1.14 CPU Power Consumption Monitor Watts < Lower Is Better EPYC 9654 2P .................. MIN: 57 AVG: 395 MAX: 418 EPYC 9554 2P .................. MIN: 48 AVG: 369 MAX: 388 Xeon Max 9480 2P, HBM Caching . MIN: 264 AVG: 573 MAX: 616 ONNX Runtime 1.14 Model: bertsquad-12 - Device: CPU - Executor: Standard Inference Time Cost (ms) < Lower Is Better EPYC 9654 2P .................. 99.00 |======================================== EPYC 9554 2P .................. 85.90 |=================================== Xeon Max 9480 2P, HBM Caching . 87.76 |=================================== ONNX Runtime 1.14 Model: bertsquad-12 - Device: CPU - Executor: Standard Inferences Per Second > Higher Is Better EPYC 9654 2P .................. 10.18 |=================================== EPYC 9554 2P .................. 11.69 |======================================== Xeon Max 9480 2P, HBM Caching . 11.46 |======================================= ONNX Runtime 1.14 CPU Power Consumption Monitor Watts < Lower Is Better EPYC 9654 2P .................. MIN: 57 AVG: 456 MAX: 482 EPYC 9554 2P .................. MIN: 47 AVG: 360 MAX: 380 Xeon Max 9480 2P, HBM Caching . MIN: 262 AVG: 573 MAX: 626 ONNX Runtime 1.14 Model: yolov4 - Device: CPU - Executor: Standard Inference Time Cost (ms) < Lower Is Better EPYC 9654 2P .................. 204.09 |======================================= EPYC 9554 2P .................. 195.90 |===================================== Xeon Max 9480 2P, HBM Caching . 130.37 |========================= ONNX Runtime 1.14 Model: yolov4 - Device: CPU - Executor: Standard Inferences Per Second > Higher Is Better EPYC 9654 2P .................. 4.90033 |======================== EPYC 9554 2P .................. 5.10505 |========================= Xeon Max 9480 2P, HBM Caching . 7.70046 |====================================== ONNX Runtime 1.14 CPU Power Consumption Monitor Watts < Lower Is Better EPYC 9654 2P .................. MIN: 59 AVG: 258 MAX: 271 EPYC 9554 2P .................. MIN: 47 AVG: 222 MAX: 233 Xeon Max 9480 2P, HBM Caching . MIN: 169 AVG: 521 MAX: 556 ONNX Runtime 1.14 Model: GPT-2 - Device: CPU - Executor: Standard Inference Time Cost (ms) < Lower Is Better EPYC 9654 2P .................. 9.68904 |====================================== EPYC 9554 2P .................. 7.64735 |============================== Xeon Max 9480 2P, HBM Caching . 4.70849 |================== ONNX Runtime 1.14 Model: GPT-2 - Device: CPU - Executor: Standard Inferences Per Second > Higher Is Better EPYC 9654 2P .................. 103.18 |================== EPYC 9554 2P .................. 132.72 |======================== Xeon Max 9480 2P, HBM Caching . 218.69 |======================================= OpenVINO 2022.3 CPU Power Consumption Monitor Watts < Lower Is Better EPYC 9654 2P .................. MIN: 59 AVG: 595 MAX: 651 EPYC 9554 2P .................. MIN: 48 AVG: 610 MAX: 665 Xeon Max 9480 2P, HBM Caching . MIN: 164 AVG: 545 MAX: 651 OpenVINO 2022.3 Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU ms < Lower Is Better EPYC 9654 2P .................. 0.99 |============================= EPYC 9554 2P .................. 0.88 |========================== Xeon Max 9480 2P, HBM Caching . 1.40 |========================================= OpenVINO 2022.3 Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU FPS > Higher Is Better EPYC 9654 2P .................. 124618.32 |=================================== EPYC 9554 2P .................. 128593.24 |==================================== Xeon Max 9480 2P, HBM Caching . 59457.14 |================= OpenVINO 2022.3 CPU Power Consumption Monitor Watts < Lower Is Better EPYC 9654 2P .................. MIN: 62 AVG: 581 MAX: 643 EPYC 9554 2P .................. MIN: 49 AVG: 580 MAX: 637 Xeon Max 9480 2P, HBM Caching . MIN: 265 AVG: 570 MAX: 619 OpenVINO 2022.3 CPU Power Consumption Monitor Watts < Lower Is Better EPYC 9654 2P .................. MIN: 59 AVG: 599 MAX: 664 EPYC 9554 2P .................. MIN: 49 AVG: 586 MAX: 647 Xeon Max 9480 2P, HBM Caching . MIN: 176 AVG: 531 MAX: 642 OpenVINO 2022.3 CPU Power Consumption Monitor Watts < Lower Is Better EPYC 9654 2P .................. MIN: 59 AVG: 632 MAX: 685 EPYC 9554 2P .................. MIN: 49 AVG: 623 MAX: 675 Xeon Max 9480 2P, HBM Caching . MIN: 137 AVG: 552 MAX: 614 OpenVINO 2022.3 CPU Power Consumption Monitor Watts < Lower Is Better EPYC 9654 2P .................. MIN: 59 AVG: 642 MAX: 706 EPYC 9554 2P .................. MIN: 51 AVG: 622 MAX: 683 Xeon Max 9480 2P, HBM Caching . MIN: 165 AVG: 554 MAX: 623 OpenVINO 2022.3 CPU Power Consumption Monitor Watts < Lower Is Better EPYC 9654 2P .................. MIN: 57 AVG: 655 MAX: 705 EPYC 9554 2P .................. MIN: 48 AVG: 648 MAX: 698 Xeon Max 9480 2P, HBM Caching . MIN: 163 AVG: 557 MAX: 629 OpenVINO 2022.3 CPU Power Consumption Monitor Watts < Lower Is Better EPYC 9654 2P .................. MIN: 58 AVG: 600 MAX: 646 EPYC 9554 2P .................. MIN: 49 AVG: 590 MAX: 636 Xeon Max 9480 2P, HBM Caching . MIN: 170 AVG: 552 MAX: 614 OpenVINO 2022.3 CPU Power Consumption Monitor Watts < Lower Is Better EPYC 9654 2P .................. MIN: 59 AVG: 613 MAX: 687 EPYC 9554 2P .................. MIN: 50 AVG: 606 MAX: 675 Xeon Max 9480 2P, HBM Caching . MIN: 168 AVG: 531 MAX: 616 OpenVINO 2022.3 CPU Power Consumption Monitor Watts < Lower Is Better EPYC 9654 2P .................. MIN: 58 AVG: 636 MAX: 689 EPYC 9554 2P .................. MIN: 50 AVG: 629 MAX: 675 Xeon Max 9480 2P, HBM Caching . MIN: 87 AVG: 548 MAX: 657 OpenVINO 2022.3 CPU Power Consumption Monitor Watts < Lower Is Better EPYC 9654 2P .................. MIN: 60 AVG: 606 MAX: 703 EPYC 9554 2P .................. MIN: 49 AVG: 600 MAX: 684 Xeon Max 9480 2P, HBM Caching . MIN: 228 AVG: 547 MAX: 624 OpenVINO 2022.3 CPU Power Consumption Monitor Watts < Lower Is Better EPYC 9654 2P .................. MIN: 60 AVG: 608 MAX: 699 EPYC 9554 2P .................. MIN: 49 AVG: 596 MAX: 683 Xeon Max 9480 2P, HBM Caching . MIN: 204 AVG: 538 MAX: 618 OpenVINO 2022.3 CPU Power Consumption Monitor Watts < Lower Is Better EPYC 9654 2P .................. MIN: 58 AVG: 646 MAX: 726 EPYC 9554 2P .................. MIN: 49 AVG: 638 MAX: 711 Xeon Max 9480 2P, HBM Caching . MIN: 136 AVG: 533 MAX: 628 TensorFlow 2.12 CPU Power Consumption Monitor Watts < Lower Is Better EPYC 9654 2P .................. MIN: 58 AVG: 503 MAX: 562 EPYC 9554 2P .................. MIN: 49 AVG: 486 MAX: 557 Xeon Max 9480 2P, HBM Caching . MIN: 231 AVG: 565 MAX: 721 TensorFlow 2.12 Device: CPU - Batch Size: 512 - Model: ResNet-50 images/sec Per Watt > Higher Is Better EPYC 9654 2P .................. 0.341 |=================================== EPYC 9554 2P .................. 0.387 |======================================== Xeon Max 9480 2P, HBM Caching . 0.136 |============== TensorFlow 2.12 CPU Power Consumption Monitor Watts < Lower Is Better EPYC 9654 2P .................. MIN: 56 AVG: 525 MAX: 568 EPYC 9554 2P .................. MIN: 47 AVG: 490 MAX: 537 Xeon Max 9480 2P, HBM Caching . MIN: 275 AVG: 562 MAX: 692 TensorFlow 2.12 Device: CPU - Batch Size: 512 - Model: GoogLeNet images/sec Per Watt > Higher Is Better EPYC 9654 2P .................. 1.020 |================================== EPYC 9554 2P .................. 1.211 |======================================== Xeon Max 9480 2P, HBM Caching . 0.421 |============== TensorFlow 2.12 CPU Power Consumption Monitor Watts < Lower Is Better EPYC 9654 2P .................. MIN: 57 AVG: 327 MAX: 394 EPYC 9554 2P .................. MIN: 47 AVG: 291 MAX: 331 Xeon Max 9480 2P, HBM Caching . MIN: 277 AVG: 539 MAX: 593 TensorFlow 2.12 Device: CPU - Batch Size: 16 - Model: ResNet-50 images/sec Per Watt > Higher Is Better EPYC 9654 2P .................. 0.077 |=========================== EPYC 9554 2P .................. 0.115 |======================================== Xeon Max 9480 2P, HBM Caching . 0.074 |========================== TensorFlow 2.12 CPU Power Consumption Monitor Watts < Lower Is Better EPYC 9654 2P .................. MIN: 57 AVG: 329 MAX: 407 EPYC 9554 2P .................. MIN: 48 AVG: 282 MAX: 351 Xeon Max 9480 2P, HBM Caching . MIN: 266 AVG: 511 MAX: 597 TensorFlow 2.12 Device: CPU - Batch Size: 16 - Model: GoogLeNet images/sec Per Watt > Higher Is Better EPYC 9654 2P .................. 0.196 |======================= EPYC 9554 2P .................. 0.335 |======================================== Xeon Max 9480 2P, HBM Caching . 0.193 |======================= TensorFlow 2.12 Device: CPU - Batch Size: 16 - Model: GoogLeNet images/sec > Higher Is Better EPYC 9654 2P .................. 64.49 |========================== EPYC 9554 2P .................. 94.41 |====================================== Xeon Max 9480 2P, HBM Caching . 98.43 |======================================== TensorFlow 2.12 CPU Power Consumption Monitor Watts < Lower Is Better EPYC 9654 2P .................. MIN: 58 AVG: 456 MAX: 542 EPYC 9554 2P .................. MIN: 49 AVG: 462 MAX: 567 Xeon Max 9480 2P, HBM Caching . MIN: 209 AVG: 551 MAX: 615 TensorFlow 2.12 Device: CPU - Batch Size: 512 - Model: AlexNet images/sec Per Watt > Higher Is Better EPYC 9654 2P .................. 3.850 |======================================= EPYC 9554 2P .................. 3.923 |======================================== Xeon Max 9480 2P, HBM Caching . 1.305 |============= TensorFlow 2.12 CPU Power Consumption Monitor Watts < Lower Is Better EPYC 9654 2P .................. MIN: 96 AVG: 617 MAX: 655 EPYC 9554 2P .................. MIN: 47 AVG: 597 MAX: 648 Xeon Max 9480 2P, HBM Caching . MIN: 163 AVG: 540 MAX: 900 TensorFlow 2.12 Device: CPU - Batch Size: 512 - Model: VGG-16 images/sec Per Watt > Higher Is Better EPYC 9654 2P .................. 0.196 |======================================== EPYC 9554 2P .................. 0.184 |====================================== Xeon Max 9480 2P, HBM Caching . 0.056 |=========== TensorFlow 2.12 CPU Power Consumption Monitor Watts < Lower Is Better EPYC 9654 2P .................. MIN: 91 AVG: 321 MAX: 425 EPYC 9554 2P .................. MIN: 47 AVG: 240 MAX: 360 Xeon Max 9480 2P, HBM Caching . MIN: 260 AVG: 466 MAX: 588 TensorFlow 2.12 Device: CPU - Batch Size: 16 - Model: AlexNet images/sec Per Watt > Higher Is Better EPYC 9654 2P .................. 0.518 |=================== EPYC 9554 2P .................. 1.076 |======================================== Xeon Max 9480 2P, HBM Caching . 0.493 |================== TensorFlow 2.12 Device: CPU - Batch Size: 16 - Model: AlexNet images/sec > Higher Is Better EPYC 9654 2P .................. 166.20 |========================= EPYC 9554 2P .................. 257.94 |======================================= Xeon Max 9480 2P, HBM Caching . 230.11 |=================================== TensorFlow 2.12 CPU Power Consumption Monitor Watts < Lower Is Better EPYC 9654 2P .................. MIN: 104 AVG: 427 MAX: 498 EPYC 9554 2P .................. MIN: 47 AVG: 426 MAX: 517 Xeon Max 9480 2P, HBM Caching . MIN: 265 AVG: 554 MAX: 662 TensorFlow 2.12 Device: CPU - Batch Size: 16 - Model: VGG-16 images/sec Per Watt > Higher Is Better EPYC 9654 2P .................. 0.111 |=============================== EPYC 9554 2P .................. 0.141 |======================================== Xeon Max 9480 2P, HBM Caching . 0.038 |=========== TensorFlow 2.12 Device: CPU - Batch Size: 16 - Model: VGG-16 images/sec > Higher Is Better EPYC 9654 2P .................. 47.27 |=============================== EPYC 9554 2P .................. 60.31 |======================================== Xeon Max 9480 2P, HBM Caching . 21.09 |============== oneDNN 3.1 CPU Power Consumption Monitor Watts < Lower Is Better EPYC 9654 2P .................. MIN: 96 AVG: 412 MAX: 555 EPYC 9554 2P .................. MIN: 47 AVG: 356 MAX: 602 Xeon Max 9480 2P, HBM Caching . MIN: 259 AVG: 561 MAX: 644 oneDNN 3.1 CPU Power Consumption Monitor Watts < Lower Is Better EPYC 9654 2P .................. MIN: 104 AVG: 414 MAX: 522 EPYC 9554 2P .................. MIN: 47 AVG: 365 MAX: 577 Xeon Max 9480 2P, HBM Caching . MIN: 266 AVG: 573 MAX: 647 oneDNN 3.1 Harness: Recurrent Neural Network Training - Data Type: bf16bf16bf16 - Engine: CPU ms < Lower Is Better EPYC 9654 2P .................. 2492.69 |====== EPYC 9554 2P .................. 1305.66 |=== Xeon Max 9480 2P, HBM Caching . 15294.60 |===================================== oneDNN 3.1 CPU Power Consumption Monitor Watts < Lower Is Better EPYC 9654 2P .................. MIN: 93 AVG: 286 MAX: 525 EPYC 9554 2P .................. MIN: 47 AVG: 270 MAX: 572 Xeon Max 9480 2P, HBM Caching . MIN: 268 AVG: 426 MAX: 673 oneDNN 3.1 CPU Power Consumption Monitor Watts < Lower Is Better EPYC 9654 2P .................. MIN: 106 AVG: 424 MAX: 558 EPYC 9554 2P .................. MIN: 47 AVG: 388 MAX: 564 Xeon Max 9480 2P, HBM Caching . MIN: 138 AVG: 534 MAX: 633 oneDNN 3.1 Harness: Deconvolution Batch shapes_1d - Data Type: bf16bf16bf16 - Engine: CPU ms < Lower Is Better EPYC 9654 2P .................. 2.533260 |===================================== EPYC 9554 2P .................. 1.761620 |========================== Xeon Max 9480 2P, HBM Caching . 0.483075 |======= oneDNN 3.1 CPU Power Consumption Monitor Watts < Lower Is Better EPYC 9654 2P .................. MIN: 87 AVG: 337 MAX: 534 EPYC 9554 2P .................. MIN: 47 AVG: 325 MAX: 610 Xeon Max 9480 2P, HBM Caching . MIN: 267 AVG: 471 MAX: 667 oneDNN 3.1 CPU Power Consumption Monitor Watts < Lower Is Better EPYC 9654 2P .................. MIN: 89 AVG: 333 MAX: 497 EPYC 9554 2P .................. MIN: 47 AVG: 256 MAX: 402 Xeon Max 9480 2P, HBM Caching . MIN: 260 AVG: 498 MAX: 639 oneDNN 3.1 CPU Power Consumption Monitor Watts < Lower Is Better EPYC 9654 2P .................. MIN: 90 AVG: 348 MAX: 491 EPYC 9554 2P .................. MIN: 47 AVG: 267 MAX: 375 Xeon Max 9480 2P, HBM Caching . MIN: 260 AVG: 530 MAX: 626 oneDNN 3.1 Harness: IP Shapes 1D - Data Type: bf16bf16bf16 - Engine: CPU ms < Lower Is Better EPYC 9654 2P .................. 16.98230 |===================================== EPYC 9554 2P .................. 11.19669 |======================== Xeon Max 9480 2P, HBM Caching . 7.88016 |================= libxsmm 2-1.17-3645 CPU Power Consumption Monitor Watts < Lower Is Better EPYC 9654 2P . MIN: 98 AVG: 380 MAX: 613 EPYC 9554 2P . MIN: 47 AVG: 344 MAX: 635 libxsmm 2-1.17-3645 M N K: 64 GFLOPS/s Per Watt > Higher Is Better EPYC 9654 2P . 5.975 |=========================================== EPYC 9554 2P . 7.839 |========================================================= libxsmm 2-1.17-3645 CPU Power Consumption Monitor Watts < Lower Is Better EPYC 9654 2P . MIN: 95 AVG: 360 MAX: 590 EPYC 9554 2P . MIN: 47 AVG: 293 MAX: 544 libxsmm 2-1.17-3645 M N K: 32 GFLOPS/s Per Watt > Higher Is Better EPYC 9654 2P . 3.609 |=========================================== EPYC 9554 2P . 4.782 |========================================================= libxsmm 2-1.17-3645 CPU Power Consumption Monitor Watts < Lower Is Better EPYC 9654 2P . MIN: 90 AVG: 435 MAX: 665 EPYC 9554 2P . MIN: 48 AVG: 395 MAX: 695 libxsmm 2-1.17-3645 M N K: 256 GFLOPS/s Per Watt > Higher Is Better EPYC 9654 2P . 10.07 |================================================= EPYC 9554 2P . 11.67 |========================================================= libxsmm 2-1.17-3645 CPU Power Consumption Monitor Watts < Lower Is Better EPYC 9654 2P .................. MIN: 99 AVG: 441 MAX: 632 EPYC 9554 2P .................. MIN: 47 AVG: 400 MAX: 668 Xeon Max 9480 2P, HBM Caching . MIN: 256 AVG: 565 MAX: 625 libxsmm 2-1.17-3645 M N K: 128 GFLOPS/s Per Watt > Higher Is Better EPYC 9654 2P .................. 7.766 |============================= EPYC 9554 2P .................. 10.285 |======================================= Xeon Max 9480 2P, HBM Caching . 3.209 |============