Sapphire Rapids AVX-512 Benchmarks Ice Lake, Sapphire Rapids, Genoa AVX-512 benchmarks by Michael Larabel for a future article. Xeon 8380: AVX-512 Off: Processor: 2 x Intel Xeon Platinum 8380 @ 3.40GHz (80 Cores / 160 Threads), Motherboard: Intel M50CYP2SB2U (SE5C6200.86B.0022.D08.2103221623 BIOS), Chipset: Intel Ice Lake IEH, Memory: 512GB, Disk: 2 x 1920GB SAMSUNG MZWLJ1T9HBJR-00007, Graphics: ASPEED, Monitor: VGA HDMI, Network: 2 x Intel X710 for 10GBASE-T + 2 x Intel E810-C for QSFP OS: Ubuntu 22.10, Kernel: 5.19.0-29-generic (x86_64), Desktop: GNOME Shell 43.1, Display Server: X Server 1.21.1.4, Vulkan: 1.3.224, Compiler: GCC 12.2.0, File-System: ext4, Screen Resolution: 1920x1080 Xeon 8380: AVX-512 On: Processor: 2 x Intel Xeon Platinum 8380 @ 3.40GHz (80 Cores / 160 Threads), Motherboard: Intel M50CYP2SB2U (SE5C6200.86B.0022.D08.2103221623 BIOS), Chipset: Intel Ice Lake IEH, Memory: 512GB, Disk: 2 x 1920GB SAMSUNG MZWLJ1T9HBJR-00007, Graphics: ASPEED, Monitor: VGA HDMI, Network: 2 x Intel X710 for 10GBASE-T + 2 x Intel E810-C for QSFP OS: Ubuntu 22.10, Kernel: 5.19.0-29-generic (x86_64), Desktop: GNOME Shell 43.1, Display Server: X Server 1.21.1.4, Vulkan: 1.3.224, Compiler: GCC 12.2.0, File-System: ext4, Screen Resolution: 1920x1080 Xeon 8490H: AVX-512 Off: Processor: 2 x Intel Xeon Platinum 8490H @ 3.50GHz (120 Cores / 240 Threads), Motherboard: Quanta Cloud S6Q-MB-MPS (3A10.uh BIOS), Chipset: Intel Device 1bce, Memory: 1008GB, Disk: 2 x 1920GB SAMSUNG MZWLJ1T9HBJR-00007, Graphics: ASPEED, Monitor: VGA HDMI, Network: 4 x Intel E810-C for QSFP + 2 x Intel X710 for 10GBASE-T OS: Ubuntu 22.10, Kernel: 5.19.0-29-generic (x86_64), Desktop: GNOME Shell 43.1, Display Server: X Server 1.21.1.4, Vulkan: 1.3.224, Compiler: GCC 12.2.0, File-System: ext4, Screen Resolution: 1920x1080 Xeon 8490H: AVX-512 On: Processor: 2 x Intel Xeon Platinum 8490H @ 3.50GHz (120 Cores / 240 Threads), Motherboard: Quanta Cloud S6Q-MB-MPS (3A10.uh BIOS), Chipset: Intel Device 1bce, Memory: 1008GB, Disk: 2 x 1920GB SAMSUNG MZWLJ1T9HBJR-00007, Graphics: ASPEED, Monitor: VGA HDMI, Network: 4 x Intel E810-C for QSFP + 2 x Intel X710 for 10GBASE-T OS: Ubuntu 22.10, Kernel: 5.19.0-29-generic (x86_64), Desktop: GNOME Shell 43.1, Display Server: X Server 1.21.1.4, Vulkan: 1.3.224, Compiler: GCC 12.2.0, File-System: ext4, Screen Resolution: 1920x1080 EPYC 9654: AVX-512 Off: Processor: 2 x AMD EPYC 9654 96-Core @ 3.71GHz (192 Cores / 384 Threads), Motherboard: AMD Titanite_4G (RTI1002E BIOS), Chipset: AMD Device 14a4, Memory: 1520GB, Disk: 2 x 1920GB SAMSUNG MZWLJ1T9HBJR-00007, Graphics: ASPEED, Monitor: VGA HDMI, Network: Broadcom NetXtreme BCM5720 PCIe OS: Ubuntu 22.10, Kernel: 5.19.0-29-generic (x86_64), Desktop: GNOME Shell 43.1, Display Server: X Server 1.21.1.4, Vulkan: 1.3.224, Compiler: GCC 12.2.0, File-System: ext4, Screen Resolution: 1920x1080 EPYC 9654: AVX-512 On: Processor: 2 x AMD EPYC 9654 96-Core @ 3.71GHz (192 Cores / 384 Threads), Motherboard: AMD Titanite_4G (RTI1002E BIOS), Chipset: AMD Device 14a4, Memory: 1520GB, Disk: 2 x 1920GB SAMSUNG MZWLJ1T9HBJR-00007, Graphics: ASPEED, Monitor: VGA HDMI, Network: Broadcom NetXtreme BCM5720 PCIe OS: Ubuntu 22.10, Kernel: 5.19.0-29-generic (x86_64), Desktop: GNOME Shell 43.1, Display Server: X Server 1.21.1.4, Vulkan: 1.3.224, Compiler: GCC 12.2.0, File-System: ext4, Screen Resolution: 1920x1080 Neural Magic DeepSparse 1.1 Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-Stream items/sec > Higher Is Better Xeon 8380: AVX-512 Off .. 183.83 |============= Xeon 8380: AVX-512 On ... 227.45 |================= Xeon 8490H: AVX-512 Off . 264.77 |=================== Xeon 8490H: AVX-512 On .. 424.27 |=============================== EPYC 9654: AVX-512 Off .. 510.88 |===================================== EPYC 9654: AVX-512 On ... 613.94 |============================================= Neural Magic DeepSparse 1.1 Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-Stream ms/batch < Lower Is Better Xeon 8380: AVX-512 Off .. 217.10 |=========================================== Xeon 8380: AVX-512 On ... 175.69 |=================================== Xeon 8490H: AVX-512 Off . 226.27 |============================================= Xeon 8490H: AVX-512 On .. 141.14 |============================ EPYC 9654: AVX-512 Off .. 187.35 |===================================== EPYC 9654: AVX-512 On ... 155.91 |=============================== Neural Magic DeepSparse 1.1 CPU Peak Freq (Highest CPU Core Frequency) Monitor Megahertz > Higher Is Better Xeon 8380: AVX-512 Off .. MIN: 2300 AVG: 2977 MAX: 3411 Xeon 8380: AVX-512 On ... MIN: 2300 AVG: 2796 MAX: 3409 Xeon 8490H: AVX-512 Off . MIN: 1900 AVG: 3039 MAX: 3517 Xeon 8490H: AVX-512 On .. MIN: 1900 AVG: 2810 MAX: 3515 EPYC 9654: AVX-512 Off .. MIN: 3709 AVG: 3709 MAX: 3709 EPYC 9654: AVX-512 On ... MIN: 3700 AVG: 3709 MAX: 3709 Neural Magic DeepSparse 1.1 CPU Power Consumption Monitor Watts < Lower Is Better Xeon 8380: AVX-512 Off .. MIN: 80 AVG: 424 MAX: 591 Xeon 8380: AVX-512 On ... MIN: 116 AVG: 423 MAX: 593 Xeon 8490H: AVX-512 Off . MIN: 203 AVG: 577 MAX: 774 Xeon 8490H: AVX-512 On .. MIN: 213 AVG: 575 MAX: 771 EPYC 9654: AVX-512 Off .. MIN: 59 AVG: 490 MAX: 722 EPYC 9654: AVX-512 On ... MIN: 58 AVG: 476 MAX: 692 Neural Magic DeepSparse 1.1 CPU Temperature Monitor Celsius < Lower Is Better Xeon 8380: AVX-512 Off .. MIN: 39 AVG: 62 MAX: 77 Xeon 8380: AVX-512 On ... MIN: 37 AVG: 61 MAX: 74 Xeon 8490H: AVX-512 Off . MIN: 36 AVG: 46 MAX: 53 Xeon 8490H: AVX-512 On .. MIN: 37 AVG: 47 MAX: 53 EPYC 9654: AVX-512 Off .. MIN: 29 AVG: 48 MAX: 61 EPYC 9654: AVX-512 On ... MIN: 32 AVG: 48 MAX: 59 Neural Magic DeepSparse 1.1 Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream items/sec > Higher Is Better Xeon 8380: AVX-512 Off .. 379.58 |============== Xeon 8380: AVX-512 On ... 455.03 |================= Xeon 8490H: AVX-512 Off . 584.15 |===================== Xeon 8490H: AVX-512 On .. 875.64 |================================ EPYC 9654: AVX-512 Off .. 1006.08 |===================================== EPYC 9654: AVX-512 On ... 1205.18 |============================================ Neural Magic DeepSparse 1.1 Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream ms/batch < Lower Is Better Xeon 8380: AVX-512 Off .. 105.26 |============================================= Xeon 8380: AVX-512 On ... 87.87 |====================================== Xeon 8490H: AVX-512 Off . 102.61 |============================================ Xeon 8490H: AVX-512 On .. 68.43 |============================= EPYC 9654: AVX-512 Off .. 95.17 |========================================= EPYC 9654: AVX-512 On ... 79.50 |================================== Neural Magic DeepSparse 1.1 CPU Peak Freq (Highest CPU Core Frequency) Monitor Megahertz > Higher Is Better Xeon 8380: AVX-512 Off .. MIN: 2300 AVG: 2912 MAX: 3406 Xeon 8380: AVX-512 On ... MIN: 2300 AVG: 2658 MAX: 3406 Xeon 8490H: AVX-512 Off . MIN: 1900 AVG: 2946 MAX: 3517 Xeon 8490H: AVX-512 On .. MIN: 1900 AVG: 2740 MAX: 3513 EPYC 9654: AVX-512 Off .. MIN: 3709 AVG: 3709 MAX: 3709 EPYC 9654: AVX-512 On ... MIN: 3709 AVG: 3709 MAX: 3709 Neural Magic DeepSparse 1.1 CPU Power Consumption Monitor Watts < Lower Is Better Xeon 8380: AVX-512 Off .. MIN: 123 AVG: 470 MAX: 593 Xeon 8380: AVX-512 On ... MIN: 102 AVG: 469 MAX: 552 Xeon 8490H: AVX-512 Off . MIN: 203 AVG: 620 MAX: 770 Xeon 8490H: AVX-512 On .. MIN: 211 AVG: 619 MAX: 769 EPYC 9654: AVX-512 Off .. MIN: 61 AVG: 532 MAX: 675 EPYC 9654: AVX-512 On ... MIN: 32 AVG: 499 MAX: 642 Neural Magic DeepSparse 1.1 CPU Temperature Monitor Celsius < Lower Is Better Xeon 8380: AVX-512 Off .. MIN: 54 AVG: 71 MAX: 78 Xeon 8380: AVX-512 On ... MIN: 53 AVG: 67 MAX: 74 Xeon 8490H: AVX-512 Off . MIN: 36 AVG: 49 MAX: 54 Xeon 8490H: AVX-512 On .. MIN: 38 AVG: 49 MAX: 53 EPYC 9654: AVX-512 Off .. MIN: 43 AVG: 55 MAX: 61 EPYC 9654: AVX-512 On ... MIN: 41 AVG: 53 MAX: 60 Neural Magic DeepSparse 1.1 Model: CV Classification, ResNet-50 ImageNet - Scenario: Synchronous Single-Stream items/sec > Higher Is Better Xeon 8380: AVX-512 Off .. 113.33 |================== Xeon 8380: AVX-512 On ... 228.12 |===================================== Xeon 8490H: AVX-512 Off . 187.65 |============================== Xeon 8490H: AVX-512 On .. 281.24 |============================================= EPYC 9654: AVX-512 Off .. 206.32 |================================= EPYC 9654: AVX-512 On ... 191.33 |=============================== Neural Magic DeepSparse 1.1 Model: CV Classification, ResNet-50 ImageNet - Scenario: Synchronous Single-Stream ms/batch < Lower Is Better Xeon 8380: AVX-512 Off .. 8.8158 |============================================= Xeon 8380: AVX-512 On ... 4.3750 |====================== Xeon 8490H: AVX-512 Off . 5.3242 |=========================== Xeon 8490H: AVX-512 On .. 3.5509 |================== EPYC 9654: AVX-512 Off .. 4.8444 |========================= EPYC 9654: AVX-512 On ... 5.2240 |=========================== Neural Magic DeepSparse 1.1 CPU Peak Freq (Highest CPU Core Frequency) Monitor Megahertz > Higher Is Better Xeon 8380: AVX-512 Off .. MIN: 2300 AVG: 2944 MAX: 3400 Xeon 8380: AVX-512 On ... MIN: 2300 AVG: 2506 MAX: 3400 Xeon 8490H: AVX-512 Off . MIN: 1900 AVG: 3287 MAX: 3517 Xeon 8490H: AVX-512 On .. MIN: 1900 AVG: 3360 MAX: 3516 EPYC 9654: AVX-512 Off .. MIN: 3698 AVG: 3709 MAX: 3709 EPYC 9654: AVX-512 On ... MIN: 3709 AVG: 3709 MAX: 3709 Neural Magic DeepSparse 1.1 CPU Power Consumption Monitor Watts < Lower Is Better Xeon 8380: AVX-512 Off .. MIN: 123 AVG: 336 MAX: 377 Xeon 8380: AVX-512 On ... MIN: 119 AVG: 331 MAX: 361 Xeon 8490H: AVX-512 Off . MIN: 107 AVG: 477 MAX: 538 Xeon 8490H: AVX-512 On .. MIN: 210 AVG: 483 MAX: 522 EPYC 9654: AVX-512 Off .. MIN: 57 AVG: 346 MAX: 397 EPYC 9654: AVX-512 On ... MIN: 59 AVG: 324 MAX: 371 Neural Magic DeepSparse 1.1 CPU Temperature Monitor Celsius < Lower Is Better Xeon 8380: AVX-512 Off .. MIN: 55 AVG: 72 MAX: 78 Xeon 8380: AVX-512 On ... MIN: 53 AVG: 69 MAX: 74 Xeon 8490H: AVX-512 Off . MIN: 36 AVG: 48 MAX: 52 Xeon 8490H: AVX-512 On .. MIN: 38 AVG: 48 MAX: 52 EPYC 9654: AVX-512 Off .. MIN: 44 AVG: 55 MAX: 58 EPYC 9654: AVX-512 On ... MIN: 44 AVG: 52 MAX: 57 Neural Magic DeepSparse 1.1 Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream items/sec > Higher Is Better Xeon 8380: AVX-512 Off .. 541.86 |============ Xeon 8380: AVX-512 On ... 835.78 |=================== Xeon 8490H: AVX-512 Off . 832.85 |=================== Xeon 8490H: AVX-512 On .. 1492.88 |================================= EPYC 9654: AVX-512 Off .. 1410.42 |================================ EPYC 9654: AVX-512 On ... 1966.41 |============================================ Neural Magic DeepSparse 1.1 Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream ms/batch < Lower Is Better Xeon 8380: AVX-512 Off .. 73.75 |============================================== Xeon 8380: AVX-512 On ... 47.82 |============================== Xeon 8490H: AVX-512 Off . 71.93 |============================================= Xeon 8490H: AVX-512 On .. 40.14 |========================= EPYC 9654: AVX-512 Off .. 67.90 |========================================== EPYC 9654: AVX-512 On ... 48.70 |============================== Neural Magic DeepSparse 1.1 CPU Peak Freq (Highest CPU Core Frequency) Monitor Megahertz > Higher Is Better Xeon 8380: AVX-512 Off .. MIN: 2300 AVG: 2701 MAX: 3401 Xeon 8380: AVX-512 On ... MIN: 2300 AVG: 2583 MAX: 3401 Xeon 8490H: AVX-512 Off . MIN: 1900 AVG: 2690 MAX: 3512 Xeon 8490H: AVX-512 On .. MIN: 1900 AVG: 2614 MAX: 3508 EPYC 9654: AVX-512 Off .. MIN: 3709 AVG: 3709 MAX: 3709 EPYC 9654: AVX-512 On ... MIN: 3709 AVG: 3709 MAX: 3709 Neural Magic DeepSparse 1.1 CPU Power Consumption Monitor Watts < Lower Is Better Xeon 8380: AVX-512 Off .. MIN: 131 AVG: 489 MAX: 594 Xeon 8380: AVX-512 On ... MIN: 116 AVG: 490 MAX: 592 Xeon 8490H: AVX-512 Off . MIN: 207 AVG: 636 MAX: 766 Xeon 8490H: AVX-512 On .. MIN: 213 AVG: 637 MAX: 774 EPYC 9654: AVX-512 Off .. MIN: 33 AVG: 552 MAX: 654 EPYC 9654: AVX-512 On ... MIN: 57 AVG: 540 MAX: 646 Neural Magic DeepSparse 1.1 CPU Temperature Monitor Celsius < Lower Is Better Xeon 8380: AVX-512 Off .. MIN: 57 AVG: 73 MAX: 77 Xeon 8380: AVX-512 On ... MIN: 54 AVG: 72 MAX: 77 Xeon 8490H: AVX-512 Off . MIN: 37 AVG: 50 MAX: 54 Xeon 8490H: AVX-512 On .. MIN: 37 AVG: 50 MAX: 54 EPYC 9654: AVX-512 Off .. MIN: 43 AVG: 56 MAX: 61 EPYC 9654: AVX-512 On ... MIN: 42 AVG: 55 MAX: 61 Neural Magic DeepSparse 1.1 Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Synchronous Single-Stream items/sec > Higher Is Better Xeon 8380: AVX-512 Off .. 16.83 |======================= Xeon 8380: AVX-512 On ... 20.19 |=========================== Xeon 8490H: AVX-512 Off . 21.29 |============================= Xeon 8490H: AVX-512 On .. 27.07 |==================================== EPYC 9654: AVX-512 Off .. 30.86 |========================================= EPYC 9654: AVX-512 On ... 34.23 |============================================== Neural Magic DeepSparse 1.1 Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Synchronous Single-Stream ms/batch < Lower Is Better Xeon 8380: AVX-512 Off .. 59.42 |============================================== Xeon 8380: AVX-512 On ... 49.51 |====================================== Xeon 8490H: AVX-512 Off . 46.97 |==================================== Xeon 8490H: AVX-512 On .. 36.94 |============================= EPYC 9654: AVX-512 Off .. 32.40 |========================= EPYC 9654: AVX-512 On ... 29.20 |======================= Neural Magic DeepSparse 1.1 CPU Peak Freq (Highest CPU Core Frequency) Monitor Megahertz > Higher Is Better Xeon 8380: AVX-512 Off .. MIN: 2300 AVG: 2813 MAX: 3401 Xeon 8380: AVX-512 On ... MIN: 2300 AVG: 2703 MAX: 3401 Xeon 8490H: AVX-512 Off . MIN: 1900 AVG: 3377 MAX: 3517 Xeon 8490H: AVX-512 On .. MIN: 1900 AVG: 3278 MAX: 3516 EPYC 9654: AVX-512 Off .. MIN: 3709 AVG: 3709 MAX: 3709 EPYC 9654: AVX-512 On ... MIN: 3709 AVG: 3709 MAX: 3709 Neural Magic DeepSparse 1.1 CPU Power Consumption Monitor Watts < Lower Is Better Xeon 8380: AVX-512 Off .. MIN: 119 AVG: 314 MAX: 389 Xeon 8380: AVX-512 On ... MIN: 116 AVG: 309 MAX: 374 Xeon 8490H: AVX-512 Off . MIN: 203 AVG: 468 MAX: 564 Xeon 8490H: AVX-512 On .. MIN: 106 AVG: 468 MAX: 557 EPYC 9654: AVX-512 Off .. MIN: 43 AVG: 344 MAX: 431 EPYC 9654: AVX-512 On ... MIN: 61 AVG: 336 MAX: 426 Neural Magic DeepSparse 1.1 CPU Temperature Monitor Celsius < Lower Is Better Xeon 8380: AVX-512 Off .. MIN: 53.0 AVG: 66.5 MAX: 75.0 Xeon 8380: AVX-512 On ... MIN: 54.0 AVG: 67.8 MAX: 75.0 Xeon 8490H: AVX-512 Off . MIN: 36.0 AVG: 46.9 MAX: 52.0 Xeon 8490H: AVX-512 On .. MIN: 37.0 AVG: 47.8 MAX: 53.0 EPYC 9654: AVX-512 Off .. MIN: 44.4 AVG: 53.1 MAX: 59.1 EPYC 9654: AVX-512 On ... MIN: 43.5 AVG: 52.4 MAX: 57.8 Neural Magic DeepSparse 1.1 Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Stream items/sec > Higher Is Better Xeon 8380: AVX-512 Off .. 43.11 |================ Xeon 8380: AVX-512 On ... 48.41 |================== Xeon 8490H: AVX-512 Off . 66.75 |========================= Xeon 8490H: AVX-512 On .. 92.02 |================================== EPYC 9654: AVX-512 Off .. 120.51 |============================================= EPYC 9654: AVX-512 On ... 84.87 |================================ Neural Magic DeepSparse 1.1 Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Stream ms/batch < Lower Is Better Xeon 8380: AVX-512 Off .. 916.94 |==================================== Xeon 8380: AVX-512 On ... 819.53 |================================ Xeon 8490H: AVX-512 Off . 887.59 |=================================== Xeon 8490H: AVX-512 On .. 648.20 |========================= EPYC 9654: AVX-512 Off .. 787.33 |=============================== EPYC 9654: AVX-512 On ... 1128.85 |============================================ Neural Magic DeepSparse 1.1 CPU Peak Freq (Highest CPU Core Frequency) Monitor Megahertz > Higher Is Better Xeon 8380: AVX-512 Off .. MIN: 2300 AVG: 2835 MAX: 3408 Xeon 8380: AVX-512 On ... MIN: 2300 AVG: 2731 MAX: 3408 Xeon 8490H: AVX-512 Off . MIN: 1900 AVG: 2898 MAX: 3517 Xeon 8490H: AVX-512 On .. MIN: 1900 AVG: 2759 MAX: 3517 EPYC 9654: AVX-512 Off .. MIN: 3709 AVG: 3709 MAX: 3709 EPYC 9654: AVX-512 On ... MIN: 3709 AVG: 3709 MAX: 3709 Neural Magic DeepSparse 1.1 CPU Power Consumption Monitor Watts < Lower Is Better Xeon 8380: AVX-512 Off .. MIN: 122 AVG: 424 MAX: 595 Xeon 8380: AVX-512 On ... MIN: 109 AVG: 424 MAX: 597 Xeon 8490H: AVX-512 Off . MIN: 205 AVG: 579 MAX: 772 Xeon 8490H: AVX-512 On .. MIN: 112 AVG: 575 MAX: 773 EPYC 9654: AVX-512 Off .. MIN: 61 AVG: 501 MAX: 721 EPYC 9654: AVX-512 On ... MIN: 62 AVG: 454 MAX: 633 Neural Magic DeepSparse 1.1 CPU Temperature Monitor Celsius < Lower Is Better Xeon 8380: AVX-512 Off .. MIN: 51.0 AVG: 64.6 MAX: 73.0 Xeon 8380: AVX-512 On ... MIN: 54.0 AVG: 67.2 MAX: 75.0 Xeon 8490H: AVX-512 Off . MIN: 37.0 AVG: 46.9 MAX: 52.0 Xeon 8490H: AVX-512 On .. MIN: 38.0 AVG: 47.8 MAX: 53.0 EPYC 9654: AVX-512 Off .. MIN: 43.9 AVG: 54.3 MAX: 62.3 EPYC 9654: AVX-512 On ... MIN: 43.5 AVG: 52.2 MAX: 59.1 Neural Magic DeepSparse 1.1 Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Synchronous Single-Stream items/sec > Higher Is Better Xeon 8380: AVX-512 Off .. 45.85 |===================== Xeon 8380: AVX-512 On ... 79.14 |==================================== Xeon 8490H: AVX-512 Off . 46.86 |===================== Xeon 8490H: AVX-512 On .. 83.70 |====================================== EPYC 9654: AVX-512 Off .. 71.51 |================================ EPYC 9654: AVX-512 On ... 100.29 |============================================= Neural Magic DeepSparse 1.1 Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Synchronous Single-Stream ms/batch < Lower Is Better Xeon 8380: AVX-512 Off .. 21.7973 |============================================ Xeon 8380: AVX-512 On ... 12.6264 |========================= Xeon 8490H: AVX-512 Off . 21.3212 |=========================================== Xeon 8490H: AVX-512 On .. 11.9378 |======================== EPYC 9654: AVX-512 Off .. 13.9740 |============================ EPYC 9654: AVX-512 On ... 9.9667 |==================== Neural Magic DeepSparse 1.1 CPU Peak Freq (Highest CPU Core Frequency) Monitor Megahertz > Higher Is Better Xeon 8380: AVX-512 Off .. MIN: 2300 AVG: 2937 MAX: 3405 Xeon 8380: AVX-512 On ... MIN: 2300 AVG: 2689 MAX: 3402 Xeon 8490H: AVX-512 Off . MIN: 1900 AVG: 3338 MAX: 3518 Xeon 8490H: AVX-512 On .. MIN: 1900 AVG: 3337 MAX: 3517 EPYC 9654: AVX-512 Off .. MIN: 3709 AVG: 3709 MAX: 3709 EPYC 9654: AVX-512 On ... MIN: 3709 AVG: 3709 MAX: 3709 Neural Magic DeepSparse 1.1 CPU Power Consumption Monitor Watts < Lower Is Better Xeon 8380: AVX-512 Off .. MIN: 123 AVG: 322 MAX: 389 Xeon 8380: AVX-512 On ... MIN: 83 AVG: 313 MAX: 366 Xeon 8490H: AVX-512 Off . MIN: 110 AVG: 466 MAX: 569 Xeon 8490H: AVX-512 On .. MIN: 215 AVG: 471 MAX: 545 EPYC 9654: AVX-512 Off .. MIN: 30 AVG: 341 MAX: 418 EPYC 9654: AVX-512 On ... MIN: 62 AVG: 340 MAX: 413 Neural Magic DeepSparse 1.1 CPU Temperature Monitor Celsius < Lower Is Better Xeon 8380: AVX-512 Off .. MIN: 51.0 AVG: 65.9 MAX: 73.0 Xeon 8380: AVX-512 On ... MIN: 52.0 AVG: 66.8 MAX: 74.0 Xeon 8490H: AVX-512 Off . MIN: 35.0 AVG: 46.1 MAX: 52.0 Xeon 8490H: AVX-512 On .. MIN: 37.0 AVG: 47.7 MAX: 53.0 EPYC 9654: AVX-512 Off .. MIN: 43.0 AVG: 52.8 MAX: 58.3 EPYC 9654: AVX-512 On ... MIN: 43.0 AVG: 52.8 MAX: 57.8 Neural Magic DeepSparse 1.1 Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-Stream items/sec > Higher Is Better Xeon 8380: AVX-512 Off .. 158.53 |========== Xeon 8380: AVX-512 On ... 221.73 |============== Xeon 8490H: AVX-512 Off . 232.21 |=============== Xeon 8490H: AVX-512 On .. 355.67 |======================= EPYC 9654: AVX-512 Off .. 491.34 |=============================== EPYC 9654: AVX-512 On ... 704.58 |============================================= Neural Magic DeepSparse 1.1 Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-Stream ms/batch < Lower Is Better Xeon 8380: AVX-512 Off .. 251.57 |============================================ Xeon 8380: AVX-512 On ... 180.17 |=============================== Xeon 8490H: AVX-512 Off . 257.56 |============================================= Xeon 8490H: AVX-512 On .. 168.23 |============================= EPYC 9654: AVX-512 Off .. 194.72 |================================== EPYC 9654: AVX-512 On ... 135.99 |======================== Neural Magic DeepSparse 1.1 CPU Peak Freq (Highest CPU Core Frequency) Monitor Megahertz > Higher Is Better Xeon 8380: AVX-512 Off .. MIN: 2300 AVG: 2857 MAX: 3402 Xeon 8380: AVX-512 On ... MIN: 2300 AVG: 2705 MAX: 3402 Xeon 8490H: AVX-512 Off . MIN: 1900 AVG: 2956 MAX: 3516 Xeon 8490H: AVX-512 On .. MIN: 1900 AVG: 2822 MAX: 3515 EPYC 9654: AVX-512 Off .. MIN: 3703 AVG: 3709 MAX: 3709 EPYC 9654: AVX-512 On ... MIN: 3709 AVG: 3709 MAX: 3709 Neural Magic DeepSparse 1.1 CPU Power Consumption Monitor Watts < Lower Is Better Xeon 8380: AVX-512 Off .. MIN: 124 AVG: 437 MAX: 595 Xeon 8380: AVX-512 On ... MIN: 103 AVG: 453 MAX: 598 Xeon 8490H: AVX-512 Off . MIN: 211 AVG: 599 MAX: 769 Xeon 8490H: AVX-512 On .. MIN: 184 AVG: 609 MAX: 775 EPYC 9654: AVX-512 Off .. MIN: 32 AVG: 494 MAX: 714 EPYC 9654: AVX-512 On ... MIN: 31 AVG: 538 MAX: 713 Neural Magic DeepSparse 1.1 CPU Temperature Monitor Celsius < Lower Is Better Xeon 8380: AVX-512 Off .. MIN: 53.0 AVG: 65.7 MAX: 74.0 Xeon 8380: AVX-512 On ... MIN: 54.0 AVG: 68.2 MAX: 75.0 Xeon 8490H: AVX-512 Off . MIN: 37.0 AVG: 47.7 MAX: 53.0 Xeon 8490H: AVX-512 On .. MIN: 38.0 AVG: 48.4 MAX: 53.0 EPYC 9654: AVX-512 Off .. MIN: 37.3 AVG: 44.8 MAX: 51.3 EPYC 9654: AVX-512 On ... MIN: 44.4 AVG: 52.9 MAX: 60.0 Neural Magic DeepSparse 1.1 Model: CV Detection,YOLOv5s COCO - Scenario: Synchronous Single-Stream items/sec > Higher Is Better Xeon 8380: AVX-512 Off .. 69.73 |========================= Xeon 8380: AVX-512 On ... 83.42 |============================== Xeon 8490H: AVX-512 Off . 84.84 |============================== Xeon 8490H: AVX-512 On .. 100.54 |==================================== EPYC 9654: AVX-512 Off .. 109.26 |======================================= EPYC 9654: AVX-512 On ... 126.01 |============================================= Neural Magic DeepSparse 1.1 Model: CV Detection,YOLOv5s COCO - Scenario: Synchronous Single-Stream ms/batch < Lower Is Better Xeon 8380: AVX-512 Off .. 14.3286 |============================================ Xeon 8380: AVX-512 On ... 11.9769 |===================================== Xeon 8490H: AVX-512 Off . 11.7823 |==================================== Xeon 8490H: AVX-512 On .. 9.9734 |=============================== EPYC 9654: AVX-512 Off .. 9.1835 |============================ EPYC 9654: AVX-512 On ... 7.9604 |======================== Neural Magic DeepSparse 1.1 CPU Peak Freq (Highest CPU Core Frequency) Monitor Megahertz > Higher Is Better Xeon 8380: AVX-512 Off .. MIN: 2300 AVG: 3087 MAX: 3400 Xeon 8380: AVX-512 On ... MIN: 2300 AVG: 2878 MAX: 3400 Xeon 8490H: AVX-512 Off . MIN: 1900 AVG: 3335 MAX: 3516 Xeon 8490H: AVX-512 On .. MIN: 1900 AVG: 3282 MAX: 3518 EPYC 9654: AVX-512 Off .. MIN: 3697 AVG: 3709 MAX: 3709 EPYC 9654: AVX-512 On ... MIN: 3700 AVG: 3709 MAX: 3709 Neural Magic DeepSparse 1.1 CPU Power Consumption Monitor Watts < Lower Is Better Xeon 8380: AVX-512 Off .. MIN: 120 AVG: 314 MAX: 351 Xeon 8380: AVX-512 On ... MIN: 114 AVG: 296 MAX: 325 Xeon 8490H: AVX-512 Off . MIN: 208 AVG: 467 MAX: 528 Xeon 8490H: AVX-512 On .. MIN: 111 AVG: 442 MAX: 493 EPYC 9654: AVX-512 Off .. MIN: 55 AVG: 321 MAX: 378 EPYC 9654: AVX-512 On ... MIN: 33 AVG: 316 MAX: 367 Neural Magic DeepSparse 1.1 CPU Temperature Monitor Celsius < Lower Is Better Xeon 8380: AVX-512 Off .. MIN: 51.0 AVG: 66.1 MAX: 71.0 Xeon 8380: AVX-512 On ... MIN: 54.0 AVG: 65.2 MAX: 69.0 Xeon 8490H: AVX-512 Off . MIN: 36.0 AVG: 45.5 MAX: 49.0 Xeon 8490H: AVX-512 On .. MIN: 38.0 AVG: 45.4 MAX: 49.0 EPYC 9654: AVX-512 Off .. MIN: 34.1 AVG: 42.8 MAX: 47.8 EPYC 9654: AVX-512 On ... MIN: 36.4 AVG: 42.7 MAX: 48.0 Neural Magic DeepSparse 1.1 Model: CV Detection,YOLOv5s COCO - Scenario: Asynchronous Multi-Stream items/sec > Higher Is Better Xeon 8380: AVX-512 Off .. 247.27 |============== Xeon 8380: AVX-512 On ... 318.79 |================== Xeon 8490H: AVX-512 Off . 405.72 |======================= Xeon 8490H: AVX-512 On .. 592.45 |================================= EPYC 9654: AVX-512 Off .. 660.54 |===================================== EPYC 9654: AVX-512 On ... 809.08 |============================================= Neural Magic DeepSparse 1.1 Model: CV Detection,YOLOv5s COCO - Scenario: Asynchronous Multi-Stream ms/batch < Lower Is Better Xeon 8380: AVX-512 Off .. 161.33 |============================================= Xeon 8380: AVX-512 On ... 125.16 |=================================== Xeon 8490H: AVX-512 Off . 147.46 |========================================= Xeon 8490H: AVX-512 On .. 101.04 |============================ EPYC 9654: AVX-512 Off .. 144.89 |======================================== EPYC 9654: AVX-512 On ... 118.35 |================================= Neural Magic DeepSparse 1.1 CPU Peak Freq (Highest CPU Core Frequency) Monitor Megahertz > Higher Is Better Xeon 8380: AVX-512 Off .. MIN: 2300 AVG: 2884 MAX: 3400 Xeon 8380: AVX-512 On ... MIN: 2300 AVG: 2673 MAX: 3410 Xeon 8490H: AVX-512 Off . MIN: 1900 AVG: 2540 MAX: 3513 Xeon 8490H: AVX-512 On .. MIN: 1900 AVG: 2475 MAX: 3509 EPYC 9654: AVX-512 Off .. MIN: 3709 AVG: 3709 MAX: 3709 EPYC 9654: AVX-512 On ... MIN: 3709 AVG: 3709 MAX: 3709 Neural Magic DeepSparse 1.1 CPU Power Consumption Monitor Watts < Lower Is Better Xeon 8380: AVX-512 Off .. MIN: 121 AVG: 486 MAX: 594 Xeon 8380: AVX-512 On ... MIN: 117 AVG: 488 MAX: 596 Xeon 8490H: AVX-512 Off . MIN: 213 AVG: 637 MAX: 774 Xeon 8490H: AVX-512 On .. MIN: 109 AVG: 637 MAX: 777 EPYC 9654: AVX-512 Off .. MIN: 34 AVG: 555 MAX: 672 EPYC 9654: AVX-512 On ... MIN: 60 AVG: 564 MAX: 674 Neural Magic DeepSparse 1.1 CPU Temperature Monitor Celsius < Lower Is Better Xeon 8380: AVX-512 Off .. MIN: 51 AVG: 70 MAX: 77 Xeon 8380: AVX-512 On ... MIN: 51 AVG: 70 MAX: 76 Xeon 8490H: AVX-512 Off . MIN: 35 AVG: 49 MAX: 53 Xeon 8490H: AVX-512 On .. MIN: 36 AVG: 50 MAX: 54 EPYC 9654: AVX-512 Off .. MIN: 34 AVG: 46 MAX: 51 EPYC 9654: AVX-512 On ... MIN: 34 AVG: 46 MAX: 51 Neural Magic DeepSparse 1.1 Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Synchronous Single-Stream items/sec > Higher Is Better Xeon 8380: AVX-512 Off .. 16.80 |====================== Xeon 8380: AVX-512 On ... 20.23 |=========================== Xeon 8490H: AVX-512 Off . 21.18 |============================ Xeon 8490H: AVX-512 On .. 26.84 |==================================== EPYC 9654: AVX-512 Off .. 30.46 |========================================= EPYC 9654: AVX-512 On ... 34.50 |============================================== Neural Magic DeepSparse 1.1 Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Synchronous Single-Stream ms/batch < Lower Is Better Xeon 8380: AVX-512 Off .. 59.52 |============================================== Xeon 8380: AVX-512 On ... 49.42 |====================================== Xeon 8490H: AVX-512 Off . 47.21 |==================================== Xeon 8490H: AVX-512 On .. 37.25 |============================= EPYC 9654: AVX-512 Off .. 32.83 |========================= EPYC 9654: AVX-512 On ... 28.98 |====================== Neural Magic DeepSparse 1.1 CPU Peak Freq (Highest CPU Core Frequency) Monitor Megahertz > Higher Is Better Xeon 8380: AVX-512 Off .. MIN: 2300 AVG: 2835 MAX: 3407 Xeon 8380: AVX-512 On ... MIN: 2300 AVG: 2708 MAX: 3403 Xeon 8490H: AVX-512 Off . MIN: 1900 AVG: 3338 MAX: 3520 Xeon 8490H: AVX-512 On .. MIN: 1900 AVG: 3216 MAX: 3518 EPYC 9654: AVX-512 Off .. MIN: 3709 AVG: 3709 MAX: 3709 EPYC 9654: AVX-512 On ... MIN: 3709 AVG: 3709 MAX: 3709 Neural Magic DeepSparse 1.1 CPU Power Consumption Monitor Watts < Lower Is Better Xeon 8380: AVX-512 Off .. MIN: 117 AVG: 308 MAX: 389 Xeon 8380: AVX-512 On ... MIN: 117 AVG: 307 MAX: 374 Xeon 8490H: AVX-512 Off . MIN: 209 AVG: 468 MAX: 561 Xeon 8490H: AVX-512 On .. MIN: 206 AVG: 463 MAX: 560 EPYC 9654: AVX-512 Off .. MIN: 58 AVG: 334 MAX: 425 EPYC 9654: AVX-512 On ... MIN: 57 AVG: 328 MAX: 420 Neural Magic DeepSparse 1.1 CPU Temperature Monitor Celsius < Lower Is Better Xeon 8380: AVX-512 Off .. MIN: 51.0 AVG: 65.4 MAX: 73.0 Xeon 8380: AVX-512 On ... MIN: 53.0 AVG: 67.3 MAX: 75.0 Xeon 8490H: AVX-512 Off . MIN: 36.0 AVG: 46.6 MAX: 53.0 Xeon 8490H: AVX-512 On .. MIN: 37.0 AVG: 47.7 MAX: 53.0 EPYC 9654: AVX-512 Off .. MIN: 34.6 AVG: 43.6 MAX: 48.4 EPYC 9654: AVX-512 On ... MIN: 34.1 AVG: 43.3 MAX: 48.0 Neural Magic DeepSparse 1.1 Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Stream items/sec > Higher Is Better Xeon 8380: AVX-512 Off .. 43.16 |================ Xeon 8380: AVX-512 On ... 48.24 |================== Xeon 8490H: AVX-512 Off . 66.73 |========================= Xeon 8490H: AVX-512 On .. 92.03 |================================== EPYC 9654: AVX-512 Off .. 120.52 |============================================= EPYC 9654: AVX-512 On ... 84.40 |================================ Neural Magic DeepSparse 1.1 Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Stream ms/batch < Lower Is Better Xeon 8380: AVX-512 Off .. 913.42 |=================================== Xeon 8380: AVX-512 On ... 821.96 |================================ Xeon 8490H: AVX-512 Off . 889.39 |=================================== Xeon 8490H: AVX-512 On .. 647.75 |========================= EPYC 9654: AVX-512 Off .. 787.72 |=============================== EPYC 9654: AVX-512 On ... 1132.61 |============================================ Neural Magic DeepSparse 1.1 CPU Peak Freq (Highest CPU Core Frequency) Monitor Megahertz > Higher Is Better Xeon 8380: AVX-512 Off .. MIN: 2300 AVG: 2852 MAX: 3409 Xeon 8380: AVX-512 On ... MIN: 2300 AVG: 2747 MAX: 3411 Xeon 8490H: AVX-512 Off . MIN: 1900 AVG: 2907 MAX: 3519 Xeon 8490H: AVX-512 On .. MIN: 1900 AVG: 2734 MAX: 3518 EPYC 9654: AVX-512 Off .. MIN: 3709 AVG: 3709 MAX: 3709 EPYC 9654: AVX-512 On ... MIN: 3697 AVG: 3709 MAX: 3709 Neural Magic DeepSparse 1.1 CPU Power Consumption Monitor Watts < Lower Is Better Xeon 8380: AVX-512 Off .. MIN: 121 AVG: 424 MAX: 596 Xeon 8380: AVX-512 On ... MIN: 116 AVG: 424 MAX: 596 Xeon 8490H: AVX-512 Off . MIN: 179 AVG: 576 MAX: 772 Xeon 8490H: AVX-512 On .. MIN: 185 AVG: 576 MAX: 777 EPYC 9654: AVX-512 Off .. MIN: 45 AVG: 492 MAX: 717 EPYC 9654: AVX-512 On ... MIN: 62 AVG: 450 MAX: 627 Neural Magic DeepSparse 1.1 CPU Temperature Monitor Celsius < Lower Is Better Xeon 8380: AVX-512 Off .. MIN: 51.0 AVG: 64.8 MAX: 74.0 Xeon 8380: AVX-512 On ... MIN: 54.0 AVG: 66.8 MAX: 75.0 Xeon 8490H: AVX-512 Off . MIN: 37.0 AVG: 46.7 MAX: 54.0 Xeon 8490H: AVX-512 On .. MIN: 38.0 AVG: 47.8 MAX: 53.0 EPYC 9654: AVX-512 Off .. MIN: 34.6 AVG: 44.8 MAX: 55.1 EPYC 9654: AVX-512 On ... MIN: 34.6 AVG: 43.5 MAX: 49.5 LeelaChessZero 0.28 Backend: BLAS Nodes Per Second > Higher Is Better Xeon 8380: AVX-512 Off .. 4780 |===================== Xeon 8380: AVX-512 On ... 5524 |======================== Xeon 8490H: AVX-512 Off . 7542 |================================= Xeon 8490H: AVX-512 On .. 10671 |============================================== EPYC 9654: AVX-512 Off .. 9425 |========================================= EPYC 9654: AVX-512 On ... 9171 |======================================== LeelaChessZero 0.28 Backend: BLAS Nodes Per Second Per Watt > Higher Is Better Xeon 8380: AVX-512 Off .. 12.09 |======================= Xeon 8380: AVX-512 On ... 14.01 |========================== Xeon 8490H: AVX-512 Off . 14.11 |========================== Xeon 8490H: AVX-512 On .. 19.81 |===================================== EPYC 9654: AVX-512 Off .. 24.70 |============================================== EPYC 9654: AVX-512 On ... 24.19 |============================================= LeelaChessZero 0.28 CPU Peak Freq (Highest CPU Core Frequency) Monitor Megahertz > Higher Is Better Xeon 8380: AVX-512 Off .. MIN: 2300 AVG: 3293 MAX: 3407 Xeon 8380: AVX-512 On ... MIN: 2300 AVG: 3286 MAX: 3420 Xeon 8490H: AVX-512 Off . MIN: 1900 AVG: 3429 MAX: 3524 Xeon 8490H: AVX-512 On .. MIN: 1900 AVG: 3433 MAX: 3523 EPYC 9654: AVX-512 Off .. MIN: 3709 AVG: 3709 MAX: 3709 EPYC 9654: AVX-512 On ... MIN: 3709 AVG: 3709 MAX: 3731 LeelaChessZero 0.28 CPU Power Consumption Monitor Watts < Lower Is Better Xeon 8380: AVX-512 Off .. MIN: 118 AVG: 395 MAX: 593 Xeon 8380: AVX-512 On ... MIN: 82 AVG: 394 MAX: 584 Xeon 8490H: AVX-512 Off . MIN: 207 AVG: 535 MAX: 716 Xeon 8490H: AVX-512 On .. MIN: 209 AVG: 539 MAX: 766 EPYC 9654: AVX-512 Off .. MIN: 56 AVG: 382 MAX: 520 EPYC 9654: AVX-512 On ... MIN: 57 AVG: 379 MAX: 512 LeelaChessZero 0.28 CPU Temperature Monitor Celsius < Lower Is Better Xeon 8380: AVX-512 Off .. MIN: 45 AVG: 60 MAX: 85 Xeon 8380: AVX-512 On ... MIN: 54 AVG: 71 MAX: 78 Xeon 8490H: AVX-512 Off . MIN: 36 AVG: 49 MAX: 59 Xeon 8490H: AVX-512 On .. MIN: 35 AVG: 44 MAX: 56 EPYC 9654: AVX-512 Off .. MIN: 34 AVG: 47 MAX: 58 EPYC 9654: AVX-512 On ... MIN: 33 AVG: 41 MAX: 55 LeelaChessZero 0.28 Backend: Eigen Nodes Per Second > Higher Is Better Xeon 8380: AVX-512 Off .. 4709 |=================== Xeon 8380: AVX-512 On ... 5750 |======================== Xeon 8490H: AVX-512 Off . 8243 |================================== Xeon 8490H: AVX-512 On .. 11134 |============================================== EPYC 9654: AVX-512 Off .. 8161 |================================== EPYC 9654: AVX-512 On ... 9085 |====================================== LeelaChessZero 0.28 Backend: Eigen Nodes Per Second Per Watt > Higher Is Better Xeon 8380: AVX-512 Off .. 12.06 |====================== Xeon 8380: AVX-512 On ... 14.53 |=========================== Xeon 8490H: AVX-512 Off . 15.38 |============================= Xeon 8490H: AVX-512 On .. 20.61 |====================================== EPYC 9654: AVX-512 Off .. 21.89 |========================================= EPYC 9654: AVX-512 On ... 24.74 |============================================== LeelaChessZero 0.28 CPU Peak Freq (Highest CPU Core Frequency) Monitor Megahertz > Higher Is Better Xeon 8380: AVX-512 Off .. MIN: 2300 AVG: 3282 MAX: 3416 Xeon 8380: AVX-512 On ... MIN: 2300 AVG: 3284 MAX: 3411 Xeon 8490H: AVX-512 Off . MIN: 1900 AVG: 3415 MAX: 3542 Xeon 8490H: AVX-512 On .. MIN: 1900 AVG: 3432 MAX: 3563 EPYC 9654: AVX-512 Off .. MIN: 3709 AVG: 3709 MAX: 3709 EPYC 9654: AVX-512 On ... MIN: 3709 AVG: 3709 MAX: 3711 LeelaChessZero 0.28 CPU Power Consumption Monitor Watts < Lower Is Better Xeon 8380: AVX-512 Off .. MIN: 124 AVG: 390 MAX: 591 Xeon 8380: AVX-512 On ... MIN: 123 AVG: 396 MAX: 586 Xeon 8490H: AVX-512 Off . MIN: 207 AVG: 536 MAX: 731 Xeon 8490H: AVX-512 On .. MIN: 211 AVG: 540 MAX: 767 EPYC 9654: AVX-512 Off .. MIN: 58 AVG: 373 MAX: 520 EPYC 9654: AVX-512 On ... MIN: 60 AVG: 367 MAX: 503 LeelaChessZero 0.28 CPU Temperature Monitor Celsius < Lower Is Better Xeon 8380: AVX-512 Off .. MIN: 44 AVG: 65 MAX: 84 Xeon 8380: AVX-512 On ... MIN: 45 AVG: 66 MAX: 82 Xeon 8490H: AVX-512 Off . MIN: 35 AVG: 48 MAX: 56 Xeon 8490H: AVX-512 On .. MIN: 34 AVG: 44 MAX: 56 EPYC 9654: AVX-512 Off .. MIN: 35 AVG: 46 MAX: 59 EPYC 9654: AVX-512 On ... MIN: 33 AVG: 41 MAX: 54 Embree 3.13 Binary: Pathtracer ISPC - Model: Asian Dragon Frames Per Second > Higher Is Better Xeon 8380: AVX-512 Off .. 96.34 |==================== Xeon 8380: AVX-512 On ... 106.18 |====================== Xeon 8490H: AVX-512 Off . 90.40 |=================== Xeon 8490H: AVX-512 On .. 122.53 |========================== EPYC 9654: AVX-512 Off .. 177.68 |===================================== EPYC 9654: AVX-512 On ... 213.95 |============================================= Embree 3.13 Binary: Pathtracer ISPC - Model: Asian Dragon Frames Per Second Per Watt > Higher Is Better Xeon 8380: AVX-512 Off .. 0.240 |================ Xeon 8380: AVX-512 On ... 0.272 |================== Xeon 8490H: AVX-512 Off . 0.168 |=========== Xeon 8490H: AVX-512 On .. 0.255 |================= EPYC 9654: AVX-512 Off .. 0.518 |=================================== EPYC 9654: AVX-512 On ... 0.690 |============================================== Embree 3.13 CPU Peak Freq (Highest CPU Core Frequency) Monitor Megahertz > Higher Is Better Xeon 8380: AVX-512 Off .. MIN: 2300 AVG: 2765 MAX: 3401 Xeon 8380: AVX-512 On ... MIN: 2300 AVG: 2565 MAX: 3400 Xeon 8490H: AVX-512 Off . MIN: 1900 AVG: 3075 MAX: 3507 Xeon 8490H: AVX-512 On .. MIN: 1900 AVG: 3148 MAX: 3511 EPYC 9654: AVX-512 Off .. MIN: 2833 AVG: 3434 MAX: 3709 EPYC 9654: AVX-512 On ... MIN: 2918 AVG: 3474 MAX: 3709 Embree 3.13 CPU Power Consumption Monitor Watts < Lower Is Better Xeon 8380: AVX-512 Off .. MIN: 102 AVG: 401 MAX: 615 Xeon 8380: AVX-512 On ... MIN: 123 AVG: 390 MAX: 625 Xeon 8490H: AVX-512 Off . MIN: 206 AVG: 537 MAX: 760 Xeon 8490H: AVX-512 On .. MIN: 207 AVG: 480 MAX: 709 EPYC 9654: AVX-512 Off .. MIN: 27 AVG: 343 MAX: 711 EPYC 9654: AVX-512 On ... MIN: 37 AVG: 310 MAX: 703 Embree 3.13 CPU Temperature Monitor Celsius < Lower Is Better Xeon 8380: AVX-512 Off .. MIN: 44.0 AVG: 57.3 MAX: 66.0 Xeon 8380: AVX-512 On ... MIN: 50.0 AVG: 59.7 MAX: 67.0 Xeon 8490H: AVX-512 Off . MIN: 39.0 AVG: 46.5 MAX: 51.0 Xeon 8490H: AVX-512 On .. MIN: 34.0 AVG: 41.4 MAX: 47.0 EPYC 9654: AVX-512 Off .. MIN: 35.9 AVG: 41.2 MAX: 48.0 EPYC 9654: AVX-512 On ... MIN: 32.4 AVG: 38.0 MAX: 44.4 Embree 3.13 Binary: Pathtracer ISPC - Model: Crown Frames Per Second > Higher Is Better Xeon 8380: AVX-512 Off .. 70.51 |================= Xeon 8380: AVX-512 On ... 74.80 |=================== Xeon 8490H: AVX-512 Off . 62.04 |=============== Xeon 8490H: AVX-512 On .. 92.65 |======================= EPYC 9654: AVX-512 Off .. 153.18 |====================================== EPYC 9654: AVX-512 On ... 181.89 |============================================= Embree 3.13 Binary: Pathtracer ISPC - Model: Crown Frames Per Second Per Watt > Higher Is Better Xeon 8380: AVX-512 Off .. 0.167 |=============== Xeon 8380: AVX-512 On ... 0.184 |================= Xeon 8490H: AVX-512 Off . 0.110 |========== Xeon 8490H: AVX-512 On .. 0.193 |================= EPYC 9654: AVX-512 Off .. 0.418 |====================================== EPYC 9654: AVX-512 On ... 0.509 |============================================== Embree 3.13 CPU Peak Freq (Highest CPU Core Frequency) Monitor Megahertz > Higher Is Better Xeon 8380: AVX-512 Off .. MIN: 2300 AVG: 2850 MAX: 3400 Xeon 8380: AVX-512 On ... MIN: 2300 AVG: 2636 MAX: 3400 Xeon 8490H: AVX-512 Off . MIN: 1900 AVG: 3071 MAX: 3512 Xeon 8490H: AVX-512 On .. MIN: 1900 AVG: 3007 MAX: 3508 EPYC 9654: AVX-512 Off .. MIN: 2771 AVG: 3463 MAX: 3709 EPYC 9654: AVX-512 On ... MIN: 2763 AVG: 3454 MAX: 3709 Embree 3.13 CPU Power Consumption Monitor Watts < Lower Is Better Xeon 8380: AVX-512 Off .. MIN: 80 AVG: 422 MAX: 584 Xeon 8380: AVX-512 On ... MIN: 118 AVG: 406 MAX: 561 Xeon 8490H: AVX-512 Off . MIN: 173 AVG: 565 MAX: 755 Xeon 8490H: AVX-512 On .. MIN: 209 AVG: 479 MAX: 666 EPYC 9654: AVX-512 Off .. MIN: 43 AVG: 367 MAX: 692 EPYC 9654: AVX-512 On ... MIN: 36 AVG: 357 MAX: 701 Embree 3.13 CPU Temperature Monitor Celsius < Lower Is Better Xeon 8380: AVX-512 Off .. MIN: 48.0 AVG: 61.4 MAX: 69.0 Xeon 8380: AVX-512 On ... MIN: 46.0 AVG: 57.9 MAX: 65.0 Xeon 8490H: AVX-512 Off . MIN: 37.0 AVG: 46.8 MAX: 51.0 Xeon 8490H: AVX-512 On .. MIN: 34.0 AVG: 42.4 MAX: 48.0 EPYC 9654: AVX-512 Off .. MIN: 35.0 AVG: 42.2 MAX: 48.9 EPYC 9654: AVX-512 On ... MIN: 33.3 AVG: 40.0 MAX: 46.6 OpenVKL 1.3.1 Benchmark: vklBenchmark ISPC Items / Sec > Higher Is Better Xeon 8380: AVX-512 Off .. 792 |============================ Xeon 8380: AVX-512 On ... 917 |================================ Xeon 8490H: AVX-512 Off . 1034 |==================================== Xeon 8490H: AVX-512 On .. 1196 |========================================== EPYC 9654: AVX-512 Off .. 1176 |========================================= EPYC 9654: AVX-512 On ... 1341 |=============================================== OpenVKL 1.3.1 Benchmark: vklBenchmark ISPC Items / Sec Per Watt > Higher Is Better Xeon 8380: AVX-512 Off .. 1.734 |============================ Xeon 8380: AVX-512 On ... 2.014 |================================ Xeon 8490H: AVX-512 Off . 1.726 |============================ Xeon 8490H: AVX-512 On .. 2.057 |================================= EPYC 9654: AVX-512 Off .. 2.405 |====================================== EPYC 9654: AVX-512 On ... 2.874 |============================================== OpenVKL 1.3.1 CPU Peak Freq (Highest CPU Core Frequency) Monitor Megahertz > Higher Is Better Xeon 8380: AVX-512 Off .. MIN: 2300 AVG: 2989 MAX: 3410 Xeon 8380: AVX-512 On ... MIN: 2262 AVG: 2929 MAX: 3409 Xeon 8490H: AVX-512 Off . MIN: 1899 AVG: 2931 MAX: 3519 Xeon 8490H: AVX-512 On .. MIN: 1169 AVG: 2888 MAX: 3515 EPYC 9654: AVX-512 Off .. MIN: 2621 AVG: 3442 MAX: 3709 EPYC 9654: AVX-512 On ... MIN: 2591 AVG: 3486 MAX: 3709 OpenVKL 1.3.1 CPU Power Consumption Monitor Watts < Lower Is Better Xeon 8380: AVX-512 Off .. MIN: 101 AVG: 457 MAX: 653 Xeon 8380: AVX-512 On ... MIN: 100 AVG: 455 MAX: 653 Xeon 8490H: AVX-512 Off . MIN: 183 AVG: 599 MAX: 805 Xeon 8490H: AVX-512 On .. MIN: 179 AVG: 581 MAX: 786 EPYC 9654: AVX-512 Off .. MIN: 60 AVG: 489 MAX: 748 EPYC 9654: AVX-512 On ... MIN: 57 AVG: 467 MAX: 707 OpenVKL 1.3.1 CPU Temperature Monitor Celsius < Lower Is Better Xeon 8380: AVX-512 Off .. MIN: 50 AVG: 70 MAX: 80 Xeon 8380: AVX-512 On ... MIN: 46 AVG: 69 MAX: 78 Xeon 8490H: AVX-512 Off . MIN: 36 AVG: 50 MAX: 57 Xeon 8490H: AVX-512 On .. MIN: 35 AVG: 49 MAX: 56 EPYC 9654: AVX-512 Off .. MIN: 36 AVG: 47 MAX: 55 EPYC 9654: AVX-512 On ... MIN: 34 AVG: 45 MAX: 53 Intel Open Image Denoise 1.4.0 Run: RT.hdr_alb_nrm.3840x2160 Images / Sec > Higher Is Better Xeon 8380: AVX-512 Off .. 2.07 |======================= Xeon 8380: AVX-512 On ... 2.94 |================================= Xeon 8490H: AVX-512 Off . 2.95 |================================= Xeon 8490H: AVX-512 On .. 4.19 |=============================================== EPYC 9654: AVX-512 Off .. 3.46 |======================================= EPYC 9654: AVX-512 On ... 3.48 |======================================= Intel Open Image Denoise 1.4.0 Run: RT.hdr_alb_nrm.3840x2160 Images / Sec Per Watt > Higher Is Better Xeon 8380: AVX-512 Off .. 0.006 |======================= Xeon 8380: AVX-512 On ... 0.009 |=================================== Xeon 8490H: AVX-512 Off . 0.007 |=========================== Xeon 8490H: AVX-512 On .. 0.010 |====================================== EPYC 9654: AVX-512 Off .. 0.012 |============================================== EPYC 9654: AVX-512 On ... 0.012 |============================================== Intel Open Image Denoise 1.4.0 CPU Peak Freq (Highest CPU Core Frequency) Monitor Megahertz > Higher Is Better Xeon 8380: AVX-512 Off .. MIN: 2300 AVG: 2644 MAX: 3400 Xeon 8380: AVX-512 On ... MIN: 2300 AVG: 2484 MAX: 3123 Xeon 8490H: AVX-512 Off . MIN: 1900 AVG: 2977 MAX: 3510 Xeon 8490H: AVX-512 On .. MIN: 1900 AVG: 2985 MAX: 3510 EPYC 9654: AVX-512 Off .. MIN: 3709 AVG: 3709 MAX: 3709 EPYC 9654: AVX-512 On ... MIN: 3709 AVG: 3709 MAX: 3709 Intel Open Image Denoise 1.4.0 CPU Power Consumption Monitor Watts < Lower Is Better Xeon 8380: AVX-512 Off .. MIN: 117 AVG: 351 MAX: 568 Xeon 8380: AVX-512 On ... MIN: 79 AVG: 329 MAX: 564 Xeon 8490H: AVX-512 Off . MIN: 191 AVG: 447 MAX: 747 Xeon 8490H: AVX-512 On .. MIN: 122 AVG: 433 MAX: 757 EPYC 9654: AVX-512 Off .. MIN: 55 AVG: 292 MAX: 587 EPYC 9654: AVX-512 On ... MIN: 60 AVG: 289 MAX: 584 Intel Open Image Denoise 1.4.0 CPU Temperature Monitor Celsius < Lower Is Better Xeon 8380: AVX-512 Off .. MIN: 50.0 AVG: 61.2 MAX: 75.0 Xeon 8380: AVX-512 On ... MIN: 48.0 AVG: 59.5 MAX: 72.0 Xeon 8490H: AVX-512 Off . MIN: 37.0 AVG: 43.0 MAX: 50.0 Xeon 8490H: AVX-512 On .. MIN: 37.0 AVG: 42.1 MAX: 50.0 EPYC 9654: AVX-512 Off .. MIN: 35.9 AVG: 40.6 MAX: 46.6 EPYC 9654: AVX-512 On ... MIN: 35.0 AVG: 39.3 MAX: 45.5 Intel Open Image Denoise 1.4.0 Run: RTLightmap.hdr.4096x4096 Images / Sec > Higher Is Better Xeon 8380: AVX-512 Off .. 1.03 |======================== Xeon 8380: AVX-512 On ... 1.42 |================================== Xeon 8490H: AVX-512 Off . 1.48 |=================================== Xeon 8490H: AVX-512 On .. 1.99 |=============================================== EPYC 9654: AVX-512 Off .. 1.72 |========================================= EPYC 9654: AVX-512 On ... 1.66 |======================================= Intel Open Image Denoise 1.4.0 Run: RTLightmap.hdr.4096x4096 Images / Sec Per Watt > Higher Is Better Xeon 8380: AVX-512 Off .. 0.003 |============================ Xeon 8380: AVX-512 On ... 0.004 |===================================== Xeon 8490H: AVX-512 Off . 0.003 |============================ Xeon 8490H: AVX-512 On .. 0.004 |===================================== EPYC 9654: AVX-512 Off .. 0.005 |============================================== EPYC 9654: AVX-512 On ... 0.005 |============================================== Intel Open Image Denoise 1.4.0 CPU Peak Freq (Highest CPU Core Frequency) Monitor Megahertz > Higher Is Better Xeon 8380: AVX-512 Off .. MIN: 2300 AVG: 2632 MAX: 3400 Xeon 8380: AVX-512 On ... MIN: 2300 AVG: 2544 MAX: 3400 Xeon 8490H: AVX-512 Off . MIN: 1900 AVG: 2888 MAX: 3505 Xeon 8490H: AVX-512 On .. MIN: 1900 AVG: 2756 MAX: 3503 EPYC 9654: AVX-512 Off .. MIN: 3709 AVG: 3709 MAX: 3709 EPYC 9654: AVX-512 On ... MIN: 3709 AVG: 3709 MAX: 3709 Intel Open Image Denoise 1.4.0 CPU Power Consumption Monitor Watts < Lower Is Better Xeon 8380: AVX-512 Off .. MIN: 81 AVG: 375 MAX: 566 Xeon 8380: AVX-512 On ... MIN: 120 AVG: 360 MAX: 568 Xeon 8490H: AVX-512 Off . MIN: 204 AVG: 488 MAX: 755 Xeon 8490H: AVX-512 On .. MIN: 207 AVG: 478 MAX: 754 EPYC 9654: AVX-512 Off .. MIN: 31 AVG: 329 MAX: 583 EPYC 9654: AVX-512 On ... MIN: 58 AVG: 332 MAX: 581 Intel Open Image Denoise 1.4.0 CPU Temperature Monitor Celsius < Lower Is Better Xeon 8380: AVX-512 Off .. MIN: 47.0 AVG: 59.2 MAX: 71.0 Xeon 8380: AVX-512 On ... MIN: 45.0 AVG: 57.8 MAX: 69.0 Xeon 8490H: AVX-512 Off . MIN: 35.0 AVG: 43.4 MAX: 50.0 Xeon 8490H: AVX-512 On .. MIN: 35.0 AVG: 42.3 MAX: 49.0 EPYC 9654: AVX-512 Off .. MIN: 34.6 AVG: 40.9 MAX: 46.6 EPYC 9654: AVX-512 On ... MIN: 33.3 AVG: 39.7 MAX: 46.4 OSPRay 2.10 Benchmark: gravity_spheres_volume/dim_512/ao/real_time Items Per Second > Higher Is Better Xeon 8380: AVX-512 Off .. 14.35 |=============== Xeon 8380: AVX-512 On ... 21.22 |====================== Xeon 8490H: AVX-512 Off . 23.17 |======================== Xeon 8490H: AVX-512 On .. 36.36 |====================================== EPYC 9654: AVX-512 Off .. 26.40 |============================ EPYC 9654: AVX-512 On ... 43.71 |============================================== OSPRay 2.10 Benchmark: gravity_spheres_volume/dim_512/ao/real_time Items Per Second Per Watt > Higher Is Better Xeon 8380: AVX-512 Off .. 0.027 |================= Xeon 8380: AVX-512 On ... 0.040 |========================= Xeon 8490H: AVX-512 Off . 0.034 |===================== Xeon 8490H: AVX-512 On .. 0.054 |================================= EPYC 9654: AVX-512 Off .. 0.043 |========================== EPYC 9654: AVX-512 On ... 0.075 |============================================== OSPRay 2.10 CPU Peak Freq (Highest CPU Core Frequency) Monitor Megahertz > Higher Is Better Xeon 8380: AVX-512 Off .. MIN: 2300 AVG: 2855 MAX: 3400 Xeon 8380: AVX-512 On ... MIN: 2300 AVG: 2867 MAX: 3402 Xeon 8490H: AVX-512 Off . MIN: 1900 AVG: 2901 MAX: 3504 Xeon 8490H: AVX-512 On .. MIN: 1900 AVG: 2653 MAX: 3514 EPYC 9654: AVX-512 Off .. MIN: 2771 AVG: 3210 MAX: 3709 EPYC 9654: AVX-512 On ... MIN: 2802 AVG: 3316 MAX: 3709 OSPRay 2.10 CPU Power Consumption Monitor Watts < Lower Is Better Xeon 8380: AVX-512 Off .. MIN: 119 AVG: 525 MAX: 618 Xeon 8380: AVX-512 On ... MIN: 119 AVG: 530 MAX: 642 Xeon 8490H: AVX-512 Off . MIN: 108 AVG: 689 MAX: 819 Xeon 8490H: AVX-512 On .. MIN: 209 AVG: 676 MAX: 802 EPYC 9654: AVX-512 Off .. MIN: 57 AVG: 614 MAX: 718 EPYC 9654: AVX-512 On ... MIN: 56 AVG: 581 MAX: 668 OSPRay 2.10 CPU Temperature Monitor Celsius < Lower Is Better Xeon 8380: AVX-512 Off .. MIN: 46 AVG: 73 MAX: 79 Xeon 8380: AVX-512 On ... MIN: 46 AVG: 74 MAX: 80 Xeon 8490H: AVX-512 Off . MIN: 35 AVG: 54 MAX: 58 Xeon 8490H: AVX-512 On .. MIN: 34 AVG: 53 MAX: 57 EPYC 9654: AVX-512 Off .. MIN: 35 AVG: 52 MAX: 55 EPYC 9654: AVX-512 On ... MIN: 33 AVG: 49 MAX: 52 OSPRay 2.10 Benchmark: gravity_spheres_volume/dim_512/scivis/real_time Items Per Second > Higher Is Better Xeon 8380: AVX-512 Off .. 13.78 |=============== Xeon 8380: AVX-512 On ... 21.06 |====================== Xeon 8490H: AVX-512 Off . 22.83 |======================== Xeon 8490H: AVX-512 On .. 35.95 |====================================== EPYC 9654: AVX-512 Off .. 25.31 |=========================== EPYC 9654: AVX-512 On ... 43.24 |============================================== OSPRay 2.10 Benchmark: gravity_spheres_volume/dim_512/scivis/real_time Items Per Second Per Watt > Higher Is Better Xeon 8380: AVX-512 Off .. 0.026 |================ Xeon 8380: AVX-512 On ... 0.040 |========================= Xeon 8490H: AVX-512 Off . 0.033 |===================== Xeon 8490H: AVX-512 On .. 0.053 |================================= EPYC 9654: AVX-512 Off .. 0.041 |========================= EPYC 9654: AVX-512 On ... 0.074 |============================================== OSPRay 2.10 CPU Peak Freq (Highest CPU Core Frequency) Monitor Megahertz > Higher Is Better Xeon 8380: AVX-512 Off .. MIN: 2300 AVG: 2843 MAX: 3400 Xeon 8380: AVX-512 On ... MIN: 2200 AVG: 2873 MAX: 3400 Xeon 8490H: AVX-512 Off . MIN: 1900 AVG: 2870 MAX: 3506 Xeon 8490H: AVX-512 On .. MIN: 1900 AVG: 2690 MAX: 3502 EPYC 9654: AVX-512 Off .. MIN: 2771 AVG: 3287 MAX: 3709 EPYC 9654: AVX-512 On ... MIN: 2796 AVG: 3268 MAX: 3709 OSPRay 2.10 CPU Power Consumption Monitor Watts < Lower Is Better Xeon 8380: AVX-512 Off .. MIN: 133 AVG: 524 MAX: 646 Xeon 8380: AVX-512 On ... MIN: 125 AVG: 529 MAX: 633 Xeon 8490H: AVX-512 Off . MIN: 207 AVG: 688 MAX: 807 Xeon 8490H: AVX-512 On .. MIN: 211 AVG: 675 MAX: 797 EPYC 9654: AVX-512 Off .. MIN: 58 AVG: 617 MAX: 718 EPYC 9654: AVX-512 On ... MIN: 60 AVG: 582 MAX: 673 OSPRay 2.10 CPU Temperature Monitor Celsius < Lower Is Better Xeon 8380: AVX-512 Off .. MIN: 56.0 AVG: 72.2 MAX: 76.0 Xeon 8380: AVX-512 On ... MIN: 52.0 AVG: 71.6 MAX: 75.0 Xeon 8490H: AVX-512 Off . MIN: 39.0 AVG: 55.1 MAX: 58.0 Xeon 8490H: AVX-512 On .. MIN: 40.0 AVG: 53.8 MAX: 57.0 EPYC 9654: AVX-512 Off .. MIN: 37.8 AVG: 52.8 MAX: 55.5 EPYC 9654: AVX-512 On ... MIN: 35.9 AVG: 49.7 MAX: 52.9 OSPRay 2.10 Benchmark: gravity_spheres_volume/dim_512/pathtracer/real_time Items Per Second > Higher Is Better Xeon 8380: AVX-512 Off .. 19.96 |================= Xeon 8380: AVX-512 On ... 25.52 |====================== Xeon 8490H: AVX-512 Off . 32.48 |============================ Xeon 8490H: AVX-512 On .. 42.97 |==================================== EPYC 9654: AVX-512 Off .. 40.67 |=================================== EPYC 9654: AVX-512 On ... 54.16 |============================================== OSPRay 2.10 Benchmark: gravity_spheres_volume/dim_512/pathtracer/real_time Items Per Second Per Watt > Higher Is Better Xeon 8380: AVX-512 Off .. 0.038 |=================== Xeon 8380: AVX-512 On ... 0.049 |========================= Xeon 8490H: AVX-512 Off . 0.048 |======================== Xeon 8490H: AVX-512 On .. 0.064 |================================ EPYC 9654: AVX-512 Off .. 0.065 |================================= EPYC 9654: AVX-512 On ... 0.092 |============================================== OSPRay 2.10 CPU Peak Freq (Highest CPU Core Frequency) Monitor Megahertz > Higher Is Better Xeon 8380: AVX-512 Off .. MIN: 2293 AVG: 2874 MAX: 3400 Xeon 8380: AVX-512 On ... MIN: 2300 AVG: 2590 MAX: 3402 Xeon 8490H: AVX-512 Off . MIN: 1900 AVG: 2828 MAX: 3508 Xeon 8490H: AVX-512 On .. MIN: 1900 AVG: 2769 MAX: 3512 EPYC 9654: AVX-512 Off .. MIN: 2690 AVG: 3284 MAX: 3709 EPYC 9654: AVX-512 On ... MIN: 2764 AVG: 3287 MAX: 3772 OSPRay 2.10 CPU Power Consumption Monitor Watts < Lower Is Better Xeon 8380: AVX-512 Off .. MIN: 123 AVG: 530 MAX: 640 Xeon 8380: AVX-512 On ... MIN: 80 AVG: 524 MAX: 630 Xeon 8490H: AVX-512 Off . MIN: 206 AVG: 679 MAX: 796 Xeon 8490H: AVX-512 On .. MIN: 211 AVG: 667 MAX: 772 EPYC 9654: AVX-512 Off .. MIN: 62 AVG: 624 MAX: 724 EPYC 9654: AVX-512 On ... MIN: 60 AVG: 592 MAX: 680 OSPRay 2.10 CPU Temperature Monitor Celsius < Lower Is Better Xeon 8380: AVX-512 Off .. MIN: 55 AVG: 73 MAX: 77 Xeon 8380: AVX-512 On ... MIN: 53 AVG: 72 MAX: 75 Xeon 8490H: AVX-512 Off . MIN: 40 AVG: 55 MAX: 58 Xeon 8490H: AVX-512 On .. MIN: 39 AVG: 54 MAX: 58 EPYC 9654: AVX-512 Off .. MIN: 37 AVG: 53 MAX: 57 EPYC 9654: AVX-512 On ... MIN: 36 AVG: 51 MAX: 53 OSPRay Studio 0.11 Camera: 1 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path Tracer ms < Lower Is Better Xeon 8380: AVX-512 Off .. 1491 |=============================================== Xeon 8380: AVX-512 On ... 1308 |========================================= Xeon 8490H: AVX-512 Off . 980 |=============================== Xeon 8490H: AVX-512 On .. 859 |=========================== EPYC 9654: AVX-512 Off .. 705 |====================== EPYC 9654: AVX-512 On ... 581 |================== OSPRay Studio 0.11 CPU Peak Freq (Highest CPU Core Frequency) Monitor Megahertz > Higher Is Better Xeon 8380: AVX-512 Off .. MIN: 1783 AVG: 2894 MAX: 3403 Xeon 8380: AVX-512 On ... MIN: 2300 AVG: 2622 MAX: 3401 Xeon 8490H: AVX-512 Off . MIN: 1900 AVG: 2891 MAX: 3545 Xeon 8490H: AVX-512 On .. MIN: 1900 AVG: 2819 MAX: 3514 EPYC 9654: AVX-512 Off .. MIN: 2720 AVG: 3276 MAX: 3709 EPYC 9654: AVX-512 On ... MIN: 2646 AVG: 3230 MAX: 3709 OSPRay Studio 0.11 CPU Power Consumption Monitor Watts < Lower Is Better Xeon 8380: AVX-512 Off .. MIN: 130 AVG: 501 MAX: 658 Xeon 8380: AVX-512 On ... MIN: 102 AVG: 497 MAX: 662 Xeon 8490H: AVX-512 Off . MIN: 212 AVG: 664 MAX: 881 Xeon 8490H: AVX-512 On .. MIN: 178 AVG: 662 MAX: 876 EPYC 9654: AVX-512 Off .. MIN: 60 AVG: 615 MAX: 792 EPYC 9654: AVX-512 On ... MIN: 61 AVG: 612 MAX: 770 OSPRay Studio 0.11 CPU Temperature Monitor Celsius < Lower Is Better Xeon 8380: AVX-512 Off .. MIN: 54.0 AVG: 69.4 MAX: 76.0 Xeon 8380: AVX-512 On ... MIN: 53.0 AVG: 69.1 MAX: 75.0 Xeon 8490H: AVX-512 Off . MIN: 35.0 AVG: 51.9 MAX: 57.0 Xeon 8490H: AVX-512 On .. MIN: 35.0 AVG: 51.7 MAX: 57.0 EPYC 9654: AVX-512 Off .. MIN: 37.3 AVG: 51.9 MAX: 55.5 EPYC 9654: AVX-512 On ... MIN: 36.4 AVG: 50.5 MAX: 53.8 OSPRay Studio 0.11 Camera: 1 - Resolution: 4K - Samples Per Pixel: 16 - Renderer: Path Tracer ms < Lower Is Better Xeon 8380: AVX-512 Off .. 23943 |============================================== Xeon 8380: AVX-512 On ... 20872 |======================================== Xeon 8490H: AVX-512 Off . 15601 |============================== Xeon 8490H: AVX-512 On .. 13589 |========================== EPYC 9654: AVX-512 Off .. 11216 |====================== EPYC 9654: AVX-512 On ... 9260 |================== OSPRay Studio 0.11 CPU Peak Freq (Highest CPU Core Frequency) Monitor Megahertz > Higher Is Better Xeon 8380: AVX-512 Off .. MIN: 1631 AVG: 2895 MAX: 3404 Xeon 8380: AVX-512 On ... MIN: 2300 AVG: 2639 MAX: 3403 Xeon 8490H: AVX-512 Off . MIN: 1900 AVG: 2892 MAX: 3509 Xeon 8490H: AVX-512 On .. MIN: 1900 AVG: 2766 MAX: 3509 EPYC 9654: AVX-512 Off .. MIN: 2773 AVG: 3123 MAX: 3709 EPYC 9654: AVX-512 On ... MIN: 2682 AVG: 3158 MAX: 3709 OSPRay Studio 0.11 CPU Power Consumption Monitor Watts < Lower Is Better Xeon 8380: AVX-512 Off .. MIN: 130 AVG: 497 MAX: 659 Xeon 8380: AVX-512 On ... MIN: 123 AVG: 489 MAX: 663 Xeon 8490H: AVX-512 Off . MIN: 206 AVG: 650 MAX: 878 Xeon 8490H: AVX-512 On .. MIN: 215 AVG: 685 MAX: 875 EPYC 9654: AVX-512 Off .. MIN: 61 AVG: 648 MAX: 799 EPYC 9654: AVX-512 On ... MIN: 57 AVG: 627 MAX: 784 OSPRay Studio 0.11 CPU Temperature Monitor Celsius < Lower Is Better Xeon 8380: AVX-512 Off .. MIN: 53.0 AVG: 68.8 MAX: 75.0 Xeon 8380: AVX-512 On ... MIN: 50.0 AVG: 67.1 MAX: 74.0 Xeon 8490H: AVX-512 Off . MIN: 38.0 AVG: 51.8 MAX: 57.0 Xeon 8490H: AVX-512 On .. MIN: 38.0 AVG: 53.8 MAX: 58.0 EPYC 9654: AVX-512 Off .. MIN: 37.3 AVG: 53.3 MAX: 58.3 EPYC 9654: AVX-512 On ... MIN: 36.8 AVG: 51.4 MAX: 55.3 OSPRay Studio 0.11 Camera: 1 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path Tracer ms < Lower Is Better Xeon 8380: AVX-512 Off .. 48165 |============================================== Xeon 8380: AVX-512 On ... 41834 |======================================== Xeon 8490H: AVX-512 Off . 31373 |============================== Xeon 8490H: AVX-512 On .. 27204 |========================== EPYC 9654: AVX-512 Off .. 22475 |===================== EPYC 9654: AVX-512 On ... 18500 |================== OSPRay Studio 0.11 CPU Peak Freq (Highest CPU Core Frequency) Monitor Megahertz > Higher Is Better Xeon 8380: AVX-512 Off .. MIN: 1740 AVG: 2881 MAX: 3403 Xeon 8380: AVX-512 On ... MIN: 2300 AVG: 2595 MAX: 3401 Xeon 8490H: AVX-512 Off . MIN: 1900 AVG: 2877 MAX: 3513 Xeon 8490H: AVX-512 On .. MIN: 1900 AVG: 2787 MAX: 3505 EPYC 9654: AVX-512 Off .. MIN: 2789 AVG: 3178 MAX: 3709 EPYC 9654: AVX-512 On ... MIN: 2771 AVG: 3169 MAX: 3709 OSPRay Studio 0.11 CPU Power Consumption Monitor Watts < Lower Is Better Xeon 8380: AVX-512 Off .. MIN: 130 AVG: 517 MAX: 653 Xeon 8380: AVX-512 On ... MIN: 101 AVG: 511 MAX: 668 Xeon 8490H: AVX-512 Off . MIN: 210 AVG: 663 MAX: 885 Xeon 8490H: AVX-512 On .. MIN: 114 AVG: 670 MAX: 876 EPYC 9654: AVX-512 Off .. MIN: 59 AVG: 615 MAX: 802 EPYC 9654: AVX-512 On ... MIN: 33 AVG: 632 MAX: 775 OSPRay Studio 0.11 CPU Temperature Monitor Celsius < Lower Is Better Xeon 8380: AVX-512 Off .. MIN: 53 AVG: 71 MAX: 77 Xeon 8380: AVX-512 On ... MIN: 50 AVG: 70 MAX: 75 Xeon 8490H: AVX-512 Off . MIN: 39 AVG: 52 MAX: 57 Xeon 8490H: AVX-512 On .. MIN: 39 AVG: 53 MAX: 57 EPYC 9654: AVX-512 Off .. MIN: 38 AVG: 52 MAX: 56 EPYC 9654: AVX-512 On ... MIN: 37 AVG: 52 MAX: 55 OSPRay Studio 0.11 Camera: 3 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path Tracer ms < Lower Is Better Xeon 8380: AVX-512 Off .. 1770 |=============================================== Xeon 8380: AVX-512 On ... 1563 |========================================== Xeon 8490H: AVX-512 Off . 1170 |=============================== Xeon 8490H: AVX-512 On .. 1029 |=========================== EPYC 9654: AVX-512 Off .. 836 |====================== EPYC 9654: AVX-512 On ... 695 |================== OSPRay Studio 0.11 CPU Peak Freq (Highest CPU Core Frequency) Monitor Megahertz > Higher Is Better Xeon 8380: AVX-512 Off .. MIN: 1947 AVG: 2897 MAX: 3403 Xeon 8380: AVX-512 On ... MIN: 2300 AVG: 2609 MAX: 3401 Xeon 8490H: AVX-512 Off . MIN: 1900 AVG: 2875 MAX: 3509 Xeon 8490H: AVX-512 On .. MIN: 1900 AVG: 2824 MAX: 3514 EPYC 9654: AVX-512 Off .. MIN: 2721 AVG: 3208 MAX: 3709 EPYC 9654: AVX-512 On ... MIN: 2671 AVG: 3308 MAX: 3711 OSPRay Studio 0.11 CPU Power Consumption Monitor Watts < Lower Is Better Xeon 8380: AVX-512 Off .. MIN: 82 AVG: 503 MAX: 657 Xeon 8380: AVX-512 On ... MIN: 111 AVG: 501 MAX: 667 Xeon 8490H: AVX-512 Off . MIN: 213 AVG: 667 MAX: 880 Xeon 8490H: AVX-512 On .. MIN: 214 AVG: 660 MAX: 875 EPYC 9654: AVX-512 Off .. MIN: 60 AVG: 620 MAX: 790 EPYC 9654: AVX-512 On ... MIN: 58 AVG: 600 MAX: 774 OSPRay Studio 0.11 CPU Temperature Monitor Celsius < Lower Is Better Xeon 8380: AVX-512 Off .. MIN: 51.0 AVG: 69.4 MAX: 76.0 Xeon 8380: AVX-512 On ... MIN: 50.0 AVG: 68.7 MAX: 75.0 Xeon 8490H: AVX-512 Off . MIN: 38.0 AVG: 52.5 MAX: 57.0 Xeon 8490H: AVX-512 On .. MIN: 39.0 AVG: 52.3 MAX: 57.0 EPYC 9654: AVX-512 Off .. MIN: 37.8 AVG: 52.0 MAX: 55.5 EPYC 9654: AVX-512 On ... MIN: 37.3 AVG: 50.4 MAX: 53.8 OSPRay Studio 0.11 Camera: 3 - Resolution: 4K - Samples Per Pixel: 16 - Renderer: Path Tracer ms < Lower Is Better Xeon 8380: AVX-512 Off .. 28490 |============================================== Xeon 8380: AVX-512 On ... 24927 |======================================== Xeon 8490H: AVX-512 Off . 18608 |============================== Xeon 8490H: AVX-512 On .. 16332 |========================== EPYC 9654: AVX-512 Off .. 13341 |====================== EPYC 9654: AVX-512 On ... 11058 |================== OSPRay Studio 0.11 CPU Peak Freq (Highest CPU Core Frequency) Monitor Megahertz > Higher Is Better Xeon 8380: AVX-512 Off .. MIN: 1835 AVG: 2868 MAX: 3402 Xeon 8380: AVX-512 On ... MIN: 2300 AVG: 2615 MAX: 3403 Xeon 8490H: AVX-512 Off . MIN: 1900 AVG: 2837 MAX: 3512 Xeon 8490H: AVX-512 On .. MIN: 1900 AVG: 2842 MAX: 3508 EPYC 9654: AVX-512 Off .. MIN: 2726 AVG: 3187 MAX: 3709 EPYC 9654: AVX-512 On ... MIN: 2777 AVG: 3170 MAX: 3709 OSPRay Studio 0.11 CPU Power Consumption Monitor Watts < Lower Is Better Xeon 8380: AVX-512 Off .. MIN: 117 AVG: 525 MAX: 656 Xeon 8380: AVX-512 On ... MIN: 100 AVG: 499 MAX: 664 Xeon 8490H: AVX-512 Off . MIN: 179 AVG: 688 MAX: 887 Xeon 8490H: AVX-512 On .. MIN: 108 AVG: 652 MAX: 894 EPYC 9654: AVX-512 Off .. MIN: 60 AVG: 637 MAX: 799 EPYC 9654: AVX-512 On ... MIN: 38 AVG: 629 MAX: 779 OSPRay Studio 0.11 CPU Temperature Monitor Celsius < Lower Is Better Xeon 8380: AVX-512 Off .. MIN: 51 AVG: 72 MAX: 77 Xeon 8380: AVX-512 On ... MIN: 52 AVG: 68 MAX: 74 Xeon 8490H: AVX-512 Off . MIN: 38 AVG: 54 MAX: 58 Xeon 8490H: AVX-512 On .. MIN: 39 AVG: 52 MAX: 57 EPYC 9654: AVX-512 Off .. MIN: 37 AVG: 53 MAX: 56 EPYC 9654: AVX-512 On ... MIN: 37 AVG: 52 MAX: 56 OSPRay Studio 0.11 Camera: 3 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path Tracer ms < Lower Is Better Xeon 8380: AVX-512 Off .. 62780 |============================================== Xeon 8380: AVX-512 On ... 49847 |===================================== Xeon 8490H: AVX-512 Off . 37300 |=========================== Xeon 8490H: AVX-512 On .. 32749 |======================== EPYC 9654: AVX-512 Off .. 26541 |=================== EPYC 9654: AVX-512 On ... 22120 |================ OSPRay Studio 0.11 CPU Peak Freq (Highest CPU Core Frequency) Monitor Megahertz > Higher Is Better Xeon 8380: AVX-512 Off .. MIN: 1597 AVG: 2940 MAX: 3407 Xeon 8380: AVX-512 On ... MIN: 2300 AVG: 2578 MAX: 3401 Xeon 8490H: AVX-512 Off . MIN: 1900 AVG: 2875 MAX: 3514 Xeon 8490H: AVX-512 On .. MIN: 1900 AVG: 2804 MAX: 3513 EPYC 9654: AVX-512 Off .. MIN: 2721 AVG: 3354 MAX: 3709 EPYC 9654: AVX-512 On ... MIN: 2702 AVG: 3343 MAX: 3709 OSPRay Studio 0.11 CPU Power Consumption Monitor Watts < Lower Is Better Xeon 8380: AVX-512 Off .. MIN: 124 AVG: 461 MAX: 660 Xeon 8380: AVX-512 On ... MIN: 102 AVG: 520 MAX: 663 Xeon 8490H: AVX-512 Off . MIN: 181 AVG: 673 MAX: 882 Xeon 8490H: AVX-512 On .. MIN: 211 AVG: 659 MAX: 862 EPYC 9654: AVX-512 Off .. MIN: 31 AVG: 619 MAX: 788 EPYC 9654: AVX-512 On ... MIN: 62 AVG: 592 MAX: 770 OSPRay Studio 0.11 CPU Temperature Monitor Celsius < Lower Is Better Xeon 8380: AVX-512 Off .. MIN: 53.0 AVG: 66.3 MAX: 73.0 Xeon 8380: AVX-512 On ... MIN: 49.0 AVG: 70.1 MAX: 75.0 Xeon 8490H: AVX-512 Off . MIN: 39.0 AVG: 53.3 MAX: 58.0 Xeon 8490H: AVX-512 On .. MIN: 39.0 AVG: 52.5 MAX: 57.0 EPYC 9654: AVX-512 Off .. MIN: 38.1 AVG: 52.6 MAX: 59.3 EPYC 9654: AVX-512 On ... MIN: 36.8 AVG: 51.4 MAX: 54.6 oneDNN 3.0 Harness: Deconvolution Batch shapes_3d - Data Type: f32 - Engine: CPU ms < Lower Is Better Xeon 8380: AVX-512 Off .. 1.992860 |=========================================== Xeon 8380: AVX-512 On ... 0.875196 |=================== Xeon 8490H: AVX-512 Off . 2.012410 |=========================================== Xeon 8490H: AVX-512 On .. 0.736822 |================ EPYC 9654: AVX-512 Off .. 1.736670 |===================================== EPYC 9654: AVX-512 On ... 0.986214 |===================== oneDNN 3.0 CPU Peak Freq (Highest CPU Core Frequency) Monitor Megahertz > Higher Is Better Xeon 8380: AVX-512 Off .. MIN: 2300 AVG: 2611 MAX: 3145 Xeon 8380: AVX-512 On ... MIN: 2300 AVG: 2464 MAX: 3025 Xeon 8490H: AVX-512 Off . MIN: 1900 AVG: 3133 MAX: 3511 Xeon 8490H: AVX-512 On .. MIN: 1900 AVG: 3013 MAX: 3507 EPYC 9654: AVX-512 Off .. MIN: 3570 AVG: 3666 MAX: 3709 EPYC 9654: AVX-512 On ... MIN: 3403 AVG: 3618 MAX: 3709 oneDNN 3.0 CPU Power Consumption Monitor Watts < Lower Is Better Xeon 8380: AVX-512 Off .. MIN: 118 AVG: 306 MAX: 585 Xeon 8380: AVX-512 On ... MIN: 120 AVG: 331 MAX: 647 Xeon 8490H: AVX-512 Off . MIN: 210 AVG: 418 MAX: 769 Xeon 8490H: AVX-512 On .. MIN: 204 AVG: 440 MAX: 838 EPYC 9654: AVX-512 Off .. MIN: 56 AVG: 241 MAX: 541 EPYC 9654: AVX-512 On ... MIN: 31 AVG: 261 MAX: 580 oneDNN 3.0 CPU Temperature Monitor Celsius < Lower Is Better Xeon 8380: AVX-512 Off .. MIN: 50.0 AVG: 57.6 MAX: 69.0 Xeon 8380: AVX-512 On ... MIN: 51.0 AVG: 59.3 MAX: 70.0 Xeon 8490H: AVX-512 Off . MIN: 33.0 AVG: 39.8 MAX: 48.0 Xeon 8490H: AVX-512 On .. MIN: 36.0 AVG: 41.0 MAX: 47.0 EPYC 9654: AVX-512 Off .. MIN: 33.6 AVG: 37.0 MAX: 40.9 EPYC 9654: AVX-512 On ... MIN: 34.1 AVG: 37.7 MAX: 41.8 Mobile Neural Network 2.1 Model: mobilenetV3 ms < Lower Is Better Xeon 8380: AVX-512 Off .. 1.764 |===================== Xeon 8380: AVX-512 On ... 1.709 |==================== Xeon 8490H: AVX-512 Off . 2.288 |=========================== Xeon 8490H: AVX-512 On .. 2.055 |======================== EPYC 9654: AVX-512 Off .. 3.889 |============================================== EPYC 9654: AVX-512 On ... 3.866 |============================================== Mobile Neural Network 2.1 Model: squeezenetv1.1 ms < Lower Is Better Xeon 8380: AVX-512 Off .. 2.678 |================ Xeon 8380: AVX-512 On ... 2.297 |============== Xeon 8490H: AVX-512 Off . 3.551 |====================== Xeon 8490H: AVX-512 On .. 2.737 |================= EPYC 9654: AVX-512 Off .. 7.566 |============================================== EPYC 9654: AVX-512 On ... 7.204 |============================================ Mobile Neural Network 2.1 Model: resnet-v2-50 ms < Lower Is Better Xeon 8380: AVX-512 Off .. 18.133 |================================== Xeon 8380: AVX-512 On ... 7.909 |=============== Xeon 8490H: AVX-512 Off . 17.716 |================================= Xeon 8490H: AVX-512 On .. 8.496 |================ EPYC 9654: AVX-512 Off .. 24.081 |============================================= EPYC 9654: AVX-512 On ... 14.727 |============================ Mobile Neural Network 2.1 Model: SqueezeNetV1.0 ms < Lower Is Better Xeon 8380: AVX-512 Off .. 4.195 |===================== Xeon 8380: AVX-512 On ... 3.999 |==================== Xeon 8490H: AVX-512 Off . 5.222 |========================== Xeon 8490H: AVX-512 On .. 4.415 |====================== EPYC 9654: AVX-512 Off .. 9.278 |============================================== EPYC 9654: AVX-512 On ... 8.762 |=========================================== Cpuminer-Opt 3.20.3 Algorithm: scrypt kH/s > Higher Is Better Xeon 8380: AVX-512 Off .. 1122.74 |========== Xeon 8380: AVX-512 On ... 2307.42 |===================== Xeon 8490H: AVX-512 Off . 1623.88 |=============== Xeon 8490H: AVX-512 On .. 3665.55 |================================= EPYC 9654: AVX-512 Off .. 2947.94 |=========================== EPYC 9654: AVX-512 On ... 4816.31 |============================================ Cpuminer-Opt 3.20.3 Algorithm: scrypt kH/s Per Watt > Higher Is Better Xeon 8380: AVX-512 Off .. 2.249 |============= Xeon 8380: AVX-512 On ... 4.627 |========================== Xeon 8490H: AVX-512 Off . 2.618 |=============== Xeon 8490H: AVX-512 On .. 5.636 |================================ EPYC 9654: AVX-512 Off .. 5.437 |=============================== EPYC 9654: AVX-512 On ... 8.054 |============================================== Cpuminer-Opt 3.20.3 CPU Peak Freq (Highest CPU Core Frequency) Monitor Megahertz > Higher Is Better Xeon 8380: AVX-512 Off .. MIN: 2300 AVG: 2914 MAX: 3000 Xeon 8380: AVX-512 On ... MIN: 2300 AVG: 2665 MAX: 2970 Xeon 8490H: AVX-512 Off . MIN: 1900 AVG: 2928 MAX: 3501 Xeon 8490H: AVX-512 On .. MIN: 1900 AVG: 2817 MAX: 3508 EPYC 9654: AVX-512 Off .. MIN: 2936 AVG: 3110 MAX: 3709 EPYC 9654: AVX-512 On ... MIN: 2986 AVG: 3250 MAX: 3709 Cpuminer-Opt 3.20.3 CPU Power Consumption Monitor Watts < Lower Is Better Xeon 8380: AVX-512 Off .. MIN: 124 AVG: 499 MAX: 603 Xeon 8380: AVX-512 On ... MIN: 115 AVG: 499 MAX: 604 Xeon 8490H: AVX-512 Off . MIN: 108 AVG: 620 MAX: 772 Xeon 8490H: AVX-512 On .. MIN: 205 AVG: 650 MAX: 782 EPYC 9654: AVX-512 Off .. MIN: 52 AVG: 542 MAX: 638 EPYC 9654: AVX-512 On ... MIN: 60 AVG: 598 MAX: 707 Cpuminer-Opt 3.20.3 CPU Temperature Monitor Celsius < Lower Is Better Xeon 8380: AVX-512 Off .. MIN: 49.0 AVG: 68.1 MAX: 73.0 Xeon 8380: AVX-512 On ... MIN: 48.0 AVG: 68.7 MAX: 75.0 Xeon 8490H: AVX-512 Off . MIN: 37.0 AVG: 50.5 MAX: 55.0 Xeon 8490H: AVX-512 On .. MIN: 36.0 AVG: 51.1 MAX: 56.0 EPYC 9654: AVX-512 Off .. MIN: 34.1 AVG: 48.0 MAX: 52.0 EPYC 9654: AVX-512 On ... MIN: 34.1 AVG: 50.1 MAX: 55.6 Cpuminer-Opt 3.20.3 Algorithm: Triple SHA-256, Onecoin kH/s > Higher Is Better Xeon 8380: AVX-512 Off .. 647033 |========= Xeon 8380: AVX-512 On ... 1328547 |================== Xeon 8490H: AVX-512 Off . 1092637 |============== Xeon 8490H: AVX-512 On .. 2074200 |=========================== EPYC 9654: AVX-512 Off .. 3338850 |============================================ EPYC 9654: AVX-512 On ... 3326287 |============================================ Cpuminer-Opt 3.20.3 Algorithm: Triple SHA-256, Onecoin kH/s Per Watt > Higher Is Better Xeon 8380: AVX-512 Off .. 1301.10 |========== Xeon 8380: AVX-512 On ... 2672.90 |===================== Xeon 8490H: AVX-512 Off . 1741.89 |============== Xeon 8490H: AVX-512 On .. 3203.65 |========================= EPYC 9654: AVX-512 Off .. 5632.97 |============================================ EPYC 9654: AVX-512 On ... 4975.70 |======================================= Cpuminer-Opt 3.20.3 CPU Peak Freq (Highest CPU Core Frequency) Monitor Megahertz > Higher Is Better Xeon 8380: AVX-512 Off .. MIN: 2300 AVG: 2889 MAX: 3283 Xeon 8380: AVX-512 On ... MIN: 2300 AVG: 2643 MAX: 3400 Xeon 8490H: AVX-512 Off . MIN: 1900 AVG: 2957 MAX: 3510 Xeon 8490H: AVX-512 On .. MIN: 1900 AVG: 2875 MAX: 3511 EPYC 9654: AVX-512 Off .. MIN: 3008 AVG: 3336 MAX: 3709 EPYC 9654: AVX-512 On ... MIN: 3178 AVG: 3466 MAX: 3714 Cpuminer-Opt 3.20.3 CPU Power Consumption Monitor Watts < Lower Is Better Xeon 8380: AVX-512 Off .. MIN: 75 AVG: 497 MAX: 602 Xeon 8380: AVX-512 On ... MIN: 120 AVG: 497 MAX: 601 Xeon 8490H: AVX-512 Off . MIN: 221 AVG: 627 MAX: 772 Xeon 8490H: AVX-512 On .. MIN: 206 AVG: 647 MAX: 782 EPYC 9654: AVX-512 Off .. MIN: 57 AVG: 593 MAX: 701 EPYC 9654: AVX-512 On ... MIN: 33 AVG: 669 MAX: 793 Cpuminer-Opt 3.20.3 CPU Temperature Monitor Celsius < Lower Is Better Xeon 8380: AVX-512 Off .. MIN: 51.0 AVG: 69.9 MAX: 74.0 Xeon 8380: AVX-512 On ... MIN: 51.0 AVG: 70.1 MAX: 75.0 Xeon 8490H: AVX-512 Off . MIN: 40.0 AVG: 51.9 MAX: 56.0 Xeon 8490H: AVX-512 On .. MIN: 39.0 AVG: 52.3 MAX: 56.0 EPYC 9654: AVX-512 Off .. MIN: 35.9 AVG: 50.9 MAX: 54.3 EPYC 9654: AVX-512 On ... MIN: 36.8 AVG: 55.2 MAX: 58.8 Cpuminer-Opt 3.20.3 Algorithm: Quad SHA-256, Pyrite kH/s > Higher Is Better Xeon 8380: AVX-512 Off .. 355173 |======= Xeon 8380: AVX-512 On ... 924040 |================== Xeon 8490H: AVX-512 Off . 687320 |============= Xeon 8490H: AVX-512 On .. 1472620 |============================= EPYC 9654: AVX-512 Off .. 1334363 |========================== EPYC 9654: AVX-512 On ... 2252500 |============================================ Cpuminer-Opt 3.20.3 Algorithm: Quad SHA-256, Pyrite kH/s Per Watt > Higher Is Better Xeon 8380: AVX-512 Off .. 710.08 |========= Xeon 8380: AVX-512 On ... 1859.26 |======================= Xeon 8490H: AVX-512 Off . 1053.06 |============= Xeon 8490H: AVX-512 On .. 2276.98 |============================ EPYC 9654: AVX-512 Off .. 2351.12 |============================= EPYC 9654: AVX-512 On ... 3555.70 |============================================ Cpuminer-Opt 3.20.3 CPU Peak Freq (Highest CPU Core Frequency) Monitor Megahertz > Higher Is Better Xeon 8380: AVX-512 Off .. MIN: 2300 AVG: 2868 MAX: 3101 Xeon 8380: AVX-512 On ... MIN: 2300 AVG: 2651 MAX: 3400 Xeon 8490H: AVX-512 Off . MIN: 1900 AVG: 2927 MAX: 3501 Xeon 8490H: AVX-512 On .. MIN: 1900 AVG: 2857 MAX: 3507 EPYC 9654: AVX-512 Off .. MIN: 3033 AVG: 3343 MAX: 3709 EPYC 9654: AVX-512 On ... MIN: 3114 AVG: 3410 MAX: 3709 Cpuminer-Opt 3.20.3 CPU Power Consumption Monitor Watts < Lower Is Better Xeon 8380: AVX-512 Off .. MIN: 121 AVG: 500 MAX: 603 Xeon 8380: AVX-512 On ... MIN: 79 AVG: 497 MAX: 602 Xeon 8490H: AVX-512 Off . MIN: 220 AVG: 653 MAX: 740 Xeon 8490H: AVX-512 On .. MIN: 207 AVG: 647 MAX: 780 EPYC 9654: AVX-512 Off .. MIN: 55 AVG: 568 MAX: 676 EPYC 9654: AVX-512 On ... MIN: 32 AVG: 633 MAX: 739 Cpuminer-Opt 3.20.3 CPU Temperature Monitor Celsius < Lower Is Better Xeon 8380: AVX-512 Off .. MIN: 51.0 AVG: 70.2 MAX: 75.0 Xeon 8380: AVX-512 On ... MIN: 52.0 AVG: 70.8 MAX: 75.0 Xeon 8490H: AVX-512 Off . MIN: 39.0 AVG: 53.9 MAX: 58.0 Xeon 8490H: AVX-512 On .. MIN: 39.0 AVG: 52.7 MAX: 57.0 EPYC 9654: AVX-512 Off .. MIN: 36.4 AVG: 51.0 MAX: 54.3 EPYC 9654: AVX-512 On ... MIN: 38.1 AVG: 52.9 MAX: 56.1 Cpuminer-Opt 3.20.3 Algorithm: x25x kH/s > Higher Is Better Xeon 8380: AVX-512 Off .. 1840.41 |=========== Xeon 8380: AVX-512 On ... 2650.36 |=============== Xeon 8490H: AVX-512 Off . 2166.90 |============ Xeon 8490H: AVX-512 On .. 4071.59 |======================= EPYC 9654: AVX-512 Off .. 5712.58 |================================= EPYC 9654: AVX-512 On ... 7691.78 |============================================ Cpuminer-Opt 3.20.3 Algorithm: x25x kH/s Per Watt > Higher Is Better Xeon 8380: AVX-512 Off .. 3.713 |============ Xeon 8380: AVX-512 On ... 5.338 |================== Xeon 8490H: AVX-512 Off . 3.313 |=========== Xeon 8490H: AVX-512 On .. 6.322 |===================== EPYC 9654: AVX-512 Off .. 10.302 |================================== EPYC 9654: AVX-512 On ... 13.447 |============================================= Cpuminer-Opt 3.20.3 CPU Peak Freq (Highest CPU Core Frequency) Monitor Megahertz > Higher Is Better Xeon 8380: AVX-512 Off .. MIN: 2300 AVG: 2917 MAX: 3305 Xeon 8380: AVX-512 On ... MIN: 2300 AVG: 2833 MAX: 3402 Xeon 8490H: AVX-512 Off . MIN: 1900 AVG: 2907 MAX: 3511 Xeon 8490H: AVX-512 On .. MIN: 1900 AVG: 2730 MAX: 3501 EPYC 9654: AVX-512 Off .. MIN: 3295 AVG: 3488 MAX: 3709 EPYC 9654: AVX-512 On ... MIN: 3132 AVG: 3368 MAX: 3709 Cpuminer-Opt 3.20.3 CPU Power Consumption Monitor Watts < Lower Is Better Xeon 8380: AVX-512 Off .. MIN: 119 AVG: 496 MAX: 593 Xeon 8380: AVX-512 On ... MIN: 128 AVG: 497 MAX: 596 Xeon 8490H: AVX-512 Off . MIN: 137 AVG: 654 MAX: 765 Xeon 8490H: AVX-512 On .. MIN: 211 AVG: 644 MAX: 769 EPYC 9654: AVX-512 Off .. MIN: 60 AVG: 555 MAX: 660 EPYC 9654: AVX-512 On ... MIN: 55 AVG: 572 MAX: 668 Cpuminer-Opt 3.20.3 CPU Temperature Monitor Celsius < Lower Is Better Xeon 8380: AVX-512 Off .. MIN: 53.0 AVG: 69.7 MAX: 74.0 Xeon 8380: AVX-512 On ... MIN: 51.0 AVG: 69.5 MAX: 74.0 Xeon 8490H: AVX-512 Off . MIN: 40.0 AVG: 53.4 MAX: 57.0 Xeon 8490H: AVX-512 On .. MIN: 38.0 AVG: 52.1 MAX: 56.0 EPYC 9654: AVX-512 Off .. MIN: 36.8 AVG: 50.8 MAX: 54.6 EPYC 9654: AVX-512 On ... MIN: 37.3 AVG: 52.2 MAX: 55.5 Cpuminer-Opt 3.20.3 Algorithm: Deepcoin kH/s > Higher Is Better Xeon 8380: AVX-512 Off .. 57930 |================ Xeon 8380: AVX-512 On ... 64690 |================== Xeon 8490H: AVX-512 Off . 91107 |========================= Xeon 8490H: AVX-512 On .. 105513 |============================= EPYC 9654: AVX-512 Off .. 165240 |============================================= EPYC 9654: AVX-512 On ... 160290 |============================================ Cpuminer-Opt 3.20.3 Algorithm: Deepcoin kH/s Per Watt > Higher Is Better Xeon 8380: AVX-512 Off .. 116.45 |================== Xeon 8380: AVX-512 On ... 130.17 |===================== Xeon 8490H: AVX-512 Off . 139.12 |====================== Xeon 8490H: AVX-512 On .. 161.98 |========================== EPYC 9654: AVX-512 Off .. 284.10 |============================================= EPYC 9654: AVX-512 On ... 274.20 |=========================================== Cpuminer-Opt 3.20.3 CPU Peak Freq (Highest CPU Core Frequency) Monitor Megahertz > Higher Is Better Xeon 8380: AVX-512 Off .. MIN: 2300 AVG: 2799 MAX: 3145 Xeon 8380: AVX-512 On ... MIN: 2300 AVG: 2779 MAX: 3400 Xeon 8490H: AVX-512 Off . MIN: 1900 AVG: 2858 MAX: 3507 Xeon 8490H: AVX-512 On .. MIN: 1900 AVG: 2936 MAX: 3508 EPYC 9654: AVX-512 Off .. MIN: 2899 AVG: 3360 MAX: 3709 EPYC 9654: AVX-512 On ... MIN: 3239 AVG: 3515 MAX: 3709 Cpuminer-Opt 3.20.3 CPU Power Consumption Monitor Watts < Lower Is Better Xeon 8380: AVX-512 Off .. MIN: 88 AVG: 497 MAX: 602 Xeon 8380: AVX-512 On ... MIN: 72 AVG: 497 MAX: 603 Xeon 8490H: AVX-512 Off . MIN: 212 AVG: 655 MAX: 783 Xeon 8490H: AVX-512 On .. MIN: 203 AVG: 651 MAX: 782 EPYC 9654: AVX-512 Off .. MIN: 61 AVG: 582 MAX: 686 EPYC 9654: AVX-512 On ... MIN: 32 AVG: 585 MAX: 690 Cpuminer-Opt 3.20.3 CPU Temperature Monitor Celsius < Lower Is Better Xeon 8380: AVX-512 Off .. MIN: 53.0 AVG: 70.2 MAX: 74.0 Xeon 8380: AVX-512 On ... MIN: 52.0 AVG: 70.3 MAX: 75.0 Xeon 8490H: AVX-512 Off . MIN: 42.0 AVG: 54.5 MAX: 58.0 Xeon 8490H: AVX-512 On .. MIN: 39.0 AVG: 53.0 MAX: 57.0 EPYC 9654: AVX-512 Off .. MIN: 36.4 AVG: 50.6 MAX: 53.8 EPYC 9654: AVX-512 On ... MIN: 36.6 AVG: 50.8 MAX: 54.3 Cpuminer-Opt 3.20.3 Algorithm: Skeincoin kH/s > Higher Is Better Xeon 8380: AVX-512 Off .. 399350 |========= Xeon 8380: AVX-512 On ... 613273 |============== Xeon 8490H: AVX-512 Off . 677733 |=============== Xeon 8490H: AVX-512 On .. 1072453 |======================== EPYC 9654: AVX-512 Off .. 1413063 |=============================== EPYC 9654: AVX-512 On ... 1990790 |============================================ Cpuminer-Opt 3.20.3 Algorithm: Skeincoin kH/s Per Watt > Higher Is Better Xeon 8380: AVX-512 Off .. 800.44 |=========== Xeon 8380: AVX-512 On ... 1225.35 |================= Xeon 8490H: AVX-512 Off . 1035.24 |=============== Xeon 8490H: AVX-512 On .. 1658.46 |======================= EPYC 9654: AVX-512 Off .. 2428.44 |================================== EPYC 9654: AVX-512 On ... 3141.21 |============================================ Cpuminer-Opt 3.20.3 CPU Peak Freq (Highest CPU Core Frequency) Monitor Megahertz > Higher Is Better Xeon 8380: AVX-512 Off .. MIN: 2300 AVG: 2776 MAX: 3195 Xeon 8380: AVX-512 On ... MIN: 2300 AVG: 2674 MAX: 3063 Xeon 8490H: AVX-512 Off . MIN: 1900 AVG: 2873 MAX: 3501 Xeon 8490H: AVX-512 On .. MIN: 2700 AVG: 2861 MAX: 3505 EPYC 9654: AVX-512 Off .. MIN: 2896 AVG: 3299 MAX: 3709 EPYC 9654: AVX-512 On ... MIN: 3001 AVG: 3367 MAX: 3709 Cpuminer-Opt 3.20.3 CPU Power Consumption Monitor Watts < Lower Is Better Xeon 8380: AVX-512 Off .. MIN: 119 AVG: 499 MAX: 602 Xeon 8380: AVX-512 On ... MIN: 124 AVG: 500 MAX: 601 Xeon 8490H: AVX-512 Off . MIN: 225 AVG: 655 MAX: 781 Xeon 8490H: AVX-512 On .. MIN: 104 AVG: 647 MAX: 783 EPYC 9654: AVX-512 Off .. MIN: 53 AVG: 582 MAX: 687 EPYC 9654: AVX-512 On ... MIN: 34 AVG: 634 MAX: 746 Cpuminer-Opt 3.20.3 CPU Temperature Monitor Celsius < Lower Is Better Xeon 8380: AVX-512 Off .. MIN: 51 AVG: 70 MAX: 74 Xeon 8380: AVX-512 On ... MIN: 52 AVG: 71 MAX: 77 Xeon 8490H: AVX-512 Off . MIN: 40 AVG: 54 MAX: 58 Xeon 8490H: AVX-512 On .. MIN: 39 AVG: 53 MAX: 56 EPYC 9654: AVX-512 Off .. MIN: 36 AVG: 51 MAX: 54 EPYC 9654: AVX-512 On ... MIN: 36 AVG: 53 MAX: 56 Cpuminer-Opt 3.20.3 Algorithm: LBC, LBRY Credits kH/s > Higher Is Better Xeon 8380: AVX-512 Off .. 157083 |====== Xeon 8380: AVX-512 On ... 419133 |================= Xeon 8490H: AVX-512 Off . 263917 |=========== Xeon 8490H: AVX-512 On .. 672677 |============================ EPYC 9654: AVX-512 Off .. 492780 |==================== EPYC 9654: AVX-512 On ... 1068993 |============================================ Cpuminer-Opt 3.20.3 Algorithm: LBC, LBRY Credits kH/s Per Watt > Higher Is Better Xeon 8380: AVX-512 Off .. 314.92 |======== Xeon 8380: AVX-512 On ... 841.20 |======================= Xeon 8490H: AVX-512 Off . 404.76 |=========== Xeon 8490H: AVX-512 On .. 1033.12 |============================ EPYC 9654: AVX-512 Off .. 834.91 |====================== EPYC 9654: AVX-512 On ... 1639.75 |============================================ Cpuminer-Opt 3.20.3 CPU Peak Freq (Highest CPU Core Frequency) Monitor Megahertz > Higher Is Better Xeon 8380: AVX-512 Off .. MIN: 2300 AVG: 2737 MAX: 3400 Xeon 8380: AVX-512 On ... MIN: 2300 AVG: 2624 MAX: 3400 Xeon 8490H: AVX-512 Off . MIN: 1900 AVG: 2761 MAX: 3502 Xeon 8490H: AVX-512 On .. MIN: 1900 AVG: 2817 MAX: 3501 EPYC 9654: AVX-512 Off .. MIN: 2733 AVG: 3271 MAX: 3709 EPYC 9654: AVX-512 On ... MIN: 3092 AVG: 3395 MAX: 3709 Cpuminer-Opt 3.20.3 CPU Power Consumption Monitor Watts < Lower Is Better Xeon 8380: AVX-512 Off .. MIN: 120 AVG: 499 MAX: 602 Xeon 8380: AVX-512 On ... MIN: 124 AVG: 498 MAX: 601 Xeon 8490H: AVX-512 Off . MIN: 133 AVG: 652 MAX: 782 Xeon 8490H: AVX-512 On .. MIN: 205 AVG: 651 MAX: 782 EPYC 9654: AVX-512 Off .. MIN: 58 AVG: 590 MAX: 704 EPYC 9654: AVX-512 On ... MIN: 32 AVG: 652 MAX: 765 Cpuminer-Opt 3.20.3 CPU Temperature Monitor Celsius < Lower Is Better Xeon 8380: AVX-512 Off .. MIN: 52.0 AVG: 69.8 MAX: 74.0 Xeon 8380: AVX-512 On ... MIN: 52.0 AVG: 70.7 MAX: 76.0 Xeon 8490H: AVX-512 Off . MIN: 40.0 AVG: 54.0 MAX: 57.0 Xeon 8490H: AVX-512 On .. MIN: 39.0 AVG: 52.4 MAX: 56.0 EPYC 9654: AVX-512 Off .. MIN: 36.8 AVG: 51.3 MAX: 55.1 EPYC 9654: AVX-512 On ... MIN: 37.3 AVG: 53.4 MAX: 57.3 OpenVINO 2022.3 Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU FPS > Higher Is Better Xeon 8380: AVX-512 Off .. 50413.98 |================== Xeon 8380: AVX-512 On ... 67701.60 |======================== Xeon 8490H: AVX-512 Off . 73906.76 |========================== Xeon 8490H: AVX-512 On .. 103184.01 |===================================== EPYC 9654: AVX-512 Off .. 114083.24 |========================================= EPYC 9654: AVX-512 On ... 118103.94 |========================================== OpenVINO 2022.3 Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU ms < Lower Is Better Xeon 8380: AVX-512 Off .. 1.58 |=============================================== Xeon 8380: AVX-512 On ... 1.16 |=================================== Xeon 8490H: AVX-512 Off . 1.57 |=============================================== Xeon 8490H: AVX-512 On .. 1.04 |=============================== EPYC 9654: AVX-512 Off .. 1.14 |================================== EPYC 9654: AVX-512 On ... 0.96 |============================= OpenVINO 2022.3 CPU Peak Freq (Highest CPU Core Frequency) Monitor Megahertz > Higher Is Better Xeon 8380: AVX-512 Off .. MIN: 2300 AVG: 2586 MAX: 3400 Xeon 8380: AVX-512 On ... MIN: 2300 AVG: 2379 MAX: 3400 Xeon 8490H: AVX-512 Off . MIN: 1900 AVG: 2585 MAX: 3508 Xeon 8490H: AVX-512 On .. MIN: 1900 AVG: 2333 MAX: 3508 EPYC 9654: AVX-512 Off .. MIN: 3709 AVG: 3709 MAX: 3709 EPYC 9654: AVX-512 On ... MIN: 3709 AVG: 3709 MAX: 3709 OpenVINO 2022.3 CPU Power Consumption Monitor Watts < Lower Is Better Xeon 8380: AVX-512 Off .. MIN: 120 AVG: 516 MAX: 594 Xeon 8380: AVX-512 On ... MIN: 120 AVG: 517 MAX: 594 Xeon 8490H: AVX-512 Off . MIN: 226 AVG: 674 MAX: 769 Xeon 8490H: AVX-512 On .. MIN: 212 AVG: 670 MAX: 769 EPYC 9654: AVX-512 Off .. MIN: 30 AVG: 580 MAX: 638 EPYC 9654: AVX-512 On ... MIN: 61 AVG: 583 MAX: 644 OpenVINO 2022.3 CPU Temperature Monitor Celsius < Lower Is Better Xeon 8380: AVX-512 Off .. MIN: 54 AVG: 73 MAX: 77 Xeon 8380: AVX-512 On ... MIN: 54 AVG: 73 MAX: 77 Xeon 8490H: AVX-512 Off . MIN: 40 AVG: 54 MAX: 57 Xeon 8490H: AVX-512 On .. MIN: 39 AVG: 53 MAX: 56 EPYC 9654: AVX-512 Off .. MIN: 37 AVG: 51 MAX: 54 EPYC 9654: AVX-512 On ... MIN: 36 AVG: 51 MAX: 55 OpenVINO 2022.3 Model: Vehicle Detection FP16-INT8 - Device: CPU FPS > Higher Is Better Xeon 8380: AVX-512 Off .. 1750.30 |======= Xeon 8380: AVX-512 On ... 4442.95 |================= Xeon 8490H: AVX-512 Off . 3878.79 |=============== Xeon 8490H: AVX-512 On .. 6206.72 |======================== EPYC 9654: AVX-512 Off .. 6218.25 |======================== EPYC 9654: AVX-512 On ... 11029.45 |=========================================== OpenVINO 2022.3 Model: Vehicle Detection FP16-INT8 - Device: CPU ms < Lower Is Better Xeon 8380: AVX-512 Off .. 11.41 |================= Xeon 8380: AVX-512 On ... 4.49 |======= Xeon 8490H: AVX-512 Off . 30.91 |============================================== Xeon 8490H: AVX-512 On .. 19.31 |============================= EPYC 9654: AVX-512 Off .. 7.71 |=========== EPYC 9654: AVX-512 On ... 4.34 |====== OpenVINO 2022.3 CPU Peak Freq (Highest CPU Core Frequency) Monitor Megahertz > Higher Is Better Xeon 8380: AVX-512 Off .. MIN: 2300 AVG: 2952 MAX: 3400 Xeon 8380: AVX-512 On ... MIN: 2300 AVG: 2465 MAX: 3400 Xeon 8490H: AVX-512 Off . MIN: 2327 AVG: 2505 MAX: 3513 Xeon 8490H: AVX-512 On .. MIN: 1900 AVG: 2572 MAX: 3502 EPYC 9654: AVX-512 Off .. MIN: 3709 AVG: 3709 MAX: 3709 EPYC 9654: AVX-512 On ... MIN: 3709 AVG: 3709 MAX: 3709 OpenVINO 2022.3 CPU Power Consumption Monitor Watts < Lower Is Better Xeon 8380: AVX-512 Off .. MIN: 124 AVG: 518 MAX: 584 Xeon 8380: AVX-512 On ... MIN: 127 AVG: 519 MAX: 596 Xeon 8490H: AVX-512 Off . MIN: 209 AVG: 668 MAX: 771 Xeon 8490H: AVX-512 On .. MIN: 212 AVG: 668 MAX: 782 EPYC 9654: AVX-512 Off .. MIN: 58 AVG: 622 MAX: 685 EPYC 9654: AVX-512 On ... MIN: 58 AVG: 594 MAX: 654 OpenVINO 2022.3 CPU Temperature Monitor Celsius < Lower Is Better Xeon 8380: AVX-512 Off .. MIN: 54 AVG: 75 MAX: 79 Xeon 8380: AVX-512 On ... MIN: 53 AVG: 74 MAX: 79 Xeon 8490H: AVX-512 Off . MIN: 40 AVG: 53 MAX: 57 Xeon 8490H: AVX-512 On .. MIN: 40 AVG: 52 MAX: 55 EPYC 9654: AVX-512 Off .. MIN: 37 AVG: 53 MAX: 56 EPYC 9654: AVX-512 On ... MIN: 38 AVG: 52 MAX: 54 OpenVINO 2022.3 Model: Vehicle Detection FP16 - Device: CPU FPS > Higher Is Better Xeon 8380: AVX-512 Off .. 1014.27 |====== Xeon 8380: AVX-512 On ... 1119.45 |======= Xeon 8490H: AVX-512 Off . 1732.74 |========== Xeon 8490H: AVX-512 On .. 3738.92 |====================== EPYC 9654: AVX-512 Off .. 3791.80 |====================== EPYC 9654: AVX-512 On ... 7420.49 |============================================ OpenVINO 2022.3 Model: Vehicle Detection FP16 - Device: CPU ms < Lower Is Better Xeon 8380: AVX-512 Off .. 19.68 |============================================== Xeon 8380: AVX-512 On ... 17.83 |========================================== Xeon 8490H: AVX-512 Off . 17.29 |======================================== Xeon 8490H: AVX-512 On .. 8.01 |=================== EPYC 9654: AVX-512 Off .. 12.64 |============================== EPYC 9654: AVX-512 On ... 6.46 |=============== OpenVINO 2022.3 CPU Peak Freq (Highest CPU Core Frequency) Monitor Megahertz > Higher Is Better Xeon 8380: AVX-512 Off .. MIN: 2300 AVG: 2789 MAX: 3402 Xeon 8380: AVX-512 On ... MIN: 2300 AVG: 2556 MAX: 3400 Xeon 8490H: AVX-512 Off . MIN: 1900 AVG: 2480 MAX: 3506 Xeon 8490H: AVX-512 On .. MIN: 1900 AVG: 2431 MAX: 3509 EPYC 9654: AVX-512 Off .. MIN: 3709 AVG: 3709 MAX: 3709 EPYC 9654: AVX-512 On ... MIN: 3709 AVG: 3709 MAX: 3709 OpenVINO 2022.3 CPU Power Consumption Monitor Watts < Lower Is Better Xeon 8380: AVX-512 Off .. MIN: 122 AVG: 518 MAX: 595 Xeon 8380: AVX-512 On ... MIN: 125 AVG: 519 MAX: 597 Xeon 8490H: AVX-512 Off . MIN: 209 AVG: 675 MAX: 776 Xeon 8490H: AVX-512 On .. MIN: 210 AVG: 674 MAX: 775 EPYC 9654: AVX-512 Off .. MIN: 55 AVG: 604 MAX: 663 EPYC 9654: AVX-512 On ... MIN: 39 AVG: 639 MAX: 699 OpenVINO 2022.3 CPU Temperature Monitor Celsius < Lower Is Better Xeon 8380: AVX-512 Off .. MIN: 54 AVG: 73 MAX: 77 Xeon 8380: AVX-512 On ... MIN: 54 AVG: 73 MAX: 77 Xeon 8490H: AVX-512 Off . MIN: 40 AVG: 54 MAX: 57 Xeon 8490H: AVX-512 On .. MIN: 40 AVG: 53 MAX: 55 EPYC 9654: AVX-512 Off .. MIN: 37 AVG: 51 MAX: 54 EPYC 9654: AVX-512 On ... MIN: 37 AVG: 53 MAX: 56 miniBUDE 20210901 Implementation: OpenMP - Input Deck: BM1 GFInst/s > Higher Is Better Xeon 8380: AVX-512 Off .. 1796.16 |=========== Xeon 8380: AVX-512 On ... 2339.32 |============== Xeon 8490H: AVX-512 Off . 2480.61 |=============== Xeon 8490H: AVX-512 On .. 3586.27 |====================== EPYC 9654: AVX-512 Off .. 5192.43 |=============================== EPYC 9654: AVX-512 On ... 7274.05 |============================================ miniBUDE 20210901 Implementation: OpenMP - Input Deck: BM1 Billion Interactions/s > Higher Is Better Xeon 8380: AVX-512 Off .. 71.85 |=========== Xeon 8380: AVX-512 On ... 93.57 |============== Xeon 8490H: AVX-512 Off . 99.23 |=============== Xeon 8490H: AVX-512 On .. 143.45 |====================== EPYC 9654: AVX-512 Off .. 207.70 |================================ EPYC 9654: AVX-512 On ... 290.96 |============================================= miniBUDE 20210901 Implementation: OpenMP - Input Deck: BM1 Billion Interactions/s Per Watt > Higher Is Better Xeon 8380: AVX-512 Off .. 0.161 |======= Xeon 8380: AVX-512 On ... 0.218 |========== Xeon 8490H: AVX-512 Off . 0.181 |======== Xeon 8490H: AVX-512 On .. 0.292 |============= EPYC 9654: AVX-512 Off .. 0.619 |============================ EPYC 9654: AVX-512 On ... 1.024 |============================================== miniBUDE 20210901 CPU Peak Freq (Highest CPU Core Frequency) Monitor Megahertz > Higher Is Better Xeon 8380: AVX-512 Off .. MIN: 2300 AVG: 2689 MAX: 3014 Xeon 8380: AVX-512 On ... MIN: 2300 AVG: 2695 MAX: 3194 Xeon 8490H: AVX-512 Off . MIN: 1900 AVG: 2980 MAX: 3511 Xeon 8490H: AVX-512 On .. MIN: 1900 AVG: 3106 MAX: 3512 EPYC 9654: AVX-512 Off .. MIN: 3145 AVG: 3571 MAX: 3709 EPYC 9654: AVX-512 On ... MIN: 3296 AVG: 3597 MAX: 3709 miniBUDE 20210901 CPU Power Consumption Monitor Watts < Lower Is Better Xeon 8380: AVX-512 Off .. MIN: 113 AVG: 448 MAX: 605 Xeon 8380: AVX-512 On ... MIN: 77 AVG: 430 MAX: 622 Xeon 8490H: AVX-512 Off . MIN: 204 AVG: 550 MAX: 791 Xeon 8490H: AVX-512 On .. MIN: 111 AVG: 492 MAX: 790 EPYC 9654: AVX-512 Off .. MIN: 51 AVG: 336 MAX: 660 EPYC 9654: AVX-512 On ... MIN: 61 AVG: 284 MAX: 711 miniBUDE 20210901 CPU Temperature Monitor Celsius < Lower Is Better Xeon 8380: AVX-512 Off .. MIN: 50.0 AVG: 65.1 MAX: 72.0 Xeon 8380: AVX-512 On ... MIN: 52.0 AVG: 65.8 MAX: 74.0 Xeon 8490H: AVX-512 Off . MIN: 39.0 AVG: 48.5 MAX: 54.0 Xeon 8490H: AVX-512 On .. MIN: 40.0 AVG: 46.0 MAX: 51.0 EPYC 9654: AVX-512 Off .. MIN: 35.0 AVG: 42.2 MAX: 50.4 EPYC 9654: AVX-512 On ... MIN: 35.9 AVG: 41.2 MAX: 49.0 miniBUDE 20210901 Implementation: OpenMP - Input Deck: BM2 GFInst/s > Higher Is Better Xeon 8380: AVX-512 Off .. 1993.07 |========== Xeon 8380: AVX-512 On ... 2588.76 |============= Xeon 8490H: AVX-512 Off . 2602.65 |============= Xeon 8490H: AVX-512 On .. 3643.84 |=================== EPYC 9654: AVX-512 Off .. 6371.32 |================================= EPYC 9654: AVX-512 On ... 8562.69 |============================================ miniBUDE 20210901 Implementation: OpenMP - Input Deck: BM2 Billion Interactions/s > Higher Is Better Xeon 8380: AVX-512 Off .. 79.72 |========== Xeon 8380: AVX-512 On ... 103.55 |============== Xeon 8490H: AVX-512 Off . 104.11 |============== Xeon 8490H: AVX-512 On .. 145.75 |=================== EPYC 9654: AVX-512 Off .. 254.85 |================================= EPYC 9654: AVX-512 On ... 342.51 |============================================= miniBUDE 20210901 Implementation: OpenMP - Input Deck: BM2 Billion Interactions/s Per Watt > Higher Is Better Xeon 8380: AVX-512 Off .. 0.156 |=========== Xeon 8380: AVX-512 On ... 0.204 |============== Xeon 8490H: AVX-512 Off . 0.170 |============ Xeon 8490H: AVX-512 On .. 0.246 |================= EPYC 9654: AVX-512 Off .. 0.481 |================================= EPYC 9654: AVX-512 On ... 0.679 |============================================== miniBUDE 20210901 CPU Peak Freq (Highest CPU Core Frequency) Monitor Megahertz > Higher Is Better Xeon 8380: AVX-512 Off .. MIN: 2300 AVG: 2944 MAX: 3400 Xeon 8380: AVX-512 On ... MIN: 2300 AVG: 2928 MAX: 3402 Xeon 8490H: AVX-512 Off . MIN: 1900 AVG: 3016 MAX: 3515 Xeon 8490H: AVX-512 On .. MIN: 1900 AVG: 2987 MAX: 3558 EPYC 9654: AVX-512 Off .. MIN: 3709 AVG: 3709 MAX: 3709 EPYC 9654: AVX-512 On ... MIN: 3709 AVG: 3709 MAX: 3709 miniBUDE 20210901 CPU Power Consumption Monitor Watts < Lower Is Better Xeon 8380: AVX-512 Off .. MIN: 114 AVG: 513 MAX: 653 Xeon 8380: AVX-512 On ... MIN: 123 AVG: 509 MAX: 665 Xeon 8490H: AVX-512 Off . MIN: 109 AVG: 612 MAX: 868 Xeon 8490H: AVX-512 On .. MIN: 209 AVG: 593 MAX: 865 EPYC 9654: AVX-512 Off .. MIN: 54 AVG: 530 MAX: 665 EPYC 9654: AVX-512 On ... MIN: 59 AVG: 505 MAX: 653 miniBUDE 20210901 CPU Temperature Monitor Celsius < Lower Is Better Xeon 8380: AVX-512 Off .. MIN: 46 AVG: 72 MAX: 85 Xeon 8380: AVX-512 On ... MIN: 47 AVG: 73 MAX: 84 Xeon 8490H: AVX-512 Off . MIN: 37 AVG: 52 MAX: 59 Xeon 8490H: AVX-512 On .. MIN: 37 AVG: 49 MAX: 55 EPYC 9654: AVX-512 Off .. MIN: 34 AVG: 49 MAX: 56 EPYC 9654: AVX-512 On ... MIN: 34 AVG: 48 MAX: 54 OpenFOAM 10 Input: drivaerFastback, Medium Mesh Size - Mesh Time Seconds < Lower Is Better Xeon 8380: AVX-512 Off .. 162.72 |=========================================== Xeon 8380: AVX-512 On ... 160.66 |=========================================== Xeon 8490H: AVX-512 Off . 169.84 |============================================= Xeon 8490H: AVX-512 On .. 159.67 |========================================== EPYC 9654: AVX-512 Off .. 146.75 |======================================= EPYC 9654: AVX-512 On ... 145.90 |======================================= OpenFOAM 10 Input: drivaerFastback, Medium Mesh Size - Execution Time Seconds < Lower Is Better Xeon 8380: AVX-512 Off .. 358.63 |============================================= Xeon 8380: AVX-512 On ... 361.37 |============================================= Xeon 8490H: AVX-512 Off . 194.79 |======================== Xeon 8490H: AVX-512 On .. 195.48 |======================== EPYC 9654: AVX-512 Off .. 110.95 |============== EPYC 9654: AVX-512 On ... 112.38 |============== OpenFOAM 10 CPU Peak Freq (Highest CPU Core Frequency) Monitor Megahertz > Higher Is Better Xeon 8380: AVX-512 Off .. MIN: 2300 AVG: 2959 MAX: 3400 Xeon 8380: AVX-512 On ... MIN: 2300 AVG: 2949 MAX: 3400 Xeon 8490H: AVX-512 Off . MIN: 1900 AVG: 2735 MAX: 3517 Xeon 8490H: AVX-512 On .. MIN: 1900 AVG: 2719 MAX: 3515 EPYC 9654: AVX-512 Off .. MIN: 3709 AVG: 3709 MAX: 3709 EPYC 9654: AVX-512 On ... MIN: 3709 AVG: 3709 MAX: 3714 OpenFOAM 10 CPU Power Consumption Monitor Watts < Lower Is Better Xeon 8380: AVX-512 Off .. MIN: 122 AVG: 540 MAX: 591 Xeon 8380: AVX-512 On ... MIN: 102 AVG: 541 MAX: 588 Xeon 8490H: AVX-512 Off . MIN: 211 AVG: 696 MAX: 761 Xeon 8490H: AVX-512 On .. MIN: 211 AVG: 695 MAX: 755 EPYC 9654: AVX-512 Off .. MIN: 58 AVG: 662 MAX: 737 EPYC 9654: AVX-512 On ... MIN: 62 AVG: 659 MAX: 739 OpenFOAM 10 CPU Temperature Monitor Celsius < Lower Is Better Xeon 8380: AVX-512 Off .. MIN: 39 AVG: 72 MAX: 78 Xeon 8380: AVX-512 On ... MIN: 40 AVG: 72 MAX: 80 Xeon 8490H: AVX-512 Off . MIN: 30 AVG: 54 MAX: 59 Xeon 8490H: AVX-512 On .. MIN: 33 AVG: 54 MAX: 59 EPYC 9654: AVX-512 Off .. MIN: 32 AVG: 54 MAX: 60 EPYC 9654: AVX-512 On ... MIN: 36 AVG: 55 MAX: 61 OpenFOAM 10 Input: drivaerFastback, Large Mesh Size - Mesh Time Seconds < Lower Is Better Xeon 8380: AVX-512 Off .. 887.21 |===================================== Xeon 8380: AVX-512 On ... 1051.35 |============================================ Xeon 8490H: AVX-512 Off . 1039.32 |=========================================== Xeon 8490H: AVX-512 On .. 847.91 |=================================== EPYC 9654: AVX-512 Off .. 867.38 |==================================== EPYC 9654: AVX-512 On ... 996.78 |========================================== OpenFOAM 10 Input: drivaerFastback, Large Mesh Size - Execution Time Seconds < Lower Is Better Xeon 8380: AVX-512 Off .. 7106.76 |============================================ Xeon 8380: AVX-512 On ... 7117.01 |============================================ Xeon 8490H: AVX-512 Off . 4319.12 |=========================== Xeon 8490H: AVX-512 On .. 4305.12 |=========================== EPYC 9654: AVX-512 Off .. 2803.54 |================= EPYC 9654: AVX-512 On ... 2849.61 |================== OpenFOAM 10 CPU Peak Freq (Highest CPU Core Frequency) Monitor Megahertz > Higher Is Better Xeon 8380: AVX-512 Off .. MIN: 2300 AVG: 2980 MAX: 3408 Xeon 8380: AVX-512 On ... MIN: 2300 AVG: 2975 MAX: 3400 Xeon 8490H: AVX-512 Off . MIN: 2491 AVG: 2871 MAX: 3516 Xeon 8490H: AVX-512 On .. MIN: 2451 AVG: 2868 MAX: 3513 EPYC 9654: AVX-512 Off .. MIN: 3709 AVG: 3709 MAX: 3709 EPYC 9654: AVX-512 On ... MIN: 3709 AVG: 3709 MAX: 3709 OpenFOAM 10 CPU Power Consumption Monitor Watts < Lower Is Better Xeon 8380: AVX-512 Off .. MIN: 127 AVG: 548 MAX: 588 Xeon 8380: AVX-512 On ... MIN: 130 AVG: 547 MAX: 589 Xeon 8490H: AVX-512 Off . MIN: 209 AVG: 709 MAX: 768 Xeon 8490H: AVX-512 On .. MIN: 215 AVG: 710 MAX: 763 EPYC 9654: AVX-512 Off .. MIN: 58 AVG: 651 MAX: 749 EPYC 9654: AVX-512 On ... MIN: 63 AVG: 655 MAX: 742 OpenFOAM 10 CPU Temperature Monitor Celsius < Lower Is Better Xeon 8380: AVX-512 Off .. MIN: 51.0 AVG: 70.2 MAX: 75.0 Xeon 8380: AVX-512 On ... MIN: 50.0 AVG: 69.8 MAX: 75.0 Xeon 8490H: AVX-512 Off . MIN: 39.0 AVG: 54.3 MAX: 60.0 Xeon 8490H: AVX-512 On .. MIN: 40.0 AVG: 54.7 MAX: 60.0 EPYC 9654: AVX-512 Off .. MIN: 36.8 AVG: 54.3 MAX: 61.4 EPYC 9654: AVX-512 On ... MIN: 37.8 AVG: 55.5 MAX: 62.6 SMHasher 2022-08-22 Hash: FarmHash32 x86_64 AVX MiB/sec > Higher Is Better Xeon 8380: AVX-512 Off .. 30330.53 |=============================== Xeon 8380: AVX-512 On ... 33979.99 |================================== Xeon 8490H: AVX-512 Off . 37809.71 |====================================== Xeon 8490H: AVX-512 On .. 42508.35 |=========================================== EPYC 9654: AVX-512 Off .. 36458.31 |===================================== EPYC 9654: AVX-512 On ... 39795.36 |======================================== SMHasher 2022-08-22 Hash: FarmHash32 x86_64 AVX cycles/hash < Lower Is Better Xeon 8380: AVX-512 Off .. 31.58 |============================================== Xeon 8380: AVX-512 On ... 31.08 |============================================= Xeon 8490H: AVX-512 Off . 23.27 |================================== Xeon 8490H: AVX-512 On .. 23.27 |================================== EPYC 9654: AVX-512 Off .. 26.41 |====================================== EPYC 9654: AVX-512 On ... 26.55 |======================================= CPU Peak Freq (Highest CPU Core Frequency) Monitor Phoronix Test Suite System Monitoring Megahertz Xeon 8380: AVX-512 Off .. MIN: 802 AVG: 3115 MAX: 3421 Xeon 8380: AVX-512 On ... MIN: 804 AVG: 2939 MAX: 3420 Xeon 8490H: AVX-512 Off . MIN: 1899 AVG: 3042 MAX: 4080 Xeon 8490H: AVX-512 On .. MIN: 690 AVG: 3000 MAX: 4081 EPYC 9654: AVX-512 Off .. MIN: 2336 AVG: 3668 MAX: 4199 EPYC 9654: AVX-512 On ... MIN: 2547 AVG: 3616 MAX: 3772 CPU Power Consumption Monitor Phoronix Test Suite System Monitoring Watts Xeon 8380: AVX-512 Off .. MIN: 58 AVG: 366 MAX: 660 Xeon 8380: AVX-512 On ... MIN: 61 AVG: 451 MAX: 668 Xeon 8490H: AVX-512 Off . MIN: 102 AVG: 589 MAX: 887 Xeon 8490H: AVX-512 On .. MIN: 103 AVG: 583 MAX: 894