eoy2024 Benchmarks for a future article. AMD EPYC 4124P 4-Core testing with a Supermicro AS-3015A-I H13SAE-MF v1.00 (2.1 BIOS) and ASPEED on Ubuntu 24.04 via the Phoronix Test Suite. a: Processor: AMD EPYC 4564P 16-Core @ 5.88GHz (16 Cores / 32 Threads), Motherboard: Supermicro AS-3015A-I H13SAE-MF v1.00 (2.1 BIOS), Chipset: AMD Device 14d8, Memory: 2 x 32GB DRAM-4800MT/s Micron MTC20C2085S1EC48BA1 BC, Disk: 3201GB Micron_7450_MTFDKCC3T2TFS + 960GB SAMSUNG MZ1L2960HCJR-00A07, Graphics: ASPEED, Audio: AMD Rembrandt Radeon HD Audio, Monitor: VA2431, Network: 2 x Intel I210 OS: Ubuntu 24.04, Kernel: 6.8.0-11-generic (x86_64), Desktop: GNOME Shell 45.3, Display Server: X Server 1.21.1.11, Compiler: GCC 13.2.0, File-System: ext4, Screen Resolution: 1024x768 4484PX: Processor: AMD EPYC 4484PX 12-Core @ 5.66GHz (12 Cores / 24 Threads), Motherboard: Supermicro AS-3015A-I H13SAE-MF v1.00 (2.1 BIOS), Chipset: AMD Device 14d8, Memory: 2 x 32GB DRAM-4800MT/s Micron MTC20C2085S1EC48BA1 BC, Disk: 3201GB Micron_7450_MTFDKCC3T2TFS + 960GB SAMSUNG MZ1L2960HCJR-00A07, Graphics: ASPEED, Audio: AMD Rembrandt Radeon HD Audio, Monitor: VA2431, Network: 2 x Intel I210 OS: Ubuntu 24.04, Kernel: 6.12.2-061202-generic (x86_64), Desktop: GNOME Shell 45.3, Display Server: X Server 1.21.1.11, Compiler: GCC 13.2.0, File-System: ext4, Screen Resolution: 1024x768 px: Processor: AMD EPYC 4484PX 12-Core @ 5.66GHz (12 Cores / 24 Threads), Motherboard: Supermicro AS-3015A-I H13SAE-MF v1.00 (2.1 BIOS), Chipset: AMD Device 14d8, Memory: 2 x 32GB DRAM-4800MT/s Micron MTC20C2085S1EC48BA1 BC, Disk: 3201GB Micron_7450_MTFDKCC3T2TFS + 960GB SAMSUNG MZ1L2960HCJR-00A07, Graphics: ASPEED, Audio: AMD Rembrandt Radeon HD Audio, Monitor: VA2431, Network: 2 x Intel I210 OS: Ubuntu 24.04, Kernel: 6.12.2-061202-generic (x86_64), Desktop: GNOME Shell 45.3, Display Server: X Server 1.21.1.11, Compiler: GCC 13.2.0, File-System: ext4, Screen Resolution: 1024x768 4464p: Processor: AMD EPYC 4464P 12-Core @ 5.48GHz (12 Cores / 24 Threads), Motherboard: Supermicro AS-3015A-I H13SAE-MF v1.00 (2.1 BIOS), Chipset: AMD Device 14d8, Memory: 2 x 32GB DRAM-4800MT/s Micron MTC20C2085S1EC48BA1 BC, Disk: 3201GB Micron_7450_MTFDKCC3T2TFS + 960GB SAMSUNG MZ1L2960HCJR-00A07, Graphics: ASPEED, Audio: AMD Rembrandt Radeon HD Audio, Monitor: VA2431, Network: 2 x Intel I210 OS: Ubuntu 24.04, Kernel: 6.12.2-061202-generic (x86_64), Desktop: GNOME Shell 45.3, Display Server: X Server 1.21.1.11, Compiler: GCC 13.2.0, File-System: ext4, Screen Resolution: 1024x768 4464p epyc: Processor: AMD EPYC 4464P 12-Core @ 5.48GHz (12 Cores / 24 Threads), Motherboard: Supermicro AS-3015A-I H13SAE-MF v1.00 (2.1 BIOS), Chipset: AMD Device 14d8, Memory: 2 x 32GB DRAM-4800MT/s Micron MTC20C2085S1EC48BA1 BC, Disk: 3201GB Micron_7450_MTFDKCC3T2TFS + 960GB SAMSUNG MZ1L2960HCJR-00A07, Graphics: ASPEED, Audio: AMD Rembrandt Radeon HD Audio, Monitor: VA2431, Network: 2 x Intel I210 OS: Ubuntu 24.04, Kernel: 6.12.2-061202-generic (x86_64), Desktop: GNOME Shell 45.3, Display Server: X Server 1.21.1.11, Compiler: GCC 13.2.0, File-System: ext4, Screen Resolution: 1024x768 4364P: Processor: AMD EPYC 4364P 8-Core @ 5.57GHz (8 Cores / 16 Threads), Motherboard: Supermicro AS-3015A-I H13SAE-MF v1.00 (2.1 BIOS), Chipset: AMD Device 14d8, Memory: 2 x 32GB DRAM-4800MT/s Micron MTC20C2085S1EC48BA1 BC, Disk: 3201GB Micron_7450_MTFDKCC3T2TFS + 960GB SAMSUNG MZ1L2960HCJR-00A07, Graphics: ASPEED, Audio: AMD Rembrandt Radeon HD Audio, Monitor: VA2431, Network: 2 x Intel I210 OS: Ubuntu 24.04, Kernel: 6.12.2-061202-generic (x86_64), Desktop: GNOME Shell 45.3, Display Server: X Server 1.21.1.11, Compiler: GCC 13.2.0, File-System: ext4, Screen Resolution: 1024x768 4584PX: Processor: AMD EPYC 4584PX 16-Core @ 5.76GHz (16 Cores / 32 Threads), Motherboard: Supermicro AS-3015A-I H13SAE-MF v1.00 (2.1 BIOS), Chipset: AMD Device 14d8, Memory: 2 x 32GB DRAM-4800MT/s Micron MTC20C2085S1EC48BA1 BC, Disk: 3201GB Micron_7450_MTFDKCC3T2TFS + 960GB SAMSUNG MZ1L2960HCJR-00A07, Graphics: ASPEED, Audio: AMD Rembrandt Radeon HD Audio, Monitor: VA2431, Network: 2 x Intel I210 OS: Ubuntu 24.04, Kernel: 6.12.2-061202-generic (x86_64), Desktop: GNOME Shell 45.3, Display Server: X Server 1.21.1.11, Compiler: GCC 13.2.0, File-System: ext4, Screen Resolution: 1024x768 EPYC 4584PX amd: Processor: AMD EPYC 4584PX 16-Core @ 5.76GHz (16 Cores / 32 Threads), Motherboard: Supermicro AS-3015A-I H13SAE-MF v1.00 (2.1 BIOS), Chipset: AMD Device 14d8, Memory: 2 x 32GB DRAM-4800MT/s Micron MTC20C2085S1EC48BA1 BC, Disk: 3201GB Micron_7450_MTFDKCC3T2TFS + 960GB SAMSUNG MZ1L2960HCJR-00A07, Graphics: ASPEED, Audio: AMD Rembrandt Radeon HD Audio, Monitor: VA2431, Network: 2 x Intel I210 OS: Ubuntu 24.04, Kernel: 6.12.2-061202-generic (x86_64), Desktop: GNOME Shell 45.3, Display Server: X Server 1.21.1.11, Compiler: GCC 13.2.0, File-System: ext4, Screen Resolution: 1024x768 45: Processor: AMD EPYC 4584PX 16-Core @ 5.76GHz (16 Cores / 32 Threads), Motherboard: Supermicro AS-3015A-I H13SAE-MF v1.00 (2.1 BIOS), Chipset: AMD Device 14d8, Memory: 2 x 32GB DRAM-4800MT/s Micron MTC20C2085S1EC48BA1 BC, Disk: 3201GB Micron_7450_MTFDKCC3T2TFS + 960GB SAMSUNG MZ1L2960HCJR-00A07, Graphics: ASPEED, Audio: AMD Rembrandt Radeon HD Audio, Monitor: VA2431, Network: 2 x Intel I210 OS: Ubuntu 24.04, Kernel: 6.12.2-061202-generic (x86_64), Desktop: GNOME Shell 45.3, Display Server: X Server 1.21.1.11, Compiler: GCC 13.2.0, File-System: ext4, Screen Resolution: 1024x768 41: Processor: AMD EPYC 4124P 4-Core @ 5.17GHz (4 Cores / 8 Threads), Motherboard: Supermicro AS-3015A-I H13SAE-MF v1.00 (2.1 BIOS), Chipset: AMD Device 14d8, Memory: 2 x 32GB DRAM-4800MT/s Micron MTC20C2085S1EC48BA1 BC, Disk: 960GB SAMSUNG MZ1L2960HCJR-00A07 + 3201GB Micron_7450_MTFDKCC3T2TFS, Graphics: ASPEED, Audio: AMD Rembrandt Radeon HD Audio, Monitor: VA2431, Network: 2 x Intel I210 OS: Ubuntu 24.04, Kernel: 6.12.2-061202-generic (x86_64), Desktop: GNOME Shell 45.3, Display Server: X Server 1.21.1.11, Compiler: GCC 13.2.0, File-System: ext4, Screen Resolution: 1024x768 41 b: Processor: AMD EPYC 4124P 4-Core @ 5.17GHz (4 Cores / 8 Threads), Motherboard: Supermicro AS-3015A-I H13SAE-MF v1.00 (2.1 BIOS), Chipset: AMD Device 14d8, Memory: 2 x 32GB DRAM-4800MT/s Micron MTC20C2085S1EC48BA1 BC, Disk: 960GB SAMSUNG MZ1L2960HCJR-00A07 + 3201GB Micron_7450_MTFDKCC3T2TFS, Graphics: ASPEED, Audio: AMD Rembrandt Radeon HD Audio, Monitor: VA2431, Network: 2 x Intel I210 OS: Ubuntu 24.04, Kernel: 6.12.2-061202-generic (x86_64), Desktop: GNOME Shell 45.3, Display Server: X Server 1.21.1.11, Compiler: GCC 13.2.0, File-System: ext4, Screen Resolution: 1024x768 QuantLib 1.35-dev Size: S tasks/s > Higher Is Better a ............... 12.74760 |============================================== 4484PX .......... 11.86470 |=========================================== px .............. 11.83900 |=========================================== 4464p ........... 10.28730 |===================================== 4464p epyc ...... 10.25310 |===================================== 4364P ........... 8.02696 |============================= 4584PX .......... 14.01710 |=================================================== EPYC 4584PX amd . 14.04720 |=================================================== 45 .............. 14.04310 |=================================================== 41 .............. 4.43021 |================ 41 b ............ 4.43091 |================ SVT-AV1 2.3 Encoder Mode: Preset 3 - Input: Beauty 4K 10-bit Frames Per Second > Higher Is Better a ............... 1.422 |====================================================== 4484PX .......... 1.188 |============================================= px .............. 1.184 |============================================= 4464p ........... 1.129 |=========================================== 4464p epyc ...... 1.132 |=========================================== 4364P ........... 0.872 |================================= 4584PX .......... 1.426 |====================================================== EPYC 4584PX amd . 1.433 |====================================================== 45 .............. 1.427 |====================================================== 41 .............. 0.443 |================= 41 b ............ 0.441 |================= RELION 5.0 Test: Basic - Device: CPU Seconds < Lower Is Better a ............... 944.27 |================ 4484PX .......... 729.40 |============ px .............. 733.02 |============= 4464p ........... 937.33 |================ 4464p epyc ...... 946.43 |================ 4364P ........... 1369.23 |======================= 4584PX .......... 551.72 |========= EPYC 4584PX amd . 553.78 |========= 45 .............. 549.80 |========= 41 .............. 2771.78 |=============================================== 41 b ............ 3046.81 |==================================================== Blender 4.3 Blend File: Barbershop - Compute: CPU-Only Seconds < Lower Is Better a ............... 506.20 |============= 4484PX .......... 679.34 |================= px .............. 678.40 |================= 4464p ........... 739.91 |================== 4464p epyc ...... 731.39 |================== 4364P ........... 978.03 |======================== 4584PX .......... 514.70 |============= EPYC 4584PX amd . 513.66 |============= 45 .............. 513.54 |============= 41 .............. 2077.69 |==================================================== 41 b ............ 2095.98 |==================================================== Whisper.cpp 1.6.2 Model: ggml-medium.en - Input: 2016 State of the Union Seconds < Lower Is Better a ............... 700.91 |==================== 4484PX .......... 809.79 |======================= px .............. 809.49 |======================= 4464p ........... 838.18 |======================== 4464p epyc ...... 839.99 |======================== 4364P ........... 966.01 |============================ 4584PX .......... 686.88 |==================== EPYC 4584PX amd . 684.39 |==================== 45 .............. 684.13 |==================== 41 b ............ 1797.86 |==================================================== CP2K Molecular Dynamics 2024.3 Input: H20-256 Seconds < Lower Is Better a ............... 592.86 |======================== 4484PX .......... 628.10 |========================= px .............. 631.31 |========================== 4464p ........... 676.74 |=========================== 4464p epyc ...... 678.68 |============================ 4364P ........... 740.09 |============================== 4584PX .......... 517.66 |===================== EPYC 4584PX amd . 517.92 |===================== 45 .............. 517.50 |===================== 41 .............. 1281.08 |==================================================== 41 b ............ 1282.66 |==================================================== Apache CouchDB 3.4.1 Bulk Size: 500 - Inserts: 3000 - Rounds: 30 Seconds < Lower Is Better a ............... 511.78 |======================================= 4484PX .......... 559.35 |========================================== px .............. 560.70 |=========================================== 4464p ........... 551.35 |========================================== 4464p epyc ...... 551.60 |========================================== 4364P ........... 545.97 |========================================= 4584PX .......... 553.81 |========================================== EPYC 4584PX amd . 554.40 |========================================== 45 .............. 552.21 |========================================== 41 .............. 695.35 |===================================================== 41 b ............ 698.07 |===================================================== QuantLib 1.35-dev Size: XXS tasks/s > Higher Is Better a ............... 13.43200 |=============================================== 4484PX .......... 12.11690 |========================================== px .............. 12.10570 |========================================== 4464p ........... 10.57880 |===================================== 4464p epyc ...... 10.56160 |===================================== 4364P ........... 8.19153 |============================ 4584PX .......... 14.62400 |=================================================== EPYC 4584PX amd . 14.69730 |=================================================== 45 .............. 14.62260 |=================================================== 41 .............. 4.47643 |================ 41 b ............ 4.46411 |=============== Whisperfile 20Aug24 Model Size: Medium Seconds < Lower Is Better a ............... 534.92 |================================== 4484PX .......... 473.55 |============================== px .............. 475.51 |============================== 4464p ........... 491.98 |=============================== 4464p epyc ...... 492.70 |=============================== 4364P ........... 528.33 |================================= 4584PX .......... 425.51 |=========================== EPYC 4584PX amd . 424.95 |=========================== 45 .............. 424.57 |=========================== 41 b ............ 845.17 |===================================================== Llamafile 0.8.16 Model: wizardcoder-python-34b-v1.0.Q6_K - Test: Prompt Processing 2048 Tokens Per Second > Higher Is Better a ............... 12288 |====================================================== 4484PX .......... 12288 |====================================================== px .............. 12288 |====================================================== 4464p ........... 12288 |====================================================== 4464p epyc ...... 12288 |====================================================== 4364P ........... 12288 |====================================================== 4584PX .......... 12288 |====================================================== EPYC 4584PX amd . 12288 |====================================================== 45 .............. 12288 |====================================================== 41 b ............ 12288 |====================================================== Apache CouchDB 3.4.1 Bulk Size: 300 - Inserts: 3000 - Rounds: 30 Seconds < Lower Is Better a ............... 367.83 |====================================== 4484PX .......... 406.12 |========================================== px .............. 408.48 |========================================== 4464p ........... 401.99 |========================================= 4464p epyc ...... 405.45 |========================================== 4364P ........... 398.39 |========================================= 4584PX .......... 397.43 |========================================= EPYC 4584PX amd . 400.40 |========================================= 45 .............. 399.26 |========================================= 41 .............. 515.50 |===================================================== 41 b ............ 513.58 |===================================================== SVT-AV1 2.3 Encoder Mode: Preset 3 - Input: Bosphorus 4K Frames Per Second > Higher Is Better a ............... 9.590 |====================================================== 4484PX .......... 7.684 |=========================================== px .............. 7.646 |=========================================== 4464p ........... 7.252 |========================================= 4464p epyc ...... 7.232 |========================================= 4364P ........... 5.373 |============================== 4584PX .......... 9.329 |===================================================== EPYC 4584PX amd . 9.400 |===================================================== 45 .............. 9.345 |===================================================== 41 .............. 2.808 |================ 41 b ............ 2.793 |================ BYTE Unix Benchmark 5.1.3-git Computational Test: Whetstone Double MWIPS > Higher Is Better a ............... 343491.9 |=================================================== 4484PX .......... 244075.3 |==================================== px .............. 244131.0 |==================================== 4464p ........... 242679.0 |==================================== 4464p epyc ...... 242340.5 |==================================== 4364P ........... 174760.6 |========================== 4584PX .......... 329601.4 |================================================= EPYC 4584PX amd . 331202.0 |================================================= 45 .............. 331193.7 |================================================= 41 .............. 84017.4 |============ 41 b ............ 83540.7 |============ Whisper.cpp 1.6.2 Model: ggml-small.en - Input: 2016 State of the Union Seconds < Lower Is Better a ............... 245.08 |====================== 4484PX .......... 268.24 |======================== px .............. 266.81 |======================== 4464p ........... 280.03 |========================= 4464p epyc ...... 280.47 |========================= 4364P ........... 314.48 |============================= 4584PX .......... 233.68 |===================== EPYC 4584PX amd . 233.05 |===================== 45 .............. 232.58 |===================== 41 .............. 581.27 |===================================================== 41 b ............ 583.20 |===================================================== Llamafile 0.8.16 Model: wizardcoder-python-34b-v1.0.Q6_K - Test: Text Generation 128 Tokens Per Second > Higher Is Better a ............... 1.99 |===================================================== 4484PX .......... 2.05 |======================================================= px .............. 2.05 |======================================================= 4464p ........... 2.05 |======================================================= 4464p epyc ...... 2.06 |======================================================= 4364P ........... 1.93 |==================================================== 4584PX .......... 2.03 |====================================================== EPYC 4584PX amd . 2.03 |====================================================== 45 .............. 2.03 |====================================================== 41 b ............ 1.93 |==================================================== Blender 4.3 Blend File: Pabellon Barcelona - Compute: CPU-Only Seconds < Lower Is Better a ............... 166.12 |============= 4484PX .......... 226.34 |================== px .............. 224.64 |================== 4464p ........... 243.35 |=================== 4464p epyc ...... 245.12 |=================== 4364P ........... 320.59 |========================= 4584PX .......... 171.82 |============== EPYC 4584PX amd . 171.25 |============== 45 .............. 170.09 |============= 41 .............. 667.71 |===================================================== 41 b ............ 671.42 |===================================================== Llamafile 0.8.16 Model: mistral-7b-instruct-v0.2.Q5_K_M - Test: Prompt Processing 2048 Tokens Per Second > Higher Is Better a ............... 32768 |====================================================== 4484PX .......... 32768 |====================================================== px .............. 32768 |====================================================== 4464p ........... 32768 |====================================================== 4464p epyc ...... 32768 |====================================================== 4364P ........... 32768 |====================================================== 4584PX .......... 32768 |====================================================== EPYC 4584PX amd . 32768 |====================================================== 45 .............. 32768 |====================================================== 41 b ............ 32768 |====================================================== SVT-AV1 2.3 Encoder Mode: Preset 5 - Input: Beauty 4K 10-bit Frames Per Second > Higher Is Better a ............... 6.504 |====================================================== 4484PX .......... 5.602 |=============================================== px .............. 5.551 |============================================== 4464p ........... 5.445 |============================================= 4464p epyc ...... 5.422 |============================================= 4364P ........... 3.802 |================================ 4584PX .......... 6.327 |===================================================== EPYC 4584PX amd . 6.391 |===================================================== 45 .............. 6.322 |==================================================== 41 .............. 2.178 |================== 41 b ............ 2.172 |================== Apache CouchDB 3.4.1 Bulk Size: 100 - Inserts: 3000 - Rounds: 30 Seconds < Lower Is Better a ............... 232.19 |======================================= 4484PX .......... 253.99 |=========================================== px .............. 254.73 |=========================================== 4464p ........... 259.20 |=========================================== 4464p epyc ...... 259.06 |=========================================== 4364P ........... 239.08 |======================================== 4584PX .......... 252.83 |========================================== EPYC 4584PX amd . 253.49 |========================================== 45 .............. 253.28 |========================================== 41 .............. 314.49 |===================================================== 41 b ............ 316.46 |===================================================== BYTE Unix Benchmark 5.1.3-git Computational Test: Pipe LPS > Higher Is Better a ............... 48806257.1 |================================================= 4484PX .......... 33443359.2 |================================== px .............. 33381363.1 |================================== 4464p ........... 32471450.7 |================================= 4464p epyc ...... 32439611.6 |================================= 4364P ........... 23448988.5 |======================== 4584PX .......... 44169926.7 |============================================ EPYC 4584PX amd . 44323920.0 |============================================ 45 .............. 44309550.9 |============================================ 41 .............. 11669425.7 |============ 41 b ............ 11518844.2 |============ BYTE Unix Benchmark 5.1.3-git Computational Test: Dhrystone 2 LPS > Higher Is Better a ............... 1866536062.7 |=============================================== 4484PX .......... 1346521770.3 |================================== px .............. 1340340196.6 |================================== 4464p ........... 1272938788.0 |================================ 4464p epyc ...... 1263644317.8 |================================ 4364P ........... 966576789.4 |======================== 4584PX .......... 1765175324.6 |============================================ EPYC 4584PX amd . 1771958344.7 |============================================= 45 .............. 1766450267.1 |============================================ 41 .............. 478992410.7 |============ 41 b ............ 475486444.1 |============ BYTE Unix Benchmark 5.1.3-git Computational Test: System Call LPS > Higher Is Better a ............... 49140426.6 |================================================= 4484PX .......... 30761218.9 |=============================== px .............. 30701622.8 |=============================== 4464p ........... 29969810.9 |============================== 4464p epyc ...... 29923094.4 |============================== 4364P ........... 21559197.0 |===================== 4584PX .......... 40531084.0 |======================================== EPYC 4584PX amd . 40718581.6 |========================================= 45 .............. 40711986.9 |========================================= 41 .............. 10707715.0 |=========== 41 b ............ 10629944.8 |=========== Blender 4.3 Blend File: Classroom - Compute: CPU-Only Seconds < Lower Is Better a ............... 143.36 |============= 4484PX .......... 197.20 |=================== px .............. 197.53 |=================== 4464p ........... 212.30 |==================== 4464p epyc ...... 211.40 |==================== 4364P ........... 276.44 |========================== 4584PX .......... 149.37 |============== EPYC 4584PX amd . 148.97 |============== 45 .............. 149.37 |============== 41 .............. 560.89 |===================================================== 41 b ............ 563.14 |===================================================== Rustls 0.23.17 Benchmark: handshake-resume - Suite: TLS13_CHACHA20_POLY1305_SHA256 handshakes/s > Higher Is Better a ............... 388077.69 |================================================== 4484PX .......... 333882.92 |=========================================== px .............. 333574.30 |=========================================== 4464p ........... 328877.92 |========================================== 4464p epyc ...... 326342.42 |========================================== 4364P ........... 272035.68 |=================================== 4584PX .......... 379874.32 |================================================= EPYC 4584PX amd . 382691.63 |================================================= 45 .............. 382067.30 |================================================= 41 .............. 135362.96 |================= 41 b ............ 135016.23 |================= Rustls 0.23.17 Benchmark: handshake-ticket - Suite: TLS13_CHACHA20_POLY1305_SHA256 handshakes/s > Higher Is Better a ............... 404263.45 |================================================== 4484PX .......... 344296.24 |=========================================== px .............. 342775.29 |========================================== 4464p ........... 336267.09 |========================================== 4464p epyc ...... 335411.96 |========================================= 4364P ........... 265949.20 |================================= 4584PX .......... 393408.85 |================================================= EPYC 4584PX amd . 394570.00 |================================================= 45 .............. 395112.39 |================================================= 41 .............. 132265.65 |================ 41 b ............ 132025.36 |================ Llamafile 0.8.16 Model: wizardcoder-python-34b-v1.0.Q6_K - Test: Prompt Processing 1024 Tokens Per Second > Higher Is Better a ............... 6144 |======================================================= 4484PX .......... 6144 |======================================================= px .............. 6144 |======================================================= 4464p ........... 6144 |======================================================= 4464p epyc ...... 6144 |======================================================= 4364P ........... 6144 |======================================================= 4584PX .......... 6144 |======================================================= EPYC 4584PX amd . 6144 |======================================================= 45 .............. 6144 |======================================================= 41 b ............ 6144 |======================================================= Llama.cpp b4154 Backend: CPU BLAS - Model: Llama-3.1-Tulu-3-8B-Q8_0 - Test: Prompt Processing 2048 Tokens Per Second > Higher Is Better a ............... 63.09 |======================================= 4484PX .......... 63.80 |======================================== px .............. 63.79 |======================================== 4464p ........... 60.68 |====================================== 4464p epyc ...... 60.80 |====================================== 4364P ........... 55.95 |=================================== 4584PX .......... 86.17 |====================================================== EPYC 4584PX amd . 86.47 |====================================================== 45 .............. 86.68 |====================================================== 41 b ............ 30.93 |=================== Llama.cpp b4154 Backend: CPU BLAS - Model: Mistral-7B-Instruct-v0.3-Q8_0 - Test: Prompt Processing 2048 Tokens Per Second > Higher Is Better a ............... 62.97 |======================================= 4484PX .......... 63.61 |======================================== px .............. 63.41 |======================================= 4464p ........... 60.47 |====================================== 4464p epyc ...... 60.30 |===================================== 4364P ........... 56.05 |=================================== 4584PX .......... 86.56 |====================================================== EPYC 4584PX amd . 86.44 |====================================================== 45 .............. 86.91 |====================================================== 41 b ............ 31.04 |=================== XNNPACK b7b048 Model: QS8MobileNetV2 us < Lower Is Better a ............... 844 |======================================================== 4484PX .......... 717 |================================================ px .............. 723 |================================================ 4464p ........... 703 |=============================================== 4464p epyc ...... 703 |=============================================== 4364P ........... 400 |=========================== 4584PX .......... 814 |====================================================== 4584PX .......... 809 |====================================================== EPYC 4584PX amd . 807 |====================================================== 45 .............. 801 |===================================================== 41 .............. 623 |========================================= 41 b ............ 623 |========================================= XNNPACK b7b048 Model: FP16MobileNetV3Small us < Lower Is Better a ............... 920 |======================================================== 4484PX .......... 779 |=============================================== px .............. 798 |================================================= 4464p ........... 759 |============================================== 4464p epyc ...... 766 |=============================================== 4364P ........... 455 |============================ 4584PX .......... 882 |====================================================== 4584PX .......... 877 |===================================================== EPYC 4584PX amd . 871 |===================================================== 45 .............. 898 |======================================================= 41 .............. 714 |=========================================== 41 b ............ 720 |============================================ XNNPACK b7b048 Model: FP16MobileNetV3Large us < Lower Is Better a ............... 1498 |========================================= 4484PX .......... 1467 |======================================== px .............. 1527 |========================================== 4464p ........... 1429 |======================================= 4464p epyc ...... 1427 |======================================= 4364P ........... 1067 |============================= 4584PX .......... 1532 |========================================== 4584PX .......... 1527 |========================================== EPYC 4584PX amd . 1542 |========================================== 45 .............. 1547 |========================================== 41 .............. 2018 |======================================================= 41 b ............ 1998 |====================================================== XNNPACK b7b048 Model: FP16MobileNetV2 us < Lower Is Better a ............... 1190 |=============================== 4484PX .......... 1217 |=============================== px .............. 1248 |================================ 4464p ........... 1208 |=============================== 4464p epyc ...... 1210 |=============================== 4364P ........... 1088 |============================ 4584PX .......... 1212 |=============================== 4584PX .......... 1224 |================================ EPYC 4584PX amd . 1222 |================================ 45 .............. 1223 |================================ 41 .............. 2131 |======================================================= 41 b ............ 2097 |====================================================== XNNPACK b7b048 Model: FP32MobileNetV3Small us < Lower Is Better a ............... 979 |======================================================== 4484PX .......... 809 |============================================== px .............. 837 |================================================ 4464p ........... 799 |============================================== 4464p epyc ...... 791 |============================================= 4364P ........... 335 |=================== 4584PX .......... 934 |===================================================== 4584PX .......... 933 |===================================================== EPYC 4584PX amd . 931 |===================================================== 45 .............. 929 |===================================================== 41 .............. 412 |======================== 41 b ............ 414 |======================== XNNPACK b7b048 Model: FP32MobileNetV3Large us < Lower Is Better a ............... 1810 |======================================================= 4484PX .......... 1515 |============================================== px .............. 1574 |================================================ 4464p ........... 1473 |============================================= 4464p epyc ...... 1542 |=============================================== 4364P ........... 753 |======================= 4584PX .......... 1749 |===================================================== 4584PX .......... 1760 |===================================================== EPYC 4584PX amd . 1756 |===================================================== 45 .............. 1754 |===================================================== 41 .............. 1342 |========================================= 41 b ............ 1359 |========================================= XNNPACK b7b048 Model: FP32MobileNetV2 us < Lower Is Better a ............... 1495 |======================================================= 4484PX .......... 1365 |================================================== px .............. 1368 |================================================== 4464p ........... 1357 |================================================== 4464p epyc ...... 1327 |================================================= 4364P ........... 708 |========================== 4584PX .......... 1481 |====================================================== 4584PX .......... 1484 |======================================================= EPYC 4584PX amd . 1477 |====================================================== 45 .............. 1478 |====================================================== 41 .............. 1425 |==================================================== 41 b ............ 1443 |===================================================== XNNPACK b7b048 Model: FP32MobileNetV1 us < Lower Is Better a ............... 1252 |============================= 4484PX .......... 1257 |============================= px .............. 1272 |============================= 4464p ........... 1267 |============================= 4464p epyc ...... 1246 |============================ 4364P ........... 1056 |======================== 4584PX .......... 1191 |=========================== 4584PX .......... 1194 |=========================== EPYC 4584PX amd . 1192 |=========================== 45 .............. 1189 |=========================== 41 .............. 2367 |====================================================== 41 b ............ 2407 |======================================================= XNNPACK b7b048 Model: FP16MobileNetV1 us < Lower Is Better a ............... 1143 |================== 4484PX .......... 1383 |====================== px .............. 1386 |====================== 4464p ........... 1418 |====================== 4464p epyc ...... 1414 |====================== 4364P ........... 1578 |========================= 4584PX .......... 1200 |=================== EPYC 4584PX amd . 1196 |=================== 45 .............. 1195 |=================== 41 .............. 3512 |======================================================= 41 b ............ 3508 |======================================================= Rustls 0.23.17 Benchmark: handshake-ticket - Suite: TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384 handshakes/s > Higher Is Better a ............... 1553632.14 |================================================= 4484PX .......... 1329363.10 |========================================== px .............. 1340712.85 |========================================== 4464p ........... 1297646.72 |========================================= 4464p epyc ...... 1300937.30 |========================================= 4364P ........... 1187839.34 |===================================== 4584PX .......... 1559859.89 |================================================= EPYC 4584PX amd . 1569308.65 |================================================= 45 .............. 1569479.70 |================================================= 41 .............. 596141.19 |=================== 41 b ............ 602002.02 |=================== Whisperfile 20Aug24 Model Size: Small Seconds < Lower Is Better a ............... 195.42 |================================= 4484PX .......... 173.38 |============================== px .............. 167.89 |============================= 4464p ........... 178.33 |============================== 4464p epyc ...... 177.87 |============================== 4364P ........... 193.94 |================================= 4584PX .......... 155.14 |========================== EPYC 4584PX amd . 155.97 |=========================== 45 .............. 154.44 |========================== 41 b ............ 310.38 |===================================================== Rustls 0.23.17 Benchmark: handshake-resume - Suite: TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384 handshakes/s > Higher Is Better a ............... 1820810.21 |================================================ 4484PX .......... 1586292.42 |========================================= px .............. 1572010.68 |========================================= 4464p ........... 1543373.12 |======================================== 4464p epyc ...... 1532788.04 |======================================== 4364P ........... 1298373.66 |================================== 4584PX .......... 1863395.07 |================================================= EPYC 4584PX amd . 1874050.70 |================================================= 45 .............. 1862938.00 |================================================= 41 .............. 732992.32 |=================== 41 b ............ 690282.02 |================== OpenSSL Algorithm: ChaCha20 byte/s > Higher Is Better a ............... 130588495050 |=============================================== 4484PX .......... 97105235690 |=================================== px .............. 97019897450 |=================================== 4464p ........... 93956743710 |================================== 4464p epyc ...... 93907572870 |================================== 4364P ........... 68048329660 |======================== 4584PX .......... 127793294810 |============================================== EPYC 4584PX amd . 128265416980 |============================================== 45 .............. 128278766110 |============================================== 41 .............. 33280835860 |============ 41 b ............ 33289542860 |============ OpenSSL Algorithm: ChaCha20-Poly1305 byte/s > Higher Is Better a ............... 92393529340 |================================================ 4484PX .......... 68816544020 |==================================== px .............. 68678955550 |==================================== 4464p ........... 66548747470 |=================================== 4464p epyc ...... 66497739430 |=================================== 4364P ........... 48278109930 |========================= 4584PX .......... 90711447140 |=============================================== EPYC 4584PX amd . 90927418030 |=============================================== 45 .............. 91025092880 |=============================================== 41 .............. 23701092760 |============ 41 b ............ 23701138360 |============ OpenSSL Algorithm: AES-256-GCM byte/s > Higher Is Better a ............... 97172751700 |================================================ 4484PX .......... 71160291870 |=================================== px .............. 70902656480 |=================================== 4464p ........... 67431535960 |================================= 4464p epyc ...... 67396254380 |================================= 4364P ........... 49930945600 |========================= 4584PX .......... 93168087590 |============================================== EPYC 4584PX amd . 93555991350 |============================================== 45 .............. 93614594180 |============================================== 41 .............. 23845653160 |============ 41 b ............ 23760535010 |============ OpenSSL Algorithm: AES-128-GCM byte/s > Higher Is Better a ............... 104784522170 |=============================================== 4484PX .......... 76496336760 |================================== px .............. 76184405610 |================================== 4464p ........... 72709954220 |================================= 4464p epyc ...... 72667527300 |================================= 4364P ........... 53755663700 |======================== 4584PX .......... 100450008810 |============================================= EPYC 4584PX amd . 100666591640 |============================================= 45 .............. 100742301290 |============================================= 41 .............. 25376123290 |=========== 41 b ............ 25582374640 |=========== Llamafile 0.8.16 Model: mistral-7b-instruct-v0.2.Q5_K_M - Test: Text Generation 128 Tokens Per Second > Higher Is Better a ............... 10.47 |==================================================== 4484PX .......... 10.91 |====================================================== px .............. 10.93 |====================================================== 4464p ........... 10.93 |====================================================== 4464p epyc ...... 10.91 |====================================================== 4364P ........... 10.32 |=================================================== 4584PX .......... 10.81 |===================================================== EPYC 4584PX amd . 10.85 |====================================================== 45 .............. 10.82 |===================================================== 41 b ............ 10.46 |==================================================== SVT-AV1 2.3 Encoder Mode: Preset 3 - Input: Bosphorus 1080p Frames Per Second > Higher Is Better a ............... 29.57 |====================================================== 4484PX .......... 25.45 |============================================== px .............. 25.45 |============================================== 4464p ........... 24.85 |============================================= 4464p epyc ...... 24.81 |============================================= 4364P ........... 18.74 |================================== 4584PX .......... 29.07 |===================================================== EPYC 4584PX amd . 29.21 |===================================================== 45 .............. 29.18 |===================================================== 41 .............. 10.58 |=================== 41 b ............ 10.55 |=================== Apache CouchDB 3.4.1 Bulk Size: 500 - Inserts: 1000 - Rounds: 30 Seconds < Lower Is Better a ............... 148.05 |===================================== 4484PX .......... 164.47 |========================================= px .............. 164.81 |========================================= 4464p ........... 164.36 |========================================= 4464p epyc ...... 163.36 |========================================= 4364P ........... 163.92 |========================================= 4584PX .......... 163.81 |========================================= EPYC 4584PX amd . 161.09 |======================================== 45 .............. 161.47 |======================================== 41 .............. 212.83 |===================================================== 41 b ............ 212.53 |===================================================== Gcrypt Library 1.10.3 Seconds < Lower Is Better a ............... 162.13 |================================================== 4484PX .......... 171.02 |===================================================== px .............. 163.84 |=================================================== 4464p ........... 156.34 |================================================ 4464p epyc ...... 156.71 |================================================= 4364P ........... 154.32 |================================================ 4584PX .......... 150.64 |=============================================== EPYC 4584PX amd . 159.25 |================================================= 45 .............. 167.63 |==================================================== 41 .............. 165.55 |=================================================== 41 b ............ 169.14 |==================================================== ASTC Encoder 5.0 Preset: Very Thorough MT/s > Higher Is Better a ............... 2.7410 |===================================================== 4484PX .......... 1.9412 |====================================== px .............. 1.9391 |===================================== 4464p ........... 1.8546 |==================================== 4464p epyc ...... 1.8559 |==================================== 4364P ........... 1.4052 |=========================== 4584PX .......... 2.5634 |================================================== EPYC 4584PX amd . 2.5694 |================================================== 45 .............. 2.5696 |================================================== 41 .............. 0.6923 |============= 41 b ............ 0.6906 |============= ASTC Encoder 5.0 Preset: Exhaustive MT/s > Higher Is Better a ............... 1.6844 |===================================================== 4484PX .......... 1.1887 |===================================== px .............. 1.1862 |===================================== 4464p ........... 1.1365 |==================================== 4464p epyc ...... 1.1368 |==================================== 4364P ........... 0.8612 |=========================== 4584PX .......... 1.5697 |================================================= EPYC 4584PX amd . 1.5743 |================================================== 45 .............. 1.5767 |================================================== 41 .............. 0.4244 |============= 41 b ............ 0.4223 |============= OSPRay 3.2 Benchmark: particle_volume/scivis/real_time Items Per Second > Higher Is Better a ............... 8.98486 |==================================================== 4484PX .......... 6.44913 |===================================== px .............. 6.52304 |====================================== 4464p ........... 6.29615 |==================================== 4464p epyc ...... 6.27188 |==================================== 4364P ........... 4.62423 |=========================== 4584PX .......... 8.49097 |================================================= EPYC 4584PX amd . 8.51233 |================================================= 45 .............. 8.54395 |================================================= 41 .............. 2.29544 |============= 41 b ............ 2.27718 |============= OSPRay 3.2 Benchmark: particle_volume/pathtracer/real_time Items Per Second > Higher Is Better a ............... 236.25 |===================================================== 4484PX .......... 199.02 |============================================= px .............. 197.20 |============================================ 4464p ........... 199.51 |============================================= 4464p epyc ...... 199.55 |============================================= 4364P ........... 177.12 |======================================== 4584PX .......... 218.18 |================================================= EPYC 4584PX amd . 220.80 |================================================== 45 .............. 220.73 |================================================== 41 .............. 112.72 |========================= 41 b ............ 111.48 |========================= SVT-AV1 2.3 Encoder Mode: Preset 8 - Input: Beauty 4K 10-bit Frames Per Second > Higher Is Better a ............... 12.468 |===================================================== 4484PX .......... 10.967 |=============================================== px .............. 10.855 |============================================== 4464p ........... 10.914 |============================================== 4464p epyc ...... 10.885 |============================================== 4364P ........... 6.458 |=========================== 4584PX .......... 12.086 |=================================================== EPYC 4584PX amd . 11.897 |=================================================== 45 .............. 12.112 |=================================================== 41 .............. 4.334 |================== 41 b ............ 4.332 |================== GROMACS Input: water_GMX50_bare Ns Per Day > Higher Is Better a ............... 1.692 |================================================== 4484PX .......... 1.577 |=============================================== px .............. 1.575 |=============================================== 4464p ........... 1.398 |========================================== 4464p epyc ...... 1.393 |========================================= 4364P ........... 1.104 |================================= 4584PX .......... 1.817 |====================================================== EPYC 4584PX amd . 1.808 |====================================================== 45 .............. 1.811 |====================================================== 41 .............. 0.664 |==================== 41 b ............ 0.661 |==================== Build2 0.17 Time To Compile Seconds < Lower Is Better a ............... 92.05 |================ 4484PX .......... 111.65 |==================== px .............. 113.78 |==================== 4464p ........... 121.74 |===================== 4464p epyc ...... 117.07 |===================== 4364P ........... 154.43 |=========================== 4584PX .......... 91.72 |================ EPYC 4584PX amd . 92.02 |================ 45 .............. 91.02 |================ 41 .............. 300.72 |===================================================== 41 b ............ 294.95 |==================================================== Primesieve 12.6 Length: 1e13 Seconds < Lower Is Better a ............... 78.50 |============== 4484PX .......... 110.61 |=================== px .............. 110.71 |=================== 4464p ........... 118.66 |===================== 4464p epyc ...... 118.85 |===================== 4364P ........... 150.67 |========================== 4584PX .......... 84.49 |=============== EPYC 4584PX amd . 84.26 |=============== 45 .............. 84.32 |=============== 41 .............. 301.60 |===================================================== 41 b ............ 302.74 |===================================================== Llamafile 0.8.16 Model: mistral-7b-instruct-v0.2.Q5_K_M - Test: Prompt Processing 1024 Tokens Per Second > Higher Is Better a ............... 16384 |====================================================== 4484PX .......... 16384 |====================================================== px .............. 16384 |====================================================== 4464p ........... 16384 |====================================================== 4464p epyc ...... 16384 |====================================================== 4364P ........... 16384 |====================================================== 4584PX .......... 16384 |====================================================== EPYC 4584PX amd . 16384 |====================================================== 45 .............. 16384 |====================================================== 41 b ............ 16384 |====================================================== Blender 4.3 Blend File: Junkshop - Compute: CPU-Only Seconds < Lower Is Better a ............... 73.56 |============= 4484PX .......... 97.01 |================= px .............. 97.10 |================== 4464p ........... 104.70 |=================== 4464p epyc ...... 104.01 |=================== 4364P ........... 141.99 |========================== 4584PX .......... 73.87 |============= EPYC 4584PX amd . 73.55 |============= 45 .............. 73.69 |============= 41 .............. 292.14 |===================================================== 41 b ............ 294.04 |===================================================== Apache Cassandra 5.0 Test: Writes Op/s > Higher Is Better a ............... 271333 |===================================================== 4484PX .......... 174960 |================================== px .............. 173946 |================================== 4464p ........... 173633 |================================== 4464p epyc ...... 174025 |================================== 4364P ........... 139110 |=========================== 4584PX .......... 235893 |============================================== EPYC 4584PX amd . 238227 |=============================================== 45 .............. 236826 |============================================== 41 .............. 66243 |============= 41 b ............ 66519 |============= Blender 4.3 Blend File: Fishy Cat - Compute: CPU-Only Seconds < Lower Is Better a ............... 71.35 |============= 4484PX .......... 96.67 |================== px .............. 97.09 |================== 4464p ........... 105.45 |==================== 4464p epyc ...... 105.24 |==================== 4364P ........... 136.51 |========================== 4584PX .......... 73.96 |============== EPYC 4584PX amd . 73.86 |============== 45 .............. 73.48 |============== 41 .............. 280.26 |===================================================== 41 b ............ 282.19 |===================================================== Apache CouchDB 3.4.1 Bulk Size: 300 - Inserts: 1000 - Rounds: 30 Seconds < Lower Is Better a ............... 106.13 |===================================== 4484PX .......... 117.57 |======================================== px .............. 119.35 |========================================= 4464p ........... 118.16 |========================================= 4464p epyc ...... 116.42 |======================================== 4364P ........... 118.32 |========================================= 4584PX .......... 116.24 |======================================== EPYC 4584PX amd . 116.62 |======================================== 45 .............. 116.22 |======================================== 41 .............. 153.03 |===================================================== 41 b ............ 154.04 |===================================================== PyPerformance 1.11 Benchmark: async_tree_io Milliseconds < Lower Is Better a ............... 755 |================================================= 4484PX .......... 666 |=========================================== px .............. 656 |=========================================== 4464p ........... 738 |================================================ 4464p epyc ...... 742 |================================================ 4364P ........... 726 |=============================================== 4584PX .......... 653 |=========================================== EPYC 4584PX amd . 651 |========================================== 45 .............. 633 |========================================= 41 .............. 855 |======================================================== 41 b ............ 858 |======================================================== OpenVINO GenAI 2024.5 Model: Gemma-7b-int4-ov - Device: CPU - Time Per Output Token ms < Lower Is Better a ............... 101.72 |=========================================== 4484PX .......... 97.79 |========================================== px .............. 97.61 |========================================== 4464p ........... 98.33 |========================================== 4464p epyc ...... 98.03 |========================================== 4364P ........... 105.09 |============================================= 4584PX .......... 98.91 |========================================== EPYC 4584PX amd . 98.64 |========================================== 45 .............. 98.31 |========================================== 41 b ............ 124.24 |===================================================== OpenVINO GenAI 2024.5 Model: Gemma-7b-int4-ov - Device: CPU - Time To First Token ms < Lower Is Better a ............... 106.62 |==================== 4484PX .......... 121.48 |====================== px .............. 122.30 |====================== 4464p ........... 124.38 |======================= 4464p epyc ...... 124.52 |======================= 4364P ........... 154.83 |============================ 4584PX .......... 105.36 |=================== EPYC 4584PX amd . 104.38 |=================== 45 .............. 104.87 |=================== 41 b ............ 288.64 |===================================================== OpenVINO GenAI 2024.5 Model: Gemma-7b-int4-ov - Device: CPU tokens/s > Higher Is Better a ............... 9.83 |==================================================== 4484PX .......... 10.23 |====================================================== px .............. 10.24 |====================================================== 4464p ........... 10.17 |====================================================== 4464p epyc ...... 10.20 |====================================================== 4364P ........... 9.52 |================================================== 4584PX .......... 10.11 |===================================================== EPYC 4584PX amd . 10.14 |===================================================== 45 .............. 10.17 |====================================================== 41 b ............ 8.05 |========================================== Llamafile 0.8.16 Model: Llama-3.2-3B-Instruct.Q6_K - Test: Prompt Processing 2048 Tokens Per Second > Higher Is Better a ............... 32768 |====================================================== 4484PX .......... 32768 |====================================================== px .............. 32768 |====================================================== 4464p ........... 32768 |====================================================== 4464p epyc ...... 32768 |====================================================== 4364P ........... 32768 |====================================================== 4584PX .......... 32768 |====================================================== EPYC 4584PX amd . 32768 |====================================================== 45 .............. 32768 |====================================================== 41 b ............ 32768 |====================================================== Rustls 0.23.17 Benchmark: handshake - Suite: TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384 handshakes/s > Higher Is Better a ............... 423535.68 |================================================= 4484PX .......... 306153.20 |=================================== px .............. 304060.28 |=================================== 4464p ........... 301017.23 |=================================== 4464p epyc ...... 301217.61 |=================================== 4364P ........... 225379.66 |========================== 4584PX .......... 435194.20 |================================================== EPYC 4584PX amd . 436101.34 |================================================== 45 .............. 435926.40 |================================================== 41 .............. 106833.78 |============ 41 b ............ 105324.92 |============ Llamafile 0.8.16 Model: wizardcoder-python-34b-v1.0.Q6_K - Test: Prompt Processing 512 Tokens Per Second > Higher Is Better a ............... 3072 |======================================================= 4484PX .......... 3072 |======================================================= px .............. 3072 |======================================================= 4464p ........... 3072 |======================================================= 4464p epyc ...... 3072 |======================================================= 4364P ........... 3072 |======================================================= 4584PX .......... 3072 |======================================================= EPYC 4584PX amd . 3072 |======================================================= 45 .............. 3072 |======================================================= 41 b ............ 3072 |======================================================= SVT-AV1 2.3 Encoder Mode: Preset 5 - Input: Bosphorus 4K Frames Per Second > Higher Is Better a ............... 34.54 |====================================================== 4484PX .......... 29.09 |============================================= px .............. 28.82 |============================================= 4464p ........... 27.36 |=========================================== 4464p epyc ...... 27.56 |=========================================== 4364P ........... 19.85 |=============================== 4584PX .......... 34.16 |===================================================== EPYC 4584PX amd . 34.41 |====================================================== 45 .............. 34.66 |====================================================== 41 .............. 10.87 |================= 41 b ............ 10.81 |================= OSPRay 3.2 Benchmark: particle_volume/ao/real_time Items Per Second > Higher Is Better a ............... 9.00917 |==================================================== 4484PX .......... 6.52776 |====================================== px .............. 6.52206 |====================================== 4464p ........... 6.28807 |==================================== 4464p epyc ...... 6.29211 |==================================== 4364P ........... 4.63965 |=========================== 4584PX .......... 8.51573 |================================================= EPYC 4584PX amd . 8.57146 |================================================= 45 .............. 8.54878 |================================================= 41 .............. 2.30223 |============= 41 b ............ 2.26612 |============= CP2K Molecular Dynamics 2024.3 Input: Fayalite-FIST Seconds < Lower Is Better a ............... 94.03 |============================ 4484PX .......... 92.21 |=========================== px .............. 94.90 |============================ 4464p ........... 100.49 |============================== 4464p epyc ...... 97.45 |============================= 4364P ........... 108.44 |================================ 4584PX .......... 84.80 |========================= EPYC 4584PX amd . 84.21 |========================= 45 .............. 84.07 |========================= 41 .............. 177.14 |==================================================== 41 b ............ 179.12 |===================================================== Whisper.cpp 1.6.2 Model: ggml-base.en - Input: 2016 State of the Union Seconds < Lower Is Better a ............... 87.49 |========================= 4484PX .......... 92.71 |========================== px .............. 93.45 |========================== 4464p ........... 97.94 |============================ 4464p epyc ...... 97.55 |============================ 4364P ........... 103.72 |============================= 4584PX .......... 84.68 |======================== EPYC 4584PX amd . 84.03 |======================== 45 .............. 84.11 |======================== 41 .............. 187.29 |===================================================== 41 b ............ 186.23 |===================================================== PyPerformance 1.11 Benchmark: asyncio_tcp_ssl Milliseconds < Lower Is Better a ............... 645 |================================================= 4484PX .......... 590 |============================================= px .............. 590 |============================================= 4464p ........... 626 |================================================ 4464p epyc ...... 628 |================================================ 4364P ........... 610 |============================================== 4584PX .......... 582 |============================================ EPYC 4584PX amd . 586 |============================================= 45 .............. 581 |============================================ 41 .............. 723 |======================================================= 41 b ............ 737 |======================================================== PyPerformance 1.11 Benchmark: xml_etree Milliseconds < Lower Is Better a ............... 35.8 |====================================================== 4484PX .......... 36.8 |======================================================= px .............. 36.5 |======================================================= 4464p ........... 35.3 |===================================================== 4464p epyc ...... 35.6 |===================================================== 4364P ........... 34.7 |==================================================== 4584PX .......... 36.1 |====================================================== EPYC 4584PX amd . 36.2 |====================================================== 45 .............. 36.1 |====================================================== 41 .............. 36.7 |======================================================= 41 b ............ 36.6 |======================================================= Numpy Benchmark Score > Higher Is Better a ............... 775.75 |================================================= 4484PX .......... 745.59 |=============================================== px .............. 831.42 |===================================================== 4464p ........... 781.66 |================================================== 4464p epyc ...... 783.43 |================================================== 4364P ........... 813.31 |==================================================== 4584PX .......... 806.83 |=================================================== EPYC 4584PX amd . 754.41 |================================================ 45 .............. 833.64 |===================================================== 41 .............. 705.99 |============================================= 41 b ............ 700.76 |============================================= simdjson 3.10 Throughput Test: Kostya GB/s > Higher Is Better a ............... 5.97 |====================================================== 4484PX .......... 6.11 |======================================================= px .............. 5.45 |================================================= 4464p ........... 5.78 |==================================================== 4464p epyc ...... 6.02 |====================================================== 4364P ........... 6.06 |======================================================= 4584PX .......... 6.07 |======================================================= EPYC 4584PX amd . 6.04 |====================================================== 45 .............. 5.54 |================================================== 41 .............. 5.70 |=================================================== 41 b ............ 5.68 |=================================================== Llama.cpp b4154 Backend: CPU BLAS - Model: Llama-3.1-Tulu-3-8B-Q8_0 - Test: Prompt Processing 1024 Tokens Per Second > Higher Is Better a ............... 70.85 |========================================== 4484PX .......... 66.57 |======================================= px .............. 66.35 |======================================= 4464p ........... 63.71 |====================================== 4464p epyc ...... 63.50 |====================================== 4364P ........... 59.27 |=================================== 4584PX .......... 90.01 |===================================================== EPYC 4584PX amd . 91.31 |====================================================== 45 .............. 90.96 |====================================================== 41 b ............ 31.91 |=================== Llama.cpp b4154 Backend: CPU BLAS - Model: Mistral-7B-Instruct-v0.3-Q8_0 - Test: Prompt Processing 1024 Tokens Per Second > Higher Is Better a ............... 69.26 |========================================= 4484PX .......... 66.85 |======================================== px .............. 66.52 |======================================= 4464p ........... 64.15 |====================================== 4464p epyc ...... 62.84 |===================================== 4364P ........... 59.54 |=================================== 4584PX .......... 91.12 |====================================================== EPYC 4584PX amd . 90.48 |====================================================== 45 .............. 91.17 |====================================================== 41 b ............ 32.59 |=================== Blender 4.3 Blend File: BMW27 - Compute: CPU-Only Seconds < Lower Is Better a ............... 53.55 |============= 4484PX .......... 74.08 |================== px .............. 73.16 |================== 4464p ........... 79.19 |=================== 4464p epyc ...... 79.24 |=================== 4364P ........... 103.97 |========================== 4584PX .......... 55.26 |============== EPYC 4584PX amd . 55.74 |============== 45 .............. 55.18 |============== 41 .............. 215.53 |===================================================== 41 b ............ 214.89 |===================================================== Llama.cpp b4154 Backend: CPU BLAS - Model: Llama-3.1-Tulu-3-8B-Q8_0 - Test: Text Generation 128 Tokens Per Second > Higher Is Better a ............... 6.88 |===================================================== 4484PX .......... 7.11 |======================================================= px .............. 7.12 |======================================================= 4464p ........... 7.09 |======================================================= 4464p epyc ...... 7.10 |======================================================= 4364P ........... 6.64 |=================================================== 4584PX .......... 7.00 |====================================================== EPYC 4584PX amd . 7.00 |====================================================== 45 .............. 7.00 |====================================================== 41 b ............ 6.55 |=================================================== Llamafile 0.8.16 Model: Llama-3.2-3B-Instruct.Q6_K - Test: Text Generation 128 Tokens Per Second > Higher Is Better a ............... 20.13 |===================================================== 4484PX .......... 20.39 |====================================================== px .............. 20.51 |====================================================== 4464p ........... 20.48 |====================================================== 4464p epyc ...... 20.50 |====================================================== 4364P ........... 19.60 |==================================================== 4584PX .......... 20.23 |===================================================== EPYC 4584PX amd . 20.26 |===================================================== 45 .............. 20.29 |===================================================== 41 b ............ 20.08 |===================================================== NAMD 3.0 Input: STMV with 1,066,628 Atoms ns/day > Higher Is Better a ............... 0.75656 |==================================================== 4484PX .......... 0.65119 |============================================ px .............. 0.65448 |============================================= 4464p ........... 0.61452 |========================================== 4464p epyc ...... 0.61093 |========================================== 4364P ........... 0.49771 |================================== 4584PX .......... 0.75987 |==================================================== EPYC 4584PX amd . 0.75645 |==================================================== 45 .............. 0.76227 |==================================================== 41 .............. 0.27352 |=================== 41 b ............ 0.27320 |=================== Llama.cpp b4154 Backend: CPU BLAS - Model: Mistral-7B-Instruct-v0.3-Q8_0 - Test: Text Generation 128 Tokens Per Second > Higher Is Better a ............... 7.24 |====================================================== 4484PX .......... 7.41 |======================================================= px .............. 7.44 |======================================================= 4464p ........... 7.42 |======================================================= 4464p epyc ...... 7.44 |======================================================= 4364P ........... 7.02 |==================================================== 4584PX .......... 7.32 |====================================================== EPYC 4584PX amd . 7.37 |====================================================== 45 .............. 7.37 |====================================================== 41 b ............ 6.90 |=================================================== OpenVINO GenAI 2024.5 Model: Falcon-7b-instruct-int4-ov - Device: CPU - Time Per Output Token ms < Lower Is Better a ............... 77.34 |================================================ 4484PX .......... 74.65 |============================================== px .............. 74.54 |============================================== 4464p ........... 74.94 |============================================== 4464p epyc ...... 75.06 |============================================== 4364P ........... 79.41 |================================================= 4584PX .......... 75.06 |============================================== EPYC 4584PX amd . 75.51 |============================================== 45 .............. 74.86 |============================================== 41 b ............ 87.90 |====================================================== OpenVINO GenAI 2024.5 Model: Falcon-7b-instruct-int4-ov - Device: CPU - Time To First Token ms < Lower Is Better a ............... 86.06 |===================== 4484PX .......... 93.01 |======================= px .............. 93.00 |======================= 4464p ........... 93.00 |======================= 4464p epyc ...... 94.77 |======================= 4364P ........... 115.73 |============================ 4584PX .......... 86.04 |===================== EPYC 4584PX amd . 86.20 |===================== 45 .............. 87.34 |===================== 41 b ............ 217.85 |===================================================== OpenVINO GenAI 2024.5 Model: Falcon-7b-instruct-int4-ov - Device: CPU tokens/s > Higher Is Better a ............... 12.93 |==================================================== 4484PX .......... 13.40 |====================================================== px .............. 13.41 |====================================================== 4464p ........... 13.34 |====================================================== 4464p epyc ...... 13.32 |====================================================== 4364P ........... 12.59 |=================================================== 4584PX .......... 13.32 |====================================================== EPYC 4584PX amd . 13.24 |===================================================== 45 .............. 13.36 |====================================================== 41 b ............ 11.38 |============================================== SVT-AV1 2.3 Encoder Mode: Preset 13 - Input: Beauty 4K 10-bit Frames Per Second > Higher Is Better a ............... 18.588 |===================================================== 4484PX .......... 17.406 |================================================== px .............. 17.355 |================================================= 4464p ........... 18.002 |=================================================== 4464p epyc ...... 17.944 |=================================================== 4364P ........... 9.188 |========================== 4584PX .......... 17.845 |=================================================== EPYC 4584PX amd . 17.863 |=================================================== 45 .............. 17.836 |=================================================== 41 .............. 8.007 |======================= 41 b ............ 7.984 |======================= Stockfish 17 Chess Benchmark Nodes Per Second > Higher Is Better a ............... 54752796 |================================================ 4484PX .......... 45267546 |======================================= px .............. 42973396 |===================================== 4464p ........... 43158853 |====================================== 4464p epyc ...... 42042951 |===================================== 4364P ........... 31514937 |=========================== 4584PX .......... 57247763 |================================================== EPYC 4584PX amd . 58676636 |=================================================== 45 .............. 55762702 |================================================ 41 .............. 12630264 |=========== 41 b ............ 14943737 |============= PyPerformance 1.11 Benchmark: python_startup Milliseconds < Lower Is Better a ............... 5.77 |============================================== 4484PX .......... 6.08 |================================================ px .............. 6.09 |================================================ 4464p ........... 5.80 |============================================== 4464p epyc ...... 5.81 |============================================== 4364P ........... 6.34 |================================================== 4584PX .......... 6.01 |=============================================== EPYC 4584PX amd . 6.01 |=============================================== 45 .............. 6.03 |================================================ 41 .............. 6.93 |======================================================= 41 b ............ 6.97 |======================================================= simdjson 3.10 Throughput Test: LargeRandom GB/s > Higher Is Better a ............... 1.83 |======================================================= 4484PX .......... 1.84 |======================================================= px .............. 1.84 |======================================================= 4464p ........... 1.81 |====================================================== 4464p epyc ...... 1.73 |==================================================== 4364P ........... 1.81 |====================================================== 4584PX .......... 1.82 |====================================================== EPYC 4584PX amd . 1.83 |======================================================= 45 .............. 1.83 |======================================================= 41 .............. 1.70 |=================================================== 41 b ............ 1.71 |=================================================== ACES DGEMM 1.0 Sustained Floating-Point Rate GFLOP/s > Higher Is Better a ............... 1141.19 |==================================================== 4484PX .......... 842.73 |====================================== px .............. 842.01 |====================================== 4464p ........... 818.68 |===================================== 4464p epyc ...... 812.15 |===================================== 4364P ........... 629.17 |============================= 4584PX .......... 1091.01 |================================================== EPYC 4584PX amd . 1093.10 |================================================== 45 .............. 1092.09 |================================================== 41 .............. 259.15 |============ 41 b ............ 263.20 |============ Timed Eigen Compilation 3.4.0 Time To Compile Seconds < Lower Is Better a ............... 58.66 |===================== 4484PX .......... 67.36 |======================== px .............. 67.08 |======================== 4464p ........... 69.38 |========================= 4464p epyc ...... 69.58 |========================= 4364P ........... 84.48 |=============================== 4584PX .......... 58.82 |===================== EPYC 4584PX amd . 58.69 |===================== 45 .............. 57.18 |===================== 41 .............. 145.21 |==================================================== 41 b ............ 146.66 |===================================================== Apache CouchDB 3.4.1 Bulk Size: 100 - Inserts: 1000 - Rounds: 30 Seconds < Lower Is Better a ............... 69.93 |======================================= 4484PX .......... 75.90 |========================================== px .............. 76.39 |=========================================== 4464p ........... 76.70 |=========================================== 4464p epyc ...... 76.58 |=========================================== 4364P ........... 73.24 |========================================= 4584PX .......... 75.89 |========================================== EPYC 4584PX amd . 76.67 |=========================================== 45 .............. 76.66 |=========================================== 41 .............. 96.74 |====================================================== 41 b ............ 96.55 |====================================================== oneDNN 3.6 Harness: Recurrent Neural Network Training - Engine: CPU ms < Lower Is Better a ............... 1372.03 |=============== 4484PX .......... 1898.36 |===================== px .............. 1895.68 |===================== 4464p ........... 1911.44 |===================== 4464p epyc ...... 1913.86 |===================== 4364P ........... 2422.83 |=========================== 4584PX .......... 1320.99 |============== EPYC 4584PX amd . 1320.37 |============== 45 .............. 1320.23 |============== 41 .............. 4726.08 |==================================================== 41 b ............ 4752.85 |==================================================== Renaissance 0.16 Test: ALS Movie Lens ms < Lower Is Better a ............... 9805.7 |==================================================== 4484PX .......... 9378.8 |================================================== px .............. 9275.7 |================================================= 4464p ........... 9243.0 |================================================= 4464p epyc ...... 8980.8 |================================================ 4364P ........... 5993.4 |================================ 4584PX .......... 9891.4 |===================================================== EPYC 4584PX amd . 9969.8 |===================================================== 45 .............. 9972.0 |===================================================== 41 .............. 7465.1 |======================================== 41 b ............ 7147.4 |====================================== oneDNN 3.6 Harness: Recurrent Neural Network Inference - Engine: CPU ms < Lower Is Better a ............... 700.86 |=============== 4484PX .......... 965.02 |===================== px .............. 966.01 |===================== 4464p ........... 1009.58 |====================== 4464p epyc ...... 1012.19 |====================== 4364P ........... 1270.76 |=========================== 4584PX .......... 672.51 |============== EPYC 4584PX amd . 670.23 |============== 45 .............. 670.70 |============== 41 .............. 2415.25 |=================================================== 41 b ............ 2441.27 |==================================================== simdjson 3.10 Throughput Test: DistinctUserID GB/s > Higher Is Better a ............... 10.46 |=================================================== 4484PX .......... 10.76 |==================================================== px .............. 8.97 |=========================================== 4464p ........... 10.54 |=================================================== 4464p epyc ...... 10.28 |================================================== 4364P ........... 10.85 |===================================================== 4584PX .......... 11.05 |====================================================== EPYC 4584PX amd . 11.14 |====================================================== 45 .............. 9.15 |============================================ 41 .............. 9.92 |================================================ 41 b ............ 10.16 |================================================= Stockfish Chess Benchmark Nodes Per Second > Higher Is Better a ............... 46507038 |================================================= 4484PX .......... 33702298 |=================================== px .............. 33871595 |=================================== 4464p ........... 30315972 |================================ 4464p epyc ...... 29940074 |=============================== 4364P ........... 24017024 |========================= 4584PX .......... 44446458 |============================================== EPYC 4584PX amd . 45724794 |================================================ 45 .............. 48797079 |=================================================== 41 .............. 12024682 |============= 41 b ............ 11607502 |============ simdjson 3.10 Throughput Test: TopTweet GB/s > Higher Is Better a ............... 10.46 |================================================== 4484PX .......... 10.82 |==================================================== px .............. 10.51 |================================================== 4464p ........... 10.66 |=================================================== 4464p epyc ...... 10.69 |=================================================== 4364P ........... 10.86 |==================================================== 4584PX .......... 11.25 |====================================================== EPYC 4584PX amd . 9.19 |============================================ 45 .............. 9.40 |============================================= 41 .............. 10.02 |================================================ 41 b ............ 9.97 |================================================ simdjson 3.10 Throughput Test: PartialTweets GB/s > Higher Is Better a ............... 9.76 |=================================================== 4484PX .......... 10.10 |===================================================== px .............. 8.35 |============================================ 4464p ........... 9.80 |=================================================== 4464p epyc ...... 9.63 |================================================== 4364P ........... 10.04 |===================================================== 4584PX .......... 9.85 |==================================================== EPYC 4584PX amd . 9.98 |==================================================== 45 .............. 10.32 |====================================================== 41 .............. 9.32 |================================================= 41 b ............ 9.30 |================================================= Llamafile 0.8.16 Model: TinyLlama-1.1B-Chat-v1.0.BF16 - Test: Text Generation 128 Tokens Per Second > Higher Is Better a ............... 26.28 |=================================================== 4484PX .......... 27.59 |====================================================== px .............. 27.80 |====================================================== 4464p ........... 27.36 |===================================================== 4464p epyc ...... 27.35 |===================================================== 4364P ........... 25.52 |================================================== 4584PX .......... 27.20 |===================================================== EPYC 4584PX amd . 27.19 |===================================================== 45 .............. 27.21 |===================================================== 41 b ............ 25.09 |================================================= Renaissance 0.16 Test: In-Memory Database Shootout ms < Lower Is Better a ............... 3256.1 |=============================================== 4484PX .......... 3241.5 |=============================================== px .............. 3175.6 |============================================== 4464p ........... 3288.5 |=============================================== 4464p epyc ...... 3275.5 |=============================================== 4364P ........... 3244.8 |=============================================== 4584PX .......... 3232.8 |=============================================== EPYC 4584PX amd . 3442.9 |================================================== 45 .............. 3408.4 |================================================= 41 .............. 2951.1 |========================================== 41 b ............ 3681.9 |===================================================== Renaissance 0.16 Test: Akka Unbalanced Cobwebbed Tree ms < Lower Is Better a ............... 4403.8 |==================================================== 4484PX .......... 4038.4 |================================================ px .............. 4002.3 |=============================================== 4464p ........... 4084.6 |================================================ 4464p epyc ...... 4098.5 |================================================= 4364P ........... 3720.1 |============================================ 4584PX .......... 4384.0 |==================================================== EPYC 4584PX amd . 4344.8 |=================================================== 45 .............. 4359.3 |==================================================== 41 .............. 4474.8 |===================================================== 41 b ............ 4457.1 |===================================================== Renaissance 0.16 Test: Apache Spark PageRank ms < Lower Is Better a ............... 2412.2 |=================================================== 4484PX .......... 2138.1 |============================================= px .............. 2229.7 |=============================================== 4464p ........... 2366.1 |================================================== 4464p epyc ...... 2373.0 |================================================== 4364P ........... 2506.8 |===================================================== 4584PX .......... 2182.5 |============================================== EPYC 4584PX amd . 2227.9 |=============================================== 45 .............. 2179.0 |============================================== 41 .............. 2267.1 |================================================ 41 b ............ 2292.2 |================================================ Llamafile 0.8.16 Model: mistral-7b-instruct-v0.2.Q5_K_M - Test: Prompt Processing 512 Tokens Per Second > Higher Is Better a ............... 8192 |======================================================= 4484PX .......... 8192 |======================================================= px .............. 8192 |======================================================= 4464p ........... 8192 |======================================================= 4464p epyc ...... 8192 |======================================================= 4364P ........... 8192 |======================================================= 4584PX .......... 8192 |======================================================= EPYC 4584PX amd . 8192 |======================================================= 45 .............. 8192 |======================================================= 41 b ............ 8192 |======================================================= CP2K Molecular Dynamics 2024.3 Input: H20-64 Seconds < Lower Is Better a ............... 58.19 |======================== 4484PX .......... 53.01 |===================== px .............. 52.72 |===================== 4464p ........... 58.40 |======================== 4464p epyc ...... 58.86 |======================== 4364P ........... 68.17 |============================ 4584PX .......... 43.17 |================= EPYC 4584PX amd . 42.51 |================= 45 .............. 42.47 |================= 41 .............. 123.66 |================================================== 41 b ............ 130.81 |===================================================== Renaissance 0.16 Test: Savina Reactors.IO ms < Lower Is Better a ............... 3506.4 |================================================= 4484PX .......... 3655.8 |=================================================== px .............. 3676.0 |=================================================== 4464p ........... 3523.1 |================================================= 4464p epyc ...... 3688.6 |=================================================== 4364P ........... 3349.5 |============================================== 4584PX .......... 3582.4 |================================================== EPYC 4584PX amd . 3641.9 |=================================================== 45 .............. 3589.4 |================================================== 41 .............. 3745.8 |==================================================== 41 b ............ 3818.5 |===================================================== Renaissance 0.16 Test: Gaussian Mixture Model ms < Lower Is Better a ............... 3399.5 |=============================================== 4484PX .......... 3860.6 |===================================================== px .............. 3815.2 |==================================================== 4464p ........... 3647.2 |================================================== 4464p epyc ...... 3703.2 |=================================================== 4364P ........... 3397.0 |=============================================== 4584PX .......... 3806.5 |==================================================== EPYC 4584PX amd . 3773.1 |==================================================== 45 .............. 3829.9 |===================================================== 41 .............. 3087.0 |========================================== 41 b ............ 3130.4 |=========================================== PyPerformance 1.11 Benchmark: gc_collect Milliseconds < Lower Is Better a ............... 677 |====================================================== 4484PX .......... 699 |======================================================= px .............. 706 |======================================================== 4464p ........... 671 |===================================================== 4464p epyc ...... 671 |===================================================== 4364P ........... 649 |=================================================== 4584PX .......... 682 |====================================================== EPYC 4584PX amd . 686 |====================================================== 45 .............. 689 |======================================================= 41 .............. 702 |======================================================== 41 b ............ 704 |======================================================== Renaissance 0.16 Test: Apache Spark Bayes ms < Lower Is Better a ............... 490.0 |============================================ 4484PX .......... 513.2 |============================================== px .............. 474.9 |=========================================== 4464p ........... 515.3 |============================================== 4464p epyc ...... 513.3 |============================================== 4364P ........... 483.4 |=========================================== 4584PX .......... 477.0 |=========================================== EPYC 4584PX amd . 515.6 |============================================== 45 .............. 500.0 |============================================= 41 .............. 566.2 |=================================================== 41 b ............ 600.1 |====================================================== Renaissance 0.16 Test: Finagle HTTP Requests ms < Lower Is Better a ............... 2319.4 |============================================= 4484PX .......... 2492.2 |================================================= px .............. 2483.1 |================================================= 4464p ........... 2650.9 |==================================================== 4464p epyc ...... 2708.1 |===================================================== 4364P ........... 1705.5 |================================= 4584PX .......... 2627.3 |=================================================== EPYC 4584PX amd . 2571.2 |================================================== 45 .............. 2570.5 |================================================== 41 .............. 1664.4 |================================= 41 b ............ 1669.9 |================================= Renaissance 0.16 Test: Random Forest ms < Lower Is Better a ............... 414.4 |============================================== 4484PX .......... 422.0 |=============================================== px .............. 453.2 |================================================== 4464p ........... 415.3 |============================================== 4464p epyc ...... 412.9 |============================================== 4364P ........... 381.6 |========================================== 4584PX .......... 420.7 |=============================================== EPYC 4584PX amd . 402.2 |============================================= 45 .............. 407.7 |============================================= 41 .............. 439.9 |================================================= 41 b ............ 485.4 |====================================================== OSPRay 3.2 Benchmark: gravity_spheres_volume/dim_512/scivis/real_time Items Per Second > Higher Is Better a ............... 7.58789 |==================================================== 4484PX .......... 5.54888 |====================================== px .............. 5.61470 |====================================== 4464p ........... 5.35756 |===================================== 4464p epyc ...... 5.36189 |===================================== 4364P ........... 3.83152 |========================== 4584PX .......... 7.32353 |================================================== EPYC 4584PX amd . 7.32284 |================================================== 45 .............. 7.31594 |================================================== 41 .............. 1.90804 |============= 41 b ............ 1.89469 |============= OSPRay 3.2 Benchmark: gravity_spheres_volume/dim_512/ao/real_time Items Per Second > Higher Is Better a ............... 7.63944 |==================================================== 4484PX .......... 5.63122 |====================================== px .............. 5.71084 |======================================= 4464p ........... 5.47043 |===================================== 4464p epyc ...... 5.47057 |===================================== 4364P ........... 3.91749 |=========================== 4584PX .......... 7.38760 |================================================== EPYC 4584PX amd . 7.44575 |=================================================== 45 .............. 7.46399 |=================================================== 41 .............. 1.84407 |============= 41 b ............ 1.90481 |============= ONNX Runtime 1.19 Model: ResNet101_DUC_HDC-12 - Device: CPU - Executor: Standard Inference Time Cost (ms) < Lower Is Better a ............... 648.52 |================ 4484PX .......... 850.14 |===================== px .............. 854.33 |===================== 4464p ........... 872.74 |===================== 4464p epyc ...... 864.81 |===================== 4364P ........... 1091.32 |========================== 4584PX .......... 650.96 |================ EPYC 4584PX amd . 647.81 |================ 45 .............. 645.21 |================ 41 .............. 2151.82 |==================================================== 41 b ............ 2152.92 |==================================================== ONNX Runtime 1.19 Model: ResNet101_DUC_HDC-12 - Device: CPU - Executor: Standard Inferences Per Second > Higher Is Better a ............... 1.541960 |=================================================== 4484PX .......... 1.176270 |======================================= px .............. 1.170500 |======================================= 4464p ........... 1.145810 |====================================== 4464p epyc ...... 1.156320 |====================================== 4364P ........... 0.916317 |============================== 4584PX .......... 1.536190 |=================================================== EPYC 4584PX amd . 1.543650 |=================================================== 45 .............. 1.549880 |=================================================== 41 .............. 0.464723 |=============== 41 b ............ 0.464485 |=============== Renaissance 0.16 Test: Scala Dotty ms < Lower Is Better a ............... 477.0 |================================================== 4484PX .......... 428.6 |============================================= px .............. 436.2 |============================================== 4464p ........... 424.6 |============================================ 4464p epyc ...... 442.9 |============================================== 4364P ........... 464.5 |================================================= 4584PX .......... 441.9 |============================================== EPYC 4584PX amd . 411.9 |=========================================== 45 .............. 455.6 |================================================ 41 .............. 506.5 |===================================================== 41 b ............ 515.8 |====================================================== Renaissance 0.16 Test: Genetic Algorithm Using Jenetics + Futures ms < Lower Is Better a ............... 732.8 |===================================== 4484PX .......... 904.0 |============================================== px .............. 920.7 |============================================== 4464p ........... 924.5 |=============================================== 4464p epyc ...... 884.0 |============================================= 4364P ........... 749.9 |====================================== 4584PX .......... 1050.3 |===================================================== EPYC 4584PX amd . 959.3 |================================================ 45 .............. 891.2 |============================================= 41 .............. 806.4 |========================================= 41 b ............ 801.4 |======================================== ONNX Runtime 1.19 Model: fcn-resnet101-11 - Device: CPU - Executor: Standard Inference Time Cost (ms) < Lower Is Better a ............... 310.88 |================== 4484PX .......... 355.75 |==================== px .............. 357.60 |==================== 4464p ........... 386.56 |====================== 4464p epyc ...... 386.06 |====================== 4364P ........... 487.30 |============================ 4584PX .......... 295.28 |================= EPYC 4584PX amd . 294.93 |================= 45 .............. 293.96 |================= 41 .............. 926.76 |===================================================== 41 b ............ 927.39 |===================================================== ONNX Runtime 1.19 Model: fcn-resnet101-11 - Device: CPU - Executor: Standard Inferences Per Second > Higher Is Better a ............... 3.21670 |================================================= 4484PX .......... 2.81093 |=========================================== px .............. 2.79638 |=========================================== 4464p ........... 2.58688 |======================================== 4464p epyc ...... 2.59025 |======================================== 4364P ........... 2.05211 |=============================== 4584PX .......... 3.38658 |==================================================== EPYC 4584PX amd . 3.39064 |==================================================== 45 .............. 3.40178 |==================================================== 41 .............. 1.07903 |================ 41 b ............ 1.07829 |================ ONNX Runtime 1.19 Model: GPT-2 - Device: CPU - Executor: Standard Inference Time Cost (ms) < Lower Is Better a ............... 7.42776 |================================================ 4484PX .......... 6.25815 |======================================== px .............. 6.33034 |========================================= 4464p ........... 7.33331 |=============================================== 4464p epyc ...... 7.36544 |=============================================== 4364P ........... 7.96069 |=================================================== 4584PX .......... 6.02069 |======================================= EPYC 4584PX amd . 6.03024 |======================================= 45 .............. 6.01631 |======================================= 41 .............. 8.04835 |==================================================== 41 b ............ 8.10767 |==================================================== ONNX Runtime 1.19 Model: GPT-2 - Device: CPU - Executor: Standard Inferences Per Second > Higher Is Better a ............... 134.60 |=========================================== 4484PX .......... 159.71 |=================================================== px .............. 157.89 |================================================== 4464p ........... 136.30 |=========================================== 4464p epyc ...... 135.72 |=========================================== 4364P ........... 125.52 |======================================== 4584PX .......... 166.05 |===================================================== EPYC 4584PX amd . 165.77 |===================================================== 45 .............. 166.17 |===================================================== 41 .............. 124.17 |======================================== 41 b ............ 123.27 |======================================= OSPRay 3.2 Benchmark: gravity_spheres_volume/dim_512/pathtracer/real_time Items Per Second > Higher Is Better a ............... 8.82093 |==================================================== 4484PX .......... 6.41198 |====================================== px .............. 6.40740 |====================================== 4464p ........... 6.17399 |==================================== 4464p epyc ...... 6.17624 |==================================== 4364P ........... 4.52318 |=========================== 4584PX .......... 8.43752 |================================================== EPYC 4584PX amd . 8.47727 |================================================== 45 .............. 8.49646 |================================================== 41 .............. 2.23851 |============= 41 b ............ 2.22318 |============= ONNX Runtime 1.19 Model: ZFNet-512 - Device: CPU - Executor: Standard Inference Time Cost (ms) < Lower Is Better a ............... 9.76985 |==================================== 4484PX .......... 9.01322 |================================== px .............. 9.01687 |================================== 4464p ........... 9.85896 |===================================== 4464p epyc ...... 9.83893 |===================================== 4364P ........... 10.28350 |====================================== 4584PX .......... 8.87444 |================================= EPYC 4584PX amd . 8.82581 |================================= 45 .............. 8.83524 |================================= 41 .............. 13.53230 |================================================== 41 b ............ 13.69550 |=================================================== ONNX Runtime 1.19 Model: ZFNet-512 - Device: CPU - Executor: Standard Inferences Per Second > Higher Is Better a ............... 102.33 |================================================ 4484PX .......... 110.94 |==================================================== px .............. 110.89 |==================================================== 4464p ........... 101.41 |=============================================== 4464p epyc ...... 101.62 |================================================ 4364P ........... 97.23 |============================================= 4584PX .......... 112.67 |===================================================== EPYC 4584PX amd . 113.29 |===================================================== 45 .............. 113.17 |===================================================== 41 .............. 73.88 |=================================== 41 b ............ 73.00 |================================== ONNX Runtime 1.19 Model: bertsquad-12 - Device: CPU - Executor: Standard Inference Time Cost (ms) < Lower Is Better a ............... 64.14 |==================================== 4484PX .......... 68.91 |======================================= px .............. 68.61 |======================================= 4464p ........... 68.08 |======================================= 4464p epyc ...... 68.09 |======================================= 4364P ........... 50.47 |============================= 4584PX .......... 66.62 |====================================== EPYC 4584PX amd . 66.92 |====================================== 45 .............. 67.18 |====================================== 41 .............. 95.07 |====================================================== 41 b ............ 94.12 |===================================================== ONNX Runtime 1.19 Model: bertsquad-12 - Device: CPU - Executor: Standard Inferences Per Second > Higher Is Better a ............... 15.59 |========================================== 4484PX .......... 14.51 |======================================== px .............. 14.57 |======================================== 4464p ........... 14.69 |======================================== 4464p epyc ...... 14.69 |======================================== 4364P ........... 19.81 |====================================================== 4584PX .......... 15.01 |========================================= EPYC 4584PX amd . 14.94 |========================================= 45 .............. 14.88 |========================================= 41 .............. 10.52 |============================= 41 b ............ 10.62 |============================= ONNX Runtime 1.19 Model: T5 Encoder - Device: CPU - Executor: Standard Inference Time Cost (ms) < Lower Is Better a ............... 6.39112 |=============================================== 4484PX .......... 4.80287 |=================================== px .............. 4.85142 |=================================== 4464p ........... 5.95035 |=========================================== 4464p epyc ...... 6.00470 |============================================ 4364P ........... 7.06075 |=================================================== 4584PX .......... 4.90285 |==================================== EPYC 4584PX amd . 4.91381 |==================================== 45 .............. 4.90313 |==================================== 41 .............. 7.04122 |=================================================== 41 b ............ 7.13857 |==================================================== ONNX Runtime 1.19 Model: T5 Encoder - Device: CPU - Executor: Standard Inferences Per Second > Higher Is Better a ............... 156.45 |======================================== 4484PX .......... 208.17 |===================================================== px .............. 206.09 |==================================================== 4464p ........... 168.04 |=========================================== 4464p epyc ...... 166.51 |========================================== 4364P ........... 141.57 |==================================== 4584PX .......... 203.95 |==================================================== EPYC 4584PX amd . 203.49 |==================================================== 45 .............. 203.93 |==================================================== 41 .............. 141.96 |==================================== 41 b ............ 140.03 |==================================== ONNX Runtime 1.19 Model: yolov4 - Device: CPU - Executor: Standard Inference Time Cost (ms) < Lower Is Better a ............... 90.45 |================================== 4484PX .......... 93.16 |=================================== px .............. 93.34 |=================================== 4464p ........... 95.25 |==================================== 4464p epyc ...... 95.36 |==================================== 4364P ........... 75.54 |============================= 4584PX .......... 88.06 |================================= EPYC 4584PX amd . 88.36 |================================== 45 .............. 88.41 |================================== 41 .............. 139.66 |===================================================== 41 b ............ 139.72 |===================================================== ONNX Runtime 1.19 Model: yolov4 - Device: CPU - Executor: Standard Inferences Per Second > Higher Is Better a ............... 11.05520 |=========================================== 4484PX .......... 10.73380 |========================================= px .............. 10.71270 |========================================= 4464p ........... 10.49820 |======================================== 4464p epyc ...... 10.48650 |======================================== 4364P ........... 13.23720 |=================================================== 4584PX .......... 11.35510 |============================================ EPYC 4584PX amd . 11.31660 |============================================ 45 .............. 11.31050 |============================================ 41 .............. 7.16015 |============================ 41 b ............ 7.15712 |============================ ONNX Runtime 1.19 Model: ArcFace ResNet-100 - Device: CPU - Executor: Standard Inference Time Cost (ms) < Lower Is Better a ............... 23.55 |============================== 4484PX .......... 26.75 |================================== px .............. 26.95 |=================================== 4464p ........... 27.68 |==================================== 4464p epyc ...... 27.47 |=================================== 4364P ........... 25.58 |================================= 4584PX .......... 22.81 |============================= EPYC 4584PX amd . 22.70 |============================= 45 .............. 22.99 |============================== 41 .............. 41.94 |====================================================== 41 b ............ 41.82 |====================================================== ONNX Runtime 1.19 Model: ArcFace ResNet-100 - Device: CPU - Executor: Standard Inferences Per Second > Higher Is Better a ............... 42.45 |==================================================== 4484PX .......... 37.38 |============================================== px .............. 37.10 |============================================= 4464p ........... 36.12 |============================================ 4464p epyc ...... 36.40 |============================================= 4364P ........... 39.08 |================================================ 4584PX .......... 43.84 |====================================================== EPYC 4584PX amd . 44.05 |====================================================== 45 .............. 43.49 |===================================================== 41 .............. 23.84 |============================= 41 b ............ 23.91 |============================= ONNX Runtime 1.19 Model: Faster R-CNN R-50-FPN-int8 - Device: CPU - Executor: Standard Inference Time Cost (ms) < Lower Is Better a ............... 21.24 |========================================= 4484PX .......... 24.94 |================================================= px .............. 23.06 |============================================= 4464p ........... 21.57 |========================================== 4464p epyc ...... 21.69 |========================================== 4364P ........... 22.32 |============================================ 4584PX .......... 20.72 |======================================== EPYC 4584PX amd . 20.88 |========================================= 45 .............. 20.98 |========================================= 41 .............. 27.69 |====================================================== 41 b ............ 25.95 |=================================================== ONNX Runtime 1.19 Model: Faster R-CNN R-50-FPN-int8 - Device: CPU - Executor: Standard Inferences Per Second > Higher Is Better a ............... 47.07 |===================================================== 4484PX .......... 40.09 |============================================= px .............. 43.36 |================================================= 4464p ........... 46.35 |==================================================== 4464p epyc ...... 46.09 |==================================================== 4364P ........... 44.80 |================================================== 4584PX .......... 48.26 |====================================================== EPYC 4584PX amd . 47.89 |====================================================== 45 .............. 47.67 |===================================================== 41 .............. 36.11 |======================================== 41 b ............ 38.53 |=========================================== ONNX Runtime 1.19 Model: CaffeNet 12-int8 - Device: CPU - Executor: Standard Inference Time Cost (ms) < Lower Is Better a ............... 1.570840 |======================================== 4484PX .......... 1.061880 |=========================== px .............. 1.066000 |=========================== 4464p ........... 1.379700 |=================================== 4464p epyc ...... 1.335160 |================================== 4364P ........... 1.311210 |================================= 4584PX .......... 0.994193 |========================= EPYC 4584PX amd . 0.999701 |========================= 45 .............. 0.986643 |========================= 41 .............. 2.016090 |=================================================== 41 b ............ 2.019130 |=================================================== ONNX Runtime 1.19 Model: CaffeNet 12-int8 - Device: CPU - Executor: Standard Inferences Per Second > Higher Is Better a ............... 636.32 |================================= 4484PX .......... 941.40 |================================================ px .............. 937.78 |================================================ 4464p ........... 724.53 |===================================== 4464p epyc ...... 748.66 |====================================== 4364P ........... 762.25 |======================================= 4584PX .......... 1005.50 |==================================================== EPYC 4584PX amd . 999.97 |=================================================== 45 .............. 1013.19 |==================================================== 41 .............. 495.84 |========================= 41 b ............ 495.08 |========================= ONNX Runtime 1.19 Model: ResNet50 v1-12-int8 - Device: CPU - Executor: Standard Inference Time Cost (ms) < Lower Is Better a ............... 2.55898 |=========================== 4484PX .......... 2.80544 |============================= px .............. 2.80695 |============================== 4464p ........... 2.77422 |============================= 4464p epyc ...... 2.76714 |============================= 4364P ........... 2.65482 |============================ 4584PX .......... 2.60974 |=========================== EPYC 4584PX amd . 2.61221 |=========================== 45 .............. 2.62573 |============================ 41 .............. 4.81530 |=================================================== 41 b ............ 4.94636 |==================================================== ONNX Runtime 1.19 Model: ResNet50 v1-12-int8 - Device: CPU - Executor: Standard Inferences Per Second > Higher Is Better a ............... 390.60 |===================================================== 4484PX .......... 356.41 |================================================ px .............. 356.19 |================================================ 4464p ........... 360.35 |================================================= 4464p epyc ...... 361.30 |================================================= 4364P ........... 376.53 |=================================================== 4584PX .......... 383.13 |==================================================== EPYC 4584PX amd . 382.77 |==================================================== 45 .............. 380.80 |==================================================== 41 .............. 207.61 |============================ 41 b ............ 202.12 |=========================== ONNX Runtime 1.19 Model: super-resolution-10 - Device: CPU - Executor: Standard Inference Time Cost (ms) < Lower Is Better a ............... 7.08601 |========================== 4484PX .......... 7.98873 |============================== px .............. 7.99486 |============================== 4464p ........... 7.41037 |============================ 4464p epyc ...... 7.43372 |============================ 4364P ........... 6.36564 |======================== 4584PX .......... 8.18519 |=============================== EPYC 4584PX amd . 8.18265 |=============================== 45 .............. 8.18175 |=============================== 41 .............. 13.64570 |=================================================== 41 b ............ 13.54170 |=================================================== ONNX Runtime 1.19 Model: super-resolution-10 - Device: CPU - Executor: Standard Inferences Per Second > Higher Is Better a ............... 141.12 |================================================ 4484PX .......... 125.17 |========================================== px .............. 125.08 |========================================== 4464p ........... 134.94 |============================================== 4464p epyc ...... 134.52 |============================================= 4364P ........... 157.08 |===================================================== 4584PX .......... 122.17 |========================================= EPYC 4584PX amd . 122.21 |========================================= 45 .............. 122.22 |========================================= 41 .............. 73.27 |========================= 41 b ............ 73.84 |========================= Llama.cpp b4154 Backend: CPU BLAS - Model: granite-3.0-3b-a800m-instruct-Q8_0 - Test: Prompt Processing 2048 Tokens Per Second > Higher Is Better a ............... 279.04 |=================================================== 4484PX .......... 222.75 |========================================= px .............. 208.99 |====================================== 4464p ........... 213.02 |======================================= 4464p epyc ...... 212.30 |======================================= 4364P ........... 171.68 |=============================== 4584PX .......... 289.41 |===================================================== EPYC 4584PX amd . 289.04 |===================================================== 45 .............. 273.67 |================================================== 41 b ............ 105.10 |=================== PyPerformance 1.11 Benchmark: asyncio_websockets Milliseconds < Lower Is Better a ............... 315 |===================================================== 4484PX .......... 321 |====================================================== px .............. 322 |====================================================== 4464p ........... 315 |===================================================== 4464p epyc ...... 316 |===================================================== 4364P ........... 308 |==================================================== 4584PX .......... 315 |===================================================== EPYC 4584PX amd . 317 |====================================================== 45 .............. 314 |===================================================== 41 .............. 330 |======================================================== 41 b ............ 331 |======================================================== Llamafile 0.8.16 Model: Llama-3.2-3B-Instruct.Q6_K - Test: Prompt Processing 1024 Tokens Per Second > Higher Is Better a ............... 16384 |====================================================== 4484PX .......... 16384 |====================================================== px .............. 16384 |====================================================== 4464p ........... 16384 |====================================================== 4464p epyc ...... 16384 |====================================================== 4364P ........... 16384 |====================================================== 4584PX .......... 16384 |====================================================== EPYC 4584PX amd . 16384 |====================================================== 45 .............. 16384 |====================================================== 41 b ............ 16384 |====================================================== Llamafile 0.8.16 Model: wizardcoder-python-34b-v1.0.Q6_K - Test: Prompt Processing 256 Tokens Per Second > Higher Is Better a ............... 1536 |======================================================= 4484PX .......... 1536 |======================================================= px .............. 1536 |======================================================= 4464p ........... 1536 |======================================================= 4464p epyc ...... 1536 |======================================================= 4364P ........... 1536 |======================================================= 4584PX .......... 1536 |======================================================= EPYC 4584PX amd . 1536 |======================================================= 45 .............. 1536 |======================================================= 41 b ............ 1536 |======================================================= Llamafile 0.8.16 Model: TinyLlama-1.1B-Chat-v1.0.BF16 - Test: Prompt Processing 2048 Tokens Per Second > Higher Is Better a ............... 32768 |====================================================== 4484PX .......... 32768 |====================================================== px .............. 32768 |====================================================== 4464p ........... 32768 |====================================================== 4464p epyc ...... 32768 |====================================================== 4364P ........... 32768 |====================================================== 4584PX .......... 32768 |====================================================== EPYC 4584PX amd . 32768 |====================================================== 45 .............. 32768 |====================================================== 41 b ............ 32768 |====================================================== SVT-AV1 2.3 Encoder Mode: Preset 5 - Input: Bosphorus 1080p Frames Per Second > Higher Is Better a ............... 101.97 |===================================================== 4484PX .......... 88.42 |============================================== px .............. 88.27 |============================================== 4464p ........... 86.96 |============================================= 4464p epyc ...... 86.39 |============================================= 4364P ........... 65.32 |================================== 4584PX .......... 98.79 |=================================================== EPYC 4584PX amd . 99.45 |==================================================== 45 .............. 98.91 |=================================================== 41 .............. 37.17 |=================== 41 b ............ 37.07 |=================== LiteRT 2024-10-15 Model: Inception V4 Microseconds < Lower Is Better a ............... 21477.8 |======================= 4484PX .......... 22083.3 |======================= px .............. 22752.4 |======================== 4464p ........... 23141.4 |========================= 4464p epyc ...... 22928.3 |======================== 4364P ........... 24502.1 |========================== 4584PX .......... 20102.8 |===================== EPYC 4584PX amd . 19859.4 |===================== 45 .............. 19686.0 |===================== 41 .............. 49048.8 |==================================================== 41 b ............ 49101.9 |==================================================== LiteRT 2024-10-15 Model: Inception ResNet V2 Microseconds < Lower Is Better a ............... 19530.2 |======================== 4484PX .......... 19477.8 |======================== px .............. 19490.7 |======================== 4464p ........... 20123.5 |========================= 4464p epyc ...... 20503.5 |========================= 4364P ........... 21153.5 |========================== 4584PX .......... 18224.0 |======================= EPYC 4584PX amd . 18412.3 |======================= 45 .............. 17824.6 |====================== 41 .............. 41844.0 |==================================================== 41 b ............ 41757.9 |==================================================== LiteRT 2024-10-15 Model: NASNet Mobile Microseconds < Lower Is Better a ............... 16936.00 |=================================================== 4484PX .......... 8057.56 |======================== px .............. 7931.64 |======================== 4464p ........... 7759.69 |======================= 4464p epyc ...... 7640.81 |======================= 4364P ........... 3808.80 |=========== 4584PX .......... 9311.77 |============================ EPYC 4584PX amd . 9231.97 |============================ 45 .............. 9245.76 |============================ 41 .............. 5153.49 |================ 41 b ............ 5034.38 |=============== LiteRT 2024-10-15 Model: DeepLab V3 Microseconds < Lower Is Better a ............... 3579.67 |==================================================== 4484PX .......... 2343.38 |================================== px .............. 2359.99 |================================== 4464p ........... 2272.28 |================================= 4464p epyc ...... 2289.58 |================================= 4364P ........... 1569.75 |======================= 4584PX .......... 2185.78 |================================ EPYC 4584PX amd . 2200.93 |================================ 45 .............. 2152.48 |=============================== 41 .............. 2950.80 |=========================================== 41 b ............ 2994.59 |============================================ LiteRT 2024-10-15 Model: Mobilenet Float Microseconds < Lower Is Better a ............... 1211.48 |============================= 4484PX .......... 1244.70 |============================== px .............. 1244.51 |============================= 4464p ........... 1248.12 |============================== 4464p epyc ...... 1248.60 |============================== 4364P ........... 1044.53 |========================= 4584PX .......... 1165.50 |============================ EPYC 4584PX amd . 1175.50 |============================ 45 .............. 1178.94 |============================ 41 .............. 2193.88 |==================================================== 41 b ............ 2190.79 |==================================================== LiteRT 2024-10-15 Model: SqueezeNet Microseconds < Lower Is Better a ............... 1794.11 |============================= 4484PX .......... 1809.18 |============================== px .............. 1821.35 |============================== 4464p ........... 1820.34 |============================== 4464p epyc ...... 1822.70 |============================== 4364P ........... 1654.65 |=========================== 4584PX .......... 1769.56 |============================= EPYC 4584PX amd . 1765.39 |============================= 45 .............. 1763.22 |============================= 41 .............. 3173.55 |==================================================== 41 b ............ 3179.55 |==================================================== LiteRT 2024-10-15 Model: Quantized COCO SSD MobileNet v1 Microseconds < Lower Is Better a ............... 2129.52 |======================================== 4484PX .......... 1420.15 |=========================== px .............. 1417.35 |=========================== 4464p ........... 1431.19 |=========================== 4464p epyc ...... 1415.11 |=========================== 4364P ........... 1494.51 |============================ 4584PX .......... 1337.78 |========================= EPYC 4584PX amd . 1339.69 |========================= 45 .............. 1343.22 |========================= 41 .............. 2736.98 |==================================================== 41 b ............ 2741.68 |==================================================== LiteRT 2024-10-15 Model: Mobilenet Quant Microseconds < Lower Is Better a ............... 823.17 |======================== 4484PX .......... 848.94 |========================= px .............. 849.21 |========================= 4464p ........... 859.76 |========================= 4464p epyc ...... 857.49 |========================= 4364P ........... 935.99 |=========================== 4584PX .......... 734.35 |===================== EPYC 4584PX amd . 742.03 |====================== 45 .............. 730.17 |===================== 41 .............. 1781.60 |==================================================== 41 b ............ 1785.40 |==================================================== Rustls 0.23.17 Benchmark: handshake-ticket - Suite: TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256 handshakes/s > Higher Is Better a ............... 2620332.00 |================================================= 4484PX .......... 2282729.64 |=========================================== px .............. 2292879.44 |=========================================== 4464p ........... 2283083.54 |=========================================== 4464p epyc ...... 2304145.79 |=========================================== 4364P ........... 2353677.96 |============================================ 4584PX .......... 2528614.52 |=============================================== EPYC 4584PX amd . 2558621.38 |================================================ 45 .............. 2559245.20 |================================================ 41 .............. 1656876.39 |=============================== 41 b ............ 1571309.62 |============================= Llama.cpp b4154 Backend: CPU BLAS - Model: Llama-3.1-Tulu-3-8B-Q8_0 - Test: Prompt Processing 512 Tokens Per Second > Higher Is Better a ............... 70.76 |========================================= 4484PX .......... 69.11 |======================================== px .............. 67.95 |======================================= 4464p ........... 64.96 |===================================== 4464p epyc ...... 64.43 |===================================== 4364P ........... 60.87 |=================================== 4584PX .......... 92.89 |===================================================== EPYC 4584PX amd . 93.91 |====================================================== 45 .............. 91.71 |===================================================== 41 b ............ 32.97 |=================== Llama.cpp b4154 Backend: CPU BLAS - Model: Mistral-7B-Instruct-v0.3-Q8_0 - Test: Prompt Processing 512 Tokens Per Second > Higher Is Better a ............... 68.40 |======================================= 4484PX .......... 68.20 |======================================= px .............. 68.81 |======================================= 4464p ........... 65.24 |===================================== 4464p epyc ...... 64.68 |===================================== 4364P ........... 61.09 |=================================== 4584PX .......... 93.24 |====================================================== EPYC 4584PX amd . 93.49 |====================================================== 45 .............. 94.08 |====================================================== 41 b ............ 32.94 |=================== Rustls 0.23.17 Benchmark: handshake-resume - Suite: TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256 handshakes/s > Higher Is Better a ............... 3563852.57 |================================================= 4484PX .......... 3035330.21 |========================================== px .............. 3038723.48 |========================================== 4464p ........... 3061522.26 |========================================== 4464p epyc ...... 3082657.50 |========================================== 4364P ........... 2874011.56 |======================================== 4584PX .......... 3397871.03 |=============================================== EPYC 4584PX amd . 3431395.73 |=============================================== 45 .............. 3379343.72 |============================================== 41 .............. 2105346.65 |============================= 41 b ............ 2103587.50 |============================= ASTC Encoder 5.0 Preset: Thorough MT/s > Higher Is Better a ............... 20.3025 |==================================================== 4484PX .......... 14.1700 |==================================== px .............. 14.1464 |==================================== 4464p ........... 13.5230 |=================================== 4464p epyc ...... 13.5139 |=================================== 4364P ........... 10.3392 |========================== 4584PX .......... 18.7075 |================================================ EPYC 4584PX amd . 18.7499 |================================================ 45 .............. 18.7661 |================================================ 41 .............. 5.0655 |============= 41 b ............ 5.0448 |============= Llamafile 0.8.16 Model: wizardcoder-python-34b-v1.0.Q6_K - Test: Text Generation 16 Tokens Per Second > Higher Is Better a ............... 1.78 |===================================================== 4484PX .......... 1.83 |====================================================== px .............. 1.84 |====================================================== 4464p ........... 1.83 |====================================================== 4464p epyc ...... 1.83 |====================================================== 4364P ........... 1.76 |==================================================== 4584PX .......... 1.82 |====================================================== EPYC 4584PX amd . 1.83 |====================================================== 45 .............. 1.86 |======================================================= 41 b ............ 1.73 |=================================================== FinanceBench 2016-07-25 Benchmark: Bonds OpenMP ms < Lower Is Better a ............... 33061.22 |==================================== 4484PX .......... 34600.77 |===================================== px .............. 34896.84 |====================================== 4464p ........... 33551.52 |==================================== 4464p epyc ...... 33538.27 |==================================== 4364P ........... 32715.81 |=================================== 4584PX .......... 34053.06 |===================================== EPYC 4584PX amd . 33913.46 |===================================== 45 .............. 33906.69 |===================================== 41 .............. 47198.94 |=================================================== 41 b ............ 46851.42 |=================================================== Etcpak 2.0 Benchmark: Multi-Threaded - Configuration: ETC2 Mpx/s > Higher Is Better a ............... 577.82 |===================================================== 4484PX .......... 410.73 |====================================== px .............. 409.88 |====================================== 4464p ........... 388.40 |==================================== 4464p epyc ...... 388.13 |==================================== 4364P ........... 304.24 |============================ 4584PX .......... 556.04 |=================================================== EPYC 4584PX amd . 556.41 |=================================================== 45 .............. 556.87 |=================================================== 41 .............. 155.44 |============== 41 b ............ 154.25 |============== Whisperfile 20Aug24 Model Size: Tiny Seconds < Lower Is Better a ............... 41.71 |================================== 4484PX .......... 37.13 |============================== px .............. 38.72 |================================ 4464p ........... 40.85 |================================= 4464p epyc ...... 38.58 |================================ 4364P ........... 41.30 |================================== 4584PX .......... 35.91 |============================= EPYC 4584PX amd . 35.43 |============================= 45 .............. 35.11 |============================= 41 b ............ 66.11 |====================================================== Rustls 0.23.17 Benchmark: handshake - Suite: TLS13_CHACHA20_POLY1305_SHA256 handshakes/s > Higher Is Better a ............... 76454.45 |=================================================== 4484PX .......... 57716.64 |======================================= px .............. 57688.08 |====================================== 4464p ........... 56047.38 |===================================== 4464p epyc ...... 56176.90 |===================================== 4364P ........... 43571.86 |============================= 4584PX .......... 72793.26 |================================================= EPYC 4584PX amd . 72508.13 |================================================ 45 .............. 72140.75 |================================================ 41 .............. 21499.73 |============== 41 b ............ 21444.09 |============== SVT-AV1 2.3 Encoder Mode: Preset 8 - Input: Bosphorus 4K Frames Per Second > Higher Is Better a ............... 102.01 |===================================================== 4484PX .......... 85.20 |============================================ px .............. 85.00 |============================================ 4464p ........... 82.53 |=========================================== 4464p epyc ...... 82.16 |=========================================== 4364P ........... 65.19 |================================== 4584PX .......... 101.33 |===================================================== EPYC 4584PX amd . 101.54 |===================================================== 45 .............. 101.52 |===================================================== 41 .............. 35.85 |=================== 41 b ............ 35.64 |=================== Rustls 0.23.17 Benchmark: handshake - Suite: TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256 handshakes/s > Higher Is Better a ............... 80462.60 |=================================================== 4484PX .......... 59308.75 |====================================== px .............. 59206.34 |====================================== 4464p ........... 57954.19 |===================================== 4464p epyc ...... 58056.01 |===================================== 4364P ........... 45095.35 |============================= 4584PX .......... 74468.49 |=============================================== EPYC 4584PX amd . 74683.74 |=============================================== 45 .............. 74672.57 |=============================================== 41 .............. 22255.23 |============== 41 b ............ 22201.03 |============== PyPerformance 1.11 Benchmark: django_template Milliseconds < Lower Is Better a ............... 20.7 |===================================================== 4484PX .......... 21.0 |====================================================== px .............. 21.2 |======================================================= 4464p ........... 20.6 |===================================================== 4464p epyc ...... 20.6 |===================================================== 4364P ........... 20.1 |==================================================== 4584PX .......... 20.8 |====================================================== EPYC 4584PX amd . 21.0 |====================================================== 45 .............. 20.9 |====================================================== 41 .............. 21.2 |======================================================= 41 b ............ 21.3 |======================================================= OpenVINO GenAI 2024.5 Model: Phi-3-mini-128k-instruct-int4-ov - Device: CPU - Time Per Output Token ms < Lower Is Better a ............... 51.86 |=============================================== 4484PX .......... 49.31 |============================================ px .............. 49.28 |============================================ 4464p ........... 50.45 |============================================= 4464p epyc ...... 50.46 |============================================= 4364P ........... 52.64 |=============================================== 4584PX .......... 50.84 |============================================== EPYC 4584PX amd . 50.68 |============================================== 45 .............. 50.74 |============================================== 41 b ............ 60.07 |====================================================== OpenVINO GenAI 2024.5 Model: Phi-3-mini-128k-instruct-int4-ov - Device: CPU - Time To First Token ms < Lower Is Better a ............... 55.93 |======================= 4484PX .......... 58.91 |======================== px .............. 58.86 |======================== 4464p ........... 59.87 |======================== 4464p epyc ...... 59.86 |======================== 4364P ........... 71.58 |============================= 4584PX .......... 56.06 |======================= EPYC 4584PX amd . 55.47 |======================= 45 .............. 55.67 |======================= 41 b ............ 130.47 |===================================================== OpenVINO GenAI 2024.5 Model: Phi-3-mini-128k-instruct-int4-ov - Device: CPU tokens/s > Higher Is Better a ............... 19.28 |=================================================== 4484PX .......... 20.28 |====================================================== px .............. 20.29 |====================================================== 4464p ........... 19.82 |===================================================== 4464p epyc ...... 19.82 |===================================================== 4364P ........... 19.00 |=================================================== 4584PX .......... 19.67 |==================================================== EPYC 4584PX amd . 19.73 |===================================================== 45 .............. 19.71 |==================================================== 41 b ............ 16.65 |============================================ POV-Ray Trace Time Seconds < Lower Is Better a ............... 18.54 |============== 4484PX .......... 25.26 |=================== px .............. 25.33 |=================== 4464p ........... 26.61 |==================== 4464p epyc ...... 26.60 |==================== 4364P ........... 34.92 |=========================== 4584PX .......... 19.55 |=============== EPYC 4584PX amd . 20.33 |================ 45 .............. 19.52 |=============== 41 .............. 70.06 |===================================================== 41 b ............ 70.77 |====================================================== NAMD 3.0 Input: ATPase with 327,506 Atoms ns/day > Higher Is Better a ............... 2.79632 |=================================================== 4484PX .......... 2.38124 |=========================================== px .............. 2.35379 |=========================================== 4464p ........... 2.21645 |======================================== 4464p epyc ...... 2.20728 |======================================== 4364P ........... 1.74038 |================================ 4584PX .......... 2.83913 |==================================================== EPYC 4584PX amd . 2.85485 |==================================================== 45 .............. 2.83798 |==================================================== 41 .............. 0.88895 |================ 41 b ............ 0.89241 |================ Llamafile 0.8.16 Model: mistral-7b-instruct-v0.2.Q5_K_M - Test: Prompt Processing 256 Tokens Per Second > Higher Is Better a ............... 4096 |======================================================= 4484PX .......... 4096 |======================================================= px .............. 4096 |======================================================= 4464p ........... 4096 |======================================================= 4464p epyc ...... 4096 |======================================================= 4364P ........... 4096 |======================================================= 4584PX .......... 4096 |======================================================= EPYC 4584PX amd . 4096 |======================================================= 45 .............. 4096 |======================================================= 41 b ............ 4096 |======================================================= PyPerformance 1.11 Benchmark: raytrace Milliseconds < Lower Is Better a ............... 175 |====================================================== 4484PX .......... 182 |======================================================== px .............. 182 |======================================================== 4464p ........... 177 |====================================================== 4464p epyc ...... 176 |====================================================== 4364P ........... 174 |====================================================== 4584PX .......... 176 |====================================================== EPYC 4584PX amd . 176 |====================================================== 45 .............. 179 |======================================================= 41 .............. 182 |======================================================== 41 b ............ 180 |======================================================= FinanceBench 2016-07-25 Benchmark: Repo OpenMP ms < Lower Is Better a ............... 21418.45 |================================== 4484PX .......... 22320.33 |=================================== px .............. 22318.74 |=================================== 4464p ........... 21588.91 |================================== 4464p epyc ...... 21612.04 |================================== 4364P ........... 21121.61 |================================= 4584PX .......... 21948.94 |================================== EPYC 4584PX amd . 21848.07 |================================== 45 .............. 22060.15 |=================================== 41 .............. 32271.67 |=================================================== 41 b ............ 32477.35 |=================================================== PyPerformance 1.11 Benchmark: crypto_pyaes Milliseconds < Lower Is Better a ............... 41.7 |===================================================== 4484PX .......... 43.1 |======================================================= px .............. 43.3 |======================================================= 4464p ........... 41.8 |===================================================== 4464p epyc ...... 42.0 |===================================================== 4364P ........... 40.7 |==================================================== 4584PX .......... 42.7 |====================================================== EPYC 4584PX amd . 42.7 |====================================================== 45 .............. 42.4 |====================================================== 41 .............. 43.0 |======================================================= 41 b ............ 43.1 |======================================================= PyPerformance 1.11 Benchmark: chaos Milliseconds < Lower Is Better a ............... 38.2 |==================================================== 4484PX .......... 39.7 |====================================================== px .............. 39.4 |====================================================== 4464p ........... 39.0 |===================================================== 4464p epyc ...... 38.6 |===================================================== 4364P ........... 38.3 |==================================================== 4584PX .......... 39.2 |====================================================== EPYC 4584PX amd . 39.1 |===================================================== 45 .............. 38.8 |===================================================== 41 .............. 39.9 |======================================================= 41 b ............ 40.2 |======================================================= PyPerformance 1.11 Benchmark: go Milliseconds < Lower Is Better a ............... 77.8 |====================================================== 4484PX .......... 78.6 |====================================================== px .............. 79.4 |======================================================= 4464p ........... 78.3 |====================================================== 4464p epyc ...... 76.0 |===================================================== 4364P ........... 75.3 |==================================================== 4584PX .......... 78.4 |====================================================== EPYC 4584PX amd . 79.6 |======================================================= 45 .............. 78.1 |====================================================== 41 .............. 78.4 |====================================================== 41 b ............ 78.7 |====================================================== PyPerformance 1.11 Benchmark: float Milliseconds < Lower Is Better a ............... 50.7 |===================================================== 4484PX .......... 51.3 |===================================================== px .............. 50.8 |===================================================== 4464p ........... 49.7 |==================================================== 4464p epyc ...... 49.7 |==================================================== 4364P ........... 48.2 |================================================== 4584PX .......... 51.1 |===================================================== EPYC 4584PX amd . 51.0 |===================================================== 45 .............. 50.7 |===================================================== 41 .............. 52.8 |======================================================= 41 b ............ 52.9 |======================================================= x265 Video Input: Bosphorus 4K Frames Per Second > Higher Is Better a ............... 32.57 |====================================================== 4484PX .......... 27.16 |============================================= px .............. 26.94 |============================================= 4464p ........... 26.09 |=========================================== 4464p epyc ...... 25.85 |=========================================== 4364P ........... 18.85 |=============================== 4584PX .......... 32.59 |====================================================== EPYC 4584PX amd . 32.22 |===================================================== 45 .............. 32.23 |===================================================== 41 .............. 10.91 |================== 41 b ............ 10.89 |================== PyPerformance 1.11 Benchmark: regex_compile Milliseconds < Lower Is Better a ............... 69.8 |===================================================== 4484PX .......... 71.7 |====================================================== px .............. 72.5 |======================================================= 4464p ........... 69.5 |===================================================== 4464p epyc ...... 70.0 |===================================================== 4364P ........... 68.1 |==================================================== 4584PX .......... 71.4 |====================================================== EPYC 4584PX amd . 69.8 |===================================================== 45 .............. 70.4 |===================================================== 41 .............. 72.6 |======================================================= 41 b ............ 72.7 |======================================================= Llamafile 0.8.16 Model: Llama-3.2-3B-Instruct.Q6_K - Test: Prompt Processing 512 Tokens Per Second > Higher Is Better a ............... 8192 |======================================================= 4484PX .......... 8192 |======================================================= px .............. 8192 |======================================================= 4464p ........... 8192 |======================================================= 4464p epyc ...... 8192 |======================================================= 4364P ........... 8192 |======================================================= 4584PX .......... 8192 |======================================================= EPYC 4584PX amd . 8192 |======================================================= 45 .............. 8192 |======================================================= 41 b ............ 8192 |======================================================= Llama.cpp b4154 Backend: CPU BLAS - Model: granite-3.0-3b-a800m-instruct-Q8_0 - Test: Prompt Processing 1024 Tokens Per Second > Higher Is Better a ............... 355.09 |===================================================== 4484PX .......... 232.26 |=================================== px .............. 244.77 |===================================== 4464p ........... 235.01 |=================================== 4464p epyc ...... 227.71 |================================== 4364P ........... 185.97 |============================ 4584PX .......... 290.10 |=========================================== EPYC 4584PX amd . 324.04 |================================================ 45 .............. 291.02 |=========================================== 41 b ............ 115.67 |================= Y-Cruncher 0.8.5 Pi Digits To Calculate: 1B Seconds < Lower Is Better a ............... 18.49 |========================= 4484PX .......... 18.38 |======================== px .............. 18.37 |======================== 4464p ........... 19.36 |========================== 4464p epyc ...... 19.28 |========================== 4364P ........... 23.89 |================================ 4584PX .......... 17.34 |======================= EPYC 4584PX amd . 17.57 |======================= 45 .............. 17.36 |======================= 41 .............. 40.56 |====================================================== 41 b ............ 39.25 |==================================================== PyPerformance 1.11 Benchmark: pathlib Milliseconds < Lower Is Better a ............... 14.2 |===================================================== 4484PX .......... 14.4 |====================================================== px .............. 14.4 |====================================================== 4464p ........... 14.1 |===================================================== 4464p epyc ...... 14.1 |===================================================== 4364P ........... 13.5 |=================================================== 4584PX .......... 14.1 |===================================================== EPYC 4584PX amd . 14.1 |===================================================== 45 .............. 14.2 |===================================================== 41 .............. 14.6 |======================================================= 41 b ............ 14.6 |======================================================= PyPerformance 1.11 Benchmark: pickle_pure_python Milliseconds < Lower Is Better a ............... 165 |====================================================== 4484PX .......... 169 |======================================================= px .............. 168 |======================================================= 4464p ........... 164 |====================================================== 4464p epyc ...... 164 |====================================================== 4364P ........... 162 |===================================================== 4584PX .......... 166 |====================================================== EPYC 4584PX amd . 165 |====================================================== 45 .............. 163 |===================================================== 41 .............. 171 |======================================================== 41 b ............ 171 |======================================================== oneDNN 3.6 Harness: Deconvolution Batch shapes_1d - Engine: CPU ms < Lower Is Better a ............... 2.97612 |===================== 4484PX .......... 3.40293 |======================== px .............. 3.40628 |======================== 4464p ........... 3.43287 |========================= 4464p epyc ...... 3.42547 |======================== 4364P ........... 3.78629 |=========================== 4584PX .......... 3.07219 |====================== EPYC 4584PX amd . 3.06341 |====================== 45 .............. 3.05918 |====================== 41 .............. 7.26738 |==================================================== 41 b ............ 7.28139 |==================================================== Llamafile 0.8.16 Model: mistral-7b-instruct-v0.2.Q5_K_M - Test: Text Generation 16 Tokens Per Second > Higher Is Better a ............... 10.22 |===================================================== 4484PX .......... 10.45 |====================================================== px .............. 10.45 |====================================================== 4464p ........... 10.48 |====================================================== 4464p epyc ...... 10.45 |====================================================== 4364P ........... 9.92 |=================================================== 4584PX .......... 10.30 |===================================================== EPYC 4584PX amd . 10.37 |===================================================== 45 .............. 10.34 |===================================================== 41 b ............ 9.99 |=================================================== Llamafile 0.8.16 Model: TinyLlama-1.1B-Chat-v1.0.BF16 - Test: Prompt Processing 1024 Tokens Per Second > Higher Is Better a ............... 16384 |====================================================== 4484PX .......... 16384 |====================================================== px .............. 16384 |====================================================== 4464p ........... 16384 |====================================================== 4464p epyc ...... 16384 |====================================================== 4364P ........... 16384 |====================================================== 4584PX .......... 16384 |====================================================== EPYC 4584PX amd . 16384 |====================================================== 45 .............. 16384 |====================================================== 41 b ............ 16384 |====================================================== PyPerformance 1.11 Benchmark: json_loads Milliseconds < Lower Is Better a ............... 12.1 |===================================================== 4484PX .......... 12.4 |======================================================= px .............. 12.5 |======================================================= 4464p ........... 12.0 |===================================================== 4464p epyc ...... 12.0 |===================================================== 4364P ........... 11.8 |==================================================== 4584PX .......... 12.5 |======================================================= EPYC 4584PX amd . 12.2 |====================================================== 45 .............. 12.3 |====================================================== 41 .............. 12.4 |======================================================= 41 b ............ 12.4 |======================================================= ASTC Encoder 5.0 Preset: Fast MT/s > Higher Is Better a ............... 396.65 |===================================================== 4484PX .......... 278.24 |===================================== px .............. 277.30 |===================================== 4464p ........... 263.55 |=================================== 4464p epyc ...... 263.37 |=================================== 4364P ........... 205.01 |=========================== 4584PX .......... 368.55 |================================================= EPYC 4584PX amd . 368.57 |================================================= 45 .............. 369.03 |================================================= 41 .............. 100.37 |============= 41 b ............ 99.40 |============= PyPerformance 1.11 Benchmark: nbody Milliseconds < Lower Is Better a ............... 59.0 |====================================================== 4484PX .......... 59.5 |====================================================== px .............. 59.2 |====================================================== 4464p ........... 57.2 |==================================================== 4464p epyc ...... 58.6 |===================================================== 4364P ........... 56.8 |==================================================== 4584PX .......... 59.0 |====================================================== EPYC 4584PX amd . 58.8 |====================================================== 45 .............. 59.6 |====================================================== 41 .............. 60.4 |======================================================= 41 b ............ 60.0 |======================================================= 7-Zip Compression Test: Decompression Rating MIPS > Higher Is Better a ............... 165916 |===================================================== 4484PX .......... 125698 |======================================== px .............. 125605 |======================================== 4464p ........... 118569 |====================================== 4464p epyc ...... 118587 |====================================== 4364P ........... 88229 |============================ 4584PX .......... 164581 |==================================================== EPYC 4584PX amd . 165934 |===================================================== 45 .............. 166180 |===================================================== 41 .............. 43781 |============== 41 b ............ 43210 |============== 7-Zip Compression Test: Compression Rating MIPS > Higher Is Better a ............... 163859 |=================================================== 4484PX .......... 141263 |============================================ px .............. 142213 |============================================ 4464p ........... 135033 |========================================== 4464p epyc ...... 133804 |========================================== 4364P ........... 101872 |================================ 4584PX .......... 170361 |===================================================== EPYC 4584PX amd . 169750 |===================================================== 45 .............. 169373 |===================================================== 41 .............. 54079 |================= 41 b ............ 53425 |================= SVT-AV1 2.3 Encoder Mode: Preset 13 - Input: Bosphorus 4K Frames Per Second > Higher Is Better a ............... 212.52 |==================================================== 4484PX .......... 198.11 |================================================ px .............. 194.02 |=============================================== 4464p ........... 192.17 |=============================================== 4464p epyc ...... 190.34 |============================================== 4364P ........... 156.60 |====================================== 4584PX .......... 217.91 |===================================================== EPYC 4584PX amd . 218.53 |===================================================== 45 .............. 217.96 |===================================================== 41 .............. 85.95 |===================== 41 b ............ 85.60 |===================== SVT-AV1 2.3 Encoder Mode: Preset 8 - Input: Bosphorus 1080p Frames Per Second > Higher Is Better a ............... 339.02 |===================================================== 4484PX .......... 287.05 |============================================= px .............. 286.96 |============================================= 4464p ........... 282.01 |============================================ 4464p epyc ...... 281.89 |============================================ 4364P ........... 215.21 |================================== 4584PX .......... 320.18 |================================================== EPYC 4584PX amd . 327.26 |=================================================== 45 .............. 325.95 |=================================================== 41 .............. 123.79 |=================== 41 b ............ 122.92 |=================== oneDNN 3.6 Harness: IP Shapes 1D - Engine: CPU ms < Lower Is Better a ............... 1.12573 |=============== 4484PX .......... 1.93806 |========================== px .............. 1.93913 |========================== 4464p ........... 1.88731 |========================== 4464p epyc ...... 1.88919 |========================== 4364P ........... 1.90686 |========================== 4584PX .......... 1.12465 |=============== EPYC 4584PX amd . 1.12801 |=============== 45 .............. 1.13012 |=============== 41 .............. 3.83117 |==================================================== 41 b ............ 3.82885 |==================================================== ASTC Encoder 5.0 Preset: Medium MT/s > Higher Is Better a ............... 156.22 |===================================================== 4484PX .......... 109.03 |===================================== px .............. 108.86 |===================================== 4464p ........... 103.81 |=================================== 4464p epyc ...... 103.67 |=================================== 4364P ........... 80.37 |=========================== 4584PX .......... 144.48 |================================================= EPYC 4584PX amd . 144.63 |================================================= 45 .............. 144.61 |================================================= 41 .............. 39.32 |============= 41 b ............ 39.04 |============= Llama.cpp b4154 Backend: CPU BLAS - Model: granite-3.0-3b-a800m-instruct-Q8_0 - Test: Text Generation 128 Tokens Per Second > Higher Is Better a ............... 47.72 |================================================= 4484PX .......... 52.30 |====================================================== px .............. 52.37 |====================================================== 4464p ........... 50.50 |==================================================== 4464p epyc ...... 50.43 |==================================================== 4364P ........... 51.86 |===================================================== 4584PX .......... 49.90 |=================================================== EPYC 4584PX amd . 49.76 |=================================================== 45 .............. 50.33 |==================================================== 41 b ............ 51.50 |===================================================== Llamafile 0.8.16 Model: Llama-3.2-3B-Instruct.Q6_K - Test: Prompt Processing 256 Tokens Per Second > Higher Is Better a ............... 4096 |======================================================= 4484PX .......... 4096 |======================================================= px .............. 4096 |======================================================= 4464p ........... 4096 |======================================================= 4464p epyc ...... 4096 |======================================================= 4364P ........... 4096 |======================================================= 4584PX .......... 4096 |======================================================= EPYC 4584PX amd . 4096 |======================================================= 45 .............. 4096 |======================================================= 41 b ............ 4096 |======================================================= Llama.cpp b4154 Backend: CPU BLAS - Model: granite-3.0-3b-a800m-instruct-Q8_0 - Test: Prompt Processing 512 Tokens Per Second > Higher Is Better a ............... 327.30 |=================================================== 4484PX .......... 243.14 |====================================== px .............. 232.86 |===================================== 4464p ........... 235.94 |===================================== 4464p epyc ...... 242.10 |====================================== 4364P ........... 204.06 |================================ 4584PX .......... 316.80 |================================================== EPYC 4584PX amd . 326.16 |=================================================== 45 .............. 337.06 |===================================================== 41 b ............ 122.80 |=================== Llamafile 0.8.16 Model: Llama-3.2-3B-Instruct.Q6_K - Test: Text Generation 16 Tokens Per Second > Higher Is Better a ............... 19.03 |===================================================== 4484PX .......... 19.49 |====================================================== px .............. 19.50 |====================================================== 4464p ........... 19.47 |====================================================== 4464p epyc ...... 19.53 |====================================================== 4364P ........... 18.83 |==================================================== 4584PX .......... 19.27 |===================================================== EPYC 4584PX amd . 19.24 |===================================================== 45 .............. 19.16 |===================================================== 41 b ............ 19.17 |===================================================== Y-Cruncher 0.8.5 Pi Digits To Calculate: 500M Seconds < Lower Is Better a ............... 8.772 |========================= 4484PX .......... 8.688 |========================= px .............. 8.623 |========================= 4464p ........... 9.041 |========================== 4464p epyc ...... 9.067 |========================== 4364P ........... 10.954 |================================ 4584PX .......... 8.173 |======================== EPYC 4584PX amd . 8.279 |======================== 45 .............. 8.119 |======================== 41 .............. 18.165 |===================================================== 41 b ............ 18.290 |===================================================== Primesieve 12.6 Length: 1e12 Seconds < Lower Is Better a ............... 6.347 |============== 4484PX .......... 9.116 |=================== px .............. 9.147 |==================== 4464p ........... 9.701 |===================== 4464p epyc ...... 9.705 |===================== 4364P ........... 12.273 |========================== 4584PX .......... 6.926 |=============== EPYC 4584PX amd . 6.903 |=============== 45 .............. 6.937 |=============== 41 .............. 24.723 |===================================================== 41 b ............ 24.821 |===================================================== Llamafile 0.8.16 Model: TinyLlama-1.1B-Chat-v1.0.BF16 - Test: Prompt Processing 512 Tokens Per Second > Higher Is Better a ............... 8192 |======================================================= 4484PX .......... 8192 |======================================================= px .............. 8192 |======================================================= 4464p ........... 8192 |======================================================= 4464p epyc ...... 8192 |======================================================= 4364P ........... 8192 |======================================================= 4584PX .......... 8192 |======================================================= EPYC 4584PX amd . 8192 |======================================================= 45 .............. 8192 |======================================================= 41 b ............ 8192 |======================================================= Llamafile 0.8.16 Model: TinyLlama-1.1B-Chat-v1.0.BF16 - Test: Text Generation 16 Tokens Per Second > Higher Is Better a ............... 24.59 |=================================================== 4484PX .......... 25.86 |====================================================== px .............. 25.94 |====================================================== 4464p ........... 25.77 |====================================================== 4464p epyc ...... 25.78 |====================================================== 4364P ........... 24.27 |=================================================== 4584PX .......... 25.32 |===================================================== EPYC 4584PX amd . 25.30 |===================================================== 45 .............. 25.38 |===================================================== 41 b ............ 23.80 |================================================== oneDNN 3.6 Harness: IP Shapes 3D - Engine: CPU ms < Lower Is Better a ............... 4.05800 |=========================================== 4484PX .......... 2.73072 |============================= px .............. 2.72942 |============================= 4464p ........... 3.75003 |======================================= 4464p epyc ...... 3.74578 |======================================= 4364P ........... 4.45096 |=============================================== 4584PX .......... 2.74699 |============================= EPYC 4584PX amd . 2.77727 |============================= 45 .............. 2.77835 |============================= 41 .............. 4.94689 |==================================================== 41 b ............ 4.95867 |==================================================== Renaissance 0.16 Test: Apache Spark ALS ms < Lower Is Better x265 Video Input: Bosphorus 1080p Frames Per Second > Higher Is Better a ............... 114.45 |===================================================== 4484PX .......... 101.37 |=============================================== px .............. 101.25 |=============================================== 4464p ........... 101.23 |=============================================== 4464p epyc ...... 101.33 |=============================================== 4364P ........... 88.71 |========================================= 4584PX .......... 113.37 |==================================================== EPYC 4584PX amd . 113.16 |==================================================== 45 .............. 113.31 |==================================================== 41 .............. 56.61 |========================== 41 b ............ 56.03 |========================== oneDNN 3.6 Harness: Convolution Batch Shapes Auto - Engine: CPU ms < Lower Is Better a ............... 6.67287 |====================================== 4484PX .......... 4.11551 |======================= px .............. 4.13321 |======================= 4464p ........... 6.36475 |==================================== 4464p epyc ...... 6.37150 |==================================== 4364P ........... 7.87367 |============================================= 4584PX .......... 4.03808 |======================= EPYC 4584PX amd . 4.04877 |======================= 45 .............. 4.03550 |======================= 41 .............. 9.18658 |==================================================== 41 b ............ 9.16956 |==================================================== SVT-AV1 2.3 Encoder Mode: Preset 13 - Input: Bosphorus 1080p Frames Per Second > Higher Is Better a ............... 842.56 |===================================================== 4484PX .......... 776.12 |================================================= px .............. 769.82 |================================================ 4464p ........... 752.16 |=============================================== 4464p epyc ...... 748.15 |=============================================== 4364P ........... 652.97 |========================================= 4584PX .......... 842.34 |===================================================== EPYC 4584PX amd . 845.58 |===================================================== 45 .............. 835.45 |==================================================== 41 .............. 380.63 |======================== 41 b ............ 377.79 |======================== Llamafile 0.8.16 Model: TinyLlama-1.1B-Chat-v1.0.BF16 - Test: Prompt Processing 256 Tokens Per Second > Higher Is Better a ............... 4096 |======================================================= 4484PX .......... 4096 |======================================================= px .............. 4096 |======================================================= 4464p ........... 4096 |======================================================= 4464p epyc ...... 4096 |======================================================= 4364P ........... 4096 |======================================================= 4584PX .......... 4096 |======================================================= EPYC 4584PX amd . 4096 |======================================================= 45 .............. 4096 |======================================================= 41 b ............ 4096 |======================================================= oneDNN 3.6 Harness: Deconvolution Batch shapes_3d - Engine: CPU ms < Lower Is Better a ............... 2.41294 |================= 4484PX .......... 3.50840 |======================== px .............. 3.51243 |======================== 4464p ........... 3.38958 |======================= 4464p epyc ...... 3.38823 |======================= 4364P ........... 3.78008 |========================== 4584PX .......... 2.67219 |================== EPYC 4584PX amd . 2.66429 |================== 45 .............. 2.66296 |================== 41 .............. 7.53655 |==================================================== 41 b ............ 7.55315 |==================================================== OpenVINO GenAI 2024.5 Model: TinyLlama-1.1B-Chat-v1.0 - Device: CPU tokens/s > Higher Is Better OpenSSL Algorithm: RSA4096 OpenSSL Algorithm: SHA512 OpenSSL Algorithm: SHA256