AMD EPYC 9754 128-Core testing with a AMD Titanite_4G (RTI1007B BIOS) and ASPEED on Ubuntu 24.04 via the Phoronix Test Suite.
Compare your own system(s) to this result file with the
Phoronix Test Suite by running the command:
phoronix-test-suite benchmark 2406020-NE-LLL71105371
lll
AMD EPYC 9754 128-Core testing with a AMD Titanite_4G (RTI1007B BIOS) and ASPEED on Ubuntu 24.04 via the Phoronix Test Suite.
a:
Processor: AMD EPYC 9754 128-Core @ 2.25GHz (128 Cores / 256 Threads), Motherboard: AMD Titanite_4G (RTI1007B BIOS), Chipset: AMD Device 14a4, Memory: 12 x 64GB DDR5-4800MT/s Samsung M321R8GA0BB0-CQKEG, Disk: 2 x 3201GB KIOXIA KCMYXVUG3T20, Graphics: ASPEED, Network: Broadcom NetXtreme BCM5720 PCIe
OS: Ubuntu 24.04, Kernel: 6.8.0-22-generic (x86_64), Compiler: GCC 13.2.0, File-System: ext4, Screen Resolution: 1920x1200
b:
Processor: AMD EPYC 9754 128-Core @ 2.25GHz (128 Cores / 256 Threads), Motherboard: AMD Titanite_4G (RTI1007B BIOS), Chipset: AMD Device 14a4, Memory: 12 x 64GB DDR5-4800MT/s Samsung M321R8GA0BB0-CQKEG, Disk: 2 x 3201GB KIOXIA KCMYXVUG3T20, Graphics: ASPEED, Network: Broadcom NetXtreme BCM5720 PCIe
OS: Ubuntu 24.04, Kernel: 6.8.0-22-generic (x86_64), Compiler: GCC 13.2.0, File-System: ext4, Screen Resolution: 1920x1200
Whisper.cpp 1.6.2
Model: ggml-base.en - Input: 2016 State of the Union
Seconds < Lower Is Better
a . 218.07 |===================================================================
b . 218.38 |===================================================================
Whisper.cpp 1.6.2
Model: ggml-small.en - Input: 2016 State of the Union
Seconds < Lower Is Better
a . 348.56 |==================================================================
b . 351.73 |===================================================================
Whisper.cpp 1.6.2
Model: ggml-medium.en - Input: 2016 State of the Union
Seconds < Lower Is Better
a . 700.78 |===================================================================
b . 694.43 |==================================================================
Llama.cpp b3067
Model: Meta-Llama-3-8B-Instruct-Q8_0.gguf
Tokens Per Second > Higher Is Better
a . 17.74 |====================================================================
b . 17.67 |====================================================================
Llamafile 0.8.6
Test: llava-v1.6-mistral-7b.Q8_0 - Acceleration: CPU
Tokens Per Second > Higher Is Better
Llamafile 0.8.6
Test: Meta-Llama-3-8B-Instruct.F16 - Acceleration: CPU
Tokens Per Second > Higher Is Better
a . 14.23 |=================================================================
b . 14.90 |====================================================================
Llamafile 0.8.6
Test: TinyLlama-1.1B-Chat-v1.0.BF16 - Acceleration: CPU
Tokens Per Second > Higher Is Better
a . 67.22 |====================================================================
b . 63.49 |================================================================
Llamafile 0.8.6
Test: mistral-7b-instruct-v0.2.Q5_K_M - Acceleration: CPU
Tokens Per Second > Higher Is Better
a . 30.66 |===================================================================
b . 30.92 |====================================================================
Llamafile 0.8.6
Test: wizardcoder-python-34b-v1.0.Q6_K - Acceleration: CPU
Tokens Per Second > Higher Is Better
a . 6.53 |=====================================================================
b . 6.53 |=====================================================================
Cpuminer-Opt 24.3
Algorithm: Magi
kH/s > Higher Is Better
a . 3212.29 |==================================================================
b . 3207.70 |==================================================================
Cpuminer-Opt 24.3
Algorithm: x20r
kH/s > Higher Is Better
a . 41520 |====================================================================
b . 41530 |====================================================================
Cpuminer-Opt 24.3
Algorithm: scrypt
kH/s > Higher Is Better
a . 1543.63 |==================================================================
b . 1542.43 |==================================================================
Cpuminer-Opt 24.3
Algorithm: Deepcoin
kH/s > Higher Is Better
a . 45960 |====================================================================
b . 46070 |====================================================================
Cpuminer-Opt 24.3
Algorithm: Ringcoin
kH/s > Higher Is Better
a . 12850 |====================================================================
b . 12850 |====================================================================
Cpuminer-Opt 24.3
Algorithm: Blake-2 S
kH/s > Higher Is Better
a . 739430 |===================================================================
b . 740080 |===================================================================
Cpuminer-Opt 24.3
Algorithm: Garlicoin
kH/s > Higher Is Better
a . 18510 |====================================================================
b . 18580 |====================================================================
Cpuminer-Opt 24.3
Algorithm: Skeincoin
kH/s > Higher Is Better
a . 232710 |===================================================================
b . 228790 |==================================================================
Cpuminer-Opt 24.3
Algorithm: Myriad-Groestl
kH/s > Higher Is Better
a . 59580 |====================================================================
b . 59690 |====================================================================
Cpuminer-Opt 24.3
Algorithm: LBC, LBRY Credits
kH/s > Higher Is Better
a . 81440 |====================================================================
b . 81460 |====================================================================
Cpuminer-Opt 24.3
Algorithm: Quad SHA-256, Pyrite
kH/s > Higher Is Better
a . 324310 |===================================================================
b . 324190 |===================================================================
Cpuminer-Opt 24.3
Algorithm: Triple SHA-256, Onecoin
kH/s > Higher Is Better
a . 413250 |===================================================================
b . 413700 |===================================================================
dav1d 1.4.2
Video Input: Chimera 1080p
FPS > Higher Is Better
a . 560.15 |===================================================================
b . 559.37 |===================================================================
dav1d 1.4.2
Video Input: Summer Nature 4K
FPS > Higher Is Better
a . 313.95 |===================================================================
b . 315.85 |===================================================================
dav1d 1.4.2
Video Input: Summer Nature 1080p
FPS > Higher Is Better
a . 640.92 |===================================================================
b . 641.59 |===================================================================
dav1d 1.4.2
Video Input: Chimera 1080p 10-bit
FPS > Higher Is Better
a . 526.31 |===================================================================
b . 525.12 |===================================================================
SVT-AV1 2.1
Encoder Mode: Preset 3 - Input: Bosphorus 4K
Frames Per Second > Higher Is Better
a . 6.889 |====================================================================
b . 6.848 |====================================================================
SVT-AV1 2.1
Encoder Mode: Preset 5 - Input: Bosphorus 4K
Frames Per Second > Higher Is Better
a . 19.96 |====================================================================
b . 20.05 |====================================================================
SVT-AV1 2.1
Encoder Mode: Preset 8 - Input: Bosphorus 4K
Frames Per Second > Higher Is Better
a . 76.11 |====================================================================
b . 76.50 |====================================================================
SVT-AV1 2.1
Encoder Mode: Preset 13 - Input: Bosphorus 4K
Frames Per Second > Higher Is Better
a . 172.52 |===================================================================
b . 165.65 |================================================================
SVT-AV1 2.1
Encoder Mode: Preset 3 - Input: Bosphorus 1080p
Frames Per Second > Higher Is Better
a . 18.48 |===================================================================
b . 18.64 |====================================================================
SVT-AV1 2.1
Encoder Mode: Preset 5 - Input: Bosphorus 1080p
Frames Per Second > Higher Is Better
a . 62.21 |===================================================================
b . 63.51 |====================================================================
SVT-AV1 2.1
Encoder Mode: Preset 8 - Input: Bosphorus 1080p
Frames Per Second > Higher Is Better
a . 145.19 |================================================================
b . 152.92 |===================================================================
SVT-AV1 2.1
Encoder Mode: Preset 13 - Input: Bosphorus 1080p
Frames Per Second > Higher Is Better
a . 550.25 |===================================================================
b . 545.64 |==================================================================