AMD EPYC 7F32 8-Core testing with a ASRockRack EPYCD8 (P2.40 BIOS) and ASPEED on Debian 12 via the Phoronix Test Suite.
Compare your own system(s) to this result file with the
Phoronix Test Suite by running the command:
phoronix-test-suite benchmark 2401266-NE-LLLL1120136
llll
AMD EPYC 7F32 8-Core testing with a ASRockRack EPYCD8 (P2.40 BIOS) and ASPEED on Debian 12 via the Phoronix Test Suite.
a:
Processor: AMD EPYC 7F32 8-Core @ 3.70GHz (8 Cores / 16 Threads), Motherboard: ASRockRack EPYCD8 (P2.40 BIOS), Chipset: AMD Starship/Matisse, Memory: 7 x 4 GB DDR4-2666MT/s Micron 9ASF51272PZ-2G6B1, Disk: Samsung SSD 970 EVO Plus 250GB, Graphics: ASPEED, Network: 2 x Intel I350
OS: Debian 12, Kernel: 6.1.0-11-amd64 (x86_64), Display Server: X Server, Compiler: GCC 12.2.0, File-System: ext4, Screen Resolution: 1024x768
b:
Processor: AMD EPYC 7F32 8-Core @ 3.70GHz (8 Cores / 16 Threads), Motherboard: ASRockRack EPYCD8 (P2.40 BIOS), Chipset: AMD Starship/Matisse, Memory: 7 x 4 GB DDR4-2666MT/s Micron 9ASF51272PZ-2G6B1, Disk: Samsung SSD 970 EVO Plus 250GB, Graphics: ASPEED, Network: 2 x Intel I350
OS: Debian 12, Kernel: 6.1.0-11-amd64 (x86_64), Display Server: X Server, Compiler: GCC 12.2.0, File-System: ext4, Screen Resolution: 1024x768
c:
Processor: AMD EPYC 7F32 8-Core @ 3.70GHz (8 Cores / 16 Threads), Motherboard: ASRockRack EPYCD8 (P2.40 BIOS), Chipset: AMD Starship/Matisse, Memory: 7 x 4 GB DDR4-2666MT/s Micron 9ASF51272PZ-2G6B1, Disk: Samsung SSD 970 EVO Plus 250GB, Graphics: ASPEED, Network: 2 x Intel I350
OS: Debian 12, Kernel: 6.1.0-11-amd64 (x86_64), Display Server: X Server, Compiler: GCC 12.2.0, File-System: ext4, Screen Resolution: 1024x768
Llamafile 0.6
Test: mistral-7b-instruct-v0.2.Q8_0 - Acceleration: CPU
Tokens Per Second > Higher Is Better
a . 4.55 |======================================
b . 8.24 |=====================================================================
c . 8.25 |=====================================================================
Llamafile 0.6
Test: llava-v1.5-7b-q4 - Acceleration: CPU
Tokens Per Second > Higher Is Better
a . 7.16 |============================================
b . 10.35 |================================================================
c . 11.05 |====================================================================
LZ4 Compression 1.9.4
Compression Level: 9 - Compression Speed
MB/s > Higher Is Better
a . 34.57 |====================================================================
b . 34.21 |===================================================================
c . 34.35 |====================================================================
LZ4 Compression 1.9.4
Compression Level: 1 - Decompression Speed
MB/s > Higher Is Better
a . 4218.9 |===================================================================
b . 4235.8 |===================================================================
c . 4227.3 |===================================================================
LZ4 Compression 1.9.4
Compression Level: 9 - Decompression Speed
MB/s > Higher Is Better
a . 4060.6 |===================================================================
b . 4071.6 |===================================================================
c . 4075.1 |===================================================================
LZ4 Compression 1.9.4
Compression Level: 3 - Decompression Speed
MB/s > Higher Is Better
a . 3880.5 |===================================================================
b . 3882.5 |===================================================================
c . 3889.0 |===================================================================
LZ4 Compression 1.9.4
Compression Level: 3 - Compression Speed
MB/s > Higher Is Better
a . 97.74 |====================================================================
b . 97.64 |====================================================================
c . 97.71 |====================================================================
LZ4 Compression 1.9.4
Compression Level: 1 - Compression Speed
MB/s > Higher Is Better
a . 672.13 |===================================================================
b . 671.96 |===================================================================
c . 672.54 |===================================================================
Llamafile 0.6
Test: wizardcoder-python-34b-v1.0.Q6_K - Acceleration: CPU
Tokens Per Second > Higher Is Better
a . 0.1 |======================================================================