AMD EPYC 7F32 8-Core testing with a ASRockRack EPYCD8 (P2.40 BIOS) and ASPEED on Debian 12 via the Phoronix Test Suite.
Compare your own system(s) to this result file with the
Phoronix Test Suite by running the command:
phoronix-test-suite benchmark 2401266-NE-LLLL1120136
llll,
"Llamafile 0.6 - Test: llava-v1.5-7b-q4 - Acceleration: CPU",
Higher Results Are Better
"a",7.24,7.04,7.21
"b",
"c",
"Llamafile 0.6 - Test: mistral-7b-instruct-v0.2.Q8_0 - Acceleration: CPU",
Higher Results Are Better
"a",4.53,4.56,4.55
"b",
"c",
"Llamafile 0.6 - Test: wizardcoder-python-34b-v1.0.Q6_K - Acceleration: CPU",
Higher Results Are Better
"a",0.1,0.1,0.1
"LZ4 Compression 1.9.4 - Compression Level: 1 - Compression Speed",
Higher Results Are Better
"a",671.62,672.76,672.02
"b",
"c",
"LZ4 Compression 1.9.4 - Compression Level: 1 - Decompression Speed",
Higher Results Are Better
"a",4210.1,4222,4224.7
"b",
"c",
"LZ4 Compression 1.9.4 - Compression Level: 3 - Compression Speed",
Higher Results Are Better
"a",98.49,96.64,98.09
"b",
"c",
"LZ4 Compression 1.9.4 - Compression Level: 3 - Decompression Speed",
Higher Results Are Better
"a",3878.7,3881.2,3881.5
"b",
"c",
"LZ4 Compression 1.9.4 - Compression Level: 9 - Compression Speed",
Higher Results Are Better
"a",34.5,34.9,34.31
"b",
"c",
"LZ4 Compression 1.9.4 - Compression Level: 9 - Decompression Speed",
Higher Results Are Better
"a",4067.2,4048.1,4066.5
"b",
"c",