AMD EPYC 7551 32-Core testing with a GIGABYTE MZ31-AR0-00 v01010101 (F10 BIOS) and ASPEED on Debian 12 via the Phoronix Test Suite.
Compare your own system(s) to this result file with the
Phoronix Test Suite by running the command:
phoronix-test-suite benchmark 2401291-NE-EOJAN080945
eo jan,
"Llamafile 0.6 - Test: mistral-7b-instruct-v0.2.Q8_0 - Acceleration: CPU",
Higher Results Are Better
"a",
"b",
"c",3.69,3.69,3.7
"d",3.44,3.45,3.59
"CacheBench - Test: Read",
Higher Results Are Better
"a",
"b",
"c",7630.808534,7629.750991,7629.947356
"d",7629.929305,7624.891342,7621.204284
"CacheBench - Test: Read / Modify / Write",
Higher Results Are Better
"a",
"b",
"c",41592.130914,41558.452943,41473.716697
"d",41610.322707,41641.773115,41597.285787
"CacheBench - Test: Write",
Higher Results Are Better
"a",
"b",
"c",38006.19263,38027.733163,37985.353268
"d",37962.465718,38018.124079,38008.624318
"Llamafile 0.6 - Test: llava-v1.5-7b-q4 - Acceleration: CPU",
Higher Results Are Better
"a",
"b",
"c",3.69,3.48,3.56
"d",3.39,3.62,3.63,3.71,3.55
"LZ4 Compression 1.9.4 - Compression Level: 9 - Decompression Speed",
Higher Results Are Better
"a",
"b",
"c",2817.8,2783,2816.2
"d",2754.7,2782.2,2742
"LZ4 Compression 1.9.4 - Compression Level: 9 - Compression Speed",
Higher Results Are Better
"a",
"b",
"c",24.24,24.78,24.94
"d",24.86,24.78,24.86
"LZ4 Compression 1.9.4 - Compression Level: 3 - Decompression Speed",
Higher Results Are Better
"a",
"b",
"c",2633.6,2671.6,2670.4
"d",2609.9,2629.2,2649.9
"LZ4 Compression 1.9.4 - Compression Level: 3 - Compression Speed",
Higher Results Are Better
"a",
"b",
"c",64.73,65.16,64.89
"d",65.89,64.98,66.1
"LZ4 Compression 1.9.4 - Compression Level: 1 - Decompression Speed",
Higher Results Are Better
"a",
"b",
"c",2879.1,2898.3,2880
"d",2923.2,2964,2940.5
"LZ4 Compression 1.9.4 - Compression Level: 1 - Compression Speed",
Higher Results Are Better
"a",
"b",
"c",464.64,461.05,460.79
"d",463.34,464.99,464.3