Intel Xeon E E-2488 testing with a Supermicro Super Server X13SCL-F v0123456789 (1.1 BIOS) and ASPEED on Ubuntu 24.04 via the Phoronix Test Suite.
Compare your own system(s) to this result file with the
Phoronix Test Suite by running the command:
phoronix-test-suite benchmark 2404035-NE-LLAMAFILE41
llamafile xeon,
"Llamafile 0.7 - Test: wizardcoder-python-34b-v1.0.Q6_K - Acceleration: CPU",
Higher Results Are Better
"a",2.17,2.16,2.17
"b",2.17,2.17,2.17
"c",2.17,2.17,2.17
"d",2.17,2.17,2.16
"Llamafile 0.7 - Test: mistral-7b-instruct-v0.2.Q8_0 - Acceleration: CPU",
Higher Results Are Better
"a",8.37,8.37,8.33
"b",8.3,8.35,8.34
"c",8.31,8.35,8.32
"d",8.31,8.31,8.34
"Llamafile 0.7 - Test: llava-v1.5-7b-q4 - Acceleration: CPU",
Higher Results Are Better
"a",13.25,13.32,13.26
"b",13.26,13.17,13.12
"c",13.2,13.13,13.39
"d",13.17,13.26,13.23