Intel Core i9-14900K testing with a ASUS PRIME Z790-P WIFI (1402 BIOS) and ASUS Intel RPL-S 31GB on Ubuntu 23.10 via the Phoronix Test Suite.
Compare your own system(s) to this result file with the
Phoronix Test Suite by running the command:
phoronix-test-suite benchmark 2404033-PTS-NEWLLAMA41
new llamafile,
"Llamafile 0.7 - Test: llava-v1.5-7b-q4 - Acceleration: CPU",
Higher Results Are Better
"a",14.93,14.89,14.87
"b",14.83,14.87,14.86
"c",14.6,14.56,14.75
"d",14.9,14.89,14.63
"Llamafile 0.7 - Test: mistral-7b-instruct-v0.2.Q8_0 - Acceleration: CPU",
Higher Results Are Better
"a",9.71,9.62,9.62
"b",9.63,9.64,9.61
"c",9.54,9.63,9.65
"d",9.62,9.66,9.61
"Llamafile 0.7 - Test: wizardcoder-python-34b-v1.0.Q6_K - Acceleration: CPU",
Higher Results Are Better
"a",2.67,2.66,2.65
"b",2.65,2.66,2.66
"c",2.66,2.65,2.65
"d",2.66,2.66,2.65