Intel Core i9-14900K testing with a ASUS PRIME Z790-P WIFI (1656 BIOS) and XFX AMD Radeon RX 7900 XTX 24GB on Ubuntu 24.04 via the Phoronix Test Suite.
Compare your own system(s) to this result file with the
Phoronix Test Suite by running the command:
phoronix-test-suite benchmark 2406022-PTS-SLSLS11146
slsls,
"Llama.cpp b3067 - Model: Meta-Llama-3-8B-Instruct-Q8_0.gguf",
Higher Results Are Better
"a",9.45,9.52,9.5
"b",
"c",
"Llamafile 0.8.6 - Test: llava-v1.6-mistral-7b.Q8_0 - Acceleration: CPU",
Higher Results Are Better
"a",
"b",
"c",
"Llamafile 0.8.6 - Test: Meta-Llama-3-8B-Instruct.F16 - Acceleration: CPU",
Higher Results Are Better
"a",5.26,5.25
"b",
"c",
"Llamafile 0.8.6 - Test: TinyLlama-1.1B-Chat-v1.0.BF16 - Acceleration: CPU",
Higher Results Are Better
"a",34.54,34.55,32.87,34.92,34.7
"b",
"c",
"Llamafile 0.8.6 - Test: mistral-7b-instruct-v0.2.Q5_K_M - Acceleration: CPU",
Higher Results Are Better
"a",12.6,12.6,12.62
"b",
"c",
"Llamafile 0.8.6 - Test: wizardcoder-python-34b-v1.0.Q6_K - Acceleration: CPU",
Higher Results Are Better
"a",2.56,2.56,2.56
"b",
"c",
"Whisper.cpp 1.6.2 - Model: ggml-base.en - Input: 2016 State of the Union",
Lower Results Are Better
"a",162.90139,162.72866,162.60556
"b",
"c",
"Whisper.cpp 1.6.2 - Model: ggml-small.en - Input: 2016 State of the Union",
Lower Results Are Better
"a",437.36422,437.60053,437.95588
"b",
"c",
"Whisper.cpp 1.6.2 - Model: ggml-medium.en - Input: 2016 State of the Union",
Lower Results Are Better
"a",1312.96962,1302.02125,1313.66975
"b",
"c",