Tests for a future article. AMD EPYC 7551 32-Core testing with a GIGABYTE MZ31-AR0-00 v01010101 (F10 BIOS) and ASPEED on Debian 12 via the Phoronix Test Suite.
Compare your own system(s) to this result file with the
Phoronix Test Suite by running the command:
phoronix-test-suite benchmark 2406025-NE-OLDEPYCAI16
old epyc ai,
"Whisper.cpp 1.6.2 - Model: ggml-base.en - Input: 2016 State of the Union",
Lower Results Are Better
"a",
"b",
"Whisper.cpp 1.6.2 - Model: ggml-small.en - Input: 2016 State of the Union",
Lower Results Are Better
"a",
"b",
"Whisper.cpp 1.6.2 - Model: ggml-medium.en - Input: 2016 State of the Union",
Lower Results Are Better
"a",
"Llama.cpp b3067 - Model: Meta-Llama-3-8B-Instruct-Q8_0.gguf",
Higher Results Are Better
"a",
"c",
"Llamafile 0.8.6 - Test: llava-v1.6-mistral-7b.Q8_0 - Acceleration: CPU",
Higher Results Are Better
"a",
"c",
"Llamafile 0.8.6 - Test: Meta-Llama-3-8B-Instruct.F16 - Acceleration: CPU",
Higher Results Are Better
"a",
"c",
"Llamafile 0.8.6 - Test: TinyLlama-1.1B-Chat-v1.0.BF16 - Acceleration: CPU",
Higher Results Are Better
"a",
"c",
"Llamafile 0.8.6 - Test: mistral-7b-instruct-v0.2.Q5_K_M - Acceleration: CPU",
Higher Results Are Better
"a",
"c",
"Llamafile 0.8.6 - Test: wizardcoder-python-34b-v1.0.Q6_K - Acceleration: CPU",
Higher Results Are Better
"a",
"c",