AMD EPYC 8534P 64-Core testing with a AMD Cinnabar (RCB1009C BIOS) and ASPEED on Ubuntu 23.10 via the Phoronix Test Suite.
Compare your own system(s) to this result file with the
Phoronix Test Suite by running the command:
phoronix-test-suite benchmark 2404045-NE-LLAMAFILE27
llamafile sienna,
"Llamafile 0.7 - Test: wizardcoder-python-34b-v1.0.Q6_K - Acceleration: CPU",
Higher Results Are Better
"a",5.2,5.19,5.21
"b",5.2,5.19,5.16
"c",5.2,5.2,5.22
"d",5.21,5.21,5.2
"Llamafile 0.7 - Test: mistral-7b-instruct-v0.2.Q8_0 - Acceleration: CPU",
Higher Results Are Better
"a",16.01,15.99,15.99
"b",16.02,15.95,16
"c",15.94,16,16.08
"d",15.99,15.96,15.85
"Llamafile 0.7 - Test: llava-v1.5-7b-q4 - Acceleration: CPU",
Higher Results Are Better
"a",20.72,20.88,20.89
"b",20.6,20.65,20.77
"c",20.75,20.77,21.01
"d",20.76,20.74,20.73