AMD Ryzen 9 7950X 16-Core testing with a ASUS ROG STRIX X670E-E GAMING WIFI (1416 BIOS) and Sapphire AMD Radeon RX 590 8GB on Ubuntu 23.10 via the Phoronix Test Suite.
Compare your own system(s) to this result file with the
Phoronix Test Suite by running the command:
phoronix-test-suite benchmark 2401195-NE-7950XLLAM30
7950x llamafile,
"Llamafile 0.6 - Test: llava-v1.5-7b-q4 - Acceleration: CPU",
Higher Results Are Better
"a",13.44,13.37,13.46
"b",13.46,13.43,13.38
"c",13.47,13.47,13.44
"d",13.44,13.43,13.43
"Llamafile 0.6 - Test: mistral-7b-instruct-v0.2.Q8_0 - Acceleration: CPU",
Higher Results Are Better
"a",7.99,7.97,7.97
"b",7.98,7.97,7.93
"c",7.98,7.97,7.94
"d",7.99,7.92,7.94
"Llamafile 0.6 - Test: wizardcoder-python-34b-v1.0.Q6_K - Acceleration: CPU",
Higher Results Are Better
"a",0.98,1.01,0.99
"b",0.98,1,1
"c",0.99,0.97,0.97
"d",1.01,1.01,1.02