llamafile thelio
AMD Ryzen Threadripper 7980X 64-Cores testing with a System76 Thelio Major (FA Z5 BIOS) and NAVI31 45GB on Pop 22.04 via the Phoronix Test Suite.
HTML result view exported from: https://openbenchmarking.org/result/2401195-PTS-LLAMAFIL46&sro&grs.
Llamafile
Test: llava-v1.5-7b-q4 - Acceleration: CPU
Llamafile
Test: mistral-7b-instruct-v0.2.Q8_0 - Acceleration: CPU
Llamafile
Test: wizardcoder-python-34b-v1.0.Q6_K - Acceleration: CPU
Phoronix Test Suite v10.8.5