llamafile xeon
Intel Xeon E E-2488 testing with a Supermicro Super Server X13SCL-F v0123456789 (1.1 BIOS) and ASPEED on Ubuntu 24.04 via the Phoronix Test Suite.
HTML result view exported from: https://openbenchmarking.org/result/2404035-NE-LLAMAFILE41&export=pdf&grs&sor.
Llamafile
Test: llava-v1.5-7b-q4 - Acceleration: CPU
Llamafile
Test: mistral-7b-instruct-v0.2.Q8_0 - Acceleration: CPU
Llamafile
Test: wizardcoder-python-34b-v1.0.Q6_K - Acceleration: CPU
Phoronix Test Suite v10.8.5