Intel Core i7-5960X testing with a Gigabyte X99-UD4-CF (F24c BIOS) and NVIDIA GeForce 6600 GT on Debian 12 via the Phoronix Test Suite.
Compare your own system(s) to this result file with the
Phoronix Test Suite by running the command:
phoronix-test-suite benchmark 2401260-NE-LLL63660360
lll,
"Llamafile 0.6 - Test: llava-v1.5-7b-q4 - Acceleration: CPU",
Higher Results Are Better
"a",
"b",10.69,10.47,10.5
"c",10.71,10.58,10.61
"LZ4 Compression 1.9.4 - Compression Level: 9 - Compression Speed",
Higher Results Are Better
"a",
"b",28.14,27.93,27.91
"c",27.99,27.55,27.54
"Llamafile 0.6 - Test: mistral-7b-instruct-v0.2.Q8_0 - Acceleration: CPU",
Higher Results Are Better
"a",
"b",6.35,6.34,6.27
"c",6.32,6.29,6.35
"LZ4 Compression 1.9.4 - Compression Level: 3 - Decompression Speed",
Higher Results Are Better
"a",
"b",3315.4,3315.3,3313.8
"c",3313.3,3315.4,3307.8
"LZ4 Compression 1.9.4 - Compression Level: 1 - Decompression Speed",
Higher Results Are Better
"a",
"b",3542.3,3541.8,3549.4
"c",3550.5,3550.5,3550.2
"LZ4 Compression 1.9.4 - Compression Level: 9 - Decompression Speed",
Higher Results Are Better
"a",
"b",3477.9,3477.4,3477.3
"c",3469.1,3479.4,3476.1
"LZ4 Compression 1.9.4 - Compression Level: 1 - Compression Speed",
Higher Results Are Better
"a",
"b",544.58,545.2,544.15
"c",544.46,545.14,545.25
"LZ4 Compression 1.9.4 - Compression Level: 3 - Compression Speed",
Higher Results Are Better
"a",
"b",77.03,77.14,77.16
"c",77.16,77,77.29