llama lz4
Intel Core Ultra 7 155H testing with a MTL Swift SFG14-72T Coral_MTH (V1.01 BIOS) and Intel Arc MTL 15GB on Ubuntu 23.10 via the Phoronix Test Suite.
HTML result view exported from: https://openbenchmarking.org/result/2401208-NE-LLAMALZ4707&rdt&grw.
LZ4 Compression
Compression Level: 1 - Compression Speed
LZ4 Compression
Compression Level: 1 - Decompression Speed
LZ4 Compression
Compression Level: 3 - Compression Speed
LZ4 Compression
Compression Level: 3 - Decompression Speed
LZ4 Compression
Compression Level: 9 - Compression Speed
LZ4 Compression
Compression Level: 9 - Decompression Speed
Llamafile
Test: llava-v1.5-7b-q4 - Acceleration: CPU
Llamafile
Test: mistral-7b-instruct-v0.2.Q8_0 - Acceleration: CPU
Llamafile
Test: wizardcoder-python-34b-v1.0.Q6_K - Acceleration: CPU
Phoronix Test Suite v10.8.5