m7g.8xlarge

amazon testing on Ubuntu 22.04 via the Phoronix Test Suite.

HTML result view exported from: https://openbenchmarking.org/result/2406303-NE-M7G8XLARG32.

Llama.cpp

Model: Meta-Llama-3-8B-Instruct-Q8_0.gguf

Whisper.cpp

Model: ggml-base.en - Input: 2016 State of the Union

Whisper.cpp

Model: ggml-small.en - Input: 2016 State of the Union

Whisper.cpp

Model: ggml-medium.en - Input: 2016 State of the Union

Phoronix Test Suite v10.8.5