slsls
Intel Core i9-14900K testing with a ASUS PRIME Z790-P WIFI (1656 BIOS) and XFX AMD Radeon RX 7900 XTX 24GB on Ubuntu 24.04 via the Phoronix Test Suite.


a: 

	Processor: Intel Core i9-14900K @ 5.70GHz (24 Cores / 32 Threads), Motherboard: ASUS PRIME Z790-P WIFI (1656 BIOS), Chipset: Intel Raptor Lake-S PCH, Memory: 2 x 16GB DDR5-6000MT/s Corsair CMK32GX5M2B6000C36, Disk: Western Digital WD_BLACK SN850X 2000GB, Graphics: XFX AMD Radeon RX 7900 XTX 24GB, Audio: Realtek ALC897, Monitor: ASUS VP28U

	OS: Ubuntu 24.04, Kernel: 6.8.0-31-generic (x86_64), Desktop: GNOME Shell 46.0, Display Server: X Server + Wayland, OpenGL: 4.6 Mesa 24.0.5-1ubuntu1 (LLVM 17.0.6 DRM 3.57), Compiler: GCC 13.2.0, File-System: ext4, Screen Resolution: 3840x2160

b: 

	Processor: Intel Core i9-14900K @ 5.70GHz (24 Cores / 32 Threads), Motherboard: ASUS PRIME Z790-P WIFI (1656 BIOS), Chipset: Intel Raptor Lake-S PCH, Memory: 2 x 16GB DDR5-6000MT/s Corsair CMK32GX5M2B6000C36, Disk: Western Digital WD_BLACK SN850X 2000GB, Graphics: XFX AMD Radeon RX 7900 XTX 24GB, Audio: Realtek ALC897, Monitor: ASUS VP28U

	OS: Ubuntu 24.04, Kernel: 6.8.0-31-generic (x86_64), Desktop: GNOME Shell 46.0, Display Server: X Server + Wayland, OpenGL: 4.6 Mesa 24.0.5-1ubuntu1 (LLVM 17.0.6 DRM 3.57), Compiler: GCC 13.2.0, File-System: ext4, Screen Resolution: 3840x2160

c: 

	Processor: Intel Core i9-14900K @ 5.70GHz (24 Cores / 32 Threads), Motherboard: ASUS PRIME Z790-P WIFI (1656 BIOS), Chipset: Intel Raptor Lake-S PCH, Memory: 2 x 16GB DDR5-6000MT/s Corsair CMK32GX5M2B6000C36, Disk: Western Digital WD_BLACK SN850X 2000GB, Graphics: XFX AMD Radeon RX 7900 XTX 24GB, Audio: Realtek ALC897, Monitor: ASUS VP28U

	OS: Ubuntu 24.04, Kernel: 6.8.0-31-generic (x86_64), Desktop: GNOME Shell 46.0, Display Server: X Server + Wayland, OpenGL: 4.6 Mesa 24.0.5-1ubuntu1 (LLVM 17.0.6 DRM 3.57), Compiler: GCC 13.2.0, File-System: ext4, Screen Resolution: 3840x2160


Llama.cpp b3067
Model: Meta-Llama-3-8B-Instruct-Q8_0.gguf
Tokens Per Second > Higher Is Better
a . 9.49 |=====================================================================
b . 9.48 |=====================================================================
c . 9.49 |=====================================================================


Llamafile 0.8.6
Test: llava-v1.6-mistral-7b.Q8_0 - Acceleration: CPU
Tokens Per Second > Higher Is Better


Llamafile 0.8.6
Test: Meta-Llama-3-8B-Instruct.F16 - Acceleration: CPU
Tokens Per Second > Higher Is Better
a . 5.26 |=====================================================================


Llamafile 0.8.6
Test: TinyLlama-1.1B-Chat-v1.0.BF16 - Acceleration: CPU
Tokens Per Second > Higher Is Better
a . 34.32 |===================================================================
b . 34.60 |====================================================================
c . 34.61 |====================================================================


Llamafile 0.8.6
Test: mistral-7b-instruct-v0.2.Q5_K_M - Acceleration: CPU
Tokens Per Second > Higher Is Better
a . 12.61 |====================================================================
b . 12.57 |===================================================================
c . 12.68 |====================================================================


Llamafile 0.8.6
Test: wizardcoder-python-34b-v1.0.Q6_K - Acceleration: CPU
Tokens Per Second > Higher Is Better
a . 2.56 |=====================================================================
b . 2.56 |=====================================================================
c . 2.56 |=====================================================================


Whisper.cpp 1.6.2
Model: ggml-base.en - Input: 2016 State of the Union
Seconds < Lower Is Better
a . 162.75 |===================================================================
b . 162.63 |===================================================================
c . 162.98 |===================================================================


Whisper.cpp 1.6.2
Model: ggml-small.en - Input: 2016 State of the Union
Seconds < Lower Is Better
a . 437.64 |===================================================================
b . 438.27 |===================================================================
c . 438.31 |===================================================================


Whisper.cpp 1.6.2
Model: ggml-medium.en - Input: 2016 State of the Union
Seconds < Lower Is Better
a . 1309.55 |==================================================================
b . 1314.75 |==================================================================
c . 1313.66 |==================================================================