kdkdk AMD Ryzen 9 7950X 16-Core testing with a ASUS ROG STRIX X670E-E GAMING WIFI (1905 BIOS) and AMD Radeon RX 7900 GRE 16GB on Ubuntu 24.04 via the Phoronix Test Suite. a: Processor: AMD Ryzen 9 7950X 16-Core @ 5.88GHz (16 Cores / 32 Threads), Motherboard: ASUS ROG STRIX X670E-E GAMING WIFI (1905 BIOS), Chipset: AMD Device 14d8, Memory: 2 x 16GB DDR5-6000MT/s Crucial CP16G60C36U5W.M8D1, Disk: Western Digital WD_BLACK SN850X 2000GB + 4001GB Western Digital WD_BLACK SN850X 4000GB, Graphics: AMD Radeon RX 7900 GRE 16GB (2200/3000MHz), Audio: AMD Navi 31 HDMI/DP, Monitor: DELL U2723QE, Network: Intel I225-V + Intel Wi-Fi 6E OS: Ubuntu 24.04, Kernel: 6.8.0-31-generic (x86_64), Desktop: GNOME Shell 46.0, Display Server: X Server + Wayland, OpenGL: 4.6 Mesa 24.0.5-1ubuntu1 (LLVM 17.0.6 DRM 3.57), Compiler: GCC 13.2.0, File-System: ext4, Screen Resolution: 3840x2160 b: Processor: AMD Ryzen 9 7950X 16-Core @ 5.88GHz (16 Cores / 32 Threads), Motherboard: ASUS ROG STRIX X670E-E GAMING WIFI (1905 BIOS), Chipset: AMD Device 14d8, Memory: 2 x 16GB DDR5-6000MT/s Crucial CP16G60C36U5W.M8D1, Disk: Western Digital WD_BLACK SN850X 2000GB + 4001GB Western Digital WD_BLACK SN850X 4000GB, Graphics: AMD Radeon RX 7900 GRE 16GB (2200/3000MHz), Audio: AMD Navi 31 HDMI/DP, Monitor: DELL U2723QE, Network: Intel I225-V + Intel Wi-Fi 6E OS: Ubuntu 24.04, Kernel: 6.8.0-31-generic (x86_64), Desktop: GNOME Shell 46.0, Display Server: X Server + Wayland, OpenGL: 4.6 Mesa 24.0.5-1ubuntu1 (LLVM 17.0.6 DRM 3.57), Compiler: GCC 13.2.0, File-System: ext4, Screen Resolution: 3840x2160 c: Processor: AMD Ryzen 9 7950X 16-Core @ 5.88GHz (16 Cores / 32 Threads), Motherboard: ASUS ROG STRIX X670E-E GAMING WIFI (1905 BIOS), Chipset: AMD Device 14d8, Memory: 2 x 16GB DDR5-6000MT/s Crucial CP16G60C36U5W.M8D1, Disk: Western Digital WD_BLACK SN850X 2000GB + 4001GB Western Digital WD_BLACK SN850X 4000GB, Graphics: AMD Radeon RX 7900 GRE 16GB (2200/3000MHz), Audio: AMD Navi 31 HDMI/DP, Monitor: DELL U2723QE, Network: Intel I225-V + Intel Wi-Fi 6E OS: Ubuntu 24.04, Kernel: 6.8.0-31-generic (x86_64), Desktop: GNOME Shell 46.0, Display Server: X Server + Wayland, OpenGL: 4.6 Mesa 24.0.5-1ubuntu1 (LLVM 17.0.6 DRM 3.57), Compiler: GCC 13.2.0, File-System: ext4, Screen Resolution: 3840x2160 d: Processor: AMD Ryzen 9 7950X 16-Core @ 5.88GHz (16 Cores / 32 Threads), Motherboard: ASUS ROG STRIX X670E-E GAMING WIFI (1905 BIOS), Chipset: AMD Device 14d8, Memory: 2 x 16GB DDR5-6000MT/s Crucial CP16G60C36U5W.M8D1, Disk: Western Digital WD_BLACK SN850X 2000GB + 4001GB Western Digital WD_BLACK SN850X 4000GB, Graphics: AMD Radeon RX 7900 GRE 16GB (2200/3000MHz), Audio: AMD Navi 31 HDMI/DP, Monitor: DELL U2723QE, Network: Intel I225-V + Intel Wi-Fi 6E OS: Ubuntu 24.04, Kernel: 6.8.0-31-generic (x86_64), Desktop: GNOME Shell 46.0, Display Server: X Server + Wayland, OpenGL: 4.6 Mesa 24.0.5-1ubuntu1 (LLVM 17.0.6 DRM 3.57), Compiler: GCC 13.2.0, File-System: ext4, Screen Resolution: 3840x2160 e: Processor: AMD Ryzen 9 7950X 16-Core @ 5.88GHz (16 Cores / 32 Threads), Motherboard: ASUS ROG STRIX X670E-E GAMING WIFI (1905 BIOS), Chipset: AMD Device 14d8, Memory: 2 x 16GB DDR5-6000MT/s Crucial CP16G60C36U5W.M8D1, Disk: Western Digital WD_BLACK SN850X 2000GB + 4001GB Western Digital WD_BLACK SN850X 4000GB, Graphics: AMD Radeon RX 7900 GRE 16GB (2200/3000MHz), Audio: AMD Navi 31 HDMI/DP, Monitor: DELL U2723QE, Network: Intel I225-V + Intel Wi-Fi 6E OS: Ubuntu 24.04, Kernel: 6.8.0-31-generic (x86_64), Desktop: GNOME Shell 46.0, Display Server: X Server + Wayland, OpenGL: 4.6 Mesa 24.0.5-1ubuntu1 (LLVM 17.0.6 DRM 3.57), Compiler: GCC 13.2.0, File-System: ext4, Screen Resolution: 3840x2160 Llamafile 0.8.6 Test: Meta-Llama-3-8B-Instruct.F16 - Acceleration: CPU Tokens Per Second > Higher Is Better a . 4.42 |===================================================================== c . 4.40 |===================================================================== d . 4.38 |==================================================================== Whisper.cpp 1.6.2 Model: ggml-medium.en - Input: 2016 State of the Union Seconds < Lower Is Better a . 648.54 |=================================================================== b . 646.96 |=================================================================== c . 648.87 |=================================================================== d . 649.92 |=================================================================== e . 651.80 |=================================================================== Whisper.cpp 1.6.2 Model: ggml-small.en - Input: 2016 State of the Union Seconds < Lower Is Better a . 225.23 |=================================================================== b . 223.34 |================================================================== c . 225.66 |=================================================================== d . 225.35 |=================================================================== e . 224.31 |=================================================================== Llamafile 0.8.6 Test: wizardcoder-python-34b-v1.0.Q6_K - Acceleration: CPU Tokens Per Second > Higher Is Better a . 2.30 |==================================================================== b . 2.32 |===================================================================== c . 2.30 |==================================================================== d . 2.29 |==================================================================== e . 2.30 |==================================================================== Whisper.cpp 1.6.2 Model: ggml-base.en - Input: 2016 State of the Union Seconds < Lower Is Better a . 81.10 |==================================================================== b . 80.81 |=================================================================== c . 81.54 |==================================================================== d . 80.68 |=================================================================== e . 80.69 |=================================================================== Llamafile 0.8.6 Test: mistral-7b-instruct-v0.2.Q5_K_M - Acceleration: CPU Tokens Per Second > Higher Is Better a . 12.25 |==================================================================== b . 12.17 |==================================================================== d . 12.20 |==================================================================== e . 12.14 |=================================================================== Llama.cpp b3067 Model: Meta-Llama-3-8B-Instruct-Q8_0.gguf Tokens Per Second > Higher Is Better a . 8.08 |===================================================================== b . 8.05 |===================================================================== c . 8.03 |===================================================================== d . 8.06 |===================================================================== e . 8.07 |===================================================================== Llamafile 0.8.6 Test: TinyLlama-1.1B-Chat-v1.0.BF16 - Acceleration: CPU Tokens Per Second > Higher Is Better a . 30.07 |==================================================================== b . 30.19 |==================================================================== c . 30.12 |==================================================================== d . 30.23 |==================================================================== e . 30.14 |==================================================================== Llamafile 0.8.6 Test: llava-v1.6-mistral-7b.Q8_0 - Acceleration: CPU Tokens Per Second > Higher Is Better