tr lamma AMD Ryzen Threadripper 7980X 64-Cores testing with a ASUS Pro WS TRX50-SAGE WIFI (0217 BIOS) and AMD Radeon RX 7900 XT 20GB on Ubuntu 23.10 via the Phoronix Test Suite. a: Processor: AMD Ryzen Threadripper 7980X 64-Cores @ 8.21GHz (64 Cores / 128 Threads), Motherboard: ASUS Pro WS TRX50-SAGE WIFI (0217 BIOS), Chipset: AMD Device 14a4, Memory: 128GB, Disk: 2000GB Corsair MP700 PRO + 1000GB Western Digital WDS100T1X0E-00AFY0, Graphics: AMD Radeon RX 7900 XT 20GB (2025/1249MHz), Audio: Realtek ALC1220, Monitor: DELL U2723QE, Network: Aquantia Device 04c0 + Intel I226-LM + MEDIATEK MT7922 802.11ax PCI OS: Ubuntu 23.10, Kernel: 6.7.0-060700rc2daily20231126-generic (x86_64), Desktop: GNOME Shell 45.0, Display Server: X Server 1.21.1.7 + Wayland, OpenGL: 4.6 Mesa 23.2.1-1ubuntu3 (LLVM 15.0.7 DRM 3.56), Compiler: GCC 13.2.0, File-System: ext4, Screen Resolution: 3840x2160 b: Processor: AMD Ryzen Threadripper 7980X 64-Cores @ 8.21GHz (64 Cores / 128 Threads), Motherboard: ASUS Pro WS TRX50-SAGE WIFI (0217 BIOS), Chipset: AMD Device 14a4, Memory: 128GB, Disk: 2000GB Corsair MP700 PRO + 1000GB Western Digital WDS100T1X0E-00AFY0, Graphics: AMD Radeon RX 7900 XT 20GB (2025/1249MHz), Audio: Realtek ALC1220, Monitor: DELL U2723QE, Network: Aquantia Device 04c0 + Intel I226-LM + MEDIATEK MT7922 802.11ax PCI OS: Ubuntu 23.10, Kernel: 6.7.0-060700rc2daily20231126-generic (x86_64), Desktop: GNOME Shell 45.0, Display Server: X Server 1.21.1.7 + Wayland, OpenGL: 4.6 Mesa 23.2.1-1ubuntu3 (LLVM 15.0.7 DRM 3.56), Compiler: GCC 13.2.0, File-System: ext4, Screen Resolution: 3840x2160 c: Processor: AMD Ryzen Threadripper 7980X 64-Cores @ 8.21GHz (64 Cores / 128 Threads), Motherboard: ASUS Pro WS TRX50-SAGE WIFI (0217 BIOS), Chipset: AMD Device 14a4, Memory: 128GB, Disk: 2000GB Corsair MP700 PRO + 1000GB Western Digital WDS100T1X0E-00AFY0, Graphics: AMD Radeon RX 7900 XT 20GB (2025/1249MHz), Audio: Realtek ALC1220, Monitor: DELL U2723QE, Network: Aquantia Device 04c0 + Intel I226-LM + MEDIATEK MT7922 802.11ax PCI OS: Ubuntu 23.10, Kernel: 6.7.0-060700rc2daily20231126-generic (x86_64), Desktop: GNOME Shell 45.0, Display Server: X Server 1.21.1.7 + Wayland, OpenGL: 4.6 Mesa 23.2.1-1ubuntu3 (LLVM 15.0.7 DRM 3.56), Compiler: GCC 13.2.0, File-System: ext4, Screen Resolution: 3840x2160 d: Processor: AMD Ryzen Threadripper 7980X 64-Cores @ 8.21GHz (64 Cores / 128 Threads), Motherboard: ASUS Pro WS TRX50-SAGE WIFI (0217 BIOS), Chipset: AMD Device 14a4, Memory: 128GB, Disk: 2000GB Corsair MP700 PRO + 1000GB Western Digital WDS100T1X0E-00AFY0, Graphics: AMD Radeon RX 7900 XT 20GB (2025/1249MHz), Audio: Realtek ALC1220, Monitor: DELL U2723QE, Network: Aquantia Device 04c0 + Intel I226-LM + MEDIATEK MT7922 802.11ax PCI OS: Ubuntu 23.10, Kernel: 6.7.0-060700rc2daily20231126-generic (x86_64), Desktop: GNOME Shell 45.0, Display Server: X Server 1.21.1.7 + Wayland, OpenGL: 4.6 Mesa 23.2.1-1ubuntu3 (LLVM 15.0.7 DRM 3.56), Compiler: GCC 13.2.0, File-System: ext4, Screen Resolution: 3840x2160 Llama.cpp b1808 Model: llama-2-70b-chat.Q5_0.gguf Tokens Per Second > Higher Is Better a . 3.46 |==================================================================== b . 3.47 |==================================================================== c . 3.48 |==================================================================== d . 3.51 |===================================================================== Llama.cpp b1808 Model: llama-2-13b.Q4_0.gguf Tokens Per Second > Higher Is Better a . 18.24 |=================================================================== b . 18.32 |=================================================================== c . 18.18 |=================================================================== d . 18.54 |==================================================================== Llama.cpp b1808 Model: llama-2-7b.Q4_0.gguf Tokens Per Second > Higher Is Better a . 31.29 |================================================================= b . 30.79 |================================================================ c . 31.21 |================================================================= d . 32.55 |====================================================================