tr lamma
AMD Ryzen Threadripper 7980X 64-Cores testing with a ASUS Pro WS TRX50-SAGE WIFI (0217 BIOS) and AMD Radeon RX 7900 XT 20GB on Ubuntu 23.10 via the Phoronix Test Suite.


a: 

	Processor: AMD Ryzen Threadripper 7980X 64-Cores @ 8.21GHz (64 Cores / 128 Threads), Motherboard: ASUS Pro WS TRX50-SAGE WIFI (0217 BIOS), Chipset: AMD Device 14a4, Memory: 128GB, Disk: 2000GB Corsair MP700 PRO + 1000GB Western Digital WDS100T1X0E-00AFY0, Graphics: AMD Radeon RX 7900 XT 20GB (2025/1249MHz), Audio: Realtek ALC1220, Monitor: DELL U2723QE, Network: Aquantia Device 04c0 + Intel I226-LM + MEDIATEK MT7922 802.11ax PCI

	OS: Ubuntu 23.10, Kernel: 6.7.0-060700rc2daily20231126-generic (x86_64), Desktop: GNOME Shell 45.0, Display Server: X Server 1.21.1.7 + Wayland, OpenGL: 4.6 Mesa 23.2.1-1ubuntu3 (LLVM 15.0.7 DRM 3.56), Compiler: GCC 13.2.0, File-System: ext4, Screen Resolution: 3840x2160

b: 

	Processor: AMD Ryzen Threadripper 7980X 64-Cores @ 8.21GHz (64 Cores / 128 Threads), Motherboard: ASUS Pro WS TRX50-SAGE WIFI (0217 BIOS), Chipset: AMD Device 14a4, Memory: 128GB, Disk: 2000GB Corsair MP700 PRO + 1000GB Western Digital WDS100T1X0E-00AFY0, Graphics: AMD Radeon RX 7900 XT 20GB (2025/1249MHz), Audio: Realtek ALC1220, Monitor: DELL U2723QE, Network: Aquantia Device 04c0 + Intel I226-LM + MEDIATEK MT7922 802.11ax PCI

	OS: Ubuntu 23.10, Kernel: 6.7.0-060700rc2daily20231126-generic (x86_64), Desktop: GNOME Shell 45.0, Display Server: X Server 1.21.1.7 + Wayland, OpenGL: 4.6 Mesa 23.2.1-1ubuntu3 (LLVM 15.0.7 DRM 3.56), Compiler: GCC 13.2.0, File-System: ext4, Screen Resolution: 3840x2160

c: 

	Processor: AMD Ryzen Threadripper 7980X 64-Cores @ 8.21GHz (64 Cores / 128 Threads), Motherboard: ASUS Pro WS TRX50-SAGE WIFI (0217 BIOS), Chipset: AMD Device 14a4, Memory: 128GB, Disk: 2000GB Corsair MP700 PRO + 1000GB Western Digital WDS100T1X0E-00AFY0, Graphics: AMD Radeon RX 7900 XT 20GB (2025/1249MHz), Audio: Realtek ALC1220, Monitor: DELL U2723QE, Network: Aquantia Device 04c0 + Intel I226-LM + MEDIATEK MT7922 802.11ax PCI

	OS: Ubuntu 23.10, Kernel: 6.7.0-060700rc2daily20231126-generic (x86_64), Desktop: GNOME Shell 45.0, Display Server: X Server 1.21.1.7 + Wayland, OpenGL: 4.6 Mesa 23.2.1-1ubuntu3 (LLVM 15.0.7 DRM 3.56), Compiler: GCC 13.2.0, File-System: ext4, Screen Resolution: 3840x2160

d: 

	Processor: AMD Ryzen Threadripper 7980X 64-Cores @ 8.21GHz (64 Cores / 128 Threads), Motherboard: ASUS Pro WS TRX50-SAGE WIFI (0217 BIOS), Chipset: AMD Device 14a4, Memory: 128GB, Disk: 2000GB Corsair MP700 PRO + 1000GB Western Digital WDS100T1X0E-00AFY0, Graphics: AMD Radeon RX 7900 XT 20GB (2025/1249MHz), Audio: Realtek ALC1220, Monitor: DELL U2723QE, Network: Aquantia Device 04c0 + Intel I226-LM + MEDIATEK MT7922 802.11ax PCI

	OS: Ubuntu 23.10, Kernel: 6.7.0-060700rc2daily20231126-generic (x86_64), Desktop: GNOME Shell 45.0, Display Server: X Server 1.21.1.7 + Wayland, OpenGL: 4.6 Mesa 23.2.1-1ubuntu3 (LLVM 15.0.7 DRM 3.56), Compiler: GCC 13.2.0, File-System: ext4, Screen Resolution: 3840x2160


Llama.cpp b1808
Model: llama-2-70b-chat.Q5_0.gguf
Tokens Per Second > Higher Is Better
a . 3.46 |====================================================================
b . 3.47 |====================================================================
c . 3.48 |====================================================================
d . 3.51 |=====================================================================


Llama.cpp b1808
Model: llama-2-13b.Q4_0.gguf
Tokens Per Second > Higher Is Better
a . 18.24 |===================================================================
b . 18.32 |===================================================================
c . 18.18 |===================================================================
d . 18.54 |====================================================================


Llama.cpp b1808
Model: llama-2-7b.Q4_0.gguf
Tokens Per Second > Higher Is Better
a . 31.29 |=================================================================
b . 30.79 |================================================================
c . 31.21 |=================================================================
d . 32.55 |====================================================================