nau
AMD EPYC 7R13 48-Core testing with a Supermicro H12SSL-I v1.02 (2.7 BIOS) and NVIDIA GeForce RTX 4090 24GB on EndeavourOS rolling via the Phoronix Test Suite.


AMD EPYC 7R13 48-Core - NVIDIA GeForce RTX 4090 24GB: 

	Processor: AMD EPYC 7R13 48-Core @ 3.73GHz (48 Cores / 96 Threads), Motherboard: Supermicro H12SSL-I v1.02 (2.7 BIOS), Chipset: AMD Starship/Matisse, Memory: 256GB, Disk: 15363GB Micron_7450_MTFDKCC15T3TFR, Graphics: NVIDIA GeForce RTX 4090 24GB, Audio: NVIDIA AD102 HD Audio, Monitor: 38GN950, Network: 2 x Intel X710 for 10GbE SFP+

	OS: EndeavourOS rolling, Kernel: 6.8.2-zen2-1-zen (x86_64), Desktop: Xfce 4.18, Display Server: X Server 1.21.1.11, Display Driver: NVIDIA 550.67, OpenGL: 4.6.0, Compiler: GCC 13.2.1 20230801 + Clang 17.0.6 + LLVM 17.0.6 + CUDA 12.4, File-System: btrfs, Screen Resolution: 3840x1600


Llama.cpp b1808
Model: llama-2-7b.Q4_0.gguf
Tokens Per Second > Higher Is Better
AMD EPYC 7R13 48-Core - NVIDIA GeForce RTX 4090 24GB . 27.85 |=================


Llama.cpp b1808
Model: llama-2-13b.Q4_0.gguf
Tokens Per Second > Higher Is Better
AMD EPYC 7R13 48-Core - NVIDIA GeForce RTX 4090 24GB . 15.79 |=================


Llama.cpp b1808
Model: llama-2-70b-chat.Q5_0.gguf
Tokens Per Second > Higher Is Better
AMD EPYC 7R13 48-Core - NVIDIA GeForce RTX 4090 24GB . 2.92 |==================