lll
AMD EPYC 8324P 32-Core testing with a AMD Cinnabar (RCB1009C BIOS) and ASPEED on Ubuntu 23.10 via the Phoronix Test Suite.


a: 

	Processor: AMD EPYC 8324P 32-Core @ 2.65GHz (32 Cores / 64 Threads), Motherboard: AMD Cinnabar (RCB1009C BIOS), Chipset: AMD Device 14a4, Memory: 6 x 32 GB DRAM-4800MT/s Samsung M321R4GA0BB0-CQKMG, Disk: 3201GB Micron_7450_MTFDKCB3T2TFS, Graphics: ASPEED, Network: 2 x Broadcom NetXtreme BCM5720 PCIe

	OS: Ubuntu 23.10, Kernel: 6.5.0-5-generic (x86_64), Desktop: GNOME Shell, Display Server: X Server 1.21.1.7, Compiler: GCC 13.2.0, File-System: ext4, Screen Resolution: 640x480

b: 

	Processor: AMD EPYC 8324P 32-Core @ 2.65GHz (32 Cores / 64 Threads), Motherboard: AMD Cinnabar (RCB1009C BIOS), Chipset: AMD Device 14a4, Memory: 6 x 32 GB DRAM-4800MT/s Samsung M321R4GA0BB0-CQKMG, Disk: 3201GB Micron_7450_MTFDKCB3T2TFS, Graphics: ASPEED, Network: 2 x Broadcom NetXtreme BCM5720 PCIe

	OS: Ubuntu 23.10, Kernel: 6.5.0-5-generic (x86_64), Desktop: GNOME Shell, Display Server: X Server 1.21.1.7, Compiler: GCC 13.2.0, File-System: ext4, Screen Resolution: 640x480

c: 

	Processor: AMD EPYC 8324P 32-Core @ 2.65GHz (32 Cores / 64 Threads), Motherboard: AMD Cinnabar (RCB1009C BIOS), Chipset: AMD Device 14a4, Memory: 6 x 32 GB DRAM-4800MT/s Samsung M321R4GA0BB0-CQKMG, Disk: 3201GB Micron_7450_MTFDKCB3T2TFS, Graphics: ASPEED, Network: 2 x Broadcom NetXtreme BCM5720 PCIe

	OS: Ubuntu 23.10, Kernel: 6.5.0-5-generic (x86_64), Desktop: GNOME Shell, Display Server: X Server 1.21.1.7, Compiler: GCC 13.2.0, File-System: ext4, Screen Resolution: 640x480


CacheBench
Test: Read
MB/s > Higher Is Better
a . 7612.84 |==================================================================
b . 7615.13 |==================================================================
c . 7615.21 |==================================================================


CacheBench
Test: Write
MB/s > Higher Is Better
a . 45638.47 |=================================================================
b . 45639.68 |=================================================================
c . 45639.01 |=================================================================


CacheBench
Test: Read / Modify / Write
MB/s > Higher Is Better
a . 87264.31 |=================================================================
b . 87154.95 |=================================================================
c . 87247.99 |=================================================================


LZ4 Compression 1.9.4
Compression Level: 1 - Compression Speed
MB/s > Higher Is Better
a . 565.03 |===================================================================
b . 564.21 |===================================================================
c . 565.42 |===================================================================


LZ4 Compression 1.9.4
Compression Level: 1 - Decompression Speed
MB/s > Higher Is Better
a . 3650.1 |===================================================================
b . 3649.8 |===================================================================
c . 3647.9 |===================================================================


LZ4 Compression 1.9.4
Compression Level: 3 - Compression Speed
MB/s > Higher Is Better
a . 88.20 |====================================================================
b . 88.23 |====================================================================
c . 88.09 |====================================================================


LZ4 Compression 1.9.4
Compression Level: 3 - Decompression Speed
MB/s > Higher Is Better
a . 3306.9 |===================================================================
b . 3307.6 |===================================================================
c . 3308.6 |===================================================================


LZ4 Compression 1.9.4
Compression Level: 9 - Compression Speed
MB/s > Higher Is Better
a . 28.35 |====================================================================
b . 28.34 |====================================================================
c . 28.29 |====================================================================


LZ4 Compression 1.9.4
Compression Level: 9 - Decompression Speed
MB/s > Higher Is Better
a . 3471.6 |===================================================================
b . 3467.4 |===================================================================
c . 3468.1 |===================================================================


Llama.cpp b1808
Model: llama-2-7b.Q4_0.gguf
Tokens Per Second > Higher Is Better
a . 29.58 |===================================================================
b . 30.03 |====================================================================
c . 29.85 |====================================================================


Llama.cpp b1808
Model: llama-2-13b.Q4_0.gguf
Tokens Per Second > Higher Is Better
a . 17.97 |===================================================================
b . 17.95 |===================================================================
c . 18.31 |====================================================================


Llama.cpp b1808
Model: llama-2-70b-chat.Q5_0.gguf
Tokens Per Second > Higher Is Better
a . 3.42 |=====================================================================
b . 3.43 |=====================================================================
c . 3.43 |=====================================================================


Llamafile 0.6
Test: llava-v1.5-7b-q4 - Acceleration: CPU
Tokens Per Second > Higher Is Better
a . 23.54 |===================================================================
b . 23.57 |===================================================================
c . 23.76 |====================================================================


Llamafile 0.6
Test: mistral-7b-instruct-v0.2.Q8_0 - Acceleration: CPU
Tokens Per Second > Higher Is Better
a . 14.75 |====================================================================
b . 14.76 |====================================================================
c . 14.75 |====================================================================


Llamafile 0.6
Test: wizardcoder-python-34b-v1.0.Q6_K - Acceleration: CPU
Tokens Per Second > Higher Is Better
a . 5.50 |=====================================================================
b . 5.53 |=====================================================================
c . 5.51 |=====================================================================