llama
Intel Core i9-14900K testing with a ASUS PRIME Z790-P WIFI (1402 BIOS) and Intel Arc A770 DG2 16GB on Ubuntu 23.10 via the Phoronix Test Suite.


a: 

	Processor: Intel Core i9-14900K @ 5.70GHz (24 Cores / 32 Threads), Motherboard: ASUS PRIME Z790-P WIFI (1402 BIOS), Chipset: Intel Device 7a27, Memory: 2 x 16 GB DRAM-6000MT/s Corsair CMK32GX5M2B6000C36, Disk: Western Digital WD_BLACK SN850X 1000GB, Graphics: Intel Arc A770 DG2 16GB (2400MHz), Audio: Realtek ALC897, Monitor: ASUS VP28U

	OS: Ubuntu 23.10, Kernel: 6.7.0-060700rc7daily20231224-generic (x86_64), Desktop: GNOME Shell 45.1, Display Server: X Server 1.21.1.7, OpenGL: 4.6 Mesa 24.0~git2312240600.c05261~oibaf~m (git-c05261a 2023-12-24 mantic-oibaf-ppa), OpenCL: OpenCL 3.0, Compiler: GCC 13.2.0, File-System: ext4, Screen Resolution: 1920x1080

v: 

	Processor: Intel Core i9-14900K @ 5.70GHz (24 Cores / 32 Threads), Motherboard: ASUS PRIME Z790-P WIFI (1402 BIOS), Chipset: Intel Device 7a27, Memory: 2 x 16 GB DRAM-6000MT/s Corsair CMK32GX5M2B6000C36, Disk: Western Digital WD_BLACK SN850X 1000GB, Graphics: Intel Arc A770 DG2 16GB (2400MHz), Audio: Realtek ALC897, Monitor: ASUS VP28U

	OS: Ubuntu 23.10, Kernel: 6.7.0-060700rc7daily20231224-generic (x86_64), Desktop: GNOME Shell 45.1, Display Server: X Server 1.21.1.7, OpenGL: 4.6 Mesa 24.0~git2312240600.c05261~oibaf~m (git-c05261a 2023-12-24 mantic-oibaf-ppa), OpenCL: OpenCL 3.0, Compiler: GCC 13.2.0, File-System: ext4, Screen Resolution: 1920x1080

c: 

	Processor: Intel Core i9-14900K @ 5.70GHz (24 Cores / 32 Threads), Motherboard: ASUS PRIME Z790-P WIFI (1402 BIOS), Chipset: Intel Device 7a27, Memory: 2 x 16 GB DRAM-6000MT/s Corsair CMK32GX5M2B6000C36, Disk: Western Digital WD_BLACK SN850X 1000GB, Graphics: Intel Arc A770 DG2 16GB (2400MHz), Audio: Realtek ALC897, Monitor: ASUS VP28U

	OS: Ubuntu 23.10, Kernel: 6.7.0-060700rc7daily20231224-generic (x86_64), Desktop: GNOME Shell 45.1, Display Server: X Server 1.21.1.7, OpenGL: 4.6 Mesa 24.0~git2312240600.c05261~oibaf~m (git-c05261a 2023-12-24 mantic-oibaf-ppa), OpenCL: OpenCL 3.0, Compiler: GCC 13.2.0, File-System: ext4, Screen Resolution: 1920x1080

d: 

	Processor: Intel Core i9-14900K @ 5.70GHz (24 Cores / 32 Threads), Motherboard: ASUS PRIME Z790-P WIFI (1402 BIOS), Chipset: Intel Device 7a27, Memory: 2 x 16 GB DRAM-6000MT/s Corsair CMK32GX5M2B6000C36, Disk: Western Digital WD_BLACK SN850X 1000GB, Graphics: Intel Arc A770 DG2 16GB (2400MHz), Audio: Realtek ALC897, Monitor: ASUS VP28U

	OS: Ubuntu 23.10, Kernel: 6.7.0-060700rc7daily20231224-generic (x86_64), Desktop: GNOME Shell 45.1, Display Server: X Server 1.21.1.7, OpenGL: 4.6 Mesa 24.0~git2312240600.c05261~oibaf~m (git-c05261a 2023-12-24 mantic-oibaf-ppa), OpenCL: OpenCL 3.0, Compiler: GCC 13.2.0, File-System: ext4, Screen Resolution: 1920x1080


CacheBench
Test: Read
MB/s > Higher Is Better
a . 22912.67 |=================================================================
v . 22911.47 |=================================================================
c . 22594.47 |================================================================
d . 22913.71 |=================================================================


CacheBench
Test: Write
MB/s > Higher Is Better
a . 161363.48 |================================================================
v . 161285.20 |================================================================
c . 161299.01 |================================================================
d . 161353.74 |================================================================


CacheBench
Test: Read / Modify / Write
MB/s > Higher Is Better
a . 176235.85 |================================================================
v . 166291.19 |============================================================
c . 175404.26 |================================================================
d . 175929.32 |================================================================


Llama.cpp b1808
Model: llama-2-7b.Q4_0.gguf
Tokens Per Second > Higher Is Better
a . 16.38 |===================================================================
v . 16.44 |===================================================================
c . 16.60 |====================================================================
d . 16.50 |====================================================================


Llama.cpp b1808
Model: llama-2-13b.Q4_0.gguf
Tokens Per Second > Higher Is Better
a . 8.75 |=====================================================================
v . 8.75 |=====================================================================
c . 8.77 |=====================================================================
d . 8.76 |=====================================================================