new llamafile

Intel Core i9-14900K testing with a ASUS PRIME Z790-P WIFI (1402 BIOS) and ASUS Intel RPL-S 31GB on Ubuntu 23.10 via the Phoronix Test Suite.

Compare your own system(s) to this result file with the Phoronix Test Suite by running the command: phoronix-test-suite benchmark 2404033-PTS-NEWLLAMA41
Jump To Table - Results

View

Do Not Show Noisy Results
Do Not Show Results With Incomplete Data
Do Not Show Results With Little Change/Spread
List Notable Results

Statistics

Show Overall Harmonic Mean(s)
Show Overall Geometric Mean
Show Wins / Losses Counts (Pie Chart)
Normalize Results
Remove Outliers Before Calculating Averages

Graph Settings

Force Line Graphs Where Applicable
Convert To Scalar Where Applicable
Prefer Vertical Bar Graphs

Multi-Way Comparison

Condense Multi-Option Tests Into Single Result Graphs

Table

Show Detailed System Result Table

Run Management

Highlight
Result
Hide
Result
Result
Identifier
Performance Per
Dollar
Date
Run
  Test
  Duration
a
April 03
  14 Minutes
b
April 03
  14 Minutes
c
April 03
  15 Minutes
d
April 03
  14 Minutes
Invert Hiding All Results Option
  14 Minutes

Only show results where is faster than
Only show results matching title/arguments (delimit multiple options with a comma):
Do not show results matching title/arguments (delimit multiple options with a comma):

new llamafile Intel Core i9-14900K testing with a ASUS PRIME Z790-P WIFI (1402 BIOS) and ASUS Intel RPL-S 31GB on Ubuntu 23.10 via the Phoronix Test Suite. ,,"a","b","c","d" Processor,,Intel Core i9-14900K @ 5.70GHz (24 Cores / 32 Threads),Intel Core i9-14900K @ 5.70GHz (24 Cores / 32 Threads),Intel Core i9-14900K @ 5.70GHz (24 Cores / 32 Threads),Intel Core i9-14900K @ 5.70GHz (24 Cores / 32 Threads) Motherboard,,ASUS PRIME Z790-P WIFI (1402 BIOS),ASUS PRIME Z790-P WIFI (1402 BIOS),ASUS PRIME Z790-P WIFI (1402 BIOS),ASUS PRIME Z790-P WIFI (1402 BIOS) Chipset,,Intel Device 7a27,Intel Device 7a27,Intel Device 7a27,Intel Device 7a27 Memory,,2 x 16GB DRAM-6000MT/s Corsair CMK32GX5M2B6000C36,2 x 16GB DRAM-6000MT/s Corsair CMK32GX5M2B6000C36,2 x 16GB DRAM-6000MT/s Corsair CMK32GX5M2B6000C36,2 x 16GB DRAM-6000MT/s Corsair CMK32GX5M2B6000C36 Disk,,Western Digital WD_BLACK SN850X 1000GB + 2000GB PCIe SSD,Western Digital WD_BLACK SN850X 1000GB + 2000GB PCIe SSD,Western Digital WD_BLACK SN850X 1000GB + 2000GB PCIe SSD,Western Digital WD_BLACK SN850X 1000GB + 2000GB PCIe SSD Graphics,,ASUS Intel RPL-S 31GB (1650MHz),ASUS Intel RPL-S 31GB (1650MHz),ASUS Intel RPL-S 31GB (1650MHz),ASUS Intel RPL-S 31GB (1650MHz) Audio,,Realtek ALC897,Realtek ALC897,Realtek ALC897,Realtek ALC897 Monitor,,ASUS VP28U,ASUS VP28U,ASUS VP28U,ASUS VP28U OS,,Ubuntu 23.10,Ubuntu 23.10,Ubuntu 23.10,Ubuntu 23.10 Kernel,,6.8.0-phx (x86_64),6.8.0-phx (x86_64),6.8.0-phx (x86_64),6.8.0-phx (x86_64) Desktop,,GNOME Shell 45.1,GNOME Shell 45.1,GNOME Shell 45.1,GNOME Shell 45.1 Display Server,,X Server 1.21.1.7,X Server 1.21.1.7,X Server 1.21.1.7,X Server 1.21.1.7 OpenGL,,4.6 Mesa 24.0~git2312240600.c05261~oibaf~m (git-c05261a 2023-12-24 mantic-oibaf-ppa),4.6 Mesa 24.0~git2312240600.c05261~oibaf~m (git-c05261a 2023-12-24 mantic-oibaf-ppa),4.6 Mesa 24.0~git2312240600.c05261~oibaf~m (git-c05261a 2023-12-24 mantic-oibaf-ppa),4.6 Mesa 24.0~git2312240600.c05261~oibaf~m (git-c05261a 2023-12-24 mantic-oibaf-ppa) Compiler,,GCC 13.2.0,GCC 13.2.0,GCC 13.2.0,GCC 13.2.0 File-System,,ext4,ext4,ext4,ext4 Screen Resolution,,3840x2160,3840x2160,3840x2160,3840x2160 ,,"a","b","c","d" "Llamafile - Test: wizardcoder-python-34b-v1.0.Q6_K - Acceleration: CPU (Tokens/sec)",HIB,2.66,2.66,2.65,2.66 "Llamafile - Test: mistral-7b-instruct-v0.2.Q8_0 - Acceleration: CPU (Tokens/sec)",HIB,9.65,9.63,9.61,9.63 "Llamafile - Test: llava-v1.5-7b-q4 - Acceleration: CPU (Tokens/sec)",HIB,14.90,14.85,14.64,14.81