new llamafile

Intel Core i9-14900K testing with a ASUS PRIME Z790-P WIFI (1402 BIOS) and ASUS Intel RPL-S 31GB on Ubuntu 23.10 via the Phoronix Test Suite.

Compare your own system(s) to this result file with the Phoronix Test Suite by running the command: phoronix-test-suite benchmark 2404033-PTS-NEWLLAMA41
Jump To Table - Results

View

Do Not Show Noisy Results
Do Not Show Results With Incomplete Data
Do Not Show Results With Little Change/Spread
List Notable Results

Statistics

Show Overall Harmonic Mean(s)
Show Overall Geometric Mean
Show Wins / Losses Counts (Pie Chart)
Normalize Results
Remove Outliers Before Calculating Averages

Graph Settings

Force Line Graphs Where Applicable
Convert To Scalar Where Applicable
Prefer Vertical Bar Graphs

Multi-Way Comparison

Condense Multi-Option Tests Into Single Result Graphs

Table

Show Detailed System Result Table

Run Management

Highlight
Result
Hide
Result
Result
Identifier
Performance Per
Dollar
Date
Run
  Test
  Duration
a
April 03
  14 Minutes
b
April 03
  14 Minutes
c
April 03
  15 Minutes
d
April 03
  14 Minutes
Invert Hiding All Results Option
  14 Minutes

Only show results where is faster than
Only show results matching title/arguments (delimit multiple options with a comma):
Do not show results matching title/arguments (delimit multiple options with a comma):

new llamafile, "Llamafile 0.7 - Test: llava-v1.5-7b-q4 - Acceleration: CPU", Higher Results Are Better "a",14.93,14.89,14.87 "b",14.83,14.87,14.86 "c",14.6,14.56,14.75 "d",14.9,14.89,14.63 "Llamafile 0.7 - Test: mistral-7b-instruct-v0.2.Q8_0 - Acceleration: CPU", Higher Results Are Better "a",9.71,9.62,9.62 "b",9.63,9.64,9.61 "c",9.54,9.63,9.65 "d",9.62,9.66,9.61 "Llamafile 0.7 - Test: wizardcoder-python-34b-v1.0.Q6_K - Acceleration: CPU", Higher Results Are Better "a",2.67,2.66,2.65 "b",2.65,2.66,2.66 "c",2.66,2.65,2.65 "d",2.66,2.66,2.65