llamafile xeon

Intel Xeon E E-2488 testing with a Supermicro Super Server X13SCL-F v0123456789 (1.1 BIOS) and ASPEED on Ubuntu 24.04 via the Phoronix Test Suite.

Compare your own system(s) to this result file with the Phoronix Test Suite by running the command: phoronix-test-suite benchmark 2404035-NE-LLAMAFILE41
Jump To Table - Results

View

Do Not Show Noisy Results
Do Not Show Results With Incomplete Data
Do Not Show Results With Little Change/Spread
List Notable Results

Statistics

Show Overall Harmonic Mean(s)
Show Overall Geometric Mean
Show Wins / Losses Counts (Pie Chart)
Normalize Results
Remove Outliers Before Calculating Averages

Graph Settings

Force Line Graphs Where Applicable
Convert To Scalar Where Applicable
Prefer Vertical Bar Graphs

Multi-Way Comparison

Condense Multi-Option Tests Into Single Result Graphs

Table

Show Detailed System Result Table

Run Management

Highlight
Result
Hide
Result
Result
Identifier
Performance Per
Dollar
Date
Run
  Test
  Duration
a
April 03
  17 Minutes
b
April 03
  17 Minutes
c
April 03
  17 Minutes
d
April 03
  18 Minutes
Invert Hiding All Results Option
  18 Minutes

Only show results where is faster than
Only show results matching title/arguments (delimit multiple options with a comma):
Do not show results matching title/arguments (delimit multiple options with a comma):

llamafile xeon Intel Xeon E E-2488 testing with a Supermicro Super Server X13SCL-F v0123456789 (1.1 BIOS) and ASPEED on Ubuntu 24.04 via the Phoronix Test Suite. ,,"a","b","c","d" Processor,,Intel Xeon E E-2488 @ 3.20GHz (8 Cores / 16 Threads),Intel Xeon E E-2488 @ 3.20GHz (8 Cores / 16 Threads),Intel Xeon E E-2488 @ 3.20GHz (8 Cores / 16 Threads),Intel Xeon E E-2488 @ 3.20GHz (8 Cores / 16 Threads) Motherboard,,Supermicro Super Server X13SCL-F v0123456789 (1.1 BIOS),Supermicro Super Server X13SCL-F v0123456789 (1.1 BIOS),Supermicro Super Server X13SCL-F v0123456789 (1.1 BIOS),Supermicro Super Server X13SCL-F v0123456789 (1.1 BIOS) Chipset,,Intel Raptor Lake-S PCH,Intel Raptor Lake-S PCH,Intel Raptor Lake-S PCH,Intel Raptor Lake-S PCH Memory,,2 x 32GB DRAM-4800MT/s Micron MTC20C2085S1EC48BA1,2 x 32GB DRAM-4800MT/s Micron MTC20C2085S1EC48BA1,2 x 32GB DRAM-4800MT/s Micron MTC20C2085S1EC48BA1,2 x 32GB DRAM-4800MT/s Micron MTC20C2085S1EC48BA1 Disk,,3201GB Micron_7450_MTFDKCC3T2TFS + 960GB Micron_7450_MTFDKBA960TFR,3201GB Micron_7450_MTFDKCC3T2TFS + 960GB Micron_7450_MTFDKBA960TFR,3201GB Micron_7450_MTFDKCC3T2TFS + 960GB Micron_7450_MTFDKBA960TFR,3201GB Micron_7450_MTFDKCC3T2TFS + 960GB Micron_7450_MTFDKBA960TFR Graphics,,ASPEED,ASPEED,ASPEED,ASPEED Monitor,,VE228,VE228,VE228,VE228 Network,,2 x Intel I210,2 x Intel I210,2 x Intel I210,2 x Intel I210 OS,,Ubuntu 24.04,Ubuntu 24.04,Ubuntu 24.04,Ubuntu 24.04 Kernel,,6.8.0-11-generic (x86_64),6.8.0-11-generic (x86_64),6.8.0-11-generic (x86_64),6.8.0-11-generic (x86_64) Desktop,,GNOME Shell 45.3,GNOME Shell 45.3,GNOME Shell 45.3,GNOME Shell 45.3 Display Server,,X Server 1.21.1.11,X Server 1.21.1.11,X Server 1.21.1.11,X Server 1.21.1.11 Compiler,,GCC 13.2.0,GCC 13.2.0,GCC 13.2.0,GCC 13.2.0 File-System,,ext4,ext4,ext4,ext4 Screen Resolution,,1920x1080,1920x1080,1920x1080,1920x1080 ,,"a","b","c","d" "Llamafile - Test: llava-v1.5-7b-q4 - Acceleration: CPU (Tokens/sec)",HIB,13.28,13.18,13.24,13.22 "Llamafile - Test: mistral-7b-instruct-v0.2.Q8_0 - Acceleration: CPU (Tokens/sec)",HIB,8.36,8.33,8.33,8.32 "Llamafile - Test: wizardcoder-python-34b-v1.0.Q6_K - Acceleration: CPU (Tokens/sec)",HIB,2.17,2.17,2.17,2.17