eo jan

AMD EPYC 7551 32-Core testing with a GIGABYTE MZ31-AR0-00 v01010101 (F10 BIOS) and ASPEED on Debian 12 via the Phoronix Test Suite.

Compare your own system(s) to this result file with the Phoronix Test Suite by running the command: phoronix-test-suite benchmark 2401291-NE-EOJAN080945
Jump To Table - Results

View

Do Not Show Noisy Results
Do Not Show Results With Incomplete Data
Do Not Show Results With Little Change/Spread
List Notable Results

Statistics

Show Overall Harmonic Mean(s)
Show Overall Geometric Mean
Show Wins / Losses Counts (Pie Chart)
Normalize Results
Remove Outliers Before Calculating Averages

Graph Settings

Force Line Graphs Where Applicable
Convert To Scalar Where Applicable
Prefer Vertical Bar Graphs

Multi-Way Comparison

Condense Multi-Option Tests Into Single Result Graphs

Table

Show Detailed System Result Table

Run Management

Highlight
Result
Hide
Result
Result
Identifier
View Logs
Performance Per
Dollar
Date
Run
  Test
  Duration
a
January 29
  16 Minutes
b
January 29
  15 Minutes
c
January 29
  45 Minutes
d
January 29
  45 Minutes
Invert Hiding All Results Option
  30 Minutes

Only show results where is faster than
Only show results matching title/arguments (delimit multiple options with a comma):
Do not show results matching title/arguments (delimit multiple options with a comma):


eo janOpenBenchmarking.orgPhoronix Test SuiteAMD EPYC 7551 32-Core @ 2.00GHz (32 Cores / 64 Threads)GIGABYTE MZ31-AR0-00 v01010101 (F10 BIOS)AMD 17h8 x 4 GB DDR4-2133MT/s 9ASF51272PZ-2G6E1Samsung SSD 960 EVO 500GB + 31GB SanDisk 3.2Gen1ASPEEDRealtek RTL8111/8168/8411 + 2 x Broadcom NetXtreme II BCM57810 10Debian 126.1.0-10-amd64 (x86_64)GCC 12.2.0ext41024x768ProcessorMotherboardChipsetMemoryDiskGraphicsNetworkOSKernelCompilerFile-SystemScreen ResolutionEo Jan BenchmarksSystem Logs- Transparent Huge Pages: always- --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-defaulted --enable-offload-targets=nvptx-none=/build/gcc-12-bTRWOB/gcc-12-12.2.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-12-bTRWOB/gcc-12-12.2.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v - Scaling Governor: acpi-cpufreq schedutil (Boost: Enabled) - CPU Microcode: 0x8001227- itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Mitigation of untrained return thunk; SMT vulnerable + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional STIBP: disabled RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected

abcdResult OverviewPhoronix Test Suite100%104%109%113%118%LlamafileLlamafileLZ4 CompressionLZ4 CompressionLZ4 CompressionLZ4 CompressionLZ4 CompressionLZ4 CompressionCacheBenchCacheBenchCacheBenchmistral-7b-instruct-v0.2.Q8_0 - CPUllava-v1.5-7b-q4 - CPU1 - D.S9 - D.S9 - Compression Speed3 - Compression Speed3 - D.S1 - Compression SpeedR.M.WWriteRead

eo jancachebench: Readcachebench: Writecachebench: Read / Modify / Writecompress-lz4: 1 - Compression Speedcompress-lz4: 1 - Decompression Speedcompress-lz4: 3 - Compression Speedcompress-lz4: 3 - Decompression Speedcompress-lz4: 9 - Compression Speedcompress-lz4: 9 - Decompression Speedllamafile: llava-v1.5-7b-q4 - CPUllamafile: mistral-7b-instruct-v0.2.Q8_0 - CPUabcd7630.25456337993.82781541600.347416460.193004.366.492639.425.12746.93.193.167625.78888137950.53631741664.405912463.672947.865.962661.624.322848.93.463.727630.16896038006.42635441541.433518462.162885.864.932658.524.652805.73.583.697625.34164437996.40470541616.460536464.212942.665.662629.724.832759.63.583.49OpenBenchmarking.org

CacheBench

This is a performance test of CacheBench, which is part of LLCbench. CacheBench is designed to test the memory and cache bandwidth performance Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgMB/s, More Is BetterCacheBenchTest: Readabcd16003200480064008000SE +/- 0.32, N = 3SE +/- 2.53, N = 37630.257625.797630.177625.34MIN: 7626.41 / MAX: 7631.29MIN: 7545.19 / MAX: 7631.02MIN: 7627.55 / MAX: 7631.62MIN: 7530.28 / MAX: 7631.411. (CC) gcc options: -O3 -lrt
OpenBenchmarking.orgMB/s, More Is BetterCacheBenchTest: Readabcd13002600390052006500Min: 7629.75 / Avg: 7630.17 / Max: 7630.81Min: 7621.2 / Avg: 7625.34 / Max: 7629.931. (CC) gcc options: -O3 -lrt

OpenBenchmarking.orgMB/s, More Is BetterCacheBenchTest: Writeabcd8K16K24K32K40KSE +/- 12.23, N = 3SE +/- 17.19, N = 337993.8337950.5438006.4337996.40MIN: 24305.51 / MAX: 45165.33MIN: 24370.41 / MAX: 45150.74MIN: 24287.88 / MAX: 45166.93MIN: 24289.31 / MAX: 45170.271. (CC) gcc options: -O3 -lrt
OpenBenchmarking.orgMB/s, More Is BetterCacheBenchTest: Writeabcd7K14K21K28K35KMin: 37985.35 / Avg: 38006.43 / Max: 38027.73Min: 37962.47 / Avg: 37996.4 / Max: 38018.121. (CC) gcc options: -O3 -lrt

OpenBenchmarking.orgMB/s, More Is BetterCacheBenchTest: Read / Modify / Writeabcd9K18K27K36K45KSE +/- 35.23, N = 3SE +/- 13.20, N = 341600.3541664.4141541.4341616.46MIN: 34358.14 / MAX: 45467.73MIN: 34349.39 / MAX: 45533.54MIN: 33763.33 / MAX: 45493.29MIN: 34175.34 / MAX: 45532.361. (CC) gcc options: -O3 -lrt
OpenBenchmarking.orgMB/s, More Is BetterCacheBenchTest: Read / Modify / Writeabcd7K14K21K28K35KMin: 41473.72 / Avg: 41541.43 / Max: 41592.13Min: 41597.29 / Avg: 41616.46 / Max: 41641.771. (CC) gcc options: -O3 -lrt

LZ4 Compression

This test measures the time needed to compress/decompress a sample file (silesia archive) using LZ4 compression. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgMB/s, More Is BetterLZ4 Compression 1.9.4Compression Level: 1 - Compression Speedabcd100200300400500SE +/- 1.24, N = 3SE +/- 0.48, N = 3460.19463.67462.16464.211. (CC) gcc options: -O3
OpenBenchmarking.orgMB/s, More Is BetterLZ4 Compression 1.9.4Compression Level: 1 - Compression Speedabcd80160240320400Min: 460.79 / Avg: 462.16 / Max: 464.64Min: 463.34 / Avg: 464.21 / Max: 464.991. (CC) gcc options: -O3

OpenBenchmarking.orgMB/s, More Is BetterLZ4 Compression 1.9.4Compression Level: 1 - Decompression Speedabcd6001200180024003000SE +/- 6.26, N = 3SE +/- 11.82, N = 33004.32947.82885.82942.61. (CC) gcc options: -O3
OpenBenchmarking.orgMB/s, More Is BetterLZ4 Compression 1.9.4Compression Level: 1 - Decompression Speedabcd5001000150020002500Min: 2879.1 / Avg: 2885.8 / Max: 2898.3Min: 2923.2 / Avg: 2942.57 / Max: 29641. (CC) gcc options: -O3

OpenBenchmarking.orgMB/s, More Is BetterLZ4 Compression 1.9.4Compression Level: 3 - Compression Speedabcd1530456075SE +/- 0.13, N = 3SE +/- 0.34, N = 366.4965.9664.9365.661. (CC) gcc options: -O3
OpenBenchmarking.orgMB/s, More Is BetterLZ4 Compression 1.9.4Compression Level: 3 - Compression Speedabcd1326395265Min: 64.73 / Avg: 64.93 / Max: 65.16Min: 64.98 / Avg: 65.66 / Max: 66.11. (CC) gcc options: -O3

OpenBenchmarking.orgMB/s, More Is BetterLZ4 Compression 1.9.4Compression Level: 3 - Decompression Speedabcd6001200180024003000SE +/- 12.47, N = 3SE +/- 11.55, N = 32639.42661.62658.52629.71. (CC) gcc options: -O3
OpenBenchmarking.orgMB/s, More Is BetterLZ4 Compression 1.9.4Compression Level: 3 - Decompression Speedabcd5001000150020002500Min: 2633.6 / Avg: 2658.53 / Max: 2671.6Min: 2609.9 / Avg: 2629.67 / Max: 2649.91. (CC) gcc options: -O3

OpenBenchmarking.orgMB/s, More Is BetterLZ4 Compression 1.9.4Compression Level: 9 - Compression Speedabcd612182430SE +/- 0.21, N = 3SE +/- 0.03, N = 325.1024.3224.6524.831. (CC) gcc options: -O3
OpenBenchmarking.orgMB/s, More Is BetterLZ4 Compression 1.9.4Compression Level: 9 - Compression Speedabcd612182430Min: 24.24 / Avg: 24.65 / Max: 24.94Min: 24.78 / Avg: 24.83 / Max: 24.861. (CC) gcc options: -O3

OpenBenchmarking.orgMB/s, More Is BetterLZ4 Compression 1.9.4Compression Level: 9 - Decompression Speedabcd6001200180024003000SE +/- 11.34, N = 3SE +/- 11.86, N = 32746.92848.92805.72759.61. (CC) gcc options: -O3
OpenBenchmarking.orgMB/s, More Is BetterLZ4 Compression 1.9.4Compression Level: 9 - Decompression Speedabcd5001000150020002500Min: 2783 / Avg: 2805.67 / Max: 2817.8Min: 2742 / Avg: 2759.63 / Max: 2782.21. (CC) gcc options: -O3

Llamafile

Mozilla's Llamafile allows distributing and running large language models (LLMs) as a single file. Llamafile aims to make open-source LLMs more accessible to developers and users. Llamafile supports a variety of models, CPUs and GPUs, and other options. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgTokens Per Second, More Is BetterLlamafile 0.6Test: llava-v1.5-7b-q4 - Acceleration: CPUabcd0.80551.6112.41653.2224.0275SE +/- 0.06, N = 3SE +/- 0.05, N = 53.193.463.583.58
OpenBenchmarking.orgTokens Per Second, More Is BetterLlamafile 0.6Test: llava-v1.5-7b-q4 - Acceleration: CPUabcd246810Min: 3.48 / Avg: 3.58 / Max: 3.69Min: 3.39 / Avg: 3.58 / Max: 3.71

OpenBenchmarking.orgTokens Per Second, More Is BetterLlamafile 0.6Test: mistral-7b-instruct-v0.2.Q8_0 - Acceleration: CPUabcd0.8371.6742.5113.3484.185SE +/- 0.00, N = 3SE +/- 0.05, N = 33.163.723.693.49
OpenBenchmarking.orgTokens Per Second, More Is BetterLlamafile 0.6Test: mistral-7b-instruct-v0.2.Q8_0 - Acceleration: CPUabcd246810Min: 3.69 / Avg: 3.69 / Max: 3.7Min: 3.44 / Avg: 3.49 / Max: 3.59