AMD EPYC 7551 32-Core testing with a GIGABYTE MZ31-AR0-00 v01010101 (F10 BIOS) and ASPEED on Debian 12 via the Phoronix Test Suite.
Compare your own system(s) to this result file with the
Phoronix Test Suite by running the command:
phoronix-test-suite benchmark 2401291-NE-EOJAN080945 eo jan - Phoronix Test Suite eo jan AMD EPYC 7551 32-Core testing with a GIGABYTE MZ31-AR0-00 v01010101 (F10 BIOS) and ASPEED on Debian 12 via the Phoronix Test Suite.
HTML result view exported from: https://openbenchmarking.org/result/2401291-NE-EOJAN080945&rdt&grs .
eo jan Processor Motherboard Chipset Memory Disk Graphics Network OS Kernel Compiler File-System Screen Resolution a b c d AMD EPYC 7551 32-Core @ 2.00GHz (32 Cores / 64 Threads) GIGABYTE MZ31-AR0-00 v01010101 (F10 BIOS) AMD 17h 8 x 4 GB DDR4-2133MT/s 9ASF51272PZ-2G6E1 Samsung SSD 960 EVO 500GB + 31GB SanDisk 3.2Gen1 ASPEED Realtek RTL8111/8168/8411 + 2 x Broadcom NetXtreme II BCM57810 10 Debian 12 6.1.0-10-amd64 (x86_64) GCC 12.2.0 ext4 1024x768 OpenBenchmarking.org Kernel Details - Transparent Huge Pages: always Compiler Details - --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-defaulted --enable-offload-targets=nvptx-none=/build/gcc-12-bTRWOB/gcc-12-12.2.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-12-bTRWOB/gcc-12-12.2.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v Processor Details - Scaling Governor: acpi-cpufreq schedutil (Boost: Enabled) - CPU Microcode: 0x8001227 Security Details - itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Mitigation of untrained return thunk; SMT vulnerable + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional STIBP: disabled RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected
eo jan llamafile: mistral-7b-instruct-v0.2.Q8_0 - CPU llamafile: llava-v1.5-7b-q4 - CPU compress-lz4: 1 - Decompression Speed compress-lz4: 9 - Decompression Speed compress-lz4: 9 - Compression Speed compress-lz4: 3 - Compression Speed compress-lz4: 3 - Decompression Speed compress-lz4: 1 - Compression Speed cachebench: Read / Modify / Write cachebench: Write cachebench: Read a b c d 3.16 3.19 3004.3 2746.9 25.1 66.49 2639.4 460.19 41600.347416 37993.827815 7630.254563 3.72 3.46 2947.8 2848.9 24.32 65.96 2661.6 463.67 41664.405912 37950.536317 7625.788881 3.69 3.58 2885.8 2805.7 24.65 64.93 2658.5 462.16 41541.433518 38006.426354 7630.168960 3.49 3.58 2942.6 2759.6 24.83 65.66 2629.7 464.21 41616.460536 37996.404705 7625.341644 OpenBenchmarking.org
Llamafile Test: mistral-7b-instruct-v0.2.Q8_0 - Acceleration: CPU OpenBenchmarking.org Tokens Per Second, More Is Better Llamafile 0.6 Test: mistral-7b-instruct-v0.2.Q8_0 - Acceleration: CPU a b c d 0.837 1.674 2.511 3.348 4.185 SE +/- 0.00, N = 3 SE +/- 0.05, N = 3 3.16 3.72 3.69 3.49
Llamafile Test: llava-v1.5-7b-q4 - Acceleration: CPU OpenBenchmarking.org Tokens Per Second, More Is Better Llamafile 0.6 Test: llava-v1.5-7b-q4 - Acceleration: CPU a b c d 0.8055 1.611 2.4165 3.222 4.0275 SE +/- 0.06, N = 3 SE +/- 0.05, N = 5 3.19 3.46 3.58 3.58
LZ4 Compression Compression Level: 1 - Decompression Speed OpenBenchmarking.org MB/s, More Is Better LZ4 Compression 1.9.4 Compression Level: 1 - Decompression Speed a b c d 600 1200 1800 2400 3000 SE +/- 6.26, N = 3 SE +/- 11.82, N = 3 3004.3 2947.8 2885.8 2942.6 1. (CC) gcc options: -O3
LZ4 Compression Compression Level: 9 - Decompression Speed OpenBenchmarking.org MB/s, More Is Better LZ4 Compression 1.9.4 Compression Level: 9 - Decompression Speed a b c d 600 1200 1800 2400 3000 SE +/- 11.34, N = 3 SE +/- 11.86, N = 3 2746.9 2848.9 2805.7 2759.6 1. (CC) gcc options: -O3
LZ4 Compression Compression Level: 9 - Compression Speed OpenBenchmarking.org MB/s, More Is Better LZ4 Compression 1.9.4 Compression Level: 9 - Compression Speed a b c d 6 12 18 24 30 SE +/- 0.21, N = 3 SE +/- 0.03, N = 3 25.10 24.32 24.65 24.83 1. (CC) gcc options: -O3
LZ4 Compression Compression Level: 3 - Compression Speed OpenBenchmarking.org MB/s, More Is Better LZ4 Compression 1.9.4 Compression Level: 3 - Compression Speed a b c d 15 30 45 60 75 SE +/- 0.13, N = 3 SE +/- 0.34, N = 3 66.49 65.96 64.93 65.66 1. (CC) gcc options: -O3
LZ4 Compression Compression Level: 3 - Decompression Speed OpenBenchmarking.org MB/s, More Is Better LZ4 Compression 1.9.4 Compression Level: 3 - Decompression Speed a b c d 600 1200 1800 2400 3000 SE +/- 12.47, N = 3 SE +/- 11.55, N = 3 2639.4 2661.6 2658.5 2629.7 1. (CC) gcc options: -O3
LZ4 Compression Compression Level: 1 - Compression Speed OpenBenchmarking.org MB/s, More Is Better LZ4 Compression 1.9.4 Compression Level: 1 - Compression Speed a b c d 100 200 300 400 500 SE +/- 1.24, N = 3 SE +/- 0.48, N = 3 460.19 463.67 462.16 464.21 1. (CC) gcc options: -O3
CacheBench Test: Read / Modify / Write OpenBenchmarking.org MB/s, More Is Better CacheBench Test: Read / Modify / Write a b c d 9K 18K 27K 36K 45K SE +/- 35.23, N = 3 SE +/- 13.20, N = 3 41600.35 41664.41 41541.43 41616.46 MIN: 34358.14 / MAX: 45467.73 MIN: 34349.39 / MAX: 45533.54 MIN: 33763.33 / MAX: 45493.29 MIN: 34175.34 / MAX: 45532.36 1. (CC) gcc options: -O3 -lrt
CacheBench Test: Write OpenBenchmarking.org MB/s, More Is Better CacheBench Test: Write a b c d 8K 16K 24K 32K 40K SE +/- 12.23, N = 3 SE +/- 17.19, N = 3 37993.83 37950.54 38006.43 37996.40 MIN: 24305.51 / MAX: 45165.33 MIN: 24370.41 / MAX: 45150.74 MIN: 24287.88 / MAX: 45166.93 MIN: 24289.31 / MAX: 45170.27 1. (CC) gcc options: -O3 -lrt
CacheBench Test: Read OpenBenchmarking.org MB/s, More Is Better CacheBench Test: Read a b c d 1600 3200 4800 6400 8000 SE +/- 0.32, N = 3 SE +/- 2.53, N = 3 7630.25 7625.79 7630.17 7625.34 MIN: 7626.41 / MAX: 7631.29 MIN: 7545.19 / MAX: 7631.02 MIN: 7627.55 / MAX: 7631.62 MIN: 7530.28 / MAX: 7631.41 1. (CC) gcc options: -O3 -lrt
Phoronix Test Suite v10.8.4