lll AMD Ryzen 7 7840U testing with a Framework Laptop 13 (AMD Ryzen 7040 ) FRANMDCP07 (03.03 BIOS) and AMD Phoenix1 512MB on Ubuntu 23.10 via the Phoronix Test Suite.
HTML result view exported from: https://openbenchmarking.org/result/2401216-NE-LLL95653850&sro&grr .
lll Processor Motherboard Chipset Memory Disk Graphics Audio Network OS Kernel Desktop Display Server OpenGL Compiler File-System Screen Resolution a b c d AMD Ryzen 7 7840U @ 5.13GHz (8 Cores / 16 Threads) Framework Laptop 13 (AMD Ryzen 7040 ) FRANMDCP07 (03.03 BIOS) AMD Device 14e8 2 x 8 GB DRAM-5600MT/s AD5S56008G-B 512GB Western Digital WD PC SN740 SDDPNQD-512G AMD Phoenix1 512MB (2700/2800MHz) AMD Rembrandt Radeon HD Audio MEDIATEK MT7922 802.11ax PCI Ubuntu 23.10 6.7.0-060700rc5-generic (x86_64) GNOME Shell 45.1 X Server 1.21.1.7 + Wayland 4.6 Mesa 24.0~git2312160600.5d937f~oibaf~m (git-5d937f0 2023-12-16 mantic-oibaf-ppa) (LLVM 16.0.6 DRM 3.56) GCC 13.2.0 ext4 2256x1504 OpenBenchmarking.org Kernel Details - Transparent Huge Pages: madvise Compiler Details - --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-bootstrap --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-link-serialization=2 --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-defaulted --enable-offload-targets=nvptx-none=/build/gcc-13-XYspKM/gcc-13-13.2.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-13-XYspKM/gcc-13-13.2.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-build-config=bootstrap-lto-lean --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v Processor Details - Scaling Governor: amd-pstate-epp powersave (EPP: performance) - Platform Profile: balanced - CPU Microcode: 0xa704103 - ACPI Profile: balanced Security Details - gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_rstack_overflow: Vulnerable: Safe RET no microcode + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional STIBP: always-on RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected
lll llamafile: wizardcoder-python-34b-v1.0.Q6_K - CPU llamafile: mistral-7b-instruct-v0.2.Q8_0 - CPU llamafile: llava-v1.5-7b-q4 - CPU compress-lz4: 9 - Decompression Speed compress-lz4: 9 - Compression Speed compress-lz4: 1 - Decompression Speed compress-lz4: 1 - Compression Speed compress-lz4: 3 - Decompression Speed compress-lz4: 3 - Compression Speed a b c d 0.12 6.79 11.32 5391.6 45.01 5678.5 886.61 5122.4 138.56 0.12 6.85 11.37 5351.7 44.72 5691.3 897.05 5118.7 138.67 0.12 6.84 11.34 5372.9 45.09 5698.2 896.39 5101.5 138.46 0.12 6.85 11.37 5324.5 44.83 5667.5 894.36 5117.8 139.08 OpenBenchmarking.org
Llamafile Test: wizardcoder-python-34b-v1.0.Q6_K - Acceleration: CPU OpenBenchmarking.org Tokens Per Second, More Is Better Llamafile 0.6 Test: wizardcoder-python-34b-v1.0.Q6_K - Acceleration: CPU a b c d 0.027 0.054 0.081 0.108 0.135 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 0.12 0.12 0.12 0.12
Llamafile Test: mistral-7b-instruct-v0.2.Q8_0 - Acceleration: CPU OpenBenchmarking.org Tokens Per Second, More Is Better Llamafile 0.6 Test: mistral-7b-instruct-v0.2.Q8_0 - Acceleration: CPU a b c d 2 4 6 8 10 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 6.79 6.85 6.84 6.85
Llamafile Test: llava-v1.5-7b-q4 - Acceleration: CPU OpenBenchmarking.org Tokens Per Second, More Is Better Llamafile 0.6 Test: llava-v1.5-7b-q4 - Acceleration: CPU a b c d 3 6 9 12 15 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 11.32 11.37 11.34 11.37
LZ4 Compression Compression Level: 9 - Decompression Speed OpenBenchmarking.org MB/s, More Is Better LZ4 Compression 1.9.4 Compression Level: 9 - Decompression Speed a b c d 1200 2400 3600 4800 6000 SE +/- 12.85, N = 3 SE +/- 18.61, N = 3 SE +/- 16.98, N = 3 SE +/- 8.91, N = 3 5391.6 5351.7 5372.9 5324.5 1. (CC) gcc options: -O3
LZ4 Compression Compression Level: 9 - Compression Speed OpenBenchmarking.org MB/s, More Is Better LZ4 Compression 1.9.4 Compression Level: 9 - Compression Speed a b c d 10 20 30 40 50 SE +/- 0.08, N = 3 SE +/- 0.23, N = 3 SE +/- 0.24, N = 3 SE +/- 0.27, N = 3 45.01 44.72 45.09 44.83 1. (CC) gcc options: -O3
LZ4 Compression Compression Level: 1 - Decompression Speed OpenBenchmarking.org MB/s, More Is Better LZ4 Compression 1.9.4 Compression Level: 1 - Decompression Speed a b c d 1200 2400 3600 4800 6000 SE +/- 33.56, N = 3 SE +/- 17.91, N = 3 SE +/- 29.33, N = 3 SE +/- 25.23, N = 3 5678.5 5691.3 5698.2 5667.5 1. (CC) gcc options: -O3
LZ4 Compression Compression Level: 1 - Compression Speed OpenBenchmarking.org MB/s, More Is Better LZ4 Compression 1.9.4 Compression Level: 1 - Compression Speed a b c d 200 400 600 800 1000 SE +/- 5.21, N = 3 SE +/- 3.70, N = 3 SE +/- 4.66, N = 3 SE +/- 5.20, N = 3 886.61 897.05 896.39 894.36 1. (CC) gcc options: -O3
LZ4 Compression Compression Level: 3 - Decompression Speed OpenBenchmarking.org MB/s, More Is Better LZ4 Compression 1.9.4 Compression Level: 3 - Decompression Speed a b c d 1100 2200 3300 4400 5500 SE +/- 4.53, N = 3 SE +/- 18.39, N = 3 SE +/- 6.93, N = 3 SE +/- 17.32, N = 3 5122.4 5118.7 5101.5 5117.8 1. (CC) gcc options: -O3
LZ4 Compression Compression Level: 3 - Compression Speed OpenBenchmarking.org MB/s, More Is Better LZ4 Compression 1.9.4 Compression Level: 3 - Compression Speed a b c d 30 60 90 120 150 SE +/- 0.72, N = 3 SE +/- 0.52, N = 3 SE +/- 0.58, N = 3 SE +/- 0.30, N = 3 138.56 138.67 138.46 139.08 1. (CC) gcc options: -O3
Phoronix Test Suite v10.8.5