AMD Ryzen 7 7840U testing with a Framework FRANMDCP07 (03.03 BIOS) and AMD Phoenix1 512MB on Ubuntu 23.10 via the Phoronix Test Suite.
Compare your own system(s) to this result file with the
Phoronix Test Suite by running the command:
phoronix-test-suite benchmark 2401119-NE-LLAMA444079 llama - Phoronix Test Suite llama AMD Ryzen 7 7840U testing with a Framework FRANMDCP07 (03.03 BIOS) and AMD Phoenix1 512MB on Ubuntu 23.10 via the Phoronix Test Suite.
HTML result view exported from: https://openbenchmarking.org/result/2401119-NE-LLAMA444079&grt .
llama Processor Motherboard Chipset Memory Disk Graphics Audio Network OS Kernel Desktop Display Server OpenGL Compiler File-System Screen Resolution a b c d AMD Ryzen 7 7840U @ 5.13GHz (8 Cores / 16 Threads) Framework FRANMDCP07 (03.03 BIOS) AMD Device 14e8 2 x 8 GB DRAM-5600MT/s AD5S56008G-B 512GB Western Digital WD PC SN740 SDDPNQD-512G AMD Phoenix1 512MB (2700/2800MHz) AMD Rembrandt Radeon HD Audio MEDIATEK MT7922 802.11ax PCI Ubuntu 23.10 6.7.0-060700rc5-generic (x86_64) GNOME Shell 45.1 X Server 1.21.1.7 + Wayland 4.6 Mesa 24.0~git2312160600.5d937f~oibaf~m (git-5d937f0 2023-12-16 mantic-oibaf-ppa) (LLVM 16.0.6 DRM 3.56) GCC 13.2.0 ext4 2256x1504 OpenBenchmarking.org Kernel Details - Transparent Huge Pages: madvise Compiler Details - --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-bootstrap --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-link-serialization=2 --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-defaulted --enable-offload-targets=nvptx-none=/build/gcc-13-XYspKM/gcc-13-13.2.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-13-XYspKM/gcc-13-13.2.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-build-config=bootstrap-lto-lean --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v Processor Details - Scaling Governor: amd-pstate-epp powersave (EPP: performance) - Platform Profile: balanced - CPU Microcode: 0xa704103 - ACPI Profile: balanced Security Details - gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_rstack_overflow: Vulnerable: Safe RET no microcode + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional STIBP: always-on RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected
llama cachebench: Read cachebench: Write cachebench: Read / Modify / Write llama-cpp: llama-2-7b.Q4_0.gguf llama-cpp: llama-2-13b.Q4_0.gguf a b c d 12396.27548 72497.856295 131556.501116 13.32 7.11 12270.096071 72913.162070 131367.670142 13.59 7.15 12319.498226 72157.67985 130628.27417 13.48 7.18 12381.073447 72501.828301 131333.362961 13.5 7.29 OpenBenchmarking.org
CacheBench Test: Read OpenBenchmarking.org MB/s, More Is Better CacheBench Test: Read a b c d 3K 6K 9K 12K 15K SE +/- 18.01, N = 3 12396.28 12270.10 12319.50 12381.07 MIN: 12367.08 / MAX: 12496.62 MIN: 12226.09 / MAX: 12316.73 MIN: 12310.3 / MAX: 12325.17 MIN: 12375.59 / MAX: 12381.24 1. (CC) gcc options: -O3 -lrt
CacheBench Test: Write OpenBenchmarking.org MB/s, More Is Better CacheBench Test: Write a b c d 16K 32K 48K 64K 80K SE +/- 19.79, N = 3 72497.86 72913.16 72157.68 72501.83 MIN: 72039.23 / MAX: 72756.09 MIN: 72419.43 / MAX: 73142.21 MIN: 71728.42 / MAX: 72349.37 MIN: 72040.49 / MAX: 72760.16 1. (CC) gcc options: -O3 -lrt
CacheBench Test: Read / Modify / Write OpenBenchmarking.org MB/s, More Is Better CacheBench Test: Read / Modify / Write a b c d 30K 60K 90K 120K 150K SE +/- 334.41, N = 3 131556.50 131367.67 130628.27 131333.36 MIN: 104085.06 / MAX: 142061.03 MIN: 103002.69 / MAX: 142719.87 MIN: 103222.92 / MAX: 141269.42 MIN: 105232.15 / MAX: 142024.31 1. (CC) gcc options: -O3 -lrt
Llama.cpp Model: llama-2-7b.Q4_0.gguf OpenBenchmarking.org Tokens Per Second, More Is Better Llama.cpp b1808 Model: llama-2-7b.Q4_0.gguf a b c d 3 6 9 12 15 SE +/- 0.15, N = 3 13.32 13.59 13.48 13.50 1. (CXX) g++ options: -std=c++11 -fPIC -O3 -pthread -march=native -mtune=native -lopenblas
Llama.cpp Model: llama-2-13b.Q4_0.gguf OpenBenchmarking.org Tokens Per Second, More Is Better Llama.cpp b1808 Model: llama-2-13b.Q4_0.gguf a b c d 2 4 6 8 10 SE +/- 0.01, N = 3 7.11 7.15 7.18 7.29 1. (CXX) g++ options: -std=c++11 -fPIC -O3 -pthread -march=native -mtune=native -lopenblas
Phoronix Test Suite v10.8.4