lll AMD Ryzen 7 PRO 6850U testing with a LENOVO ThinkPad X13 Gen 3 21CM0001US (R22ET51W 1.21 BIOS) and AMD Radeon 680M 1GB on Fedora Linux 39 via the Phoronix Test Suite.
HTML result view exported from: https://openbenchmarking.org/result/2401205-NE-LLL82608750&grs&rdt .
lll Processor Motherboard Chipset Memory Disk Graphics Audio Network OS Kernel Desktop Display Server OpenGL Compiler File-System Screen Resolution a b c AMD Ryzen 7 PRO 6850U @ 4.77GHz (8 Cores / 16 Threads) LENOVO ThinkPad X13 Gen 3 21CM0001US (R22ET51W 1.21 BIOS) AMD 17h-19h PCIe Root Complex 4 x GB DRAM-6400MT/s Micron MT62F1G32D4DR-031 WT 512GB Micron MTFDKBA512TFK AMD Radeon 680M 1GB AMD Rembrandt Radeon HD Audio Qualcomm QCNFA765 Fedora Linux 39 6.5.7-300.fc39.x86_64 (x86_64) GNOME Shell 45.0 X Server 1.20.14 + Wayland 4.6 Mesa 23.2.1 (LLVM 16.0.6 DRM 3.54) GCC 13.2.1 20230918 btrfs 1920x1200 OpenBenchmarking.org Kernel Details - Transparent Huge Pages: madvise Compiler Details - --build=x86_64-redhat-linux --disable-libunwind-exceptions --enable-__cxa_atexit --enable-bootstrap --enable-cet --enable-checking=release --enable-gnu-indirect-function --enable-gnu-unique-object --enable-initfini-array --enable-languages=c,c++,fortran,objc,obj-c++,ada,go,d,m2,lto --enable-libstdcxx-backtrace --enable-link-serialization=1 --enable-multilib --enable-offload-defaulted --enable-offload-targets=nvptx-none --enable-plugin --enable-shared --enable-threads=posix --mandir=/usr/share/man --with-arch_32=i686 --with-build-config=bootstrap-lto --with-gcc-major-version-only --with-libstdcxx-zoneinfo=/usr/share/zoneinfo --with-linker-hash-style=gnu --with-tune=generic --without-cuda-driver Processor Details - Scaling Governor: amd-pstate-epp powersave (EPP: performance) - Platform Profile: balanced - CPU Microcode: 0xa404102 - ACPI Profile: balanced Security Details - SELinux + gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_rstack_overflow: Mitigation of safe RET no microcode + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional IBRS_FW STIBP: always-on RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected
lll llamafile: wizardcoder-python-34b-v1.0.Q6_K - CPU compress-lz4: 3 - Compression Speed cachebench: Read / Modify / Write cachebench: Write llamafile: mistral-7b-instruct-v0.2.Q8_0 - CPU compress-lz4: 1 - Compression Speed compress-lz4: 1 - Decompression Speed cachebench: Read llamafile: llava-v1.5-7b-q4 - CPU compress-lz4: 3 - Decompression Speed compress-lz4: 9 - Decompression Speed compress-lz4: 9 - Compression Speed a b c 0.07 129.84 128562.333526 68923.377755 4.43 802.53 4766.5 11810.812861 7.56 4467.4 4663.1 41.36 0.08 125.76 130802.304386 69964.920642 4.49 812.59 4823.2 11694.514515 7.61 4433.4 4691.4 41.45 0.08 126.2 130895.150868 68969.741641 4.47 806.11 4794.3 11829.604907 7.63 4449.6 4680.1 41.45 OpenBenchmarking.org
Llamafile Test: wizardcoder-python-34b-v1.0.Q6_K - Acceleration: CPU OpenBenchmarking.org Tokens Per Second, More Is Better Llamafile 0.6 Test: wizardcoder-python-34b-v1.0.Q6_K - Acceleration: CPU a b c 0.018 0.036 0.054 0.072 0.09 0.07 0.08 0.08
LZ4 Compression Compression Level: 3 - Compression Speed OpenBenchmarking.org MB/s, More Is Better LZ4 Compression 1.9.4 Compression Level: 3 - Compression Speed a b c 30 60 90 120 150 129.84 125.76 126.20 1. (CC) gcc options: -O3
CacheBench Test: Read / Modify / Write OpenBenchmarking.org MB/s, More Is Better CacheBench Test: Read / Modify / Write a b c 30K 60K 90K 120K 150K 128562.33 130802.30 130895.15 MIN: 107544.22 / MAX: 135609.38 MIN: 109519.91 / MAX: 137534.46 MIN: 109318.21 / MAX: 137824.92 1. (CC) gcc options: -O3 -lrt
CacheBench Test: Write OpenBenchmarking.org MB/s, More Is Better CacheBench Test: Write a b c 15K 30K 45K 60K 75K 68923.38 69964.92 68969.74 MIN: 68708.87 / MAX: 69180.98 MIN: 69500.48 / MAX: 70338.15 MIN: 68546.66 / MAX: 69404.67 1. (CC) gcc options: -O3 -lrt
Llamafile Test: mistral-7b-instruct-v0.2.Q8_0 - Acceleration: CPU OpenBenchmarking.org Tokens Per Second, More Is Better Llamafile 0.6 Test: mistral-7b-instruct-v0.2.Q8_0 - Acceleration: CPU a b c 1.0103 2.0206 3.0309 4.0412 5.0515 4.43 4.49 4.47
LZ4 Compression Compression Level: 1 - Compression Speed OpenBenchmarking.org MB/s, More Is Better LZ4 Compression 1.9.4 Compression Level: 1 - Compression Speed a b c 200 400 600 800 1000 802.53 812.59 806.11 1. (CC) gcc options: -O3
LZ4 Compression Compression Level: 1 - Decompression Speed OpenBenchmarking.org MB/s, More Is Better LZ4 Compression 1.9.4 Compression Level: 1 - Decompression Speed a b c 1000 2000 3000 4000 5000 4766.5 4823.2 4794.3 1. (CC) gcc options: -O3
CacheBench Test: Read OpenBenchmarking.org MB/s, More Is Better CacheBench Test: Read a b c 3K 6K 9K 12K 15K 11810.81 11694.51 11829.60 MIN: 11759.95 / MAX: 11830.29 MIN: 11680.09 / MAX: 11753.77 MIN: 11823.33 / MAX: 11833.15 1. (CC) gcc options: -O3 -lrt
Llamafile Test: llava-v1.5-7b-q4 - Acceleration: CPU OpenBenchmarking.org Tokens Per Second, More Is Better Llamafile 0.6 Test: llava-v1.5-7b-q4 - Acceleration: CPU a b c 2 4 6 8 10 7.56 7.61 7.63
LZ4 Compression Compression Level: 3 - Decompression Speed OpenBenchmarking.org MB/s, More Is Better LZ4 Compression 1.9.4 Compression Level: 3 - Decompression Speed a b c 1000 2000 3000 4000 5000 4467.4 4433.4 4449.6 1. (CC) gcc options: -O3
LZ4 Compression Compression Level: 9 - Decompression Speed OpenBenchmarking.org MB/s, More Is Better LZ4 Compression 1.9.4 Compression Level: 9 - Decompression Speed a b c 1000 2000 3000 4000 5000 4663.1 4691.4 4680.1 1. (CC) gcc options: -O3
LZ4 Compression Compression Level: 9 - Compression Speed OpenBenchmarking.org MB/s, More Is Better LZ4 Compression 1.9.4 Compression Level: 9 - Compression Speed a b c 9 18 27 36 45 41.36 41.45 41.45 1. (CC) gcc options: -O3
Phoronix Test Suite v10.8.5