lll AMD Ryzen 5 5500U testing with a NB01 TUXEDO Aura 15 Gen2 NL5xNU (1.07.11RTR1 BIOS) and AMD Lucienne 512MB on Tuxedo 22.04 via the Phoronix Test Suite.
HTML result view exported from: https://openbenchmarking.org/result/2401211-NE-LLL04968850&sro&grs .
lll Processor Motherboard Chipset Memory Disk Graphics Audio Network OS Kernel Desktop Display Server OpenGL Vulkan Compiler File-System Screen Resolution aa b c AMD Ryzen 5 5500U @ 4.06GHz (6 Cores / 12 Threads) NB01 TUXEDO Aura 15 Gen2 NL5xNU (1.07.11RTR1 BIOS) AMD Renoir/Cezanne 2 x 8 GB DDR4-3200MT/s Samsung M471A1K43DB1-CWE Samsung SSD 970 EVO Plus 500GB AMD Lucienne 512MB (1800/400MHz) AMD Renoir Radeon HD Audio Realtek RTL8111/8168/8411 + Intel Wi-Fi 6 AX200 Tuxedo 22.04 6.0.0-1010-oem (x86_64) KDE Plasma 5.26.5 X Server 1.21.1.3 4.6 Mesa 22.3.7 (LLVM 14.0.0 DRM 3.48) 1.3.230 GCC 11.3.0 ext4 1920x1080 OpenBenchmarking.org Kernel Details - Transparent Huge Pages: madvise Compiler Details - --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-bootstrap --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-link-serialization=2 --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none=/build/gcc-11-xKiWfi/gcc-11-11.3.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-11-xKiWfi/gcc-11-11.3.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-build-config=bootstrap-lto-lean --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v Processor Details - Scaling Governor: amd-pstate ondemand (Boost: Enabled) - CPU Microcode: 0x8608103 Security Details - itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Mitigation of untrained return thunk; SMT enabled with STIBP protection + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional STIBP: always-on RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected
lll compress-lz4: 9 - Compression Speed llamafile: llava-v1.5-7b-q4 - CPU compress-lz4: 3 - Compression Speed compress-lz4: 1 - Decompression Speed cachebench: Read cachebench: Write compress-lz4: 1 - Compression Speed compress-lz4: 3 - Decompression Speed cachebench: Read / Modify / Write compress-lz4: 9 - Decompression Speed llamafile: wizardcoder-python-34b-v1.0.Q6_K - CPU llamafile: mistral-7b-instruct-v0.2.Q8_0 - CPU aa b c 35.49 8.12 100.30 4262.1 10214.351198 56702.977023 686.30 3966.8 110771.705631 4149.8 0.1 4.99 34.57 8.03 100.20 4283.5 10240.636520 56564.048866 687.92 3972.7 110987.518407 4151.6 0.1 4.99 34.86 8.12 99.73 4279.9 10228.694095 56704.938089 686.88 3963.4 110770.254745 4144.7 0.1 4.99 OpenBenchmarking.org
LZ4 Compression Compression Level: 9 - Compression Speed OpenBenchmarking.org MB/s, More Is Better LZ4 Compression 1.9.4 Compression Level: 9 - Compression Speed aa b c 8 16 24 32 40 SE +/- 0.23, N = 3 SE +/- 0.40, N = 4 SE +/- 0.03, N = 3 35.49 34.57 34.86 1. (CC) gcc options: -O3
Llamafile Test: llava-v1.5-7b-q4 - Acceleration: CPU OpenBenchmarking.org Tokens Per Second, More Is Better Llamafile 0.6 Test: llava-v1.5-7b-q4 - Acceleration: CPU aa b c 2 4 6 8 10 SE +/- 0.02, N = 3 SE +/- 0.08, N = 7 SE +/- 0.01, N = 3 8.12 8.03 8.12
LZ4 Compression Compression Level: 3 - Compression Speed OpenBenchmarking.org MB/s, More Is Better LZ4 Compression 1.9.4 Compression Level: 3 - Compression Speed aa b c 20 40 60 80 100 SE +/- 0.27, N = 3 SE +/- 0.14, N = 3 SE +/- 0.35, N = 3 100.30 100.20 99.73 1. (CC) gcc options: -O3
LZ4 Compression Compression Level: 1 - Decompression Speed OpenBenchmarking.org MB/s, More Is Better LZ4 Compression 1.9.4 Compression Level: 1 - Decompression Speed aa b c 900 1800 2700 3600 4500 SE +/- 5.31, N = 3 SE +/- 8.58, N = 3 SE +/- 5.54, N = 3 4262.1 4283.5 4279.9 1. (CC) gcc options: -O3
CacheBench Test: Read OpenBenchmarking.org MB/s, More Is Better CacheBench Test: Read aa b c 2K 4K 6K 8K 10K SE +/- 2.41, N = 3 SE +/- 16.92, N = 3 SE +/- 6.69, N = 3 10214.35 10240.64 10228.69 MIN: 10145.75 / MAX: 10261.15 MIN: 10161.16 / MAX: 10267.45 MIN: 10157.62 / MAX: 10265.94 1. (CC) gcc options: -O3 -lrt
CacheBench Test: Write OpenBenchmarking.org MB/s, More Is Better CacheBench Test: Write aa b c 12K 24K 36K 48K 60K SE +/- 69.56, N = 3 SE +/- 78.27, N = 3 SE +/- 136.34, N = 3 56702.98 56564.05 56704.94 MIN: 38385.34 / MAX: 61194.25 MIN: 37128.16 / MAX: 61155.4 MIN: 37221.06 / MAX: 60880.36 1. (CC) gcc options: -O3 -lrt
LZ4 Compression Compression Level: 1 - Compression Speed OpenBenchmarking.org MB/s, More Is Better LZ4 Compression 1.9.4 Compression Level: 1 - Compression Speed aa b c 150 300 450 600 750 SE +/- 0.60, N = 3 SE +/- 0.42, N = 3 SE +/- 1.86, N = 3 686.30 687.92 686.88 1. (CC) gcc options: -O3
LZ4 Compression Compression Level: 3 - Decompression Speed OpenBenchmarking.org MB/s, More Is Better LZ4 Compression 1.9.4 Compression Level: 3 - Decompression Speed aa b c 900 1800 2700 3600 4500 SE +/- 6.71, N = 3 SE +/- 7.37, N = 3 SE +/- 4.16, N = 3 3966.8 3972.7 3963.4 1. (CC) gcc options: -O3
CacheBench Test: Read / Modify / Write OpenBenchmarking.org MB/s, More Is Better CacheBench Test: Read / Modify / Write aa b c 20K 40K 60K 80K 100K SE +/- 204.04, N = 3 SE +/- 97.90, N = 3 SE +/- 134.60, N = 3 110771.71 110987.52 110770.25 MIN: 91749.45 / MAX: 121154.46 MIN: 91892.63 / MAX: 121630.79 MIN: 91623.8 / MAX: 121035.06 1. (CC) gcc options: -O3 -lrt
LZ4 Compression Compression Level: 9 - Decompression Speed OpenBenchmarking.org MB/s, More Is Better LZ4 Compression 1.9.4 Compression Level: 9 - Decompression Speed aa b c 900 1800 2700 3600 4500 SE +/- 11.05, N = 3 SE +/- 5.19, N = 4 SE +/- 8.82, N = 3 4149.8 4151.6 4144.7 1. (CC) gcc options: -O3
Llamafile Test: wizardcoder-python-34b-v1.0.Q6_K - Acceleration: CPU OpenBenchmarking.org Tokens Per Second, More Is Better Llamafile 0.6 Test: wizardcoder-python-34b-v1.0.Q6_K - Acceleration: CPU aa b c 0.0225 0.045 0.0675 0.09 0.1125 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 0.1 0.1 0.1
Llamafile Test: mistral-7b-instruct-v0.2.Q8_0 - Acceleration: CPU OpenBenchmarking.org Tokens Per Second, More Is Better Llamafile 0.6 Test: mistral-7b-instruct-v0.2.Q8_0 - Acceleration: CPU aa b c 1.1228 2.2456 3.3684 4.4912 5.614 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 4.99 4.99 4.99
Phoronix Test Suite v10.8.5