dkd

AMD Ryzen 7 7840U testing with a Framework Laptop 13 (AMD Ryzen 7040 ) FRANMDCP07 (03.03 BIOS) and GFX1103_R1 512MB on Ubuntu 22.04 via the Phoronix Test Suite.

Compare your own system(s) to this result file with the Phoronix Test Suite by running the command: phoronix-test-suite benchmark 2406037-NE-DKD00122471
Jump To Table - Results

View

Do Not Show Noisy Results
Do Not Show Results With Incomplete Data
Do Not Show Results With Little Change/Spread
List Notable Results

Limit displaying results to tests within:

AV1 2 Tests
C/C++ Compiler Tests 2 Tests
CPU Massive 4 Tests
Creator Workloads 2 Tests
Encoding 2 Tests
HPC - High Performance Computing 3 Tests
Large Language Models 2 Tests
Machine Learning 3 Tests
Multi-Core 3 Tests
Server CPU Tests 4 Tests
Video Encoding 2 Tests

Statistics

Show Overall Harmonic Mean(s)
Show Overall Geometric Mean
Show Geometric Means Per-Suite/Category
Show Wins / Losses Counts (Pie Chart)
Normalize Results
Remove Outliers Before Calculating Averages

Graph Settings

Force Line Graphs Where Applicable
Convert To Scalar Where Applicable
Prefer Vertical Bar Graphs

Multi-Way Comparison

Condense Multi-Option Tests Into Single Result Graphs

Table

Show Detailed System Result Table

Run Management

Highlight
Result
Hide
Result
Result
Identifier
Performance Per
Dollar
Date
Run
  Test
  Duration
a
June 03
  49 Minutes
b
June 03
  49 Minutes
c
June 03
  50 Minutes
Invert Hiding All Results Option
  49 Minutes

Only show results where is faster than
Only show results matching title/arguments (delimit multiple options with a comma):
Do not show results matching title/arguments (delimit multiple options with a comma):

a

Kernel Notes: Transparent Huge Pages: madvise
Compiler Notes: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-bootstrap --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-link-serialization=2 --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none=/build/gcc-11-XeT9lY/gcc-11-11.4.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-11-XeT9lY/gcc-11-11.4.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-build-config=bootstrap-lto-lean --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v
Processor Notes: Scaling Governor: amd-pstate-epp powersave (EPP: performance) - Platform Profile: balanced - CPU Microcode: 0xa704103 - ACPI Profile: balanced
Security Notes: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_rstack_overflow: Vulnerable: Safe RET no microcode + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS; IBPB: conditional; STIBP: always-on; RSB filling; PBRSB-eIBRS: Not affected; BHI: Not affected + srbds: Not affected + tsx_async_abort: Not affected

b

c

Processor: AMD Ryzen 7 7840U @ 5.13GHz (8 Cores / 16 Threads), Motherboard: Framework Laptop 13 (AMD Ryzen 7040 ) FRANMDCP07 (03.03 BIOS), Chipset: AMD Device 14e8, Memory: 2 x 8GB DRAM-5600MT/s A-DATA AD5S56008G-B, Disk: 512GB Western Digital WD PC SN740 SDDPNQD-512G, Graphics: GFX1103_R1 512MB (2700/2800MHz), Audio: AMD Device 1640, Network: MEDIATEK Device 0616

OS: Ubuntu 22.04, Kernel: 6.5.0-35-generic (x86_64), Desktop: GNOME Shell 42.9, Display Server: X Server + Wayland, OpenGL: 4.6 Mesa 23.2.1-1ubuntu3.1~22.04.2 (LLVM 15.0.7 DRM 3.54), Vulkan: 1.3.255, Compiler: GCC 11.4.0, File-System: ext4, Screen Resolution: 2256x1504

dkdOpenBenchmarking.orgPhoronix Test SuiteAMD Ryzen 7 7840U @ 5.13GHz (8 Cores / 16 Threads)Framework Laptop 13 (AMD Ryzen 7040 ) FRANMDCP07 (03.03 BIOS)AMD Device 14e82 x 8GB DRAM-5600MT/s A-DATA AD5S56008G-B512GB Western Digital WD PC SN740 SDDPNQD-512GGFX1103_R1 512MB (2700/2800MHz)AMD Device 1640MEDIATEK Device 0616Ubuntu 22.046.5.0-35-generic (x86_64)GNOME Shell 42.9X Server + Wayland4.6 Mesa 23.2.1-1ubuntu3.1~22.04.2 (LLVM 15.0.7 DRM 3.54)1.3.255GCC 11.4.0ext42256x1504ProcessorMotherboardChipsetMemoryDiskGraphicsAudioNetworkOSKernelDesktopDisplay ServerOpenGLVulkanCompilerFile-SystemScreen ResolutionDkd BenchmarksSystem Logs- Transparent Huge Pages: madvise- --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-bootstrap --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-link-serialization=2 --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none=/build/gcc-11-XeT9lY/gcc-11-11.4.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-11-XeT9lY/gcc-11-11.4.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-build-config=bootstrap-lto-lean --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v - Scaling Governor: amd-pstate-epp powersave (EPP: performance) - Platform Profile: balanced - CPU Microcode: 0xa704103 - ACPI Profile: balanced - gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_rstack_overflow: Vulnerable: Safe RET no microcode + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS; IBPB: conditional; STIBP: always-on; RSB filling; PBRSB-eIBRS: Not affected; BHI: Not affected + srbds: Not affected + tsx_async_abort: Not affected

abcResult OverviewPhoronix Test Suite100%101%102%103%104%LlamafileSVT-AV1perf-benchdav1dCpuminer-OptGlibc BenchmarksWhisper.cppLlama.cpp

dkdglibc-bench: cosglibc-bench: expglibc-bench: ffsglibc-bench: powglibc-bench: singlibc-bench: log2glibc-bench: modfglibc-bench: sinhglibc-bench: sqrtglibc-bench: tanhglibc-bench: asinhglibc-bench: atanhglibc-bench: ffsllglibc-bench: sincosglibc-bench: pthread_onceperf-bench: Epoll Waitperf-bench: Futex Hashperf-bench: Memcpy 1MBperf-bench: Memset 1MBperf-bench: Sched Pipeperf-bench: Futex Lock-Piperf-bench: Syscall Basicdav1d: Chimera 1080pdav1d: Summer Nature 4Kdav1d: Summer Nature 1080pdav1d: Chimera 1080p 10-bitsvt-av1: Preset 3 - Bosphorus 4Ksvt-av1: Preset 5 - Bosphorus 4Ksvt-av1: Preset 8 - Bosphorus 4Ksvt-av1: Preset 13 - Bosphorus 4Ksvt-av1: Preset 3 - Bosphorus 1080psvt-av1: Preset 5 - Bosphorus 1080psvt-av1: Preset 8 - Bosphorus 1080psvt-av1: Preset 13 - Bosphorus 1080pcpuminer-opt: Magicpuminer-opt: x20rcpuminer-opt: scryptcpuminer-opt: Deepcoincpuminer-opt: Ringcoincpuminer-opt: Blake-2 Scpuminer-opt: Garlicoincpuminer-opt: Skeincoincpuminer-opt: Myriad-Groestlcpuminer-opt: LBC, LBRY Creditscpuminer-opt: Quad SHA-256, Pyritecpuminer-opt: Triple SHA-256, Onecoinwhisper-cpp: ggml-base.en - 2016 State of the Unionwhisper-cpp: ggml-small.en - 2016 State of the Unionwhisper-cpp: ggml-medium.en - 2016 State of the Unionllama-cpp: Meta-Llama-3-8B-Instruct-Q8_0.ggufllamafile: TinyLlama-1.1B-Chat-v1.0.BF16 - CPUllamafile: mistral-7b-instruct-v0.2.Q5_K_M - CPUabc50.901511.03214.053425.683745.55457.599534.8031216.7085.8915219.471816.372320.36494.0937928.0964.06541133089342892953.936535118.8827682085899828179538731.04235.691042.07593.242.969.3826.58990.53311.91637.59799.031462.707265.23249117.883511.221473558901382.59176604649.356707.412601031360140.60941418.000751254.3387.125.3210.7751.171311.21334.1453926.086345.8187.703784.8491116.84145.9447919.564316.444720.44424.1028728.314.10783132922344699054.146143116.2092972080869828163471724.15234.681023.3589.142.949.29626.82493.69111.87437.81598.245459.689264.43174.84116.723522.221404.43558601375.79178004625.746703.162634029970142.68631419.391691257.497887.1227.3210.7750.567110.90744.0866725.685345.33747.624194.8100916.55445.9285419.54216.423520.43254.1125728.32494.10222133846341455153.782991115.9379212057349827828555730.82234.191041.98595.452.9539.31426.62483.43911.8737.89499.096459.714264.893167.28118.213527.521405.47558501379.71177304653.766715.542603031620141.09938419.710471257.674627.1126.6610.74OpenBenchmarking.org

Glibc Benchmarks

OpenBenchmarking.orgns, Fewer Is BetterGlibc Benchmarks 2.39Benchmark: coscba122436486050.5751.1750.901. (CC) gcc options: -pie -nostdlib -nostartfiles -lgcc -lgcc_s

OpenBenchmarking.orgns, Fewer Is BetterGlibc Benchmarks 2.39Benchmark: expcba369121510.9111.2111.031. (CC) gcc options: -pie -nostdlib -nostartfiles -lgcc -lgcc_s

OpenBenchmarking.orgns, Fewer Is BetterGlibc Benchmarks 2.39Benchmark: ffscba0.93271.86542.79813.73084.66354.086674.145394.053401. (CC) gcc options: -pie -nostdlib -nostartfiles -lgcc -lgcc_s

OpenBenchmarking.orgns, Fewer Is BetterGlibc Benchmarks 2.39Benchmark: powcba61218243025.6926.0925.681. (CC) gcc options: -pie -nostdlib -nostartfiles -lgcc -lgcc_s

OpenBenchmarking.orgns, Fewer Is BetterGlibc Benchmarks 2.39Benchmark: sincba102030405045.3445.8245.551. (CC) gcc options: -pie -nostdlib -nostartfiles -lgcc -lgcc_s

OpenBenchmarking.orgns, Fewer Is BetterGlibc Benchmarks 2.39Benchmark: log2cba2468107.624197.703787.599531. (CC) gcc options: -pie -nostdlib -nostartfiles -lgcc -lgcc_s

OpenBenchmarking.orgns, Fewer Is BetterGlibc Benchmarks 2.39Benchmark: modfcba1.0912.1823.2734.3645.4554.810094.849114.803121. (CC) gcc options: -pie -nostdlib -nostartfiles -lgcc -lgcc_s

OpenBenchmarking.orgns, Fewer Is BetterGlibc Benchmarks 2.39Benchmark: sinhcba4812162016.5516.8416.711. (CC) gcc options: -pie -nostdlib -nostartfiles -lgcc -lgcc_s

OpenBenchmarking.orgns, Fewer Is BetterGlibc Benchmarks 2.39Benchmark: sqrtcba1.33762.67524.01285.35046.6885.928545.944795.891521. (CC) gcc options: -pie -nostdlib -nostartfiles -lgcc -lgcc_s

OpenBenchmarking.orgns, Fewer Is BetterGlibc Benchmarks 2.39Benchmark: tanhcba51015202519.5419.5619.471. (CC) gcc options: -pie -nostdlib -nostartfiles -lgcc -lgcc_s

OpenBenchmarking.orgns, Fewer Is BetterGlibc Benchmarks 2.39Benchmark: asinhcba4812162016.4216.4416.371. (CC) gcc options: -pie -nostdlib -nostartfiles -lgcc -lgcc_s

OpenBenchmarking.orgns, Fewer Is BetterGlibc Benchmarks 2.39Benchmark: atanhcba51015202520.4320.4420.361. (CC) gcc options: -pie -nostdlib -nostartfiles -lgcc -lgcc_s

OpenBenchmarking.orgns, Fewer Is BetterGlibc Benchmarks 2.39Benchmark: ffsllcba0.92531.85062.77593.70124.62654.112574.102874.093791. (CC) gcc options: -pie -nostdlib -nostartfiles -lgcc -lgcc_s

OpenBenchmarking.orgns, Fewer Is BetterGlibc Benchmarks 2.39Benchmark: sincoscba71421283528.3228.3128.101. (CC) gcc options: -pie -nostdlib -nostartfiles -lgcc -lgcc_s

OpenBenchmarking.orgns, Fewer Is BetterGlibc Benchmarks 2.39Benchmark: pthread_oncecba0.92431.84862.77293.69724.62154.102224.107834.065411. (CC) gcc options: -pie -nostdlib -nostartfiles -lgcc -lgcc_s

perf-bench

OpenBenchmarking.orgops/sec, More Is Betterperf-bench 6.9Benchmark: Epoll Waitcba30K60K90K120K150K1338461329221330891. (CXX) g++ options: -MD -std=gnu++17 -fno-exceptions -fno-rtti

OpenBenchmarking.orgops/sec, More Is Betterperf-bench 6.9Benchmark: Futex Hashcba700K1400K2100K2800K3500K3414551344699034289291. (CXX) g++ options: -MD -std=gnu++17 -fno-exceptions -fno-rtti

OpenBenchmarking.orgGB/sec, More Is Betterperf-bench 6.9Benchmark: Memcpy 1MBcba122436486053.7854.1553.941. (CXX) g++ options: -MD -std=gnu++17 -fno-exceptions -fno-rtti

OpenBenchmarking.orgGB/sec, More Is Betterperf-bench 6.9Benchmark: Memset 1MBcba306090120150115.94116.21118.881. (CXX) g++ options: -MD -std=gnu++17 -fno-exceptions -fno-rtti

OpenBenchmarking.orgops/sec, More Is Betterperf-bench 6.9Benchmark: Sched Pipecba40K80K120K160K200K2057342080862085891. (CXX) g++ options: -MD -std=gnu++17 -fno-exceptions -fno-rtti

OpenBenchmarking.orgops/sec, More Is Betterperf-bench 6.9Benchmark: Futex Lock-Picba20040060080010009829829821. (CXX) g++ options: -MD -std=gnu++17 -fno-exceptions -fno-rtti

OpenBenchmarking.orgops/sec, More Is Betterperf-bench 6.9Benchmark: Syscall Basiccba2M4M6M8M10M7828555816347181795381. (CXX) g++ options: -MD -std=gnu++17 -fno-exceptions -fno-rtti

dav1d

OpenBenchmarking.orgFPS, More Is Betterdav1d 1.4.2Video Input: Chimera 1080pcba160320480640800730.82724.15731.041. (CC) gcc options: -pthread

OpenBenchmarking.orgFPS, More Is Betterdav1d 1.4.2Video Input: Summer Nature 4Kcba50100150200250234.19234.68235.691. (CC) gcc options: -pthread

OpenBenchmarking.orgFPS, More Is Betterdav1d 1.4.2Video Input: Summer Nature 1080pcba20040060080010001041.981023.301042.071. (CC) gcc options: -pthread

OpenBenchmarking.orgFPS, More Is Betterdav1d 1.4.2Video Input: Chimera 1080p 10-bitcba130260390520650595.45589.14593.241. (CC) gcc options: -pthread

SVT-AV1

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 2.1Encoder Mode: Preset 3 - Input: Bosphorus 4Kcba0.6661.3321.9982.6643.332.9532.9402.9601. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 2.1Encoder Mode: Preset 5 - Input: Bosphorus 4Kcba36912159.3149.2969.3801. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 2.1Encoder Mode: Preset 8 - Input: Bosphorus 4Kcba61218243026.6226.8226.591. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 2.1Encoder Mode: Preset 13 - Input: Bosphorus 4Kcba2040608010083.4493.6990.531. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 2.1Encoder Mode: Preset 3 - Input: Bosphorus 1080pcba369121511.8711.8711.921. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 2.1Encoder Mode: Preset 5 - Input: Bosphorus 1080pcba91827364537.8937.8237.601. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 2.1Encoder Mode: Preset 8 - Input: Bosphorus 1080pcba2040608010099.1098.2599.031. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 2.1Encoder Mode: Preset 13 - Input: Bosphorus 1080pcba100200300400500459.71459.69462.711. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

Cpuminer-Opt

OpenBenchmarking.orgkH/s, More Is BetterCpuminer-Opt 24.3Algorithm: Magicba60120180240300264.89264.40265.201. (CXX) g++ options: -O2 -lcurl -lz -lpthread -lgmp

OpenBenchmarking.orgkH/s, More Is BetterCpuminer-Opt 24.3Algorithm: x20rcba70014002100280035003167.283174.843249.001. (CXX) g++ options: -O2 -lcurl -lz -lpthread -lgmp

OpenBenchmarking.orgkH/s, More Is BetterCpuminer-Opt 24.3Algorithm: scryptcba306090120150118.21116.72117.881. (CXX) g++ options: -O2 -lcurl -lz -lpthread -lgmp

OpenBenchmarking.orgkH/s, More Is BetterCpuminer-Opt 24.3Algorithm: Deepcoincba80016002400320040003527.523522.223511.221. (CXX) g++ options: -O2 -lcurl -lz -lpthread -lgmp

OpenBenchmarking.orgkH/s, More Is BetterCpuminer-Opt 24.3Algorithm: Ringcoincba300600900120015001405.471404.431473.001. (CXX) g++ options: -O2 -lcurl -lz -lpthread -lgmp

OpenBenchmarking.orgkH/s, More Is BetterCpuminer-Opt 24.3Algorithm: Blake-2 Scba12K24K36K48K60K5585055860558901. (CXX) g++ options: -O2 -lcurl -lz -lpthread -lgmp

OpenBenchmarking.orgkH/s, More Is BetterCpuminer-Opt 24.3Algorithm: Garlicoincba300600900120015001379.711375.791382.591. (CXX) g++ options: -O2 -lcurl -lz -lpthread -lgmp

OpenBenchmarking.orgkH/s, More Is BetterCpuminer-Opt 24.3Algorithm: Skeincoincba4K8K12K16K20K1773017800176601. (CXX) g++ options: -O2 -lcurl -lz -lpthread -lgmp

OpenBenchmarking.orgkH/s, More Is BetterCpuminer-Opt 24.3Algorithm: Myriad-Groestlcba100020003000400050004653.764625.744649.351. (CXX) g++ options: -O2 -lcurl -lz -lpthread -lgmp

OpenBenchmarking.orgkH/s, More Is BetterCpuminer-Opt 24.3Algorithm: LBC, LBRY Creditscba140028004200560070006715.546703.166707.411. (CXX) g++ options: -O2 -lcurl -lz -lpthread -lgmp

OpenBenchmarking.orgkH/s, More Is BetterCpuminer-Opt 24.3Algorithm: Quad SHA-256, Pyritecba6K12K18K24K30K2603026340260101. (CXX) g++ options: -O2 -lcurl -lz -lpthread -lgmp

OpenBenchmarking.orgkH/s, More Is BetterCpuminer-Opt 24.3Algorithm: Triple SHA-256, Onecoincba7K14K21K28K35K3162029970313601. (CXX) g++ options: -O2 -lcurl -lz -lpthread -lgmp

Whisper.cpp

OpenBenchmarking.orgSeconds, Fewer Is BetterWhisper.cpp 1.6.2Model: ggml-base.en - Input: 2016 State of the Unioncba306090120150141.10142.69140.611. (CXX) g++ options: -O3 -std=c++11 -fPIC -pthread -msse3 -mssse3 -mavx -mf16c -mfma -mavx2 -mavx512f -mavx512cd -mavx512vl -mavx512dq -mavx512bw -mavx512vbmi -mavx512vnni

OpenBenchmarking.orgSeconds, Fewer Is BetterWhisper.cpp 1.6.2Model: ggml-small.en - Input: 2016 State of the Unioncba90180270360450419.71419.39418.001. (CXX) g++ options: -O3 -std=c++11 -fPIC -pthread -msse3 -mssse3 -mavx -mf16c -mfma -mavx2 -mavx512f -mavx512cd -mavx512vl -mavx512dq -mavx512bw -mavx512vbmi -mavx512vnni

OpenBenchmarking.orgSeconds, Fewer Is BetterWhisper.cpp 1.6.2Model: ggml-medium.en - Input: 2016 State of the Unioncba300600900120015001257.671257.501254.341. (CXX) g++ options: -O3 -std=c++11 -fPIC -pthread -msse3 -mssse3 -mavx -mf16c -mfma -mavx2 -mavx512f -mavx512cd -mavx512vl -mavx512dq -mavx512bw -mavx512vbmi -mavx512vnni

Llama.cpp

OpenBenchmarking.orgTokens Per Second, More Is BetterLlama.cpp b3067Model: Meta-Llama-3-8B-Instruct-Q8_0.ggufcba2468107.117.127.101. (CXX) g++ options: -std=c++11 -fPIC -O3 -pthread -march=native -mtune=native -lopenblas

Llamafile

OpenBenchmarking.orgTokens Per Second, More Is BetterLlamafile 0.8.6Test: TinyLlama-1.1B-Chat-v1.0.BF16 - Acceleration: CPUcba61218243026.6627.3225.32

OpenBenchmarking.orgTokens Per Second, More Is BetterLlamafile 0.8.6Test: mistral-7b-instruct-v0.2.Q5_K_M - Acceleration: CPUcba369121510.7410.7710.77

a

Kernel Notes: Transparent Huge Pages: madvise
Compiler Notes: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-bootstrap --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-link-serialization=2 --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none=/build/gcc-11-XeT9lY/gcc-11-11.4.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-11-XeT9lY/gcc-11-11.4.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-build-config=bootstrap-lto-lean --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v
Processor Notes: Scaling Governor: amd-pstate-epp powersave (EPP: performance) - Platform Profile: balanced - CPU Microcode: 0xa704103 - ACPI Profile: balanced
Security Notes: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_rstack_overflow: Vulnerable: Safe RET no microcode + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS; IBPB: conditional; STIBP: always-on; RSB filling; PBRSB-eIBRS: Not affected; BHI: Not affected + srbds: Not affected + tsx_async_abort: Not affected

Testing initiated at 3 June 2024 04:26 by user phoronix.

b

Kernel Notes: Transparent Huge Pages: madvise
Compiler Notes: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-bootstrap --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-link-serialization=2 --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none=/build/gcc-11-XeT9lY/gcc-11-11.4.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-11-XeT9lY/gcc-11-11.4.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-build-config=bootstrap-lto-lean --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v
Processor Notes: Scaling Governor: amd-pstate-epp powersave (EPP: performance) - Platform Profile: balanced - CPU Microcode: 0xa704103 - ACPI Profile: balanced
Security Notes: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_rstack_overflow: Vulnerable: Safe RET no microcode + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS; IBPB: conditional; STIBP: always-on; RSB filling; PBRSB-eIBRS: Not affected; BHI: Not affected + srbds: Not affected + tsx_async_abort: Not affected

Testing initiated at 3 June 2024 06:01 by user phoronix.

c

Processor: AMD Ryzen 7 7840U @ 5.13GHz (8 Cores / 16 Threads), Motherboard: Framework Laptop 13 (AMD Ryzen 7040 ) FRANMDCP07 (03.03 BIOS), Chipset: AMD Device 14e8, Memory: 2 x 8GB DRAM-5600MT/s A-DATA AD5S56008G-B, Disk: 512GB Western Digital WD PC SN740 SDDPNQD-512G, Graphics: GFX1103_R1 512MB (2700/2800MHz), Audio: AMD Device 1640, Network: MEDIATEK Device 0616

OS: Ubuntu 22.04, Kernel: 6.5.0-35-generic (x86_64), Desktop: GNOME Shell 42.9, Display Server: X Server + Wayland, OpenGL: 4.6 Mesa 23.2.1-1ubuntu3.1~22.04.2 (LLVM 15.0.7 DRM 3.54), Vulkan: 1.3.255, Compiler: GCC 11.4.0, File-System: ext4, Screen Resolution: 2256x1504

Kernel Notes: Transparent Huge Pages: madvise
Compiler Notes: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-bootstrap --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-link-serialization=2 --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none=/build/gcc-11-XeT9lY/gcc-11-11.4.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-11-XeT9lY/gcc-11-11.4.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-build-config=bootstrap-lto-lean --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v
Processor Notes: Scaling Governor: amd-pstate-epp powersave (EPP: performance) - Platform Profile: balanced - CPU Microcode: 0xa704103 - ACPI Profile: balanced
Security Notes: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_rstack_overflow: Vulnerable: Safe RET no microcode + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS; IBPB: conditional; STIBP: always-on; RSB filling; PBRSB-eIBRS: Not affected; BHI: Not affected + srbds: Not affected + tsx_async_abort: Not affected

Testing initiated at 3 June 2024 07:41 by user phoronix.