2

AMD Ryzen 5 9600X 6-Core testing with a ASRock B650M PG Lightning (3.10 BIOS) and amdgpudrmfb on Ubuntu 22.04 via the Phoronix Test Suite.

HTML result view exported from: https://openbenchmarking.org/result/2412300-NE-25589455371.

2ProcessorMotherboardChipsetMemoryDiskGraphicsAudioMonitorNetworkOSKernelDesktopDisplay ServerFile-SystemScreen ResolutionAMD Ryzen 5 9600X 6-Core - amdgpudrmfb - ASRock B650MAMD Ryzen 5 9600X 6-Core @ 5.48GHz (6 Cores / 12 Threads)ASRock B650M PG Lightning (3.10 BIOS)AMD Device 14d82 x 16GB DRAM-6400MT/s IR-6400D564L32S1000GB Samsung SSD 990 PRO 1TB + 1000GB Western Digital WD10EZRX-00A + 1000GB Western Digital WD10EZRX-00LamdgpudrmfbAMD Device 1640S34CG50Realtek RTL8125 2.5GbEUbuntu 22.046.12.3-061203-generic (x86_64)GNOME Shell 42.9X Serverext43440x1440OpenBenchmarking.org- Transparent Huge Pages: madvise- Scaling Governor: amd-pstate-epp powersave (Boost: Enabled EPP: balance_performance) - CPU Microcode: 0xb404023- gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + reg_file_data_sampling: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS; IBPB: conditional; STIBP: always-on; RSB filling; PBRSB-eIBRS: Not affected; BHI: Not affected + srbds: Not affected + tsx_async_abort: Not affected

2llamafile: wizardcoder-python-34b-v1.0.Q6_K - Text Generation 16llamafile: wizardcoder-python-34b-v1.0.Q6_K - Text Generation 128llamafile: wizardcoder-python-34b-v1.0.Q6_K - Prompt Processing 256llamafile: wizardcoder-python-34b-v1.0.Q6_K - Prompt Processing 512llamafile: wizardcoder-python-34b-v1.0.Q6_K - Prompt Processing 1024llamafile: wizardcoder-python-34b-v1.0.Q6_K - Prompt Processing 2048AMD Ryzen 5 9600X 6-Core - amdgpudrmfb - ASRock B650M2.112.1215363072614412288OpenBenchmarking.org

Llamafile

Model: wizardcoder-python-34b-v1.0.Q6_K - Test: Text Generation 16

OpenBenchmarking.orgTokens Per Second, More Is BetterLlamafile 0.8.16Model: wizardcoder-python-34b-v1.0.Q6_K - Test: Text Generation 16AMD Ryzen 5 9600X 6-Core - amdgpudrmfb - ASRock B650M0.47480.94961.42441.89922.374SE +/- 0.02, N = 122.11

Llamafile

Model: wizardcoder-python-34b-v1.0.Q6_K - Test: Text Generation 128

OpenBenchmarking.orgTokens Per Second, More Is BetterLlamafile 0.8.16Model: wizardcoder-python-34b-v1.0.Q6_K - Test: Text Generation 128AMD Ryzen 5 9600X 6-Core - amdgpudrmfb - ASRock B650M0.4770.9541.4311.9082.385SE +/- 0.00, N = 32.12

Llamafile

Model: wizardcoder-python-34b-v1.0.Q6_K - Test: Prompt Processing 256

OpenBenchmarking.orgTokens Per Second, More Is BetterLlamafile 0.8.16Model: wizardcoder-python-34b-v1.0.Q6_K - Test: Prompt Processing 256AMD Ryzen 5 9600X 6-Core - amdgpudrmfb - ASRock B650M30060090012001500SE +/- 0.00, N = 31536

Llamafile

Model: wizardcoder-python-34b-v1.0.Q6_K - Test: Prompt Processing 512

OpenBenchmarking.orgTokens Per Second, More Is BetterLlamafile 0.8.16Model: wizardcoder-python-34b-v1.0.Q6_K - Test: Prompt Processing 512AMD Ryzen 5 9600X 6-Core - amdgpudrmfb - ASRock B650M7001400210028003500SE +/- 0.00, N = 33072

Llamafile

Model: wizardcoder-python-34b-v1.0.Q6_K - Test: Prompt Processing 1024

OpenBenchmarking.orgTokens Per Second, More Is BetterLlamafile 0.8.16Model: wizardcoder-python-34b-v1.0.Q6_K - Test: Prompt Processing 1024AMD Ryzen 5 9600X 6-Core - amdgpudrmfb - ASRock B650M13002600390052006500SE +/- 0.00, N = 36144

Llamafile

Model: wizardcoder-python-34b-v1.0.Q6_K - Test: Prompt Processing 2048

OpenBenchmarking.orgTokens Per Second, More Is BetterLlamafile 0.8.16Model: wizardcoder-python-34b-v1.0.Q6_K - Test: Prompt Processing 2048AMD Ryzen 5 9600X 6-Core - amdgpudrmfb - ASRock B650M3K6K9K12K15KSE +/- 0.00, N = 312288

Phoronix Test Suite v10.8.5