1

AMD Ryzen 5 9600X 6-Core testing with a ASRock B650M PG Lightning (3.10 BIOS) and amdgpudrmfb on Ubuntu 22.04 via the Phoronix Test Suite.

HTML result view exported from: https://openbenchmarking.org/result/2412305-NE-17105455371.

1ProcessorMotherboardChipsetMemoryDiskGraphicsAudioMonitorNetworkOSKernelDesktopDisplay ServerFile-SystemScreen ResolutionAMD Ryzen 5 9600X 6-Core - amdgpudrmfb - ASRock B650MAMD Ryzen 5 9600X 6-Core @ 5.48GHz (6 Cores / 12 Threads)ASRock B650M PG Lightning (3.10 BIOS)AMD Device 14d82 x 16GB DRAM-6400MT/s IR-6400D564L32S1000GB Samsung SSD 990 PRO 1TB + 1000GB Western Digital WD10EZRX-00A + 1000GB Western Digital WD10EZRX-00LamdgpudrmfbAMD Device 1640S34CG50Realtek RTL8125 2.5GbEUbuntu 22.046.12.3-061203-generic (x86_64)GNOME Shell 42.9X Serverext43440x1440OpenBenchmarking.org- Transparent Huge Pages: madvise- Scaling Governor: amd-pstate-epp powersave (Boost: Enabled EPP: balance_performance) - CPU Microcode: 0xb404023- gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + reg_file_data_sampling: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS; IBPB: conditional; STIBP: always-on; RSB filling; PBRSB-eIBRS: Not affected; BHI: Not affected + srbds: Not affected + tsx_async_abort: Not affected

1llamafile: TinyLlama-1.1B-Chat-v1.0.BF16 - Text Generation 16llamafile: TinyLlama-1.1B-Chat-v1.0.BF16 - Text Generation 128llamafile: TinyLlama-1.1B-Chat-v1.0.BF16 - Prompt Processing 256llamafile: TinyLlama-1.1B-Chat-v1.0.BF16 - Prompt Processing 512llamafile: TinyLlama-1.1B-Chat-v1.0.BF16 - Prompt Processing 1024llamafile: TinyLlama-1.1B-Chat-v1.0.BF16 - Prompt Processing 2048AMD Ryzen 5 9600X 6-Core - amdgpudrmfb - ASRock B650M27.9027.88409681921638432768OpenBenchmarking.org

Llamafile

Model: TinyLlama-1.1B-Chat-v1.0.BF16 - Test: Text Generation 16

OpenBenchmarking.orgTokens Per Second, More Is BetterLlamafile 0.8.16Model: TinyLlama-1.1B-Chat-v1.0.BF16 - Test: Text Generation 16AMD Ryzen 5 9600X 6-Core - amdgpudrmfb - ASRock B650M714212835SE +/- 0.00, N = 327.90

Llamafile

Model: TinyLlama-1.1B-Chat-v1.0.BF16 - Test: Text Generation 128

OpenBenchmarking.orgTokens Per Second, More Is BetterLlamafile 0.8.16Model: TinyLlama-1.1B-Chat-v1.0.BF16 - Test: Text Generation 128AMD Ryzen 5 9600X 6-Core - amdgpudrmfb - ASRock B650M714212835SE +/- 0.00, N = 327.88

Llamafile

Model: TinyLlama-1.1B-Chat-v1.0.BF16 - Test: Prompt Processing 256

OpenBenchmarking.orgTokens Per Second, More Is BetterLlamafile 0.8.16Model: TinyLlama-1.1B-Chat-v1.0.BF16 - Test: Prompt Processing 256AMD Ryzen 5 9600X 6-Core - amdgpudrmfb - ASRock B650M9001800270036004500SE +/- 0.00, N = 34096

Llamafile

Model: TinyLlama-1.1B-Chat-v1.0.BF16 - Test: Prompt Processing 512

OpenBenchmarking.orgTokens Per Second, More Is BetterLlamafile 0.8.16Model: TinyLlama-1.1B-Chat-v1.0.BF16 - Test: Prompt Processing 512AMD Ryzen 5 9600X 6-Core - amdgpudrmfb - ASRock B650M2K4K6K8K10KSE +/- 0.00, N = 38192

Llamafile

Model: TinyLlama-1.1B-Chat-v1.0.BF16 - Test: Prompt Processing 1024

OpenBenchmarking.orgTokens Per Second, More Is BetterLlamafile 0.8.16Model: TinyLlama-1.1B-Chat-v1.0.BF16 - Test: Prompt Processing 1024AMD Ryzen 5 9600X 6-Core - amdgpudrmfb - ASRock B650M4K8K12K16K20KSE +/- 0.00, N = 316384

Llamafile

Model: TinyLlama-1.1B-Chat-v1.0.BF16 - Test: Prompt Processing 2048

OpenBenchmarking.orgTokens Per Second, More Is BetterLlamafile 0.8.16Model: TinyLlama-1.1B-Chat-v1.0.BF16 - Test: Prompt Processing 2048AMD Ryzen 5 9600X 6-Core - amdgpudrmfb - ASRock B650M7K14K21K28K35KSE +/- 0.00, N = 332768

Phoronix Test Suite v10.8.5