2024-04-13-0917

AMD Ryzen 7 7800X3D 8-Core testing with a Gigabyte B650M K (FC BIOS) and NVIDIA NV193 16GB on Fedora Linux 39 via the Phoronix Test Suite.

HTML result view exported from: https://openbenchmarking.org/result/2404130-NE-20240413067.

2024-04-13-0917ProcessorMotherboardChipsetMemoryDiskGraphicsAudioMonitorNetworkOSKernelDesktopDisplay ServerDisplay DriverOpenGLCompilerFile-SystemScreen Resolution2024-04-13 09:17AMD Ryzen 7 7800X3D 8-Core @ 5.05GHz (8 Cores / 16 Threads)Gigabyte B650M K (FC BIOS)AMD Device 14d832GB1024GB SAMSUNG MZVL21T0HCLR-00B00NVIDIA NV193 16GBNVIDIA Device 22bbLG ULTRAGEARRealtek RTL8125 2.5GbEFedora Linux 396.8.5-201.fc39.x86_64 (x86_64)GNOME Shell 45.5X Server + Waylandnouveau4.3 Mesa 23.3.6GCC 13.2.1 20240316btrfs2560x1440OpenBenchmarking.org- Transparent Huge Pages: madvise- Scaling Governor: amd-pstate-epp performance (EPP: performance) - CPU Microcode: 0xa601203 - SELinux + gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + reg_file_data_sampling: Not affected + retbleed: Not affected + spec_rstack_overflow: Vulnerable: Safe RET no microcode + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS; IBPB: conditional; STIBP: always-on; RSB filling; PBRSB-eIBRS: Not affected; BHI: Not affected + srbds: Not affected + tsx_async_abort: Not affected

2024-04-13-0917llamafile: llava-v1.5-7b-q4 - CPUllamafile: llava-v1.5-7b-q4 - GPU AUTOllamafile: mistral-7b-instruct-v0.2.Q8_0 - CPUllamafile: wizardcoder-python-34b-v1.0.Q6_K - CPUllamafile: mistral-7b-instruct-v0.2.Q8_0 - GPU AUTOllamafile: wizardcoder-python-34b-v1.0.Q6_K - GPU AUTO2024-04-13 09:1710.4010.396.371.786.271.77OpenBenchmarking.org

Llamafile

Test: llava-v1.5-7b-q4 - Acceleration: CPU

OpenBenchmarking.orgTokens Per Second, More Is BetterLlamafile 0.7Test: llava-v1.5-7b-q4 - Acceleration: CPU2024-04-13 09:173691215SE +/- 0.01, N = 310.40

Llamafile

Test: llava-v1.5-7b-q4 - Acceleration: GPU AUTO

OpenBenchmarking.orgTokens Per Second, More Is BetterLlamafile 0.7Test: llava-v1.5-7b-q4 - Acceleration: GPU AUTO2024-04-13 09:173691215SE +/- 0.01, N = 310.39

Llamafile

Test: mistral-7b-instruct-v0.2.Q8_0 - Acceleration: CPU

OpenBenchmarking.orgTokens Per Second, More Is BetterLlamafile 0.7Test: mistral-7b-instruct-v0.2.Q8_0 - Acceleration: CPU2024-04-13 09:17246810SE +/- 0.00, N = 36.37

Llamafile

Test: wizardcoder-python-34b-v1.0.Q6_K - Acceleration: CPU

OpenBenchmarking.orgTokens Per Second, More Is BetterLlamafile 0.7Test: wizardcoder-python-34b-v1.0.Q6_K - Acceleration: CPU2024-04-13 09:170.40050.8011.20151.6022.0025SE +/- 0.00, N = 31.78

Llamafile

Test: mistral-7b-instruct-v0.2.Q8_0 - Acceleration: GPU AUTO

OpenBenchmarking.orgTokens Per Second, More Is BetterLlamafile 0.7Test: mistral-7b-instruct-v0.2.Q8_0 - Acceleration: GPU AUTO2024-04-13 09:17246810SE +/- 0.06, N = 36.27

Llamafile

Test: wizardcoder-python-34b-v1.0.Q6_K - Acceleration: GPU AUTO

OpenBenchmarking.orgTokens Per Second, More Is BetterLlamafile 0.7Test: wizardcoder-python-34b-v1.0.Q6_K - Acceleration: GPU AUTO2024-04-13 09:170.39830.79661.19491.59321.9915SE +/- 0.00, N = 31.77

Phoronix Test Suite v10.8.4