4

AMD EPYC 9754 128-Core testing with a Supermicro H13SSH v1.01 (1.6c BIOS) and ASPEED on Ubuntu 22.04 via the Phoronix Test Suite.

HTML result view exported from: https://openbenchmarking.org/result/2405208-NE-44943326171.

4ProcessorMotherboardChipsetMemoryDiskGraphicsNetworkOSKernelDesktopDisplay ServerCompilerFile-SystemScreen ResolutionAMD EPYC 9754 128-Core - ASPEED - Supermicro H13SSHAMD EPYC 9754 128-Core @ 2.25GHz (128 Cores / 256 Threads)Supermicro H13SSH v1.01 (1.6c BIOS)AMD Device 14a41520GB12 x 1920GB Micron_7450_MTFDKCB1T9TFRASPEED2 x Intel 10G X550TUbuntu 22.045.15.0-107-generic (x86_64)XfceX ServerGCC 11.4.0ext41024x768OpenBenchmarking.org- Transparent Huge Pages: madvise- Scaling Governor: acpi-cpufreq schedutil (Boost: Enabled) - CPU Microcode: 0xaa00116 - gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_rstack_overflow: Mitigation of safe RET + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines; IBPB: conditional; IBRS_FW; STIBP: always-on; RSB filling; PBRSB-eIBRS: Not affected; BHI: Not affected + srbds: Not affected + tsx_async_abort: Not affected

4llamafile: llava-v1.5-7b-q4 - CPUStandard ErrorStandard DeviationAMD EPYC 9754 128-Core - ASPEED - Supermicro H13SSH26.150.100.66%OpenBenchmarking.org

Llamafile

Test: llava-v1.5-7b-q4 - Acceleration: CPU

OpenBenchmarking.orgTokens Per Second, More Is BetterLlamafile 0.7Test: llava-v1.5-7b-q4 - Acceleration: CPUAMD EPYC 9754 128-Core - ASPEED - Supermicro H13SSH612182430SE +/- 0.10, N = 326.15

Phoronix Test Suite v10.8.4