AMD EPYC 7R13 48-Core testing with a Supermicro H12SSL-I v1.02 (2.7 BIOS) and NVIDIA GeForce RTX 4090 24GB on EndeavourOS rolling via the Phoronix Test Suite.
Compare your own system(s) to this result file with the
Phoronix Test Suite by running the command:
phoronix-test-suite benchmark 2402177-NE-HWMIG553791
hw-mig,
"Llama.cpp b1808 - Model: llama-2-7b.Q4_0.gguf",
Higher Results Are Better
"AMD EPYC 7R13 48-Core - NVIDIA GeForce RTX 4090 24GB",23.12,23.2,23.19
"Llama.cpp b1808 - Model: llama-2-13b.Q4_0.gguf",
Higher Results Are Better
"AMD EPYC 7R13 48-Core - NVIDIA GeForce RTX 4090 24GB",14.46,14.44,14.46
"Llama.cpp b1808 - Model: llama-2-70b-chat.Q5_0.gguf",
Higher Results Are Better
"AMD EPYC 7R13 48-Core - NVIDIA GeForce RTX 4090 24GB",2.87,2.84,2.87
"Llamafile 0.6 - Test: llava-v1.5-7b-q4 - Acceleration: CPU",
Higher Results Are Better
"AMD EPYC 7R13 48-Core - NVIDIA GeForce RTX 4090 24GB",22.2,22.37,22.32
"Llamafile 0.6 - Test: mistral-7b-instruct-v0.2.Q8_0 - Acceleration: CPU",
Higher Results Are Better
"AMD EPYC 7R13 48-Core - NVIDIA GeForce RTX 4090 24GB",13.3,13.31,13.4
"Llamafile 0.6 - Test: wizardcoder-python-34b-v1.0.Q6_K - Acceleration: CPU",
Higher Results Are Better
"AMD EPYC 7R13 48-Core - NVIDIA GeForce RTX 4090 24GB",4.72,4.72,4.75
"POV-Ray 3.7.0.7 - Trace Time",
Lower Results Are Better
"AMD EPYC 7R13 48-Core",10.573,10.638,10.637
"Redis 7.0.4 - Test: GET - Parallel Connections: 50",
Higher Results Are Better
"AMD EPYC 7R13 48-Core - NVIDIA GeForce RTX 4090 24GB",2831295,2775200.25,2769506.25
"Redis 7.0.4 - Test: GET - Parallel Connections: 1000",
Higher Results Are Better
"AMD EPYC 7R13 48-Core - NVIDIA GeForce RTX 4090 24GB",2616204.25,2601503.5,2201963.25,2623755,2167859.5,2576436.25,2462613,2582824.5,2605299,2330066.5,2564937.75,2580425,2529257.75,2596370.25,2550415.5
"Redis 7.0.4 - Test: SET - Parallel Connections: 1000",
Higher Results Are Better
"AMD EPYC 7R13 48-Core - NVIDIA GeForce RTX 4090 24GB",1858678,2115992.25,2104503.25,2010248,2085108.25,2087632.88,2075242.62,2063850.12,2115365.75,2054580.5,2084152.25,2014784.12
"Redis 7.0.4 - Test: LPOP - Parallel Connections: 1000",
Higher Results Are Better
"AMD EPYC 7R13 48-Core - NVIDIA GeForce RTX 4090 24GB",1701265.25,1717154.62,1580682,1737210.75,1709446,1687228.12,1632993.88,1676358.38,1681553.38,1689794.5,1676379.38,1665019.38
"Redis 7.0.4 - Test: SADD - Parallel Connections: 1000",
Higher Results Are Better
"AMD EPYC 7R13 48-Core - NVIDIA GeForce RTX 4090 24GB",2169707,2379846.75,2115095,2356310,2242393.75,1996434.25,2318290.75,2337036.5,2358978,2030782,2337145.75,2338129.25,2320227.25,2378390,2342401.25
"Redis 7.0.4 - Test: LPUSH - Parallel Connections: 1000",
Higher Results Are Better
"AMD EPYC 7R13 48-Core - NVIDIA GeForce RTX 4090 24GB",1817685.62,1574527,1635566.25,1803784.12,1787789.5,1804485.25,1799888.25,1806390.75,1731903.88,1727685.38,1718981.75,1559989.88,1806390.75,1817421.38,1780402.75