Linux 6.13 AMD EPYC Performance

Benchmarks for a future article. AMD EPYC 9575F 64-Core testing with a Supermicro Super Server H13SSL-N v1.01 (3.0 BIOS) and ASPEED on Ubuntu 24.10 via the Phoronix Test Suite.

Compare your own system(s) to this result file with the Phoronix Test Suite by running the command: phoronix-test-suite benchmark 2412073-NE-LINUX613A93
Jump To Table - Results

View

Do Not Show Noisy Results
Do Not Show Results With Incomplete Data
Do Not Show Results With Little Change/Spread
List Notable Results
Show Result Confidence Charts
Allow Limiting Results To Certain Suite(s)

Statistics

Show Overall Harmonic Mean(s)
Show Overall Geometric Mean
Show Wins / Losses Counts (Pie Chart)
Normalize Results
Remove Outliers Before Calculating Averages

Graph Settings

Force Line Graphs Where Applicable
Convert To Scalar Where Applicable
Prefer Vertical Bar Graphs

Multi-Way Comparison

Condense Multi-Option Tests Into Single Result Graphs

Table

Show Detailed System Result Table

Run Management

Highlight
Result
Toggle/Hide
Result
Result
Identifier
Performance Per
Dollar
Date
Run
  Test
  Duration
v6.11
December 07
  7 Hours, 42 Minutes
v6.12
December 06
  7 Hours, 21 Minutes
v6.13 7 Dec
December 07
  7 Hours, 41 Minutes
Invert Behavior (Only Show Selected Data)
  7 Hours, 35 Minutes

Only show results where is faster than
Only show results matching title/arguments (delimit multiple options with a comma):
Do not show results matching title/arguments (delimit multiple options with a comma):


Linux 6.13 AMD EPYC PerformanceProcessorMotherboardChipsetMemoryDiskGraphicsNetworkOSKernelDesktopDisplay ServerCompilerFile-SystemScreen Resolutionv6.11v6.12v6.13 7 DecAMD EPYC 9575F 64-Core @ 3.30GHz (64 Cores / 128 Threads)Supermicro Super Server H13SSL-N v1.01 (3.0 BIOS)AMD 1Ah12 x 64GB DDR5-6000MT/s Micron MTC40F2046S1RC64BDY QSFF3201GB Micron_7450_MTFDKCB3T2TFSASPEED2 x Broadcom NetXtreme BCM5720 PCIeUbuntu 24.106.11.0-phx (x86_64)GNOME Shell 47.0X ServerGCC 14.2.0ext41920x12006.12.0-phx (x86_64)1024x7686.13.0-rc1-phx (x86_64)OpenBenchmarking.orgKernel Details- Transparent Huge Pages: madviseCompiler Details- --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-bootstrap --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2,rust --enable-libphobos-checking=release --enable-libstdcxx-backtrace --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-link-serialization=2 --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-defaulted --enable-offload-targets=nvptx-none=/build/gcc-14-zdkDXv/gcc-14-14.2.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-14-zdkDXv/gcc-14-14.2.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-build-config=bootstrap-lto-lean --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v Processor Details- Scaling Governor: acpi-cpufreq performance (Boost: Enabled) - CPU Microcode: 0xb002116Java Details- OpenJDK Runtime Environment (build 21.0.5+11-Ubuntu-1ubuntu124.10)Python Details- Python 3.12.7Security Details- gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + reg_file_data_sampling: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS; IBPB: conditional; STIBP: always-on; RSB filling; PBRSB-eIBRS: Not affected; BHI: Not affected + srbds: Not affected + tsx_async_abort: Not affected

v6.11v6.12v6.13 7 DecResult OverviewPhoronix Test Suite100%110%121%131%141%PalabosStress-NGMariaDBApache CouchDBRELIONPostgreSQLMemcachedApache CassandraSVT-AV1LaghosBlenderLlamafileClickHousePrimesieveOpenSSLOpenVINO GenAITimed LLVM CompilationTimed Linux Kernel CompilationDaCapo Benchmark

Linux 6.13 AMD EPYC Performancestress-ng: Context Switchingmariadb: oltp_update_index - 128dacapobench: Spring Bootdacapobench: Apache Lucene Search Enginestress-ng: NUMAdacapobench: Zxing 1D/2D Barcode Image Processingstress-ng: Semaphorespgbench: 100 - 1000 - Read Write - Average Latencypgbench: 100 - 1000 - Read Writemariadb: oltp_write_only - 128memcached: 1:100stress-ng: Futexstress-ng: MEMFDpgbench: 100 - 800 - Read Write - Average Latencystress-ng: Mutexpgbench: 100 - 800 - Read Writedacapobench: H2 Database Enginellamafile: mistral-7b-instruct-v0.2.Q5_K_M - Text Generation 128couchdb: 300 - 1000 - 30stress-ng: Mixed Schedulerdacapobench: Avrora AVR Simulation Frameworksvt-av1: Preset 13 - Bosphorus 4Kpgbench: 100 - 1000 - Read Only - Average Latencyllamafile: Llama-3.2-3B-Instruct.Q6_K - Text Generation 128pgbench: 100 - 1000 - Read Onlymariadb: oltp_read_write - 128llamafile: TinyLlama-1.1B-Chat-v1.0.BF16 - Text Generation 128mariadb: oltp_read_only - 128laghos: Triple Point Problemmemcached: 1:10dacapobench: Apache Tomcatdacapobench: Batik SVG Toolkitdacapobench: Apache Lucene Search Indexcassandra: Writesblender: Fishy Cat - CPU-Onlyclickhouse: 100M Rows Hits Dataset, First Run / Cold Cachedacapobench: Tradesoapblender: Classroom - CPU-Onlydacapobench: BioJava Biological Data Frameworkmemcached: 1:5pgbench: 100 - 800 - Read Only - Average Latencydacapobench: FOP Print Formatterblender: BMW27 - CPU-Onlydacapobench: Eclipsesvt-av1: Preset 5 - Bosphorus 4Kblender: Pabellon Barcelona - CPU-Onlyclickhouse: 100M Rows Hits Dataset, Second Runpgbench: 100 - 800 - Read Onlyopenvino-genai: Falcon-7b-instruct-int4-ov - CPUdacapobench: GraphChiclickhouse: 100M Rows Hits Dataset, Third Runopenssl: ChaCha20openvino-genai: TinyLlama-1.1B-Chat-v1.0 - CPUopenvino-genai: Gemma-7b-int4-ov - CPUllamafile: wizardcoder-python-34b-v1.0.Q6_K - Text Generation 128svt-av1: Preset 8 - Bosphorus 4Kblender: Barbershop - CPU-Onlysvt-av1: Preset 3 - Bosphorus 4Kbuild-linux-kernel: allmodconfigdacapobench: Jythonlaghos: Sedov Blast Wave, ube_922_hex.meshstress-ng: Socket Activityprimesieve: 1e12openssl: ChaCha20-Poly1305dacapobench: Apache Kafkabuild-llvm: Unix Makefilesopenssl: AES-128-GCMopenssl: AES-256-GCMprimesieve: 1e13build-linux-kernel: defconfigdacapobench: Apache Xalan XSLTbuild-llvm: Ninjablender: Junkshop - CPU-Onlyopenvino-genai: Phi-3-mini-128k-instruct-int4-ov - CPUdacapobench: jMonkeyEnginellamafile: wizardcoder-python-34b-v1.0.Q6_K - Prompt Processing 2048llamafile: wizardcoder-python-34b-v1.0.Q6_K - Prompt Processing 1024llamafile: wizardcoder-python-34b-v1.0.Q6_K - Prompt Processing 512llamafile: wizardcoder-python-34b-v1.0.Q6_K - Prompt Processing 256llamafile: mistral-7b-instruct-v0.2.Q5_K_M - Prompt Processing 2048llamafile: mistral-7b-instruct-v0.2.Q5_K_M - Prompt Processing 1024llamafile: mistral-7b-instruct-v0.2.Q5_K_M - Prompt Processing 512llamafile: mistral-7b-instruct-v0.2.Q5_K_M - Prompt Processing 256llamafile: TinyLlama-1.1B-Chat-v1.0.BF16 - Prompt Processing 2048llamafile: TinyLlama-1.1B-Chat-v1.0.BF16 - Prompt Processing 1024llamafile: TinyLlama-1.1B-Chat-v1.0.BF16 - Prompt Processing 512llamafile: TinyLlama-1.1B-Chat-v1.0.BF16 - Prompt Processing 256llamafile: Llama-3.2-3B-Instruct.Q6_K - Prompt Processing 2048llamafile: Llama-3.2-3B-Instruct.Q6_K - Prompt Processing 1024llamafile: Llama-3.2-3B-Instruct.Q6_K - Prompt Processing 512llamafile: Llama-3.2-3B-Instruct.Q6_K - Prompt Processing 256openvino-genai: Phi-3-mini-128k-instruct-int4-ov - CPU - Time Per Output Tokenopenvino-genai: Phi-3-mini-128k-instruct-int4-ov - CPU - Time To First Tokenopenvino-genai: Falcon-7b-instruct-int4-ov - CPU - Time Per Output Tokenopenvino-genai: Falcon-7b-instruct-int4-ov - CPU - Time To First Tokenopenvino-genai: TinyLlama-1.1B-Chat-v1.0 - CPU - Time Per Output Tokenopenvino-genai: TinyLlama-1.1B-Chat-v1.0 - CPU - Time To First Tokenopenvino-genai: Gemma-7b-int4-ov - CPU - Time Per Output Tokenopenvino-genai: Gemma-7b-int4-ov - CPU - Time To First Tokenllamafile: wizardcoder-python-34b-v1.0.Q6_K - Text Generation 16llamafile: mistral-7b-instruct-v0.2.Q5_K_M - Text Generation 16llamafile: TinyLlama-1.1B-Chat-v1.0.BF16 - Text Generation 16llamafile: Llama-3.2-3B-Instruct.Q6_K - Text Generation 16dacapobench: PMD Source Code Analyzercouchdb: 500 - 1000 - 30couchdb: 300 - 3000 - 30dacapobench: Tradebeansrelion: Basic - CPUpalabos: 1000palabos: 500v6.11v6.12v6.13 7 Dec36748330.54192098272441202071.98522233159294.148.49811767741296712696519.854154651.852054.706.30545376718.94126877210468.13103.22879773.372354466.6140.217112.564621379183693159.9043688297.997421710.241053923229448395221.66770.47307742.0340584115352.490.16733915.19634960.17147.90804.06478364856.732093801.1971810687659078.3649.1315.90199.209149.3016.880194.3383782561.9147424.871.9994878349854505070159.81935993130371033316299589725.03621.792743101.82120.2465.8967911228861443072153632768163848192409632768163848192409632768163848192409615.1822.6617.6330.3912.7615.8620.3630.3914.9864.87152.07108.221085354.526363.5274999176.673481.489529.23255755486.32183537225943262298.65551251549880.018.92711202539941713294800.594313954.942010.996.55045398166.14122181204967.71104.16382674.982303468.6660.211111.984732753181192159.6043581303.117297642.211038937225849118621.49765.59303541.7440714064048.140.16633515.08628060.38147.70801.90481562556.212083799.9972161667691078.1849.0915.82200.316148.8216.990193.2023755565.1047501.041.9904905110852035045160.30236156405387033448669611724.97221.848741101.59920.2165.8267971228861443072153632768163848192409632768163848192409632768163848192409615.1922.7317.8030.0012.7915.8920.3730.2715.0164.80152.89107.951167333.178371.2884968179.868655.184775.11053038526.00158304265136312385.59493246944948.469.08211011238698313514659.674398887.772125.136.62843186401.84120703201065.45100.14081582.582283480.9120.211109.604735578179909156.8242936300.727400996.981055938227848774321.35774.01304941.4940194099640.310.16533815.02633160.82147.39803.49482925556.282102807.2771998076318077.6748.7015.77200.823148.1617.008192.9233763565.1447238.701.9884894861022535057160.55936132488888033442815745024.93921.855742101.72520.2065.9167931228861443072153632768163848192409632768163848192409632768163848192409615.1722.3817.7730.1812.8816.0520.5430.4814.9064.15147.98102.211089311.038360.8264957172.482509.126764.024OpenBenchmarking.org

Stress-NG

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.17.08Test: Context Switchingv6.13 7 Decv6.12v6.1112M24M36M48M60MSE +/- 159927.59, N = 3SE +/- 64836.17, N = 3SE +/- 247154.69, N = 1353038526.0055755486.3236748330.541. (CXX) g++ options: -O2 -std=gnu99 -lc -lm

MariaDB

This is a MariaDB MySQL database server benchmark making use of sysbench rather than the existing pts/mysqlslap test profile that uses MariaDB with mysqlslap/mariadb-slap as the benchmark driver. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgQueries Per Second, More Is BetterMariaDB 11.5Test: oltp_update_index - Threads: 128v6.13 7 Decv6.12v6.1140K80K120K160K200KSE +/- 112.30, N = 3SE +/- 76.99, N = 3SE +/- 123.94, N = 31583041835371920981. (CXX) g++ options: -pie -fPIC -fstack-protector -O3 -lnuma -lpcre2-8 -lcrypt -laio -lz -lm -lssl -lcrypto -lpthread -ldl

DaCapo Benchmark

This test runs the DaCapo Benchmarks written in Java and intended to test system/CPU performance of various popular real-world Java workloads. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgmsec, Fewer Is BetterDaCapo Benchmark 23.11Java Test: Spring Bootv6.13 7 Decv6.12v6.116001200180024003000SE +/- 26.77, N = 3SE +/- 20.60, N = 3SE +/- 17.89, N = 3265122592724

OpenBenchmarking.orgmsec, Fewer Is BetterDaCapo Benchmark 23.11Java Test: Apache Lucene Search Enginev6.13 7 Decv6.12v6.119001800270036004500SE +/- 42.57, N = 3SE +/- 47.07, N = 3SE +/- 43.31, N = 15363143264120

Stress-NG

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.17.08Test: NUMAv6.13 7 Decv6.12v6.115001000150020002500SE +/- 10.25, N = 3SE +/- 1.02, N = 3SE +/- 6.78, N = 32385.592298.652071.981. (CXX) g++ options: -O2 -std=gnu99 -lc -lm

DaCapo Benchmark

This test runs the DaCapo Benchmarks written in Java and intended to test system/CPU performance of various popular real-world Java workloads. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgmsec, Fewer Is BetterDaCapo Benchmark 23.11Java Test: Zxing 1D/2D Barcode Image Processingv6.13 7 Decv6.12v6.11120240360480600SE +/- 5.55, N = 3SE +/- 4.38, N = 9SE +/- 4.26, N = 3493551522

Stress-NG

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.17.08Test: Semaphoresv6.13 7 Decv6.12v6.1150M100M150M200M250MSE +/- 1084579.30, N = 3SE +/- 3074547.79, N = 3SE +/- 2150155.18, N = 15246944948.46251549880.01233159294.141. (CXX) g++ options: -O2 -std=gnu99 -lc -lm

PostgreSQL

OpenBenchmarking.orgms, Fewer Is BetterPostgreSQL 17Scaling Factor: 100 - Clients: 1000 - Mode: Read Write - Average Latencyv6.13 7 Decv6.12v6.113691215SE +/- 0.042, N = 3SE +/- 0.048, N = 3SE +/- 0.020, N = 39.0828.9278.4981. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpq -lpgcommon -lpgport -lm

OpenBenchmarking.orgTPS, More Is BetterPostgreSQL 17Scaling Factor: 100 - Clients: 1000 - Mode: Read Writev6.13 7 Decv6.12v6.1130K60K90K120K150KSE +/- 515.38, N = 3SE +/- 604.26, N = 3SE +/- 274.82, N = 31101121120251176771. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpq -lpgcommon -lpgport -lm

MariaDB

This is a MariaDB MySQL database server benchmark making use of sysbench rather than the existing pts/mysqlslap test profile that uses MariaDB with mysqlslap/mariadb-slap as the benchmark driver. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgQueries Per Second, More Is BetterMariaDB 11.5Test: oltp_write_only - Threads: 128v6.13 7 Decv6.12v6.1190K180K270K360K450KSE +/- 154.44, N = 3SE +/- 474.96, N = 3SE +/- 286.92, N = 33869833994174129671. (CXX) g++ options: -pie -fPIC -fstack-protector -O3 -lnuma -lpcre2-8 -lcrypt -laio -lz -lm -lssl -lcrypto -lpthread -ldl

Memcached

Memcached is a high performance, distributed memory object caching system. This Memcached test profiles makes use of memtier_benchmark for excuting this CPU/memory-focused server benchmark. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgOps/sec, More Is BetterMemcached 1.6.19Set To Get Ratio: 1:100v6.13 7 Decv6.12v6.113M6M9M12M15MSE +/- 24482.38, N = 3SE +/- 15384.68, N = 3SE +/- 13756.93, N = 313514659.6713294800.5912696519.851. (CXX) g++ options: -O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre

Stress-NG

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.17.08Test: Futexv6.13 7 Decv6.12v6.11900K1800K2700K3600K4500KSE +/- 31680.82, N = 3SE +/- 15124.18, N = 3SE +/- 17548.84, N = 34398887.774313954.944154651.851. (CXX) g++ options: -O2 -std=gnu99 -lc -lm

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.17.08Test: MEMFDv6.13 7 Decv6.12v6.115001000150020002500SE +/- 3.27, N = 3SE +/- 2.72, N = 3SE +/- 4.79, N = 32125.132010.992054.701. (CXX) g++ options: -O2 -std=gnu99 -lc -lm

PostgreSQL

OpenBenchmarking.orgms, Fewer Is BetterPostgreSQL 17Scaling Factor: 100 - Clients: 800 - Mode: Read Write - Average Latencyv6.13 7 Decv6.12v6.11246810SE +/- 0.030, N = 3SE +/- 0.082, N = 3SE +/- 0.030, N = 36.6286.5506.3051. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpq -lpgcommon -lpgport -lm

Stress-NG

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.17.08Test: Mutexv6.13 7 Decv6.12v6.1110M20M30M40M50MSE +/- 188378.96, N = 3SE +/- 442253.04, N = 3SE +/- 181454.22, N = 343186401.8445398166.1445376718.941. (CXX) g++ options: -O2 -std=gnu99 -lc -lm

PostgreSQL

OpenBenchmarking.orgTPS, More Is BetterPostgreSQL 17Scaling Factor: 100 - Clients: 800 - Mode: Read Writev6.13 7 Decv6.12v6.1130K60K90K120K150KSE +/- 536.64, N = 3SE +/- 1549.82, N = 3SE +/- 594.42, N = 31207031221811268771. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpq -lpgcommon -lpgport -lm

DaCapo Benchmark

This test runs the DaCapo Benchmarks written in Java and intended to test system/CPU performance of various popular real-world Java workloads. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgmsec, Fewer Is BetterDaCapo Benchmark 23.11Java Test: H2 Database Enginev6.13 7 Decv6.12v6.115001000150020002500SE +/- 18.21, N = 3SE +/- 13.65, N = 3SE +/- 28.09, N = 3201020492104

Llamafile

OpenBenchmarking.orgTokens Per Second, More Is BetterLlamafile 0.8.16Model: mistral-7b-instruct-v0.2.Q5_K_M - Test: Text Generation 128v6.13 7 Decv6.12v6.111530456075SE +/- 0.36, N = 3SE +/- 0.47, N = 3SE +/- 0.37, N = 365.4567.7168.13

Apache CouchDB

OpenBenchmarking.orgSeconds, Fewer Is BetterApache CouchDB 3.4.1Bulk Size: 300 - Inserts: 1000 - Rounds: 30v6.13 7 Decv6.12v6.1120406080100SE +/- 0.87, N = 7SE +/- 0.71, N = 3SE +/- 1.11, N = 3100.14104.16103.231. (CXX) g++ options: -flto -lstdc++ -shared -lei

Stress-NG

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.17.08Test: Mixed Schedulerv6.13 7 Decv6.12v6.1120K40K60K80K100KSE +/- 282.83, N = 3SE +/- 215.02, N = 3SE +/- 161.54, N = 381582.5882674.9879773.371. (CXX) g++ options: -O2 -std=gnu99 -lc -lm

DaCapo Benchmark

This test runs the DaCapo Benchmarks written in Java and intended to test system/CPU performance of various popular real-world Java workloads. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgmsec, Fewer Is BetterDaCapo Benchmark 23.11Java Test: Avrora AVR Simulation Frameworkv6.13 7 Decv6.12v6.115001000150020002500SE +/- 20.72, N = 15SE +/- 15.56, N = 13SE +/- 16.90, N = 3228323032354

SVT-AV1

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 2.3Encoder Mode: Preset 13 - Input: Bosphorus 4Kv6.13 7 Decv6.12v6.11100200300400500SE +/- 0.44, N = 3SE +/- 1.95, N = 3SE +/- 3.40, N = 3480.91468.67466.611. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

PostgreSQL

OpenBenchmarking.orgms, Fewer Is BetterPostgreSQL 17Scaling Factor: 100 - Clients: 1000 - Mode: Read Only - Average Latencyv6.13 7 Decv6.12v6.110.04880.09760.14640.19520.244SE +/- 0.001, N = 3SE +/- 0.001, N = 3SE +/- 0.001, N = 30.2110.2110.2171. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpq -lpgcommon -lpgport -lm

Llamafile

OpenBenchmarking.orgTokens Per Second, More Is BetterLlamafile 0.8.16Model: Llama-3.2-3B-Instruct.Q6_K - Test: Text Generation 128v6.13 7 Decv6.12v6.11306090120150SE +/- 1.53, N = 3SE +/- 1.04, N = 3SE +/- 0.87, N = 3109.60111.98112.56

PostgreSQL

OpenBenchmarking.orgTPS, More Is BetterPostgreSQL 17Scaling Factor: 100 - Clients: 1000 - Mode: Read Onlyv6.13 7 Decv6.12v6.111000K2000K3000K4000K5000KSE +/- 9098.55, N = 3SE +/- 18553.35, N = 3SE +/- 23812.59, N = 34735578473275346213791. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpq -lpgcommon -lpgport -lm

MariaDB

This is a MariaDB MySQL database server benchmark making use of sysbench rather than the existing pts/mysqlslap test profile that uses MariaDB with mysqlslap/mariadb-slap as the benchmark driver. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgQueries Per Second, More Is BetterMariaDB 11.5Test: oltp_read_write - Threads: 128v6.13 7 Decv6.12v6.1140K80K120K160K200KSE +/- 77.99, N = 3SE +/- 60.34, N = 3SE +/- 155.52, N = 31799091811921836931. (CXX) g++ options: -pie -fPIC -fstack-protector -O3 -lnuma -lpcre2-8 -lcrypt -laio -lz -lm -lssl -lcrypto -lpthread -ldl

Llamafile

OpenBenchmarking.orgTokens Per Second, More Is BetterLlamafile 0.8.16Model: TinyLlama-1.1B-Chat-v1.0.BF16 - Test: Text Generation 128v6.13 7 Decv6.12v6.114080120160200SE +/- 1.45, N = 15SE +/- 1.26, N = 3SE +/- 1.11, N = 3156.82159.60159.90

MariaDB

This is a MariaDB MySQL database server benchmark making use of sysbench rather than the existing pts/mysqlslap test profile that uses MariaDB with mysqlslap/mariadb-slap as the benchmark driver. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgQueries Per Second, More Is BetterMariaDB 11.5Test: oltp_read_only - Threads: 128v6.13 7 Decv6.12v6.119K18K27K36K45KSE +/- 18.45, N = 3SE +/- 15.19, N = 3SE +/- 14.78, N = 34293643581436881. (CXX) g++ options: -pie -fPIC -fstack-protector -O3 -lnuma -lpcre2-8 -lcrypt -laio -lz -lm -lssl -lcrypto -lpthread -ldl

Laghos

OpenBenchmarking.orgMajor Kernels Total Rate, More Is BetterLaghos 3.1Test: Triple Point Problemv6.13 7 Decv6.12v6.1170140210280350SE +/- 3.23, N = 3SE +/- 1.53, N = 3SE +/- 3.08, N = 3300.72303.11297.991. (CXX) g++ options: -O3 -std=c++11 -lmfem -lHYPRE -lmetis -lrt -lmpi_cxx -lmpi

Memcached

Memcached is a high performance, distributed memory object caching system. This Memcached test profiles makes use of memtier_benchmark for excuting this CPU/memory-focused server benchmark. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgOps/sec, More Is BetterMemcached 1.6.19Set To Get Ratio: 1:10v6.13 7 Decv6.12v6.111.6M3.2M4.8M6.4M8MSE +/- 37597.18, N = 3SE +/- 30399.87, N = 3SE +/- 35717.40, N = 37400996.987297642.217421710.241. (CXX) g++ options: -O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre

DaCapo Benchmark

This test runs the DaCapo Benchmarks written in Java and intended to test system/CPU performance of various popular real-world Java workloads. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgmsec, Fewer Is BetterDaCapo Benchmark 23.11Java Test: Apache Tomcatv6.13 7 Decv6.12v6.112004006008001000SE +/- 2.00, N = 3SE +/- 3.51, N = 3SE +/- 7.81, N = 3105510381053

OpenBenchmarking.orgmsec, Fewer Is BetterDaCapo Benchmark 23.11Java Test: Batik SVG Toolkitv6.13 7 Decv6.12v6.112004006008001000SE +/- 7.55, N = 3SE +/- 4.00, N = 3SE +/- 3.61, N = 3938937923

OpenBenchmarking.orgmsec, Fewer Is BetterDaCapo Benchmark 23.11Java Test: Apache Lucene Search Indexv6.13 7 Decv6.12v6.115001000150020002500SE +/- 25.32, N = 3SE +/- 8.39, N = 3SE +/- 16.64, N = 3227822582294

Apache Cassandra

OpenBenchmarking.orgOp/s, More Is BetterApache Cassandra 5.0Test: Writesv6.13 7 Decv6.12v6.11110K220K330K440K550KSE +/- 4648.88, N = 3SE +/- 1282.82, N = 3SE +/- 5140.53, N = 3487743491186483952

Blender

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 4.3Blend File: Fishy Cat - Compute: CPU-Onlyv6.13 7 Decv6.12v6.11510152025SE +/- 0.06, N = 3SE +/- 0.06, N = 3SE +/- 0.12, N = 321.3521.4921.66

ClickHouse

ClickHouse is an open-source, high performance OLAP data management system. This test profile uses ClickHouse's standard benchmark recommendations per https://clickhouse.com/docs/en/operations/performance-test/ / https://github.com/ClickHouse/ClickBench/tree/main/clickhouse with the 100 million rows web analytics dataset. The reported value is the query processing time using the geometric mean of all separate queries performed as an aggregate. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgQueries Per Minute, Geo Mean, More Is BetterClickHouse 22.12.3.5100M Rows Hits Dataset, First Run / Cold Cachev6.13 7 Decv6.12v6.112004006008001000SE +/- 2.84, N = 3SE +/- 3.20, N = 3SE +/- 2.38, N = 3774.01776.70770.47MIN: 65.86 / MAX: 7500MIN: 65.22 / MAX: 8571.43MIN: 65.15 / MAX: 8571.43

DaCapo Benchmark

This test runs the DaCapo Benchmarks written in Java and intended to test system/CPU performance of various popular real-world Java workloads. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgmsec, Fewer Is BetterDaCapo Benchmark 23.11Java Test: Tradesoapv6.13 7 Decv6.12v6.117001400210028003500SE +/- 31.71, N = 5SE +/- 21.97, N = 15SE +/- 24.92, N = 3304930353077

Blender

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 4.3Blend File: Classroom - Compute: CPU-Onlyv6.13 7 Decv6.12v6.111020304050SE +/- 0.04, N = 3SE +/- 0.05, N = 3SE +/- 0.01, N = 341.4941.7442.03

DaCapo Benchmark

This test runs the DaCapo Benchmarks written in Java and intended to test system/CPU performance of various popular real-world Java workloads. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgmsec, Fewer Is BetterDaCapo Benchmark 23.11Java Test: BioJava Biological Data Frameworkv6.13 7 Decv6.12v6.119001800270036004500SE +/- 22.00, N = 3SE +/- 18.98, N = 3SE +/- 11.89, N = 3401940714058

Memcached

Memcached is a high performance, distributed memory object caching system. This Memcached test profiles makes use of memtier_benchmark for excuting this CPU/memory-focused server benchmark. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgOps/sec, More Is BetterMemcached 1.6.19Set To Get Ratio: 1:5v6.13 7 Decv6.12v6.11900K1800K2700K3600K4500KSE +/- 28528.57, N = 3SE +/- 16085.40, N = 3SE +/- 26467.49, N = 34099640.314064048.144115352.491. (CXX) g++ options: -O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre

PostgreSQL

OpenBenchmarking.orgms, Fewer Is BetterPostgreSQL 17Scaling Factor: 100 - Clients: 800 - Mode: Read Only - Average Latencyv6.13 7 Decv6.12v6.110.03760.07520.11280.15040.188SE +/- 0.000, N = 3SE +/- 0.000, N = 3SE +/- 0.001, N = 30.1650.1660.1671. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpq -lpgcommon -lpgport -lm

DaCapo Benchmark

This test runs the DaCapo Benchmarks written in Java and intended to test system/CPU performance of various popular real-world Java workloads. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgmsec, Fewer Is BetterDaCapo Benchmark 23.11Java Test: FOP Print Formatterv6.13 7 Decv6.12v6.1170140210280350SE +/- 1.20, N = 3SE +/- 2.08, N = 3SE +/- 0.67, N = 3338335339

Blender

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 4.3Blend File: BMW27 - Compute: CPU-Onlyv6.13 7 Decv6.12v6.1148121620SE +/- 0.04, N = 3SE +/- 0.05, N = 3SE +/- 0.00, N = 315.0215.0815.19

DaCapo Benchmark

This test runs the DaCapo Benchmarks written in Java and intended to test system/CPU performance of various popular real-world Java workloads. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgmsec, Fewer Is BetterDaCapo Benchmark 23.11Java Test: Eclipsev6.13 7 Decv6.12v6.1114002800420056007000SE +/- 23.78, N = 3SE +/- 33.39, N = 3SE +/- 14.75, N = 3633162806349

SVT-AV1

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 2.3Encoder Mode: Preset 5 - Input: Bosphorus 4Kv6.13 7 Decv6.12v6.111428425670SE +/- 0.08, N = 3SE +/- 0.12, N = 3SE +/- 0.07, N = 360.8260.3860.171. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

Blender

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 4.3Blend File: Pabellon Barcelona - Compute: CPU-Onlyv6.13 7 Decv6.12v6.111122334455SE +/- 0.02, N = 3SE +/- 0.08, N = 3SE +/- 0.05, N = 347.3947.7047.90

ClickHouse

ClickHouse is an open-source, high performance OLAP data management system. This test profile uses ClickHouse's standard benchmark recommendations per https://clickhouse.com/docs/en/operations/performance-test/ / https://github.com/ClickHouse/ClickBench/tree/main/clickhouse with the 100 million rows web analytics dataset. The reported value is the query processing time using the geometric mean of all separate queries performed as an aggregate. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgQueries Per Minute, Geo Mean, More Is BetterClickHouse 22.12.3.5100M Rows Hits Dataset, Second Runv6.13 7 Decv6.12v6.112004006008001000SE +/- 8.62, N = 3SE +/- 3.55, N = 3SE +/- 4.73, N = 3803.49801.90804.06MIN: 66.08 / MAX: 10000MIN: 65.79 / MAX: 8571.43MIN: 65.15 / MAX: 10000

PostgreSQL

OpenBenchmarking.orgTPS, More Is BetterPostgreSQL 17Scaling Factor: 100 - Clients: 800 - Mode: Read Onlyv6.13 7 Decv6.12v6.111000K2000K3000K4000K5000KSE +/- 8981.60, N = 3SE +/- 9902.78, N = 3SE +/- 11484.93, N = 34829255481562547836481. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpq -lpgcommon -lpgport -lm

OpenVINO GenAI

OpenBenchmarking.orgtokens/s, More Is BetterOpenVINO GenAI 2024.5Model: Falcon-7b-instruct-int4-ov - Device: CPUv6.13 7 Decv6.12v6.111326395265SE +/- 0.54, N = 3SE +/- 0.55, N = 6SE +/- 0.63, N = 356.2856.2156.73

DaCapo Benchmark

This test runs the DaCapo Benchmarks written in Java and intended to test system/CPU performance of various popular real-world Java workloads. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgmsec, Fewer Is BetterDaCapo Benchmark 23.11Java Test: GraphChiv6.13 7 Decv6.12v6.115001000150020002500SE +/- 6.00, N = 3SE +/- 5.51, N = 3SE +/- 13.86, N = 3210220832093

ClickHouse

ClickHouse is an open-source, high performance OLAP data management system. This test profile uses ClickHouse's standard benchmark recommendations per https://clickhouse.com/docs/en/operations/performance-test/ / https://github.com/ClickHouse/ClickBench/tree/main/clickhouse with the 100 million rows web analytics dataset. The reported value is the query processing time using the geometric mean of all separate queries performed as an aggregate. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgQueries Per Minute, Geo Mean, More Is BetterClickHouse 22.12.3.5100M Rows Hits Dataset, Third Runv6.13 7 Decv6.12v6.112004006008001000SE +/- 2.96, N = 3SE +/- 3.72, N = 3SE +/- 4.79, N = 3807.27800.56801.19MIN: 66.01 / MAX: 8571.43MIN: 63.63 / MAX: 10000MIN: 65.5 / MAX: 8571.43

OpenSSL

OpenBenchmarking.orgbyte/s, More Is BetterOpenSSLAlgorithm: ChaCha20v6.13 7 Decv6.12v6.11160000M320000M480000M640000M800000MSE +/- 626958911.68, N = 3SE +/- 2136131841.14, N = 3SE +/- 652717270.91, N = 37199807631807246118325807181068765901. OpenSSL 3.3.1 4 Jun 2024 (Library: OpenSSL 3.3.1 4 Jun 2024) - Additional Parameters: -engine qatengine -async_jobs 8

OpenVINO GenAI

OpenBenchmarking.orgtokens/s, More Is BetterOpenVINO GenAI 2024.5Model: TinyLlama-1.1B-Chat-v1.0 - Device: CPUv6.13 7 Decv6.12v6.1120406080100SE +/- 0.28, N = 3SE +/- 0.23, N = 3SE +/- 0.57, N = 377.6778.1878.36

OpenBenchmarking.orgtokens/s, More Is BetterOpenVINO GenAI 2024.5Model: Gemma-7b-int4-ov - Device: CPUv6.13 7 Decv6.12v6.111122334455SE +/- 0.27, N = 3SE +/- 0.10, N = 3SE +/- 0.15, N = 348.7049.0949.13

Llamafile

OpenBenchmarking.orgTokens Per Second, More Is BetterLlamafile 0.8.16Model: wizardcoder-python-34b-v1.0.Q6_K - Test: Text Generation 128v6.13 7 Decv6.12v6.1148121620SE +/- 0.02, N = 3SE +/- 0.04, N = 3SE +/- 0.02, N = 315.7715.8215.90

SVT-AV1

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 2.3Encoder Mode: Preset 8 - Input: Bosphorus 4Kv6.13 7 Decv6.12v6.114080120160200SE +/- 0.64, N = 3SE +/- 1.77, N = 3SE +/- 1.84, N = 3200.82200.32199.211. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

Blender

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 4.3Blend File: Barbershop - Compute: CPU-Onlyv6.13 7 Decv6.12v6.11306090120150SE +/- 0.23, N = 3SE +/- 0.18, N = 3SE +/- 0.08, N = 3148.16148.82149.30

SVT-AV1

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 2.3Encoder Mode: Preset 3 - Input: Bosphorus 4Kv6.13 7 Decv6.12v6.1148121620SE +/- 0.02, N = 3SE +/- 0.04, N = 3SE +/- 0.08, N = 317.0116.9916.881. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

Timed Linux Kernel Compilation

This test times how long it takes to build the Linux kernel in a default configuration (defconfig) for the architecture being tested or alternatively an allmodconfig for building all possible kernel modules for the build. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed Linux Kernel Compilation 6.8Build: allmodconfigv6.13 7 Decv6.12v6.114080120160200SE +/- 0.25, N = 3SE +/- 0.34, N = 3SE +/- 0.21, N = 3192.92193.20194.34

DaCapo Benchmark

This test runs the DaCapo Benchmarks written in Java and intended to test system/CPU performance of various popular real-world Java workloads. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgmsec, Fewer Is BetterDaCapo Benchmark 23.11Java Test: Jythonv6.13 7 Decv6.12v6.118001600240032004000SE +/- 11.00, N = 3SE +/- 5.33, N = 3SE +/- 6.67, N = 3376337553782

Laghos

OpenBenchmarking.orgMajor Kernels Total Rate, More Is BetterLaghos 3.1Test: Sedov Blast Wave, ube_922_hex.meshv6.13 7 Decv6.12v6.11120240360480600SE +/- 2.95, N = 3SE +/- 2.47, N = 3SE +/- 3.27, N = 3565.14565.10561.911. (CXX) g++ options: -O3 -std=c++11 -lmfem -lHYPRE -lmetis -lrt -lmpi_cxx -lmpi

Stress-NG

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.17.08Test: Socket Activityv6.13 7 Decv6.12v6.1110K20K30K40K50KSE +/- 42.06, N = 3SE +/- 68.22, N = 3SE +/- 29.82, N = 347238.7047501.0447424.871. (CXX) g++ options: -O2 -std=gnu99 -lc -lm

Primesieve

OpenBenchmarking.orgSeconds, Fewer Is BetterPrimesieve 12.6Length: 1e12v6.13 7 Decv6.12v6.110.44980.89961.34941.79922.249SE +/- 0.002, N = 3SE +/- 0.001, N = 3SE +/- 0.003, N = 31.9881.9901.9991. (CXX) g++ options: -O3

OpenSSL

OpenBenchmarking.orgbyte/s, More Is BetterOpenSSLAlgorithm: ChaCha20-Poly1305v6.13 7 Decv6.12v6.11110000M220000M330000M440000M550000MSE +/- 158903312.00, N = 3SE +/- 118571563.57, N = 3SE +/- 271433364.08, N = 34894861022534905110852034878349854501. OpenSSL 3.3.1 4 Jun 2024 (Library: OpenSSL 3.3.1 4 Jun 2024) - Additional Parameters: -engine qatengine -async_jobs 8

DaCapo Benchmark

This test runs the DaCapo Benchmarks written in Java and intended to test system/CPU performance of various popular real-world Java workloads. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgmsec, Fewer Is BetterDaCapo Benchmark 23.11Java Test: Apache Kafkav6.13 7 Decv6.12v6.1111002200330044005500SE +/- 3.53, N = 3SE +/- 26.64, N = 3SE +/- 7.33, N = 3505750455070

Timed LLVM Compilation

This test times how long it takes to compile/build the LLVM compiler stack. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed LLVM Compilation 16.0Build System: Unix Makefilesv6.13 7 Decv6.12v6.114080120160200SE +/- 0.86, N = 3SE +/- 0.33, N = 3SE +/- 0.34, N = 3160.56160.30159.82

OpenSSL

OpenBenchmarking.orgbyte/s, More Is BetterOpenSSLAlgorithm: AES-128-GCMv6.13 7 Decv6.12v6.1180000M160000M240000M320000M400000MSE +/- 88875000.56, N = 3SE +/- 158067306.31, N = 3SE +/- 130266226.11, N = 33613248888803615640538703599313037101. OpenSSL 3.3.1 4 Jun 2024 (Library: OpenSSL 3.3.1 4 Jun 2024) - Additional Parameters: -engine qatengine -async_jobs 8

OpenBenchmarking.orgbyte/s, More Is BetterOpenSSLAlgorithm: AES-256-GCMv6.13 7 Decv6.12v6.1170000M140000M210000M280000M350000MSE +/- 134252719.45, N = 3SE +/- 47580595.33, N = 3SE +/- 105448439.59, N = 33344281574503344866961173331629958971. OpenSSL 3.3.1 4 Jun 2024 (Library: OpenSSL 3.3.1 4 Jun 2024) - Additional Parameters: -engine qatengine -async_jobs 8

Primesieve

OpenBenchmarking.orgSeconds, Fewer Is BetterPrimesieve 12.6Length: 1e13v6.13 7 Decv6.12v6.11612182430SE +/- 0.02, N = 3SE +/- 0.03, N = 3SE +/- 0.04, N = 324.9424.9725.041. (CXX) g++ options: -O3

Timed Linux Kernel Compilation

This test times how long it takes to build the Linux kernel in a default configuration (defconfig) for the architecture being tested or alternatively an allmodconfig for building all possible kernel modules for the build. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed Linux Kernel Compilation 6.8Build: defconfigv6.13 7 Decv6.12v6.11510152025SE +/- 0.26, N = 4SE +/- 0.31, N = 3SE +/- 0.25, N = 421.8621.8521.79

DaCapo Benchmark

This test runs the DaCapo Benchmarks written in Java and intended to test system/CPU performance of various popular real-world Java workloads. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgmsec, Fewer Is BetterDaCapo Benchmark 23.11Java Test: Apache Xalan XSLTv6.13 7 Decv6.12v6.11160320480640800SE +/- 8.54, N = 3SE +/- 1.76, N = 3SE +/- 6.06, N = 3742741743

Timed LLVM Compilation

This test times how long it takes to compile/build the LLVM compiler stack. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed LLVM Compilation 16.0Build System: Ninjav6.13 7 Decv6.12v6.1120406080100SE +/- 0.19, N = 3SE +/- 0.06, N = 3SE +/- 0.11, N = 3101.73101.60101.82

Blender

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 4.3Blend File: Junkshop - Compute: CPU-Onlyv6.13 7 Decv6.12v6.11510152025SE +/- 0.06, N = 3SE +/- 0.06, N = 3SE +/- 0.04, N = 320.2020.2120.24

OpenVINO GenAI

OpenBenchmarking.orgtokens/s, More Is BetterOpenVINO GenAI 2024.5Model: Phi-3-mini-128k-instruct-int4-ov - Device: CPUv6.13 7 Decv6.12v6.111530456075SE +/- 0.79, N = 3SE +/- 0.10, N = 3SE +/- 0.41, N = 365.9165.8265.89

DaCapo Benchmark

This test runs the DaCapo Benchmarks written in Java and intended to test system/CPU performance of various popular real-world Java workloads. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgmsec, Fewer Is BetterDaCapo Benchmark 23.11Java Test: jMonkeyEnginev6.13 7 Decv6.12v6.1115003000450060007500SE +/- 1.86, N = 3SE +/- 4.84, N = 3SE +/- 1.86, N = 3679367976791

Llamafile

OpenBenchmarking.orgTokens Per Second, More Is BetterLlamafile 0.8.16Model: wizardcoder-python-34b-v1.0.Q6_K - Test: Prompt Processing 2048v6.13 7 Decv6.12v6.113K6K9K12K15KSE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3122881228812288

OpenBenchmarking.orgTokens Per Second, More Is BetterLlamafile 0.8.16Model: wizardcoder-python-34b-v1.0.Q6_K - Test: Prompt Processing 1024v6.13 7 Decv6.12v6.1113002600390052006500SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3614461446144

OpenBenchmarking.orgTokens Per Second, More Is BetterLlamafile 0.8.16Model: wizardcoder-python-34b-v1.0.Q6_K - Test: Prompt Processing 512v6.13 7 Decv6.12v6.117001400210028003500SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3307230723072

OpenBenchmarking.orgTokens Per Second, More Is BetterLlamafile 0.8.16Model: wizardcoder-python-34b-v1.0.Q6_K - Test: Prompt Processing 256v6.13 7 Decv6.12v6.1130060090012001500SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3153615361536

OpenBenchmarking.orgTokens Per Second, More Is BetterLlamafile 0.8.16Model: mistral-7b-instruct-v0.2.Q5_K_M - Test: Prompt Processing 2048v6.13 7 Decv6.12v6.117K14K21K28K35KSE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3327683276832768

OpenBenchmarking.orgTokens Per Second, More Is BetterLlamafile 0.8.16Model: mistral-7b-instruct-v0.2.Q5_K_M - Test: Prompt Processing 1024v6.13 7 Decv6.12v6.114K8K12K16K20KSE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3163841638416384

OpenBenchmarking.orgTokens Per Second, More Is BetterLlamafile 0.8.16Model: mistral-7b-instruct-v0.2.Q5_K_M - Test: Prompt Processing 512v6.13 7 Decv6.12v6.112K4K6K8K10KSE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3819281928192

OpenBenchmarking.orgTokens Per Second, More Is BetterLlamafile 0.8.16Model: mistral-7b-instruct-v0.2.Q5_K_M - Test: Prompt Processing 256v6.13 7 Decv6.12v6.119001800270036004500SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3409640964096

OpenBenchmarking.orgTokens Per Second, More Is BetterLlamafile 0.8.16Model: TinyLlama-1.1B-Chat-v1.0.BF16 - Test: Prompt Processing 2048v6.13 7 Decv6.12v6.117K14K21K28K35KSE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3327683276832768

OpenBenchmarking.orgTokens Per Second, More Is BetterLlamafile 0.8.16Model: TinyLlama-1.1B-Chat-v1.0.BF16 - Test: Prompt Processing 1024v6.13 7 Decv6.12v6.114K8K12K16K20KSE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3163841638416384

OpenBenchmarking.orgTokens Per Second, More Is BetterLlamafile 0.8.16Model: TinyLlama-1.1B-Chat-v1.0.BF16 - Test: Prompt Processing 512v6.13 7 Decv6.12v6.112K4K6K8K10KSE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3819281928192

OpenBenchmarking.orgTokens Per Second, More Is BetterLlamafile 0.8.16Model: TinyLlama-1.1B-Chat-v1.0.BF16 - Test: Prompt Processing 256v6.13 7 Decv6.12v6.119001800270036004500SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3409640964096

OpenBenchmarking.orgTokens Per Second, More Is BetterLlamafile 0.8.16Model: Llama-3.2-3B-Instruct.Q6_K - Test: Prompt Processing 2048v6.13 7 Decv6.12v6.117K14K21K28K35KSE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3327683276832768

OpenBenchmarking.orgTokens Per Second, More Is BetterLlamafile 0.8.16Model: Llama-3.2-3B-Instruct.Q6_K - Test: Prompt Processing 1024v6.13 7 Decv6.12v6.114K8K12K16K20KSE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3163841638416384

OpenBenchmarking.orgTokens Per Second, More Is BetterLlamafile 0.8.16Model: Llama-3.2-3B-Instruct.Q6_K - Test: Prompt Processing 512v6.13 7 Decv6.12v6.112K4K6K8K10KSE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3819281928192

OpenBenchmarking.orgTokens Per Second, More Is BetterLlamafile 0.8.16Model: Llama-3.2-3B-Instruct.Q6_K - Test: Prompt Processing 256v6.13 7 Decv6.12v6.119001800270036004500SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3409640964096

OpenBenchmarking.orgTokens Per Second, More Is BetterLlamafile 0.8.16Model: wizardcoder-python-34b-v1.0.Q6_K - Test: Text Generation 16v6.13 7 Decv6.12v6.1148121620SE +/- 0.73, N = 12SE +/- 0.74, N = 12SE +/- 0.74, N = 1214.9015.0114.98

OpenBenchmarking.orgTokens Per Second, More Is BetterLlamafile 0.8.16Model: mistral-7b-instruct-v0.2.Q5_K_M - Test: Text Generation 16v6.13 7 Decv6.12v6.111428425670SE +/- 1.70, N = 12SE +/- 1.75, N = 12SE +/- 1.73, N = 1264.1564.8064.87

OpenBenchmarking.orgTokens Per Second, More Is BetterLlamafile 0.8.16Model: TinyLlama-1.1B-Chat-v1.0.BF16 - Test: Text Generation 16v6.13 7 Decv6.12v6.11306090120150SE +/- 4.35, N = 12SE +/- 4.63, N = 12SE +/- 4.56, N = 12147.98152.89152.07

OpenBenchmarking.orgTokens Per Second, More Is BetterLlamafile 0.8.16Model: Llama-3.2-3B-Instruct.Q6_K - Test: Text Generation 16v6.13 7 Decv6.12v6.1120406080100SE +/- 2.52, N = 14SE +/- 2.55, N = 12SE +/- 2.48, N = 12102.21107.95108.22

DaCapo Benchmark

This test runs the DaCapo Benchmarks written in Java and intended to test system/CPU performance of various popular real-world Java workloads. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgmsec, Fewer Is BetterDaCapo Benchmark 23.11Java Test: PMD Source Code Analyzerv6.13 7 Decv6.12v6.1130060090012001500SE +/- 18.53, N = 15SE +/- 23.97, N = 15SE +/- 5.90, N = 3108911671085

Apache CouchDB

OpenBenchmarking.orgSeconds, Fewer Is BetterApache CouchDB 3.4.1Bulk Size: 500 - Inserts: 1000 - Rounds: 30v6.13 7 Decv6.12v6.1180160240320400SE +/- 29.09, N = 7SE +/- 36.20, N = 9SE +/- 62.71, N = 8311.04333.18354.531. (CXX) g++ options: -flto -lstdc++ -shared -lei

OpenBenchmarking.orgSeconds, Fewer Is BetterApache CouchDB 3.4.1Bulk Size: 300 - Inserts: 3000 - Rounds: 30v6.13 7 Decv6.12v6.1180160240320400SE +/- 3.45, N = 9SE +/- 12.48, N = 9SE +/- 6.26, N = 9360.83371.29363.531. (CXX) g++ options: -flto -lstdc++ -shared -lei

DaCapo Benchmark

This test runs the DaCapo Benchmarks written in Java and intended to test system/CPU performance of various popular real-world Java workloads. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgmsec, Fewer Is BetterDaCapo Benchmark 23.11Java Test: Tradebeansv6.13 7 Decv6.12v6.1111002200330044005500SE +/- 100.21, N = 12SE +/- 76.59, N = 15SE +/- 48.79, N = 15495749684999

RELION

OpenBenchmarking.orgSeconds, Fewer Is BetterRELION 5.0Test: Basic - Device: CPUv6.13 7 Decv6.12v6.114080120160200SE +/- 3.31, N = 12SE +/- 0.79, N = 3SE +/- 1.95, N = 3172.48179.87176.671. (CXX) g++ options: -fPIC -std=c++14 -fopenmp -O3 -rdynamic -ldl -ltiff -lfftw3f -lfftw3 -lpng -ljpeg -lmpi_cxx -lmpi

Palabos

OpenBenchmarking.orgMega Site Updates Per Second, More Is BetterPalabos 2.3Grid Size: 1000v6.13 7 Decv6.12v6.11140280420560700SE +/- 21.98, N = 15SE +/- 36.69, N = 12SE +/- 3.07, N = 15509.13655.18481.491. (CXX) g++ options: -std=c++17 -pedantic -O3 -rdynamic -lcrypto -lcurl -lsz -lz -ldl -lm

OpenBenchmarking.orgMega Site Updates Per Second, More Is BetterPalabos 2.3Grid Size: 500v6.13 7 Decv6.12v6.112004006008001000SE +/- 5.28, N = 3SE +/- 1.19, N = 3SE +/- 40.67, N = 12764.02775.11529.231. (CXX) g++ options: -std=c++17 -pedantic -O3 -rdynamic -lcrypto -lcurl -lsz -lz -ldl -lm

102 Results Shown

Stress-NG
MariaDB
DaCapo Benchmark:
  Spring Boot
  Apache Lucene Search Engine
Stress-NG
DaCapo Benchmark
Stress-NG
PostgreSQL:
  100 - 1000 - Read Write - Average Latency
  100 - 1000 - Read Write
MariaDB
Memcached
Stress-NG:
  Futex
  MEMFD
PostgreSQL
Stress-NG
PostgreSQL
DaCapo Benchmark
Llamafile
Apache CouchDB
Stress-NG
DaCapo Benchmark
SVT-AV1
PostgreSQL
Llamafile
PostgreSQL
MariaDB
Llamafile
MariaDB
Laghos
Memcached
DaCapo Benchmark:
  Apache Tomcat
  Batik SVG Toolkit
  Apache Lucene Search Index
Apache Cassandra
Blender
ClickHouse
DaCapo Benchmark
Blender
DaCapo Benchmark
Memcached
PostgreSQL
DaCapo Benchmark
Blender
DaCapo Benchmark
SVT-AV1
Blender
ClickHouse
PostgreSQL
OpenVINO GenAI
DaCapo Benchmark
ClickHouse
OpenSSL
OpenVINO GenAI:
  TinyLlama-1.1B-Chat-v1.0 - CPU
  Gemma-7b-int4-ov - CPU
Llamafile
SVT-AV1
Blender
SVT-AV1
Timed Linux Kernel Compilation
DaCapo Benchmark
Laghos
Stress-NG
Primesieve
OpenSSL
DaCapo Benchmark
Timed LLVM Compilation
OpenSSL:
  AES-128-GCM
  AES-256-GCM
Primesieve
Timed Linux Kernel Compilation
DaCapo Benchmark
Timed LLVM Compilation
Blender
OpenVINO GenAI
DaCapo Benchmark
Llamafile:
  wizardcoder-python-34b-v1.0.Q6_K - Prompt Processing 2048
  wizardcoder-python-34b-v1.0.Q6_K - Prompt Processing 1024
  wizardcoder-python-34b-v1.0.Q6_K - Prompt Processing 512
  wizardcoder-python-34b-v1.0.Q6_K - Prompt Processing 256
  mistral-7b-instruct-v0.2.Q5_K_M - Prompt Processing 2048
  mistral-7b-instruct-v0.2.Q5_K_M - Prompt Processing 1024
  mistral-7b-instruct-v0.2.Q5_K_M - Prompt Processing 512
  mistral-7b-instruct-v0.2.Q5_K_M - Prompt Processing 256
  TinyLlama-1.1B-Chat-v1.0.BF16 - Prompt Processing 2048
  TinyLlama-1.1B-Chat-v1.0.BF16 - Prompt Processing 1024
  TinyLlama-1.1B-Chat-v1.0.BF16 - Prompt Processing 512
  TinyLlama-1.1B-Chat-v1.0.BF16 - Prompt Processing 256
  Llama-3.2-3B-Instruct.Q6_K - Prompt Processing 2048
  Llama-3.2-3B-Instruct.Q6_K - Prompt Processing 1024
  Llama-3.2-3B-Instruct.Q6_K - Prompt Processing 512
  Llama-3.2-3B-Instruct.Q6_K - Prompt Processing 256
  wizardcoder-python-34b-v1.0.Q6_K - Text Generation 16
  mistral-7b-instruct-v0.2.Q5_K_M - Text Generation 16
  TinyLlama-1.1B-Chat-v1.0.BF16 - Text Generation 16
  Llama-3.2-3B-Instruct.Q6_K - Text Generation 16
DaCapo Benchmark
Apache CouchDB:
  500 - 1000 - 30
  300 - 3000 - 30
DaCapo Benchmark
RELION
Palabos:
  1000
  500