Linux 6.13 AMD EPYC Performance

Benchmarks for a future article. AMD EPYC 9575F 64-Core testing with a Supermicro Super Server H13SSL-N v1.01 (3.0 BIOS) and ASPEED on Ubuntu 24.10 via the Phoronix Test Suite.

Compare your own system(s) to this result file with the Phoronix Test Suite by running the command: phoronix-test-suite benchmark 2412073-NE-LINUX613A93
Jump To Table - Results

View

Do Not Show Noisy Results
Do Not Show Results With Incomplete Data
Do Not Show Results With Little Change/Spread
List Notable Results
Show Result Confidence Charts
Allow Limiting Results To Certain Suite(s)

Statistics

Show Overall Harmonic Mean(s)
Show Overall Geometric Mean
Show Wins / Losses Counts (Pie Chart)
Normalize Results
Remove Outliers Before Calculating Averages

Graph Settings

Force Line Graphs Where Applicable
Convert To Scalar Where Applicable
Prefer Vertical Bar Graphs

Multi-Way Comparison

Condense Multi-Option Tests Into Single Result Graphs

Table

Show Detailed System Result Table

Run Management

Highlight
Result
Toggle/Hide
Result
Result
Identifier
Performance Per
Dollar
Date
Run
  Test
  Duration
v6.11
December 07
  7 Hours, 42 Minutes
v6.12
December 06
  7 Hours, 21 Minutes
v6.13 7 Dec
December 07
  7 Hours, 41 Minutes
Invert Behavior (Only Show Selected Data)
  7 Hours, 35 Minutes

Only show results where is faster than
Only show results matching title/arguments (delimit multiple options with a comma):
Do not show results matching title/arguments (delimit multiple options with a comma):


Linux 6.13 AMD EPYC PerformanceProcessorMotherboardChipsetMemoryDiskGraphicsNetworkOSKernelDesktopDisplay ServerCompilerFile-SystemScreen Resolutionv6.11v6.12v6.13 7 DecAMD EPYC 9575F 64-Core @ 3.30GHz (64 Cores / 128 Threads)Supermicro Super Server H13SSL-N v1.01 (3.0 BIOS)AMD 1Ah12 x 64GB DDR5-6000MT/s Micron MTC40F2046S1RC64BDY QSFF3201GB Micron_7450_MTFDKCB3T2TFSASPEED2 x Broadcom NetXtreme BCM5720 PCIeUbuntu 24.106.11.0-phx (x86_64)GNOME Shell 47.0X ServerGCC 14.2.0ext41920x12006.12.0-phx (x86_64)1024x7686.13.0-rc1-phx (x86_64)OpenBenchmarking.orgKernel Details- Transparent Huge Pages: madviseCompiler Details- --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-bootstrap --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2,rust --enable-libphobos-checking=release --enable-libstdcxx-backtrace --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-link-serialization=2 --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-defaulted --enable-offload-targets=nvptx-none=/build/gcc-14-zdkDXv/gcc-14-14.2.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-14-zdkDXv/gcc-14-14.2.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-build-config=bootstrap-lto-lean --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v Processor Details- Scaling Governor: acpi-cpufreq performance (Boost: Enabled) - CPU Microcode: 0xb002116Java Details- OpenJDK Runtime Environment (build 21.0.5+11-Ubuntu-1ubuntu124.10)Python Details- Python 3.12.7Security Details- gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + reg_file_data_sampling: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS; IBPB: conditional; STIBP: always-on; RSB filling; PBRSB-eIBRS: Not affected; BHI: Not affected + srbds: Not affected + tsx_async_abort: Not affected

v6.11v6.12v6.13 7 DecResult OverviewPhoronix Test Suite100%110%121%131%141%PalabosStress-NGMariaDBApache CouchDBRELIONPostgreSQLMemcachedApache CassandraSVT-AV1LaghosBlenderLlamafileClickHousePrimesieveOpenSSLOpenVINO GenAITimed LLVM CompilationTimed Linux Kernel CompilationDaCapo Benchmark

Linux 6.13 AMD EPYC Performancelaghos: Triple Point Problemlaghos: Sedov Blast Wave, ube_922_hex.meshpalabos: 500palabos: 1000relion: Basic - CPUdacapobench: Jythondacapobench: GraphChidacapobench: Tradesoapdacapobench: Tradebeansdacapobench: Apache Tomcatdacapobench: Apache Xalan XSLTdacapobench: H2 Database Enginesvt-av1: Preset 3 - Bosphorus 4Ksvt-av1: Preset 5 - Bosphorus 4Ksvt-av1: Preset 8 - Bosphorus 4Ksvt-av1: Preset 13 - Bosphorus 4Kbuild-linux-kernel: defconfigbuild-linux-kernel: allmodconfigbuild-llvm: Ninjabuild-llvm: Unix Makefilesprimesieve: 1e12primesieve: 1e13openssl: ChaCha20openssl: AES-128-GCMopenssl: AES-256-GCMopenssl: ChaCha20-Poly1305clickhouse: 100M Rows Hits Dataset, First Run / Cold Cacheclickhouse: 100M Rows Hits Dataset, Second Runclickhouse: 100M Rows Hits Dataset, Third Runcouchdb: 300 - 1000 - 30couchdb: 300 - 3000 - 30couchdb: 500 - 1000 - 30dacapobench: Eclipsedacapobench: Spring Bootdacapobench: Apache Kafkadacapobench: jMonkeyEnginedacapobench: Batik SVG Toolkitdacapobench: FOP Print Formatterdacapobench: PMD Source Code Analyzerdacapobench: Apache Lucene Search Indexdacapobench: Apache Lucene Search Enginedacapobench: Avrora AVR Simulation Frameworkdacapobench: BioJava Biological Data Frameworkdacapobench: Zxing 1D/2D Barcode Image Processingmemcached: 1:5memcached: 1:10memcached: 1:100mariadb: oltp_read_only - 128mariadb: oltp_read_write - 128mariadb: oltp_write_only - 128mariadb: oltp_update_index - 128pgbench: 100 - 800 - Read Onlypgbench: 100 - 800 - Read Only - Average Latencypgbench: 100 - 1000 - Read Onlypgbench: 100 - 1000 - Read Only - Average Latencypgbench: 100 - 800 - Read Writepgbench: 100 - 800 - Read Write - Average Latencypgbench: 100 - 1000 - Read Writepgbench: 100 - 1000 - Read Write - Average Latencystress-ng: NUMAstress-ng: Futexstress-ng: MEMFDstress-ng: Mutexstress-ng: Semaphoresstress-ng: Mixed Schedulerstress-ng: Socket Activitystress-ng: Context Switchingblender: BMW27 - CPU-Onlyblender: Junkshop - CPU-Onlyblender: Classroom - CPU-Onlyblender: Fishy Cat - CPU-Onlyblender: Barbershop - CPU-Onlyblender: Pabellon Barcelona - CPU-Onlycassandra: Writesllamafile: Llama-3.2-3B-Instruct.Q6_K - Text Generation 16llamafile: Llama-3.2-3B-Instruct.Q6_K - Text Generation 128llamafile: Llama-3.2-3B-Instruct.Q6_K - Prompt Processing 256llamafile: Llama-3.2-3B-Instruct.Q6_K - Prompt Processing 512llamafile: TinyLlama-1.1B-Chat-v1.0.BF16 - Text Generation 16llamafile: Llama-3.2-3B-Instruct.Q6_K - Prompt Processing 1024llamafile: Llama-3.2-3B-Instruct.Q6_K - Prompt Processing 2048llamafile: TinyLlama-1.1B-Chat-v1.0.BF16 - Text Generation 128llamafile: mistral-7b-instruct-v0.2.Q5_K_M - Text Generation 16llamafile: TinyLlama-1.1B-Chat-v1.0.BF16 - Prompt Processing 256llamafile: TinyLlama-1.1B-Chat-v1.0.BF16 - Prompt Processing 512llamafile: mistral-7b-instruct-v0.2.Q5_K_M - Text Generation 128llamafile: wizardcoder-python-34b-v1.0.Q6_K - Text Generation 16llamafile: TinyLlama-1.1B-Chat-v1.0.BF16 - Prompt Processing 1024llamafile: TinyLlama-1.1B-Chat-v1.0.BF16 - Prompt Processing 2048llamafile: wizardcoder-python-34b-v1.0.Q6_K - Text Generation 128llamafile: mistral-7b-instruct-v0.2.Q5_K_M - Prompt Processing 256llamafile: mistral-7b-instruct-v0.2.Q5_K_M - Prompt Processing 512llamafile: mistral-7b-instruct-v0.2.Q5_K_M - Prompt Processing 1024llamafile: mistral-7b-instruct-v0.2.Q5_K_M - Prompt Processing 2048llamafile: wizardcoder-python-34b-v1.0.Q6_K - Prompt Processing 256llamafile: wizardcoder-python-34b-v1.0.Q6_K - Prompt Processing 512llamafile: wizardcoder-python-34b-v1.0.Q6_K - Prompt Processing 1024llamafile: wizardcoder-python-34b-v1.0.Q6_K - Prompt Processing 2048openvino-genai: Gemma-7b-int4-ov - CPUopenvino-genai: Gemma-7b-int4-ov - CPU - Time To First Tokenopenvino-genai: Gemma-7b-int4-ov - CPU - Time Per Output Tokenopenvino-genai: TinyLlama-1.1B-Chat-v1.0 - CPUopenvino-genai: TinyLlama-1.1B-Chat-v1.0 - CPU - Time To First Tokenopenvino-genai: TinyLlama-1.1B-Chat-v1.0 - CPU - Time Per Output Tokenopenvino-genai: Falcon-7b-instruct-int4-ov - CPUopenvino-genai: Falcon-7b-instruct-int4-ov - CPU - Time To First Tokenopenvino-genai: Falcon-7b-instruct-int4-ov - CPU - Time Per Output Tokenopenvino-genai: Phi-3-mini-128k-instruct-int4-ov - CPUopenvino-genai: Phi-3-mini-128k-instruct-int4-ov - CPU - Time To First Tokenopenvino-genai: Phi-3-mini-128k-instruct-int4-ov - CPU - Time Per Output Tokenv6.11v6.12v6.13 7 Dec297.99561.91529.232481.489176.67337822093307749991053743210416.88060.171199.209466.61421.792194.338101.821159.8191.99925.036718106876590359931303710333162995897487834985450770.47804.06801.19103.228363.527354.5266349272450706791923339108522944120235440585224115352.497421710.2412696519.854368818369341296719209847836480.16746213790.2171268776.3051176778.4982071.984154651.852054.7045376718.94233159294.1479773.3747424.8736748330.5415.1920.2442.0321.66149.3047.90483952108.22112.5640968192152.071638432768159.9064.874096819268.1314.98163843276815.904096819216384327681536307261441228849.1330.3920.3678.3615.8612.7656.7330.3917.6365.8922.6615.18303.11565.10775.110655.184179.86837552083303549681038741204916.99060.381200.316468.66621.848193.202101.599160.3021.99024.972721616676910361564053870334486696117490511085203765.59801.90799.99104.163371.288333.1786280225950456797937335116722584326230340715514064048.147297642.2113294800.594358118119239941718353748156250.16647327530.2111221816.5501120258.9272298.654313954.942010.9945398166.14251549880.0182674.9847501.0455755486.3215.0820.2141.7421.49148.8247.70491186107.95111.9840968192152.891638432768159.6064.804096819267.7115.01163843276815.824096819216384327681536307261441228849.0930.2720.3778.1815.8912.7956.2130.0017.8065.8222.7315.19300.72565.14764.024509.126172.48237632102304949571055742201017.00860.821200.823480.91221.855192.923101.725160.5591.98824.939719980763180361324888880334428157450489486102253774.01803.49807.27100.140360.826311.0386331265150576793938338108922783631228340194934099640.317400996.9813514659.674293617990938698315830448292550.16547355780.2111207036.6281101129.0822385.594398887.772125.1343186401.84246944948.4681582.5847238.7053038526.0015.0220.2041.4921.35148.1647.39487743102.21109.6040968192147.981638432768156.8264.154096819265.4514.90163843276815.774096819216384327681536307261441228848.7030.4820.5477.6716.0512.8856.2830.1817.7765.9122.3815.17OpenBenchmarking.org

Laghos

OpenBenchmarking.orgMajor Kernels Total Rate, More Is BetterLaghos 3.1Test: Triple Point Problemv6.13 7 Decv6.12v6.1170140210280350SE +/- 3.23, N = 3SE +/- 1.53, N = 3SE +/- 3.08, N = 3300.72303.11297.991. (CXX) g++ options: -O3 -std=c++11 -lmfem -lHYPRE -lmetis -lrt -lmpi_cxx -lmpi

OpenBenchmarking.orgMajor Kernels Total Rate, More Is BetterLaghos 3.1Test: Sedov Blast Wave, ube_922_hex.meshv6.13 7 Decv6.12v6.11120240360480600SE +/- 2.95, N = 3SE +/- 2.47, N = 3SE +/- 3.27, N = 3565.14565.10561.911. (CXX) g++ options: -O3 -std=c++11 -lmfem -lHYPRE -lmetis -lrt -lmpi_cxx -lmpi

Palabos

OpenBenchmarking.orgMega Site Updates Per Second, More Is BetterPalabos 2.3Grid Size: 500v6.13 7 Decv6.12v6.112004006008001000SE +/- 5.28, N = 3SE +/- 1.19, N = 3SE +/- 40.67, N = 12764.02775.11529.231. (CXX) g++ options: -std=c++17 -pedantic -O3 -rdynamic -lcrypto -lcurl -lsz -lz -ldl -lm

OpenBenchmarking.orgMega Site Updates Per Second, More Is BetterPalabos 2.3Grid Size: 1000v6.13 7 Decv6.12v6.11140280420560700SE +/- 21.98, N = 15SE +/- 36.69, N = 12SE +/- 3.07, N = 15509.13655.18481.491. (CXX) g++ options: -std=c++17 -pedantic -O3 -rdynamic -lcrypto -lcurl -lsz -lz -ldl -lm

RELION

OpenBenchmarking.orgSeconds, Fewer Is BetterRELION 5.0Test: Basic - Device: CPUv6.13 7 Decv6.12v6.114080120160200SE +/- 3.31, N = 12SE +/- 0.79, N = 3SE +/- 1.95, N = 3172.48179.87176.671. (CXX) g++ options: -fPIC -std=c++14 -fopenmp -O3 -rdynamic -ldl -ltiff -lfftw3f -lfftw3 -lpng -ljpeg -lmpi_cxx -lmpi

DaCapo Benchmark

This test runs the DaCapo Benchmarks written in Java and intended to test system/CPU performance of various popular real-world Java workloads. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgmsec, Fewer Is BetterDaCapo Benchmark 23.11Java Test: Jythonv6.13 7 Decv6.12v6.118001600240032004000SE +/- 11.00, N = 3SE +/- 5.33, N = 3SE +/- 6.67, N = 3376337553782

OpenBenchmarking.orgmsec, Fewer Is BetterDaCapo Benchmark 23.11Java Test: GraphChiv6.13 7 Decv6.12v6.115001000150020002500SE +/- 6.00, N = 3SE +/- 5.51, N = 3SE +/- 13.86, N = 3210220832093

OpenBenchmarking.orgmsec, Fewer Is BetterDaCapo Benchmark 23.11Java Test: Tradesoapv6.13 7 Decv6.12v6.117001400210028003500SE +/- 31.71, N = 5SE +/- 21.97, N = 15SE +/- 24.92, N = 3304930353077

OpenBenchmarking.orgmsec, Fewer Is BetterDaCapo Benchmark 23.11Java Test: Tradebeansv6.13 7 Decv6.12v6.1111002200330044005500SE +/- 100.21, N = 12SE +/- 76.59, N = 15SE +/- 48.79, N = 15495749684999

OpenBenchmarking.orgmsec, Fewer Is BetterDaCapo Benchmark 23.11Java Test: Apache Tomcatv6.13 7 Decv6.12v6.112004006008001000SE +/- 2.00, N = 3SE +/- 3.51, N = 3SE +/- 7.81, N = 3105510381053

OpenBenchmarking.orgmsec, Fewer Is BetterDaCapo Benchmark 23.11Java Test: Apache Xalan XSLTv6.13 7 Decv6.12v6.11160320480640800SE +/- 8.54, N = 3SE +/- 1.76, N = 3SE +/- 6.06, N = 3742741743

OpenBenchmarking.orgmsec, Fewer Is BetterDaCapo Benchmark 23.11Java Test: H2 Database Enginev6.13 7 Decv6.12v6.115001000150020002500SE +/- 18.21, N = 3SE +/- 13.65, N = 3SE +/- 28.09, N = 3201020492104

SVT-AV1

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 2.3Encoder Mode: Preset 3 - Input: Bosphorus 4Kv6.13 7 Decv6.12v6.1148121620SE +/- 0.02, N = 3SE +/- 0.04, N = 3SE +/- 0.08, N = 317.0116.9916.881. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 2.3Encoder Mode: Preset 5 - Input: Bosphorus 4Kv6.13 7 Decv6.12v6.111428425670SE +/- 0.08, N = 3SE +/- 0.12, N = 3SE +/- 0.07, N = 360.8260.3860.171. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 2.3Encoder Mode: Preset 8 - Input: Bosphorus 4Kv6.13 7 Decv6.12v6.114080120160200SE +/- 0.64, N = 3SE +/- 1.77, N = 3SE +/- 1.84, N = 3200.82200.32199.211. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 2.3Encoder Mode: Preset 13 - Input: Bosphorus 4Kv6.13 7 Decv6.12v6.11100200300400500SE +/- 0.44, N = 3SE +/- 1.95, N = 3SE +/- 3.40, N = 3480.91468.67466.611. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

Timed Linux Kernel Compilation

This test times how long it takes to build the Linux kernel in a default configuration (defconfig) for the architecture being tested or alternatively an allmodconfig for building all possible kernel modules for the build. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed Linux Kernel Compilation 6.8Build: defconfigv6.13 7 Decv6.12v6.11510152025SE +/- 0.26, N = 4SE +/- 0.31, N = 3SE +/- 0.25, N = 421.8621.8521.79

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed Linux Kernel Compilation 6.8Build: allmodconfigv6.13 7 Decv6.12v6.114080120160200SE +/- 0.25, N = 3SE +/- 0.34, N = 3SE +/- 0.21, N = 3192.92193.20194.34

Timed LLVM Compilation

This test times how long it takes to compile/build the LLVM compiler stack. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed LLVM Compilation 16.0Build System: Ninjav6.13 7 Decv6.12v6.1120406080100SE +/- 0.19, N = 3SE +/- 0.06, N = 3SE +/- 0.11, N = 3101.73101.60101.82

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed LLVM Compilation 16.0Build System: Unix Makefilesv6.13 7 Decv6.12v6.114080120160200SE +/- 0.86, N = 3SE +/- 0.33, N = 3SE +/- 0.34, N = 3160.56160.30159.82

Primesieve

OpenBenchmarking.orgSeconds, Fewer Is BetterPrimesieve 12.6Length: 1e12v6.13 7 Decv6.12v6.110.44980.89961.34941.79922.249SE +/- 0.002, N = 3SE +/- 0.001, N = 3SE +/- 0.003, N = 31.9881.9901.9991. (CXX) g++ options: -O3

OpenBenchmarking.orgSeconds, Fewer Is BetterPrimesieve 12.6Length: 1e13v6.13 7 Decv6.12v6.11612182430SE +/- 0.02, N = 3SE +/- 0.03, N = 3SE +/- 0.04, N = 324.9424.9725.041. (CXX) g++ options: -O3

OpenSSL

OpenBenchmarking.orgbyte/s, More Is BetterOpenSSLAlgorithm: ChaCha20v6.13 7 Decv6.12v6.11160000M320000M480000M640000M800000MSE +/- 626958911.68, N = 3SE +/- 2136131841.14, N = 3SE +/- 652717270.91, N = 37199807631807246118325807181068765901. OpenSSL 3.3.1 4 Jun 2024 (Library: OpenSSL 3.3.1 4 Jun 2024) - Additional Parameters: -engine qatengine -async_jobs 8

OpenBenchmarking.orgbyte/s, More Is BetterOpenSSLAlgorithm: AES-128-GCMv6.13 7 Decv6.12v6.1180000M160000M240000M320000M400000MSE +/- 88875000.56, N = 3SE +/- 158067306.31, N = 3SE +/- 130266226.11, N = 33613248888803615640538703599313037101. OpenSSL 3.3.1 4 Jun 2024 (Library: OpenSSL 3.3.1 4 Jun 2024) - Additional Parameters: -engine qatengine -async_jobs 8

OpenBenchmarking.orgbyte/s, More Is BetterOpenSSLAlgorithm: AES-256-GCMv6.13 7 Decv6.12v6.1170000M140000M210000M280000M350000MSE +/- 134252719.45, N = 3SE +/- 47580595.33, N = 3SE +/- 105448439.59, N = 33344281574503344866961173331629958971. OpenSSL 3.3.1 4 Jun 2024 (Library: OpenSSL 3.3.1 4 Jun 2024) - Additional Parameters: -engine qatengine -async_jobs 8

OpenBenchmarking.orgbyte/s, More Is BetterOpenSSLAlgorithm: ChaCha20-Poly1305v6.13 7 Decv6.12v6.11110000M220000M330000M440000M550000MSE +/- 158903312.00, N = 3SE +/- 118571563.57, N = 3SE +/- 271433364.08, N = 34894861022534905110852034878349854501. OpenSSL 3.3.1 4 Jun 2024 (Library: OpenSSL 3.3.1 4 Jun 2024) - Additional Parameters: -engine qatengine -async_jobs 8

ClickHouse

ClickHouse is an open-source, high performance OLAP data management system. This test profile uses ClickHouse's standard benchmark recommendations per https://clickhouse.com/docs/en/operations/performance-test/ / https://github.com/ClickHouse/ClickBench/tree/main/clickhouse with the 100 million rows web analytics dataset. The reported value is the query processing time using the geometric mean of all separate queries performed as an aggregate. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgQueries Per Minute, Geo Mean, More Is BetterClickHouse 22.12.3.5100M Rows Hits Dataset, First Run / Cold Cachev6.13 7 Decv6.12v6.112004006008001000SE +/- 2.84, N = 3SE +/- 3.20, N = 3SE +/- 2.38, N = 3774.01776.70770.47MIN: 65.86 / MAX: 7500MIN: 65.22 / MAX: 8571.43MIN: 65.15 / MAX: 8571.43

OpenBenchmarking.orgQueries Per Minute, Geo Mean, More Is BetterClickHouse 22.12.3.5100M Rows Hits Dataset, Second Runv6.13 7 Decv6.12v6.112004006008001000SE +/- 8.62, N = 3SE +/- 3.55, N = 3SE +/- 4.73, N = 3803.49801.90804.06MIN: 66.08 / MAX: 10000MIN: 65.79 / MAX: 8571.43MIN: 65.15 / MAX: 10000

OpenBenchmarking.orgQueries Per Minute, Geo Mean, More Is BetterClickHouse 22.12.3.5100M Rows Hits Dataset, Third Runv6.13 7 Decv6.12v6.112004006008001000SE +/- 2.96, N = 3SE +/- 3.72, N = 3SE +/- 4.79, N = 3807.27800.56801.19MIN: 66.01 / MAX: 8571.43MIN: 63.63 / MAX: 10000MIN: 65.5 / MAX: 8571.43

Apache CouchDB

OpenBenchmarking.orgSeconds, Fewer Is BetterApache CouchDB 3.4.1Bulk Size: 300 - Inserts: 1000 - Rounds: 30v6.13 7 Decv6.12v6.1120406080100SE +/- 0.87, N = 7SE +/- 0.71, N = 3SE +/- 1.11, N = 3100.14104.16103.231. (CXX) g++ options: -flto -lstdc++ -shared -lei

OpenBenchmarking.orgSeconds, Fewer Is BetterApache CouchDB 3.4.1Bulk Size: 300 - Inserts: 3000 - Rounds: 30v6.13 7 Decv6.12v6.1180160240320400SE +/- 3.45, N = 9SE +/- 12.48, N = 9SE +/- 6.26, N = 9360.83371.29363.531. (CXX) g++ options: -flto -lstdc++ -shared -lei

OpenBenchmarking.orgSeconds, Fewer Is BetterApache CouchDB 3.4.1Bulk Size: 500 - Inserts: 1000 - Rounds: 30v6.13 7 Decv6.12v6.1180160240320400SE +/- 29.09, N = 7SE +/- 36.20, N = 9SE +/- 62.71, N = 8311.04333.18354.531. (CXX) g++ options: -flto -lstdc++ -shared -lei

DaCapo Benchmark

This test runs the DaCapo Benchmarks written in Java and intended to test system/CPU performance of various popular real-world Java workloads. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgmsec, Fewer Is BetterDaCapo Benchmark 23.11Java Test: Eclipsev6.13 7 Decv6.12v6.1114002800420056007000SE +/- 23.78, N = 3SE +/- 33.39, N = 3SE +/- 14.75, N = 3633162806349

OpenBenchmarking.orgmsec, Fewer Is BetterDaCapo Benchmark 23.11Java Test: Spring Bootv6.13 7 Decv6.12v6.116001200180024003000SE +/- 26.77, N = 3SE +/- 20.60, N = 3SE +/- 17.89, N = 3265122592724

OpenBenchmarking.orgmsec, Fewer Is BetterDaCapo Benchmark 23.11Java Test: Apache Kafkav6.13 7 Decv6.12v6.1111002200330044005500SE +/- 3.53, N = 3SE +/- 26.64, N = 3SE +/- 7.33, N = 3505750455070

OpenBenchmarking.orgmsec, Fewer Is BetterDaCapo Benchmark 23.11Java Test: jMonkeyEnginev6.13 7 Decv6.12v6.1115003000450060007500SE +/- 1.86, N = 3SE +/- 4.84, N = 3SE +/- 1.86, N = 3679367976791

OpenBenchmarking.orgmsec, Fewer Is BetterDaCapo Benchmark 23.11Java Test: Batik SVG Toolkitv6.13 7 Decv6.12v6.112004006008001000SE +/- 7.55, N = 3SE +/- 4.00, N = 3SE +/- 3.61, N = 3938937923

OpenBenchmarking.orgmsec, Fewer Is BetterDaCapo Benchmark 23.11Java Test: FOP Print Formatterv6.13 7 Decv6.12v6.1170140210280350SE +/- 1.20, N = 3SE +/- 2.08, N = 3SE +/- 0.67, N = 3338335339

OpenBenchmarking.orgmsec, Fewer Is BetterDaCapo Benchmark 23.11Java Test: PMD Source Code Analyzerv6.13 7 Decv6.12v6.1130060090012001500SE +/- 18.53, N = 15SE +/- 23.97, N = 15SE +/- 5.90, N = 3108911671085

OpenBenchmarking.orgmsec, Fewer Is BetterDaCapo Benchmark 23.11Java Test: Apache Lucene Search Indexv6.13 7 Decv6.12v6.115001000150020002500SE +/- 25.32, N = 3SE +/- 8.39, N = 3SE +/- 16.64, N = 3227822582294

OpenBenchmarking.orgmsec, Fewer Is BetterDaCapo Benchmark 23.11Java Test: Apache Lucene Search Enginev6.13 7 Decv6.12v6.119001800270036004500SE +/- 42.57, N = 3SE +/- 47.07, N = 3SE +/- 43.31, N = 15363143264120

OpenBenchmarking.orgmsec, Fewer Is BetterDaCapo Benchmark 23.11Java Test: Avrora AVR Simulation Frameworkv6.13 7 Decv6.12v6.115001000150020002500SE +/- 20.72, N = 15SE +/- 15.56, N = 13SE +/- 16.90, N = 3228323032354

OpenBenchmarking.orgmsec, Fewer Is BetterDaCapo Benchmark 23.11Java Test: BioJava Biological Data Frameworkv6.13 7 Decv6.12v6.119001800270036004500SE +/- 22.00, N = 3SE +/- 18.98, N = 3SE +/- 11.89, N = 3401940714058

OpenBenchmarking.orgmsec, Fewer Is BetterDaCapo Benchmark 23.11Java Test: Zxing 1D/2D Barcode Image Processingv6.13 7 Decv6.12v6.11120240360480600SE +/- 5.55, N = 3SE +/- 4.38, N = 9SE +/- 4.26, N = 3493551522

Memcached

Memcached is a high performance, distributed memory object caching system. This Memcached test profiles makes use of memtier_benchmark for excuting this CPU/memory-focused server benchmark. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgOps/sec, More Is BetterMemcached 1.6.19Set To Get Ratio: 1:5v6.13 7 Decv6.12v6.11900K1800K2700K3600K4500KSE +/- 28528.57, N = 3SE +/- 16085.40, N = 3SE +/- 26467.49, N = 34099640.314064048.144115352.491. (CXX) g++ options: -O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre

OpenBenchmarking.orgOps/sec, More Is BetterMemcached 1.6.19Set To Get Ratio: 1:10v6.13 7 Decv6.12v6.111.6M3.2M4.8M6.4M8MSE +/- 37597.18, N = 3SE +/- 30399.87, N = 3SE +/- 35717.40, N = 37400996.987297642.217421710.241. (CXX) g++ options: -O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre

OpenBenchmarking.orgOps/sec, More Is BetterMemcached 1.6.19Set To Get Ratio: 1:100v6.13 7 Decv6.12v6.113M6M9M12M15MSE +/- 24482.38, N = 3SE +/- 15384.68, N = 3SE +/- 13756.93, N = 313514659.6713294800.5912696519.851. (CXX) g++ options: -O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre

MariaDB

This is a MariaDB MySQL database server benchmark making use of sysbench rather than the existing pts/mysqlslap test profile that uses MariaDB with mysqlslap/mariadb-slap as the benchmark driver. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgQueries Per Second, More Is BetterMariaDB 11.5Test: oltp_read_only - Threads: 128v6.13 7 Decv6.12v6.119K18K27K36K45KSE +/- 18.45, N = 3SE +/- 15.19, N = 3SE +/- 14.78, N = 34293643581436881. (CXX) g++ options: -pie -fPIC -fstack-protector -O3 -lnuma -lpcre2-8 -lcrypt -laio -lz -lm -lssl -lcrypto -lpthread -ldl

OpenBenchmarking.orgQueries Per Second, More Is BetterMariaDB 11.5Test: oltp_read_write - Threads: 128v6.13 7 Decv6.12v6.1140K80K120K160K200KSE +/- 77.99, N = 3SE +/- 60.34, N = 3SE +/- 155.52, N = 31799091811921836931. (CXX) g++ options: -pie -fPIC -fstack-protector -O3 -lnuma -lpcre2-8 -lcrypt -laio -lz -lm -lssl -lcrypto -lpthread -ldl

OpenBenchmarking.orgQueries Per Second, More Is BetterMariaDB 11.5Test: oltp_write_only - Threads: 128v6.13 7 Decv6.12v6.1190K180K270K360K450KSE +/- 154.44, N = 3SE +/- 474.96, N = 3SE +/- 286.92, N = 33869833994174129671. (CXX) g++ options: -pie -fPIC -fstack-protector -O3 -lnuma -lpcre2-8 -lcrypt -laio -lz -lm -lssl -lcrypto -lpthread -ldl

OpenBenchmarking.orgQueries Per Second, More Is BetterMariaDB 11.5Test: oltp_update_index - Threads: 128v6.13 7 Decv6.12v6.1140K80K120K160K200KSE +/- 112.30, N = 3SE +/- 76.99, N = 3SE +/- 123.94, N = 31583041835371920981. (CXX) g++ options: -pie -fPIC -fstack-protector -O3 -lnuma -lpcre2-8 -lcrypt -laio -lz -lm -lssl -lcrypto -lpthread -ldl

PostgreSQL

OpenBenchmarking.orgTPS, More Is BetterPostgreSQL 17Scaling Factor: 100 - Clients: 800 - Mode: Read Onlyv6.13 7 Decv6.12v6.111000K2000K3000K4000K5000KSE +/- 8981.60, N = 3SE +/- 9902.78, N = 3SE +/- 11484.93, N = 34829255481562547836481. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpq -lpgcommon -lpgport -lm

OpenBenchmarking.orgms, Fewer Is BetterPostgreSQL 17Scaling Factor: 100 - Clients: 800 - Mode: Read Only - Average Latencyv6.13 7 Decv6.12v6.110.03760.07520.11280.15040.188SE +/- 0.000, N = 3SE +/- 0.000, N = 3SE +/- 0.001, N = 30.1650.1660.1671. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpq -lpgcommon -lpgport -lm

OpenBenchmarking.orgTPS, More Is BetterPostgreSQL 17Scaling Factor: 100 - Clients: 1000 - Mode: Read Onlyv6.13 7 Decv6.12v6.111000K2000K3000K4000K5000KSE +/- 9098.55, N = 3SE +/- 18553.35, N = 3SE +/- 23812.59, N = 34735578473275346213791. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpq -lpgcommon -lpgport -lm

OpenBenchmarking.orgms, Fewer Is BetterPostgreSQL 17Scaling Factor: 100 - Clients: 1000 - Mode: Read Only - Average Latencyv6.13 7 Decv6.12v6.110.04880.09760.14640.19520.244SE +/- 0.001, N = 3SE +/- 0.001, N = 3SE +/- 0.001, N = 30.2110.2110.2171. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpq -lpgcommon -lpgport -lm

OpenBenchmarking.orgTPS, More Is BetterPostgreSQL 17Scaling Factor: 100 - Clients: 800 - Mode: Read Writev6.13 7 Decv6.12v6.1130K60K90K120K150KSE +/- 536.64, N = 3SE +/- 1549.82, N = 3SE +/- 594.42, N = 31207031221811268771. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpq -lpgcommon -lpgport -lm

OpenBenchmarking.orgms, Fewer Is BetterPostgreSQL 17Scaling Factor: 100 - Clients: 800 - Mode: Read Write - Average Latencyv6.13 7 Decv6.12v6.11246810SE +/- 0.030, N = 3SE +/- 0.082, N = 3SE +/- 0.030, N = 36.6286.5506.3051. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpq -lpgcommon -lpgport -lm

OpenBenchmarking.orgTPS, More Is BetterPostgreSQL 17Scaling Factor: 100 - Clients: 1000 - Mode: Read Writev6.13 7 Decv6.12v6.1130K60K90K120K150KSE +/- 515.38, N = 3SE +/- 604.26, N = 3SE +/- 274.82, N = 31101121120251176771. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpq -lpgcommon -lpgport -lm

OpenBenchmarking.orgms, Fewer Is BetterPostgreSQL 17Scaling Factor: 100 - Clients: 1000 - Mode: Read Write - Average Latencyv6.13 7 Decv6.12v6.113691215SE +/- 0.042, N = 3SE +/- 0.048, N = 3SE +/- 0.020, N = 39.0828.9278.4981. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpq -lpgcommon -lpgport -lm

Stress-NG

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.17.08Test: NUMAv6.13 7 Decv6.12v6.115001000150020002500SE +/- 10.25, N = 3SE +/- 1.02, N = 3SE +/- 6.78, N = 32385.592298.652071.981. (CXX) g++ options: -O2 -std=gnu99 -lc -lm

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.17.08Test: Futexv6.13 7 Decv6.12v6.11900K1800K2700K3600K4500KSE +/- 31680.82, N = 3SE +/- 15124.18, N = 3SE +/- 17548.84, N = 34398887.774313954.944154651.851. (CXX) g++ options: -O2 -std=gnu99 -lc -lm

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.17.08Test: MEMFDv6.13 7 Decv6.12v6.115001000150020002500SE +/- 3.27, N = 3SE +/- 2.72, N = 3SE +/- 4.79, N = 32125.132010.992054.701. (CXX) g++ options: -O2 -std=gnu99 -lc -lm

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.17.08Test: Mutexv6.13 7 Decv6.12v6.1110M20M30M40M50MSE +/- 188378.96, N = 3SE +/- 442253.04, N = 3SE +/- 181454.22, N = 343186401.8445398166.1445376718.941. (CXX) g++ options: -O2 -std=gnu99 -lc -lm

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.17.08Test: Semaphoresv6.13 7 Decv6.12v6.1150M100M150M200M250MSE +/- 1084579.30, N = 3SE +/- 3074547.79, N = 3SE +/- 2150155.18, N = 15246944948.46251549880.01233159294.141. (CXX) g++ options: -O2 -std=gnu99 -lc -lm

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.17.08Test: Mixed Schedulerv6.13 7 Decv6.12v6.1120K40K60K80K100KSE +/- 282.83, N = 3SE +/- 215.02, N = 3SE +/- 161.54, N = 381582.5882674.9879773.371. (CXX) g++ options: -O2 -std=gnu99 -lc -lm

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.17.08Test: Socket Activityv6.13 7 Decv6.12v6.1110K20K30K40K50KSE +/- 42.06, N = 3SE +/- 68.22, N = 3SE +/- 29.82, N = 347238.7047501.0447424.871. (CXX) g++ options: -O2 -std=gnu99 -lc -lm

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.17.08Test: Context Switchingv6.13 7 Decv6.12v6.1112M24M36M48M60MSE +/- 159927.59, N = 3SE +/- 64836.17, N = 3SE +/- 247154.69, N = 1353038526.0055755486.3236748330.541. (CXX) g++ options: -O2 -std=gnu99 -lc -lm

Blender

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 4.3Blend File: BMW27 - Compute: CPU-Onlyv6.13 7 Decv6.12v6.1148121620SE +/- 0.04, N = 3SE +/- 0.05, N = 3SE +/- 0.00, N = 315.0215.0815.19

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 4.3Blend File: Junkshop - Compute: CPU-Onlyv6.13 7 Decv6.12v6.11510152025SE +/- 0.06, N = 3SE +/- 0.06, N = 3SE +/- 0.04, N = 320.2020.2120.24

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 4.3Blend File: Classroom - Compute: CPU-Onlyv6.13 7 Decv6.12v6.111020304050SE +/- 0.04, N = 3SE +/- 0.05, N = 3SE +/- 0.01, N = 341.4941.7442.03

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 4.3Blend File: Fishy Cat - Compute: CPU-Onlyv6.13 7 Decv6.12v6.11510152025SE +/- 0.06, N = 3SE +/- 0.06, N = 3SE +/- 0.12, N = 321.3521.4921.66

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 4.3Blend File: Barbershop - Compute: CPU-Onlyv6.13 7 Decv6.12v6.11306090120150SE +/- 0.23, N = 3SE +/- 0.18, N = 3SE +/- 0.08, N = 3148.16148.82149.30

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 4.3Blend File: Pabellon Barcelona - Compute: CPU-Onlyv6.13 7 Decv6.12v6.111122334455SE +/- 0.02, N = 3SE +/- 0.08, N = 3SE +/- 0.05, N = 347.3947.7047.90

Apache Cassandra

OpenBenchmarking.orgOp/s, More Is BetterApache Cassandra 5.0Test: Writesv6.13 7 Decv6.12v6.11110K220K330K440K550KSE +/- 4648.88, N = 3SE +/- 1282.82, N = 3SE +/- 5140.53, N = 3487743491186483952

Llamafile

OpenBenchmarking.orgTokens Per Second, More Is BetterLlamafile 0.8.16Model: Llama-3.2-3B-Instruct.Q6_K - Test: Text Generation 16v6.13 7 Decv6.12v6.1120406080100SE +/- 2.52, N = 14SE +/- 2.55, N = 12SE +/- 2.48, N = 12102.21107.95108.22

OpenBenchmarking.orgTokens Per Second, More Is BetterLlamafile 0.8.16Model: Llama-3.2-3B-Instruct.Q6_K - Test: Text Generation 128v6.13 7 Decv6.12v6.11306090120150SE +/- 1.53, N = 3SE +/- 1.04, N = 3SE +/- 0.87, N = 3109.60111.98112.56

OpenBenchmarking.orgTokens Per Second, More Is BetterLlamafile 0.8.16Model: Llama-3.2-3B-Instruct.Q6_K - Test: Prompt Processing 256v6.13 7 Decv6.12v6.119001800270036004500SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3409640964096

OpenBenchmarking.orgTokens Per Second, More Is BetterLlamafile 0.8.16Model: Llama-3.2-3B-Instruct.Q6_K - Test: Prompt Processing 512v6.13 7 Decv6.12v6.112K4K6K8K10KSE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3819281928192

OpenBenchmarking.orgTokens Per Second, More Is BetterLlamafile 0.8.16Model: TinyLlama-1.1B-Chat-v1.0.BF16 - Test: Text Generation 16v6.13 7 Decv6.12v6.11306090120150SE +/- 4.35, N = 12SE +/- 4.63, N = 12SE +/- 4.56, N = 12147.98152.89152.07

OpenBenchmarking.orgTokens Per Second, More Is BetterLlamafile 0.8.16Model: Llama-3.2-3B-Instruct.Q6_K - Test: Prompt Processing 1024v6.13 7 Decv6.12v6.114K8K12K16K20KSE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3163841638416384

OpenBenchmarking.orgTokens Per Second, More Is BetterLlamafile 0.8.16Model: Llama-3.2-3B-Instruct.Q6_K - Test: Prompt Processing 2048v6.13 7 Decv6.12v6.117K14K21K28K35KSE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3327683276832768

OpenBenchmarking.orgTokens Per Second, More Is BetterLlamafile 0.8.16Model: TinyLlama-1.1B-Chat-v1.0.BF16 - Test: Text Generation 128v6.13 7 Decv6.12v6.114080120160200SE +/- 1.45, N = 15SE +/- 1.26, N = 3SE +/- 1.11, N = 3156.82159.60159.90

OpenBenchmarking.orgTokens Per Second, More Is BetterLlamafile 0.8.16Model: mistral-7b-instruct-v0.2.Q5_K_M - Test: Text Generation 16v6.13 7 Decv6.12v6.111428425670SE +/- 1.70, N = 12SE +/- 1.75, N = 12SE +/- 1.73, N = 1264.1564.8064.87

OpenBenchmarking.orgTokens Per Second, More Is BetterLlamafile 0.8.16Model: TinyLlama-1.1B-Chat-v1.0.BF16 - Test: Prompt Processing 256v6.13 7 Decv6.12v6.119001800270036004500SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3409640964096

OpenBenchmarking.orgTokens Per Second, More Is BetterLlamafile 0.8.16Model: TinyLlama-1.1B-Chat-v1.0.BF16 - Test: Prompt Processing 512v6.13 7 Decv6.12v6.112K4K6K8K10KSE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3819281928192

OpenBenchmarking.orgTokens Per Second, More Is BetterLlamafile 0.8.16Model: mistral-7b-instruct-v0.2.Q5_K_M - Test: Text Generation 128v6.13 7 Decv6.12v6.111530456075SE +/- 0.36, N = 3SE +/- 0.47, N = 3SE +/- 0.37, N = 365.4567.7168.13

OpenBenchmarking.orgTokens Per Second, More Is BetterLlamafile 0.8.16Model: wizardcoder-python-34b-v1.0.Q6_K - Test: Text Generation 16v6.13 7 Decv6.12v6.1148121620SE +/- 0.73, N = 12SE +/- 0.74, N = 12SE +/- 0.74, N = 1214.9015.0114.98

OpenBenchmarking.orgTokens Per Second, More Is BetterLlamafile 0.8.16Model: TinyLlama-1.1B-Chat-v1.0.BF16 - Test: Prompt Processing 1024v6.13 7 Decv6.12v6.114K8K12K16K20KSE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3163841638416384

OpenBenchmarking.orgTokens Per Second, More Is BetterLlamafile 0.8.16Model: TinyLlama-1.1B-Chat-v1.0.BF16 - Test: Prompt Processing 2048v6.13 7 Decv6.12v6.117K14K21K28K35KSE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3327683276832768

OpenBenchmarking.orgTokens Per Second, More Is BetterLlamafile 0.8.16Model: wizardcoder-python-34b-v1.0.Q6_K - Test: Text Generation 128v6.13 7 Decv6.12v6.1148121620SE +/- 0.02, N = 3SE +/- 0.04, N = 3SE +/- 0.02, N = 315.7715.8215.90

OpenBenchmarking.orgTokens Per Second, More Is BetterLlamafile 0.8.16Model: mistral-7b-instruct-v0.2.Q5_K_M - Test: Prompt Processing 256v6.13 7 Decv6.12v6.119001800270036004500SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3409640964096

OpenBenchmarking.orgTokens Per Second, More Is BetterLlamafile 0.8.16Model: mistral-7b-instruct-v0.2.Q5_K_M - Test: Prompt Processing 512v6.13 7 Decv6.12v6.112K4K6K8K10KSE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3819281928192

OpenBenchmarking.orgTokens Per Second, More Is BetterLlamafile 0.8.16Model: mistral-7b-instruct-v0.2.Q5_K_M - Test: Prompt Processing 1024v6.13 7 Decv6.12v6.114K8K12K16K20KSE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3163841638416384

OpenBenchmarking.orgTokens Per Second, More Is BetterLlamafile 0.8.16Model: mistral-7b-instruct-v0.2.Q5_K_M - Test: Prompt Processing 2048v6.13 7 Decv6.12v6.117K14K21K28K35KSE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3327683276832768

OpenBenchmarking.orgTokens Per Second, More Is BetterLlamafile 0.8.16Model: wizardcoder-python-34b-v1.0.Q6_K - Test: Prompt Processing 256v6.13 7 Decv6.12v6.1130060090012001500SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3153615361536

OpenBenchmarking.orgTokens Per Second, More Is BetterLlamafile 0.8.16Model: wizardcoder-python-34b-v1.0.Q6_K - Test: Prompt Processing 512v6.13 7 Decv6.12v6.117001400210028003500SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3307230723072

OpenBenchmarking.orgTokens Per Second, More Is BetterLlamafile 0.8.16Model: wizardcoder-python-34b-v1.0.Q6_K - Test: Prompt Processing 1024v6.13 7 Decv6.12v6.1113002600390052006500SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3614461446144

OpenBenchmarking.orgTokens Per Second, More Is BetterLlamafile 0.8.16Model: wizardcoder-python-34b-v1.0.Q6_K - Test: Prompt Processing 2048v6.13 7 Decv6.12v6.113K6K9K12K15KSE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3122881228812288

OpenVINO GenAI

OpenBenchmarking.orgtokens/s, More Is BetterOpenVINO GenAI 2024.5Model: Gemma-7b-int4-ov - Device: CPUv6.13 7 Decv6.12v6.111122334455SE +/- 0.27, N = 3SE +/- 0.10, N = 3SE +/- 0.15, N = 348.7049.0949.13

OpenBenchmarking.orgtokens/s, More Is BetterOpenVINO GenAI 2024.5Model: TinyLlama-1.1B-Chat-v1.0 - Device: CPUv6.13 7 Decv6.12v6.1120406080100SE +/- 0.28, N = 3SE +/- 0.23, N = 3SE +/- 0.57, N = 377.6778.1878.36

OpenBenchmarking.orgtokens/s, More Is BetterOpenVINO GenAI 2024.5Model: Falcon-7b-instruct-int4-ov - Device: CPUv6.13 7 Decv6.12v6.111326395265SE +/- 0.54, N = 3SE +/- 0.55, N = 6SE +/- 0.63, N = 356.2856.2156.73

OpenBenchmarking.orgtokens/s, More Is BetterOpenVINO GenAI 2024.5Model: Phi-3-mini-128k-instruct-int4-ov - Device: CPUv6.13 7 Decv6.12v6.111530456075SE +/- 0.79, N = 3SE +/- 0.10, N = 3SE +/- 0.41, N = 365.9165.8265.89

102 Results Shown

Laghos:
  Triple Point Problem
  Sedov Blast Wave, ube_922_hex.mesh
Palabos:
  500
  1000
RELION
DaCapo Benchmark:
  Jython
  GraphChi
  Tradesoap
  Tradebeans
  Apache Tomcat
  Apache Xalan XSLT
  H2 Database Engine
SVT-AV1:
  Preset 3 - Bosphorus 4K
  Preset 5 - Bosphorus 4K
  Preset 8 - Bosphorus 4K
  Preset 13 - Bosphorus 4K
Timed Linux Kernel Compilation:
  defconfig
  allmodconfig
Timed LLVM Compilation:
  Ninja
  Unix Makefiles
Primesieve:
  1e12
  1e13
OpenSSL:
  ChaCha20
  AES-128-GCM
  AES-256-GCM
  ChaCha20-Poly1305
ClickHouse:
  100M Rows Hits Dataset, First Run / Cold Cache
  100M Rows Hits Dataset, Second Run
  100M Rows Hits Dataset, Third Run
Apache CouchDB:
  300 - 1000 - 30
  300 - 3000 - 30
  500 - 1000 - 30
DaCapo Benchmark:
  Eclipse
  Spring Boot
  Apache Kafka
  jMonkeyEngine
  Batik SVG Toolkit
  FOP Print Formatter
  PMD Source Code Analyzer
  Apache Lucene Search Index
  Apache Lucene Search Engine
  Avrora AVR Simulation Framework
  BioJava Biological Data Framework
  Zxing 1D/2D Barcode Image Processing
Memcached:
  1:5
  1:10
  1:100
MariaDB:
  oltp_read_only - 128
  oltp_read_write - 128
  oltp_write_only - 128
  oltp_update_index - 128
PostgreSQL:
  100 - 800 - Read Only
  100 - 800 - Read Only - Average Latency
  100 - 1000 - Read Only
  100 - 1000 - Read Only - Average Latency
  100 - 800 - Read Write
  100 - 800 - Read Write - Average Latency
  100 - 1000 - Read Write
  100 - 1000 - Read Write - Average Latency
Stress-NG:
  NUMA
  Futex
  MEMFD
  Mutex
  Semaphores
  Mixed Scheduler
  Socket Activity
  Context Switching
Blender:
  BMW27 - CPU-Only
  Junkshop - CPU-Only
  Classroom - CPU-Only
  Fishy Cat - CPU-Only
  Barbershop - CPU-Only
  Pabellon Barcelona - CPU-Only
Apache Cassandra
Llamafile:
  Llama-3.2-3B-Instruct.Q6_K - Text Generation 16
  Llama-3.2-3B-Instruct.Q6_K - Text Generation 128
  Llama-3.2-3B-Instruct.Q6_K - Prompt Processing 256
  Llama-3.2-3B-Instruct.Q6_K - Prompt Processing 512
  TinyLlama-1.1B-Chat-v1.0.BF16 - Text Generation 16
  Llama-3.2-3B-Instruct.Q6_K - Prompt Processing 1024
  Llama-3.2-3B-Instruct.Q6_K - Prompt Processing 2048
  TinyLlama-1.1B-Chat-v1.0.BF16 - Text Generation 128
  mistral-7b-instruct-v0.2.Q5_K_M - Text Generation 16
  TinyLlama-1.1B-Chat-v1.0.BF16 - Prompt Processing 256
  TinyLlama-1.1B-Chat-v1.0.BF16 - Prompt Processing 512
  mistral-7b-instruct-v0.2.Q5_K_M - Text Generation 128
  wizardcoder-python-34b-v1.0.Q6_K - Text Generation 16
  TinyLlama-1.1B-Chat-v1.0.BF16 - Prompt Processing 1024
  TinyLlama-1.1B-Chat-v1.0.BF16 - Prompt Processing 2048
  wizardcoder-python-34b-v1.0.Q6_K - Text Generation 128
  mistral-7b-instruct-v0.2.Q5_K_M - Prompt Processing 256
  mistral-7b-instruct-v0.2.Q5_K_M - Prompt Processing 512
  mistral-7b-instruct-v0.2.Q5_K_M - Prompt Processing 1024
  mistral-7b-instruct-v0.2.Q5_K_M - Prompt Processing 2048
  wizardcoder-python-34b-v1.0.Q6_K - Prompt Processing 256
  wizardcoder-python-34b-v1.0.Q6_K - Prompt Processing 512
  wizardcoder-python-34b-v1.0.Q6_K - Prompt Processing 1024
  wizardcoder-python-34b-v1.0.Q6_K - Prompt Processing 2048
OpenVINO GenAI:
  Gemma-7b-int4-ov - CPU
  TinyLlama-1.1B-Chat-v1.0 - CPU
  Falcon-7b-instruct-int4-ov - CPU
  Phi-3-mini-128k-instruct-int4-ov - CPU