Linux 6.6 vs. Linux 6.12 LTS Comparison

Linux 6.12 LTS benchmarks by Michael Larabel for a future article.

HTML result view exported from: https://openbenchmarking.org/result/2412221-PTS-LINUXLTS14&sro.

Linux 6.6 vs. Linux 6.12 LTS ComparisonProcessorMotherboardChipsetMemoryDiskGraphicsAudioMonitorNetworkOSKernelDesktopDisplay ServerOpenGLCompilerFile-SystemScreen ResolutionLinux 6.6 LTSLinux 6.12 LTSAMD Ryzen Threadripper 7980X 64-Cores @ 5.37GHz (64 Cores / 128 Threads)System76 Thelio Major (FA Z5 BIOS)AMD Device 14a44 x 32GB DDR5-4800MT/s Micron MTC20F1045S1RC48BA21000GB CT1000T700SSD5AMD Radeon RX 6700 XT 12GBAMD Device 14ccDELL P2415QAquantia AQC113C NBase-T/IEEE + Realtek RTL8125 2.5GbE + Intel Wi-Fi 6EUbuntu 24.046.6.63-060663-generic (x86_64)GNOME Shell 46.0X Server + Wayland4.6 Mesa 24.0.9-0ubuntu0.2 (LLVM 17.0.6 DRM 3.54)GCC 13.3.0ext41920x12006.12.3-061203-generic (x86_64)4.6 Mesa 24.0.9-0ubuntu0.2 (LLVM 17.0.6 DRM 3.59)OpenBenchmarking.orgKernel Details- Transparent Huge Pages: madviseCompiler Details- --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-bootstrap --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-backtrace --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-link-serialization=2 --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-defaulted --enable-offload-targets=nvptx-none=/build/gcc-13-fG75Ri/gcc-13-13.3.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-13-fG75Ri/gcc-13-13.3.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-build-config=bootstrap-lto-lean --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v Processor Details- Linux 6.6 LTS: Scaling Governor: amd-pstate-epp powersave (EPP: balance_performance) - CPU Microcode: 0xa108105- Linux 6.12 LTS: Scaling Governor: amd-pstate-epp powersave (Boost: Enabled EPP: balance_performance) - CPU Microcode: 0xa108105 Graphics Details- Linux 6.6 LTS: BAR1 / Visible vRAM Size: 12272 MB - vBIOS Version: 113-D5121100-101- Linux 6.12 LTS: BAR1 / Visible vRAM Size: 12272 MBJava Details- OpenJDK Runtime Environment (build 21.0.5+11-Ubuntu-1ubuntu124.04)Python Details- Python 3.12.3Security Details- gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + reg_file_data_sampling: Not affected + retbleed: Not affected + spec_rstack_overflow: Mitigation of Safe RET + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS; IBPB: conditional; STIBP: always-on; RSB filling; PBRSB-eIBRS: Not affected; BHI: Not affected + srbds: Not affected + tsx_async_abort: Not affected

Linux 6.6 vs. Linux 6.12 LTS Comparisongravitymark: 1920 x 1200 - OpenGLgravitymark: 1920 x 1200 - Vulkanunigine-super: 1920 x 1200 - Fullscreen - Low - OpenGLunigine-super: 1920 x 1200 - Fullscreen - High - OpenGLunigine-super: 1920 x 1200 - Fullscreen - Medium - OpenGLunvanquished: 1920 x 1200 - Highunvanquished: 1920 x 1200 - Ultraunvanquished: 1920 x 1200 - Mediumbreaking-limit: 1920 x 1200 - Offparaview: Many Spheres - 600 - 1920 x 1200paraview: Many Spheres - 600 - 1920 x 1200paraview: Wavelet Volume - 600 - 1920 x 1200paraview: Wavelet Volume - 600 - 1920 x 1200paraview: Wavelet Contour - 600 - 1920 x 1200paraview: Wavelet Contour - 600 - 1920 x 1200wireguard: namd: ATPase with 327,506 Atomsnamd: STMV with 1,066,628 Atomsdacapobench: Jythondacapobench: Eclipsedacapobench: GraphChidacapobench: Tradesoapdacapobench: Tradebeansdacapobench: Spring Bootdacapobench: Apache Kafkadacapobench: Apache Tomcatdacapobench: jMonkeyEnginedacapobench: Apache Xalan XSLTdacapobench: Batik SVG Toolkitdacapobench: H2 Database Enginedacapobench: FOP Print Formatterdacapobench: PMD Source Code Analyzerdacapobench: Apache Lucene Search Indexdacapobench: Apache Lucene Search Enginedacapobench: Avrora AVR Simulation Frameworkdacapobench: BioJava Biological Data Frameworkdacapobench: Zxing 1D/2D Barcode Image Processingsrsran: PUSCH Processor Benchmark, Throughput Totalsvt-av1: Preset 3 - Bosphorus 4Ksvt-av1: Preset 5 - Bosphorus 4Ksvt-av1: Preset 8 - Bosphorus 4Ksvt-av1: Preset 13 - Bosphorus 4Kx265: Bosphorus 4Kx265: Bosphorus 1080pbuild-linux-kernel: defconfigbuild-linux-kernel: allmodconfighackbench: 16 - Threadhackbench: 16 - Processhackbench: 32 - Processmemcached: 1:5memcached: 1:10memcached: 1:100cryptsetup: PBKDF2-sha512cryptsetup: PBKDF2-whirlpoolcryptsetup: AES-XTS 256b Encryptioncryptsetup: AES-XTS 256b Decryptioncryptsetup: Serpent-XTS 256b Encryptioncryptsetup: Serpent-XTS 256b Decryptioncryptsetup: Twofish-XTS 256b Encryptioncryptsetup: Twofish-XTS 256b Decryptioncryptsetup: AES-XTS 512b Encryptioncryptsetup: AES-XTS 512b Decryptioncryptsetup: Serpent-XTS 512b Encryptioncryptsetup: Serpent-XTS 512b Decryptioncryptsetup: Twofish-XTS 512b Encryptioncryptsetup: Twofish-XTS 512b Decryptiongromacs: MPI CPU - water_GMX50_barelitert: SqueezeNetlitert: Inception V4litert: Mobilenet Floatpgbench: 100 - 800 - Read Onlypgbench: 100 - 800 - Read Only - Average Latencypgbench: 100 - 1000 - Read Onlypgbench: 100 - 1000 - Read Only - Average Latencypgbench: 100 - 800 - Read Writepgbench: 100 - 800 - Read Write - Average Latencypgbench: 100 - 1000 - Read Writepgbench: 100 - 1000 - Read Write - Average Latencysqlite-speedtest: Timed Time - Size 1,000stress-ng: SENDFILEstress-ng: Mixed Schedulerstress-ng: Socket Activitystress-ng: Context Switchingblender: BMW27 - CPU-Onlyblender: Junkshop - CPU-Onlyblender: Classroom - CPU-Onlyblender: Fishy Cat - CPU-Onlyblender: Barbershop - CPU-Onlyblender: Pabellon Barcelona - CPU-Onlyindigobench: CPU - Bedroomindigobench: CPU - Supercarcassandra: Writesrocksdb: Rand Readrocksdb: Update Randrocksdb: Read While Writingrocksdb: Read Rand Write Randllama-cpp: CPU BLAS - Llama-3.1-Tulu-3-8B-Q8_0 - Text Generation 128llama-cpp: CPU BLAS - Llama-3.1-Tulu-3-8B-Q8_0 - Prompt Processing 1024llama-cpp: CPU BLAS - Mistral-7B-Instruct-v0.3-Q8_0 - Text Generation 128llama-cpp: CPU BLAS - Mistral-7B-Instruct-v0.3-Q8_0 - Prompt Processing 1024llama-cpp: CPU BLAS - granite-3.0-3b-a800m-instruct-Q8_0 - Text Generation 128llama-cpp: CPU BLAS - granite-3.0-3b-a800m-instruct-Q8_0 - Prompt Processing 1024v-ray: CPUopenvino-genai: Gemma-7b-int4-ov - CPUopenvino-genai: Gemma-7b-int4-ov - CPU - Time To First Tokenopenvino-genai: Gemma-7b-int4-ov - CPU - Time Per Output Tokenopenvino-genai: TinyLlama-1.1B-Chat-v1.0 - CPUopenvino-genai: TinyLlama-1.1B-Chat-v1.0 - CPU - Time To First Tokenopenvino-genai: TinyLlama-1.1B-Chat-v1.0 - CPU - Time Per Output Tokenopenvino-genai: Falcon-7b-instruct-int4-ov - CPUopenvino-genai: Falcon-7b-instruct-int4-ov - CPU - Time To First Tokenopenvino-genai: Falcon-7b-instruct-int4-ov - CPU - Time Per Output Tokenopenvino-genai: Phi-3-mini-128k-instruct-int4-ov - CPUopenvino-genai: Phi-3-mini-128k-instruct-int4-ov - CPU - Time To First Tokenopenvino-genai: Phi-3-mini-128k-instruct-int4-ov - CPU - Time Per Output TokenLinux 6.6 LTSLinux 6.12 LTS198.2217.1239.4113.3157.1691.0687.2707.9132.37118.1311842.936411.436582.932289.733019.322273.2216.272071.64374429571692408555012081208554511157686372610241994430115526472817484446964855811.714.14048.375141.969232.45041.00116.9228.661278.32211.40311.13820.3353790466.166814926.29031077.6326270299424403972.83974.3946.0947.1592.3608.43662.23658.9958.4950.1597.7610.27.5443230.9326555.22129.6436380600.2236101090.2773287324.3363247630.79551.563710089.3538895.0029743.6511705033.6117.5724.4646.4023.63167.9754.2416.14535.79339907644022822053146311791885363718815.81110.8216.69111.1477.76186.8313503320.6657.0348.4245.0024.7122.2225.0049.8040.0035.6835.3728.03197.6218.4244.8111.7155.1678.6672.7689.2131.34120.9912130.232442.877085.921292.653049.796283.7326.427741.63324426770632463588412523200154521245688074410122034439117326702632492347684055875.713.97148.176140.938223.54440.93116.4127.986270.65610.70110.97519.8173741056.006600797.839379299.9826117769357325714.95735.2946.2939.9578.4596.15320.75324.1946.5936.5576.8595.97.5583287.5926660.62128.8937098120.21636914980.2713366423.7653333430.00049.7631006166.3039770.2230773.3222070300.1217.6524.1446.0623.58166.4754.1516.16535.45641805243961448752684411028127358795215.51120.9816.55117.1176.81232.3513579520.5357.1548.7045.1524.5522.1525.0849.7339.8735.6035.5728.09OpenBenchmarking.org

GravityMark

Resolution: 1920 x 1200 - Renderer: OpenGL

OpenBenchmarking.orgFrames Per Second, More Is BetterGravityMark 1.87Resolution: 1920 x 1200 - Renderer: OpenGLLinux 6.12 LTSLinux 6.6 LTS4080120160200SE +/- 0.17, N = 3SE +/- 0.03, N = 3197.6198.2

GravityMark

Resolution: 1920 x 1200 - Renderer: Vulkan

OpenBenchmarking.orgFrames Per Second, More Is BetterGravityMark 1.87Resolution: 1920 x 1200 - Renderer: VulkanLinux 6.12 LTSLinux 6.6 LTS50100150200250SE +/- 0.03, N = 3SE +/- 0.23, N = 3218.4217.1

Unigine Superposition

Resolution: 1920 x 1200 - Mode: Fullscreen - Quality: Low - Renderer: OpenGL

OpenBenchmarking.orgFrames Per Second, More Is BetterUnigine Superposition 1.0Resolution: 1920 x 1200 - Mode: Fullscreen - Quality: Low - Renderer: OpenGLLinux 6.12 LTSLinux 6.6 LTS50100150200250SE +/- 1.68, N = 3SE +/- 1.52, N = 3244.8239.4MAX: 374.8MAX: 350.7

Unigine Superposition

Resolution: 1920 x 1200 - Mode: Fullscreen - Quality: High - Renderer: OpenGL

OpenBenchmarking.orgFrames Per Second, More Is BetterUnigine Superposition 1.0Resolution: 1920 x 1200 - Mode: Fullscreen - Quality: High - Renderer: OpenGLLinux 6.12 LTSLinux 6.6 LTS306090120150SE +/- 0.00, N = 3SE +/- 0.03, N = 3111.7113.3MAX: 137.2MAX: 138.7

Unigine Superposition

Resolution: 1920 x 1200 - Mode: Fullscreen - Quality: Medium - Renderer: OpenGL

OpenBenchmarking.orgFrames Per Second, More Is BetterUnigine Superposition 1.0Resolution: 1920 x 1200 - Mode: Fullscreen - Quality: Medium - Renderer: OpenGLLinux 6.12 LTSLinux 6.6 LTS306090120150SE +/- 0.06, N = 3SE +/- 0.12, N = 3155.1157.1MAX: 202.4MAX: 203.6

Unvanquished

Resolution: 1920 x 1200 - Effects Quality: High

OpenBenchmarking.orgFrames Per Second, More Is BetterUnvanquished 0.55Resolution: 1920 x 1200 - Effects Quality: HighLinux 6.12 LTSLinux 6.6 LTS150300450600750SE +/- 3.84, N = 3SE +/- 2.80, N = 3678.6691.0

Unvanquished

Resolution: 1920 x 1200 - Effects Quality: Ultra

OpenBenchmarking.orgFrames Per Second, More Is BetterUnvanquished 0.55Resolution: 1920 x 1200 - Effects Quality: UltraLinux 6.12 LTSLinux 6.6 LTS150300450600750SE +/- 6.32, N = 6SE +/- 2.62, N = 3672.7687.2

Unvanquished

Resolution: 1920 x 1200 - Effects Quality: Medium

OpenBenchmarking.orgFrames Per Second, More Is BetterUnvanquished 0.55Resolution: 1920 x 1200 - Effects Quality: MediumLinux 6.12 LTSLinux 6.6 LTS150300450600750SE +/- 1.99, N = 3SE +/- 5.36, N = 3689.2707.9

GPUScore: Breaking Limit

Resolution: 1920 x 1200 - Ray-Tracing: Off

OpenBenchmarking.orgFPS, More Is BetterGPUScore: Breaking Limit 1.0Resolution: 1920 x 1200 - Ray-Tracing: OffLinux 6.12 LTSLinux 6.6 LTS306090120150SE +/- 0.05, N = 3SE +/- 0.08, N = 3131.34132.37MIN: 94.33 / MAX: 317.71MIN: 95.51 / MAX: 317.39

ParaView

Test: Many Spheres - Frames: 600 - Resolution: 1920 x 1200

OpenBenchmarking.orgFrames / Sec, More Is BetterParaView 5.13Test: Many Spheres - Frames: 600 - Resolution: 1920 x 1200Linux 6.12 LTSLinux 6.6 LTS306090120150SE +/- 0.29, N = 3SE +/- 1.06, N = 3120.99118.13

ParaView

Test: Many Spheres - Frames: 600 - Resolution: 1920 x 1200

OpenBenchmarking.orgMiPolys / Sec, More Is BetterParaView 5.13Test: Many Spheres - Frames: 600 - Resolution: 1920 x 1200Linux 6.12 LTSLinux 6.6 LTS3K6K9K12K15KSE +/- 28.78, N = 3SE +/- 106.65, N = 312130.2311842.94

ParaView

Test: Wavelet Volume - Frames: 600 - Resolution: 1920 x 1200

OpenBenchmarking.orgFrames / Sec, More Is BetterParaView 5.13Test: Wavelet Volume - Frames: 600 - Resolution: 1920 x 1200Linux 6.12 LTSLinux 6.6 LTS100200300400500SE +/- 12.45, N = 12SE +/- 12.74, N = 14442.87411.43

ParaView

Test: Wavelet Volume - Frames: 600 - Resolution: 1920 x 1200

OpenBenchmarking.orgMiVoxels / Sec, More Is BetterParaView 5.13Test: Wavelet Volume - Frames: 600 - Resolution: 1920 x 1200Linux 6.12 LTSLinux 6.6 LTS15003000450060007500SE +/- 199.16, N = 12SE +/- 203.86, N = 147085.926582.93

ParaView

Test: Wavelet Contour - Frames: 600 - Resolution: 1920 x 1200

OpenBenchmarking.orgFrames / Sec, More Is BetterParaView 5.13Test: Wavelet Contour - Frames: 600 - Resolution: 1920 x 1200Linux 6.12 LTSLinux 6.6 LTS60120180240300SE +/- 0.24, N = 3SE +/- 1.20, N = 3292.65289.73

ParaView

Test: Wavelet Contour - Frames: 600 - Resolution: 1920 x 1200

OpenBenchmarking.orgMiPolys / Sec, More Is BetterParaView 5.13Test: Wavelet Contour - Frames: 600 - Resolution: 1920 x 1200Linux 6.12 LTSLinux 6.6 LTS7001400210028003500SE +/- 2.54, N = 3SE +/- 12.53, N = 33049.803019.32

WireGuard + Linux Networking Stack Stress Test

OpenBenchmarking.orgSeconds, Fewer Is BetterWireGuard + Linux Networking Stack Stress TestLinux 6.12 LTSLinux 6.6 LTS60120180240300SE +/- 0.34, N = 3SE +/- 0.02, N = 3283.73273.22

NAMD

Input: ATPase with 327,506 Atoms

OpenBenchmarking.orgns/day, More Is BetterNAMD 3.0Input: ATPase with 327,506 AtomsLinux 6.12 LTSLinux 6.6 LTS246810SE +/- 0.01151, N = 3SE +/- 0.04086, N = 146.427746.27207

NAMD

Input: STMV with 1,066,628 Atoms

OpenBenchmarking.orgns/day, More Is BetterNAMD 3.0Input: STMV with 1,066,628 AtomsLinux 6.12 LTSLinux 6.6 LTS0.36980.73961.10941.47921.849SE +/- 0.00261, N = 3SE +/- 0.01023, N = 31.633241.64374

DaCapo Benchmark

Java Test: Jython

OpenBenchmarking.orgmsec, Fewer Is BetterDaCapo Benchmark 23.11Java Test: JythonLinux 6.12 LTSLinux 6.6 LTS9001800270036004500SE +/- 47.04, N = 5SE +/- 26.50, N = 342674295

DaCapo Benchmark

Java Test: Eclipse

OpenBenchmarking.orgmsec, Fewer Is BetterDaCapo Benchmark 23.11Java Test: EclipseLinux 6.12 LTSLinux 6.6 LTS15003000450060007500SE +/- 36.56, N = 3SE +/- 30.14, N = 370637169

DaCapo Benchmark

Java Test: GraphChi

OpenBenchmarking.orgmsec, Fewer Is BetterDaCapo Benchmark 23.11Java Test: GraphChiLinux 6.12 LTSLinux 6.6 LTS5001000150020002500SE +/- 19.86, N = 3SE +/- 33.01, N = 324632408

DaCapo Benchmark

Java Test: Tradesoap

OpenBenchmarking.orgmsec, Fewer Is BetterDaCapo Benchmark 23.11Java Test: TradesoapLinux 6.12 LTSLinux 6.6 LTS13002600390052006500SE +/- 76.62, N = 15SE +/- 142.65, N = 1558845550

DaCapo Benchmark

Java Test: Tradebeans

OpenBenchmarking.orgmsec, Fewer Is BetterDaCapo Benchmark 23.11Java Test: TradebeansLinux 6.12 LTSLinux 6.6 LTS3K6K9K12K15KSE +/- 396.80, N = 15SE +/- 385.34, N = 151252312081

DaCapo Benchmark

Java Test: Spring Boot

OpenBenchmarking.orgmsec, Fewer Is BetterDaCapo Benchmark 23.11Java Test: Spring BootLinux 6.12 LTSLinux 6.6 LTS400800120016002000SE +/- 24.47, N = 4SE +/- 19.17, N = 720012085

DaCapo Benchmark

Java Test: Apache Kafka

OpenBenchmarking.orgmsec, Fewer Is BetterDaCapo Benchmark 23.11Java Test: Apache KafkaLinux 6.12 LTSLinux 6.6 LTS12002400360048006000SE +/- 4.04, N = 3SE +/- 0.58, N = 354525451

DaCapo Benchmark

Java Test: Apache Tomcat

OpenBenchmarking.orgmsec, Fewer Is BetterDaCapo Benchmark 23.11Java Test: Apache TomcatLinux 6.12 LTSLinux 6.6 LTS30060090012001500SE +/- 7.54, N = 3SE +/- 8.17, N = 312451157

DaCapo Benchmark

Java Test: jMonkeyEngine

OpenBenchmarking.orgmsec, Fewer Is BetterDaCapo Benchmark 23.11Java Test: jMonkeyEngineLinux 6.12 LTSLinux 6.6 LTS15003000450060007500SE +/- 2.19, N = 3SE +/- 0.88, N = 368806863

DaCapo Benchmark

Java Test: Apache Xalan XSLT

OpenBenchmarking.orgmsec, Fewer Is BetterDaCapo Benchmark 23.11Java Test: Apache Xalan XSLTLinux 6.12 LTSLinux 6.6 LTS160320480640800SE +/- 1.86, N = 3SE +/- 5.90, N = 3744726

DaCapo Benchmark

Java Test: Batik SVG Toolkit

OpenBenchmarking.orgmsec, Fewer Is BetterDaCapo Benchmark 23.11Java Test: Batik SVG ToolkitLinux 6.12 LTSLinux 6.6 LTS2004006008001000SE +/- 9.69, N = 15SE +/- 12.22, N = 310121024

DaCapo Benchmark

Java Test: H2 Database Engine

OpenBenchmarking.orgmsec, Fewer Is BetterDaCapo Benchmark 23.11Java Test: H2 Database EngineLinux 6.12 LTSLinux 6.6 LTS400800120016002000SE +/- 12.68, N = 3SE +/- 12.33, N = 320341994

DaCapo Benchmark

Java Test: FOP Print Formatter

OpenBenchmarking.orgmsec, Fewer Is BetterDaCapo Benchmark 23.11Java Test: FOP Print FormatterLinux 6.12 LTSLinux 6.6 LTS100200300400500SE +/- 4.18, N = 3SE +/- 2.85, N = 3439430

DaCapo Benchmark

Java Test: PMD Source Code Analyzer

OpenBenchmarking.orgmsec, Fewer Is BetterDaCapo Benchmark 23.11Java Test: PMD Source Code AnalyzerLinux 6.12 LTSLinux 6.6 LTS30060090012001500SE +/- 23.46, N = 12SE +/- 12.80, N = 411731155

DaCapo Benchmark

Java Test: Apache Lucene Search Index

OpenBenchmarking.orgmsec, Fewer Is BetterDaCapo Benchmark 23.11Java Test: Apache Lucene Search IndexLinux 6.12 LTSLinux 6.6 LTS6001200180024003000SE +/- 37.99, N = 3SE +/- 10.17, N = 326702647

DaCapo Benchmark

Java Test: Apache Lucene Search Engine

OpenBenchmarking.orgmsec, Fewer Is BetterDaCapo Benchmark 23.11Java Test: Apache Lucene Search EngineLinux 6.12 LTSLinux 6.6 LTS6001200180024003000SE +/- 8.62, N = 3SE +/- 37.69, N = 326322817

DaCapo Benchmark

Java Test: Avrora AVR Simulation Framework

OpenBenchmarking.orgmsec, Fewer Is BetterDaCapo Benchmark 23.11Java Test: Avrora AVR Simulation FrameworkLinux 6.12 LTSLinux 6.6 LTS11002200330044005500SE +/- 8.19, N = 3SE +/- 29.92, N = 349234844

DaCapo Benchmark

Java Test: BioJava Biological Data Framework

OpenBenchmarking.orgmsec, Fewer Is BetterDaCapo Benchmark 23.11Java Test: BioJava Biological Data FrameworkLinux 6.12 LTSLinux 6.6 LTS10002000300040005000SE +/- 15.03, N = 3SE +/- 11.98, N = 347684696

DaCapo Benchmark

Java Test: Zxing 1D/2D Barcode Image Processing

OpenBenchmarking.orgmsec, Fewer Is BetterDaCapo Benchmark 23.11Java Test: Zxing 1D/2D Barcode Image ProcessingLinux 6.12 LTSLinux 6.6 LTS100200300400500SE +/- 3.12, N = 15SE +/- 5.05, N = 15405485

srsRAN Project

Test: PUSCH Processor Benchmark, Throughput Total

OpenBenchmarking.orgMbps, More Is BettersrsRAN Project 24.10Test: PUSCH Processor Benchmark, Throughput TotalLinux 6.12 LTSLinux 6.6 LTS13002600390052006500SE +/- 65.75, N = 14SE +/- 1.12, N = 35875.75811.71. (CXX) g++ options: -O3 -march=native -mtune=generic -fno-trapping-math -fno-math-errno -ldl

SVT-AV1

Encoder Mode: Preset 3 - Input: Bosphorus 4K

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 2.3Encoder Mode: Preset 3 - Input: Bosphorus 4KLinux 6.12 LTSLinux 6.6 LTS48121620SE +/- 0.03, N = 3SE +/- 0.03, N = 313.9714.141. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

SVT-AV1

Encoder Mode: Preset 5 - Input: Bosphorus 4K

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 2.3Encoder Mode: Preset 5 - Input: Bosphorus 4KLinux 6.12 LTSLinux 6.6 LTS1122334455SE +/- 0.07, N = 3SE +/- 0.13, N = 348.1848.381. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

SVT-AV1

Encoder Mode: Preset 8 - Input: Bosphorus 4K

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 2.3Encoder Mode: Preset 8 - Input: Bosphorus 4KLinux 6.12 LTSLinux 6.6 LTS306090120150SE +/- 0.78, N = 3SE +/- 0.17, N = 3140.94141.971. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

SVT-AV1

Encoder Mode: Preset 13 - Input: Bosphorus 4K

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 2.3Encoder Mode: Preset 13 - Input: Bosphorus 4KLinux 6.12 LTSLinux 6.6 LTS50100150200250SE +/- 1.14, N = 3SE +/- 2.36, N = 6223.54232.451. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

x265

Video Input: Bosphorus 4K

OpenBenchmarking.orgFrames Per Second, More Is Betterx265 4.1Video Input: Bosphorus 4KLinux 6.12 LTSLinux 6.6 LTS918273645SE +/- 0.04, N = 3SE +/- 0.12, N = 340.9341.001. (CXX) g++ options: -O3 -rdynamic -lpthread -lrt -ldl -lnuma

x265

Video Input: Bosphorus 1080p

OpenBenchmarking.orgFrames Per Second, More Is Betterx265 4.1Video Input: Bosphorus 1080pLinux 6.12 LTSLinux 6.6 LTS306090120150SE +/- 0.34, N = 3SE +/- 0.41, N = 3116.41116.921. (CXX) g++ options: -O3 -rdynamic -lpthread -lrt -ldl -lnuma

Timed Linux Kernel Compilation

Build: defconfig

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed Linux Kernel Compilation 6.8Build: defconfigLinux 6.12 LTSLinux 6.6 LTS714212835SE +/- 0.37, N = 3SE +/- 0.29, N = 627.9928.66

Timed Linux Kernel Compilation

Build: allmodconfig

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed Linux Kernel Compilation 6.8Build: allmodconfigLinux 6.12 LTSLinux 6.6 LTS60120180240300SE +/- 0.19, N = 3SE +/- 0.29, N = 3270.66278.32

Hackbench

Count: 16 - Type: Thread

OpenBenchmarking.orgSeconds, Fewer Is BetterHackbenchCount: 16 - Type: ThreadLinux 6.12 LTSLinux 6.6 LTS3691215SE +/- 0.07, N = 3SE +/- 0.02, N = 310.7011.401. (CC) gcc options: -lpthread

Hackbench

Count: 16 - Type: Process

OpenBenchmarking.orgSeconds, Fewer Is BetterHackbenchCount: 16 - Type: ProcessLinux 6.12 LTSLinux 6.6 LTS3691215SE +/- 0.10, N = 3SE +/- 0.04, N = 310.9811.141. (CC) gcc options: -lpthread

Hackbench

Count: 32 - Type: Process

OpenBenchmarking.orgSeconds, Fewer Is BetterHackbenchCount: 32 - Type: ProcessLinux 6.12 LTSLinux 6.6 LTS510152025SE +/- 0.05, N = 3SE +/- 0.13, N = 319.8220.341. (CC) gcc options: -lpthread

Memcached

Set To Get Ratio: 1:5

OpenBenchmarking.orgOps/sec, More Is BetterMemcached 1.6.19Set To Get Ratio: 1:5Linux 6.12 LTSLinux 6.6 LTS800K1600K2400K3200K4000KSE +/- 2828.47, N = 3SE +/- 17586.46, N = 33741056.003790466.161. (CXX) g++ options: -O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre

Memcached

Set To Get Ratio: 1:10

OpenBenchmarking.orgOps/sec, More Is BetterMemcached 1.6.19Set To Get Ratio: 1:10Linux 6.12 LTSLinux 6.6 LTS1.5M3M4.5M6M7.5MSE +/- 39216.77, N = 3SE +/- 49410.05, N = 36600797.836814926.201. (CXX) g++ options: -O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre

Memcached

Set To Get Ratio: 1:100

OpenBenchmarking.orgOps/sec, More Is BetterMemcached 1.6.19Set To Get Ratio: 1:100Linux 6.12 LTSLinux 6.6 LTS2M4M6M8M10MSE +/- 19495.81, N = 3SE +/- 27494.50, N = 39379299.989031077.631. (CXX) g++ options: -O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre

Cryptsetup

PBKDF2-sha512

OpenBenchmarking.orgIterations Per Second, More Is BetterCryptsetupPBKDF2-sha512Linux 6.12 LTSLinux 6.6 LTS600K1200K1800K2400K3000KSE +/- 13075.33, N = 3SE +/- 12354.07, N = 326117762627029

Cryptsetup

PBKDF2-whirlpool

OpenBenchmarking.orgIterations Per Second, More Is BetterCryptsetupPBKDF2-whirlpoolLinux 6.12 LTSLinux 6.6 LTS200K400K600K800K1000KSE +/- 5339.48, N = 3SE +/- 4406.63, N = 3935732942440

Cryptsetup

AES-XTS 256b Encryption

OpenBenchmarking.orgMiB/s, More Is BetterCryptsetupAES-XTS 256b EncryptionLinux 6.12 LTSLinux 6.6 LTS12002400360048006000SE +/- 14.10, N = 3SE +/- 17.91, N = 35714.93972.8

Cryptsetup

AES-XTS 256b Decryption

OpenBenchmarking.orgMiB/s, More Is BetterCryptsetupAES-XTS 256b DecryptionLinux 6.12 LTSLinux 6.6 LTS12002400360048006000SE +/- 4.24, N = 3SE +/- 16.03, N = 35735.23974.3

Cryptsetup

Serpent-XTS 256b Encryption

OpenBenchmarking.orgMiB/s, More Is BetterCryptsetupSerpent-XTS 256b EncryptionLinux 6.12 LTSLinux 6.6 LTS2004006008001000SE +/- 5.03, N = 3SE +/- 9.38, N = 3946.2946.0

Cryptsetup

Serpent-XTS 256b Decryption

OpenBenchmarking.orgMiB/s, More Is BetterCryptsetupSerpent-XTS 256b DecryptionLinux 6.12 LTSLinux 6.6 LTS2004006008001000SE +/- 2.40, N = 3SE +/- 3.12, N = 3939.9947.1

Cryptsetup

Twofish-XTS 256b Encryption

OpenBenchmarking.orgMiB/s, More Is BetterCryptsetupTwofish-XTS 256b EncryptionLinux 6.12 LTSLinux 6.6 LTS130260390520650SE +/- 6.39, N = 3SE +/- 3.72, N = 3578.4592.3

Cryptsetup

Twofish-XTS 256b Decryption

OpenBenchmarking.orgMiB/s, More Is BetterCryptsetupTwofish-XTS 256b DecryptionLinux 6.12 LTSLinux 6.6 LTS130260390520650SE +/- 4.98, N = 3SE +/- 3.03, N = 3596.1608.4

Cryptsetup

AES-XTS 512b Encryption

OpenBenchmarking.orgMiB/s, More Is BetterCryptsetupAES-XTS 512b EncryptionLinux 6.12 LTSLinux 6.6 LTS11002200330044005500SE +/- 18.18, N = 3SE +/- 13.94, N = 35320.73662.2

Cryptsetup

AES-XTS 512b Decryption

OpenBenchmarking.orgMiB/s, More Is BetterCryptsetupAES-XTS 512b DecryptionLinux 6.12 LTSLinux 6.6 LTS11002200330044005500SE +/- 19.22, N = 3SE +/- 12.68, N = 35324.13658.9

Cryptsetup

Serpent-XTS 512b Encryption

OpenBenchmarking.orgMiB/s, More Is BetterCryptsetupSerpent-XTS 512b EncryptionLinux 6.12 LTSLinux 6.6 LTS2004006008001000SE +/- 5.35, N = 3SE +/- 1.11, N = 3946.5958.4

Cryptsetup

Serpent-XTS 512b Decryption

OpenBenchmarking.orgMiB/s, More Is BetterCryptsetupSerpent-XTS 512b DecryptionLinux 6.12 LTSLinux 6.6 LTS2004006008001000SE +/- 5.34, N = 3SE +/- 1.22, N = 3936.5950.1

Cryptsetup

Twofish-XTS 512b Encryption

OpenBenchmarking.orgMiB/s, More Is BetterCryptsetupTwofish-XTS 512b EncryptionLinux 6.12 LTSLinux 6.6 LTS130260390520650SE +/- 2.60, N = 2SE +/- 0.97, N = 3576.8597.7

Cryptsetup

Twofish-XTS 512b Decryption

OpenBenchmarking.orgMiB/s, More Is BetterCryptsetupTwofish-XTS 512b DecryptionLinux 6.12 LTSLinux 6.6 LTS130260390520650SE +/- 4.61, N = 3SE +/- 0.30, N = 2595.9610.2

GROMACS

Implementation: MPI CPU - Input: water_GMX50_bare

OpenBenchmarking.orgNs Per Day, More Is BetterGROMACS 2024Implementation: MPI CPU - Input: water_GMX50_bareLinux 6.12 LTSLinux 6.6 LTS246810SE +/- 0.007, N = 3SE +/- 0.013, N = 37.5587.5441. (CXX) g++ options: -O3 -lm

LiteRT

Model: SqueezeNet

OpenBenchmarking.orgMicroseconds, Fewer Is BetterLiteRT 2024-10-15Model: SqueezeNetLinux 6.12 LTSLinux 6.6 LTS7001400210028003500SE +/- 16.68, N = 3SE +/- 27.31, N = 33287.593230.93

LiteRT

Model: Inception V4

OpenBenchmarking.orgMicroseconds, Fewer Is BetterLiteRT 2024-10-15Model: Inception V4Linux 6.12 LTSLinux 6.6 LTS6K12K18K24K30KSE +/- 20.95, N = 3SE +/- 67.75, N = 326660.626555.2

LiteRT

Model: Mobilenet Float

OpenBenchmarking.orgMicroseconds, Fewer Is BetterLiteRT 2024-10-15Model: Mobilenet FloatLinux 6.12 LTSLinux 6.6 LTS5001000150020002500SE +/- 12.65, N = 3SE +/- 8.56, N = 32128.892129.64

PostgreSQL

Scaling Factor: 100 - Clients: 800 - Mode: Read Only

OpenBenchmarking.orgTPS, More Is BetterPostgreSQL 17Scaling Factor: 100 - Clients: 800 - Mode: Read OnlyLinux 6.12 LTSLinux 6.6 LTS800K1600K2400K3200K4000KSE +/- 7725.31, N = 3SE +/- 3948.30, N = 3370981236380601. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpq -lpgcommon -lpgport -lm

PostgreSQL

Scaling Factor: 100 - Clients: 800 - Mode: Read Only - Average Latency

OpenBenchmarking.orgms, Fewer Is BetterPostgreSQL 17Scaling Factor: 100 - Clients: 800 - Mode: Read Only - Average LatencyLinux 6.12 LTSLinux 6.6 LTS0.04950.0990.14850.1980.2475SE +/- 0.000, N = 3SE +/- 0.000, N = 30.2160.2201. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpq -lpgcommon -lpgport -lm

PostgreSQL

Scaling Factor: 100 - Clients: 1000 - Mode: Read Only

OpenBenchmarking.orgTPS, More Is BetterPostgreSQL 17Scaling Factor: 100 - Clients: 1000 - Mode: Read OnlyLinux 6.12 LTSLinux 6.6 LTS800K1600K2400K3200K4000KSE +/- 6510.05, N = 3SE +/- 6092.17, N = 3369149836101091. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpq -lpgcommon -lpgport -lm

PostgreSQL

Scaling Factor: 100 - Clients: 1000 - Mode: Read Only - Average Latency

OpenBenchmarking.orgms, Fewer Is BetterPostgreSQL 17Scaling Factor: 100 - Clients: 1000 - Mode: Read Only - Average LatencyLinux 6.12 LTSLinux 6.6 LTS0.06230.12460.18690.24920.3115SE +/- 0.001, N = 3SE +/- 0.001, N = 30.2710.2771. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpq -lpgcommon -lpgport -lm

PostgreSQL

Scaling Factor: 100 - Clients: 800 - Mode: Read Write

OpenBenchmarking.orgTPS, More Is BetterPostgreSQL 17Scaling Factor: 100 - Clients: 800 - Mode: Read WriteLinux 6.12 LTSLinux 6.6 LTS7K14K21K28K35KSE +/- 81.42, N = 3SE +/- 7.12, N = 333664328731. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpq -lpgcommon -lpgport -lm

PostgreSQL

Scaling Factor: 100 - Clients: 800 - Mode: Read Write - Average Latency

OpenBenchmarking.orgms, Fewer Is BetterPostgreSQL 17Scaling Factor: 100 - Clients: 800 - Mode: Read Write - Average LatencyLinux 6.12 LTSLinux 6.6 LTS612182430SE +/- 0.06, N = 3SE +/- 0.01, N = 323.7724.341. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpq -lpgcommon -lpgport -lm

PostgreSQL

Scaling Factor: 100 - Clients: 1000 - Mode: Read Write

OpenBenchmarking.orgTPS, More Is BetterPostgreSQL 17Scaling Factor: 100 - Clients: 1000 - Mode: Read WriteLinux 6.12 LTSLinux 6.6 LTS7K14K21K28K35KSE +/- 89.94, N = 3SE +/- 219.18, N = 333334324761. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpq -lpgcommon -lpgport -lm

PostgreSQL

Scaling Factor: 100 - Clients: 1000 - Mode: Read Write - Average Latency

OpenBenchmarking.orgms, Fewer Is BetterPostgreSQL 17Scaling Factor: 100 - Clients: 1000 - Mode: Read Write - Average LatencyLinux 6.12 LTSLinux 6.6 LTS714212835SE +/- 0.08, N = 3SE +/- 0.21, N = 330.0030.801. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpq -lpgcommon -lpgport -lm

SQLite Speedtest

Timed Time - Size 1,000

OpenBenchmarking.orgSeconds, Fewer Is BetterSQLite Speedtest 3.30Timed Time - Size 1,000Linux 6.12 LTSLinux 6.6 LTS1224364860SE +/- 0.04, N = 3SE +/- 0.15, N = 349.7651.561. (CC) gcc options: -O2 -lz

Stress-NG

Test: SENDFILE

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.17.08Test: SENDFILELinux 6.12 LTSLinux 6.6 LTS200K400K600K800K1000KSE +/- 10129.48, N = 15SE +/- 11884.90, N = 151006166.30710089.351. (CXX) g++ options: -O2 -std=gnu99 -lc -lm

Stress-NG

Test: Mixed Scheduler

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.17.08Test: Mixed SchedulerLinux 6.12 LTSLinux 6.6 LTS9K18K27K36K45KSE +/- 90.61, N = 3SE +/- 38.24, N = 339770.2238895.001. (CXX) g++ options: -O2 -std=gnu99 -lc -lm

Stress-NG

Test: Socket Activity

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.17.08Test: Socket ActivityLinux 6.12 LTSLinux 6.6 LTS7K14K21K28K35KSE +/- 83.00, N = 3SE +/- 284.16, N = 630773.3229743.651. (CXX) g++ options: -O2 -std=gnu99 -lc -lm

Stress-NG

Test: Context Switching

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.17.08Test: Context SwitchingLinux 6.12 LTSLinux 6.6 LTS5M10M15M20M25MSE +/- 82130.66, N = 3SE +/- 129368.33, N = 1522070300.1211705033.611. (CXX) g++ options: -O2 -std=gnu99 -lc -lm

Blender

Blend File: BMW27 - Compute: CPU-Only

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 4.3Blend File: BMW27 - Compute: CPU-OnlyLinux 6.12 LTSLinux 6.6 LTS48121620SE +/- 0.03, N = 3SE +/- 0.04, N = 317.6517.57

Blender

Blend File: Junkshop - Compute: CPU-Only

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 4.3Blend File: Junkshop - Compute: CPU-OnlyLinux 6.12 LTSLinux 6.6 LTS612182430SE +/- 0.03, N = 3SE +/- 0.05, N = 324.1424.46

Blender

Blend File: Classroom - Compute: CPU-Only

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 4.3Blend File: Classroom - Compute: CPU-OnlyLinux 6.12 LTSLinux 6.6 LTS1122334455SE +/- 0.03, N = 3SE +/- 0.06, N = 346.0646.40

Blender

Blend File: Fishy Cat - Compute: CPU-Only

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 4.3Blend File: Fishy Cat - Compute: CPU-OnlyLinux 6.12 LTSLinux 6.6 LTS612182430SE +/- 0.14, N = 3SE +/- 0.08, N = 323.5823.63

Blender

Blend File: Barbershop - Compute: CPU-Only

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 4.3Blend File: Barbershop - Compute: CPU-OnlyLinux 6.12 LTSLinux 6.6 LTS4080120160200SE +/- 0.23, N = 3SE +/- 0.62, N = 3166.47167.97

Blender

Blend File: Pabellon Barcelona - Compute: CPU-Only

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 4.3Blend File: Pabellon Barcelona - Compute: CPU-OnlyLinux 6.12 LTSLinux 6.6 LTS1224364860SE +/- 0.17, N = 3SE +/- 0.06, N = 354.1554.24

IndigoBench

Acceleration: CPU - Scene: Bedroom

OpenBenchmarking.orgM samples/s, More Is BetterIndigoBench 4.4Acceleration: CPU - Scene: BedroomLinux 6.12 LTSLinux 6.6 LTS48121620SE +/- 0.03, N = 3SE +/- 0.04, N = 316.1716.15

IndigoBench

Acceleration: CPU - Scene: Supercar

OpenBenchmarking.orgM samples/s, More Is BetterIndigoBench 4.4Acceleration: CPU - Scene: SupercarLinux 6.12 LTSLinux 6.6 LTS816243240SE +/- 0.18, N = 3SE +/- 0.10, N = 335.4635.79

Apache Cassandra

Test: Writes

OpenBenchmarking.orgOp/s, More Is BetterApache Cassandra 5.0Test: WritesLinux 6.12 LTSLinux 6.6 LTS90K180K270K360K450KSE +/- 4663.86, N = 3SE +/- 2581.70, N = 3418052399076

RocksDB

Test: Random Read

OpenBenchmarking.orgOp/s, More Is BetterRocksDB 9.0Test: Random ReadLinux 6.12 LTSLinux 6.6 LTS90M180M270M360M450MSE +/- 1998121.04, N = 3SE +/- 414934.54, N = 34396144874402282201. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti

RocksDB

Test: Update Random

OpenBenchmarking.orgOp/s, More Is BetterRocksDB 9.0Test: Update RandomLinux 6.12 LTSLinux 6.6 LTS110K220K330K440K550KSE +/- 306.96, N = 3SE +/- 646.08, N = 35268445314631. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti

RocksDB

Test: Read While Writing

OpenBenchmarking.orgOp/s, More Is BetterRocksDB 9.0Test: Read While WritingLinux 6.12 LTSLinux 6.6 LTS3M6M9M12M15MSE +/- 72612.28, N = 14SE +/- 117684.65, N = 611028127117918851. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti

RocksDB

Test: Read Random Write Random

OpenBenchmarking.orgOp/s, More Is BetterRocksDB 9.0Test: Read Random Write RandomLinux 6.12 LTSLinux 6.6 LTS800K1600K2400K3200K4000KSE +/- 17391.58, N = 3SE +/- 23703.72, N = 3358795236371881. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti

Llama.cpp

Backend: CPU BLAS - Model: Llama-3.1-Tulu-3-8B-Q8_0 - Test: Text Generation 128

OpenBenchmarking.orgTokens Per Second, More Is BetterLlama.cpp b4154Backend: CPU BLAS - Model: Llama-3.1-Tulu-3-8B-Q8_0 - Test: Text Generation 128Linux 6.12 LTSLinux 6.6 LTS48121620SE +/- 0.09, N = 3SE +/- 0.03, N = 315.5115.811. (CXX) g++ options: -std=c++11 -fPIC -O3 -pthread -fopenmp -march=native -mtune=native -lopenblas

Llama.cpp

Backend: CPU BLAS - Model: Llama-3.1-Tulu-3-8B-Q8_0 - Test: Prompt Processing 1024

OpenBenchmarking.orgTokens Per Second, More Is BetterLlama.cpp b4154Backend: CPU BLAS - Model: Llama-3.1-Tulu-3-8B-Q8_0 - Test: Prompt Processing 1024Linux 6.12 LTSLinux 6.6 LTS306090120150SE +/- 1.07, N = 15SE +/- 1.50, N = 15120.98110.821. (CXX) g++ options: -std=c++11 -fPIC -O3 -pthread -fopenmp -march=native -mtune=native -lopenblas

Llama.cpp

Backend: CPU BLAS - Model: Mistral-7B-Instruct-v0.3-Q8_0 - Test: Text Generation 128

OpenBenchmarking.orgTokens Per Second, More Is BetterLlama.cpp b4154Backend: CPU BLAS - Model: Mistral-7B-Instruct-v0.3-Q8_0 - Test: Text Generation 128Linux 6.12 LTSLinux 6.6 LTS48121620SE +/- 0.06, N = 3SE +/- 0.01, N = 316.5516.691. (CXX) g++ options: -std=c++11 -fPIC -O3 -pthread -fopenmp -march=native -mtune=native -lopenblas

Llama.cpp

Backend: CPU BLAS - Model: Mistral-7B-Instruct-v0.3-Q8_0 - Test: Prompt Processing 1024

OpenBenchmarking.orgTokens Per Second, More Is BetterLlama.cpp b4154Backend: CPU BLAS - Model: Mistral-7B-Instruct-v0.3-Q8_0 - Test: Prompt Processing 1024Linux 6.12 LTSLinux 6.6 LTS306090120150SE +/- 1.36, N = 4SE +/- 1.45, N = 15117.11111.141. (CXX) g++ options: -std=c++11 -fPIC -O3 -pthread -fopenmp -march=native -mtune=native -lopenblas

Llama.cpp

Backend: CPU BLAS - Model: granite-3.0-3b-a800m-instruct-Q8_0 - Test: Text Generation 128

OpenBenchmarking.orgTokens Per Second, More Is BetterLlama.cpp b4154Backend: CPU BLAS - Model: granite-3.0-3b-a800m-instruct-Q8_0 - Test: Text Generation 128Linux 6.12 LTSLinux 6.6 LTS20406080100SE +/- 0.17, N = 3SE +/- 0.28, N = 376.8177.761. (CXX) g++ options: -std=c++11 -fPIC -O3 -pthread -fopenmp -march=native -mtune=native -lopenblas

Llama.cpp

Backend: CPU BLAS - Model: granite-3.0-3b-a800m-instruct-Q8_0 - Test: Prompt Processing 1024

OpenBenchmarking.orgTokens Per Second, More Is BetterLlama.cpp b4154Backend: CPU BLAS - Model: granite-3.0-3b-a800m-instruct-Q8_0 - Test: Prompt Processing 1024Linux 6.12 LTSLinux 6.6 LTS50100150200250SE +/- 2.50, N = 3SE +/- 1.22, N = 3232.35186.831. (CXX) g++ options: -std=c++11 -fPIC -O3 -pthread -fopenmp -march=native -mtune=native -lopenblas

Chaos Group V-RAY

Mode: CPU

OpenBenchmarking.orgvsamples, More Is BetterChaos Group V-RAY 6.0Mode: CPULinux 6.12 LTSLinux 6.6 LTS30K60K90K120K150KSE +/- 649.45, N = 3SE +/- 165.30, N = 3135795135033

OpenVINO GenAI

Model: Gemma-7b-int4-ov - Device: CPU

OpenBenchmarking.orgtokens/s, More Is BetterOpenVINO GenAI 2024.5Model: Gemma-7b-int4-ov - Device: CPULinux 6.12 LTSLinux 6.6 LTS510152025SE +/- 0.07, N = 3SE +/- 0.06, N = 320.5320.66

OpenVINO GenAI

Model: Gemma-7b-int4-ov - Device: CPU - Time To First Token

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO GenAI 2024.5Model: Gemma-7b-int4-ov - Device: CPU - Time To First TokenLinux 6.12 LTSLinux 6.6 LTS1326395265SE +/- 0.28, N = 3SE +/- 0.29, N = 357.1557.03

OpenVINO GenAI

Model: Gemma-7b-int4-ov - Device: CPU - Time Per Output Token

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO GenAI 2024.5Model: Gemma-7b-int4-ov - Device: CPU - Time Per Output TokenLinux 6.12 LTSLinux 6.6 LTS1122334455SE +/- 0.18, N = 3SE +/- 0.14, N = 348.7048.42

OpenVINO GenAI

Model: TinyLlama-1.1B-Chat-v1.0 - Device: CPU

OpenBenchmarking.orgtokens/s, More Is BetterOpenVINO GenAI 2024.5Model: TinyLlama-1.1B-Chat-v1.0 - Device: CPULinux 6.12 LTSLinux 6.6 LTS1020304050SE +/- 0.02, N = 3SE +/- 0.12, N = 345.1545.00

OpenVINO GenAI

Model: TinyLlama-1.1B-Chat-v1.0 - Device: CPU - Time To First Token

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO GenAI 2024.5Model: TinyLlama-1.1B-Chat-v1.0 - Device: CPU - Time To First TokenLinux 6.12 LTSLinux 6.6 LTS612182430SE +/- 0.03, N = 3SE +/- 0.09, N = 324.5524.71

OpenVINO GenAI

Model: TinyLlama-1.1B-Chat-v1.0 - Device: CPU - Time Per Output Token

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO GenAI 2024.5Model: TinyLlama-1.1B-Chat-v1.0 - Device: CPU - Time Per Output TokenLinux 6.12 LTSLinux 6.6 LTS510152025SE +/- 0.01, N = 3SE +/- 0.06, N = 322.1522.22

OpenVINO GenAI

Model: Falcon-7b-instruct-int4-ov - Device: CPU

OpenBenchmarking.orgtokens/s, More Is BetterOpenVINO GenAI 2024.5Model: Falcon-7b-instruct-int4-ov - Device: CPULinux 6.12 LTSLinux 6.6 LTS612182430SE +/- 0.10, N = 3SE +/- 0.05, N = 325.0825.00

OpenVINO GenAI

Model: Falcon-7b-instruct-int4-ov - Device: CPU - Time To First Token

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO GenAI 2024.5Model: Falcon-7b-instruct-int4-ov - Device: CPU - Time To First TokenLinux 6.12 LTSLinux 6.6 LTS1122334455SE +/- 0.32, N = 3SE +/- 0.58, N = 349.7349.80

OpenVINO GenAI

Model: Falcon-7b-instruct-int4-ov - Device: CPU - Time Per Output Token

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO GenAI 2024.5Model: Falcon-7b-instruct-int4-ov - Device: CPU - Time Per Output TokenLinux 6.12 LTSLinux 6.6 LTS918273645SE +/- 0.15, N = 3SE +/- 0.08, N = 339.8740.00

OpenVINO GenAI

Model: Phi-3-mini-128k-instruct-int4-ov - Device: CPU

OpenBenchmarking.orgtokens/s, More Is BetterOpenVINO GenAI 2024.5Model: Phi-3-mini-128k-instruct-int4-ov - Device: CPULinux 6.12 LTSLinux 6.6 LTS816243240SE +/- 0.21, N = 3SE +/- 0.16, N = 335.6035.68

OpenVINO GenAI

Model: Phi-3-mini-128k-instruct-int4-ov - Device: CPU - Time To First Token

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO GenAI 2024.5Model: Phi-3-mini-128k-instruct-int4-ov - Device: CPU - Time To First TokenLinux 6.12 LTSLinux 6.6 LTS816243240SE +/- 0.06, N = 3SE +/- 0.14, N = 335.5735.37

OpenVINO GenAI

Model: Phi-3-mini-128k-instruct-int4-ov - Device: CPU - Time Per Output Token

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO GenAI 2024.5Model: Phi-3-mini-128k-instruct-int4-ov - Device: CPU - Time Per Output TokenLinux 6.12 LTSLinux 6.6 LTS714212835SE +/- 0.17, N = 3SE +/- 0.12, N = 328.0928.03

Phoronix Test Suite v10.8.5