Xeon Max Linux 6.9 Kernel Benchmarks

2 x Intel Xeon Max 9480 benchmarks for a future article.

Compare your own system(s) to this result file with the Phoronix Test Suite by running the command: phoronix-test-suite benchmark 2404035-NE-XEONMAXLI15
Jump To Table - Results

View

Do Not Show Noisy Results
Do Not Show Results With Incomplete Data
Do Not Show Results With Little Change/Spread
List Notable Results

Limit displaying results to tests within:

Timed Code Compilation 3 Tests
C/C++ Compiler Tests 4 Tests
CPU Massive 13 Tests
Creator Workloads 17 Tests
Database Test Suite 2 Tests
Encoding 4 Tests
Game Development 3 Tests
HPC - High Performance Computing 7 Tests
Imaging 3 Tests
Common Kernel Benchmarks 3 Tests
Large Language Models 2 Tests
Machine Learning 6 Tests
Multi-Core 18 Tests
NVIDIA GPU Compute 3 Tests
Intel oneAPI 6 Tests
Programmer / Developer System Benchmarks 3 Tests
Python Tests 5 Tests
Raytracing 2 Tests
Renderers 4 Tests
Server 3 Tests
Server CPU Tests 8 Tests
Video Encoding 3 Tests
Common Workstation Benchmarks 2 Tests

Statistics

Show Overall Harmonic Mean(s)
Show Overall Geometric Mean
Show Geometric Means Per-Suite/Category
Show Wins / Losses Counts (Pie Chart)
Normalize Results
Remove Outliers Before Calculating Averages

Graph Settings

Force Line Graphs Where Applicable
Convert To Scalar Where Applicable
Prefer Vertical Bar Graphs

Multi-Way Comparison

Condense Multi-Option Tests Into Single Result Graphs

Table

Show Detailed System Result Table

Run Management

Highlight
Result
Hide
Result
Result
Identifier
View Logs
Performance Per
Dollar
Date
Run
  Test
  Duration
Linux 6.8
March 29
  1 Day, 17 Hours, 1 Minute
Linux 6.9-rc2
April 01
  1 Day, 15 Hours, 4 Minutes
Invert Hiding All Results Option
  1 Day, 16 Hours, 2 Minutes
Only show results matching title/arguments (delimit multiple options with a comma):
Do not show results matching title/arguments (delimit multiple options with a comma):


Xeon Max Linux 6.9 Kernel Benchmarks - Phoronix Test Suite

Xeon Max Linux 6.9 Kernel Benchmarks

2 x Intel Xeon Max 9480 benchmarks for a future article.

HTML result view exported from: https://openbenchmarking.org/result/2404035-NE-XEONMAXLI15&rdt.

Xeon Max Linux 6.9 Kernel BenchmarksProcessorMotherboardChipsetMemoryDiskGraphicsNetworkOSKernelDesktopDisplay ServerCompilerFile-SystemScreen ResolutionLinux 6.8Linux 6.9-rc22 x Intel Xeon Max 9480 @ 3.50GHz (112 Cores / 224 Threads)Supermicro SYS-221H-TNR X13DEM v1.10 (1.3 BIOS)Intel Device 1bce512GB7682GB INTEL SSDPF2KX076TZASPEED2 x Broadcom BCM57508 NetXtreme-E 10Gb/25Gb/40Gb/50Gb/100Gb/200GbUbuntu 23.106.8.0-060800-generic (x86_64)GNOME Shell 45.0X Server 1.21.1.7GCC 13.2.0ext41024x7686.9.0-060900rc2-generic (x86_64)OpenBenchmarking.orgKernel Details- Transparent Huge Pages: madviseCompiler Details- --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-bootstrap --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-link-serialization=2 --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-defaulted --enable-offload-targets=nvptx-none=/build/gcc-13-XYspKM/gcc-13-13.2.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-13-XYspKM/gcc-13-13.2.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-build-config=bootstrap-lto-lean --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v Processor Details- Scaling Governor: intel_cpufreq performance - CPU Microcode: 0x2c000290Python Details- Python 3.11.6Security Details- Linux 6.8: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Not affected - Linux 6.9-rc2: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + reg_file_data_sampling: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Not affected

Xeon Max Linux 6.9 Kernel Benchmarksquicksilver: CORAL2 P1quicksilver: CORAL2 P2ffmpeg: libx264 - Liveffmpeg: libx265 - Liveffmpeg: libx264 - Uploadffmpeg: libx265 - Uploadffmpeg: libx264 - Platformffmpeg: libx265 - Platformffmpeg: libx264 - Video On Demandffmpeg: libx265 - Video On Demandxmrig: KawPow - 1Mxmrig: Monero - 1Mxmrig: Wownero - 1Mxmrig: GhostRider - 1Mxmrig: CryptoNight-Heavy - 1Mxmrig: CryptoNight-Femto UPX2 - 1Mcachebench: Readcachebench: Writecachebench: Read / Modify / Writecompress-lz4: 1 - Compression Speedcompress-lz4: 1 - Decompression Speedcompress-lz4: 3 - Compression Speedcompress-lz4: 3 - Decompression Speedcompress-lz4: 9 - Compression Speedcompress-lz4: 9 - Decompression Speedjpegxl: PNG - 80jpegxl: PNG - 90jpegxl: JPEG - 80jpegxl: JPEG - 90jpegxl: PNG - 100jpegxl: JPEG - 100jpegxl-decode: Allwebp2: Defaultwebp2: Quality 75, Compression Effort 7webp2: Quality 95, Compression Effort 7webp2: Quality 100, Compression Effort 5webp2: Quality 100, Lossless Compressionsrsran: PDSCH Processor Benchmark, Throughput Totalembree: Pathtracer - Crownembree: Pathtracer ISPC - Crownembree: Pathtracer - Asian Dragonembree: Pathtracer - Asian Dragon Objembree: Pathtracer ISPC - Asian Dragonembree: Pathtracer ISPC - Asian Dragon Objsvt-av1: Preset 4 - Bosphorus 4Ksvt-av1: Preset 8 - Bosphorus 4Ksvt-av1: Preset 12 - Bosphorus 4Ksvt-av1: Preset 13 - Bosphorus 4Ksvt-av1: Preset 4 - Bosphorus 1080pvvenc: Bosphorus 4K - Fastvvenc: Bosphorus 4K - Fastervvenc: Bosphorus 1080p - Fastvvenc: Bosphorus 1080p - Fasteroidn: RT.hdr_alb_nrm.3840x2160 - CPU-Onlyoidn: RT.ldr_alb_nrm.3840x2160 - CPU-Onlyoidn: RTLightmap.hdr.4096x4096 - CPU-Onlyospray: particle_volume/ao/real_timeospray: particle_volume/scivis/real_timeospray: particle_volume/pathtracer/real_timeospray: gravity_spheres_volume/dim_512/ao/real_timeospray: gravity_spheres_volume/dim_512/scivis/real_timeospray: gravity_spheres_volume/dim_512/pathtracer/real_timestockfish: Chess Benchmarkbuild-ffmpeg: Time To Compilebuild-linux-kernel: defconfigbuild-linux-kernel: allmodconfigbuild-mesa: Time To Compileprimesieve: 1e12primesieve: 1e13y-cruncher: 1By-cruncher: 500Monednn: IP Shapes 1D - CPUonednn: IP Shapes 3D - CPUonednn: Convolution Batch Shapes Auto - CPUonednn: Deconvolution Batch shapes_1d - CPUonednn: Deconvolution Batch shapes_3d - CPUonednn: Recurrent Neural Network Training - CPUonednn: Recurrent Neural Network Inference - CPUospray-studio: 1 - 4K - 1 - Path Tracer - CPUospray-studio: 2 - 4K - 1 - Path Tracer - CPUospray-studio: 3 - 4K - 1 - Path Tracer - CPUospray-studio: 1 - 4K - 16 - Path Tracer - CPUospray-studio: 1 - 4K - 32 - Path Tracer - CPUospray-studio: 2 - 4K - 16 - Path Tracer - CPUospray-studio: 2 - 4K - 32 - Path Tracer - CPUospray-studio: 3 - 4K - 16 - Path Tracer - CPUospray-studio: 3 - 4K - 32 - Path Tracer - CPUospray-studio: 1 - 1080p - 1 - Path Tracer - CPUospray-studio: 2 - 1080p - 1 - Path Tracer - CPUospray-studio: 3 - 1080p - 1 - Path Tracer - CPUospray-studio: 1 - 1080p - 16 - Path Tracer - CPUospray-studio: 1 - 1080p - 32 - Path Tracer - CPUospray-studio: 2 - 1080p - 16 - Path Tracer - CPUospray-studio: 2 - 1080p - 32 - Path Tracer - CPUospray-studio: 3 - 1080p - 16 - Path Tracer - CPUospray-studio: 3 - 1080p - 32 - Path Tracer - CPUhackbench: 16 - Threadhackbench: 16 - Processhackbench: 32 - Processopenssl: SHA256openssl: SHA512openssl: RSA4096openssl: RSA4096gromacs: MPI CPU - water_GMX50_baremysqlslap: 512mysqlslap: 1024tensorflow: CPU - 1 - AlexNettensorflow: CPU - 16 - AlexNettensorflow: CPU - 32 - AlexNettensorflow: CPU - 64 - AlexNettensorflow: CPU - 1 - GoogLeNettensorflow: CPU - 1 - ResNet-50tensorflow: CPU - 256 - AlexNettensorflow: CPU - 16 - GoogLeNettensorflow: CPU - 16 - ResNet-50tensorflow: CPU - 32 - GoogLeNettensorflow: CPU - 32 - ResNet-50tensorflow: CPU - 64 - GoogLeNettensorflow: CPU - 64 - ResNet-50tensorflow: CPU - 256 - GoogLeNettensorflow: CPU - 256 - ResNet-50draco: Liondraco: Church Facadestress-ng: Hashstress-ng: MMAPstress-ng: NUMAstress-ng: Pipestress-ng: Pollstress-ng: Zlibstress-ng: MEMFDstress-ng: Mutexstress-ng: Cryptostress-ng: Mallocstress-ng: Pthreadstress-ng: AVL Treestress-ng: IO_uringstress-ng: SENDFILEstress-ng: CPU Stressstress-ng: Semaphoresstress-ng: Matrix Mathstress-ng: Floating Pointstress-ng: Matrix 3D Mathstress-ng: Memory Copyingstress-ng: Vector Shufflestress-ng: Mixed Schedulerstress-ng: Socket Activitystress-ng: Wide Vector Mathstress-ng: Context Switchingstress-ng: Fused Multiply-Addstress-ng: Vector Floating Pointstress-ng: Glibc C String Functionsstress-ng: Glibc Qsort Data Sortingstress-ng: System V Message Passingblender: BMW27 - CPU-Onlyblender: Junkshop - CPU-Onlyblender: Classroom - CPU-Onlyblender: Fishy Cat - CPU-Onlyblender: Barbershop - CPU-Onlyblender: Pabellon Barcelona - CPU-Onlyopenvino: Face Detection FP16 - CPUopenvino: Face Detection FP16 - CPUopenvino: Person Detection FP16 - CPUopenvino: Person Detection FP16 - CPUopenvino: Person Detection FP32 - CPUopenvino: Person Detection FP32 - CPUopenvino: Vehicle Detection FP16 - CPUopenvino: Vehicle Detection FP16 - CPUopenvino: Face Detection FP16-INT8 - CPUopenvino: Face Detection FP16-INT8 - CPUopenvino: Face Detection Retail FP16 - CPUopenvino: Face Detection Retail FP16 - CPUopenvino: Road Segmentation ADAS FP16 - CPUopenvino: Road Segmentation ADAS FP16 - CPUopenvino: Vehicle Detection FP16-INT8 - CPUopenvino: Vehicle Detection FP16-INT8 - CPUopenvino: Weld Porosity Detection FP16 - CPUopenvino: Weld Porosity Detection FP16 - CPUopenvino: Face Detection Retail FP16-INT8 - CPUopenvino: Face Detection Retail FP16-INT8 - CPUopenvino: Road Segmentation ADAS FP16-INT8 - CPUopenvino: Road Segmentation ADAS FP16-INT8 - CPUopenvino: Machine Translation EN To DE FP16 - CPUopenvino: Machine Translation EN To DE FP16 - CPUopenvino: Weld Porosity Detection FP16-INT8 - CPUopenvino: Weld Porosity Detection FP16-INT8 - CPUopenvino: Person Vehicle Bike Detection FP16 - CPUopenvino: Person Vehicle Bike Detection FP16 - CPUopenvino: Noise Suppression Poconet-Like FP16 - CPUopenvino: Noise Suppression Poconet-Like FP16 - CPUopenvino: Handwritten English Recognition FP16 - CPUopenvino: Handwritten English Recognition FP16 - CPUopenvino: Person Re-Identification Retail FP16 - CPUopenvino: Person Re-Identification Retail FP16 - CPUopenvino: Age Gender Recognition Retail 0013 FP16 - CPUopenvino: Age Gender Recognition Retail 0013 FP16 - CPUopenvino: Handwritten English Recognition FP16-INT8 - CPUopenvino: Handwritten English Recognition FP16-INT8 - CPUopenvino: Age Gender Recognition Retail 0013 FP16-INT8 - CPUopenvino: Age Gender Recognition Retail 0013 FP16-INT8 - CPUrocksdb: Overwriterocksdb: Rand Readrocksdb: Update Randrocksdb: Read Rand Write Randspeedb: Rand Fillspeedb: Rand Readspeedb: Update Randspeedb: Seq Fillspeedb: Rand Fill Syncspeedb: Read Rand Write Randonnx: GPT-2 - CPU - Parallelonnx: GPT-2 - CPU - Parallelonnx: yolov4 - CPU - Parallelonnx: yolov4 - CPU - Parallelonnx: yolov4 - CPU - Standardonnx: yolov4 - CPU - Standardonnx: T5 Encoder - CPU - Parallelonnx: T5 Encoder - CPU - Parallelonnx: T5 Encoder - CPU - Standardonnx: T5 Encoder - CPU - Standardonnx: bertsquad-12 - CPU - Parallelonnx: bertsquad-12 - CPU - Parallelonnx: bertsquad-12 - CPU - Standardonnx: bertsquad-12 - CPU - Standardonnx: CaffeNet 12-int8 - CPU - Parallelonnx: CaffeNet 12-int8 - CPU - Parallelonnx: CaffeNet 12-int8 - CPU - Standardonnx: CaffeNet 12-int8 - CPU - Standardonnx: fcn-resnet101-11 - CPU - Parallelonnx: fcn-resnet101-11 - CPU - Parallelonnx: fcn-resnet101-11 - CPU - Standardonnx: fcn-resnet101-11 - CPU - Standardonnx: ArcFace ResNet-100 - CPU - Parallelonnx: ArcFace ResNet-100 - CPU - Parallelonnx: ArcFace ResNet-100 - CPU - Standardonnx: ArcFace ResNet-100 - CPU - Standardonnx: ResNet50 v1-12-int8 - CPU - Parallelonnx: ResNet50 v1-12-int8 - CPU - Parallelonnx: ResNet50 v1-12-int8 - CPU - Standardonnx: ResNet50 v1-12-int8 - CPU - Standardonnx: super-resolution-10 - CPU - Parallelonnx: super-resolution-10 - CPU - Parallelonnx: super-resolution-10 - CPU - Standardonnx: super-resolution-10 - CPU - Standardonnx: Faster R-CNN R-50-FPN-int8 - CPU - Parallelonnx: Faster R-CNN R-50-FPN-int8 - CPU - Parallelonnx: Faster R-CNN R-50-FPN-int8 - CPU - Standardonnx: Faster R-CNN R-50-FPN-int8 - CPU - Standardencode-wavpack: WAV To WavPackllama-cpp: llama-2-13b.Q4_0.ggufllama-cpp: llama-2-70b-chat.Q5_0.ggufllamafile: mistral-7b-instruct-v0.2.Q8_0 - CPUllamafile: wizardcoder-python-34b-v1.0.Q6_K - CPUbrl-cad: VGR Performance Metricv-ray: CPULinux 6.8Linux 6.9-rc268146676677333181.51112.4311.5022.3142.7642.7442.9444.8032860.832361.236096.69592.332856.333002.213344.69962093036.30241599112.699260602.693601.098.433364.832.613537.032.47730.96934.60432.56225.66626.002386.2325.900.640.348.350.0717006.836.601138.835035.403339.817731.595736.43595.86548.943127.202123.24618.6624.9029.84715.91333.9862.282.321.0629.733629.2815102.950110.7021210.5041224.28056199971717.24538.462307.50219.5113.35639.61913.4166.4834.500554.798539.0062118.33776.165764821.32748.49518011861210834412613633531763514406577217246650156969091386774021483687321720414.67913.11224.748846784206672994073574038204.61358616.412.085863417.23213.35346.10495.726.051.88723.1658.5024.1296.3135.30135.1847.03202.3770.106129774717071694.526169.36482.6230377557.9710389186.029670.37688.2628490133.28143967.24163551396.4039599.26810.193468957.591798203.12202073.08154589461.19384748.5429600.0231442.6921085.10576905.9270407.9647927.755874353.6320343491.52204365411.59234669.7480643523.241866.5817859304.3821.8245.6053.9838.09271.9976.20119.92307.74451.1381.90445.9082.872530.0414.58331.23337.2111260.989.921018.4736.285067.4022.0616147.576.8515532.547.171446.4277.34671.6654.9826732.884.056336.7817.524621.3223.683626.4130.8511638.519.5967789.250.783777.5629.61121702.120.3838801036049851835982521208443264993804193892921803276372574461181758101.9019.805147.91321126.3848.22351122.236185.2945.41191353.5732.8950110.781792.746714.265670.9566292.1733.42357541.8271.848071.35994747.0844.43649231.28416.783259.602123.461342.781994.248710.6098111.57069.01538152.6356.55011205.4144.8818123.427642.683332.450330.82096.3491.480.364.500.7939068395985269166676689667182.12113.9911.5122.2442.7740.2042.8844.2433072.533015.536180.79602.732826.132993.813341.46732593862.76331198711.076947602.543628.098.413349.632.663492.033.04530.12834.18733.88825.60725.960381.6575.650.610.338.450.0716877.635.078835.734835.650736.503032.829737.43355.76048.568126.187123.09818.9344.9369.52416.15233.0942.232.221.0428.875429.069398.869010.509010.823625.17126444309917.28337.698311.74519.8883.29939.46113.3356.2024.511664.842458.8104318.02755.7820210195.75753.36417741839216434953611623542263529397947336747848957068041380775061541585521668714.29813.35727.994816782841762966549905338147.41396904.011.764863618.28210.71341.97471.885.981.90711.7458.8324.8097.5334.86128.7147.96203.6370.536054776217199190.096427.33487.6029814480.6710232390.419446.07688.7628934422.16147978.33161652700.0935919.64808.993346567.801900682.08200671.70150005776.47392750.0929139.6031460.4220605.39569593.0070036.2046123.325908316.0319390362.90200468629.32230503.3485035507.551858.7018740350.5622.0246.5653.8239.37279.7475.56121.93302.77466.4579.23467.7979.002656.4213.89330.73337.7811295.929.891051.3035.145052.7122.1216349.056.7615589.597.141442.2177.57673.4654.8327790.243.896306.4217.584600.9523.973608.2131.0111564.789.6573754.740.713704.3830.20119735.570.3839196836158608336150220685883228163758374792934143301672596031175562105.78279.464968.04142124.3768.90936112.428196.0765.10755402.6692.4823410.600694.333015.411065.9960293.0293.40972571.1901.749731.50300668.6995.41259184.78517.562356.947824.232841.504895.144110.5119122.6018.23121153.5646.51127213.7374.6781123.172743.151134.351229.11076.3401.530.374.580.77399180258995OpenBenchmarking.org

Quicksilver

Input: CORAL2 P1

OpenBenchmarking.orgFigure Of Merit, More Is BetterQuicksilver 20230818Input: CORAL2 P1Linux 6.8Linux 6.9-rc21.5M3M4.5M6M7.5MSE +/- 67589.78, N = 6SE +/- 46491.34, N = 3681466769166671. (CXX) g++ options: -fopenmp -O3 -march=native

Quicksilver

Input: CORAL2 P2

OpenBenchmarking.orgFigure Of Merit, More Is BetterQuicksilver 20230818Input: CORAL2 P2Linux 6.8Linux 6.9-rc21.4M2.8M4.2M5.6M7MSE +/- 74194.56, N = 9SE +/- 91964.82, N = 9667733366896671. (CXX) g++ options: -fopenmp -O3 -march=native

FFmpeg

Encoder: libx264 - Scenario: Live

OpenBenchmarking.orgFPS, More Is BetterFFmpeg 6.1Encoder: libx264 - Scenario: LiveLinux 6.8Linux 6.9-rc24080120160200SE +/- 1.29, N = 3SE +/- 0.70, N = 3181.51182.121. (CXX) g++ options: -O3 -rdynamic -lpthread -lrt -ldl -lnuma

FFmpeg

Encoder: libx265 - Scenario: Live

OpenBenchmarking.orgFPS, More Is BetterFFmpeg 6.1Encoder: libx265 - Scenario: LiveLinux 6.8Linux 6.9-rc2306090120150SE +/- 1.36, N = 15SE +/- 1.80, N = 15112.43113.991. (CXX) g++ options: -O3 -rdynamic -lpthread -lrt -ldl -lnuma

FFmpeg

Encoder: libx264 - Scenario: Upload

OpenBenchmarking.orgFPS, More Is BetterFFmpeg 6.1Encoder: libx264 - Scenario: UploadLinux 6.8Linux 6.9-rc23691215SE +/- 0.01, N = 3SE +/- 0.01, N = 311.5011.511. (CXX) g++ options: -O3 -rdynamic -lpthread -lrt -ldl -lnuma

FFmpeg

Encoder: libx265 - Scenario: Upload

OpenBenchmarking.orgFPS, More Is BetterFFmpeg 6.1Encoder: libx265 - Scenario: UploadLinux 6.8Linux 6.9-rc2510152025SE +/- 0.31, N = 3SE +/- 0.26, N = 422.3122.241. (CXX) g++ options: -O3 -rdynamic -lpthread -lrt -ldl -lnuma

FFmpeg

Encoder: libx264 - Scenario: Platform

OpenBenchmarking.orgFPS, More Is BetterFFmpeg 6.1Encoder: libx264 - Scenario: PlatformLinux 6.8Linux 6.9-rc21020304050SE +/- 0.17, N = 3SE +/- 0.10, N = 342.7642.771. (CXX) g++ options: -O3 -rdynamic -lpthread -lrt -ldl -lnuma

FFmpeg

Encoder: libx265 - Scenario: Platform

OpenBenchmarking.orgFPS, More Is BetterFFmpeg 6.1Encoder: libx265 - Scenario: PlatformLinux 6.8Linux 6.9-rc21020304050SE +/- 0.71, N = 12SE +/- 0.46, N = 1242.7440.201. (CXX) g++ options: -O3 -rdynamic -lpthread -lrt -ldl -lnuma

FFmpeg

Encoder: libx264 - Scenario: Video On Demand

OpenBenchmarking.orgFPS, More Is BetterFFmpeg 6.1Encoder: libx264 - Scenario: Video On DemandLinux 6.8Linux 6.9-rc21020304050SE +/- 0.06, N = 3SE +/- 0.10, N = 342.9442.881. (CXX) g++ options: -O3 -rdynamic -lpthread -lrt -ldl -lnuma

FFmpeg

Encoder: libx265 - Scenario: Video On Demand

OpenBenchmarking.orgFPS, More Is BetterFFmpeg 6.1Encoder: libx265 - Scenario: Video On DemandLinux 6.8Linux 6.9-rc21020304050SE +/- 0.50, N = 12SE +/- 0.76, N = 944.8044.241. (CXX) g++ options: -O3 -rdynamic -lpthread -lrt -ldl -lnuma

Xmrig

Variant: KawPow - Hash Count: 1M

OpenBenchmarking.orgH/s, More Is BetterXmrig 6.21Variant: KawPow - Hash Count: 1MLinux 6.8Linux 6.9-rc27K14K21K28K35KSE +/- 68.36, N = 3SE +/- 137.96, N = 332860.833072.51. (CXX) g++ options: -fexceptions -fno-rtti -maes -O3 -Ofast -static-libgcc -static-libstdc++ -rdynamic -lssl -lcrypto -luv -lpthread -lrt -ldl -lhwloc

Xmrig

Variant: Monero - Hash Count: 1M

OpenBenchmarking.orgH/s, More Is BetterXmrig 6.21Variant: Monero - Hash Count: 1MLinux 6.8Linux 6.9-rc27K14K21K28K35KSE +/- 320.50, N = 13SE +/- 181.84, N = 332361.233015.51. (CXX) g++ options: -fexceptions -fno-rtti -maes -O3 -Ofast -static-libgcc -static-libstdc++ -rdynamic -lssl -lcrypto -luv -lpthread -lrt -ldl -lhwloc

Xmrig

Variant: Wownero - Hash Count: 1M

OpenBenchmarking.orgH/s, More Is BetterXmrig 6.21Variant: Wownero - Hash Count: 1MLinux 6.8Linux 6.9-rc28K16K24K32K40KSE +/- 245.88, N = 3SE +/- 490.33, N = 336096.636180.71. (CXX) g++ options: -fexceptions -fno-rtti -maes -O3 -Ofast -static-libgcc -static-libstdc++ -rdynamic -lssl -lcrypto -luv -lpthread -lrt -ldl -lhwloc

Xmrig

Variant: GhostRider - Hash Count: 1M

OpenBenchmarking.orgH/s, More Is BetterXmrig 6.21Variant: GhostRider - Hash Count: 1MLinux 6.8Linux 6.9-rc22K4K6K8K10KSE +/- 31.05, N = 3SE +/- 42.79, N = 39592.39602.71. (CXX) g++ options: -fexceptions -fno-rtti -maes -O3 -Ofast -static-libgcc -static-libstdc++ -rdynamic -lssl -lcrypto -luv -lpthread -lrt -ldl -lhwloc

Xmrig

Variant: CryptoNight-Heavy - Hash Count: 1M

OpenBenchmarking.orgH/s, More Is BetterXmrig 6.21Variant: CryptoNight-Heavy - Hash Count: 1MLinux 6.8Linux 6.9-rc27K14K21K28K35KSE +/- 49.86, N = 3SE +/- 160.32, N = 332856.332826.11. (CXX) g++ options: -fexceptions -fno-rtti -maes -O3 -Ofast -static-libgcc -static-libstdc++ -rdynamic -lssl -lcrypto -luv -lpthread -lrt -ldl -lhwloc

Xmrig

Variant: CryptoNight-Femto UPX2 - Hash Count: 1M

OpenBenchmarking.orgH/s, More Is BetterXmrig 6.21Variant: CryptoNight-Femto UPX2 - Hash Count: 1MLinux 6.8Linux 6.9-rc27K14K21K28K35KSE +/- 110.64, N = 3SE +/- 170.37, N = 333002.232993.81. (CXX) g++ options: -fexceptions -fno-rtti -maes -O3 -Ofast -static-libgcc -static-libstdc++ -rdynamic -lssl -lcrypto -luv -lpthread -lrt -ldl -lhwloc

CacheBench

Test: Read

OpenBenchmarking.orgMB/s, More Is BetterCacheBenchTest: ReadLinux 6.8Linux 6.9-rc23K6K9K12K15KSE +/- 0.52, N = 3SE +/- 0.88, N = 313344.7013341.47MIN: 13338.06 / MAX: 13346.23MIN: 13335.31 / MAX: 13343.851. (CC) gcc options: -O3 -lrt

CacheBench

Test: Write

OpenBenchmarking.orgMB/s, More Is BetterCacheBenchTest: WriteLinux 6.8Linux 6.9-rc220K40K60K80K100KSE +/- 36.95, N = 3SE +/- 65.10, N = 393036.3093862.76MIN: 54037.87 / MAX: 103869.49MIN: 54012.69 / MAX: 104121.121. (CC) gcc options: -O3 -lrt

CacheBench

Test: Read / Modify / Write

OpenBenchmarking.orgMB/s, More Is BetterCacheBenchTest: Read / Modify / WriteLinux 6.8Linux 6.9-rc220K40K60K80K100KSE +/- 2.71, N = 3SE +/- 71.07, N = 399112.7098711.08MIN: 88982.6 / MAX: 105154.55MIN: 85707.72 / MAX: 105115.441. (CC) gcc options: -O3 -lrt

LZ4 Compression

Compression Level: 1 - Compression Speed

OpenBenchmarking.orgMB/s, More Is BetterLZ4 Compression 1.9.4Compression Level: 1 - Compression SpeedLinux 6.8Linux 6.9-rc2130260390520650SE +/- 1.15, N = 3SE +/- 0.16, N = 3602.69602.541. (CC) gcc options: -O3

LZ4 Compression

Compression Level: 1 - Decompression Speed

OpenBenchmarking.orgMB/s, More Is BetterLZ4 Compression 1.9.4Compression Level: 1 - Decompression SpeedLinux 6.8Linux 6.9-rc28001600240032004000SE +/- 44.31, N = 3SE +/- 18.57, N = 33601.03628.01. (CC) gcc options: -O3

LZ4 Compression

Compression Level: 3 - Compression Speed

OpenBenchmarking.orgMB/s, More Is BetterLZ4 Compression 1.9.4Compression Level: 3 - Compression SpeedLinux 6.8Linux 6.9-rc220406080100SE +/- 0.06, N = 3SE +/- 0.06, N = 398.4398.411. (CC) gcc options: -O3

LZ4 Compression

Compression Level: 3 - Decompression Speed

OpenBenchmarking.orgMB/s, More Is BetterLZ4 Compression 1.9.4Compression Level: 3 - Decompression SpeedLinux 6.8Linux 6.9-rc27001400210028003500SE +/- 33.92, N = 3SE +/- 34.17, N = 33364.83349.61. (CC) gcc options: -O3

LZ4 Compression

Compression Level: 9 - Compression Speed

OpenBenchmarking.orgMB/s, More Is BetterLZ4 Compression 1.9.4Compression Level: 9 - Compression SpeedLinux 6.8Linux 6.9-rc2816243240SE +/- 0.08, N = 3SE +/- 0.07, N = 332.6132.661. (CC) gcc options: -O3

LZ4 Compression

Compression Level: 9 - Decompression Speed

OpenBenchmarking.orgMB/s, More Is BetterLZ4 Compression 1.9.4Compression Level: 9 - Decompression SpeedLinux 6.8Linux 6.9-rc28001600240032004000SE +/- 16.01, N = 3SE +/- 57.81, N = 33537.03492.01. (CC) gcc options: -O3

JPEG-XL libjxl

Input: PNG - Quality: 80

OpenBenchmarking.orgMP/s, More Is BetterJPEG-XL libjxl 0.10.1Input: PNG - Quality: 80Linux 6.8Linux 6.9-rc2816243240SE +/- 0.38, N = 3SE +/- 0.36, N = 1532.4833.051. (CXX) g++ options: -fno-rtti -O3 -fPIE -pie -lm

JPEG-XL libjxl

Input: PNG - Quality: 90

OpenBenchmarking.orgMP/s, More Is BetterJPEG-XL libjxl 0.10.1Input: PNG - Quality: 90Linux 6.8Linux 6.9-rc2714212835SE +/- 0.28, N = 3SE +/- 0.18, N = 330.9730.131. (CXX) g++ options: -fno-rtti -O3 -fPIE -pie -lm

JPEG-XL libjxl

Input: JPEG - Quality: 80

OpenBenchmarking.orgMP/s, More Is BetterJPEG-XL libjxl 0.10.1Input: JPEG - Quality: 80Linux 6.8Linux 6.9-rc2816243240SE +/- 0.51, N = 12SE +/- 0.53, N = 1534.6034.191. (CXX) g++ options: -fno-rtti -O3 -fPIE -pie -lm

JPEG-XL libjxl

Input: JPEG - Quality: 90

OpenBenchmarking.orgMP/s, More Is BetterJPEG-XL libjxl 0.10.1Input: JPEG - Quality: 90Linux 6.8Linux 6.9-rc2816243240SE +/- 0.37, N = 3SE +/- 0.38, N = 1532.5633.891. (CXX) g++ options: -fno-rtti -O3 -fPIE -pie -lm

JPEG-XL libjxl

Input: PNG - Quality: 100

OpenBenchmarking.orgMP/s, More Is BetterJPEG-XL libjxl 0.10.1Input: PNG - Quality: 100Linux 6.8Linux 6.9-rc2612182430SE +/- 0.15, N = 3SE +/- 0.21, N = 325.6725.611. (CXX) g++ options: -fno-rtti -O3 -fPIE -pie -lm

JPEG-XL libjxl

Input: JPEG - Quality: 100

OpenBenchmarking.orgMP/s, More Is BetterJPEG-XL libjxl 0.10.1Input: JPEG - Quality: 100Linux 6.8Linux 6.9-rc2612182430SE +/- 0.11, N = 3SE +/- 0.08, N = 326.0025.961. (CXX) g++ options: -fno-rtti -O3 -fPIE -pie -lm

JPEG-XL Decoding libjxl

CPU Threads: All

OpenBenchmarking.orgMP/s, More Is BetterJPEG-XL Decoding libjxl 0.10.1CPU Threads: AllLinux 6.8Linux 6.9-rc280160240320400SE +/- 4.23, N = 3SE +/- 2.26, N = 3386.23381.66

WebP2 Image Encode

Encode Settings: Default

OpenBenchmarking.orgMP/s, More Is BetterWebP2 Image Encode 20220823Encode Settings: DefaultLinux 6.8Linux 6.9-rc21.32752.6553.98255.316.6375SE +/- 0.11, N = 15SE +/- 0.09, N = 155.905.651. (CXX) g++ options: -msse4.2 -fno-rtti -O3 -ldl

WebP2 Image Encode

Encode Settings: Quality 75, Compression Effort 7

OpenBenchmarking.orgMP/s, More Is BetterWebP2 Image Encode 20220823Encode Settings: Quality 75, Compression Effort 7Linux 6.8Linux 6.9-rc20.1440.2880.4320.5760.72SE +/- 0.01, N = 3SE +/- 0.01, N = 40.640.611. (CXX) g++ options: -msse4.2 -fno-rtti -O3 -ldl

WebP2 Image Encode

Encode Settings: Quality 95, Compression Effort 7

OpenBenchmarking.orgMP/s, More Is BetterWebP2 Image Encode 20220823Encode Settings: Quality 95, Compression Effort 7Linux 6.8Linux 6.9-rc20.07650.1530.22950.3060.3825SE +/- 0.00, N = 3SE +/- 0.00, N = 30.340.331. (CXX) g++ options: -msse4.2 -fno-rtti -O3 -ldl

WebP2 Image Encode

Encode Settings: Quality 100, Compression Effort 5

OpenBenchmarking.orgMP/s, More Is BetterWebP2 Image Encode 20220823Encode Settings: Quality 100, Compression Effort 5Linux 6.8Linux 6.9-rc2246810SE +/- 0.11, N = 15SE +/- 0.07, N = 38.358.451. (CXX) g++ options: -msse4.2 -fno-rtti -O3 -ldl

WebP2 Image Encode

Encode Settings: Quality 100, Lossless Compression

OpenBenchmarking.orgMP/s, More Is BetterWebP2 Image Encode 20220823Encode Settings: Quality 100, Lossless CompressionLinux 6.8Linux 6.9-rc20.01580.03160.04740.06320.079SE +/- 0.00, N = 3SE +/- 0.00, N = 30.070.071. (CXX) g++ options: -msse4.2 -fno-rtti -O3 -ldl

srsRAN Project

Test: PDSCH Processor Benchmark, Throughput Total

OpenBenchmarking.orgMbps, More Is BettersrsRAN Project 23.10.1-20240219Test: PDSCH Processor Benchmark, Throughput TotalLinux 6.8Linux 6.9-rc24K8K12K16K20KSE +/- 263.34, N = 15SE +/- 377.19, N = 1217006.816877.61. (CXX) g++ options: -march=native -mavx2 -mavx -msse4.1 -mfma -mavx512f -mavx512cd -mavx512bw -mavx512dq -O3 -fno-trapping-math -fno-math-errno -ldl

Embree

Binary: Pathtracer - Model: Crown

OpenBenchmarking.orgFrames Per Second, More Is BetterEmbree 4.3Binary: Pathtracer - Model: CrownLinux 6.8Linux 6.9-rc2816243240SE +/- 0.59, N = 15SE +/- 1.07, N = 1536.6035.08MIN: 25.71 / MAX: 54.49MIN: 22.8 / MAX: 59.06

Embree

Binary: Pathtracer ISPC - Model: Crown

OpenBenchmarking.orgFrames Per Second, More Is BetterEmbree 4.3Binary: Pathtracer ISPC - Model: CrownLinux 6.8Linux 6.9-rc2918273645SE +/- 0.47, N = 4SE +/- 1.44, N = 1238.8435.73MIN: 30.82 / MAX: 52.25MIN: 20.32 / MAX: 57.51

Embree

Binary: Pathtracer - Model: Asian Dragon

OpenBenchmarking.orgFrames Per Second, More Is BetterEmbree 4.3Binary: Pathtracer - Model: Asian DragonLinux 6.8Linux 6.9-rc2816243240SE +/- 0.86, N = 15SE +/- 0.54, N = 1535.4035.65MIN: 23.5 / MAX: 52.61MIN: 24.54 / MAX: 51.88

Embree

Binary: Pathtracer - Model: Asian Dragon Obj

OpenBenchmarking.orgFrames Per Second, More Is BetterEmbree 4.3Binary: Pathtracer - Model: Asian Dragon ObjLinux 6.8Linux 6.9-rc2918273645SE +/- 0.92, N = 15SE +/- 0.60, N = 1539.8236.50MIN: 26.64 / MAX: 50.91MIN: 22.66 / MAX: 46.51

Embree

Binary: Pathtracer ISPC - Model: Asian Dragon

OpenBenchmarking.orgFrames Per Second, More Is BetterEmbree 4.3Binary: Pathtracer ISPC - Model: Asian DragonLinux 6.8Linux 6.9-rc2816243240SE +/- 0.77, N = 13SE +/- 0.82, N = 1531.6032.83MIN: 20.8 / MAX: 52.83MIN: 22.56 / MAX: 48.16

Embree

Binary: Pathtracer ISPC - Model: Asian Dragon Obj

OpenBenchmarking.orgFrames Per Second, More Is BetterEmbree 4.3Binary: Pathtracer ISPC - Model: Asian Dragon ObjLinux 6.8Linux 6.9-rc2918273645SE +/- 0.94, N = 15SE +/- 0.88, N = 1536.4437.43MIN: 22.56 / MAX: 49.05MIN: 27.23 / MAX: 49.01

SVT-AV1

Encoder Mode: Preset 4 - Input: Bosphorus 4K

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 2.0Encoder Mode: Preset 4 - Input: Bosphorus 4KLinux 6.8Linux 6.9-rc21.31962.63923.95885.27846.598SE +/- 0.035, N = 3SE +/- 0.051, N = 155.8655.7601. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

SVT-AV1

Encoder Mode: Preset 8 - Input: Bosphorus 4K

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 2.0Encoder Mode: Preset 8 - Input: Bosphorus 4KLinux 6.8Linux 6.9-rc21122334455SE +/- 1.10, N = 12SE +/- 1.18, N = 1548.9448.571. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

SVT-AV1

Encoder Mode: Preset 12 - Input: Bosphorus 4K

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 2.0Encoder Mode: Preset 12 - Input: Bosphorus 4KLinux 6.8Linux 6.9-rc2306090120150SE +/- 5.13, N = 15SE +/- 5.21, N = 15127.20126.191. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

SVT-AV1

Encoder Mode: Preset 13 - Input: Bosphorus 4K

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 2.0Encoder Mode: Preset 13 - Input: Bosphorus 4KLinux 6.8Linux 6.9-rc2306090120150SE +/- 3.82, N = 12SE +/- 5.42, N = 15123.25123.101. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

SVT-AV1

Encoder Mode: Preset 4 - Input: Bosphorus 1080p

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 2.0Encoder Mode: Preset 4 - Input: Bosphorus 1080pLinux 6.8Linux 6.9-rc2510152025SE +/- 0.13, N = 15SE +/- 0.21, N = 318.6618.931. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

VVenC

Video Input: Bosphorus 4K - Video Preset: Fast

OpenBenchmarking.orgFrames Per Second, More Is BetterVVenC 1.11Video Input: Bosphorus 4K - Video Preset: FastLinux 6.8Linux 6.9-rc21.11062.22123.33184.44245.553SE +/- 0.075, N = 10SE +/- 0.077, N = 124.9024.9361. (CXX) g++ options: -O3 -flto=auto -fno-fat-lto-objects

VVenC

Video Input: Bosphorus 4K - Video Preset: Faster

OpenBenchmarking.orgFrames Per Second, More Is BetterVVenC 1.11Video Input: Bosphorus 4K - Video Preset: FasterLinux 6.8Linux 6.9-rc23691215SE +/- 0.200, N = 12SE +/- 0.172, N = 159.8479.5241. (CXX) g++ options: -O3 -flto=auto -fno-fat-lto-objects

VVenC

Video Input: Bosphorus 1080p - Video Preset: Fast

OpenBenchmarking.orgFrames Per Second, More Is BetterVVenC 1.11Video Input: Bosphorus 1080p - Video Preset: FastLinux 6.8Linux 6.9-rc248121620SE +/- 0.11, N = 3SE +/- 0.07, N = 315.9116.151. (CXX) g++ options: -O3 -flto=auto -fno-fat-lto-objects

VVenC

Video Input: Bosphorus 1080p - Video Preset: Faster

OpenBenchmarking.orgFrames Per Second, More Is BetterVVenC 1.11Video Input: Bosphorus 1080p - Video Preset: FasterLinux 6.8Linux 6.9-rc2816243240SE +/- 0.29, N = 15SE +/- 0.36, N = 1533.9933.091. (CXX) g++ options: -O3 -flto=auto -fno-fat-lto-objects

Intel Open Image Denoise

Run: RT.hdr_alb_nrm.3840x2160 - Device: CPU-Only

OpenBenchmarking.orgImages / Sec, More Is BetterIntel Open Image Denoise 2.2Run: RT.hdr_alb_nrm.3840x2160 - Device: CPU-OnlyLinux 6.8Linux 6.9-rc20.5131.0261.5392.0522.565SE +/- 0.02, N = 15SE +/- 0.02, N = 152.282.23

Intel Open Image Denoise

Run: RT.ldr_alb_nrm.3840x2160 - Device: CPU-Only

OpenBenchmarking.orgImages / Sec, More Is BetterIntel Open Image Denoise 2.2Run: RT.ldr_alb_nrm.3840x2160 - Device: CPU-OnlyLinux 6.8Linux 6.9-rc20.5221.0441.5662.0882.61SE +/- 0.03, N = 3SE +/- 0.03, N = 32.322.22

Intel Open Image Denoise

Run: RTLightmap.hdr.4096x4096 - Device: CPU-Only

OpenBenchmarking.orgImages / Sec, More Is BetterIntel Open Image Denoise 2.2Run: RTLightmap.hdr.4096x4096 - Device: CPU-OnlyLinux 6.8Linux 6.9-rc20.23850.4770.71550.9541.1925SE +/- 0.01, N = 7SE +/- 0.01, N = 151.061.04

OSPRay

Benchmark: particle_volume/ao/real_time

OpenBenchmarking.orgItems Per Second, More Is BetterOSPRay 3.1Benchmark: particle_volume/ao/real_timeLinux 6.8Linux 6.9-rc2714212835SE +/- 0.11, N = 3SE +/- 0.19, N = 329.7328.88

OSPRay

Benchmark: particle_volume/scivis/real_time

OpenBenchmarking.orgItems Per Second, More Is BetterOSPRay 3.1Benchmark: particle_volume/scivis/real_timeLinux 6.8Linux 6.9-rc2714212835SE +/- 0.26, N = 3SE +/- 0.33, N = 329.2829.07

OSPRay

Benchmark: particle_volume/pathtracer/real_time

OpenBenchmarking.orgItems Per Second, More Is BetterOSPRay 3.1Benchmark: particle_volume/pathtracer/real_timeLinux 6.8Linux 6.9-rc220406080100SE +/- 1.85, N = 12SE +/- 1.98, N = 9102.9598.87

OSPRay

Benchmark: gravity_spheres_volume/dim_512/ao/real_time

OpenBenchmarking.orgItems Per Second, More Is BetterOSPRay 3.1Benchmark: gravity_spheres_volume/dim_512/ao/real_timeLinux 6.8Linux 6.9-rc23691215SE +/- 0.14, N = 15SE +/- 0.05, N = 310.7010.51

OSPRay

Benchmark: gravity_spheres_volume/dim_512/scivis/real_time

OpenBenchmarking.orgItems Per Second, More Is BetterOSPRay 3.1Benchmark: gravity_spheres_volume/dim_512/scivis/real_timeLinux 6.8Linux 6.9-rc23691215SE +/- 0.08, N = 15SE +/- 0.07, N = 310.5010.82

OSPRay

Benchmark: gravity_spheres_volume/dim_512/pathtracer/real_time

OpenBenchmarking.orgItems Per Second, More Is BetterOSPRay 3.1Benchmark: gravity_spheres_volume/dim_512/pathtracer/real_timeLinux 6.8Linux 6.9-rc2612182430SE +/- 0.41, N = 12SE +/- 0.20, N = 324.2825.17

Stockfish

Chess Benchmark

OpenBenchmarking.orgNodes Per Second, More Is BetterStockfish 16.1Chess BenchmarkLinux 6.8Linux 6.9-rc214M28M42M56M70MSE +/- 2993041.97, N = 9SE +/- 2705883.43, N = 961999717644430991. (CXX) g++ options: -lgcov -m64 -lpthread -fno-exceptions -std=c++17 -fno-peel-loops -fno-tracer -pedantic -O3 -funroll-loops -msse -msse3 -mpopcnt -mavx2 -mbmi -mavx512f -mavx512bw -mavx512vnni -mavx512dq -mavx512vl -msse4.1 -mssse3 -msse2 -mbmi2 -flto -flto-partition=one -flto=jobserver

Timed FFmpeg Compilation

Time To Compile

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed FFmpeg Compilation 6.1Time To CompileLinux 6.8Linux 6.9-rc248121620SE +/- 0.39, N = 15SE +/- 0.39, N = 1517.2517.28

Timed Linux Kernel Compilation

Build: defconfig

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed Linux Kernel Compilation 6.8Build: defconfigLinux 6.8Linux 6.9-rc2918273645SE +/- 0.36, N = 6SE +/- 0.37, N = 638.4637.70

Timed Linux Kernel Compilation

Build: allmodconfig

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed Linux Kernel Compilation 6.8Build: allmodconfigLinux 6.8Linux 6.9-rc270140210280350SE +/- 3.84, N = 3SE +/- 1.26, N = 3307.50311.75

Timed Mesa Compilation

Time To Compile

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed Mesa Compilation 24.0Time To CompileLinux 6.8Linux 6.9-rc2510152025SE +/- 0.51, N = 15SE +/- 0.39, N = 1519.5119.89

Primesieve

Length: 1e12

OpenBenchmarking.orgSeconds, Fewer Is BetterPrimesieve 12.1Length: 1e12Linux 6.8Linux 6.9-rc20.75511.51022.26533.02043.7755SE +/- 0.024, N = 11SE +/- 0.044, N = 33.3563.2991. (CXX) g++ options: -O3

Primesieve

Length: 1e13

OpenBenchmarking.orgSeconds, Fewer Is BetterPrimesieve 12.1Length: 1e13Linux 6.8Linux 6.9-rc2918273645SE +/- 0.06, N = 3SE +/- 0.09, N = 339.6239.461. (CXX) g++ options: -O3

Y-Cruncher

Pi Digits To Calculate: 1B

OpenBenchmarking.orgSeconds, Fewer Is BetterY-Cruncher 0.8.3Pi Digits To Calculate: 1BLinux 6.8Linux 6.9-rc23691215SE +/- 0.30, N = 15SE +/- 0.24, N = 1513.4213.34

Y-Cruncher

Pi Digits To Calculate: 500M

OpenBenchmarking.orgSeconds, Fewer Is BetterY-Cruncher 0.8.3Pi Digits To Calculate: 500MLinux 6.8Linux 6.9-rc2246810SE +/- 0.143, N = 12SE +/- 0.083, N = 156.4836.202

oneDNN

Harness: IP Shapes 1D - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.4Harness: IP Shapes 1D - Engine: CPULinux 6.8Linux 6.9-rc21.01512.03023.04534.06045.0755SE +/- 0.04580, N = 3SE +/- 0.05180, N = 124.500554.51166MIN: 3.52MIN: 3.371. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread

oneDNN

Harness: IP Shapes 3D - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.4Harness: IP Shapes 3D - Engine: CPULinux 6.8Linux 6.9-rc21.08962.17923.26884.35845.448SE +/- 0.02352, N = 3SE +/- 0.02357, N = 34.798534.84245MIN: 3.98MIN: 4.011. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread

oneDNN

Harness: Convolution Batch Shapes Auto - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.4Harness: Convolution Batch Shapes Auto - Engine: CPULinux 6.8Linux 6.9-rc23691215SE +/- 0.03328, N = 3SE +/- 0.09863, N = 159.006218.81043MIN: 8.12MIN: 6.251. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread

oneDNN

Harness: Deconvolution Batch shapes_1d - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.4Harness: Deconvolution Batch shapes_1d - Engine: CPULinux 6.8Linux 6.9-rc2510152025SE +/- 0.23, N = 15SE +/- 0.14, N = 318.3418.03MIN: 10.09MIN: 13.291. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread

oneDNN

Harness: Deconvolution Batch shapes_3d - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.4Harness: Deconvolution Batch shapes_3d - Engine: CPULinux 6.8Linux 6.9-rc2246810SE +/- 0.10591, N = 15SE +/- 0.04472, N = 36.165765.78202MIN: 3.75MIN: 3.811. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread

oneDNN

Harness: Recurrent Neural Network Training - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.4Harness: Recurrent Neural Network Training - Engine: CPULinux 6.8Linux 6.9-rc22K4K6K8K10KSE +/- 22.69, N = 3SE +/- 498.89, N = 134821.3210195.75MIN: 4659.99MIN: 4568.31. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread

oneDNN

Harness: Recurrent Neural Network Inference - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.4Harness: Recurrent Neural Network Inference - Engine: CPULinux 6.8Linux 6.9-rc2160320480640800SE +/- 7.46, N = 3SE +/- 6.16, N = 9748.50753.36MIN: 677.68MIN: 652.831. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread

OSPRay Studio

Camera: 1 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path Tracer - Acceleration: CPU

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 1.0Camera: 1 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path Tracer - Acceleration: CPULinux 6.8Linux 6.9-rc2400800120016002000SE +/- 40.26, N = 15SE +/- 22.91, N = 1518011774

OSPRay Studio

Camera: 2 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path Tracer - Acceleration: CPU

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 1.0Camera: 2 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path Tracer - Acceleration: CPULinux 6.8Linux 6.9-rc2400800120016002000SE +/- 13.93, N = 11SE +/- 26.21, N = 318611839

OSPRay Studio

Camera: 3 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path Tracer - Acceleration: CPU

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 1.0Camera: 3 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path Tracer - Acceleration: CPULinux 6.8Linux 6.9-rc25001000150020002500SE +/- 21.99, N = 4SE +/- 26.16, N = 1321082164

OSPRay Studio

Camera: 1 - Resolution: 4K - Samples Per Pixel: 16 - Renderer: Path Tracer - Acceleration: CPU

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 1.0Camera: 1 - Resolution: 4K - Samples Per Pixel: 16 - Renderer: Path Tracer - Acceleration: CPULinux 6.8Linux 6.9-rc27K14K21K28K35KSE +/- 294.16, N = 3SE +/- 454.99, N = 33441234953

OSPRay Studio

Camera: 1 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path Tracer - Acceleration: CPU

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 1.0Camera: 1 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path Tracer - Acceleration: CPULinux 6.8Linux 6.9-rc213K26K39K52K65KSE +/- 443.96, N = 15SE +/- 567.54, N = 76136361162

OSPRay Studio

Camera: 2 - Resolution: 4K - Samples Per Pixel: 16 - Renderer: Path Tracer - Acceleration: CPU

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 1.0Camera: 2 - Resolution: 4K - Samples Per Pixel: 16 - Renderer: Path Tracer - Acceleration: CPULinux 6.8Linux 6.9-rc28K16K24K32K40KSE +/- 302.37, N = 15SE +/- 483.46, N = 33531735422

OSPRay Studio

Camera: 2 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path Tracer - Acceleration: CPU

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 1.0Camera: 2 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path Tracer - Acceleration: CPULinux 6.8Linux 6.9-rc214K28K42K56K70KSE +/- 591.53, N = 7SE +/- 885.61, N = 36351463529

OSPRay Studio

Camera: 3 - Resolution: 4K - Samples Per Pixel: 16 - Renderer: Path Tracer - Acceleration: CPU

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 1.0Camera: 3 - Resolution: 4K - Samples Per Pixel: 16 - Renderer: Path Tracer - Acceleration: CPULinux 6.8Linux 6.9-rc29K18K27K36K45KSE +/- 626.71, N = 12SE +/- 252.89, N = 34065739794

OSPRay Studio

Camera: 3 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path Tracer - Acceleration: CPU

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 1.0Camera: 3 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path Tracer - Acceleration: CPULinux 6.8Linux 6.9-rc216K32K48K64K80KSE +/- 506.90, N = 3SE +/- 855.02, N = 157217273367

OSPRay Studio

Camera: 1 - Resolution: 1080p - Samples Per Pixel: 1 - Renderer: Path Tracer - Acceleration: CPU

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 1.0Camera: 1 - Resolution: 1080p - Samples Per Pixel: 1 - Renderer: Path Tracer - Acceleration: CPULinux 6.8Linux 6.9-rc2100200300400500SE +/- 3.71, N = 3SE +/- 2.33, N = 3466478

OSPRay Studio

Camera: 2 - Resolution: 1080p - Samples Per Pixel: 1 - Renderer: Path Tracer - Acceleration: CPU

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 1.0Camera: 2 - Resolution: 1080p - Samples Per Pixel: 1 - Renderer: Path Tracer - Acceleration: CPULinux 6.8Linux 6.9-rc2110220330440550SE +/- 5.26, N = 5SE +/- 2.33, N = 3501489

OSPRay Studio

Camera: 3 - Resolution: 1080p - Samples Per Pixel: 1 - Renderer: Path Tracer - Acceleration: CPU

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 1.0Camera: 3 - Resolution: 1080p - Samples Per Pixel: 1 - Renderer: Path Tracer - Acceleration: CPULinux 6.8Linux 6.9-rc2120240360480600SE +/- 4.36, N = 15SE +/- 4.85, N = 15569570

OSPRay Studio

Camera: 1 - Resolution: 1080p - Samples Per Pixel: 16 - Renderer: Path Tracer - Acceleration: CPU

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 1.0Camera: 1 - Resolution: 1080p - Samples Per Pixel: 16 - Renderer: Path Tracer - Acceleration: CPULinux 6.8Linux 6.9-rc215003000450060007500SE +/- 83.68, N = 3SE +/- 15.17, N = 369096804

OSPRay Studio

Camera: 1 - Resolution: 1080p - Samples Per Pixel: 32 - Renderer: Path Tracer - Acceleration: CPU

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 1.0Camera: 1 - Resolution: 1080p - Samples Per Pixel: 32 - Renderer: Path Tracer - Acceleration: CPULinux 6.8Linux 6.9-rc23K6K9K12K15KSE +/- 112.81, N = 9SE +/- 180.26, N = 31386713807

OSPRay Studio

Camera: 2 - Resolution: 1080p - Samples Per Pixel: 16 - Renderer: Path Tracer - Acceleration: CPU

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 1.0Camera: 2 - Resolution: 1080p - Samples Per Pixel: 16 - Renderer: Path Tracer - Acceleration: CPULinux 6.8Linux 6.9-rc216003200480064008000SE +/- 105.66, N = 3SE +/- 118.69, N = 1574027506

OSPRay Studio

Camera: 2 - Resolution: 1080p - Samples Per Pixel: 32 - Renderer: Path Tracer - Acceleration: CPU

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 1.0Camera: 2 - Resolution: 1080p - Samples Per Pixel: 32 - Renderer: Path Tracer - Acceleration: CPULinux 6.8Linux 6.9-rc23K6K9K12K15KSE +/- 268.32, N = 12SE +/- 235.77, N = 151483615415

OSPRay Studio

Camera: 3 - Resolution: 1080p - Samples Per Pixel: 16 - Renderer: Path Tracer - Acceleration: CPU

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 1.0Camera: 3 - Resolution: 1080p - Samples Per Pixel: 16 - Renderer: Path Tracer - Acceleration: CPULinux 6.8Linux 6.9-rc22K4K6K8K10KSE +/- 70.21, N = 3SE +/- 26.21, N = 387328552

OSPRay Studio

Camera: 3 - Resolution: 1080p - Samples Per Pixel: 32 - Renderer: Path Tracer - Acceleration: CPU

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 1.0Camera: 3 - Resolution: 1080p - Samples Per Pixel: 32 - Renderer: Path Tracer - Acceleration: CPULinux 6.8Linux 6.9-rc24K8K12K16K20KSE +/- 101.18, N = 3SE +/- 156.23, N = 61720416687

Hackbench

Count: 16 - Type: Thread

OpenBenchmarking.orgSeconds, Fewer Is BetterHackbenchCount: 16 - Type: ThreadLinux 6.8Linux 6.9-rc248121620SE +/- 0.00, N = 3SE +/- 0.14, N = 1514.6814.301. (CC) gcc options: -lpthread

Hackbench

Count: 16 - Type: Process

OpenBenchmarking.orgSeconds, Fewer Is BetterHackbenchCount: 16 - Type: ProcessLinux 6.8Linux 6.9-rc23691215SE +/- 0.11, N = 3SE +/- 0.19, N = 313.1113.361. (CC) gcc options: -lpthread

Hackbench

Count: 32 - Type: Process

OpenBenchmarking.orgSeconds, Fewer Is BetterHackbenchCount: 32 - Type: ProcessLinux 6.8Linux 6.9-rc2714212835SE +/- 0.27, N = 3SE +/- 0.39, N = 324.7527.991. (CC) gcc options: -lpthread

OpenSSL

Algorithm: SHA256

OpenBenchmarking.orgbyte/s, More Is BetterOpenSSLAlgorithm: SHA256Linux 6.8Linux 6.9-rc220000M40000M60000M80000M100000MSE +/- 767626108.54, N = 3SE +/- 717052715.91, N = 1284678420667816782841761. OpenSSL 3.0.10 1 Aug 2023 (Library: OpenSSL 3.0.10 1 Aug 2023)

OpenSSL

Algorithm: SHA512

OpenBenchmarking.orgbyte/s, More Is BetterOpenSSLAlgorithm: SHA512Linux 6.8Linux 6.9-rc26000M12000M18000M24000M30000MSE +/- 92272355.83, N = 3SE +/- 252323355.66, N = 329940735740296654990531. OpenSSL 3.0.10 1 Aug 2023 (Library: OpenSSL 3.0.10 1 Aug 2023)

OpenSSL

Algorithm: RSA4096

OpenBenchmarking.orgsign/s, More Is BetterOpenSSLAlgorithm: RSA4096Linux 6.8Linux 6.9-rc28K16K24K32K40KSE +/- 46.27, N = 3SE +/- 90.23, N = 338204.638147.41. OpenSSL 3.0.10 1 Aug 2023 (Library: OpenSSL 3.0.10 1 Aug 2023)

OpenSSL

Algorithm: RSA4096

OpenBenchmarking.orgverify/s, More Is BetterOpenSSLAlgorithm: RSA4096Linux 6.8Linux 6.9-rc2300K600K900K1200K1500KSE +/- 19064.62, N = 3SE +/- 833.27, N = 31358616.41396904.01. OpenSSL 3.0.10 1 Aug 2023 (Library: OpenSSL 3.0.10 1 Aug 2023)

GROMACS

Implementation: MPI CPU - Input: water_GMX50_bare

OpenBenchmarking.orgNs Per Day, More Is BetterGROMACS 2024Implementation: MPI CPU - Input: water_GMX50_bareLinux 6.8Linux 6.9-rc23691215SE +/- 0.06, N = 3SE +/- 0.08, N = 312.0911.761. (CXX) g++ options: -O3 -lm

MariaDB mariadb-slap

Clients: 512

OpenBenchmarking.orgQueries Per Second, More Is BetterMariaDB mariadb-slap 11.5Clients: 512Linux 6.8Linux 6.9-rc220406080100SE +/- 0.41, N = 3SE +/- 0.87, N = 986861. (CXX) g++ options: -fPIC -pie -fstack-protector -O3 -shared -lrt -lpthread -lz -ldl -lm -lstdc++

MariaDB mariadb-slap

Clients: 1024

OpenBenchmarking.orgQueries Per Second, More Is BetterMariaDB mariadb-slap 11.5Clients: 1024Linux 6.8Linux 6.9-rc2816243240SE +/- 1.23, N = 9SE +/- 1.41, N = 634361. (CXX) g++ options: -fPIC -pie -fstack-protector -O3 -shared -lrt -lpthread -lz -ldl -lm -lstdc++

TensorFlow

Device: CPU - Batch Size: 1 - Model: AlexNet

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.16.1Device: CPU - Batch Size: 1 - Model: AlexNetLinux 6.8Linux 6.9-rc248121620SE +/- 0.25, N = 12SE +/- 0.25, N = 317.2318.28

TensorFlow

Device: CPU - Batch Size: 16 - Model: AlexNet

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.16.1Device: CPU - Batch Size: 16 - Model: AlexNetLinux 6.8Linux 6.9-rc250100150200250SE +/- 1.58, N = 15SE +/- 1.89, N = 15213.35210.71

TensorFlow

Device: CPU - Batch Size: 32 - Model: AlexNet

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.16.1Device: CPU - Batch Size: 32 - Model: AlexNetLinux 6.8Linux 6.9-rc280160240320400SE +/- 2.86, N = 15SE +/- 5.16, N = 15346.10341.97

TensorFlow

Device: CPU - Batch Size: 64 - Model: AlexNet

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.16.1Device: CPU - Batch Size: 64 - Model: AlexNetLinux 6.8Linux 6.9-rc2110220330440550SE +/- 6.05, N = 3SE +/- 5.17, N = 15495.72471.88

TensorFlow

Device: CPU - Batch Size: 1 - Model: GoogLeNet

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.16.1Device: CPU - Batch Size: 1 - Model: GoogLeNetLinux 6.8Linux 6.9-rc2246810SE +/- 0.13, N = 12SE +/- 0.14, N = 156.055.98

TensorFlow

Device: CPU - Batch Size: 1 - Model: ResNet-50

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.16.1Device: CPU - Batch Size: 1 - Model: ResNet-50Linux 6.8Linux 6.9-rc20.42750.8551.28251.712.1375SE +/- 0.03, N = 15SE +/- 0.03, N = 151.881.90

TensorFlow

Device: CPU - Batch Size: 256 - Model: AlexNet

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.16.1Device: CPU - Batch Size: 256 - Model: AlexNetLinux 6.8Linux 6.9-rc2160320480640800SE +/- 9.01, N = 3SE +/- 6.62, N = 7723.16711.74

TensorFlow

Device: CPU - Batch Size: 16 - Model: GoogLeNet

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.16.1Device: CPU - Batch Size: 16 - Model: GoogLeNetLinux 6.8Linux 6.9-rc21326395265SE +/- 1.31, N = 12SE +/- 1.24, N = 1258.5058.83

TensorFlow

Device: CPU - Batch Size: 16 - Model: ResNet-50

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.16.1Device: CPU - Batch Size: 16 - Model: ResNet-50Linux 6.8Linux 6.9-rc2612182430SE +/- 0.30, N = 3SE +/- 0.28, N = 1524.1224.80

TensorFlow

Device: CPU - Batch Size: 32 - Model: GoogLeNet

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.16.1Device: CPU - Batch Size: 32 - Model: GoogLeNetLinux 6.8Linux 6.9-rc220406080100SE +/- 1.27, N = 12SE +/- 1.10, N = 1596.3197.53

TensorFlow

Device: CPU - Batch Size: 32 - Model: ResNet-50

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.16.1Device: CPU - Batch Size: 32 - Model: ResNet-50Linux 6.8Linux 6.9-rc2816243240SE +/- 0.48, N = 15SE +/- 0.42, N = 1535.3034.86

TensorFlow

Device: CPU - Batch Size: 64 - Model: GoogLeNet

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.16.1Device: CPU - Batch Size: 64 - Model: GoogLeNetLinux 6.8Linux 6.9-rc2306090120150SE +/- 0.94, N = 3SE +/- 1.70, N = 15135.18128.71

TensorFlow

Device: CPU - Batch Size: 64 - Model: ResNet-50

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.16.1Device: CPU - Batch Size: 64 - Model: ResNet-50Linux 6.8Linux 6.9-rc21122334455SE +/- 0.54, N = 12SE +/- 0.42, N = 347.0347.96

TensorFlow

Device: CPU - Batch Size: 256 - Model: GoogLeNet

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.16.1Device: CPU - Batch Size: 256 - Model: GoogLeNetLinux 6.8Linux 6.9-rc24080120160200SE +/- 2.20, N = 12SE +/- 1.95, N = 3202.37203.63

TensorFlow

Device: CPU - Batch Size: 256 - Model: ResNet-50

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.16.1Device: CPU - Batch Size: 256 - Model: ResNet-50Linux 6.8Linux 6.9-rc21632486480SE +/- 0.38, N = 3SE +/- 0.47, N = 370.1070.53

Google Draco

Model: Lion

OpenBenchmarking.orgms, Fewer Is BetterGoogle Draco 1.5.6Model: LionLinux 6.8Linux 6.9-rc213002600390052006500SE +/- 40.84, N = 3SE +/- 29.28, N = 3612960541. (CXX) g++ options: -O3

Google Draco

Model: Church Facade

OpenBenchmarking.orgms, Fewer Is BetterGoogle Draco 1.5.6Model: Church FacadeLinux 6.8Linux 6.9-rc217003400510068008500SE +/- 0.88, N = 3SE +/- 9.56, N = 3774777621. (CXX) g++ options: -O3

Stress-NG

Test: Hash

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: HashLinux 6.8Linux 6.9-rc24M8M12M16M20MSE +/- 82496.53, N = 3SE +/- 192774.29, N = 317071694.5217199190.091. (CXX) g++ options: -lm -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lpthread -lrt -lsctp -lz

Stress-NG

Test: MMAP

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: MMAPLinux 6.8Linux 6.9-rc214002800420056007000SE +/- 70.88, N = 14SE +/- 66.09, N = 156169.366427.331. (CXX) g++ options: -lm -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lpthread -lrt -lsctp -lz

Stress-NG

Test: NUMA

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: NUMALinux 6.8Linux 6.9-rc2110220330440550SE +/- 4.27, N = 3SE +/- 5.89, N = 4482.62487.601. (CXX) g++ options: -lm -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lpthread -lrt -lsctp -lz

Stress-NG

Test: Pipe

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: PipeLinux 6.8Linux 6.9-rc27M14M21M28M35MSE +/- 749025.19, N = 15SE +/- 2106194.07, N = 1530377557.9729814480.671. (CXX) g++ options: -lm -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lpthread -lrt -lsctp -lz

Stress-NG

Test: Poll

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: PollLinux 6.8Linux 6.9-rc22M4M6M8M10MSE +/- 37074.52, N = 3SE +/- 30731.99, N = 310389186.0210232390.411. (CXX) g++ options: -lm -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lpthread -lrt -lsctp -lz

Stress-NG

Test: Zlib

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: ZlibLinux 6.8Linux 6.9-rc22K4K6K8K10KSE +/- 25.13, N = 3SE +/- 124.93, N = 39670.379446.071. (CXX) g++ options: -lm -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lpthread -lrt -lsctp -lz

Stress-NG

Test: MEMFD

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: MEMFDLinux 6.8Linux 6.9-rc2150300450600750SE +/- 14.68, N = 15SE +/- 5.94, N = 8688.26688.761. (CXX) g++ options: -lm -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lpthread -lrt -lsctp -lz

Stress-NG

Test: Mutex

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: MutexLinux 6.8Linux 6.9-rc26M12M18M24M30MSE +/- 281178.86, N = 3SE +/- 294297.65, N = 328490133.2828934422.161. (CXX) g++ options: -lm -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lpthread -lrt -lsctp -lz

Stress-NG

Test: Crypto

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: CryptoLinux 6.8Linux 6.9-rc230K60K90K120K150KSE +/- 1720.03, N = 15SE +/- 2039.96, N = 15143967.24147978.331. (CXX) g++ options: -lm -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lpthread -lrt -lsctp -lz

Stress-NG

Test: Malloc

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: MallocLinux 6.8Linux 6.9-rc240M80M120M160M200MSE +/- 201545.00, N = 3SE +/- 3675496.40, N = 12163551396.40161652700.091. (CXX) g++ options: -lm -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lpthread -lrt -lsctp -lz

Stress-NG

Test: Pthread

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: PthreadLinux 6.8Linux 6.9-rc28K16K24K32K40KSE +/- 49.70, N = 3SE +/- 450.35, N = 1539599.2635919.641. (CXX) g++ options: -lm -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lpthread -lrt -lsctp -lz

Stress-NG

Test: AVL Tree

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: AVL TreeLinux 6.8Linux 6.9-rc22004006008001000SE +/- 6.53, N = 3SE +/- 2.13, N = 3810.19808.991. (CXX) g++ options: -lm -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lpthread -lrt -lsctp -lz

Stress-NG

Test: IO_uring

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: IO_uringLinux 6.8Linux 6.9-rc2700K1400K2100K2800K3500KSE +/- 31595.27, N = 3SE +/- 43339.28, N = 153468957.593346567.801. (CXX) g++ options: -lm -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lpthread -lrt -lsctp -lz

Stress-NG

Test: SENDFILE

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: SENDFILELinux 6.8Linux 6.9-rc2400K800K1200K1600K2000KSE +/- 609.53, N = 3SE +/- 5873.31, N = 31798203.121900682.081. (CXX) g++ options: -lm -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lpthread -lrt -lsctp -lz

Stress-NG

Test: CPU Stress

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: CPU StressLinux 6.8Linux 6.9-rc240K80K120K160K200KSE +/- 569.84, N = 3SE +/- 335.84, N = 3202073.08200671.701. (CXX) g++ options: -lm -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lpthread -lrt -lsctp -lz

Stress-NG

Test: Semaphores

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: SemaphoresLinux 6.8Linux 6.9-rc230M60M90M120M150MSE +/- 1498916.25, N = 3SE +/- 1330349.25, N = 3154589461.19150005776.471. (CXX) g++ options: -lm -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lpthread -lrt -lsctp -lz

Stress-NG

Test: Matrix Math

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Matrix MathLinux 6.8Linux 6.9-rc280K160K240K320K400KSE +/- 4925.11, N = 15SE +/- 9278.38, N = 12384748.54392750.091. (CXX) g++ options: -lm -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lpthread -lrt -lsctp -lz

Stress-NG

Test: Floating Point

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Floating PointLinux 6.8Linux 6.9-rc26K12K18K24K30KSE +/- 632.70, N = 12SE +/- 214.66, N = 1129600.0229139.601. (CXX) g++ options: -lm -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lpthread -lrt -lsctp -lz

Stress-NG

Test: Matrix 3D Math

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Matrix 3D MathLinux 6.8Linux 6.9-rc27K14K21K28K35KSE +/- 669.33, N = 15SE +/- 437.41, N = 1531442.6931460.421. (CXX) g++ options: -lm -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lpthread -lrt -lsctp -lz

Stress-NG

Test: Memory Copying

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Memory CopyingLinux 6.8Linux 6.9-rc25K10K15K20K25KSE +/- 178.25, N = 3SE +/- 155.03, N = 1021085.1020605.391. (CXX) g++ options: -lm -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lpthread -lrt -lsctp -lz

Stress-NG

Test: Vector Shuffle

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Vector ShuffleLinux 6.8Linux 6.9-rc2120K240K360K480K600KSE +/- 1416.85, N = 3SE +/- 1897.90, N = 3576905.92569593.001. (CXX) g++ options: -lm -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lpthread -lrt -lsctp -lz

Stress-NG

Test: Mixed Scheduler

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Mixed SchedulerLinux 6.8Linux 6.9-rc215K30K45K60K75KSE +/- 153.71, N = 3SE +/- 281.29, N = 370407.9670036.201. (CXX) g++ options: -lm -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lpthread -lrt -lsctp -lz

Stress-NG

Test: Socket Activity

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Socket ActivityLinux 6.8Linux 6.9-rc210K20K30K40K50KSE +/- 79.93, N = 3SE +/- 21.40, N = 347927.7546123.321. (CXX) g++ options: -lm -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lpthread -lrt -lsctp -lz

Stress-NG

Test: Wide Vector Math

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Wide Vector MathLinux 6.8Linux 6.9-rc21.3M2.6M3.9M5.2M6.5MSE +/- 72950.92, N = 4SE +/- 55746.31, N = 155874353.635908316.031. (CXX) g++ options: -lm -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lpthread -lrt -lsctp -lz

Stress-NG

Test: Context Switching

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Context SwitchingLinux 6.8Linux 6.9-rc24M8M12M16M20MSE +/- 178479.09, N = 8SE +/- 265846.30, N = 320343491.5219390362.901. (CXX) g++ options: -lm -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lpthread -lrt -lsctp -lz

Stress-NG

Test: Fused Multiply-Add

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Fused Multiply-AddLinux 6.8Linux 6.9-rc240M80M120M160M200MSE +/- 6187723.80, N = 12SE +/- 3824188.11, N = 15204365411.59200468629.321. (CXX) g++ options: -lm -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lpthread -lrt -lsctp -lz

Stress-NG

Test: Vector Floating Point

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Vector Floating PointLinux 6.8Linux 6.9-rc250K100K150K200K250KSE +/- 5616.14, N = 12SE +/- 8579.53, N = 12234669.74230503.341. (CXX) g++ options: -lm -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lpthread -lrt -lsctp -lz

Stress-NG

Test: Glibc C String Functions

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Glibc C String FunctionsLinux 6.8Linux 6.9-rc220M40M60M80M100MSE +/- 2138024.53, N = 13SE +/- 1504028.14, N = 1580643523.2485035507.551. (CXX) g++ options: -lm -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lpthread -lrt -lsctp -lz

Stress-NG

Test: Glibc Qsort Data Sorting

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Glibc Qsort Data SortingLinux 6.8Linux 6.9-rc2400800120016002000SE +/- 4.40, N = 3SE +/- 4.16, N = 31866.581858.701. (CXX) g++ options: -lm -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lpthread -lrt -lsctp -lz

Stress-NG

Test: System V Message Passing

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: System V Message PassingLinux 6.8Linux 6.9-rc24M8M12M16M20MSE +/- 189741.33, N = 15SE +/- 35075.39, N = 317859304.3818740350.561. (CXX) g++ options: -lm -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lpthread -lrt -lsctp -lz

Blender

Blend File: BMW27 - Compute: CPU-Only

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 4.1Blend File: BMW27 - Compute: CPU-OnlyLinux 6.8Linux 6.9-rc2510152025SE +/- 0.33, N = 14SE +/- 0.08, N = 321.8222.02

Blender

Blend File: Junkshop - Compute: CPU-Only

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 4.1Blend File: Junkshop - Compute: CPU-OnlyLinux 6.8Linux 6.9-rc21122334455SE +/- 0.47, N = 15SE +/- 0.40, N = 1545.6046.56

Blender

Blend File: Classroom - Compute: CPU-Only

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 4.1Blend File: Classroom - Compute: CPU-OnlyLinux 6.8Linux 6.9-rc21224364860SE +/- 0.10, N = 3SE +/- 0.09, N = 353.9853.82

Blender

Blend File: Fishy Cat - Compute: CPU-Only

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 4.1Blend File: Fishy Cat - Compute: CPU-OnlyLinux 6.8Linux 6.9-rc2918273645SE +/- 0.38, N = 15SE +/- 0.44, N = 438.0939.37

Blender

Blend File: Barbershop - Compute: CPU-Only

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 4.1Blend File: Barbershop - Compute: CPU-OnlyLinux 6.8Linux 6.9-rc260120180240300SE +/- 6.20, N = 8SE +/- 6.67, N = 9271.99279.74

Blender

Blend File: Pabellon Barcelona - Compute: CPU-Only

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 4.1Blend File: Pabellon Barcelona - Compute: CPU-OnlyLinux 6.8Linux 6.9-rc220406080100SE +/- 0.83, N = 5SE +/- 0.61, N = 1576.2075.56

OpenVINO

Model: Face Detection FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Face Detection FP16 - Device: CPULinux 6.8Linux 6.9-rc2306090120150SE +/- 0.33, N = 3SE +/- 0.55, N = 3119.92121.931. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Face Detection FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Face Detection FP16 - Device: CPULinux 6.8Linux 6.9-rc270140210280350SE +/- 0.84, N = 3SE +/- 1.30, N = 3307.74302.77MIN: 183.58 / MAX: 728.14MIN: 181.55 / MAX: 894.731. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Person Detection FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Person Detection FP16 - Device: CPULinux 6.8Linux 6.9-rc2100200300400500SE +/- 2.33, N = 3SE +/- 1.20, N = 3451.13466.451. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Person Detection FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Person Detection FP16 - Device: CPULinux 6.8Linux 6.9-rc220406080100SE +/- 0.43, N = 3SE +/- 0.20, N = 381.9079.23MIN: 49.43 / MAX: 345.35MIN: 50.1 / MAX: 290.061. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Person Detection FP32 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Person Detection FP32 - Device: CPULinux 6.8Linux 6.9-rc2100200300400500SE +/- 3.09, N = 3SE +/- 3.72, N = 3445.90467.791. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Person Detection FP32 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Person Detection FP32 - Device: CPULinux 6.8Linux 6.9-rc220406080100SE +/- 0.57, N = 3SE +/- 0.62, N = 382.8779.00MIN: 51.69 / MAX: 529.56MIN: 49.24 / MAX: 319.951. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Vehicle Detection FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Vehicle Detection FP16 - Device: CPULinux 6.8Linux 6.9-rc26001200180024003000SE +/- 16.72, N = 3SE +/- 25.96, N = 32530.042656.421. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Vehicle Detection FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Vehicle Detection FP16 - Device: CPULinux 6.8Linux 6.9-rc248121620SE +/- 0.10, N = 3SE +/- 0.14, N = 314.5813.89MIN: 9.5 / MAX: 109.83MIN: 9.12 / MAX: 90.571. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Face Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Face Detection FP16-INT8 - Device: CPULinux 6.8Linux 6.9-rc270140210280350SE +/- 0.75, N = 3SE +/- 0.82, N = 3331.23330.731. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Face Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Face Detection FP16-INT8 - Device: CPULinux 6.8Linux 6.9-rc270140210280350SE +/- 0.74, N = 3SE +/- 0.81, N = 3337.21337.78MIN: 261.24 / MAX: 615.09MIN: 253.21 / MAX: 781.061. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Face Detection Retail FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Face Detection Retail FP16 - Device: CPULinux 6.8Linux 6.9-rc22K4K6K8K10KSE +/- 23.83, N = 3SE +/- 26.72, N = 311260.9811295.921. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Face Detection Retail FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Face Detection Retail FP16 - Device: CPULinux 6.8Linux 6.9-rc23691215SE +/- 0.02, N = 3SE +/- 0.02, N = 39.929.89MIN: 7.45 / MAX: 33.82MIN: 7.63 / MAX: 36.571. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Road Segmentation ADAS FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Road Segmentation ADAS FP16 - Device: CPULinux 6.8Linux 6.9-rc22004006008001000SE +/- 9.82, N = 3SE +/- 6.69, N = 31018.471051.301. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Road Segmentation ADAS FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Road Segmentation ADAS FP16 - Device: CPULinux 6.8Linux 6.9-rc2816243240SE +/- 0.35, N = 3SE +/- 0.23, N = 336.2835.14MIN: 24.78 / MAX: 205.05MIN: 25.25 / MAX: 437.271. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Vehicle Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Vehicle Detection FP16-INT8 - Device: CPULinux 6.8Linux 6.9-rc211002200330044005500SE +/- 9.46, N = 3SE +/- 18.34, N = 35067.405052.711. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Vehicle Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Vehicle Detection FP16-INT8 - Device: CPULinux 6.8Linux 6.9-rc2510152025SE +/- 0.04, N = 3SE +/- 0.08, N = 322.0622.12MIN: 15.51 / MAX: 86.25MIN: 15.73 / MAX: 71.51. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Weld Porosity Detection FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Weld Porosity Detection FP16 - Device: CPULinux 6.8Linux 6.9-rc24K8K12K16K20KSE +/- 194.69, N = 3SE +/- 107.94, N = 316147.5716349.051. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Weld Porosity Detection FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Weld Porosity Detection FP16 - Device: CPULinux 6.8Linux 6.9-rc2246810SE +/- 0.08, N = 3SE +/- 0.05, N = 36.856.76MIN: 4.47 / MAX: 51.04MIN: 4.36 / MAX: 70.911. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Face Detection Retail FP16-INT8 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Face Detection Retail FP16-INT8 - Device: CPULinux 6.8Linux 6.9-rc23K6K9K12K15KSE +/- 132.85, N = 3SE +/- 25.09, N = 315532.5415589.591. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Face Detection Retail FP16-INT8 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Face Detection Retail FP16-INT8 - Device: CPULinux 6.8Linux 6.9-rc2246810SE +/- 0.07, N = 3SE +/- 0.00, N = 37.177.14MIN: 5.78 / MAX: 54.3MIN: 5.79 / MAX: 44.661. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Road Segmentation ADAS FP16-INT8 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Road Segmentation ADAS FP16-INT8 - Device: CPULinux 6.8Linux 6.9-rc230060090012001500SE +/- 1.59, N = 3SE +/- 5.16, N = 31446.421442.211. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Road Segmentation ADAS FP16-INT8 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Road Segmentation ADAS FP16-INT8 - Device: CPULinux 6.8Linux 6.9-rc220406080100SE +/- 0.09, N = 3SE +/- 0.28, N = 377.3477.57MIN: 56.48 / MAX: 158.67MIN: 57.16 / MAX: 148.671. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Machine Translation EN To DE FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Machine Translation EN To DE FP16 - Device: CPULinux 6.8Linux 6.9-rc2150300450600750SE +/- 5.75, N = 3SE +/- 3.16, N = 3671.66673.461. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Machine Translation EN To DE FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Machine Translation EN To DE FP16 - Device: CPULinux 6.8Linux 6.9-rc21224364860SE +/- 0.47, N = 3SE +/- 0.25, N = 354.9854.83MIN: 33.9 / MAX: 423.36MIN: 34.71 / MAX: 375.041. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Weld Porosity Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Weld Porosity Detection FP16-INT8 - Device: CPULinux 6.8Linux 6.9-rc26K12K18K24K30KSE +/- 285.82, N = 4SE +/- 155.42, N = 326732.8827790.241. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Weld Porosity Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Weld Porosity Detection FP16-INT8 - Device: CPULinux 6.8Linux 6.9-rc20.91131.82262.73393.64524.5565SE +/- 0.05, N = 4SE +/- 0.01, N = 34.053.89MIN: 2.67 / MAX: 52.43MIN: 2.64 / MAX: 47.091. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Person Vehicle Bike Detection FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Person Vehicle Bike Detection FP16 - Device: CPULinux 6.8Linux 6.9-rc214002800420056007000SE +/- 18.88, N = 3SE +/- 23.77, N = 36336.786306.421. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Person Vehicle Bike Detection FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Person Vehicle Bike Detection FP16 - Device: CPULinux 6.8Linux 6.9-rc248121620SE +/- 0.06, N = 3SE +/- 0.07, N = 317.5217.58MIN: 11.97 / MAX: 108.98MIN: 12.03 / MAX: 66.231. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Noise Suppression Poconet-Like FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Noise Suppression Poconet-Like FP16 - Device: CPULinux 6.8Linux 6.9-rc210002000300040005000SE +/- 54.03, N = 3SE +/- 29.05, N = 34621.324600.951. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Noise Suppression Poconet-Like FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Noise Suppression Poconet-Like FP16 - Device: CPULinux 6.8Linux 6.9-rc2612182430SE +/- 0.17, N = 3SE +/- 0.20, N = 323.6823.97MIN: 11.64 / MAX: 175.69MIN: 11.24 / MAX: 358.11. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Handwritten English Recognition FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Handwritten English Recognition FP16 - Device: CPULinux 6.8Linux 6.9-rc28001600240032004000SE +/- 3.14, N = 3SE +/- 10.89, N = 33626.413608.211. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Handwritten English Recognition FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Handwritten English Recognition FP16 - Device: CPULinux 6.8Linux 6.9-rc2714212835SE +/- 0.03, N = 3SE +/- 0.09, N = 330.8531.01MIN: 24.82 / MAX: 82.03MIN: 24.42 / MAX: 90.861. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Person Re-Identification Retail FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Person Re-Identification Retail FP16 - Device: CPULinux 6.8Linux 6.9-rc22K4K6K8K10KSE +/- 20.55, N = 3SE +/- 28.95, N = 311638.5111564.781. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Person Re-Identification Retail FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Person Re-Identification Retail FP16 - Device: CPULinux 6.8Linux 6.9-rc23691215SE +/- 0.02, N = 3SE +/- 0.03, N = 39.599.65MIN: 7.62 / MAX: 27.98MIN: 7.62 / MAX: 34.181. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Age Gender Recognition Retail 0013 FP16 - Device: CPULinux 6.8Linux 6.9-rc216K32K48K64K80KSE +/- 711.41, N = 15SE +/- 1055.18, N = 367789.2573754.741. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Age Gender Recognition Retail 0013 FP16 - Device: CPULinux 6.8Linux 6.9-rc20.17550.3510.52650.7020.8775SE +/- 0.01, N = 15SE +/- 0.03, N = 30.780.71MIN: 0.3 / MAX: 138.08MIN: 0.32 / MAX: 74.711. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Handwritten English Recognition FP16-INT8 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Handwritten English Recognition FP16-INT8 - Device: CPULinux 6.8Linux 6.9-rc28001600240032004000SE +/- 10.67, N = 3SE +/- 8.36, N = 33777.563704.381. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Handwritten English Recognition FP16-INT8 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Handwritten English Recognition FP16-INT8 - Device: CPULinux 6.8Linux 6.9-rc2714212835SE +/- 0.08, N = 3SE +/- 0.07, N = 329.6130.20MIN: 25.51 / MAX: 92.13MIN: 22.08 / MAX: 107.871. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPULinux 6.8Linux 6.9-rc230K60K90K120K150KSE +/- 1455.69, N = 15SE +/- 1149.56, N = 15121702.12119735.571. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPULinux 6.8Linux 6.9-rc20.08550.1710.25650.3420.4275SE +/- 0.01, N = 15SE +/- 0.00, N = 150.380.38MIN: 0.23 / MAX: 46.5MIN: 0.24 / MAX: 50.651. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

RocksDB

Test: Overwrite

OpenBenchmarking.orgOp/s, More Is BetterRocksDB 9.0Test: OverwriteLinux 6.8Linux 6.9-rc280K160K240K320K400KSE +/- 881.98, N = 3SE +/- 3053.81, N = 33880103919681. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti -lpthread

RocksDB

Test: Random Read

OpenBenchmarking.orgOp/s, More Is BetterRocksDB 9.0Test: Random ReadLinux 6.8Linux 6.9-rc280M160M240M320M400MSE +/- 1573786.50, N = 3SE +/- 1447290.34, N = 33604985183615860831. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti -lpthread

RocksDB

Test: Update Random

OpenBenchmarking.orgOp/s, More Is BetterRocksDB 9.0Test: Update RandomLinux 6.8Linux 6.9-rc280K160K240K320K400KSE +/- 1470.46, N = 3SE +/- 1522.72, N = 33598253615021. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti -lpthread

RocksDB

Test: Read Random Write Random

OpenBenchmarking.orgOp/s, More Is BetterRocksDB 9.0Test: Read Random Write RandomLinux 6.8Linux 6.9-rc2500K1000K1500K2000K2500KSE +/- 17412.72, N = 3SE +/- 22543.45, N = 5212084420685881. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti -lpthread

Speedb

Test: Random Fill

OpenBenchmarking.orgOp/s, More Is BetterSpeedb 2.7Test: Random FillLinux 6.8Linux 6.9-rc270K140K210K280K350KSE +/- 2148.02, N = 3SE +/- 3492.28, N = 33264993228161. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti -lpthread

Speedb

Test: Random Read

OpenBenchmarking.orgOp/s, More Is BetterSpeedb 2.7Test: Random ReadLinux 6.8Linux 6.9-rc280M160M240M320M400MSE +/- 1002006.26, N = 3SE +/- 4146957.10, N = 33804193893758374791. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti -lpthread

Speedb

Test: Update Random

OpenBenchmarking.orgOp/s, More Is BetterSpeedb 2.7Test: Update RandomLinux 6.8Linux 6.9-rc260K120K180K240K300KSE +/- 3488.80, N = 3SE +/- 3235.16, N = 32921802934141. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti -lpthread

Speedb

Test: Sequential Fill

OpenBenchmarking.orgOp/s, More Is BetterSpeedb 2.7Test: Sequential FillLinux 6.8Linux 6.9-rc270K140K210K280K350KSE +/- 1183.38, N = 3SE +/- 1955.03, N = 33276373301671. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti -lpthread

Speedb

Test: Random Fill Sync

OpenBenchmarking.orgOp/s, More Is BetterSpeedb 2.7Test: Random Fill SyncLinux 6.8Linux 6.9-rc260K120K180K240K300KSE +/- 1490.88, N = 3SE +/- 3603.61, N = 32574462596031. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti -lpthread

Speedb

Test: Read Random Write Random

OpenBenchmarking.orgOp/s, More Is BetterSpeedb 2.7Test: Read Random Write RandomLinux 6.8Linux 6.9-rc2300K600K900K1200K1500KSE +/- 8674.90, N = 11SE +/- 13609.90, N = 3118175811755621. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti -lpthread

ONNX Runtime

Model: GPT-2 - Device: CPU - Executor: Parallel

OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.17Model: GPT-2 - Device: CPU - Executor: ParallelLinux 6.8Linux 6.9-rc220406080100SE +/- 1.16, N = 3SE +/- 1.34, N = 15101.90105.781. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

ONNX Runtime

Model: GPT-2 - Device: CPU - Executor: Parallel

OpenBenchmarking.orgInference Time Cost (ms), Fewer Is BetterONNX Runtime 1.17Model: GPT-2 - Device: CPU - Executor: ParallelLinux 6.8Linux 6.9-rc23691215SE +/- 0.11034, N = 3SE +/- 0.12308, N = 159.805149.464961. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

ONNX Runtime

Model: yolov4 - Device: CPU - Executor: Parallel

OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.17Model: yolov4 - Device: CPU - Executor: ParallelLinux 6.8Linux 6.9-rc2246810SE +/- 0.07338, N = 3SE +/- 0.08546, N = 37.913218.041421. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

ONNX Runtime

Model: yolov4 - Device: CPU - Executor: Parallel

OpenBenchmarking.orgInference Time Cost (ms), Fewer Is BetterONNX Runtime 1.17Model: yolov4 - Device: CPU - Executor: ParallelLinux 6.8Linux 6.9-rc2306090120150SE +/- 1.18, N = 3SE +/- 1.32, N = 3126.38124.381. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

ONNX Runtime

Model: yolov4 - Device: CPU - Executor: Standard

OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.17Model: yolov4 - Device: CPU - Executor: StandardLinux 6.8Linux 6.9-rc2246810SE +/- 0.16273, N = 15SE +/- 0.10643, N = 138.223518.909361. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

ONNX Runtime

Model: yolov4 - Device: CPU - Executor: Standard

OpenBenchmarking.orgInference Time Cost (ms), Fewer Is BetterONNX Runtime 1.17Model: yolov4 - Device: CPU - Executor: StandardLinux 6.8Linux 6.9-rc2306090120150SE +/- 2.31, N = 15SE +/- 1.33, N = 13122.24112.431. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

ONNX Runtime

Model: T5 Encoder - Device: CPU - Executor: Parallel

OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.17Model: T5 Encoder - Device: CPU - Executor: ParallelLinux 6.8Linux 6.9-rc24080120160200SE +/- 3.10, N = 12SE +/- 2.39, N = 14185.29196.081. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

ONNX Runtime

Model: T5 Encoder - Device: CPU - Executor: Parallel

OpenBenchmarking.orgInference Time Cost (ms), Fewer Is BetterONNX Runtime 1.17Model: T5 Encoder - Device: CPU - Executor: ParallelLinux 6.8Linux 6.9-rc21.21772.43543.65314.87086.0885SE +/- 0.09595, N = 12SE +/- 0.06160, N = 145.411915.107551. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

ONNX Runtime

Model: T5 Encoder - Device: CPU - Executor: Standard

OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.17Model: T5 Encoder - Device: CPU - Executor: StandardLinux 6.8Linux 6.9-rc290180270360450SE +/- 14.02, N = 15SE +/- 3.01, N = 3353.57402.671. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

ONNX Runtime

Model: T5 Encoder - Device: CPU - Executor: Standard

OpenBenchmarking.orgInference Time Cost (ms), Fewer Is BetterONNX Runtime 1.17Model: T5 Encoder - Device: CPU - Executor: StandardLinux 6.8Linux 6.9-rc20.65141.30281.95422.60563.257SE +/- 0.12453, N = 15SE +/- 0.01855, N = 32.895012.482341. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

ONNX Runtime

Model: bertsquad-12 - Device: CPU - Executor: Parallel

OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.17Model: bertsquad-12 - Device: CPU - Executor: ParallelLinux 6.8Linux 6.9-rc23691215SE +/- 0.04, N = 3SE +/- 0.05, N = 310.7810.601. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

ONNX Runtime

Model: bertsquad-12 - Device: CPU - Executor: Parallel

OpenBenchmarking.orgInference Time Cost (ms), Fewer Is BetterONNX Runtime 1.17Model: bertsquad-12 - Device: CPU - Executor: ParallelLinux 6.8Linux 6.9-rc220406080100SE +/- 0.33, N = 3SE +/- 0.44, N = 392.7594.331. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

ONNX Runtime

Model: bertsquad-12 - Device: CPU - Executor: Standard

OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.17Model: bertsquad-12 - Device: CPU - Executor: StandardLinux 6.8Linux 6.9-rc248121620SE +/- 0.50, N = 12SE +/- 0.54, N = 1514.2715.411. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

ONNX Runtime

Model: bertsquad-12 - Device: CPU - Executor: Standard

OpenBenchmarking.orgInference Time Cost (ms), Fewer Is BetterONNX Runtime 1.17Model: bertsquad-12 - Device: CPU - Executor: StandardLinux 6.8Linux 6.9-rc21632486480SE +/- 2.24, N = 12SE +/- 2.28, N = 1570.9666.001. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

ONNX Runtime

Model: CaffeNet 12-int8 - Device: CPU - Executor: Parallel

OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.17Model: CaffeNet 12-int8 - Device: CPU - Executor: ParallelLinux 6.8Linux 6.9-rc260120180240300SE +/- 2.79, N = 15SE +/- 2.09, N = 3292.17293.031. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

ONNX Runtime

Model: CaffeNet 12-int8 - Device: CPU - Executor: Parallel

OpenBenchmarking.orgInference Time Cost (ms), Fewer Is BetterONNX Runtime 1.17Model: CaffeNet 12-int8 - Device: CPU - Executor: ParallelLinux 6.8Linux 6.9-rc20.77031.54062.31093.08123.8515SE +/- 0.03367, N = 15SE +/- 0.02459, N = 33.423573.409721. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

ONNX Runtime

Model: CaffeNet 12-int8 - Device: CPU - Executor: Standard

OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.17Model: CaffeNet 12-int8 - Device: CPU - Executor: StandardLinux 6.8Linux 6.9-rc2120240360480600SE +/- 6.47, N = 15SE +/- 5.63, N = 3541.83571.191. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

ONNX Runtime

Model: CaffeNet 12-int8 - Device: CPU - Executor: Standard

OpenBenchmarking.orgInference Time Cost (ms), Fewer Is BetterONNX Runtime 1.17Model: CaffeNet 12-int8 - Device: CPU - Executor: StandardLinux 6.8Linux 6.9-rc20.41580.83161.24741.66322.079SE +/- 0.02432, N = 15SE +/- 0.01721, N = 31.848071.749731. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

ONNX Runtime

Model: fcn-resnet101-11 - Device: CPU - Executor: Parallel

OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.17Model: fcn-resnet101-11 - Device: CPU - Executor: ParallelLinux 6.8Linux 6.9-rc20.33820.67641.01461.35281.691SE +/- 0.04472, N = 15SE +/- 0.03151, N = 121.359941.503001. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

ONNX Runtime

Model: fcn-resnet101-11 - Device: CPU - Executor: Parallel

OpenBenchmarking.orgInference Time Cost (ms), Fewer Is BetterONNX Runtime 1.17Model: fcn-resnet101-11 - Device: CPU - Executor: ParallelLinux 6.8Linux 6.9-rc2160320480640800SE +/- 25.74, N = 15SE +/- 14.65, N = 12747.08668.701. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

ONNX Runtime

Model: fcn-resnet101-11 - Device: CPU - Executor: Standard

OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.17Model: fcn-resnet101-11 - Device: CPU - Executor: StandardLinux 6.8Linux 6.9-rc21.21782.43563.65344.87126.089SE +/- 0.20811, N = 12SE +/- 0.05231, N = 34.436495.412591. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

ONNX Runtime

Model: fcn-resnet101-11 - Device: CPU - Executor: Standard

OpenBenchmarking.orgInference Time Cost (ms), Fewer Is BetterONNX Runtime 1.17Model: fcn-resnet101-11 - Device: CPU - Executor: StandardLinux 6.8Linux 6.9-rc250100150200250SE +/- 11.46, N = 12SE +/- 1.80, N = 3231.28184.791. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

ONNX Runtime

Model: ArcFace ResNet-100 - Device: CPU - Executor: Parallel

OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.17Model: ArcFace ResNet-100 - Device: CPU - Executor: ParallelLinux 6.8Linux 6.9-rc248121620SE +/- 0.23, N = 3SE +/- 0.17, N = 316.7817.561. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

ONNX Runtime

Model: ArcFace ResNet-100 - Device: CPU - Executor: Parallel

OpenBenchmarking.orgInference Time Cost (ms), Fewer Is BetterONNX Runtime 1.17Model: ArcFace ResNet-100 - Device: CPU - Executor: ParallelLinux 6.8Linux 6.9-rc21326395265SE +/- 0.81, N = 3SE +/- 0.56, N = 359.6056.951. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

ONNX Runtime

Model: ArcFace ResNet-100 - Device: CPU - Executor: Standard

OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.17Model: ArcFace ResNet-100 - Device: CPU - Executor: StandardLinux 6.8Linux 6.9-rc2612182430SE +/- 0.43, N = 12SE +/- 0.48, N = 1523.4624.231. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

ONNX Runtime

Model: ArcFace ResNet-100 - Device: CPU - Executor: Standard

OpenBenchmarking.orgInference Time Cost (ms), Fewer Is BetterONNX Runtime 1.17Model: ArcFace ResNet-100 - Device: CPU - Executor: StandardLinux 6.8Linux 6.9-rc21020304050SE +/- 0.81, N = 12SE +/- 0.86, N = 1542.7841.501. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

ONNX Runtime

Model: ResNet50 v1-12-int8 - Device: CPU - Executor: Parallel

OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.17Model: ResNet50 v1-12-int8 - Device: CPU - Executor: ParallelLinux 6.8Linux 6.9-rc220406080100SE +/- 0.92, N = 3SE +/- 1.23, N = 394.2595.141. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

ONNX Runtime

Model: ResNet50 v1-12-int8 - Device: CPU - Executor: Parallel

OpenBenchmarking.orgInference Time Cost (ms), Fewer Is BetterONNX Runtime 1.17Model: ResNet50 v1-12-int8 - Device: CPU - Executor: ParallelLinux 6.8Linux 6.9-rc23691215SE +/- 0.10, N = 3SE +/- 0.14, N = 310.6110.511. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

ONNX Runtime

Model: ResNet50 v1-12-int8 - Device: CPU - Executor: Standard

OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.17Model: ResNet50 v1-12-int8 - Device: CPU - Executor: StandardLinux 6.8Linux 6.9-rc2306090120150SE +/- 2.58, N = 12SE +/- 3.02, N = 15111.57122.601. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

ONNX Runtime

Model: ResNet50 v1-12-int8 - Device: CPU - Executor: Standard

OpenBenchmarking.orgInference Time Cost (ms), Fewer Is BetterONNX Runtime 1.17Model: ResNet50 v1-12-int8 - Device: CPU - Executor: StandardLinux 6.8Linux 6.9-rc23691215SE +/- 0.20919, N = 12SE +/- 0.21896, N = 159.015388.231211. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

ONNX Runtime

Model: super-resolution-10 - Device: CPU - Executor: Parallel

OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.17Model: super-resolution-10 - Device: CPU - Executor: ParallelLinux 6.8Linux 6.9-rc2306090120150SE +/- 0.93, N = 3SE +/- 1.50, N = 3152.64153.561. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

ONNX Runtime

Model: super-resolution-10 - Device: CPU - Executor: Parallel

OpenBenchmarking.orgInference Time Cost (ms), Fewer Is BetterONNX Runtime 1.17Model: super-resolution-10 - Device: CPU - Executor: ParallelLinux 6.8Linux 6.9-rc2246810SE +/- 0.04024, N = 3SE +/- 0.06370, N = 36.550116.511271. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

ONNX Runtime

Model: super-resolution-10 - Device: CPU - Executor: Standard

OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.17Model: super-resolution-10 - Device: CPU - Executor: StandardLinux 6.8Linux 6.9-rc250100150200250SE +/- 2.99, N = 15SE +/- 0.80, N = 3205.41213.741. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

ONNX Runtime

Model: super-resolution-10 - Device: CPU - Executor: Standard

OpenBenchmarking.orgInference Time Cost (ms), Fewer Is BetterONNX Runtime 1.17Model: super-resolution-10 - Device: CPU - Executor: StandardLinux 6.8Linux 6.9-rc21.09842.19683.29524.39365.492SE +/- 0.07270, N = 15SE +/- 0.01745, N = 34.881814.678111. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

ONNX Runtime

Model: Faster R-CNN R-50-FPN-int8 - Device: CPU - Executor: Parallel

OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.17Model: Faster R-CNN R-50-FPN-int8 - Device: CPU - Executor: ParallelLinux 6.8Linux 6.9-rc2612182430SE +/- 0.13, N = 3SE +/- 0.07, N = 323.4323.171. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

ONNX Runtime

Model: Faster R-CNN R-50-FPN-int8 - Device: CPU - Executor: Parallel

OpenBenchmarking.orgInference Time Cost (ms), Fewer Is BetterONNX Runtime 1.17Model: Faster R-CNN R-50-FPN-int8 - Device: CPU - Executor: ParallelLinux 6.8Linux 6.9-rc21020304050SE +/- 0.23, N = 3SE +/- 0.13, N = 342.6843.151. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

ONNX Runtime

Model: Faster R-CNN R-50-FPN-int8 - Device: CPU - Executor: Standard

OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.17Model: Faster R-CNN R-50-FPN-int8 - Device: CPU - Executor: StandardLinux 6.8Linux 6.9-rc2816243240SE +/- 0.40, N = 3SE +/- 0.25, N = 332.4534.351. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

ONNX Runtime

Model: Faster R-CNN R-50-FPN-int8 - Device: CPU - Executor: Standard

OpenBenchmarking.orgInference Time Cost (ms), Fewer Is BetterONNX Runtime 1.17Model: Faster R-CNN R-50-FPN-int8 - Device: CPU - Executor: StandardLinux 6.8Linux 6.9-rc2714212835SE +/- 0.38, N = 3SE +/- 0.22, N = 330.8229.111. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

WavPack Audio Encoding

WAV To WavPack

OpenBenchmarking.orgSeconds, Fewer Is BetterWavPack Audio Encoding 5.7WAV To WavPackLinux 6.8Linux 6.9-rc2246810SE +/- 0.023, N = 5SE +/- 0.019, N = 56.3496.340

Llama.cpp

Model: llama-2-13b.Q4_0.gguf

OpenBenchmarking.orgTokens Per Second, More Is BetterLlama.cpp b1808Model: llama-2-13b.Q4_0.ggufLinux 6.8Linux 6.9-rc20.34430.68861.03291.37721.7215SE +/- 0.01, N = 3SE +/- 0.02, N = 31.481.531. (CXX) g++ options: -std=c++11 -fPIC -O3 -pthread -march=native -mtune=native -lopenblas

Llama.cpp

Model: llama-2-70b-chat.Q5_0.gguf

OpenBenchmarking.orgTokens Per Second, More Is BetterLlama.cpp b1808Model: llama-2-70b-chat.Q5_0.ggufLinux 6.8Linux 6.9-rc20.08330.16660.24990.33320.4165SE +/- 0.00, N = 3SE +/- 0.00, N = 30.360.371. (CXX) g++ options: -std=c++11 -fPIC -O3 -pthread -march=native -mtune=native -lopenblas

Llamafile

Test: mistral-7b-instruct-v0.2.Q8_0 - Acceleration: CPU

OpenBenchmarking.orgTokens Per Second, More Is BetterLlamafile 0.6Test: mistral-7b-instruct-v0.2.Q8_0 - Acceleration: CPULinux 6.8Linux 6.9-rc21.03052.0613.09154.1225.1525SE +/- 0.04, N = 3SE +/- 0.03, N = 34.504.58

Llamafile

Test: wizardcoder-python-34b-v1.0.Q6_K - Acceleration: CPU

OpenBenchmarking.orgTokens Per Second, More Is BetterLlamafile 0.6Test: wizardcoder-python-34b-v1.0.Q6_K - Acceleration: CPULinux 6.8Linux 6.9-rc20.17780.35560.53340.71120.889SE +/- 0.01, N = 4SE +/- 0.00, N = 30.790.77

BRL-CAD

VGR Performance Metric

OpenBenchmarking.orgVGR Performance Metric, More Is BetterBRL-CAD 7.38.2VGR Performance MetricLinux 6.8Linux 6.9-rc2900K1800K2700K3600K4500K390683939918021. (CXX) g++ options: -std=c++17 -pipe -fvisibility=hidden -fno-strict-aliasing -fno-common -fexceptions -ftemplate-depth-128 -m64 -ggdb3 -O3 -fipa-pta -fstrength-reduce -finline-functions -flto -ltcl8.6 -lnetpbm -lregex_brl -lz_brl -lassimp -ldl -lm -ltk8.6

Chaos Group V-RAY

Mode: CPU

OpenBenchmarking.orgvsamples, More Is BetterChaos Group V-RAY 6.0Mode: CPULinux 6.8Linux 6.9-rc213K26K39K52K65KSE +/- 530.58, N = 15SE +/- 557.85, N = 35985258995


Phoronix Test Suite v10.8.4