Xeon Max Linux 6.9 Kernel Benchmarks

2 x Intel Xeon Max 9480 benchmarks for a future article.

HTML result view exported from: https://openbenchmarking.org/result/2404035-NE-XEONMAXLI15&sro.

Xeon Max Linux 6.9 Kernel BenchmarksProcessorMotherboardChipsetMemoryDiskGraphicsNetworkOSKernelDesktopDisplay ServerCompilerFile-SystemScreen ResolutionLinux 6.8Linux 6.9-rc22 x Intel Xeon Max 9480 @ 3.50GHz (112 Cores / 224 Threads)Supermicro SYS-221H-TNR X13DEM v1.10 (1.3 BIOS)Intel Device 1bce512GB7682GB INTEL SSDPF2KX076TZASPEED2 x Broadcom BCM57508 NetXtreme-E 10Gb/25Gb/40Gb/50Gb/100Gb/200GbUbuntu 23.106.8.0-060800-generic (x86_64)GNOME Shell 45.0X Server 1.21.1.7GCC 13.2.0ext41024x7686.9.0-060900rc2-generic (x86_64)OpenBenchmarking.orgKernel Details- Transparent Huge Pages: madviseCompiler Details- --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-bootstrap --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-link-serialization=2 --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-defaulted --enable-offload-targets=nvptx-none=/build/gcc-13-XYspKM/gcc-13-13.2.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-13-XYspKM/gcc-13-13.2.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-build-config=bootstrap-lto-lean --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v Processor Details- Scaling Governor: intel_cpufreq performance - CPU Microcode: 0x2c000290Python Details- Python 3.11.6Security Details- Linux 6.8: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Not affected - Linux 6.9-rc2: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + reg_file_data_sampling: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Not affected

Xeon Max Linux 6.9 Kernel Benchmarksquicksilver: CORAL2 P1quicksilver: CORAL2 P2ffmpeg: libx264 - Liveffmpeg: libx265 - Liveffmpeg: libx264 - Uploadffmpeg: libx265 - Uploadffmpeg: libx264 - Platformffmpeg: libx265 - Platformffmpeg: libx264 - Video On Demandffmpeg: libx265 - Video On Demandxmrig: KawPow - 1Mxmrig: Monero - 1Mxmrig: Wownero - 1Mxmrig: GhostRider - 1Mxmrig: CryptoNight-Heavy - 1Mxmrig: CryptoNight-Femto UPX2 - 1Mcachebench: Readcachebench: Writecachebench: Read / Modify / Writecompress-lz4: 1 - Compression Speedcompress-lz4: 1 - Decompression Speedcompress-lz4: 3 - Compression Speedcompress-lz4: 3 - Decompression Speedcompress-lz4: 9 - Compression Speedcompress-lz4: 9 - Decompression Speedjpegxl: PNG - 80jpegxl: PNG - 90jpegxl: JPEG - 80jpegxl: JPEG - 90jpegxl: PNG - 100jpegxl: JPEG - 100jpegxl-decode: Allwebp2: Defaultwebp2: Quality 75, Compression Effort 7webp2: Quality 95, Compression Effort 7webp2: Quality 100, Compression Effort 5webp2: Quality 100, Lossless Compressionsrsran: PDSCH Processor Benchmark, Throughput Totalembree: Pathtracer - Crownembree: Pathtracer ISPC - Crownembree: Pathtracer - Asian Dragonembree: Pathtracer - Asian Dragon Objembree: Pathtracer ISPC - Asian Dragonembree: Pathtracer ISPC - Asian Dragon Objsvt-av1: Preset 4 - Bosphorus 4Ksvt-av1: Preset 8 - Bosphorus 4Ksvt-av1: Preset 12 - Bosphorus 4Ksvt-av1: Preset 13 - Bosphorus 4Ksvt-av1: Preset 4 - Bosphorus 1080pvvenc: Bosphorus 4K - Fastvvenc: Bosphorus 4K - Fastervvenc: Bosphorus 1080p - Fastvvenc: Bosphorus 1080p - Fasteroidn: RT.hdr_alb_nrm.3840x2160 - CPU-Onlyoidn: RT.ldr_alb_nrm.3840x2160 - CPU-Onlyoidn: RTLightmap.hdr.4096x4096 - CPU-Onlyospray: particle_volume/ao/real_timeospray: particle_volume/scivis/real_timeospray: particle_volume/pathtracer/real_timeospray: gravity_spheres_volume/dim_512/ao/real_timeospray: gravity_spheres_volume/dim_512/scivis/real_timeospray: gravity_spheres_volume/dim_512/pathtracer/real_timestockfish: Chess Benchmarkbuild-ffmpeg: Time To Compilebuild-linux-kernel: defconfigbuild-linux-kernel: allmodconfigbuild-mesa: Time To Compileprimesieve: 1e12primesieve: 1e13y-cruncher: 1By-cruncher: 500Monednn: IP Shapes 1D - CPUonednn: IP Shapes 3D - CPUonednn: Convolution Batch Shapes Auto - CPUonednn: Deconvolution Batch shapes_1d - CPUonednn: Deconvolution Batch shapes_3d - CPUonednn: Recurrent Neural Network Training - CPUonednn: Recurrent Neural Network Inference - CPUospray-studio: 1 - 4K - 1 - Path Tracer - CPUospray-studio: 2 - 4K - 1 - Path Tracer - CPUospray-studio: 3 - 4K - 1 - Path Tracer - CPUospray-studio: 1 - 4K - 16 - Path Tracer - CPUospray-studio: 1 - 4K - 32 - Path Tracer - CPUospray-studio: 2 - 4K - 16 - Path Tracer - CPUospray-studio: 2 - 4K - 32 - Path Tracer - CPUospray-studio: 3 - 4K - 16 - Path Tracer - CPUospray-studio: 3 - 4K - 32 - Path Tracer - CPUospray-studio: 1 - 1080p - 1 - Path Tracer - CPUospray-studio: 2 - 1080p - 1 - Path Tracer - CPUospray-studio: 3 - 1080p - 1 - Path Tracer - CPUospray-studio: 1 - 1080p - 16 - Path Tracer - CPUospray-studio: 1 - 1080p - 32 - Path Tracer - CPUospray-studio: 2 - 1080p - 16 - Path Tracer - CPUospray-studio: 2 - 1080p - 32 - Path Tracer - CPUospray-studio: 3 - 1080p - 16 - Path Tracer - CPUospray-studio: 3 - 1080p - 32 - Path Tracer - CPUhackbench: 16 - Threadhackbench: 16 - Processhackbench: 32 - Processopenssl: SHA256openssl: SHA512openssl: RSA4096openssl: RSA4096gromacs: MPI CPU - water_GMX50_baremysqlslap: 512mysqlslap: 1024tensorflow: CPU - 1 - AlexNettensorflow: CPU - 16 - AlexNettensorflow: CPU - 32 - AlexNettensorflow: CPU - 64 - AlexNettensorflow: CPU - 1 - GoogLeNettensorflow: CPU - 1 - ResNet-50tensorflow: CPU - 256 - AlexNettensorflow: CPU - 16 - GoogLeNettensorflow: CPU - 16 - ResNet-50tensorflow: CPU - 32 - GoogLeNettensorflow: CPU - 32 - ResNet-50tensorflow: CPU - 64 - GoogLeNettensorflow: CPU - 64 - ResNet-50tensorflow: CPU - 256 - GoogLeNettensorflow: CPU - 256 - ResNet-50draco: Liondraco: Church Facadestress-ng: Hashstress-ng: MMAPstress-ng: NUMAstress-ng: Pipestress-ng: Pollstress-ng: Zlibstress-ng: MEMFDstress-ng: Mutexstress-ng: Cryptostress-ng: Mallocstress-ng: Pthreadstress-ng: AVL Treestress-ng: IO_uringstress-ng: SENDFILEstress-ng: CPU Stressstress-ng: Semaphoresstress-ng: Matrix Mathstress-ng: Floating Pointstress-ng: Matrix 3D Mathstress-ng: Memory Copyingstress-ng: Vector Shufflestress-ng: Mixed Schedulerstress-ng: Socket Activitystress-ng: Wide Vector Mathstress-ng: Context Switchingstress-ng: Fused Multiply-Addstress-ng: Vector Floating Pointstress-ng: Glibc C String Functionsstress-ng: Glibc Qsort Data Sortingstress-ng: System V Message Passingblender: BMW27 - CPU-Onlyblender: Junkshop - CPU-Onlyblender: Classroom - CPU-Onlyblender: Fishy Cat - CPU-Onlyblender: Barbershop - CPU-Onlyblender: Pabellon Barcelona - CPU-Onlyopenvino: Face Detection FP16 - CPUopenvino: Face Detection FP16 - CPUopenvino: Person Detection FP16 - CPUopenvino: Person Detection FP16 - CPUopenvino: Person Detection FP32 - CPUopenvino: Person Detection FP32 - CPUopenvino: Vehicle Detection FP16 - CPUopenvino: Vehicle Detection FP16 - CPUopenvino: Face Detection FP16-INT8 - CPUopenvino: Face Detection FP16-INT8 - CPUopenvino: Face Detection Retail FP16 - CPUopenvino: Face Detection Retail FP16 - CPUopenvino: Road Segmentation ADAS FP16 - CPUopenvino: Road Segmentation ADAS FP16 - CPUopenvino: Vehicle Detection FP16-INT8 - CPUopenvino: Vehicle Detection FP16-INT8 - CPUopenvino: Weld Porosity Detection FP16 - CPUopenvino: Weld Porosity Detection FP16 - CPUopenvino: Face Detection Retail FP16-INT8 - CPUopenvino: Face Detection Retail FP16-INT8 - CPUopenvino: Road Segmentation ADAS FP16-INT8 - CPUopenvino: Road Segmentation ADAS FP16-INT8 - CPUopenvino: Machine Translation EN To DE FP16 - CPUopenvino: Machine Translation EN To DE FP16 - CPUopenvino: Weld Porosity Detection FP16-INT8 - CPUopenvino: Weld Porosity Detection FP16-INT8 - CPUopenvino: Person Vehicle Bike Detection FP16 - CPUopenvino: Person Vehicle Bike Detection FP16 - CPUopenvino: Noise Suppression Poconet-Like FP16 - CPUopenvino: Noise Suppression Poconet-Like FP16 - CPUopenvino: Handwritten English Recognition FP16 - CPUopenvino: Handwritten English Recognition FP16 - CPUopenvino: Person Re-Identification Retail FP16 - CPUopenvino: Person Re-Identification Retail FP16 - CPUopenvino: Age Gender Recognition Retail 0013 FP16 - CPUopenvino: Age Gender Recognition Retail 0013 FP16 - CPUopenvino: Handwritten English Recognition FP16-INT8 - CPUopenvino: Handwritten English Recognition FP16-INT8 - CPUopenvino: Age Gender Recognition Retail 0013 FP16-INT8 - CPUopenvino: Age Gender Recognition Retail 0013 FP16-INT8 - CPUrocksdb: Overwriterocksdb: Rand Readrocksdb: Update Randrocksdb: Read Rand Write Randspeedb: Rand Fillspeedb: Rand Readspeedb: Update Randspeedb: Seq Fillspeedb: Rand Fill Syncspeedb: Read Rand Write Randonnx: GPT-2 - CPU - Parallelonnx: GPT-2 - CPU - Parallelonnx: yolov4 - CPU - Parallelonnx: yolov4 - CPU - Parallelonnx: yolov4 - CPU - Standardonnx: yolov4 - CPU - Standardonnx: T5 Encoder - CPU - Parallelonnx: T5 Encoder - CPU - Parallelonnx: T5 Encoder - CPU - Standardonnx: T5 Encoder - CPU - Standardonnx: bertsquad-12 - CPU - Parallelonnx: bertsquad-12 - CPU - Parallelonnx: bertsquad-12 - CPU - Standardonnx: bertsquad-12 - CPU - Standardonnx: CaffeNet 12-int8 - CPU - Parallelonnx: CaffeNet 12-int8 - CPU - Parallelonnx: CaffeNet 12-int8 - CPU - Standardonnx: CaffeNet 12-int8 - CPU - Standardonnx: fcn-resnet101-11 - CPU - Parallelonnx: fcn-resnet101-11 - CPU - Parallelonnx: fcn-resnet101-11 - CPU - Standardonnx: fcn-resnet101-11 - CPU - Standardonnx: ArcFace ResNet-100 - CPU - Parallelonnx: ArcFace ResNet-100 - CPU - Parallelonnx: ArcFace ResNet-100 - CPU - Standardonnx: ArcFace ResNet-100 - CPU - Standardonnx: ResNet50 v1-12-int8 - CPU - Parallelonnx: ResNet50 v1-12-int8 - CPU - Parallelonnx: ResNet50 v1-12-int8 - CPU - Standardonnx: ResNet50 v1-12-int8 - CPU - Standardonnx: super-resolution-10 - CPU - Parallelonnx: super-resolution-10 - CPU - Parallelonnx: super-resolution-10 - CPU - Standardonnx: super-resolution-10 - CPU - Standardonnx: Faster R-CNN R-50-FPN-int8 - CPU - Parallelonnx: Faster R-CNN R-50-FPN-int8 - CPU - Parallelonnx: Faster R-CNN R-50-FPN-int8 - CPU - Standardonnx: Faster R-CNN R-50-FPN-int8 - CPU - Standardencode-wavpack: WAV To WavPackllama-cpp: llama-2-13b.Q4_0.ggufllama-cpp: llama-2-70b-chat.Q5_0.ggufllamafile: mistral-7b-instruct-v0.2.Q8_0 - CPUllamafile: wizardcoder-python-34b-v1.0.Q6_K - CPUbrl-cad: VGR Performance Metricv-ray: CPULinux 6.8Linux 6.9-rc268146676677333181.51112.4311.5022.3142.7642.7442.9444.8032860.832361.236096.69592.332856.333002.213344.69962093036.30241599112.699260602.693601.098.433364.832.613537.032.47730.96934.60432.56225.66626.002386.2325.900.640.348.350.0717006.836.601138.835035.403339.817731.595736.43595.86548.943127.202123.24618.6624.9029.84715.91333.9862.282.321.0629.733629.2815102.950110.7021210.5041224.28056199971717.24538.462307.50219.5113.35639.61913.4166.4834.500554.798539.0062118.33776.165764821.32748.49518011861210834412613633531763514406577217246650156969091386774021483687321720414.67913.11224.748846784206672994073574038204.61358616.412.085863417.23213.35346.10495.726.051.88723.1658.5024.1296.3135.30135.1847.03202.3770.106129774717071694.526169.36482.6230377557.9710389186.029670.37688.2628490133.28143967.24163551396.4039599.26810.193468957.591798203.12202073.08154589461.19384748.5429600.0231442.6921085.10576905.9270407.9647927.755874353.6320343491.52204365411.59234669.7480643523.241866.5817859304.3821.8245.6053.9838.09271.9976.20119.92307.74451.1381.90445.9082.872530.0414.58331.23337.2111260.989.921018.4736.285067.4022.0616147.576.8515532.547.171446.4277.34671.6654.9826732.884.056336.7817.524621.3223.683626.4130.8511638.519.5967789.250.783777.5629.61121702.120.3838801036049851835982521208443264993804193892921803276372574461181758101.9019.805147.91321126.3848.22351122.236185.2945.41191353.5732.8950110.781792.746714.265670.9566292.1733.42357541.8271.848071.35994747.0844.43649231.28416.783259.602123.461342.781994.248710.6098111.57069.01538152.6356.55011205.4144.8818123.427642.683332.450330.82096.3491.480.364.500.7939068395985269166676689667182.12113.9911.5122.2442.7740.2042.8844.2433072.533015.536180.79602.732826.132993.813341.46732593862.76331198711.076947602.543628.098.413349.632.663492.033.04530.12834.18733.88825.60725.960381.6575.650.610.338.450.0716877.635.078835.734835.650736.503032.829737.43355.76048.568126.187123.09818.9344.9369.52416.15233.0942.232.221.0428.875429.069398.869010.509010.823625.17126444309917.28337.698311.74519.8883.29939.46113.3356.2024.511664.842458.8104318.02755.7820210195.75753.36417741839216434953611623542263529397947336747848957068041380775061541585521668714.29813.35727.994816782841762966549905338147.41396904.011.764863618.28210.71341.97471.885.981.90711.7458.8324.8097.5334.86128.7147.96203.6370.536054776217199190.096427.33487.6029814480.6710232390.419446.07688.7628934422.16147978.33161652700.0935919.64808.993346567.801900682.08200671.70150005776.47392750.0929139.6031460.4220605.39569593.0070036.2046123.325908316.0319390362.90200468629.32230503.3485035507.551858.7018740350.5622.0246.5653.8239.37279.7475.56121.93302.77466.4579.23467.7979.002656.4213.89330.73337.7811295.929.891051.3035.145052.7122.1216349.056.7615589.597.141442.2177.57673.4654.8327790.243.896306.4217.584600.9523.973608.2131.0111564.789.6573754.740.713704.3830.20119735.570.3839196836158608336150220685883228163758374792934143301672596031175562105.78279.464968.04142124.3768.90936112.428196.0765.10755402.6692.4823410.600694.333015.411065.9960293.0293.40972571.1901.749731.50300668.6995.41259184.78517.562356.947824.232841.504895.144110.5119122.6018.23121153.5646.51127213.7374.6781123.172743.151134.351229.11076.3401.530.374.580.77399180258995OpenBenchmarking.org

Quicksilver

Input: CORAL2 P1

OpenBenchmarking.orgFigure Of Merit, More Is BetterQuicksilver 20230818Input: CORAL2 P1Linux 6.8Linux 6.9-rc21.5M3M4.5M6M7.5MSE +/- 67589.78, N = 6SE +/- 46491.34, N = 3681466769166671. (CXX) g++ options: -fopenmp -O3 -march=native

Quicksilver

Input: CORAL2 P2

OpenBenchmarking.orgFigure Of Merit, More Is BetterQuicksilver 20230818Input: CORAL2 P2Linux 6.8Linux 6.9-rc21.4M2.8M4.2M5.6M7MSE +/- 74194.56, N = 9SE +/- 91964.82, N = 9667733366896671. (CXX) g++ options: -fopenmp -O3 -march=native

FFmpeg

Encoder: libx264 - Scenario: Live

OpenBenchmarking.orgFPS, More Is BetterFFmpeg 6.1Encoder: libx264 - Scenario: LiveLinux 6.8Linux 6.9-rc24080120160200SE +/- 1.29, N = 3SE +/- 0.70, N = 3181.51182.121. (CXX) g++ options: -O3 -rdynamic -lpthread -lrt -ldl -lnuma

FFmpeg

Encoder: libx265 - Scenario: Live

OpenBenchmarking.orgFPS, More Is BetterFFmpeg 6.1Encoder: libx265 - Scenario: LiveLinux 6.8Linux 6.9-rc2306090120150SE +/- 1.36, N = 15SE +/- 1.80, N = 15112.43113.991. (CXX) g++ options: -O3 -rdynamic -lpthread -lrt -ldl -lnuma

FFmpeg

Encoder: libx264 - Scenario: Upload

OpenBenchmarking.orgFPS, More Is BetterFFmpeg 6.1Encoder: libx264 - Scenario: UploadLinux 6.8Linux 6.9-rc23691215SE +/- 0.01, N = 3SE +/- 0.01, N = 311.5011.511. (CXX) g++ options: -O3 -rdynamic -lpthread -lrt -ldl -lnuma

FFmpeg

Encoder: libx265 - Scenario: Upload

OpenBenchmarking.orgFPS, More Is BetterFFmpeg 6.1Encoder: libx265 - Scenario: UploadLinux 6.8Linux 6.9-rc2510152025SE +/- 0.31, N = 3SE +/- 0.26, N = 422.3122.241. (CXX) g++ options: -O3 -rdynamic -lpthread -lrt -ldl -lnuma

FFmpeg

Encoder: libx264 - Scenario: Platform

OpenBenchmarking.orgFPS, More Is BetterFFmpeg 6.1Encoder: libx264 - Scenario: PlatformLinux 6.8Linux 6.9-rc21020304050SE +/- 0.17, N = 3SE +/- 0.10, N = 342.7642.771. (CXX) g++ options: -O3 -rdynamic -lpthread -lrt -ldl -lnuma

FFmpeg

Encoder: libx265 - Scenario: Platform

OpenBenchmarking.orgFPS, More Is BetterFFmpeg 6.1Encoder: libx265 - Scenario: PlatformLinux 6.8Linux 6.9-rc21020304050SE +/- 0.71, N = 12SE +/- 0.46, N = 1242.7440.201. (CXX) g++ options: -O3 -rdynamic -lpthread -lrt -ldl -lnuma

FFmpeg

Encoder: libx264 - Scenario: Video On Demand

OpenBenchmarking.orgFPS, More Is BetterFFmpeg 6.1Encoder: libx264 - Scenario: Video On DemandLinux 6.8Linux 6.9-rc21020304050SE +/- 0.06, N = 3SE +/- 0.10, N = 342.9442.881. (CXX) g++ options: -O3 -rdynamic -lpthread -lrt -ldl -lnuma

FFmpeg

Encoder: libx265 - Scenario: Video On Demand

OpenBenchmarking.orgFPS, More Is BetterFFmpeg 6.1Encoder: libx265 - Scenario: Video On DemandLinux 6.8Linux 6.9-rc21020304050SE +/- 0.50, N = 12SE +/- 0.76, N = 944.8044.241. (CXX) g++ options: -O3 -rdynamic -lpthread -lrt -ldl -lnuma

Xmrig

Variant: KawPow - Hash Count: 1M

OpenBenchmarking.orgH/s, More Is BetterXmrig 6.21Variant: KawPow - Hash Count: 1MLinux 6.8Linux 6.9-rc27K14K21K28K35KSE +/- 68.36, N = 3SE +/- 137.96, N = 332860.833072.51. (CXX) g++ options: -fexceptions -fno-rtti -maes -O3 -Ofast -static-libgcc -static-libstdc++ -rdynamic -lssl -lcrypto -luv -lpthread -lrt -ldl -lhwloc

Xmrig

Variant: Monero - Hash Count: 1M

OpenBenchmarking.orgH/s, More Is BetterXmrig 6.21Variant: Monero - Hash Count: 1MLinux 6.8Linux 6.9-rc27K14K21K28K35KSE +/- 320.50, N = 13SE +/- 181.84, N = 332361.233015.51. (CXX) g++ options: -fexceptions -fno-rtti -maes -O3 -Ofast -static-libgcc -static-libstdc++ -rdynamic -lssl -lcrypto -luv -lpthread -lrt -ldl -lhwloc

Xmrig

Variant: Wownero - Hash Count: 1M

OpenBenchmarking.orgH/s, More Is BetterXmrig 6.21Variant: Wownero - Hash Count: 1MLinux 6.8Linux 6.9-rc28K16K24K32K40KSE +/- 245.88, N = 3SE +/- 490.33, N = 336096.636180.71. (CXX) g++ options: -fexceptions -fno-rtti -maes -O3 -Ofast -static-libgcc -static-libstdc++ -rdynamic -lssl -lcrypto -luv -lpthread -lrt -ldl -lhwloc

Xmrig

Variant: GhostRider - Hash Count: 1M

OpenBenchmarking.orgH/s, More Is BetterXmrig 6.21Variant: GhostRider - Hash Count: 1MLinux 6.8Linux 6.9-rc22K4K6K8K10KSE +/- 31.05, N = 3SE +/- 42.79, N = 39592.39602.71. (CXX) g++ options: -fexceptions -fno-rtti -maes -O3 -Ofast -static-libgcc -static-libstdc++ -rdynamic -lssl -lcrypto -luv -lpthread -lrt -ldl -lhwloc

Xmrig

Variant: CryptoNight-Heavy - Hash Count: 1M

OpenBenchmarking.orgH/s, More Is BetterXmrig 6.21Variant: CryptoNight-Heavy - Hash Count: 1MLinux 6.8Linux 6.9-rc27K14K21K28K35KSE +/- 49.86, N = 3SE +/- 160.32, N = 332856.332826.11. (CXX) g++ options: -fexceptions -fno-rtti -maes -O3 -Ofast -static-libgcc -static-libstdc++ -rdynamic -lssl -lcrypto -luv -lpthread -lrt -ldl -lhwloc

Xmrig

Variant: CryptoNight-Femto UPX2 - Hash Count: 1M

OpenBenchmarking.orgH/s, More Is BetterXmrig 6.21Variant: CryptoNight-Femto UPX2 - Hash Count: 1MLinux 6.8Linux 6.9-rc27K14K21K28K35KSE +/- 110.64, N = 3SE +/- 170.37, N = 333002.232993.81. (CXX) g++ options: -fexceptions -fno-rtti -maes -O3 -Ofast -static-libgcc -static-libstdc++ -rdynamic -lssl -lcrypto -luv -lpthread -lrt -ldl -lhwloc

CacheBench

Test: Read

OpenBenchmarking.orgMB/s, More Is BetterCacheBenchTest: ReadLinux 6.8Linux 6.9-rc23K6K9K12K15KSE +/- 0.52, N = 3SE +/- 0.88, N = 313344.7013341.47MIN: 13338.06 / MAX: 13346.23MIN: 13335.31 / MAX: 13343.851. (CC) gcc options: -O3 -lrt

CacheBench

Test: Write

OpenBenchmarking.orgMB/s, More Is BetterCacheBenchTest: WriteLinux 6.8Linux 6.9-rc220K40K60K80K100KSE +/- 36.95, N = 3SE +/- 65.10, N = 393036.3093862.76MIN: 54037.87 / MAX: 103869.49MIN: 54012.69 / MAX: 104121.121. (CC) gcc options: -O3 -lrt

CacheBench

Test: Read / Modify / Write

OpenBenchmarking.orgMB/s, More Is BetterCacheBenchTest: Read / Modify / WriteLinux 6.8Linux 6.9-rc220K40K60K80K100KSE +/- 2.71, N = 3SE +/- 71.07, N = 399112.7098711.08MIN: 88982.6 / MAX: 105154.55MIN: 85707.72 / MAX: 105115.441. (CC) gcc options: -O3 -lrt

LZ4 Compression

Compression Level: 1 - Compression Speed

OpenBenchmarking.orgMB/s, More Is BetterLZ4 Compression 1.9.4Compression Level: 1 - Compression SpeedLinux 6.8Linux 6.9-rc2130260390520650SE +/- 1.15, N = 3SE +/- 0.16, N = 3602.69602.541. (CC) gcc options: -O3

LZ4 Compression

Compression Level: 1 - Decompression Speed

OpenBenchmarking.orgMB/s, More Is BetterLZ4 Compression 1.9.4Compression Level: 1 - Decompression SpeedLinux 6.8Linux 6.9-rc28001600240032004000SE +/- 44.31, N = 3SE +/- 18.57, N = 33601.03628.01. (CC) gcc options: -O3

LZ4 Compression

Compression Level: 3 - Compression Speed

OpenBenchmarking.orgMB/s, More Is BetterLZ4 Compression 1.9.4Compression Level: 3 - Compression SpeedLinux 6.8Linux 6.9-rc220406080100SE +/- 0.06, N = 3SE +/- 0.06, N = 398.4398.411. (CC) gcc options: -O3

LZ4 Compression

Compression Level: 3 - Decompression Speed

OpenBenchmarking.orgMB/s, More Is BetterLZ4 Compression 1.9.4Compression Level: 3 - Decompression SpeedLinux 6.8Linux 6.9-rc27001400210028003500SE +/- 33.92, N = 3SE +/- 34.17, N = 33364.83349.61. (CC) gcc options: -O3

LZ4 Compression

Compression Level: 9 - Compression Speed

OpenBenchmarking.orgMB/s, More Is BetterLZ4 Compression 1.9.4Compression Level: 9 - Compression SpeedLinux 6.8Linux 6.9-rc2816243240SE +/- 0.08, N = 3SE +/- 0.07, N = 332.6132.661. (CC) gcc options: -O3

LZ4 Compression

Compression Level: 9 - Decompression Speed

OpenBenchmarking.orgMB/s, More Is BetterLZ4 Compression 1.9.4Compression Level: 9 - Decompression SpeedLinux 6.8Linux 6.9-rc28001600240032004000SE +/- 16.01, N = 3SE +/- 57.81, N = 33537.03492.01. (CC) gcc options: -O3

JPEG-XL libjxl

Input: PNG - Quality: 80

OpenBenchmarking.orgMP/s, More Is BetterJPEG-XL libjxl 0.10.1Input: PNG - Quality: 80Linux 6.8Linux 6.9-rc2816243240SE +/- 0.38, N = 3SE +/- 0.36, N = 1532.4833.051. (CXX) g++ options: -fno-rtti -O3 -fPIE -pie -lm

JPEG-XL libjxl

Input: PNG - Quality: 90

OpenBenchmarking.orgMP/s, More Is BetterJPEG-XL libjxl 0.10.1Input: PNG - Quality: 90Linux 6.8Linux 6.9-rc2714212835SE +/- 0.28, N = 3SE +/- 0.18, N = 330.9730.131. (CXX) g++ options: -fno-rtti -O3 -fPIE -pie -lm

JPEG-XL libjxl

Input: JPEG - Quality: 80

OpenBenchmarking.orgMP/s, More Is BetterJPEG-XL libjxl 0.10.1Input: JPEG - Quality: 80Linux 6.8Linux 6.9-rc2816243240SE +/- 0.51, N = 12SE +/- 0.53, N = 1534.6034.191. (CXX) g++ options: -fno-rtti -O3 -fPIE -pie -lm

JPEG-XL libjxl

Input: JPEG - Quality: 90

OpenBenchmarking.orgMP/s, More Is BetterJPEG-XL libjxl 0.10.1Input: JPEG - Quality: 90Linux 6.8Linux 6.9-rc2816243240SE +/- 0.37, N = 3SE +/- 0.38, N = 1532.5633.891. (CXX) g++ options: -fno-rtti -O3 -fPIE -pie -lm

JPEG-XL libjxl

Input: PNG - Quality: 100

OpenBenchmarking.orgMP/s, More Is BetterJPEG-XL libjxl 0.10.1Input: PNG - Quality: 100Linux 6.8Linux 6.9-rc2612182430SE +/- 0.15, N = 3SE +/- 0.21, N = 325.6725.611. (CXX) g++ options: -fno-rtti -O3 -fPIE -pie -lm

JPEG-XL libjxl

Input: JPEG - Quality: 100

OpenBenchmarking.orgMP/s, More Is BetterJPEG-XL libjxl 0.10.1Input: JPEG - Quality: 100Linux 6.8Linux 6.9-rc2612182430SE +/- 0.11, N = 3SE +/- 0.08, N = 326.0025.961. (CXX) g++ options: -fno-rtti -O3 -fPIE -pie -lm

JPEG-XL Decoding libjxl

CPU Threads: All

OpenBenchmarking.orgMP/s, More Is BetterJPEG-XL Decoding libjxl 0.10.1CPU Threads: AllLinux 6.8Linux 6.9-rc280160240320400SE +/- 4.23, N = 3SE +/- 2.26, N = 3386.23381.66

WebP2 Image Encode

Encode Settings: Default

OpenBenchmarking.orgMP/s, More Is BetterWebP2 Image Encode 20220823Encode Settings: DefaultLinux 6.8Linux 6.9-rc21.32752.6553.98255.316.6375SE +/- 0.11, N = 15SE +/- 0.09, N = 155.905.651. (CXX) g++ options: -msse4.2 -fno-rtti -O3 -ldl

WebP2 Image Encode

Encode Settings: Quality 75, Compression Effort 7

OpenBenchmarking.orgMP/s, More Is BetterWebP2 Image Encode 20220823Encode Settings: Quality 75, Compression Effort 7Linux 6.8Linux 6.9-rc20.1440.2880.4320.5760.72SE +/- 0.01, N = 3SE +/- 0.01, N = 40.640.611. (CXX) g++ options: -msse4.2 -fno-rtti -O3 -ldl

WebP2 Image Encode

Encode Settings: Quality 95, Compression Effort 7

OpenBenchmarking.orgMP/s, More Is BetterWebP2 Image Encode 20220823Encode Settings: Quality 95, Compression Effort 7Linux 6.8Linux 6.9-rc20.07650.1530.22950.3060.3825SE +/- 0.00, N = 3SE +/- 0.00, N = 30.340.331. (CXX) g++ options: -msse4.2 -fno-rtti -O3 -ldl

WebP2 Image Encode

Encode Settings: Quality 100, Compression Effort 5

OpenBenchmarking.orgMP/s, More Is BetterWebP2 Image Encode 20220823Encode Settings: Quality 100, Compression Effort 5Linux 6.8Linux 6.9-rc2246810SE +/- 0.11, N = 15SE +/- 0.07, N = 38.358.451. (CXX) g++ options: -msse4.2 -fno-rtti -O3 -ldl

WebP2 Image Encode

Encode Settings: Quality 100, Lossless Compression

OpenBenchmarking.orgMP/s, More Is BetterWebP2 Image Encode 20220823Encode Settings: Quality 100, Lossless CompressionLinux 6.8Linux 6.9-rc20.01580.03160.04740.06320.079SE +/- 0.00, N = 3SE +/- 0.00, N = 30.070.071. (CXX) g++ options: -msse4.2 -fno-rtti -O3 -ldl

srsRAN Project

Test: PDSCH Processor Benchmark, Throughput Total

OpenBenchmarking.orgMbps, More Is BettersrsRAN Project 23.10.1-20240219Test: PDSCH Processor Benchmark, Throughput TotalLinux 6.8Linux 6.9-rc24K8K12K16K20KSE +/- 263.34, N = 15SE +/- 377.19, N = 1217006.816877.61. (CXX) g++ options: -march=native -mavx2 -mavx -msse4.1 -mfma -mavx512f -mavx512cd -mavx512bw -mavx512dq -O3 -fno-trapping-math -fno-math-errno -ldl

Embree

Binary: Pathtracer - Model: Crown

OpenBenchmarking.orgFrames Per Second, More Is BetterEmbree 4.3Binary: Pathtracer - Model: CrownLinux 6.8Linux 6.9-rc2816243240SE +/- 0.59, N = 15SE +/- 1.07, N = 1536.6035.08MIN: 25.71 / MAX: 54.49MIN: 22.8 / MAX: 59.06

Embree

Binary: Pathtracer ISPC - Model: Crown

OpenBenchmarking.orgFrames Per Second, More Is BetterEmbree 4.3Binary: Pathtracer ISPC - Model: CrownLinux 6.8Linux 6.9-rc2918273645SE +/- 0.47, N = 4SE +/- 1.44, N = 1238.8435.73MIN: 30.82 / MAX: 52.25MIN: 20.32 / MAX: 57.51

Embree

Binary: Pathtracer - Model: Asian Dragon

OpenBenchmarking.orgFrames Per Second, More Is BetterEmbree 4.3Binary: Pathtracer - Model: Asian DragonLinux 6.8Linux 6.9-rc2816243240SE +/- 0.86, N = 15SE +/- 0.54, N = 1535.4035.65MIN: 23.5 / MAX: 52.61MIN: 24.54 / MAX: 51.88

Embree

Binary: Pathtracer - Model: Asian Dragon Obj

OpenBenchmarking.orgFrames Per Second, More Is BetterEmbree 4.3Binary: Pathtracer - Model: Asian Dragon ObjLinux 6.8Linux 6.9-rc2918273645SE +/- 0.92, N = 15SE +/- 0.60, N = 1539.8236.50MIN: 26.64 / MAX: 50.91MIN: 22.66 / MAX: 46.51

Embree

Binary: Pathtracer ISPC - Model: Asian Dragon

OpenBenchmarking.orgFrames Per Second, More Is BetterEmbree 4.3Binary: Pathtracer ISPC - Model: Asian DragonLinux 6.8Linux 6.9-rc2816243240SE +/- 0.77, N = 13SE +/- 0.82, N = 1531.6032.83MIN: 20.8 / MAX: 52.83MIN: 22.56 / MAX: 48.16

Embree

Binary: Pathtracer ISPC - Model: Asian Dragon Obj

OpenBenchmarking.orgFrames Per Second, More Is BetterEmbree 4.3Binary: Pathtracer ISPC - Model: Asian Dragon ObjLinux 6.8Linux 6.9-rc2918273645SE +/- 0.94, N = 15SE +/- 0.88, N = 1536.4437.43MIN: 22.56 / MAX: 49.05MIN: 27.23 / MAX: 49.01

SVT-AV1

Encoder Mode: Preset 4 - Input: Bosphorus 4K

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 2.0Encoder Mode: Preset 4 - Input: Bosphorus 4KLinux 6.8Linux 6.9-rc21.31962.63923.95885.27846.598SE +/- 0.035, N = 3SE +/- 0.051, N = 155.8655.7601. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

SVT-AV1

Encoder Mode: Preset 8 - Input: Bosphorus 4K

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 2.0Encoder Mode: Preset 8 - Input: Bosphorus 4KLinux 6.8Linux 6.9-rc21122334455SE +/- 1.10, N = 12SE +/- 1.18, N = 1548.9448.571. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

SVT-AV1

Encoder Mode: Preset 12 - Input: Bosphorus 4K

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 2.0Encoder Mode: Preset 12 - Input: Bosphorus 4KLinux 6.8Linux 6.9-rc2306090120150SE +/- 5.13, N = 15SE +/- 5.21, N = 15127.20126.191. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

SVT-AV1

Encoder Mode: Preset 13 - Input: Bosphorus 4K

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 2.0Encoder Mode: Preset 13 - Input: Bosphorus 4KLinux 6.8Linux 6.9-rc2306090120150SE +/- 3.82, N = 12SE +/- 5.42, N = 15123.25123.101. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

SVT-AV1

Encoder Mode: Preset 4 - Input: Bosphorus 1080p

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 2.0Encoder Mode: Preset 4 - Input: Bosphorus 1080pLinux 6.8Linux 6.9-rc2510152025SE +/- 0.13, N = 15SE +/- 0.21, N = 318.6618.931. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

VVenC

Video Input: Bosphorus 4K - Video Preset: Fast

OpenBenchmarking.orgFrames Per Second, More Is BetterVVenC 1.11Video Input: Bosphorus 4K - Video Preset: FastLinux 6.8Linux 6.9-rc21.11062.22123.33184.44245.553SE +/- 0.075, N = 10SE +/- 0.077, N = 124.9024.9361. (CXX) g++ options: -O3 -flto=auto -fno-fat-lto-objects

VVenC

Video Input: Bosphorus 4K - Video Preset: Faster

OpenBenchmarking.orgFrames Per Second, More Is BetterVVenC 1.11Video Input: Bosphorus 4K - Video Preset: FasterLinux 6.8Linux 6.9-rc23691215SE +/- 0.200, N = 12SE +/- 0.172, N = 159.8479.5241. (CXX) g++ options: -O3 -flto=auto -fno-fat-lto-objects

VVenC

Video Input: Bosphorus 1080p - Video Preset: Fast

OpenBenchmarking.orgFrames Per Second, More Is BetterVVenC 1.11Video Input: Bosphorus 1080p - Video Preset: FastLinux 6.8Linux 6.9-rc248121620SE +/- 0.11, N = 3SE +/- 0.07, N = 315.9116.151. (CXX) g++ options: -O3 -flto=auto -fno-fat-lto-objects

VVenC

Video Input: Bosphorus 1080p - Video Preset: Faster

OpenBenchmarking.orgFrames Per Second, More Is BetterVVenC 1.11Video Input: Bosphorus 1080p - Video Preset: FasterLinux 6.8Linux 6.9-rc2816243240SE +/- 0.29, N = 15SE +/- 0.36, N = 1533.9933.091. (CXX) g++ options: -O3 -flto=auto -fno-fat-lto-objects

Intel Open Image Denoise

Run: RT.hdr_alb_nrm.3840x2160 - Device: CPU-Only

OpenBenchmarking.orgImages / Sec, More Is BetterIntel Open Image Denoise 2.2Run: RT.hdr_alb_nrm.3840x2160 - Device: CPU-OnlyLinux 6.8Linux 6.9-rc20.5131.0261.5392.0522.565SE +/- 0.02, N = 15SE +/- 0.02, N = 152.282.23

Intel Open Image Denoise

Run: RT.ldr_alb_nrm.3840x2160 - Device: CPU-Only

OpenBenchmarking.orgImages / Sec, More Is BetterIntel Open Image Denoise 2.2Run: RT.ldr_alb_nrm.3840x2160 - Device: CPU-OnlyLinux 6.8Linux 6.9-rc20.5221.0441.5662.0882.61SE +/- 0.03, N = 3SE +/- 0.03, N = 32.322.22

Intel Open Image Denoise

Run: RTLightmap.hdr.4096x4096 - Device: CPU-Only

OpenBenchmarking.orgImages / Sec, More Is BetterIntel Open Image Denoise 2.2Run: RTLightmap.hdr.4096x4096 - Device: CPU-OnlyLinux 6.8Linux 6.9-rc20.23850.4770.71550.9541.1925SE +/- 0.01, N = 7SE +/- 0.01, N = 151.061.04

OSPRay

Benchmark: particle_volume/ao/real_time

OpenBenchmarking.orgItems Per Second, More Is BetterOSPRay 3.1Benchmark: particle_volume/ao/real_timeLinux 6.8Linux 6.9-rc2714212835SE +/- 0.11, N = 3SE +/- 0.19, N = 329.7328.88

OSPRay

Benchmark: particle_volume/scivis/real_time

OpenBenchmarking.orgItems Per Second, More Is BetterOSPRay 3.1Benchmark: particle_volume/scivis/real_timeLinux 6.8Linux 6.9-rc2714212835SE +/- 0.26, N = 3SE +/- 0.33, N = 329.2829.07

OSPRay

Benchmark: particle_volume/pathtracer/real_time

OpenBenchmarking.orgItems Per Second, More Is BetterOSPRay 3.1Benchmark: particle_volume/pathtracer/real_timeLinux 6.8Linux 6.9-rc220406080100SE +/- 1.85, N = 12SE +/- 1.98, N = 9102.9598.87

OSPRay

Benchmark: gravity_spheres_volume/dim_512/ao/real_time

OpenBenchmarking.orgItems Per Second, More Is BetterOSPRay 3.1Benchmark: gravity_spheres_volume/dim_512/ao/real_timeLinux 6.8Linux 6.9-rc23691215SE +/- 0.14, N = 15SE +/- 0.05, N = 310.7010.51

OSPRay

Benchmark: gravity_spheres_volume/dim_512/scivis/real_time

OpenBenchmarking.orgItems Per Second, More Is BetterOSPRay 3.1Benchmark: gravity_spheres_volume/dim_512/scivis/real_timeLinux 6.8Linux 6.9-rc23691215SE +/- 0.08, N = 15SE +/- 0.07, N = 310.5010.82

OSPRay

Benchmark: gravity_spheres_volume/dim_512/pathtracer/real_time

OpenBenchmarking.orgItems Per Second, More Is BetterOSPRay 3.1Benchmark: gravity_spheres_volume/dim_512/pathtracer/real_timeLinux 6.8Linux 6.9-rc2612182430SE +/- 0.41, N = 12SE +/- 0.20, N = 324.2825.17

Stockfish

Chess Benchmark

OpenBenchmarking.orgNodes Per Second, More Is BetterStockfish 16.1Chess BenchmarkLinux 6.8Linux 6.9-rc214M28M42M56M70MSE +/- 2993041.97, N = 9SE +/- 2705883.43, N = 961999717644430991. (CXX) g++ options: -lgcov -m64 -lpthread -fno-exceptions -std=c++17 -fno-peel-loops -fno-tracer -pedantic -O3 -funroll-loops -msse -msse3 -mpopcnt -mavx2 -mbmi -mavx512f -mavx512bw -mavx512vnni -mavx512dq -mavx512vl -msse4.1 -mssse3 -msse2 -mbmi2 -flto -flto-partition=one -flto=jobserver

Timed FFmpeg Compilation

Time To Compile

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed FFmpeg Compilation 6.1Time To CompileLinux 6.8Linux 6.9-rc248121620SE +/- 0.39, N = 15SE +/- 0.39, N = 1517.2517.28

Timed Linux Kernel Compilation

Build: defconfig

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed Linux Kernel Compilation 6.8Build: defconfigLinux 6.8Linux 6.9-rc2918273645SE +/- 0.36, N = 6SE +/- 0.37, N = 638.4637.70

Timed Linux Kernel Compilation

Build: allmodconfig

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed Linux Kernel Compilation 6.8Build: allmodconfigLinux 6.8Linux 6.9-rc270140210280350SE +/- 3.84, N = 3SE +/- 1.26, N = 3307.50311.75

Timed Mesa Compilation

Time To Compile

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed Mesa Compilation 24.0Time To CompileLinux 6.8Linux 6.9-rc2510152025SE +/- 0.51, N = 15SE +/- 0.39, N = 1519.5119.89

Primesieve

Length: 1e12

OpenBenchmarking.orgSeconds, Fewer Is BetterPrimesieve 12.1Length: 1e12Linux 6.8Linux 6.9-rc20.75511.51022.26533.02043.7755SE +/- 0.024, N = 11SE +/- 0.044, N = 33.3563.2991. (CXX) g++ options: -O3

Primesieve

Length: 1e13

OpenBenchmarking.orgSeconds, Fewer Is BetterPrimesieve 12.1Length: 1e13Linux 6.8Linux 6.9-rc2918273645SE +/- 0.06, N = 3SE +/- 0.09, N = 339.6239.461. (CXX) g++ options: -O3

Y-Cruncher

Pi Digits To Calculate: 1B

OpenBenchmarking.orgSeconds, Fewer Is BetterY-Cruncher 0.8.3Pi Digits To Calculate: 1BLinux 6.8Linux 6.9-rc23691215SE +/- 0.30, N = 15SE +/- 0.24, N = 1513.4213.34

Y-Cruncher

Pi Digits To Calculate: 500M

OpenBenchmarking.orgSeconds, Fewer Is BetterY-Cruncher 0.8.3Pi Digits To Calculate: 500MLinux 6.8Linux 6.9-rc2246810SE +/- 0.143, N = 12SE +/- 0.083, N = 156.4836.202

oneDNN

Harness: IP Shapes 1D - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.4Harness: IP Shapes 1D - Engine: CPULinux 6.8Linux 6.9-rc21.01512.03023.04534.06045.0755SE +/- 0.04580, N = 3SE +/- 0.05180, N = 124.500554.51166MIN: 3.52MIN: 3.371. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread

oneDNN

Harness: IP Shapes 3D - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.4Harness: IP Shapes 3D - Engine: CPULinux 6.8Linux 6.9-rc21.08962.17923.26884.35845.448SE +/- 0.02352, N = 3SE +/- 0.02357, N = 34.798534.84245MIN: 3.98MIN: 4.011. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread

oneDNN

Harness: Convolution Batch Shapes Auto - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.4Harness: Convolution Batch Shapes Auto - Engine: CPULinux 6.8Linux 6.9-rc23691215SE +/- 0.03328, N = 3SE +/- 0.09863, N = 159.006218.81043MIN: 8.12MIN: 6.251. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread

oneDNN

Harness: Deconvolution Batch shapes_1d - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.4Harness: Deconvolution Batch shapes_1d - Engine: CPULinux 6.8Linux 6.9-rc2510152025SE +/- 0.23, N = 15SE +/- 0.14, N = 318.3418.03MIN: 10.09MIN: 13.291. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread

oneDNN

Harness: Deconvolution Batch shapes_3d - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.4Harness: Deconvolution Batch shapes_3d - Engine: CPULinux 6.8Linux 6.9-rc2246810SE +/- 0.10591, N = 15SE +/- 0.04472, N = 36.165765.78202MIN: 3.75MIN: 3.811. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread

oneDNN

Harness: Recurrent Neural Network Training - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.4Harness: Recurrent Neural Network Training - Engine: CPULinux 6.8Linux 6.9-rc22K4K6K8K10KSE +/- 22.69, N = 3SE +/- 498.89, N = 134821.3210195.75MIN: 4659.99MIN: 4568.31. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread

oneDNN

Harness: Recurrent Neural Network Inference - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.4Harness: Recurrent Neural Network Inference - Engine: CPULinux 6.8Linux 6.9-rc2160320480640800SE +/- 7.46, N = 3SE +/- 6.16, N = 9748.50753.36MIN: 677.68MIN: 652.831. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread

OSPRay Studio

Camera: 1 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path Tracer - Acceleration: CPU

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 1.0Camera: 1 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path Tracer - Acceleration: CPULinux 6.8Linux 6.9-rc2400800120016002000SE +/- 40.26, N = 15SE +/- 22.91, N = 1518011774

OSPRay Studio

Camera: 2 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path Tracer - Acceleration: CPU

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 1.0Camera: 2 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path Tracer - Acceleration: CPULinux 6.8Linux 6.9-rc2400800120016002000SE +/- 13.93, N = 11SE +/- 26.21, N = 318611839

OSPRay Studio

Camera: 3 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path Tracer - Acceleration: CPU

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 1.0Camera: 3 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path Tracer - Acceleration: CPULinux 6.8Linux 6.9-rc25001000150020002500SE +/- 21.99, N = 4SE +/- 26.16, N = 1321082164

OSPRay Studio

Camera: 1 - Resolution: 4K - Samples Per Pixel: 16 - Renderer: Path Tracer - Acceleration: CPU

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 1.0Camera: 1 - Resolution: 4K - Samples Per Pixel: 16 - Renderer: Path Tracer - Acceleration: CPULinux 6.8Linux 6.9-rc27K14K21K28K35KSE +/- 294.16, N = 3SE +/- 454.99, N = 33441234953

OSPRay Studio

Camera: 1 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path Tracer - Acceleration: CPU

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 1.0Camera: 1 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path Tracer - Acceleration: CPULinux 6.8Linux 6.9-rc213K26K39K52K65KSE +/- 443.96, N = 15SE +/- 567.54, N = 76136361162

OSPRay Studio

Camera: 2 - Resolution: 4K - Samples Per Pixel: 16 - Renderer: Path Tracer - Acceleration: CPU

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 1.0Camera: 2 - Resolution: 4K - Samples Per Pixel: 16 - Renderer: Path Tracer - Acceleration: CPULinux 6.8Linux 6.9-rc28K16K24K32K40KSE +/- 302.37, N = 15SE +/- 483.46, N = 33531735422

OSPRay Studio

Camera: 2 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path Tracer - Acceleration: CPU

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 1.0Camera: 2 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path Tracer - Acceleration: CPULinux 6.8Linux 6.9-rc214K28K42K56K70KSE +/- 591.53, N = 7SE +/- 885.61, N = 36351463529

OSPRay Studio

Camera: 3 - Resolution: 4K - Samples Per Pixel: 16 - Renderer: Path Tracer - Acceleration: CPU

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 1.0Camera: 3 - Resolution: 4K - Samples Per Pixel: 16 - Renderer: Path Tracer - Acceleration: CPULinux 6.8Linux 6.9-rc29K18K27K36K45KSE +/- 626.71, N = 12SE +/- 252.89, N = 34065739794

OSPRay Studio

Camera: 3 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path Tracer - Acceleration: CPU

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 1.0Camera: 3 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path Tracer - Acceleration: CPULinux 6.8Linux 6.9-rc216K32K48K64K80KSE +/- 506.90, N = 3SE +/- 855.02, N = 157217273367

OSPRay Studio

Camera: 1 - Resolution: 1080p - Samples Per Pixel: 1 - Renderer: Path Tracer - Acceleration: CPU

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 1.0Camera: 1 - Resolution: 1080p - Samples Per Pixel: 1 - Renderer: Path Tracer - Acceleration: CPULinux 6.8Linux 6.9-rc2100200300400500SE +/- 3.71, N = 3SE +/- 2.33, N = 3466478

OSPRay Studio

Camera: 2 - Resolution: 1080p - Samples Per Pixel: 1 - Renderer: Path Tracer - Acceleration: CPU

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 1.0Camera: 2 - Resolution: 1080p - Samples Per Pixel: 1 - Renderer: Path Tracer - Acceleration: CPULinux 6.8Linux 6.9-rc2110220330440550SE +/- 5.26, N = 5SE +/- 2.33, N = 3501489

OSPRay Studio

Camera: 3 - Resolution: 1080p - Samples Per Pixel: 1 - Renderer: Path Tracer - Acceleration: CPU

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 1.0Camera: 3 - Resolution: 1080p - Samples Per Pixel: 1 - Renderer: Path Tracer - Acceleration: CPULinux 6.8Linux 6.9-rc2120240360480600SE +/- 4.36, N = 15SE +/- 4.85, N = 15569570

OSPRay Studio

Camera: 1 - Resolution: 1080p - Samples Per Pixel: 16 - Renderer: Path Tracer - Acceleration: CPU

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 1.0Camera: 1 - Resolution: 1080p - Samples Per Pixel: 16 - Renderer: Path Tracer - Acceleration: CPULinux 6.8Linux 6.9-rc215003000450060007500SE +/- 83.68, N = 3SE +/- 15.17, N = 369096804

OSPRay Studio

Camera: 1 - Resolution: 1080p - Samples Per Pixel: 32 - Renderer: Path Tracer - Acceleration: CPU

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 1.0Camera: 1 - Resolution: 1080p - Samples Per Pixel: 32 - Renderer: Path Tracer - Acceleration: CPULinux 6.8Linux 6.9-rc23K6K9K12K15KSE +/- 112.81, N = 9SE +/- 180.26, N = 31386713807

OSPRay Studio

Camera: 2 - Resolution: 1080p - Samples Per Pixel: 16 - Renderer: Path Tracer - Acceleration: CPU

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 1.0Camera: 2 - Resolution: 1080p - Samples Per Pixel: 16 - Renderer: Path Tracer - Acceleration: CPULinux 6.8Linux 6.9-rc216003200480064008000SE +/- 105.66, N = 3SE +/- 118.69, N = 1574027506

OSPRay Studio

Camera: 2 - Resolution: 1080p - Samples Per Pixel: 32 - Renderer: Path Tracer - Acceleration: CPU

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 1.0Camera: 2 - Resolution: 1080p - Samples Per Pixel: 32 - Renderer: Path Tracer - Acceleration: CPULinux 6.8Linux 6.9-rc23K6K9K12K15KSE +/- 268.32, N = 12SE +/- 235.77, N = 151483615415

OSPRay Studio

Camera: 3 - Resolution: 1080p - Samples Per Pixel: 16 - Renderer: Path Tracer - Acceleration: CPU

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 1.0Camera: 3 - Resolution: 1080p - Samples Per Pixel: 16 - Renderer: Path Tracer - Acceleration: CPULinux 6.8Linux 6.9-rc22K4K6K8K10KSE +/- 70.21, N = 3SE +/- 26.21, N = 387328552

OSPRay Studio

Camera: 3 - Resolution: 1080p - Samples Per Pixel: 32 - Renderer: Path Tracer - Acceleration: CPU

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 1.0Camera: 3 - Resolution: 1080p - Samples Per Pixel: 32 - Renderer: Path Tracer - Acceleration: CPULinux 6.8Linux 6.9-rc24K8K12K16K20KSE +/- 101.18, N = 3SE +/- 156.23, N = 61720416687

Hackbench

Count: 16 - Type: Thread

OpenBenchmarking.orgSeconds, Fewer Is BetterHackbenchCount: 16 - Type: ThreadLinux 6.8Linux 6.9-rc248121620SE +/- 0.00, N = 3SE +/- 0.14, N = 1514.6814.301. (CC) gcc options: -lpthread

Hackbench

Count: 16 - Type: Process

OpenBenchmarking.orgSeconds, Fewer Is BetterHackbenchCount: 16 - Type: ProcessLinux 6.8Linux 6.9-rc23691215SE +/- 0.11, N = 3SE +/- 0.19, N = 313.1113.361. (CC) gcc options: -lpthread

Hackbench

Count: 32 - Type: Process

OpenBenchmarking.orgSeconds, Fewer Is BetterHackbenchCount: 32 - Type: ProcessLinux 6.8Linux 6.9-rc2714212835SE +/- 0.27, N = 3SE +/- 0.39, N = 324.7527.991. (CC) gcc options: -lpthread

OpenSSL

Algorithm: SHA256

OpenBenchmarking.orgbyte/s, More Is BetterOpenSSLAlgorithm: SHA256Linux 6.8Linux 6.9-rc220000M40000M60000M80000M100000MSE +/- 767626108.54, N = 3SE +/- 717052715.91, N = 1284678420667816782841761. OpenSSL 3.0.10 1 Aug 2023 (Library: OpenSSL 3.0.10 1 Aug 2023)

OpenSSL

Algorithm: SHA512

OpenBenchmarking.orgbyte/s, More Is BetterOpenSSLAlgorithm: SHA512Linux 6.8Linux 6.9-rc26000M12000M18000M24000M30000MSE +/- 92272355.83, N = 3SE +/- 252323355.66, N = 329940735740296654990531. OpenSSL 3.0.10 1 Aug 2023 (Library: OpenSSL 3.0.10 1 Aug 2023)

OpenSSL

Algorithm: RSA4096

OpenBenchmarking.orgsign/s, More Is BetterOpenSSLAlgorithm: RSA4096Linux 6.8Linux 6.9-rc28K16K24K32K40KSE +/- 46.27, N = 3SE +/- 90.23, N = 338204.638147.41. OpenSSL 3.0.10 1 Aug 2023 (Library: OpenSSL 3.0.10 1 Aug 2023)

OpenSSL

Algorithm: RSA4096

OpenBenchmarking.orgverify/s, More Is BetterOpenSSLAlgorithm: RSA4096Linux 6.8Linux 6.9-rc2300K600K900K1200K1500KSE +/- 19064.62, N = 3SE +/- 833.27, N = 31358616.41396904.01. OpenSSL 3.0.10 1 Aug 2023 (Library: OpenSSL 3.0.10 1 Aug 2023)

GROMACS

Implementation: MPI CPU - Input: water_GMX50_bare

OpenBenchmarking.orgNs Per Day, More Is BetterGROMACS 2024Implementation: MPI CPU - Input: water_GMX50_bareLinux 6.8Linux 6.9-rc23691215SE +/- 0.06, N = 3SE +/- 0.08, N = 312.0911.761. (CXX) g++ options: -O3 -lm

MariaDB mariadb-slap

Clients: 512

OpenBenchmarking.orgQueries Per Second, More Is BetterMariaDB mariadb-slap 11.5Clients: 512Linux 6.8Linux 6.9-rc220406080100SE +/- 0.41, N = 3SE +/- 0.87, N = 986861. (CXX) g++ options: -fPIC -pie -fstack-protector -O3 -shared -lrt -lpthread -lz -ldl -lm -lstdc++

MariaDB mariadb-slap

Clients: 1024

OpenBenchmarking.orgQueries Per Second, More Is BetterMariaDB mariadb-slap 11.5Clients: 1024Linux 6.8Linux 6.9-rc2816243240SE +/- 1.23, N = 9SE +/- 1.41, N = 634361. (CXX) g++ options: -fPIC -pie -fstack-protector -O3 -shared -lrt -lpthread -lz -ldl -lm -lstdc++

TensorFlow

Device: CPU - Batch Size: 1 - Model: AlexNet

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.16.1Device: CPU - Batch Size: 1 - Model: AlexNetLinux 6.8Linux 6.9-rc248121620SE +/- 0.25, N = 12SE +/- 0.25, N = 317.2318.28

TensorFlow

Device: CPU - Batch Size: 16 - Model: AlexNet

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.16.1Device: CPU - Batch Size: 16 - Model: AlexNetLinux 6.8Linux 6.9-rc250100150200250SE +/- 1.58, N = 15SE +/- 1.89, N = 15213.35210.71

TensorFlow

Device: CPU - Batch Size: 32 - Model: AlexNet

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.16.1Device: CPU - Batch Size: 32 - Model: AlexNetLinux 6.8Linux 6.9-rc280160240320400SE +/- 2.86, N = 15SE +/- 5.16, N = 15346.10341.97

TensorFlow

Device: CPU - Batch Size: 64 - Model: AlexNet

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.16.1Device: CPU - Batch Size: 64 - Model: AlexNetLinux 6.8Linux 6.9-rc2110220330440550SE +/- 6.05, N = 3SE +/- 5.17, N = 15495.72471.88

TensorFlow

Device: CPU - Batch Size: 1 - Model: GoogLeNet

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.16.1Device: CPU - Batch Size: 1 - Model: GoogLeNetLinux 6.8Linux 6.9-rc2246810SE +/- 0.13, N = 12SE +/- 0.14, N = 156.055.98

TensorFlow

Device: CPU - Batch Size: 1 - Model: ResNet-50

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.16.1Device: CPU - Batch Size: 1 - Model: ResNet-50Linux 6.8Linux 6.9-rc20.42750.8551.28251.712.1375SE +/- 0.03, N = 15SE +/- 0.03, N = 151.881.90

TensorFlow

Device: CPU - Batch Size: 256 - Model: AlexNet

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.16.1Device: CPU - Batch Size: 256 - Model: AlexNetLinux 6.8Linux 6.9-rc2160320480640800SE +/- 9.01, N = 3SE +/- 6.62, N = 7723.16711.74

TensorFlow

Device: CPU - Batch Size: 16 - Model: GoogLeNet

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.16.1Device: CPU - Batch Size: 16 - Model: GoogLeNetLinux 6.8Linux 6.9-rc21326395265SE +/- 1.31, N = 12SE +/- 1.24, N = 1258.5058.83

TensorFlow

Device: CPU - Batch Size: 16 - Model: ResNet-50

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.16.1Device: CPU - Batch Size: 16 - Model: ResNet-50Linux 6.8Linux 6.9-rc2612182430SE +/- 0.30, N = 3SE +/- 0.28, N = 1524.1224.80

TensorFlow

Device: CPU - Batch Size: 32 - Model: GoogLeNet

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.16.1Device: CPU - Batch Size: 32 - Model: GoogLeNetLinux 6.8Linux 6.9-rc220406080100SE +/- 1.27, N = 12SE +/- 1.10, N = 1596.3197.53

TensorFlow

Device: CPU - Batch Size: 32 - Model: ResNet-50

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.16.1Device: CPU - Batch Size: 32 - Model: ResNet-50Linux 6.8Linux 6.9-rc2816243240SE +/- 0.48, N = 15SE +/- 0.42, N = 1535.3034.86

TensorFlow

Device: CPU - Batch Size: 64 - Model: GoogLeNet

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.16.1Device: CPU - Batch Size: 64 - Model: GoogLeNetLinux 6.8Linux 6.9-rc2306090120150SE +/- 0.94, N = 3SE +/- 1.70, N = 15135.18128.71

TensorFlow

Device: CPU - Batch Size: 64 - Model: ResNet-50

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.16.1Device: CPU - Batch Size: 64 - Model: ResNet-50Linux 6.8Linux 6.9-rc21122334455SE +/- 0.54, N = 12SE +/- 0.42, N = 347.0347.96

TensorFlow

Device: CPU - Batch Size: 256 - Model: GoogLeNet

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.16.1Device: CPU - Batch Size: 256 - Model: GoogLeNetLinux 6.8Linux 6.9-rc24080120160200SE +/- 2.20, N = 12SE +/- 1.95, N = 3202.37203.63

TensorFlow

Device: CPU - Batch Size: 256 - Model: ResNet-50

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.16.1Device: CPU - Batch Size: 256 - Model: ResNet-50Linux 6.8Linux 6.9-rc21632486480SE +/- 0.38, N = 3SE +/- 0.47, N = 370.1070.53

Google Draco

Model: Lion

OpenBenchmarking.orgms, Fewer Is BetterGoogle Draco 1.5.6Model: LionLinux 6.8Linux 6.9-rc213002600390052006500SE +/- 40.84, N = 3SE +/- 29.28, N = 3612960541. (CXX) g++ options: -O3

Google Draco

Model: Church Facade

OpenBenchmarking.orgms, Fewer Is BetterGoogle Draco 1.5.6Model: Church FacadeLinux 6.8Linux 6.9-rc217003400510068008500SE +/- 0.88, N = 3SE +/- 9.56, N = 3774777621. (CXX) g++ options: -O3

Stress-NG

Test: Hash

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: HashLinux 6.8Linux 6.9-rc24M8M12M16M20MSE +/- 82496.53, N = 3SE +/- 192774.29, N = 317071694.5217199190.091. (CXX) g++ options: -lm -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lpthread -lrt -lsctp -lz

Stress-NG

Test: MMAP

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: MMAPLinux 6.8Linux 6.9-rc214002800420056007000SE +/- 70.88, N = 14SE +/- 66.09, N = 156169.366427.331. (CXX) g++ options: -lm -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lpthread -lrt -lsctp -lz

Stress-NG

Test: NUMA

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: NUMALinux 6.8Linux 6.9-rc2110220330440550SE +/- 4.27, N = 3SE +/- 5.89, N = 4482.62487.601. (CXX) g++ options: -lm -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lpthread -lrt -lsctp -lz

Stress-NG

Test: Pipe

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: PipeLinux 6.8Linux 6.9-rc27M14M21M28M35MSE +/- 749025.19, N = 15SE +/- 2106194.07, N = 1530377557.9729814480.671. (CXX) g++ options: -lm -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lpthread -lrt -lsctp -lz

Stress-NG

Test: Poll

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: PollLinux 6.8Linux 6.9-rc22M4M6M8M10MSE +/- 37074.52, N = 3SE +/- 30731.99, N = 310389186.0210232390.411. (CXX) g++ options: -lm -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lpthread -lrt -lsctp -lz

Stress-NG

Test: Zlib

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: ZlibLinux 6.8Linux 6.9-rc22K4K6K8K10KSE +/- 25.13, N = 3SE +/- 124.93, N = 39670.379446.071. (CXX) g++ options: -lm -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lpthread -lrt -lsctp -lz

Stress-NG

Test: MEMFD

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: MEMFDLinux 6.8Linux 6.9-rc2150300450600750SE +/- 14.68, N = 15SE +/- 5.94, N = 8688.26688.761. (CXX) g++ options: -lm -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lpthread -lrt -lsctp -lz

Stress-NG

Test: Mutex

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: MutexLinux 6.8Linux 6.9-rc26M12M18M24M30MSE +/- 281178.86, N = 3SE +/- 294297.65, N = 328490133.2828934422.161. (CXX) g++ options: -lm -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lpthread -lrt -lsctp -lz

Stress-NG

Test: Crypto

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: CryptoLinux 6.8Linux 6.9-rc230K60K90K120K150KSE +/- 1720.03, N = 15SE +/- 2039.96, N = 15143967.24147978.331. (CXX) g++ options: -lm -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lpthread -lrt -lsctp -lz

Stress-NG

Test: Malloc

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: MallocLinux 6.8Linux 6.9-rc240M80M120M160M200MSE +/- 201545.00, N = 3SE +/- 3675496.40, N = 12163551396.40161652700.091. (CXX) g++ options: -lm -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lpthread -lrt -lsctp -lz

Stress-NG

Test: Pthread

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: PthreadLinux 6.8Linux 6.9-rc28K16K24K32K40KSE +/- 49.70, N = 3SE +/- 450.35, N = 1539599.2635919.641. (CXX) g++ options: -lm -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lpthread -lrt -lsctp -lz

Stress-NG

Test: AVL Tree

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: AVL TreeLinux 6.8Linux 6.9-rc22004006008001000SE +/- 6.53, N = 3SE +/- 2.13, N = 3810.19808.991. (CXX) g++ options: -lm -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lpthread -lrt -lsctp -lz

Stress-NG

Test: IO_uring

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: IO_uringLinux 6.8Linux 6.9-rc2700K1400K2100K2800K3500KSE +/- 31595.27, N = 3SE +/- 43339.28, N = 153468957.593346567.801. (CXX) g++ options: -lm -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lpthread -lrt -lsctp -lz

Stress-NG

Test: SENDFILE

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: SENDFILELinux 6.8Linux 6.9-rc2400K800K1200K1600K2000KSE +/- 609.53, N = 3SE +/- 5873.31, N = 31798203.121900682.081. (CXX) g++ options: -lm -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lpthread -lrt -lsctp -lz

Stress-NG

Test: CPU Stress

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: CPU StressLinux 6.8Linux 6.9-rc240K80K120K160K200KSE +/- 569.84, N = 3SE +/- 335.84, N = 3202073.08200671.701. (CXX) g++ options: -lm -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lpthread -lrt -lsctp -lz

Stress-NG

Test: Semaphores

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: SemaphoresLinux 6.8Linux 6.9-rc230M60M90M120M150MSE +/- 1498916.25, N = 3SE +/- 1330349.25, N = 3154589461.19150005776.471. (CXX) g++ options: -lm -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lpthread -lrt -lsctp -lz

Stress-NG

Test: Matrix Math

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Matrix MathLinux 6.8Linux 6.9-rc280K160K240K320K400KSE +/- 4925.11, N = 15SE +/- 9278.38, N = 12384748.54392750.091. (CXX) g++ options: -lm -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lpthread -lrt -lsctp -lz

Stress-NG

Test: Floating Point

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Floating PointLinux 6.8Linux 6.9-rc26K12K18K24K30KSE +/- 632.70, N = 12SE +/- 214.66, N = 1129600.0229139.601. (CXX) g++ options: -lm -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lpthread -lrt -lsctp -lz

Stress-NG

Test: Matrix 3D Math

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Matrix 3D MathLinux 6.8Linux 6.9-rc27K14K21K28K35KSE +/- 669.33, N = 15SE +/- 437.41, N = 1531442.6931460.421. (CXX) g++ options: -lm -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lpthread -lrt -lsctp -lz

Stress-NG

Test: Memory Copying

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Memory CopyingLinux 6.8Linux 6.9-rc25K10K15K20K25KSE +/- 178.25, N = 3SE +/- 155.03, N = 1021085.1020605.391. (CXX) g++ options: -lm -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lpthread -lrt -lsctp -lz

Stress-NG

Test: Vector Shuffle

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Vector ShuffleLinux 6.8Linux 6.9-rc2120K240K360K480K600KSE +/- 1416.85, N = 3SE +/- 1897.90, N = 3576905.92569593.001. (CXX) g++ options: -lm -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lpthread -lrt -lsctp -lz

Stress-NG

Test: Mixed Scheduler

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Mixed SchedulerLinux 6.8Linux 6.9-rc215K30K45K60K75KSE +/- 153.71, N = 3SE +/- 281.29, N = 370407.9670036.201. (CXX) g++ options: -lm -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lpthread -lrt -lsctp -lz

Stress-NG

Test: Socket Activity

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Socket ActivityLinux 6.8Linux 6.9-rc210K20K30K40K50KSE +/- 79.93, N = 3SE +/- 21.40, N = 347927.7546123.321. (CXX) g++ options: -lm -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lpthread -lrt -lsctp -lz

Stress-NG

Test: Wide Vector Math

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Wide Vector MathLinux 6.8Linux 6.9-rc21.3M2.6M3.9M5.2M6.5MSE +/- 72950.92, N = 4SE +/- 55746.31, N = 155874353.635908316.031. (CXX) g++ options: -lm -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lpthread -lrt -lsctp -lz

Stress-NG

Test: Context Switching

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Context SwitchingLinux 6.8Linux 6.9-rc24M8M12M16M20MSE +/- 178479.09, N = 8SE +/- 265846.30, N = 320343491.5219390362.901. (CXX) g++ options: -lm -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lpthread -lrt -lsctp -lz

Stress-NG

Test: Fused Multiply-Add

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Fused Multiply-AddLinux 6.8Linux 6.9-rc240M80M120M160M200MSE +/- 6187723.80, N = 12SE +/- 3824188.11, N = 15204365411.59200468629.321. (CXX) g++ options: -lm -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lpthread -lrt -lsctp -lz

Stress-NG

Test: Vector Floating Point

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Vector Floating PointLinux 6.8Linux 6.9-rc250K100K150K200K250KSE +/- 5616.14, N = 12SE +/- 8579.53, N = 12234669.74230503.341. (CXX) g++ options: -lm -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lpthread -lrt -lsctp -lz

Stress-NG

Test: Glibc C String Functions

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Glibc C String FunctionsLinux 6.8Linux 6.9-rc220M40M60M80M100MSE +/- 2138024.53, N = 13SE +/- 1504028.14, N = 1580643523.2485035507.551. (CXX) g++ options: -lm -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lpthread -lrt -lsctp -lz

Stress-NG

Test: Glibc Qsort Data Sorting

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Glibc Qsort Data SortingLinux 6.8Linux 6.9-rc2400800120016002000SE +/- 4.40, N = 3SE +/- 4.16, N = 31866.581858.701. (CXX) g++ options: -lm -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lpthread -lrt -lsctp -lz

Stress-NG

Test: System V Message Passing

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: System V Message PassingLinux 6.8Linux 6.9-rc24M8M12M16M20MSE +/- 189741.33, N = 15SE +/- 35075.39, N = 317859304.3818740350.561. (CXX) g++ options: -lm -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lpthread -lrt -lsctp -lz

Blender

Blend File: BMW27 - Compute: CPU-Only

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 4.1Blend File: BMW27 - Compute: CPU-OnlyLinux 6.8Linux 6.9-rc2510152025SE +/- 0.33, N = 14SE +/- 0.08, N = 321.8222.02

Blender

Blend File: Junkshop - Compute: CPU-Only

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 4.1Blend File: Junkshop - Compute: CPU-OnlyLinux 6.8Linux 6.9-rc21122334455SE +/- 0.47, N = 15SE +/- 0.40, N = 1545.6046.56

Blender

Blend File: Classroom - Compute: CPU-Only

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 4.1Blend File: Classroom - Compute: CPU-OnlyLinux 6.8Linux 6.9-rc21224364860SE +/- 0.10, N = 3SE +/- 0.09, N = 353.9853.82

Blender

Blend File: Fishy Cat - Compute: CPU-Only

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 4.1Blend File: Fishy Cat - Compute: CPU-OnlyLinux 6.8Linux 6.9-rc2918273645SE +/- 0.38, N = 15SE +/- 0.44, N = 438.0939.37

Blender

Blend File: Barbershop - Compute: CPU-Only

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 4.1Blend File: Barbershop - Compute: CPU-OnlyLinux 6.8Linux 6.9-rc260120180240300SE +/- 6.20, N = 8SE +/- 6.67, N = 9271.99279.74

Blender

Blend File: Pabellon Barcelona - Compute: CPU-Only

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 4.1Blend File: Pabellon Barcelona - Compute: CPU-OnlyLinux 6.8Linux 6.9-rc220406080100SE +/- 0.83, N = 5SE +/- 0.61, N = 1576.2075.56

OpenVINO

Model: Face Detection FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Face Detection FP16 - Device: CPULinux 6.8Linux 6.9-rc2306090120150SE +/- 0.33, N = 3SE +/- 0.55, N = 3119.92121.931. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Face Detection FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Face Detection FP16 - Device: CPULinux 6.8Linux 6.9-rc270140210280350SE +/- 0.84, N = 3SE +/- 1.30, N = 3307.74302.77MIN: 183.58 / MAX: 728.14MIN: 181.55 / MAX: 894.731. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Person Detection FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Person Detection FP16 - Device: CPULinux 6.8Linux 6.9-rc2100200300400500SE +/- 2.33, N = 3SE +/- 1.20, N = 3451.13466.451. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Person Detection FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Person Detection FP16 - Device: CPULinux 6.8Linux 6.9-rc220406080100SE +/- 0.43, N = 3SE +/- 0.20, N = 381.9079.23MIN: 49.43 / MAX: 345.35MIN: 50.1 / MAX: 290.061. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Person Detection FP32 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Person Detection FP32 - Device: CPULinux 6.8Linux 6.9-rc2100200300400500SE +/- 3.09, N = 3SE +/- 3.72, N = 3445.90467.791. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Person Detection FP32 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Person Detection FP32 - Device: CPULinux 6.8Linux 6.9-rc220406080100SE +/- 0.57, N = 3SE +/- 0.62, N = 382.8779.00MIN: 51.69 / MAX: 529.56MIN: 49.24 / MAX: 319.951. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Vehicle Detection FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Vehicle Detection FP16 - Device: CPULinux 6.8Linux 6.9-rc26001200180024003000SE +/- 16.72, N = 3SE +/- 25.96, N = 32530.042656.421. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Vehicle Detection FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Vehicle Detection FP16 - Device: CPULinux 6.8Linux 6.9-rc248121620SE +/- 0.10, N = 3SE +/- 0.14, N = 314.5813.89MIN: 9.5 / MAX: 109.83MIN: 9.12 / MAX: 90.571. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Face Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Face Detection FP16-INT8 - Device: CPULinux 6.8Linux 6.9-rc270140210280350SE +/- 0.75, N = 3SE +/- 0.82, N = 3331.23330.731. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Face Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Face Detection FP16-INT8 - Device: CPULinux 6.8Linux 6.9-rc270140210280350SE +/- 0.74, N = 3SE +/- 0.81, N = 3337.21337.78MIN: 261.24 / MAX: 615.09MIN: 253.21 / MAX: 781.061. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Face Detection Retail FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Face Detection Retail FP16 - Device: CPULinux 6.8Linux 6.9-rc22K4K6K8K10KSE +/- 23.83, N = 3SE +/- 26.72, N = 311260.9811295.921. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Face Detection Retail FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Face Detection Retail FP16 - Device: CPULinux 6.8Linux 6.9-rc23691215SE +/- 0.02, N = 3SE +/- 0.02, N = 39.929.89MIN: 7.45 / MAX: 33.82MIN: 7.63 / MAX: 36.571. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Road Segmentation ADAS FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Road Segmentation ADAS FP16 - Device: CPULinux 6.8Linux 6.9-rc22004006008001000SE +/- 9.82, N = 3SE +/- 6.69, N = 31018.471051.301. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Road Segmentation ADAS FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Road Segmentation ADAS FP16 - Device: CPULinux 6.8Linux 6.9-rc2816243240SE +/- 0.35, N = 3SE +/- 0.23, N = 336.2835.14MIN: 24.78 / MAX: 205.05MIN: 25.25 / MAX: 437.271. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Vehicle Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Vehicle Detection FP16-INT8 - Device: CPULinux 6.8Linux 6.9-rc211002200330044005500SE +/- 9.46, N = 3SE +/- 18.34, N = 35067.405052.711. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Vehicle Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Vehicle Detection FP16-INT8 - Device: CPULinux 6.8Linux 6.9-rc2510152025SE +/- 0.04, N = 3SE +/- 0.08, N = 322.0622.12MIN: 15.51 / MAX: 86.25MIN: 15.73 / MAX: 71.51. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Weld Porosity Detection FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Weld Porosity Detection FP16 - Device: CPULinux 6.8Linux 6.9-rc24K8K12K16K20KSE +/- 194.69, N = 3SE +/- 107.94, N = 316147.5716349.051. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Weld Porosity Detection FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Weld Porosity Detection FP16 - Device: CPULinux 6.8Linux 6.9-rc2246810SE +/- 0.08, N = 3SE +/- 0.05, N = 36.856.76MIN: 4.47 / MAX: 51.04MIN: 4.36 / MAX: 70.911. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Face Detection Retail FP16-INT8 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Face Detection Retail FP16-INT8 - Device: CPULinux 6.8Linux 6.9-rc23K6K9K12K15KSE +/- 132.85, N = 3SE +/- 25.09, N = 315532.5415589.591. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Face Detection Retail FP16-INT8 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Face Detection Retail FP16-INT8 - Device: CPULinux 6.8Linux 6.9-rc2246810SE +/- 0.07, N = 3SE +/- 0.00, N = 37.177.14MIN: 5.78 / MAX: 54.3MIN: 5.79 / MAX: 44.661. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Road Segmentation ADAS FP16-INT8 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Road Segmentation ADAS FP16-INT8 - Device: CPULinux 6.8Linux 6.9-rc230060090012001500SE +/- 1.59, N = 3SE +/- 5.16, N = 31446.421442.211. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Road Segmentation ADAS FP16-INT8 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Road Segmentation ADAS FP16-INT8 - Device: CPULinux 6.8Linux 6.9-rc220406080100SE +/- 0.09, N = 3SE +/- 0.28, N = 377.3477.57MIN: 56.48 / MAX: 158.67MIN: 57.16 / MAX: 148.671. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Machine Translation EN To DE FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Machine Translation EN To DE FP16 - Device: CPULinux 6.8Linux 6.9-rc2150300450600750SE +/- 5.75, N = 3SE +/- 3.16, N = 3671.66673.461. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Machine Translation EN To DE FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Machine Translation EN To DE FP16 - Device: CPULinux 6.8Linux 6.9-rc21224364860SE +/- 0.47, N = 3SE +/- 0.25, N = 354.9854.83MIN: 33.9 / MAX: 423.36MIN: 34.71 / MAX: 375.041. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Weld Porosity Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Weld Porosity Detection FP16-INT8 - Device: CPULinux 6.8Linux 6.9-rc26K12K18K24K30KSE +/- 285.82, N = 4SE +/- 155.42, N = 326732.8827790.241. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Weld Porosity Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Weld Porosity Detection FP16-INT8 - Device: CPULinux 6.8Linux 6.9-rc20.91131.82262.73393.64524.5565SE +/- 0.05, N = 4SE +/- 0.01, N = 34.053.89MIN: 2.67 / MAX: 52.43MIN: 2.64 / MAX: 47.091. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Person Vehicle Bike Detection FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Person Vehicle Bike Detection FP16 - Device: CPULinux 6.8Linux 6.9-rc214002800420056007000SE +/- 18.88, N = 3SE +/- 23.77, N = 36336.786306.421. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Person Vehicle Bike Detection FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Person Vehicle Bike Detection FP16 - Device: CPULinux 6.8Linux 6.9-rc248121620SE +/- 0.06, N = 3SE +/- 0.07, N = 317.5217.58MIN: 11.97 / MAX: 108.98MIN: 12.03 / MAX: 66.231. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Noise Suppression Poconet-Like FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Noise Suppression Poconet-Like FP16 - Device: CPULinux 6.8Linux 6.9-rc210002000300040005000SE +/- 54.03, N = 3SE +/- 29.05, N = 34621.324600.951. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Noise Suppression Poconet-Like FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Noise Suppression Poconet-Like FP16 - Device: CPULinux 6.8Linux 6.9-rc2612182430SE +/- 0.17, N = 3SE +/- 0.20, N = 323.6823.97MIN: 11.64 / MAX: 175.69MIN: 11.24 / MAX: 358.11. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Handwritten English Recognition FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Handwritten English Recognition FP16 - Device: CPULinux 6.8Linux 6.9-rc28001600240032004000SE +/- 3.14, N = 3SE +/- 10.89, N = 33626.413608.211. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Handwritten English Recognition FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Handwritten English Recognition FP16 - Device: CPULinux 6.8Linux 6.9-rc2714212835SE +/- 0.03, N = 3SE +/- 0.09, N = 330.8531.01MIN: 24.82 / MAX: 82.03MIN: 24.42 / MAX: 90.861. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Person Re-Identification Retail FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Person Re-Identification Retail FP16 - Device: CPULinux 6.8Linux 6.9-rc22K4K6K8K10KSE +/- 20.55, N = 3SE +/- 28.95, N = 311638.5111564.781. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Person Re-Identification Retail FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Person Re-Identification Retail FP16 - Device: CPULinux 6.8Linux 6.9-rc23691215SE +/- 0.02, N = 3SE +/- 0.03, N = 39.599.65MIN: 7.62 / MAX: 27.98MIN: 7.62 / MAX: 34.181. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Age Gender Recognition Retail 0013 FP16 - Device: CPULinux 6.8Linux 6.9-rc216K32K48K64K80KSE +/- 711.41, N = 15SE +/- 1055.18, N = 367789.2573754.741. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Age Gender Recognition Retail 0013 FP16 - Device: CPULinux 6.8Linux 6.9-rc20.17550.3510.52650.7020.8775SE +/- 0.01, N = 15SE +/- 0.03, N = 30.780.71MIN: 0.3 / MAX: 138.08MIN: 0.32 / MAX: 74.711. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Handwritten English Recognition FP16-INT8 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Handwritten English Recognition FP16-INT8 - Device: CPULinux 6.8Linux 6.9-rc28001600240032004000SE +/- 10.67, N = 3SE +/- 8.36, N = 33777.563704.381. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Handwritten English Recognition FP16-INT8 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Handwritten English Recognition FP16-INT8 - Device: CPULinux 6.8Linux 6.9-rc2714212835SE +/- 0.08, N = 3SE +/- 0.07, N = 329.6130.20MIN: 25.51 / MAX: 92.13MIN: 22.08 / MAX: 107.871. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPULinux 6.8Linux 6.9-rc230K60K90K120K150KSE +/- 1455.69, N = 15SE +/- 1149.56, N = 15121702.12119735.571. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPULinux 6.8Linux 6.9-rc20.08550.1710.25650.3420.4275SE +/- 0.01, N = 15SE +/- 0.00, N = 150.380.38MIN: 0.23 / MAX: 46.5MIN: 0.24 / MAX: 50.651. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

RocksDB

Test: Overwrite

OpenBenchmarking.orgOp/s, More Is BetterRocksDB 9.0Test: OverwriteLinux 6.8Linux 6.9-rc280K160K240K320K400KSE +/- 881.98, N = 3SE +/- 3053.81, N = 33880103919681. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti -lpthread

RocksDB

Test: Random Read

OpenBenchmarking.orgOp/s, More Is BetterRocksDB 9.0Test: Random ReadLinux 6.8Linux 6.9-rc280M160M240M320M400MSE +/- 1573786.50, N = 3SE +/- 1447290.34, N = 33604985183615860831. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti -lpthread

RocksDB

Test: Update Random

OpenBenchmarking.orgOp/s, More Is BetterRocksDB 9.0Test: Update RandomLinux 6.8Linux 6.9-rc280K160K240K320K400KSE +/- 1470.46, N = 3SE +/- 1522.72, N = 33598253615021. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti -lpthread

RocksDB

Test: Read Random Write Random

OpenBenchmarking.orgOp/s, More Is BetterRocksDB 9.0Test: Read Random Write RandomLinux 6.8Linux 6.9-rc2500K1000K1500K2000K2500KSE +/- 17412.72, N = 3SE +/- 22543.45, N = 5212084420685881. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti -lpthread

Speedb

Test: Random Fill

OpenBenchmarking.orgOp/s, More Is BetterSpeedb 2.7Test: Random FillLinux 6.8Linux 6.9-rc270K140K210K280K350KSE +/- 2148.02, N = 3SE +/- 3492.28, N = 33264993228161. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti -lpthread

Speedb

Test: Random Read

OpenBenchmarking.orgOp/s, More Is BetterSpeedb 2.7Test: Random ReadLinux 6.8Linux 6.9-rc280M160M240M320M400MSE +/- 1002006.26, N = 3SE +/- 4146957.10, N = 33804193893758374791. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti -lpthread

Speedb

Test: Update Random

OpenBenchmarking.orgOp/s, More Is BetterSpeedb 2.7Test: Update RandomLinux 6.8Linux 6.9-rc260K120K180K240K300KSE +/- 3488.80, N = 3SE +/- 3235.16, N = 32921802934141. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti -lpthread

Speedb

Test: Sequential Fill

OpenBenchmarking.orgOp/s, More Is BetterSpeedb 2.7Test: Sequential FillLinux 6.8Linux 6.9-rc270K140K210K280K350KSE +/- 1183.38, N = 3SE +/- 1955.03, N = 33276373301671. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti -lpthread

Speedb

Test: Random Fill Sync

OpenBenchmarking.orgOp/s, More Is BetterSpeedb 2.7Test: Random Fill SyncLinux 6.8Linux 6.9-rc260K120K180K240K300KSE +/- 1490.88, N = 3SE +/- 3603.61, N = 32574462596031. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti -lpthread

Speedb

Test: Read Random Write Random

OpenBenchmarking.orgOp/s, More Is BetterSpeedb 2.7Test: Read Random Write RandomLinux 6.8Linux 6.9-rc2300K600K900K1200K1500KSE +/- 8674.90, N = 11SE +/- 13609.90, N = 3118175811755621. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti -lpthread

ONNX Runtime

Model: GPT-2 - Device: CPU - Executor: Parallel

OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.17Model: GPT-2 - Device: CPU - Executor: ParallelLinux 6.8Linux 6.9-rc220406080100SE +/- 1.16, N = 3SE +/- 1.34, N = 15101.90105.781. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

ONNX Runtime

Model: GPT-2 - Device: CPU - Executor: Parallel

OpenBenchmarking.orgInference Time Cost (ms), Fewer Is BetterONNX Runtime 1.17Model: GPT-2 - Device: CPU - Executor: ParallelLinux 6.8Linux 6.9-rc23691215SE +/- 0.11034, N = 3SE +/- 0.12308, N = 159.805149.464961. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

ONNX Runtime

Model: yolov4 - Device: CPU - Executor: Parallel

OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.17Model: yolov4 - Device: CPU - Executor: ParallelLinux 6.8Linux 6.9-rc2246810SE +/- 0.07338, N = 3SE +/- 0.08546, N = 37.913218.041421. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

ONNX Runtime

Model: yolov4 - Device: CPU - Executor: Parallel

OpenBenchmarking.orgInference Time Cost (ms), Fewer Is BetterONNX Runtime 1.17Model: yolov4 - Device: CPU - Executor: ParallelLinux 6.8Linux 6.9-rc2306090120150SE +/- 1.18, N = 3SE +/- 1.32, N = 3126.38124.381. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

ONNX Runtime

Model: yolov4 - Device: CPU - Executor: Standard

OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.17Model: yolov4 - Device: CPU - Executor: StandardLinux 6.8Linux 6.9-rc2246810SE +/- 0.16273, N = 15SE +/- 0.10643, N = 138.223518.909361. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

ONNX Runtime

Model: yolov4 - Device: CPU - Executor: Standard

OpenBenchmarking.orgInference Time Cost (ms), Fewer Is BetterONNX Runtime 1.17Model: yolov4 - Device: CPU - Executor: StandardLinux 6.8Linux 6.9-rc2306090120150SE +/- 2.31, N = 15SE +/- 1.33, N = 13122.24112.431. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

ONNX Runtime

Model: T5 Encoder - Device: CPU - Executor: Parallel

OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.17Model: T5 Encoder - Device: CPU - Executor: ParallelLinux 6.8Linux 6.9-rc24080120160200SE +/- 3.10, N = 12SE +/- 2.39, N = 14185.29196.081. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

ONNX Runtime

Model: T5 Encoder - Device: CPU - Executor: Parallel

OpenBenchmarking.orgInference Time Cost (ms), Fewer Is BetterONNX Runtime 1.17Model: T5 Encoder - Device: CPU - Executor: ParallelLinux 6.8Linux 6.9-rc21.21772.43543.65314.87086.0885SE +/- 0.09595, N = 12SE +/- 0.06160, N = 145.411915.107551. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

ONNX Runtime

Model: T5 Encoder - Device: CPU - Executor: Standard

OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.17Model: T5 Encoder - Device: CPU - Executor: StandardLinux 6.8Linux 6.9-rc290180270360450SE +/- 14.02, N = 15SE +/- 3.01, N = 3353.57402.671. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

ONNX Runtime

Model: T5 Encoder - Device: CPU - Executor: Standard

OpenBenchmarking.orgInference Time Cost (ms), Fewer Is BetterONNX Runtime 1.17Model: T5 Encoder - Device: CPU - Executor: StandardLinux 6.8Linux 6.9-rc20.65141.30281.95422.60563.257SE +/- 0.12453, N = 15SE +/- 0.01855, N = 32.895012.482341. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

ONNX Runtime

Model: bertsquad-12 - Device: CPU - Executor: Parallel

OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.17Model: bertsquad-12 - Device: CPU - Executor: ParallelLinux 6.8Linux 6.9-rc23691215SE +/- 0.04, N = 3SE +/- 0.05, N = 310.7810.601. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

ONNX Runtime

Model: bertsquad-12 - Device: CPU - Executor: Parallel

OpenBenchmarking.orgInference Time Cost (ms), Fewer Is BetterONNX Runtime 1.17Model: bertsquad-12 - Device: CPU - Executor: ParallelLinux 6.8Linux 6.9-rc220406080100SE +/- 0.33, N = 3SE +/- 0.44, N = 392.7594.331. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

ONNX Runtime

Model: bertsquad-12 - Device: CPU - Executor: Standard

OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.17Model: bertsquad-12 - Device: CPU - Executor: StandardLinux 6.8Linux 6.9-rc248121620SE +/- 0.50, N = 12SE +/- 0.54, N = 1514.2715.411. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

ONNX Runtime

Model: bertsquad-12 - Device: CPU - Executor: Standard

OpenBenchmarking.orgInference Time Cost (ms), Fewer Is BetterONNX Runtime 1.17Model: bertsquad-12 - Device: CPU - Executor: StandardLinux 6.8Linux 6.9-rc21632486480SE +/- 2.24, N = 12SE +/- 2.28, N = 1570.9666.001. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

ONNX Runtime

Model: CaffeNet 12-int8 - Device: CPU - Executor: Parallel

OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.17Model: CaffeNet 12-int8 - Device: CPU - Executor: ParallelLinux 6.8Linux 6.9-rc260120180240300SE +/- 2.79, N = 15SE +/- 2.09, N = 3292.17293.031. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

ONNX Runtime

Model: CaffeNet 12-int8 - Device: CPU - Executor: Parallel

OpenBenchmarking.orgInference Time Cost (ms), Fewer Is BetterONNX Runtime 1.17Model: CaffeNet 12-int8 - Device: CPU - Executor: ParallelLinux 6.8Linux 6.9-rc20.77031.54062.31093.08123.8515SE +/- 0.03367, N = 15SE +/- 0.02459, N = 33.423573.409721. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

ONNX Runtime

Model: CaffeNet 12-int8 - Device: CPU - Executor: Standard

OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.17Model: CaffeNet 12-int8 - Device: CPU - Executor: StandardLinux 6.8Linux 6.9-rc2120240360480600SE +/- 6.47, N = 15SE +/- 5.63, N = 3541.83571.191. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

ONNX Runtime

Model: CaffeNet 12-int8 - Device: CPU - Executor: Standard

OpenBenchmarking.orgInference Time Cost (ms), Fewer Is BetterONNX Runtime 1.17Model: CaffeNet 12-int8 - Device: CPU - Executor: StandardLinux 6.8Linux 6.9-rc20.41580.83161.24741.66322.079SE +/- 0.02432, N = 15SE +/- 0.01721, N = 31.848071.749731. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

ONNX Runtime

Model: fcn-resnet101-11 - Device: CPU - Executor: Parallel

OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.17Model: fcn-resnet101-11 - Device: CPU - Executor: ParallelLinux 6.8Linux 6.9-rc20.33820.67641.01461.35281.691SE +/- 0.04472, N = 15SE +/- 0.03151, N = 121.359941.503001. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

ONNX Runtime

Model: fcn-resnet101-11 - Device: CPU - Executor: Parallel

OpenBenchmarking.orgInference Time Cost (ms), Fewer Is BetterONNX Runtime 1.17Model: fcn-resnet101-11 - Device: CPU - Executor: ParallelLinux 6.8Linux 6.9-rc2160320480640800SE +/- 25.74, N = 15SE +/- 14.65, N = 12747.08668.701. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

ONNX Runtime

Model: fcn-resnet101-11 - Device: CPU - Executor: Standard

OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.17Model: fcn-resnet101-11 - Device: CPU - Executor: StandardLinux 6.8Linux 6.9-rc21.21782.43563.65344.87126.089SE +/- 0.20811, N = 12SE +/- 0.05231, N = 34.436495.412591. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

ONNX Runtime

Model: fcn-resnet101-11 - Device: CPU - Executor: Standard

OpenBenchmarking.orgInference Time Cost (ms), Fewer Is BetterONNX Runtime 1.17Model: fcn-resnet101-11 - Device: CPU - Executor: StandardLinux 6.8Linux 6.9-rc250100150200250SE +/- 11.46, N = 12SE +/- 1.80, N = 3231.28184.791. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

ONNX Runtime

Model: ArcFace ResNet-100 - Device: CPU - Executor: Parallel

OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.17Model: ArcFace ResNet-100 - Device: CPU - Executor: ParallelLinux 6.8Linux 6.9-rc248121620SE +/- 0.23, N = 3SE +/- 0.17, N = 316.7817.561. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

ONNX Runtime

Model: ArcFace ResNet-100 - Device: CPU - Executor: Parallel

OpenBenchmarking.orgInference Time Cost (ms), Fewer Is BetterONNX Runtime 1.17Model: ArcFace ResNet-100 - Device: CPU - Executor: ParallelLinux 6.8Linux 6.9-rc21326395265SE +/- 0.81, N = 3SE +/- 0.56, N = 359.6056.951. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

ONNX Runtime

Model: ArcFace ResNet-100 - Device: CPU - Executor: Standard

OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.17Model: ArcFace ResNet-100 - Device: CPU - Executor: StandardLinux 6.8Linux 6.9-rc2612182430SE +/- 0.43, N = 12SE +/- 0.48, N = 1523.4624.231. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

ONNX Runtime

Model: ArcFace ResNet-100 - Device: CPU - Executor: Standard

OpenBenchmarking.orgInference Time Cost (ms), Fewer Is BetterONNX Runtime 1.17Model: ArcFace ResNet-100 - Device: CPU - Executor: StandardLinux 6.8Linux 6.9-rc21020304050SE +/- 0.81, N = 12SE +/- 0.86, N = 1542.7841.501. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

ONNX Runtime

Model: ResNet50 v1-12-int8 - Device: CPU - Executor: Parallel

OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.17Model: ResNet50 v1-12-int8 - Device: CPU - Executor: ParallelLinux 6.8Linux 6.9-rc220406080100SE +/- 0.92, N = 3SE +/- 1.23, N = 394.2595.141. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

ONNX Runtime

Model: ResNet50 v1-12-int8 - Device: CPU - Executor: Parallel

OpenBenchmarking.orgInference Time Cost (ms), Fewer Is BetterONNX Runtime 1.17Model: ResNet50 v1-12-int8 - Device: CPU - Executor: ParallelLinux 6.8Linux 6.9-rc23691215SE +/- 0.10, N = 3SE +/- 0.14, N = 310.6110.511. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

ONNX Runtime

Model: ResNet50 v1-12-int8 - Device: CPU - Executor: Standard

OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.17Model: ResNet50 v1-12-int8 - Device: CPU - Executor: StandardLinux 6.8Linux 6.9-rc2306090120150SE +/- 2.58, N = 12SE +/- 3.02, N = 15111.57122.601. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

ONNX Runtime

Model: ResNet50 v1-12-int8 - Device: CPU - Executor: Standard

OpenBenchmarking.orgInference Time Cost (ms), Fewer Is BetterONNX Runtime 1.17Model: ResNet50 v1-12-int8 - Device: CPU - Executor: StandardLinux 6.8Linux 6.9-rc23691215SE +/- 0.20919, N = 12SE +/- 0.21896, N = 159.015388.231211. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

ONNX Runtime

Model: super-resolution-10 - Device: CPU - Executor: Parallel

OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.17Model: super-resolution-10 - Device: CPU - Executor: ParallelLinux 6.8Linux 6.9-rc2306090120150SE +/- 0.93, N = 3SE +/- 1.50, N = 3152.64153.561. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

ONNX Runtime

Model: super-resolution-10 - Device: CPU - Executor: Parallel

OpenBenchmarking.orgInference Time Cost (ms), Fewer Is BetterONNX Runtime 1.17Model: super-resolution-10 - Device: CPU - Executor: ParallelLinux 6.8Linux 6.9-rc2246810SE +/- 0.04024, N = 3SE +/- 0.06370, N = 36.550116.511271. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

ONNX Runtime

Model: super-resolution-10 - Device: CPU - Executor: Standard

OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.17Model: super-resolution-10 - Device: CPU - Executor: StandardLinux 6.8Linux 6.9-rc250100150200250SE +/- 2.99, N = 15SE +/- 0.80, N = 3205.41213.741. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

ONNX Runtime

Model: super-resolution-10 - Device: CPU - Executor: Standard

OpenBenchmarking.orgInference Time Cost (ms), Fewer Is BetterONNX Runtime 1.17Model: super-resolution-10 - Device: CPU - Executor: StandardLinux 6.8Linux 6.9-rc21.09842.19683.29524.39365.492SE +/- 0.07270, N = 15SE +/- 0.01745, N = 34.881814.678111. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

ONNX Runtime

Model: Faster R-CNN R-50-FPN-int8 - Device: CPU - Executor: Parallel

OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.17Model: Faster R-CNN R-50-FPN-int8 - Device: CPU - Executor: ParallelLinux 6.8Linux 6.9-rc2612182430SE +/- 0.13, N = 3SE +/- 0.07, N = 323.4323.171. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

ONNX Runtime

Model: Faster R-CNN R-50-FPN-int8 - Device: CPU - Executor: Parallel

OpenBenchmarking.orgInference Time Cost (ms), Fewer Is BetterONNX Runtime 1.17Model: Faster R-CNN R-50-FPN-int8 - Device: CPU - Executor: ParallelLinux 6.8Linux 6.9-rc21020304050SE +/- 0.23, N = 3SE +/- 0.13, N = 342.6843.151. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

ONNX Runtime

Model: Faster R-CNN R-50-FPN-int8 - Device: CPU - Executor: Standard

OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.17Model: Faster R-CNN R-50-FPN-int8 - Device: CPU - Executor: StandardLinux 6.8Linux 6.9-rc2816243240SE +/- 0.40, N = 3SE +/- 0.25, N = 332.4534.351. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

ONNX Runtime

Model: Faster R-CNN R-50-FPN-int8 - Device: CPU - Executor: Standard

OpenBenchmarking.orgInference Time Cost (ms), Fewer Is BetterONNX Runtime 1.17Model: Faster R-CNN R-50-FPN-int8 - Device: CPU - Executor: StandardLinux 6.8Linux 6.9-rc2714212835SE +/- 0.38, N = 3SE +/- 0.22, N = 330.8229.111. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

WavPack Audio Encoding

WAV To WavPack

OpenBenchmarking.orgSeconds, Fewer Is BetterWavPack Audio Encoding 5.7WAV To WavPackLinux 6.8Linux 6.9-rc2246810SE +/- 0.023, N = 5SE +/- 0.019, N = 56.3496.340

Llama.cpp

Model: llama-2-13b.Q4_0.gguf

OpenBenchmarking.orgTokens Per Second, More Is BetterLlama.cpp b1808Model: llama-2-13b.Q4_0.ggufLinux 6.8Linux 6.9-rc20.34430.68861.03291.37721.7215SE +/- 0.01, N = 3SE +/- 0.02, N = 31.481.531. (CXX) g++ options: -std=c++11 -fPIC -O3 -pthread -march=native -mtune=native -lopenblas

Llama.cpp

Model: llama-2-70b-chat.Q5_0.gguf

OpenBenchmarking.orgTokens Per Second, More Is BetterLlama.cpp b1808Model: llama-2-70b-chat.Q5_0.ggufLinux 6.8Linux 6.9-rc20.08330.16660.24990.33320.4165SE +/- 0.00, N = 3SE +/- 0.00, N = 30.360.371. (CXX) g++ options: -std=c++11 -fPIC -O3 -pthread -march=native -mtune=native -lopenblas

Llamafile

Test: mistral-7b-instruct-v0.2.Q8_0 - Acceleration: CPU

OpenBenchmarking.orgTokens Per Second, More Is BetterLlamafile 0.6Test: mistral-7b-instruct-v0.2.Q8_0 - Acceleration: CPULinux 6.8Linux 6.9-rc21.03052.0613.09154.1225.1525SE +/- 0.04, N = 3SE +/- 0.03, N = 34.504.58

Llamafile

Test: wizardcoder-python-34b-v1.0.Q6_K - Acceleration: CPU

OpenBenchmarking.orgTokens Per Second, More Is BetterLlamafile 0.6Test: wizardcoder-python-34b-v1.0.Q6_K - Acceleration: CPULinux 6.8Linux 6.9-rc20.17780.35560.53340.71120.889SE +/- 0.01, N = 4SE +/- 0.00, N = 30.790.77

BRL-CAD

VGR Performance Metric

OpenBenchmarking.orgVGR Performance Metric, More Is BetterBRL-CAD 7.38.2VGR Performance MetricLinux 6.8Linux 6.9-rc2900K1800K2700K3600K4500K390683939918021. (CXX) g++ options: -std=c++17 -pipe -fvisibility=hidden -fno-strict-aliasing -fno-common -fexceptions -ftemplate-depth-128 -m64 -ggdb3 -O3 -fipa-pta -fstrength-reduce -finline-functions -flto -ltcl8.6 -lnetpbm -lregex_brl -lz_brl -lassimp -ldl -lm -ltk8.6

Chaos Group V-RAY

Mode: CPU

OpenBenchmarking.orgvsamples, More Is BetterChaos Group V-RAY 6.0Mode: CPULinux 6.8Linux 6.9-rc213K26K39K52K65KSE +/- 530.58, N = 15SE +/- 557.85, N = 35985258995

Phoronix Test Suite v10.8.4