Xeon Max Linux 6.9 Kernel Benchmarks

2 x Intel Xeon Max 9480 benchmarks for a future article.

HTML result view exported from: https://openbenchmarking.org/result/2404035-NE-XEONMAXLI15&sgm=1&grs&sor.

Xeon Max Linux 6.9 Kernel BenchmarksProcessorMotherboardChipsetMemoryDiskGraphicsNetworkOSKernelDesktopDisplay ServerCompilerFile-SystemScreen ResolutionLinux 6.8Linux 6.9-rc22 x Intel Xeon Max 9480 @ 3.50GHz (112 Cores / 224 Threads)Supermicro SYS-221H-TNR X13DEM v1.10 (1.3 BIOS)Intel Device 1bce512GB7682GB INTEL SSDPF2KX076TZASPEED2 x Broadcom BCM57508 NetXtreme-E 10Gb/25Gb/40Gb/50Gb/100Gb/200GbUbuntu 23.106.8.0-060800-generic (x86_64)GNOME Shell 45.0X Server 1.21.1.7GCC 13.2.0ext41024x7686.9.0-060900rc2-generic (x86_64)OpenBenchmarking.orgKernel Details- Transparent Huge Pages: madviseCompiler Details- --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-bootstrap --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-link-serialization=2 --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-defaulted --enable-offload-targets=nvptx-none=/build/gcc-13-XYspKM/gcc-13-13.2.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-13-XYspKM/gcc-13-13.2.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-build-config=bootstrap-lto-lean --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v Processor Details- Scaling Governor: intel_cpufreq performance - CPU Microcode: 0x2c000290Python Details- Python 3.11.6Security Details- Linux 6.8: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Not affected - Linux 6.9-rc2: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + reg_file_data_sampling: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Not affected

Xeon Max Linux 6.9 Kernel Benchmarkshackbench: 32 - Processstress-ng: Pthreadopenvino: Age Gender Recognition Retail 0013 FP16 - CPUffmpeg: libx265 - Platformtensorflow: CPU - 1 - AlexNetonnx: Faster R-CNN R-50-FPN-int8 - CPU - Standardonnx: T5 Encoder - CPU - Parallelstress-ng: SENDFILEonnx: CaffeNet 12-int8 - CPU - Standardtensorflow: CPU - 64 - AlexNettensorflow: CPU - 64 - GoogLeNetopenvino: Vehicle Detection FP16 - CPUopenvino: Vehicle Detection FP16 - CPUstress-ng: System V Message Passingwebp2: Quality 75, Compression Effort 7stress-ng: Context Switchingopenvino: Person Detection FP32 - CPUopenvino: Person Detection FP32 - CPUonnx: ArcFace ResNet-100 - CPU - Paralleloidn: RT.ldr_alb_nrm.3840x2160 - CPU-Onlystress-ng: MMAPopenvino: Weld Porosity Detection FP16-INT8 - CPUjpegxl: JPEG - 90onnx: super-resolution-10 - CPU - Standardopenvino: Weld Porosity Detection FP16-INT8 - CPUstress-ng: Socket Activityonnx: GPT-2 - CPU - Parallelopenssl: SHA256ospray: gravity_spheres_volume/dim_512/pathtracer/real_timestress-ng: IO_uringopenvino: Person Detection FP16 - CPUllama-cpp: llama-2-13b.Q4_0.ggufopenvino: Person Detection FP16 - CPUblender: Fishy Cat - CPU-Onlyopenvino: Road Segmentation ADAS FP16 - CPUopenvino: Road Segmentation ADAS FP16 - CPUospray-studio: 3 - 1080p - 32 - Path Tracer - CPUstress-ng: Semaphoresospray: gravity_spheres_volume/dim_512/scivis/real_timewebp2: Quality 95, Compression Effort 7ospray: particle_volume/ao/real_timetensorflow: CPU - 16 - ResNet-50openssl: RSA4096jpegxl: PNG - 90stress-ng: Cryptollama-cpp: llama-2-70b-chat.Q5_0.ggufgromacs: MPI CPU - water_GMX50_barevvenc: Bosphorus 1080p - Fasterhackbench: 16 - Threadospray-studio: 3 - 4K - 1 - Path Tracer - CPUllamafile: wizardcoder-python-34b-v1.0.Q6_K - CPUospray-studio: 1 - 1080p - 1 - Path Tracer - CPUrocksdb: Read Rand Write Randospray-studio: 2 - 1080p - 1 - Path Tracer - CPUstress-ng: Zlibstress-ng: Memory Copyingoidn: RT.hdr_alb_nrm.3840x2160 - CPU-Onlyonednn: Convolution Batch Shapes Auto - CPUbrl-cad: VGR Performance Metricospray-studio: 3 - 4K - 16 - Path Tracer - CPUblender: Junkshop - CPU-Onlyospray-studio: 3 - 1080p - 16 - Path Tracer - CPUbuild-linux-kernel: defconfigxmrig: Monero - 1Mopenvino: Handwritten English Recognition FP16-INT8 - CPUtensorflow: CPU - 64 - ResNet-50openvino: Handwritten English Recognition FP16-INT8 - CPUoidn: RTLightmap.hdr.4096x4096 - CPU-Onlyhackbench: 16 - Processospray: gravity_spheres_volume/dim_512/ao/real_timesvt-av1: Preset 4 - Bosphorus 4Kllamafile: mistral-7b-instruct-v0.2.Q8_0 - CPUjpegxl: PNG - 80primesieve: 1e12onednn: Deconvolution Batch shapes_1d - CPUonnx: bertsquad-12 - CPU - Parallelopenvino: Face Detection FP16 - CPUospray-studio: 3 - 4K - 32 - Path Tracer - CPUopenvino: Age Gender Recognition Retail 0013 FP16-INT8 - CPUopenvino: Face Detection FP16 - CPUonnx: yolov4 - CPU - Paralleltensorflow: CPU - 256 - AlexNetospray-studio: 1 - 4K - 16 - Path Tracer - CPUstress-ng: Mutexospray-studio: 1 - 1080p - 16 - Path Tracer - CPUstress-ng: Pollvvenc: Bosphorus 1080p - Fastquicksilver: CORAL2 P1svt-av1: Preset 4 - Bosphorus 1080pv-ray: CPUbuild-linux-kernel: allmodconfigopenvino: Weld Porosity Detection FP16 - CPUcompress-lz4: 9 - Decompression Speedstress-ng: Vector Shuffletensorflow: CPU - 32 - GoogLeNetffmpeg: libx265 - Video On Demandtensorflow: CPU - 32 - ResNet-50tensorflow: CPU - 16 - AlexNetopenvino: Weld Porosity Detection FP16 - CPUdraco: Lionopenvino: Noise Suppression Poconet-Like FP16 - CPUspeedb: Rand Readtensorflow: CPU - 32 - AlexNetjpegxl-decode: Allwebp2: Quality 100, Compression Effort 5ospray-studio: 2 - 4K - 1 - Path Tracer - CPUspeedb: Rand Fillonnx: Faster R-CNN R-50-FPN-int8 - CPU - Parallelstress-ng: NUMArocksdb: Overwriteonnx: ResNet50 v1-12-int8 - CPU - Parallelopenssl: SHA512blender: BMW27 - CPU-Onlyonednn: IP Shapes 3D - CPUcachebench: Writeblender: Pabellon Barcelona - CPU-Onlyspeedb: Rand Fill Syncspeedb: Seq Fillcompress-lz4: 1 - Decompression Speedstress-ng: Hashospray: particle_volume/scivis/real_timestress-ng: CPU Stressvvenc: Bosphorus 4K - Fastonednn: Recurrent Neural Network Inference - CPUxmrig: KawPow - 1Mopenvino: Person Re-Identification Retail FP16 - CPUopenvino: Person Re-Identification Retail FP16 - CPUtensorflow: CPU - 256 - GoogLeNettensorflow: CPU - 256 - ResNet-50onnx: super-resolution-10 - CPU - Parallelstress-ng: Wide Vector Mathstress-ng: Mixed Schedulerspeedb: Read Rand Write Randopenvino: Handwritten English Recognition FP16 - CPUopenvino: Handwritten English Recognition FP16 - CPUopenvino: Person Vehicle Bike Detection FP16 - CPUrocksdb: Update Randcompress-lz4: 3 - Decompression Speedopenvino: Noise Suppression Poconet-Like FP16 - CPUospray-studio: 1 - 1080p - 32 - Path Tracer - CPUstress-ng: Glibc Qsort Data Sortingspeedb: Update Randopenvino: Face Detection Retail FP16-INT8 - CPUcachebench: Read / Modify / Writeprimesieve: 1e13openvino: Face Detection Retail FP16-INT8 - CPUopenvino: Person Vehicle Bike Detection FP16 - CPUffmpeg: libx264 - Liveospray-studio: 1 - 4K - 32 - Path Tracer - CPUffmpeg: libx265 - Uploadopenvino: Face Detection Retail FP16 - CPUopenvino: Face Detection Retail FP16 - CPUrocksdb: Rand Readopenvino: Road Segmentation ADAS FP16-INT8 - CPUospray-studio: 2 - 4K - 16 - Path Tracer - CPUblender: Classroom - CPU-Onlyonnx: CaffeNet 12-int8 - CPU - Parallelopenvino: Road Segmentation ADAS FP16-INT8 - CPUopenvino: Vehicle Detection FP16-INT8 - CPUopenvino: Machine Translation EN To DE FP16 - CPUopenvino: Vehicle Detection FP16-INT8 - CPUopenvino: Machine Translation EN To DE FP16 - CPUonednn: IP Shapes 1D - CPUxmrig: Wownero - 1Mjpegxl: PNG - 100draco: Church Facadequicksilver: CORAL2 P2ospray-studio: 3 - 1080p - 1 - Path Tracer - CPUopenvino: Face Detection FP16-INT8 - CPUjpegxl: JPEG - 100compress-lz4: 9 - Compression Speedopenvino: Face Detection FP16-INT8 - CPUopenssl: RSA4096stress-ng: AVL Treeencode-wavpack: WAV To WavPackffmpeg: libx264 - Video On Demandxmrig: GhostRider - 1Mxmrig: CryptoNight-Heavy - 1Mffmpeg: libx264 - Uploadxmrig: CryptoNight-Femto UPX2 - 1Mcompress-lz4: 1 - Compression Speedcachebench: Readospray-studio: 2 - 4K - 32 - Path Tracer - CPUffmpeg: libx264 - Platformcompress-lz4: 3 - Compression Speedopenvino: Age Gender Recognition Retail 0013 FP16-INT8 - CPUmysqlslap: 512webp2: Quality 100, Lossless Compressiononnx: Faster R-CNN R-50-FPN-int8 - CPU - Standardonnx: Faster R-CNN R-50-FPN-int8 - CPU - Parallelonnx: super-resolution-10 - CPU - Standardonnx: super-resolution-10 - CPU - Parallelonnx: ResNet50 v1-12-int8 - CPU - Standardonnx: ResNet50 v1-12-int8 - CPU - Standardonnx: ResNet50 v1-12-int8 - CPU - Parallelonnx: ArcFace ResNet-100 - CPU - Standardonnx: ArcFace ResNet-100 - CPU - Standardonnx: ArcFace ResNet-100 - CPU - Parallelonnx: fcn-resnet101-11 - CPU - Standardonnx: fcn-resnet101-11 - CPU - Standardonnx: fcn-resnet101-11 - CPU - Parallelonnx: fcn-resnet101-11 - CPU - Parallelonnx: CaffeNet 12-int8 - CPU - Standardonnx: CaffeNet 12-int8 - CPU - Parallelonnx: bertsquad-12 - CPU - Standardonnx: bertsquad-12 - CPU - Standardonnx: bertsquad-12 - CPU - Parallelonnx: T5 Encoder - CPU - Standardonnx: T5 Encoder - CPU - Standardonnx: T5 Encoder - CPU - Parallelonnx: yolov4 - CPU - Standardonnx: yolov4 - CPU - Standardonnx: yolov4 - CPU - Parallelonnx: GPT-2 - CPU - Parallelopenvino: Age Gender Recognition Retail 0013 FP16 - CPUblender: Barbershop - CPU-Onlystress-ng: Glibc C String Functionsstress-ng: Vector Floating Pointstress-ng: Fused Multiply-Addstress-ng: Matrix 3D Mathstress-ng: Floating Pointstress-ng: Matrix Mathstress-ng: Mallocstress-ng: MEMFDstress-ng: Pipetensorflow: CPU - 16 - GoogLeNettensorflow: CPU - 1 - ResNet-50tensorflow: CPU - 1 - GoogLeNetmysqlslap: 1024ospray-studio: 2 - 1080p - 32 - Path Tracer - CPUospray-studio: 2 - 1080p - 16 - Path Tracer - CPUospray-studio: 1 - 4K - 1 - Path Tracer - CPUonednn: Recurrent Neural Network Training - CPUonednn: Deconvolution Batch shapes_3d - CPUy-cruncher: 500My-cruncher: 1Bbuild-mesa: Time To Compilebuild-ffmpeg: Time To Compilestockfish: Chess Benchmarkospray: particle_volume/pathtracer/real_timevvenc: Bosphorus 4K - Fastersvt-av1: Preset 13 - Bosphorus 4Ksvt-av1: Preset 12 - Bosphorus 4Ksvt-av1: Preset 8 - Bosphorus 4Kembree: Pathtracer ISPC - Asian Dragon Objembree: Pathtracer ISPC - Asian Dragonembree: Pathtracer - Asian Dragon Objembree: Pathtracer - Asian Dragonembree: Pathtracer ISPC - Crownembree: Pathtracer - Crownsrsran: PDSCH Processor Benchmark, Throughput Totalwebp2: Defaultjpegxl: JPEG - 80ffmpeg: libx265 - LiveLinux 6.8Linux 6.9-rc224.74839599.2667789.2542.7417.2332.4503185.2941798203.12541.827495.72135.182530.0414.5817859304.380.6420343491.52445.9082.8716.78322.326169.364.0532.562205.41426732.8847927.75101.9018467842066724.28053468957.59451.131.4881.9038.0936.281018.4717204154589461.1910.504120.3429.733624.121358616.430.969143967.240.3612.08533.98614.67921080.7946621208445019670.3721085.102.289.0062139068394065745.60873238.46232361.229.6147.033777.561.0613.11210.702125.8654.5032.4773.35618.337710.7817119.9272172121702.12307.747.91321723.163441228490133.28690910389186.0215.913681466718.66259852307.5026.853537.0576905.9296.3144.8035.30213.3516147.57612923.68380419389346.10386.2328.35186132649923.4276482.6238801094.24872994073574021.824.7985393036.30241576.202574463276373601.017071694.5229.2815202073.084.902748.49532860.811638.519.59202.3770.10152.6355874353.6370407.96118175830.853626.416336.783598253364.84621.32138671866.582921807.1799112.69926039.61915532.5417.52181.516136322.3111260.989.9236049851877.343531753.98292.1731446.425067.4054.9822.06671.664.5005536096.625.66677476677333569337.2126.00232.61331.2338204.6810.196.34942.949592.332856.311.5033002.2602.6913344.6996206351442.7698.430.38860.0730.820942.68334.881816.550119.01538111.570610.609842.781923.461359.6021231.2844.43649747.0841.359941.848073.4235770.956614.265692.74672.89501353.5735.41191122.2368.22351126.3849.805140.78271.9980643523.24234669.74204365411.5931442.6929600.02384748.54163551396.40688.2630377557.9758.501.886.053414836740218014821.326.165766.48313.41619.51117.24561999717102.95019.847123.246127.20248.94336.435931.595739.817735.403338.835036.601117006.85.9034.604112.4327.99435919.6473754.7440.2018.2834.3512196.0761900682.08571.190471.88128.712656.4213.8918740350.560.6119390362.90467.7979.0017.56232.226427.333.8933.888213.73727790.2446123.32105.78278167828417625.17123346567.80466.451.5379.2339.3735.141051.3016687150005776.4710.82360.3328.875424.801396904.030.128147978.330.3711.76433.09414.29821640.7747820685884899446.0720605.392.238.8104339918023979446.56855237.69833015.530.2047.963704.381.0413.35710.50905.7604.5833.0453.29918.027510.6006121.9373367119735.57302.778.04142711.743495328934422.16680410232390.4116.152691666718.93458995311.7456.763492.0569593.0097.5344.2434.86210.7116349.05605423.97375837479341.97381.6578.45183932281623.1727487.6039196895.14412966549905322.024.8424593862.76331175.562596033301673628.017199190.0929.0693200671.704.936753.36433072.511564.789.65203.6370.53153.5645908316.0370036.20117556231.013608.216306.423615023349.64600.95138071858.702934147.1498711.07694739.46115589.5917.58182.126116222.2411295.929.8936158608377.573542253.82293.0291442.215052.7154.8322.12673.464.5116636180.725.60777626689667570337.7825.96032.66330.7338147.4808.996.34042.889602.732826.111.5132993.8602.5413341.4673256352942.7798.410.38860.0729.110743.15114.678116.511278.23121122.60110.511941.504824.232856.9478184.7855.41259668.6991.503001.749733.4097265.996015.411094.33302.48234402.6695.10755112.4288.90936124.3769.464960.71279.7485035507.55230503.34200468629.3231460.4229139.60392750.09161652700.09688.7629814480.6758.831.905.9836154157506177410195.755.782026.20213.33519.88817.2836444309998.86909.524123.098126.18748.56837.433532.829736.503035.650735.734835.078816877.65.6534.187113.99OpenBenchmarking.org

Hackbench

Count: 32 - Type: Process

OpenBenchmarking.orgSeconds, Fewer Is BetterHackbenchCount: 32 - Type: ProcessLinux 6.8Linux 6.9-rc2714212835SE +/- 0.27, N = 3SE +/- 0.39, N = 324.7527.991. (CC) gcc options: -lpthread

Stress-NG

Test: Pthread

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: PthreadLinux 6.8Linux 6.9-rc28K16K24K32K40KSE +/- 49.70, N = 3SE +/- 450.35, N = 1539599.2635919.641. (CXX) g++ options: -lm -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lpthread -lrt -lsctp -lz

OpenVINO

Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Age Gender Recognition Retail 0013 FP16 - Device: CPULinux 6.9-rc2Linux 6.816K32K48K64K80KSE +/- 1055.18, N = 3SE +/- 711.41, N = 1573754.7467789.251. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

FFmpeg

Encoder: libx265 - Scenario: Platform

OpenBenchmarking.orgFPS, More Is BetterFFmpeg 6.1Encoder: libx265 - Scenario: PlatformLinux 6.8Linux 6.9-rc21020304050SE +/- 0.71, N = 12SE +/- 0.46, N = 1242.7440.201. (CXX) g++ options: -O3 -rdynamic -lpthread -lrt -ldl -lnuma

TensorFlow

Device: CPU - Batch Size: 1 - Model: AlexNet

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.16.1Device: CPU - Batch Size: 1 - Model: AlexNetLinux 6.9-rc2Linux 6.848121620SE +/- 0.25, N = 3SE +/- 0.25, N = 1218.2817.23

ONNX Runtime

Model: Faster R-CNN R-50-FPN-int8 - Device: CPU - Executor: Standard

OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.17Model: Faster R-CNN R-50-FPN-int8 - Device: CPU - Executor: StandardLinux 6.9-rc2Linux 6.8816243240SE +/- 0.25, N = 3SE +/- 0.40, N = 334.3532.451. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

ONNX Runtime

Model: T5 Encoder - Device: CPU - Executor: Parallel

OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.17Model: T5 Encoder - Device: CPU - Executor: ParallelLinux 6.9-rc2Linux 6.84080120160200SE +/- 2.39, N = 14SE +/- 3.10, N = 12196.08185.291. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

Stress-NG

Test: SENDFILE

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: SENDFILELinux 6.9-rc2Linux 6.8400K800K1200K1600K2000KSE +/- 5873.31, N = 3SE +/- 609.53, N = 31900682.081798203.121. (CXX) g++ options: -lm -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lpthread -lrt -lsctp -lz

ONNX Runtime

Model: CaffeNet 12-int8 - Device: CPU - Executor: Standard

OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.17Model: CaffeNet 12-int8 - Device: CPU - Executor: StandardLinux 6.9-rc2Linux 6.8120240360480600SE +/- 5.63, N = 3SE +/- 6.47, N = 15571.19541.831. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

TensorFlow

Device: CPU - Batch Size: 64 - Model: AlexNet

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.16.1Device: CPU - Batch Size: 64 - Model: AlexNetLinux 6.8Linux 6.9-rc2110220330440550SE +/- 6.05, N = 3SE +/- 5.17, N = 15495.72471.88

TensorFlow

Device: CPU - Batch Size: 64 - Model: GoogLeNet

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.16.1Device: CPU - Batch Size: 64 - Model: GoogLeNetLinux 6.8Linux 6.9-rc2306090120150SE +/- 0.94, N = 3SE +/- 1.70, N = 15135.18128.71

OpenVINO

Model: Vehicle Detection FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Vehicle Detection FP16 - Device: CPULinux 6.9-rc2Linux 6.86001200180024003000SE +/- 25.96, N = 3SE +/- 16.72, N = 32656.422530.041. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Vehicle Detection FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Vehicle Detection FP16 - Device: CPULinux 6.9-rc2Linux 6.848121620SE +/- 0.14, N = 3SE +/- 0.10, N = 313.8914.58MIN: 9.12 / MAX: 90.57MIN: 9.5 / MAX: 109.831. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

Stress-NG

Test: System V Message Passing

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: System V Message PassingLinux 6.9-rc2Linux 6.84M8M12M16M20MSE +/- 35075.39, N = 3SE +/- 189741.33, N = 1518740350.5617859304.381. (CXX) g++ options: -lm -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lpthread -lrt -lsctp -lz

WebP2 Image Encode

Encode Settings: Quality 75, Compression Effort 7

OpenBenchmarking.orgMP/s, More Is BetterWebP2 Image Encode 20220823Encode Settings: Quality 75, Compression Effort 7Linux 6.8Linux 6.9-rc20.1440.2880.4320.5760.72SE +/- 0.01, N = 3SE +/- 0.01, N = 40.640.611. (CXX) g++ options: -msse4.2 -fno-rtti -O3 -ldl

Stress-NG

Test: Context Switching

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Context SwitchingLinux 6.8Linux 6.9-rc24M8M12M16M20MSE +/- 178479.09, N = 8SE +/- 265846.30, N = 320343491.5219390362.901. (CXX) g++ options: -lm -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lpthread -lrt -lsctp -lz

OpenVINO

Model: Person Detection FP32 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Person Detection FP32 - Device: CPULinux 6.9-rc2Linux 6.8100200300400500SE +/- 3.72, N = 3SE +/- 3.09, N = 3467.79445.901. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Person Detection FP32 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Person Detection FP32 - Device: CPULinux 6.9-rc2Linux 6.820406080100SE +/- 0.62, N = 3SE +/- 0.57, N = 379.0082.87MIN: 49.24 / MAX: 319.95MIN: 51.69 / MAX: 529.561. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

ONNX Runtime

Model: ArcFace ResNet-100 - Device: CPU - Executor: Parallel

OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.17Model: ArcFace ResNet-100 - Device: CPU - Executor: ParallelLinux 6.9-rc2Linux 6.848121620SE +/- 0.17, N = 3SE +/- 0.23, N = 317.5616.781. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

Intel Open Image Denoise

Run: RT.ldr_alb_nrm.3840x2160 - Device: CPU-Only

OpenBenchmarking.orgImages / Sec, More Is BetterIntel Open Image Denoise 2.2Run: RT.ldr_alb_nrm.3840x2160 - Device: CPU-OnlyLinux 6.8Linux 6.9-rc20.5221.0441.5662.0882.61SE +/- 0.03, N = 3SE +/- 0.03, N = 32.322.22

Stress-NG

Test: MMAP

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: MMAPLinux 6.9-rc2Linux 6.814002800420056007000SE +/- 66.09, N = 15SE +/- 70.88, N = 146427.336169.361. (CXX) g++ options: -lm -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lpthread -lrt -lsctp -lz

OpenVINO

Model: Weld Porosity Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Weld Porosity Detection FP16-INT8 - Device: CPULinux 6.9-rc2Linux 6.80.91131.82262.73393.64524.5565SE +/- 0.01, N = 3SE +/- 0.05, N = 43.894.05MIN: 2.64 / MAX: 47.09MIN: 2.67 / MAX: 52.431. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

JPEG-XL libjxl

Input: JPEG - Quality: 90

OpenBenchmarking.orgMP/s, More Is BetterJPEG-XL libjxl 0.10.1Input: JPEG - Quality: 90Linux 6.9-rc2Linux 6.8816243240SE +/- 0.38, N = 15SE +/- 0.37, N = 333.8932.561. (CXX) g++ options: -fno-rtti -O3 -fPIE -pie -lm

ONNX Runtime

Model: super-resolution-10 - Device: CPU - Executor: Standard

OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.17Model: super-resolution-10 - Device: CPU - Executor: StandardLinux 6.9-rc2Linux 6.850100150200250SE +/- 0.80, N = 3SE +/- 2.99, N = 15213.74205.411. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

OpenVINO

Model: Weld Porosity Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Weld Porosity Detection FP16-INT8 - Device: CPULinux 6.9-rc2Linux 6.86K12K18K24K30KSE +/- 155.42, N = 3SE +/- 285.82, N = 427790.2426732.881. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

Stress-NG

Test: Socket Activity

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Socket ActivityLinux 6.8Linux 6.9-rc210K20K30K40K50KSE +/- 79.93, N = 3SE +/- 21.40, N = 347927.7546123.321. (CXX) g++ options: -lm -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lpthread -lrt -lsctp -lz

ONNX Runtime

Model: GPT-2 - Device: CPU - Executor: Parallel

OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.17Model: GPT-2 - Device: CPU - Executor: ParallelLinux 6.9-rc2Linux 6.820406080100SE +/- 1.34, N = 15SE +/- 1.16, N = 3105.78101.901. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

OpenSSL

Algorithm: SHA256

OpenBenchmarking.orgbyte/s, More Is BetterOpenSSLAlgorithm: SHA256Linux 6.8Linux 6.9-rc220000M40000M60000M80000M100000MSE +/- 767626108.54, N = 3SE +/- 717052715.91, N = 1284678420667816782841761. OpenSSL 3.0.10 1 Aug 2023 (Library: OpenSSL 3.0.10 1 Aug 2023)

OSPRay

Benchmark: gravity_spheres_volume/dim_512/pathtracer/real_time

OpenBenchmarking.orgItems Per Second, More Is BetterOSPRay 3.1Benchmark: gravity_spheres_volume/dim_512/pathtracer/real_timeLinux 6.9-rc2Linux 6.8612182430SE +/- 0.20, N = 3SE +/- 0.41, N = 1225.1724.28

Stress-NG

Test: IO_uring

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: IO_uringLinux 6.8Linux 6.9-rc2700K1400K2100K2800K3500KSE +/- 31595.27, N = 3SE +/- 43339.28, N = 153468957.593346567.801. (CXX) g++ options: -lm -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lpthread -lrt -lsctp -lz

OpenVINO

Model: Person Detection FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Person Detection FP16 - Device: CPULinux 6.9-rc2Linux 6.8100200300400500SE +/- 1.20, N = 3SE +/- 2.33, N = 3466.45451.131. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

Llama.cpp

Model: llama-2-13b.Q4_0.gguf

OpenBenchmarking.orgTokens Per Second, More Is BetterLlama.cpp b1808Model: llama-2-13b.Q4_0.ggufLinux 6.9-rc2Linux 6.80.34430.68861.03291.37721.7215SE +/- 0.02, N = 3SE +/- 0.01, N = 31.531.481. (CXX) g++ options: -std=c++11 -fPIC -O3 -pthread -march=native -mtune=native -lopenblas

OpenVINO

Model: Person Detection FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Person Detection FP16 - Device: CPULinux 6.9-rc2Linux 6.820406080100SE +/- 0.20, N = 3SE +/- 0.43, N = 379.2381.90MIN: 50.1 / MAX: 290.06MIN: 49.43 / MAX: 345.351. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

Blender

Blend File: Fishy Cat - Compute: CPU-Only

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 4.1Blend File: Fishy Cat - Compute: CPU-OnlyLinux 6.8Linux 6.9-rc2918273645SE +/- 0.38, N = 15SE +/- 0.44, N = 438.0939.37

OpenVINO

Model: Road Segmentation ADAS FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Road Segmentation ADAS FP16 - Device: CPULinux 6.9-rc2Linux 6.8816243240SE +/- 0.23, N = 3SE +/- 0.35, N = 335.1436.28MIN: 25.25 / MAX: 437.27MIN: 24.78 / MAX: 205.051. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Road Segmentation ADAS FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Road Segmentation ADAS FP16 - Device: CPULinux 6.9-rc2Linux 6.82004006008001000SE +/- 6.69, N = 3SE +/- 9.82, N = 31051.301018.471. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OSPRay Studio

Camera: 3 - Resolution: 1080p - Samples Per Pixel: 32 - Renderer: Path Tracer - Acceleration: CPU

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 1.0Camera: 3 - Resolution: 1080p - Samples Per Pixel: 32 - Renderer: Path Tracer - Acceleration: CPULinux 6.9-rc2Linux 6.84K8K12K16K20KSE +/- 156.23, N = 6SE +/- 101.18, N = 31668717204

Stress-NG

Test: Semaphores

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: SemaphoresLinux 6.8Linux 6.9-rc230M60M90M120M150MSE +/- 1498916.25, N = 3SE +/- 1330349.25, N = 3154589461.19150005776.471. (CXX) g++ options: -lm -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lpthread -lrt -lsctp -lz

OSPRay

Benchmark: gravity_spheres_volume/dim_512/scivis/real_time

OpenBenchmarking.orgItems Per Second, More Is BetterOSPRay 3.1Benchmark: gravity_spheres_volume/dim_512/scivis/real_timeLinux 6.9-rc2Linux 6.83691215SE +/- 0.07, N = 3SE +/- 0.08, N = 1510.8210.50

WebP2 Image Encode

Encode Settings: Quality 95, Compression Effort 7

OpenBenchmarking.orgMP/s, More Is BetterWebP2 Image Encode 20220823Encode Settings: Quality 95, Compression Effort 7Linux 6.8Linux 6.9-rc20.07650.1530.22950.3060.3825SE +/- 0.00, N = 3SE +/- 0.00, N = 30.340.331. (CXX) g++ options: -msse4.2 -fno-rtti -O3 -ldl

OSPRay

Benchmark: particle_volume/ao/real_time

OpenBenchmarking.orgItems Per Second, More Is BetterOSPRay 3.1Benchmark: particle_volume/ao/real_timeLinux 6.8Linux 6.9-rc2714212835SE +/- 0.11, N = 3SE +/- 0.19, N = 329.7328.88

TensorFlow

Device: CPU - Batch Size: 16 - Model: ResNet-50

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.16.1Device: CPU - Batch Size: 16 - Model: ResNet-50Linux 6.9-rc2Linux 6.8612182430SE +/- 0.28, N = 15SE +/- 0.30, N = 324.8024.12

OpenSSL

Algorithm: RSA4096

OpenBenchmarking.orgverify/s, More Is BetterOpenSSLAlgorithm: RSA4096Linux 6.9-rc2Linux 6.8300K600K900K1200K1500KSE +/- 833.27, N = 3SE +/- 19064.62, N = 31396904.01358616.41. OpenSSL 3.0.10 1 Aug 2023 (Library: OpenSSL 3.0.10 1 Aug 2023)

JPEG-XL libjxl

Input: PNG - Quality: 90

OpenBenchmarking.orgMP/s, More Is BetterJPEG-XL libjxl 0.10.1Input: PNG - Quality: 90Linux 6.8Linux 6.9-rc2714212835SE +/- 0.28, N = 3SE +/- 0.18, N = 330.9730.131. (CXX) g++ options: -fno-rtti -O3 -fPIE -pie -lm

Stress-NG

Test: Crypto

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: CryptoLinux 6.9-rc2Linux 6.830K60K90K120K150KSE +/- 2039.96, N = 15SE +/- 1720.03, N = 15147978.33143967.241. (CXX) g++ options: -lm -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lpthread -lrt -lsctp -lz

Llama.cpp

Model: llama-2-70b-chat.Q5_0.gguf

OpenBenchmarking.orgTokens Per Second, More Is BetterLlama.cpp b1808Model: llama-2-70b-chat.Q5_0.ggufLinux 6.9-rc2Linux 6.80.08330.16660.24990.33320.4165SE +/- 0.00, N = 3SE +/- 0.00, N = 30.370.361. (CXX) g++ options: -std=c++11 -fPIC -O3 -pthread -march=native -mtune=native -lopenblas

GROMACS

Implementation: MPI CPU - Input: water_GMX50_bare

OpenBenchmarking.orgNs Per Day, More Is BetterGROMACS 2024Implementation: MPI CPU - Input: water_GMX50_bareLinux 6.8Linux 6.9-rc23691215SE +/- 0.06, N = 3SE +/- 0.08, N = 312.0911.761. (CXX) g++ options: -O3 -lm

VVenC

Video Input: Bosphorus 1080p - Video Preset: Faster

OpenBenchmarking.orgFrames Per Second, More Is BetterVVenC 1.11Video Input: Bosphorus 1080p - Video Preset: FasterLinux 6.8Linux 6.9-rc2816243240SE +/- 0.29, N = 15SE +/- 0.36, N = 1533.9933.091. (CXX) g++ options: -O3 -flto=auto -fno-fat-lto-objects

Hackbench

Count: 16 - Type: Thread

OpenBenchmarking.orgSeconds, Fewer Is BetterHackbenchCount: 16 - Type: ThreadLinux 6.9-rc2Linux 6.848121620SE +/- 0.14, N = 15SE +/- 0.00, N = 314.3014.681. (CC) gcc options: -lpthread

OSPRay Studio

Camera: 3 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path Tracer - Acceleration: CPU

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 1.0Camera: 3 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path Tracer - Acceleration: CPULinux 6.8Linux 6.9-rc25001000150020002500SE +/- 21.99, N = 4SE +/- 26.16, N = 1321082164

Llamafile

Test: wizardcoder-python-34b-v1.0.Q6_K - Acceleration: CPU

OpenBenchmarking.orgTokens Per Second, More Is BetterLlamafile 0.6Test: wizardcoder-python-34b-v1.0.Q6_K - Acceleration: CPULinux 6.8Linux 6.9-rc20.17780.35560.53340.71120.889SE +/- 0.01, N = 4SE +/- 0.00, N = 30.790.77

OSPRay Studio

Camera: 1 - Resolution: 1080p - Samples Per Pixel: 1 - Renderer: Path Tracer - Acceleration: CPU

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 1.0Camera: 1 - Resolution: 1080p - Samples Per Pixel: 1 - Renderer: Path Tracer - Acceleration: CPULinux 6.8Linux 6.9-rc2100200300400500SE +/- 3.71, N = 3SE +/- 2.33, N = 3466478

RocksDB

Test: Read Random Write Random

OpenBenchmarking.orgOp/s, More Is BetterRocksDB 9.0Test: Read Random Write RandomLinux 6.8Linux 6.9-rc2500K1000K1500K2000K2500KSE +/- 17412.72, N = 3SE +/- 22543.45, N = 5212084420685881. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti -lpthread

OSPRay Studio

Camera: 2 - Resolution: 1080p - Samples Per Pixel: 1 - Renderer: Path Tracer - Acceleration: CPU

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 1.0Camera: 2 - Resolution: 1080p - Samples Per Pixel: 1 - Renderer: Path Tracer - Acceleration: CPULinux 6.9-rc2Linux 6.8110220330440550SE +/- 2.33, N = 3SE +/- 5.26, N = 5489501

Stress-NG

Test: Zlib

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: ZlibLinux 6.8Linux 6.9-rc22K4K6K8K10KSE +/- 25.13, N = 3SE +/- 124.93, N = 39670.379446.071. (CXX) g++ options: -lm -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lpthread -lrt -lsctp -lz

Stress-NG

Test: Memory Copying

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Memory CopyingLinux 6.8Linux 6.9-rc25K10K15K20K25KSE +/- 178.25, N = 3SE +/- 155.03, N = 1021085.1020605.391. (CXX) g++ options: -lm -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lpthread -lrt -lsctp -lz

Intel Open Image Denoise

Run: RT.hdr_alb_nrm.3840x2160 - Device: CPU-Only

OpenBenchmarking.orgImages / Sec, More Is BetterIntel Open Image Denoise 2.2Run: RT.hdr_alb_nrm.3840x2160 - Device: CPU-OnlyLinux 6.8Linux 6.9-rc20.5131.0261.5392.0522.565SE +/- 0.02, N = 15SE +/- 0.02, N = 152.282.23

oneDNN

Harness: Convolution Batch Shapes Auto - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.4Harness: Convolution Batch Shapes Auto - Engine: CPULinux 6.9-rc2Linux 6.83691215SE +/- 0.09863, N = 15SE +/- 0.03328, N = 38.810439.00621MIN: 6.25MIN: 8.121. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread

BRL-CAD

VGR Performance Metric

OpenBenchmarking.orgVGR Performance Metric, More Is BetterBRL-CAD 7.38.2VGR Performance MetricLinux 6.9-rc2Linux 6.8900K1800K2700K3600K4500K399180239068391. (CXX) g++ options: -std=c++17 -pipe -fvisibility=hidden -fno-strict-aliasing -fno-common -fexceptions -ftemplate-depth-128 -m64 -ggdb3 -O3 -fipa-pta -fstrength-reduce -finline-functions -flto -ltcl8.6 -lnetpbm -lregex_brl -lz_brl -lassimp -ldl -lm -ltk8.6

OSPRay Studio

Camera: 3 - Resolution: 4K - Samples Per Pixel: 16 - Renderer: Path Tracer - Acceleration: CPU

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 1.0Camera: 3 - Resolution: 4K - Samples Per Pixel: 16 - Renderer: Path Tracer - Acceleration: CPULinux 6.9-rc2Linux 6.89K18K27K36K45KSE +/- 252.89, N = 3SE +/- 626.71, N = 123979440657

Blender

Blend File: Junkshop - Compute: CPU-Only

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 4.1Blend File: Junkshop - Compute: CPU-OnlyLinux 6.8Linux 6.9-rc21122334455SE +/- 0.47, N = 15SE +/- 0.40, N = 1545.6046.56

OSPRay Studio

Camera: 3 - Resolution: 1080p - Samples Per Pixel: 16 - Renderer: Path Tracer - Acceleration: CPU

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 1.0Camera: 3 - Resolution: 1080p - Samples Per Pixel: 16 - Renderer: Path Tracer - Acceleration: CPULinux 6.9-rc2Linux 6.82K4K6K8K10KSE +/- 26.21, N = 3SE +/- 70.21, N = 385528732

Timed Linux Kernel Compilation

Build: defconfig

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed Linux Kernel Compilation 6.8Build: defconfigLinux 6.9-rc2Linux 6.8918273645SE +/- 0.37, N = 6SE +/- 0.36, N = 637.7038.46

Xmrig

Variant: Monero - Hash Count: 1M

OpenBenchmarking.orgH/s, More Is BetterXmrig 6.21Variant: Monero - Hash Count: 1MLinux 6.9-rc2Linux 6.87K14K21K28K35KSE +/- 181.84, N = 3SE +/- 320.50, N = 1333015.532361.21. (CXX) g++ options: -fexceptions -fno-rtti -maes -O3 -Ofast -static-libgcc -static-libstdc++ -rdynamic -lssl -lcrypto -luv -lpthread -lrt -ldl -lhwloc

OpenVINO

Model: Handwritten English Recognition FP16-INT8 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Handwritten English Recognition FP16-INT8 - Device: CPULinux 6.8Linux 6.9-rc2714212835SE +/- 0.08, N = 3SE +/- 0.07, N = 329.6130.20MIN: 25.51 / MAX: 92.13MIN: 22.08 / MAX: 107.871. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

TensorFlow

Device: CPU - Batch Size: 64 - Model: ResNet-50

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.16.1Device: CPU - Batch Size: 64 - Model: ResNet-50Linux 6.9-rc2Linux 6.81122334455SE +/- 0.42, N = 3SE +/- 0.54, N = 1247.9647.03

OpenVINO

Model: Handwritten English Recognition FP16-INT8 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Handwritten English Recognition FP16-INT8 - Device: CPULinux 6.8Linux 6.9-rc28001600240032004000SE +/- 10.67, N = 3SE +/- 8.36, N = 33777.563704.381. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

Intel Open Image Denoise

Run: RTLightmap.hdr.4096x4096 - Device: CPU-Only

OpenBenchmarking.orgImages / Sec, More Is BetterIntel Open Image Denoise 2.2Run: RTLightmap.hdr.4096x4096 - Device: CPU-OnlyLinux 6.8Linux 6.9-rc20.23850.4770.71550.9541.1925SE +/- 0.01, N = 7SE +/- 0.01, N = 151.061.04

Hackbench

Count: 16 - Type: Process

OpenBenchmarking.orgSeconds, Fewer Is BetterHackbenchCount: 16 - Type: ProcessLinux 6.8Linux 6.9-rc23691215SE +/- 0.11, N = 3SE +/- 0.19, N = 313.1113.361. (CC) gcc options: -lpthread

OSPRay

Benchmark: gravity_spheres_volume/dim_512/ao/real_time

OpenBenchmarking.orgItems Per Second, More Is BetterOSPRay 3.1Benchmark: gravity_spheres_volume/dim_512/ao/real_timeLinux 6.8Linux 6.9-rc23691215SE +/- 0.14, N = 15SE +/- 0.05, N = 310.7010.51

SVT-AV1

Encoder Mode: Preset 4 - Input: Bosphorus 4K

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 2.0Encoder Mode: Preset 4 - Input: Bosphorus 4KLinux 6.8Linux 6.9-rc21.31962.63923.95885.27846.598SE +/- 0.035, N = 3SE +/- 0.051, N = 155.8655.7601. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

Llamafile

Test: mistral-7b-instruct-v0.2.Q8_0 - Acceleration: CPU

OpenBenchmarking.orgTokens Per Second, More Is BetterLlamafile 0.6Test: mistral-7b-instruct-v0.2.Q8_0 - Acceleration: CPULinux 6.9-rc2Linux 6.81.03052.0613.09154.1225.1525SE +/- 0.03, N = 3SE +/- 0.04, N = 34.584.50

JPEG-XL libjxl

Input: PNG - Quality: 80

OpenBenchmarking.orgMP/s, More Is BetterJPEG-XL libjxl 0.10.1Input: PNG - Quality: 80Linux 6.9-rc2Linux 6.8816243240SE +/- 0.36, N = 15SE +/- 0.38, N = 333.0532.481. (CXX) g++ options: -fno-rtti -O3 -fPIE -pie -lm

Primesieve

Length: 1e12

OpenBenchmarking.orgSeconds, Fewer Is BetterPrimesieve 12.1Length: 1e12Linux 6.9-rc2Linux 6.80.75511.51022.26533.02043.7755SE +/- 0.044, N = 3SE +/- 0.024, N = 113.2993.3561. (CXX) g++ options: -O3

oneDNN

Harness: Deconvolution Batch shapes_1d - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.4Harness: Deconvolution Batch shapes_1d - Engine: CPULinux 6.9-rc2Linux 6.8510152025SE +/- 0.14, N = 3SE +/- 0.23, N = 1518.0318.34MIN: 13.29MIN: 10.091. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread

ONNX Runtime

Model: bertsquad-12 - Device: CPU - Executor: Parallel

OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.17Model: bertsquad-12 - Device: CPU - Executor: ParallelLinux 6.8Linux 6.9-rc23691215SE +/- 0.04, N = 3SE +/- 0.05, N = 310.7810.601. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

OpenVINO

Model: Face Detection FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Face Detection FP16 - Device: CPULinux 6.9-rc2Linux 6.8306090120150SE +/- 0.55, N = 3SE +/- 0.33, N = 3121.93119.921. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OSPRay Studio

Camera: 3 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path Tracer - Acceleration: CPU

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 1.0Camera: 3 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path Tracer - Acceleration: CPULinux 6.8Linux 6.9-rc216K32K48K64K80KSE +/- 506.90, N = 3SE +/- 855.02, N = 157217273367

OpenVINO

Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPULinux 6.8Linux 6.9-rc230K60K90K120K150KSE +/- 1455.69, N = 15SE +/- 1149.56, N = 15121702.12119735.571. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Face Detection FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Face Detection FP16 - Device: CPULinux 6.9-rc2Linux 6.870140210280350SE +/- 1.30, N = 3SE +/- 0.84, N = 3302.77307.74MIN: 181.55 / MAX: 894.73MIN: 183.58 / MAX: 728.141. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

ONNX Runtime

Model: yolov4 - Device: CPU - Executor: Parallel

OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.17Model: yolov4 - Device: CPU - Executor: ParallelLinux 6.9-rc2Linux 6.8246810SE +/- 0.08546, N = 3SE +/- 0.07338, N = 38.041427.913211. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

TensorFlow

Device: CPU - Batch Size: 256 - Model: AlexNet

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.16.1Device: CPU - Batch Size: 256 - Model: AlexNetLinux 6.8Linux 6.9-rc2160320480640800SE +/- 9.01, N = 3SE +/- 6.62, N = 7723.16711.74

OSPRay Studio

Camera: 1 - Resolution: 4K - Samples Per Pixel: 16 - Renderer: Path Tracer - Acceleration: CPU

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 1.0Camera: 1 - Resolution: 4K - Samples Per Pixel: 16 - Renderer: Path Tracer - Acceleration: CPULinux 6.8Linux 6.9-rc27K14K21K28K35KSE +/- 294.16, N = 3SE +/- 454.99, N = 33441234953

Stress-NG

Test: Mutex

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: MutexLinux 6.9-rc2Linux 6.86M12M18M24M30MSE +/- 294297.65, N = 3SE +/- 281178.86, N = 328934422.1628490133.281. (CXX) g++ options: -lm -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lpthread -lrt -lsctp -lz

OSPRay Studio

Camera: 1 - Resolution: 1080p - Samples Per Pixel: 16 - Renderer: Path Tracer - Acceleration: CPU

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 1.0Camera: 1 - Resolution: 1080p - Samples Per Pixel: 16 - Renderer: Path Tracer - Acceleration: CPULinux 6.9-rc2Linux 6.815003000450060007500SE +/- 15.17, N = 3SE +/- 83.68, N = 368046909

Stress-NG

Test: Poll

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: PollLinux 6.8Linux 6.9-rc22M4M6M8M10MSE +/- 37074.52, N = 3SE +/- 30731.99, N = 310389186.0210232390.411. (CXX) g++ options: -lm -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lpthread -lrt -lsctp -lz

VVenC

Video Input: Bosphorus 1080p - Video Preset: Fast

OpenBenchmarking.orgFrames Per Second, More Is BetterVVenC 1.11Video Input: Bosphorus 1080p - Video Preset: FastLinux 6.9-rc2Linux 6.848121620SE +/- 0.07, N = 3SE +/- 0.11, N = 316.1515.911. (CXX) g++ options: -O3 -flto=auto -fno-fat-lto-objects

Quicksilver

Input: CORAL2 P1

OpenBenchmarking.orgFigure Of Merit, More Is BetterQuicksilver 20230818Input: CORAL2 P1Linux 6.9-rc2Linux 6.81.5M3M4.5M6M7.5MSE +/- 46491.34, N = 3SE +/- 67589.78, N = 6691666768146671. (CXX) g++ options: -fopenmp -O3 -march=native

SVT-AV1

Encoder Mode: Preset 4 - Input: Bosphorus 1080p

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 2.0Encoder Mode: Preset 4 - Input: Bosphorus 1080pLinux 6.9-rc2Linux 6.8510152025SE +/- 0.21, N = 3SE +/- 0.13, N = 1518.9318.661. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

Chaos Group V-RAY

Mode: CPU

OpenBenchmarking.orgvsamples, More Is BetterChaos Group V-RAY 6.0Mode: CPULinux 6.8Linux 6.9-rc213K26K39K52K65KSE +/- 530.58, N = 15SE +/- 557.85, N = 35985258995

Timed Linux Kernel Compilation

Build: allmodconfig

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed Linux Kernel Compilation 6.8Build: allmodconfigLinux 6.8Linux 6.9-rc270140210280350SE +/- 3.84, N = 3SE +/- 1.26, N = 3307.50311.75

OpenVINO

Model: Weld Porosity Detection FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Weld Porosity Detection FP16 - Device: CPULinux 6.9-rc2Linux 6.8246810SE +/- 0.05, N = 3SE +/- 0.08, N = 36.766.85MIN: 4.36 / MAX: 70.91MIN: 4.47 / MAX: 51.041. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

LZ4 Compression

Compression Level: 9 - Decompression Speed

OpenBenchmarking.orgMB/s, More Is BetterLZ4 Compression 1.9.4Compression Level: 9 - Decompression SpeedLinux 6.8Linux 6.9-rc28001600240032004000SE +/- 16.01, N = 3SE +/- 57.81, N = 33537.03492.01. (CC) gcc options: -O3

Stress-NG

Test: Vector Shuffle

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Vector ShuffleLinux 6.8Linux 6.9-rc2120K240K360K480K600KSE +/- 1416.85, N = 3SE +/- 1897.90, N = 3576905.92569593.001. (CXX) g++ options: -lm -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lpthread -lrt -lsctp -lz

TensorFlow

Device: CPU - Batch Size: 32 - Model: GoogLeNet

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.16.1Device: CPU - Batch Size: 32 - Model: GoogLeNetLinux 6.9-rc2Linux 6.820406080100SE +/- 1.10, N = 15SE +/- 1.27, N = 1297.5396.31

FFmpeg

Encoder: libx265 - Scenario: Video On Demand

OpenBenchmarking.orgFPS, More Is BetterFFmpeg 6.1Encoder: libx265 - Scenario: Video On DemandLinux 6.8Linux 6.9-rc21020304050SE +/- 0.50, N = 12SE +/- 0.76, N = 944.8044.241. (CXX) g++ options: -O3 -rdynamic -lpthread -lrt -ldl -lnuma

TensorFlow

Device: CPU - Batch Size: 32 - Model: ResNet-50

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.16.1Device: CPU - Batch Size: 32 - Model: ResNet-50Linux 6.8Linux 6.9-rc2816243240SE +/- 0.48, N = 15SE +/- 0.42, N = 1535.3034.86

TensorFlow

Device: CPU - Batch Size: 16 - Model: AlexNet

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.16.1Device: CPU - Batch Size: 16 - Model: AlexNetLinux 6.8Linux 6.9-rc250100150200250SE +/- 1.58, N = 15SE +/- 1.89, N = 15213.35210.71

OpenVINO

Model: Weld Porosity Detection FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Weld Porosity Detection FP16 - Device: CPULinux 6.9-rc2Linux 6.84K8K12K16K20KSE +/- 107.94, N = 3SE +/- 194.69, N = 316349.0516147.571. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

Google Draco

Model: Lion

OpenBenchmarking.orgms, Fewer Is BetterGoogle Draco 1.5.6Model: LionLinux 6.9-rc2Linux 6.813002600390052006500SE +/- 29.28, N = 3SE +/- 40.84, N = 3605461291. (CXX) g++ options: -O3

OpenVINO

Model: Noise Suppression Poconet-Like FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Noise Suppression Poconet-Like FP16 - Device: CPULinux 6.8Linux 6.9-rc2612182430SE +/- 0.17, N = 3SE +/- 0.20, N = 323.6823.97MIN: 11.64 / MAX: 175.69MIN: 11.24 / MAX: 358.11. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

Speedb

Test: Random Read

OpenBenchmarking.orgOp/s, More Is BetterSpeedb 2.7Test: Random ReadLinux 6.8Linux 6.9-rc280M160M240M320M400MSE +/- 1002006.26, N = 3SE +/- 4146957.10, N = 33804193893758374791. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti -lpthread

TensorFlow

Device: CPU - Batch Size: 32 - Model: AlexNet

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.16.1Device: CPU - Batch Size: 32 - Model: AlexNetLinux 6.8Linux 6.9-rc280160240320400SE +/- 2.86, N = 15SE +/- 5.16, N = 15346.10341.97

JPEG-XL Decoding libjxl

CPU Threads: All

OpenBenchmarking.orgMP/s, More Is BetterJPEG-XL Decoding libjxl 0.10.1CPU Threads: AllLinux 6.8Linux 6.9-rc280160240320400SE +/- 4.23, N = 3SE +/- 2.26, N = 3386.23381.66

WebP2 Image Encode

Encode Settings: Quality 100, Compression Effort 5

OpenBenchmarking.orgMP/s, More Is BetterWebP2 Image Encode 20220823Encode Settings: Quality 100, Compression Effort 5Linux 6.9-rc2Linux 6.8246810SE +/- 0.07, N = 3SE +/- 0.11, N = 158.458.351. (CXX) g++ options: -msse4.2 -fno-rtti -O3 -ldl

OSPRay Studio

Camera: 2 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path Tracer - Acceleration: CPU

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 1.0Camera: 2 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path Tracer - Acceleration: CPULinux 6.9-rc2Linux 6.8400800120016002000SE +/- 26.21, N = 3SE +/- 13.93, N = 1118391861

Speedb

Test: Random Fill

OpenBenchmarking.orgOp/s, More Is BetterSpeedb 2.7Test: Random FillLinux 6.8Linux 6.9-rc270K140K210K280K350KSE +/- 2148.02, N = 3SE +/- 3492.28, N = 33264993228161. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti -lpthread

ONNX Runtime

Model: Faster R-CNN R-50-FPN-int8 - Device: CPU - Executor: Parallel

OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.17Model: Faster R-CNN R-50-FPN-int8 - Device: CPU - Executor: ParallelLinux 6.8Linux 6.9-rc2612182430SE +/- 0.13, N = 3SE +/- 0.07, N = 323.4323.171. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

Stress-NG

Test: NUMA

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: NUMALinux 6.9-rc2Linux 6.8110220330440550SE +/- 5.89, N = 4SE +/- 4.27, N = 3487.60482.621. (CXX) g++ options: -lm -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lpthread -lrt -lsctp -lz

RocksDB

Test: Overwrite

OpenBenchmarking.orgOp/s, More Is BetterRocksDB 9.0Test: OverwriteLinux 6.9-rc2Linux 6.880K160K240K320K400KSE +/- 3053.81, N = 3SE +/- 881.98, N = 33919683880101. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti -lpthread

ONNX Runtime

Model: ResNet50 v1-12-int8 - Device: CPU - Executor: Parallel

OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.17Model: ResNet50 v1-12-int8 - Device: CPU - Executor: ParallelLinux 6.9-rc2Linux 6.820406080100SE +/- 1.23, N = 3SE +/- 0.92, N = 395.1494.251. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

OpenSSL

Algorithm: SHA512

OpenBenchmarking.orgbyte/s, More Is BetterOpenSSLAlgorithm: SHA512Linux 6.8Linux 6.9-rc26000M12000M18000M24000M30000MSE +/- 92272355.83, N = 3SE +/- 252323355.66, N = 329940735740296654990531. OpenSSL 3.0.10 1 Aug 2023 (Library: OpenSSL 3.0.10 1 Aug 2023)

Blender

Blend File: BMW27 - Compute: CPU-Only

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 4.1Blend File: BMW27 - Compute: CPU-OnlyLinux 6.8Linux 6.9-rc2510152025SE +/- 0.33, N = 14SE +/- 0.08, N = 321.8222.02

oneDNN

Harness: IP Shapes 3D - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.4Harness: IP Shapes 3D - Engine: CPULinux 6.8Linux 6.9-rc21.08962.17923.26884.35845.448SE +/- 0.02352, N = 3SE +/- 0.02357, N = 34.798534.84245MIN: 3.98MIN: 4.011. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread

CacheBench

Test: Write

OpenBenchmarking.orgMB/s, More Is BetterCacheBenchTest: WriteLinux 6.9-rc2Linux 6.820K40K60K80K100KSE +/- 65.10, N = 3SE +/- 36.95, N = 393862.7693036.30MIN: 54012.69 / MAX: 104121.12MIN: 54037.87 / MAX: 103869.491. (CC) gcc options: -O3 -lrt

Blender

Blend File: Pabellon Barcelona - Compute: CPU-Only

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 4.1Blend File: Pabellon Barcelona - Compute: CPU-OnlyLinux 6.9-rc2Linux 6.820406080100SE +/- 0.61, N = 15SE +/- 0.83, N = 575.5676.20

Speedb

Test: Random Fill Sync

OpenBenchmarking.orgOp/s, More Is BetterSpeedb 2.7Test: Random Fill SyncLinux 6.9-rc2Linux 6.860K120K180K240K300KSE +/- 3603.61, N = 3SE +/- 1490.88, N = 32596032574461. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti -lpthread

Speedb

Test: Sequential Fill

OpenBenchmarking.orgOp/s, More Is BetterSpeedb 2.7Test: Sequential FillLinux 6.9-rc2Linux 6.870K140K210K280K350KSE +/- 1955.03, N = 3SE +/- 1183.38, N = 33301673276371. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti -lpthread

LZ4 Compression

Compression Level: 1 - Decompression Speed

OpenBenchmarking.orgMB/s, More Is BetterLZ4 Compression 1.9.4Compression Level: 1 - Decompression SpeedLinux 6.9-rc2Linux 6.88001600240032004000SE +/- 18.57, N = 3SE +/- 44.31, N = 33628.03601.01. (CC) gcc options: -O3

Stress-NG

Test: Hash

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: HashLinux 6.9-rc2Linux 6.84M8M12M16M20MSE +/- 192774.29, N = 3SE +/- 82496.53, N = 317199190.0917071694.521. (CXX) g++ options: -lm -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lpthread -lrt -lsctp -lz

OSPRay

Benchmark: particle_volume/scivis/real_time

OpenBenchmarking.orgItems Per Second, More Is BetterOSPRay 3.1Benchmark: particle_volume/scivis/real_timeLinux 6.8Linux 6.9-rc2714212835SE +/- 0.26, N = 3SE +/- 0.33, N = 329.2829.07

Stress-NG

Test: CPU Stress

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: CPU StressLinux 6.8Linux 6.9-rc240K80K120K160K200KSE +/- 569.84, N = 3SE +/- 335.84, N = 3202073.08200671.701. (CXX) g++ options: -lm -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lpthread -lrt -lsctp -lz

VVenC

Video Input: Bosphorus 4K - Video Preset: Fast

OpenBenchmarking.orgFrames Per Second, More Is BetterVVenC 1.11Video Input: Bosphorus 4K - Video Preset: FastLinux 6.9-rc2Linux 6.81.11062.22123.33184.44245.553SE +/- 0.077, N = 12SE +/- 0.075, N = 104.9364.9021. (CXX) g++ options: -O3 -flto=auto -fno-fat-lto-objects

oneDNN

Harness: Recurrent Neural Network Inference - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.4Harness: Recurrent Neural Network Inference - Engine: CPULinux 6.8Linux 6.9-rc2160320480640800SE +/- 7.46, N = 3SE +/- 6.16, N = 9748.50753.36MIN: 677.68MIN: 652.831. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread

Xmrig

Variant: KawPow - Hash Count: 1M

OpenBenchmarking.orgH/s, More Is BetterXmrig 6.21Variant: KawPow - Hash Count: 1MLinux 6.9-rc2Linux 6.87K14K21K28K35KSE +/- 137.96, N = 3SE +/- 68.36, N = 333072.532860.81. (CXX) g++ options: -fexceptions -fno-rtti -maes -O3 -Ofast -static-libgcc -static-libstdc++ -rdynamic -lssl -lcrypto -luv -lpthread -lrt -ldl -lhwloc

OpenVINO

Model: Person Re-Identification Retail FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Person Re-Identification Retail FP16 - Device: CPULinux 6.8Linux 6.9-rc22K4K6K8K10KSE +/- 20.55, N = 3SE +/- 28.95, N = 311638.5111564.781. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Person Re-Identification Retail FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Person Re-Identification Retail FP16 - Device: CPULinux 6.8Linux 6.9-rc23691215SE +/- 0.02, N = 3SE +/- 0.03, N = 39.599.65MIN: 7.62 / MAX: 27.98MIN: 7.62 / MAX: 34.181. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

TensorFlow

Device: CPU - Batch Size: 256 - Model: GoogLeNet

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.16.1Device: CPU - Batch Size: 256 - Model: GoogLeNetLinux 6.9-rc2Linux 6.84080120160200SE +/- 1.95, N = 3SE +/- 2.20, N = 12203.63202.37

TensorFlow

Device: CPU - Batch Size: 256 - Model: ResNet-50

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.16.1Device: CPU - Batch Size: 256 - Model: ResNet-50Linux 6.9-rc2Linux 6.81632486480SE +/- 0.47, N = 3SE +/- 0.38, N = 370.5370.10

ONNX Runtime

Model: super-resolution-10 - Device: CPU - Executor: Parallel

OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.17Model: super-resolution-10 - Device: CPU - Executor: ParallelLinux 6.9-rc2Linux 6.8306090120150SE +/- 1.50, N = 3SE +/- 0.93, N = 3153.56152.641. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

Stress-NG

Test: Wide Vector Math

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Wide Vector MathLinux 6.9-rc2Linux 6.81.3M2.6M3.9M5.2M6.5MSE +/- 55746.31, N = 15SE +/- 72950.92, N = 45908316.035874353.631. (CXX) g++ options: -lm -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lpthread -lrt -lsctp -lz

Stress-NG

Test: Mixed Scheduler

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Mixed SchedulerLinux 6.8Linux 6.9-rc215K30K45K60K75KSE +/- 153.71, N = 3SE +/- 281.29, N = 370407.9670036.201. (CXX) g++ options: -lm -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lpthread -lrt -lsctp -lz

Speedb

Test: Read Random Write Random

OpenBenchmarking.orgOp/s, More Is BetterSpeedb 2.7Test: Read Random Write RandomLinux 6.8Linux 6.9-rc2300K600K900K1200K1500KSE +/- 8674.90, N = 11SE +/- 13609.90, N = 3118175811755621. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti -lpthread

OpenVINO

Model: Handwritten English Recognition FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Handwritten English Recognition FP16 - Device: CPULinux 6.8Linux 6.9-rc2714212835SE +/- 0.03, N = 3SE +/- 0.09, N = 330.8531.01MIN: 24.82 / MAX: 82.03MIN: 24.42 / MAX: 90.861. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Handwritten English Recognition FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Handwritten English Recognition FP16 - Device: CPULinux 6.8Linux 6.9-rc28001600240032004000SE +/- 3.14, N = 3SE +/- 10.89, N = 33626.413608.211. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Person Vehicle Bike Detection FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Person Vehicle Bike Detection FP16 - Device: CPULinux 6.8Linux 6.9-rc214002800420056007000SE +/- 18.88, N = 3SE +/- 23.77, N = 36336.786306.421. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

RocksDB

Test: Update Random

OpenBenchmarking.orgOp/s, More Is BetterRocksDB 9.0Test: Update RandomLinux 6.9-rc2Linux 6.880K160K240K320K400KSE +/- 1522.72, N = 3SE +/- 1470.46, N = 33615023598251. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti -lpthread

LZ4 Compression

Compression Level: 3 - Decompression Speed

OpenBenchmarking.orgMB/s, More Is BetterLZ4 Compression 1.9.4Compression Level: 3 - Decompression SpeedLinux 6.8Linux 6.9-rc27001400210028003500SE +/- 33.92, N = 3SE +/- 34.17, N = 33364.83349.61. (CC) gcc options: -O3

OpenVINO

Model: Noise Suppression Poconet-Like FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Noise Suppression Poconet-Like FP16 - Device: CPULinux 6.8Linux 6.9-rc210002000300040005000SE +/- 54.03, N = 3SE +/- 29.05, N = 34621.324600.951. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OSPRay Studio

Camera: 1 - Resolution: 1080p - Samples Per Pixel: 32 - Renderer: Path Tracer - Acceleration: CPU

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 1.0Camera: 1 - Resolution: 1080p - Samples Per Pixel: 32 - Renderer: Path Tracer - Acceleration: CPULinux 6.9-rc2Linux 6.83K6K9K12K15KSE +/- 180.26, N = 3SE +/- 112.81, N = 91380713867

Stress-NG

Test: Glibc Qsort Data Sorting

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Glibc Qsort Data SortingLinux 6.8Linux 6.9-rc2400800120016002000SE +/- 4.40, N = 3SE +/- 4.16, N = 31866.581858.701. (CXX) g++ options: -lm -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lpthread -lrt -lsctp -lz

Speedb

Test: Update Random

OpenBenchmarking.orgOp/s, More Is BetterSpeedb 2.7Test: Update RandomLinux 6.9-rc2Linux 6.860K120K180K240K300KSE +/- 3235.16, N = 3SE +/- 3488.80, N = 32934142921801. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti -lpthread

OpenVINO

Model: Face Detection Retail FP16-INT8 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Face Detection Retail FP16-INT8 - Device: CPULinux 6.9-rc2Linux 6.8246810SE +/- 0.00, N = 3SE +/- 0.07, N = 37.147.17MIN: 5.79 / MAX: 44.66MIN: 5.78 / MAX: 54.31. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

CacheBench

Test: Read / Modify / Write

OpenBenchmarking.orgMB/s, More Is BetterCacheBenchTest: Read / Modify / WriteLinux 6.8Linux 6.9-rc220K40K60K80K100KSE +/- 2.71, N = 3SE +/- 71.07, N = 399112.7098711.08MIN: 88982.6 / MAX: 105154.55MIN: 85707.72 / MAX: 105115.441. (CC) gcc options: -O3 -lrt

Primesieve

Length: 1e13

OpenBenchmarking.orgSeconds, Fewer Is BetterPrimesieve 12.1Length: 1e13Linux 6.9-rc2Linux 6.8918273645SE +/- 0.09, N = 3SE +/- 0.06, N = 339.4639.621. (CXX) g++ options: -O3

OpenVINO

Model: Face Detection Retail FP16-INT8 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Face Detection Retail FP16-INT8 - Device: CPULinux 6.9-rc2Linux 6.83K6K9K12K15KSE +/- 25.09, N = 3SE +/- 132.85, N = 315589.5915532.541. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Person Vehicle Bike Detection FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Person Vehicle Bike Detection FP16 - Device: CPULinux 6.8Linux 6.9-rc248121620SE +/- 0.06, N = 3SE +/- 0.07, N = 317.5217.58MIN: 11.97 / MAX: 108.98MIN: 12.03 / MAX: 66.231. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

FFmpeg

Encoder: libx264 - Scenario: Live

OpenBenchmarking.orgFPS, More Is BetterFFmpeg 6.1Encoder: libx264 - Scenario: LiveLinux 6.9-rc2Linux 6.84080120160200SE +/- 0.70, N = 3SE +/- 1.29, N = 3182.12181.511. (CXX) g++ options: -O3 -rdynamic -lpthread -lrt -ldl -lnuma

OSPRay Studio

Camera: 1 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path Tracer - Acceleration: CPU

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 1.0Camera: 1 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path Tracer - Acceleration: CPULinux 6.9-rc2Linux 6.813K26K39K52K65KSE +/- 567.54, N = 7SE +/- 443.96, N = 156116261363

FFmpeg

Encoder: libx265 - Scenario: Upload

OpenBenchmarking.orgFPS, More Is BetterFFmpeg 6.1Encoder: libx265 - Scenario: UploadLinux 6.8Linux 6.9-rc2510152025SE +/- 0.31, N = 3SE +/- 0.26, N = 422.3122.241. (CXX) g++ options: -O3 -rdynamic -lpthread -lrt -ldl -lnuma

OpenVINO

Model: Face Detection Retail FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Face Detection Retail FP16 - Device: CPULinux 6.9-rc2Linux 6.82K4K6K8K10KSE +/- 26.72, N = 3SE +/- 23.83, N = 311295.9211260.981. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Face Detection Retail FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Face Detection Retail FP16 - Device: CPULinux 6.9-rc2Linux 6.83691215SE +/- 0.02, N = 3SE +/- 0.02, N = 39.899.92MIN: 7.63 / MAX: 36.57MIN: 7.45 / MAX: 33.821. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

RocksDB

Test: Random Read

OpenBenchmarking.orgOp/s, More Is BetterRocksDB 9.0Test: Random ReadLinux 6.9-rc2Linux 6.880M160M240M320M400MSE +/- 1447290.34, N = 3SE +/- 1573786.50, N = 33615860833604985181. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti -lpthread

OpenVINO

Model: Road Segmentation ADAS FP16-INT8 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Road Segmentation ADAS FP16-INT8 - Device: CPULinux 6.8Linux 6.9-rc220406080100SE +/- 0.09, N = 3SE +/- 0.28, N = 377.3477.57MIN: 56.48 / MAX: 158.67MIN: 57.16 / MAX: 148.671. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OSPRay Studio

Camera: 2 - Resolution: 4K - Samples Per Pixel: 16 - Renderer: Path Tracer - Acceleration: CPU

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 1.0Camera: 2 - Resolution: 4K - Samples Per Pixel: 16 - Renderer: Path Tracer - Acceleration: CPULinux 6.8Linux 6.9-rc28K16K24K32K40KSE +/- 302.37, N = 15SE +/- 483.46, N = 33531735422

Blender

Blend File: Classroom - Compute: CPU-Only

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 4.1Blend File: Classroom - Compute: CPU-OnlyLinux 6.9-rc2Linux 6.81224364860SE +/- 0.09, N = 3SE +/- 0.10, N = 353.8253.98

ONNX Runtime

Model: CaffeNet 12-int8 - Device: CPU - Executor: Parallel

OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.17Model: CaffeNet 12-int8 - Device: CPU - Executor: ParallelLinux 6.9-rc2Linux 6.860120180240300SE +/- 2.09, N = 3SE +/- 2.79, N = 15293.03292.171. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

OpenVINO

Model: Road Segmentation ADAS FP16-INT8 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Road Segmentation ADAS FP16-INT8 - Device: CPULinux 6.8Linux 6.9-rc230060090012001500SE +/- 1.59, N = 3SE +/- 5.16, N = 31446.421442.211. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Vehicle Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Vehicle Detection FP16-INT8 - Device: CPULinux 6.8Linux 6.9-rc211002200330044005500SE +/- 9.46, N = 3SE +/- 18.34, N = 35067.405052.711. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Machine Translation EN To DE FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Machine Translation EN To DE FP16 - Device: CPULinux 6.9-rc2Linux 6.81224364860SE +/- 0.25, N = 3SE +/- 0.47, N = 354.8354.98MIN: 34.71 / MAX: 375.04MIN: 33.9 / MAX: 423.361. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Vehicle Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Vehicle Detection FP16-INT8 - Device: CPULinux 6.8Linux 6.9-rc2510152025SE +/- 0.04, N = 3SE +/- 0.08, N = 322.0622.12MIN: 15.51 / MAX: 86.25MIN: 15.73 / MAX: 71.51. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Machine Translation EN To DE FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Machine Translation EN To DE FP16 - Device: CPULinux 6.9-rc2Linux 6.8150300450600750SE +/- 3.16, N = 3SE +/- 5.75, N = 3673.46671.661. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

oneDNN

Harness: IP Shapes 1D - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.4Harness: IP Shapes 1D - Engine: CPULinux 6.8Linux 6.9-rc21.01512.03023.04534.06045.0755SE +/- 0.04580, N = 3SE +/- 0.05180, N = 124.500554.51166MIN: 3.52MIN: 3.371. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread

Xmrig

Variant: Wownero - Hash Count: 1M

OpenBenchmarking.orgH/s, More Is BetterXmrig 6.21Variant: Wownero - Hash Count: 1MLinux 6.9-rc2Linux 6.88K16K24K32K40KSE +/- 490.33, N = 3SE +/- 245.88, N = 336180.736096.61. (CXX) g++ options: -fexceptions -fno-rtti -maes -O3 -Ofast -static-libgcc -static-libstdc++ -rdynamic -lssl -lcrypto -luv -lpthread -lrt -ldl -lhwloc

JPEG-XL libjxl

Input: PNG - Quality: 100

OpenBenchmarking.orgMP/s, More Is BetterJPEG-XL libjxl 0.10.1Input: PNG - Quality: 100Linux 6.8Linux 6.9-rc2612182430SE +/- 0.15, N = 3SE +/- 0.21, N = 325.6725.611. (CXX) g++ options: -fno-rtti -O3 -fPIE -pie -lm

Google Draco

Model: Church Facade

OpenBenchmarking.orgms, Fewer Is BetterGoogle Draco 1.5.6Model: Church FacadeLinux 6.8Linux 6.9-rc217003400510068008500SE +/- 0.88, N = 3SE +/- 9.56, N = 3774777621. (CXX) g++ options: -O3

Quicksilver

Input: CORAL2 P2

OpenBenchmarking.orgFigure Of Merit, More Is BetterQuicksilver 20230818Input: CORAL2 P2Linux 6.9-rc2Linux 6.81.4M2.8M4.2M5.6M7MSE +/- 91964.82, N = 9SE +/- 74194.56, N = 9668966766773331. (CXX) g++ options: -fopenmp -O3 -march=native

OSPRay Studio

Camera: 3 - Resolution: 1080p - Samples Per Pixel: 1 - Renderer: Path Tracer - Acceleration: CPU

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 1.0Camera: 3 - Resolution: 1080p - Samples Per Pixel: 1 - Renderer: Path Tracer - Acceleration: CPULinux 6.8Linux 6.9-rc2120240360480600SE +/- 4.36, N = 15SE +/- 4.85, N = 15569570

OpenVINO

Model: Face Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Face Detection FP16-INT8 - Device: CPULinux 6.8Linux 6.9-rc270140210280350SE +/- 0.74, N = 3SE +/- 0.81, N = 3337.21337.78MIN: 261.24 / MAX: 615.09MIN: 253.21 / MAX: 781.061. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

JPEG-XL libjxl

Input: JPEG - Quality: 100

OpenBenchmarking.orgMP/s, More Is BetterJPEG-XL libjxl 0.10.1Input: JPEG - Quality: 100Linux 6.8Linux 6.9-rc2612182430SE +/- 0.11, N = 3SE +/- 0.08, N = 326.0025.961. (CXX) g++ options: -fno-rtti -O3 -fPIE -pie -lm

LZ4 Compression

Compression Level: 9 - Compression Speed

OpenBenchmarking.orgMB/s, More Is BetterLZ4 Compression 1.9.4Compression Level: 9 - Compression SpeedLinux 6.9-rc2Linux 6.8816243240SE +/- 0.07, N = 3SE +/- 0.08, N = 332.6632.611. (CC) gcc options: -O3

OpenVINO

Model: Face Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Face Detection FP16-INT8 - Device: CPULinux 6.8Linux 6.9-rc270140210280350SE +/- 0.75, N = 3SE +/- 0.82, N = 3331.23330.731. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenSSL

Algorithm: RSA4096

OpenBenchmarking.orgsign/s, More Is BetterOpenSSLAlgorithm: RSA4096Linux 6.8Linux 6.9-rc28K16K24K32K40KSE +/- 46.27, N = 3SE +/- 90.23, N = 338204.638147.41. OpenSSL 3.0.10 1 Aug 2023 (Library: OpenSSL 3.0.10 1 Aug 2023)

Stress-NG

Test: AVL Tree

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: AVL TreeLinux 6.8Linux 6.9-rc22004006008001000SE +/- 6.53, N = 3SE +/- 2.13, N = 3810.19808.991. (CXX) g++ options: -lm -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lpthread -lrt -lsctp -lz

WavPack Audio Encoding

WAV To WavPack

OpenBenchmarking.orgSeconds, Fewer Is BetterWavPack Audio Encoding 5.7WAV To WavPackLinux 6.9-rc2Linux 6.8246810SE +/- 0.019, N = 5SE +/- 0.023, N = 56.3406.349

FFmpeg

Encoder: libx264 - Scenario: Video On Demand

OpenBenchmarking.orgFPS, More Is BetterFFmpeg 6.1Encoder: libx264 - Scenario: Video On DemandLinux 6.8Linux 6.9-rc21020304050SE +/- 0.06, N = 3SE +/- 0.10, N = 342.9442.881. (CXX) g++ options: -O3 -rdynamic -lpthread -lrt -ldl -lnuma

Xmrig

Variant: GhostRider - Hash Count: 1M

OpenBenchmarking.orgH/s, More Is BetterXmrig 6.21Variant: GhostRider - Hash Count: 1MLinux 6.9-rc2Linux 6.82K4K6K8K10KSE +/- 42.79, N = 3SE +/- 31.05, N = 39602.79592.31. (CXX) g++ options: -fexceptions -fno-rtti -maes -O3 -Ofast -static-libgcc -static-libstdc++ -rdynamic -lssl -lcrypto -luv -lpthread -lrt -ldl -lhwloc

Xmrig

Variant: CryptoNight-Heavy - Hash Count: 1M

OpenBenchmarking.orgH/s, More Is BetterXmrig 6.21Variant: CryptoNight-Heavy - Hash Count: 1MLinux 6.8Linux 6.9-rc27K14K21K28K35KSE +/- 49.86, N = 3SE +/- 160.32, N = 332856.332826.11. (CXX) g++ options: -fexceptions -fno-rtti -maes -O3 -Ofast -static-libgcc -static-libstdc++ -rdynamic -lssl -lcrypto -luv -lpthread -lrt -ldl -lhwloc

FFmpeg

Encoder: libx264 - Scenario: Upload

OpenBenchmarking.orgFPS, More Is BetterFFmpeg 6.1Encoder: libx264 - Scenario: UploadLinux 6.9-rc2Linux 6.83691215SE +/- 0.01, N = 3SE +/- 0.01, N = 311.5111.501. (CXX) g++ options: -O3 -rdynamic -lpthread -lrt -ldl -lnuma

Xmrig

Variant: CryptoNight-Femto UPX2 - Hash Count: 1M

OpenBenchmarking.orgH/s, More Is BetterXmrig 6.21Variant: CryptoNight-Femto UPX2 - Hash Count: 1MLinux 6.8Linux 6.9-rc27K14K21K28K35KSE +/- 110.64, N = 3SE +/- 170.37, N = 333002.232993.81. (CXX) g++ options: -fexceptions -fno-rtti -maes -O3 -Ofast -static-libgcc -static-libstdc++ -rdynamic -lssl -lcrypto -luv -lpthread -lrt -ldl -lhwloc

LZ4 Compression

Compression Level: 1 - Compression Speed

OpenBenchmarking.orgMB/s, More Is BetterLZ4 Compression 1.9.4Compression Level: 1 - Compression SpeedLinux 6.8Linux 6.9-rc2130260390520650SE +/- 1.15, N = 3SE +/- 0.16, N = 3602.69602.541. (CC) gcc options: -O3

CacheBench

Test: Read

OpenBenchmarking.orgMB/s, More Is BetterCacheBenchTest: ReadLinux 6.8Linux 6.9-rc23K6K9K12K15KSE +/- 0.52, N = 3SE +/- 0.88, N = 313344.7013341.47MIN: 13338.06 / MAX: 13346.23MIN: 13335.31 / MAX: 13343.851. (CC) gcc options: -O3 -lrt

OSPRay Studio

Camera: 2 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path Tracer - Acceleration: CPU

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 1.0Camera: 2 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path Tracer - Acceleration: CPULinux 6.8Linux 6.9-rc214K28K42K56K70KSE +/- 591.53, N = 7SE +/- 885.61, N = 36351463529

FFmpeg

Encoder: libx264 - Scenario: Platform

OpenBenchmarking.orgFPS, More Is BetterFFmpeg 6.1Encoder: libx264 - Scenario: PlatformLinux 6.9-rc2Linux 6.81020304050SE +/- 0.10, N = 3SE +/- 0.17, N = 342.7742.761. (CXX) g++ options: -O3 -rdynamic -lpthread -lrt -ldl -lnuma

LZ4 Compression

Compression Level: 3 - Compression Speed

OpenBenchmarking.orgMB/s, More Is BetterLZ4 Compression 1.9.4Compression Level: 3 - Compression SpeedLinux 6.8Linux 6.9-rc220406080100SE +/- 0.06, N = 3SE +/- 0.06, N = 398.4398.411. (CC) gcc options: -O3

OpenVINO

Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPULinux 6.8Linux 6.9-rc20.08550.1710.25650.3420.4275SE +/- 0.01, N = 15SE +/- 0.00, N = 150.380.38MIN: 0.23 / MAX: 46.5MIN: 0.24 / MAX: 50.651. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

MariaDB mariadb-slap

Clients: 512

OpenBenchmarking.orgQueries Per Second, More Is BetterMariaDB mariadb-slap 11.5Clients: 512Linux 6.9-rc2Linux 6.820406080100SE +/- 0.87, N = 9SE +/- 0.41, N = 386861. (CXX) g++ options: -fPIC -pie -fstack-protector -O3 -shared -lrt -lpthread -lz -ldl -lm -lstdc++

WebP2 Image Encode

Encode Settings: Quality 100, Lossless Compression

OpenBenchmarking.orgMP/s, More Is BetterWebP2 Image Encode 20220823Encode Settings: Quality 100, Lossless CompressionLinux 6.9-rc2Linux 6.80.01580.03160.04740.06320.079SE +/- 0.00, N = 3SE +/- 0.00, N = 30.070.071. (CXX) g++ options: -msse4.2 -fno-rtti -O3 -ldl

ONNX Runtime

Model: Faster R-CNN R-50-FPN-int8 - Device: CPU - Executor: Standard

OpenBenchmarking.orgInference Time Cost (ms), Fewer Is BetterONNX Runtime 1.17Model: Faster R-CNN R-50-FPN-int8 - Device: CPU - Executor: StandardLinux 6.9-rc2Linux 6.8714212835SE +/- 0.22, N = 3SE +/- 0.38, N = 329.1130.821. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

ONNX Runtime

Model: Faster R-CNN R-50-FPN-int8 - Device: CPU - Executor: Parallel

OpenBenchmarking.orgInference Time Cost (ms), Fewer Is BetterONNX Runtime 1.17Model: Faster R-CNN R-50-FPN-int8 - Device: CPU - Executor: ParallelLinux 6.8Linux 6.9-rc21020304050SE +/- 0.23, N = 3SE +/- 0.13, N = 342.6843.151. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

ONNX Runtime

Model: super-resolution-10 - Device: CPU - Executor: Standard

OpenBenchmarking.orgInference Time Cost (ms), Fewer Is BetterONNX Runtime 1.17Model: super-resolution-10 - Device: CPU - Executor: StandardLinux 6.9-rc2Linux 6.81.09842.19683.29524.39365.492SE +/- 0.01745, N = 3SE +/- 0.07270, N = 154.678114.881811. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

ONNX Runtime

Model: super-resolution-10 - Device: CPU - Executor: Parallel

OpenBenchmarking.orgInference Time Cost (ms), Fewer Is BetterONNX Runtime 1.17Model: super-resolution-10 - Device: CPU - Executor: ParallelLinux 6.9-rc2Linux 6.8246810SE +/- 0.06370, N = 3SE +/- 0.04024, N = 36.511276.550111. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

ONNX Runtime

Model: ResNet50 v1-12-int8 - Device: CPU - Executor: Standard

OpenBenchmarking.orgInference Time Cost (ms), Fewer Is BetterONNX Runtime 1.17Model: ResNet50 v1-12-int8 - Device: CPU - Executor: StandardLinux 6.9-rc2Linux 6.83691215SE +/- 0.21896, N = 15SE +/- 0.20919, N = 128.231219.015381. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

ONNX Runtime

Model: ResNet50 v1-12-int8 - Device: CPU - Executor: Standard

OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.17Model: ResNet50 v1-12-int8 - Device: CPU - Executor: StandardLinux 6.9-rc2Linux 6.8306090120150SE +/- 3.02, N = 15SE +/- 2.58, N = 12122.60111.571. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

ONNX Runtime

Model: ResNet50 v1-12-int8 - Device: CPU - Executor: Parallel

OpenBenchmarking.orgInference Time Cost (ms), Fewer Is BetterONNX Runtime 1.17Model: ResNet50 v1-12-int8 - Device: CPU - Executor: ParallelLinux 6.9-rc2Linux 6.83691215SE +/- 0.14, N = 3SE +/- 0.10, N = 310.5110.611. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

ONNX Runtime

Model: ArcFace ResNet-100 - Device: CPU - Executor: Standard

OpenBenchmarking.orgInference Time Cost (ms), Fewer Is BetterONNX Runtime 1.17Model: ArcFace ResNet-100 - Device: CPU - Executor: StandardLinux 6.9-rc2Linux 6.81020304050SE +/- 0.86, N = 15SE +/- 0.81, N = 1241.5042.781. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

ONNX Runtime

Model: ArcFace ResNet-100 - Device: CPU - Executor: Standard

OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.17Model: ArcFace ResNet-100 - Device: CPU - Executor: StandardLinux 6.9-rc2Linux 6.8612182430SE +/- 0.48, N = 15SE +/- 0.43, N = 1224.2323.461. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

ONNX Runtime

Model: ArcFace ResNet-100 - Device: CPU - Executor: Parallel

OpenBenchmarking.orgInference Time Cost (ms), Fewer Is BetterONNX Runtime 1.17Model: ArcFace ResNet-100 - Device: CPU - Executor: ParallelLinux 6.9-rc2Linux 6.81326395265SE +/- 0.56, N = 3SE +/- 0.81, N = 356.9559.601. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

ONNX Runtime

Model: fcn-resnet101-11 - Device: CPU - Executor: Standard

OpenBenchmarking.orgInference Time Cost (ms), Fewer Is BetterONNX Runtime 1.17Model: fcn-resnet101-11 - Device: CPU - Executor: StandardLinux 6.9-rc2Linux 6.850100150200250SE +/- 1.80, N = 3SE +/- 11.46, N = 12184.79231.281. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

ONNX Runtime

Model: fcn-resnet101-11 - Device: CPU - Executor: Standard

OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.17Model: fcn-resnet101-11 - Device: CPU - Executor: StandardLinux 6.9-rc2Linux 6.81.21782.43563.65344.87126.089SE +/- 0.05231, N = 3SE +/- 0.20811, N = 125.412594.436491. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

ONNX Runtime

Model: fcn-resnet101-11 - Device: CPU - Executor: Parallel

OpenBenchmarking.orgInference Time Cost (ms), Fewer Is BetterONNX Runtime 1.17Model: fcn-resnet101-11 - Device: CPU - Executor: ParallelLinux 6.9-rc2Linux 6.8160320480640800SE +/- 14.65, N = 12SE +/- 25.74, N = 15668.70747.081. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

ONNX Runtime

Model: fcn-resnet101-11 - Device: CPU - Executor: Parallel

OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.17Model: fcn-resnet101-11 - Device: CPU - Executor: ParallelLinux 6.9-rc2Linux 6.80.33820.67641.01461.35281.691SE +/- 0.03151, N = 12SE +/- 0.04472, N = 151.503001.359941. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

ONNX Runtime

Model: CaffeNet 12-int8 - Device: CPU - Executor: Standard

OpenBenchmarking.orgInference Time Cost (ms), Fewer Is BetterONNX Runtime 1.17Model: CaffeNet 12-int8 - Device: CPU - Executor: StandardLinux 6.9-rc2Linux 6.80.41580.83161.24741.66322.079SE +/- 0.01721, N = 3SE +/- 0.02432, N = 151.749731.848071. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

ONNX Runtime

Model: CaffeNet 12-int8 - Device: CPU - Executor: Parallel

OpenBenchmarking.orgInference Time Cost (ms), Fewer Is BetterONNX Runtime 1.17Model: CaffeNet 12-int8 - Device: CPU - Executor: ParallelLinux 6.9-rc2Linux 6.80.77031.54062.31093.08123.8515SE +/- 0.02459, N = 3SE +/- 0.03367, N = 153.409723.423571. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

ONNX Runtime

Model: bertsquad-12 - Device: CPU - Executor: Standard

OpenBenchmarking.orgInference Time Cost (ms), Fewer Is BetterONNX Runtime 1.17Model: bertsquad-12 - Device: CPU - Executor: StandardLinux 6.9-rc2Linux 6.81632486480SE +/- 2.28, N = 15SE +/- 2.24, N = 1266.0070.961. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

ONNX Runtime

Model: bertsquad-12 - Device: CPU - Executor: Standard

OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.17Model: bertsquad-12 - Device: CPU - Executor: StandardLinux 6.9-rc2Linux 6.848121620SE +/- 0.54, N = 15SE +/- 0.50, N = 1215.4114.271. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

ONNX Runtime

Model: bertsquad-12 - Device: CPU - Executor: Parallel

OpenBenchmarking.orgInference Time Cost (ms), Fewer Is BetterONNX Runtime 1.17Model: bertsquad-12 - Device: CPU - Executor: ParallelLinux 6.8Linux 6.9-rc220406080100SE +/- 0.33, N = 3SE +/- 0.44, N = 392.7594.331. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

ONNX Runtime

Model: T5 Encoder - Device: CPU - Executor: Standard

OpenBenchmarking.orgInference Time Cost (ms), Fewer Is BetterONNX Runtime 1.17Model: T5 Encoder - Device: CPU - Executor: StandardLinux 6.9-rc2Linux 6.80.65141.30281.95422.60563.257SE +/- 0.01855, N = 3SE +/- 0.12453, N = 152.482342.895011. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

ONNX Runtime

Model: T5 Encoder - Device: CPU - Executor: Standard

OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.17Model: T5 Encoder - Device: CPU - Executor: StandardLinux 6.9-rc2Linux 6.890180270360450SE +/- 3.01, N = 3SE +/- 14.02, N = 15402.67353.571. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

ONNX Runtime

Model: T5 Encoder - Device: CPU - Executor: Parallel

OpenBenchmarking.orgInference Time Cost (ms), Fewer Is BetterONNX Runtime 1.17Model: T5 Encoder - Device: CPU - Executor: ParallelLinux 6.9-rc2Linux 6.81.21772.43543.65314.87086.0885SE +/- 0.06160, N = 14SE +/- 0.09595, N = 125.107555.411911. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

ONNX Runtime

Model: yolov4 - Device: CPU - Executor: Standard

OpenBenchmarking.orgInference Time Cost (ms), Fewer Is BetterONNX Runtime 1.17Model: yolov4 - Device: CPU - Executor: StandardLinux 6.9-rc2Linux 6.8306090120150SE +/- 1.33, N = 13SE +/- 2.31, N = 15112.43122.241. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

ONNX Runtime

Model: yolov4 - Device: CPU - Executor: Standard

OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.17Model: yolov4 - Device: CPU - Executor: StandardLinux 6.9-rc2Linux 6.8246810SE +/- 0.10643, N = 13SE +/- 0.16273, N = 158.909368.223511. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

ONNX Runtime

Model: yolov4 - Device: CPU - Executor: Parallel

OpenBenchmarking.orgInference Time Cost (ms), Fewer Is BetterONNX Runtime 1.17Model: yolov4 - Device: CPU - Executor: ParallelLinux 6.9-rc2Linux 6.8306090120150SE +/- 1.32, N = 3SE +/- 1.18, N = 3124.38126.381. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

ONNX Runtime

Model: GPT-2 - Device: CPU - Executor: Parallel

OpenBenchmarking.orgInference Time Cost (ms), Fewer Is BetterONNX Runtime 1.17Model: GPT-2 - Device: CPU - Executor: ParallelLinux 6.9-rc2Linux 6.83691215SE +/- 0.12308, N = 15SE +/- 0.11034, N = 39.464969.805141. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

OpenVINO

Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Age Gender Recognition Retail 0013 FP16 - Device: CPULinux 6.9-rc2Linux 6.80.17550.3510.52650.7020.8775SE +/- 0.03, N = 3SE +/- 0.01, N = 150.710.78MIN: 0.32 / MAX: 74.71MIN: 0.3 / MAX: 138.081. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

Blender

Blend File: Barbershop - Compute: CPU-Only

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 4.1Blend File: Barbershop - Compute: CPU-OnlyLinux 6.8Linux 6.9-rc260120180240300SE +/- 6.20, N = 8SE +/- 6.67, N = 9271.99279.74

Stress-NG

Test: Glibc C String Functions

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Glibc C String FunctionsLinux 6.9-rc2Linux 6.820M40M60M80M100MSE +/- 1504028.14, N = 15SE +/- 2138024.53, N = 1385035507.5580643523.241. (CXX) g++ options: -lm -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lpthread -lrt -lsctp -lz

Stress-NG

Test: Vector Floating Point

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Vector Floating PointLinux 6.8Linux 6.9-rc250K100K150K200K250KSE +/- 5616.14, N = 12SE +/- 8579.53, N = 12234669.74230503.341. (CXX) g++ options: -lm -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lpthread -lrt -lsctp -lz

Stress-NG

Test: Fused Multiply-Add

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Fused Multiply-AddLinux 6.8Linux 6.9-rc240M80M120M160M200MSE +/- 6187723.80, N = 12SE +/- 3824188.11, N = 15204365411.59200468629.321. (CXX) g++ options: -lm -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lpthread -lrt -lsctp -lz

Stress-NG

Test: Matrix 3D Math

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Matrix 3D MathLinux 6.9-rc2Linux 6.87K14K21K28K35KSE +/- 437.41, N = 15SE +/- 669.33, N = 1531460.4231442.691. (CXX) g++ options: -lm -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lpthread -lrt -lsctp -lz

Stress-NG

Test: Floating Point

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Floating PointLinux 6.8Linux 6.9-rc26K12K18K24K30KSE +/- 632.70, N = 12SE +/- 214.66, N = 1129600.0229139.601. (CXX) g++ options: -lm -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lpthread -lrt -lsctp -lz

Stress-NG

Test: Matrix Math

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Matrix MathLinux 6.9-rc2Linux 6.880K160K240K320K400KSE +/- 9278.38, N = 12SE +/- 4925.11, N = 15392750.09384748.541. (CXX) g++ options: -lm -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lpthread -lrt -lsctp -lz

Stress-NG

Test: Malloc

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: MallocLinux 6.8Linux 6.9-rc240M80M120M160M200MSE +/- 201545.00, N = 3SE +/- 3675496.40, N = 12163551396.40161652700.091. (CXX) g++ options: -lm -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lpthread -lrt -lsctp -lz

Stress-NG

Test: MEMFD

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: MEMFDLinux 6.9-rc2Linux 6.8150300450600750SE +/- 5.94, N = 8SE +/- 14.68, N = 15688.76688.261. (CXX) g++ options: -lm -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lpthread -lrt -lsctp -lz

Stress-NG

Test: Pipe

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: PipeLinux 6.8Linux 6.9-rc27M14M21M28M35MSE +/- 749025.19, N = 15SE +/- 2106194.07, N = 1530377557.9729814480.671. (CXX) g++ options: -lm -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lpthread -lrt -lsctp -lz

TensorFlow

Device: CPU - Batch Size: 16 - Model: GoogLeNet

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.16.1Device: CPU - Batch Size: 16 - Model: GoogLeNetLinux 6.9-rc2Linux 6.81326395265SE +/- 1.24, N = 12SE +/- 1.31, N = 1258.8358.50

TensorFlow

Device: CPU - Batch Size: 1 - Model: ResNet-50

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.16.1Device: CPU - Batch Size: 1 - Model: ResNet-50Linux 6.9-rc2Linux 6.80.42750.8551.28251.712.1375SE +/- 0.03, N = 15SE +/- 0.03, N = 151.901.88

TensorFlow

Device: CPU - Batch Size: 1 - Model: GoogLeNet

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.16.1Device: CPU - Batch Size: 1 - Model: GoogLeNetLinux 6.8Linux 6.9-rc2246810SE +/- 0.13, N = 12SE +/- 0.14, N = 156.055.98

MariaDB mariadb-slap

Clients: 1024

OpenBenchmarking.orgQueries Per Second, More Is BetterMariaDB mariadb-slap 11.5Clients: 1024Linux 6.9-rc2Linux 6.8816243240SE +/- 1.41, N = 6SE +/- 1.23, N = 936341. (CXX) g++ options: -fPIC -pie -fstack-protector -O3 -shared -lrt -lpthread -lz -ldl -lm -lstdc++

OSPRay Studio

Camera: 2 - Resolution: 1080p - Samples Per Pixel: 32 - Renderer: Path Tracer - Acceleration: CPU

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 1.0Camera: 2 - Resolution: 1080p - Samples Per Pixel: 32 - Renderer: Path Tracer - Acceleration: CPULinux 6.8Linux 6.9-rc23K6K9K12K15KSE +/- 268.32, N = 12SE +/- 235.77, N = 151483615415

OSPRay Studio

Camera: 2 - Resolution: 1080p - Samples Per Pixel: 16 - Renderer: Path Tracer - Acceleration: CPU

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 1.0Camera: 2 - Resolution: 1080p - Samples Per Pixel: 16 - Renderer: Path Tracer - Acceleration: CPULinux 6.8Linux 6.9-rc216003200480064008000SE +/- 105.66, N = 3SE +/- 118.69, N = 1574027506

OSPRay Studio

Camera: 1 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path Tracer - Acceleration: CPU

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 1.0Camera: 1 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path Tracer - Acceleration: CPULinux 6.9-rc2Linux 6.8400800120016002000SE +/- 22.91, N = 15SE +/- 40.26, N = 1517741801

oneDNN

Harness: Recurrent Neural Network Training - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.4Harness: Recurrent Neural Network Training - Engine: CPULinux 6.8Linux 6.9-rc22K4K6K8K10KSE +/- 22.69, N = 3SE +/- 498.89, N = 134821.3210195.75MIN: 4659.99MIN: 4568.31. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread

oneDNN

Harness: Deconvolution Batch shapes_3d - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.4Harness: Deconvolution Batch shapes_3d - Engine: CPULinux 6.9-rc2Linux 6.8246810SE +/- 0.04472, N = 3SE +/- 0.10591, N = 155.782026.16576MIN: 3.81MIN: 3.751. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread

Y-Cruncher

Pi Digits To Calculate: 500M

OpenBenchmarking.orgSeconds, Fewer Is BetterY-Cruncher 0.8.3Pi Digits To Calculate: 500MLinux 6.9-rc2Linux 6.8246810SE +/- 0.083, N = 15SE +/- 0.143, N = 126.2026.483

Y-Cruncher

Pi Digits To Calculate: 1B

OpenBenchmarking.orgSeconds, Fewer Is BetterY-Cruncher 0.8.3Pi Digits To Calculate: 1BLinux 6.9-rc2Linux 6.83691215SE +/- 0.24, N = 15SE +/- 0.30, N = 1513.3413.42

Timed Mesa Compilation

Time To Compile

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed Mesa Compilation 24.0Time To CompileLinux 6.8Linux 6.9-rc2510152025SE +/- 0.51, N = 15SE +/- 0.39, N = 1519.5119.89

Timed FFmpeg Compilation

Time To Compile

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed FFmpeg Compilation 6.1Time To CompileLinux 6.8Linux 6.9-rc248121620SE +/- 0.39, N = 15SE +/- 0.39, N = 1517.2517.28

Stockfish

Chess Benchmark

OpenBenchmarking.orgNodes Per Second, More Is BetterStockfish 16.1Chess BenchmarkLinux 6.9-rc2Linux 6.814M28M42M56M70MSE +/- 2705883.43, N = 9SE +/- 2993041.97, N = 964443099619997171. (CXX) g++ options: -lgcov -m64 -lpthread -fno-exceptions -std=c++17 -fno-peel-loops -fno-tracer -pedantic -O3 -funroll-loops -msse -msse3 -mpopcnt -mavx2 -mbmi -mavx512f -mavx512bw -mavx512vnni -mavx512dq -mavx512vl -msse4.1 -mssse3 -msse2 -mbmi2 -flto -flto-partition=one -flto=jobserver

OSPRay

Benchmark: particle_volume/pathtracer/real_time

OpenBenchmarking.orgItems Per Second, More Is BetterOSPRay 3.1Benchmark: particle_volume/pathtracer/real_timeLinux 6.8Linux 6.9-rc220406080100SE +/- 1.85, N = 12SE +/- 1.98, N = 9102.9598.87

VVenC

Video Input: Bosphorus 4K - Video Preset: Faster

OpenBenchmarking.orgFrames Per Second, More Is BetterVVenC 1.11Video Input: Bosphorus 4K - Video Preset: FasterLinux 6.8Linux 6.9-rc23691215SE +/- 0.200, N = 12SE +/- 0.172, N = 159.8479.5241. (CXX) g++ options: -O3 -flto=auto -fno-fat-lto-objects

SVT-AV1

Encoder Mode: Preset 13 - Input: Bosphorus 4K

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 2.0Encoder Mode: Preset 13 - Input: Bosphorus 4KLinux 6.8Linux 6.9-rc2306090120150SE +/- 3.82, N = 12SE +/- 5.42, N = 15123.25123.101. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

SVT-AV1

Encoder Mode: Preset 12 - Input: Bosphorus 4K

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 2.0Encoder Mode: Preset 12 - Input: Bosphorus 4KLinux 6.8Linux 6.9-rc2306090120150SE +/- 5.13, N = 15SE +/- 5.21, N = 15127.20126.191. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

SVT-AV1

Encoder Mode: Preset 8 - Input: Bosphorus 4K

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 2.0Encoder Mode: Preset 8 - Input: Bosphorus 4KLinux 6.8Linux 6.9-rc21122334455SE +/- 1.10, N = 12SE +/- 1.18, N = 1548.9448.571. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

Embree

Binary: Pathtracer ISPC - Model: Asian Dragon Obj

OpenBenchmarking.orgFrames Per Second, More Is BetterEmbree 4.3Binary: Pathtracer ISPC - Model: Asian Dragon ObjLinux 6.9-rc2Linux 6.8918273645SE +/- 0.88, N = 15SE +/- 0.94, N = 1537.4336.44MIN: 27.23 / MAX: 49.01MIN: 22.56 / MAX: 49.05

Embree

Binary: Pathtracer ISPC - Model: Asian Dragon

OpenBenchmarking.orgFrames Per Second, More Is BetterEmbree 4.3Binary: Pathtracer ISPC - Model: Asian DragonLinux 6.9-rc2Linux 6.8816243240SE +/- 0.82, N = 15SE +/- 0.77, N = 1332.8331.60MIN: 22.56 / MAX: 48.16MIN: 20.8 / MAX: 52.83

Embree

Binary: Pathtracer - Model: Asian Dragon Obj

OpenBenchmarking.orgFrames Per Second, More Is BetterEmbree 4.3Binary: Pathtracer - Model: Asian Dragon ObjLinux 6.8Linux 6.9-rc2918273645SE +/- 0.92, N = 15SE +/- 0.60, N = 1539.8236.50MIN: 26.64 / MAX: 50.91MIN: 22.66 / MAX: 46.51

Embree

Binary: Pathtracer - Model: Asian Dragon

OpenBenchmarking.orgFrames Per Second, More Is BetterEmbree 4.3Binary: Pathtracer - Model: Asian DragonLinux 6.9-rc2Linux 6.8816243240SE +/- 0.54, N = 15SE +/- 0.86, N = 1535.6535.40MIN: 24.54 / MAX: 51.88MIN: 23.5 / MAX: 52.61

Embree

Binary: Pathtracer ISPC - Model: Crown

OpenBenchmarking.orgFrames Per Second, More Is BetterEmbree 4.3Binary: Pathtracer ISPC - Model: CrownLinux 6.8Linux 6.9-rc2918273645SE +/- 0.47, N = 4SE +/- 1.44, N = 1238.8435.73MIN: 30.82 / MAX: 52.25MIN: 20.32 / MAX: 57.51

Embree

Binary: Pathtracer - Model: Crown

OpenBenchmarking.orgFrames Per Second, More Is BetterEmbree 4.3Binary: Pathtracer - Model: CrownLinux 6.8Linux 6.9-rc2816243240SE +/- 0.59, N = 15SE +/- 1.07, N = 1536.6035.08MIN: 25.71 / MAX: 54.49MIN: 22.8 / MAX: 59.06

srsRAN Project

Test: PDSCH Processor Benchmark, Throughput Total

OpenBenchmarking.orgMbps, More Is BettersrsRAN Project 23.10.1-20240219Test: PDSCH Processor Benchmark, Throughput TotalLinux 6.8Linux 6.9-rc24K8K12K16K20KSE +/- 263.34, N = 15SE +/- 377.19, N = 1217006.816877.61. (CXX) g++ options: -march=native -mavx2 -mavx -msse4.1 -mfma -mavx512f -mavx512cd -mavx512bw -mavx512dq -O3 -fno-trapping-math -fno-math-errno -ldl

WebP2 Image Encode

Encode Settings: Default

OpenBenchmarking.orgMP/s, More Is BetterWebP2 Image Encode 20220823Encode Settings: DefaultLinux 6.8Linux 6.9-rc21.32752.6553.98255.316.6375SE +/- 0.11, N = 15SE +/- 0.09, N = 155.905.651. (CXX) g++ options: -msse4.2 -fno-rtti -O3 -ldl

JPEG-XL libjxl

Input: JPEG - Quality: 80

OpenBenchmarking.orgMP/s, More Is BetterJPEG-XL libjxl 0.10.1Input: JPEG - Quality: 80Linux 6.8Linux 6.9-rc2816243240SE +/- 0.51, N = 12SE +/- 0.53, N = 1534.6034.191. (CXX) g++ options: -fno-rtti -O3 -fPIE -pie -lm

FFmpeg

Encoder: libx265 - Scenario: Live

OpenBenchmarking.orgFPS, More Is BetterFFmpeg 6.1Encoder: libx265 - Scenario: LiveLinux 6.9-rc2Linux 6.8306090120150SE +/- 1.80, N = 15SE +/- 1.36, N = 15113.99112.431. (CXX) g++ options: -O3 -rdynamic -lpthread -lrt -ldl -lnuma

Geometric Mean Of All Test Results

Result Composite - Xeon Max Linux 6.9 Kernel Benchmarks

OpenBenchmarking.orgGeometric Mean, More Is BetterGeometric Mean Of All Test ResultsResult Composite - Xeon Max Linux 6.9 Kernel BenchmarksLinux 6.9-rc2Linux 6.8306090120150147.76146.99

Phoronix Test Suite v10.8.5