Xeon Max Linux 6.9 Kernel Benchmarks

2 x Intel Xeon Max 9480 benchmarks for a future article.

HTML result view exported from: https://openbenchmarking.org/result/2404035-NE-XEONMAXLI15&sgm=1&grr&sor.

Xeon Max Linux 6.9 Kernel BenchmarksProcessorMotherboardChipsetMemoryDiskGraphicsNetworkOSKernelDesktopDisplay ServerCompilerFile-SystemScreen ResolutionLinux 6.8Linux 6.9-rc22 x Intel Xeon Max 9480 @ 3.50GHz (112 Cores / 224 Threads)Supermicro SYS-221H-TNR X13DEM v1.10 (1.3 BIOS)Intel Device 1bce512GB7682GB INTEL SSDPF2KX076TZASPEED2 x Broadcom BCM57508 NetXtreme-E 10Gb/25Gb/40Gb/50Gb/100Gb/200GbUbuntu 23.106.8.0-060800-generic (x86_64)GNOME Shell 45.0X Server 1.21.1.7GCC 13.2.0ext41024x7686.9.0-060900rc2-generic (x86_64)OpenBenchmarking.orgKernel Details- Transparent Huge Pages: madviseCompiler Details- --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-bootstrap --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-link-serialization=2 --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-defaulted --enable-offload-targets=nvptx-none=/build/gcc-13-XYspKM/gcc-13-13.2.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-13-XYspKM/gcc-13-13.2.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-build-config=bootstrap-lto-lean --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v Processor Details- Scaling Governor: intel_cpufreq performance - CPU Microcode: 0x2c000290Python Details- Python 3.11.6Security Details- Linux 6.8: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Not affected - Linux 6.9-rc2: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + reg_file_data_sampling: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Not affected

Xeon Max Linux 6.9 Kernel Benchmarksmysqlslap: 1024mysqlslap: 512quicksilver: CORAL2 P2stockfish: Chess Benchmarkllama-cpp: llama-2-70b-chat.Q5_0.ggufffmpeg: libx265 - Platformblender: Barbershop - CPU-Onlyspeedb: Seq Fillffmpeg: libx265 - Video On Demandbrl-cad: VGR Performance Metricospray: particle_volume/pathtracer/real_timetensorflow: CPU - 32 - ResNet-50vvenc: Bosphorus 4K - Fastopenssl: SHA256tensorflow: CPU - 256 - ResNet-50ospray-studio: 2 - 1080p - 32 - Path Tracer - CPUtensorflow: CPU - 64 - ResNet-50tensorflow: CPU - 256 - GoogLeNetwebp2: Quality 100, Lossless Compressionllama-cpp: llama-2-13b.Q4_0.ggufospray-studio: 1 - 4K - 1 - Path Tracer - CPUffmpeg: libx265 - Livetensorflow: CPU - 1 - ResNet-50llamafile: wizardcoder-python-34b-v1.0.Q6_K - CPUbuild-linux-kernel: allmodconfigonednn: Recurrent Neural Network Training - CPUopenvino: Age Gender Recognition Retail 0013 FP16-INT8 - CPUopenvino: Age Gender Recognition Retail 0013 FP16-INT8 - CPUvvenc: Bosphorus 4K - Fasterffmpeg: libx264 - Uploadospray-studio: 3 - 1080p - 1 - Path Tracer - CPUonnx: yolov4 - CPU - Standardonnx: yolov4 - CPU - Standardonnx: fcn-resnet101-11 - CPU - Parallelonnx: fcn-resnet101-11 - CPU - Parallelonnx: bertsquad-12 - CPU - Standardonnx: bertsquad-12 - CPU - Standardonnx: ArcFace ResNet-100 - CPU - Standardonnx: ArcFace ResNet-100 - CPU - Standardospray-studio: 2 - 1080p - 16 - Path Tracer - CPUonnx: ResNet50 v1-12-int8 - CPU - Standardonnx: ResNet50 v1-12-int8 - CPU - Standardonnx: T5 Encoder - CPU - Parallelonnx: T5 Encoder - CPU - Parallelospray-studio: 1 - 4K - 32 - Path Tracer - CPUblender: Pabellon Barcelona - CPU-Onlyjpegxl: JPEG - 80ospray-studio: 3 - 4K - 32 - Path Tracer - CPUquicksilver: CORAL2 P1v-ray: CPUblender: Junkshop - CPU-Onlytensorflow: CPU - 16 - ResNet-50ffmpeg: libx265 - Uploadospray-studio: 1 - 1080p - 32 - Path Tracer - CPUffmpeg: libx264 - Platformffmpeg: libx264 - Video On Demandospray-studio: 3 - 4K - 1 - Path Tracer - CPUllamafile: mistral-7b-instruct-v0.2.Q8_0 - CPUopenvino: Age Gender Recognition Retail 0013 FP16 - CPUopenvino: Age Gender Recognition Retail 0013 FP16 - CPUonnx: GPT-2 - CPU - Parallelonnx: GPT-2 - CPU - Parallelonnx: T5 Encoder - CPU - Standardonnx: T5 Encoder - CPU - Standardtensorflow: CPU - 32 - GoogLeNetonnx: CaffeNet 12-int8 - CPU - Parallelonnx: CaffeNet 12-int8 - CPU - Parallelonnx: CaffeNet 12-int8 - CPU - Standardonnx: CaffeNet 12-int8 - CPU - Standardonnx: super-resolution-10 - CPU - Standardonnx: super-resolution-10 - CPU - Standardopenssl: SHA512jpegxl: PNG - 80tensorflow: CPU - 64 - GoogLeNetospray: gravity_spheres_volume/dim_512/scivis/real_timeospray: gravity_spheres_volume/dim_512/ao/real_timeospray: particle_volume/scivis/real_timeospray-studio: 2 - 4K - 1 - Path Tracer - CPUembree: Pathtracer ISPC - Asian Dragon Objembree: Pathtracer - Asian Dragon Objstress-ng: Matrix 3D Mathstress-ng: Pipestress-ng: Cryptoonnx: fcn-resnet101-11 - CPU - Standardonnx: fcn-resnet101-11 - CPU - Standardonednn: Recurrent Neural Network Inference - CPUstress-ng: MMAPstress-ng: Glibc C String Functionsspeedb: Read Rand Write Randstress-ng: Matrix Mathstress-ng: Fused Multiply-Addospray-studio: 2 - 4K - 16 - Path Tracer - CPUtensorflow: CPU - 16 - GoogLeNetospray-studio: 3 - 4K - 16 - Path Tracer - CPUsrsran: PDSCH Processor Benchmark, Throughput Totalcachebench: Readcachebench: Read / Modify / Writecachebench: Writeblender: Fishy Cat - CPU-Onlyospray: gravity_spheres_volume/dim_512/pathtracer/real_timeospray-studio: 2 - 4K - 32 - Path Tracer - CPUstress-ng: Vector Floating Pointstress-ng: Floating Pointstress-ng: MEMFDembree: Pathtracer - Crownembree: Pathtracer ISPC - Asian Dragonembree: Pathtracer - Asian Dragonvvenc: Bosphorus 1080p - Fasteroidn: RTLightmap.hdr.4096x4096 - CPU-Onlyjpegxl: JPEG - 90xmrig: GhostRider - 1Mstress-ng: IO_uringospray: particle_volume/ao/real_timeospray-studio: 3 - 1080p - 32 - Path Tracer - CPUbuild-mesa: Time To Compiletensorflow: CPU - 1 - GoogLeNetstress-ng: Wide Vector Mathsvt-av1: Preset 4 - Bosphorus 4Kxmrig: Monero - 1My-cruncher: 1Bstress-ng: Pthreadospray-studio: 3 - 1080p - 16 - Path Tracer - CPUstress-ng: System V Message Passingospray-studio: 1 - 1080p - 16 - Path Tracer - CPUbuild-ffmpeg: Time To Compilerocksdb: Read Rand Write Randospray-studio: 2 - 1080p - 1 - Path Tracer - CPUstress-ng: Mallocbuild-linux-kernel: defconfigopenvino: Weld Porosity Detection FP16-INT8 - CPUopenvino: Weld Porosity Detection FP16-INT8 - CPUwebp2: Quality 95, Compression Effort 7svt-av1: Preset 8 - Bosphorus 4Koidn: RT.hdr_alb_nrm.3840x2160 - CPU-Onlytensorflow: CPU - 256 - AlexNetopenvino: Face Detection FP16-INT8 - CPUopenvino: Face Detection FP16-INT8 - CPUopenvino: Noise Suppression Poconet-Like FP16 - CPUopenvino: Noise Suppression Poconet-Like FP16 - CPUstress-ng: Memory Copyingopenvino: Person Vehicle Bike Detection FP16 - CPUopenvino: Person Vehicle Bike Detection FP16 - CPUopenvino: Face Detection FP16 - CPUopenvino: Face Detection FP16 - CPUopenvino: Road Segmentation ADAS FP16-INT8 - CPUopenvino: Road Segmentation ADAS FP16-INT8 - CPUopenvino: Person Detection FP16 - CPUopenvino: Person Detection FP16 - CPUopenvino: Person Detection FP32 - CPUopenvino: Person Detection FP32 - CPUopenvino: Person Re-Identification Retail FP16 - CPUopenvino: Person Re-Identification Retail FP16 - CPUblender: BMW27 - CPU-Onlyopenvino: Machine Translation EN To DE FP16 - CPUopenvino: Machine Translation EN To DE FP16 - CPUonednn: Deconvolution Batch shapes_1d - CPUopenvino: Vehicle Detection FP16-INT8 - CPUopenvino: Vehicle Detection FP16-INT8 - CPUtensorflow: CPU - 32 - AlexNetopenvino: Road Segmentation ADAS FP16 - CPUopenvino: Road Segmentation ADAS FP16 - CPUonnx: Faster R-CNN R-50-FPN-int8 - CPU - Parallelonnx: Faster R-CNN R-50-FPN-int8 - CPU - Parallelonnx: Faster R-CNN R-50-FPN-int8 - CPU - Standardonnx: Faster R-CNN R-50-FPN-int8 - CPU - Standardopenvino: Face Detection Retail FP16 - CPUopenvino: Face Detection Retail FP16 - CPUembree: Pathtracer ISPC - Crownopenvino: Weld Porosity Detection FP16 - CPUopenvino: Weld Porosity Detection FP16 - CPUopenvino: Face Detection Retail FP16-INT8 - CPUopenvino: Face Detection Retail FP16-INT8 - CPUopenvino: Vehicle Detection FP16 - CPUopenvino: Vehicle Detection FP16 - CPUopenvino: Handwritten English Recognition FP16 - CPUopenvino: Handwritten English Recognition FP16 - CPUonnx: bertsquad-12 - CPU - Parallelonnx: bertsquad-12 - CPU - Parallelonnx: yolov4 - CPU - Parallelonnx: yolov4 - CPU - Parallelopenvino: Handwritten English Recognition FP16-INT8 - CPUopenvino: Handwritten English Recognition FP16-INT8 - CPUonnx: ArcFace ResNet-100 - CPU - Parallelonnx: ArcFace ResNet-100 - CPU - Parallelspeedb: Rand Fillspeedb: Rand Fill Syncspeedb: Update Randrocksdb: Overwriterocksdb: Update Randonnx: ResNet50 v1-12-int8 - CPU - Parallelonnx: ResNet50 v1-12-int8 - CPU - Parallelspeedb: Rand Readonnx: super-resolution-10 - CPU - Parallelonnx: super-resolution-10 - CPU - Parallelopenssl: RSA4096openssl: RSA4096rocksdb: Rand Readstress-ng: Context Switchingospray-studio: 1 - 1080p - 1 - Path Tracer - CPUblender: Classroom - CPU-Onlytensorflow: CPU - 16 - AlexNettensorflow: CPU - 64 - AlexNetffmpeg: libx264 - Livey-cruncher: 500Mospray-studio: 1 - 4K - 16 - Path Tracer - CPUwebp2: Quality 75, Compression Effort 7hackbench: 16 - Threadvvenc: Bosphorus 1080p - Fastjpegxl: PNG - 90primesieve: 1e13svt-av1: Preset 12 - Bosphorus 4Konednn: IP Shapes 1D - CPUstress-ng: NUMAxmrig: CryptoNight-Femto UPX2 - 1Mxmrig: CryptoNight-Heavy - 1Msvt-av1: Preset 13 - Bosphorus 4Kxmrig: KawPow - 1Msvt-av1: Preset 4 - Bosphorus 1080pgromacs: MPI CPU - water_GMX50_barexmrig: Wownero - 1Mstress-ng: Mutexstress-ng: Socket Activitystress-ng: Zlibstress-ng: Mixed Schedulerstress-ng: Glibc Qsort Data Sortingstress-ng: Semaphoresstress-ng: CPU Stressstress-ng: SENDFILEstress-ng: Pollstress-ng: Hashstress-ng: AVL Treestress-ng: Vector Shufflehackbench: 32 - Processcompress-lz4: 9 - Decompression Speedcompress-lz4: 9 - Compression Speedcompress-lz4: 3 - Decompression Speedcompress-lz4: 3 - Compression Speedjpegxl-decode: Allcompress-lz4: 1 - Decompression Speedcompress-lz4: 1 - Compression Speedwebp2: Defaulttensorflow: CPU - 1 - AlexNetjpegxl: PNG - 100jpegxl: JPEG - 100onednn: Convolution Batch Shapes Auto - CPUoidn: RT.ldr_alb_nrm.3840x2160 - CPU-Onlyhackbench: 16 - Processencode-wavpack: WAV To WavPackonednn: IP Shapes 3D - CPUdraco: Church Facadewebp2: Quality 100, Compression Effort 5onednn: Deconvolution Batch shapes_3d - CPUprimesieve: 1e12draco: LionLinux 6.8Linux 6.9-rc234866677333619997170.3642.74271.9932763744.803906839102.950135.304.9028467842066770.101483647.03202.370.071.481801112.431.880.79307.5024821.320.38121702.129.84711.50569122.2368.22351747.0841.3599470.956614.265642.781923.461374029.01538111.57065.41191185.2946136376.2034.6047217268146675985245.6024.1222.311386742.7642.9421084.500.7867789.259.80514101.9012.89501353.57396.313.42357292.1731.84807541.8274.88181205.4142994073574032.477135.1810.5041210.7021229.2815186136.435939.817731442.6930377557.97143967.24231.2844.43649748.4956169.3680643523.241181758384748.54204365411.593531758.504065717006.813344.69962099112.69926093036.30241538.0924.280563514234669.7429600.02688.2636.601131.595735.403333.9861.0632.5629592.33468957.5929.73361720419.5116.055874353.635.86532361.213.41639599.26873217859304.38690917.2452120844501163551396.4038.4624.0526732.880.3448.9432.28723.16337.21331.2323.684621.3221085.1017.526336.78307.74119.9277.341446.4281.90451.1382.87445.909.5911638.5121.8254.98671.6618.337722.065067.40346.1036.281018.4742.683323.427630.820932.45039.9211260.9838.83506.8516147.577.1715532.5414.582530.0430.853626.4192.746710.7817126.3847.9132129.613777.5659.602116.783232649925744629218038801035982510.609894.24873804193896.55011152.6351358616.438204.636049851820343491.5246653.98213.35495.72181.516.483344120.6414.67915.91330.96939.619127.2024.50055482.6233002.232856.3123.24632860.818.66212.08536096.628490133.2847927.759670.3770407.961866.58154589461.19202073.081798203.1210389186.0217071694.52810.19576905.9224.7483537.032.613364.898.43386.2323601.0602.695.9017.2325.66626.0029.006212.3213.1126.3494.7985377478.356.165763.356612936866689667644430990.3740.20279.7433016744.24399180298.869034.864.9368167828417670.531541547.96203.630.071.531774113.991.900.77311.74510195.750.38119735.579.52411.51570112.4288.90936668.6991.5030065.996015.411041.504824.232875068.23121122.6015.10755196.0766116275.5634.1877336769166675899546.5624.8022.241380742.7742.8821644.580.7173754.749.46496105.78272.48234402.66997.533.40972293.0291.74973571.1904.67811213.7372966549905333.045128.7110.823610.509029.0693183937.433536.503031460.4229814480.67147978.33184.7855.41259753.3646427.3385035507.551175562392750.09200468629.323542258.833979416877.613341.46732598711.07694793862.76331139.3725.171263529230503.3429139.60688.7635.078832.829735.650733.0941.0433.8889602.73346567.8028.87541668719.8885.985908316.035.76033015.513.33535919.64855218740350.56680417.2832068588489161652700.0937.6983.8927790.240.3348.5682.23711.74337.78330.7323.974600.9520605.3917.586306.42302.77121.9377.571442.2179.23466.4579.00467.799.6511564.7822.0254.83673.4618.027522.125052.71341.9735.141051.3043.151123.172729.110734.35129.8911295.9235.73486.7616349.057.1415589.5913.892656.4231.013608.2194.333010.6006124.3768.0414230.203704.3856.947817.562332281625960329341439196836150210.511995.14413758374796.51127153.5641396904.038147.436158608319390362.9047853.82210.71471.88182.126.202349530.6114.29816.15230.12839.461126.1874.51166487.6032993.832826.1123.09833072.518.93411.76436180.728934422.1646123.329446.0770036.201858.70150005776.47200671.701900682.0810232390.4117199190.09808.99569593.0027.9943492.032.663349.698.41381.6573628.0602.545.6518.2825.60725.9608.810432.2213.3576.3404.8424577628.455.782023.2996054OpenBenchmarking.org

MariaDB mariadb-slap

Clients: 1024

OpenBenchmarking.orgQueries Per Second, More Is BetterMariaDB mariadb-slap 11.5Clients: 1024Linux 6.9-rc2Linux 6.8816243240SE +/- 1.41, N = 6SE +/- 1.23, N = 936341. (CXX) g++ options: -fPIC -pie -fstack-protector -O3 -shared -lrt -lpthread -lz -ldl -lm -lstdc++

MariaDB mariadb-slap

Clients: 512

OpenBenchmarking.orgQueries Per Second, More Is BetterMariaDB mariadb-slap 11.5Clients: 512Linux 6.9-rc2Linux 6.820406080100SE +/- 0.87, N = 9SE +/- 0.41, N = 386861. (CXX) g++ options: -fPIC -pie -fstack-protector -O3 -shared -lrt -lpthread -lz -ldl -lm -lstdc++

Quicksilver

Input: CORAL2 P2

OpenBenchmarking.orgFigure Of Merit, More Is BetterQuicksilver 20230818Input: CORAL2 P2Linux 6.9-rc2Linux 6.81.4M2.8M4.2M5.6M7MSE +/- 91964.82, N = 9SE +/- 74194.56, N = 9668966766773331. (CXX) g++ options: -fopenmp -O3 -march=native

Stockfish

Chess Benchmark

OpenBenchmarking.orgNodes Per Second, More Is BetterStockfish 16.1Chess BenchmarkLinux 6.9-rc2Linux 6.814M28M42M56M70MSE +/- 2705883.43, N = 9SE +/- 2993041.97, N = 964443099619997171. (CXX) g++ options: -lgcov -m64 -lpthread -fno-exceptions -std=c++17 -fno-peel-loops -fno-tracer -pedantic -O3 -funroll-loops -msse -msse3 -mpopcnt -mavx2 -mbmi -mavx512f -mavx512bw -mavx512vnni -mavx512dq -mavx512vl -msse4.1 -mssse3 -msse2 -mbmi2 -flto -flto-partition=one -flto=jobserver

Llama.cpp

Model: llama-2-70b-chat.Q5_0.gguf

OpenBenchmarking.orgTokens Per Second, More Is BetterLlama.cpp b1808Model: llama-2-70b-chat.Q5_0.ggufLinux 6.9-rc2Linux 6.80.08330.16660.24990.33320.4165SE +/- 0.00, N = 3SE +/- 0.00, N = 30.370.361. (CXX) g++ options: -std=c++11 -fPIC -O3 -pthread -march=native -mtune=native -lopenblas

FFmpeg

Encoder: libx265 - Scenario: Platform

OpenBenchmarking.orgFPS, More Is BetterFFmpeg 6.1Encoder: libx265 - Scenario: PlatformLinux 6.8Linux 6.9-rc21020304050SE +/- 0.71, N = 12SE +/- 0.46, N = 1242.7440.201. (CXX) g++ options: -O3 -rdynamic -lpthread -lrt -ldl -lnuma

Blender

Blend File: Barbershop - Compute: CPU-Only

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 4.1Blend File: Barbershop - Compute: CPU-OnlyLinux 6.8Linux 6.9-rc260120180240300SE +/- 6.20, N = 8SE +/- 6.67, N = 9271.99279.74

Speedb

Test: Sequential Fill

OpenBenchmarking.orgOp/s, More Is BetterSpeedb 2.7Test: Sequential FillLinux 6.9-rc2Linux 6.870K140K210K280K350KSE +/- 1955.03, N = 3SE +/- 1183.38, N = 33301673276371. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti -lpthread

FFmpeg

Encoder: libx265 - Scenario: Video On Demand

OpenBenchmarking.orgFPS, More Is BetterFFmpeg 6.1Encoder: libx265 - Scenario: Video On DemandLinux 6.8Linux 6.9-rc21020304050SE +/- 0.50, N = 12SE +/- 0.76, N = 944.8044.241. (CXX) g++ options: -O3 -rdynamic -lpthread -lrt -ldl -lnuma

BRL-CAD

VGR Performance Metric

OpenBenchmarking.orgVGR Performance Metric, More Is BetterBRL-CAD 7.38.2VGR Performance MetricLinux 6.9-rc2Linux 6.8900K1800K2700K3600K4500K399180239068391. (CXX) g++ options: -std=c++17 -pipe -fvisibility=hidden -fno-strict-aliasing -fno-common -fexceptions -ftemplate-depth-128 -m64 -ggdb3 -O3 -fipa-pta -fstrength-reduce -finline-functions -flto -ltcl8.6 -lnetpbm -lregex_brl -lz_brl -lassimp -ldl -lm -ltk8.6

OSPRay

Benchmark: particle_volume/pathtracer/real_time

OpenBenchmarking.orgItems Per Second, More Is BetterOSPRay 3.1Benchmark: particle_volume/pathtracer/real_timeLinux 6.8Linux 6.9-rc220406080100SE +/- 1.85, N = 12SE +/- 1.98, N = 9102.9598.87

TensorFlow

Device: CPU - Batch Size: 32 - Model: ResNet-50

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.16.1Device: CPU - Batch Size: 32 - Model: ResNet-50Linux 6.8Linux 6.9-rc2816243240SE +/- 0.48, N = 15SE +/- 0.42, N = 1535.3034.86

VVenC

Video Input: Bosphorus 4K - Video Preset: Fast

OpenBenchmarking.orgFrames Per Second, More Is BetterVVenC 1.11Video Input: Bosphorus 4K - Video Preset: FastLinux 6.9-rc2Linux 6.81.11062.22123.33184.44245.553SE +/- 0.077, N = 12SE +/- 0.075, N = 104.9364.9021. (CXX) g++ options: -O3 -flto=auto -fno-fat-lto-objects

OpenSSL

Algorithm: SHA256

OpenBenchmarking.orgbyte/s, More Is BetterOpenSSLAlgorithm: SHA256Linux 6.8Linux 6.9-rc220000M40000M60000M80000M100000MSE +/- 767626108.54, N = 3SE +/- 717052715.91, N = 1284678420667816782841761. OpenSSL 3.0.10 1 Aug 2023 (Library: OpenSSL 3.0.10 1 Aug 2023)

TensorFlow

Device: CPU - Batch Size: 256 - Model: ResNet-50

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.16.1Device: CPU - Batch Size: 256 - Model: ResNet-50Linux 6.9-rc2Linux 6.81632486480SE +/- 0.47, N = 3SE +/- 0.38, N = 370.5370.10

OSPRay Studio

Camera: 2 - Resolution: 1080p - Samples Per Pixel: 32 - Renderer: Path Tracer - Acceleration: CPU

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 1.0Camera: 2 - Resolution: 1080p - Samples Per Pixel: 32 - Renderer: Path Tracer - Acceleration: CPULinux 6.8Linux 6.9-rc23K6K9K12K15KSE +/- 268.32, N = 12SE +/- 235.77, N = 151483615415

TensorFlow

Device: CPU - Batch Size: 64 - Model: ResNet-50

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.16.1Device: CPU - Batch Size: 64 - Model: ResNet-50Linux 6.9-rc2Linux 6.81122334455SE +/- 0.42, N = 3SE +/- 0.54, N = 1247.9647.03

TensorFlow

Device: CPU - Batch Size: 256 - Model: GoogLeNet

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.16.1Device: CPU - Batch Size: 256 - Model: GoogLeNetLinux 6.9-rc2Linux 6.84080120160200SE +/- 1.95, N = 3SE +/- 2.20, N = 12203.63202.37

WebP2 Image Encode

Encode Settings: Quality 100, Lossless Compression

OpenBenchmarking.orgMP/s, More Is BetterWebP2 Image Encode 20220823Encode Settings: Quality 100, Lossless CompressionLinux 6.9-rc2Linux 6.80.01580.03160.04740.06320.079SE +/- 0.00, N = 3SE +/- 0.00, N = 30.070.071. (CXX) g++ options: -msse4.2 -fno-rtti -O3 -ldl

Llama.cpp

Model: llama-2-13b.Q4_0.gguf

OpenBenchmarking.orgTokens Per Second, More Is BetterLlama.cpp b1808Model: llama-2-13b.Q4_0.ggufLinux 6.9-rc2Linux 6.80.34430.68861.03291.37721.7215SE +/- 0.02, N = 3SE +/- 0.01, N = 31.531.481. (CXX) g++ options: -std=c++11 -fPIC -O3 -pthread -march=native -mtune=native -lopenblas

OSPRay Studio

Camera: 1 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path Tracer - Acceleration: CPU

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 1.0Camera: 1 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path Tracer - Acceleration: CPULinux 6.9-rc2Linux 6.8400800120016002000SE +/- 22.91, N = 15SE +/- 40.26, N = 1517741801

FFmpeg

Encoder: libx265 - Scenario: Live

OpenBenchmarking.orgFPS, More Is BetterFFmpeg 6.1Encoder: libx265 - Scenario: LiveLinux 6.9-rc2Linux 6.8306090120150SE +/- 1.80, N = 15SE +/- 1.36, N = 15113.99112.431. (CXX) g++ options: -O3 -rdynamic -lpthread -lrt -ldl -lnuma

TensorFlow

Device: CPU - Batch Size: 1 - Model: ResNet-50

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.16.1Device: CPU - Batch Size: 1 - Model: ResNet-50Linux 6.9-rc2Linux 6.80.42750.8551.28251.712.1375SE +/- 0.03, N = 15SE +/- 0.03, N = 151.901.88

Llamafile

Test: wizardcoder-python-34b-v1.0.Q6_K - Acceleration: CPU

OpenBenchmarking.orgTokens Per Second, More Is BetterLlamafile 0.6Test: wizardcoder-python-34b-v1.0.Q6_K - Acceleration: CPULinux 6.8Linux 6.9-rc20.17780.35560.53340.71120.889SE +/- 0.01, N = 4SE +/- 0.00, N = 30.790.77

Timed Linux Kernel Compilation

Build: allmodconfig

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed Linux Kernel Compilation 6.8Build: allmodconfigLinux 6.8Linux 6.9-rc270140210280350SE +/- 3.84, N = 3SE +/- 1.26, N = 3307.50311.75

oneDNN

Harness: Recurrent Neural Network Training - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.4Harness: Recurrent Neural Network Training - Engine: CPULinux 6.8Linux 6.9-rc22K4K6K8K10KSE +/- 22.69, N = 3SE +/- 498.89, N = 134821.3210195.75MIN: 4659.99MIN: 4568.31. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread

OpenVINO

Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPULinux 6.8Linux 6.9-rc20.08550.1710.25650.3420.4275SE +/- 0.01, N = 15SE +/- 0.00, N = 150.380.38MIN: 0.23 / MAX: 46.5MIN: 0.24 / MAX: 50.651. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPULinux 6.8Linux 6.9-rc230K60K90K120K150KSE +/- 1455.69, N = 15SE +/- 1149.56, N = 15121702.12119735.571. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

VVenC

Video Input: Bosphorus 4K - Video Preset: Faster

OpenBenchmarking.orgFrames Per Second, More Is BetterVVenC 1.11Video Input: Bosphorus 4K - Video Preset: FasterLinux 6.8Linux 6.9-rc23691215SE +/- 0.200, N = 12SE +/- 0.172, N = 159.8479.5241. (CXX) g++ options: -O3 -flto=auto -fno-fat-lto-objects

FFmpeg

Encoder: libx264 - Scenario: Upload

OpenBenchmarking.orgFPS, More Is BetterFFmpeg 6.1Encoder: libx264 - Scenario: UploadLinux 6.9-rc2Linux 6.83691215SE +/- 0.01, N = 3SE +/- 0.01, N = 311.5111.501. (CXX) g++ options: -O3 -rdynamic -lpthread -lrt -ldl -lnuma

OSPRay Studio

Camera: 3 - Resolution: 1080p - Samples Per Pixel: 1 - Renderer: Path Tracer - Acceleration: CPU

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 1.0Camera: 3 - Resolution: 1080p - Samples Per Pixel: 1 - Renderer: Path Tracer - Acceleration: CPULinux 6.8Linux 6.9-rc2120240360480600SE +/- 4.36, N = 15SE +/- 4.85, N = 15569570

ONNX Runtime

Model: yolov4 - Device: CPU - Executor: Standard

OpenBenchmarking.orgInference Time Cost (ms), Fewer Is BetterONNX Runtime 1.17Model: yolov4 - Device: CPU - Executor: StandardLinux 6.9-rc2Linux 6.8306090120150SE +/- 1.33, N = 13SE +/- 2.31, N = 15112.43122.241. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

ONNX Runtime

Model: yolov4 - Device: CPU - Executor: Standard

OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.17Model: yolov4 - Device: CPU - Executor: StandardLinux 6.9-rc2Linux 6.8246810SE +/- 0.10643, N = 13SE +/- 0.16273, N = 158.909368.223511. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

ONNX Runtime

Model: fcn-resnet101-11 - Device: CPU - Executor: Parallel

OpenBenchmarking.orgInference Time Cost (ms), Fewer Is BetterONNX Runtime 1.17Model: fcn-resnet101-11 - Device: CPU - Executor: ParallelLinux 6.9-rc2Linux 6.8160320480640800SE +/- 14.65, N = 12SE +/- 25.74, N = 15668.70747.081. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

ONNX Runtime

Model: fcn-resnet101-11 - Device: CPU - Executor: Parallel

OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.17Model: fcn-resnet101-11 - Device: CPU - Executor: ParallelLinux 6.9-rc2Linux 6.80.33820.67641.01461.35281.691SE +/- 0.03151, N = 12SE +/- 0.04472, N = 151.503001.359941. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

ONNX Runtime

Model: bertsquad-12 - Device: CPU - Executor: Standard

OpenBenchmarking.orgInference Time Cost (ms), Fewer Is BetterONNX Runtime 1.17Model: bertsquad-12 - Device: CPU - Executor: StandardLinux 6.9-rc2Linux 6.81632486480SE +/- 2.28, N = 15SE +/- 2.24, N = 1266.0070.961. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

ONNX Runtime

Model: bertsquad-12 - Device: CPU - Executor: Standard

OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.17Model: bertsquad-12 - Device: CPU - Executor: StandardLinux 6.9-rc2Linux 6.848121620SE +/- 0.54, N = 15SE +/- 0.50, N = 1215.4114.271. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

ONNX Runtime

Model: ArcFace ResNet-100 - Device: CPU - Executor: Standard

OpenBenchmarking.orgInference Time Cost (ms), Fewer Is BetterONNX Runtime 1.17Model: ArcFace ResNet-100 - Device: CPU - Executor: StandardLinux 6.9-rc2Linux 6.81020304050SE +/- 0.86, N = 15SE +/- 0.81, N = 1241.5042.781. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

ONNX Runtime

Model: ArcFace ResNet-100 - Device: CPU - Executor: Standard

OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.17Model: ArcFace ResNet-100 - Device: CPU - Executor: StandardLinux 6.9-rc2Linux 6.8612182430SE +/- 0.48, N = 15SE +/- 0.43, N = 1224.2323.461. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

OSPRay Studio

Camera: 2 - Resolution: 1080p - Samples Per Pixel: 16 - Renderer: Path Tracer - Acceleration: CPU

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 1.0Camera: 2 - Resolution: 1080p - Samples Per Pixel: 16 - Renderer: Path Tracer - Acceleration: CPULinux 6.8Linux 6.9-rc216003200480064008000SE +/- 105.66, N = 3SE +/- 118.69, N = 1574027506

ONNX Runtime

Model: ResNet50 v1-12-int8 - Device: CPU - Executor: Standard

OpenBenchmarking.orgInference Time Cost (ms), Fewer Is BetterONNX Runtime 1.17Model: ResNet50 v1-12-int8 - Device: CPU - Executor: StandardLinux 6.9-rc2Linux 6.83691215SE +/- 0.21896, N = 15SE +/- 0.20919, N = 128.231219.015381. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

ONNX Runtime

Model: ResNet50 v1-12-int8 - Device: CPU - Executor: Standard

OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.17Model: ResNet50 v1-12-int8 - Device: CPU - Executor: StandardLinux 6.9-rc2Linux 6.8306090120150SE +/- 3.02, N = 15SE +/- 2.58, N = 12122.60111.571. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

ONNX Runtime

Model: T5 Encoder - Device: CPU - Executor: Parallel

OpenBenchmarking.orgInference Time Cost (ms), Fewer Is BetterONNX Runtime 1.17Model: T5 Encoder - Device: CPU - Executor: ParallelLinux 6.9-rc2Linux 6.81.21772.43543.65314.87086.0885SE +/- 0.06160, N = 14SE +/- 0.09595, N = 125.107555.411911. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

ONNX Runtime

Model: T5 Encoder - Device: CPU - Executor: Parallel

OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.17Model: T5 Encoder - Device: CPU - Executor: ParallelLinux 6.9-rc2Linux 6.84080120160200SE +/- 2.39, N = 14SE +/- 3.10, N = 12196.08185.291. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

OSPRay Studio

Camera: 1 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path Tracer - Acceleration: CPU

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 1.0Camera: 1 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path Tracer - Acceleration: CPULinux 6.9-rc2Linux 6.813K26K39K52K65KSE +/- 567.54, N = 7SE +/- 443.96, N = 156116261363

Blender

Blend File: Pabellon Barcelona - Compute: CPU-Only

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 4.1Blend File: Pabellon Barcelona - Compute: CPU-OnlyLinux 6.9-rc2Linux 6.820406080100SE +/- 0.61, N = 15SE +/- 0.83, N = 575.5676.20

JPEG-XL libjxl

Input: JPEG - Quality: 80

OpenBenchmarking.orgMP/s, More Is BetterJPEG-XL libjxl 0.10.1Input: JPEG - Quality: 80Linux 6.8Linux 6.9-rc2816243240SE +/- 0.51, N = 12SE +/- 0.53, N = 1534.6034.191. (CXX) g++ options: -fno-rtti -O3 -fPIE -pie -lm

OSPRay Studio

Camera: 3 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path Tracer - Acceleration: CPU

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 1.0Camera: 3 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path Tracer - Acceleration: CPULinux 6.8Linux 6.9-rc216K32K48K64K80KSE +/- 506.90, N = 3SE +/- 855.02, N = 157217273367

Quicksilver

Input: CORAL2 P1

OpenBenchmarking.orgFigure Of Merit, More Is BetterQuicksilver 20230818Input: CORAL2 P1Linux 6.9-rc2Linux 6.81.5M3M4.5M6M7.5MSE +/- 46491.34, N = 3SE +/- 67589.78, N = 6691666768146671. (CXX) g++ options: -fopenmp -O3 -march=native

Chaos Group V-RAY

Mode: CPU

OpenBenchmarking.orgvsamples, More Is BetterChaos Group V-RAY 6.0Mode: CPULinux 6.8Linux 6.9-rc213K26K39K52K65KSE +/- 530.58, N = 15SE +/- 557.85, N = 35985258995

Blender

Blend File: Junkshop - Compute: CPU-Only

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 4.1Blend File: Junkshop - Compute: CPU-OnlyLinux 6.8Linux 6.9-rc21122334455SE +/- 0.47, N = 15SE +/- 0.40, N = 1545.6046.56

TensorFlow

Device: CPU - Batch Size: 16 - Model: ResNet-50

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.16.1Device: CPU - Batch Size: 16 - Model: ResNet-50Linux 6.9-rc2Linux 6.8612182430SE +/- 0.28, N = 15SE +/- 0.30, N = 324.8024.12

FFmpeg

Encoder: libx265 - Scenario: Upload

OpenBenchmarking.orgFPS, More Is BetterFFmpeg 6.1Encoder: libx265 - Scenario: UploadLinux 6.8Linux 6.9-rc2510152025SE +/- 0.31, N = 3SE +/- 0.26, N = 422.3122.241. (CXX) g++ options: -O3 -rdynamic -lpthread -lrt -ldl -lnuma

OSPRay Studio

Camera: 1 - Resolution: 1080p - Samples Per Pixel: 32 - Renderer: Path Tracer - Acceleration: CPU

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 1.0Camera: 1 - Resolution: 1080p - Samples Per Pixel: 32 - Renderer: Path Tracer - Acceleration: CPULinux 6.9-rc2Linux 6.83K6K9K12K15KSE +/- 180.26, N = 3SE +/- 112.81, N = 91380713867

FFmpeg

Encoder: libx264 - Scenario: Platform

OpenBenchmarking.orgFPS, More Is BetterFFmpeg 6.1Encoder: libx264 - Scenario: PlatformLinux 6.9-rc2Linux 6.81020304050SE +/- 0.10, N = 3SE +/- 0.17, N = 342.7742.761. (CXX) g++ options: -O3 -rdynamic -lpthread -lrt -ldl -lnuma

FFmpeg

Encoder: libx264 - Scenario: Video On Demand

OpenBenchmarking.orgFPS, More Is BetterFFmpeg 6.1Encoder: libx264 - Scenario: Video On DemandLinux 6.8Linux 6.9-rc21020304050SE +/- 0.06, N = 3SE +/- 0.10, N = 342.9442.881. (CXX) g++ options: -O3 -rdynamic -lpthread -lrt -ldl -lnuma

OSPRay Studio

Camera: 3 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path Tracer - Acceleration: CPU

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 1.0Camera: 3 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path Tracer - Acceleration: CPULinux 6.8Linux 6.9-rc25001000150020002500SE +/- 21.99, N = 4SE +/- 26.16, N = 1321082164

Llamafile

Test: mistral-7b-instruct-v0.2.Q8_0 - Acceleration: CPU

OpenBenchmarking.orgTokens Per Second, More Is BetterLlamafile 0.6Test: mistral-7b-instruct-v0.2.Q8_0 - Acceleration: CPULinux 6.9-rc2Linux 6.81.03052.0613.09154.1225.1525SE +/- 0.03, N = 3SE +/- 0.04, N = 34.584.50

OpenVINO

Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Age Gender Recognition Retail 0013 FP16 - Device: CPULinux 6.9-rc2Linux 6.80.17550.3510.52650.7020.8775SE +/- 0.03, N = 3SE +/- 0.01, N = 150.710.78MIN: 0.32 / MAX: 74.71MIN: 0.3 / MAX: 138.081. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Age Gender Recognition Retail 0013 FP16 - Device: CPULinux 6.9-rc2Linux 6.816K32K48K64K80KSE +/- 1055.18, N = 3SE +/- 711.41, N = 1573754.7467789.251. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

ONNX Runtime

Model: GPT-2 - Device: CPU - Executor: Parallel

OpenBenchmarking.orgInference Time Cost (ms), Fewer Is BetterONNX Runtime 1.17Model: GPT-2 - Device: CPU - Executor: ParallelLinux 6.9-rc2Linux 6.83691215SE +/- 0.12308, N = 15SE +/- 0.11034, N = 39.464969.805141. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

ONNX Runtime

Model: GPT-2 - Device: CPU - Executor: Parallel

OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.17Model: GPT-2 - Device: CPU - Executor: ParallelLinux 6.9-rc2Linux 6.820406080100SE +/- 1.34, N = 15SE +/- 1.16, N = 3105.78101.901. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

ONNX Runtime

Model: T5 Encoder - Device: CPU - Executor: Standard

OpenBenchmarking.orgInference Time Cost (ms), Fewer Is BetterONNX Runtime 1.17Model: T5 Encoder - Device: CPU - Executor: StandardLinux 6.9-rc2Linux 6.80.65141.30281.95422.60563.257SE +/- 0.01855, N = 3SE +/- 0.12453, N = 152.482342.895011. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

ONNX Runtime

Model: T5 Encoder - Device: CPU - Executor: Standard

OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.17Model: T5 Encoder - Device: CPU - Executor: StandardLinux 6.9-rc2Linux 6.890180270360450SE +/- 3.01, N = 3SE +/- 14.02, N = 15402.67353.571. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

TensorFlow

Device: CPU - Batch Size: 32 - Model: GoogLeNet

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.16.1Device: CPU - Batch Size: 32 - Model: GoogLeNetLinux 6.9-rc2Linux 6.820406080100SE +/- 1.10, N = 15SE +/- 1.27, N = 1297.5396.31

ONNX Runtime

Model: CaffeNet 12-int8 - Device: CPU - Executor: Parallel

OpenBenchmarking.orgInference Time Cost (ms), Fewer Is BetterONNX Runtime 1.17Model: CaffeNet 12-int8 - Device: CPU - Executor: ParallelLinux 6.9-rc2Linux 6.80.77031.54062.31093.08123.8515SE +/- 0.02459, N = 3SE +/- 0.03367, N = 153.409723.423571. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

ONNX Runtime

Model: CaffeNet 12-int8 - Device: CPU - Executor: Parallel

OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.17Model: CaffeNet 12-int8 - Device: CPU - Executor: ParallelLinux 6.9-rc2Linux 6.860120180240300SE +/- 2.09, N = 3SE +/- 2.79, N = 15293.03292.171. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

ONNX Runtime

Model: CaffeNet 12-int8 - Device: CPU - Executor: Standard

OpenBenchmarking.orgInference Time Cost (ms), Fewer Is BetterONNX Runtime 1.17Model: CaffeNet 12-int8 - Device: CPU - Executor: StandardLinux 6.9-rc2Linux 6.80.41580.83161.24741.66322.079SE +/- 0.01721, N = 3SE +/- 0.02432, N = 151.749731.848071. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

ONNX Runtime

Model: CaffeNet 12-int8 - Device: CPU - Executor: Standard

OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.17Model: CaffeNet 12-int8 - Device: CPU - Executor: StandardLinux 6.9-rc2Linux 6.8120240360480600SE +/- 5.63, N = 3SE +/- 6.47, N = 15571.19541.831. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

ONNX Runtime

Model: super-resolution-10 - Device: CPU - Executor: Standard

OpenBenchmarking.orgInference Time Cost (ms), Fewer Is BetterONNX Runtime 1.17Model: super-resolution-10 - Device: CPU - Executor: StandardLinux 6.9-rc2Linux 6.81.09842.19683.29524.39365.492SE +/- 0.01745, N = 3SE +/- 0.07270, N = 154.678114.881811. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

ONNX Runtime

Model: super-resolution-10 - Device: CPU - Executor: Standard

OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.17Model: super-resolution-10 - Device: CPU - Executor: StandardLinux 6.9-rc2Linux 6.850100150200250SE +/- 0.80, N = 3SE +/- 2.99, N = 15213.74205.411. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

OpenSSL

Algorithm: SHA512

OpenBenchmarking.orgbyte/s, More Is BetterOpenSSLAlgorithm: SHA512Linux 6.8Linux 6.9-rc26000M12000M18000M24000M30000MSE +/- 92272355.83, N = 3SE +/- 252323355.66, N = 329940735740296654990531. OpenSSL 3.0.10 1 Aug 2023 (Library: OpenSSL 3.0.10 1 Aug 2023)

JPEG-XL libjxl

Input: PNG - Quality: 80

OpenBenchmarking.orgMP/s, More Is BetterJPEG-XL libjxl 0.10.1Input: PNG - Quality: 80Linux 6.9-rc2Linux 6.8816243240SE +/- 0.36, N = 15SE +/- 0.38, N = 333.0532.481. (CXX) g++ options: -fno-rtti -O3 -fPIE -pie -lm

TensorFlow

Device: CPU - Batch Size: 64 - Model: GoogLeNet

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.16.1Device: CPU - Batch Size: 64 - Model: GoogLeNetLinux 6.8Linux 6.9-rc2306090120150SE +/- 0.94, N = 3SE +/- 1.70, N = 15135.18128.71

OSPRay

Benchmark: gravity_spheres_volume/dim_512/scivis/real_time

OpenBenchmarking.orgItems Per Second, More Is BetterOSPRay 3.1Benchmark: gravity_spheres_volume/dim_512/scivis/real_timeLinux 6.9-rc2Linux 6.83691215SE +/- 0.07, N = 3SE +/- 0.08, N = 1510.8210.50

OSPRay

Benchmark: gravity_spheres_volume/dim_512/ao/real_time

OpenBenchmarking.orgItems Per Second, More Is BetterOSPRay 3.1Benchmark: gravity_spheres_volume/dim_512/ao/real_timeLinux 6.8Linux 6.9-rc23691215SE +/- 0.14, N = 15SE +/- 0.05, N = 310.7010.51

OSPRay

Benchmark: particle_volume/scivis/real_time

OpenBenchmarking.orgItems Per Second, More Is BetterOSPRay 3.1Benchmark: particle_volume/scivis/real_timeLinux 6.8Linux 6.9-rc2714212835SE +/- 0.26, N = 3SE +/- 0.33, N = 329.2829.07

OSPRay Studio

Camera: 2 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path Tracer - Acceleration: CPU

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 1.0Camera: 2 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path Tracer - Acceleration: CPULinux 6.9-rc2Linux 6.8400800120016002000SE +/- 26.21, N = 3SE +/- 13.93, N = 1118391861

Embree

Binary: Pathtracer ISPC - Model: Asian Dragon Obj

OpenBenchmarking.orgFrames Per Second, More Is BetterEmbree 4.3Binary: Pathtracer ISPC - Model: Asian Dragon ObjLinux 6.9-rc2Linux 6.8918273645SE +/- 0.88, N = 15SE +/- 0.94, N = 1537.4336.44MIN: 27.23 / MAX: 49.01MIN: 22.56 / MAX: 49.05

Embree

Binary: Pathtracer - Model: Asian Dragon Obj

OpenBenchmarking.orgFrames Per Second, More Is BetterEmbree 4.3Binary: Pathtracer - Model: Asian Dragon ObjLinux 6.8Linux 6.9-rc2918273645SE +/- 0.92, N = 15SE +/- 0.60, N = 1539.8236.50MIN: 26.64 / MAX: 50.91MIN: 22.66 / MAX: 46.51

Stress-NG

Test: Matrix 3D Math

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Matrix 3D MathLinux 6.9-rc2Linux 6.87K14K21K28K35KSE +/- 437.41, N = 15SE +/- 669.33, N = 1531460.4231442.691. (CXX) g++ options: -lm -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lpthread -lrt -lsctp -lz

Stress-NG

Test: Pipe

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: PipeLinux 6.8Linux 6.9-rc27M14M21M28M35MSE +/- 749025.19, N = 15SE +/- 2106194.07, N = 1530377557.9729814480.671. (CXX) g++ options: -lm -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lpthread -lrt -lsctp -lz

Stress-NG

Test: Crypto

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: CryptoLinux 6.9-rc2Linux 6.830K60K90K120K150KSE +/- 2039.96, N = 15SE +/- 1720.03, N = 15147978.33143967.241. (CXX) g++ options: -lm -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lpthread -lrt -lsctp -lz

ONNX Runtime

Model: fcn-resnet101-11 - Device: CPU - Executor: Standard

OpenBenchmarking.orgInference Time Cost (ms), Fewer Is BetterONNX Runtime 1.17Model: fcn-resnet101-11 - Device: CPU - Executor: StandardLinux 6.9-rc2Linux 6.850100150200250SE +/- 1.80, N = 3SE +/- 11.46, N = 12184.79231.281. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

ONNX Runtime

Model: fcn-resnet101-11 - Device: CPU - Executor: Standard

OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.17Model: fcn-resnet101-11 - Device: CPU - Executor: StandardLinux 6.9-rc2Linux 6.81.21782.43563.65344.87126.089SE +/- 0.05231, N = 3SE +/- 0.20811, N = 125.412594.436491. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

oneDNN

Harness: Recurrent Neural Network Inference - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.4Harness: Recurrent Neural Network Inference - Engine: CPULinux 6.8Linux 6.9-rc2160320480640800SE +/- 7.46, N = 3SE +/- 6.16, N = 9748.50753.36MIN: 677.68MIN: 652.831. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread

Stress-NG

Test: MMAP

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: MMAPLinux 6.9-rc2Linux 6.814002800420056007000SE +/- 66.09, N = 15SE +/- 70.88, N = 146427.336169.361. (CXX) g++ options: -lm -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lpthread -lrt -lsctp -lz

Stress-NG

Test: Glibc C String Functions

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Glibc C String FunctionsLinux 6.9-rc2Linux 6.820M40M60M80M100MSE +/- 1504028.14, N = 15SE +/- 2138024.53, N = 1385035507.5580643523.241. (CXX) g++ options: -lm -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lpthread -lrt -lsctp -lz

Speedb

Test: Read Random Write Random

OpenBenchmarking.orgOp/s, More Is BetterSpeedb 2.7Test: Read Random Write RandomLinux 6.8Linux 6.9-rc2300K600K900K1200K1500KSE +/- 8674.90, N = 11SE +/- 13609.90, N = 3118175811755621. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti -lpthread

Stress-NG

Test: Matrix Math

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Matrix MathLinux 6.9-rc2Linux 6.880K160K240K320K400KSE +/- 9278.38, N = 12SE +/- 4925.11, N = 15392750.09384748.541. (CXX) g++ options: -lm -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lpthread -lrt -lsctp -lz

Stress-NG

Test: Fused Multiply-Add

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Fused Multiply-AddLinux 6.8Linux 6.9-rc240M80M120M160M200MSE +/- 6187723.80, N = 12SE +/- 3824188.11, N = 15204365411.59200468629.321. (CXX) g++ options: -lm -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lpthread -lrt -lsctp -lz

OSPRay Studio

Camera: 2 - Resolution: 4K - Samples Per Pixel: 16 - Renderer: Path Tracer - Acceleration: CPU

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 1.0Camera: 2 - Resolution: 4K - Samples Per Pixel: 16 - Renderer: Path Tracer - Acceleration: CPULinux 6.8Linux 6.9-rc28K16K24K32K40KSE +/- 302.37, N = 15SE +/- 483.46, N = 33531735422

TensorFlow

Device: CPU - Batch Size: 16 - Model: GoogLeNet

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.16.1Device: CPU - Batch Size: 16 - Model: GoogLeNetLinux 6.9-rc2Linux 6.81326395265SE +/- 1.24, N = 12SE +/- 1.31, N = 1258.8358.50

OSPRay Studio

Camera: 3 - Resolution: 4K - Samples Per Pixel: 16 - Renderer: Path Tracer - Acceleration: CPU

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 1.0Camera: 3 - Resolution: 4K - Samples Per Pixel: 16 - Renderer: Path Tracer - Acceleration: CPULinux 6.9-rc2Linux 6.89K18K27K36K45KSE +/- 252.89, N = 3SE +/- 626.71, N = 123979440657

srsRAN Project

Test: PDSCH Processor Benchmark, Throughput Total

OpenBenchmarking.orgMbps, More Is BettersrsRAN Project 23.10.1-20240219Test: PDSCH Processor Benchmark, Throughput TotalLinux 6.8Linux 6.9-rc24K8K12K16K20KSE +/- 263.34, N = 15SE +/- 377.19, N = 1217006.816877.61. (CXX) g++ options: -march=native -mavx2 -mavx -msse4.1 -mfma -mavx512f -mavx512cd -mavx512bw -mavx512dq -O3 -fno-trapping-math -fno-math-errno -ldl

CacheBench

Test: Read

OpenBenchmarking.orgMB/s, More Is BetterCacheBenchTest: ReadLinux 6.8Linux 6.9-rc23K6K9K12K15KSE +/- 0.52, N = 3SE +/- 0.88, N = 313344.7013341.47MIN: 13338.06 / MAX: 13346.23MIN: 13335.31 / MAX: 13343.851. (CC) gcc options: -O3 -lrt

CacheBench

Test: Read / Modify / Write

OpenBenchmarking.orgMB/s, More Is BetterCacheBenchTest: Read / Modify / WriteLinux 6.8Linux 6.9-rc220K40K60K80K100KSE +/- 2.71, N = 3SE +/- 71.07, N = 399112.7098711.08MIN: 88982.6 / MAX: 105154.55MIN: 85707.72 / MAX: 105115.441. (CC) gcc options: -O3 -lrt

CacheBench

Test: Write

OpenBenchmarking.orgMB/s, More Is BetterCacheBenchTest: WriteLinux 6.9-rc2Linux 6.820K40K60K80K100KSE +/- 65.10, N = 3SE +/- 36.95, N = 393862.7693036.30MIN: 54012.69 / MAX: 104121.12MIN: 54037.87 / MAX: 103869.491. (CC) gcc options: -O3 -lrt

Blender

Blend File: Fishy Cat - Compute: CPU-Only

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 4.1Blend File: Fishy Cat - Compute: CPU-OnlyLinux 6.8Linux 6.9-rc2918273645SE +/- 0.38, N = 15SE +/- 0.44, N = 438.0939.37

OSPRay

Benchmark: gravity_spheres_volume/dim_512/pathtracer/real_time

OpenBenchmarking.orgItems Per Second, More Is BetterOSPRay 3.1Benchmark: gravity_spheres_volume/dim_512/pathtracer/real_timeLinux 6.9-rc2Linux 6.8612182430SE +/- 0.20, N = 3SE +/- 0.41, N = 1225.1724.28

OSPRay Studio

Camera: 2 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path Tracer - Acceleration: CPU

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 1.0Camera: 2 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path Tracer - Acceleration: CPULinux 6.8Linux 6.9-rc214K28K42K56K70KSE +/- 591.53, N = 7SE +/- 885.61, N = 36351463529

Stress-NG

Test: Vector Floating Point

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Vector Floating PointLinux 6.8Linux 6.9-rc250K100K150K200K250KSE +/- 5616.14, N = 12SE +/- 8579.53, N = 12234669.74230503.341. (CXX) g++ options: -lm -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lpthread -lrt -lsctp -lz

Stress-NG

Test: Floating Point

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Floating PointLinux 6.8Linux 6.9-rc26K12K18K24K30KSE +/- 632.70, N = 12SE +/- 214.66, N = 1129600.0229139.601. (CXX) g++ options: -lm -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lpthread -lrt -lsctp -lz

Stress-NG

Test: MEMFD

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: MEMFDLinux 6.9-rc2Linux 6.8150300450600750SE +/- 5.94, N = 8SE +/- 14.68, N = 15688.76688.261. (CXX) g++ options: -lm -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lpthread -lrt -lsctp -lz

Embree

Binary: Pathtracer - Model: Crown

OpenBenchmarking.orgFrames Per Second, More Is BetterEmbree 4.3Binary: Pathtracer - Model: CrownLinux 6.8Linux 6.9-rc2816243240SE +/- 0.59, N = 15SE +/- 1.07, N = 1536.6035.08MIN: 25.71 / MAX: 54.49MIN: 22.8 / MAX: 59.06

Embree

Binary: Pathtracer ISPC - Model: Asian Dragon

OpenBenchmarking.orgFrames Per Second, More Is BetterEmbree 4.3Binary: Pathtracer ISPC - Model: Asian DragonLinux 6.9-rc2Linux 6.8816243240SE +/- 0.82, N = 15SE +/- 0.77, N = 1332.8331.60MIN: 22.56 / MAX: 48.16MIN: 20.8 / MAX: 52.83

Embree

Binary: Pathtracer - Model: Asian Dragon

OpenBenchmarking.orgFrames Per Second, More Is BetterEmbree 4.3Binary: Pathtracer - Model: Asian DragonLinux 6.9-rc2Linux 6.8816243240SE +/- 0.54, N = 15SE +/- 0.86, N = 1535.6535.40MIN: 24.54 / MAX: 51.88MIN: 23.5 / MAX: 52.61

VVenC

Video Input: Bosphorus 1080p - Video Preset: Faster

OpenBenchmarking.orgFrames Per Second, More Is BetterVVenC 1.11Video Input: Bosphorus 1080p - Video Preset: FasterLinux 6.8Linux 6.9-rc2816243240SE +/- 0.29, N = 15SE +/- 0.36, N = 1533.9933.091. (CXX) g++ options: -O3 -flto=auto -fno-fat-lto-objects

Intel Open Image Denoise

Run: RTLightmap.hdr.4096x4096 - Device: CPU-Only

OpenBenchmarking.orgImages / Sec, More Is BetterIntel Open Image Denoise 2.2Run: RTLightmap.hdr.4096x4096 - Device: CPU-OnlyLinux 6.8Linux 6.9-rc20.23850.4770.71550.9541.1925SE +/- 0.01, N = 7SE +/- 0.01, N = 151.061.04

JPEG-XL libjxl

Input: JPEG - Quality: 90

OpenBenchmarking.orgMP/s, More Is BetterJPEG-XL libjxl 0.10.1Input: JPEG - Quality: 90Linux 6.9-rc2Linux 6.8816243240SE +/- 0.38, N = 15SE +/- 0.37, N = 333.8932.561. (CXX) g++ options: -fno-rtti -O3 -fPIE -pie -lm

Xmrig

Variant: GhostRider - Hash Count: 1M

OpenBenchmarking.orgH/s, More Is BetterXmrig 6.21Variant: GhostRider - Hash Count: 1MLinux 6.9-rc2Linux 6.82K4K6K8K10KSE +/- 42.79, N = 3SE +/- 31.05, N = 39602.79592.31. (CXX) g++ options: -fexceptions -fno-rtti -maes -O3 -Ofast -static-libgcc -static-libstdc++ -rdynamic -lssl -lcrypto -luv -lpthread -lrt -ldl -lhwloc

Stress-NG

Test: IO_uring

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: IO_uringLinux 6.8Linux 6.9-rc2700K1400K2100K2800K3500KSE +/- 31595.27, N = 3SE +/- 43339.28, N = 153468957.593346567.801. (CXX) g++ options: -lm -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lpthread -lrt -lsctp -lz

OSPRay

Benchmark: particle_volume/ao/real_time

OpenBenchmarking.orgItems Per Second, More Is BetterOSPRay 3.1Benchmark: particle_volume/ao/real_timeLinux 6.8Linux 6.9-rc2714212835SE +/- 0.11, N = 3SE +/- 0.19, N = 329.7328.88

OSPRay Studio

Camera: 3 - Resolution: 1080p - Samples Per Pixel: 32 - Renderer: Path Tracer - Acceleration: CPU

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 1.0Camera: 3 - Resolution: 1080p - Samples Per Pixel: 32 - Renderer: Path Tracer - Acceleration: CPULinux 6.9-rc2Linux 6.84K8K12K16K20KSE +/- 156.23, N = 6SE +/- 101.18, N = 31668717204

Timed Mesa Compilation

Time To Compile

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed Mesa Compilation 24.0Time To CompileLinux 6.8Linux 6.9-rc2510152025SE +/- 0.51, N = 15SE +/- 0.39, N = 1519.5119.89

TensorFlow

Device: CPU - Batch Size: 1 - Model: GoogLeNet

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.16.1Device: CPU - Batch Size: 1 - Model: GoogLeNetLinux 6.8Linux 6.9-rc2246810SE +/- 0.13, N = 12SE +/- 0.14, N = 156.055.98

Stress-NG

Test: Wide Vector Math

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Wide Vector MathLinux 6.9-rc2Linux 6.81.3M2.6M3.9M5.2M6.5MSE +/- 55746.31, N = 15SE +/- 72950.92, N = 45908316.035874353.631. (CXX) g++ options: -lm -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lpthread -lrt -lsctp -lz

SVT-AV1

Encoder Mode: Preset 4 - Input: Bosphorus 4K

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 2.0Encoder Mode: Preset 4 - Input: Bosphorus 4KLinux 6.8Linux 6.9-rc21.31962.63923.95885.27846.598SE +/- 0.035, N = 3SE +/- 0.051, N = 155.8655.7601. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

Xmrig

Variant: Monero - Hash Count: 1M

OpenBenchmarking.orgH/s, More Is BetterXmrig 6.21Variant: Monero - Hash Count: 1MLinux 6.9-rc2Linux 6.87K14K21K28K35KSE +/- 181.84, N = 3SE +/- 320.50, N = 1333015.532361.21. (CXX) g++ options: -fexceptions -fno-rtti -maes -O3 -Ofast -static-libgcc -static-libstdc++ -rdynamic -lssl -lcrypto -luv -lpthread -lrt -ldl -lhwloc

Y-Cruncher

Pi Digits To Calculate: 1B

OpenBenchmarking.orgSeconds, Fewer Is BetterY-Cruncher 0.8.3Pi Digits To Calculate: 1BLinux 6.9-rc2Linux 6.83691215SE +/- 0.24, N = 15SE +/- 0.30, N = 1513.3413.42

Stress-NG

Test: Pthread

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: PthreadLinux 6.8Linux 6.9-rc28K16K24K32K40KSE +/- 49.70, N = 3SE +/- 450.35, N = 1539599.2635919.641. (CXX) g++ options: -lm -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lpthread -lrt -lsctp -lz

OSPRay Studio

Camera: 3 - Resolution: 1080p - Samples Per Pixel: 16 - Renderer: Path Tracer - Acceleration: CPU

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 1.0Camera: 3 - Resolution: 1080p - Samples Per Pixel: 16 - Renderer: Path Tracer - Acceleration: CPULinux 6.9-rc2Linux 6.82K4K6K8K10KSE +/- 26.21, N = 3SE +/- 70.21, N = 385528732

Stress-NG

Test: System V Message Passing

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: System V Message PassingLinux 6.9-rc2Linux 6.84M8M12M16M20MSE +/- 35075.39, N = 3SE +/- 189741.33, N = 1518740350.5617859304.381. (CXX) g++ options: -lm -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lpthread -lrt -lsctp -lz

OSPRay Studio

Camera: 1 - Resolution: 1080p - Samples Per Pixel: 16 - Renderer: Path Tracer - Acceleration: CPU

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 1.0Camera: 1 - Resolution: 1080p - Samples Per Pixel: 16 - Renderer: Path Tracer - Acceleration: CPULinux 6.9-rc2Linux 6.815003000450060007500SE +/- 15.17, N = 3SE +/- 83.68, N = 368046909

Timed FFmpeg Compilation

Time To Compile

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed FFmpeg Compilation 6.1Time To CompileLinux 6.8Linux 6.9-rc248121620SE +/- 0.39, N = 15SE +/- 0.39, N = 1517.2517.28

RocksDB

Test: Read Random Write Random

OpenBenchmarking.orgOp/s, More Is BetterRocksDB 9.0Test: Read Random Write RandomLinux 6.8Linux 6.9-rc2500K1000K1500K2000K2500KSE +/- 17412.72, N = 3SE +/- 22543.45, N = 5212084420685881. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti -lpthread

OSPRay Studio

Camera: 2 - Resolution: 1080p - Samples Per Pixel: 1 - Renderer: Path Tracer - Acceleration: CPU

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 1.0Camera: 2 - Resolution: 1080p - Samples Per Pixel: 1 - Renderer: Path Tracer - Acceleration: CPULinux 6.9-rc2Linux 6.8110220330440550SE +/- 2.33, N = 3SE +/- 5.26, N = 5489501

Stress-NG

Test: Malloc

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: MallocLinux 6.8Linux 6.9-rc240M80M120M160M200MSE +/- 201545.00, N = 3SE +/- 3675496.40, N = 12163551396.40161652700.091. (CXX) g++ options: -lm -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lpthread -lrt -lsctp -lz

Timed Linux Kernel Compilation

Build: defconfig

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed Linux Kernel Compilation 6.8Build: defconfigLinux 6.9-rc2Linux 6.8918273645SE +/- 0.37, N = 6SE +/- 0.36, N = 637.7038.46

OpenVINO

Model: Weld Porosity Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Weld Porosity Detection FP16-INT8 - Device: CPULinux 6.9-rc2Linux 6.80.91131.82262.73393.64524.5565SE +/- 0.01, N = 3SE +/- 0.05, N = 43.894.05MIN: 2.64 / MAX: 47.09MIN: 2.67 / MAX: 52.431. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Weld Porosity Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Weld Porosity Detection FP16-INT8 - Device: CPULinux 6.9-rc2Linux 6.86K12K18K24K30KSE +/- 155.42, N = 3SE +/- 285.82, N = 427790.2426732.881. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

WebP2 Image Encode

Encode Settings: Quality 95, Compression Effort 7

OpenBenchmarking.orgMP/s, More Is BetterWebP2 Image Encode 20220823Encode Settings: Quality 95, Compression Effort 7Linux 6.8Linux 6.9-rc20.07650.1530.22950.3060.3825SE +/- 0.00, N = 3SE +/- 0.00, N = 30.340.331. (CXX) g++ options: -msse4.2 -fno-rtti -O3 -ldl

SVT-AV1

Encoder Mode: Preset 8 - Input: Bosphorus 4K

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 2.0Encoder Mode: Preset 8 - Input: Bosphorus 4KLinux 6.8Linux 6.9-rc21122334455SE +/- 1.10, N = 12SE +/- 1.18, N = 1548.9448.571. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

Intel Open Image Denoise

Run: RT.hdr_alb_nrm.3840x2160 - Device: CPU-Only

OpenBenchmarking.orgImages / Sec, More Is BetterIntel Open Image Denoise 2.2Run: RT.hdr_alb_nrm.3840x2160 - Device: CPU-OnlyLinux 6.8Linux 6.9-rc20.5131.0261.5392.0522.565SE +/- 0.02, N = 15SE +/- 0.02, N = 152.282.23

TensorFlow

Device: CPU - Batch Size: 256 - Model: AlexNet

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.16.1Device: CPU - Batch Size: 256 - Model: AlexNetLinux 6.8Linux 6.9-rc2160320480640800SE +/- 9.01, N = 3SE +/- 6.62, N = 7723.16711.74

OpenVINO

Model: Face Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Face Detection FP16-INT8 - Device: CPULinux 6.8Linux 6.9-rc270140210280350SE +/- 0.74, N = 3SE +/- 0.81, N = 3337.21337.78MIN: 261.24 / MAX: 615.09MIN: 253.21 / MAX: 781.061. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Face Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Face Detection FP16-INT8 - Device: CPULinux 6.8Linux 6.9-rc270140210280350SE +/- 0.75, N = 3SE +/- 0.82, N = 3331.23330.731. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Noise Suppression Poconet-Like FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Noise Suppression Poconet-Like FP16 - Device: CPULinux 6.8Linux 6.9-rc2612182430SE +/- 0.17, N = 3SE +/- 0.20, N = 323.6823.97MIN: 11.64 / MAX: 175.69MIN: 11.24 / MAX: 358.11. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Noise Suppression Poconet-Like FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Noise Suppression Poconet-Like FP16 - Device: CPULinux 6.8Linux 6.9-rc210002000300040005000SE +/- 54.03, N = 3SE +/- 29.05, N = 34621.324600.951. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

Stress-NG

Test: Memory Copying

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Memory CopyingLinux 6.8Linux 6.9-rc25K10K15K20K25KSE +/- 178.25, N = 3SE +/- 155.03, N = 1021085.1020605.391. (CXX) g++ options: -lm -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lpthread -lrt -lsctp -lz

OpenVINO

Model: Person Vehicle Bike Detection FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Person Vehicle Bike Detection FP16 - Device: CPULinux 6.8Linux 6.9-rc248121620SE +/- 0.06, N = 3SE +/- 0.07, N = 317.5217.58MIN: 11.97 / MAX: 108.98MIN: 12.03 / MAX: 66.231. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Person Vehicle Bike Detection FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Person Vehicle Bike Detection FP16 - Device: CPULinux 6.8Linux 6.9-rc214002800420056007000SE +/- 18.88, N = 3SE +/- 23.77, N = 36336.786306.421. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Face Detection FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Face Detection FP16 - Device: CPULinux 6.9-rc2Linux 6.870140210280350SE +/- 1.30, N = 3SE +/- 0.84, N = 3302.77307.74MIN: 181.55 / MAX: 894.73MIN: 183.58 / MAX: 728.141. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Face Detection FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Face Detection FP16 - Device: CPULinux 6.9-rc2Linux 6.8306090120150SE +/- 0.55, N = 3SE +/- 0.33, N = 3121.93119.921. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Road Segmentation ADAS FP16-INT8 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Road Segmentation ADAS FP16-INT8 - Device: CPULinux 6.8Linux 6.9-rc220406080100SE +/- 0.09, N = 3SE +/- 0.28, N = 377.3477.57MIN: 56.48 / MAX: 158.67MIN: 57.16 / MAX: 148.671. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Road Segmentation ADAS FP16-INT8 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Road Segmentation ADAS FP16-INT8 - Device: CPULinux 6.8Linux 6.9-rc230060090012001500SE +/- 1.59, N = 3SE +/- 5.16, N = 31446.421442.211. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Person Detection FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Person Detection FP16 - Device: CPULinux 6.9-rc2Linux 6.820406080100SE +/- 0.20, N = 3SE +/- 0.43, N = 379.2381.90MIN: 50.1 / MAX: 290.06MIN: 49.43 / MAX: 345.351. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Person Detection FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Person Detection FP16 - Device: CPULinux 6.9-rc2Linux 6.8100200300400500SE +/- 1.20, N = 3SE +/- 2.33, N = 3466.45451.131. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Person Detection FP32 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Person Detection FP32 - Device: CPULinux 6.9-rc2Linux 6.820406080100SE +/- 0.62, N = 3SE +/- 0.57, N = 379.0082.87MIN: 49.24 / MAX: 319.95MIN: 51.69 / MAX: 529.561. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Person Detection FP32 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Person Detection FP32 - Device: CPULinux 6.9-rc2Linux 6.8100200300400500SE +/- 3.72, N = 3SE +/- 3.09, N = 3467.79445.901. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Person Re-Identification Retail FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Person Re-Identification Retail FP16 - Device: CPULinux 6.8Linux 6.9-rc23691215SE +/- 0.02, N = 3SE +/- 0.03, N = 39.599.65MIN: 7.62 / MAX: 27.98MIN: 7.62 / MAX: 34.181. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Person Re-Identification Retail FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Person Re-Identification Retail FP16 - Device: CPULinux 6.8Linux 6.9-rc22K4K6K8K10KSE +/- 20.55, N = 3SE +/- 28.95, N = 311638.5111564.781. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

Blender

Blend File: BMW27 - Compute: CPU-Only

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 4.1Blend File: BMW27 - Compute: CPU-OnlyLinux 6.8Linux 6.9-rc2510152025SE +/- 0.33, N = 14SE +/- 0.08, N = 321.8222.02

OpenVINO

Model: Machine Translation EN To DE FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Machine Translation EN To DE FP16 - Device: CPULinux 6.9-rc2Linux 6.81224364860SE +/- 0.25, N = 3SE +/- 0.47, N = 354.8354.98MIN: 34.71 / MAX: 375.04MIN: 33.9 / MAX: 423.361. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Machine Translation EN To DE FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Machine Translation EN To DE FP16 - Device: CPULinux 6.9-rc2Linux 6.8150300450600750SE +/- 3.16, N = 3SE +/- 5.75, N = 3673.46671.661. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

oneDNN

Harness: Deconvolution Batch shapes_1d - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.4Harness: Deconvolution Batch shapes_1d - Engine: CPULinux 6.9-rc2Linux 6.8510152025SE +/- 0.14, N = 3SE +/- 0.23, N = 1518.0318.34MIN: 13.29MIN: 10.091. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread

OpenVINO

Model: Vehicle Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Vehicle Detection FP16-INT8 - Device: CPULinux 6.8Linux 6.9-rc2510152025SE +/- 0.04, N = 3SE +/- 0.08, N = 322.0622.12MIN: 15.51 / MAX: 86.25MIN: 15.73 / MAX: 71.51. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Vehicle Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Vehicle Detection FP16-INT8 - Device: CPULinux 6.8Linux 6.9-rc211002200330044005500SE +/- 9.46, N = 3SE +/- 18.34, N = 35067.405052.711. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

TensorFlow

Device: CPU - Batch Size: 32 - Model: AlexNet

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.16.1Device: CPU - Batch Size: 32 - Model: AlexNetLinux 6.8Linux 6.9-rc280160240320400SE +/- 2.86, N = 15SE +/- 5.16, N = 15346.10341.97

OpenVINO

Model: Road Segmentation ADAS FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Road Segmentation ADAS FP16 - Device: CPULinux 6.9-rc2Linux 6.8816243240SE +/- 0.23, N = 3SE +/- 0.35, N = 335.1436.28MIN: 25.25 / MAX: 437.27MIN: 24.78 / MAX: 205.051. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Road Segmentation ADAS FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Road Segmentation ADAS FP16 - Device: CPULinux 6.9-rc2Linux 6.82004006008001000SE +/- 6.69, N = 3SE +/- 9.82, N = 31051.301018.471. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

ONNX Runtime

Model: Faster R-CNN R-50-FPN-int8 - Device: CPU - Executor: Parallel

OpenBenchmarking.orgInference Time Cost (ms), Fewer Is BetterONNX Runtime 1.17Model: Faster R-CNN R-50-FPN-int8 - Device: CPU - Executor: ParallelLinux 6.8Linux 6.9-rc21020304050SE +/- 0.23, N = 3SE +/- 0.13, N = 342.6843.151. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

ONNX Runtime

Model: Faster R-CNN R-50-FPN-int8 - Device: CPU - Executor: Parallel

OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.17Model: Faster R-CNN R-50-FPN-int8 - Device: CPU - Executor: ParallelLinux 6.8Linux 6.9-rc2612182430SE +/- 0.13, N = 3SE +/- 0.07, N = 323.4323.171. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

ONNX Runtime

Model: Faster R-CNN R-50-FPN-int8 - Device: CPU - Executor: Standard

OpenBenchmarking.orgInference Time Cost (ms), Fewer Is BetterONNX Runtime 1.17Model: Faster R-CNN R-50-FPN-int8 - Device: CPU - Executor: StandardLinux 6.9-rc2Linux 6.8714212835SE +/- 0.22, N = 3SE +/- 0.38, N = 329.1130.821. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

ONNX Runtime

Model: Faster R-CNN R-50-FPN-int8 - Device: CPU - Executor: Standard

OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.17Model: Faster R-CNN R-50-FPN-int8 - Device: CPU - Executor: StandardLinux 6.9-rc2Linux 6.8816243240SE +/- 0.25, N = 3SE +/- 0.40, N = 334.3532.451. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

OpenVINO

Model: Face Detection Retail FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Face Detection Retail FP16 - Device: CPULinux 6.9-rc2Linux 6.83691215SE +/- 0.02, N = 3SE +/- 0.02, N = 39.899.92MIN: 7.63 / MAX: 36.57MIN: 7.45 / MAX: 33.821. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Face Detection Retail FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Face Detection Retail FP16 - Device: CPULinux 6.9-rc2Linux 6.82K4K6K8K10KSE +/- 26.72, N = 3SE +/- 23.83, N = 311295.9211260.981. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

Embree

Binary: Pathtracer ISPC - Model: Crown

OpenBenchmarking.orgFrames Per Second, More Is BetterEmbree 4.3Binary: Pathtracer ISPC - Model: CrownLinux 6.8Linux 6.9-rc2918273645SE +/- 0.47, N = 4SE +/- 1.44, N = 1238.8435.73MIN: 30.82 / MAX: 52.25MIN: 20.32 / MAX: 57.51

OpenVINO

Model: Weld Porosity Detection FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Weld Porosity Detection FP16 - Device: CPULinux 6.9-rc2Linux 6.8246810SE +/- 0.05, N = 3SE +/- 0.08, N = 36.766.85MIN: 4.36 / MAX: 70.91MIN: 4.47 / MAX: 51.041. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Weld Porosity Detection FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Weld Porosity Detection FP16 - Device: CPULinux 6.9-rc2Linux 6.84K8K12K16K20KSE +/- 107.94, N = 3SE +/- 194.69, N = 316349.0516147.571. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Face Detection Retail FP16-INT8 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Face Detection Retail FP16-INT8 - Device: CPULinux 6.9-rc2Linux 6.8246810SE +/- 0.00, N = 3SE +/- 0.07, N = 37.147.17MIN: 5.79 / MAX: 44.66MIN: 5.78 / MAX: 54.31. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Face Detection Retail FP16-INT8 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Face Detection Retail FP16-INT8 - Device: CPULinux 6.9-rc2Linux 6.83K6K9K12K15KSE +/- 25.09, N = 3SE +/- 132.85, N = 315589.5915532.541. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Vehicle Detection FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Vehicle Detection FP16 - Device: CPULinux 6.9-rc2Linux 6.848121620SE +/- 0.14, N = 3SE +/- 0.10, N = 313.8914.58MIN: 9.12 / MAX: 90.57MIN: 9.5 / MAX: 109.831. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Vehicle Detection FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Vehicle Detection FP16 - Device: CPULinux 6.9-rc2Linux 6.86001200180024003000SE +/- 25.96, N = 3SE +/- 16.72, N = 32656.422530.041. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Handwritten English Recognition FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Handwritten English Recognition FP16 - Device: CPULinux 6.8Linux 6.9-rc2714212835SE +/- 0.03, N = 3SE +/- 0.09, N = 330.8531.01MIN: 24.82 / MAX: 82.03MIN: 24.42 / MAX: 90.861. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Handwritten English Recognition FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Handwritten English Recognition FP16 - Device: CPULinux 6.8Linux 6.9-rc28001600240032004000SE +/- 3.14, N = 3SE +/- 10.89, N = 33626.413608.211. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

ONNX Runtime

Model: bertsquad-12 - Device: CPU - Executor: Parallel

OpenBenchmarking.orgInference Time Cost (ms), Fewer Is BetterONNX Runtime 1.17Model: bertsquad-12 - Device: CPU - Executor: ParallelLinux 6.8Linux 6.9-rc220406080100SE +/- 0.33, N = 3SE +/- 0.44, N = 392.7594.331. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

ONNX Runtime

Model: bertsquad-12 - Device: CPU - Executor: Parallel

OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.17Model: bertsquad-12 - Device: CPU - Executor: ParallelLinux 6.8Linux 6.9-rc23691215SE +/- 0.04, N = 3SE +/- 0.05, N = 310.7810.601. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

ONNX Runtime

Model: yolov4 - Device: CPU - Executor: Parallel

OpenBenchmarking.orgInference Time Cost (ms), Fewer Is BetterONNX Runtime 1.17Model: yolov4 - Device: CPU - Executor: ParallelLinux 6.9-rc2Linux 6.8306090120150SE +/- 1.32, N = 3SE +/- 1.18, N = 3124.38126.381. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

ONNX Runtime

Model: yolov4 - Device: CPU - Executor: Parallel

OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.17Model: yolov4 - Device: CPU - Executor: ParallelLinux 6.9-rc2Linux 6.8246810SE +/- 0.08546, N = 3SE +/- 0.07338, N = 38.041427.913211. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

OpenVINO

Model: Handwritten English Recognition FP16-INT8 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Handwritten English Recognition FP16-INT8 - Device: CPULinux 6.8Linux 6.9-rc2714212835SE +/- 0.08, N = 3SE +/- 0.07, N = 329.6130.20MIN: 25.51 / MAX: 92.13MIN: 22.08 / MAX: 107.871. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Handwritten English Recognition FP16-INT8 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Handwritten English Recognition FP16-INT8 - Device: CPULinux 6.8Linux 6.9-rc28001600240032004000SE +/- 10.67, N = 3SE +/- 8.36, N = 33777.563704.381. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

ONNX Runtime

Model: ArcFace ResNet-100 - Device: CPU - Executor: Parallel

OpenBenchmarking.orgInference Time Cost (ms), Fewer Is BetterONNX Runtime 1.17Model: ArcFace ResNet-100 - Device: CPU - Executor: ParallelLinux 6.9-rc2Linux 6.81326395265SE +/- 0.56, N = 3SE +/- 0.81, N = 356.9559.601. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

ONNX Runtime

Model: ArcFace ResNet-100 - Device: CPU - Executor: Parallel

OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.17Model: ArcFace ResNet-100 - Device: CPU - Executor: ParallelLinux 6.9-rc2Linux 6.848121620SE +/- 0.17, N = 3SE +/- 0.23, N = 317.5616.781. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

Speedb

Test: Random Fill

OpenBenchmarking.orgOp/s, More Is BetterSpeedb 2.7Test: Random FillLinux 6.8Linux 6.9-rc270K140K210K280K350KSE +/- 2148.02, N = 3SE +/- 3492.28, N = 33264993228161. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti -lpthread

Speedb

Test: Random Fill Sync

OpenBenchmarking.orgOp/s, More Is BetterSpeedb 2.7Test: Random Fill SyncLinux 6.9-rc2Linux 6.860K120K180K240K300KSE +/- 3603.61, N = 3SE +/- 1490.88, N = 32596032574461. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti -lpthread

Speedb

Test: Update Random

OpenBenchmarking.orgOp/s, More Is BetterSpeedb 2.7Test: Update RandomLinux 6.9-rc2Linux 6.860K120K180K240K300KSE +/- 3235.16, N = 3SE +/- 3488.80, N = 32934142921801. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti -lpthread

RocksDB

Test: Overwrite

OpenBenchmarking.orgOp/s, More Is BetterRocksDB 9.0Test: OverwriteLinux 6.9-rc2Linux 6.880K160K240K320K400KSE +/- 3053.81, N = 3SE +/- 881.98, N = 33919683880101. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti -lpthread

RocksDB

Test: Update Random

OpenBenchmarking.orgOp/s, More Is BetterRocksDB 9.0Test: Update RandomLinux 6.9-rc2Linux 6.880K160K240K320K400KSE +/- 1522.72, N = 3SE +/- 1470.46, N = 33615023598251. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti -lpthread

ONNX Runtime

Model: ResNet50 v1-12-int8 - Device: CPU - Executor: Parallel

OpenBenchmarking.orgInference Time Cost (ms), Fewer Is BetterONNX Runtime 1.17Model: ResNet50 v1-12-int8 - Device: CPU - Executor: ParallelLinux 6.9-rc2Linux 6.83691215SE +/- 0.14, N = 3SE +/- 0.10, N = 310.5110.611. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

ONNX Runtime

Model: ResNet50 v1-12-int8 - Device: CPU - Executor: Parallel

OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.17Model: ResNet50 v1-12-int8 - Device: CPU - Executor: ParallelLinux 6.9-rc2Linux 6.820406080100SE +/- 1.23, N = 3SE +/- 0.92, N = 395.1494.251. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

Speedb

Test: Random Read

OpenBenchmarking.orgOp/s, More Is BetterSpeedb 2.7Test: Random ReadLinux 6.8Linux 6.9-rc280M160M240M320M400MSE +/- 1002006.26, N = 3SE +/- 4146957.10, N = 33804193893758374791. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti -lpthread

ONNX Runtime

Model: super-resolution-10 - Device: CPU - Executor: Parallel

OpenBenchmarking.orgInference Time Cost (ms), Fewer Is BetterONNX Runtime 1.17Model: super-resolution-10 - Device: CPU - Executor: ParallelLinux 6.9-rc2Linux 6.8246810SE +/- 0.06370, N = 3SE +/- 0.04024, N = 36.511276.550111. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

ONNX Runtime

Model: super-resolution-10 - Device: CPU - Executor: Parallel

OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.17Model: super-resolution-10 - Device: CPU - Executor: ParallelLinux 6.9-rc2Linux 6.8306090120150SE +/- 1.50, N = 3SE +/- 0.93, N = 3153.56152.641. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

OpenSSL

Algorithm: RSA4096

OpenBenchmarking.orgverify/s, More Is BetterOpenSSLAlgorithm: RSA4096Linux 6.9-rc2Linux 6.8300K600K900K1200K1500KSE +/- 833.27, N = 3SE +/- 19064.62, N = 31396904.01358616.41. OpenSSL 3.0.10 1 Aug 2023 (Library: OpenSSL 3.0.10 1 Aug 2023)

OpenSSL

Algorithm: RSA4096

OpenBenchmarking.orgsign/s, More Is BetterOpenSSLAlgorithm: RSA4096Linux 6.8Linux 6.9-rc28K16K24K32K40KSE +/- 46.27, N = 3SE +/- 90.23, N = 338204.638147.41. OpenSSL 3.0.10 1 Aug 2023 (Library: OpenSSL 3.0.10 1 Aug 2023)

RocksDB

Test: Random Read

OpenBenchmarking.orgOp/s, More Is BetterRocksDB 9.0Test: Random ReadLinux 6.9-rc2Linux 6.880M160M240M320M400MSE +/- 1447290.34, N = 3SE +/- 1573786.50, N = 33615860833604985181. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti -lpthread

Stress-NG

Test: Context Switching

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Context SwitchingLinux 6.8Linux 6.9-rc24M8M12M16M20MSE +/- 178479.09, N = 8SE +/- 265846.30, N = 320343491.5219390362.901. (CXX) g++ options: -lm -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lpthread -lrt -lsctp -lz

OSPRay Studio

Camera: 1 - Resolution: 1080p - Samples Per Pixel: 1 - Renderer: Path Tracer - Acceleration: CPU

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 1.0Camera: 1 - Resolution: 1080p - Samples Per Pixel: 1 - Renderer: Path Tracer - Acceleration: CPULinux 6.8Linux 6.9-rc2100200300400500SE +/- 3.71, N = 3SE +/- 2.33, N = 3466478

Blender

Blend File: Classroom - Compute: CPU-Only

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 4.1Blend File: Classroom - Compute: CPU-OnlyLinux 6.9-rc2Linux 6.81224364860SE +/- 0.09, N = 3SE +/- 0.10, N = 353.8253.98

TensorFlow

Device: CPU - Batch Size: 16 - Model: AlexNet

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.16.1Device: CPU - Batch Size: 16 - Model: AlexNetLinux 6.8Linux 6.9-rc250100150200250SE +/- 1.58, N = 15SE +/- 1.89, N = 15213.35210.71

TensorFlow

Device: CPU - Batch Size: 64 - Model: AlexNet

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.16.1Device: CPU - Batch Size: 64 - Model: AlexNetLinux 6.8Linux 6.9-rc2110220330440550SE +/- 6.05, N = 3SE +/- 5.17, N = 15495.72471.88

FFmpeg

Encoder: libx264 - Scenario: Live

OpenBenchmarking.orgFPS, More Is BetterFFmpeg 6.1Encoder: libx264 - Scenario: LiveLinux 6.9-rc2Linux 6.84080120160200SE +/- 0.70, N = 3SE +/- 1.29, N = 3182.12181.511. (CXX) g++ options: -O3 -rdynamic -lpthread -lrt -ldl -lnuma

Y-Cruncher

Pi Digits To Calculate: 500M

OpenBenchmarking.orgSeconds, Fewer Is BetterY-Cruncher 0.8.3Pi Digits To Calculate: 500MLinux 6.9-rc2Linux 6.8246810SE +/- 0.083, N = 15SE +/- 0.143, N = 126.2026.483

OSPRay Studio

Camera: 1 - Resolution: 4K - Samples Per Pixel: 16 - Renderer: Path Tracer - Acceleration: CPU

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 1.0Camera: 1 - Resolution: 4K - Samples Per Pixel: 16 - Renderer: Path Tracer - Acceleration: CPULinux 6.8Linux 6.9-rc27K14K21K28K35KSE +/- 294.16, N = 3SE +/- 454.99, N = 33441234953

WebP2 Image Encode

Encode Settings: Quality 75, Compression Effort 7

OpenBenchmarking.orgMP/s, More Is BetterWebP2 Image Encode 20220823Encode Settings: Quality 75, Compression Effort 7Linux 6.8Linux 6.9-rc20.1440.2880.4320.5760.72SE +/- 0.01, N = 3SE +/- 0.01, N = 40.640.611. (CXX) g++ options: -msse4.2 -fno-rtti -O3 -ldl

Hackbench

Count: 16 - Type: Thread

OpenBenchmarking.orgSeconds, Fewer Is BetterHackbenchCount: 16 - Type: ThreadLinux 6.9-rc2Linux 6.848121620SE +/- 0.14, N = 15SE +/- 0.00, N = 314.3014.681. (CC) gcc options: -lpthread

VVenC

Video Input: Bosphorus 1080p - Video Preset: Fast

OpenBenchmarking.orgFrames Per Second, More Is BetterVVenC 1.11Video Input: Bosphorus 1080p - Video Preset: FastLinux 6.9-rc2Linux 6.848121620SE +/- 0.07, N = 3SE +/- 0.11, N = 316.1515.911. (CXX) g++ options: -O3 -flto=auto -fno-fat-lto-objects

JPEG-XL libjxl

Input: PNG - Quality: 90

OpenBenchmarking.orgMP/s, More Is BetterJPEG-XL libjxl 0.10.1Input: PNG - Quality: 90Linux 6.8Linux 6.9-rc2714212835SE +/- 0.28, N = 3SE +/- 0.18, N = 330.9730.131. (CXX) g++ options: -fno-rtti -O3 -fPIE -pie -lm

Primesieve

Length: 1e13

OpenBenchmarking.orgSeconds, Fewer Is BetterPrimesieve 12.1Length: 1e13Linux 6.9-rc2Linux 6.8918273645SE +/- 0.09, N = 3SE +/- 0.06, N = 339.4639.621. (CXX) g++ options: -O3

SVT-AV1

Encoder Mode: Preset 12 - Input: Bosphorus 4K

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 2.0Encoder Mode: Preset 12 - Input: Bosphorus 4KLinux 6.8Linux 6.9-rc2306090120150SE +/- 5.13, N = 15SE +/- 5.21, N = 15127.20126.191. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

oneDNN

Harness: IP Shapes 1D - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.4Harness: IP Shapes 1D - Engine: CPULinux 6.8Linux 6.9-rc21.01512.03023.04534.06045.0755SE +/- 0.04580, N = 3SE +/- 0.05180, N = 124.500554.51166MIN: 3.52MIN: 3.371. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread

Stress-NG

Test: NUMA

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: NUMALinux 6.9-rc2Linux 6.8110220330440550SE +/- 5.89, N = 4SE +/- 4.27, N = 3487.60482.621. (CXX) g++ options: -lm -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lpthread -lrt -lsctp -lz

Xmrig

Variant: CryptoNight-Femto UPX2 - Hash Count: 1M

OpenBenchmarking.orgH/s, More Is BetterXmrig 6.21Variant: CryptoNight-Femto UPX2 - Hash Count: 1MLinux 6.8Linux 6.9-rc27K14K21K28K35KSE +/- 110.64, N = 3SE +/- 170.37, N = 333002.232993.81. (CXX) g++ options: -fexceptions -fno-rtti -maes -O3 -Ofast -static-libgcc -static-libstdc++ -rdynamic -lssl -lcrypto -luv -lpthread -lrt -ldl -lhwloc

Xmrig

Variant: CryptoNight-Heavy - Hash Count: 1M

OpenBenchmarking.orgH/s, More Is BetterXmrig 6.21Variant: CryptoNight-Heavy - Hash Count: 1MLinux 6.8Linux 6.9-rc27K14K21K28K35KSE +/- 49.86, N = 3SE +/- 160.32, N = 332856.332826.11. (CXX) g++ options: -fexceptions -fno-rtti -maes -O3 -Ofast -static-libgcc -static-libstdc++ -rdynamic -lssl -lcrypto -luv -lpthread -lrt -ldl -lhwloc

SVT-AV1

Encoder Mode: Preset 13 - Input: Bosphorus 4K

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 2.0Encoder Mode: Preset 13 - Input: Bosphorus 4KLinux 6.8Linux 6.9-rc2306090120150SE +/- 3.82, N = 12SE +/- 5.42, N = 15123.25123.101. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

Xmrig

Variant: KawPow - Hash Count: 1M

OpenBenchmarking.orgH/s, More Is BetterXmrig 6.21Variant: KawPow - Hash Count: 1MLinux 6.9-rc2Linux 6.87K14K21K28K35KSE +/- 137.96, N = 3SE +/- 68.36, N = 333072.532860.81. (CXX) g++ options: -fexceptions -fno-rtti -maes -O3 -Ofast -static-libgcc -static-libstdc++ -rdynamic -lssl -lcrypto -luv -lpthread -lrt -ldl -lhwloc

SVT-AV1

Encoder Mode: Preset 4 - Input: Bosphorus 1080p

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 2.0Encoder Mode: Preset 4 - Input: Bosphorus 1080pLinux 6.9-rc2Linux 6.8510152025SE +/- 0.21, N = 3SE +/- 0.13, N = 1518.9318.661. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

GROMACS

Implementation: MPI CPU - Input: water_GMX50_bare

OpenBenchmarking.orgNs Per Day, More Is BetterGROMACS 2024Implementation: MPI CPU - Input: water_GMX50_bareLinux 6.8Linux 6.9-rc23691215SE +/- 0.06, N = 3SE +/- 0.08, N = 312.0911.761. (CXX) g++ options: -O3 -lm

Xmrig

Variant: Wownero - Hash Count: 1M

OpenBenchmarking.orgH/s, More Is BetterXmrig 6.21Variant: Wownero - Hash Count: 1MLinux 6.9-rc2Linux 6.88K16K24K32K40KSE +/- 490.33, N = 3SE +/- 245.88, N = 336180.736096.61. (CXX) g++ options: -fexceptions -fno-rtti -maes -O3 -Ofast -static-libgcc -static-libstdc++ -rdynamic -lssl -lcrypto -luv -lpthread -lrt -ldl -lhwloc

Stress-NG

Test: Mutex

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: MutexLinux 6.9-rc2Linux 6.86M12M18M24M30MSE +/- 294297.65, N = 3SE +/- 281178.86, N = 328934422.1628490133.281. (CXX) g++ options: -lm -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lpthread -lrt -lsctp -lz

Stress-NG

Test: Socket Activity

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Socket ActivityLinux 6.8Linux 6.9-rc210K20K30K40K50KSE +/- 79.93, N = 3SE +/- 21.40, N = 347927.7546123.321. (CXX) g++ options: -lm -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lpthread -lrt -lsctp -lz

Stress-NG

Test: Zlib

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: ZlibLinux 6.8Linux 6.9-rc22K4K6K8K10KSE +/- 25.13, N = 3SE +/- 124.93, N = 39670.379446.071. (CXX) g++ options: -lm -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lpthread -lrt -lsctp -lz

Stress-NG

Test: Mixed Scheduler

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Mixed SchedulerLinux 6.8Linux 6.9-rc215K30K45K60K75KSE +/- 153.71, N = 3SE +/- 281.29, N = 370407.9670036.201. (CXX) g++ options: -lm -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lpthread -lrt -lsctp -lz

Stress-NG

Test: Glibc Qsort Data Sorting

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Glibc Qsort Data SortingLinux 6.8Linux 6.9-rc2400800120016002000SE +/- 4.40, N = 3SE +/- 4.16, N = 31866.581858.701. (CXX) g++ options: -lm -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lpthread -lrt -lsctp -lz

Stress-NG

Test: Semaphores

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: SemaphoresLinux 6.8Linux 6.9-rc230M60M90M120M150MSE +/- 1498916.25, N = 3SE +/- 1330349.25, N = 3154589461.19150005776.471. (CXX) g++ options: -lm -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lpthread -lrt -lsctp -lz

Stress-NG

Test: CPU Stress

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: CPU StressLinux 6.8Linux 6.9-rc240K80K120K160K200KSE +/- 569.84, N = 3SE +/- 335.84, N = 3202073.08200671.701. (CXX) g++ options: -lm -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lpthread -lrt -lsctp -lz

Stress-NG

Test: SENDFILE

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: SENDFILELinux 6.9-rc2Linux 6.8400K800K1200K1600K2000KSE +/- 5873.31, N = 3SE +/- 609.53, N = 31900682.081798203.121. (CXX) g++ options: -lm -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lpthread -lrt -lsctp -lz

Stress-NG

Test: Poll

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: PollLinux 6.8Linux 6.9-rc22M4M6M8M10MSE +/- 37074.52, N = 3SE +/- 30731.99, N = 310389186.0210232390.411. (CXX) g++ options: -lm -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lpthread -lrt -lsctp -lz

Stress-NG

Test: Hash

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: HashLinux 6.9-rc2Linux 6.84M8M12M16M20MSE +/- 192774.29, N = 3SE +/- 82496.53, N = 317199190.0917071694.521. (CXX) g++ options: -lm -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lpthread -lrt -lsctp -lz

Stress-NG

Test: AVL Tree

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: AVL TreeLinux 6.8Linux 6.9-rc22004006008001000SE +/- 6.53, N = 3SE +/- 2.13, N = 3810.19808.991. (CXX) g++ options: -lm -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lpthread -lrt -lsctp -lz

Stress-NG

Test: Vector Shuffle

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Vector ShuffleLinux 6.8Linux 6.9-rc2120K240K360K480K600KSE +/- 1416.85, N = 3SE +/- 1897.90, N = 3576905.92569593.001. (CXX) g++ options: -lm -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lpthread -lrt -lsctp -lz

Hackbench

Count: 32 - Type: Process

OpenBenchmarking.orgSeconds, Fewer Is BetterHackbenchCount: 32 - Type: ProcessLinux 6.8Linux 6.9-rc2714212835SE +/- 0.27, N = 3SE +/- 0.39, N = 324.7527.991. (CC) gcc options: -lpthread

LZ4 Compression

Compression Level: 9 - Decompression Speed

OpenBenchmarking.orgMB/s, More Is BetterLZ4 Compression 1.9.4Compression Level: 9 - Decompression SpeedLinux 6.8Linux 6.9-rc28001600240032004000SE +/- 16.01, N = 3SE +/- 57.81, N = 33537.03492.01. (CC) gcc options: -O3

LZ4 Compression

Compression Level: 9 - Compression Speed

OpenBenchmarking.orgMB/s, More Is BetterLZ4 Compression 1.9.4Compression Level: 9 - Compression SpeedLinux 6.9-rc2Linux 6.8816243240SE +/- 0.07, N = 3SE +/- 0.08, N = 332.6632.611. (CC) gcc options: -O3

LZ4 Compression

Compression Level: 3 - Decompression Speed

OpenBenchmarking.orgMB/s, More Is BetterLZ4 Compression 1.9.4Compression Level: 3 - Decompression SpeedLinux 6.8Linux 6.9-rc27001400210028003500SE +/- 33.92, N = 3SE +/- 34.17, N = 33364.83349.61. (CC) gcc options: -O3

LZ4 Compression

Compression Level: 3 - Compression Speed

OpenBenchmarking.orgMB/s, More Is BetterLZ4 Compression 1.9.4Compression Level: 3 - Compression SpeedLinux 6.8Linux 6.9-rc220406080100SE +/- 0.06, N = 3SE +/- 0.06, N = 398.4398.411. (CC) gcc options: -O3

JPEG-XL Decoding libjxl

CPU Threads: All

OpenBenchmarking.orgMP/s, More Is BetterJPEG-XL Decoding libjxl 0.10.1CPU Threads: AllLinux 6.8Linux 6.9-rc280160240320400SE +/- 4.23, N = 3SE +/- 2.26, N = 3386.23381.66

LZ4 Compression

Compression Level: 1 - Decompression Speed

OpenBenchmarking.orgMB/s, More Is BetterLZ4 Compression 1.9.4Compression Level: 1 - Decompression SpeedLinux 6.9-rc2Linux 6.88001600240032004000SE +/- 18.57, N = 3SE +/- 44.31, N = 33628.03601.01. (CC) gcc options: -O3

LZ4 Compression

Compression Level: 1 - Compression Speed

OpenBenchmarking.orgMB/s, More Is BetterLZ4 Compression 1.9.4Compression Level: 1 - Compression SpeedLinux 6.8Linux 6.9-rc2130260390520650SE +/- 1.15, N = 3SE +/- 0.16, N = 3602.69602.541. (CC) gcc options: -O3

WebP2 Image Encode

Encode Settings: Default

OpenBenchmarking.orgMP/s, More Is BetterWebP2 Image Encode 20220823Encode Settings: DefaultLinux 6.8Linux 6.9-rc21.32752.6553.98255.316.6375SE +/- 0.11, N = 15SE +/- 0.09, N = 155.905.651. (CXX) g++ options: -msse4.2 -fno-rtti -O3 -ldl

TensorFlow

Device: CPU - Batch Size: 1 - Model: AlexNet

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.16.1Device: CPU - Batch Size: 1 - Model: AlexNetLinux 6.9-rc2Linux 6.848121620SE +/- 0.25, N = 3SE +/- 0.25, N = 1218.2817.23

JPEG-XL libjxl

Input: PNG - Quality: 100

OpenBenchmarking.orgMP/s, More Is BetterJPEG-XL libjxl 0.10.1Input: PNG - Quality: 100Linux 6.8Linux 6.9-rc2612182430SE +/- 0.15, N = 3SE +/- 0.21, N = 325.6725.611. (CXX) g++ options: -fno-rtti -O3 -fPIE -pie -lm

JPEG-XL libjxl

Input: JPEG - Quality: 100

OpenBenchmarking.orgMP/s, More Is BetterJPEG-XL libjxl 0.10.1Input: JPEG - Quality: 100Linux 6.8Linux 6.9-rc2612182430SE +/- 0.11, N = 3SE +/- 0.08, N = 326.0025.961. (CXX) g++ options: -fno-rtti -O3 -fPIE -pie -lm

oneDNN

Harness: Convolution Batch Shapes Auto - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.4Harness: Convolution Batch Shapes Auto - Engine: CPULinux 6.9-rc2Linux 6.83691215SE +/- 0.09863, N = 15SE +/- 0.03328, N = 38.810439.00621MIN: 6.25MIN: 8.121. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread

Intel Open Image Denoise

Run: RT.ldr_alb_nrm.3840x2160 - Device: CPU-Only

OpenBenchmarking.orgImages / Sec, More Is BetterIntel Open Image Denoise 2.2Run: RT.ldr_alb_nrm.3840x2160 - Device: CPU-OnlyLinux 6.8Linux 6.9-rc20.5221.0441.5662.0882.61SE +/- 0.03, N = 3SE +/- 0.03, N = 32.322.22

Hackbench

Count: 16 - Type: Process

OpenBenchmarking.orgSeconds, Fewer Is BetterHackbenchCount: 16 - Type: ProcessLinux 6.8Linux 6.9-rc23691215SE +/- 0.11, N = 3SE +/- 0.19, N = 313.1113.361. (CC) gcc options: -lpthread

WavPack Audio Encoding

WAV To WavPack

OpenBenchmarking.orgSeconds, Fewer Is BetterWavPack Audio Encoding 5.7WAV To WavPackLinux 6.9-rc2Linux 6.8246810SE +/- 0.019, N = 5SE +/- 0.023, N = 56.3406.349

oneDNN

Harness: IP Shapes 3D - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.4Harness: IP Shapes 3D - Engine: CPULinux 6.8Linux 6.9-rc21.08962.17923.26884.35845.448SE +/- 0.02352, N = 3SE +/- 0.02357, N = 34.798534.84245MIN: 3.98MIN: 4.011. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread

Google Draco

Model: Church Facade

OpenBenchmarking.orgms, Fewer Is BetterGoogle Draco 1.5.6Model: Church FacadeLinux 6.8Linux 6.9-rc217003400510068008500SE +/- 0.88, N = 3SE +/- 9.56, N = 3774777621. (CXX) g++ options: -O3

WebP2 Image Encode

Encode Settings: Quality 100, Compression Effort 5

OpenBenchmarking.orgMP/s, More Is BetterWebP2 Image Encode 20220823Encode Settings: Quality 100, Compression Effort 5Linux 6.9-rc2Linux 6.8246810SE +/- 0.07, N = 3SE +/- 0.11, N = 158.458.351. (CXX) g++ options: -msse4.2 -fno-rtti -O3 -ldl

oneDNN

Harness: Deconvolution Batch shapes_3d - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.4Harness: Deconvolution Batch shapes_3d - Engine: CPULinux 6.9-rc2Linux 6.8246810SE +/- 0.04472, N = 3SE +/- 0.10591, N = 155.782026.16576MIN: 3.81MIN: 3.751. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread

Primesieve

Length: 1e12

OpenBenchmarking.orgSeconds, Fewer Is BetterPrimesieve 12.1Length: 1e12Linux 6.9-rc2Linux 6.80.75511.51022.26533.02043.7755SE +/- 0.044, N = 3SE +/- 0.024, N = 113.2993.3561. (CXX) g++ options: -O3

Google Draco

Model: Lion

OpenBenchmarking.orgms, Fewer Is BetterGoogle Draco 1.5.6Model: LionLinux 6.9-rc2Linux 6.813002600390052006500SE +/- 29.28, N = 3SE +/- 40.84, N = 3605461291. (CXX) g++ options: -O3

Geometric Mean Of All Test Results

Result Composite - Xeon Max Linux 6.9 Kernel Benchmarks

OpenBenchmarking.orgGeometric Mean, More Is BetterGeometric Mean Of All Test ResultsResult Composite - Xeon Max Linux 6.9 Kernel BenchmarksLinux 6.9-rc2Linux 6.8306090120150147.76146.99

Phoronix Test Suite v10.8.5