Xeon Max Linux 6.9 Kernel Benchmarks

2 x Intel Xeon Max 9480 benchmarks for a future article.

HTML result view exported from: https://openbenchmarking.org/result/2404035-NE-XEONMAXLI15&grr.

Xeon Max Linux 6.9 Kernel BenchmarksProcessorMotherboardChipsetMemoryDiskGraphicsNetworkOSKernelDesktopDisplay ServerCompilerFile-SystemScreen ResolutionLinux 6.8Linux 6.9-rc22 x Intel Xeon Max 9480 @ 3.50GHz (112 Cores / 224 Threads)Supermicro SYS-221H-TNR X13DEM v1.10 (1.3 BIOS)Intel Device 1bce512GB7682GB INTEL SSDPF2KX076TZASPEED2 x Broadcom BCM57508 NetXtreme-E 10Gb/25Gb/40Gb/50Gb/100Gb/200GbUbuntu 23.106.8.0-060800-generic (x86_64)GNOME Shell 45.0X Server 1.21.1.7GCC 13.2.0ext41024x7686.9.0-060900rc2-generic (x86_64)OpenBenchmarking.orgKernel Details- Transparent Huge Pages: madviseCompiler Details- --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-bootstrap --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-link-serialization=2 --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-defaulted --enable-offload-targets=nvptx-none=/build/gcc-13-XYspKM/gcc-13-13.2.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-13-XYspKM/gcc-13-13.2.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-build-config=bootstrap-lto-lean --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v Processor Details- Scaling Governor: intel_cpufreq performance - CPU Microcode: 0x2c000290Python Details- Python 3.11.6Security Details- Linux 6.8: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Not affected - Linux 6.9-rc2: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + reg_file_data_sampling: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Not affected

Xeon Max Linux 6.9 Kernel Benchmarksmysqlslap: 1024mysqlslap: 512quicksilver: CORAL2 P2stockfish: Chess Benchmarkllama-cpp: llama-2-70b-chat.Q5_0.ggufffmpeg: libx265 - Platformblender: Barbershop - CPU-Onlyspeedb: Seq Fillffmpeg: libx265 - Video On Demandbrl-cad: VGR Performance Metricospray: particle_volume/pathtracer/real_timetensorflow: CPU - 32 - ResNet-50vvenc: Bosphorus 4K - Fastopenssl: SHA256tensorflow: CPU - 256 - ResNet-50ospray-studio: 2 - 1080p - 32 - Path Tracer - CPUtensorflow: CPU - 64 - ResNet-50tensorflow: CPU - 256 - GoogLeNetwebp2: Quality 100, Lossless Compressionllama-cpp: llama-2-13b.Q4_0.ggufospray-studio: 1 - 4K - 1 - Path Tracer - CPUffmpeg: libx265 - Livetensorflow: CPU - 1 - ResNet-50llamafile: wizardcoder-python-34b-v1.0.Q6_K - CPUbuild-linux-kernel: allmodconfigonednn: Recurrent Neural Network Training - CPUopenvino: Age Gender Recognition Retail 0013 FP16-INT8 - CPUopenvino: Age Gender Recognition Retail 0013 FP16-INT8 - CPUvvenc: Bosphorus 4K - Fasterffmpeg: libx264 - Uploadospray-studio: 3 - 1080p - 1 - Path Tracer - CPUonnx: yolov4 - CPU - Standardonnx: yolov4 - CPU - Standardonnx: fcn-resnet101-11 - CPU - Parallelonnx: fcn-resnet101-11 - CPU - Parallelonnx: bertsquad-12 - CPU - Standardonnx: bertsquad-12 - CPU - Standardonnx: ArcFace ResNet-100 - CPU - Standardonnx: ArcFace ResNet-100 - CPU - Standardospray-studio: 2 - 1080p - 16 - Path Tracer - CPUonnx: ResNet50 v1-12-int8 - CPU - Standardonnx: ResNet50 v1-12-int8 - CPU - Standardonnx: T5 Encoder - CPU - Parallelonnx: T5 Encoder - CPU - Parallelospray-studio: 1 - 4K - 32 - Path Tracer - CPUblender: Pabellon Barcelona - CPU-Onlyjpegxl: JPEG - 80ospray-studio: 3 - 4K - 32 - Path Tracer - CPUquicksilver: CORAL2 P1v-ray: CPUblender: Junkshop - CPU-Onlytensorflow: CPU - 16 - ResNet-50ffmpeg: libx265 - Uploadospray-studio: 1 - 1080p - 32 - Path Tracer - CPUffmpeg: libx264 - Platformffmpeg: libx264 - Video On Demandospray-studio: 3 - 4K - 1 - Path Tracer - CPUllamafile: mistral-7b-instruct-v0.2.Q8_0 - CPUopenvino: Age Gender Recognition Retail 0013 FP16 - CPUopenvino: Age Gender Recognition Retail 0013 FP16 - CPUonnx: GPT-2 - CPU - Parallelonnx: GPT-2 - CPU - Parallelonnx: T5 Encoder - CPU - Standardonnx: T5 Encoder - CPU - Standardtensorflow: CPU - 32 - GoogLeNetonnx: CaffeNet 12-int8 - CPU - Parallelonnx: CaffeNet 12-int8 - CPU - Parallelonnx: CaffeNet 12-int8 - CPU - Standardonnx: CaffeNet 12-int8 - CPU - Standardonnx: super-resolution-10 - CPU - Standardonnx: super-resolution-10 - CPU - Standardopenssl: SHA512jpegxl: PNG - 80tensorflow: CPU - 64 - GoogLeNetospray: gravity_spheres_volume/dim_512/scivis/real_timeospray: gravity_spheres_volume/dim_512/ao/real_timeospray: particle_volume/scivis/real_timeospray-studio: 2 - 4K - 1 - Path Tracer - CPUembree: Pathtracer ISPC - Asian Dragon Objembree: Pathtracer - Asian Dragon Objstress-ng: Matrix 3D Mathstress-ng: Pipestress-ng: Cryptoonnx: fcn-resnet101-11 - CPU - Standardonnx: fcn-resnet101-11 - CPU - Standardonednn: Recurrent Neural Network Inference - CPUstress-ng: MMAPstress-ng: Glibc C String Functionsspeedb: Read Rand Write Randstress-ng: Matrix Mathstress-ng: Fused Multiply-Addospray-studio: 2 - 4K - 16 - Path Tracer - CPUtensorflow: CPU - 16 - GoogLeNetospray-studio: 3 - 4K - 16 - Path Tracer - CPUsrsran: PDSCH Processor Benchmark, Throughput Totalcachebench: Readcachebench: Read / Modify / Writecachebench: Writeblender: Fishy Cat - CPU-Onlyospray: gravity_spheres_volume/dim_512/pathtracer/real_timeospray-studio: 2 - 4K - 32 - Path Tracer - CPUstress-ng: Vector Floating Pointstress-ng: Floating Pointstress-ng: MEMFDembree: Pathtracer - Crownembree: Pathtracer ISPC - Asian Dragonembree: Pathtracer - Asian Dragonvvenc: Bosphorus 1080p - Fasteroidn: RTLightmap.hdr.4096x4096 - CPU-Onlyjpegxl: JPEG - 90xmrig: GhostRider - 1Mstress-ng: IO_uringospray: particle_volume/ao/real_timeospray-studio: 3 - 1080p - 32 - Path Tracer - CPUbuild-mesa: Time To Compiletensorflow: CPU - 1 - GoogLeNetstress-ng: Wide Vector Mathsvt-av1: Preset 4 - Bosphorus 4Kxmrig: Monero - 1My-cruncher: 1Bstress-ng: Pthreadospray-studio: 3 - 1080p - 16 - Path Tracer - CPUstress-ng: System V Message Passingospray-studio: 1 - 1080p - 16 - Path Tracer - CPUbuild-ffmpeg: Time To Compilerocksdb: Read Rand Write Randospray-studio: 2 - 1080p - 1 - Path Tracer - CPUstress-ng: Mallocbuild-linux-kernel: defconfigopenvino: Weld Porosity Detection FP16-INT8 - CPUopenvino: Weld Porosity Detection FP16-INT8 - CPUwebp2: Quality 95, Compression Effort 7svt-av1: Preset 8 - Bosphorus 4Koidn: RT.hdr_alb_nrm.3840x2160 - CPU-Onlytensorflow: CPU - 256 - AlexNetopenvino: Face Detection FP16-INT8 - CPUopenvino: Face Detection FP16-INT8 - CPUopenvino: Noise Suppression Poconet-Like FP16 - CPUopenvino: Noise Suppression Poconet-Like FP16 - CPUstress-ng: Memory Copyingopenvino: Person Vehicle Bike Detection FP16 - CPUopenvino: Person Vehicle Bike Detection FP16 - CPUopenvino: Face Detection FP16 - CPUopenvino: Face Detection FP16 - CPUopenvino: Road Segmentation ADAS FP16-INT8 - CPUopenvino: Road Segmentation ADAS FP16-INT8 - CPUopenvino: Person Detection FP16 - CPUopenvino: Person Detection FP16 - CPUopenvino: Person Detection FP32 - CPUopenvino: Person Detection FP32 - CPUopenvino: Person Re-Identification Retail FP16 - CPUopenvino: Person Re-Identification Retail FP16 - CPUblender: BMW27 - CPU-Onlyopenvino: Machine Translation EN To DE FP16 - CPUopenvino: Machine Translation EN To DE FP16 - CPUonednn: Deconvolution Batch shapes_1d - CPUopenvino: Vehicle Detection FP16-INT8 - CPUopenvino: Vehicle Detection FP16-INT8 - CPUtensorflow: CPU - 32 - AlexNetopenvino: Road Segmentation ADAS FP16 - CPUopenvino: Road Segmentation ADAS FP16 - CPUonnx: Faster R-CNN R-50-FPN-int8 - CPU - Parallelonnx: Faster R-CNN R-50-FPN-int8 - CPU - Parallelonnx: Faster R-CNN R-50-FPN-int8 - CPU - Standardonnx: Faster R-CNN R-50-FPN-int8 - CPU - Standardopenvino: Face Detection Retail FP16 - CPUopenvino: Face Detection Retail FP16 - CPUembree: Pathtracer ISPC - Crownopenvino: Weld Porosity Detection FP16 - CPUopenvino: Weld Porosity Detection FP16 - CPUopenvino: Face Detection Retail FP16-INT8 - CPUopenvino: Face Detection Retail FP16-INT8 - CPUopenvino: Vehicle Detection FP16 - CPUopenvino: Vehicle Detection FP16 - CPUopenvino: Handwritten English Recognition FP16 - CPUopenvino: Handwritten English Recognition FP16 - CPUonnx: bertsquad-12 - CPU - Parallelonnx: bertsquad-12 - CPU - Parallelonnx: yolov4 - CPU - Parallelonnx: yolov4 - CPU - Parallelopenvino: Handwritten English Recognition FP16-INT8 - CPUopenvino: Handwritten English Recognition FP16-INT8 - CPUonnx: ArcFace ResNet-100 - CPU - Parallelonnx: ArcFace ResNet-100 - CPU - Parallelspeedb: Rand Fillspeedb: Rand Fill Syncspeedb: Update Randrocksdb: Overwriterocksdb: Update Randonnx: ResNet50 v1-12-int8 - CPU - Parallelonnx: ResNet50 v1-12-int8 - CPU - Parallelspeedb: Rand Readonnx: super-resolution-10 - CPU - Parallelonnx: super-resolution-10 - CPU - Parallelopenssl: RSA4096openssl: RSA4096rocksdb: Rand Readstress-ng: Context Switchingospray-studio: 1 - 1080p - 1 - Path Tracer - CPUblender: Classroom - CPU-Onlytensorflow: CPU - 16 - AlexNettensorflow: CPU - 64 - AlexNetffmpeg: libx264 - Livey-cruncher: 500Mospray-studio: 1 - 4K - 16 - Path Tracer - CPUwebp2: Quality 75, Compression Effort 7hackbench: 16 - Threadvvenc: Bosphorus 1080p - Fastjpegxl: PNG - 90primesieve: 1e13svt-av1: Preset 12 - Bosphorus 4Konednn: IP Shapes 1D - CPUstress-ng: NUMAxmrig: CryptoNight-Femto UPX2 - 1Mxmrig: CryptoNight-Heavy - 1Msvt-av1: Preset 13 - Bosphorus 4Kxmrig: KawPow - 1Msvt-av1: Preset 4 - Bosphorus 1080pgromacs: MPI CPU - water_GMX50_barexmrig: Wownero - 1Mstress-ng: Mutexstress-ng: Socket Activitystress-ng: Zlibstress-ng: Mixed Schedulerstress-ng: Glibc Qsort Data Sortingstress-ng: Semaphoresstress-ng: CPU Stressstress-ng: SENDFILEstress-ng: Pollstress-ng: Hashstress-ng: AVL Treestress-ng: Vector Shufflehackbench: 32 - Processcompress-lz4: 9 - Decompression Speedcompress-lz4: 9 - Compression Speedcompress-lz4: 3 - Decompression Speedcompress-lz4: 3 - Compression Speedjpegxl-decode: Allcompress-lz4: 1 - Decompression Speedcompress-lz4: 1 - Compression Speedwebp2: Defaulttensorflow: CPU - 1 - AlexNetjpegxl: PNG - 100jpegxl: JPEG - 100onednn: Convolution Batch Shapes Auto - CPUoidn: RT.ldr_alb_nrm.3840x2160 - CPU-Onlyhackbench: 16 - Processencode-wavpack: WAV To WavPackonednn: IP Shapes 3D - CPUdraco: Church Facadewebp2: Quality 100, Compression Effort 5onednn: Deconvolution Batch shapes_3d - CPUprimesieve: 1e12draco: LionLinux 6.8Linux 6.9-rc234866677333619997170.3642.74271.9932763744.803906839102.950135.304.9028467842066770.101483647.03202.370.071.481801112.431.880.79307.5024821.320.38121702.129.84711.50569122.2368.22351747.0841.3599470.956614.265642.781923.461374029.01538111.57065.41191185.2946136376.2034.6047217268146675985245.6024.1222.311386742.7642.9421084.500.7867789.259.80514101.9012.89501353.57396.313.42357292.1731.84807541.8274.88181205.4142994073574032.477135.1810.5041210.7021229.2815186136.435939.817731442.6930377557.97143967.24231.2844.43649748.4956169.3680643523.241181758384748.54204365411.593531758.504065717006.813344.69962099112.69926093036.30241538.0924.280563514234669.7429600.02688.2636.601131.595735.403333.9861.0632.5629592.33468957.5929.73361720419.5116.055874353.635.86532361.213.41639599.26873217859304.38690917.2452120844501163551396.4038.4624.0526732.880.3448.9432.28723.16337.21331.2323.684621.3221085.1017.526336.78307.74119.9277.341446.4281.90451.1382.87445.909.5911638.5121.8254.98671.6618.337722.065067.40346.1036.281018.4742.683323.427630.820932.45039.9211260.9838.83506.8516147.577.1715532.5414.582530.0430.853626.4192.746710.7817126.3847.9132129.613777.5659.602116.783232649925744629218038801035982510.609894.24873804193896.55011152.6351358616.438204.636049851820343491.5246653.98213.35495.72181.516.483344120.6414.67915.91330.96939.619127.2024.50055482.6233002.232856.3123.24632860.818.66212.08536096.628490133.2847927.759670.3770407.961866.58154589461.19202073.081798203.1210389186.0217071694.52810.19576905.9224.7483537.032.613364.898.43386.2323601.0602.695.9017.2325.66626.0029.006212.3213.1126.3494.7985377478.356.165763.356612936866689667644430990.3740.20279.7433016744.24399180298.869034.864.9368167828417670.531541547.96203.630.071.531774113.991.900.77311.74510195.750.38119735.579.52411.51570112.4288.90936668.6991.5030065.996015.411041.504824.232875068.23121122.6015.10755196.0766116275.5634.1877336769166675899546.5624.8022.241380742.7742.8821644.580.7173754.749.46496105.78272.48234402.66997.533.40972293.0291.74973571.1904.67811213.7372966549905333.045128.7110.823610.509029.0693183937.433536.503031460.4229814480.67147978.33184.7855.41259753.3646427.3385035507.551175562392750.09200468629.323542258.833979416877.613341.46732598711.07694793862.76331139.3725.171263529230503.3429139.60688.7635.078832.829735.650733.0941.0433.8889602.73346567.8028.87541668719.8885.985908316.035.76033015.513.33535919.64855218740350.56680417.2832068588489161652700.0937.6983.8927790.240.3348.5682.23711.74337.78330.7323.974600.9520605.3917.586306.42302.77121.9377.571442.2179.23466.4579.00467.799.6511564.7822.0254.83673.4618.027522.125052.71341.9735.141051.3043.151123.172729.110734.35129.8911295.9235.73486.7616349.057.1415589.5913.892656.4231.013608.2194.333010.6006124.3768.0414230.203704.3856.947817.562332281625960329341439196836150210.511995.14413758374796.51127153.5641396904.038147.436158608319390362.9047853.82210.71471.88182.126.202349530.6114.29816.15230.12839.461126.1874.51166487.6032993.832826.1123.09833072.518.93411.76436180.728934422.1646123.329446.0770036.201858.70150005776.47200671.701900682.0810232390.4117199190.09808.99569593.0027.9943492.032.663349.698.41381.6573628.0602.545.6518.2825.60725.9608.810432.2213.3576.3404.8424577628.455.782023.2996054OpenBenchmarking.org

MariaDB mariadb-slap

Clients: 1024

OpenBenchmarking.orgQueries Per Second, More Is BetterMariaDB mariadb-slap 11.5Clients: 1024Linux 6.8Linux 6.9-rc2816243240SE +/- 1.23, N = 9SE +/- 1.41, N = 634361. (CXX) g++ options: -fPIC -pie -fstack-protector -O3 -shared -lrt -lpthread -lz -ldl -lm -lstdc++

MariaDB mariadb-slap

Clients: 512

OpenBenchmarking.orgQueries Per Second, More Is BetterMariaDB mariadb-slap 11.5Clients: 512Linux 6.8Linux 6.9-rc220406080100SE +/- 0.41, N = 3SE +/- 0.87, N = 986861. (CXX) g++ options: -fPIC -pie -fstack-protector -O3 -shared -lrt -lpthread -lz -ldl -lm -lstdc++

Quicksilver

Input: CORAL2 P2

OpenBenchmarking.orgFigure Of Merit, More Is BetterQuicksilver 20230818Input: CORAL2 P2Linux 6.8Linux 6.9-rc21.4M2.8M4.2M5.6M7MSE +/- 74194.56, N = 9SE +/- 91964.82, N = 9667733366896671. (CXX) g++ options: -fopenmp -O3 -march=native

Stockfish

Chess Benchmark

OpenBenchmarking.orgNodes Per Second, More Is BetterStockfish 16.1Chess BenchmarkLinux 6.8Linux 6.9-rc214M28M42M56M70MSE +/- 2993041.97, N = 9SE +/- 2705883.43, N = 961999717644430991. (CXX) g++ options: -lgcov -m64 -lpthread -fno-exceptions -std=c++17 -fno-peel-loops -fno-tracer -pedantic -O3 -funroll-loops -msse -msse3 -mpopcnt -mavx2 -mbmi -mavx512f -mavx512bw -mavx512vnni -mavx512dq -mavx512vl -msse4.1 -mssse3 -msse2 -mbmi2 -flto -flto-partition=one -flto=jobserver

Llama.cpp

Model: llama-2-70b-chat.Q5_0.gguf

OpenBenchmarking.orgTokens Per Second, More Is BetterLlama.cpp b1808Model: llama-2-70b-chat.Q5_0.ggufLinux 6.8Linux 6.9-rc20.08330.16660.24990.33320.4165SE +/- 0.00, N = 3SE +/- 0.00, N = 30.360.371. (CXX) g++ options: -std=c++11 -fPIC -O3 -pthread -march=native -mtune=native -lopenblas

FFmpeg

Encoder: libx265 - Scenario: Platform

OpenBenchmarking.orgFPS, More Is BetterFFmpeg 6.1Encoder: libx265 - Scenario: PlatformLinux 6.8Linux 6.9-rc21020304050SE +/- 0.71, N = 12SE +/- 0.46, N = 1242.7440.201. (CXX) g++ options: -O3 -rdynamic -lpthread -lrt -ldl -lnuma

Blender

Blend File: Barbershop - Compute: CPU-Only

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 4.1Blend File: Barbershop - Compute: CPU-OnlyLinux 6.8Linux 6.9-rc260120180240300SE +/- 6.20, N = 8SE +/- 6.67, N = 9271.99279.74

Speedb

Test: Sequential Fill

OpenBenchmarking.orgOp/s, More Is BetterSpeedb 2.7Test: Sequential FillLinux 6.8Linux 6.9-rc270K140K210K280K350KSE +/- 1183.38, N = 3SE +/- 1955.03, N = 33276373301671. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti -lpthread

FFmpeg

Encoder: libx265 - Scenario: Video On Demand

OpenBenchmarking.orgFPS, More Is BetterFFmpeg 6.1Encoder: libx265 - Scenario: Video On DemandLinux 6.8Linux 6.9-rc21020304050SE +/- 0.50, N = 12SE +/- 0.76, N = 944.8044.241. (CXX) g++ options: -O3 -rdynamic -lpthread -lrt -ldl -lnuma

BRL-CAD

VGR Performance Metric

OpenBenchmarking.orgVGR Performance Metric, More Is BetterBRL-CAD 7.38.2VGR Performance MetricLinux 6.8Linux 6.9-rc2900K1800K2700K3600K4500K390683939918021. (CXX) g++ options: -std=c++17 -pipe -fvisibility=hidden -fno-strict-aliasing -fno-common -fexceptions -ftemplate-depth-128 -m64 -ggdb3 -O3 -fipa-pta -fstrength-reduce -finline-functions -flto -ltcl8.6 -lnetpbm -lregex_brl -lz_brl -lassimp -ldl -lm -ltk8.6

OSPRay

Benchmark: particle_volume/pathtracer/real_time

OpenBenchmarking.orgItems Per Second, More Is BetterOSPRay 3.1Benchmark: particle_volume/pathtracer/real_timeLinux 6.8Linux 6.9-rc220406080100SE +/- 1.85, N = 12SE +/- 1.98, N = 9102.9598.87

TensorFlow

Device: CPU - Batch Size: 32 - Model: ResNet-50

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.16.1Device: CPU - Batch Size: 32 - Model: ResNet-50Linux 6.8Linux 6.9-rc2816243240SE +/- 0.48, N = 15SE +/- 0.42, N = 1535.3034.86

VVenC

Video Input: Bosphorus 4K - Video Preset: Fast

OpenBenchmarking.orgFrames Per Second, More Is BetterVVenC 1.11Video Input: Bosphorus 4K - Video Preset: FastLinux 6.8Linux 6.9-rc21.11062.22123.33184.44245.553SE +/- 0.075, N = 10SE +/- 0.077, N = 124.9024.9361. (CXX) g++ options: -O3 -flto=auto -fno-fat-lto-objects

OpenSSL

Algorithm: SHA256

OpenBenchmarking.orgbyte/s, More Is BetterOpenSSLAlgorithm: SHA256Linux 6.8Linux 6.9-rc220000M40000M60000M80000M100000MSE +/- 767626108.54, N = 3SE +/- 717052715.91, N = 1284678420667816782841761. OpenSSL 3.0.10 1 Aug 2023 (Library: OpenSSL 3.0.10 1 Aug 2023)

TensorFlow

Device: CPU - Batch Size: 256 - Model: ResNet-50

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.16.1Device: CPU - Batch Size: 256 - Model: ResNet-50Linux 6.8Linux 6.9-rc21632486480SE +/- 0.38, N = 3SE +/- 0.47, N = 370.1070.53

OSPRay Studio

Camera: 2 - Resolution: 1080p - Samples Per Pixel: 32 - Renderer: Path Tracer - Acceleration: CPU

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 1.0Camera: 2 - Resolution: 1080p - Samples Per Pixel: 32 - Renderer: Path Tracer - Acceleration: CPULinux 6.8Linux 6.9-rc23K6K9K12K15KSE +/- 268.32, N = 12SE +/- 235.77, N = 151483615415

TensorFlow

Device: CPU - Batch Size: 64 - Model: ResNet-50

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.16.1Device: CPU - Batch Size: 64 - Model: ResNet-50Linux 6.8Linux 6.9-rc21122334455SE +/- 0.54, N = 12SE +/- 0.42, N = 347.0347.96

TensorFlow

Device: CPU - Batch Size: 256 - Model: GoogLeNet

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.16.1Device: CPU - Batch Size: 256 - Model: GoogLeNetLinux 6.8Linux 6.9-rc24080120160200SE +/- 2.20, N = 12SE +/- 1.95, N = 3202.37203.63

WebP2 Image Encode

Encode Settings: Quality 100, Lossless Compression

OpenBenchmarking.orgMP/s, More Is BetterWebP2 Image Encode 20220823Encode Settings: Quality 100, Lossless CompressionLinux 6.8Linux 6.9-rc20.01580.03160.04740.06320.079SE +/- 0.00, N = 3SE +/- 0.00, N = 30.070.071. (CXX) g++ options: -msse4.2 -fno-rtti -O3 -ldl

Llama.cpp

Model: llama-2-13b.Q4_0.gguf

OpenBenchmarking.orgTokens Per Second, More Is BetterLlama.cpp b1808Model: llama-2-13b.Q4_0.ggufLinux 6.8Linux 6.9-rc20.34430.68861.03291.37721.7215SE +/- 0.01, N = 3SE +/- 0.02, N = 31.481.531. (CXX) g++ options: -std=c++11 -fPIC -O3 -pthread -march=native -mtune=native -lopenblas

OSPRay Studio

Camera: 1 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path Tracer - Acceleration: CPU

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 1.0Camera: 1 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path Tracer - Acceleration: CPULinux 6.8Linux 6.9-rc2400800120016002000SE +/- 40.26, N = 15SE +/- 22.91, N = 1518011774

FFmpeg

Encoder: libx265 - Scenario: Live

OpenBenchmarking.orgFPS, More Is BetterFFmpeg 6.1Encoder: libx265 - Scenario: LiveLinux 6.8Linux 6.9-rc2306090120150SE +/- 1.36, N = 15SE +/- 1.80, N = 15112.43113.991. (CXX) g++ options: -O3 -rdynamic -lpthread -lrt -ldl -lnuma

TensorFlow

Device: CPU - Batch Size: 1 - Model: ResNet-50

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.16.1Device: CPU - Batch Size: 1 - Model: ResNet-50Linux 6.8Linux 6.9-rc20.42750.8551.28251.712.1375SE +/- 0.03, N = 15SE +/- 0.03, N = 151.881.90

Llamafile

Test: wizardcoder-python-34b-v1.0.Q6_K - Acceleration: CPU

OpenBenchmarking.orgTokens Per Second, More Is BetterLlamafile 0.6Test: wizardcoder-python-34b-v1.0.Q6_K - Acceleration: CPULinux 6.8Linux 6.9-rc20.17780.35560.53340.71120.889SE +/- 0.01, N = 4SE +/- 0.00, N = 30.790.77

Timed Linux Kernel Compilation

Build: allmodconfig

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed Linux Kernel Compilation 6.8Build: allmodconfigLinux 6.8Linux 6.9-rc270140210280350SE +/- 3.84, N = 3SE +/- 1.26, N = 3307.50311.75

oneDNN

Harness: Recurrent Neural Network Training - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.4Harness: Recurrent Neural Network Training - Engine: CPULinux 6.8Linux 6.9-rc22K4K6K8K10KSE +/- 22.69, N = 3SE +/- 498.89, N = 134821.3210195.75MIN: 4659.99MIN: 4568.31. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread

OpenVINO

Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPULinux 6.8Linux 6.9-rc20.08550.1710.25650.3420.4275SE +/- 0.01, N = 15SE +/- 0.00, N = 150.380.38MIN: 0.23 / MAX: 46.5MIN: 0.24 / MAX: 50.651. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPULinux 6.8Linux 6.9-rc230K60K90K120K150KSE +/- 1455.69, N = 15SE +/- 1149.56, N = 15121702.12119735.571. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

VVenC

Video Input: Bosphorus 4K - Video Preset: Faster

OpenBenchmarking.orgFrames Per Second, More Is BetterVVenC 1.11Video Input: Bosphorus 4K - Video Preset: FasterLinux 6.8Linux 6.9-rc23691215SE +/- 0.200, N = 12SE +/- 0.172, N = 159.8479.5241. (CXX) g++ options: -O3 -flto=auto -fno-fat-lto-objects

FFmpeg

Encoder: libx264 - Scenario: Upload

OpenBenchmarking.orgFPS, More Is BetterFFmpeg 6.1Encoder: libx264 - Scenario: UploadLinux 6.8Linux 6.9-rc23691215SE +/- 0.01, N = 3SE +/- 0.01, N = 311.5011.511. (CXX) g++ options: -O3 -rdynamic -lpthread -lrt -ldl -lnuma

OSPRay Studio

Camera: 3 - Resolution: 1080p - Samples Per Pixel: 1 - Renderer: Path Tracer - Acceleration: CPU

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 1.0Camera: 3 - Resolution: 1080p - Samples Per Pixel: 1 - Renderer: Path Tracer - Acceleration: CPULinux 6.8Linux 6.9-rc2120240360480600SE +/- 4.36, N = 15SE +/- 4.85, N = 15569570

ONNX Runtime

Model: yolov4 - Device: CPU - Executor: Standard

OpenBenchmarking.orgInference Time Cost (ms), Fewer Is BetterONNX Runtime 1.17Model: yolov4 - Device: CPU - Executor: StandardLinux 6.8Linux 6.9-rc2306090120150SE +/- 2.31, N = 15SE +/- 1.33, N = 13122.24112.431. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

ONNX Runtime

Model: yolov4 - Device: CPU - Executor: Standard

OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.17Model: yolov4 - Device: CPU - Executor: StandardLinux 6.8Linux 6.9-rc2246810SE +/- 0.16273, N = 15SE +/- 0.10643, N = 138.223518.909361. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

ONNX Runtime

Model: fcn-resnet101-11 - Device: CPU - Executor: Parallel

OpenBenchmarking.orgInference Time Cost (ms), Fewer Is BetterONNX Runtime 1.17Model: fcn-resnet101-11 - Device: CPU - Executor: ParallelLinux 6.8Linux 6.9-rc2160320480640800SE +/- 25.74, N = 15SE +/- 14.65, N = 12747.08668.701. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

ONNX Runtime

Model: fcn-resnet101-11 - Device: CPU - Executor: Parallel

OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.17Model: fcn-resnet101-11 - Device: CPU - Executor: ParallelLinux 6.8Linux 6.9-rc20.33820.67641.01461.35281.691SE +/- 0.04472, N = 15SE +/- 0.03151, N = 121.359941.503001. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

ONNX Runtime

Model: bertsquad-12 - Device: CPU - Executor: Standard

OpenBenchmarking.orgInference Time Cost (ms), Fewer Is BetterONNX Runtime 1.17Model: bertsquad-12 - Device: CPU - Executor: StandardLinux 6.8Linux 6.9-rc21632486480SE +/- 2.24, N = 12SE +/- 2.28, N = 1570.9666.001. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

ONNX Runtime

Model: bertsquad-12 - Device: CPU - Executor: Standard

OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.17Model: bertsquad-12 - Device: CPU - Executor: StandardLinux 6.8Linux 6.9-rc248121620SE +/- 0.50, N = 12SE +/- 0.54, N = 1514.2715.411. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

ONNX Runtime

Model: ArcFace ResNet-100 - Device: CPU - Executor: Standard

OpenBenchmarking.orgInference Time Cost (ms), Fewer Is BetterONNX Runtime 1.17Model: ArcFace ResNet-100 - Device: CPU - Executor: StandardLinux 6.8Linux 6.9-rc21020304050SE +/- 0.81, N = 12SE +/- 0.86, N = 1542.7841.501. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

ONNX Runtime

Model: ArcFace ResNet-100 - Device: CPU - Executor: Standard

OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.17Model: ArcFace ResNet-100 - Device: CPU - Executor: StandardLinux 6.8Linux 6.9-rc2612182430SE +/- 0.43, N = 12SE +/- 0.48, N = 1523.4624.231. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

OSPRay Studio

Camera: 2 - Resolution: 1080p - Samples Per Pixel: 16 - Renderer: Path Tracer - Acceleration: CPU

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 1.0Camera: 2 - Resolution: 1080p - Samples Per Pixel: 16 - Renderer: Path Tracer - Acceleration: CPULinux 6.8Linux 6.9-rc216003200480064008000SE +/- 105.66, N = 3SE +/- 118.69, N = 1574027506

ONNX Runtime

Model: ResNet50 v1-12-int8 - Device: CPU - Executor: Standard

OpenBenchmarking.orgInference Time Cost (ms), Fewer Is BetterONNX Runtime 1.17Model: ResNet50 v1-12-int8 - Device: CPU - Executor: StandardLinux 6.8Linux 6.9-rc23691215SE +/- 0.20919, N = 12SE +/- 0.21896, N = 159.015388.231211. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

ONNX Runtime

Model: ResNet50 v1-12-int8 - Device: CPU - Executor: Standard

OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.17Model: ResNet50 v1-12-int8 - Device: CPU - Executor: StandardLinux 6.8Linux 6.9-rc2306090120150SE +/- 2.58, N = 12SE +/- 3.02, N = 15111.57122.601. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

ONNX Runtime

Model: T5 Encoder - Device: CPU - Executor: Parallel

OpenBenchmarking.orgInference Time Cost (ms), Fewer Is BetterONNX Runtime 1.17Model: T5 Encoder - Device: CPU - Executor: ParallelLinux 6.8Linux 6.9-rc21.21772.43543.65314.87086.0885SE +/- 0.09595, N = 12SE +/- 0.06160, N = 145.411915.107551. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

ONNX Runtime

Model: T5 Encoder - Device: CPU - Executor: Parallel

OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.17Model: T5 Encoder - Device: CPU - Executor: ParallelLinux 6.8Linux 6.9-rc24080120160200SE +/- 3.10, N = 12SE +/- 2.39, N = 14185.29196.081. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

OSPRay Studio

Camera: 1 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path Tracer - Acceleration: CPU

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 1.0Camera: 1 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path Tracer - Acceleration: CPULinux 6.8Linux 6.9-rc213K26K39K52K65KSE +/- 443.96, N = 15SE +/- 567.54, N = 76136361162

Blender

Blend File: Pabellon Barcelona - Compute: CPU-Only

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 4.1Blend File: Pabellon Barcelona - Compute: CPU-OnlyLinux 6.8Linux 6.9-rc220406080100SE +/- 0.83, N = 5SE +/- 0.61, N = 1576.2075.56

JPEG-XL libjxl

Input: JPEG - Quality: 80

OpenBenchmarking.orgMP/s, More Is BetterJPEG-XL libjxl 0.10.1Input: JPEG - Quality: 80Linux 6.8Linux 6.9-rc2816243240SE +/- 0.51, N = 12SE +/- 0.53, N = 1534.6034.191. (CXX) g++ options: -fno-rtti -O3 -fPIE -pie -lm

OSPRay Studio

Camera: 3 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path Tracer - Acceleration: CPU

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 1.0Camera: 3 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path Tracer - Acceleration: CPULinux 6.8Linux 6.9-rc216K32K48K64K80KSE +/- 506.90, N = 3SE +/- 855.02, N = 157217273367

Quicksilver

Input: CORAL2 P1

OpenBenchmarking.orgFigure Of Merit, More Is BetterQuicksilver 20230818Input: CORAL2 P1Linux 6.8Linux 6.9-rc21.5M3M4.5M6M7.5MSE +/- 67589.78, N = 6SE +/- 46491.34, N = 3681466769166671. (CXX) g++ options: -fopenmp -O3 -march=native

Chaos Group V-RAY

Mode: CPU

OpenBenchmarking.orgvsamples, More Is BetterChaos Group V-RAY 6.0Mode: CPULinux 6.8Linux 6.9-rc213K26K39K52K65KSE +/- 530.58, N = 15SE +/- 557.85, N = 35985258995

Blender

Blend File: Junkshop - Compute: CPU-Only

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 4.1Blend File: Junkshop - Compute: CPU-OnlyLinux 6.8Linux 6.9-rc21122334455SE +/- 0.47, N = 15SE +/- 0.40, N = 1545.6046.56

TensorFlow

Device: CPU - Batch Size: 16 - Model: ResNet-50

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.16.1Device: CPU - Batch Size: 16 - Model: ResNet-50Linux 6.8Linux 6.9-rc2612182430SE +/- 0.30, N = 3SE +/- 0.28, N = 1524.1224.80

FFmpeg

Encoder: libx265 - Scenario: Upload

OpenBenchmarking.orgFPS, More Is BetterFFmpeg 6.1Encoder: libx265 - Scenario: UploadLinux 6.8Linux 6.9-rc2510152025SE +/- 0.31, N = 3SE +/- 0.26, N = 422.3122.241. (CXX) g++ options: -O3 -rdynamic -lpthread -lrt -ldl -lnuma

OSPRay Studio

Camera: 1 - Resolution: 1080p - Samples Per Pixel: 32 - Renderer: Path Tracer - Acceleration: CPU

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 1.0Camera: 1 - Resolution: 1080p - Samples Per Pixel: 32 - Renderer: Path Tracer - Acceleration: CPULinux 6.8Linux 6.9-rc23K6K9K12K15KSE +/- 112.81, N = 9SE +/- 180.26, N = 31386713807

FFmpeg

Encoder: libx264 - Scenario: Platform

OpenBenchmarking.orgFPS, More Is BetterFFmpeg 6.1Encoder: libx264 - Scenario: PlatformLinux 6.8Linux 6.9-rc21020304050SE +/- 0.17, N = 3SE +/- 0.10, N = 342.7642.771. (CXX) g++ options: -O3 -rdynamic -lpthread -lrt -ldl -lnuma

FFmpeg

Encoder: libx264 - Scenario: Video On Demand

OpenBenchmarking.orgFPS, More Is BetterFFmpeg 6.1Encoder: libx264 - Scenario: Video On DemandLinux 6.8Linux 6.9-rc21020304050SE +/- 0.06, N = 3SE +/- 0.10, N = 342.9442.881. (CXX) g++ options: -O3 -rdynamic -lpthread -lrt -ldl -lnuma

OSPRay Studio

Camera: 3 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path Tracer - Acceleration: CPU

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 1.0Camera: 3 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path Tracer - Acceleration: CPULinux 6.8Linux 6.9-rc25001000150020002500SE +/- 21.99, N = 4SE +/- 26.16, N = 1321082164

Llamafile

Test: mistral-7b-instruct-v0.2.Q8_0 - Acceleration: CPU

OpenBenchmarking.orgTokens Per Second, More Is BetterLlamafile 0.6Test: mistral-7b-instruct-v0.2.Q8_0 - Acceleration: CPULinux 6.8Linux 6.9-rc21.03052.0613.09154.1225.1525SE +/- 0.04, N = 3SE +/- 0.03, N = 34.504.58

OpenVINO

Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Age Gender Recognition Retail 0013 FP16 - Device: CPULinux 6.8Linux 6.9-rc20.17550.3510.52650.7020.8775SE +/- 0.01, N = 15SE +/- 0.03, N = 30.780.71MIN: 0.3 / MAX: 138.08MIN: 0.32 / MAX: 74.711. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Age Gender Recognition Retail 0013 FP16 - Device: CPULinux 6.8Linux 6.9-rc216K32K48K64K80KSE +/- 711.41, N = 15SE +/- 1055.18, N = 367789.2573754.741. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

ONNX Runtime

Model: GPT-2 - Device: CPU - Executor: Parallel

OpenBenchmarking.orgInference Time Cost (ms), Fewer Is BetterONNX Runtime 1.17Model: GPT-2 - Device: CPU - Executor: ParallelLinux 6.8Linux 6.9-rc23691215SE +/- 0.11034, N = 3SE +/- 0.12308, N = 159.805149.464961. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

ONNX Runtime

Model: GPT-2 - Device: CPU - Executor: Parallel

OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.17Model: GPT-2 - Device: CPU - Executor: ParallelLinux 6.8Linux 6.9-rc220406080100SE +/- 1.16, N = 3SE +/- 1.34, N = 15101.90105.781. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

ONNX Runtime

Model: T5 Encoder - Device: CPU - Executor: Standard

OpenBenchmarking.orgInference Time Cost (ms), Fewer Is BetterONNX Runtime 1.17Model: T5 Encoder - Device: CPU - Executor: StandardLinux 6.8Linux 6.9-rc20.65141.30281.95422.60563.257SE +/- 0.12453, N = 15SE +/- 0.01855, N = 32.895012.482341. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

ONNX Runtime

Model: T5 Encoder - Device: CPU - Executor: Standard

OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.17Model: T5 Encoder - Device: CPU - Executor: StandardLinux 6.8Linux 6.9-rc290180270360450SE +/- 14.02, N = 15SE +/- 3.01, N = 3353.57402.671. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

TensorFlow

Device: CPU - Batch Size: 32 - Model: GoogLeNet

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.16.1Device: CPU - Batch Size: 32 - Model: GoogLeNetLinux 6.8Linux 6.9-rc220406080100SE +/- 1.27, N = 12SE +/- 1.10, N = 1596.3197.53

ONNX Runtime

Model: CaffeNet 12-int8 - Device: CPU - Executor: Parallel

OpenBenchmarking.orgInference Time Cost (ms), Fewer Is BetterONNX Runtime 1.17Model: CaffeNet 12-int8 - Device: CPU - Executor: ParallelLinux 6.8Linux 6.9-rc20.77031.54062.31093.08123.8515SE +/- 0.03367, N = 15SE +/- 0.02459, N = 33.423573.409721. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

ONNX Runtime

Model: CaffeNet 12-int8 - Device: CPU - Executor: Parallel

OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.17Model: CaffeNet 12-int8 - Device: CPU - Executor: ParallelLinux 6.8Linux 6.9-rc260120180240300SE +/- 2.79, N = 15SE +/- 2.09, N = 3292.17293.031. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

ONNX Runtime

Model: CaffeNet 12-int8 - Device: CPU - Executor: Standard

OpenBenchmarking.orgInference Time Cost (ms), Fewer Is BetterONNX Runtime 1.17Model: CaffeNet 12-int8 - Device: CPU - Executor: StandardLinux 6.8Linux 6.9-rc20.41580.83161.24741.66322.079SE +/- 0.02432, N = 15SE +/- 0.01721, N = 31.848071.749731. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

ONNX Runtime

Model: CaffeNet 12-int8 - Device: CPU - Executor: Standard

OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.17Model: CaffeNet 12-int8 - Device: CPU - Executor: StandardLinux 6.8Linux 6.9-rc2120240360480600SE +/- 6.47, N = 15SE +/- 5.63, N = 3541.83571.191. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

ONNX Runtime

Model: super-resolution-10 - Device: CPU - Executor: Standard

OpenBenchmarking.orgInference Time Cost (ms), Fewer Is BetterONNX Runtime 1.17Model: super-resolution-10 - Device: CPU - Executor: StandardLinux 6.8Linux 6.9-rc21.09842.19683.29524.39365.492SE +/- 0.07270, N = 15SE +/- 0.01745, N = 34.881814.678111. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

ONNX Runtime

Model: super-resolution-10 - Device: CPU - Executor: Standard

OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.17Model: super-resolution-10 - Device: CPU - Executor: StandardLinux 6.8Linux 6.9-rc250100150200250SE +/- 2.99, N = 15SE +/- 0.80, N = 3205.41213.741. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

OpenSSL

Algorithm: SHA512

OpenBenchmarking.orgbyte/s, More Is BetterOpenSSLAlgorithm: SHA512Linux 6.8Linux 6.9-rc26000M12000M18000M24000M30000MSE +/- 92272355.83, N = 3SE +/- 252323355.66, N = 329940735740296654990531. OpenSSL 3.0.10 1 Aug 2023 (Library: OpenSSL 3.0.10 1 Aug 2023)

JPEG-XL libjxl

Input: PNG - Quality: 80

OpenBenchmarking.orgMP/s, More Is BetterJPEG-XL libjxl 0.10.1Input: PNG - Quality: 80Linux 6.8Linux 6.9-rc2816243240SE +/- 0.38, N = 3SE +/- 0.36, N = 1532.4833.051. (CXX) g++ options: -fno-rtti -O3 -fPIE -pie -lm

TensorFlow

Device: CPU - Batch Size: 64 - Model: GoogLeNet

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.16.1Device: CPU - Batch Size: 64 - Model: GoogLeNetLinux 6.8Linux 6.9-rc2306090120150SE +/- 0.94, N = 3SE +/- 1.70, N = 15135.18128.71

OSPRay

Benchmark: gravity_spheres_volume/dim_512/scivis/real_time

OpenBenchmarking.orgItems Per Second, More Is BetterOSPRay 3.1Benchmark: gravity_spheres_volume/dim_512/scivis/real_timeLinux 6.8Linux 6.9-rc23691215SE +/- 0.08, N = 15SE +/- 0.07, N = 310.5010.82

OSPRay

Benchmark: gravity_spheres_volume/dim_512/ao/real_time

OpenBenchmarking.orgItems Per Second, More Is BetterOSPRay 3.1Benchmark: gravity_spheres_volume/dim_512/ao/real_timeLinux 6.8Linux 6.9-rc23691215SE +/- 0.14, N = 15SE +/- 0.05, N = 310.7010.51

OSPRay

Benchmark: particle_volume/scivis/real_time

OpenBenchmarking.orgItems Per Second, More Is BetterOSPRay 3.1Benchmark: particle_volume/scivis/real_timeLinux 6.8Linux 6.9-rc2714212835SE +/- 0.26, N = 3SE +/- 0.33, N = 329.2829.07

OSPRay Studio

Camera: 2 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path Tracer - Acceleration: CPU

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 1.0Camera: 2 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path Tracer - Acceleration: CPULinux 6.8Linux 6.9-rc2400800120016002000SE +/- 13.93, N = 11SE +/- 26.21, N = 318611839

Embree

Binary: Pathtracer ISPC - Model: Asian Dragon Obj

OpenBenchmarking.orgFrames Per Second, More Is BetterEmbree 4.3Binary: Pathtracer ISPC - Model: Asian Dragon ObjLinux 6.8Linux 6.9-rc2918273645SE +/- 0.94, N = 15SE +/- 0.88, N = 1536.4437.43MIN: 22.56 / MAX: 49.05MIN: 27.23 / MAX: 49.01

Embree

Binary: Pathtracer - Model: Asian Dragon Obj

OpenBenchmarking.orgFrames Per Second, More Is BetterEmbree 4.3Binary: Pathtracer - Model: Asian Dragon ObjLinux 6.8Linux 6.9-rc2918273645SE +/- 0.92, N = 15SE +/- 0.60, N = 1539.8236.50MIN: 26.64 / MAX: 50.91MIN: 22.66 / MAX: 46.51

Stress-NG

Test: Matrix 3D Math

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Matrix 3D MathLinux 6.8Linux 6.9-rc27K14K21K28K35KSE +/- 669.33, N = 15SE +/- 437.41, N = 1531442.6931460.421. (CXX) g++ options: -lm -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lpthread -lrt -lsctp -lz

Stress-NG

Test: Pipe

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: PipeLinux 6.8Linux 6.9-rc27M14M21M28M35MSE +/- 749025.19, N = 15SE +/- 2106194.07, N = 1530377557.9729814480.671. (CXX) g++ options: -lm -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lpthread -lrt -lsctp -lz

Stress-NG

Test: Crypto

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: CryptoLinux 6.8Linux 6.9-rc230K60K90K120K150KSE +/- 1720.03, N = 15SE +/- 2039.96, N = 15143967.24147978.331. (CXX) g++ options: -lm -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lpthread -lrt -lsctp -lz

ONNX Runtime

Model: fcn-resnet101-11 - Device: CPU - Executor: Standard

OpenBenchmarking.orgInference Time Cost (ms), Fewer Is BetterONNX Runtime 1.17Model: fcn-resnet101-11 - Device: CPU - Executor: StandardLinux 6.8Linux 6.9-rc250100150200250SE +/- 11.46, N = 12SE +/- 1.80, N = 3231.28184.791. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

ONNX Runtime

Model: fcn-resnet101-11 - Device: CPU - Executor: Standard

OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.17Model: fcn-resnet101-11 - Device: CPU - Executor: StandardLinux 6.8Linux 6.9-rc21.21782.43563.65344.87126.089SE +/- 0.20811, N = 12SE +/- 0.05231, N = 34.436495.412591. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

oneDNN

Harness: Recurrent Neural Network Inference - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.4Harness: Recurrent Neural Network Inference - Engine: CPULinux 6.8Linux 6.9-rc2160320480640800SE +/- 7.46, N = 3SE +/- 6.16, N = 9748.50753.36MIN: 677.68MIN: 652.831. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread

Stress-NG

Test: MMAP

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: MMAPLinux 6.8Linux 6.9-rc214002800420056007000SE +/- 70.88, N = 14SE +/- 66.09, N = 156169.366427.331. (CXX) g++ options: -lm -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lpthread -lrt -lsctp -lz

Stress-NG

Test: Glibc C String Functions

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Glibc C String FunctionsLinux 6.8Linux 6.9-rc220M40M60M80M100MSE +/- 2138024.53, N = 13SE +/- 1504028.14, N = 1580643523.2485035507.551. (CXX) g++ options: -lm -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lpthread -lrt -lsctp -lz

Speedb

Test: Read Random Write Random

OpenBenchmarking.orgOp/s, More Is BetterSpeedb 2.7Test: Read Random Write RandomLinux 6.8Linux 6.9-rc2300K600K900K1200K1500KSE +/- 8674.90, N = 11SE +/- 13609.90, N = 3118175811755621. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti -lpthread

Stress-NG

Test: Matrix Math

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Matrix MathLinux 6.8Linux 6.9-rc280K160K240K320K400KSE +/- 4925.11, N = 15SE +/- 9278.38, N = 12384748.54392750.091. (CXX) g++ options: -lm -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lpthread -lrt -lsctp -lz

Stress-NG

Test: Fused Multiply-Add

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Fused Multiply-AddLinux 6.8Linux 6.9-rc240M80M120M160M200MSE +/- 6187723.80, N = 12SE +/- 3824188.11, N = 15204365411.59200468629.321. (CXX) g++ options: -lm -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lpthread -lrt -lsctp -lz

OSPRay Studio

Camera: 2 - Resolution: 4K - Samples Per Pixel: 16 - Renderer: Path Tracer - Acceleration: CPU

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 1.0Camera: 2 - Resolution: 4K - Samples Per Pixel: 16 - Renderer: Path Tracer - Acceleration: CPULinux 6.8Linux 6.9-rc28K16K24K32K40KSE +/- 302.37, N = 15SE +/- 483.46, N = 33531735422

TensorFlow

Device: CPU - Batch Size: 16 - Model: GoogLeNet

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.16.1Device: CPU - Batch Size: 16 - Model: GoogLeNetLinux 6.8Linux 6.9-rc21326395265SE +/- 1.31, N = 12SE +/- 1.24, N = 1258.5058.83

OSPRay Studio

Camera: 3 - Resolution: 4K - Samples Per Pixel: 16 - Renderer: Path Tracer - Acceleration: CPU

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 1.0Camera: 3 - Resolution: 4K - Samples Per Pixel: 16 - Renderer: Path Tracer - Acceleration: CPULinux 6.8Linux 6.9-rc29K18K27K36K45KSE +/- 626.71, N = 12SE +/- 252.89, N = 34065739794

srsRAN Project

Test: PDSCH Processor Benchmark, Throughput Total

OpenBenchmarking.orgMbps, More Is BettersrsRAN Project 23.10.1-20240219Test: PDSCH Processor Benchmark, Throughput TotalLinux 6.8Linux 6.9-rc24K8K12K16K20KSE +/- 263.34, N = 15SE +/- 377.19, N = 1217006.816877.61. (CXX) g++ options: -march=native -mavx2 -mavx -msse4.1 -mfma -mavx512f -mavx512cd -mavx512bw -mavx512dq -O3 -fno-trapping-math -fno-math-errno -ldl

CacheBench

Test: Read

OpenBenchmarking.orgMB/s, More Is BetterCacheBenchTest: ReadLinux 6.8Linux 6.9-rc23K6K9K12K15KSE +/- 0.52, N = 3SE +/- 0.88, N = 313344.7013341.47MIN: 13338.06 / MAX: 13346.23MIN: 13335.31 / MAX: 13343.851. (CC) gcc options: -O3 -lrt

CacheBench

Test: Read / Modify / Write

OpenBenchmarking.orgMB/s, More Is BetterCacheBenchTest: Read / Modify / WriteLinux 6.8Linux 6.9-rc220K40K60K80K100KSE +/- 2.71, N = 3SE +/- 71.07, N = 399112.7098711.08MIN: 88982.6 / MAX: 105154.55MIN: 85707.72 / MAX: 105115.441. (CC) gcc options: -O3 -lrt

CacheBench

Test: Write

OpenBenchmarking.orgMB/s, More Is BetterCacheBenchTest: WriteLinux 6.8Linux 6.9-rc220K40K60K80K100KSE +/- 36.95, N = 3SE +/- 65.10, N = 393036.3093862.76MIN: 54037.87 / MAX: 103869.49MIN: 54012.69 / MAX: 104121.121. (CC) gcc options: -O3 -lrt

Blender

Blend File: Fishy Cat - Compute: CPU-Only

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 4.1Blend File: Fishy Cat - Compute: CPU-OnlyLinux 6.8Linux 6.9-rc2918273645SE +/- 0.38, N = 15SE +/- 0.44, N = 438.0939.37

OSPRay

Benchmark: gravity_spheres_volume/dim_512/pathtracer/real_time

OpenBenchmarking.orgItems Per Second, More Is BetterOSPRay 3.1Benchmark: gravity_spheres_volume/dim_512/pathtracer/real_timeLinux 6.8Linux 6.9-rc2612182430SE +/- 0.41, N = 12SE +/- 0.20, N = 324.2825.17

OSPRay Studio

Camera: 2 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path Tracer - Acceleration: CPU

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 1.0Camera: 2 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path Tracer - Acceleration: CPULinux 6.8Linux 6.9-rc214K28K42K56K70KSE +/- 591.53, N = 7SE +/- 885.61, N = 36351463529

Stress-NG

Test: Vector Floating Point

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Vector Floating PointLinux 6.8Linux 6.9-rc250K100K150K200K250KSE +/- 5616.14, N = 12SE +/- 8579.53, N = 12234669.74230503.341. (CXX) g++ options: -lm -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lpthread -lrt -lsctp -lz

Stress-NG

Test: Floating Point

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Floating PointLinux 6.8Linux 6.9-rc26K12K18K24K30KSE +/- 632.70, N = 12SE +/- 214.66, N = 1129600.0229139.601. (CXX) g++ options: -lm -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lpthread -lrt -lsctp -lz

Stress-NG

Test: MEMFD

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: MEMFDLinux 6.8Linux 6.9-rc2150300450600750SE +/- 14.68, N = 15SE +/- 5.94, N = 8688.26688.761. (CXX) g++ options: -lm -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lpthread -lrt -lsctp -lz

Embree

Binary: Pathtracer - Model: Crown

OpenBenchmarking.orgFrames Per Second, More Is BetterEmbree 4.3Binary: Pathtracer - Model: CrownLinux 6.8Linux 6.9-rc2816243240SE +/- 0.59, N = 15SE +/- 1.07, N = 1536.6035.08MIN: 25.71 / MAX: 54.49MIN: 22.8 / MAX: 59.06

Embree

Binary: Pathtracer ISPC - Model: Asian Dragon

OpenBenchmarking.orgFrames Per Second, More Is BetterEmbree 4.3Binary: Pathtracer ISPC - Model: Asian DragonLinux 6.8Linux 6.9-rc2816243240SE +/- 0.77, N = 13SE +/- 0.82, N = 1531.6032.83MIN: 20.8 / MAX: 52.83MIN: 22.56 / MAX: 48.16

Embree

Binary: Pathtracer - Model: Asian Dragon

OpenBenchmarking.orgFrames Per Second, More Is BetterEmbree 4.3Binary: Pathtracer - Model: Asian DragonLinux 6.8Linux 6.9-rc2816243240SE +/- 0.86, N = 15SE +/- 0.54, N = 1535.4035.65MIN: 23.5 / MAX: 52.61MIN: 24.54 / MAX: 51.88

VVenC

Video Input: Bosphorus 1080p - Video Preset: Faster

OpenBenchmarking.orgFrames Per Second, More Is BetterVVenC 1.11Video Input: Bosphorus 1080p - Video Preset: FasterLinux 6.8Linux 6.9-rc2816243240SE +/- 0.29, N = 15SE +/- 0.36, N = 1533.9933.091. (CXX) g++ options: -O3 -flto=auto -fno-fat-lto-objects

Intel Open Image Denoise

Run: RTLightmap.hdr.4096x4096 - Device: CPU-Only

OpenBenchmarking.orgImages / Sec, More Is BetterIntel Open Image Denoise 2.2Run: RTLightmap.hdr.4096x4096 - Device: CPU-OnlyLinux 6.8Linux 6.9-rc20.23850.4770.71550.9541.1925SE +/- 0.01, N = 7SE +/- 0.01, N = 151.061.04

JPEG-XL libjxl

Input: JPEG - Quality: 90

OpenBenchmarking.orgMP/s, More Is BetterJPEG-XL libjxl 0.10.1Input: JPEG - Quality: 90Linux 6.8Linux 6.9-rc2816243240SE +/- 0.37, N = 3SE +/- 0.38, N = 1532.5633.891. (CXX) g++ options: -fno-rtti -O3 -fPIE -pie -lm

Xmrig

Variant: GhostRider - Hash Count: 1M

OpenBenchmarking.orgH/s, More Is BetterXmrig 6.21Variant: GhostRider - Hash Count: 1MLinux 6.8Linux 6.9-rc22K4K6K8K10KSE +/- 31.05, N = 3SE +/- 42.79, N = 39592.39602.71. (CXX) g++ options: -fexceptions -fno-rtti -maes -O3 -Ofast -static-libgcc -static-libstdc++ -rdynamic -lssl -lcrypto -luv -lpthread -lrt -ldl -lhwloc

Stress-NG

Test: IO_uring

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: IO_uringLinux 6.8Linux 6.9-rc2700K1400K2100K2800K3500KSE +/- 31595.27, N = 3SE +/- 43339.28, N = 153468957.593346567.801. (CXX) g++ options: -lm -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lpthread -lrt -lsctp -lz

OSPRay

Benchmark: particle_volume/ao/real_time

OpenBenchmarking.orgItems Per Second, More Is BetterOSPRay 3.1Benchmark: particle_volume/ao/real_timeLinux 6.8Linux 6.9-rc2714212835SE +/- 0.11, N = 3SE +/- 0.19, N = 329.7328.88

OSPRay Studio

Camera: 3 - Resolution: 1080p - Samples Per Pixel: 32 - Renderer: Path Tracer - Acceleration: CPU

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 1.0Camera: 3 - Resolution: 1080p - Samples Per Pixel: 32 - Renderer: Path Tracer - Acceleration: CPULinux 6.8Linux 6.9-rc24K8K12K16K20KSE +/- 101.18, N = 3SE +/- 156.23, N = 61720416687

Timed Mesa Compilation

Time To Compile

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed Mesa Compilation 24.0Time To CompileLinux 6.8Linux 6.9-rc2510152025SE +/- 0.51, N = 15SE +/- 0.39, N = 1519.5119.89

TensorFlow

Device: CPU - Batch Size: 1 - Model: GoogLeNet

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.16.1Device: CPU - Batch Size: 1 - Model: GoogLeNetLinux 6.8Linux 6.9-rc2246810SE +/- 0.13, N = 12SE +/- 0.14, N = 156.055.98

Stress-NG

Test: Wide Vector Math

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Wide Vector MathLinux 6.8Linux 6.9-rc21.3M2.6M3.9M5.2M6.5MSE +/- 72950.92, N = 4SE +/- 55746.31, N = 155874353.635908316.031. (CXX) g++ options: -lm -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lpthread -lrt -lsctp -lz

SVT-AV1

Encoder Mode: Preset 4 - Input: Bosphorus 4K

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 2.0Encoder Mode: Preset 4 - Input: Bosphorus 4KLinux 6.8Linux 6.9-rc21.31962.63923.95885.27846.598SE +/- 0.035, N = 3SE +/- 0.051, N = 155.8655.7601. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

Xmrig

Variant: Monero - Hash Count: 1M

OpenBenchmarking.orgH/s, More Is BetterXmrig 6.21Variant: Monero - Hash Count: 1MLinux 6.8Linux 6.9-rc27K14K21K28K35KSE +/- 320.50, N = 13SE +/- 181.84, N = 332361.233015.51. (CXX) g++ options: -fexceptions -fno-rtti -maes -O3 -Ofast -static-libgcc -static-libstdc++ -rdynamic -lssl -lcrypto -luv -lpthread -lrt -ldl -lhwloc

Y-Cruncher

Pi Digits To Calculate: 1B

OpenBenchmarking.orgSeconds, Fewer Is BetterY-Cruncher 0.8.3Pi Digits To Calculate: 1BLinux 6.8Linux 6.9-rc23691215SE +/- 0.30, N = 15SE +/- 0.24, N = 1513.4213.34

Stress-NG

Test: Pthread

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: PthreadLinux 6.8Linux 6.9-rc28K16K24K32K40KSE +/- 49.70, N = 3SE +/- 450.35, N = 1539599.2635919.641. (CXX) g++ options: -lm -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lpthread -lrt -lsctp -lz

OSPRay Studio

Camera: 3 - Resolution: 1080p - Samples Per Pixel: 16 - Renderer: Path Tracer - Acceleration: CPU

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 1.0Camera: 3 - Resolution: 1080p - Samples Per Pixel: 16 - Renderer: Path Tracer - Acceleration: CPULinux 6.8Linux 6.9-rc22K4K6K8K10KSE +/- 70.21, N = 3SE +/- 26.21, N = 387328552

Stress-NG

Test: System V Message Passing

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: System V Message PassingLinux 6.8Linux 6.9-rc24M8M12M16M20MSE +/- 189741.33, N = 15SE +/- 35075.39, N = 317859304.3818740350.561. (CXX) g++ options: -lm -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lpthread -lrt -lsctp -lz

OSPRay Studio

Camera: 1 - Resolution: 1080p - Samples Per Pixel: 16 - Renderer: Path Tracer - Acceleration: CPU

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 1.0Camera: 1 - Resolution: 1080p - Samples Per Pixel: 16 - Renderer: Path Tracer - Acceleration: CPULinux 6.8Linux 6.9-rc215003000450060007500SE +/- 83.68, N = 3SE +/- 15.17, N = 369096804

Timed FFmpeg Compilation

Time To Compile

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed FFmpeg Compilation 6.1Time To CompileLinux 6.8Linux 6.9-rc248121620SE +/- 0.39, N = 15SE +/- 0.39, N = 1517.2517.28

RocksDB

Test: Read Random Write Random

OpenBenchmarking.orgOp/s, More Is BetterRocksDB 9.0Test: Read Random Write RandomLinux 6.8Linux 6.9-rc2500K1000K1500K2000K2500KSE +/- 17412.72, N = 3SE +/- 22543.45, N = 5212084420685881. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti -lpthread

OSPRay Studio

Camera: 2 - Resolution: 1080p - Samples Per Pixel: 1 - Renderer: Path Tracer - Acceleration: CPU

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 1.0Camera: 2 - Resolution: 1080p - Samples Per Pixel: 1 - Renderer: Path Tracer - Acceleration: CPULinux 6.8Linux 6.9-rc2110220330440550SE +/- 5.26, N = 5SE +/- 2.33, N = 3501489

Stress-NG

Test: Malloc

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: MallocLinux 6.8Linux 6.9-rc240M80M120M160M200MSE +/- 201545.00, N = 3SE +/- 3675496.40, N = 12163551396.40161652700.091. (CXX) g++ options: -lm -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lpthread -lrt -lsctp -lz

Timed Linux Kernel Compilation

Build: defconfig

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed Linux Kernel Compilation 6.8Build: defconfigLinux 6.8Linux 6.9-rc2918273645SE +/- 0.36, N = 6SE +/- 0.37, N = 638.4637.70

OpenVINO

Model: Weld Porosity Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Weld Porosity Detection FP16-INT8 - Device: CPULinux 6.8Linux 6.9-rc20.91131.82262.73393.64524.5565SE +/- 0.05, N = 4SE +/- 0.01, N = 34.053.89MIN: 2.67 / MAX: 52.43MIN: 2.64 / MAX: 47.091. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Weld Porosity Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Weld Porosity Detection FP16-INT8 - Device: CPULinux 6.8Linux 6.9-rc26K12K18K24K30KSE +/- 285.82, N = 4SE +/- 155.42, N = 326732.8827790.241. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

WebP2 Image Encode

Encode Settings: Quality 95, Compression Effort 7

OpenBenchmarking.orgMP/s, More Is BetterWebP2 Image Encode 20220823Encode Settings: Quality 95, Compression Effort 7Linux 6.8Linux 6.9-rc20.07650.1530.22950.3060.3825SE +/- 0.00, N = 3SE +/- 0.00, N = 30.340.331. (CXX) g++ options: -msse4.2 -fno-rtti -O3 -ldl

SVT-AV1

Encoder Mode: Preset 8 - Input: Bosphorus 4K

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 2.0Encoder Mode: Preset 8 - Input: Bosphorus 4KLinux 6.8Linux 6.9-rc21122334455SE +/- 1.10, N = 12SE +/- 1.18, N = 1548.9448.571. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

Intel Open Image Denoise

Run: RT.hdr_alb_nrm.3840x2160 - Device: CPU-Only

OpenBenchmarking.orgImages / Sec, More Is BetterIntel Open Image Denoise 2.2Run: RT.hdr_alb_nrm.3840x2160 - Device: CPU-OnlyLinux 6.8Linux 6.9-rc20.5131.0261.5392.0522.565SE +/- 0.02, N = 15SE +/- 0.02, N = 152.282.23

TensorFlow

Device: CPU - Batch Size: 256 - Model: AlexNet

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.16.1Device: CPU - Batch Size: 256 - Model: AlexNetLinux 6.8Linux 6.9-rc2160320480640800SE +/- 9.01, N = 3SE +/- 6.62, N = 7723.16711.74

OpenVINO

Model: Face Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Face Detection FP16-INT8 - Device: CPULinux 6.8Linux 6.9-rc270140210280350SE +/- 0.74, N = 3SE +/- 0.81, N = 3337.21337.78MIN: 261.24 / MAX: 615.09MIN: 253.21 / MAX: 781.061. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Face Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Face Detection FP16-INT8 - Device: CPULinux 6.8Linux 6.9-rc270140210280350SE +/- 0.75, N = 3SE +/- 0.82, N = 3331.23330.731. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Noise Suppression Poconet-Like FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Noise Suppression Poconet-Like FP16 - Device: CPULinux 6.8Linux 6.9-rc2612182430SE +/- 0.17, N = 3SE +/- 0.20, N = 323.6823.97MIN: 11.64 / MAX: 175.69MIN: 11.24 / MAX: 358.11. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Noise Suppression Poconet-Like FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Noise Suppression Poconet-Like FP16 - Device: CPULinux 6.8Linux 6.9-rc210002000300040005000SE +/- 54.03, N = 3SE +/- 29.05, N = 34621.324600.951. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

Stress-NG

Test: Memory Copying

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Memory CopyingLinux 6.8Linux 6.9-rc25K10K15K20K25KSE +/- 178.25, N = 3SE +/- 155.03, N = 1021085.1020605.391. (CXX) g++ options: -lm -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lpthread -lrt -lsctp -lz

OpenVINO

Model: Person Vehicle Bike Detection FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Person Vehicle Bike Detection FP16 - Device: CPULinux 6.8Linux 6.9-rc248121620SE +/- 0.06, N = 3SE +/- 0.07, N = 317.5217.58MIN: 11.97 / MAX: 108.98MIN: 12.03 / MAX: 66.231. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Person Vehicle Bike Detection FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Person Vehicle Bike Detection FP16 - Device: CPULinux 6.8Linux 6.9-rc214002800420056007000SE +/- 18.88, N = 3SE +/- 23.77, N = 36336.786306.421. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Face Detection FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Face Detection FP16 - Device: CPULinux 6.8Linux 6.9-rc270140210280350SE +/- 0.84, N = 3SE +/- 1.30, N = 3307.74302.77MIN: 183.58 / MAX: 728.14MIN: 181.55 / MAX: 894.731. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Face Detection FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Face Detection FP16 - Device: CPULinux 6.8Linux 6.9-rc2306090120150SE +/- 0.33, N = 3SE +/- 0.55, N = 3119.92121.931. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Road Segmentation ADAS FP16-INT8 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Road Segmentation ADAS FP16-INT8 - Device: CPULinux 6.8Linux 6.9-rc220406080100SE +/- 0.09, N = 3SE +/- 0.28, N = 377.3477.57MIN: 56.48 / MAX: 158.67MIN: 57.16 / MAX: 148.671. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Road Segmentation ADAS FP16-INT8 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Road Segmentation ADAS FP16-INT8 - Device: CPULinux 6.8Linux 6.9-rc230060090012001500SE +/- 1.59, N = 3SE +/- 5.16, N = 31446.421442.211. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Person Detection FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Person Detection FP16 - Device: CPULinux 6.8Linux 6.9-rc220406080100SE +/- 0.43, N = 3SE +/- 0.20, N = 381.9079.23MIN: 49.43 / MAX: 345.35MIN: 50.1 / MAX: 290.061. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Person Detection FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Person Detection FP16 - Device: CPULinux 6.8Linux 6.9-rc2100200300400500SE +/- 2.33, N = 3SE +/- 1.20, N = 3451.13466.451. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Person Detection FP32 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Person Detection FP32 - Device: CPULinux 6.8Linux 6.9-rc220406080100SE +/- 0.57, N = 3SE +/- 0.62, N = 382.8779.00MIN: 51.69 / MAX: 529.56MIN: 49.24 / MAX: 319.951. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Person Detection FP32 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Person Detection FP32 - Device: CPULinux 6.8Linux 6.9-rc2100200300400500SE +/- 3.09, N = 3SE +/- 3.72, N = 3445.90467.791. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Person Re-Identification Retail FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Person Re-Identification Retail FP16 - Device: CPULinux 6.8Linux 6.9-rc23691215SE +/- 0.02, N = 3SE +/- 0.03, N = 39.599.65MIN: 7.62 / MAX: 27.98MIN: 7.62 / MAX: 34.181. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Person Re-Identification Retail FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Person Re-Identification Retail FP16 - Device: CPULinux 6.8Linux 6.9-rc22K4K6K8K10KSE +/- 20.55, N = 3SE +/- 28.95, N = 311638.5111564.781. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

Blender

Blend File: BMW27 - Compute: CPU-Only

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 4.1Blend File: BMW27 - Compute: CPU-OnlyLinux 6.8Linux 6.9-rc2510152025SE +/- 0.33, N = 14SE +/- 0.08, N = 321.8222.02

OpenVINO

Model: Machine Translation EN To DE FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Machine Translation EN To DE FP16 - Device: CPULinux 6.8Linux 6.9-rc21224364860SE +/- 0.47, N = 3SE +/- 0.25, N = 354.9854.83MIN: 33.9 / MAX: 423.36MIN: 34.71 / MAX: 375.041. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Machine Translation EN To DE FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Machine Translation EN To DE FP16 - Device: CPULinux 6.8Linux 6.9-rc2150300450600750SE +/- 5.75, N = 3SE +/- 3.16, N = 3671.66673.461. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

oneDNN

Harness: Deconvolution Batch shapes_1d - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.4Harness: Deconvolution Batch shapes_1d - Engine: CPULinux 6.8Linux 6.9-rc2510152025SE +/- 0.23, N = 15SE +/- 0.14, N = 318.3418.03MIN: 10.09MIN: 13.291. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread

OpenVINO

Model: Vehicle Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Vehicle Detection FP16-INT8 - Device: CPULinux 6.8Linux 6.9-rc2510152025SE +/- 0.04, N = 3SE +/- 0.08, N = 322.0622.12MIN: 15.51 / MAX: 86.25MIN: 15.73 / MAX: 71.51. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Vehicle Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Vehicle Detection FP16-INT8 - Device: CPULinux 6.8Linux 6.9-rc211002200330044005500SE +/- 9.46, N = 3SE +/- 18.34, N = 35067.405052.711. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

TensorFlow

Device: CPU - Batch Size: 32 - Model: AlexNet

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.16.1Device: CPU - Batch Size: 32 - Model: AlexNetLinux 6.8Linux 6.9-rc280160240320400SE +/- 2.86, N = 15SE +/- 5.16, N = 15346.10341.97

OpenVINO

Model: Road Segmentation ADAS FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Road Segmentation ADAS FP16 - Device: CPULinux 6.8Linux 6.9-rc2816243240SE +/- 0.35, N = 3SE +/- 0.23, N = 336.2835.14MIN: 24.78 / MAX: 205.05MIN: 25.25 / MAX: 437.271. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Road Segmentation ADAS FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Road Segmentation ADAS FP16 - Device: CPULinux 6.8Linux 6.9-rc22004006008001000SE +/- 9.82, N = 3SE +/- 6.69, N = 31018.471051.301. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

ONNX Runtime

Model: Faster R-CNN R-50-FPN-int8 - Device: CPU - Executor: Parallel

OpenBenchmarking.orgInference Time Cost (ms), Fewer Is BetterONNX Runtime 1.17Model: Faster R-CNN R-50-FPN-int8 - Device: CPU - Executor: ParallelLinux 6.8Linux 6.9-rc21020304050SE +/- 0.23, N = 3SE +/- 0.13, N = 342.6843.151. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

ONNX Runtime

Model: Faster R-CNN R-50-FPN-int8 - Device: CPU - Executor: Parallel

OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.17Model: Faster R-CNN R-50-FPN-int8 - Device: CPU - Executor: ParallelLinux 6.8Linux 6.9-rc2612182430SE +/- 0.13, N = 3SE +/- 0.07, N = 323.4323.171. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

ONNX Runtime

Model: Faster R-CNN R-50-FPN-int8 - Device: CPU - Executor: Standard

OpenBenchmarking.orgInference Time Cost (ms), Fewer Is BetterONNX Runtime 1.17Model: Faster R-CNN R-50-FPN-int8 - Device: CPU - Executor: StandardLinux 6.8Linux 6.9-rc2714212835SE +/- 0.38, N = 3SE +/- 0.22, N = 330.8229.111. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

ONNX Runtime

Model: Faster R-CNN R-50-FPN-int8 - Device: CPU - Executor: Standard

OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.17Model: Faster R-CNN R-50-FPN-int8 - Device: CPU - Executor: StandardLinux 6.8Linux 6.9-rc2816243240SE +/- 0.40, N = 3SE +/- 0.25, N = 332.4534.351. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

OpenVINO

Model: Face Detection Retail FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Face Detection Retail FP16 - Device: CPULinux 6.8Linux 6.9-rc23691215SE +/- 0.02, N = 3SE +/- 0.02, N = 39.929.89MIN: 7.45 / MAX: 33.82MIN: 7.63 / MAX: 36.571. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Face Detection Retail FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Face Detection Retail FP16 - Device: CPULinux 6.8Linux 6.9-rc22K4K6K8K10KSE +/- 23.83, N = 3SE +/- 26.72, N = 311260.9811295.921. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

Embree

Binary: Pathtracer ISPC - Model: Crown

OpenBenchmarking.orgFrames Per Second, More Is BetterEmbree 4.3Binary: Pathtracer ISPC - Model: CrownLinux 6.8Linux 6.9-rc2918273645SE +/- 0.47, N = 4SE +/- 1.44, N = 1238.8435.73MIN: 30.82 / MAX: 52.25MIN: 20.32 / MAX: 57.51

OpenVINO

Model: Weld Porosity Detection FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Weld Porosity Detection FP16 - Device: CPULinux 6.8Linux 6.9-rc2246810SE +/- 0.08, N = 3SE +/- 0.05, N = 36.856.76MIN: 4.47 / MAX: 51.04MIN: 4.36 / MAX: 70.911. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Weld Porosity Detection FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Weld Porosity Detection FP16 - Device: CPULinux 6.8Linux 6.9-rc24K8K12K16K20KSE +/- 194.69, N = 3SE +/- 107.94, N = 316147.5716349.051. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Face Detection Retail FP16-INT8 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Face Detection Retail FP16-INT8 - Device: CPULinux 6.8Linux 6.9-rc2246810SE +/- 0.07, N = 3SE +/- 0.00, N = 37.177.14MIN: 5.78 / MAX: 54.3MIN: 5.79 / MAX: 44.661. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Face Detection Retail FP16-INT8 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Face Detection Retail FP16-INT8 - Device: CPULinux 6.8Linux 6.9-rc23K6K9K12K15KSE +/- 132.85, N = 3SE +/- 25.09, N = 315532.5415589.591. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Vehicle Detection FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Vehicle Detection FP16 - Device: CPULinux 6.8Linux 6.9-rc248121620SE +/- 0.10, N = 3SE +/- 0.14, N = 314.5813.89MIN: 9.5 / MAX: 109.83MIN: 9.12 / MAX: 90.571. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Vehicle Detection FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Vehicle Detection FP16 - Device: CPULinux 6.8Linux 6.9-rc26001200180024003000SE +/- 16.72, N = 3SE +/- 25.96, N = 32530.042656.421. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Handwritten English Recognition FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Handwritten English Recognition FP16 - Device: CPULinux 6.8Linux 6.9-rc2714212835SE +/- 0.03, N = 3SE +/- 0.09, N = 330.8531.01MIN: 24.82 / MAX: 82.03MIN: 24.42 / MAX: 90.861. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Handwritten English Recognition FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Handwritten English Recognition FP16 - Device: CPULinux 6.8Linux 6.9-rc28001600240032004000SE +/- 3.14, N = 3SE +/- 10.89, N = 33626.413608.211. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

ONNX Runtime

Model: bertsquad-12 - Device: CPU - Executor: Parallel

OpenBenchmarking.orgInference Time Cost (ms), Fewer Is BetterONNX Runtime 1.17Model: bertsquad-12 - Device: CPU - Executor: ParallelLinux 6.8Linux 6.9-rc220406080100SE +/- 0.33, N = 3SE +/- 0.44, N = 392.7594.331. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

ONNX Runtime

Model: bertsquad-12 - Device: CPU - Executor: Parallel

OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.17Model: bertsquad-12 - Device: CPU - Executor: ParallelLinux 6.8Linux 6.9-rc23691215SE +/- 0.04, N = 3SE +/- 0.05, N = 310.7810.601. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

ONNX Runtime

Model: yolov4 - Device: CPU - Executor: Parallel

OpenBenchmarking.orgInference Time Cost (ms), Fewer Is BetterONNX Runtime 1.17Model: yolov4 - Device: CPU - Executor: ParallelLinux 6.8Linux 6.9-rc2306090120150SE +/- 1.18, N = 3SE +/- 1.32, N = 3126.38124.381. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

ONNX Runtime

Model: yolov4 - Device: CPU - Executor: Parallel

OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.17Model: yolov4 - Device: CPU - Executor: ParallelLinux 6.8Linux 6.9-rc2246810SE +/- 0.07338, N = 3SE +/- 0.08546, N = 37.913218.041421. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

OpenVINO

Model: Handwritten English Recognition FP16-INT8 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Handwritten English Recognition FP16-INT8 - Device: CPULinux 6.8Linux 6.9-rc2714212835SE +/- 0.08, N = 3SE +/- 0.07, N = 329.6130.20MIN: 25.51 / MAX: 92.13MIN: 22.08 / MAX: 107.871. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Handwritten English Recognition FP16-INT8 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Handwritten English Recognition FP16-INT8 - Device: CPULinux 6.8Linux 6.9-rc28001600240032004000SE +/- 10.67, N = 3SE +/- 8.36, N = 33777.563704.381. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

ONNX Runtime

Model: ArcFace ResNet-100 - Device: CPU - Executor: Parallel

OpenBenchmarking.orgInference Time Cost (ms), Fewer Is BetterONNX Runtime 1.17Model: ArcFace ResNet-100 - Device: CPU - Executor: ParallelLinux 6.8Linux 6.9-rc21326395265SE +/- 0.81, N = 3SE +/- 0.56, N = 359.6056.951. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

ONNX Runtime

Model: ArcFace ResNet-100 - Device: CPU - Executor: Parallel

OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.17Model: ArcFace ResNet-100 - Device: CPU - Executor: ParallelLinux 6.8Linux 6.9-rc248121620SE +/- 0.23, N = 3SE +/- 0.17, N = 316.7817.561. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

Speedb

Test: Random Fill

OpenBenchmarking.orgOp/s, More Is BetterSpeedb 2.7Test: Random FillLinux 6.8Linux 6.9-rc270K140K210K280K350KSE +/- 2148.02, N = 3SE +/- 3492.28, N = 33264993228161. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti -lpthread

Speedb

Test: Random Fill Sync

OpenBenchmarking.orgOp/s, More Is BetterSpeedb 2.7Test: Random Fill SyncLinux 6.8Linux 6.9-rc260K120K180K240K300KSE +/- 1490.88, N = 3SE +/- 3603.61, N = 32574462596031. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti -lpthread

Speedb

Test: Update Random

OpenBenchmarking.orgOp/s, More Is BetterSpeedb 2.7Test: Update RandomLinux 6.8Linux 6.9-rc260K120K180K240K300KSE +/- 3488.80, N = 3SE +/- 3235.16, N = 32921802934141. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti -lpthread

RocksDB

Test: Overwrite

OpenBenchmarking.orgOp/s, More Is BetterRocksDB 9.0Test: OverwriteLinux 6.8Linux 6.9-rc280K160K240K320K400KSE +/- 881.98, N = 3SE +/- 3053.81, N = 33880103919681. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti -lpthread

RocksDB

Test: Update Random

OpenBenchmarking.orgOp/s, More Is BetterRocksDB 9.0Test: Update RandomLinux 6.8Linux 6.9-rc280K160K240K320K400KSE +/- 1470.46, N = 3SE +/- 1522.72, N = 33598253615021. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti -lpthread

ONNX Runtime

Model: ResNet50 v1-12-int8 - Device: CPU - Executor: Parallel

OpenBenchmarking.orgInference Time Cost (ms), Fewer Is BetterONNX Runtime 1.17Model: ResNet50 v1-12-int8 - Device: CPU - Executor: ParallelLinux 6.8Linux 6.9-rc23691215SE +/- 0.10, N = 3SE +/- 0.14, N = 310.6110.511. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

ONNX Runtime

Model: ResNet50 v1-12-int8 - Device: CPU - Executor: Parallel

OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.17Model: ResNet50 v1-12-int8 - Device: CPU - Executor: ParallelLinux 6.8Linux 6.9-rc220406080100SE +/- 0.92, N = 3SE +/- 1.23, N = 394.2595.141. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

Speedb

Test: Random Read

OpenBenchmarking.orgOp/s, More Is BetterSpeedb 2.7Test: Random ReadLinux 6.8Linux 6.9-rc280M160M240M320M400MSE +/- 1002006.26, N = 3SE +/- 4146957.10, N = 33804193893758374791. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti -lpthread

ONNX Runtime

Model: super-resolution-10 - Device: CPU - Executor: Parallel

OpenBenchmarking.orgInference Time Cost (ms), Fewer Is BetterONNX Runtime 1.17Model: super-resolution-10 - Device: CPU - Executor: ParallelLinux 6.8Linux 6.9-rc2246810SE +/- 0.04024, N = 3SE +/- 0.06370, N = 36.550116.511271. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

ONNX Runtime

Model: super-resolution-10 - Device: CPU - Executor: Parallel

OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.17Model: super-resolution-10 - Device: CPU - Executor: ParallelLinux 6.8Linux 6.9-rc2306090120150SE +/- 0.93, N = 3SE +/- 1.50, N = 3152.64153.561. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

OpenSSL

Algorithm: RSA4096

OpenBenchmarking.orgverify/s, More Is BetterOpenSSLAlgorithm: RSA4096Linux 6.8Linux 6.9-rc2300K600K900K1200K1500KSE +/- 19064.62, N = 3SE +/- 833.27, N = 31358616.41396904.01. OpenSSL 3.0.10 1 Aug 2023 (Library: OpenSSL 3.0.10 1 Aug 2023)

OpenSSL

Algorithm: RSA4096

OpenBenchmarking.orgsign/s, More Is BetterOpenSSLAlgorithm: RSA4096Linux 6.8Linux 6.9-rc28K16K24K32K40KSE +/- 46.27, N = 3SE +/- 90.23, N = 338204.638147.41. OpenSSL 3.0.10 1 Aug 2023 (Library: OpenSSL 3.0.10 1 Aug 2023)

RocksDB

Test: Random Read

OpenBenchmarking.orgOp/s, More Is BetterRocksDB 9.0Test: Random ReadLinux 6.8Linux 6.9-rc280M160M240M320M400MSE +/- 1573786.50, N = 3SE +/- 1447290.34, N = 33604985183615860831. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti -lpthread

Stress-NG

Test: Context Switching

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Context SwitchingLinux 6.8Linux 6.9-rc24M8M12M16M20MSE +/- 178479.09, N = 8SE +/- 265846.30, N = 320343491.5219390362.901. (CXX) g++ options: -lm -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lpthread -lrt -lsctp -lz

OSPRay Studio

Camera: 1 - Resolution: 1080p - Samples Per Pixel: 1 - Renderer: Path Tracer - Acceleration: CPU

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 1.0Camera: 1 - Resolution: 1080p - Samples Per Pixel: 1 - Renderer: Path Tracer - Acceleration: CPULinux 6.8Linux 6.9-rc2100200300400500SE +/- 3.71, N = 3SE +/- 2.33, N = 3466478

Blender

Blend File: Classroom - Compute: CPU-Only

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 4.1Blend File: Classroom - Compute: CPU-OnlyLinux 6.8Linux 6.9-rc21224364860SE +/- 0.10, N = 3SE +/- 0.09, N = 353.9853.82

TensorFlow

Device: CPU - Batch Size: 16 - Model: AlexNet

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.16.1Device: CPU - Batch Size: 16 - Model: AlexNetLinux 6.8Linux 6.9-rc250100150200250SE +/- 1.58, N = 15SE +/- 1.89, N = 15213.35210.71

TensorFlow

Device: CPU - Batch Size: 64 - Model: AlexNet

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.16.1Device: CPU - Batch Size: 64 - Model: AlexNetLinux 6.8Linux 6.9-rc2110220330440550SE +/- 6.05, N = 3SE +/- 5.17, N = 15495.72471.88

FFmpeg

Encoder: libx264 - Scenario: Live

OpenBenchmarking.orgFPS, More Is BetterFFmpeg 6.1Encoder: libx264 - Scenario: LiveLinux 6.8Linux 6.9-rc24080120160200SE +/- 1.29, N = 3SE +/- 0.70, N = 3181.51182.121. (CXX) g++ options: -O3 -rdynamic -lpthread -lrt -ldl -lnuma

Y-Cruncher

Pi Digits To Calculate: 500M

OpenBenchmarking.orgSeconds, Fewer Is BetterY-Cruncher 0.8.3Pi Digits To Calculate: 500MLinux 6.8Linux 6.9-rc2246810SE +/- 0.143, N = 12SE +/- 0.083, N = 156.4836.202

OSPRay Studio

Camera: 1 - Resolution: 4K - Samples Per Pixel: 16 - Renderer: Path Tracer - Acceleration: CPU

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 1.0Camera: 1 - Resolution: 4K - Samples Per Pixel: 16 - Renderer: Path Tracer - Acceleration: CPULinux 6.8Linux 6.9-rc27K14K21K28K35KSE +/- 294.16, N = 3SE +/- 454.99, N = 33441234953

WebP2 Image Encode

Encode Settings: Quality 75, Compression Effort 7

OpenBenchmarking.orgMP/s, More Is BetterWebP2 Image Encode 20220823Encode Settings: Quality 75, Compression Effort 7Linux 6.8Linux 6.9-rc20.1440.2880.4320.5760.72SE +/- 0.01, N = 3SE +/- 0.01, N = 40.640.611. (CXX) g++ options: -msse4.2 -fno-rtti -O3 -ldl

Hackbench

Count: 16 - Type: Thread

OpenBenchmarking.orgSeconds, Fewer Is BetterHackbenchCount: 16 - Type: ThreadLinux 6.8Linux 6.9-rc248121620SE +/- 0.00, N = 3SE +/- 0.14, N = 1514.6814.301. (CC) gcc options: -lpthread

VVenC

Video Input: Bosphorus 1080p - Video Preset: Fast

OpenBenchmarking.orgFrames Per Second, More Is BetterVVenC 1.11Video Input: Bosphorus 1080p - Video Preset: FastLinux 6.8Linux 6.9-rc248121620SE +/- 0.11, N = 3SE +/- 0.07, N = 315.9116.151. (CXX) g++ options: -O3 -flto=auto -fno-fat-lto-objects

JPEG-XL libjxl

Input: PNG - Quality: 90

OpenBenchmarking.orgMP/s, More Is BetterJPEG-XL libjxl 0.10.1Input: PNG - Quality: 90Linux 6.8Linux 6.9-rc2714212835SE +/- 0.28, N = 3SE +/- 0.18, N = 330.9730.131. (CXX) g++ options: -fno-rtti -O3 -fPIE -pie -lm

Primesieve

Length: 1e13

OpenBenchmarking.orgSeconds, Fewer Is BetterPrimesieve 12.1Length: 1e13Linux 6.8Linux 6.9-rc2918273645SE +/- 0.06, N = 3SE +/- 0.09, N = 339.6239.461. (CXX) g++ options: -O3

SVT-AV1

Encoder Mode: Preset 12 - Input: Bosphorus 4K

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 2.0Encoder Mode: Preset 12 - Input: Bosphorus 4KLinux 6.8Linux 6.9-rc2306090120150SE +/- 5.13, N = 15SE +/- 5.21, N = 15127.20126.191. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

oneDNN

Harness: IP Shapes 1D - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.4Harness: IP Shapes 1D - Engine: CPULinux 6.8Linux 6.9-rc21.01512.03023.04534.06045.0755SE +/- 0.04580, N = 3SE +/- 0.05180, N = 124.500554.51166MIN: 3.52MIN: 3.371. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread

Stress-NG

Test: NUMA

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: NUMALinux 6.8Linux 6.9-rc2110220330440550SE +/- 4.27, N = 3SE +/- 5.89, N = 4482.62487.601. (CXX) g++ options: -lm -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lpthread -lrt -lsctp -lz

Xmrig

Variant: CryptoNight-Femto UPX2 - Hash Count: 1M

OpenBenchmarking.orgH/s, More Is BetterXmrig 6.21Variant: CryptoNight-Femto UPX2 - Hash Count: 1MLinux 6.8Linux 6.9-rc27K14K21K28K35KSE +/- 110.64, N = 3SE +/- 170.37, N = 333002.232993.81. (CXX) g++ options: -fexceptions -fno-rtti -maes -O3 -Ofast -static-libgcc -static-libstdc++ -rdynamic -lssl -lcrypto -luv -lpthread -lrt -ldl -lhwloc

Xmrig

Variant: CryptoNight-Heavy - Hash Count: 1M

OpenBenchmarking.orgH/s, More Is BetterXmrig 6.21Variant: CryptoNight-Heavy - Hash Count: 1MLinux 6.8Linux 6.9-rc27K14K21K28K35KSE +/- 49.86, N = 3SE +/- 160.32, N = 332856.332826.11. (CXX) g++ options: -fexceptions -fno-rtti -maes -O3 -Ofast -static-libgcc -static-libstdc++ -rdynamic -lssl -lcrypto -luv -lpthread -lrt -ldl -lhwloc

SVT-AV1

Encoder Mode: Preset 13 - Input: Bosphorus 4K

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 2.0Encoder Mode: Preset 13 - Input: Bosphorus 4KLinux 6.8Linux 6.9-rc2306090120150SE +/- 3.82, N = 12SE +/- 5.42, N = 15123.25123.101. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

Xmrig

Variant: KawPow - Hash Count: 1M

OpenBenchmarking.orgH/s, More Is BetterXmrig 6.21Variant: KawPow - Hash Count: 1MLinux 6.8Linux 6.9-rc27K14K21K28K35KSE +/- 68.36, N = 3SE +/- 137.96, N = 332860.833072.51. (CXX) g++ options: -fexceptions -fno-rtti -maes -O3 -Ofast -static-libgcc -static-libstdc++ -rdynamic -lssl -lcrypto -luv -lpthread -lrt -ldl -lhwloc

SVT-AV1

Encoder Mode: Preset 4 - Input: Bosphorus 1080p

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 2.0Encoder Mode: Preset 4 - Input: Bosphorus 1080pLinux 6.8Linux 6.9-rc2510152025SE +/- 0.13, N = 15SE +/- 0.21, N = 318.6618.931. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

GROMACS

Implementation: MPI CPU - Input: water_GMX50_bare

OpenBenchmarking.orgNs Per Day, More Is BetterGROMACS 2024Implementation: MPI CPU - Input: water_GMX50_bareLinux 6.8Linux 6.9-rc23691215SE +/- 0.06, N = 3SE +/- 0.08, N = 312.0911.761. (CXX) g++ options: -O3 -lm

Xmrig

Variant: Wownero - Hash Count: 1M

OpenBenchmarking.orgH/s, More Is BetterXmrig 6.21Variant: Wownero - Hash Count: 1MLinux 6.8Linux 6.9-rc28K16K24K32K40KSE +/- 245.88, N = 3SE +/- 490.33, N = 336096.636180.71. (CXX) g++ options: -fexceptions -fno-rtti -maes -O3 -Ofast -static-libgcc -static-libstdc++ -rdynamic -lssl -lcrypto -luv -lpthread -lrt -ldl -lhwloc

Stress-NG

Test: Mutex

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: MutexLinux 6.8Linux 6.9-rc26M12M18M24M30MSE +/- 281178.86, N = 3SE +/- 294297.65, N = 328490133.2828934422.161. (CXX) g++ options: -lm -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lpthread -lrt -lsctp -lz

Stress-NG

Test: Socket Activity

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Socket ActivityLinux 6.8Linux 6.9-rc210K20K30K40K50KSE +/- 79.93, N = 3SE +/- 21.40, N = 347927.7546123.321. (CXX) g++ options: -lm -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lpthread -lrt -lsctp -lz

Stress-NG

Test: Zlib

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: ZlibLinux 6.8Linux 6.9-rc22K4K6K8K10KSE +/- 25.13, N = 3SE +/- 124.93, N = 39670.379446.071. (CXX) g++ options: -lm -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lpthread -lrt -lsctp -lz

Stress-NG

Test: Mixed Scheduler

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Mixed SchedulerLinux 6.8Linux 6.9-rc215K30K45K60K75KSE +/- 153.71, N = 3SE +/- 281.29, N = 370407.9670036.201. (CXX) g++ options: -lm -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lpthread -lrt -lsctp -lz

Stress-NG

Test: Glibc Qsort Data Sorting

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Glibc Qsort Data SortingLinux 6.8Linux 6.9-rc2400800120016002000SE +/- 4.40, N = 3SE +/- 4.16, N = 31866.581858.701. (CXX) g++ options: -lm -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lpthread -lrt -lsctp -lz

Stress-NG

Test: Semaphores

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: SemaphoresLinux 6.8Linux 6.9-rc230M60M90M120M150MSE +/- 1498916.25, N = 3SE +/- 1330349.25, N = 3154589461.19150005776.471. (CXX) g++ options: -lm -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lpthread -lrt -lsctp -lz

Stress-NG

Test: CPU Stress

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: CPU StressLinux 6.8Linux 6.9-rc240K80K120K160K200KSE +/- 569.84, N = 3SE +/- 335.84, N = 3202073.08200671.701. (CXX) g++ options: -lm -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lpthread -lrt -lsctp -lz

Stress-NG

Test: SENDFILE

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: SENDFILELinux 6.8Linux 6.9-rc2400K800K1200K1600K2000KSE +/- 609.53, N = 3SE +/- 5873.31, N = 31798203.121900682.081. (CXX) g++ options: -lm -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lpthread -lrt -lsctp -lz

Stress-NG

Test: Poll

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: PollLinux 6.8Linux 6.9-rc22M4M6M8M10MSE +/- 37074.52, N = 3SE +/- 30731.99, N = 310389186.0210232390.411. (CXX) g++ options: -lm -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lpthread -lrt -lsctp -lz

Stress-NG

Test: Hash

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: HashLinux 6.8Linux 6.9-rc24M8M12M16M20MSE +/- 82496.53, N = 3SE +/- 192774.29, N = 317071694.5217199190.091. (CXX) g++ options: -lm -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lpthread -lrt -lsctp -lz

Stress-NG

Test: AVL Tree

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: AVL TreeLinux 6.8Linux 6.9-rc22004006008001000SE +/- 6.53, N = 3SE +/- 2.13, N = 3810.19808.991. (CXX) g++ options: -lm -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lpthread -lrt -lsctp -lz

Stress-NG

Test: Vector Shuffle

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Vector ShuffleLinux 6.8Linux 6.9-rc2120K240K360K480K600KSE +/- 1416.85, N = 3SE +/- 1897.90, N = 3576905.92569593.001. (CXX) g++ options: -lm -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lpthread -lrt -lsctp -lz

Hackbench

Count: 32 - Type: Process

OpenBenchmarking.orgSeconds, Fewer Is BetterHackbenchCount: 32 - Type: ProcessLinux 6.8Linux 6.9-rc2714212835SE +/- 0.27, N = 3SE +/- 0.39, N = 324.7527.991. (CC) gcc options: -lpthread

LZ4 Compression

Compression Level: 9 - Decompression Speed

OpenBenchmarking.orgMB/s, More Is BetterLZ4 Compression 1.9.4Compression Level: 9 - Decompression SpeedLinux 6.8Linux 6.9-rc28001600240032004000SE +/- 16.01, N = 3SE +/- 57.81, N = 33537.03492.01. (CC) gcc options: -O3

LZ4 Compression

Compression Level: 9 - Compression Speed

OpenBenchmarking.orgMB/s, More Is BetterLZ4 Compression 1.9.4Compression Level: 9 - Compression SpeedLinux 6.8Linux 6.9-rc2816243240SE +/- 0.08, N = 3SE +/- 0.07, N = 332.6132.661. (CC) gcc options: -O3

LZ4 Compression

Compression Level: 3 - Decompression Speed

OpenBenchmarking.orgMB/s, More Is BetterLZ4 Compression 1.9.4Compression Level: 3 - Decompression SpeedLinux 6.8Linux 6.9-rc27001400210028003500SE +/- 33.92, N = 3SE +/- 34.17, N = 33364.83349.61. (CC) gcc options: -O3

LZ4 Compression

Compression Level: 3 - Compression Speed

OpenBenchmarking.orgMB/s, More Is BetterLZ4 Compression 1.9.4Compression Level: 3 - Compression SpeedLinux 6.8Linux 6.9-rc220406080100SE +/- 0.06, N = 3SE +/- 0.06, N = 398.4398.411. (CC) gcc options: -O3

JPEG-XL Decoding libjxl

CPU Threads: All

OpenBenchmarking.orgMP/s, More Is BetterJPEG-XL Decoding libjxl 0.10.1CPU Threads: AllLinux 6.8Linux 6.9-rc280160240320400SE +/- 4.23, N = 3SE +/- 2.26, N = 3386.23381.66

LZ4 Compression

Compression Level: 1 - Decompression Speed

OpenBenchmarking.orgMB/s, More Is BetterLZ4 Compression 1.9.4Compression Level: 1 - Decompression SpeedLinux 6.8Linux 6.9-rc28001600240032004000SE +/- 44.31, N = 3SE +/- 18.57, N = 33601.03628.01. (CC) gcc options: -O3

LZ4 Compression

Compression Level: 1 - Compression Speed

OpenBenchmarking.orgMB/s, More Is BetterLZ4 Compression 1.9.4Compression Level: 1 - Compression SpeedLinux 6.8Linux 6.9-rc2130260390520650SE +/- 1.15, N = 3SE +/- 0.16, N = 3602.69602.541. (CC) gcc options: -O3

WebP2 Image Encode

Encode Settings: Default

OpenBenchmarking.orgMP/s, More Is BetterWebP2 Image Encode 20220823Encode Settings: DefaultLinux 6.8Linux 6.9-rc21.32752.6553.98255.316.6375SE +/- 0.11, N = 15SE +/- 0.09, N = 155.905.651. (CXX) g++ options: -msse4.2 -fno-rtti -O3 -ldl

TensorFlow

Device: CPU - Batch Size: 1 - Model: AlexNet

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.16.1Device: CPU - Batch Size: 1 - Model: AlexNetLinux 6.8Linux 6.9-rc248121620SE +/- 0.25, N = 12SE +/- 0.25, N = 317.2318.28

JPEG-XL libjxl

Input: PNG - Quality: 100

OpenBenchmarking.orgMP/s, More Is BetterJPEG-XL libjxl 0.10.1Input: PNG - Quality: 100Linux 6.8Linux 6.9-rc2612182430SE +/- 0.15, N = 3SE +/- 0.21, N = 325.6725.611. (CXX) g++ options: -fno-rtti -O3 -fPIE -pie -lm

JPEG-XL libjxl

Input: JPEG - Quality: 100

OpenBenchmarking.orgMP/s, More Is BetterJPEG-XL libjxl 0.10.1Input: JPEG - Quality: 100Linux 6.8Linux 6.9-rc2612182430SE +/- 0.11, N = 3SE +/- 0.08, N = 326.0025.961. (CXX) g++ options: -fno-rtti -O3 -fPIE -pie -lm

oneDNN

Harness: Convolution Batch Shapes Auto - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.4Harness: Convolution Batch Shapes Auto - Engine: CPULinux 6.8Linux 6.9-rc23691215SE +/- 0.03328, N = 3SE +/- 0.09863, N = 159.006218.81043MIN: 8.12MIN: 6.251. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread

Intel Open Image Denoise

Run: RT.ldr_alb_nrm.3840x2160 - Device: CPU-Only

OpenBenchmarking.orgImages / Sec, More Is BetterIntel Open Image Denoise 2.2Run: RT.ldr_alb_nrm.3840x2160 - Device: CPU-OnlyLinux 6.8Linux 6.9-rc20.5221.0441.5662.0882.61SE +/- 0.03, N = 3SE +/- 0.03, N = 32.322.22

Hackbench

Count: 16 - Type: Process

OpenBenchmarking.orgSeconds, Fewer Is BetterHackbenchCount: 16 - Type: ProcessLinux 6.8Linux 6.9-rc23691215SE +/- 0.11, N = 3SE +/- 0.19, N = 313.1113.361. (CC) gcc options: -lpthread

WavPack Audio Encoding

WAV To WavPack

OpenBenchmarking.orgSeconds, Fewer Is BetterWavPack Audio Encoding 5.7WAV To WavPackLinux 6.8Linux 6.9-rc2246810SE +/- 0.023, N = 5SE +/- 0.019, N = 56.3496.340

oneDNN

Harness: IP Shapes 3D - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.4Harness: IP Shapes 3D - Engine: CPULinux 6.8Linux 6.9-rc21.08962.17923.26884.35845.448SE +/- 0.02352, N = 3SE +/- 0.02357, N = 34.798534.84245MIN: 3.98MIN: 4.011. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread

Google Draco

Model: Church Facade

OpenBenchmarking.orgms, Fewer Is BetterGoogle Draco 1.5.6Model: Church FacadeLinux 6.8Linux 6.9-rc217003400510068008500SE +/- 0.88, N = 3SE +/- 9.56, N = 3774777621. (CXX) g++ options: -O3

WebP2 Image Encode

Encode Settings: Quality 100, Compression Effort 5

OpenBenchmarking.orgMP/s, More Is BetterWebP2 Image Encode 20220823Encode Settings: Quality 100, Compression Effort 5Linux 6.8Linux 6.9-rc2246810SE +/- 0.11, N = 15SE +/- 0.07, N = 38.358.451. (CXX) g++ options: -msse4.2 -fno-rtti -O3 -ldl

oneDNN

Harness: Deconvolution Batch shapes_3d - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.4Harness: Deconvolution Batch shapes_3d - Engine: CPULinux 6.8Linux 6.9-rc2246810SE +/- 0.10591, N = 15SE +/- 0.04472, N = 36.165765.78202MIN: 3.75MIN: 3.811. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread

Primesieve

Length: 1e12

OpenBenchmarking.orgSeconds, Fewer Is BetterPrimesieve 12.1Length: 1e12Linux 6.8Linux 6.9-rc20.75511.51022.26533.02043.7755SE +/- 0.024, N = 11SE +/- 0.044, N = 33.3563.2991. (CXX) g++ options: -O3

Google Draco

Model: Lion

OpenBenchmarking.orgms, Fewer Is BetterGoogle Draco 1.5.6Model: LionLinux 6.8Linux 6.9-rc213002600390052006500SE +/- 40.84, N = 3SE +/- 29.28, N = 3612960541. (CXX) g++ options: -O3

Phoronix Test Suite v10.8.4