Xeon Gold Cascade Lake Refresh LTS Linux Benchmarks

Intel Xeon Gold 6226R testing with a Supermicro X11SPL-F v1.02 (3.1 BIOS) and ASPEED on Ubuntu 20.10 via the Phoronix Test Suite.

HTML result view exported from: https://openbenchmarking.org/result/2212171-PTS-XEONGOLD08&rdt&grs.

Xeon Gold Cascade Lake Refresh LTS Linux BenchmarksProcessorMotherboardChipsetMemoryDiskGraphicsMonitorNetworkOSKernelDesktopDisplay ServerCompilerFile-SystemScreen ResolutionLinux 5.10.130Linux 5.15.83Linux 6.1Intel Xeon Gold 6226R @ 3.90GHz (16 Cores / 32 Threads)Supermicro X11SPL-F v1.02 (3.1 BIOS)Intel Sky Lake-E DMI3 Registers192GB280GB INTEL SSDPED1D280GAASPEEDVE2282 x Intel I210Ubuntu 20.105.10.130-0510130-generic (x86_64)GNOME Shell 3.38.1X Server 1.20.9GCC 10.3.0ext41920x10805.15.83-051583-generic (x86_64)6.1.0-phx (x86_64)OpenBenchmarking.orgKernel Details- Transparent Huge Pages: madviseCompiler Details- --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-bootstrap --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-link-mutex --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none=/build/gcc-10-poYruo/gcc-10-10.3.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-10-poYruo/gcc-10-10.3.0/debian/tmp-gcn/usr,hsa --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-build-config=bootstrap-lto-lean --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v Processor Details- Scaling Governor: intel_cpufreq performance - CPU Microcode: 0x5003102Python Details- Python 3.8.10Security Details- Linux 5.10.130: itlb_multihit: KVM: Mitigation of VMX disabled + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Vulnerable: Clear buffers attempted no microcode; SMT vulnerable + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Vulnerable: eIBRS with unprivileged eBPF + srbds: Not affected + tsx_async_abort: Mitigation of TSX disabled - Linux 5.15.83: itlb_multihit: KVM: Mitigation of VMX disabled + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Vulnerable: Clear buffers attempted no microcode; SMT vulnerable + retbleed: Mitigation of Enhanced IBRS + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Mitigation of TSX disabled - Linux 6.1: itlb_multihit: KVM: Mitigation of VMX disabled + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Vulnerable: Clear buffers attempted no microcode; SMT vulnerable + retbleed: Mitigation of Enhanced IBRS + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Mitigation of TSX disabled

Xeon Gold Cascade Lake Refresh LTS Linux Benchmarksstress-ng: Context Switchingstress-ng: System V Message Passingstress-ng: MEMFDstress-ng: Mallocstress-ng: NUMActx-clock: Context Switch Timepgbench: 100 - 500 - Read Onlypgbench: 100 - 500 - Read Only - Average Latencystress-ng: MMAPstress-ng: Mutexstress-ng: SENDFILEpgbench: 100 - 250 - Read Onlypgbench: 100 - 250 - Read Only - Average Latencyjpegxl-decode: Allpgbench: 100 - 500 - Read Write - Average Latencypgbench: 100 - 500 - Read Writegraphics-magick: Rotatedragonflydb: 50 - 1:5pgbench: 100 - 100 - Read Only - Average Latencypgbench: 100 - 100 - Read Onlystress-ng: Forkinggraphics-magick: HWB Color Spacestress-ng: IO_uringdragonflydb: 200 - 1:5dragonflydb: 200 - 1:1dragonflydb: 50 - 5:1encodec: 6 kbpsrocksdb: Rand Fill Syncdragonflydb: 200 - 5:1encodec: 1.5 kbpsencodec: 24 kbpsencodec: 3 kbpsrocksdb: Seq Fillonednn: Deconvolution Batch shapes_1d - f32 - CPUaom-av1: Speed 9 Realtime - Bosphorus 4Kpgbench: 100 - 250 - Read Writepgbench: 100 - 250 - Read Write - Average Latencystargate: 192000 - 1024jpegxl: PNG - 90rocksdb: Update Randjpegxl: JPEG - 80jpegxl: JPEG - 90aom-av1: Speed 10 Realtime - Bosphorus 4Krocksdb: Rand Fillblosc: blosclz shufflejpegxl-decode: 1aom-av1: Speed 8 Realtime - Bosphorus 4Kpgbench: 100 - 100 - Read Writepgbench: 100 - 100 - Read Write - Average Latencyjpegxl: PNG - 80spacy: en_core_web_trfavifenc: 10, Losslessstargate: 44100 - 512graphics-magick: Noise-Gaussianclickhouse: 100M Rows Web Analytics Dataset, Second Runncnn: CPU - blazefaceblosc: blosclz bitshufflerocksdb: Read While Writingclickhouse: 100M Rows Web Analytics Dataset, First Run / Cold Cachebuild-linux-kernel: defconfigdeepsparse: NLP Text Classification, BERT base uncased SST2 - Synchronous Single-Streamdeepsparse: NLP Text Classification, BERT base uncased SST2 - Synchronous Single-Streamstargate: 96000 - 512stress-ng: Semaphoresstargate: 192000 - 512mnn: resnet-v2-50build-linux-kernel: allmodconfigstargate: 44100 - 1024ncnn: CPU - resnet50mnn: MobileNetV2_224mnn: squeezenetv1.1numenta-nab: KNN CADgraphics-magick: Resizingdeepsparse: NLP Text Classification, DistilBERT mnli - Synchronous Single-Streamdeepsparse: NLP Text Classification, DistilBERT mnli - Synchronous Single-Streambuild-erlang: Time To Compileonednn: Deconvolution Batch shapes_3d - u8s8f32 - CPUdeepsparse: NLP Text Classification, BERT base uncased SST2 - Asynchronous Multi-Streamdeepsparse: NLP Text Classification, BERT base uncased SST2 - Asynchronous Multi-Streamospray-studio: 3 - 1080p - 32 - Path Tracerncnn: CPU - yolov4-tinygraphics-magick: Swirlbuild-godot: Time To Compilencnn: CPU - squeezenet_ssdsrsran: 4G PHY_DL_Test 100 PRB MIMO 256-QAMsvt-av1: Preset 12 - Bosphorus 1080pstargate: 96000 - 1024deepsparse: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Synchronous Single-Streamdeepsparse: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Synchronous Single-Streamopenvino: Age Gender Recognition Retail 0013 FP16-INT8 - CPUopenvino: Vehicle Detection FP16 - CPUopenvino: Vehicle Detection FP16 - CPUjpegxl: JPEG - 100stargate: 480000 - 512jpegxl: PNG - 100numenta-nab: Relative Entropysvt-av1: Preset 13 - Bosphorus 4Kncnn: CPU - mobilenetavifenc: 6, Losslessopenvino: Age Gender Recognition Retail 0013 FP16-INT8 - CPUstress-ng: Memory Copyingstargate: 480000 - 1024build-python: Defaultavifenc: 6mnn: nasnetcompress-7zip: Compression Ratingncnn: CPU - FastestDetmnn: SqueezeNetV1.0srsran: OFDM_Testmnn: inception-v3ospray-studio: 2 - 4K - 16 - Path Tracertensorflow: CPU - 16 - GoogLeNetospray-studio: 2 - 1080p - 32 - Path Tracerdeepsparse: NLP Token Classification, BERT base uncased conll2003 - Asynchronous Multi-Streammnn: mobilenet-v1-1.0cpuminer-opt: Myriad-Groestlbuild-nodejs: Time To Compiledeepsparse: NLP Token Classification, BERT base uncased conll2003 - Asynchronous Multi-Streamopenvino: Machine Translation EN To DE FP16 - CPUopenvino: Machine Translation EN To DE FP16 - CPUencode-flac: WAV To FLACnumenta-nab: Bayesian Changepointsvt-av1: Preset 13 - Bosphorus 1080pgraphics-magick: Enhancedopenvino: Vehicle Detection FP16-INT8 - CPUdeepsparse: CV Classification, ResNet-50 ImageNet - Synchronous Single-Streamospray-studio: 1 - 4K - 16 - Path Tracerbuild-php: Time To Compilencnn: CPU - shufflenet-v2openvino: Person Vehicle Bike Detection FP16 - CPUncnn: CPU - mnasnetopenvino: Person Vehicle Bike Detection FP16 - CPUdeepsparse: CV Classification, ResNet-50 ImageNet - Synchronous Single-Streamclickhouse: 100M Rows Web Analytics Dataset, Third Runopenvino: Vehicle Detection FP16-INT8 - CPUtensorflow: CPU - 32 - GoogLeNetminibude: OpenMP - BM1minibude: OpenMP - BM1cpuminer-opt: Ringcoincpuminer-opt: Blake-2 Sminibude: OpenMP - BM2minibude: OpenMP - BM2tensorflow: CPU - 16 - ResNet-50onednn: Convolution Batch Shapes Auto - u8s8f32 - CPUdeepsparse: NLP Document Classification, oBERT base uncased on IMDB - Asynchronous Multi-Streamsrsran: 4G PHY_DL_Test 100 PRB MIMO 64-QAMaom-av1: Speed 6 Two-Pass - Bosphorus 4Ksrsran: 4G PHY_DL_Test 100 PRB MIMO 64-QAMgraphics-magick: Sharpenopenfoam: drivaerFastback, Small Mesh Size - Execution Timencnn: CPU - efficientnet-b0ospray-studio: 1 - 1080p - 32 - Path Tracersrsran: 4G PHY_DL_Test 100 PRB SISO 256-QAMopenvino: Age Gender Recognition Retail 0013 FP16 - CPUavifenc: 2mnn: mobilenetV3ncnn: CPU - googlenetsvt-av1: Preset 4 - Bosphorus 4Kopenradioss: Bumper Beamxmrig: Monero - 1Mopenvino: Person Detection FP16 - CPUbrl-cad: VGR Performance Metricnumenta-nab: Earthgecko Skylinedeepsparse: NLP Document Classification, oBERT base uncased on IMDB - Asynchronous Multi-Streamonednn: Matrix Multiply Batch Shapes Transformer - u8s8f32 - CPUsvt-av1: Preset 4 - Bosphorus 1080psrsran: 4G PHY_DL_Test 100 PRB MIMO 256-QAMsvt-av1: Preset 8 - Bosphorus 4Kncnn: CPU - regnety_400mstress-ng: Atomiccpuminer-opt: LBC, LBRY Creditssvt-av1: Preset 12 - Bosphorus 4Kopenfoam: drivaerFastback, Medium Mesh Size - Execution Timedeepsparse: NLP Document Classification, oBERT base uncased on IMDB - Synchronous Single-Streamopenvino: Weld Porosity Detection FP16 - CPUwebp: Quality 100, Losslesssrsran: 4G PHY_DL_Test 100 PRB SISO 64-QAMsrsran: 4G PHY_DL_Test 100 PRB SISO 256-QAMdeepsparse: NLP Document Classification, oBERT base uncased on IMDB - Synchronous Single-Streamopenvino: Weld Porosity Detection FP16 - CPUopenfoam: drivaerFastback, Small Mesh Size - Mesh Timewebp: Quality 100openvino: Age Gender Recognition Retail 0013 FP16 - CPUspacy: en_core_web_lgcpuminer-opt: Quad SHA-256, Pyriteonednn: Matrix Multiply Batch Shapes Transformer - f32 - CPUncnn: CPU-v2-v2 - mobilenet-v2openradioss: Rubber O-Ring Seal Installationopenradioss: INIVOL and Fluid Structure Interaction Drop Containerwebp: Quality 100, Highest Compressiony-cruncher: 500Mopenvino: Person Detection FP16 - CPUcpuminer-opt: Triple SHA-256, Onecoinonednn: Recurrent Neural Network Inference - u8s8f32 - CPUstress-ng: CPU Stressnekrs: TurboPipe Periodicopenvino: Person Detection FP32 - CPUnumenta-nab: Windowed Gaussianopenvino: Person Detection FP32 - CPUncnn: CPU - vision_transformeronednn: Convolution Batch Shapes Auto - f32 - CPUopenfoam: drivaerFastback, Medium Mesh Size - Mesh Timecpuminer-opt: Skeincointensorflow: CPU - 64 - GoogLeNetcpuminer-opt: Deepcoinstress-ng: Glibc C String Functionsbuild-python: Released Build, PGO + LTO Optimizedblender: Classroom - CPU-Onlyonednn: IP Shapes 3D - f32 - CPUonednn: Deconvolution Batch shapes_3d - f32 - CPUsrsran: 4G PHY_DL_Test 100 PRB SISO 64-QAMlammps: Rhodopsin Proteinsvt-av1: Preset 8 - Bosphorus 1080pcpuminer-opt: x25xy-cruncher: 1Btensorflow: CPU - 32 - ResNet-50deepsparse: NLP Token Classification, BERT base uncased conll2003 - Synchronous Single-Streamdeepsparse: NLP Token Classification, BERT base uncased conll2003 - Synchronous Single-Streamonednn: Recurrent Neural Network Training - u8s8f32 - CPUcpuminer-opt: scryptxmrig: Wownero - 1Mcpuminer-opt: Magitensorflow: CPU - 64 - AlexNettensorflow: CPU - 64 - ResNet-50deepsparse: NLP Text Classification, DistilBERT mnli - Asynchronous Multi-Streamdeepsparse: NLP Text Classification, DistilBERT mnli - Asynchronous Multi-Streamrocksdb: Rand Readopenvino: Face Detection FP16-INT8 - CPUncnn: CPU - alexnettensorflow: CPU - 16 - AlexNetcompress-7zip: Decompression Ratingcpuminer-opt: Garlicoindeepsparse: CV Detection,YOLOv5s COCO - Asynchronous Multi-Streamonednn: Recurrent Neural Network Inference - f32 - CPUonednn: IP Shapes 3D - u8s8f32 - CPUopenvino: Face Detection FP16-INT8 - CPUblender: BMW27 - CPU-Onlysrsran: 5G PHY_DL_NR Test 52 PRB SISO 64-QAMdeepsparse: CV Classification, ResNet-50 ImageNet - Asynchronous Multi-Streamdeepsparse: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Asynchronous Multi-Streamdeepsparse: CV Detection,YOLOv5s COCO - Synchronous Single-Streamtensorflow: CPU - 256 - ResNet-50stress-ng: Glibc Qsort Data Sortingdeepsparse: CV Detection,YOLOv5s COCO - Synchronous Single-Streamdeepsparse: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Asynchronous Multi-Streamnumenta-nab: Contextual Anomaly Detector OSEdeepsparse: CV Classification, ResNet-50 ImageNet - Asynchronous Multi-Streamlammps: 20k Atomsdeepsparse: CV Detection,YOLOv5s COCO - Asynchronous Multi-Streamospray-studio: 1 - 1080p - 16 - Path Tracerospray-studio: 3 - 1080p - 1 - Path Traceravifenc: 0ospray-studio: 3 - 4K - 32 - Path Tracertensorflow: CPU - 256 - AlexNetopenradioss: Bird Strike on Windshieldwebp: Defaultospray-studio: 2 - 4K - 32 - Path Tracertensorflow: CPU - 256 - GoogLeNetrocksdb: Read Rand Write Randtensorflow: CPU - 32 - AlexNetprimesieve: 1e13onednn: Recurrent Neural Network Training - f32 - CPUonednn: Deconvolution Batch shapes_1d - u8s8f32 - CPUastcenc: Thoroughopenvino: Face Detection FP16 - CPUblender: Pabellon Barcelona - CPU-Onlysrsran: 5G PHY_DL_NR Test 52 PRB SISO 64-QAMonednn: IP Shapes 1D - f32 - CPUospray-studio: 2 - 1080p - 16 - Path Tracerprimesieve: 1e12onednn: IP Shapes 1D - u8s8f32 - CPUospray-studio: 1 - 4K - 1 - Path Tracerstress-ng: Vector Mathopenvino: Weld Porosity Detection FP16-INT8 - CPUospray-studio: 2 - 1080p - 1 - Path Traceropenradioss: Cell Phone Drop Testospray-studio: 1 - 4K - 32 - Path Tracerblender: Barbershop - CPU-Onlyopenvino: Weld Porosity Detection FP16-INT8 - CPUastcenc: Mediumospray-studio: 3 - 4K - 16 - Path Tracerstress-ng: Cryptoopenvino: Face Detection FP16 - CPUastcenc: Exhaustiveastcenc: Faststress-ng: Matrix Mathospray-studio: 3 - 1080p - 16 - Path Tracerblender: Fishy Cat - CPU-Onlyospray-studio: 3 - 4K - 1 - Path Tracerospray-studio: 1 - 1080p - 1 - Path Tracerospray-studio: 2 - 4K - 1 - Path Tracerstress-ng: x86_64 RdRandaircrack-ng: natron: Spaceshipncnn: CPU-v3-v3 - mobilenet-v3webp: Quality 100, Lossless, Highest Compressionncnn: CPU - resnet18ncnn: CPU - vgg16stress-ng: Socket Activitystress-ng: CPU Cachestress-ng: Futexdragonflydb: 50 - 1:1Linux 5.10.130Linux 5.15.83Linux 6.15500706.766490812.351008.6222392194.28358.051543702381.350390.208606774.99241610.684139490.604208.7912.986385037571047699.230.21546542256719.5197636489.151021149.38971725.25989148.9729.495216464918617.3728.20834.16229.14112042554.7069948.05476765.2441.8892687.586256957.457.3048.3498319915238.138.1737.88536561.8647.7024466.6373.909552335212.602.3810158.93100899205.7670.16926.001138.44382.5378913214994.831.53625510.148907.7484.38589314.203.8552.592185.330133373.603913.577191.5600.851455144.006255.54337801623.6050297.24617.13303.4415.1362.99961122.839643.76120.5029.37272.090.533.7269330.5415.803120.79414.5411.37631167.814201.024.19956819.4496.68914.9101063577.024.89212200000022.733124428114.416682310.54032.67817363453.613752.831964.82123.3421.11041.392423.649315969.337.526512146765.3255.66485.364.9116.47132.6485212.428.24121.72530.26621.2112833.09114910321.389534.73837.684.1586910.5210279.811.70117.3199188.282087.0665271131.01.0470.5172.09111.572.475152.416794.53.31167771114.813758.02770.3132387.046126.934.51918.83223731.7096820126.4971598.6991104.1622625.501.27279.8307.09.599625.5338.535119.0015259.86113142188300.9563995.56159.75443.723.0711.3452400.02315913911.81634273.52706497666673.259.0702436.30160.274.29153241.48551135103125.7914497911917.94383.514318.283.101443.30606123.310.65995.493640.0624.44940.23103.99609.61531621.84491.909492.2374.94243.3041.90108.547573.675965094239417.715.46166.55864326572.8186.6567909.6321.2527119.11106.1398.6219.3569144.241013.268943.50194.3675.261655.423355.73436.439010.42792.2142284092178145.012284699278.63256.4314.37239935130.212132608211.25174.7221613.120.5406549.32255.88373.7465.92.296362917214.4430.496613705555351.588.02182696.212342161145.901991.7572.159514658318742.671357.370.9371193.131555915.3634786144.25863317787242252390.5650605.5593.64.950.488.0926.9510160.91116.331498828.70978963.312284154.168257907.06879.6720930090.96335.581794264281.173381.239013626.15285766.994751750.526209.1814.783338247311186278.250.19451527360087.3695732758.891117321.901060251.051068662.9129.530234969993337.9028.34933.91728.66011938374.7083447.66459225.4441.9896807.546166267.407.2548.3398284815998.637.9037.86562301.7797.7124166.6663.972591331209.582.2910555.73043279204.2670.48826.477437.76022.5790453314461.381.5670499.850911.0834.43109814.213.7522.537182.657132172.055213.867991.7540.846543146.950554.43327799723.8949997.56816.85310.0418.0223.06351123.313942.90130.529.29272.800.533.7903210.5415.813122.97814.7111.42531007.384129.344.27089719.4936.74914.8801080586.914.89712263333322.438124556115.156681710.43392.63917610453.307760.837464.28124.3421.09841.433425.263314957.087.440812148665.1435.59485.194.8516.46134.1326215.028.34122.18529.24021.1702812.34115058321.317532.92438.094.2034310.4539282.711.77118.3199186.398436.9965242131.61.0371.0652.07111.462.483151.826829.83.30166852115.529759.35250.3160056.985128.034.81818.67225144.3396663127.5341611.5943104.0054623.361.28282.0307.99.614125.6238.2357819.0215258.56112362184930.9616825.53159.15445.173.0911.3662401.74313917908.18834238.77709236333333.259.0182441.67161.234.31178242.25487134833126.2914500916397.13383.962317.073.085613.29633123.910.63995.043641.6124.56240.41104.03769.61111614.87489.839531.3373.55242.7342.05108.337773.821665233649416.955.48166.90867356594.1886.9402912.0661.2517419.15106.3898.6219.0088143.806513.308943.41194.8875.040155.584955.65936.497310.41491.9860284172176144.709284853279.05256.1914.40240311130.402129359211.47174.6581611.140.5404529.32675.88373.5466.02.293852920614.4290.497248704655415.018.01182696.312341421144.821993.5872.121914657018733.101356.350.9375193.024455890.2334801144.34862817787246252393.8850607.7383.64.950.488.0527.6917786.17128.312364278.751123953.552054658.6414896082.79667.8215989079.77256.612004671671.070310.227375258.06284966.044874680.513181.5413.847361096681180450.090.19152378853632.6787232918.801099078.401046604.151074996.4332.017218454979549.4330.49336.32130.42611349914.9806745.41452235.5281.9288147.205944857.086.9445.9793528515256.136.3736.10543651.8397.3623416.9093.817268322204.432.3610161.32985392198.5172.55826.865637.21152.4971643315660.881.5200409.932934.2654.31138213.833.8312.606180.519129971.885213.901393.7390.831866147.380454.27267980423.3549199.42016.76307.4409.1273.01258523.071843.32020.5129.86267.620.523.7188120.5315.525121.59614.4511.58030632.464181.804.20888019.7776.79815.1221069686.964.96912073333322.789126341116.166783710.38322.64017477459.753763.306463.96124.9721.37641.936419.750311957.417.535912300065.9645.63491.244.8916.27132.5077212.928.33123.19535.56521.4222800.62113755021.552538.79038.014.1809610.4097280.211.65117.1197186.934677.0465894130.31.0471.2012.08311.482.460153.236767.33.28168334115.831764.74250.3139757.024127.234.72318.70225639.3296010126.7631607.4012104.8348620.611.27280.3305.59.539325.7338.3619938.9515144.32112312172370.9634005.57160.27446.663.0811.2942415.31315723913.94334059.43704815000003.239.0732451.10160.394.28618242.92307134320126.4914420916843.52385.5318.713.094333.31244123.310.60895.151638.6424.45540.32103.58239.65321618.86491.859527.7373.45242.3442.06108.744373.545665337175416.165.46166.31866806571.6686.8832909.1471.2487119.17106.4698.3218.6936144.211413.269143.37194.3075.263555.436655.81536.539210.39992.0462284792173145.036284235279.22255.8914.38240430130.472133528211.06174.9771614.070.5414309.31035.89374.1765.92.297082916514.4240.496776704855344.328.02182496.302343711145.181992.2372.097214669218727.611357.100.9368192.991755875.1834779144.29863317797245252372.2950609.2763.64.950.487.8526.5216990.75115.592433807.141130454.03OpenBenchmarking.org

Stress-NG

Test: Context Switching

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.14.06Test: Context SwitchingLinux 5.10.130Linux 5.15.83Linux 6.11.2M2.4M3.6M4.8M6MSE +/- 72191.04, N = 3SE +/- 7040.94, N = 3SE +/- 3492.53, N = 35500706.762284154.162054658.641. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -laio -lapparmor -latomic -lbsd -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lrt -lsctp -lz -pthread

Stress-NG

Test: System V Message Passing

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.14.06Test: System V Message PassingLinux 5.10.130Linux 5.15.83Linux 6.13M6M9M12M15MSE +/- 23387.52, N = 3SE +/- 4399.60, N = 3SE +/- 26770.64, N = 36490812.358257907.0614896082.791. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -laio -lapparmor -latomic -lbsd -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lrt -lsctp -lz -pthread

Stress-NG

Test: MEMFD

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.14.06Test: MEMFDLinux 5.10.130Linux 5.15.83Linux 6.12004006008001000SE +/- 0.88, N = 3SE +/- 0.39, N = 3SE +/- 0.28, N = 31008.62879.67667.821. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -laio -lapparmor -latomic -lbsd -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lrt -lsctp -lz -pthread

Stress-NG

Test: Malloc

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.14.06Test: MallocLinux 5.10.130Linux 5.15.83Linux 6.15M10M15M20M25MSE +/- 90978.10, N = 3SE +/- 130302.14, N = 3SE +/- 91731.80, N = 322392194.2820930090.9615989079.771. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -laio -lapparmor -latomic -lbsd -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lrt -lsctp -lz -pthread

Stress-NG

Test: NUMA

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.14.06Test: NUMALinux 5.10.130Linux 5.15.83Linux 6.180160240320400SE +/- 2.82, N = 3SE +/- 0.90, N = 3SE +/- 1.78, N = 3358.05335.58256.611. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -laio -lapparmor -latomic -lbsd -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lrt -lsctp -lz -pthread

ctx_clock

Context Switch Time

OpenBenchmarking.orgClocks, Fewer Is Betterctx_clockContext Switch TimeLinux 5.10.130Linux 5.15.83Linux 6.14080120160200SE +/- 0.67, N = 3154179200

PostgreSQL

Scaling Factor: 100 - Clients: 500 - Mode: Read Only

OpenBenchmarking.orgTPS, More Is BetterPostgreSQL 15Scaling Factor: 100 - Clients: 500 - Mode: Read OnlyLinux 5.10.130Linux 5.15.83Linux 6.1100K200K300K400K500KSE +/- 956.06, N = 3SE +/- 666.01, N = 3SE +/- 757.53, N = 33702384264284671671. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lpthread -lrt -ldl -lm

PostgreSQL

Scaling Factor: 100 - Clients: 500 - Mode: Read Only - Average Latency

OpenBenchmarking.orgms, Fewer Is BetterPostgreSQL 15Scaling Factor: 100 - Clients: 500 - Mode: Read Only - Average LatencyLinux 5.10.130Linux 5.15.83Linux 6.10.30380.60760.91141.21521.519SE +/- 0.003, N = 3SE +/- 0.002, N = 3SE +/- 0.002, N = 31.3501.1731.0701. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lpthread -lrt -ldl -lm

Stress-NG

Test: MMAP

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.14.06Test: MMAPLinux 5.10.130Linux 5.15.83Linux 6.180160240320400SE +/- 0.74, N = 3SE +/- 0.56, N = 3SE +/- 2.76, N = 3390.20381.23310.221. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -laio -lapparmor -latomic -lbsd -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lrt -lsctp -lz -pthread

Stress-NG

Test: Mutex

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.14.06Test: MutexLinux 5.10.130Linux 5.15.83Linux 6.12M4M6M8M10MSE +/- 10182.54, N = 3SE +/- 112044.15, N = 15SE +/- 24065.62, N = 38606774.999013626.157375258.061. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -laio -lapparmor -latomic -lbsd -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lrt -lsctp -lz -pthread

Stress-NG

Test: SENDFILE

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.14.06Test: SENDFILELinux 5.10.130Linux 5.15.83Linux 6.160K120K180K240K300KSE +/- 2449.06, N = 3SE +/- 2143.98, N = 3SE +/- 1947.11, N = 3241610.68285766.99284966.041. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -laio -lapparmor -latomic -lbsd -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lrt -lsctp -lz -pthread

PostgreSQL

Scaling Factor: 100 - Clients: 250 - Mode: Read Only

OpenBenchmarking.orgTPS, More Is BetterPostgreSQL 15Scaling Factor: 100 - Clients: 250 - Mode: Read OnlyLinux 5.10.130Linux 5.15.83Linux 6.1100K200K300K400K500KSE +/- 2810.03, N = 3SE +/- 286.86, N = 3SE +/- 5532.44, N = 34139494751754874681. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lpthread -lrt -ldl -lm

PostgreSQL

Scaling Factor: 100 - Clients: 250 - Mode: Read Only - Average Latency

OpenBenchmarking.orgms, Fewer Is BetterPostgreSQL 15Scaling Factor: 100 - Clients: 250 - Mode: Read Only - Average LatencyLinux 5.10.130Linux 5.15.83Linux 6.10.13590.27180.40770.54360.6795SE +/- 0.004, N = 3SE +/- 0.000, N = 3SE +/- 0.006, N = 30.6040.5260.5131. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lpthread -lrt -ldl -lm

JPEG XL Decoding libjxl

CPU Threads: All

OpenBenchmarking.orgMP/s, More Is BetterJPEG XL Decoding libjxl 0.7CPU Threads: AllLinux 5.10.130Linux 5.15.83Linux 6.150100150200250SE +/- 1.38, N = 3SE +/- 0.37, N = 3SE +/- 2.09, N = 3208.79209.18181.54

PostgreSQL

Scaling Factor: 100 - Clients: 500 - Mode: Read Write - Average Latency

OpenBenchmarking.orgms, Fewer Is BetterPostgreSQL 15Scaling Factor: 100 - Clients: 500 - Mode: Read Write - Average LatencyLinux 5.10.130Linux 5.15.83Linux 6.148121620SE +/- 0.02, N = 3SE +/- 0.04, N = 3SE +/- 0.03, N = 312.9914.7813.851. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lpthread -lrt -ldl -lm

PostgreSQL

Scaling Factor: 100 - Clients: 500 - Mode: Read Write

OpenBenchmarking.orgTPS, More Is BetterPostgreSQL 15Scaling Factor: 100 - Clients: 500 - Mode: Read WriteLinux 5.10.130Linux 5.15.83Linux 6.18K16K24K32K40KSE +/- 59.40, N = 3SE +/- 99.01, N = 3SE +/- 91.02, N = 33850333824361091. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lpthread -lrt -ldl -lm

GraphicsMagick

Operation: Rotate

OpenBenchmarking.orgIterations Per Minute, More Is BetterGraphicsMagick 1.3.38Operation: RotateLinux 5.10.130Linux 5.15.83Linux 6.1160320480640800SE +/- 9.97, N = 5SE +/- 1.76, N = 3SE +/- 5.43, N = 157577316681. (CC) gcc options: -fopenmp -O2 -pthread -ljbig -lwebp -lwebpmux -ltiff -lfreetype -ljpeg -lXext -lSM -lICE -lX11 -llzma -lbz2 -lxml2 -lz -lm -lpthread

Dragonflydb

Clients: 50 - Set To Get Ratio: 1:5

OpenBenchmarking.orgOps/sec, More Is BetterDragonflydb 0.6Clients: 50 - Set To Get Ratio: 1:5Linux 5.10.130Linux 5.15.83Linux 6.1300K600K900K1200K1500KSE +/- 872.80, N = 3SE +/- 1515.54, N = 3SE +/- 1580.99, N = 31047699.231186278.251180450.091. (CXX) g++ options: -O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre

PostgreSQL

Scaling Factor: 100 - Clients: 100 - Mode: Read Only - Average Latency

OpenBenchmarking.orgms, Fewer Is BetterPostgreSQL 15Scaling Factor: 100 - Clients: 100 - Mode: Read Only - Average LatencyLinux 5.10.130Linux 5.15.83Linux 6.10.04840.09680.14520.19360.242SE +/- 0.001, N = 3SE +/- 0.000, N = 3SE +/- 0.001, N = 30.2150.1940.1911. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lpthread -lrt -ldl -lm

PostgreSQL

Scaling Factor: 100 - Clients: 100 - Mode: Read Only

OpenBenchmarking.orgTPS, More Is BetterPostgreSQL 15Scaling Factor: 100 - Clients: 100 - Mode: Read OnlyLinux 5.10.130Linux 5.15.83Linux 6.1110K220K330K440K550KSE +/- 1779.96, N = 3SE +/- 92.73, N = 3SE +/- 1990.45, N = 34654225152735237881. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lpthread -lrt -ldl -lm

Stress-NG

Test: Forking

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.14.06Test: ForkingLinux 5.10.130Linux 5.15.83Linux 6.113K26K39K52K65KSE +/- 175.99, N = 3SE +/- 184.20, N = 3SE +/- 386.64, N = 356719.5160087.3653632.671. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -laio -lapparmor -latomic -lbsd -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lrt -lsctp -lz -pthread

GraphicsMagick

Operation: HWB Color Space

OpenBenchmarking.orgIterations Per Minute, More Is BetterGraphicsMagick 1.3.38Operation: HWB Color SpaceLinux 5.10.130Linux 5.15.83Linux 6.12004006008001000SE +/- 1.53, N = 3SE +/- 1.67, N = 39769578721. (CC) gcc options: -fopenmp -O2 -pthread -ljbig -lwebp -lwebpmux -ltiff -lfreetype -ljpeg -lXext -lSM -lICE -lX11 -llzma -lbz2 -lxml2 -lz -lm -lpthread

Stress-NG

Test: IO_uring

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.14.06Test: IO_uringLinux 5.10.130Linux 5.15.83Linux 6.18K16K24K32K40KSE +/- 401.23, N = 3SE +/- 501.84, N = 3SE +/- 240.39, N = 336489.1532758.8932918.801. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -laio -lapparmor -latomic -lbsd -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lrt -lsctp -lz -pthread

Dragonflydb

Clients: 200 - Set To Get Ratio: 1:5

OpenBenchmarking.orgOps/sec, More Is BetterDragonflydb 0.6Clients: 200 - Set To Get Ratio: 1:5Linux 5.10.130Linux 5.15.83Linux 6.1200K400K600K800K1000KSE +/- 515.57, N = 3SE +/- 3993.93, N = 3SE +/- 797.47, N = 31021149.381117321.901099078.401. (CXX) g++ options: -O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre

Dragonflydb

Clients: 200 - Set To Get Ratio: 1:1

OpenBenchmarking.orgOps/sec, More Is BetterDragonflydb 0.6Clients: 200 - Set To Get Ratio: 1:1Linux 5.10.130Linux 5.15.83Linux 6.1200K400K600K800K1000KSE +/- 1890.11, N = 3SE +/- 1111.75, N = 3SE +/- 6338.63, N = 3971725.251060251.051046604.151. (CXX) g++ options: -O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre

Dragonflydb

Clients: 50 - Set To Get Ratio: 5:1

OpenBenchmarking.orgOps/sec, More Is BetterDragonflydb 0.6Clients: 50 - Set To Get Ratio: 5:1Linux 5.10.130Linux 5.15.83Linux 6.1200K400K600K800K1000KSE +/- 8046.26, N = 3SE +/- 3987.52, N = 3SE +/- 741.75, N = 3989148.971068662.911074996.431. (CXX) g++ options: -O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre

EnCodec

Target Bandwidth: 6 kbps

OpenBenchmarking.orgSeconds, Fewer Is BetterEnCodec 0.1.1Target Bandwidth: 6 kbpsLinux 5.10.130Linux 5.15.83Linux 6.1714212835SE +/- 0.11, N = 3SE +/- 0.11, N = 3SE +/- 0.09, N = 329.5029.5332.02

Facebook RocksDB

Test: Random Fill Sync

OpenBenchmarking.orgOp/s, More Is BetterFacebook RocksDB 7.5.3Test: Random Fill SyncLinux 5.10.130Linux 5.15.83Linux 6.150K100K150K200K250KSE +/- 254.19, N = 3SE +/- 684.45, N = 3SE +/- 160.74, N = 32164642349692184541. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti -lpthread

Dragonflydb

Clients: 200 - Set To Get Ratio: 5:1

OpenBenchmarking.orgOps/sec, More Is BetterDragonflydb 0.6Clients: 200 - Set To Get Ratio: 5:1Linux 5.10.130Linux 5.15.83Linux 6.1200K400K600K800K1000KSE +/- 4444.49, N = 3SE +/- 845.72, N = 3SE +/- 1905.52, N = 3918617.37993337.90979549.431. (CXX) g++ options: -O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre

EnCodec

Target Bandwidth: 1.5 kbps

OpenBenchmarking.orgSeconds, Fewer Is BetterEnCodec 0.1.1Target Bandwidth: 1.5 kbpsLinux 5.10.130Linux 5.15.83Linux 6.1714212835SE +/- 0.29, N = 8SE +/- 0.33, N = 3SE +/- 0.30, N = 928.2128.3530.49

EnCodec

Target Bandwidth: 24 kbps

OpenBenchmarking.orgSeconds, Fewer Is BetterEnCodec 0.1.1Target Bandwidth: 24 kbpsLinux 5.10.130Linux 5.15.83Linux 6.1816243240SE +/- 0.02, N = 3SE +/- 0.20, N = 3SE +/- 0.13, N = 334.1633.9236.32

EnCodec

Target Bandwidth: 3 kbps

OpenBenchmarking.orgSeconds, Fewer Is BetterEnCodec 0.1.1Target Bandwidth: 3 kbpsLinux 5.10.130Linux 5.15.83Linux 6.1714212835SE +/- 0.21, N = 3SE +/- 0.34, N = 6SE +/- 0.30, N = 829.1428.6630.43

Facebook RocksDB

Test: Sequential Fill

OpenBenchmarking.orgOp/s, More Is BetterFacebook RocksDB 7.5.3Test: Sequential FillLinux 5.10.130Linux 5.15.83Linux 6.1300K600K900K1200K1500KSE +/- 10501.31, N = 3SE +/- 3547.16, N = 3SE +/- 11595.14, N = 31204255119383711349911. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti -lpthread

oneDNN

Harness: Deconvolution Batch shapes_1d - Data Type: f32 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.7Harness: Deconvolution Batch shapes_1d - Data Type: f32 - Engine: CPULinux 5.10.130Linux 5.15.83Linux 6.11.12072.24143.36214.48285.6035SE +/- 0.01724, N = 3SE +/- 0.01367, N = 3SE +/- 0.02580, N = 34.706994.708344.98067MIN: 4.43MIN: 4.4MIN: 4.621. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -lpthread -ldl

AOM AV1

Encoder Mode: Speed 9 Realtime - Input: Bosphorus 4K

OpenBenchmarking.orgFrames Per Second, More Is BetterAOM AV1 3.5Encoder Mode: Speed 9 Realtime - Input: Bosphorus 4KLinux 5.10.130Linux 5.15.83Linux 6.11122334455SE +/- 0.06, N = 3SE +/- 0.14, N = 3SE +/- 0.11, N = 348.0547.6645.411. (CXX) g++ options: -O3 -std=c++11 -U_FORTIFY_SOURCE -lm -lpthread

PostgreSQL

Scaling Factor: 100 - Clients: 250 - Mode: Read Write

OpenBenchmarking.orgTPS, More Is BetterPostgreSQL 15Scaling Factor: 100 - Clients: 250 - Mode: Read WriteLinux 5.10.130Linux 5.15.83Linux 6.110K20K30K40K50KSE +/- 132.15, N = 3SE +/- 31.67, N = 3SE +/- 71.67, N = 34767645922452231. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lpthread -lrt -ldl -lm

PostgreSQL

Scaling Factor: 100 - Clients: 250 - Mode: Read Write - Average Latency

OpenBenchmarking.orgms, Fewer Is BetterPostgreSQL 15Scaling Factor: 100 - Clients: 250 - Mode: Read Write - Average LatencyLinux 5.10.130Linux 5.15.83Linux 6.11.24382.48763.73144.97526.219SE +/- 0.015, N = 3SE +/- 0.004, N = 3SE +/- 0.009, N = 35.2445.4445.5281. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lpthread -lrt -ldl -lm

Stargate Digital Audio Workstation

Sample Rate: 192000 - Buffer Size: 1024

OpenBenchmarking.orgRender Ratio, More Is BetterStargate Digital Audio Workstation 22.11.5Sample Rate: 192000 - Buffer Size: 1024Linux 5.10.130Linux 5.15.83Linux 6.10.44770.89541.34311.79082.2385SE +/- 0.016352, N = 3SE +/- 0.011134, N = 3SE +/- 0.012895, N = 31.8892681.9896801.9288141. (CXX) g++ options: -lpthread -lsndfile -lm -O3 -march=native -ffast-math -funroll-loops -fstrength-reduce -fstrict-aliasing -finline-functions

JPEG XL libjxl

Input: PNG - Quality: 90

OpenBenchmarking.orgMP/s, More Is BetterJPEG XL libjxl 0.7Input: PNG - Quality: 90Linux 5.10.130Linux 5.15.83Linux 6.1246810SE +/- 0.01, N = 3SE +/- 0.02, N = 3SE +/- 0.02, N = 37.587.547.201. (CXX) g++ options: -fno-rtti -funwind-tables -O3 -O2 -fPIE -pie -lm -pthread -latomic

Facebook RocksDB

Test: Update Random

OpenBenchmarking.orgOp/s, More Is BetterFacebook RocksDB 7.5.3Test: Update RandomLinux 5.10.130Linux 5.15.83Linux 6.1130K260K390K520K650KSE +/- 3662.51, N = 3SE +/- 1069.98, N = 3SE +/- 2022.46, N = 36256956166265944851. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti -lpthread

JPEG XL libjxl

Input: JPEG - Quality: 80

OpenBenchmarking.orgMP/s, More Is BetterJPEG XL libjxl 0.7Input: JPEG - Quality: 80Linux 5.10.130Linux 5.15.83Linux 6.1246810SE +/- 0.01, N = 3SE +/- 0.00, N = 3SE +/- 0.01, N = 37.457.407.081. (CXX) g++ options: -fno-rtti -funwind-tables -O3 -O2 -fPIE -pie -lm -pthread -latomic

JPEG XL libjxl

Input: JPEG - Quality: 90

OpenBenchmarking.orgMP/s, More Is BetterJPEG XL libjxl 0.7Input: JPEG - Quality: 90Linux 5.10.130Linux 5.15.83Linux 6.1246810SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 37.307.256.941. (CXX) g++ options: -fno-rtti -funwind-tables -O3 -O2 -fPIE -pie -lm -pthread -latomic

AOM AV1

Encoder Mode: Speed 10 Realtime - Input: Bosphorus 4K

OpenBenchmarking.orgFrames Per Second, More Is BetterAOM AV1 3.5Encoder Mode: Speed 10 Realtime - Input: Bosphorus 4KLinux 5.10.130Linux 5.15.83Linux 6.11122334455SE +/- 0.10, N = 3SE +/- 0.20, N = 3SE +/- 0.14, N = 348.3448.3345.971. (CXX) g++ options: -O3 -std=c++11 -U_FORTIFY_SOURCE -lm -lpthread

Facebook RocksDB

Test: Random Fill

OpenBenchmarking.orgOp/s, More Is BetterFacebook RocksDB 7.5.3Test: Random FillLinux 5.10.130Linux 5.15.83Linux 6.1200K400K600K800K1000KSE +/- 10947.16, N = 3SE +/- 11892.65, N = 3SE +/- 2558.50, N = 39831999828489352851. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti -lpthread

C-Blosc

Test: blosclz shuffle

OpenBenchmarking.orgMB/s, More Is BetterC-Blosc 2.3Test: blosclz shuffleLinux 5.10.130Linux 5.15.83Linux 6.13K6K9K12K15KSE +/- 62.87, N = 3SE +/- 51.78, N = 3SE +/- 27.75, N = 315238.115998.615256.11. (CC) gcc options: -std=gnu99 -O3 -lrt -pthread -lm

JPEG XL Decoding libjxl

CPU Threads: 1

OpenBenchmarking.orgMP/s, More Is BetterJPEG XL Decoding libjxl 0.7CPU Threads: 1Linux 5.10.130Linux 5.15.83Linux 6.1918273645SE +/- 0.06, N = 3SE +/- 0.04, N = 3SE +/- 0.02, N = 338.1737.9036.37

AOM AV1

Encoder Mode: Speed 8 Realtime - Input: Bosphorus 4K

OpenBenchmarking.orgFrames Per Second, More Is BetterAOM AV1 3.5Encoder Mode: Speed 8 Realtime - Input: Bosphorus 4KLinux 5.10.130Linux 5.15.83Linux 6.1918273645SE +/- 0.08, N = 3SE +/- 0.19, N = 3SE +/- 0.08, N = 337.8837.8636.101. (CXX) g++ options: -O3 -std=c++11 -U_FORTIFY_SOURCE -lm -lpthread

PostgreSQL

Scaling Factor: 100 - Clients: 100 - Mode: Read Write

OpenBenchmarking.orgTPS, More Is BetterPostgreSQL 15Scaling Factor: 100 - Clients: 100 - Mode: Read WriteLinux 5.10.130Linux 5.15.83Linux 6.112K24K36K48K60KSE +/- 146.53, N = 3SE +/- 125.21, N = 3SE +/- 90.59, N = 35365656230543651. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lpthread -lrt -ldl -lm

PostgreSQL

Scaling Factor: 100 - Clients: 100 - Mode: Read Write - Average Latency

OpenBenchmarking.orgms, Fewer Is BetterPostgreSQL 15Scaling Factor: 100 - Clients: 100 - Mode: Read Write - Average LatencyLinux 5.10.130Linux 5.15.83Linux 6.10.41940.83881.25821.67762.097SE +/- 0.005, N = 3SE +/- 0.004, N = 3SE +/- 0.003, N = 31.8641.7791.8391. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lpthread -lrt -ldl -lm

JPEG XL libjxl

Input: PNG - Quality: 80

OpenBenchmarking.orgMP/s, More Is BetterJPEG XL libjxl 0.7Input: PNG - Quality: 80Linux 5.10.130Linux 5.15.83Linux 6.1246810SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 37.707.717.361. (CXX) g++ options: -fno-rtti -funwind-tables -O3 -O2 -fPIE -pie -lm -pthread -latomic

spaCy

Model: en_core_web_trf

OpenBenchmarking.orgtokens/sec, More Is BetterspaCy 3.4.1Model: en_core_web_trfLinux 5.10.130Linux 5.15.83Linux 6.15001000150020002500SE +/- 9.87, N = 3SE +/- 6.33, N = 3SE +/- 7.51, N = 3244624162341

libavif avifenc

Encoder Speed: 10, Lossless

OpenBenchmarking.orgSeconds, Fewer Is Betterlibavif avifenc 0.11Encoder Speed: 10, LosslessLinux 5.10.130Linux 5.15.83Linux 6.1246810SE +/- 0.021, N = 3SE +/- 0.017, N = 3SE +/- 0.029, N = 36.6376.6666.9091. (CXX) g++ options: -O3 -fPIC -lm

Stargate Digital Audio Workstation

Sample Rate: 44100 - Buffer Size: 512

OpenBenchmarking.orgRender Ratio, More Is BetterStargate Digital Audio Workstation 22.11.5Sample Rate: 44100 - Buffer Size: 512Linux 5.10.130Linux 5.15.83Linux 6.10.89381.78762.68143.57524.469SE +/- 0.028488, N = 3SE +/- 0.017996, N = 3SE +/- 0.063340, N = 33.9095523.9725913.8172681. (CXX) g++ options: -lpthread -lsndfile -lm -O3 -march=native -ffast-math -funroll-loops -fstrength-reduce -fstrict-aliasing -finline-functions

GraphicsMagick

Operation: Noise-Gaussian

OpenBenchmarking.orgIterations Per Minute, More Is BetterGraphicsMagick 1.3.38Operation: Noise-GaussianLinux 5.10.130Linux 5.15.83Linux 6.170140210280350SE +/- 1.76, N = 33353313221. (CC) gcc options: -fopenmp -O2 -pthread -ljbig -lwebp -lwebpmux -ltiff -lfreetype -ljpeg -lXext -lSM -lICE -lX11 -llzma -lbz2 -lxml2 -lz -lm -lpthread

ClickHouse

100M Rows Web Analytics Dataset, Second Run

OpenBenchmarking.orgQueries Per Minute, Geo Mean, More Is BetterClickHouse 22.5.4.19100M Rows Web Analytics Dataset, Second RunLinux 5.10.130Linux 5.15.83Linux 6.150100150200250SE +/- 0.88, N = 15SE +/- 1.25, N = 14SE +/- 4.28, N = 3212.60209.58204.43MIN: 22.96 / MAX: 20000MIN: 22.65 / MAX: 20000MIN: 22.33 / MAX: 200001. ClickHouse server version 22.5.4.19 (official build).

NCNN

Target: CPU - Model: blazeface

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20220729Target: CPU - Model: blazefaceLinux 5.10.130Linux 5.15.83Linux 6.10.53551.0711.60652.1422.6775SE +/- 0.01, N = 3SE +/- 0.00, N = 6SE +/- 0.01, N = 32.382.292.36MIN: 2.2 / MAX: 2.75MIN: 2.23 / MAX: 3.1MIN: 2.3 / MAX: 2.621. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

C-Blosc

Test: blosclz bitshuffle

OpenBenchmarking.orgMB/s, More Is BetterC-Blosc 2.3Test: blosclz bitshuffleLinux 5.10.130Linux 5.15.83Linux 6.12K4K6K8K10KSE +/- 20.30, N = 3SE +/- 12.20, N = 3SE +/- 25.18, N = 310158.910555.710161.31. (CC) gcc options: -std=gnu99 -O3 -lrt -pthread -lm

Facebook RocksDB

Test: Read While Writing

OpenBenchmarking.orgOp/s, More Is BetterFacebook RocksDB 7.5.3Test: Read While WritingLinux 5.10.130Linux 5.15.83Linux 6.1700K1400K2100K2800K3500KSE +/- 49813.03, N = 3SE +/- 29968.88, N = 3SE +/- 14227.22, N = 33100899304327929853921. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti -lpthread

ClickHouse

100M Rows Web Analytics Dataset, First Run / Cold Cache

OpenBenchmarking.orgQueries Per Minute, Geo Mean, More Is BetterClickHouse 22.5.4.19100M Rows Web Analytics Dataset, First Run / Cold CacheLinux 5.10.130Linux 5.15.83Linux 6.150100150200250SE +/- 1.55, N = 15SE +/- 1.58, N = 14SE +/- 0.88, N = 3205.76204.26198.51MIN: 22.01 / MAX: 20000MIN: 22.52 / MAX: 20000MIN: 22.14 / MAX: 200001. ClickHouse server version 22.5.4.19 (official build).

Timed Linux Kernel Compilation

Build: defconfig

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed Linux Kernel Compilation 6.1Build: defconfigLinux 5.10.130Linux 5.15.83Linux 6.11632486480SE +/- 0.25, N = 3SE +/- 0.24, N = 3SE +/- 0.28, N = 370.1770.4972.56

Neural Magic DeepSparse

Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Synchronous Single-StreamLinux 5.10.130Linux 5.15.83Linux 6.1612182430SE +/- 0.10, N = 3SE +/- 0.29, N = 3SE +/- 0.23, N = 326.0026.4826.87

Neural Magic DeepSparse

Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Synchronous Single-StreamLinux 5.10.130Linux 5.15.83Linux 6.1918273645SE +/- 0.15, N = 3SE +/- 0.41, N = 3SE +/- 0.31, N = 338.4437.7637.21

Stargate Digital Audio Workstation

Sample Rate: 96000 - Buffer Size: 512

OpenBenchmarking.orgRender Ratio, More Is BetterStargate Digital Audio Workstation 22.11.5Sample Rate: 96000 - Buffer Size: 512Linux 5.10.130Linux 5.15.83Linux 6.10.58031.16061.74092.32122.9015SE +/- 0.035214, N = 3SE +/- 0.013088, N = 3SE +/- 0.031971, N = 32.5378912.5790452.4971641. (CXX) g++ options: -lpthread -lsndfile -lm -O3 -march=native -ffast-math -funroll-loops -fstrength-reduce -fstrict-aliasing -finline-functions

Stress-NG

Test: Semaphores

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.14.06Test: SemaphoresLinux 5.10.130Linux 5.15.83Linux 6.1700K1400K2100K2800K3500KSE +/- 159.78, N = 3SE +/- 1860.75, N = 3SE +/- 1806.60, N = 33214994.833314461.383315660.881. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -laio -lapparmor -latomic -lbsd -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lrt -lsctp -lz -pthread

Stargate Digital Audio Workstation

Sample Rate: 192000 - Buffer Size: 512

OpenBenchmarking.orgRender Ratio, More Is BetterStargate Digital Audio Workstation 22.11.5Sample Rate: 192000 - Buffer Size: 512Linux 5.10.130Linux 5.15.83Linux 6.10.35260.70521.05781.41041.763SE +/- 0.008212, N = 3SE +/- 0.017482, N = 3SE +/- 0.006196, N = 31.5362551.5670491.5200401. (CXX) g++ options: -lpthread -lsndfile -lm -O3 -march=native -ffast-math -funroll-loops -fstrength-reduce -fstrict-aliasing -finline-functions

Mobile Neural Network

Model: resnet-v2-50

OpenBenchmarking.orgms, Fewer Is BetterMobile Neural Network 2.1Model: resnet-v2-50Linux 5.10.130Linux 5.15.83Linux 6.13691215SE +/- 0.099, N = 3SE +/- 0.025, N = 3SE +/- 0.037, N = 910.1489.8509.932MIN: 9.88 / MAX: 23.7MIN: 9.74 / MAX: 31.53MIN: 9.74 / MAX: 23.921. (CXX) g++ options: -std=c++11 -O3 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl

Timed Linux Kernel Compilation

Build: allmodconfig

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed Linux Kernel Compilation 6.1Build: allmodconfigLinux 5.10.130Linux 5.15.83Linux 6.12004006008001000SE +/- 0.08, N = 3SE +/- 1.08, N = 3SE +/- 0.78, N = 3907.75911.08934.27

Stargate Digital Audio Workstation

Sample Rate: 44100 - Buffer Size: 1024

OpenBenchmarking.orgRender Ratio, More Is BetterStargate Digital Audio Workstation 22.11.5Sample Rate: 44100 - Buffer Size: 1024Linux 5.10.130Linux 5.15.83Linux 6.10.9971.9942.9913.9884.985SE +/- 0.002245, N = 3SE +/- 0.011431, N = 3SE +/- 0.047576, N = 34.3858934.4310984.3113821. (CXX) g++ options: -lpthread -lsndfile -lm -O3 -march=native -ffast-math -funroll-loops -fstrength-reduce -fstrict-aliasing -finline-functions

NCNN

Target: CPU - Model: resnet50

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20220729Target: CPU - Model: resnet50Linux 5.10.130Linux 5.15.83Linux 6.148121620SE +/- 0.05, N = 3SE +/- 0.34, N = 6SE +/- 0.13, N = 314.2014.2113.83MIN: 13.99 / MAX: 15.03MIN: 13.45 / MAX: 157.72MIN: 13.51 / MAX: 26.191. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

Mobile Neural Network

Model: MobileNetV2_224

OpenBenchmarking.orgms, Fewer Is BetterMobile Neural Network 2.1Model: MobileNetV2_224Linux 5.10.130Linux 5.15.83Linux 6.10.86741.73482.60223.46964.337SE +/- 0.007, N = 3SE +/- 0.020, N = 3SE +/- 0.020, N = 93.8553.7523.831MIN: 3.65 / MAX: 16.53MIN: 3.56 / MAX: 17.6MIN: 3.59 / MAX: 5.871. (CXX) g++ options: -std=c++11 -O3 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl

Mobile Neural Network

Model: squeezenetv1.1

OpenBenchmarking.orgms, Fewer Is BetterMobile Neural Network 2.1Model: squeezenetv1.1Linux 5.10.130Linux 5.15.83Linux 6.10.58641.17281.75922.34562.932SE +/- 0.020, N = 3SE +/- 0.015, N = 3SE +/- 0.012, N = 92.5922.5372.606MIN: 2.48 / MAX: 5.22MIN: 2.47 / MAX: 4.14MIN: 2.49 / MAX: 16.461. (CXX) g++ options: -std=c++11 -O3 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl

Numenta Anomaly Benchmark

Detector: KNN CAD

OpenBenchmarking.orgSeconds, Fewer Is BetterNumenta Anomaly Benchmark 1.1Detector: KNN CADLinux 5.10.130Linux 5.15.83Linux 6.14080120160200SE +/- 0.84, N = 3SE +/- 0.59, N = 3SE +/- 0.44, N = 3185.33182.66180.52

GraphicsMagick

Operation: Resizing

OpenBenchmarking.orgIterations Per Minute, More Is BetterGraphicsMagick 1.3.38Operation: ResizingLinux 5.10.130Linux 5.15.83Linux 6.130060090012001500SE +/- 7.42, N = 3SE +/- 2.73, N = 3SE +/- 2.91, N = 31333132112991. (CC) gcc options: -fopenmp -O2 -pthread -ljbig -lwebp -lwebpmux -ltiff -lfreetype -ljpeg -lXext -lSM -lICE -lX11 -llzma -lbz2 -lxml2 -lz -lm -lpthread

Neural Magic DeepSparse

Model: NLP Text Classification, DistilBERT mnli - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: NLP Text Classification, DistilBERT mnli - Scenario: Synchronous Single-StreamLinux 5.10.130Linux 5.15.83Linux 6.11632486480SE +/- 0.65, N = 3SE +/- 0.33, N = 3SE +/- 0.51, N = 373.6072.0671.89

Neural Magic DeepSparse

Model: NLP Text Classification, DistilBERT mnli - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: NLP Text Classification, DistilBERT mnli - Scenario: Synchronous Single-StreamLinux 5.10.130Linux 5.15.83Linux 6.148121620SE +/- 0.12, N = 3SE +/- 0.06, N = 3SE +/- 0.10, N = 313.5813.8713.90

Timed Erlang/OTP Compilation

Time To Compile

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed Erlang/OTP Compilation 25.0Time To CompileLinux 5.10.130Linux 5.15.83Linux 6.120406080100SE +/- 0.08, N = 3SE +/- 0.17, N = 3SE +/- 0.08, N = 391.5691.7593.74

oneDNN

Harness: Deconvolution Batch shapes_3d - Data Type: u8s8f32 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.7Harness: Deconvolution Batch shapes_3d - Data Type: u8s8f32 - Engine: CPULinux 5.10.130Linux 5.15.83Linux 6.10.19160.38320.57480.76640.958SE +/- 0.006451, N = 3SE +/- 0.010105, N = 3SE +/- 0.003867, N = 30.8514550.8465430.831866MIN: 0.83MIN: 0.82MIN: 0.811. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -lpthread -ldl

Neural Magic DeepSparse

Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-StreamLinux 5.10.130Linux 5.15.83Linux 6.1306090120150SE +/- 0.30, N = 3SE +/- 0.74, N = 3SE +/- 0.43, N = 3144.01146.95147.38

Neural Magic DeepSparse

Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-StreamLinux 5.10.130Linux 5.15.83Linux 6.11224364860SE +/- 0.12, N = 3SE +/- 0.27, N = 3SE +/- 0.16, N = 355.5454.4354.27

OSPRay Studio

Camera: 3 - Resolution: 1080p - Samples Per Pixel: 32 - Renderer: Path Tracer

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.11Camera: 3 - Resolution: 1080p - Samples Per Pixel: 32 - Renderer: Path TracerLinux 5.10.130Linux 5.15.83Linux 6.120K40K60K80K100KSE +/- 96.91, N = 3SE +/- 75.54, N = 3SE +/- 964.72, N = 67801677997798041. (CXX) g++ options: -O3 -lm -ldl -lpthread -pthread

NCNN

Target: CPU - Model: yolov4-tiny

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20220729Target: CPU - Model: yolov4-tinyLinux 5.10.130Linux 5.15.83Linux 6.1612182430SE +/- 0.07, N = 3SE +/- 0.39, N = 6SE +/- 0.09, N = 323.6023.8923.35MIN: 23.16 / MAX: 27.3MIN: 22.91 / MAX: 31.78MIN: 23.01 / MAX: 26.251. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

GraphicsMagick

Operation: Swirl

OpenBenchmarking.orgIterations Per Minute, More Is BetterGraphicsMagick 1.3.38Operation: SwirlLinux 5.10.130Linux 5.15.83Linux 6.1110220330440550SE +/- 2.40, N = 3SE +/- 1.53, N = 3SE +/- 1.53, N = 35024994911. (CC) gcc options: -fopenmp -O2 -pthread -ljbig -lwebp -lwebpmux -ltiff -lfreetype -ljpeg -lXext -lSM -lICE -lX11 -llzma -lbz2 -lxml2 -lz -lm -lpthread

Timed Godot Game Engine Compilation

Time To Compile

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed Godot Game Engine Compilation 3.2.3Time To CompileLinux 5.10.130Linux 5.15.83Linux 6.120406080100SE +/- 0.21, N = 3SE +/- 0.35, N = 3SE +/- 0.17, N = 397.2597.5799.42

NCNN

Target: CPU - Model: squeezenet_ssd

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20220729Target: CPU - Model: squeezenet_ssdLinux 5.10.130Linux 5.15.83Linux 6.148121620SE +/- 0.12, N = 3SE +/- 0.12, N = 6SE +/- 0.14, N = 317.1316.8516.76MIN: 16.75 / MAX: 17.86MIN: 16.41 / MAX: 19.23MIN: 16.41 / MAX: 17.261. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

srsRAN

Test: 4G PHY_DL_Test 100 PRB MIMO 256-QAM

OpenBenchmarking.orgeNb Mb/s, More Is BettersrsRAN 22.04.1Test: 4G PHY_DL_Test 100 PRB MIMO 256-QAMLinux 5.10.130Linux 5.15.83Linux 6.170140210280350SE +/- 1.79, N = 3SE +/- 0.22, N = 3SE +/- 0.35, N = 3303.4310.0307.41. (CXX) g++ options: -std=c++14 -fno-strict-aliasing -march=native -mfpmath=sse -mavx2 -fvisibility=hidden -O3 -fno-trapping-math -fno-math-errno -mavx512f -mavx512cd -mavx512bw -mavx512dq -lpthread -ldl -lm

SVT-AV1

Encoder Mode: Preset 12 - Input: Bosphorus 1080p

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.4Encoder Mode: Preset 12 - Input: Bosphorus 1080pLinux 5.10.130Linux 5.15.83Linux 6.190180270360450SE +/- 0.88, N = 3SE +/- 0.85, N = 3SE +/- 2.62, N = 3415.14418.02409.131. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

Stargate Digital Audio Workstation

Sample Rate: 96000 - Buffer Size: 1024

OpenBenchmarking.orgRender Ratio, More Is BetterStargate Digital Audio Workstation 22.11.5Sample Rate: 96000 - Buffer Size: 1024Linux 5.10.130Linux 5.15.83Linux 6.10.68931.37862.06792.75723.4465SE +/- 0.016716, N = 3SE +/- 0.004654, N = 3SE +/- 0.021684, N = 32.9996113.0635113.0125851. (CXX) g++ options: -lpthread -lsndfile -lm -O3 -march=native -ffast-math -funroll-loops -fstrength-reduce -fstrict-aliasing -finline-functions

Neural Magic DeepSparse

Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Synchronous Single-StreamLinux 5.10.130Linux 5.15.83Linux 6.1612182430SE +/- 0.14, N = 3SE +/- 0.27, N = 7SE +/- 0.11, N = 322.8423.3123.07

Neural Magic DeepSparse

Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Synchronous Single-StreamLinux 5.10.130Linux 5.15.83Linux 6.11020304050SE +/- 0.26, N = 3SE +/- 0.47, N = 7SE +/- 0.21, N = 343.7642.9043.32

OpenVINO

Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.2.devModel: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPULinux 5.10.130Linux 5.15.83Linux 6.10.11480.22960.34440.45920.574SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 30.500.500.51MIN: 0.31 / MAX: 16.57MIN: 0.31 / MAX: 28.92MIN: 0.32 / MAX: 15.061. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -flto -shared

OpenVINO

Model: Vehicle Detection FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.2.devModel: Vehicle Detection FP16 - Device: CPULinux 5.10.130Linux 5.15.83Linux 6.1714212835SE +/- 0.12, N = 3SE +/- 0.01, N = 3SE +/- 0.14, N = 329.3729.2929.86MIN: 11.56 / MAX: 50.23MIN: 13.39 / MAX: 49.34MIN: 11.2 / MAX: 55.831. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -flto -shared

OpenVINO

Model: Vehicle Detection FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.2.devModel: Vehicle Detection FP16 - Device: CPULinux 5.10.130Linux 5.15.83Linux 6.160120180240300SE +/- 1.08, N = 3SE +/- 0.06, N = 3SE +/- 1.20, N = 3272.09272.80267.621. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -flto -shared

JPEG XL libjxl

Input: JPEG - Quality: 100

OpenBenchmarking.orgMP/s, More Is BetterJPEG XL libjxl 0.7Input: JPEG - Quality: 100Linux 5.10.130Linux 5.15.83Linux 6.10.11930.23860.35790.47720.5965SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 30.530.530.521. (CXX) g++ options: -fno-rtti -funwind-tables -O3 -O2 -fPIE -pie -lm -pthread -latomic

Stargate Digital Audio Workstation

Sample Rate: 480000 - Buffer Size: 512

OpenBenchmarking.orgRender Ratio, More Is BetterStargate Digital Audio Workstation 22.11.5Sample Rate: 480000 - Buffer Size: 512Linux 5.10.130Linux 5.15.83Linux 6.10.85281.70562.55843.41124.264SE +/- 0.019070, N = 3SE +/- 0.052597, N = 3SE +/- 0.044488, N = 33.7269333.7903213.7188121. (CXX) g++ options: -lpthread -lsndfile -lm -O3 -march=native -ffast-math -funroll-loops -fstrength-reduce -fstrict-aliasing -finline-functions

JPEG XL libjxl

Input: PNG - Quality: 100

OpenBenchmarking.orgMP/s, More Is BetterJPEG XL libjxl 0.7Input: PNG - Quality: 100Linux 5.10.130Linux 5.15.83Linux 6.10.12150.2430.36450.4860.6075SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 30.540.540.531. (CXX) g++ options: -fno-rtti -funwind-tables -O3 -O2 -fPIE -pie -lm -pthread -latomic

Numenta Anomaly Benchmark

Detector: Relative Entropy

OpenBenchmarking.orgSeconds, Fewer Is BetterNumenta Anomaly Benchmark 1.1Detector: Relative EntropyLinux 5.10.130Linux 5.15.83Linux 6.148121620SE +/- 0.27, N = 3SE +/- 0.09, N = 3SE +/- 0.19, N = 315.8015.8115.53

SVT-AV1

Encoder Mode: Preset 13 - Input: Bosphorus 4K

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.4Encoder Mode: Preset 13 - Input: Bosphorus 4KLinux 5.10.130Linux 5.15.83Linux 6.1306090120150SE +/- 0.69, N = 3SE +/- 0.32, N = 3SE +/- 0.62, N = 3120.79122.98121.601. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

NCNN

Target: CPU - Model: mobilenet

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20220729Target: CPU - Model: mobilenetLinux 5.10.130Linux 5.15.83Linux 6.148121620SE +/- 0.03, N = 3SE +/- 0.18, N = 6SE +/- 0.01, N = 314.5414.7114.45MIN: 14.37 / MAX: 17.06MIN: 14.26 / MAX: 15.75MIN: 14.31 / MAX: 15.471. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

libavif avifenc

Encoder Speed: 6, Lossless

OpenBenchmarking.orgSeconds, Fewer Is Betterlibavif avifenc 0.11Encoder Speed: 6, LosslessLinux 5.10.130Linux 5.15.83Linux 6.13691215SE +/- 0.04, N = 3SE +/- 0.01, N = 3SE +/- 0.02, N = 311.3811.4311.581. (CXX) g++ options: -O3 -fPIC -lm

OpenVINO

Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.2.devModel: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPULinux 5.10.130Linux 5.15.83Linux 6.17K14K21K28K35KSE +/- 85.59, N = 3SE +/- 38.88, N = 3SE +/- 16.23, N = 331167.8131007.3830632.461. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -flto -shared

Stress-NG

Test: Memory Copying

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.14.06Test: Memory CopyingLinux 5.10.130Linux 5.15.83Linux 6.19001800270036004500SE +/- 31.35, N = 3SE +/- 42.48, N = 3SE +/- 29.72, N = 34201.024129.344181.801. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -laio -lapparmor -latomic -lbsd -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lrt -lsctp -lz -pthread

Stargate Digital Audio Workstation

Sample Rate: 480000 - Buffer Size: 1024

OpenBenchmarking.orgRender Ratio, More Is BetterStargate Digital Audio Workstation 22.11.5Sample Rate: 480000 - Buffer Size: 1024Linux 5.10.130Linux 5.15.83Linux 6.10.9611.9222.8833.8444.805SE +/- 0.030220, N = 3SE +/- 0.015411, N = 3SE +/- 0.017869, N = 34.1995684.2708974.2088801. (CXX) g++ options: -lpthread -lsndfile -lm -O3 -march=native -ffast-math -funroll-loops -fstrength-reduce -fstrict-aliasing -finline-functions

Timed CPython Compilation

Build Configuration: Default

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed CPython Compilation 3.10.6Build Configuration: DefaultLinux 5.10.130Linux 5.15.83Linux 6.151015202519.4519.4919.78

libavif avifenc

Encoder Speed: 6

OpenBenchmarking.orgSeconds, Fewer Is Betterlibavif avifenc 0.11Encoder Speed: 6Linux 5.10.130Linux 5.15.83Linux 6.1246810SE +/- 0.059, N = 3SE +/- 0.054, N = 3SE +/- 0.036, N = 36.6896.7496.7981. (CXX) g++ options: -O3 -fPIC -lm

Mobile Neural Network

Model: nasnet

OpenBenchmarking.orgms, Fewer Is BetterMobile Neural Network 2.1Model: nasnetLinux 5.10.130Linux 5.15.83Linux 6.148121620SE +/- 0.12, N = 3SE +/- 0.10, N = 3SE +/- 0.15, N = 914.9114.8815.12MIN: 14.46 / MAX: 28.47MIN: 14.51 / MAX: 33.86MIN: 14.55 / MAX: 29.561. (CXX) g++ options: -std=c++11 -O3 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl

7-Zip Compression

Test: Compression Rating

OpenBenchmarking.orgMIPS, More Is Better7-Zip Compression 22.01Test: Compression RatingLinux 5.10.130Linux 5.15.83Linux 6.120K40K60K80K100KSE +/- 95.64, N = 3SE +/- 364.72, N = 3SE +/- 526.57, N = 31063571080581069681. (CXX) g++ options: -lpthread -ldl -O2 -fPIC

NCNN

Target: CPU - Model: FastestDet

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20220729Target: CPU - Model: FastestDetLinux 5.10.130Linux 5.15.83Linux 6.1246810SE +/- 0.03, N = 3SE +/- 0.02, N = 6SE +/- 0.02, N = 37.026.916.96MIN: 6.87 / MAX: 7.89MIN: 6.78 / MAX: 7.67MIN: 6.86 / MAX: 7.191. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

Mobile Neural Network

Model: SqueezeNetV1.0

OpenBenchmarking.orgms, Fewer Is BetterMobile Neural Network 2.1Model: SqueezeNetV1.0Linux 5.10.130Linux 5.15.83Linux 6.11.1182.2363.3544.4725.59SE +/- 0.043, N = 3SE +/- 0.009, N = 3SE +/- 0.019, N = 94.8924.8974.969MIN: 4.79 / MAX: 17.74MIN: 4.84 / MAX: 18.25MIN: 4.87 / MAX: 7.191. (CXX) g++ options: -std=c++11 -O3 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl

srsRAN

Test: OFDM_Test

OpenBenchmarking.orgSamples / Second, More Is BettersrsRAN 22.04.1Test: OFDM_TestLinux 5.10.130Linux 5.15.83Linux 6.130M60M90M120M150MSE +/- 251661.15, N = 3SE +/- 352766.84, N = 3SE +/- 417665.47, N = 31220000001226333331207333331. (CXX) g++ options: -std=c++14 -fno-strict-aliasing -march=native -mfpmath=sse -mavx2 -fvisibility=hidden -O3 -fno-trapping-math -fno-math-errno -mavx512f -mavx512cd -mavx512bw -mavx512dq -lpthread -ldl -lm

Mobile Neural Network

Model: inception-v3

OpenBenchmarking.orgms, Fewer Is BetterMobile Neural Network 2.1Model: inception-v3Linux 5.10.130Linux 5.15.83Linux 6.1510152025SE +/- 0.36, N = 3SE +/- 0.38, N = 3SE +/- 0.32, N = 922.7322.4422.79MIN: 22.05 / MAX: 36.04MIN: 21.58 / MAX: 36.88MIN: 21.59 / MAX: 102.891. (CXX) g++ options: -std=c++11 -O3 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl

OSPRay Studio

Camera: 2 - Resolution: 4K - Samples Per Pixel: 16 - Renderer: Path Tracer

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.11Camera: 2 - Resolution: 4K - Samples Per Pixel: 16 - Renderer: Path TracerLinux 5.10.130Linux 5.15.83Linux 6.130K60K90K120K150KSE +/- 68.75, N = 3SE +/- 104.41, N = 3SE +/- 1877.65, N = 31244281245561263411. (CXX) g++ options: -O3 -lm -ldl -lpthread -pthread

TensorFlow

Device: CPU - Batch Size: 16 - Model: GoogLeNet

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.10Device: CPU - Batch Size: 16 - Model: GoogLeNetLinux 5.10.130Linux 5.15.83Linux 6.1306090120150SE +/- 0.12, N = 3SE +/- 0.10, N = 3SE +/- 0.17, N = 3114.41115.15116.16

OSPRay Studio

Camera: 2 - Resolution: 1080p - Samples Per Pixel: 32 - Renderer: Path Tracer

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.11Camera: 2 - Resolution: 1080p - Samples Per Pixel: 32 - Renderer: Path TracerLinux 5.10.130Linux 5.15.83Linux 6.115K30K45K60K75KSE +/- 35.09, N = 3SE +/- 44.92, N = 3SE +/- 539.86, N = 146682366817678371. (CXX) g++ options: -O3 -lm -ldl -lpthread -pthread

Neural Magic DeepSparse

Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-StreamLinux 5.10.130Linux 5.15.83Linux 6.13691215SE +/- 0.05, N = 3SE +/- 0.04, N = 3SE +/- 0.04, N = 310.5410.4310.38

Mobile Neural Network

Model: mobilenet-v1-1.0

OpenBenchmarking.orgms, Fewer Is BetterMobile Neural Network 2.1Model: mobilenet-v1-1.0Linux 5.10.130Linux 5.15.83Linux 6.10.60261.20521.80782.41043.013SE +/- 0.044, N = 3SE +/- 0.047, N = 3SE +/- 0.028, N = 92.6782.6392.640MIN: 2.4 / MAX: 5.22MIN: 2.38 / MAX: 3.73MIN: 2.36 / MAX: 16.91. (CXX) g++ options: -std=c++11 -O3 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl

Cpuminer-Opt

Algorithm: Myriad-Groestl

OpenBenchmarking.orgkH/s, More Is BetterCpuminer-Opt 3.20.3Algorithm: Myriad-GroestlLinux 5.10.130Linux 5.15.83Linux 6.14K8K12K16K20KSE +/- 286.72, N = 3SE +/- 185.02, N = 3SE +/- 135.32, N = 31736317610174771. (CXX) g++ options: -O2 -lcurl -lz -lpthread -lssl -lcrypto -lgmp

Timed Node.js Compilation

Time To Compile

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed Node.js Compilation 18.8Time To CompileLinux 5.10.130Linux 5.15.83Linux 6.1100200300400500SE +/- 0.23, N = 3SE +/- 0.27, N = 3SE +/- 0.24, N = 3453.61453.31459.75

Neural Magic DeepSparse

Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-StreamLinux 5.10.130Linux 5.15.83Linux 6.1160320480640800SE +/- 2.25, N = 3SE +/- 1.90, N = 3SE +/- 2.74, N = 3752.83760.84763.31

OpenVINO

Model: Machine Translation EN To DE FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.2.devModel: Machine Translation EN To DE FP16 - Device: CPULinux 5.10.130Linux 5.15.83Linux 6.11428425670SE +/- 0.70, N = 3SE +/- 0.24, N = 3SE +/- 0.40, N = 364.8264.2863.961. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -flto -shared

OpenVINO

Model: Machine Translation EN To DE FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.2.devModel: Machine Translation EN To DE FP16 - Device: CPULinux 5.10.130Linux 5.15.83Linux 6.1306090120150SE +/- 1.34, N = 3SE +/- 0.46, N = 3SE +/- 0.78, N = 3123.34124.34124.97MIN: 64 / MAX: 136.84MIN: 64.41 / MAX: 139.86MIN: 64.13 / MAX: 142.041. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -flto -shared

FLAC Audio Encoding

WAV To FLAC

OpenBenchmarking.orgSeconds, Fewer Is BetterFLAC Audio Encoding 1.4WAV To FLACLinux 5.10.130Linux 5.15.83Linux 6.1510152025SE +/- 0.03, N = 5SE +/- 0.02, N = 5SE +/- 0.04, N = 521.1121.1021.381. (CXX) g++ options: -O3 -fvisibility=hidden -logg -lm

Numenta Anomaly Benchmark

Detector: Bayesian Changepoint

OpenBenchmarking.orgSeconds, Fewer Is BetterNumenta Anomaly Benchmark 1.1Detector: Bayesian ChangepointLinux 5.10.130Linux 5.15.83Linux 6.11020304050SE +/- 0.18, N = 3SE +/- 0.21, N = 3SE +/- 0.20, N = 341.3941.4341.94

SVT-AV1

Encoder Mode: Preset 13 - Input: Bosphorus 1080p

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.4Encoder Mode: Preset 13 - Input: Bosphorus 1080pLinux 5.10.130Linux 5.15.83Linux 6.190180270360450SE +/- 0.82, N = 3SE +/- 1.29, N = 3SE +/- 1.64, N = 3423.65425.26419.751. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

GraphicsMagick

Operation: Enhanced

OpenBenchmarking.orgIterations Per Minute, More Is BetterGraphicsMagick 1.3.38Operation: EnhancedLinux 5.10.130Linux 5.15.83Linux 6.170140210280350SE +/- 0.67, N = 3SE +/- 0.67, N = 3SE +/- 0.67, N = 33153143111. (CC) gcc options: -fopenmp -O2 -pthread -ljbig -lwebp -lwebpmux -ltiff -lfreetype -ljpeg -lXext -lSM -lICE -lX11 -llzma -lbz2 -lxml2 -lz -lm -lpthread

OpenVINO

Model: Vehicle Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.2.devModel: Vehicle Detection FP16-INT8 - Device: CPULinux 5.10.130Linux 5.15.83Linux 6.12004006008001000SE +/- 5.71, N = 3SE +/- 1.74, N = 3SE +/- 0.69, N = 3969.33957.08957.411. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -flto -shared

Neural Magic DeepSparse

Model: CV Classification, ResNet-50 ImageNet - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: CV Classification, ResNet-50 ImageNet - Scenario: Synchronous Single-StreamLinux 5.10.130Linux 5.15.83Linux 6.1246810SE +/- 0.0949, N = 3SE +/- 0.0304, N = 3SE +/- 0.1212, N = 37.52657.44087.5359

OSPRay Studio

Camera: 1 - Resolution: 4K - Samples Per Pixel: 16 - Renderer: Path Tracer

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.11Camera: 1 - Resolution: 4K - Samples Per Pixel: 16 - Renderer: Path TracerLinux 5.10.130Linux 5.15.83Linux 6.130K60K90K120K150KSE +/- 26.43, N = 3SE +/- 135.52, N = 3SE +/- 1530.19, N = 51214671214861230001. (CXX) g++ options: -O3 -lm -ldl -lpthread -pthread

Timed PHP Compilation

Time To Compile

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed PHP Compilation 8.1.9Time To CompileLinux 5.10.130Linux 5.15.83Linux 6.11530456075SE +/- 0.32, N = 3SE +/- 0.24, N = 3SE +/- 0.39, N = 365.3365.1465.96

NCNN

Target: CPU - Model: shufflenet-v2

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20220729Target: CPU - Model: shufflenet-v2Linux 5.10.130Linux 5.15.83Linux 6.11.27352.5473.82055.0946.3675SE +/- 0.02, N = 3SE +/- 0.01, N = 6SE +/- 0.01, N = 35.665.595.63MIN: 5.54 / MAX: 17.07MIN: 5.48 / MAX: 6.6MIN: 5.53 / MAX: 6.551. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

OpenVINO

Model: Person Vehicle Bike Detection FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.2.devModel: Person Vehicle Bike Detection FP16 - Device: CPULinux 5.10.130Linux 5.15.83Linux 6.1110220330440550SE +/- 4.00, N = 13SE +/- 4.62, N = 3SE +/- 4.29, N = 11485.36485.19491.241. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -flto -shared

NCNN

Target: CPU - Model: mnasnet

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20220729Target: CPU - Model: mnasnetLinux 5.10.130Linux 5.15.83Linux 6.11.10482.20963.31444.41925.524SE +/- 0.03, N = 3SE +/- 0.00, N = 6SE +/- 0.01, N = 34.914.854.89MIN: 4.74 / MAX: 16.51MIN: 4.72 / MAX: 7.62MIN: 4.81 / MAX: 5.211. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

OpenVINO

Model: Person Vehicle Bike Detection FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.2.devModel: Person Vehicle Bike Detection FP16 - Device: CPULinux 5.10.130Linux 5.15.83Linux 6.148121620SE +/- 0.14, N = 13SE +/- 0.16, N = 3SE +/- 0.15, N = 1116.4716.4616.27MIN: 7.86 / MAX: 36.14MIN: 9.28 / MAX: 33.36MIN: 7.67 / MAX: 36.051. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -flto -shared

Neural Magic DeepSparse

Model: CV Classification, ResNet-50 ImageNet - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: CV Classification, ResNet-50 ImageNet - Scenario: Synchronous Single-StreamLinux 5.10.130Linux 5.15.83Linux 6.1306090120150SE +/- 1.67, N = 3SE +/- 0.54, N = 3SE +/- 2.16, N = 3132.65134.13132.51

ClickHouse

100M Rows Web Analytics Dataset, Third Run

OpenBenchmarking.orgQueries Per Minute, Geo Mean, More Is BetterClickHouse 22.5.4.19100M Rows Web Analytics Dataset, Third RunLinux 5.10.130Linux 5.15.83Linux 6.150100150200250SE +/- 1.01, N = 15SE +/- 0.78, N = 14SE +/- 1.08, N = 3212.42215.02212.92MIN: 22.81 / MAX: 20000MIN: 22.68 / MAX: 20000MIN: 22.26 / MAX: 200001. ClickHouse server version 22.5.4.19 (official build).

OpenVINO

Model: Vehicle Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.2.devModel: Vehicle Detection FP16-INT8 - Device: CPULinux 5.10.130Linux 5.15.83Linux 6.1246810SE +/- 0.05, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 38.248.348.33MIN: 4.42 / MAX: 23.84MIN: 4.49 / MAX: 23.48MIN: 4.48 / MAX: 25.961. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -flto -shared

TensorFlow

Device: CPU - Batch Size: 32 - Model: GoogLeNet

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.10Device: CPU - Batch Size: 32 - Model: GoogLeNetLinux 5.10.130Linux 5.15.83Linux 6.1306090120150SE +/- 0.14, N = 3SE +/- 0.12, N = 3SE +/- 0.12, N = 3121.72122.18123.19

miniBUDE

Implementation: OpenMP - Input Deck: BM1

OpenBenchmarking.orgGFInst/s, More Is BetterminiBUDE 20210901Implementation: OpenMP - Input Deck: BM1Linux 5.10.130Linux 5.15.83Linux 6.1120240360480600SE +/- 0.13, N = 3SE +/- 0.39, N = 3SE +/- 0.30, N = 3530.27529.24535.571. (CC) gcc options: -std=c99 -Ofast -ffast-math -fopenmp -march=native -lm

miniBUDE

Implementation: OpenMP - Input Deck: BM1

OpenBenchmarking.orgBillion Interactions/s, More Is BetterminiBUDE 20210901Implementation: OpenMP - Input Deck: BM1Linux 5.10.130Linux 5.15.83Linux 6.1510152025SE +/- 0.01, N = 3SE +/- 0.02, N = 3SE +/- 0.01, N = 321.2121.1721.421. (CC) gcc options: -std=c99 -Ofast -ffast-math -fopenmp -march=native -lm

Cpuminer-Opt

Algorithm: Ringcoin

OpenBenchmarking.orgkH/s, More Is BetterCpuminer-Opt 3.20.3Algorithm: RingcoinLinux 5.10.130Linux 5.15.83Linux 6.16001200180024003000SE +/- 27.91, N = 3SE +/- 0.80, N = 3SE +/- 1.62, N = 32833.092812.342800.621. (CXX) g++ options: -O2 -lcurl -lz -lpthread -lssl -lcrypto -lgmp

Cpuminer-Opt

Algorithm: Blake-2 S

OpenBenchmarking.orgkH/s, More Is BetterCpuminer-Opt 3.20.3Algorithm: Blake-2 SLinux 5.10.130Linux 5.15.83Linux 6.1200K400K600K800K1000KSE +/- 6874.21, N = 3SE +/- 10686.26, N = 3SE +/- 3289.87, N = 31149103115058311375501. (CXX) g++ options: -O2 -lcurl -lz -lpthread -lssl -lcrypto -lgmp

miniBUDE

Implementation: OpenMP - Input Deck: BM2

OpenBenchmarking.orgBillion Interactions/s, More Is BetterminiBUDE 20210901Implementation: OpenMP - Input Deck: BM2Linux 5.10.130Linux 5.15.83Linux 6.1510152025SE +/- 0.01, N = 3SE +/- 0.00, N = 3SE +/- 0.01, N = 321.3921.3221.551. (CC) gcc options: -std=c99 -Ofast -ffast-math -fopenmp -march=native -lm

miniBUDE

Implementation: OpenMP - Input Deck: BM2

OpenBenchmarking.orgGFInst/s, More Is BetterminiBUDE 20210901Implementation: OpenMP - Input Deck: BM2Linux 5.10.130Linux 5.15.83Linux 6.1120240360480600SE +/- 0.18, N = 3SE +/- 0.02, N = 3SE +/- 0.18, N = 3534.74532.92538.791. (CC) gcc options: -std=c99 -Ofast -ffast-math -fopenmp -march=native -lm

TensorFlow

Device: CPU - Batch Size: 16 - Model: ResNet-50

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.10Device: CPU - Batch Size: 16 - Model: ResNet-50Linux 5.10.130Linux 5.15.83Linux 6.1918273645SE +/- 0.03, N = 3SE +/- 0.07, N = 3SE +/- 0.02, N = 337.6838.0938.01

oneDNN

Harness: Convolution Batch Shapes Auto - Data Type: u8s8f32 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.7Harness: Convolution Batch Shapes Auto - Data Type: u8s8f32 - Engine: CPULinux 5.10.130Linux 5.15.83Linux 6.10.94581.89162.83743.78324.729SE +/- 0.01257, N = 3SE +/- 0.00929, N = 3SE +/- 0.00677, N = 34.158694.203434.18096MIN: 4.09MIN: 4.13MIN: 4.131. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -lpthread -ldl

Neural Magic DeepSparse

Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-StreamLinux 5.10.130Linux 5.15.83Linux 6.13691215SE +/- 0.02, N = 3SE +/- 0.06, N = 3SE +/- 0.07, N = 310.5210.4510.41

srsRAN

Test: 4G PHY_DL_Test 100 PRB MIMO 64-QAM

OpenBenchmarking.orgeNb Mb/s, More Is BettersrsRAN 22.04.1Test: 4G PHY_DL_Test 100 PRB MIMO 64-QAMLinux 5.10.130Linux 5.15.83Linux 6.160120180240300SE +/- 0.15, N = 3SE +/- 0.17, N = 3SE +/- 0.27, N = 3279.8282.7280.21. (CXX) g++ options: -std=c++14 -fno-strict-aliasing -march=native -mfpmath=sse -mavx2 -fvisibility=hidden -O3 -fno-trapping-math -fno-math-errno -mavx512f -mavx512cd -mavx512bw -mavx512dq -lpthread -ldl -lm

AOM AV1

Encoder Mode: Speed 6 Two-Pass - Input: Bosphorus 4K

OpenBenchmarking.orgFrames Per Second, More Is BetterAOM AV1 3.5Encoder Mode: Speed 6 Two-Pass - Input: Bosphorus 4KLinux 5.10.130Linux 5.15.83Linux 6.13691215SE +/- 0.02, N = 3SE +/- 0.02, N = 3SE +/- 0.03, N = 311.7011.7711.651. (CXX) g++ options: -O3 -std=c++11 -U_FORTIFY_SOURCE -lm -lpthread

srsRAN

Test: 4G PHY_DL_Test 100 PRB MIMO 64-QAM

OpenBenchmarking.orgUE Mb/s, More Is BettersrsRAN 22.04.1Test: 4G PHY_DL_Test 100 PRB MIMO 64-QAMLinux 5.10.130Linux 5.15.83Linux 6.1306090120150SE +/- 0.27, N = 3SE +/- 0.07, N = 3SE +/- 0.03, N = 3117.3118.3117.11. (CXX) g++ options: -std=c++14 -fno-strict-aliasing -march=native -mfpmath=sse -mavx2 -fvisibility=hidden -O3 -fno-trapping-math -fno-math-errno -mavx512f -mavx512cd -mavx512bw -mavx512dq -lpthread -ldl -lm

GraphicsMagick

Operation: Sharpen

OpenBenchmarking.orgIterations Per Minute, More Is BetterGraphicsMagick 1.3.38Operation: SharpenLinux 5.10.130Linux 5.15.83Linux 6.14080120160200SE +/- 1.33, N = 3SE +/- 1.20, N = 3SE +/- 1.33, N = 31991991971. (CC) gcc options: -fopenmp -O2 -pthread -ljbig -lwebp -lwebpmux -ltiff -lfreetype -ljpeg -lXext -lSM -lICE -lX11 -llzma -lbz2 -lxml2 -lz -lm -lpthread

OpenFOAM

Input: drivaerFastback, Small Mesh Size - Execution Time

OpenBenchmarking.orgSeconds, Fewer Is BetterOpenFOAM 10Input: drivaerFastback, Small Mesh Size - Execution TimeLinux 5.10.130Linux 5.15.83Linux 6.14080120160200188.28186.40186.931. (CXX) g++ options: -std=c++14 -m64 -O3 -ftemplate-depth-100 -fPIC -fuse-ld=bfd -Xlinker --add-needed --no-as-needed -ldynamicMesh -lgenericPatchFields -lOpenFOAM -ldl -lm

NCNN

Target: CPU - Model: efficientnet-b0

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20220729Target: CPU - Model: efficientnet-b0Linux 5.10.130Linux 5.15.83Linux 6.1246810SE +/- 0.02, N = 3SE +/- 0.01, N = 6SE +/- 0.01, N = 37.066.997.04MIN: 6.92 / MAX: 7.42MIN: 6.89 / MAX: 8.15MIN: 6.92 / MAX: 7.341. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

OSPRay Studio

Camera: 1 - Resolution: 1080p - Samples Per Pixel: 32 - Renderer: Path Tracer

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.11Camera: 1 - Resolution: 1080p - Samples Per Pixel: 32 - Renderer: Path TracerLinux 5.10.130Linux 5.15.83Linux 6.114K28K42K56K70KSE +/- 37.27, N = 3SE +/- 20.81, N = 3SE +/- 527.74, N = 36527165242658941. (CXX) g++ options: -O3 -lm -ldl -lpthread -pthread

srsRAN

Test: 4G PHY_DL_Test 100 PRB SISO 256-QAM

OpenBenchmarking.orgUE Mb/s, More Is BettersrsRAN 22.04.1Test: 4G PHY_DL_Test 100 PRB SISO 256-QAMLinux 5.10.130Linux 5.15.83Linux 6.1306090120150SE +/- 0.09, N = 3SE +/- 0.06, N = 3SE +/- 0.15, N = 3131.0131.6130.31. (CXX) g++ options: -std=c++14 -fno-strict-aliasing -march=native -mfpmath=sse -mavx2 -fvisibility=hidden -O3 -fno-trapping-math -fno-math-errno -mavx512f -mavx512cd -mavx512bw -mavx512dq -lpthread -ldl -lm

OpenVINO

Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.2.devModel: Age Gender Recognition Retail 0013 FP16 - Device: CPULinux 5.10.130Linux 5.15.83Linux 6.10.2340.4680.7020.9361.17SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 31.041.031.04MIN: 0.61 / MAX: 17.55MIN: 0.61 / MAX: 17.94MIN: 0.61 / MAX: 17.761. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -flto -shared

libavif avifenc

Encoder Speed: 2

OpenBenchmarking.orgSeconds, Fewer Is Betterlibavif avifenc 0.11Encoder Speed: 2Linux 5.10.130Linux 5.15.83Linux 6.11632486480SE +/- 0.04, N = 3SE +/- 0.41, N = 3SE +/- 0.25, N = 370.5271.0771.201. (CXX) g++ options: -O3 -fPIC -lm

Mobile Neural Network

Model: mobilenetV3

OpenBenchmarking.orgms, Fewer Is BetterMobile Neural Network 2.1Model: mobilenetV3Linux 5.10.130Linux 5.15.83Linux 6.10.47050.9411.41151.8822.3525SE +/- 0.010, N = 3SE +/- 0.009, N = 3SE +/- 0.009, N = 92.0912.0712.083MIN: 1.99 / MAX: 3.26MIN: 1.99 / MAX: 4.73MIN: 1.98 / MAX: 6.071. (CXX) g++ options: -std=c++11 -O3 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl

NCNN

Target: CPU - Model: googlenet

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20220729Target: CPU - Model: googlenetLinux 5.10.130Linux 5.15.83Linux 6.13691215SE +/- 0.05, N = 3SE +/- 0.02, N = 6SE +/- 0.02, N = 311.5711.4611.48MIN: 11.39 / MAX: 11.86MIN: 11.27 / MAX: 12.43MIN: 11.33 / MAX: 12.451. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

SVT-AV1

Encoder Mode: Preset 4 - Input: Bosphorus 4K

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.4Encoder Mode: Preset 4 - Input: Bosphorus 4KLinux 5.10.130Linux 5.15.83Linux 6.10.55871.11741.67612.23482.7935SE +/- 0.003, N = 3SE +/- 0.005, N = 3SE +/- 0.005, N = 32.4752.4832.4601. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

OpenRadioss

Model: Bumper Beam

OpenBenchmarking.orgSeconds, Fewer Is BetterOpenRadioss 2022.10.13Model: Bumper BeamLinux 5.10.130Linux 5.15.83Linux 6.1306090120150SE +/- 0.18, N = 3SE +/- 0.14, N = 3SE +/- 0.17, N = 3152.41151.82153.23

Xmrig

Variant: Monero - Hash Count: 1M

OpenBenchmarking.orgH/s, More Is BetterXmrig 6.18.1Variant: Monero - Hash Count: 1MLinux 5.10.130Linux 5.15.83Linux 6.115003000450060007500SE +/- 3.14, N = 3SE +/- 23.74, N = 3SE +/- 54.19, N = 36794.56829.86767.31. (CXX) g++ options: -fexceptions -fno-rtti -maes -O3 -Ofast -static-libgcc -static-libstdc++ -rdynamic -lssl -lcrypto -luv -lpthread -lrt -ldl -lhwloc

OpenVINO

Model: Person Detection FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.2.devModel: Person Detection FP16 - Device: CPULinux 5.10.130Linux 5.15.83Linux 6.10.74481.48962.23442.97923.724SE +/- 0.01, N = 3SE +/- 0.02, N = 3SE +/- 0.01, N = 33.313.303.281. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -flto -shared

BRL-CAD

VGR Performance Metric

OpenBenchmarking.orgVGR Performance Metric, More Is BetterBRL-CAD 7.32.6VGR Performance MetricLinux 5.10.130Linux 5.15.83Linux 6.140K80K120K160K200K1677711668521683341. (CXX) g++ options: -std=c++11 -pipe -fvisibility=hidden -fno-strict-aliasing -fno-common -fexceptions -ftemplate-depth-128 -m64 -ggdb3 -O3 -fipa-pta -fstrength-reduce -finline-functions -flto -pedantic -pthread -ldl -lm

Numenta Anomaly Benchmark

Detector: Earthgecko Skyline

OpenBenchmarking.orgSeconds, Fewer Is BetterNumenta Anomaly Benchmark 1.1Detector: Earthgecko SkylineLinux 5.10.130Linux 5.15.83Linux 6.1306090120150SE +/- 0.46, N = 3SE +/- 0.35, N = 3SE +/- 0.67, N = 3114.81115.53115.83

Neural Magic DeepSparse

Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-StreamLinux 5.10.130Linux 5.15.83Linux 6.1160320480640800SE +/- 1.03, N = 3SE +/- 2.20, N = 3SE +/- 4.45, N = 3758.03759.35764.74

oneDNN

Harness: Matrix Multiply Batch Shapes Transformer - Data Type: u8s8f32 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.7Harness: Matrix Multiply Batch Shapes Transformer - Data Type: u8s8f32 - Engine: CPULinux 5.10.130Linux 5.15.83Linux 6.10.07110.14220.21330.28440.3555SE +/- 0.000694, N = 3SE +/- 0.001833, N = 3SE +/- 0.000082, N = 30.3132380.3160050.313975MIN: 0.3MIN: 0.3MIN: 0.31. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -lpthread -ldl

SVT-AV1

Encoder Mode: Preset 4 - Input: Bosphorus 1080p

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.4Encoder Mode: Preset 4 - Input: Bosphorus 1080pLinux 5.10.130Linux 5.15.83Linux 6.1246810SE +/- 0.057, N = 3SE +/- 0.016, N = 3SE +/- 0.044, N = 37.0466.9857.0241. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

srsRAN

Test: 4G PHY_DL_Test 100 PRB MIMO 256-QAM

OpenBenchmarking.orgUE Mb/s, More Is BettersrsRAN 22.04.1Test: 4G PHY_DL_Test 100 PRB MIMO 256-QAMLinux 5.10.130Linux 5.15.83Linux 6.1306090120150SE +/- 0.13, N = 3SE +/- 0.18, N = 3SE +/- 0.15, N = 3126.9128.0127.21. (CXX) g++ options: -std=c++14 -fno-strict-aliasing -march=native -mfpmath=sse -mavx2 -fvisibility=hidden -O3 -fno-trapping-math -fno-math-errno -mavx512f -mavx512cd -mavx512bw -mavx512dq -lpthread -ldl -lm

SVT-AV1

Encoder Mode: Preset 8 - Input: Bosphorus 4K

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.4Encoder Mode: Preset 8 - Input: Bosphorus 4KLinux 5.10.130Linux 5.15.83Linux 6.1816243240SE +/- 0.07, N = 3SE +/- 0.15, N = 3SE +/- 0.20, N = 334.5234.8234.721. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

NCNN

Target: CPU - Model: regnety_400m

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20220729Target: CPU - Model: regnety_400mLinux 5.10.130Linux 5.15.83Linux 6.1510152025SE +/- 0.15, N = 3SE +/- 0.02, N = 6SE +/- 0.03, N = 318.8318.6718.70MIN: 18.43 / MAX: 58.94MIN: 18.39 / MAX: 21.55MIN: 18.43 / MAX: 19.51. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

Stress-NG

Test: Atomic

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.14.06Test: AtomicLinux 5.10.130Linux 5.15.83Linux 6.150K100K150K200K250KSE +/- 1447.49, N = 3SE +/- 1620.65, N = 3SE +/- 3644.44, N = 3223731.70225144.33225639.321. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -laio -lapparmor -latomic -lbsd -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lrt -lsctp -lz -pthread

Cpuminer-Opt

Algorithm: LBC, LBRY Credits

OpenBenchmarking.orgkH/s, More Is BetterCpuminer-Opt 3.20.3Algorithm: LBC, LBRY CreditsLinux 5.10.130Linux 5.15.83Linux 6.120K40K60K80K100KSE +/- 656.84, N = 3SE +/- 167.46, N = 3SE +/- 615.39, N = 39682096663960101. (CXX) g++ options: -O2 -lcurl -lz -lpthread -lssl -lcrypto -lgmp

SVT-AV1

Encoder Mode: Preset 12 - Input: Bosphorus 4K

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.4Encoder Mode: Preset 12 - Input: Bosphorus 4KLinux 5.10.130Linux 5.15.83Linux 6.1306090120150SE +/- 0.46, N = 3SE +/- 0.62, N = 3SE +/- 0.29, N = 3126.50127.53126.761. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

OpenFOAM

Input: drivaerFastback, Medium Mesh Size - Execution Time

OpenBenchmarking.orgSeconds, Fewer Is BetterOpenFOAM 10Input: drivaerFastback, Medium Mesh Size - Execution TimeLinux 5.10.130Linux 5.15.83Linux 6.1300600900120015001598.701611.591607.401. (CXX) g++ options: -std=c++14 -m64 -O3 -ftemplate-depth-100 -fPIC -fuse-ld=bfd -Xlinker --add-needed --no-as-needed -ldynamicMesh -lgenericPatchFields -lOpenFOAM -ldl -lm

Neural Magic DeepSparse

Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Synchronous Single-StreamLinux 5.10.130Linux 5.15.83Linux 6.120406080100SE +/- 0.33, N = 3SE +/- 0.39, N = 3SE +/- 0.93, N = 3104.16104.01104.83

OpenVINO

Model: Weld Porosity Detection FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.2.devModel: Weld Porosity Detection FP16 - Device: CPULinux 5.10.130Linux 5.15.83Linux 6.1140280420560700SE +/- 0.68, N = 3SE +/- 0.90, N = 3SE +/- 1.31, N = 3625.50623.36620.611. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -flto -shared

WebP Image Encode

Encode Settings: Quality 100, Lossless

OpenBenchmarking.orgMP/s, More Is BetterWebP Image Encode 1.2.4Encode Settings: Quality 100, LosslessLinux 5.10.130Linux 5.15.83Linux 6.10.2880.5760.8641.1521.44SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 31.271.281.271. (CC) gcc options: -fvisibility=hidden -O2 -lm -pthread

srsRAN

Test: 4G PHY_DL_Test 100 PRB SISO 64-QAM

OpenBenchmarking.orgeNb Mb/s, More Is BettersrsRAN 22.04.1Test: 4G PHY_DL_Test 100 PRB SISO 64-QAMLinux 5.10.130Linux 5.15.83Linux 6.160120180240300SE +/- 0.30, N = 3SE +/- 0.09, N = 3SE +/- 0.15, N = 3279.8282.0280.31. (CXX) g++ options: -std=c++14 -fno-strict-aliasing -march=native -mfpmath=sse -mavx2 -fvisibility=hidden -O3 -fno-trapping-math -fno-math-errno -mavx512f -mavx512cd -mavx512bw -mavx512dq -lpthread -ldl -lm

srsRAN

Test: 4G PHY_DL_Test 100 PRB SISO 256-QAM

OpenBenchmarking.orgeNb Mb/s, More Is BettersrsRAN 22.04.1Test: 4G PHY_DL_Test 100 PRB SISO 256-QAMLinux 5.10.130Linux 5.15.83Linux 6.170140210280350SE +/- 0.25, N = 3SE +/- 0.15, N = 3SE +/- 0.09, N = 3307.0307.9305.51. (CXX) g++ options: -std=c++14 -fno-strict-aliasing -march=native -mfpmath=sse -mavx2 -fvisibility=hidden -O3 -fno-trapping-math -fno-math-errno -mavx512f -mavx512cd -mavx512bw -mavx512dq -lpthread -ldl -lm

Neural Magic DeepSparse

Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Synchronous Single-StreamLinux 5.10.130Linux 5.15.83Linux 6.13691215SE +/- 0.0301, N = 3SE +/- 0.0357, N = 3SE +/- 0.0848, N = 39.59969.61419.5393

OpenVINO

Model: Weld Porosity Detection FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.2.devModel: Weld Porosity Detection FP16 - Device: CPULinux 5.10.130Linux 5.15.83Linux 6.1612182430SE +/- 0.03, N = 3SE +/- 0.04, N = 3SE +/- 0.06, N = 325.5325.6225.73MIN: 13.67 / MAX: 47.14MIN: 14.62 / MAX: 46.69MIN: 14.41 / MAX: 47.881. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -flto -shared

OpenFOAM

Input: drivaerFastback, Small Mesh Size - Mesh Time

OpenBenchmarking.orgSeconds, Fewer Is BetterOpenFOAM 10Input: drivaerFastback, Small Mesh Size - Mesh TimeLinux 5.10.130Linux 5.15.83Linux 6.191827364538.5438.2438.361. (CXX) g++ options: -std=c++14 -m64 -O3 -ftemplate-depth-100 -fPIC -fuse-ld=bfd -Xlinker --add-needed --no-as-needed -ldynamicMesh -lgenericPatchFields -lOpenFOAM -ldl -lm

WebP Image Encode

Encode Settings: Quality 100

OpenBenchmarking.orgMP/s, More Is BetterWebP Image Encode 1.2.4Encode Settings: Quality 100Linux 5.10.130Linux 5.15.83Linux 6.13691215SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.01, N = 39.009.028.951. (CC) gcc options: -fvisibility=hidden -O2 -lm -pthread

OpenVINO

Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.2.devModel: Age Gender Recognition Retail 0013 FP16 - Device: CPULinux 5.10.130Linux 5.15.83Linux 6.13K6K9K12K15KSE +/- 110.56, N = 3SE +/- 108.60, N = 3SE +/- 96.54, N = 315259.8615258.5615144.321. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -flto -shared

spaCy

Model: en_core_web_lg

OpenBenchmarking.orgtokens/sec, More Is BetterspaCy 3.4.1Model: en_core_web_lgLinux 5.10.130Linux 5.15.83Linux 6.12K4K6K8K10KSE +/- 15.62, N = 3SE +/- 10.74, N = 3SE +/- 18.76, N = 3113141123611231

Cpuminer-Opt

Algorithm: Quad SHA-256, Pyrite

OpenBenchmarking.orgkH/s, More Is BetterCpuminer-Opt 3.20.3Algorithm: Quad SHA-256, PyriteLinux 5.10.130Linux 5.15.83Linux 6.150K100K150K200K250KSE +/- 820.33, N = 3SE +/- 6.67, N = 3SE +/- 258.61, N = 32188302184932172371. (CXX) g++ options: -O2 -lcurl -lz -lpthread -lssl -lcrypto -lgmp

oneDNN

Harness: Matrix Multiply Batch Shapes Transformer - Data Type: f32 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.7Harness: Matrix Multiply Batch Shapes Transformer - Data Type: f32 - Engine: CPULinux 5.10.130Linux 5.15.83Linux 6.10.21680.43360.65040.86721.084SE +/- 0.001517, N = 3SE +/- 0.003629, N = 3SE +/- 0.002932, N = 30.9563990.9616820.963400MIN: 0.93MIN: 0.93MIN: 0.931. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -lpthread -ldl

NCNN

Target: CPU-v2-v2 - Model: mobilenet-v2

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20220729Target: CPU-v2-v2 - Model: mobilenet-v2Linux 5.10.130Linux 5.15.83Linux 6.11.25332.50663.75995.01326.2665SE +/- 0.01, N = 3SE +/- 0.01, N = 6SE +/- 0.01, N = 35.565.535.57MIN: 5.44 / MAX: 6.03MIN: 5.41 / MAX: 10.99MIN: 5.49 / MAX: 6.181. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

OpenRadioss

Model: Rubber O-Ring Seal Installation

OpenBenchmarking.orgSeconds, Fewer Is BetterOpenRadioss 2022.10.13Model: Rubber O-Ring Seal InstallationLinux 5.10.130Linux 5.15.83Linux 6.14080120160200SE +/- 0.08, N = 3SE +/- 0.22, N = 3SE +/- 0.29, N = 3159.75159.15160.27

OpenRadioss

Model: INIVOL and Fluid Structure Interaction Drop Container

OpenBenchmarking.orgSeconds, Fewer Is BetterOpenRadioss 2022.10.13Model: INIVOL and Fluid Structure Interaction Drop ContainerLinux 5.10.130Linux 5.15.83Linux 6.1100200300400500SE +/- 0.39, N = 3SE +/- 0.43, N = 3SE +/- 0.46, N = 3443.72445.17446.66

WebP Image Encode

Encode Settings: Quality 100, Highest Compression

OpenBenchmarking.orgMP/s, More Is BetterWebP Image Encode 1.2.4Encode Settings: Quality 100, Highest CompressionLinux 5.10.130Linux 5.15.83Linux 6.10.69531.39062.08592.78123.4765SE +/- 0.02, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 33.073.093.081. (CC) gcc options: -fvisibility=hidden -O2 -lm -pthread

Y-Cruncher

Pi Digits To Calculate: 500M

OpenBenchmarking.orgSeconds, Fewer Is BetterY-Cruncher 0.7.10.9513Pi Digits To Calculate: 500MLinux 5.10.130Linux 5.15.83Linux 6.13691215SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 311.3511.3711.29

OpenVINO

Model: Person Detection FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.2.devModel: Person Detection FP16 - Device: CPULinux 5.10.130Linux 5.15.83Linux 6.15001000150020002500SE +/- 6.79, N = 3SE +/- 6.63, N = 3SE +/- 4.48, N = 32400.022401.742415.31MIN: 1971.05 / MAX: 2519.43MIN: 2074.14 / MAX: 2532.54MIN: 2186.01 / MAX: 2533.331. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -flto -shared

Cpuminer-Opt

Algorithm: Triple SHA-256, Onecoin

OpenBenchmarking.orgkH/s, More Is BetterCpuminer-Opt 3.20.3Algorithm: Triple SHA-256, OnecoinLinux 5.10.130Linux 5.15.83Linux 6.170K140K210K280K350KSE +/- 2642.36, N = 3SE +/- 661.12, N = 3SE +/- 2222.66, N = 33159133139173157231. (CXX) g++ options: -O2 -lcurl -lz -lpthread -lssl -lcrypto -lgmp

oneDNN

Harness: Recurrent Neural Network Inference - Data Type: u8s8f32 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.7Harness: Recurrent Neural Network Inference - Data Type: u8s8f32 - Engine: CPULinux 5.10.130Linux 5.15.83Linux 6.12004006008001000SE +/- 1.27, N = 3SE +/- 0.73, N = 3SE +/- 2.67, N = 3911.82908.19913.94MIN: 907.5MIN: 904.52MIN: 907.081. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -lpthread -ldl

Stress-NG

Test: CPU Stress

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.14.06Test: CPU StressLinux 5.10.130Linux 5.15.83Linux 6.17K14K21K28K35KSE +/- 248.24, N = 14SE +/- 3.47, N = 3SE +/- 27.28, N = 334273.5234238.7734059.431. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -laio -lapparmor -latomic -lbsd -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lrt -lsctp -lz -pthread

nekRS

Input: TurboPipe Periodic

OpenBenchmarking.orgFLOP/s, More Is BetternekRS 22.0Input: TurboPipe PeriodicLinux 5.10.130Linux 5.15.83Linux 6.115000M30000M45000M60000M75000MSE +/- 144216808.24, N = 3SE +/- 219477639.96, N = 3SE +/- 48731133.10, N = 37064976666770923633333704815000001. (CXX) g++ options: -fopenmp -O2 -march=native -mtune=native -ftree-vectorize -pthread -lmpi_cxx -lmpi

OpenVINO

Model: Person Detection FP32 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.2.devModel: Person Detection FP32 - Device: CPULinux 5.10.130Linux 5.15.83Linux 6.10.73131.46262.19392.92523.6565SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 33.253.253.231. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -flto -shared

Numenta Anomaly Benchmark

Detector: Windowed Gaussian

OpenBenchmarking.orgSeconds, Fewer Is BetterNumenta Anomaly Benchmark 1.1Detector: Windowed GaussianLinux 5.10.130Linux 5.15.83Linux 6.13691215SE +/- 0.038, N = 3SE +/- 0.045, N = 3SE +/- 0.037, N = 39.0709.0189.073

OpenVINO

Model: Person Detection FP32 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.2.devModel: Person Detection FP32 - Device: CPULinux 5.10.130Linux 5.15.83Linux 6.15001000150020002500SE +/- 6.93, N = 3SE +/- 9.26, N = 3SE +/- 5.75, N = 32436.302441.672451.10MIN: 2086.23 / MAX: 2572.2MIN: 2123.66 / MAX: 2621.99MIN: 2080.43 / MAX: 2583.811. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -flto -shared

NCNN

Target: CPU - Model: vision_transformer

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20220729Target: CPU - Model: vision_transformerLinux 5.10.130Linux 5.15.83Linux 6.14080120160200SE +/- 0.96, N = 3SE +/- 0.40, N = 6SE +/- 0.61, N = 3160.27161.23160.39MIN: 158.5 / MAX: 166.42MIN: 158.43 / MAX: 179.56MIN: 158.59 / MAX: 172.131. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

oneDNN

Harness: Convolution Batch Shapes Auto - Data Type: f32 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.7Harness: Convolution Batch Shapes Auto - Data Type: f32 - Engine: CPULinux 5.10.130Linux 5.15.83Linux 6.10.97021.94042.91063.88084.851SE +/- 0.00912, N = 3SE +/- 0.01348, N = 3SE +/- 0.00632, N = 34.291534.311784.28618MIN: 4.25MIN: 4.24MIN: 4.241. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -lpthread -ldl

OpenFOAM

Input: drivaerFastback, Medium Mesh Size - Mesh Time

OpenBenchmarking.orgSeconds, Fewer Is BetterOpenFOAM 10Input: drivaerFastback, Medium Mesh Size - Mesh TimeLinux 5.10.130Linux 5.15.83Linux 6.150100150200250241.49242.25242.921. (CXX) g++ options: -std=c++14 -m64 -O3 -ftemplate-depth-100 -fPIC -fuse-ld=bfd -Xlinker --add-needed --no-as-needed -ldynamicMesh -lgenericPatchFields -lOpenFOAM -ldl -lm

Cpuminer-Opt

Algorithm: Skeincoin

OpenBenchmarking.orgkH/s, More Is BetterCpuminer-Opt 3.20.3Algorithm: SkeincoinLinux 5.10.130Linux 5.15.83Linux 6.130K60K90K120K150KSE +/- 169.54, N = 3SE +/- 3.33, N = 3SE +/- 283.78, N = 31351031348331343201. (CXX) g++ options: -O2 -lcurl -lz -lpthread -lssl -lcrypto -lgmp

TensorFlow

Device: CPU - Batch Size: 64 - Model: GoogLeNet

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.10Device: CPU - Batch Size: 64 - Model: GoogLeNetLinux 5.10.130Linux 5.15.83Linux 6.1306090120150SE +/- 0.05, N = 3SE +/- 0.14, N = 3SE +/- 0.18, N = 3125.79126.29126.49

Cpuminer-Opt

Algorithm: Deepcoin

OpenBenchmarking.orgkH/s, More Is BetterCpuminer-Opt 3.20.3Algorithm: DeepcoinLinux 5.10.130Linux 5.15.83Linux 6.13K6K9K12K15KSE +/- 46.67, N = 3SE +/- 50.00, N = 31449714500144201. (CXX) g++ options: -O2 -lcurl -lz -lpthread -lssl -lcrypto -lgmp

Stress-NG

Test: Glibc C String Functions

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.14.06Test: Glibc C String FunctionsLinux 5.10.130Linux 5.15.83Linux 6.1200K400K600K800K1000KSE +/- 6508.49, N = 3SE +/- 3709.52, N = 3SE +/- 8664.27, N = 3911917.94916397.13916843.521. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -laio -lapparmor -latomic -lbsd -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lrt -lsctp -lz -pthread

Timed CPython Compilation

Build Configuration: Released Build, PGO + LTO Optimized

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed CPython Compilation 3.10.6Build Configuration: Released Build, PGO + LTO OptimizedLinux 5.10.130Linux 5.15.83Linux 6.180160240320400383.51383.96385.50

Blender

Blend File: Classroom - Compute: CPU-Only

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 3.4Blend File: Classroom - Compute: CPU-OnlyLinux 5.10.130Linux 5.15.83Linux 6.170140210280350SE +/- 0.37, N = 3SE +/- 0.22, N = 3SE +/- 0.49, N = 3318.28317.07318.71

oneDNN

Harness: IP Shapes 3D - Data Type: f32 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.7Harness: IP Shapes 3D - Data Type: f32 - Engine: CPULinux 5.10.130Linux 5.15.83Linux 6.10.69781.39562.09342.79123.489SE +/- 0.00480, N = 3SE +/- 0.01196, N = 3SE +/- 0.00478, N = 33.101443.085613.09433MIN: 3.06MIN: 3.05MIN: 3.061. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -lpthread -ldl

oneDNN

Harness: Deconvolution Batch shapes_3d - Data Type: f32 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.7Harness: Deconvolution Batch shapes_3d - Data Type: f32 - Engine: CPULinux 5.10.130Linux 5.15.83Linux 6.10.74531.49062.23592.98123.7265SE +/- 0.00465, N = 3SE +/- 0.00438, N = 3SE +/- 0.00768, N = 33.306063.296333.31244MIN: 3.27MIN: 3.27MIN: 3.261. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -lpthread -ldl

srsRAN

Test: 4G PHY_DL_Test 100 PRB SISO 64-QAM

OpenBenchmarking.orgUE Mb/s, More Is BettersrsRAN 22.04.1Test: 4G PHY_DL_Test 100 PRB SISO 64-QAMLinux 5.10.130Linux 5.15.83Linux 6.1306090120150SE +/- 0.03, N = 3SE +/- 0.06, N = 3SE +/- 0.15, N = 3123.3123.9123.31. (CXX) g++ options: -std=c++14 -fno-strict-aliasing -march=native -mfpmath=sse -mavx2 -fvisibility=hidden -O3 -fno-trapping-math -fno-math-errno -mavx512f -mavx512cd -mavx512bw -mavx512dq -lpthread -ldl -lm

LAMMPS Molecular Dynamics Simulator

Model: Rhodopsin Protein

OpenBenchmarking.orgns/day, More Is BetterLAMMPS Molecular Dynamics Simulator 23Jun2022Model: Rhodopsin ProteinLinux 5.10.130Linux 5.15.83Linux 6.13691215SE +/- 0.02, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 310.6610.6410.611. (CXX) g++ options: -O3 -pthread -lm -ldl

SVT-AV1

Encoder Mode: Preset 8 - Input: Bosphorus 1080p

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.4Encoder Mode: Preset 8 - Input: Bosphorus 1080pLinux 5.10.130Linux 5.15.83Linux 6.120406080100SE +/- 0.40, N = 3SE +/- 0.30, N = 3SE +/- 0.46, N = 395.4995.0495.151. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

Cpuminer-Opt

Algorithm: x25x

OpenBenchmarking.orgkH/s, More Is BetterCpuminer-Opt 3.20.3Algorithm: x25xLinux 5.10.130Linux 5.15.83Linux 6.1140280420560700SE +/- 0.20, N = 3SE +/- 1.51, N = 3SE +/- 0.34, N = 3640.06641.61638.641. (CXX) g++ options: -O2 -lcurl -lz -lpthread -lssl -lcrypto -lgmp

Y-Cruncher

Pi Digits To Calculate: 1B

OpenBenchmarking.orgSeconds, Fewer Is BetterY-Cruncher 0.7.10.9513Pi Digits To Calculate: 1BLinux 5.10.130Linux 5.15.83Linux 6.1612182430SE +/- 0.02, N = 3SE +/- 0.03, N = 3SE +/- 0.02, N = 324.4524.5624.46

TensorFlow

Device: CPU - Batch Size: 32 - Model: ResNet-50

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.10Device: CPU - Batch Size: 32 - Model: ResNet-50Linux 5.10.130Linux 5.15.83Linux 6.1918273645SE +/- 0.02, N = 3SE +/- 0.04, N = 3SE +/- 0.03, N = 340.2340.4140.32

Neural Magic DeepSparse

Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Synchronous Single-StreamLinux 5.10.130Linux 5.15.83Linux 6.120406080100SE +/- 0.59, N = 3SE +/- 0.31, N = 3SE +/- 0.22, N = 3104.00104.04103.58

Neural Magic DeepSparse

Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Synchronous Single-StreamLinux 5.10.130Linux 5.15.83Linux 6.13691215SE +/- 0.0549, N = 3SE +/- 0.0282, N = 3SE +/- 0.0209, N = 39.61539.61119.6532

oneDNN

Harness: Recurrent Neural Network Training - Data Type: u8s8f32 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.7Harness: Recurrent Neural Network Training - Data Type: u8s8f32 - Engine: CPULinux 5.10.130Linux 5.15.83Linux 6.130060090012001500SE +/- 2.14, N = 3SE +/- 3.87, N = 3SE +/- 1.70, N = 31621.841614.871618.86MIN: 1617.11MIN: 1607.67MIN: 1614.31. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -lpthread -ldl

Cpuminer-Opt

Algorithm: scrypt

OpenBenchmarking.orgkH/s, More Is BetterCpuminer-Opt 3.20.3Algorithm: scryptLinux 5.10.130Linux 5.15.83Linux 6.1110220330440550SE +/- 3.92, N = 3SE +/- 5.31, N = 3SE +/- 2.46, N = 3491.90489.83491.851. (CXX) g++ options: -O2 -lcurl -lz -lpthread -lssl -lcrypto -lgmp

Xmrig

Variant: Wownero - Hash Count: 1M

OpenBenchmarking.orgH/s, More Is BetterXmrig 6.18.1Variant: Wownero - Hash Count: 1MLinux 5.10.130Linux 5.15.83Linux 6.12K4K6K8K10KSE +/- 67.20, N = 3SE +/- 34.41, N = 3SE +/- 49.24, N = 39492.29531.39527.71. (CXX) g++ options: -fexceptions -fno-rtti -maes -O3 -Ofast -static-libgcc -static-libstdc++ -rdynamic -lssl -lcrypto -luv -lpthread -lrt -ldl -lhwloc

Cpuminer-Opt

Algorithm: Magi

OpenBenchmarking.orgkH/s, More Is BetterCpuminer-Opt 3.20.3Algorithm: MagiLinux 5.10.130Linux 5.15.83Linux 6.180160240320400SE +/- 4.81, N = 3SE +/- 4.11, N = 3SE +/- 4.81, N = 3374.94373.55373.451. (CXX) g++ options: -O2 -lcurl -lz -lpthread -lssl -lcrypto -lgmp

TensorFlow

Device: CPU - Batch Size: 64 - Model: AlexNet

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.10Device: CPU - Batch Size: 64 - Model: AlexNetLinux 5.10.130Linux 5.15.83Linux 6.150100150200250SE +/- 0.06, N = 3SE +/- 0.39, N = 3SE +/- 0.27, N = 3243.30242.73242.34

TensorFlow

Device: CPU - Batch Size: 64 - Model: ResNet-50

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.10Device: CPU - Batch Size: 64 - Model: ResNet-50Linux 5.10.130Linux 5.15.83Linux 6.11020304050SE +/- 0.02, N = 3SE +/- 0.02, N = 3SE +/- 0.05, N = 341.9042.0542.06

Neural Magic DeepSparse

Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-StreamLinux 5.10.130Linux 5.15.83Linux 6.120406080100SE +/- 0.05, N = 3SE +/- 0.53, N = 3SE +/- 0.47, N = 3108.55108.34108.74

Neural Magic DeepSparse

Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-StreamLinux 5.10.130Linux 5.15.83Linux 6.11632486480SE +/- 0.04, N = 3SE +/- 0.36, N = 3SE +/- 0.32, N = 373.6873.8273.55

Facebook RocksDB

Test: Random Read

OpenBenchmarking.orgOp/s, More Is BetterFacebook RocksDB 7.5.3Test: Random ReadLinux 5.10.130Linux 5.15.83Linux 6.114M28M42M56M70MSE +/- 547664.44, N = 3SE +/- 139131.71, N = 3SE +/- 360247.64, N = 36509423965233649653371751. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti -lpthread

OpenVINO

Model: Face Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.2.devModel: Face Detection FP16-INT8 - Device: CPULinux 5.10.130Linux 5.15.83Linux 6.190180270360450SE +/- 0.17, N = 3SE +/- 0.53, N = 3SE +/- 0.59, N = 3417.71416.95416.16MIN: 260.74 / MAX: 433.77MIN: 240.72 / MAX: 434.4MIN: 211.14 / MAX: 443.451. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -flto -shared

NCNN

Target: CPU - Model: alexnet

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20220729Target: CPU - Model: alexnetLinux 5.10.130Linux 5.15.83Linux 6.11.2332.4663.6994.9326.165SE +/- 0.01, N = 3SE +/- 0.08, N = 6SE +/- 0.01, N = 35.465.485.46MIN: 5.35 / MAX: 5.85MIN: 5.3 / MAX: 6.07MIN: 5.35 / MAX: 9.831. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

TensorFlow

Device: CPU - Batch Size: 16 - Model: AlexNet

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.10Device: CPU - Batch Size: 16 - Model: AlexNetLinux 5.10.130Linux 5.15.83Linux 6.14080120160200SE +/- 0.44, N = 3SE +/- 0.13, N = 3SE +/- 0.22, N = 3166.55166.90166.31

7-Zip Compression

Test: Decompression Rating

OpenBenchmarking.orgMIPS, More Is Better7-Zip Compression 22.01Test: Decompression RatingLinux 5.10.130Linux 5.15.83Linux 6.120K40K60K80K100KSE +/- 259.98, N = 3SE +/- 150.80, N = 3SE +/- 264.89, N = 38643286735866801. (CXX) g++ options: -lpthread -ldl -O2 -fPIC

Cpuminer-Opt

Algorithm: Garlicoin

OpenBenchmarking.orgkH/s, More Is BetterCpuminer-Opt 3.20.3Algorithm: GarlicoinLinux 5.10.130Linux 5.15.83Linux 6.114002800420056007000SE +/- 2.21, N = 3SE +/- 11.67, N = 3SE +/- 2.16, N = 36572.816594.186571.661. (CXX) g++ options: -O2 -lcurl -lz -lpthread -lssl -lcrypto -lgmp

Neural Magic DeepSparse

Model: CV Detection,YOLOv5s COCO - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: CV Detection,YOLOv5s COCO - Scenario: Asynchronous Multi-StreamLinux 5.10.130Linux 5.15.83Linux 6.120406080100SE +/- 0.12, N = 3SE +/- 0.08, N = 3SE +/- 0.04, N = 386.6686.9486.88

oneDNN

Harness: Recurrent Neural Network Inference - Data Type: f32 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.7Harness: Recurrent Neural Network Inference - Data Type: f32 - Engine: CPULinux 5.10.130Linux 5.15.83Linux 6.12004006008001000SE +/- 2.14, N = 3SE +/- 1.01, N = 3SE +/- 1.41, N = 3909.63912.07909.15MIN: 903.56MIN: 908.55MIN: 904.931. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -lpthread -ldl

oneDNN

Harness: IP Shapes 3D - Data Type: u8s8f32 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.7Harness: IP Shapes 3D - Data Type: u8s8f32 - Engine: CPULinux 5.10.130Linux 5.15.83Linux 6.10.28190.56380.84571.12761.4095SE +/- 0.00257, N = 3SE +/- 0.00241, N = 3SE +/- 0.00376, N = 31.252711.251741.24871MIN: 1.22MIN: 1.22MIN: 1.211. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -lpthread -ldl

OpenVINO

Model: Face Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.2.devModel: Face Detection FP16-INT8 - Device: CPULinux 5.10.130Linux 5.15.83Linux 6.1510152025SE +/- 0.00, N = 3SE +/- 0.02, N = 3SE +/- 0.03, N = 319.1119.1519.171. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -flto -shared

Blender

Blend File: BMW27 - Compute: CPU-Only

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 3.4Blend File: BMW27 - Compute: CPU-OnlyLinux 5.10.130Linux 5.15.83Linux 6.120406080100SE +/- 0.08, N = 3SE +/- 0.06, N = 3SE +/- 0.02, N = 3106.13106.38106.46

srsRAN

Test: 5G PHY_DL_NR Test 52 PRB SISO 64-QAM

OpenBenchmarking.orgeNb Mb/s, More Is BettersrsRAN 22.04.1Test: 5G PHY_DL_NR Test 52 PRB SISO 64-QAMLinux 5.10.130Linux 5.15.83Linux 6.120406080100SE +/- 0.35, N = 3SE +/- 0.10, N = 3SE +/- 0.15, N = 398.698.698.31. (CXX) g++ options: -std=c++14 -fno-strict-aliasing -march=native -mfpmath=sse -mavx2 -fvisibility=hidden -O3 -fno-trapping-math -fno-math-errno -mavx512f -mavx512cd -mavx512bw -mavx512dq -lpthread -ldl -lm

Neural Magic DeepSparse

Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-StreamLinux 5.10.130Linux 5.15.83Linux 6.150100150200250SE +/- 0.10, N = 3SE +/- 0.45, N = 3SE +/- 0.45, N = 3219.36219.01218.69

Neural Magic DeepSparse

Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-StreamLinux 5.10.130Linux 5.15.83Linux 6.1306090120150SE +/- 0.43, N = 3SE +/- 0.31, N = 3SE +/- 0.38, N = 3144.24143.81144.21

Neural Magic DeepSparse

Model: CV Detection,YOLOv5s COCO - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: CV Detection,YOLOv5s COCO - Scenario: Synchronous Single-StreamLinux 5.10.130Linux 5.15.83Linux 6.13691215SE +/- 0.00, N = 3SE +/- 0.02, N = 3SE +/- 0.02, N = 313.2713.3113.27

TensorFlow

Device: CPU - Batch Size: 256 - Model: ResNet-50

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.10Device: CPU - Batch Size: 256 - Model: ResNet-50Linux 5.10.130Linux 5.15.83Linux 6.11020304050SE +/- 0.02, N = 3SE +/- 0.02, N = 3SE +/- 0.03, N = 343.5043.4143.37

Stress-NG

Test: Glibc Qsort Data Sorting

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.14.06Test: Glibc Qsort Data SortingLinux 5.10.130Linux 5.15.83Linux 6.14080120160200SE +/- 1.58, N = 3SE +/- 1.18, N = 3SE +/- 1.25, N = 3194.36194.88194.301. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -laio -lapparmor -latomic -lbsd -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lrt -lsctp -lz -pthread

Neural Magic DeepSparse

Model: CV Detection,YOLOv5s COCO - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: CV Detection,YOLOv5s COCO - Scenario: Synchronous Single-StreamLinux 5.10.130Linux 5.15.83Linux 6.120406080100SE +/- 0.01, N = 3SE +/- 0.14, N = 3SE +/- 0.10, N = 375.2675.0475.26

Neural Magic DeepSparse

Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-StreamLinux 5.10.130Linux 5.15.83Linux 6.11224364860SE +/- 0.15, N = 3SE +/- 0.12, N = 3SE +/- 0.16, N = 355.4255.5855.44

Numenta Anomaly Benchmark

Detector: Contextual Anomaly Detector OSE

OpenBenchmarking.orgSeconds, Fewer Is BetterNumenta Anomaly Benchmark 1.1Detector: Contextual Anomaly Detector OSELinux 5.10.130Linux 5.15.83Linux 6.11326395265SE +/- 0.29, N = 3SE +/- 0.25, N = 3SE +/- 0.15, N = 355.7355.6655.82

Neural Magic DeepSparse

Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-StreamLinux 5.10.130Linux 5.15.83Linux 6.1816243240SE +/- 0.02, N = 3SE +/- 0.07, N = 3SE +/- 0.08, N = 336.4436.5036.54

LAMMPS Molecular Dynamics Simulator

Model: 20k Atoms

OpenBenchmarking.orgns/day, More Is BetterLAMMPS Molecular Dynamics Simulator 23Jun2022Model: 20k AtomsLinux 5.10.130Linux 5.15.83Linux 6.13691215SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.02, N = 310.4310.4110.401. (CXX) g++ options: -O3 -pthread -lm -ldl

Neural Magic DeepSparse

Model: CV Detection,YOLOv5s COCO - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: CV Detection,YOLOv5s COCO - Scenario: Asynchronous Multi-StreamLinux 5.10.130Linux 5.15.83Linux 6.120406080100SE +/- 0.08, N = 3SE +/- 0.09, N = 3SE +/- 0.04, N = 392.2191.9992.05

OSPRay Studio

Camera: 1 - Resolution: 1080p - Samples Per Pixel: 16 - Renderer: Path Tracer

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.11Camera: 1 - Resolution: 1080p - Samples Per Pixel: 16 - Renderer: Path TracerLinux 5.10.130Linux 5.15.83Linux 6.16K12K18K24K30KSE +/- 8.11, N = 3SE +/- 21.40, N = 3SE +/- 9.70, N = 32840928417284791. (CXX) g++ options: -O3 -lm -ldl -lpthread -pthread

OSPRay Studio

Camera: 3 - Resolution: 1080p - Samples Per Pixel: 1 - Renderer: Path Tracer

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.11Camera: 3 - Resolution: 1080p - Samples Per Pixel: 1 - Renderer: Path TracerLinux 5.10.130Linux 5.15.83Linux 6.15001000150020002500SE +/- 0.67, N = 3SE +/- 0.58, N = 32178217621731. (CXX) g++ options: -O3 -lm -ldl -lpthread -pthread

libavif avifenc

Encoder Speed: 0

OpenBenchmarking.orgSeconds, Fewer Is Betterlibavif avifenc 0.11Encoder Speed: 0Linux 5.10.130Linux 5.15.83Linux 6.1306090120150SE +/- 0.40, N = 3SE +/- 0.50, N = 3SE +/- 0.17, N = 3145.01144.71145.041. (CXX) g++ options: -O3 -fPIC -lm

OSPRay Studio

Camera: 3 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path Tracer

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.11Camera: 3 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path TracerLinux 5.10.130Linux 5.15.83Linux 6.160K120K180K240K300KSE +/- 239.39, N = 3SE +/- 192.14, N = 3SE +/- 92.98, N = 32846992848532842351. (CXX) g++ options: -O3 -lm -ldl -lpthread -pthread

TensorFlow

Device: CPU - Batch Size: 256 - Model: AlexNet

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.10Device: CPU - Batch Size: 256 - Model: AlexNetLinux 5.10.130Linux 5.15.83Linux 6.160120180240300SE +/- 0.53, N = 3SE +/- 0.66, N = 3SE +/- 0.40, N = 3278.63279.05279.22

OpenRadioss

Model: Bird Strike on Windshield

OpenBenchmarking.orgSeconds, Fewer Is BetterOpenRadioss 2022.10.13Model: Bird Strike on WindshieldLinux 5.10.130Linux 5.15.83Linux 6.160120180240300SE +/- 0.38, N = 3SE +/- 0.19, N = 3SE +/- 0.19, N = 3256.43256.19255.89

WebP Image Encode

Encode Settings: Default

OpenBenchmarking.orgMP/s, More Is BetterWebP Image Encode 1.2.4Encode Settings: DefaultLinux 5.10.130Linux 5.15.83Linux 6.148121620SE +/- 0.01, N = 3SE +/- 0.00, N = 3SE +/- 0.01, N = 314.3714.4014.381. (CC) gcc options: -fvisibility=hidden -O2 -lm -pthread

OSPRay Studio

Camera: 2 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path Tracer

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.11Camera: 2 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path TracerLinux 5.10.130Linux 5.15.83Linux 6.150K100K150K200K250KSE +/- 103.12, N = 3SE +/- 62.00, N = 3SE +/- 131.54, N = 32399352403112404301. (CXX) g++ options: -O3 -lm -ldl -lpthread -pthread

TensorFlow

Device: CPU - Batch Size: 256 - Model: GoogLeNet

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.10Device: CPU - Batch Size: 256 - Model: GoogLeNetLinux 5.10.130Linux 5.15.83Linux 6.1306090120150SE +/- 0.03, N = 3SE +/- 0.05, N = 3SE +/- 0.03, N = 3130.21130.40130.47

Facebook RocksDB

Test: Read Random Write Random

OpenBenchmarking.orgOp/s, More Is BetterFacebook RocksDB 7.5.3Test: Read Random Write RandomLinux 5.10.130Linux 5.15.83Linux 6.1500K1000K1500K2000K2500KSE +/- 16550.67, N = 3SE +/- 8919.50, N = 3SE +/- 10651.17, N = 32132608212935921335281. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti -lpthread

TensorFlow

Device: CPU - Batch Size: 32 - Model: AlexNet

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.10Device: CPU - Batch Size: 32 - Model: AlexNetLinux 5.10.130Linux 5.15.83Linux 6.150100150200250SE +/- 0.47, N = 3SE +/- 0.13, N = 3SE +/- 0.28, N = 3211.25211.47211.06

Primesieve

Length: 1e13

OpenBenchmarking.orgSeconds, Fewer Is BetterPrimesieve 8.0Length: 1e13Linux 5.10.130Linux 5.15.83Linux 6.14080120160200SE +/- 0.36, N = 3SE +/- 0.38, N = 3SE +/- 0.47, N = 3174.72174.66174.981. (CXX) g++ options: -O3 -lpthread

oneDNN

Harness: Recurrent Neural Network Training - Data Type: f32 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.7Harness: Recurrent Neural Network Training - Data Type: f32 - Engine: CPULinux 5.10.130Linux 5.15.83Linux 6.130060090012001500SE +/- 0.83, N = 3SE +/- 0.39, N = 3SE +/- 0.44, N = 31613.121611.141614.07MIN: 1608.28MIN: 1608.25MIN: 1609.861. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -lpthread -ldl

oneDNN

Harness: Deconvolution Batch shapes_1d - Data Type: u8s8f32 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.7Harness: Deconvolution Batch shapes_1d - Data Type: u8s8f32 - Engine: CPULinux 5.10.130Linux 5.15.83Linux 6.10.12180.24360.36540.48720.609SE +/- 0.000704, N = 3SE +/- 0.000263, N = 3SE +/- 0.000200, N = 30.5406540.5404520.541430MIN: 0.53MIN: 0.53MIN: 0.531. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -lpthread -ldl

ASTC Encoder

Preset: Thorough

OpenBenchmarking.orgMT/s, More Is BetterASTC Encoder 4.0Preset: ThoroughLinux 5.10.130Linux 5.15.83Linux 6.13691215SE +/- 0.0023, N = 3SE +/- 0.0055, N = 3SE +/- 0.0088, N = 39.32259.32679.31031. (CXX) g++ options: -O3 -flto -pthread

OpenVINO

Model: Face Detection FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.2.devModel: Face Detection FP16 - Device: CPULinux 5.10.130Linux 5.15.83Linux 6.11.32532.65063.97595.30126.6265SE +/- 0.03, N = 3SE +/- 0.03, N = 3SE +/- 0.02, N = 35.885.885.891. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -flto -shared

Blender

Blend File: Pabellon Barcelona - Compute: CPU-Only

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 3.4Blend File: Pabellon Barcelona - Compute: CPU-OnlyLinux 5.10.130Linux 5.15.83Linux 6.180160240320400SE +/- 0.42, N = 3SE +/- 0.29, N = 3SE +/- 0.42, N = 3373.74373.54374.17

srsRAN

Test: 5G PHY_DL_NR Test 52 PRB SISO 64-QAM

OpenBenchmarking.orgUE Mb/s, More Is BettersrsRAN 22.04.1Test: 5G PHY_DL_NR Test 52 PRB SISO 64-QAMLinux 5.10.130Linux 5.15.83Linux 6.11530456075SE +/- 0.07, N = 3SE +/- 0.15, N = 3SE +/- 0.06, N = 365.966.065.91. (CXX) g++ options: -std=c++14 -fno-strict-aliasing -march=native -mfpmath=sse -mavx2 -fvisibility=hidden -O3 -fno-trapping-math -fno-math-errno -mavx512f -mavx512cd -mavx512bw -mavx512dq -lpthread -ldl -lm

oneDNN

Harness: IP Shapes 1D - Data Type: f32 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.7Harness: IP Shapes 1D - Data Type: f32 - Engine: CPULinux 5.10.130Linux 5.15.83Linux 6.10.51681.03361.55042.06722.584SE +/- 0.00305, N = 3SE +/- 0.00109, N = 3SE +/- 0.00145, N = 32.296362.293852.29708MIN: 2.22MIN: 2.19MIN: 2.221. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -lpthread -ldl

OSPRay Studio

Camera: 2 - Resolution: 1080p - Samples Per Pixel: 16 - Renderer: Path Tracer

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.11Camera: 2 - Resolution: 1080p - Samples Per Pixel: 16 - Renderer: Path TracerLinux 5.10.130Linux 5.15.83Linux 6.16K12K18K24K30KSE +/- 28.26, N = 3SE +/- 5.24, N = 32917229206291651. (CXX) g++ options: -O3 -lm -ldl -lpthread -pthread

Primesieve

Length: 1e12

OpenBenchmarking.orgSeconds, Fewer Is BetterPrimesieve 8.0Length: 1e12Linux 5.10.130Linux 5.15.83Linux 6.148121620SE +/- 0.01, N = 3SE +/- 0.05, N = 3SE +/- 0.03, N = 314.4414.4314.421. (CXX) g++ options: -O3 -lpthread

oneDNN

Harness: IP Shapes 1D - Data Type: u8s8f32 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.7Harness: IP Shapes 1D - Data Type: u8s8f32 - Engine: CPULinux 5.10.130Linux 5.15.83Linux 6.10.11190.22380.33570.44760.5595SE +/- 0.000232, N = 3SE +/- 0.000206, N = 3SE +/- 0.000335, N = 30.4966130.4972480.496776MIN: 0.48MIN: 0.48MIN: 0.481. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -lpthread -ldl

OSPRay Studio

Camera: 1 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path Tracer

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.11Camera: 1 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path TracerLinux 5.10.130Linux 5.15.83Linux 6.115003000450060007500SE +/- 10.90, N = 3SE +/- 1.45, N = 37055704670481. (CXX) g++ options: -O3 -lm -ldl -lpthread -pthread

Stress-NG

Test: Vector Math

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.14.06Test: Vector MathLinux 5.10.130Linux 5.15.83Linux 6.112K24K36K48K60KSE +/- 337.57, N = 3SE +/- 330.15, N = 3SE +/- 321.30, N = 355351.5855415.0155344.321. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -laio -lapparmor -latomic -lbsd -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lrt -lsctp -lz -pthread

OpenVINO

Model: Weld Porosity Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.2.devModel: Weld Porosity Detection FP16-INT8 - Device: CPULinux 5.10.130Linux 5.15.83Linux 6.1246810SE +/- 0.01, N = 3SE +/- 0.00, N = 3SE +/- 0.01, N = 38.028.018.02MIN: 4.07 / MAX: 22.04MIN: 5.89 / MAX: 26.32MIN: 6 / MAX: 25.191. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -flto -shared

OSPRay Studio

Camera: 2 - Resolution: 1080p - Samples Per Pixel: 1 - Renderer: Path Tracer

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.11Camera: 2 - Resolution: 1080p - Samples Per Pixel: 1 - Renderer: Path TracerLinux 5.10.130Linux 5.15.83Linux 6.1400800120016002000SE +/- 1.15, N = 3SE +/- 0.67, N = 3SE +/- 1.00, N = 31826182618241. (CXX) g++ options: -O3 -lm -ldl -lpthread -pthread

OpenRadioss

Model: Cell Phone Drop Test

OpenBenchmarking.orgSeconds, Fewer Is BetterOpenRadioss 2022.10.13Model: Cell Phone Drop TestLinux 5.10.130Linux 5.15.83Linux 6.120406080100SE +/- 0.20, N = 3SE +/- 0.10, N = 3SE +/- 0.06, N = 396.2196.3196.30

OSPRay Studio

Camera: 1 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path Tracer

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.11Camera: 1 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path TracerLinux 5.10.130Linux 5.15.83Linux 6.150K100K150K200K250KSE +/- 254.40, N = 3SE +/- 19.15, N = 3SE +/- 262.34, N = 32342162341422343711. (CXX) g++ options: -O3 -lm -ldl -lpthread -pthread

Blender

Blend File: Barbershop - Compute: CPU-Only

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 3.4Blend File: Barbershop - Compute: CPU-OnlyLinux 5.10.130Linux 5.15.83Linux 6.12004006008001000SE +/- 0.49, N = 3SE +/- 0.12, N = 3SE +/- 0.42, N = 31145.901144.821145.18

OpenVINO

Model: Weld Porosity Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.2.devModel: Weld Porosity Detection FP16-INT8 - Device: CPULinux 5.10.130Linux 5.15.83Linux 6.1400800120016002000SE +/- 1.36, N = 3SE +/- 0.98, N = 3SE +/- 1.06, N = 31991.751993.581992.231. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -flto -shared

ASTC Encoder

Preset: Medium

OpenBenchmarking.orgMT/s, More Is BetterASTC Encoder 4.0Preset: MediumLinux 5.10.130Linux 5.15.83Linux 6.11632486480SE +/- 0.01, N = 3SE +/- 0.04, N = 3SE +/- 0.02, N = 372.1672.1272.101. (CXX) g++ options: -O3 -flto -pthread

OSPRay Studio

Camera: 3 - Resolution: 4K - Samples Per Pixel: 16 - Renderer: Path Tracer

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.11Camera: 3 - Resolution: 4K - Samples Per Pixel: 16 - Renderer: Path TracerLinux 5.10.130Linux 5.15.83Linux 6.130K60K90K120K150KSE +/- 58.33, N = 3SE +/- 69.67, N = 3SE +/- 27.67, N = 31465831465701466921. (CXX) g++ options: -O3 -lm -ldl -lpthread -pthread

Stress-NG

Test: Crypto

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.14.06Test: CryptoLinux 5.10.130Linux 5.15.83Linux 6.14K8K12K16K20KSE +/- 47.41, N = 3SE +/- 83.58, N = 3SE +/- 66.53, N = 318742.6718733.1018727.611. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -laio -lapparmor -latomic -lbsd -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lrt -lsctp -lz -pthread

OpenVINO

Model: Face Detection FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.2.devModel: Face Detection FP16 - Device: CPULinux 5.10.130Linux 5.15.83Linux 6.130060090012001500SE +/- 7.68, N = 3SE +/- 8.21, N = 3SE +/- 5.43, N = 31357.371356.351357.10MIN: 1303.04 / MAX: 1429.1MIN: 1238.64 / MAX: 1424.43MIN: 1311.47 / MAX: 1435.451. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -flto -shared

ASTC Encoder

Preset: Exhaustive

OpenBenchmarking.orgMT/s, More Is BetterASTC Encoder 4.0Preset: ExhaustiveLinux 5.10.130Linux 5.15.83Linux 6.10.21090.42180.63270.84361.0545SE +/- 0.0001, N = 3SE +/- 0.0001, N = 3SE +/- 0.0006, N = 30.93710.93750.93681. (CXX) g++ options: -O3 -flto -pthread

ASTC Encoder

Preset: Fast

OpenBenchmarking.orgMT/s, More Is BetterASTC Encoder 4.0Preset: FastLinux 5.10.130Linux 5.15.83Linux 6.14080120160200SE +/- 0.04, N = 3SE +/- 0.05, N = 3SE +/- 0.03, N = 3193.13193.02192.991. (CXX) g++ options: -O3 -flto -pthread

Stress-NG

Test: Matrix Math

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.14.06Test: Matrix MathLinux 5.10.130Linux 5.15.83Linux 6.112K24K36K48K60KSE +/- 476.25, N = 3SE +/- 503.37, N = 3SE +/- 647.24, N = 355915.3655890.2355875.181. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -laio -lapparmor -latomic -lbsd -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lrt -lsctp -lz -pthread

OSPRay Studio

Camera: 3 - Resolution: 1080p - Samples Per Pixel: 16 - Renderer: Path Tracer

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.11Camera: 3 - Resolution: 1080p - Samples Per Pixel: 16 - Renderer: Path TracerLinux 5.10.130Linux 5.15.83Linux 6.17K14K21K28K35KSE +/- 21.06, N = 3SE +/- 4.51, N = 3SE +/- 5.29, N = 33478634801347791. (CXX) g++ options: -O3 -lm -ldl -lpthread -pthread

Blender

Blend File: Fishy Cat - Compute: CPU-Only

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 3.4Blend File: Fishy Cat - Compute: CPU-OnlyLinux 5.10.130Linux 5.15.83Linux 6.1306090120150SE +/- 0.12, N = 3SE +/- 0.30, N = 3SE +/- 0.09, N = 3144.25144.34144.29

OSPRay Studio

Camera: 3 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path Tracer

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.11Camera: 3 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path TracerLinux 5.10.130Linux 5.15.83Linux 6.12K4K6K8K10KSE +/- 5.51, N = 3SE +/- 9.45, N = 38633862886331. (CXX) g++ options: -O3 -lm -ldl -lpthread -pthread

OSPRay Studio

Camera: 1 - Resolution: 1080p - Samples Per Pixel: 1 - Renderer: Path Tracer

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.11Camera: 1 - Resolution: 1080p - Samples Per Pixel: 1 - Renderer: Path TracerLinux 5.10.130Linux 5.15.83Linux 6.1400800120016002000SE +/- 0.67, N = 3SE +/- 1.33, N = 3SE +/- 0.58, N = 31778177817791. (CXX) g++ options: -O3 -lm -ldl -lpthread -pthread

OSPRay Studio

Camera: 2 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path Tracer

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.11Camera: 2 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path TracerLinux 5.10.130Linux 5.15.83Linux 6.116003200480064008000SE +/- 2.33, N = 3SE +/- 3.79, N = 3SE +/- 2.52, N = 37242724672451. (CXX) g++ options: -O3 -lm -ldl -lpthread -pthread

Stress-NG

Test: x86_64 RdRand

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.14.06Test: x86_64 RdRandLinux 5.10.130Linux 5.15.83Linux 6.150K100K150K200K250KSE +/- 0.71, N = 3SE +/- 1.57, N = 3SE +/- 12.63, N = 3252390.56252393.88252372.291. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -laio -lapparmor -latomic -lbsd -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lrt -lsctp -lz -pthread

Aircrack-ng

OpenBenchmarking.orgk/s, More Is BetterAircrack-ng 1.7Linux 5.10.130Linux 5.15.83Linux 6.111K22K33K44K55KSE +/- 129.98, N = 3SE +/- 118.77, N = 3SE +/- 144.43, N = 350605.5650607.7450609.281. (CXX) g++ options: -std=gnu++17 -O3 -fvisibility=hidden -fcommon -rdynamic -lnl-3 -lnl-genl-3 -lpcre -lpthread -lz -lssl -lcrypto -lhwloc -ldl -lm -lbsd -pthread

Natron

Input: Spaceship

OpenBenchmarking.orgFPS, More Is BetterNatron 2.4.3Input: SpaceshipLinux 5.10.130Linux 5.15.83Linux 6.10.811.622.433.244.05SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 33.63.63.6

NCNN

Target: CPU-v3-v3 - Model: mobilenet-v3

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20220729Target: CPU-v3-v3 - Model: mobilenet-v3Linux 5.10.130Linux 5.15.83Linux 6.11.11382.22763.34144.45525.569SE +/- 0.01, N = 3SE +/- 0.04, N = 6SE +/- 0.01, N = 34.954.954.95MIN: 4.85 / MAX: 5.91MIN: 4.8 / MAX: 63.45MIN: 4.86 / MAX: 5.261. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

WebP Image Encode

Encode Settings: Quality 100, Lossless, Highest Compression

OpenBenchmarking.orgMP/s, More Is BetterWebP Image Encode 1.2.4Encode Settings: Quality 100, Lossless, Highest CompressionLinux 5.10.130Linux 5.15.83Linux 6.10.1080.2160.3240.4320.54SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 30.480.480.481. (CC) gcc options: -fvisibility=hidden -O2 -lm -pthread

NCNN

Target: CPU - Model: resnet18

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20220729Target: CPU - Model: resnet18Linux 5.10.130Linux 5.15.83Linux 6.1246810SE +/- 0.04, N = 3SE +/- 0.22, N = 6SE +/- 0.01, N = 38.098.057.85MIN: 7.89 / MAX: 9.29MIN: 7.68 / MAX: 9.97MIN: 7.74 / MAX: 10.21. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

NCNN

Target: CPU - Model: vgg16

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20220729Target: CPU - Model: vgg16Linux 5.10.130Linux 5.15.83Linux 6.1714212835SE +/- 0.13, N = 3SE +/- 1.00, N = 6SE +/- 0.10, N = 326.9527.6926.52MIN: 26.65 / MAX: 27.51MIN: 26.21 / MAX: 33.47MIN: 26.22 / MAX: 27.611. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

Stress-NG

Test: Socket Activity

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.14.06Test: Socket ActivityLinux 5.10.130Linux 5.15.83Linux 6.14K8K12K16K20KSE +/- 302.66, N = 15SE +/- 80.02, N = 3SE +/- 112.51, N = 310160.9117786.1716990.751. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -laio -lapparmor -latomic -lbsd -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lrt -lsctp -lz -pthread

Stress-NG

Test: CPU Cache

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.14.06Test: CPU CacheLinux 5.10.130Linux 5.15.83Linux 6.1306090120150SE +/- 2.89, N = 15SE +/- 6.07, N = 12SE +/- 2.00, N = 15116.33128.31115.591. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -laio -lapparmor -latomic -lbsd -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lrt -lsctp -lz -pthread

Stress-NG

Test: Futex

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.14.06Test: FutexLinux 5.10.130Linux 5.15.83Linux 6.1500K1000K1500K2000K2500KSE +/- 33488.35, N = 15SE +/- 32600.02, N = 3SE +/- 9882.04, N = 31498828.702364278.752433807.141. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -laio -lapparmor -latomic -lbsd -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lrt -lsctp -lz -pthread

Dragonflydb

Clients: 50 - Set To Get Ratio: 1:1

OpenBenchmarking.orgOps/sec, More Is BetterDragonflydb 0.6Clients: 50 - Set To Get Ratio: 1:1Linux 5.10.130Linux 5.15.83Linux 6.1200K400K600K800K1000KSE +/- 19609.96, N = 13SE +/- 643.98, N = 3SE +/- 1471.72, N = 3978963.311123953.551130454.031. (CXX) g++ options: -O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre


Phoronix Test Suite v10.8.5