Xeon Gold Cascade Lake Refresh LTS Linux Benchmarks

Intel Xeon Gold 6226R testing with a Supermicro X11SPL-F v1.02 (3.1 BIOS) and ASPEED on Ubuntu 20.10 via the Phoronix Test Suite.

HTML result view exported from: https://openbenchmarking.org/result/2212171-PTS-XEONGOLD08&sor&grs.

Xeon Gold Cascade Lake Refresh LTS Linux BenchmarksProcessorMotherboardChipsetMemoryDiskGraphicsMonitorNetworkOSKernelDesktopDisplay ServerCompilerFile-SystemScreen ResolutionLinux 5.10.130Linux 5.15.83Linux 6.1Intel Xeon Gold 6226R @ 3.90GHz (16 Cores / 32 Threads)Supermicro X11SPL-F v1.02 (3.1 BIOS)Intel Sky Lake-E DMI3 Registers192GB280GB INTEL SSDPED1D280GAASPEEDVE2282 x Intel I210Ubuntu 20.105.10.130-0510130-generic (x86_64)GNOME Shell 3.38.1X Server 1.20.9GCC 10.3.0ext41920x10805.15.83-051583-generic (x86_64)6.1.0-phx (x86_64)OpenBenchmarking.orgKernel Details- Transparent Huge Pages: madviseCompiler Details- --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-bootstrap --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-link-mutex --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none=/build/gcc-10-poYruo/gcc-10-10.3.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-10-poYruo/gcc-10-10.3.0/debian/tmp-gcn/usr,hsa --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-build-config=bootstrap-lto-lean --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v Processor Details- Scaling Governor: intel_cpufreq performance - CPU Microcode: 0x5003102Python Details- Python 3.8.10Security Details- Linux 5.10.130: itlb_multihit: KVM: Mitigation of VMX disabled + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Vulnerable: Clear buffers attempted no microcode; SMT vulnerable + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Vulnerable: eIBRS with unprivileged eBPF + srbds: Not affected + tsx_async_abort: Mitigation of TSX disabled - Linux 5.15.83: itlb_multihit: KVM: Mitigation of VMX disabled + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Vulnerable: Clear buffers attempted no microcode; SMT vulnerable + retbleed: Mitigation of Enhanced IBRS + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Mitigation of TSX disabled - Linux 6.1: itlb_multihit: KVM: Mitigation of VMX disabled + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Vulnerable: Clear buffers attempted no microcode; SMT vulnerable + retbleed: Mitigation of Enhanced IBRS + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Mitigation of TSX disabled

Xeon Gold Cascade Lake Refresh LTS Linux Benchmarksstress-ng: Context Switchingstress-ng: System V Message Passingstress-ng: MEMFDstress-ng: Mallocstress-ng: NUMActx-clock: Context Switch Timepgbench: 100 - 500 - Read Onlypgbench: 100 - 500 - Read Only - Average Latencystress-ng: MMAPstress-ng: Mutexstress-ng: SENDFILEpgbench: 100 - 250 - Read Onlypgbench: 100 - 250 - Read Only - Average Latencyjpegxl-decode: Allpgbench: 100 - 500 - Read Write - Average Latencypgbench: 100 - 500 - Read Writegraphics-magick: Rotatedragonflydb: 50 - 1:5pgbench: 100 - 100 - Read Only - Average Latencypgbench: 100 - 100 - Read Onlystress-ng: Forkinggraphics-magick: HWB Color Spacestress-ng: IO_uringdragonflydb: 200 - 1:5dragonflydb: 200 - 1:1dragonflydb: 50 - 5:1encodec: 6 kbpsrocksdb: Rand Fill Syncdragonflydb: 200 - 5:1encodec: 1.5 kbpsencodec: 24 kbpsencodec: 3 kbpsrocksdb: Seq Fillonednn: Deconvolution Batch shapes_1d - f32 - CPUaom-av1: Speed 9 Realtime - Bosphorus 4Kpgbench: 100 - 250 - Read Writepgbench: 100 - 250 - Read Write - Average Latencystargate: 192000 - 1024jpegxl: PNG - 90rocksdb: Update Randjpegxl: JPEG - 80jpegxl: JPEG - 90aom-av1: Speed 10 Realtime - Bosphorus 4Krocksdb: Rand Fillblosc: blosclz shufflejpegxl-decode: 1aom-av1: Speed 8 Realtime - Bosphorus 4Kpgbench: 100 - 100 - Read Writepgbench: 100 - 100 - Read Write - Average Latencyjpegxl: PNG - 80spacy: en_core_web_trfavifenc: 10, Losslessstargate: 44100 - 512graphics-magick: Noise-Gaussianclickhouse: 100M Rows Web Analytics Dataset, Second Runncnn: CPU - blazefaceblosc: blosclz bitshufflerocksdb: Read While Writingclickhouse: 100M Rows Web Analytics Dataset, First Run / Cold Cachebuild-linux-kernel: defconfigdeepsparse: NLP Text Classification, BERT base uncased SST2 - Synchronous Single-Streamdeepsparse: NLP Text Classification, BERT base uncased SST2 - Synchronous Single-Streamstargate: 96000 - 512stress-ng: Semaphoresstargate: 192000 - 512mnn: resnet-v2-50build-linux-kernel: allmodconfigstargate: 44100 - 1024ncnn: CPU - resnet50mnn: MobileNetV2_224mnn: squeezenetv1.1numenta-nab: KNN CADgraphics-magick: Resizingdeepsparse: NLP Text Classification, DistilBERT mnli - Synchronous Single-Streamdeepsparse: NLP Text Classification, DistilBERT mnli - Synchronous Single-Streambuild-erlang: Time To Compileonednn: Deconvolution Batch shapes_3d - u8s8f32 - CPUdeepsparse: NLP Text Classification, BERT base uncased SST2 - Asynchronous Multi-Streamdeepsparse: NLP Text Classification, BERT base uncased SST2 - Asynchronous Multi-Streamospray-studio: 3 - 1080p - 32 - Path Tracerncnn: CPU - yolov4-tinygraphics-magick: Swirlbuild-godot: Time To Compilencnn: CPU - squeezenet_ssdsrsran: 4G PHY_DL_Test 100 PRB MIMO 256-QAMsvt-av1: Preset 12 - Bosphorus 1080pstargate: 96000 - 1024deepsparse: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Synchronous Single-Streamdeepsparse: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Synchronous Single-Streamopenvino: Age Gender Recognition Retail 0013 FP16-INT8 - CPUopenvino: Vehicle Detection FP16 - CPUopenvino: Vehicle Detection FP16 - CPUjpegxl: JPEG - 100stargate: 480000 - 512jpegxl: PNG - 100numenta-nab: Relative Entropysvt-av1: Preset 13 - Bosphorus 4Kncnn: CPU - mobilenetavifenc: 6, Losslessopenvino: Age Gender Recognition Retail 0013 FP16-INT8 - CPUstress-ng: Memory Copyingstargate: 480000 - 1024build-python: Defaultavifenc: 6mnn: nasnetcompress-7zip: Compression Ratingncnn: CPU - FastestDetmnn: SqueezeNetV1.0srsran: OFDM_Testmnn: inception-v3ospray-studio: 2 - 4K - 16 - Path Tracertensorflow: CPU - 16 - GoogLeNetospray-studio: 2 - 1080p - 32 - Path Tracerdeepsparse: NLP Token Classification, BERT base uncased conll2003 - Asynchronous Multi-Streammnn: mobilenet-v1-1.0cpuminer-opt: Myriad-Groestlbuild-nodejs: Time To Compiledeepsparse: NLP Token Classification, BERT base uncased conll2003 - Asynchronous Multi-Streamopenvino: Machine Translation EN To DE FP16 - CPUopenvino: Machine Translation EN To DE FP16 - CPUencode-flac: WAV To FLACnumenta-nab: Bayesian Changepointsvt-av1: Preset 13 - Bosphorus 1080pgraphics-magick: Enhancedopenvino: Vehicle Detection FP16-INT8 - CPUdeepsparse: CV Classification, ResNet-50 ImageNet - Synchronous Single-Streamospray-studio: 1 - 4K - 16 - Path Tracerbuild-php: Time To Compilencnn: CPU - shufflenet-v2openvino: Person Vehicle Bike Detection FP16 - CPUncnn: CPU - mnasnetopenvino: Person Vehicle Bike Detection FP16 - CPUdeepsparse: CV Classification, ResNet-50 ImageNet - Synchronous Single-Streamclickhouse: 100M Rows Web Analytics Dataset, Third Runopenvino: Vehicle Detection FP16-INT8 - CPUtensorflow: CPU - 32 - GoogLeNetminibude: OpenMP - BM1minibude: OpenMP - BM1cpuminer-opt: Ringcoincpuminer-opt: Blake-2 Sminibude: OpenMP - BM2minibude: OpenMP - BM2tensorflow: CPU - 16 - ResNet-50onednn: Convolution Batch Shapes Auto - u8s8f32 - CPUdeepsparse: NLP Document Classification, oBERT base uncased on IMDB - Asynchronous Multi-Streamsrsran: 4G PHY_DL_Test 100 PRB MIMO 64-QAMaom-av1: Speed 6 Two-Pass - Bosphorus 4Ksrsran: 4G PHY_DL_Test 100 PRB MIMO 64-QAMgraphics-magick: Sharpenopenfoam: drivaerFastback, Small Mesh Size - Execution Timencnn: CPU - efficientnet-b0ospray-studio: 1 - 1080p - 32 - Path Tracersrsran: 4G PHY_DL_Test 100 PRB SISO 256-QAMopenvino: Age Gender Recognition Retail 0013 FP16 - CPUavifenc: 2mnn: mobilenetV3ncnn: CPU - googlenetsvt-av1: Preset 4 - Bosphorus 4Kopenradioss: Bumper Beamxmrig: Monero - 1Mopenvino: Person Detection FP16 - CPUbrl-cad: VGR Performance Metricnumenta-nab: Earthgecko Skylinedeepsparse: NLP Document Classification, oBERT base uncased on IMDB - Asynchronous Multi-Streamonednn: Matrix Multiply Batch Shapes Transformer - u8s8f32 - CPUsvt-av1: Preset 4 - Bosphorus 1080psrsran: 4G PHY_DL_Test 100 PRB MIMO 256-QAMsvt-av1: Preset 8 - Bosphorus 4Kncnn: CPU - regnety_400mstress-ng: Atomiccpuminer-opt: LBC, LBRY Creditssvt-av1: Preset 12 - Bosphorus 4Kopenfoam: drivaerFastback, Medium Mesh Size - Execution Timedeepsparse: NLP Document Classification, oBERT base uncased on IMDB - Synchronous Single-Streamopenvino: Weld Porosity Detection FP16 - CPUwebp: Quality 100, Losslesssrsran: 4G PHY_DL_Test 100 PRB SISO 64-QAMsrsran: 4G PHY_DL_Test 100 PRB SISO 256-QAMdeepsparse: NLP Document Classification, oBERT base uncased on IMDB - Synchronous Single-Streamopenvino: Weld Porosity Detection FP16 - CPUopenfoam: drivaerFastback, Small Mesh Size - Mesh Timewebp: Quality 100openvino: Age Gender Recognition Retail 0013 FP16 - CPUspacy: en_core_web_lgcpuminer-opt: Quad SHA-256, Pyriteonednn: Matrix Multiply Batch Shapes Transformer - f32 - CPUncnn: CPU-v2-v2 - mobilenet-v2openradioss: Rubber O-Ring Seal Installationopenradioss: INIVOL and Fluid Structure Interaction Drop Containerwebp: Quality 100, Highest Compressiony-cruncher: 500Mopenvino: Person Detection FP16 - CPUcpuminer-opt: Triple SHA-256, Onecoinonednn: Recurrent Neural Network Inference - u8s8f32 - CPUstress-ng: CPU Stressnekrs: TurboPipe Periodicopenvino: Person Detection FP32 - CPUnumenta-nab: Windowed Gaussianopenvino: Person Detection FP32 - CPUncnn: CPU - vision_transformeronednn: Convolution Batch Shapes Auto - f32 - CPUopenfoam: drivaerFastback, Medium Mesh Size - Mesh Timecpuminer-opt: Skeincointensorflow: CPU - 64 - GoogLeNetcpuminer-opt: Deepcoinstress-ng: Glibc C String Functionsbuild-python: Released Build, PGO + LTO Optimizedblender: Classroom - CPU-Onlyonednn: IP Shapes 3D - f32 - CPUonednn: Deconvolution Batch shapes_3d - f32 - CPUsrsran: 4G PHY_DL_Test 100 PRB SISO 64-QAMlammps: Rhodopsin Proteinsvt-av1: Preset 8 - Bosphorus 1080pcpuminer-opt: x25xy-cruncher: 1Btensorflow: CPU - 32 - ResNet-50deepsparse: NLP Token Classification, BERT base uncased conll2003 - Synchronous Single-Streamdeepsparse: NLP Token Classification, BERT base uncased conll2003 - Synchronous Single-Streamonednn: Recurrent Neural Network Training - u8s8f32 - CPUcpuminer-opt: scryptxmrig: Wownero - 1Mcpuminer-opt: Magitensorflow: CPU - 64 - AlexNettensorflow: CPU - 64 - ResNet-50deepsparse: NLP Text Classification, DistilBERT mnli - Asynchronous Multi-Streamdeepsparse: NLP Text Classification, DistilBERT mnli - Asynchronous Multi-Streamrocksdb: Rand Readopenvino: Face Detection FP16-INT8 - CPUncnn: CPU - alexnettensorflow: CPU - 16 - AlexNetcompress-7zip: Decompression Ratingcpuminer-opt: Garlicoindeepsparse: CV Detection,YOLOv5s COCO - Asynchronous Multi-Streamonednn: Recurrent Neural Network Inference - f32 - CPUonednn: IP Shapes 3D - u8s8f32 - CPUopenvino: Face Detection FP16-INT8 - CPUblender: BMW27 - CPU-Onlysrsran: 5G PHY_DL_NR Test 52 PRB SISO 64-QAMdeepsparse: CV Classification, ResNet-50 ImageNet - Asynchronous Multi-Streamdeepsparse: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Asynchronous Multi-Streamdeepsparse: CV Detection,YOLOv5s COCO - Synchronous Single-Streamtensorflow: CPU - 256 - ResNet-50stress-ng: Glibc Qsort Data Sortingdeepsparse: CV Detection,YOLOv5s COCO - Synchronous Single-Streamdeepsparse: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Asynchronous Multi-Streamnumenta-nab: Contextual Anomaly Detector OSEdeepsparse: CV Classification, ResNet-50 ImageNet - Asynchronous Multi-Streamlammps: 20k Atomsdeepsparse: CV Detection,YOLOv5s COCO - Asynchronous Multi-Streamospray-studio: 1 - 1080p - 16 - Path Tracerospray-studio: 3 - 1080p - 1 - Path Traceravifenc: 0ospray-studio: 3 - 4K - 32 - Path Tracertensorflow: CPU - 256 - AlexNetopenradioss: Bird Strike on Windshieldwebp: Defaultospray-studio: 2 - 4K - 32 - Path Tracertensorflow: CPU - 256 - GoogLeNetrocksdb: Read Rand Write Randtensorflow: CPU - 32 - AlexNetprimesieve: 1e13onednn: Recurrent Neural Network Training - f32 - CPUonednn: Deconvolution Batch shapes_1d - u8s8f32 - CPUastcenc: Thoroughopenvino: Face Detection FP16 - CPUblender: Pabellon Barcelona - CPU-Onlysrsran: 5G PHY_DL_NR Test 52 PRB SISO 64-QAMonednn: IP Shapes 1D - f32 - CPUospray-studio: 2 - 1080p - 16 - Path Tracerprimesieve: 1e12onednn: IP Shapes 1D - u8s8f32 - CPUospray-studio: 1 - 4K - 1 - Path Tracerstress-ng: Vector Mathopenvino: Weld Porosity Detection FP16-INT8 - CPUospray-studio: 2 - 1080p - 1 - Path Traceropenradioss: Cell Phone Drop Testospray-studio: 1 - 4K - 32 - Path Tracerblender: Barbershop - CPU-Onlyopenvino: Weld Porosity Detection FP16-INT8 - CPUastcenc: Mediumospray-studio: 3 - 4K - 16 - Path Tracerstress-ng: Cryptoopenvino: Face Detection FP16 - CPUastcenc: Exhaustiveastcenc: Faststress-ng: Matrix Mathospray-studio: 3 - 1080p - 16 - Path Tracerblender: Fishy Cat - CPU-Onlyospray-studio: 3 - 4K - 1 - Path Tracerospray-studio: 1 - 1080p - 1 - Path Tracerospray-studio: 2 - 4K - 1 - Path Tracerstress-ng: x86_64 RdRandaircrack-ng: natron: Spaceshipncnn: CPU-v3-v3 - mobilenet-v3webp: Quality 100, Lossless, Highest Compressionncnn: CPU - resnet18ncnn: CPU - vgg16stress-ng: Socket Activitystress-ng: CPU Cachestress-ng: Futexdragonflydb: 50 - 1:1Linux 5.10.130Linux 5.15.83Linux 6.15500706.766490812.351008.6222392194.28358.051543702381.350390.208606774.99241610.684139490.604208.7912.986385037571047699.230.21546542256719.5197636489.151021149.38971725.25989148.9729.495216464918617.3728.20834.16229.14112042554.7069948.05476765.2441.8892687.586256957.457.3048.3498319915238.138.1737.88536561.8647.7024466.6373.909552335212.602.3810158.93100899205.7670.16926.001138.44382.5378913214994.831.53625510.148907.7484.38589314.203.8552.592185.330133373.603913.577191.5600.851455144.006255.54337801623.6050297.24617.13303.4415.1362.99961122.839643.76120.5029.37272.090.533.7269330.5415.803120.79414.5411.37631167.814201.024.19956819.4496.68914.9101063577.024.89212200000022.733124428114.416682310.54032.67817363453.613752.831964.82123.3421.11041.392423.649315969.337.526512146765.3255.66485.364.9116.47132.6485212.428.24121.72530.26621.2112833.09114910321.389534.73837.684.1586910.5210279.811.70117.3199188.282087.0665271131.01.0470.5172.09111.572.475152.416794.53.31167771114.813758.02770.3132387.046126.934.51918.83223731.7096820126.4971598.6991104.1622625.501.27279.8307.09.599625.5338.535119.0015259.86113142188300.9563995.56159.75443.723.0711.3452400.02315913911.81634273.52706497666673.259.0702436.30160.274.29153241.48551135103125.7914497911917.94383.514318.283.101443.30606123.310.65995.493640.0624.44940.23103.99609.61531621.84491.909492.2374.94243.3041.90108.547573.675965094239417.715.46166.55864326572.8186.6567909.6321.2527119.11106.1398.6219.3569144.241013.268943.50194.3675.261655.423355.73436.439010.42792.2142284092178145.012284699278.63256.4314.37239935130.212132608211.25174.7221613.120.5406549.32255.88373.7465.92.296362917214.4430.496613705555351.588.02182696.212342161145.901991.7572.159514658318742.671357.370.9371193.131555915.3634786144.25863317787242252390.5650605.5593.64.950.488.0926.9510160.91116.331498828.70978963.312284154.168257907.06879.6720930090.96335.581794264281.173381.239013626.15285766.994751750.526209.1814.783338247311186278.250.19451527360087.3695732758.891117321.901060251.051068662.9129.530234969993337.9028.34933.91728.66011938374.7083447.66459225.4441.9896807.546166267.407.2548.3398284815998.637.9037.86562301.7797.7124166.6663.972591331209.582.2910555.73043279204.2670.48826.477437.76022.5790453314461.381.5670499.850911.0834.43109814.213.7522.537182.657132172.055213.867991.7540.846543146.950554.43327799723.8949997.56816.85310.0418.0223.06351123.313942.90130.529.29272.800.533.7903210.5415.813122.97814.7111.42531007.384129.344.27089719.4936.74914.8801080586.914.89712263333322.438124556115.156681710.43392.63917610453.307760.837464.28124.3421.09841.433425.263314957.087.440812148665.1435.59485.194.8516.46134.1326215.028.34122.18529.24021.1702812.34115058321.317532.92438.094.2034310.4539282.711.77118.3199186.398436.9965242131.61.0371.0652.07111.462.483151.826829.83.30166852115.529759.35250.3160056.985128.034.81818.67225144.3396663127.5341611.5943104.0054623.361.28282.0307.99.614125.6238.2357819.0215258.56112362184930.9616825.53159.15445.173.0911.3662401.74313917908.18834238.77709236333333.259.0182441.67161.234.31178242.25487134833126.2914500916397.13383.962317.073.085613.29633123.910.63995.043641.6124.56240.41104.03769.61111614.87489.839531.3373.55242.7342.05108.337773.821665233649416.955.48166.90867356594.1886.9402912.0661.2517419.15106.3898.6219.0088143.806513.308943.41194.8875.040155.584955.65936.497310.41491.9860284172176144.709284853279.05256.1914.40240311130.402129359211.47174.6581611.140.5404529.32675.88373.5466.02.293852920614.4290.497248704655415.018.01182696.312341421144.821993.5872.121914657018733.101356.350.9375193.024455890.2334801144.34862817787246252393.8850607.7383.64.950.488.0527.6917786.17128.312364278.751123953.552054658.6414896082.79667.8215989079.77256.612004671671.070310.227375258.06284966.044874680.513181.5413.847361096681180450.090.19152378853632.6787232918.801099078.401046604.151074996.4332.017218454979549.4330.49336.32130.42611349914.9806745.41452235.5281.9288147.205944857.086.9445.9793528515256.136.3736.10543651.8397.3623416.9093.817268322204.432.3610161.32985392198.5172.55826.865637.21152.4971643315660.881.5200409.932934.2654.31138213.833.8312.606180.519129971.885213.901393.7390.831866147.380454.27267980423.3549199.42016.76307.4409.1273.01258523.071843.32020.5129.86267.620.523.7188120.5315.525121.59614.4511.58030632.464181.804.20888019.7776.79815.1221069686.964.96912073333322.789126341116.166783710.38322.64017477459.753763.306463.96124.9721.37641.936419.750311957.417.535912300065.9645.63491.244.8916.27132.5077212.928.33123.19535.56521.4222800.62113755021.552538.79038.014.1809610.4097280.211.65117.1197186.934677.0465894130.31.0471.2012.08311.482.460153.236767.33.28168334115.831764.74250.3139757.024127.234.72318.70225639.3296010126.7631607.4012104.8348620.611.27280.3305.59.539325.7338.3619938.9515144.32112312172370.9634005.57160.27446.663.0811.2942415.31315723913.94334059.43704815000003.239.0732451.10160.394.28618242.92307134320126.4914420916843.52385.5318.713.094333.31244123.310.60895.151638.6424.45540.32103.58239.65321618.86491.859527.7373.45242.3442.06108.744373.545665337175416.165.46166.31866806571.6686.8832909.1471.2487119.17106.4698.3218.6936144.211413.269143.37194.3075.263555.436655.81536.539210.39992.0462284792173145.036284235279.22255.8914.38240430130.472133528211.06174.9771614.070.5414309.31035.89374.1765.92.297082916514.4240.496776704855344.328.02182496.302343711145.181992.2372.097214669218727.611357.100.9368192.991755875.1834779144.29863317797245252372.2950609.2763.64.950.487.8526.5216990.75115.592433807.141130454.03OpenBenchmarking.org

Stress-NG

Test: Context Switching

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.14.06Test: Context SwitchingLinux 5.10.130Linux 5.15.83Linux 6.11.2M2.4M3.6M4.8M6MSE +/- 72191.04, N = 3SE +/- 7040.94, N = 3SE +/- 3492.53, N = 35500706.762284154.162054658.641. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -laio -lapparmor -latomic -lbsd -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lrt -lsctp -lz -pthread

Stress-NG

Test: System V Message Passing

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.14.06Test: System V Message PassingLinux 6.1Linux 5.15.83Linux 5.10.1303M6M9M12M15MSE +/- 26770.64, N = 3SE +/- 4399.60, N = 3SE +/- 23387.52, N = 314896082.798257907.066490812.351. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -laio -lapparmor -latomic -lbsd -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lrt -lsctp -lz -pthread

Stress-NG

Test: MEMFD

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.14.06Test: MEMFDLinux 5.10.130Linux 5.15.83Linux 6.12004006008001000SE +/- 0.88, N = 3SE +/- 0.39, N = 3SE +/- 0.28, N = 31008.62879.67667.821. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -laio -lapparmor -latomic -lbsd -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lrt -lsctp -lz -pthread

Stress-NG

Test: Malloc

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.14.06Test: MallocLinux 5.10.130Linux 5.15.83Linux 6.15M10M15M20M25MSE +/- 90978.10, N = 3SE +/- 130302.14, N = 3SE +/- 91731.80, N = 322392194.2820930090.9615989079.771. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -laio -lapparmor -latomic -lbsd -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lrt -lsctp -lz -pthread

Stress-NG

Test: NUMA

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.14.06Test: NUMALinux 5.10.130Linux 5.15.83Linux 6.180160240320400SE +/- 2.82, N = 3SE +/- 0.90, N = 3SE +/- 1.78, N = 3358.05335.58256.611. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -laio -lapparmor -latomic -lbsd -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lrt -lsctp -lz -pthread

ctx_clock

Context Switch Time

OpenBenchmarking.orgClocks, Fewer Is Betterctx_clockContext Switch TimeLinux 5.10.130Linux 5.15.83Linux 6.14080120160200SE +/- 0.67, N = 3154179200

PostgreSQL

Scaling Factor: 100 - Clients: 500 - Mode: Read Only

OpenBenchmarking.orgTPS, More Is BetterPostgreSQL 15Scaling Factor: 100 - Clients: 500 - Mode: Read OnlyLinux 6.1Linux 5.15.83Linux 5.10.130100K200K300K400K500KSE +/- 757.53, N = 3SE +/- 666.01, N = 3SE +/- 956.06, N = 34671674264283702381. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lpthread -lrt -ldl -lm

PostgreSQL

Scaling Factor: 100 - Clients: 500 - Mode: Read Only - Average Latency

OpenBenchmarking.orgms, Fewer Is BetterPostgreSQL 15Scaling Factor: 100 - Clients: 500 - Mode: Read Only - Average LatencyLinux 6.1Linux 5.15.83Linux 5.10.1300.30380.60760.91141.21521.519SE +/- 0.002, N = 3SE +/- 0.002, N = 3SE +/- 0.003, N = 31.0701.1731.3501. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lpthread -lrt -ldl -lm

Stress-NG

Test: MMAP

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.14.06Test: MMAPLinux 5.10.130Linux 5.15.83Linux 6.180160240320400SE +/- 0.74, N = 3SE +/- 0.56, N = 3SE +/- 2.76, N = 3390.20381.23310.221. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -laio -lapparmor -latomic -lbsd -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lrt -lsctp -lz -pthread

Stress-NG

Test: Mutex

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.14.06Test: MutexLinux 5.15.83Linux 5.10.130Linux 6.12M4M6M8M10MSE +/- 112044.15, N = 15SE +/- 10182.54, N = 3SE +/- 24065.62, N = 39013626.158606774.997375258.061. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -laio -lapparmor -latomic -lbsd -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lrt -lsctp -lz -pthread

Stress-NG

Test: SENDFILE

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.14.06Test: SENDFILELinux 5.15.83Linux 6.1Linux 5.10.13060K120K180K240K300KSE +/- 2143.98, N = 3SE +/- 1947.11, N = 3SE +/- 2449.06, N = 3285766.99284966.04241610.681. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -laio -lapparmor -latomic -lbsd -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lrt -lsctp -lz -pthread

PostgreSQL

Scaling Factor: 100 - Clients: 250 - Mode: Read Only

OpenBenchmarking.orgTPS, More Is BetterPostgreSQL 15Scaling Factor: 100 - Clients: 250 - Mode: Read OnlyLinux 6.1Linux 5.15.83Linux 5.10.130100K200K300K400K500KSE +/- 5532.44, N = 3SE +/- 286.86, N = 3SE +/- 2810.03, N = 34874684751754139491. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lpthread -lrt -ldl -lm

PostgreSQL

Scaling Factor: 100 - Clients: 250 - Mode: Read Only - Average Latency

OpenBenchmarking.orgms, Fewer Is BetterPostgreSQL 15Scaling Factor: 100 - Clients: 250 - Mode: Read Only - Average LatencyLinux 6.1Linux 5.15.83Linux 5.10.1300.13590.27180.40770.54360.6795SE +/- 0.006, N = 3SE +/- 0.000, N = 3SE +/- 0.004, N = 30.5130.5260.6041. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lpthread -lrt -ldl -lm

JPEG XL Decoding libjxl

CPU Threads: All

OpenBenchmarking.orgMP/s, More Is BetterJPEG XL Decoding libjxl 0.7CPU Threads: AllLinux 5.15.83Linux 5.10.130Linux 6.150100150200250SE +/- 0.37, N = 3SE +/- 1.38, N = 3SE +/- 2.09, N = 3209.18208.79181.54

PostgreSQL

Scaling Factor: 100 - Clients: 500 - Mode: Read Write - Average Latency

OpenBenchmarking.orgms, Fewer Is BetterPostgreSQL 15Scaling Factor: 100 - Clients: 500 - Mode: Read Write - Average LatencyLinux 5.10.130Linux 6.1Linux 5.15.8348121620SE +/- 0.02, N = 3SE +/- 0.03, N = 3SE +/- 0.04, N = 312.9913.8514.781. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lpthread -lrt -ldl -lm

PostgreSQL

Scaling Factor: 100 - Clients: 500 - Mode: Read Write

OpenBenchmarking.orgTPS, More Is BetterPostgreSQL 15Scaling Factor: 100 - Clients: 500 - Mode: Read WriteLinux 5.10.130Linux 6.1Linux 5.15.838K16K24K32K40KSE +/- 59.40, N = 3SE +/- 91.02, N = 3SE +/- 99.01, N = 33850336109338241. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lpthread -lrt -ldl -lm

GraphicsMagick

Operation: Rotate

OpenBenchmarking.orgIterations Per Minute, More Is BetterGraphicsMagick 1.3.38Operation: RotateLinux 5.10.130Linux 5.15.83Linux 6.1160320480640800SE +/- 9.97, N = 5SE +/- 1.76, N = 3SE +/- 5.43, N = 157577316681. (CC) gcc options: -fopenmp -O2 -pthread -ljbig -lwebp -lwebpmux -ltiff -lfreetype -ljpeg -lXext -lSM -lICE -lX11 -llzma -lbz2 -lxml2 -lz -lm -lpthread

Dragonflydb

Clients: 50 - Set To Get Ratio: 1:5

OpenBenchmarking.orgOps/sec, More Is BetterDragonflydb 0.6Clients: 50 - Set To Get Ratio: 1:5Linux 5.15.83Linux 6.1Linux 5.10.130300K600K900K1200K1500KSE +/- 1515.54, N = 3SE +/- 1580.99, N = 3SE +/- 872.80, N = 31186278.251180450.091047699.231. (CXX) g++ options: -O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre

PostgreSQL

Scaling Factor: 100 - Clients: 100 - Mode: Read Only - Average Latency

OpenBenchmarking.orgms, Fewer Is BetterPostgreSQL 15Scaling Factor: 100 - Clients: 100 - Mode: Read Only - Average LatencyLinux 6.1Linux 5.15.83Linux 5.10.1300.04840.09680.14520.19360.242SE +/- 0.001, N = 3SE +/- 0.000, N = 3SE +/- 0.001, N = 30.1910.1940.2151. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lpthread -lrt -ldl -lm

PostgreSQL

Scaling Factor: 100 - Clients: 100 - Mode: Read Only

OpenBenchmarking.orgTPS, More Is BetterPostgreSQL 15Scaling Factor: 100 - Clients: 100 - Mode: Read OnlyLinux 6.1Linux 5.15.83Linux 5.10.130110K220K330K440K550KSE +/- 1990.45, N = 3SE +/- 92.73, N = 3SE +/- 1779.96, N = 35237885152734654221. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lpthread -lrt -ldl -lm

Stress-NG

Test: Forking

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.14.06Test: ForkingLinux 5.15.83Linux 5.10.130Linux 6.113K26K39K52K65KSE +/- 184.20, N = 3SE +/- 175.99, N = 3SE +/- 386.64, N = 360087.3656719.5153632.671. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -laio -lapparmor -latomic -lbsd -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lrt -lsctp -lz -pthread

GraphicsMagick

Operation: HWB Color Space

OpenBenchmarking.orgIterations Per Minute, More Is BetterGraphicsMagick 1.3.38Operation: HWB Color SpaceLinux 5.10.130Linux 5.15.83Linux 6.12004006008001000SE +/- 1.53, N = 3SE +/- 1.67, N = 39769578721. (CC) gcc options: -fopenmp -O2 -pthread -ljbig -lwebp -lwebpmux -ltiff -lfreetype -ljpeg -lXext -lSM -lICE -lX11 -llzma -lbz2 -lxml2 -lz -lm -lpthread

Stress-NG

Test: IO_uring

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.14.06Test: IO_uringLinux 5.10.130Linux 6.1Linux 5.15.838K16K24K32K40KSE +/- 401.23, N = 3SE +/- 240.39, N = 3SE +/- 501.84, N = 336489.1532918.8032758.891. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -laio -lapparmor -latomic -lbsd -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lrt -lsctp -lz -pthread

Dragonflydb

Clients: 200 - Set To Get Ratio: 1:5

OpenBenchmarking.orgOps/sec, More Is BetterDragonflydb 0.6Clients: 200 - Set To Get Ratio: 1:5Linux 5.15.83Linux 6.1Linux 5.10.130200K400K600K800K1000KSE +/- 3993.93, N = 3SE +/- 797.47, N = 3SE +/- 515.57, N = 31117321.901099078.401021149.381. (CXX) g++ options: -O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre

Dragonflydb

Clients: 200 - Set To Get Ratio: 1:1

OpenBenchmarking.orgOps/sec, More Is BetterDragonflydb 0.6Clients: 200 - Set To Get Ratio: 1:1Linux 5.15.83Linux 6.1Linux 5.10.130200K400K600K800K1000KSE +/- 1111.75, N = 3SE +/- 6338.63, N = 3SE +/- 1890.11, N = 31060251.051046604.15971725.251. (CXX) g++ options: -O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre

Dragonflydb

Clients: 50 - Set To Get Ratio: 5:1

OpenBenchmarking.orgOps/sec, More Is BetterDragonflydb 0.6Clients: 50 - Set To Get Ratio: 5:1Linux 6.1Linux 5.15.83Linux 5.10.130200K400K600K800K1000KSE +/- 741.75, N = 3SE +/- 3987.52, N = 3SE +/- 8046.26, N = 31074996.431068662.91989148.971. (CXX) g++ options: -O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre

EnCodec

Target Bandwidth: 6 kbps

OpenBenchmarking.orgSeconds, Fewer Is BetterEnCodec 0.1.1Target Bandwidth: 6 kbpsLinux 5.10.130Linux 5.15.83Linux 6.1714212835SE +/- 0.11, N = 3SE +/- 0.11, N = 3SE +/- 0.09, N = 329.5029.5332.02

Facebook RocksDB

Test: Random Fill Sync

OpenBenchmarking.orgOp/s, More Is BetterFacebook RocksDB 7.5.3Test: Random Fill SyncLinux 5.15.83Linux 6.1Linux 5.10.13050K100K150K200K250KSE +/- 684.45, N = 3SE +/- 160.74, N = 3SE +/- 254.19, N = 32349692184542164641. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti -lpthread

Dragonflydb

Clients: 200 - Set To Get Ratio: 5:1

OpenBenchmarking.orgOps/sec, More Is BetterDragonflydb 0.6Clients: 200 - Set To Get Ratio: 5:1Linux 5.15.83Linux 6.1Linux 5.10.130200K400K600K800K1000KSE +/- 845.72, N = 3SE +/- 1905.52, N = 3SE +/- 4444.49, N = 3993337.90979549.43918617.371. (CXX) g++ options: -O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre

EnCodec

Target Bandwidth: 1.5 kbps

OpenBenchmarking.orgSeconds, Fewer Is BetterEnCodec 0.1.1Target Bandwidth: 1.5 kbpsLinux 5.10.130Linux 5.15.83Linux 6.1714212835SE +/- 0.29, N = 8SE +/- 0.33, N = 3SE +/- 0.30, N = 928.2128.3530.49

EnCodec

Target Bandwidth: 24 kbps

OpenBenchmarking.orgSeconds, Fewer Is BetterEnCodec 0.1.1Target Bandwidth: 24 kbpsLinux 5.15.83Linux 5.10.130Linux 6.1816243240SE +/- 0.20, N = 3SE +/- 0.02, N = 3SE +/- 0.13, N = 333.9234.1636.32

EnCodec

Target Bandwidth: 3 kbps

OpenBenchmarking.orgSeconds, Fewer Is BetterEnCodec 0.1.1Target Bandwidth: 3 kbpsLinux 5.15.83Linux 5.10.130Linux 6.1714212835SE +/- 0.34, N = 6SE +/- 0.21, N = 3SE +/- 0.30, N = 828.6629.1430.43

Facebook RocksDB

Test: Sequential Fill

OpenBenchmarking.orgOp/s, More Is BetterFacebook RocksDB 7.5.3Test: Sequential FillLinux 5.10.130Linux 5.15.83Linux 6.1300K600K900K1200K1500KSE +/- 10501.31, N = 3SE +/- 3547.16, N = 3SE +/- 11595.14, N = 31204255119383711349911. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti -lpthread

oneDNN

Harness: Deconvolution Batch shapes_1d - Data Type: f32 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.7Harness: Deconvolution Batch shapes_1d - Data Type: f32 - Engine: CPULinux 5.10.130Linux 5.15.83Linux 6.11.12072.24143.36214.48285.6035SE +/- 0.01724, N = 3SE +/- 0.01367, N = 3SE +/- 0.02580, N = 34.706994.708344.98067MIN: 4.43MIN: 4.4MIN: 4.621. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -lpthread -ldl

AOM AV1

Encoder Mode: Speed 9 Realtime - Input: Bosphorus 4K

OpenBenchmarking.orgFrames Per Second, More Is BetterAOM AV1 3.5Encoder Mode: Speed 9 Realtime - Input: Bosphorus 4KLinux 5.10.130Linux 5.15.83Linux 6.11122334455SE +/- 0.06, N = 3SE +/- 0.14, N = 3SE +/- 0.11, N = 348.0547.6645.411. (CXX) g++ options: -O3 -std=c++11 -U_FORTIFY_SOURCE -lm -lpthread

PostgreSQL

Scaling Factor: 100 - Clients: 250 - Mode: Read Write

OpenBenchmarking.orgTPS, More Is BetterPostgreSQL 15Scaling Factor: 100 - Clients: 250 - Mode: Read WriteLinux 5.10.130Linux 5.15.83Linux 6.110K20K30K40K50KSE +/- 132.15, N = 3SE +/- 31.67, N = 3SE +/- 71.67, N = 34767645922452231. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lpthread -lrt -ldl -lm

PostgreSQL

Scaling Factor: 100 - Clients: 250 - Mode: Read Write - Average Latency

OpenBenchmarking.orgms, Fewer Is BetterPostgreSQL 15Scaling Factor: 100 - Clients: 250 - Mode: Read Write - Average LatencyLinux 5.10.130Linux 5.15.83Linux 6.11.24382.48763.73144.97526.219SE +/- 0.015, N = 3SE +/- 0.004, N = 3SE +/- 0.009, N = 35.2445.4445.5281. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lpthread -lrt -ldl -lm

Stargate Digital Audio Workstation

Sample Rate: 192000 - Buffer Size: 1024

OpenBenchmarking.orgRender Ratio, More Is BetterStargate Digital Audio Workstation 22.11.5Sample Rate: 192000 - Buffer Size: 1024Linux 5.15.83Linux 6.1Linux 5.10.1300.44770.89541.34311.79082.2385SE +/- 0.011134, N = 3SE +/- 0.012895, N = 3SE +/- 0.016352, N = 31.9896801.9288141.8892681. (CXX) g++ options: -lpthread -lsndfile -lm -O3 -march=native -ffast-math -funroll-loops -fstrength-reduce -fstrict-aliasing -finline-functions

JPEG XL libjxl

Input: PNG - Quality: 90

OpenBenchmarking.orgMP/s, More Is BetterJPEG XL libjxl 0.7Input: PNG - Quality: 90Linux 5.10.130Linux 5.15.83Linux 6.1246810SE +/- 0.01, N = 3SE +/- 0.02, N = 3SE +/- 0.02, N = 37.587.547.201. (CXX) g++ options: -fno-rtti -funwind-tables -O3 -O2 -fPIE -pie -lm -pthread -latomic

Facebook RocksDB

Test: Update Random

OpenBenchmarking.orgOp/s, More Is BetterFacebook RocksDB 7.5.3Test: Update RandomLinux 5.10.130Linux 5.15.83Linux 6.1130K260K390K520K650KSE +/- 3662.51, N = 3SE +/- 1069.98, N = 3SE +/- 2022.46, N = 36256956166265944851. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti -lpthread

JPEG XL libjxl

Input: JPEG - Quality: 80

OpenBenchmarking.orgMP/s, More Is BetterJPEG XL libjxl 0.7Input: JPEG - Quality: 80Linux 5.10.130Linux 5.15.83Linux 6.1246810SE +/- 0.01, N = 3SE +/- 0.00, N = 3SE +/- 0.01, N = 37.457.407.081. (CXX) g++ options: -fno-rtti -funwind-tables -O3 -O2 -fPIE -pie -lm -pthread -latomic

JPEG XL libjxl

Input: JPEG - Quality: 90

OpenBenchmarking.orgMP/s, More Is BetterJPEG XL libjxl 0.7Input: JPEG - Quality: 90Linux 5.10.130Linux 5.15.83Linux 6.1246810SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 37.307.256.941. (CXX) g++ options: -fno-rtti -funwind-tables -O3 -O2 -fPIE -pie -lm -pthread -latomic

AOM AV1

Encoder Mode: Speed 10 Realtime - Input: Bosphorus 4K

OpenBenchmarking.orgFrames Per Second, More Is BetterAOM AV1 3.5Encoder Mode: Speed 10 Realtime - Input: Bosphorus 4KLinux 5.10.130Linux 5.15.83Linux 6.11122334455SE +/- 0.10, N = 3SE +/- 0.20, N = 3SE +/- 0.14, N = 348.3448.3345.971. (CXX) g++ options: -O3 -std=c++11 -U_FORTIFY_SOURCE -lm -lpthread

Facebook RocksDB

Test: Random Fill

OpenBenchmarking.orgOp/s, More Is BetterFacebook RocksDB 7.5.3Test: Random FillLinux 5.10.130Linux 5.15.83Linux 6.1200K400K600K800K1000KSE +/- 10947.16, N = 3SE +/- 11892.65, N = 3SE +/- 2558.50, N = 39831999828489352851. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti -lpthread

C-Blosc

Test: blosclz shuffle

OpenBenchmarking.orgMB/s, More Is BetterC-Blosc 2.3Test: blosclz shuffleLinux 5.15.83Linux 6.1Linux 5.10.1303K6K9K12K15KSE +/- 51.78, N = 3SE +/- 27.75, N = 3SE +/- 62.87, N = 315998.615256.115238.11. (CC) gcc options: -std=gnu99 -O3 -lrt -pthread -lm

JPEG XL Decoding libjxl

CPU Threads: 1

OpenBenchmarking.orgMP/s, More Is BetterJPEG XL Decoding libjxl 0.7CPU Threads: 1Linux 5.10.130Linux 5.15.83Linux 6.1918273645SE +/- 0.06, N = 3SE +/- 0.04, N = 3SE +/- 0.02, N = 338.1737.9036.37

AOM AV1

Encoder Mode: Speed 8 Realtime - Input: Bosphorus 4K

OpenBenchmarking.orgFrames Per Second, More Is BetterAOM AV1 3.5Encoder Mode: Speed 8 Realtime - Input: Bosphorus 4KLinux 5.10.130Linux 5.15.83Linux 6.1918273645SE +/- 0.08, N = 3SE +/- 0.19, N = 3SE +/- 0.08, N = 337.8837.8636.101. (CXX) g++ options: -O3 -std=c++11 -U_FORTIFY_SOURCE -lm -lpthread

PostgreSQL

Scaling Factor: 100 - Clients: 100 - Mode: Read Write

OpenBenchmarking.orgTPS, More Is BetterPostgreSQL 15Scaling Factor: 100 - Clients: 100 - Mode: Read WriteLinux 5.15.83Linux 6.1Linux 5.10.13012K24K36K48K60KSE +/- 125.21, N = 3SE +/- 90.59, N = 3SE +/- 146.53, N = 35623054365536561. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lpthread -lrt -ldl -lm

PostgreSQL

Scaling Factor: 100 - Clients: 100 - Mode: Read Write - Average Latency

OpenBenchmarking.orgms, Fewer Is BetterPostgreSQL 15Scaling Factor: 100 - Clients: 100 - Mode: Read Write - Average LatencyLinux 5.15.83Linux 6.1Linux 5.10.1300.41940.83881.25821.67762.097SE +/- 0.004, N = 3SE +/- 0.003, N = 3SE +/- 0.005, N = 31.7791.8391.8641. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lpthread -lrt -ldl -lm

JPEG XL libjxl

Input: PNG - Quality: 80

OpenBenchmarking.orgMP/s, More Is BetterJPEG XL libjxl 0.7Input: PNG - Quality: 80Linux 5.15.83Linux 5.10.130Linux 6.1246810SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 37.717.707.361. (CXX) g++ options: -fno-rtti -funwind-tables -O3 -O2 -fPIE -pie -lm -pthread -latomic

spaCy

Model: en_core_web_trf

OpenBenchmarking.orgtokens/sec, More Is BetterspaCy 3.4.1Model: en_core_web_trfLinux 5.10.130Linux 5.15.83Linux 6.15001000150020002500SE +/- 9.87, N = 3SE +/- 6.33, N = 3SE +/- 7.51, N = 3244624162341

libavif avifenc

Encoder Speed: 10, Lossless

OpenBenchmarking.orgSeconds, Fewer Is Betterlibavif avifenc 0.11Encoder Speed: 10, LosslessLinux 5.10.130Linux 5.15.83Linux 6.1246810SE +/- 0.021, N = 3SE +/- 0.017, N = 3SE +/- 0.029, N = 36.6376.6666.9091. (CXX) g++ options: -O3 -fPIC -lm

Stargate Digital Audio Workstation

Sample Rate: 44100 - Buffer Size: 512

OpenBenchmarking.orgRender Ratio, More Is BetterStargate Digital Audio Workstation 22.11.5Sample Rate: 44100 - Buffer Size: 512Linux 5.15.83Linux 5.10.130Linux 6.10.89381.78762.68143.57524.469SE +/- 0.017996, N = 3SE +/- 0.028488, N = 3SE +/- 0.063340, N = 33.9725913.9095523.8172681. (CXX) g++ options: -lpthread -lsndfile -lm -O3 -march=native -ffast-math -funroll-loops -fstrength-reduce -fstrict-aliasing -finline-functions

GraphicsMagick

Operation: Noise-Gaussian

OpenBenchmarking.orgIterations Per Minute, More Is BetterGraphicsMagick 1.3.38Operation: Noise-GaussianLinux 5.10.130Linux 5.15.83Linux 6.170140210280350SE +/- 1.76, N = 33353313221. (CC) gcc options: -fopenmp -O2 -pthread -ljbig -lwebp -lwebpmux -ltiff -lfreetype -ljpeg -lXext -lSM -lICE -lX11 -llzma -lbz2 -lxml2 -lz -lm -lpthread

ClickHouse

100M Rows Web Analytics Dataset, Second Run

OpenBenchmarking.orgQueries Per Minute, Geo Mean, More Is BetterClickHouse 22.5.4.19100M Rows Web Analytics Dataset, Second RunLinux 5.10.130Linux 5.15.83Linux 6.150100150200250SE +/- 0.88, N = 15SE +/- 1.25, N = 14SE +/- 4.28, N = 3212.60209.58204.43MIN: 22.96 / MAX: 20000MIN: 22.65 / MAX: 20000MIN: 22.33 / MAX: 200001. ClickHouse server version 22.5.4.19 (official build).

NCNN

Target: CPU - Model: blazeface

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20220729Target: CPU - Model: blazefaceLinux 5.15.83Linux 6.1Linux 5.10.1300.53551.0711.60652.1422.6775SE +/- 0.00, N = 6SE +/- 0.01, N = 3SE +/- 0.01, N = 32.292.362.38MIN: 2.23 / MAX: 3.1MIN: 2.3 / MAX: 2.62MIN: 2.2 / MAX: 2.751. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

C-Blosc

Test: blosclz bitshuffle

OpenBenchmarking.orgMB/s, More Is BetterC-Blosc 2.3Test: blosclz bitshuffleLinux 5.15.83Linux 6.1Linux 5.10.1302K4K6K8K10KSE +/- 12.20, N = 3SE +/- 25.18, N = 3SE +/- 20.30, N = 310555.710161.310158.91. (CC) gcc options: -std=gnu99 -O3 -lrt -pthread -lm

Facebook RocksDB

Test: Read While Writing

OpenBenchmarking.orgOp/s, More Is BetterFacebook RocksDB 7.5.3Test: Read While WritingLinux 5.10.130Linux 5.15.83Linux 6.1700K1400K2100K2800K3500KSE +/- 49813.03, N = 3SE +/- 29968.88, N = 3SE +/- 14227.22, N = 33100899304327929853921. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti -lpthread

ClickHouse

100M Rows Web Analytics Dataset, First Run / Cold Cache

OpenBenchmarking.orgQueries Per Minute, Geo Mean, More Is BetterClickHouse 22.5.4.19100M Rows Web Analytics Dataset, First Run / Cold CacheLinux 5.10.130Linux 5.15.83Linux 6.150100150200250SE +/- 1.55, N = 15SE +/- 1.58, N = 14SE +/- 0.88, N = 3205.76204.26198.51MIN: 22.01 / MAX: 20000MIN: 22.52 / MAX: 20000MIN: 22.14 / MAX: 200001. ClickHouse server version 22.5.4.19 (official build).

Timed Linux Kernel Compilation

Build: defconfig

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed Linux Kernel Compilation 6.1Build: defconfigLinux 5.10.130Linux 5.15.83Linux 6.11632486480SE +/- 0.25, N = 3SE +/- 0.24, N = 3SE +/- 0.28, N = 370.1770.4972.56

Neural Magic DeepSparse

Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Synchronous Single-StreamLinux 5.10.130Linux 5.15.83Linux 6.1612182430SE +/- 0.10, N = 3SE +/- 0.29, N = 3SE +/- 0.23, N = 326.0026.4826.87

Neural Magic DeepSparse

Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Synchronous Single-StreamLinux 5.10.130Linux 5.15.83Linux 6.1918273645SE +/- 0.15, N = 3SE +/- 0.41, N = 3SE +/- 0.31, N = 338.4437.7637.21

Stargate Digital Audio Workstation

Sample Rate: 96000 - Buffer Size: 512

OpenBenchmarking.orgRender Ratio, More Is BetterStargate Digital Audio Workstation 22.11.5Sample Rate: 96000 - Buffer Size: 512Linux 5.15.83Linux 5.10.130Linux 6.10.58031.16061.74092.32122.9015SE +/- 0.013088, N = 3SE +/- 0.035214, N = 3SE +/- 0.031971, N = 32.5790452.5378912.4971641. (CXX) g++ options: -lpthread -lsndfile -lm -O3 -march=native -ffast-math -funroll-loops -fstrength-reduce -fstrict-aliasing -finline-functions

Stress-NG

Test: Semaphores

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.14.06Test: SemaphoresLinux 6.1Linux 5.15.83Linux 5.10.130700K1400K2100K2800K3500KSE +/- 1806.60, N = 3SE +/- 1860.75, N = 3SE +/- 159.78, N = 33315660.883314461.383214994.831. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -laio -lapparmor -latomic -lbsd -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lrt -lsctp -lz -pthread

Stargate Digital Audio Workstation

Sample Rate: 192000 - Buffer Size: 512

OpenBenchmarking.orgRender Ratio, More Is BetterStargate Digital Audio Workstation 22.11.5Sample Rate: 192000 - Buffer Size: 512Linux 5.15.83Linux 5.10.130Linux 6.10.35260.70521.05781.41041.763SE +/- 0.017482, N = 3SE +/- 0.008212, N = 3SE +/- 0.006196, N = 31.5670491.5362551.5200401. (CXX) g++ options: -lpthread -lsndfile -lm -O3 -march=native -ffast-math -funroll-loops -fstrength-reduce -fstrict-aliasing -finline-functions

Mobile Neural Network

Model: resnet-v2-50

OpenBenchmarking.orgms, Fewer Is BetterMobile Neural Network 2.1Model: resnet-v2-50Linux 5.15.83Linux 6.1Linux 5.10.1303691215SE +/- 0.025, N = 3SE +/- 0.037, N = 9SE +/- 0.099, N = 39.8509.93210.148MIN: 9.74 / MAX: 31.53MIN: 9.74 / MAX: 23.92MIN: 9.88 / MAX: 23.71. (CXX) g++ options: -std=c++11 -O3 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl

Timed Linux Kernel Compilation

Build: allmodconfig

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed Linux Kernel Compilation 6.1Build: allmodconfigLinux 5.10.130Linux 5.15.83Linux 6.12004006008001000SE +/- 0.08, N = 3SE +/- 1.08, N = 3SE +/- 0.78, N = 3907.75911.08934.27

Stargate Digital Audio Workstation

Sample Rate: 44100 - Buffer Size: 1024

OpenBenchmarking.orgRender Ratio, More Is BetterStargate Digital Audio Workstation 22.11.5Sample Rate: 44100 - Buffer Size: 1024Linux 5.15.83Linux 5.10.130Linux 6.10.9971.9942.9913.9884.985SE +/- 0.011431, N = 3SE +/- 0.002245, N = 3SE +/- 0.047576, N = 34.4310984.3858934.3113821. (CXX) g++ options: -lpthread -lsndfile -lm -O3 -march=native -ffast-math -funroll-loops -fstrength-reduce -fstrict-aliasing -finline-functions

NCNN

Target: CPU - Model: resnet50

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20220729Target: CPU - Model: resnet50Linux 6.1Linux 5.10.130Linux 5.15.8348121620SE +/- 0.13, N = 3SE +/- 0.05, N = 3SE +/- 0.34, N = 613.8314.2014.21MIN: 13.51 / MAX: 26.19MIN: 13.99 / MAX: 15.03MIN: 13.45 / MAX: 157.721. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

Mobile Neural Network

Model: MobileNetV2_224

OpenBenchmarking.orgms, Fewer Is BetterMobile Neural Network 2.1Model: MobileNetV2_224Linux 5.15.83Linux 6.1Linux 5.10.1300.86741.73482.60223.46964.337SE +/- 0.020, N = 3SE +/- 0.020, N = 9SE +/- 0.007, N = 33.7523.8313.855MIN: 3.56 / MAX: 17.6MIN: 3.59 / MAX: 5.87MIN: 3.65 / MAX: 16.531. (CXX) g++ options: -std=c++11 -O3 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl

Mobile Neural Network

Model: squeezenetv1.1

OpenBenchmarking.orgms, Fewer Is BetterMobile Neural Network 2.1Model: squeezenetv1.1Linux 5.15.83Linux 5.10.130Linux 6.10.58641.17281.75922.34562.932SE +/- 0.015, N = 3SE +/- 0.020, N = 3SE +/- 0.012, N = 92.5372.5922.606MIN: 2.47 / MAX: 4.14MIN: 2.48 / MAX: 5.22MIN: 2.49 / MAX: 16.461. (CXX) g++ options: -std=c++11 -O3 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl

Numenta Anomaly Benchmark

Detector: KNN CAD

OpenBenchmarking.orgSeconds, Fewer Is BetterNumenta Anomaly Benchmark 1.1Detector: KNN CADLinux 6.1Linux 5.15.83Linux 5.10.1304080120160200SE +/- 0.44, N = 3SE +/- 0.59, N = 3SE +/- 0.84, N = 3180.52182.66185.33

GraphicsMagick

Operation: Resizing

OpenBenchmarking.orgIterations Per Minute, More Is BetterGraphicsMagick 1.3.38Operation: ResizingLinux 5.10.130Linux 5.15.83Linux 6.130060090012001500SE +/- 7.42, N = 3SE +/- 2.73, N = 3SE +/- 2.91, N = 31333132112991. (CC) gcc options: -fopenmp -O2 -pthread -ljbig -lwebp -lwebpmux -ltiff -lfreetype -ljpeg -lXext -lSM -lICE -lX11 -llzma -lbz2 -lxml2 -lz -lm -lpthread

Neural Magic DeepSparse

Model: NLP Text Classification, DistilBERT mnli - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: NLP Text Classification, DistilBERT mnli - Scenario: Synchronous Single-StreamLinux 5.10.130Linux 5.15.83Linux 6.11632486480SE +/- 0.65, N = 3SE +/- 0.33, N = 3SE +/- 0.51, N = 373.6072.0671.89

Neural Magic DeepSparse

Model: NLP Text Classification, DistilBERT mnli - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: NLP Text Classification, DistilBERT mnli - Scenario: Synchronous Single-StreamLinux 5.10.130Linux 5.15.83Linux 6.148121620SE +/- 0.12, N = 3SE +/- 0.06, N = 3SE +/- 0.10, N = 313.5813.8713.90

Timed Erlang/OTP Compilation

Time To Compile

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed Erlang/OTP Compilation 25.0Time To CompileLinux 5.10.130Linux 5.15.83Linux 6.120406080100SE +/- 0.08, N = 3SE +/- 0.17, N = 3SE +/- 0.08, N = 391.5691.7593.74

oneDNN

Harness: Deconvolution Batch shapes_3d - Data Type: u8s8f32 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.7Harness: Deconvolution Batch shapes_3d - Data Type: u8s8f32 - Engine: CPULinux 6.1Linux 5.15.83Linux 5.10.1300.19160.38320.57480.76640.958SE +/- 0.003867, N = 3SE +/- 0.010105, N = 3SE +/- 0.006451, N = 30.8318660.8465430.851455MIN: 0.81MIN: 0.82MIN: 0.831. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -lpthread -ldl

Neural Magic DeepSparse

Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-StreamLinux 5.10.130Linux 5.15.83Linux 6.1306090120150SE +/- 0.30, N = 3SE +/- 0.74, N = 3SE +/- 0.43, N = 3144.01146.95147.38

Neural Magic DeepSparse

Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-StreamLinux 5.10.130Linux 5.15.83Linux 6.11224364860SE +/- 0.12, N = 3SE +/- 0.27, N = 3SE +/- 0.16, N = 355.5454.4354.27

OSPRay Studio

Camera: 3 - Resolution: 1080p - Samples Per Pixel: 32 - Renderer: Path Tracer

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.11Camera: 3 - Resolution: 1080p - Samples Per Pixel: 32 - Renderer: Path TracerLinux 5.15.83Linux 5.10.130Linux 6.120K40K60K80K100KSE +/- 75.54, N = 3SE +/- 96.91, N = 3SE +/- 964.72, N = 67799778016798041. (CXX) g++ options: -O3 -lm -ldl -lpthread -pthread

NCNN

Target: CPU - Model: yolov4-tiny

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20220729Target: CPU - Model: yolov4-tinyLinux 6.1Linux 5.10.130Linux 5.15.83612182430SE +/- 0.09, N = 3SE +/- 0.07, N = 3SE +/- 0.39, N = 623.3523.6023.89MIN: 23.01 / MAX: 26.25MIN: 23.16 / MAX: 27.3MIN: 22.91 / MAX: 31.781. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

GraphicsMagick

Operation: Swirl

OpenBenchmarking.orgIterations Per Minute, More Is BetterGraphicsMagick 1.3.38Operation: SwirlLinux 5.10.130Linux 5.15.83Linux 6.1110220330440550SE +/- 2.40, N = 3SE +/- 1.53, N = 3SE +/- 1.53, N = 35024994911. (CC) gcc options: -fopenmp -O2 -pthread -ljbig -lwebp -lwebpmux -ltiff -lfreetype -ljpeg -lXext -lSM -lICE -lX11 -llzma -lbz2 -lxml2 -lz -lm -lpthread

Timed Godot Game Engine Compilation

Time To Compile

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed Godot Game Engine Compilation 3.2.3Time To CompileLinux 5.10.130Linux 5.15.83Linux 6.120406080100SE +/- 0.21, N = 3SE +/- 0.35, N = 3SE +/- 0.17, N = 397.2597.5799.42

NCNN

Target: CPU - Model: squeezenet_ssd

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20220729Target: CPU - Model: squeezenet_ssdLinux 6.1Linux 5.15.83Linux 5.10.13048121620SE +/- 0.14, N = 3SE +/- 0.12, N = 6SE +/- 0.12, N = 316.7616.8517.13MIN: 16.41 / MAX: 17.26MIN: 16.41 / MAX: 19.23MIN: 16.75 / MAX: 17.861. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

srsRAN

Test: 4G PHY_DL_Test 100 PRB MIMO 256-QAM

OpenBenchmarking.orgeNb Mb/s, More Is BettersrsRAN 22.04.1Test: 4G PHY_DL_Test 100 PRB MIMO 256-QAMLinux 5.15.83Linux 6.1Linux 5.10.13070140210280350SE +/- 0.22, N = 3SE +/- 0.35, N = 3SE +/- 1.79, N = 3310.0307.4303.41. (CXX) g++ options: -std=c++14 -fno-strict-aliasing -march=native -mfpmath=sse -mavx2 -fvisibility=hidden -O3 -fno-trapping-math -fno-math-errno -mavx512f -mavx512cd -mavx512bw -mavx512dq -lpthread -ldl -lm

SVT-AV1

Encoder Mode: Preset 12 - Input: Bosphorus 1080p

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.4Encoder Mode: Preset 12 - Input: Bosphorus 1080pLinux 5.15.83Linux 5.10.130Linux 6.190180270360450SE +/- 0.85, N = 3SE +/- 0.88, N = 3SE +/- 2.62, N = 3418.02415.14409.131. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

Stargate Digital Audio Workstation

Sample Rate: 96000 - Buffer Size: 1024

OpenBenchmarking.orgRender Ratio, More Is BetterStargate Digital Audio Workstation 22.11.5Sample Rate: 96000 - Buffer Size: 1024Linux 5.15.83Linux 6.1Linux 5.10.1300.68931.37862.06792.75723.4465SE +/- 0.004654, N = 3SE +/- 0.021684, N = 3SE +/- 0.016716, N = 33.0635113.0125852.9996111. (CXX) g++ options: -lpthread -lsndfile -lm -O3 -march=native -ffast-math -funroll-loops -fstrength-reduce -fstrict-aliasing -finline-functions

Neural Magic DeepSparse

Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Synchronous Single-StreamLinux 5.10.130Linux 6.1Linux 5.15.83612182430SE +/- 0.14, N = 3SE +/- 0.11, N = 3SE +/- 0.27, N = 722.8423.0723.31

Neural Magic DeepSparse

Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Synchronous Single-StreamLinux 5.10.130Linux 6.1Linux 5.15.831020304050SE +/- 0.26, N = 3SE +/- 0.21, N = 3SE +/- 0.47, N = 743.7643.3242.90

OpenVINO

Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.2.devModel: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPULinux 5.10.130Linux 5.15.83Linux 6.10.11480.22960.34440.45920.574SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 30.500.500.51MIN: 0.31 / MAX: 16.57MIN: 0.31 / MAX: 28.92MIN: 0.32 / MAX: 15.061. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -flto -shared

OpenVINO

Model: Vehicle Detection FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.2.devModel: Vehicle Detection FP16 - Device: CPULinux 5.15.83Linux 5.10.130Linux 6.1714212835SE +/- 0.01, N = 3SE +/- 0.12, N = 3SE +/- 0.14, N = 329.2929.3729.86MIN: 13.39 / MAX: 49.34MIN: 11.56 / MAX: 50.23MIN: 11.2 / MAX: 55.831. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -flto -shared

OpenVINO

Model: Vehicle Detection FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.2.devModel: Vehicle Detection FP16 - Device: CPULinux 5.15.83Linux 5.10.130Linux 6.160120180240300SE +/- 0.06, N = 3SE +/- 1.08, N = 3SE +/- 1.20, N = 3272.80272.09267.621. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -flto -shared

JPEG XL libjxl

Input: JPEG - Quality: 100

OpenBenchmarking.orgMP/s, More Is BetterJPEG XL libjxl 0.7Input: JPEG - Quality: 100Linux 5.15.83Linux 5.10.130Linux 6.10.11930.23860.35790.47720.5965SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 30.530.530.521. (CXX) g++ options: -fno-rtti -funwind-tables -O3 -O2 -fPIE -pie -lm -pthread -latomic

Stargate Digital Audio Workstation

Sample Rate: 480000 - Buffer Size: 512

OpenBenchmarking.orgRender Ratio, More Is BetterStargate Digital Audio Workstation 22.11.5Sample Rate: 480000 - Buffer Size: 512Linux 5.15.83Linux 5.10.130Linux 6.10.85281.70562.55843.41124.264SE +/- 0.052597, N = 3SE +/- 0.019070, N = 3SE +/- 0.044488, N = 33.7903213.7269333.7188121. (CXX) g++ options: -lpthread -lsndfile -lm -O3 -march=native -ffast-math -funroll-loops -fstrength-reduce -fstrict-aliasing -finline-functions

JPEG XL libjxl

Input: PNG - Quality: 100

OpenBenchmarking.orgMP/s, More Is BetterJPEG XL libjxl 0.7Input: PNG - Quality: 100Linux 5.15.83Linux 5.10.130Linux 6.10.12150.2430.36450.4860.6075SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 30.540.540.531. (CXX) g++ options: -fno-rtti -funwind-tables -O3 -O2 -fPIE -pie -lm -pthread -latomic

Numenta Anomaly Benchmark

Detector: Relative Entropy

OpenBenchmarking.orgSeconds, Fewer Is BetterNumenta Anomaly Benchmark 1.1Detector: Relative EntropyLinux 6.1Linux 5.10.130Linux 5.15.8348121620SE +/- 0.19, N = 3SE +/- 0.27, N = 3SE +/- 0.09, N = 315.5315.8015.81

SVT-AV1

Encoder Mode: Preset 13 - Input: Bosphorus 4K

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.4Encoder Mode: Preset 13 - Input: Bosphorus 4KLinux 5.15.83Linux 6.1Linux 5.10.130306090120150SE +/- 0.32, N = 3SE +/- 0.62, N = 3SE +/- 0.69, N = 3122.98121.60120.791. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

NCNN

Target: CPU - Model: mobilenet

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20220729Target: CPU - Model: mobilenetLinux 6.1Linux 5.10.130Linux 5.15.8348121620SE +/- 0.01, N = 3SE +/- 0.03, N = 3SE +/- 0.18, N = 614.4514.5414.71MIN: 14.31 / MAX: 15.47MIN: 14.37 / MAX: 17.06MIN: 14.26 / MAX: 15.751. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

libavif avifenc

Encoder Speed: 6, Lossless

OpenBenchmarking.orgSeconds, Fewer Is Betterlibavif avifenc 0.11Encoder Speed: 6, LosslessLinux 5.10.130Linux 5.15.83Linux 6.13691215SE +/- 0.04, N = 3SE +/- 0.01, N = 3SE +/- 0.02, N = 311.3811.4311.581. (CXX) g++ options: -O3 -fPIC -lm

OpenVINO

Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.2.devModel: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPULinux 5.10.130Linux 5.15.83Linux 6.17K14K21K28K35KSE +/- 85.59, N = 3SE +/- 38.88, N = 3SE +/- 16.23, N = 331167.8131007.3830632.461. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -flto -shared

Stress-NG

Test: Memory Copying

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.14.06Test: Memory CopyingLinux 5.10.130Linux 6.1Linux 5.15.839001800270036004500SE +/- 31.35, N = 3SE +/- 29.72, N = 3SE +/- 42.48, N = 34201.024181.804129.341. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -laio -lapparmor -latomic -lbsd -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lrt -lsctp -lz -pthread

Stargate Digital Audio Workstation

Sample Rate: 480000 - Buffer Size: 1024

OpenBenchmarking.orgRender Ratio, More Is BetterStargate Digital Audio Workstation 22.11.5Sample Rate: 480000 - Buffer Size: 1024Linux 5.15.83Linux 6.1Linux 5.10.1300.9611.9222.8833.8444.805SE +/- 0.015411, N = 3SE +/- 0.017869, N = 3SE +/- 0.030220, N = 34.2708974.2088804.1995681. (CXX) g++ options: -lpthread -lsndfile -lm -O3 -march=native -ffast-math -funroll-loops -fstrength-reduce -fstrict-aliasing -finline-functions

Timed CPython Compilation

Build Configuration: Default

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed CPython Compilation 3.10.6Build Configuration: DefaultLinux 5.10.130Linux 5.15.83Linux 6.151015202519.4519.4919.78

libavif avifenc

Encoder Speed: 6

OpenBenchmarking.orgSeconds, Fewer Is Betterlibavif avifenc 0.11Encoder Speed: 6Linux 5.10.130Linux 5.15.83Linux 6.1246810SE +/- 0.059, N = 3SE +/- 0.054, N = 3SE +/- 0.036, N = 36.6896.7496.7981. (CXX) g++ options: -O3 -fPIC -lm

Mobile Neural Network

Model: nasnet

OpenBenchmarking.orgms, Fewer Is BetterMobile Neural Network 2.1Model: nasnetLinux 5.15.83Linux 5.10.130Linux 6.148121620SE +/- 0.10, N = 3SE +/- 0.12, N = 3SE +/- 0.15, N = 914.8814.9115.12MIN: 14.51 / MAX: 33.86MIN: 14.46 / MAX: 28.47MIN: 14.55 / MAX: 29.561. (CXX) g++ options: -std=c++11 -O3 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl

7-Zip Compression

Test: Compression Rating

OpenBenchmarking.orgMIPS, More Is Better7-Zip Compression 22.01Test: Compression RatingLinux 5.15.83Linux 6.1Linux 5.10.13020K40K60K80K100KSE +/- 364.72, N = 3SE +/- 526.57, N = 3SE +/- 95.64, N = 31080581069681063571. (CXX) g++ options: -lpthread -ldl -O2 -fPIC

NCNN

Target: CPU - Model: FastestDet

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20220729Target: CPU - Model: FastestDetLinux 5.15.83Linux 6.1Linux 5.10.130246810SE +/- 0.02, N = 6SE +/- 0.02, N = 3SE +/- 0.03, N = 36.916.967.02MIN: 6.78 / MAX: 7.67MIN: 6.86 / MAX: 7.19MIN: 6.87 / MAX: 7.891. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

Mobile Neural Network

Model: SqueezeNetV1.0

OpenBenchmarking.orgms, Fewer Is BetterMobile Neural Network 2.1Model: SqueezeNetV1.0Linux 5.10.130Linux 5.15.83Linux 6.11.1182.2363.3544.4725.59SE +/- 0.043, N = 3SE +/- 0.009, N = 3SE +/- 0.019, N = 94.8924.8974.969MIN: 4.79 / MAX: 17.74MIN: 4.84 / MAX: 18.25MIN: 4.87 / MAX: 7.191. (CXX) g++ options: -std=c++11 -O3 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl

srsRAN

Test: OFDM_Test

OpenBenchmarking.orgSamples / Second, More Is BettersrsRAN 22.04.1Test: OFDM_TestLinux 5.15.83Linux 5.10.130Linux 6.130M60M90M120M150MSE +/- 352766.84, N = 3SE +/- 251661.15, N = 3SE +/- 417665.47, N = 31226333331220000001207333331. (CXX) g++ options: -std=c++14 -fno-strict-aliasing -march=native -mfpmath=sse -mavx2 -fvisibility=hidden -O3 -fno-trapping-math -fno-math-errno -mavx512f -mavx512cd -mavx512bw -mavx512dq -lpthread -ldl -lm

Mobile Neural Network

Model: inception-v3

OpenBenchmarking.orgms, Fewer Is BetterMobile Neural Network 2.1Model: inception-v3Linux 5.15.83Linux 5.10.130Linux 6.1510152025SE +/- 0.38, N = 3SE +/- 0.36, N = 3SE +/- 0.32, N = 922.4422.7322.79MIN: 21.58 / MAX: 36.88MIN: 22.05 / MAX: 36.04MIN: 21.59 / MAX: 102.891. (CXX) g++ options: -std=c++11 -O3 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl

OSPRay Studio

Camera: 2 - Resolution: 4K - Samples Per Pixel: 16 - Renderer: Path Tracer

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.11Camera: 2 - Resolution: 4K - Samples Per Pixel: 16 - Renderer: Path TracerLinux 5.10.130Linux 5.15.83Linux 6.130K60K90K120K150KSE +/- 68.75, N = 3SE +/- 104.41, N = 3SE +/- 1877.65, N = 31244281245561263411. (CXX) g++ options: -O3 -lm -ldl -lpthread -pthread

TensorFlow

Device: CPU - Batch Size: 16 - Model: GoogLeNet

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.10Device: CPU - Batch Size: 16 - Model: GoogLeNetLinux 6.1Linux 5.15.83Linux 5.10.130306090120150SE +/- 0.17, N = 3SE +/- 0.10, N = 3SE +/- 0.12, N = 3116.16115.15114.41

OSPRay Studio

Camera: 2 - Resolution: 1080p - Samples Per Pixel: 32 - Renderer: Path Tracer

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.11Camera: 2 - Resolution: 1080p - Samples Per Pixel: 32 - Renderer: Path TracerLinux 5.15.83Linux 5.10.130Linux 6.115K30K45K60K75KSE +/- 44.92, N = 3SE +/- 35.09, N = 3SE +/- 539.86, N = 146681766823678371. (CXX) g++ options: -O3 -lm -ldl -lpthread -pthread

Neural Magic DeepSparse

Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-StreamLinux 5.10.130Linux 5.15.83Linux 6.13691215SE +/- 0.05, N = 3SE +/- 0.04, N = 3SE +/- 0.04, N = 310.5410.4310.38

Mobile Neural Network

Model: mobilenet-v1-1.0

OpenBenchmarking.orgms, Fewer Is BetterMobile Neural Network 2.1Model: mobilenet-v1-1.0Linux 5.15.83Linux 6.1Linux 5.10.1300.60261.20521.80782.41043.013SE +/- 0.047, N = 3SE +/- 0.028, N = 9SE +/- 0.044, N = 32.6392.6402.678MIN: 2.38 / MAX: 3.73MIN: 2.36 / MAX: 16.9MIN: 2.4 / MAX: 5.221. (CXX) g++ options: -std=c++11 -O3 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl

Cpuminer-Opt

Algorithm: Myriad-Groestl

OpenBenchmarking.orgkH/s, More Is BetterCpuminer-Opt 3.20.3Algorithm: Myriad-GroestlLinux 5.15.83Linux 6.1Linux 5.10.1304K8K12K16K20KSE +/- 185.02, N = 3SE +/- 135.32, N = 3SE +/- 286.72, N = 31761017477173631. (CXX) g++ options: -O2 -lcurl -lz -lpthread -lssl -lcrypto -lgmp

Timed Node.js Compilation

Time To Compile

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed Node.js Compilation 18.8Time To CompileLinux 5.15.83Linux 5.10.130Linux 6.1100200300400500SE +/- 0.27, N = 3SE +/- 0.23, N = 3SE +/- 0.24, N = 3453.31453.61459.75

Neural Magic DeepSparse

Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-StreamLinux 5.10.130Linux 5.15.83Linux 6.1160320480640800SE +/- 2.25, N = 3SE +/- 1.90, N = 3SE +/- 2.74, N = 3752.83760.84763.31

OpenVINO

Model: Machine Translation EN To DE FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.2.devModel: Machine Translation EN To DE FP16 - Device: CPULinux 5.10.130Linux 5.15.83Linux 6.11428425670SE +/- 0.70, N = 3SE +/- 0.24, N = 3SE +/- 0.40, N = 364.8264.2863.961. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -flto -shared

OpenVINO

Model: Machine Translation EN To DE FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.2.devModel: Machine Translation EN To DE FP16 - Device: CPULinux 5.10.130Linux 5.15.83Linux 6.1306090120150SE +/- 1.34, N = 3SE +/- 0.46, N = 3SE +/- 0.78, N = 3123.34124.34124.97MIN: 64 / MAX: 136.84MIN: 64.41 / MAX: 139.86MIN: 64.13 / MAX: 142.041. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -flto -shared

FLAC Audio Encoding

WAV To FLAC

OpenBenchmarking.orgSeconds, Fewer Is BetterFLAC Audio Encoding 1.4WAV To FLACLinux 5.15.83Linux 5.10.130Linux 6.1510152025SE +/- 0.02, N = 5SE +/- 0.03, N = 5SE +/- 0.04, N = 521.1021.1121.381. (CXX) g++ options: -O3 -fvisibility=hidden -logg -lm

Numenta Anomaly Benchmark

Detector: Bayesian Changepoint

OpenBenchmarking.orgSeconds, Fewer Is BetterNumenta Anomaly Benchmark 1.1Detector: Bayesian ChangepointLinux 5.10.130Linux 5.15.83Linux 6.11020304050SE +/- 0.18, N = 3SE +/- 0.21, N = 3SE +/- 0.20, N = 341.3941.4341.94

SVT-AV1

Encoder Mode: Preset 13 - Input: Bosphorus 1080p

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.4Encoder Mode: Preset 13 - Input: Bosphorus 1080pLinux 5.15.83Linux 5.10.130Linux 6.190180270360450SE +/- 1.29, N = 3SE +/- 0.82, N = 3SE +/- 1.64, N = 3425.26423.65419.751. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

GraphicsMagick

Operation: Enhanced

OpenBenchmarking.orgIterations Per Minute, More Is BetterGraphicsMagick 1.3.38Operation: EnhancedLinux 5.10.130Linux 5.15.83Linux 6.170140210280350SE +/- 0.67, N = 3SE +/- 0.67, N = 3SE +/- 0.67, N = 33153143111. (CC) gcc options: -fopenmp -O2 -pthread -ljbig -lwebp -lwebpmux -ltiff -lfreetype -ljpeg -lXext -lSM -lICE -lX11 -llzma -lbz2 -lxml2 -lz -lm -lpthread

OpenVINO

Model: Vehicle Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.2.devModel: Vehicle Detection FP16-INT8 - Device: CPULinux 5.10.130Linux 6.1Linux 5.15.832004006008001000SE +/- 5.71, N = 3SE +/- 0.69, N = 3SE +/- 1.74, N = 3969.33957.41957.081. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -flto -shared

Neural Magic DeepSparse

Model: CV Classification, ResNet-50 ImageNet - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: CV Classification, ResNet-50 ImageNet - Scenario: Synchronous Single-StreamLinux 5.15.83Linux 5.10.130Linux 6.1246810SE +/- 0.0304, N = 3SE +/- 0.0949, N = 3SE +/- 0.1212, N = 37.44087.52657.5359

OSPRay Studio

Camera: 1 - Resolution: 4K - Samples Per Pixel: 16 - Renderer: Path Tracer

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.11Camera: 1 - Resolution: 4K - Samples Per Pixel: 16 - Renderer: Path TracerLinux 5.10.130Linux 5.15.83Linux 6.130K60K90K120K150KSE +/- 26.43, N = 3SE +/- 135.52, N = 3SE +/- 1530.19, N = 51214671214861230001. (CXX) g++ options: -O3 -lm -ldl -lpthread -pthread

Timed PHP Compilation

Time To Compile

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed PHP Compilation 8.1.9Time To CompileLinux 5.15.83Linux 5.10.130Linux 6.11530456075SE +/- 0.24, N = 3SE +/- 0.32, N = 3SE +/- 0.39, N = 365.1465.3365.96

NCNN

Target: CPU - Model: shufflenet-v2

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20220729Target: CPU - Model: shufflenet-v2Linux 5.15.83Linux 6.1Linux 5.10.1301.27352.5473.82055.0946.3675SE +/- 0.01, N = 6SE +/- 0.01, N = 3SE +/- 0.02, N = 35.595.635.66MIN: 5.48 / MAX: 6.6MIN: 5.53 / MAX: 6.55MIN: 5.54 / MAX: 17.071. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

OpenVINO

Model: Person Vehicle Bike Detection FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.2.devModel: Person Vehicle Bike Detection FP16 - Device: CPULinux 6.1Linux 5.10.130Linux 5.15.83110220330440550SE +/- 4.29, N = 11SE +/- 4.00, N = 13SE +/- 4.62, N = 3491.24485.36485.191. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -flto -shared

NCNN

Target: CPU - Model: mnasnet

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20220729Target: CPU - Model: mnasnetLinux 5.15.83Linux 6.1Linux 5.10.1301.10482.20963.31444.41925.524SE +/- 0.00, N = 6SE +/- 0.01, N = 3SE +/- 0.03, N = 34.854.894.91MIN: 4.72 / MAX: 7.62MIN: 4.81 / MAX: 5.21MIN: 4.74 / MAX: 16.511. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

OpenVINO

Model: Person Vehicle Bike Detection FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.2.devModel: Person Vehicle Bike Detection FP16 - Device: CPULinux 6.1Linux 5.15.83Linux 5.10.13048121620SE +/- 0.15, N = 11SE +/- 0.16, N = 3SE +/- 0.14, N = 1316.2716.4616.47MIN: 7.67 / MAX: 36.05MIN: 9.28 / MAX: 33.36MIN: 7.86 / MAX: 36.141. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -flto -shared

Neural Magic DeepSparse

Model: CV Classification, ResNet-50 ImageNet - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: CV Classification, ResNet-50 ImageNet - Scenario: Synchronous Single-StreamLinux 5.15.83Linux 5.10.130Linux 6.1306090120150SE +/- 0.54, N = 3SE +/- 1.67, N = 3SE +/- 2.16, N = 3134.13132.65132.51

ClickHouse

100M Rows Web Analytics Dataset, Third Run

OpenBenchmarking.orgQueries Per Minute, Geo Mean, More Is BetterClickHouse 22.5.4.19100M Rows Web Analytics Dataset, Third RunLinux 5.15.83Linux 6.1Linux 5.10.13050100150200250SE +/- 0.78, N = 14SE +/- 1.08, N = 3SE +/- 1.01, N = 15215.02212.92212.42MIN: 22.68 / MAX: 20000MIN: 22.26 / MAX: 20000MIN: 22.81 / MAX: 200001. ClickHouse server version 22.5.4.19 (official build).

OpenVINO

Model: Vehicle Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.2.devModel: Vehicle Detection FP16-INT8 - Device: CPULinux 5.10.130Linux 6.1Linux 5.15.83246810SE +/- 0.05, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 38.248.338.34MIN: 4.42 / MAX: 23.84MIN: 4.48 / MAX: 25.96MIN: 4.49 / MAX: 23.481. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -flto -shared

TensorFlow

Device: CPU - Batch Size: 32 - Model: GoogLeNet

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.10Device: CPU - Batch Size: 32 - Model: GoogLeNetLinux 6.1Linux 5.15.83Linux 5.10.130306090120150SE +/- 0.12, N = 3SE +/- 0.12, N = 3SE +/- 0.14, N = 3123.19122.18121.72

miniBUDE

Implementation: OpenMP - Input Deck: BM1

OpenBenchmarking.orgGFInst/s, More Is BetterminiBUDE 20210901Implementation: OpenMP - Input Deck: BM1Linux 6.1Linux 5.10.130Linux 5.15.83120240360480600SE +/- 0.30, N = 3SE +/- 0.13, N = 3SE +/- 0.39, N = 3535.57530.27529.241. (CC) gcc options: -std=c99 -Ofast -ffast-math -fopenmp -march=native -lm

miniBUDE

Implementation: OpenMP - Input Deck: BM1

OpenBenchmarking.orgBillion Interactions/s, More Is BetterminiBUDE 20210901Implementation: OpenMP - Input Deck: BM1Linux 6.1Linux 5.10.130Linux 5.15.83510152025SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.02, N = 321.4221.2121.171. (CC) gcc options: -std=c99 -Ofast -ffast-math -fopenmp -march=native -lm

Cpuminer-Opt

Algorithm: Ringcoin

OpenBenchmarking.orgkH/s, More Is BetterCpuminer-Opt 3.20.3Algorithm: RingcoinLinux 5.10.130Linux 5.15.83Linux 6.16001200180024003000SE +/- 27.91, N = 3SE +/- 0.80, N = 3SE +/- 1.62, N = 32833.092812.342800.621. (CXX) g++ options: -O2 -lcurl -lz -lpthread -lssl -lcrypto -lgmp

Cpuminer-Opt

Algorithm: Blake-2 S

OpenBenchmarking.orgkH/s, More Is BetterCpuminer-Opt 3.20.3Algorithm: Blake-2 SLinux 5.15.83Linux 5.10.130Linux 6.1200K400K600K800K1000KSE +/- 10686.26, N = 3SE +/- 6874.21, N = 3SE +/- 3289.87, N = 31150583114910311375501. (CXX) g++ options: -O2 -lcurl -lz -lpthread -lssl -lcrypto -lgmp

miniBUDE

Implementation: OpenMP - Input Deck: BM2

OpenBenchmarking.orgBillion Interactions/s, More Is BetterminiBUDE 20210901Implementation: OpenMP - Input Deck: BM2Linux 6.1Linux 5.10.130Linux 5.15.83510152025SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.00, N = 321.5521.3921.321. (CC) gcc options: -std=c99 -Ofast -ffast-math -fopenmp -march=native -lm

miniBUDE

Implementation: OpenMP - Input Deck: BM2

OpenBenchmarking.orgGFInst/s, More Is BetterminiBUDE 20210901Implementation: OpenMP - Input Deck: BM2Linux 6.1Linux 5.10.130Linux 5.15.83120240360480600SE +/- 0.18, N = 3SE +/- 0.18, N = 3SE +/- 0.02, N = 3538.79534.74532.921. (CC) gcc options: -std=c99 -Ofast -ffast-math -fopenmp -march=native -lm

TensorFlow

Device: CPU - Batch Size: 16 - Model: ResNet-50

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.10Device: CPU - Batch Size: 16 - Model: ResNet-50Linux 5.15.83Linux 6.1Linux 5.10.130918273645SE +/- 0.07, N = 3SE +/- 0.02, N = 3SE +/- 0.03, N = 338.0938.0137.68

oneDNN

Harness: Convolution Batch Shapes Auto - Data Type: u8s8f32 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.7Harness: Convolution Batch Shapes Auto - Data Type: u8s8f32 - Engine: CPULinux 5.10.130Linux 6.1Linux 5.15.830.94581.89162.83743.78324.729SE +/- 0.01257, N = 3SE +/- 0.00677, N = 3SE +/- 0.00929, N = 34.158694.180964.20343MIN: 4.09MIN: 4.13MIN: 4.131. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -lpthread -ldl

Neural Magic DeepSparse

Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-StreamLinux 5.10.130Linux 5.15.83Linux 6.13691215SE +/- 0.02, N = 3SE +/- 0.06, N = 3SE +/- 0.07, N = 310.5210.4510.41

srsRAN

Test: 4G PHY_DL_Test 100 PRB MIMO 64-QAM

OpenBenchmarking.orgeNb Mb/s, More Is BettersrsRAN 22.04.1Test: 4G PHY_DL_Test 100 PRB MIMO 64-QAMLinux 5.15.83Linux 6.1Linux 5.10.13060120180240300SE +/- 0.17, N = 3SE +/- 0.27, N = 3SE +/- 0.15, N = 3282.7280.2279.81. (CXX) g++ options: -std=c++14 -fno-strict-aliasing -march=native -mfpmath=sse -mavx2 -fvisibility=hidden -O3 -fno-trapping-math -fno-math-errno -mavx512f -mavx512cd -mavx512bw -mavx512dq -lpthread -ldl -lm

AOM AV1

Encoder Mode: Speed 6 Two-Pass - Input: Bosphorus 4K

OpenBenchmarking.orgFrames Per Second, More Is BetterAOM AV1 3.5Encoder Mode: Speed 6 Two-Pass - Input: Bosphorus 4KLinux 5.15.83Linux 5.10.130Linux 6.13691215SE +/- 0.02, N = 3SE +/- 0.02, N = 3SE +/- 0.03, N = 311.7711.7011.651. (CXX) g++ options: -O3 -std=c++11 -U_FORTIFY_SOURCE -lm -lpthread

srsRAN

Test: 4G PHY_DL_Test 100 PRB MIMO 64-QAM

OpenBenchmarking.orgUE Mb/s, More Is BettersrsRAN 22.04.1Test: 4G PHY_DL_Test 100 PRB MIMO 64-QAMLinux 5.15.83Linux 5.10.130Linux 6.1306090120150SE +/- 0.07, N = 3SE +/- 0.27, N = 3SE +/- 0.03, N = 3118.3117.3117.11. (CXX) g++ options: -std=c++14 -fno-strict-aliasing -march=native -mfpmath=sse -mavx2 -fvisibility=hidden -O3 -fno-trapping-math -fno-math-errno -mavx512f -mavx512cd -mavx512bw -mavx512dq -lpthread -ldl -lm

GraphicsMagick

Operation: Sharpen

OpenBenchmarking.orgIterations Per Minute, More Is BetterGraphicsMagick 1.3.38Operation: SharpenLinux 5.15.83Linux 5.10.130Linux 6.14080120160200SE +/- 1.20, N = 3SE +/- 1.33, N = 3SE +/- 1.33, N = 31991991971. (CC) gcc options: -fopenmp -O2 -pthread -ljbig -lwebp -lwebpmux -ltiff -lfreetype -ljpeg -lXext -lSM -lICE -lX11 -llzma -lbz2 -lxml2 -lz -lm -lpthread

OpenFOAM

Input: drivaerFastback, Small Mesh Size - Execution Time

OpenBenchmarking.orgSeconds, Fewer Is BetterOpenFOAM 10Input: drivaerFastback, Small Mesh Size - Execution TimeLinux 5.15.83Linux 6.1Linux 5.10.1304080120160200186.40186.93188.281. (CXX) g++ options: -std=c++14 -m64 -O3 -ftemplate-depth-100 -fPIC -fuse-ld=bfd -Xlinker --add-needed --no-as-needed -ldynamicMesh -lgenericPatchFields -lOpenFOAM -ldl -lm

NCNN

Target: CPU - Model: efficientnet-b0

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20220729Target: CPU - Model: efficientnet-b0Linux 5.15.83Linux 6.1Linux 5.10.130246810SE +/- 0.01, N = 6SE +/- 0.01, N = 3SE +/- 0.02, N = 36.997.047.06MIN: 6.89 / MAX: 8.15MIN: 6.92 / MAX: 7.34MIN: 6.92 / MAX: 7.421. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

OSPRay Studio

Camera: 1 - Resolution: 1080p - Samples Per Pixel: 32 - Renderer: Path Tracer

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.11Camera: 1 - Resolution: 1080p - Samples Per Pixel: 32 - Renderer: Path TracerLinux 5.15.83Linux 5.10.130Linux 6.114K28K42K56K70KSE +/- 20.81, N = 3SE +/- 37.27, N = 3SE +/- 527.74, N = 36524265271658941. (CXX) g++ options: -O3 -lm -ldl -lpthread -pthread

srsRAN

Test: 4G PHY_DL_Test 100 PRB SISO 256-QAM

OpenBenchmarking.orgUE Mb/s, More Is BettersrsRAN 22.04.1Test: 4G PHY_DL_Test 100 PRB SISO 256-QAMLinux 5.15.83Linux 5.10.130Linux 6.1306090120150SE +/- 0.06, N = 3SE +/- 0.09, N = 3SE +/- 0.15, N = 3131.6131.0130.31. (CXX) g++ options: -std=c++14 -fno-strict-aliasing -march=native -mfpmath=sse -mavx2 -fvisibility=hidden -O3 -fno-trapping-math -fno-math-errno -mavx512f -mavx512cd -mavx512bw -mavx512dq -lpthread -ldl -lm

OpenVINO

Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.2.devModel: Age Gender Recognition Retail 0013 FP16 - Device: CPULinux 5.15.83Linux 5.10.130Linux 6.10.2340.4680.7020.9361.17SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 31.031.041.04MIN: 0.61 / MAX: 17.94MIN: 0.61 / MAX: 17.55MIN: 0.61 / MAX: 17.761. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -flto -shared

libavif avifenc

Encoder Speed: 2

OpenBenchmarking.orgSeconds, Fewer Is Betterlibavif avifenc 0.11Encoder Speed: 2Linux 5.10.130Linux 5.15.83Linux 6.11632486480SE +/- 0.04, N = 3SE +/- 0.41, N = 3SE +/- 0.25, N = 370.5271.0771.201. (CXX) g++ options: -O3 -fPIC -lm

Mobile Neural Network

Model: mobilenetV3

OpenBenchmarking.orgms, Fewer Is BetterMobile Neural Network 2.1Model: mobilenetV3Linux 5.15.83Linux 6.1Linux 5.10.1300.47050.9411.41151.8822.3525SE +/- 0.009, N = 3SE +/- 0.009, N = 9SE +/- 0.010, N = 32.0712.0832.091MIN: 1.99 / MAX: 4.73MIN: 1.98 / MAX: 6.07MIN: 1.99 / MAX: 3.261. (CXX) g++ options: -std=c++11 -O3 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl

NCNN

Target: CPU - Model: googlenet

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20220729Target: CPU - Model: googlenetLinux 5.15.83Linux 6.1Linux 5.10.1303691215SE +/- 0.02, N = 6SE +/- 0.02, N = 3SE +/- 0.05, N = 311.4611.4811.57MIN: 11.27 / MAX: 12.43MIN: 11.33 / MAX: 12.45MIN: 11.39 / MAX: 11.861. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

SVT-AV1

Encoder Mode: Preset 4 - Input: Bosphorus 4K

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.4Encoder Mode: Preset 4 - Input: Bosphorus 4KLinux 5.15.83Linux 5.10.130Linux 6.10.55871.11741.67612.23482.7935SE +/- 0.005, N = 3SE +/- 0.003, N = 3SE +/- 0.005, N = 32.4832.4752.4601. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

OpenRadioss

Model: Bumper Beam

OpenBenchmarking.orgSeconds, Fewer Is BetterOpenRadioss 2022.10.13Model: Bumper BeamLinux 5.15.83Linux 5.10.130Linux 6.1306090120150SE +/- 0.14, N = 3SE +/- 0.18, N = 3SE +/- 0.17, N = 3151.82152.41153.23

Xmrig

Variant: Monero - Hash Count: 1M

OpenBenchmarking.orgH/s, More Is BetterXmrig 6.18.1Variant: Monero - Hash Count: 1MLinux 5.15.83Linux 5.10.130Linux 6.115003000450060007500SE +/- 23.74, N = 3SE +/- 3.14, N = 3SE +/- 54.19, N = 36829.86794.56767.31. (CXX) g++ options: -fexceptions -fno-rtti -maes -O3 -Ofast -static-libgcc -static-libstdc++ -rdynamic -lssl -lcrypto -luv -lpthread -lrt -ldl -lhwloc

OpenVINO

Model: Person Detection FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.2.devModel: Person Detection FP16 - Device: CPULinux 5.10.130Linux 5.15.83Linux 6.10.74481.48962.23442.97923.724SE +/- 0.01, N = 3SE +/- 0.02, N = 3SE +/- 0.01, N = 33.313.303.281. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -flto -shared

BRL-CAD

VGR Performance Metric

OpenBenchmarking.orgVGR Performance Metric, More Is BetterBRL-CAD 7.32.6VGR Performance MetricLinux 6.1Linux 5.10.130Linux 5.15.8340K80K120K160K200K1683341677711668521. (CXX) g++ options: -std=c++11 -pipe -fvisibility=hidden -fno-strict-aliasing -fno-common -fexceptions -ftemplate-depth-128 -m64 -ggdb3 -O3 -fipa-pta -fstrength-reduce -finline-functions -flto -pedantic -pthread -ldl -lm

Numenta Anomaly Benchmark

Detector: Earthgecko Skyline

OpenBenchmarking.orgSeconds, Fewer Is BetterNumenta Anomaly Benchmark 1.1Detector: Earthgecko SkylineLinux 5.10.130Linux 5.15.83Linux 6.1306090120150SE +/- 0.46, N = 3SE +/- 0.35, N = 3SE +/- 0.67, N = 3114.81115.53115.83

Neural Magic DeepSparse

Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-StreamLinux 5.10.130Linux 5.15.83Linux 6.1160320480640800SE +/- 1.03, N = 3SE +/- 2.20, N = 3SE +/- 4.45, N = 3758.03759.35764.74

oneDNN

Harness: Matrix Multiply Batch Shapes Transformer - Data Type: u8s8f32 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.7Harness: Matrix Multiply Batch Shapes Transformer - Data Type: u8s8f32 - Engine: CPULinux 5.10.130Linux 6.1Linux 5.15.830.07110.14220.21330.28440.3555SE +/- 0.000694, N = 3SE +/- 0.000082, N = 3SE +/- 0.001833, N = 30.3132380.3139750.316005MIN: 0.3MIN: 0.3MIN: 0.31. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -lpthread -ldl

SVT-AV1

Encoder Mode: Preset 4 - Input: Bosphorus 1080p

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.4Encoder Mode: Preset 4 - Input: Bosphorus 1080pLinux 5.10.130Linux 6.1Linux 5.15.83246810SE +/- 0.057, N = 3SE +/- 0.044, N = 3SE +/- 0.016, N = 37.0467.0246.9851. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

srsRAN

Test: 4G PHY_DL_Test 100 PRB MIMO 256-QAM

OpenBenchmarking.orgUE Mb/s, More Is BettersrsRAN 22.04.1Test: 4G PHY_DL_Test 100 PRB MIMO 256-QAMLinux 5.15.83Linux 6.1Linux 5.10.130306090120150SE +/- 0.18, N = 3SE +/- 0.15, N = 3SE +/- 0.13, N = 3128.0127.2126.91. (CXX) g++ options: -std=c++14 -fno-strict-aliasing -march=native -mfpmath=sse -mavx2 -fvisibility=hidden -O3 -fno-trapping-math -fno-math-errno -mavx512f -mavx512cd -mavx512bw -mavx512dq -lpthread -ldl -lm

SVT-AV1

Encoder Mode: Preset 8 - Input: Bosphorus 4K

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.4Encoder Mode: Preset 8 - Input: Bosphorus 4KLinux 5.15.83Linux 6.1Linux 5.10.130816243240SE +/- 0.15, N = 3SE +/- 0.20, N = 3SE +/- 0.07, N = 334.8234.7234.521. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

NCNN

Target: CPU - Model: regnety_400m

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20220729Target: CPU - Model: regnety_400mLinux 5.15.83Linux 6.1Linux 5.10.130510152025SE +/- 0.02, N = 6SE +/- 0.03, N = 3SE +/- 0.15, N = 318.6718.7018.83MIN: 18.39 / MAX: 21.55MIN: 18.43 / MAX: 19.5MIN: 18.43 / MAX: 58.941. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

Stress-NG

Test: Atomic

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.14.06Test: AtomicLinux 6.1Linux 5.15.83Linux 5.10.13050K100K150K200K250KSE +/- 3644.44, N = 3SE +/- 1620.65, N = 3SE +/- 1447.49, N = 3225639.32225144.33223731.701. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -laio -lapparmor -latomic -lbsd -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lrt -lsctp -lz -pthread

Cpuminer-Opt

Algorithm: LBC, LBRY Credits

OpenBenchmarking.orgkH/s, More Is BetterCpuminer-Opt 3.20.3Algorithm: LBC, LBRY CreditsLinux 5.10.130Linux 5.15.83Linux 6.120K40K60K80K100KSE +/- 656.84, N = 3SE +/- 167.46, N = 3SE +/- 615.39, N = 39682096663960101. (CXX) g++ options: -O2 -lcurl -lz -lpthread -lssl -lcrypto -lgmp

SVT-AV1

Encoder Mode: Preset 12 - Input: Bosphorus 4K

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.4Encoder Mode: Preset 12 - Input: Bosphorus 4KLinux 5.15.83Linux 6.1Linux 5.10.130306090120150SE +/- 0.62, N = 3SE +/- 0.29, N = 3SE +/- 0.46, N = 3127.53126.76126.501. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

OpenFOAM

Input: drivaerFastback, Medium Mesh Size - Execution Time

OpenBenchmarking.orgSeconds, Fewer Is BetterOpenFOAM 10Input: drivaerFastback, Medium Mesh Size - Execution TimeLinux 5.10.130Linux 6.1Linux 5.15.83300600900120015001598.701607.401611.591. (CXX) g++ options: -std=c++14 -m64 -O3 -ftemplate-depth-100 -fPIC -fuse-ld=bfd -Xlinker --add-needed --no-as-needed -ldynamicMesh -lgenericPatchFields -lOpenFOAM -ldl -lm

Neural Magic DeepSparse

Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Synchronous Single-StreamLinux 5.15.83Linux 5.10.130Linux 6.120406080100SE +/- 0.39, N = 3SE +/- 0.33, N = 3SE +/- 0.93, N = 3104.01104.16104.83

OpenVINO

Model: Weld Porosity Detection FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.2.devModel: Weld Porosity Detection FP16 - Device: CPULinux 5.10.130Linux 5.15.83Linux 6.1140280420560700SE +/- 0.68, N = 3SE +/- 0.90, N = 3SE +/- 1.31, N = 3625.50623.36620.611. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -flto -shared

WebP Image Encode

Encode Settings: Quality 100, Lossless

OpenBenchmarking.orgMP/s, More Is BetterWebP Image Encode 1.2.4Encode Settings: Quality 100, LosslessLinux 5.15.83Linux 6.1Linux 5.10.1300.2880.5760.8641.1521.44SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 31.281.271.271. (CC) gcc options: -fvisibility=hidden -O2 -lm -pthread

srsRAN

Test: 4G PHY_DL_Test 100 PRB SISO 64-QAM

OpenBenchmarking.orgeNb Mb/s, More Is BettersrsRAN 22.04.1Test: 4G PHY_DL_Test 100 PRB SISO 64-QAMLinux 5.15.83Linux 6.1Linux 5.10.13060120180240300SE +/- 0.09, N = 3SE +/- 0.15, N = 3SE +/- 0.30, N = 3282.0280.3279.81. (CXX) g++ options: -std=c++14 -fno-strict-aliasing -march=native -mfpmath=sse -mavx2 -fvisibility=hidden -O3 -fno-trapping-math -fno-math-errno -mavx512f -mavx512cd -mavx512bw -mavx512dq -lpthread -ldl -lm

srsRAN

Test: 4G PHY_DL_Test 100 PRB SISO 256-QAM

OpenBenchmarking.orgeNb Mb/s, More Is BettersrsRAN 22.04.1Test: 4G PHY_DL_Test 100 PRB SISO 256-QAMLinux 5.15.83Linux 5.10.130Linux 6.170140210280350SE +/- 0.15, N = 3SE +/- 0.25, N = 3SE +/- 0.09, N = 3307.9307.0305.51. (CXX) g++ options: -std=c++14 -fno-strict-aliasing -march=native -mfpmath=sse -mavx2 -fvisibility=hidden -O3 -fno-trapping-math -fno-math-errno -mavx512f -mavx512cd -mavx512bw -mavx512dq -lpthread -ldl -lm

Neural Magic DeepSparse

Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Synchronous Single-StreamLinux 5.15.83Linux 5.10.130Linux 6.13691215SE +/- 0.0357, N = 3SE +/- 0.0301, N = 3SE +/- 0.0848, N = 39.61419.59969.5393

OpenVINO

Model: Weld Porosity Detection FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.2.devModel: Weld Porosity Detection FP16 - Device: CPULinux 5.10.130Linux 5.15.83Linux 6.1612182430SE +/- 0.03, N = 3SE +/- 0.04, N = 3SE +/- 0.06, N = 325.5325.6225.73MIN: 13.67 / MAX: 47.14MIN: 14.62 / MAX: 46.69MIN: 14.41 / MAX: 47.881. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -flto -shared

OpenFOAM

Input: drivaerFastback, Small Mesh Size - Mesh Time

OpenBenchmarking.orgSeconds, Fewer Is BetterOpenFOAM 10Input: drivaerFastback, Small Mesh Size - Mesh TimeLinux 5.15.83Linux 6.1Linux 5.10.13091827364538.2438.3638.541. (CXX) g++ options: -std=c++14 -m64 -O3 -ftemplate-depth-100 -fPIC -fuse-ld=bfd -Xlinker --add-needed --no-as-needed -ldynamicMesh -lgenericPatchFields -lOpenFOAM -ldl -lm

WebP Image Encode

Encode Settings: Quality 100

OpenBenchmarking.orgMP/s, More Is BetterWebP Image Encode 1.2.4Encode Settings: Quality 100Linux 5.15.83Linux 5.10.130Linux 6.13691215SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.01, N = 39.029.008.951. (CC) gcc options: -fvisibility=hidden -O2 -lm -pthread

OpenVINO

Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.2.devModel: Age Gender Recognition Retail 0013 FP16 - Device: CPULinux 5.10.130Linux 5.15.83Linux 6.13K6K9K12K15KSE +/- 110.56, N = 3SE +/- 108.60, N = 3SE +/- 96.54, N = 315259.8615258.5615144.321. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -flto -shared

spaCy

Model: en_core_web_lg

OpenBenchmarking.orgtokens/sec, More Is BetterspaCy 3.4.1Model: en_core_web_lgLinux 5.10.130Linux 5.15.83Linux 6.12K4K6K8K10KSE +/- 15.62, N = 3SE +/- 10.74, N = 3SE +/- 18.76, N = 3113141123611231

Cpuminer-Opt

Algorithm: Quad SHA-256, Pyrite

OpenBenchmarking.orgkH/s, More Is BetterCpuminer-Opt 3.20.3Algorithm: Quad SHA-256, PyriteLinux 5.10.130Linux 5.15.83Linux 6.150K100K150K200K250KSE +/- 820.33, N = 3SE +/- 6.67, N = 3SE +/- 258.61, N = 32188302184932172371. (CXX) g++ options: -O2 -lcurl -lz -lpthread -lssl -lcrypto -lgmp

oneDNN

Harness: Matrix Multiply Batch Shapes Transformer - Data Type: f32 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.7Harness: Matrix Multiply Batch Shapes Transformer - Data Type: f32 - Engine: CPULinux 5.10.130Linux 5.15.83Linux 6.10.21680.43360.65040.86721.084SE +/- 0.001517, N = 3SE +/- 0.003629, N = 3SE +/- 0.002932, N = 30.9563990.9616820.963400MIN: 0.93MIN: 0.93MIN: 0.931. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -lpthread -ldl

NCNN

Target: CPU-v2-v2 - Model: mobilenet-v2

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20220729Target: CPU-v2-v2 - Model: mobilenet-v2Linux 5.15.83Linux 5.10.130Linux 6.11.25332.50663.75995.01326.2665SE +/- 0.01, N = 6SE +/- 0.01, N = 3SE +/- 0.01, N = 35.535.565.57MIN: 5.41 / MAX: 10.99MIN: 5.44 / MAX: 6.03MIN: 5.49 / MAX: 6.181. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

OpenRadioss

Model: Rubber O-Ring Seal Installation

OpenBenchmarking.orgSeconds, Fewer Is BetterOpenRadioss 2022.10.13Model: Rubber O-Ring Seal InstallationLinux 5.15.83Linux 5.10.130Linux 6.14080120160200SE +/- 0.22, N = 3SE +/- 0.08, N = 3SE +/- 0.29, N = 3159.15159.75160.27

OpenRadioss

Model: INIVOL and Fluid Structure Interaction Drop Container

OpenBenchmarking.orgSeconds, Fewer Is BetterOpenRadioss 2022.10.13Model: INIVOL and Fluid Structure Interaction Drop ContainerLinux 5.10.130Linux 5.15.83Linux 6.1100200300400500SE +/- 0.39, N = 3SE +/- 0.43, N = 3SE +/- 0.46, N = 3443.72445.17446.66

WebP Image Encode

Encode Settings: Quality 100, Highest Compression

OpenBenchmarking.orgMP/s, More Is BetterWebP Image Encode 1.2.4Encode Settings: Quality 100, Highest CompressionLinux 5.15.83Linux 6.1Linux 5.10.1300.69531.39062.08592.78123.4765SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.02, N = 33.093.083.071. (CC) gcc options: -fvisibility=hidden -O2 -lm -pthread

Y-Cruncher

Pi Digits To Calculate: 500M

OpenBenchmarking.orgSeconds, Fewer Is BetterY-Cruncher 0.7.10.9513Pi Digits To Calculate: 500MLinux 6.1Linux 5.10.130Linux 5.15.833691215SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 311.2911.3511.37

OpenVINO

Model: Person Detection FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.2.devModel: Person Detection FP16 - Device: CPULinux 5.10.130Linux 5.15.83Linux 6.15001000150020002500SE +/- 6.79, N = 3SE +/- 6.63, N = 3SE +/- 4.48, N = 32400.022401.742415.31MIN: 1971.05 / MAX: 2519.43MIN: 2074.14 / MAX: 2532.54MIN: 2186.01 / MAX: 2533.331. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -flto -shared

Cpuminer-Opt

Algorithm: Triple SHA-256, Onecoin

OpenBenchmarking.orgkH/s, More Is BetterCpuminer-Opt 3.20.3Algorithm: Triple SHA-256, OnecoinLinux 5.10.130Linux 6.1Linux 5.15.8370K140K210K280K350KSE +/- 2642.36, N = 3SE +/- 2222.66, N = 3SE +/- 661.12, N = 33159133157233139171. (CXX) g++ options: -O2 -lcurl -lz -lpthread -lssl -lcrypto -lgmp

oneDNN

Harness: Recurrent Neural Network Inference - Data Type: u8s8f32 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.7Harness: Recurrent Neural Network Inference - Data Type: u8s8f32 - Engine: CPULinux 5.15.83Linux 5.10.130Linux 6.12004006008001000SE +/- 0.73, N = 3SE +/- 1.27, N = 3SE +/- 2.67, N = 3908.19911.82913.94MIN: 904.52MIN: 907.5MIN: 907.081. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -lpthread -ldl

Stress-NG

Test: CPU Stress

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.14.06Test: CPU StressLinux 5.10.130Linux 5.15.83Linux 6.17K14K21K28K35KSE +/- 248.24, N = 14SE +/- 3.47, N = 3SE +/- 27.28, N = 334273.5234238.7734059.431. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -laio -lapparmor -latomic -lbsd -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lrt -lsctp -lz -pthread

nekRS

Input: TurboPipe Periodic

OpenBenchmarking.orgFLOP/s, More Is BetternekRS 22.0Input: TurboPipe PeriodicLinux 5.15.83Linux 5.10.130Linux 6.115000M30000M45000M60000M75000MSE +/- 219477639.96, N = 3SE +/- 144216808.24, N = 3SE +/- 48731133.10, N = 37092363333370649766667704815000001. (CXX) g++ options: -fopenmp -O2 -march=native -mtune=native -ftree-vectorize -pthread -lmpi_cxx -lmpi

OpenVINO

Model: Person Detection FP32 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.2.devModel: Person Detection FP32 - Device: CPULinux 5.15.83Linux 5.10.130Linux 6.10.73131.46262.19392.92523.6565SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 33.253.253.231. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -flto -shared

Numenta Anomaly Benchmark

Detector: Windowed Gaussian

OpenBenchmarking.orgSeconds, Fewer Is BetterNumenta Anomaly Benchmark 1.1Detector: Windowed GaussianLinux 5.15.83Linux 5.10.130Linux 6.13691215SE +/- 0.045, N = 3SE +/- 0.038, N = 3SE +/- 0.037, N = 39.0189.0709.073

OpenVINO

Model: Person Detection FP32 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.2.devModel: Person Detection FP32 - Device: CPULinux 5.10.130Linux 5.15.83Linux 6.15001000150020002500SE +/- 6.93, N = 3SE +/- 9.26, N = 3SE +/- 5.75, N = 32436.302441.672451.10MIN: 2086.23 / MAX: 2572.2MIN: 2123.66 / MAX: 2621.99MIN: 2080.43 / MAX: 2583.811. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -flto -shared

NCNN

Target: CPU - Model: vision_transformer

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20220729Target: CPU - Model: vision_transformerLinux 5.10.130Linux 6.1Linux 5.15.834080120160200SE +/- 0.96, N = 3SE +/- 0.61, N = 3SE +/- 0.40, N = 6160.27160.39161.23MIN: 158.5 / MAX: 166.42MIN: 158.59 / MAX: 172.13MIN: 158.43 / MAX: 179.561. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

oneDNN

Harness: Convolution Batch Shapes Auto - Data Type: f32 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.7Harness: Convolution Batch Shapes Auto - Data Type: f32 - Engine: CPULinux 6.1Linux 5.10.130Linux 5.15.830.97021.94042.91063.88084.851SE +/- 0.00632, N = 3SE +/- 0.00912, N = 3SE +/- 0.01348, N = 34.286184.291534.31178MIN: 4.24MIN: 4.25MIN: 4.241. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -lpthread -ldl

OpenFOAM

Input: drivaerFastback, Medium Mesh Size - Mesh Time

OpenBenchmarking.orgSeconds, Fewer Is BetterOpenFOAM 10Input: drivaerFastback, Medium Mesh Size - Mesh TimeLinux 5.10.130Linux 5.15.83Linux 6.150100150200250241.49242.25242.921. (CXX) g++ options: -std=c++14 -m64 -O3 -ftemplate-depth-100 -fPIC -fuse-ld=bfd -Xlinker --add-needed --no-as-needed -ldynamicMesh -lgenericPatchFields -lOpenFOAM -ldl -lm

Cpuminer-Opt

Algorithm: Skeincoin

OpenBenchmarking.orgkH/s, More Is BetterCpuminer-Opt 3.20.3Algorithm: SkeincoinLinux 5.10.130Linux 5.15.83Linux 6.130K60K90K120K150KSE +/- 169.54, N = 3SE +/- 3.33, N = 3SE +/- 283.78, N = 31351031348331343201. (CXX) g++ options: -O2 -lcurl -lz -lpthread -lssl -lcrypto -lgmp

TensorFlow

Device: CPU - Batch Size: 64 - Model: GoogLeNet

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.10Device: CPU - Batch Size: 64 - Model: GoogLeNetLinux 6.1Linux 5.15.83Linux 5.10.130306090120150SE +/- 0.18, N = 3SE +/- 0.14, N = 3SE +/- 0.05, N = 3126.49126.29125.79

Cpuminer-Opt

Algorithm: Deepcoin

OpenBenchmarking.orgkH/s, More Is BetterCpuminer-Opt 3.20.3Algorithm: DeepcoinLinux 5.15.83Linux 5.10.130Linux 6.13K6K9K12K15KSE +/- 50.00, N = 3SE +/- 46.67, N = 31450014497144201. (CXX) g++ options: -O2 -lcurl -lz -lpthread -lssl -lcrypto -lgmp

Stress-NG

Test: Glibc C String Functions

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.14.06Test: Glibc C String FunctionsLinux 6.1Linux 5.15.83Linux 5.10.130200K400K600K800K1000KSE +/- 8664.27, N = 3SE +/- 3709.52, N = 3SE +/- 6508.49, N = 3916843.52916397.13911917.941. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -laio -lapparmor -latomic -lbsd -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lrt -lsctp -lz -pthread

Timed CPython Compilation

Build Configuration: Released Build, PGO + LTO Optimized

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed CPython Compilation 3.10.6Build Configuration: Released Build, PGO + LTO OptimizedLinux 5.10.130Linux 5.15.83Linux 6.180160240320400383.51383.96385.50

Blender

Blend File: Classroom - Compute: CPU-Only

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 3.4Blend File: Classroom - Compute: CPU-OnlyLinux 5.15.83Linux 5.10.130Linux 6.170140210280350SE +/- 0.22, N = 3SE +/- 0.37, N = 3SE +/- 0.49, N = 3317.07318.28318.71

oneDNN

Harness: IP Shapes 3D - Data Type: f32 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.7Harness: IP Shapes 3D - Data Type: f32 - Engine: CPULinux 5.15.83Linux 6.1Linux 5.10.1300.69781.39562.09342.79123.489SE +/- 0.01196, N = 3SE +/- 0.00478, N = 3SE +/- 0.00480, N = 33.085613.094333.10144MIN: 3.05MIN: 3.06MIN: 3.061. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -lpthread -ldl

oneDNN

Harness: Deconvolution Batch shapes_3d - Data Type: f32 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.7Harness: Deconvolution Batch shapes_3d - Data Type: f32 - Engine: CPULinux 5.15.83Linux 5.10.130Linux 6.10.74531.49062.23592.98123.7265SE +/- 0.00438, N = 3SE +/- 0.00465, N = 3SE +/- 0.00768, N = 33.296333.306063.31244MIN: 3.27MIN: 3.27MIN: 3.261. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -lpthread -ldl

srsRAN

Test: 4G PHY_DL_Test 100 PRB SISO 64-QAM

OpenBenchmarking.orgUE Mb/s, More Is BettersrsRAN 22.04.1Test: 4G PHY_DL_Test 100 PRB SISO 64-QAMLinux 5.15.83Linux 6.1Linux 5.10.130306090120150SE +/- 0.06, N = 3SE +/- 0.15, N = 3SE +/- 0.03, N = 3123.9123.3123.31. (CXX) g++ options: -std=c++14 -fno-strict-aliasing -march=native -mfpmath=sse -mavx2 -fvisibility=hidden -O3 -fno-trapping-math -fno-math-errno -mavx512f -mavx512cd -mavx512bw -mavx512dq -lpthread -ldl -lm

LAMMPS Molecular Dynamics Simulator

Model: Rhodopsin Protein

OpenBenchmarking.orgns/day, More Is BetterLAMMPS Molecular Dynamics Simulator 23Jun2022Model: Rhodopsin ProteinLinux 5.10.130Linux 5.15.83Linux 6.13691215SE +/- 0.02, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 310.6610.6410.611. (CXX) g++ options: -O3 -pthread -lm -ldl

SVT-AV1

Encoder Mode: Preset 8 - Input: Bosphorus 1080p

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.4Encoder Mode: Preset 8 - Input: Bosphorus 1080pLinux 5.10.130Linux 6.1Linux 5.15.8320406080100SE +/- 0.40, N = 3SE +/- 0.46, N = 3SE +/- 0.30, N = 395.4995.1595.041. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

Cpuminer-Opt

Algorithm: x25x

OpenBenchmarking.orgkH/s, More Is BetterCpuminer-Opt 3.20.3Algorithm: x25xLinux 5.15.83Linux 5.10.130Linux 6.1140280420560700SE +/- 1.51, N = 3SE +/- 0.20, N = 3SE +/- 0.34, N = 3641.61640.06638.641. (CXX) g++ options: -O2 -lcurl -lz -lpthread -lssl -lcrypto -lgmp

Y-Cruncher

Pi Digits To Calculate: 1B

OpenBenchmarking.orgSeconds, Fewer Is BetterY-Cruncher 0.7.10.9513Pi Digits To Calculate: 1BLinux 5.10.130Linux 6.1Linux 5.15.83612182430SE +/- 0.02, N = 3SE +/- 0.02, N = 3SE +/- 0.03, N = 324.4524.4624.56

TensorFlow

Device: CPU - Batch Size: 32 - Model: ResNet-50

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.10Device: CPU - Batch Size: 32 - Model: ResNet-50Linux 5.15.83Linux 6.1Linux 5.10.130918273645SE +/- 0.04, N = 3SE +/- 0.03, N = 3SE +/- 0.02, N = 340.4140.3240.23

Neural Magic DeepSparse

Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Synchronous Single-StreamLinux 6.1Linux 5.10.130Linux 5.15.8320406080100SE +/- 0.22, N = 3SE +/- 0.59, N = 3SE +/- 0.31, N = 3103.58104.00104.04

Neural Magic DeepSparse

Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Synchronous Single-StreamLinux 6.1Linux 5.10.130Linux 5.15.833691215SE +/- 0.0209, N = 3SE +/- 0.0549, N = 3SE +/- 0.0282, N = 39.65329.61539.6111

oneDNN

Harness: Recurrent Neural Network Training - Data Type: u8s8f32 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.7Harness: Recurrent Neural Network Training - Data Type: u8s8f32 - Engine: CPULinux 5.15.83Linux 6.1Linux 5.10.13030060090012001500SE +/- 3.87, N = 3SE +/- 1.70, N = 3SE +/- 2.14, N = 31614.871618.861621.84MIN: 1607.67MIN: 1614.3MIN: 1617.111. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -lpthread -ldl

Cpuminer-Opt

Algorithm: scrypt

OpenBenchmarking.orgkH/s, More Is BetterCpuminer-Opt 3.20.3Algorithm: scryptLinux 5.10.130Linux 6.1Linux 5.15.83110220330440550SE +/- 3.92, N = 3SE +/- 2.46, N = 3SE +/- 5.31, N = 3491.90491.85489.831. (CXX) g++ options: -O2 -lcurl -lz -lpthread -lssl -lcrypto -lgmp

Xmrig

Variant: Wownero - Hash Count: 1M

OpenBenchmarking.orgH/s, More Is BetterXmrig 6.18.1Variant: Wownero - Hash Count: 1MLinux 5.15.83Linux 6.1Linux 5.10.1302K4K6K8K10KSE +/- 34.41, N = 3SE +/- 49.24, N = 3SE +/- 67.20, N = 39531.39527.79492.21. (CXX) g++ options: -fexceptions -fno-rtti -maes -O3 -Ofast -static-libgcc -static-libstdc++ -rdynamic -lssl -lcrypto -luv -lpthread -lrt -ldl -lhwloc

Cpuminer-Opt

Algorithm: Magi

OpenBenchmarking.orgkH/s, More Is BetterCpuminer-Opt 3.20.3Algorithm: MagiLinux 5.10.130Linux 5.15.83Linux 6.180160240320400SE +/- 4.81, N = 3SE +/- 4.11, N = 3SE +/- 4.81, N = 3374.94373.55373.451. (CXX) g++ options: -O2 -lcurl -lz -lpthread -lssl -lcrypto -lgmp

TensorFlow

Device: CPU - Batch Size: 64 - Model: AlexNet

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.10Device: CPU - Batch Size: 64 - Model: AlexNetLinux 5.10.130Linux 5.15.83Linux 6.150100150200250SE +/- 0.06, N = 3SE +/- 0.39, N = 3SE +/- 0.27, N = 3243.30242.73242.34

TensorFlow

Device: CPU - Batch Size: 64 - Model: ResNet-50

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.10Device: CPU - Batch Size: 64 - Model: ResNet-50Linux 6.1Linux 5.15.83Linux 5.10.1301020304050SE +/- 0.05, N = 3SE +/- 0.02, N = 3SE +/- 0.02, N = 342.0642.0541.90

Neural Magic DeepSparse

Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-StreamLinux 6.1Linux 5.10.130Linux 5.15.8320406080100SE +/- 0.47, N = 3SE +/- 0.05, N = 3SE +/- 0.53, N = 3108.74108.55108.34

Neural Magic DeepSparse

Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-StreamLinux 6.1Linux 5.10.130Linux 5.15.831632486480SE +/- 0.32, N = 3SE +/- 0.04, N = 3SE +/- 0.36, N = 373.5573.6873.82

Facebook RocksDB

Test: Random Read

OpenBenchmarking.orgOp/s, More Is BetterFacebook RocksDB 7.5.3Test: Random ReadLinux 6.1Linux 5.15.83Linux 5.10.13014M28M42M56M70MSE +/- 360247.64, N = 3SE +/- 139131.71, N = 3SE +/- 547664.44, N = 36533717565233649650942391. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti -lpthread

OpenVINO

Model: Face Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.2.devModel: Face Detection FP16-INT8 - Device: CPULinux 6.1Linux 5.15.83Linux 5.10.13090180270360450SE +/- 0.59, N = 3SE +/- 0.53, N = 3SE +/- 0.17, N = 3416.16416.95417.71MIN: 211.14 / MAX: 443.45MIN: 240.72 / MAX: 434.4MIN: 260.74 / MAX: 433.771. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -flto -shared

NCNN

Target: CPU - Model: alexnet

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20220729Target: CPU - Model: alexnetLinux 5.10.130Linux 6.1Linux 5.15.831.2332.4663.6994.9326.165SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.08, N = 65.465.465.48MIN: 5.35 / MAX: 5.85MIN: 5.35 / MAX: 9.83MIN: 5.3 / MAX: 6.071. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

TensorFlow

Device: CPU - Batch Size: 16 - Model: AlexNet

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.10Device: CPU - Batch Size: 16 - Model: AlexNetLinux 5.15.83Linux 5.10.130Linux 6.14080120160200SE +/- 0.13, N = 3SE +/- 0.44, N = 3SE +/- 0.22, N = 3166.90166.55166.31

7-Zip Compression

Test: Decompression Rating

OpenBenchmarking.orgMIPS, More Is Better7-Zip Compression 22.01Test: Decompression RatingLinux 5.15.83Linux 6.1Linux 5.10.13020K40K60K80K100KSE +/- 150.80, N = 3SE +/- 264.89, N = 3SE +/- 259.98, N = 38673586680864321. (CXX) g++ options: -lpthread -ldl -O2 -fPIC

Cpuminer-Opt

Algorithm: Garlicoin

OpenBenchmarking.orgkH/s, More Is BetterCpuminer-Opt 3.20.3Algorithm: GarlicoinLinux 5.15.83Linux 5.10.130Linux 6.114002800420056007000SE +/- 11.67, N = 3SE +/- 2.21, N = 3SE +/- 2.16, N = 36594.186572.816571.661. (CXX) g++ options: -O2 -lcurl -lz -lpthread -lssl -lcrypto -lgmp

Neural Magic DeepSparse

Model: CV Detection,YOLOv5s COCO - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: CV Detection,YOLOv5s COCO - Scenario: Asynchronous Multi-StreamLinux 5.15.83Linux 6.1Linux 5.10.13020406080100SE +/- 0.08, N = 3SE +/- 0.04, N = 3SE +/- 0.12, N = 386.9486.8886.66

oneDNN

Harness: Recurrent Neural Network Inference - Data Type: f32 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.7Harness: Recurrent Neural Network Inference - Data Type: f32 - Engine: CPULinux 6.1Linux 5.10.130Linux 5.15.832004006008001000SE +/- 1.41, N = 3SE +/- 2.14, N = 3SE +/- 1.01, N = 3909.15909.63912.07MIN: 904.93MIN: 903.56MIN: 908.551. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -lpthread -ldl

oneDNN

Harness: IP Shapes 3D - Data Type: u8s8f32 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.7Harness: IP Shapes 3D - Data Type: u8s8f32 - Engine: CPULinux 6.1Linux 5.15.83Linux 5.10.1300.28190.56380.84571.12761.4095SE +/- 0.00376, N = 3SE +/- 0.00241, N = 3SE +/- 0.00257, N = 31.248711.251741.25271MIN: 1.21MIN: 1.22MIN: 1.221. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -lpthread -ldl

OpenVINO

Model: Face Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.2.devModel: Face Detection FP16-INT8 - Device: CPULinux 6.1Linux 5.15.83Linux 5.10.130510152025SE +/- 0.03, N = 3SE +/- 0.02, N = 3SE +/- 0.00, N = 319.1719.1519.111. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -flto -shared

Blender

Blend File: BMW27 - Compute: CPU-Only

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 3.4Blend File: BMW27 - Compute: CPU-OnlyLinux 5.10.130Linux 5.15.83Linux 6.120406080100SE +/- 0.08, N = 3SE +/- 0.06, N = 3SE +/- 0.02, N = 3106.13106.38106.46

srsRAN

Test: 5G PHY_DL_NR Test 52 PRB SISO 64-QAM

OpenBenchmarking.orgeNb Mb/s, More Is BettersrsRAN 22.04.1Test: 5G PHY_DL_NR Test 52 PRB SISO 64-QAMLinux 5.15.83Linux 5.10.130Linux 6.120406080100SE +/- 0.10, N = 3SE +/- 0.35, N = 3SE +/- 0.15, N = 398.698.698.31. (CXX) g++ options: -std=c++14 -fno-strict-aliasing -march=native -mfpmath=sse -mavx2 -fvisibility=hidden -O3 -fno-trapping-math -fno-math-errno -mavx512f -mavx512cd -mavx512bw -mavx512dq -lpthread -ldl -lm

Neural Magic DeepSparse

Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-StreamLinux 5.10.130Linux 5.15.83Linux 6.150100150200250SE +/- 0.10, N = 3SE +/- 0.45, N = 3SE +/- 0.45, N = 3219.36219.01218.69

Neural Magic DeepSparse

Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-StreamLinux 5.15.83Linux 6.1Linux 5.10.130306090120150SE +/- 0.31, N = 3SE +/- 0.38, N = 3SE +/- 0.43, N = 3143.81144.21144.24

Neural Magic DeepSparse

Model: CV Detection,YOLOv5s COCO - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: CV Detection,YOLOv5s COCO - Scenario: Synchronous Single-StreamLinux 5.10.130Linux 6.1Linux 5.15.833691215SE +/- 0.00, N = 3SE +/- 0.02, N = 3SE +/- 0.02, N = 313.2713.2713.31

TensorFlow

Device: CPU - Batch Size: 256 - Model: ResNet-50

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.10Device: CPU - Batch Size: 256 - Model: ResNet-50Linux 5.10.130Linux 5.15.83Linux 6.11020304050SE +/- 0.02, N = 3SE +/- 0.02, N = 3SE +/- 0.03, N = 343.5043.4143.37

Stress-NG

Test: Glibc Qsort Data Sorting

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.14.06Test: Glibc Qsort Data SortingLinux 5.15.83Linux 5.10.130Linux 6.14080120160200SE +/- 1.18, N = 3SE +/- 1.58, N = 3SE +/- 1.25, N = 3194.88194.36194.301. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -laio -lapparmor -latomic -lbsd -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lrt -lsctp -lz -pthread

Neural Magic DeepSparse

Model: CV Detection,YOLOv5s COCO - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: CV Detection,YOLOv5s COCO - Scenario: Synchronous Single-StreamLinux 6.1Linux 5.10.130Linux 5.15.8320406080100SE +/- 0.10, N = 3SE +/- 0.01, N = 3SE +/- 0.14, N = 375.2675.2675.04

Neural Magic DeepSparse

Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-StreamLinux 5.15.83Linux 6.1Linux 5.10.1301224364860SE +/- 0.12, N = 3SE +/- 0.16, N = 3SE +/- 0.15, N = 355.5855.4455.42

Numenta Anomaly Benchmark

Detector: Contextual Anomaly Detector OSE

OpenBenchmarking.orgSeconds, Fewer Is BetterNumenta Anomaly Benchmark 1.1Detector: Contextual Anomaly Detector OSELinux 5.15.83Linux 5.10.130Linux 6.11326395265SE +/- 0.25, N = 3SE +/- 0.29, N = 3SE +/- 0.15, N = 355.6655.7355.82

Neural Magic DeepSparse

Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-StreamLinux 5.10.130Linux 5.15.83Linux 6.1816243240SE +/- 0.02, N = 3SE +/- 0.07, N = 3SE +/- 0.08, N = 336.4436.5036.54

LAMMPS Molecular Dynamics Simulator

Model: 20k Atoms

OpenBenchmarking.orgns/day, More Is BetterLAMMPS Molecular Dynamics Simulator 23Jun2022Model: 20k AtomsLinux 5.10.130Linux 5.15.83Linux 6.13691215SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.02, N = 310.4310.4110.401. (CXX) g++ options: -O3 -pthread -lm -ldl

Neural Magic DeepSparse

Model: CV Detection,YOLOv5s COCO - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: CV Detection,YOLOv5s COCO - Scenario: Asynchronous Multi-StreamLinux 5.15.83Linux 6.1Linux 5.10.13020406080100SE +/- 0.09, N = 3SE +/- 0.04, N = 3SE +/- 0.08, N = 391.9992.0592.21

OSPRay Studio

Camera: 1 - Resolution: 1080p - Samples Per Pixel: 16 - Renderer: Path Tracer

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.11Camera: 1 - Resolution: 1080p - Samples Per Pixel: 16 - Renderer: Path TracerLinux 5.10.130Linux 5.15.83Linux 6.16K12K18K24K30KSE +/- 8.11, N = 3SE +/- 21.40, N = 3SE +/- 9.70, N = 32840928417284791. (CXX) g++ options: -O3 -lm -ldl -lpthread -pthread

OSPRay Studio

Camera: 3 - Resolution: 1080p - Samples Per Pixel: 1 - Renderer: Path Tracer

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.11Camera: 3 - Resolution: 1080p - Samples Per Pixel: 1 - Renderer: Path TracerLinux 6.1Linux 5.15.83Linux 5.10.1305001000150020002500SE +/- 0.58, N = 3SE +/- 0.67, N = 32173217621781. (CXX) g++ options: -O3 -lm -ldl -lpthread -pthread

libavif avifenc

Encoder Speed: 0

OpenBenchmarking.orgSeconds, Fewer Is Betterlibavif avifenc 0.11Encoder Speed: 0Linux 5.15.83Linux 5.10.130Linux 6.1306090120150SE +/- 0.50, N = 3SE +/- 0.40, N = 3SE +/- 0.17, N = 3144.71145.01145.041. (CXX) g++ options: -O3 -fPIC -lm

OSPRay Studio

Camera: 3 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path Tracer

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.11Camera: 3 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path TracerLinux 6.1Linux 5.10.130Linux 5.15.8360K120K180K240K300KSE +/- 92.98, N = 3SE +/- 239.39, N = 3SE +/- 192.14, N = 32842352846992848531. (CXX) g++ options: -O3 -lm -ldl -lpthread -pthread

TensorFlow

Device: CPU - Batch Size: 256 - Model: AlexNet

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.10Device: CPU - Batch Size: 256 - Model: AlexNetLinux 6.1Linux 5.15.83Linux 5.10.13060120180240300SE +/- 0.40, N = 3SE +/- 0.66, N = 3SE +/- 0.53, N = 3279.22279.05278.63

OpenRadioss

Model: Bird Strike on Windshield

OpenBenchmarking.orgSeconds, Fewer Is BetterOpenRadioss 2022.10.13Model: Bird Strike on WindshieldLinux 6.1Linux 5.15.83Linux 5.10.13060120180240300SE +/- 0.19, N = 3SE +/- 0.19, N = 3SE +/- 0.38, N = 3255.89256.19256.43

WebP Image Encode

Encode Settings: Default

OpenBenchmarking.orgMP/s, More Is BetterWebP Image Encode 1.2.4Encode Settings: DefaultLinux 5.15.83Linux 6.1Linux 5.10.13048121620SE +/- 0.00, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 314.4014.3814.371. (CC) gcc options: -fvisibility=hidden -O2 -lm -pthread

OSPRay Studio

Camera: 2 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path Tracer

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.11Camera: 2 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path TracerLinux 5.10.130Linux 5.15.83Linux 6.150K100K150K200K250KSE +/- 103.12, N = 3SE +/- 62.00, N = 3SE +/- 131.54, N = 32399352403112404301. (CXX) g++ options: -O3 -lm -ldl -lpthread -pthread

TensorFlow

Device: CPU - Batch Size: 256 - Model: GoogLeNet

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.10Device: CPU - Batch Size: 256 - Model: GoogLeNetLinux 6.1Linux 5.15.83Linux 5.10.130306090120150SE +/- 0.03, N = 3SE +/- 0.05, N = 3SE +/- 0.03, N = 3130.47130.40130.21

Facebook RocksDB

Test: Read Random Write Random

OpenBenchmarking.orgOp/s, More Is BetterFacebook RocksDB 7.5.3Test: Read Random Write RandomLinux 6.1Linux 5.10.130Linux 5.15.83500K1000K1500K2000K2500KSE +/- 10651.17, N = 3SE +/- 16550.67, N = 3SE +/- 8919.50, N = 32133528213260821293591. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti -lpthread

TensorFlow

Device: CPU - Batch Size: 32 - Model: AlexNet

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.10Device: CPU - Batch Size: 32 - Model: AlexNetLinux 5.15.83Linux 5.10.130Linux 6.150100150200250SE +/- 0.13, N = 3SE +/- 0.47, N = 3SE +/- 0.28, N = 3211.47211.25211.06

Primesieve

Length: 1e13

OpenBenchmarking.orgSeconds, Fewer Is BetterPrimesieve 8.0Length: 1e13Linux 5.15.83Linux 5.10.130Linux 6.14080120160200SE +/- 0.38, N = 3SE +/- 0.36, N = 3SE +/- 0.47, N = 3174.66174.72174.981. (CXX) g++ options: -O3 -lpthread

oneDNN

Harness: Recurrent Neural Network Training - Data Type: f32 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.7Harness: Recurrent Neural Network Training - Data Type: f32 - Engine: CPULinux 5.15.83Linux 5.10.130Linux 6.130060090012001500SE +/- 0.39, N = 3SE +/- 0.83, N = 3SE +/- 0.44, N = 31611.141613.121614.07MIN: 1608.25MIN: 1608.28MIN: 1609.861. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -lpthread -ldl

oneDNN

Harness: Deconvolution Batch shapes_1d - Data Type: u8s8f32 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.7Harness: Deconvolution Batch shapes_1d - Data Type: u8s8f32 - Engine: CPULinux 5.15.83Linux 5.10.130Linux 6.10.12180.24360.36540.48720.609SE +/- 0.000263, N = 3SE +/- 0.000704, N = 3SE +/- 0.000200, N = 30.5404520.5406540.541430MIN: 0.53MIN: 0.53MIN: 0.531. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -lpthread -ldl

ASTC Encoder

Preset: Thorough

OpenBenchmarking.orgMT/s, More Is BetterASTC Encoder 4.0Preset: ThoroughLinux 5.15.83Linux 5.10.130Linux 6.13691215SE +/- 0.0055, N = 3SE +/- 0.0023, N = 3SE +/- 0.0088, N = 39.32679.32259.31031. (CXX) g++ options: -O3 -flto -pthread

OpenVINO

Model: Face Detection FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.2.devModel: Face Detection FP16 - Device: CPULinux 6.1Linux 5.15.83Linux 5.10.1301.32532.65063.97595.30126.6265SE +/- 0.02, N = 3SE +/- 0.03, N = 3SE +/- 0.03, N = 35.895.885.881. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -flto -shared

Blender

Blend File: Pabellon Barcelona - Compute: CPU-Only

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 3.4Blend File: Pabellon Barcelona - Compute: CPU-OnlyLinux 5.15.83Linux 5.10.130Linux 6.180160240320400SE +/- 0.29, N = 3SE +/- 0.42, N = 3SE +/- 0.42, N = 3373.54373.74374.17

srsRAN

Test: 5G PHY_DL_NR Test 52 PRB SISO 64-QAM

OpenBenchmarking.orgUE Mb/s, More Is BettersrsRAN 22.04.1Test: 5G PHY_DL_NR Test 52 PRB SISO 64-QAMLinux 5.15.83Linux 6.1Linux 5.10.1301530456075SE +/- 0.15, N = 3SE +/- 0.06, N = 3SE +/- 0.07, N = 366.065.965.91. (CXX) g++ options: -std=c++14 -fno-strict-aliasing -march=native -mfpmath=sse -mavx2 -fvisibility=hidden -O3 -fno-trapping-math -fno-math-errno -mavx512f -mavx512cd -mavx512bw -mavx512dq -lpthread -ldl -lm

oneDNN

Harness: IP Shapes 1D - Data Type: f32 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.7Harness: IP Shapes 1D - Data Type: f32 - Engine: CPULinux 5.15.83Linux 5.10.130Linux 6.10.51681.03361.55042.06722.584SE +/- 0.00109, N = 3SE +/- 0.00305, N = 3SE +/- 0.00145, N = 32.293852.296362.29708MIN: 2.19MIN: 2.22MIN: 2.221. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -lpthread -ldl

OSPRay Studio

Camera: 2 - Resolution: 1080p - Samples Per Pixel: 16 - Renderer: Path Tracer

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.11Camera: 2 - Resolution: 1080p - Samples Per Pixel: 16 - Renderer: Path TracerLinux 6.1Linux 5.10.130Linux 5.15.836K12K18K24K30KSE +/- 28.26, N = 3SE +/- 5.24, N = 32916529172292061. (CXX) g++ options: -O3 -lm -ldl -lpthread -pthread

Primesieve

Length: 1e12

OpenBenchmarking.orgSeconds, Fewer Is BetterPrimesieve 8.0Length: 1e12Linux 6.1Linux 5.15.83Linux 5.10.13048121620SE +/- 0.03, N = 3SE +/- 0.05, N = 3SE +/- 0.01, N = 314.4214.4314.441. (CXX) g++ options: -O3 -lpthread

oneDNN

Harness: IP Shapes 1D - Data Type: u8s8f32 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.7Harness: IP Shapes 1D - Data Type: u8s8f32 - Engine: CPULinux 5.10.130Linux 6.1Linux 5.15.830.11190.22380.33570.44760.5595SE +/- 0.000232, N = 3SE +/- 0.000335, N = 3SE +/- 0.000206, N = 30.4966130.4967760.497248MIN: 0.48MIN: 0.48MIN: 0.481. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -lpthread -ldl

OSPRay Studio

Camera: 1 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path Tracer

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.11Camera: 1 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path TracerLinux 5.15.83Linux 6.1Linux 5.10.13015003000450060007500SE +/- 1.45, N = 3SE +/- 10.90, N = 37046704870551. (CXX) g++ options: -O3 -lm -ldl -lpthread -pthread

Stress-NG

Test: Vector Math

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.14.06Test: Vector MathLinux 5.15.83Linux 5.10.130Linux 6.112K24K36K48K60KSE +/- 330.15, N = 3SE +/- 337.57, N = 3SE +/- 321.30, N = 355415.0155351.5855344.321. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -laio -lapparmor -latomic -lbsd -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lrt -lsctp -lz -pthread

OpenVINO

Model: Weld Porosity Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.2.devModel: Weld Porosity Detection FP16-INT8 - Device: CPULinux 5.15.83Linux 5.10.130Linux 6.1246810SE +/- 0.00, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 38.018.028.02MIN: 5.89 / MAX: 26.32MIN: 4.07 / MAX: 22.04MIN: 6 / MAX: 25.191. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -flto -shared

OSPRay Studio

Camera: 2 - Resolution: 1080p - Samples Per Pixel: 1 - Renderer: Path Tracer

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.11Camera: 2 - Resolution: 1080p - Samples Per Pixel: 1 - Renderer: Path TracerLinux 6.1Linux 5.10.130Linux 5.15.83400800120016002000SE +/- 1.00, N = 3SE +/- 1.15, N = 3SE +/- 0.67, N = 31824182618261. (CXX) g++ options: -O3 -lm -ldl -lpthread -pthread

OpenRadioss

Model: Cell Phone Drop Test

OpenBenchmarking.orgSeconds, Fewer Is BetterOpenRadioss 2022.10.13Model: Cell Phone Drop TestLinux 5.10.130Linux 6.1Linux 5.15.8320406080100SE +/- 0.20, N = 3SE +/- 0.06, N = 3SE +/- 0.10, N = 396.2196.3096.31

OSPRay Studio

Camera: 1 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path Tracer

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.11Camera: 1 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path TracerLinux 5.15.83Linux 5.10.130Linux 6.150K100K150K200K250KSE +/- 19.15, N = 3SE +/- 254.40, N = 3SE +/- 262.34, N = 32341422342162343711. (CXX) g++ options: -O3 -lm -ldl -lpthread -pthread

Blender

Blend File: Barbershop - Compute: CPU-Only

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 3.4Blend File: Barbershop - Compute: CPU-OnlyLinux 5.15.83Linux 6.1Linux 5.10.1302004006008001000SE +/- 0.12, N = 3SE +/- 0.42, N = 3SE +/- 0.49, N = 31144.821145.181145.90

OpenVINO

Model: Weld Porosity Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.2.devModel: Weld Porosity Detection FP16-INT8 - Device: CPULinux 5.15.83Linux 6.1Linux 5.10.130400800120016002000SE +/- 0.98, N = 3SE +/- 1.06, N = 3SE +/- 1.36, N = 31993.581992.231991.751. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -flto -shared

ASTC Encoder

Preset: Medium

OpenBenchmarking.orgMT/s, More Is BetterASTC Encoder 4.0Preset: MediumLinux 5.10.130Linux 5.15.83Linux 6.11632486480SE +/- 0.01, N = 3SE +/- 0.04, N = 3SE +/- 0.02, N = 372.1672.1272.101. (CXX) g++ options: -O3 -flto -pthread

OSPRay Studio

Camera: 3 - Resolution: 4K - Samples Per Pixel: 16 - Renderer: Path Tracer

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.11Camera: 3 - Resolution: 4K - Samples Per Pixel: 16 - Renderer: Path TracerLinux 5.15.83Linux 5.10.130Linux 6.130K60K90K120K150KSE +/- 69.67, N = 3SE +/- 58.33, N = 3SE +/- 27.67, N = 31465701465831466921. (CXX) g++ options: -O3 -lm -ldl -lpthread -pthread

Stress-NG

Test: Crypto

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.14.06Test: CryptoLinux 5.10.130Linux 5.15.83Linux 6.14K8K12K16K20KSE +/- 47.41, N = 3SE +/- 83.58, N = 3SE +/- 66.53, N = 318742.6718733.1018727.611. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -laio -lapparmor -latomic -lbsd -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lrt -lsctp -lz -pthread

OpenVINO

Model: Face Detection FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.2.devModel: Face Detection FP16 - Device: CPULinux 5.15.83Linux 6.1Linux 5.10.13030060090012001500SE +/- 8.21, N = 3SE +/- 5.43, N = 3SE +/- 7.68, N = 31356.351357.101357.37MIN: 1238.64 / MAX: 1424.43MIN: 1311.47 / MAX: 1435.45MIN: 1303.04 / MAX: 1429.11. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -flto -shared

ASTC Encoder

Preset: Exhaustive

OpenBenchmarking.orgMT/s, More Is BetterASTC Encoder 4.0Preset: ExhaustiveLinux 5.15.83Linux 5.10.130Linux 6.10.21090.42180.63270.84361.0545SE +/- 0.0001, N = 3SE +/- 0.0001, N = 3SE +/- 0.0006, N = 30.93750.93710.93681. (CXX) g++ options: -O3 -flto -pthread

ASTC Encoder

Preset: Fast

OpenBenchmarking.orgMT/s, More Is BetterASTC Encoder 4.0Preset: FastLinux 5.10.130Linux 5.15.83Linux 6.14080120160200SE +/- 0.04, N = 3SE +/- 0.05, N = 3SE +/- 0.03, N = 3193.13193.02192.991. (CXX) g++ options: -O3 -flto -pthread

Stress-NG

Test: Matrix Math

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.14.06Test: Matrix MathLinux 5.10.130Linux 5.15.83Linux 6.112K24K36K48K60KSE +/- 476.25, N = 3SE +/- 503.37, N = 3SE +/- 647.24, N = 355915.3655890.2355875.181. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -laio -lapparmor -latomic -lbsd -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lrt -lsctp -lz -pthread

OSPRay Studio

Camera: 3 - Resolution: 1080p - Samples Per Pixel: 16 - Renderer: Path Tracer

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.11Camera: 3 - Resolution: 1080p - Samples Per Pixel: 16 - Renderer: Path TracerLinux 6.1Linux 5.10.130Linux 5.15.837K14K21K28K35KSE +/- 5.29, N = 3SE +/- 21.06, N = 3SE +/- 4.51, N = 33477934786348011. (CXX) g++ options: -O3 -lm -ldl -lpthread -pthread

Blender

Blend File: Fishy Cat - Compute: CPU-Only

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 3.4Blend File: Fishy Cat - Compute: CPU-OnlyLinux 5.10.130Linux 6.1Linux 5.15.83306090120150SE +/- 0.12, N = 3SE +/- 0.09, N = 3SE +/- 0.30, N = 3144.25144.29144.34

OSPRay Studio

Camera: 3 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path Tracer

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.11Camera: 3 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path TracerLinux 5.15.83Linux 5.10.130Linux 6.12K4K6K8K10KSE +/- 5.51, N = 3SE +/- 9.45, N = 38628863386331. (CXX) g++ options: -O3 -lm -ldl -lpthread -pthread

OSPRay Studio

Camera: 1 - Resolution: 1080p - Samples Per Pixel: 1 - Renderer: Path Tracer

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.11Camera: 1 - Resolution: 1080p - Samples Per Pixel: 1 - Renderer: Path TracerLinux 5.10.130Linux 5.15.83Linux 6.1400800120016002000SE +/- 0.67, N = 3SE +/- 1.33, N = 3SE +/- 0.58, N = 31778177817791. (CXX) g++ options: -O3 -lm -ldl -lpthread -pthread

OSPRay Studio

Camera: 2 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path Tracer

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.11Camera: 2 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path TracerLinux 5.10.130Linux 6.1Linux 5.15.8316003200480064008000SE +/- 2.33, N = 3SE +/- 2.52, N = 3SE +/- 3.79, N = 37242724572461. (CXX) g++ options: -O3 -lm -ldl -lpthread -pthread

Stress-NG

Test: x86_64 RdRand

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.14.06Test: x86_64 RdRandLinux 5.15.83Linux 5.10.130Linux 6.150K100K150K200K250KSE +/- 1.57, N = 3SE +/- 0.71, N = 3SE +/- 12.63, N = 3252393.88252390.56252372.291. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -laio -lapparmor -latomic -lbsd -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lrt -lsctp -lz -pthread

Aircrack-ng

OpenBenchmarking.orgk/s, More Is BetterAircrack-ng 1.7Linux 6.1Linux 5.15.83Linux 5.10.13011K22K33K44K55KSE +/- 144.43, N = 3SE +/- 118.77, N = 3SE +/- 129.98, N = 350609.2850607.7450605.561. (CXX) g++ options: -std=gnu++17 -O3 -fvisibility=hidden -fcommon -rdynamic -lnl-3 -lnl-genl-3 -lpcre -lpthread -lz -lssl -lcrypto -lhwloc -ldl -lm -lbsd -pthread

Natron

Input: Spaceship

OpenBenchmarking.orgFPS, More Is BetterNatron 2.4.3Input: SpaceshipLinux 6.1Linux 5.15.83Linux 5.10.1300.811.622.433.244.05SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 33.63.63.6

NCNN

Target: CPU-v3-v3 - Model: mobilenet-v3

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20220729Target: CPU-v3-v3 - Model: mobilenet-v3Linux 5.10.130Linux 5.15.83Linux 6.11.11382.22763.34144.45525.569SE +/- 0.01, N = 3SE +/- 0.04, N = 6SE +/- 0.01, N = 34.954.954.95MIN: 4.85 / MAX: 5.91MIN: 4.8 / MAX: 63.45MIN: 4.86 / MAX: 5.261. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

WebP Image Encode

Encode Settings: Quality 100, Lossless, Highest Compression

OpenBenchmarking.orgMP/s, More Is BetterWebP Image Encode 1.2.4Encode Settings: Quality 100, Lossless, Highest CompressionLinux 6.1Linux 5.15.83Linux 5.10.1300.1080.2160.3240.4320.54SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 30.480.480.481. (CC) gcc options: -fvisibility=hidden -O2 -lm -pthread

NCNN

Target: CPU - Model: resnet18

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20220729Target: CPU - Model: resnet18Linux 6.1Linux 5.15.83Linux 5.10.130246810SE +/- 0.01, N = 3SE +/- 0.22, N = 6SE +/- 0.04, N = 37.858.058.09MIN: 7.74 / MAX: 10.2MIN: 7.68 / MAX: 9.97MIN: 7.89 / MAX: 9.291. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

NCNN

Target: CPU - Model: vgg16

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20220729Target: CPU - Model: vgg16Linux 6.1Linux 5.10.130Linux 5.15.83714212835SE +/- 0.10, N = 3SE +/- 0.13, N = 3SE +/- 1.00, N = 626.5226.9527.69MIN: 26.22 / MAX: 27.61MIN: 26.65 / MAX: 27.51MIN: 26.21 / MAX: 33.471. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

Stress-NG

Test: Socket Activity

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.14.06Test: Socket ActivityLinux 5.15.83Linux 6.1Linux 5.10.1304K8K12K16K20KSE +/- 80.02, N = 3SE +/- 112.51, N = 3SE +/- 302.66, N = 1517786.1716990.7510160.911. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -laio -lapparmor -latomic -lbsd -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lrt -lsctp -lz -pthread

Stress-NG

Test: CPU Cache

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.14.06Test: CPU CacheLinux 5.15.83Linux 5.10.130Linux 6.1306090120150SE +/- 6.07, N = 12SE +/- 2.89, N = 15SE +/- 2.00, N = 15128.31116.33115.591. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -laio -lapparmor -latomic -lbsd -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lrt -lsctp -lz -pthread

Stress-NG

Test: Futex

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.14.06Test: FutexLinux 6.1Linux 5.15.83Linux 5.10.130500K1000K1500K2000K2500KSE +/- 9882.04, N = 3SE +/- 32600.02, N = 3SE +/- 33488.35, N = 152433807.142364278.751498828.701. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -laio -lapparmor -latomic -lbsd -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lrt -lsctp -lz -pthread

Dragonflydb

Clients: 50 - Set To Get Ratio: 1:1

OpenBenchmarking.orgOps/sec, More Is BetterDragonflydb 0.6Clients: 50 - Set To Get Ratio: 1:1Linux 6.1Linux 5.15.83Linux 5.10.130200K400K600K800K1000KSE +/- 1471.72, N = 3SE +/- 643.98, N = 3SE +/- 19609.96, N = 131130454.031123953.55978963.311. (CXX) g++ options: -O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre


Phoronix Test Suite v10.8.4