Intel Core i5 12400, Core i5 13400 Linux benchmarks new cpus

Benchmarks for a future article on Phoronix.

HTML result view exported from: https://openbenchmarking.org/result/2301154-PTS-EO2022BE79&sor&grs.

Intel Core i5 12400, Core i5 13400 Linux benchmarks new cpusProcessorMotherboardChipsetMemoryDiskGraphicsAudioMonitorNetworkOSKernelDesktopDisplay ServerOpenGLVulkanCompilerFile-SystemScreen ResolutionCore i5 124001240013400Core i5 13400Intel Core i5-12400 @ 5.60GHz (6 Cores / 12 Threads)ASUS PRIME Z790-P WIFI (0602 BIOS)Intel Device 7a2732GB2000GB Samsung SSD 980 PRO 2TBAMD Radeon RX 6700 XT 12GB (2855/1000MHz)Realtek ALC897ASUS VP28UIntel Device 7a70Ubuntu 22.046.0.0-060000rc1daily20220820-generic (x86_64)GNOME Shell 42.2X Server 1.21.1.3 + Wayland4.6 Mesa 22.3.0-devel (git-4685385 2022-08-23 jammy-oibaf-ppa) (LLVM 14.0.6 DRM 3.48)1.3.224GCC 12.0.1 20220319ext43840x2160Intel Core i5-13400 @ 3.40GHz (10 Cores / 16 Threads)OpenBenchmarking.orgKernel Details- Transparent Huge Pages: madviseCompiler Details- --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-defaulted --enable-offload-targets=nvptx-none=/build/gcc-12-OcsLtf/gcc-12-12-20220319/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-12-OcsLtf/gcc-12-12-20220319/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v Processor Details- Core i5 12400: Scaling Governor: intel_pstate performance (EPP: performance) - CPU Microcode: 0x25 - Thermald 2.4.9- 12400: Scaling Governor: intel_pstate performance (EPP: performance) - CPU Microcode: 0x25 - Thermald 2.4.9- 13400: Scaling Governor: intel_pstate performance (EPP: performance) - CPU Microcode: 0x25- Core i5 13400: Scaling Governor: intel_pstate performance (EPP: performance) - CPU Microcode: 0x25Python Details- Python 3.10.4Security Details- itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Not affected

Intel Core i5 12400, Core i5 13400 Linux benchmarks new cpusopenvino: Weld Porosity Detection FP16 - CPUopenvino: Weld Porosity Detection FP16-INT8 - CPUquadray: 5 - 4Kquadray: 5 - 1080popenvino: Age Gender Recognition Retail 0013 FP16 - CPUopenvino: Age Gender Recognition Retail 0013 FP16-INT8 - CPUquadray: 2 - 4Kquadray: 3 - 1080pquadray: 1 - 4Kquadray: 2 - 1080pquadray: 3 - 4Kquadray: 1 - 1080pdeepsparse: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Asynchronous Multi-Streamdeepsparse: CV Detection,YOLOv5s COCO - Asynchronous Multi-Streamdeepsparse: NLP Text Classification, BERT base uncased SST2 - Asynchronous Multi-Streamdeepsparse: NLP Document Classification, oBERT base uncased on IMDB - Asynchronous Multi-Streamdeepsparse: NLP Token Classification, BERT base uncased conll2003 - Asynchronous Multi-Streamdeepsparse: CV Classification, ResNet-50 ImageNet - Asynchronous Multi-Streamdeepsparse: NLP Text Classification, DistilBERT mnli - Asynchronous Multi-Streamspacy: en_core_web_trfopenradioss: Rubber O-Ring Seal Installationopenradioss: Cell Phone Drop Teststargate: 480000 - 1024stargate: 44100 - 1024stargate: 96000 - 1024stargate: 192000 - 1024stargate: 44100 - 512stargate: 480000 - 512stargate: 192000 - 512stargate: 96000 - 512minibude: OpenMP - BM1minibude: OpenMP - BM1brl-cad: VGR Performance Metricopenradioss: Bumper Beamopenvino: Face Detection FP16 - CPUopenvino: Face Detection FP16 - CPUuvg266: Bosphorus 1080p - Slowkvazaar: Bosphorus 1080p - Slowkvazaar: Bosphorus 1080p - Mediumuvg266: Bosphorus 1080p - Mediumavifenc: 6nekrs: TurboPipe Periodicavifenc: 6, Losslessuvg266: Bosphorus 1080p - Ultra Fastopenvino: Person Detection FP32 - CPUkvazaar: Bosphorus 1080p - Ultra Fastopenvino: Person Detection FP16 - CPUblender: BMW27 - CPU-Onlyuvg266: Bosphorus 1080p - Super Fastopenvino: Person Detection FP32 - CPUopenvino: Person Detection FP16 - CPUavifenc: 0build-linux-kernel: allmodconfigblender: Pabellon Barcelona - CPU-Onlyblender: Classroom - CPU-Onlyuvg266: Bosphorus 1080p - Very Fastbuild-linux-kernel: defconfigblender: Fishy Cat - CPU-Onlyblender: Barbershop - CPU-Onlyuvg266: Bosphorus 4K - Very Fastavifenc: 2uvg266: Bosphorus 4K - Ultra Fastuvg266: Bosphorus 4K - Super Fastkvazaar: Bosphorus 1080p - Super Fastopenvino: Machine Translation EN To DE FP16 - CPUopenvino: Machine Translation EN To DE FP16 - CPUkvazaar: Bosphorus 4K - Super Fastkvazaar: Bosphorus 4K - Slowkvazaar: Bosphorus 4K - Mediumkvazaar: Bosphorus 4K - Ultra Fastkvazaar: Bosphorus 4K - Very Fastuvg266: Bosphorus 4K - Slowuvg266: Bosphorus 4K - Mediumopenvkl: vklBenchmark Scalaropenradioss: INIVOL and Fluid Structure Interaction Drop Containerkvazaar: Bosphorus 1080p - Very Fastopenvino: Vehicle Detection FP16 - CPUopenvino: Vehicle Detection FP16 - CPUopenvkl: vklBenchmark ISPCsvt-av1: Preset 8 - Bosphorus 4Ksvt-av1: Preset 4 - Bosphorus 4Ksvt-av1: Preset 8 - Bosphorus 1080pcockroach: KV, 95% Reads - 512openvino: Person Vehicle Bike Detection FP16 - CPUopenvino: Person Vehicle Bike Detection FP16 - CPUavifenc: 10, Losslesscockroach: KV, 95% Reads - 256cockroach: KV, 95% Reads - 128cockroach: KV, 95% Reads - 1024encodec: 6 kbpsopenvino: Vehicle Detection FP16-INT8 - CPUopenvino: Vehicle Detection FP16-INT8 - CPUencodec: 24 kbpsclickhouse: 100M Rows Hits Dataset, First Run / Cold Cachecockroach: KV, 50% Reads - 1024clickhouse: 100M Rows Hits Dataset, Second Runcockroach: KV, 60% Reads - 1024encodec: 1.5 kbpsopenvino: Face Detection FP16-INT8 - CPUopenvino: Face Detection FP16-INT8 - CPUopenradioss: Bird Strike on Windshieldencodec: 3 kbpsopenvino: Weld Porosity Detection FP16 - CPUsvt-av1: Preset 13 - Bosphorus 4Kcockroach: KV, 10% Reads - 1024xmrig: Wownero - 1Mopenvino: Weld Porosity Detection FP16-INT8 - CPUsvt-av1: Preset 12 - Bosphorus 4Ksvt-av1: Preset 4 - Bosphorus 1080ptensorflow: CPU - 64 - GoogLeNetcockroach: KV, 60% Reads - 512clickhouse: 100M Rows Hits Dataset, Third Runtensorflow: CPU - 16 - GoogLeNettensorflow: CPU - 32 - GoogLeNetxmrig: Monero - 1Mjpegxl-decode: Allsvt-av1: Preset 12 - Bosphorus 1080pcockroach: KV, 50% Reads - 512deepsparse: NLP Text Classification, DistilBERT mnli - Asynchronous Multi-Streamcockroach: KV, 10% Reads - 512jpegxl: JPEG - 90deepsparse: CV Classification, ResNet-50 ImageNet - Asynchronous Multi-Streamdeepsparse: CV Detection,YOLOv5s COCO - Asynchronous Multi-Streamjpegxl: JPEG - 80deepsparse: NLP Token Classification, BERT base uncased conll2003 - Asynchronous Multi-Streamdeepsparse: NLP Text Classification, BERT base uncased SST2 - Asynchronous Multi-Streamjpegxl: PNG - 90deepsparse: NLP Token Classification, BERT base uncased conll2003 - Synchronous Single-Streamdeepsparse: NLP Token Classification, BERT base uncased conll2003 - Synchronous Single-Streamsvt-av1: Preset 13 - Bosphorus 1080pjpegxl: PNG - 80deepsparse: NLP Document Classification, oBERT base uncased on IMDB - Asynchronous Multi-Streamdeepsparse: NLP Document Classification, oBERT base uncased on IMDB - Synchronous Single-Streamdeepsparse: NLP Document Classification, oBERT base uncased on IMDB - Synchronous Single-Streamdeepsparse: NLP Text Classification, DistilBERT mnli - Synchronous Single-Streamdeepsparse: NLP Text Classification, DistilBERT mnli - Synchronous Single-Streamtensorflow: CPU - 64 - AlexNetdeepsparse: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Asynchronous Multi-Streamopenvino: Age Gender Recognition Retail 0013 FP16 - CPUdeepsparse: NLP Text Classification, BERT base uncased SST2 - Synchronous Single-Streamdeepsparse: NLP Text Classification, BERT base uncased SST2 - Synchronous Single-Streamtensorflow: CPU - 32 - AlexNetopenvino: Age Gender Recognition Retail 0013 FP16-INT8 - CPUtensorflow: CPU - 16 - AlexNetjpegxl: PNG - 100spacy: en_core_web_lgy-cruncher: 500Mjpegxl-decode: 1deepsparse: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Synchronous Single-Streamdeepsparse: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Synchronous Single-Streamjpegxl: JPEG - 100cockroach: KV, 50% Reads - 128cockroach: KV, 10% Reads - 256cockroach: KV, 60% Reads - 128cockroach: KV, 10% Reads - 128y-cruncher: 1Btensorflow: CPU - 32 - ResNet-50cockroach: KV, 50% Reads - 256tensorflow: CPU - 64 - ResNet-50tensorflow: CPU - 16 - ResNet-50cockroach: MoVR - 1024cockroach: MoVR - 128deepsparse: CV Classification, ResNet-50 ImageNet - Synchronous Single-Streamdeepsparse: CV Classification, ResNet-50 ImageNet - Synchronous Single-Streamdeepsparse: CV Detection,YOLOv5s COCO - Synchronous Single-Streamdeepsparse: CV Detection,YOLOv5s COCO - Synchronous Single-Streamcockroach: MoVR - 512cockroach: KV, 60% Reads - 256cockroach: MoVR - 256smhasher: wyhashCore i5 124001240013400Core i5 1340028.917.60.552.180.940.862.176.97.458.211.727.92111.749277.4178119.7297497.1534497.200238.083760.29661535195.38112.092.6417622.7280481.9426771.2826592.5900082.5118931.1681831.816299255.43510.217149598178.371.92098.2922.4133.1234.4725.149.1275692680000013.16682.413026.39127.533016.23154.1668.61.321.32180.8961597.045536.66445.1264.17122.039217.841728.214.4482.83418.9315.4994.9325.49156.7522.226.937.1330.717.794.485.0675644.8375.4519.45205.5214631.6112.40587.11156455.512.55318.635.84157642.859000.655187.627.19510.25390.0231.179180.3841950.8200.5944079.626.047503.597.93333.3927.083207.49123.33836820.56231.7788.77117.2967.89949.9443959.3202.9047.9949.294585.3269.98453.39241073.549.746230654.18.6878.752438.70658.876.033625.05258.935.7776173.0775497.7129.146.0338172.72645.789422.153845.1328109.5726.83986329.9243.844822.806102.46963.1790.310.841590719.59355.7442.364123.60110.8311841.813343.214590.16631.242.6619.2823659.619.7118.7125.8125.314.721967.906934.759828.7617125.429557.2124.928.77.580.552.180.940.862.186.727.418.211.727.65112.128376.3733121.5126498.3122501.939438.173761.43671557195.67111.922.6503672.721681.9454861.2846952.5895812.5034361.1786181.811417255.53410.221149551178.131.92094.0622.433.234.4325.139.055653830000013.10182.383010.56127.363012.86154.368.51.331.33180.6521592.63535.47444.964.15121.358216.931726.2914.4782.42418.9215.595.0325.57156.3122.266.947.1230.6617.844.495.0675644.875.6319.43205.7914731.5532.40886.71456109.512.65316.135.7475747059140.655093.526.20610.25390.0329.901185.3941862.4194.5244239.525.013503.117.95333.4326.143209.02123.73436894.86201.5790.35116.9837.91549.9743981196.9148.0949.174590271.97447.69140974.948.823130683.98.9278.563639.25099.095.966624.6859.085.7122175.0597497.2179.256.0197174.37735.734622.823343.8089109.3526.74896317.9745.600821.9279102.846960.1489.960.841588519.64556.8842.816623.35160.8311716.513478.114628.7662242.76619.3223631.119.7218.73124.8125.314.681668.093534.762728.7578124.929540.2124.955.114.530.311.231.661.511.314.214.575.161.0817.98173.5036118.5130184.5428764.8044765.895157.802891.47911040292.59165.133.8689273.9834382.8216041.8585523.7119773.5796661.6426012.545532185.2937.412205078242.522.521583.0729.5543.3745.0232.936.9704354920000010.120107.572330.87165.292328.1119.2088.331.71.7140.7151243.638418.18348.7781.6395.932171.621359.518.2965.72323.9419.53119.2732.08124.6227.938.678.938.3122.215.586.393796.7592.7116249.8317537.9982.873103.92967125.810.63774.90668318.569633.965255.631.0368.68460.2234.691212.3749206.7228.2751715.529.127429.899.26387.7830.305181.19141.41142546.17122.9684.89134.9469.09857.5150477.0225.5554.7456.005168.4304.22502.96145770.254.512934012.09.5986.357242.07609.756.477926.93029.716.1961161.3888537.8869.886.5068161.46426.193221.416046.6875117.4328.66975970.9343.057223.2232108.316606.3394.050.881645920.45557.9944.036622.70510.8612043.813657.014829.26690.843.36818.9223946.219.4718.94124.4124.214.597768.484235.054828.5207124.429512.3124.355.6114.340.311.231.651.511.314.214.555.161.0817.95173.1329116.5342185.0887765.8308761.826957.509191.49591034291.76164.843.858653.9734042.8142641.8500663.6753623.5639791.6202422.524847185.8487.434204733239.472.511584.9129.3743.6745.1332.867.0114347820000010.078107.52341.39164.92334.05119.1588.261.71.7140.4741245.071419.6348.5481.7296.778171.281365.2118.2565.42523.7719.44119.6432124.9327.748.678.8838.1822.115.576.2993785.4492.5616.04249.2117637.9342.889103.77466905.610.62376.184.98368289.169900.265146.230.8228.72458.3835.278209.3449201.1222.1551692.829.318432.139.17388.730.425179.69142.941425517156.9694.55134.2529.01257.550413.5224.4854.7255.955164.3304.23500.42645816.554.575134253.89.6186.878642.7459.776.529526.81429.726.1829161.7337533.9419.876.4929161.69316.184421.137147.3035117.1428.70426046.3243.151223.1726107.896605.8694.380.881663220.42957.9143.955822.74660.8612118.21370414961.36770.543.6118.9424114.219.4318.97124.6124.814.605368.449935.043428.53124.629664.7124.9OpenBenchmarking.org

OpenVINO

Model: Weld Porosity Detection FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.3Model: Weld Porosity Detection FP16 - Device: CPU12400Core i5 1240013400Core i5 13400122436486028.7028.9155.1055.61MIN: 28.15 / MAX: 35.06MIN: 28.13 / MAX: 34.69MIN: 43.43 / MAX: 57.02MIN: 41.77 / MAX: 68.791. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared

OpenVINO

Model: Weld Porosity Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.3Model: Weld Porosity Detection FP16-INT8 - Device: CPU12400Core i5 12400Core i5 1340013400481216207.587.6014.3414.53MIN: 7.47 / MAX: 33.92MIN: 7.46 / MAX: 12.65MIN: 11.11 / MAX: 15.47MIN: 8.16 / MAX: 18.151. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared

QuadRay

Scene: 5 - Resolution: 4K

OpenBenchmarking.orgFPS, More Is BetterQuadRay 2022.05.25Scene: 5 - Resolution: 4K12400Core i5 12400Core i5 13400134000.12380.24760.37140.49520.619SE +/- 0.00, N = 30.550.550.310.311. (CXX) g++ options: -O3 -pthread -lm -lstdc++ -lX11 -lXext -lpthread

QuadRay

Scene: 5 - Resolution: 1080p

OpenBenchmarking.orgFPS, More Is BetterQuadRay 2022.05.25Scene: 5 - Resolution: 1080p12400Core i5 12400Core i5 13400134000.49050.9811.47151.9622.4525SE +/- 0.00, N = 32.182.181.231.231. (CXX) g++ options: -O3 -pthread -lm -lstdc++ -lX11 -lXext -lpthread

OpenVINO

Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.3Model: Age Gender Recognition Retail 0013 FP16 - Device: CPUCore i5 1240012400Core i5 13400134000.37350.7471.12051.4941.86750.940.941.651.66MIN: 0.9 / MAX: 6.47MIN: 0.91 / MAX: 6.48MIN: 1.27 / MAX: 2.22MIN: 0.97 / MAX: 2.791. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared

OpenVINO

Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.3Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPUCore i5 124001240013400Core i5 134000.33980.67961.01941.35921.6990.860.861.511.51MIN: 0.84 / MAX: 6.54MIN: 0.83 / MAX: 6.58MIN: 1.14 / MAX: 2.14MIN: 1.11 / MAX: 1.951. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared

QuadRay

Scene: 2 - Resolution: 4K

OpenBenchmarking.orgFPS, More Is BetterQuadRay 2022.05.25Scene: 2 - Resolution: 4K12400Core i5 12400Core i5 13400134000.49050.9811.47151.9622.4525SE +/- 0.00, N = 32.182.171.311.311. (CXX) g++ options: -O3 -pthread -lm -lstdc++ -lX11 -lXext -lpthread

QuadRay

Scene: 3 - Resolution: 1080p

OpenBenchmarking.orgFPS, More Is BetterQuadRay 2022.05.25Scene: 3 - Resolution: 1080pCore i5 1240012400Core i5 1340013400246810SE +/- 0.00, N = 36.906.724.214.211. (CXX) g++ options: -O3 -pthread -lm -lstdc++ -lX11 -lXext -lpthread

QuadRay

Scene: 1 - Resolution: 4K

OpenBenchmarking.orgFPS, More Is BetterQuadRay 2022.05.25Scene: 1 - Resolution: 4KCore i5 124001240013400Core i5 13400246810SE +/- 0.00, N = 37.457.414.574.551. (CXX) g++ options: -O3 -pthread -lm -lstdc++ -lX11 -lXext -lpthread

QuadRay

Scene: 2 - Resolution: 1080p

OpenBenchmarking.orgFPS, More Is BetterQuadRay 2022.05.25Scene: 2 - Resolution: 1080p12400Core i5 12400Core i5 1340013400246810SE +/- 0.00, N = 38.218.215.165.161. (CXX) g++ options: -O3 -pthread -lm -lstdc++ -lX11 -lXext -lpthread

QuadRay

Scene: 3 - Resolution: 4K

OpenBenchmarking.orgFPS, More Is BetterQuadRay 2022.05.25Scene: 3 - Resolution: 4K12400Core i5 12400Core i5 13400134000.38250.7651.14751.531.9125SE +/- 0.00, N = 31.701.701.081.081. (CXX) g++ options: -O3 -pthread -lm -lstdc++ -lX11 -lXext -lpthread

QuadRay

Scene: 1 - Resolution: 1080p

OpenBenchmarking.orgFPS, More Is BetterQuadRay 2022.05.25Scene: 1 - Resolution: 1080pCore i5 124001240013400Core i5 13400714212835SE +/- 0.03, N = 327.9227.6517.9817.951. (CXX) g++ options: -O3 -pthread -lm -lstdc++ -lX11 -lXext -lpthread

Neural Magic DeepSparse

Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-StreamCore i5 1240012400Core i5 13400134004080120160200SE +/- 0.65, N = 3111.75112.13173.13173.50

Neural Magic DeepSparse

Model: CV Detection,YOLOv5s COCO - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: CV Detection,YOLOv5s COCO - Scenario: Asynchronous Multi-Stream12400Core i5 12400Core i5 1340013400306090120150SE +/- 0.50, N = 376.3777.42116.53118.51

Neural Magic DeepSparse

Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-StreamCore i5 124001240013400Core i5 134004080120160200SE +/- 0.37, N = 3119.73121.51184.54185.09

Neural Magic DeepSparse

Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-StreamCore i5 124001240013400Core i5 13400170340510680850SE +/- 2.15, N = 3497.15498.31764.80765.83

Neural Magic DeepSparse

Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-StreamCore i5 1240012400Core i5 1340013400170340510680850SE +/- 1.42, N = 3497.20501.94761.83765.90

Neural Magic DeepSparse

Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-StreamCore i5 1240012400Core i5 13400134001326395265SE +/- 0.22, N = 338.0838.1757.5157.80

Neural Magic DeepSparse

Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-StreamCore i5 124001240013400Core i5 1340020406080100SE +/- 0.08, N = 360.3061.4491.4891.50

spaCy

Model: en_core_web_trf

OpenBenchmarking.orgtokens/sec, More Is BetterspaCy 3.4.1Model: en_core_web_trf12400Core i5 1240013400Core i5 1340030060090012001500SE +/- 2.60, N = 31557153510401034

OpenRadioss

Model: Rubber O-Ring Seal Installation

OpenBenchmarking.orgSeconds, Fewer Is BetterOpenRadioss 2022.10.13Model: Rubber O-Ring Seal InstallationCore i5 1240012400Core i5 134001340060120180240300SE +/- 0.41, N = 3195.38195.67291.76292.59

OpenRadioss

Model: Cell Phone Drop Test

OpenBenchmarking.orgSeconds, Fewer Is BetterOpenRadioss 2022.10.13Model: Cell Phone Drop Test12400Core i5 12400Core i5 13400134004080120160200SE +/- 1.12, N = 3111.92112.09164.84165.13

Stargate Digital Audio Workstation

Sample Rate: 480000 - Buffer Size: 1024

OpenBenchmarking.orgRender Ratio, More Is BetterStargate Digital Audio Workstation 22.11.5Sample Rate: 480000 - Buffer Size: 102413400Core i5 1340012400Core i5 124000.87051.7412.61153.4824.3525SE +/- 0.003281, N = 33.8689273.8586502.6503672.6417621. (CXX) g++ options: -lpthread -lsndfile -lm -O3 -march=native -ffast-math -funroll-loops -fstrength-reduce -fstrict-aliasing -finline-functions

Stargate Digital Audio Workstation

Sample Rate: 44100 - Buffer Size: 1024

OpenBenchmarking.orgRender Ratio, More Is BetterStargate Digital Audio Workstation 22.11.5Sample Rate: 44100 - Buffer Size: 102413400Core i5 13400Core i5 12400124000.89631.79262.68893.58524.4815SE +/- 0.002717, N = 33.9834383.9734042.7280482.7216801. (CXX) g++ options: -lpthread -lsndfile -lm -O3 -march=native -ffast-math -funroll-loops -fstrength-reduce -fstrict-aliasing -finline-functions

Stargate Digital Audio Workstation

Sample Rate: 96000 - Buffer Size: 1024

OpenBenchmarking.orgRender Ratio, More Is BetterStargate Digital Audio Workstation 22.11.5Sample Rate: 96000 - Buffer Size: 102413400Core i5 1340012400Core i5 124000.63491.26981.90472.53963.1745SE +/- 0.000675, N = 32.8216042.8142641.9454861.9426771. (CXX) g++ options: -lpthread -lsndfile -lm -O3 -march=native -ffast-math -funroll-loops -fstrength-reduce -fstrict-aliasing -finline-functions

Stargate Digital Audio Workstation

Sample Rate: 192000 - Buffer Size: 1024

OpenBenchmarking.orgRender Ratio, More Is BetterStargate Digital Audio Workstation 22.11.5Sample Rate: 192000 - Buffer Size: 102413400Core i5 1340012400Core i5 124000.41820.83641.25461.67282.091SE +/- 0.000775, N = 31.8585521.8500661.2846951.2826591. (CXX) g++ options: -lpthread -lsndfile -lm -O3 -march=native -ffast-math -funroll-loops -fstrength-reduce -fstrict-aliasing -finline-functions

Stargate Digital Audio Workstation

Sample Rate: 44100 - Buffer Size: 512

OpenBenchmarking.orgRender Ratio, More Is BetterStargate Digital Audio Workstation 22.11.5Sample Rate: 44100 - Buffer Size: 51213400Core i5 13400Core i5 12400124000.83521.67042.50563.34084.176SE +/- 0.000973, N = 33.7119773.6753622.5900082.5895811. (CXX) g++ options: -lpthread -lsndfile -lm -O3 -march=native -ffast-math -funroll-loops -fstrength-reduce -fstrict-aliasing -finline-functions

Stargate Digital Audio Workstation

Sample Rate: 480000 - Buffer Size: 512

OpenBenchmarking.orgRender Ratio, More Is BetterStargate Digital Audio Workstation 22.11.5Sample Rate: 480000 - Buffer Size: 51213400Core i5 13400Core i5 12400124000.80541.61082.41623.22164.027SE +/- 0.001049, N = 33.5796663.5639792.5118932.5034361. (CXX) g++ options: -lpthread -lsndfile -lm -O3 -march=native -ffast-math -funroll-loops -fstrength-reduce -fstrict-aliasing -finline-functions

Stargate Digital Audio Workstation

Sample Rate: 192000 - Buffer Size: 512

OpenBenchmarking.orgRender Ratio, More Is BetterStargate Digital Audio Workstation 22.11.5Sample Rate: 192000 - Buffer Size: 51213400Core i5 1340012400Core i5 124000.36960.73921.10881.47841.848SE +/- 0.000398, N = 31.6426011.6202421.1786181.1681831. (CXX) g++ options: -lpthread -lsndfile -lm -O3 -march=native -ffast-math -funroll-loops -fstrength-reduce -fstrict-aliasing -finline-functions

Stargate Digital Audio Workstation

Sample Rate: 96000 - Buffer Size: 512

OpenBenchmarking.orgRender Ratio, More Is BetterStargate Digital Audio Workstation 22.11.5Sample Rate: 96000 - Buffer Size: 51213400Core i5 13400Core i5 12400124000.57271.14541.71812.29082.8635SE +/- 0.001647, N = 32.5455322.5248471.8162991.8114171. (CXX) g++ options: -lpthread -lsndfile -lm -O3 -march=native -ffast-math -funroll-loops -fstrength-reduce -fstrict-aliasing -finline-functions

miniBUDE

Implementation: OpenMP - Input Deck: BM1

OpenBenchmarking.orgGFInst/s, More Is BetterminiBUDE 20210901Implementation: OpenMP - Input Deck: BM112400Core i5 12400Core i5 134001340060120180240300SE +/- 0.67, N = 3255.53255.44185.85185.291. (CC) gcc options: -std=c99 -Ofast -ffast-math -fopenmp -march=native -lm

miniBUDE

Implementation: OpenMP - Input Deck: BM1

OpenBenchmarking.orgBillion Interactions/s, More Is BetterminiBUDE 20210901Implementation: OpenMP - Input Deck: BM112400Core i5 12400Core i5 13400134003691215SE +/- 0.027, N = 310.22110.2177.4347.4121. (CC) gcc options: -std=c99 -Ofast -ffast-math -fopenmp -march=native -lm

BRL-CAD

VGR Performance Metric

OpenBenchmarking.orgVGR Performance Metric, More Is BetterBRL-CAD 7.34VGR Performance Metric13400Core i5 13400Core i5 124001240040K80K120K160K200K2050782047331495981495511. (CXX) g++ options: -std=c++14 -pipe -fvisibility=hidden -fno-strict-aliasing -fno-common -fexceptions -ftemplate-depth-128 -m64 -ggdb3 -O3 -fipa-pta -fstrength-reduce -finline-functions -flto -ltcl8.6 -lregex_brl -lz_brl -lnetpbm -ldl -lm -ltk8.6

OpenRadioss

Model: Bumper Beam

OpenBenchmarking.orgSeconds, Fewer Is BetterOpenRadioss 2022.10.13Model: Bumper Beam12400Core i5 12400Core i5 134001340050100150200250SE +/- 2.21, N = 3178.13178.37239.47242.52

OpenVINO

Model: Face Detection FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.3Model: Face Detection FP16 - Device: CPU13400Core i5 1340012400Core i5 124000.5671.1341.7012.2682.8352.522.511.901.901. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared

OpenVINO

Model: Face Detection FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.3Model: Face Detection FP16 - Device: CPU13400Core i5 1340012400Core i5 1240050010001500200025001583.071584.912094.062098.29MIN: 1477.42 / MAX: 1887.76MIN: 1427.31 / MAX: 1889.25MIN: 2054 / MAX: 2144.08MIN: 2052.06 / MAX: 2136.021. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared

uvg266

Video Input: Bosphorus 1080p - Video Preset: Slow

OpenBenchmarking.orgFrames Per Second, More Is Betteruvg266 0.4.1Video Input: Bosphorus 1080p - Video Preset: Slow13400Core i5 13400Core i5 124001240071421283529.5529.3722.4122.40

Kvazaar

Video Input: Bosphorus 1080p - Video Preset: Slow

OpenBenchmarking.orgFrames Per Second, More Is BetterKvazaar 2.2Video Input: Bosphorus 1080p - Video Preset: SlowCore i5 134001340012400Core i5 12400102030405043.6743.3733.2033.121. (CC) gcc options: -pthread -ftree-vectorize -fvisibility=hidden -O2 -lpthread -lm -lrt

Kvazaar

Video Input: Bosphorus 1080p - Video Preset: Medium

OpenBenchmarking.orgFrames Per Second, More Is BetterKvazaar 2.2Video Input: Bosphorus 1080p - Video Preset: MediumCore i5 1340013400Core i5 1240012400102030405045.1345.0234.4734.431. (CC) gcc options: -pthread -ftree-vectorize -fvisibility=hidden -O2 -lpthread -lm -lrt

uvg266

Video Input: Bosphorus 1080p - Video Preset: Medium

OpenBenchmarking.orgFrames Per Second, More Is Betteruvg266 0.4.1Video Input: Bosphorus 1080p - Video Preset: Medium13400Core i5 13400Core i5 124001240081624324032.9332.8625.1425.13

libavif avifenc

Encoder Speed: 6

OpenBenchmarking.orgSeconds, Fewer Is Betterlibavif avifenc 0.11Encoder Speed: 613400Core i5 1340012400Core i5 124003691215SE +/- 0.012, N = 36.9707.0119.0509.1271. (CXX) g++ options: -O3 -fPIC -lm

nekRS

Input: TurboPipe Periodic

OpenBenchmarking.orgFLOP/s, More Is BetternekRS 22.0Input: TurboPipe PeriodicCore i5 124001240013400Core i5 1340012000M24000M36000M48000M60000MSE +/- 42366535.54, N = 3569268000005653830000043549200000434782000001. (CXX) g++ options: -fopenmp -O2 -march=native -mtune=native -ftree-vectorize -lmpi_cxx -lmpi

libavif avifenc

Encoder Speed: 6, Lossless

OpenBenchmarking.orgSeconds, Fewer Is Betterlibavif avifenc 0.11Encoder Speed: 6, LosslessCore i5 134001340012400Core i5 124003691215SE +/- 0.02, N = 310.0810.1213.1013.171. (CXX) g++ options: -O3 -fPIC -lm

uvg266

Video Input: Bosphorus 1080p - Video Preset: Ultra Fast

OpenBenchmarking.orgFrames Per Second, More Is Betteruvg266 0.4.1Video Input: Bosphorus 1080p - Video Preset: Ultra Fast13400Core i5 13400Core i5 124001240020406080100107.57107.5082.4182.38

OpenVINO

Model: Person Detection FP32 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.3Model: Person Detection FP32 - Device: CPU13400Core i5 1340012400Core i5 1240060012001800240030002330.872341.393010.563026.39MIN: 2130.11 / MAX: 3008.71MIN: 2163.53 / MAX: 3007.58MIN: 2966.05 / MAX: 3058.2MIN: 2963.75 / MAX: 3245.441. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared

Kvazaar

Video Input: Bosphorus 1080p - Video Preset: Ultra Fast

OpenBenchmarking.orgFrames Per Second, More Is BetterKvazaar 2.2Video Input: Bosphorus 1080p - Video Preset: Ultra Fast13400Core i5 13400Core i5 12400124004080120160200165.29164.90127.53127.361. (CC) gcc options: -pthread -ftree-vectorize -fvisibility=hidden -O2 -lpthread -lm -lrt

OpenVINO

Model: Person Detection FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.3Model: Person Detection FP16 - Device: CPU13400Core i5 1340012400Core i5 1240060012001800240030002328.102334.053012.863016.23MIN: 2104.47 / MAX: 2986.35MIN: 2135.53 / MAX: 3065.89MIN: 2985.99 / MAX: 3074.98MIN: 2973.48 / MAX: 3071.331. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared

Blender

Blend File: BMW27 - Compute: CPU-Only

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 3.4Blend File: BMW27 - Compute: CPU-OnlyCore i5 1340013400Core i5 1240012400306090120150SE +/- 0.02, N = 3119.15119.20154.16154.30

uvg266

Video Input: Bosphorus 1080p - Video Preset: Super Fast

OpenBenchmarking.orgFrames Per Second, More Is Betteruvg266 0.4.1Video Input: Bosphorus 1080p - Video Preset: Super Fast13400Core i5 13400Core i5 12400124002040608010088.3388.2668.6068.50

OpenVINO

Model: Person Detection FP32 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.3Model: Person Detection FP32 - Device: CPUCore i5 134001340012400Core i5 124000.38250.7651.14751.531.91251.701.701.331.321. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared

OpenVINO

Model: Person Detection FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.3Model: Person Detection FP16 - Device: CPUCore i5 134001340012400Core i5 124000.38250.7651.14751.531.91251.701.701.331.321. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared

libavif avifenc

Encoder Speed: 0

OpenBenchmarking.orgSeconds, Fewer Is Betterlibavif avifenc 0.11Encoder Speed: 0Core i5 134001340012400Core i5 124004080120160200SE +/- 0.36, N = 3140.47140.72180.65180.901. (CXX) g++ options: -O3 -fPIC -lm

Timed Linux Kernel Compilation

Build: allmodconfig

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed Linux Kernel Compilation 6.1Build: allmodconfig13400Core i5 1340012400Core i5 1240030060090012001500SE +/- 0.19, N = 31243.641245.071592.631597.05

Blender

Blend File: Pabellon Barcelona - Compute: CPU-Only

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 3.4Blend File: Pabellon Barcelona - Compute: CPU-Only13400Core i5 1340012400Core i5 12400120240360480600418.18419.60535.47536.66

Blender

Blend File: Classroom - Compute: CPU-Only

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 3.4Blend File: Classroom - Compute: CPU-OnlyCore i5 134001340012400Core i5 12400100200300400500SE +/- 0.14, N = 3348.54348.77444.90445.12

uvg266

Video Input: Bosphorus 1080p - Video Preset: Very Fast

OpenBenchmarking.orgFrames Per Second, More Is Betteruvg266 0.4.1Video Input: Bosphorus 1080p - Video Preset: Very FastCore i5 1340013400Core i5 12400124002040608010081.7281.6364.1764.15

Timed Linux Kernel Compilation

Build: defconfig

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed Linux Kernel Compilation 6.1Build: defconfig13400Core i5 1340012400Core i5 12400306090120150SE +/- 0.34, N = 395.9396.78121.36122.04

Blender

Blend File: Fishy Cat - Compute: CPU-Only

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 3.4Blend File: Fishy Cat - Compute: CPU-OnlyCore i5 134001340012400Core i5 1240050100150200250SE +/- 0.17, N = 3171.28171.62216.93217.84

Blender

Blend File: Barbershop - Compute: CPU-Only

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 3.4Blend File: Barbershop - Compute: CPU-Only13400Core i5 1340012400Core i5 124004008001200160020001359.501365.211726.291728.20

uvg266

Video Input: Bosphorus 4K - Video Preset: Very Fast

OpenBenchmarking.orgFrames Per Second, More Is Betteruvg266 0.4.1Video Input: Bosphorus 4K - Video Preset: Very Fast13400Core i5 1340012400Core i5 1240051015202518.2918.2514.4714.44

libavif avifenc

Encoder Speed: 2

OpenBenchmarking.orgSeconds, Fewer Is Betterlibavif avifenc 0.11Encoder Speed: 2Core i5 134001340012400Core i5 1240020406080100SE +/- 0.04, N = 365.4365.7282.4282.831. (CXX) g++ options: -O3 -fPIC -lm

uvg266

Video Input: Bosphorus 4K - Video Preset: Ultra Fast

OpenBenchmarking.orgFrames Per Second, More Is Betteruvg266 0.4.1Video Input: Bosphorus 4K - Video Preset: Ultra Fast13400Core i5 13400Core i5 124001240061218243023.9423.7718.9318.92

uvg266

Video Input: Bosphorus 4K - Video Preset: Super Fast

OpenBenchmarking.orgFrames Per Second, More Is Betteruvg266 0.4.1Video Input: Bosphorus 4K - Video Preset: Super Fast13400Core i5 1340012400Core i5 1240051015202519.5319.4415.5015.49

Kvazaar

Video Input: Bosphorus 1080p - Video Preset: Super Fast

OpenBenchmarking.orgFrames Per Second, More Is BetterKvazaar 2.2Video Input: Bosphorus 1080p - Video Preset: Super FastCore i5 134001340012400Core i5 12400306090120150119.64119.2795.0394.931. (CC) gcc options: -pthread -ftree-vectorize -fvisibility=hidden -O2 -lpthread -lm -lrt

OpenVINO

Model: Machine Translation EN To DE FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.3Model: Machine Translation EN To DE FP16 - Device: CPU13400Core i5 1340012400Core i5 1240071421283532.0832.0025.5725.491. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared

OpenVINO

Model: Machine Translation EN To DE FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.3Model: Machine Translation EN To DE FP16 - Device: CPU13400Core i5 1340012400Core i5 12400306090120150124.62124.93156.31156.75MIN: 111.98 / MAX: 178.7MIN: 111.3 / MAX: 183.58MIN: 149.83 / MAX: 167MIN: 149.92 / MAX: 175.471. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared

Kvazaar

Video Input: Bosphorus 4K - Video Preset: Super Fast

OpenBenchmarking.orgFrames Per Second, More Is BetterKvazaar 2.2Video Input: Bosphorus 4K - Video Preset: Super Fast13400Core i5 1340012400Core i5 1240071421283527.9327.7422.2622.221. (CC) gcc options: -pthread -ftree-vectorize -fvisibility=hidden -O2 -lpthread -lm -lrt

Kvazaar

Video Input: Bosphorus 4K - Video Preset: Slow

OpenBenchmarking.orgFrames Per Second, More Is BetterKvazaar 2.2Video Input: Bosphorus 4K - Video Preset: SlowCore i5 134001340012400Core i5 124002468108.678.676.946.931. (CC) gcc options: -pthread -ftree-vectorize -fvisibility=hidden -O2 -lpthread -lm -lrt

Kvazaar

Video Input: Bosphorus 4K - Video Preset: Medium

OpenBenchmarking.orgFrames Per Second, More Is BetterKvazaar 2.2Video Input: Bosphorus 4K - Video Preset: Medium13400Core i5 13400Core i5 12400124002468108.908.887.137.121. (CC) gcc options: -pthread -ftree-vectorize -fvisibility=hidden -O2 -lpthread -lm -lrt

Kvazaar

Video Input: Bosphorus 4K - Video Preset: Ultra Fast

OpenBenchmarking.orgFrames Per Second, More Is BetterKvazaar 2.2Video Input: Bosphorus 4K - Video Preset: Ultra Fast13400Core i5 13400Core i5 124001240091827364538.3138.1830.7030.661. (CC) gcc options: -pthread -ftree-vectorize -fvisibility=hidden -O2 -lpthread -lm -lrt

Kvazaar

Video Input: Bosphorus 4K - Video Preset: Very Fast

OpenBenchmarking.orgFrames Per Second, More Is BetterKvazaar 2.2Video Input: Bosphorus 4K - Video Preset: Very Fast13400Core i5 1340012400Core i5 1240051015202522.2122.1117.8417.791. (CC) gcc options: -pthread -ftree-vectorize -fvisibility=hidden -O2 -lpthread -lm -lrt

uvg266

Video Input: Bosphorus 4K - Video Preset: Slow

OpenBenchmarking.orgFrames Per Second, More Is Betteruvg266 0.4.1Video Input: Bosphorus 4K - Video Preset: Slow13400Core i5 1340012400Core i5 124001.25552.5113.76655.0226.27755.585.574.494.48

uvg266

Video Input: Bosphorus 4K - Video Preset: Medium

OpenBenchmarking.orgFrames Per Second, More Is Betteruvg266 0.4.1Video Input: Bosphorus 4K - Video Preset: Medium13400Core i5 1340012400Core i5 124002468106.306.295.065.06

OpenVKL

Benchmark: vklBenchmark Scalar

OpenBenchmarking.orgItems / Sec, More Is BetterOpenVKL 1.3.1Benchmark: vklBenchmark ScalarCore i5 134001340012400Core i5 1240020406080100SE +/- 0.00, N = 393937575MIN: 9 / MAX: 1779MIN: 9 / MAX: 1775MIN: 7 / MAX: 1385MIN: 7 / MAX: 1382

OpenRadioss

Model: INIVOL and Fluid Structure Interaction Drop Container

OpenBenchmarking.orgSeconds, Fewer Is BetterOpenRadioss 2022.10.13Model: INIVOL and Fluid Structure Interaction Drop Container12400Core i5 12400Core i5 13400134002004006008001000SE +/- 3.17, N = 3644.80644.83785.44796.75

Kvazaar

Video Input: Bosphorus 1080p - Video Preset: Very Fast

OpenBenchmarking.orgFrames Per Second, More Is BetterKvazaar 2.2Video Input: Bosphorus 1080p - Video Preset: Very Fast13400Core i5 1340012400Core i5 124002040608010092.7192.5675.6375.451. (CC) gcc options: -pthread -ftree-vectorize -fvisibility=hidden -O2 -lpthread -lm -lrt

OpenVINO

Model: Vehicle Detection FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.3Model: Vehicle Detection FP16 - Device: CPU13400Core i5 1340012400Core i5 1240051015202516.0016.0419.4319.45MIN: 14.09 / MAX: 25.84MIN: 13.66 / MAX: 25.82MIN: 18.46 / MAX: 26.18MIN: 18.39 / MAX: 25.471. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared

OpenVINO

Model: Vehicle Detection FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.3Model: Vehicle Detection FP16 - Device: CPU13400Core i5 1340012400Core i5 1240050100150200250249.83249.21205.79205.521. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared

OpenVKL

Benchmark: vklBenchmark ISPC

OpenBenchmarking.orgItems / Sec, More Is BetterOpenVKL 1.3.1Benchmark: vklBenchmark ISPCCore i5 134001340012400Core i5 124004080120160200SE +/- 0.58, N = 3176175147146MIN: 19 / MAX: 2712MIN: 18 / MAX: 2713MIN: 15 / MAX: 2299MIN: 15 / MAX: 2301

SVT-AV1

Encoder Mode: Preset 8 - Input: Bosphorus 4K

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.4Encoder Mode: Preset 8 - Input: Bosphorus 4K13400Core i5 13400Core i5 1240012400918273645SE +/- 0.10, N = 338.0037.9331.6131.551. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

SVT-AV1

Encoder Mode: Preset 4 - Input: Bosphorus 4K

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.4Encoder Mode: Preset 4 - Input: Bosphorus 4KCore i5 134001340012400Core i5 124000.651.31.952.63.25SE +/- 0.004, N = 32.8892.8732.4082.4051. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

SVT-AV1

Encoder Mode: Preset 8 - Input: Bosphorus 1080p

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.4Encoder Mode: Preset 8 - Input: Bosphorus 1080p13400Core i5 13400Core i5 124001240020406080100SE +/- 0.36, N = 3103.93103.7787.1186.711. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

CockroachDB

Workload: KV, 95% Reads - Concurrency: 512

OpenBenchmarking.orgops/s, More Is BetterCockroachDB 22.2Workload: KV, 95% Reads - Concurrency: 51213400Core i5 13400Core i5 124001240014K28K42K56K70KSE +/- 241.43, N = 367125.866905.656455.556109.5

OpenVINO

Model: Person Vehicle Bike Detection FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.3Model: Person Vehicle Bike Detection FP16 - Device: CPU13400Core i5 13400Core i5 1240012400369121510.6010.6212.5512.65MIN: 9.52 / MAX: 16.08MIN: 9.14 / MAX: 16.53MIN: 12.23 / MAX: 20.14MIN: 12.01 / MAX: 18.991. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared

OpenVINO

Model: Person Vehicle Bike Detection FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.3Model: Person Vehicle Bike Detection FP16 - Device: CPU13400Core i5 13400Core i5 124001240080160240320400377.00376.18318.63316.131. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared

libavif avifenc

Encoder Speed: 10, Lossless

OpenBenchmarking.orgSeconds, Fewer Is Betterlibavif avifenc 0.11Encoder Speed: 10, Lossless13400Core i5 1340012400Core i5 124001.31422.62843.94265.25686.571SE +/- 0.021, N = 34.9064.9835.7475.8411. (CXX) g++ options: -O3 -fPIC -lm

CockroachDB

Workload: KV, 95% Reads - Concurrency: 256

OpenBenchmarking.orgops/s, More Is BetterCockroachDB 22.2Workload: KV, 95% Reads - Concurrency: 25613400Core i5 13400Core i5 124001240015K30K45K60K75KSE +/- 126.38, N = 368318.568289.157642.857470.0

CockroachDB

Workload: KV, 95% Reads - Concurrency: 128

OpenBenchmarking.orgops/s, More Is BetterCockroachDB 22.2Workload: KV, 95% Reads - Concurrency: 128Core i5 134001340012400Core i5 1240015K30K45K60K75KSE +/- 104.96, N = 369900.269633.959140.659000.6

CockroachDB

Workload: KV, 95% Reads - Concurrency: 1024

OpenBenchmarking.orgops/s, More Is BetterCockroachDB 22.2Workload: KV, 95% Reads - Concurrency: 102413400Core i5 13400Core i5 124001240014K28K42K56K70KSE +/- 72.44, N = 365255.665146.255187.655093.5

EnCodec

Target Bandwidth: 6 kbps

OpenBenchmarking.orgSeconds, Fewer Is BetterEnCodec 0.1.1Target Bandwidth: 6 kbps12400Core i5 12400Core i5 134001340071421283526.2127.2030.8231.04

OpenVINO

Model: Vehicle Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.3Model: Vehicle Detection FP16-INT8 - Device: CPU13400Core i5 13400Core i5 124001240036912158.688.7210.2510.25MIN: 7.54 / MAX: 17.41MIN: 7.54 / MAX: 22.25MIN: 10.08 / MAX: 16.3MIN: 10.11 / MAX: 17.661. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared

OpenVINO

Model: Vehicle Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.3Model: Vehicle Detection FP16-INT8 - Device: CPU13400Core i5 1340012400Core i5 12400100200300400500460.22458.38390.03390.021. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared

EnCodec

Target Bandwidth: 24 kbps

OpenBenchmarking.orgSeconds, Fewer Is BetterEnCodec 0.1.1Target Bandwidth: 24 kbps12400Core i5 1240013400Core i5 1340081624324029.9031.1834.6935.28

ClickHouse

100M Rows Hits Dataset, First Run / Cold Cache

OpenBenchmarking.orgQueries Per Minute, Geo Mean, More Is BetterClickHouse 22.12.3.5100M Rows Hits Dataset, First Run / Cold Cache13400Core i5 1340012400Core i5 1240050100150200250212.37209.34185.39180.38MIN: 9.19 / MAX: 7500MIN: 9.46 / MAX: 7500MIN: 6.57 / MAX: 6666.67MIN: 6.59 / MAX: 6666.67

CockroachDB

Workload: KV, 50% Reads - Concurrency: 1024

OpenBenchmarking.orgops/s, More Is BetterCockroachDB 22.2Workload: KV, 50% Reads - Concurrency: 102413400Core i5 13400Core i5 124001240011K22K33K44K55KSE +/- 93.19, N = 349206.749201.141950.841862.4

ClickHouse

100M Rows Hits Dataset, Second Run

OpenBenchmarking.orgQueries Per Minute, Geo Mean, More Is BetterClickHouse 22.12.3.5100M Rows Hits Dataset, Second Run13400Core i5 13400Core i5 124001240050100150200250228.27222.15200.59199.01MIN: 9.34 / MAX: 8571.43MIN: 9.54 / MAX: 7500MIN: 6.72 / MAX: 7500MIN: 6.76 / MAX: 6666.67

CockroachDB

Workload: KV, 60% Reads - Concurrency: 1024

OpenBenchmarking.orgops/s, More Is BetterCockroachDB 22.2Workload: KV, 60% Reads - Concurrency: 102413400Core i5 1340012400Core i5 1240011K22K33K44K55KSE +/- 106.59, N = 351715.551692.844239.544079.6

EnCodec

Target Bandwidth: 1.5 kbps

OpenBenchmarking.orgSeconds, Fewer Is BetterEnCodec 0.1.1Target Bandwidth: 1.5 kbps12400Core i5 1240013400Core i5 1340071421283525.0126.0529.1329.32

OpenVINO

Model: Face Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.3Model: Face Detection FP16-INT8 - Device: CPU13400Core i5 1340012400Core i5 12400110220330440550429.89432.13503.11503.59MIN: 339.29 / MAX: 913.71MIN: 360.39 / MAX: 940.27MIN: 498.88 / MAX: 511.99MIN: 492.41 / MAX: 512.071. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared

OpenVINO

Model: Face Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.3Model: Face Detection FP16-INT8 - Device: CPU13400Core i5 1340012400Core i5 1240036912159.269.177.957.931. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared

OpenRadioss

Model: Bird Strike on Windshield

OpenBenchmarking.orgSeconds, Fewer Is BetterOpenRadioss 2022.10.13Model: Bird Strike on WindshieldCore i5 124001240013400Core i5 1340080160240320400SE +/- 1.87, N = 3333.39333.43387.78388.70

EnCodec

Target Bandwidth: 3 kbps

OpenBenchmarking.orgSeconds, Fewer Is BetterEnCodec 0.1.1Target Bandwidth: 3 kbps12400Core i5 1240013400Core i5 1340071421283526.1427.0830.3130.43

OpenVINO

Model: Weld Porosity Detection FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.3Model: Weld Porosity Detection FP16 - Device: CPU12400Core i5 1240013400Core i5 1340050100150200250209.02207.49181.19179.691. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared

SVT-AV1

Encoder Mode: Preset 13 - Input: Bosphorus 4K

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.4Encoder Mode: Preset 13 - Input: Bosphorus 4KCore i5 134001340012400Core i5 12400306090120150SE +/- 0.71, N = 3142.94141.41123.73123.341. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

CockroachDB

Workload: KV, 10% Reads - Concurrency: 1024

OpenBenchmarking.orgops/s, More Is BetterCockroachDB 22.2Workload: KV, 10% Reads - Concurrency: 1024Core i5 134001340012400Core i5 124009K18K27K36K45KSE +/- 24.23, N = 342551.042546.136894.836820.5

Xmrig

Variant: Wownero - Hash Count: 1M

OpenBenchmarking.orgH/s, More Is BetterXmrig 6.18.1Variant: Wownero - Hash Count: 1MCore i5 1340013400Core i5 124001240015003000450060007500SE +/- 15.59, N = 37156.97122.96231.76201.51. (CXX) g++ options: -fexceptions -fno-rtti -maes -O3 -Ofast -static-libgcc -static-libstdc++ -rdynamic -lssl -lcrypto -luv -lpthread -lrt -ldl -lhwloc

OpenVINO

Model: Weld Porosity Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.3Model: Weld Porosity Detection FP16-INT8 - Device: CPU12400Core i5 12400Core i5 13400134002004006008001000790.35788.77694.55684.891. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared

SVT-AV1

Encoder Mode: Preset 12 - Input: Bosphorus 4K

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.4Encoder Mode: Preset 12 - Input: Bosphorus 4K13400Core i5 13400Core i5 1240012400306090120150SE +/- 0.26, N = 3134.95134.25117.30116.981. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

SVT-AV1

Encoder Mode: Preset 4 - Input: Bosphorus 1080p

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.4Encoder Mode: Preset 4 - Input: Bosphorus 1080p13400Core i5 1340012400Core i5 124003691215SE +/- 0.055, N = 39.0989.0127.9157.8991. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

TensorFlow

Device: CPU - Batch Size: 64 - Model: GoogLeNet

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.10Device: CPU - Batch Size: 64 - Model: GoogLeNet13400Core i5 1340012400Core i5 124001326395265SE +/- 0.13, N = 357.5157.5049.9749.94

CockroachDB

Workload: KV, 60% Reads - Concurrency: 512

OpenBenchmarking.orgops/s, More Is BetterCockroachDB 22.2Workload: KV, 60% Reads - Concurrency: 51213400Core i5 1340012400Core i5 1240011K22K33K44K55KSE +/- 42.65, N = 350477.050413.543981.043959.3

ClickHouse

100M Rows Hits Dataset, Third Run

OpenBenchmarking.orgQueries Per Minute, Geo Mean, More Is BetterClickHouse 22.12.3.5100M Rows Hits Dataset, Third Run13400Core i5 13400Core i5 124001240050100150200250225.55224.48202.90201.10MIN: 9.32 / MAX: 7500MIN: 9.15 / MAX: 7500MIN: 6.79 / MAX: 8571.43MIN: 6.78 / MAX: 7500

TensorFlow

Device: CPU - Batch Size: 16 - Model: GoogLeNet

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.10Device: CPU - Batch Size: 16 - Model: GoogLeNet13400Core i5 1340012400Core i5 124001224364860SE +/- 0.11, N = 354.7454.7248.0947.99

TensorFlow

Device: CPU - Batch Size: 32 - Model: GoogLeNet

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.10Device: CPU - Batch Size: 32 - Model: GoogLeNet13400Core i5 13400Core i5 12400124001326395265SE +/- 0.07, N = 356.0055.9549.2949.17

Xmrig

Variant: Monero - Hash Count: 1M

OpenBenchmarking.orgH/s, More Is BetterXmrig 6.18.1Variant: Monero - Hash Count: 1M13400Core i5 1340012400Core i5 1240011002200330044005500SE +/- 5.44, N = 35168.45164.34590.04585.31. (CXX) g++ options: -fexceptions -fno-rtti -maes -O3 -Ofast -static-libgcc -static-libstdc++ -rdynamic -lssl -lcrypto -luv -lpthread -lrt -ldl -lhwloc

JPEG XL Decoding libjxl

CPU Threads: All

OpenBenchmarking.orgMP/s, More Is BetterJPEG XL Decoding libjxl 0.7CPU Threads: AllCore i5 134001340012400Core i5 1240070140210280350SE +/- 0.38, N = 3304.23304.22271.97269.98

SVT-AV1

Encoder Mode: Preset 12 - Input: Bosphorus 1080p

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.4Encoder Mode: Preset 12 - Input: Bosphorus 1080p13400Core i5 13400Core i5 1240012400110220330440550SE +/- 3.43, N = 3502.96500.43453.39447.691. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

CockroachDB

Workload: KV, 50% Reads - Concurrency: 512

OpenBenchmarking.orgops/s, More Is BetterCockroachDB 22.2Workload: KV, 50% Reads - Concurrency: 512Core i5 1340013400Core i5 124001240010K20K30K40K50KSE +/- 45.17, N = 345816.545770.241073.540974.9

Neural Magic DeepSparse

Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-StreamCore i5 1340013400Core i5 12400124001224364860SE +/- 0.05, N = 354.5854.5149.7548.82

CockroachDB

Workload: KV, 10% Reads - Concurrency: 512

OpenBenchmarking.orgops/s, More Is BetterCockroachDB 22.2Workload: KV, 10% Reads - Concurrency: 512Core i5 134001340012400Core i5 124007K14K21K28K35KSE +/- 56.87, N = 334253.834012.030683.930654.1

JPEG XL libjxl

Input: JPEG - Quality: 90

OpenBenchmarking.orgMP/s, More Is BetterJPEG XL libjxl 0.7Input: JPEG - Quality: 90Core i5 134001340012400Core i5 124003691215SE +/- 0.01, N = 39.619.598.928.681. (CXX) g++ options: -fno-rtti -funwind-tables -O3 -O2 -fPIE -pie -lm -latomic

Neural Magic DeepSparse

Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-StreamCore i5 1340013400Core i5 124001240020406080100SE +/- 0.33, N = 386.8886.3678.7578.56

Neural Magic DeepSparse

Model: CV Detection,YOLOv5s COCO - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: CV Detection,YOLOv5s COCO - Scenario: Asynchronous Multi-StreamCore i5 134001340012400Core i5 124001020304050SE +/- 0.17, N = 342.7542.0839.2538.71

JPEG XL libjxl

Input: JPEG - Quality: 80

OpenBenchmarking.orgMP/s, More Is BetterJPEG XL libjxl 0.7Input: JPEG - Quality: 80Core i5 134001340012400Core i5 124003691215SE +/- 0.00, N = 39.779.759.098.871. (CXX) g++ options: -fno-rtti -funwind-tables -O3 -O2 -fPIE -pie -lm -latomic

Neural Magic DeepSparse

Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-StreamCore i5 1340013400Core i5 1240012400246810SE +/- 0.0214, N = 36.52956.47796.03365.9666

Neural Magic DeepSparse

Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-Stream13400Core i5 13400Core i5 1240012400612182430SE +/- 0.07, N = 326.9326.8125.0524.69

JPEG XL libjxl

Input: PNG - Quality: 90

OpenBenchmarking.orgMP/s, More Is BetterJPEG XL libjxl 0.7Input: PNG - Quality: 90Core i5 134001340012400Core i5 124003691215SE +/- 0.01, N = 39.729.719.088.931. (CXX) g++ options: -fno-rtti -funwind-tables -O3 -O2 -fPIE -pie -lm -latomic

Neural Magic DeepSparse

Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Synchronous Single-Stream13400Core i5 13400Core i5 1240012400246810SE +/- 0.0097, N = 36.19616.18295.77765.7122

Neural Magic DeepSparse

Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Synchronous Single-Stream13400Core i5 13400Core i5 12400124004080120160200SE +/- 0.25, N = 3161.39161.73173.08175.06

SVT-AV1

Encoder Mode: Preset 13 - Input: Bosphorus 1080p

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.4Encoder Mode: Preset 13 - Input: Bosphorus 1080p13400Core i5 13400Core i5 1240012400120240360480600SE +/- 2.55, N = 3537.89533.94497.71497.221. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

JPEG XL libjxl

Input: PNG - Quality: 80

OpenBenchmarking.orgMP/s, More Is BetterJPEG XL libjxl 0.7Input: PNG - Quality: 8013400Core i5 1340012400Core i5 124003691215SE +/- 0.01, N = 39.889.879.259.141. (CXX) g++ options: -fno-rtti -funwind-tables -O3 -O2 -fPIE -pie -lm -latomic

Neural Magic DeepSparse

Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Stream13400Core i5 13400Core i5 1240012400246810SE +/- 0.0278, N = 36.50686.49296.03386.0197

Neural Magic DeepSparse

Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Synchronous Single-Stream13400Core i5 13400Core i5 12400124004080120160200SE +/- 0.02, N = 3161.46161.69172.73174.38

Neural Magic DeepSparse

Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Synchronous Single-Stream13400Core i5 13400Core i5 1240012400246810SE +/- 0.0006, N = 36.19326.18445.78945.7346

Neural Magic DeepSparse

Model: NLP Text Classification, DistilBERT mnli - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: NLP Text Classification, DistilBERT mnli - Scenario: Synchronous Single-StreamCore i5 1340013400Core i5 1240012400510152025SE +/- 0.04, N = 321.1421.4222.1522.82

Neural Magic DeepSparse

Model: NLP Text Classification, DistilBERT mnli - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: NLP Text Classification, DistilBERT mnli - Scenario: Synchronous Single-StreamCore i5 1340013400Core i5 12400124001122334455SE +/- 0.09, N = 347.3046.6945.1343.81

TensorFlow

Device: CPU - Batch Size: 64 - Model: AlexNet

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.10Device: CPU - Batch Size: 64 - Model: AlexNet13400Core i5 13400Core i5 1240012400306090120150SE +/- 0.25, N = 3117.43117.14109.57109.35

Neural Magic DeepSparse

Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-StreamCore i5 1340013400Core i5 1240012400714212835SE +/- 0.10, N = 328.7028.6726.8426.75

OpenVINO

Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.3Model: Age Gender Recognition Retail 0013 FP16 - Device: CPUCore i5 1240012400Core i5 1340013400140028004200560070006329.926317.976046.325970.931. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared

Neural Magic DeepSparse

Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Synchronous Single-Stream13400Core i5 13400Core i5 12400124001020304050SE +/- 0.05, N = 343.0643.1543.8445.60

Neural Magic DeepSparse

Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Synchronous Single-Stream13400Core i5 13400Core i5 1240012400612182430SE +/- 0.02, N = 323.2223.1722.8121.93

TensorFlow

Device: CPU - Batch Size: 32 - Model: AlexNet

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.10Device: CPU - Batch Size: 32 - Model: AlexNet13400Core i5 1340012400Core i5 1240020406080100SE +/- 0.40, N = 3108.31107.89102.84102.40

OpenVINO

Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.3Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPUCore i5 124001240013400Core i5 13400150030004500600075006963.176960.146606.336605.861. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared

TensorFlow

Device: CPU - Batch Size: 16 - Model: AlexNet

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.10Device: CPU - Batch Size: 16 - Model: AlexNetCore i5 1340013400Core i5 124001240020406080100SE +/- 0.07, N = 394.3894.0590.3189.96

JPEG XL libjxl

Input: PNG - Quality: 100

OpenBenchmarking.orgMP/s, More Is BetterJPEG XL libjxl 0.7Input: PNG - Quality: 100Core i5 134001340012400Core i5 124000.1980.3960.5940.7920.99SE +/- 0.00, N = 30.880.880.840.841. (CXX) g++ options: -fno-rtti -funwind-tables -O3 -O2 -fPIE -pie -lm -latomic

spaCy

Model: en_core_web_lg

OpenBenchmarking.orgtokens/sec, More Is BetterspaCy 3.4.1Model: en_core_web_lgCore i5 1340013400Core i5 12400124004K8K12K16K20KSE +/- 53.42, N = 316632164591590715885

Y-Cruncher

Pi Digits To Calculate: 500M

OpenBenchmarking.orgSeconds, Fewer Is BetterY-Cruncher 0.7.10.9513Pi Digits To Calculate: 500MCore i5 1240012400Core i5 1340013400510152025SE +/- 0.06, N = 319.5919.6520.4320.46

JPEG XL Decoding libjxl

CPU Threads: 1

OpenBenchmarking.orgMP/s, More Is BetterJPEG XL Decoding libjxl 0.7CPU Threads: 113400Core i5 1340012400Core i5 124001326395265SE +/- 0.12, N = 357.9957.9156.8855.74

Neural Magic DeepSparse

Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Synchronous Single-StreamCore i5 1240012400Core i5 13400134001020304050SE +/- 0.11, N = 342.3642.8243.9644.04

Neural Magic DeepSparse

Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Synchronous Single-StreamCore i5 1240012400Core i5 1340013400612182430SE +/- 0.06, N = 323.6023.3522.7522.71

JPEG XL libjxl

Input: JPEG - Quality: 100

OpenBenchmarking.orgMP/s, More Is BetterJPEG XL libjxl 0.7Input: JPEG - Quality: 100Core i5 134001340012400Core i5 124000.19350.3870.58050.7740.9675SE +/- 0.00, N = 30.860.860.830.831. (CXX) g++ options: -fno-rtti -funwind-tables -O3 -O2 -fPIE -pie -lm -latomic

CockroachDB

Workload: KV, 50% Reads - Concurrency: 128

OpenBenchmarking.orgops/s, More Is BetterCockroachDB 22.2Workload: KV, 50% Reads - Concurrency: 128Core i5 1340013400Core i5 12400124003K6K9K12K15KSE +/- 141.12, N = 312118.212043.811841.811716.5

CockroachDB

Workload: KV, 10% Reads - Concurrency: 256

OpenBenchmarking.orgops/s, More Is BetterCockroachDB 22.2Workload: KV, 10% Reads - Concurrency: 256Core i5 134001340012400Core i5 124003K6K9K12K15KSE +/- 57.49, N = 313704.013657.013478.113343.2

CockroachDB

Workload: KV, 60% Reads - Concurrency: 128

OpenBenchmarking.orgops/s, More Is BetterCockroachDB 22.2Workload: KV, 60% Reads - Concurrency: 128Core i5 134001340012400Core i5 124003K6K9K12K15KSE +/- 39.43, N = 314961.314829.214628.714590.1

CockroachDB

Workload: KV, 10% Reads - Concurrency: 128

OpenBenchmarking.orgops/s, More Is BetterCockroachDB 22.2Workload: KV, 10% Reads - Concurrency: 128Core i5 1340013400Core i5 124001240015003000450060007500SE +/- 28.90, N = 36770.56690.86631.26622.0

Y-Cruncher

Pi Digits To Calculate: 1B

OpenBenchmarking.orgSeconds, Fewer Is BetterY-Cruncher 0.7.10.9513Pi Digits To Calculate: 1BCore i5 124001240013400Core i5 134001020304050SE +/- 0.13, N = 342.6642.7743.3743.61

TensorFlow

Device: CPU - Batch Size: 32 - Model: ResNet-50

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.10Device: CPU - Batch Size: 32 - Model: ResNet-5012400Core i5 12400Core i5 1340013400510152025SE +/- 0.02, N = 319.3219.2818.9418.92

CockroachDB

Workload: KV, 50% Reads - Concurrency: 256

OpenBenchmarking.orgops/s, More Is BetterCockroachDB 22.2Workload: KV, 50% Reads - Concurrency: 256Core i5 1340013400Core i5 12400124005K10K15K20K25KSE +/- 42.71, N = 324114.223946.223659.623631.1

TensorFlow

Device: CPU - Batch Size: 64 - Model: ResNet-50

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.10Device: CPU - Batch Size: 64 - Model: ResNet-5012400Core i5 1240013400Core i5 13400510152025SE +/- 0.02, N = 319.7219.7119.4719.43

TensorFlow

Device: CPU - Batch Size: 16 - Model: ResNet-50

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.10Device: CPU - Batch Size: 16 - Model: ResNet-50Core i5 134001340012400Core i5 12400510152025SE +/- 0.01, N = 318.9718.9418.7318.70

CockroachDB

Workload: MoVR - Concurrency: 1024

OpenBenchmarking.orgops/s, More Is BetterCockroachDB 22.2Workload: MoVR - Concurrency: 1024Core i5 1240012400Core i5 1340013400306090120150SE +/- 0.07, N = 3125.8124.8124.6124.4

CockroachDB

Workload: MoVR - Concurrency: 128

OpenBenchmarking.orgops/s, More Is BetterCockroachDB 22.2Workload: MoVR - Concurrency: 12812400Core i5 12400Core i5 1340013400306090120150SE +/- 0.07, N = 3125.3125.3124.8124.2

Neural Magic DeepSparse

Model: CV Classification, ResNet-50 ImageNet - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: CV Classification, ResNet-50 ImageNet - Scenario: Synchronous Single-Stream13400Core i5 1340012400Core i5 1240048121620SE +/- 0.01, N = 314.6014.6114.6814.72

Neural Magic DeepSparse

Model: CV Classification, ResNet-50 ImageNet - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: CV Classification, ResNet-50 ImageNet - Scenario: Synchronous Single-Stream13400Core i5 1340012400Core i5 124001530456075SE +/- 0.04, N = 368.4868.4568.0967.91

Neural Magic DeepSparse

Model: CV Detection,YOLOv5s COCO - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: CV Detection,YOLOv5s COCO - Scenario: Synchronous Single-Stream13400Core i5 1340012400Core i5 12400816243240SE +/- 0.06, N = 335.0535.0434.7634.76

Neural Magic DeepSparse

Model: CV Detection,YOLOv5s COCO - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: CV Detection,YOLOv5s COCO - Scenario: Synchronous Single-Stream13400Core i5 1340012400Core i5 12400714212835SE +/- 0.05, N = 328.5228.5328.7628.76

CockroachDB

Workload: MoVR - Concurrency: 512

OpenBenchmarking.orgops/s, More Is BetterCockroachDB 22.2Workload: MoVR - Concurrency: 512Core i5 1240012400Core i5 1340013400306090120150SE +/- 0.10, N = 3125.4124.9124.6124.4

CockroachDB

Workload: KV, 60% Reads - Concurrency: 256

OpenBenchmarking.orgops/s, More Is BetterCockroachDB 22.2Workload: KV, 60% Reads - Concurrency: 256Core i5 13400Core i5 1240012400134006K12K18K24K30KSE +/- 213.65, N = 329664.729557.229540.229512.3

CockroachDB

Workload: MoVR - Concurrency: 256

OpenBenchmarking.orgops/s, More Is BetterCockroachDB 22.2Workload: MoVR - Concurrency: 256Core i5 1340012400Core i5 1240013400306090120150SE +/- 0.00, N = 3124.9124.9124.9124.3

Phoronix Test Suite v10.8.5