Intel Core i5 12400, Core i5 13400 Linux benchmarks new cpus

Benchmarks for a future article on Phoronix.

HTML result view exported from: https://openbenchmarking.org/result/2301154-PTS-EO2022BE79&rdt&grs.

Intel Core i5 12400, Core i5 13400 Linux benchmarks new cpusProcessorMotherboardChipsetMemoryDiskGraphicsAudioMonitorNetworkOSKernelDesktopDisplay ServerOpenGLVulkanCompilerFile-SystemScreen ResolutionCore i5 124001240013400Core i5 13400Intel Core i5-12400 @ 5.60GHz (6 Cores / 12 Threads)ASUS PRIME Z790-P WIFI (0602 BIOS)Intel Device 7a2732GB2000GB Samsung SSD 980 PRO 2TBAMD Radeon RX 6700 XT 12GB (2855/1000MHz)Realtek ALC897ASUS VP28UIntel Device 7a70Ubuntu 22.046.0.0-060000rc1daily20220820-generic (x86_64)GNOME Shell 42.2X Server 1.21.1.3 + Wayland4.6 Mesa 22.3.0-devel (git-4685385 2022-08-23 jammy-oibaf-ppa) (LLVM 14.0.6 DRM 3.48)1.3.224GCC 12.0.1 20220319ext43840x2160Intel Core i5-13400 @ 3.40GHz (10 Cores / 16 Threads)OpenBenchmarking.orgKernel Details- Transparent Huge Pages: madviseCompiler Details- --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-defaulted --enable-offload-targets=nvptx-none=/build/gcc-12-OcsLtf/gcc-12-12-20220319/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-12-OcsLtf/gcc-12-12-20220319/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v Processor Details- Core i5 12400: Scaling Governor: intel_pstate performance (EPP: performance) - CPU Microcode: 0x25 - Thermald 2.4.9- 12400: Scaling Governor: intel_pstate performance (EPP: performance) - CPU Microcode: 0x25 - Thermald 2.4.9- 13400: Scaling Governor: intel_pstate performance (EPP: performance) - CPU Microcode: 0x25- Core i5 13400: Scaling Governor: intel_pstate performance (EPP: performance) - CPU Microcode: 0x25Python Details- Python 3.10.4Security Details- itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Not affected

Intel Core i5 12400, Core i5 13400 Linux benchmarks new cpusopenvino: Weld Porosity Detection FP16 - CPUopenvino: Weld Porosity Detection FP16-INT8 - CPUquadray: 5 - 4Kquadray: 5 - 1080popenvino: Age Gender Recognition Retail 0013 FP16 - CPUopenvino: Age Gender Recognition Retail 0013 FP16-INT8 - CPUquadray: 2 - 4Kquadray: 3 - 1080pquadray: 1 - 4Kquadray: 2 - 1080pquadray: 3 - 4Kquadray: 1 - 1080pdeepsparse: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Asynchronous Multi-Streamdeepsparse: CV Detection,YOLOv5s COCO - Asynchronous Multi-Streamdeepsparse: NLP Text Classification, BERT base uncased SST2 - Asynchronous Multi-Streamdeepsparse: NLP Document Classification, oBERT base uncased on IMDB - Asynchronous Multi-Streamdeepsparse: NLP Token Classification, BERT base uncased conll2003 - Asynchronous Multi-Streamdeepsparse: CV Classification, ResNet-50 ImageNet - Asynchronous Multi-Streamdeepsparse: NLP Text Classification, DistilBERT mnli - Asynchronous Multi-Streamspacy: en_core_web_trfopenradioss: Rubber O-Ring Seal Installationopenradioss: Cell Phone Drop Teststargate: 480000 - 1024stargate: 44100 - 1024stargate: 96000 - 1024stargate: 192000 - 1024stargate: 44100 - 512stargate: 480000 - 512stargate: 192000 - 512stargate: 96000 - 512minibude: OpenMP - BM1minibude: OpenMP - BM1brl-cad: VGR Performance Metricopenradioss: Bumper Beamopenvino: Face Detection FP16 - CPUopenvino: Face Detection FP16 - CPUuvg266: Bosphorus 1080p - Slowkvazaar: Bosphorus 1080p - Slowkvazaar: Bosphorus 1080p - Mediumuvg266: Bosphorus 1080p - Mediumavifenc: 6nekrs: TurboPipe Periodicavifenc: 6, Losslessuvg266: Bosphorus 1080p - Ultra Fastopenvino: Person Detection FP32 - CPUkvazaar: Bosphorus 1080p - Ultra Fastopenvino: Person Detection FP16 - CPUblender: BMW27 - CPU-Onlyuvg266: Bosphorus 1080p - Super Fastopenvino: Person Detection FP32 - CPUopenvino: Person Detection FP16 - CPUavifenc: 0build-linux-kernel: allmodconfigblender: Pabellon Barcelona - CPU-Onlyblender: Classroom - CPU-Onlyuvg266: Bosphorus 1080p - Very Fastbuild-linux-kernel: defconfigblender: Fishy Cat - CPU-Onlyblender: Barbershop - CPU-Onlyuvg266: Bosphorus 4K - Very Fastavifenc: 2uvg266: Bosphorus 4K - Ultra Fastuvg266: Bosphorus 4K - Super Fastkvazaar: Bosphorus 1080p - Super Fastopenvino: Machine Translation EN To DE FP16 - CPUopenvino: Machine Translation EN To DE FP16 - CPUkvazaar: Bosphorus 4K - Super Fastkvazaar: Bosphorus 4K - Slowkvazaar: Bosphorus 4K - Mediumkvazaar: Bosphorus 4K - Ultra Fastkvazaar: Bosphorus 4K - Very Fastuvg266: Bosphorus 4K - Slowuvg266: Bosphorus 4K - Mediumopenvkl: vklBenchmark Scalaropenradioss: INIVOL and Fluid Structure Interaction Drop Containerkvazaar: Bosphorus 1080p - Very Fastopenvino: Vehicle Detection FP16 - CPUopenvino: Vehicle Detection FP16 - CPUopenvkl: vklBenchmark ISPCsvt-av1: Preset 8 - Bosphorus 4Ksvt-av1: Preset 4 - Bosphorus 4Ksvt-av1: Preset 8 - Bosphorus 1080pcockroach: KV, 95% Reads - 512openvino: Person Vehicle Bike Detection FP16 - CPUopenvino: Person Vehicle Bike Detection FP16 - CPUavifenc: 10, Losslesscockroach: KV, 95% Reads - 256cockroach: KV, 95% Reads - 128cockroach: KV, 95% Reads - 1024encodec: 6 kbpsopenvino: Vehicle Detection FP16-INT8 - CPUopenvino: Vehicle Detection FP16-INT8 - CPUencodec: 24 kbpsclickhouse: 100M Rows Hits Dataset, First Run / Cold Cachecockroach: KV, 50% Reads - 1024clickhouse: 100M Rows Hits Dataset, Second Runcockroach: KV, 60% Reads - 1024encodec: 1.5 kbpsopenvino: Face Detection FP16-INT8 - CPUopenvino: Face Detection FP16-INT8 - CPUopenradioss: Bird Strike on Windshieldencodec: 3 kbpsopenvino: Weld Porosity Detection FP16 - CPUsvt-av1: Preset 13 - Bosphorus 4Kcockroach: KV, 10% Reads - 1024xmrig: Wownero - 1Mopenvino: Weld Porosity Detection FP16-INT8 - CPUsvt-av1: Preset 12 - Bosphorus 4Ksvt-av1: Preset 4 - Bosphorus 1080ptensorflow: CPU - 64 - GoogLeNetcockroach: KV, 60% Reads - 512clickhouse: 100M Rows Hits Dataset, Third Runtensorflow: CPU - 16 - GoogLeNettensorflow: CPU - 32 - GoogLeNetxmrig: Monero - 1Mjpegxl-decode: Allsvt-av1: Preset 12 - Bosphorus 1080pcockroach: KV, 50% Reads - 512deepsparse: NLP Text Classification, DistilBERT mnli - Asynchronous Multi-Streamcockroach: KV, 10% Reads - 512jpegxl: JPEG - 90deepsparse: CV Classification, ResNet-50 ImageNet - Asynchronous Multi-Streamdeepsparse: CV Detection,YOLOv5s COCO - Asynchronous Multi-Streamjpegxl: JPEG - 80deepsparse: NLP Token Classification, BERT base uncased conll2003 - Asynchronous Multi-Streamdeepsparse: NLP Text Classification, BERT base uncased SST2 - Asynchronous Multi-Streamjpegxl: PNG - 90deepsparse: NLP Token Classification, BERT base uncased conll2003 - Synchronous Single-Streamdeepsparse: NLP Token Classification, BERT base uncased conll2003 - Synchronous Single-Streamsvt-av1: Preset 13 - Bosphorus 1080pjpegxl: PNG - 80deepsparse: NLP Document Classification, oBERT base uncased on IMDB - Asynchronous Multi-Streamdeepsparse: NLP Document Classification, oBERT base uncased on IMDB - Synchronous Single-Streamdeepsparse: NLP Document Classification, oBERT base uncased on IMDB - Synchronous Single-Streamdeepsparse: NLP Text Classification, DistilBERT mnli - Synchronous Single-Streamdeepsparse: NLP Text Classification, DistilBERT mnli - Synchronous Single-Streamtensorflow: CPU - 64 - AlexNetdeepsparse: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Asynchronous Multi-Streamopenvino: Age Gender Recognition Retail 0013 FP16 - CPUdeepsparse: NLP Text Classification, BERT base uncased SST2 - Synchronous Single-Streamdeepsparse: NLP Text Classification, BERT base uncased SST2 - Synchronous Single-Streamtensorflow: CPU - 32 - AlexNetopenvino: Age Gender Recognition Retail 0013 FP16-INT8 - CPUtensorflow: CPU - 16 - AlexNetjpegxl: PNG - 100spacy: en_core_web_lgy-cruncher: 500Mjpegxl-decode: 1deepsparse: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Synchronous Single-Streamdeepsparse: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Synchronous Single-Streamjpegxl: JPEG - 100cockroach: KV, 50% Reads - 128cockroach: KV, 10% Reads - 256cockroach: KV, 60% Reads - 128cockroach: KV, 10% Reads - 128y-cruncher: 1Btensorflow: CPU - 32 - ResNet-50cockroach: KV, 50% Reads - 256tensorflow: CPU - 64 - ResNet-50tensorflow: CPU - 16 - ResNet-50cockroach: MoVR - 1024cockroach: MoVR - 128deepsparse: CV Classification, ResNet-50 ImageNet - Synchronous Single-Streamdeepsparse: CV Classification, ResNet-50 ImageNet - Synchronous Single-Streamdeepsparse: CV Detection,YOLOv5s COCO - Synchronous Single-Streamdeepsparse: CV Detection,YOLOv5s COCO - Synchronous Single-Streamcockroach: MoVR - 512cockroach: KV, 60% Reads - 256cockroach: MoVR - 256smhasher: wyhashCore i5 124001240013400Core i5 1340028.917.60.552.180.940.862.176.97.458.211.727.92111.749277.4178119.7297497.1534497.200238.083760.29661535195.38112.092.6417622.7280481.9426771.2826592.5900082.5118931.1681831.816299255.43510.217149598178.371.92098.2922.4133.1234.4725.149.1275692680000013.16682.413026.39127.533016.23154.1668.61.321.32180.8961597.045536.66445.1264.17122.039217.841728.214.4482.83418.9315.4994.9325.49156.7522.226.937.1330.717.794.485.0675644.8375.4519.45205.5214631.6112.40587.11156455.512.55318.635.84157642.859000.655187.627.19510.25390.0231.179180.3841950.8200.5944079.626.047503.597.93333.3927.083207.49123.33836820.56231.7788.77117.2967.89949.9443959.3202.9047.9949.294585.3269.98453.39241073.549.746230654.18.6878.752438.70658.876.033625.05258.935.7776173.0775497.7129.146.0338172.72645.789422.153845.1328109.5726.83986329.9243.844822.806102.46963.1790.310.841590719.59355.7442.364123.60110.8311841.813343.214590.16631.242.6619.2823659.619.7118.7125.8125.314.721967.906934.759828.7617125.429557.2124.928.77.580.552.180.940.862.186.727.418.211.727.65112.128376.3733121.5126498.3122501.939438.173761.43671557195.67111.922.6503672.721681.9454861.2846952.5895812.5034361.1786181.811417255.53410.221149551178.131.92094.0622.433.234.4325.139.055653830000013.10182.383010.56127.363012.86154.368.51.331.33180.6521592.63535.47444.964.15121.358216.931726.2914.4782.42418.9215.595.0325.57156.3122.266.947.1230.6617.844.495.0675644.875.6319.43205.7914731.5532.40886.71456109.512.65316.135.7475747059140.655093.526.20610.25390.0329.901185.0041862.4199.0144239.525.013503.117.95333.4326.143209.02123.73436894.86201.5790.35116.9837.91549.9743981201.1048.0949.174590271.97447.69140974.948.823130683.98.9278.563639.25099.095.966624.6859.085.7122175.0597497.2179.256.0197174.37735.734622.823343.8089109.3526.74896317.9745.600821.9279102.846960.1489.960.841588519.64556.8842.816623.35160.8311716.513478.114628.7662242.76619.3223631.119.7218.73124.8125.314.681668.093534.762728.7578124.929540.2124.955.114.530.311.231.661.511.314.214.575.161.0817.98173.5036118.5130184.5428764.8044765.895157.802891.47911040292.59165.133.8689273.9834382.8216041.8585523.7119773.5796661.6426012.545532185.2937.412205078242.522.521583.0729.5543.3745.0232.936.9704354920000010.120107.572330.87165.292328.1119.2088.331.71.7140.7151243.638418.18348.7781.6395.932171.621359.518.2965.72323.9419.53119.2732.08124.6227.938.678.938.3122.215.586.393796.7592.7116249.8317537.9982.873103.92967125.810.63774.90668318.569633.965255.631.0368.68460.2234.691212.3749206.7228.2751715.529.127429.899.26387.7830.305181.19141.41142546.17122.9684.89134.9469.09857.5150477.0225.5554.7456.005168.4304.22502.96145770.254.512934012.09.5986.357242.07609.756.477926.93029.716.1961161.3888537.8869.886.5068161.46426.193221.416046.6875117.4328.66975970.9343.057223.2232108.316606.3394.050.881645920.45557.9944.036622.70510.8612043.813657.014829.26690.843.36818.9223946.219.4718.94124.4124.214.597768.484235.054828.5207124.429512.3124.355.6114.340.311.231.651.511.314.214.555.161.0817.95173.1329116.5342185.0887765.8308761.826957.509191.49591034291.76164.843.858653.9734042.8142641.8500663.6753623.5639791.6202422.524847185.8487.434204733239.472.511584.9129.3743.6745.1332.867.0114347820000010.078107.52341.39164.92334.05119.1588.261.71.7140.4741245.071419.6348.5481.7296.778171.281365.2118.2565.42523.7719.44119.6432124.9327.748.678.8838.1822.115.576.2993785.4492.5616.04249.2117637.9342.889103.77466905.610.62376.184.98368289.169900.265146.230.8228.72458.3835.278209.3449201.1222.1551692.829.318432.139.17388.730.425179.69142.941425517156.9694.55134.2529.01257.550413.5224.4854.7255.955164.3304.23500.42645816.554.575134253.89.6186.878642.7459.776.529526.81429.726.1829161.7337533.9419.876.4929161.69316.184421.137147.3035117.1428.70426046.3243.151223.1726107.896605.8694.380.881663220.42957.9143.955822.74660.8612118.21370414961.36770.543.6118.9424114.219.4318.97124.6124.814.605368.449935.043428.53124.629664.7124.9OpenBenchmarking.org

OpenVINO

Model: Weld Porosity Detection FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.3Model: Weld Porosity Detection FP16 - Device: CPUCore i5 124001240013400Core i5 13400122436486028.9128.7055.1055.61MIN: 28.13 / MAX: 34.69MIN: 28.15 / MAX: 35.06MIN: 43.43 / MAX: 57.02MIN: 41.77 / MAX: 68.791. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared

OpenVINO

Model: Weld Porosity Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.3Model: Weld Porosity Detection FP16-INT8 - Device: CPUCore i5 124001240013400Core i5 13400481216207.607.5814.5314.34MIN: 7.46 / MAX: 12.65MIN: 7.47 / MAX: 33.92MIN: 8.16 / MAX: 18.15MIN: 11.11 / MAX: 15.471. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared

QuadRay

Scene: 5 - Resolution: 4K

OpenBenchmarking.orgFPS, More Is BetterQuadRay 2022.05.25Scene: 5 - Resolution: 4KCore i5 124001240013400Core i5 134000.12380.24760.37140.49520.619SE +/- 0.00, N = 30.550.550.310.311. (CXX) g++ options: -O3 -pthread -lm -lstdc++ -lX11 -lXext -lpthread

QuadRay

Scene: 5 - Resolution: 1080p

OpenBenchmarking.orgFPS, More Is BetterQuadRay 2022.05.25Scene: 5 - Resolution: 1080pCore i5 124001240013400Core i5 134000.49050.9811.47151.9622.4525SE +/- 0.00, N = 32.182.181.231.231. (CXX) g++ options: -O3 -pthread -lm -lstdc++ -lX11 -lXext -lpthread

OpenVINO

Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.3Model: Age Gender Recognition Retail 0013 FP16 - Device: CPUCore i5 124001240013400Core i5 134000.37350.7471.12051.4941.86750.940.941.661.65MIN: 0.9 / MAX: 6.47MIN: 0.91 / MAX: 6.48MIN: 0.97 / MAX: 2.79MIN: 1.27 / MAX: 2.221. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared

OpenVINO

Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.3Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPUCore i5 124001240013400Core i5 134000.33980.67961.01941.35921.6990.860.861.511.51MIN: 0.84 / MAX: 6.54MIN: 0.83 / MAX: 6.58MIN: 1.14 / MAX: 2.14MIN: 1.11 / MAX: 1.951. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared

QuadRay

Scene: 2 - Resolution: 4K

OpenBenchmarking.orgFPS, More Is BetterQuadRay 2022.05.25Scene: 2 - Resolution: 4KCore i5 124001240013400Core i5 134000.49050.9811.47151.9622.4525SE +/- 0.00, N = 32.172.181.311.311. (CXX) g++ options: -O3 -pthread -lm -lstdc++ -lX11 -lXext -lpthread

QuadRay

Scene: 3 - Resolution: 1080p

OpenBenchmarking.orgFPS, More Is BetterQuadRay 2022.05.25Scene: 3 - Resolution: 1080pCore i5 124001240013400Core i5 13400246810SE +/- 0.00, N = 36.906.724.214.211. (CXX) g++ options: -O3 -pthread -lm -lstdc++ -lX11 -lXext -lpthread

QuadRay

Scene: 1 - Resolution: 4K

OpenBenchmarking.orgFPS, More Is BetterQuadRay 2022.05.25Scene: 1 - Resolution: 4KCore i5 124001240013400Core i5 13400246810SE +/- 0.00, N = 37.457.414.574.551. (CXX) g++ options: -O3 -pthread -lm -lstdc++ -lX11 -lXext -lpthread

QuadRay

Scene: 2 - Resolution: 1080p

OpenBenchmarking.orgFPS, More Is BetterQuadRay 2022.05.25Scene: 2 - Resolution: 1080pCore i5 124001240013400Core i5 13400246810SE +/- 0.00, N = 38.218.215.165.161. (CXX) g++ options: -O3 -pthread -lm -lstdc++ -lX11 -lXext -lpthread

QuadRay

Scene: 3 - Resolution: 4K

OpenBenchmarking.orgFPS, More Is BetterQuadRay 2022.05.25Scene: 3 - Resolution: 4KCore i5 124001240013400Core i5 134000.38250.7651.14751.531.9125SE +/- 0.00, N = 31.701.701.081.081. (CXX) g++ options: -O3 -pthread -lm -lstdc++ -lX11 -lXext -lpthread

QuadRay

Scene: 1 - Resolution: 1080p

OpenBenchmarking.orgFPS, More Is BetterQuadRay 2022.05.25Scene: 1 - Resolution: 1080pCore i5 124001240013400Core i5 13400714212835SE +/- 0.03, N = 327.9227.6517.9817.951. (CXX) g++ options: -O3 -pthread -lm -lstdc++ -lX11 -lXext -lpthread

Neural Magic DeepSparse

Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-StreamCore i5 124001240013400Core i5 134004080120160200SE +/- 0.65, N = 3111.75112.13173.50173.13

Neural Magic DeepSparse

Model: CV Detection,YOLOv5s COCO - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: CV Detection,YOLOv5s COCO - Scenario: Asynchronous Multi-StreamCore i5 124001240013400Core i5 13400306090120150SE +/- 0.50, N = 377.4276.37118.51116.53

Neural Magic DeepSparse

Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-StreamCore i5 124001240013400Core i5 134004080120160200SE +/- 0.37, N = 3119.73121.51184.54185.09

Neural Magic DeepSparse

Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-StreamCore i5 124001240013400Core i5 13400170340510680850SE +/- 2.15, N = 3497.15498.31764.80765.83

Neural Magic DeepSparse

Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-StreamCore i5 124001240013400Core i5 13400170340510680850SE +/- 1.42, N = 3497.20501.94765.90761.83

Neural Magic DeepSparse

Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-StreamCore i5 124001240013400Core i5 134001326395265SE +/- 0.22, N = 338.0838.1757.8057.51

Neural Magic DeepSparse

Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-StreamCore i5 124001240013400Core i5 1340020406080100SE +/- 0.08, N = 360.3061.4491.4891.50

spaCy

Model: en_core_web_trf

OpenBenchmarking.orgtokens/sec, More Is BetterspaCy 3.4.1Model: en_core_web_trfCore i5 124001240013400Core i5 1340030060090012001500SE +/- 2.60, N = 31535155710401034

OpenRadioss

Model: Rubber O-Ring Seal Installation

OpenBenchmarking.orgSeconds, Fewer Is BetterOpenRadioss 2022.10.13Model: Rubber O-Ring Seal InstallationCore i5 124001240013400Core i5 1340060120180240300SE +/- 0.41, N = 3195.38195.67292.59291.76

OpenRadioss

Model: Cell Phone Drop Test

OpenBenchmarking.orgSeconds, Fewer Is BetterOpenRadioss 2022.10.13Model: Cell Phone Drop TestCore i5 124001240013400Core i5 134004080120160200SE +/- 1.12, N = 3112.09111.92165.13164.84

Stargate Digital Audio Workstation

Sample Rate: 480000 - Buffer Size: 1024

OpenBenchmarking.orgRender Ratio, More Is BetterStargate Digital Audio Workstation 22.11.5Sample Rate: 480000 - Buffer Size: 1024Core i5 124001240013400Core i5 134000.87051.7412.61153.4824.3525SE +/- 0.003281, N = 32.6417622.6503673.8689273.8586501. (CXX) g++ options: -lpthread -lsndfile -lm -O3 -march=native -ffast-math -funroll-loops -fstrength-reduce -fstrict-aliasing -finline-functions

Stargate Digital Audio Workstation

Sample Rate: 44100 - Buffer Size: 1024

OpenBenchmarking.orgRender Ratio, More Is BetterStargate Digital Audio Workstation 22.11.5Sample Rate: 44100 - Buffer Size: 1024Core i5 124001240013400Core i5 134000.89631.79262.68893.58524.4815SE +/- 0.002717, N = 32.7280482.7216803.9834383.9734041. (CXX) g++ options: -lpthread -lsndfile -lm -O3 -march=native -ffast-math -funroll-loops -fstrength-reduce -fstrict-aliasing -finline-functions

Stargate Digital Audio Workstation

Sample Rate: 96000 - Buffer Size: 1024

OpenBenchmarking.orgRender Ratio, More Is BetterStargate Digital Audio Workstation 22.11.5Sample Rate: 96000 - Buffer Size: 1024Core i5 124001240013400Core i5 134000.63491.26981.90472.53963.1745SE +/- 0.000675, N = 31.9426771.9454862.8216042.8142641. (CXX) g++ options: -lpthread -lsndfile -lm -O3 -march=native -ffast-math -funroll-loops -fstrength-reduce -fstrict-aliasing -finline-functions

Stargate Digital Audio Workstation

Sample Rate: 192000 - Buffer Size: 1024

OpenBenchmarking.orgRender Ratio, More Is BetterStargate Digital Audio Workstation 22.11.5Sample Rate: 192000 - Buffer Size: 1024Core i5 124001240013400Core i5 134000.41820.83641.25461.67282.091SE +/- 0.000775, N = 31.2826591.2846951.8585521.8500661. (CXX) g++ options: -lpthread -lsndfile -lm -O3 -march=native -ffast-math -funroll-loops -fstrength-reduce -fstrict-aliasing -finline-functions

Stargate Digital Audio Workstation

Sample Rate: 44100 - Buffer Size: 512

OpenBenchmarking.orgRender Ratio, More Is BetterStargate Digital Audio Workstation 22.11.5Sample Rate: 44100 - Buffer Size: 512Core i5 124001240013400Core i5 134000.83521.67042.50563.34084.176SE +/- 0.000973, N = 32.5900082.5895813.7119773.6753621. (CXX) g++ options: -lpthread -lsndfile -lm -O3 -march=native -ffast-math -funroll-loops -fstrength-reduce -fstrict-aliasing -finline-functions

Stargate Digital Audio Workstation

Sample Rate: 480000 - Buffer Size: 512

OpenBenchmarking.orgRender Ratio, More Is BetterStargate Digital Audio Workstation 22.11.5Sample Rate: 480000 - Buffer Size: 512Core i5 124001240013400Core i5 134000.80541.61082.41623.22164.027SE +/- 0.001049, N = 32.5118932.5034363.5796663.5639791. (CXX) g++ options: -lpthread -lsndfile -lm -O3 -march=native -ffast-math -funroll-loops -fstrength-reduce -fstrict-aliasing -finline-functions

Stargate Digital Audio Workstation

Sample Rate: 192000 - Buffer Size: 512

OpenBenchmarking.orgRender Ratio, More Is BetterStargate Digital Audio Workstation 22.11.5Sample Rate: 192000 - Buffer Size: 512Core i5 124001240013400Core i5 134000.36960.73921.10881.47841.848SE +/- 0.000398, N = 31.1681831.1786181.6426011.6202421. (CXX) g++ options: -lpthread -lsndfile -lm -O3 -march=native -ffast-math -funroll-loops -fstrength-reduce -fstrict-aliasing -finline-functions

Stargate Digital Audio Workstation

Sample Rate: 96000 - Buffer Size: 512

OpenBenchmarking.orgRender Ratio, More Is BetterStargate Digital Audio Workstation 22.11.5Sample Rate: 96000 - Buffer Size: 512Core i5 124001240013400Core i5 134000.57271.14541.71812.29082.8635SE +/- 0.001647, N = 31.8162991.8114172.5455322.5248471. (CXX) g++ options: -lpthread -lsndfile -lm -O3 -march=native -ffast-math -funroll-loops -fstrength-reduce -fstrict-aliasing -finline-functions

miniBUDE

Implementation: OpenMP - Input Deck: BM1

OpenBenchmarking.orgGFInst/s, More Is BetterminiBUDE 20210901Implementation: OpenMP - Input Deck: BM1Core i5 124001240013400Core i5 1340060120180240300SE +/- 0.67, N = 3255.44255.53185.29185.851. (CC) gcc options: -std=c99 -Ofast -ffast-math -fopenmp -march=native -lm

miniBUDE

Implementation: OpenMP - Input Deck: BM1

OpenBenchmarking.orgBillion Interactions/s, More Is BetterminiBUDE 20210901Implementation: OpenMP - Input Deck: BM1Core i5 124001240013400Core i5 134003691215SE +/- 0.027, N = 310.21710.2217.4127.4341. (CC) gcc options: -std=c99 -Ofast -ffast-math -fopenmp -march=native -lm

BRL-CAD

VGR Performance Metric

OpenBenchmarking.orgVGR Performance Metric, More Is BetterBRL-CAD 7.34VGR Performance MetricCore i5 124001240013400Core i5 1340040K80K120K160K200K1495981495512050782047331. (CXX) g++ options: -std=c++14 -pipe -fvisibility=hidden -fno-strict-aliasing -fno-common -fexceptions -ftemplate-depth-128 -m64 -ggdb3 -O3 -fipa-pta -fstrength-reduce -finline-functions -flto -ltcl8.6 -lregex_brl -lz_brl -lnetpbm -ldl -lm -ltk8.6

OpenRadioss

Model: Bumper Beam

OpenBenchmarking.orgSeconds, Fewer Is BetterOpenRadioss 2022.10.13Model: Bumper BeamCore i5 124001240013400Core i5 1340050100150200250SE +/- 2.21, N = 3178.37178.13242.52239.47

OpenVINO

Model: Face Detection FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.3Model: Face Detection FP16 - Device: CPUCore i5 124001240013400Core i5 134000.5671.1341.7012.2682.8351.901.902.522.511. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared

OpenVINO

Model: Face Detection FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.3Model: Face Detection FP16 - Device: CPUCore i5 124001240013400Core i5 1340050010001500200025002098.292094.061583.071584.91MIN: 2052.06 / MAX: 2136.02MIN: 2054 / MAX: 2144.08MIN: 1477.42 / MAX: 1887.76MIN: 1427.31 / MAX: 1889.251. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared

uvg266

Video Input: Bosphorus 1080p - Video Preset: Slow

OpenBenchmarking.orgFrames Per Second, More Is Betteruvg266 0.4.1Video Input: Bosphorus 1080p - Video Preset: SlowCore i5 124001240013400Core i5 1340071421283522.4122.4029.5529.37

Kvazaar

Video Input: Bosphorus 1080p - Video Preset: Slow

OpenBenchmarking.orgFrames Per Second, More Is BetterKvazaar 2.2Video Input: Bosphorus 1080p - Video Preset: SlowCore i5 124001240013400Core i5 13400102030405033.1233.2043.3743.671. (CC) gcc options: -pthread -ftree-vectorize -fvisibility=hidden -O2 -lpthread -lm -lrt

Kvazaar

Video Input: Bosphorus 1080p - Video Preset: Medium

OpenBenchmarking.orgFrames Per Second, More Is BetterKvazaar 2.2Video Input: Bosphorus 1080p - Video Preset: MediumCore i5 124001240013400Core i5 13400102030405034.4734.4345.0245.131. (CC) gcc options: -pthread -ftree-vectorize -fvisibility=hidden -O2 -lpthread -lm -lrt

uvg266

Video Input: Bosphorus 1080p - Video Preset: Medium

OpenBenchmarking.orgFrames Per Second, More Is Betteruvg266 0.4.1Video Input: Bosphorus 1080p - Video Preset: MediumCore i5 124001240013400Core i5 1340081624324025.1425.1332.9332.86

libavif avifenc

Encoder Speed: 6

OpenBenchmarking.orgSeconds, Fewer Is Betterlibavif avifenc 0.11Encoder Speed: 6Core i5 124001240013400Core i5 134003691215SE +/- 0.012, N = 39.1279.0506.9707.0111. (CXX) g++ options: -O3 -fPIC -lm

nekRS

Input: TurboPipe Periodic

OpenBenchmarking.orgFLOP/s, More Is BetternekRS 22.0Input: TurboPipe PeriodicCore i5 124001240013400Core i5 1340012000M24000M36000M48000M60000MSE +/- 42366535.54, N = 3569268000005653830000043549200000434782000001. (CXX) g++ options: -fopenmp -O2 -march=native -mtune=native -ftree-vectorize -lmpi_cxx -lmpi

libavif avifenc

Encoder Speed: 6, Lossless

OpenBenchmarking.orgSeconds, Fewer Is Betterlibavif avifenc 0.11Encoder Speed: 6, LosslessCore i5 124001240013400Core i5 134003691215SE +/- 0.02, N = 313.1713.1010.1210.081. (CXX) g++ options: -O3 -fPIC -lm

uvg266

Video Input: Bosphorus 1080p - Video Preset: Ultra Fast

OpenBenchmarking.orgFrames Per Second, More Is Betteruvg266 0.4.1Video Input: Bosphorus 1080p - Video Preset: Ultra FastCore i5 124001240013400Core i5 134002040608010082.4182.38107.57107.50

OpenVINO

Model: Person Detection FP32 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.3Model: Person Detection FP32 - Device: CPUCore i5 124001240013400Core i5 1340060012001800240030003026.393010.562330.872341.39MIN: 2963.75 / MAX: 3245.44MIN: 2966.05 / MAX: 3058.2MIN: 2130.11 / MAX: 3008.71MIN: 2163.53 / MAX: 3007.581. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared

Kvazaar

Video Input: Bosphorus 1080p - Video Preset: Ultra Fast

OpenBenchmarking.orgFrames Per Second, More Is BetterKvazaar 2.2Video Input: Bosphorus 1080p - Video Preset: Ultra FastCore i5 124001240013400Core i5 134004080120160200127.53127.36165.29164.901. (CC) gcc options: -pthread -ftree-vectorize -fvisibility=hidden -O2 -lpthread -lm -lrt

OpenVINO

Model: Person Detection FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.3Model: Person Detection FP16 - Device: CPUCore i5 124001240013400Core i5 1340060012001800240030003016.233012.862328.102334.05MIN: 2973.48 / MAX: 3071.33MIN: 2985.99 / MAX: 3074.98MIN: 2104.47 / MAX: 2986.35MIN: 2135.53 / MAX: 3065.891. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared

Blender

Blend File: BMW27 - Compute: CPU-Only

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 3.4Blend File: BMW27 - Compute: CPU-OnlyCore i5 124001240013400Core i5 13400306090120150SE +/- 0.02, N = 3154.16154.30119.20119.15

uvg266

Video Input: Bosphorus 1080p - Video Preset: Super Fast

OpenBenchmarking.orgFrames Per Second, More Is Betteruvg266 0.4.1Video Input: Bosphorus 1080p - Video Preset: Super FastCore i5 124001240013400Core i5 134002040608010068.6068.5088.3388.26

OpenVINO

Model: Person Detection FP32 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.3Model: Person Detection FP32 - Device: CPUCore i5 124001240013400Core i5 134000.38250.7651.14751.531.91251.321.331.701.701. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared

OpenVINO

Model: Person Detection FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.3Model: Person Detection FP16 - Device: CPUCore i5 124001240013400Core i5 134000.38250.7651.14751.531.91251.321.331.701.701. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared

libavif avifenc

Encoder Speed: 0

OpenBenchmarking.orgSeconds, Fewer Is Betterlibavif avifenc 0.11Encoder Speed: 0Core i5 124001240013400Core i5 134004080120160200SE +/- 0.36, N = 3180.90180.65140.72140.471. (CXX) g++ options: -O3 -fPIC -lm

Timed Linux Kernel Compilation

Build: allmodconfig

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed Linux Kernel Compilation 6.1Build: allmodconfigCore i5 124001240013400Core i5 1340030060090012001500SE +/- 0.19, N = 31597.051592.631243.641245.07

Blender

Blend File: Pabellon Barcelona - Compute: CPU-Only

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 3.4Blend File: Pabellon Barcelona - Compute: CPU-OnlyCore i5 124001240013400Core i5 13400120240360480600536.66535.47418.18419.60

Blender

Blend File: Classroom - Compute: CPU-Only

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 3.4Blend File: Classroom - Compute: CPU-OnlyCore i5 124001240013400Core i5 13400100200300400500SE +/- 0.14, N = 3445.12444.90348.77348.54

uvg266

Video Input: Bosphorus 1080p - Video Preset: Very Fast

OpenBenchmarking.orgFrames Per Second, More Is Betteruvg266 0.4.1Video Input: Bosphorus 1080p - Video Preset: Very FastCore i5 124001240013400Core i5 134002040608010064.1764.1581.6381.72

Timed Linux Kernel Compilation

Build: defconfig

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed Linux Kernel Compilation 6.1Build: defconfigCore i5 124001240013400Core i5 13400306090120150SE +/- 0.34, N = 3122.04121.3695.9396.78

Blender

Blend File: Fishy Cat - Compute: CPU-Only

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 3.4Blend File: Fishy Cat - Compute: CPU-OnlyCore i5 124001240013400Core i5 1340050100150200250SE +/- 0.17, N = 3217.84216.93171.62171.28

Blender

Blend File: Barbershop - Compute: CPU-Only

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 3.4Blend File: Barbershop - Compute: CPU-OnlyCore i5 124001240013400Core i5 134004008001200160020001728.201726.291359.501365.21

uvg266

Video Input: Bosphorus 4K - Video Preset: Very Fast

OpenBenchmarking.orgFrames Per Second, More Is Betteruvg266 0.4.1Video Input: Bosphorus 4K - Video Preset: Very FastCore i5 124001240013400Core i5 1340051015202514.4414.4718.2918.25

libavif avifenc

Encoder Speed: 2

OpenBenchmarking.orgSeconds, Fewer Is Betterlibavif avifenc 0.11Encoder Speed: 2Core i5 124001240013400Core i5 1340020406080100SE +/- 0.04, N = 382.8382.4265.7265.431. (CXX) g++ options: -O3 -fPIC -lm

uvg266

Video Input: Bosphorus 4K - Video Preset: Ultra Fast

OpenBenchmarking.orgFrames Per Second, More Is Betteruvg266 0.4.1Video Input: Bosphorus 4K - Video Preset: Ultra FastCore i5 124001240013400Core i5 1340061218243018.9318.9223.9423.77

uvg266

Video Input: Bosphorus 4K - Video Preset: Super Fast

OpenBenchmarking.orgFrames Per Second, More Is Betteruvg266 0.4.1Video Input: Bosphorus 4K - Video Preset: Super FastCore i5 124001240013400Core i5 1340051015202515.4915.5019.5319.44

Kvazaar

Video Input: Bosphorus 1080p - Video Preset: Super Fast

OpenBenchmarking.orgFrames Per Second, More Is BetterKvazaar 2.2Video Input: Bosphorus 1080p - Video Preset: Super FastCore i5 124001240013400Core i5 1340030609012015094.9395.03119.27119.641. (CC) gcc options: -pthread -ftree-vectorize -fvisibility=hidden -O2 -lpthread -lm -lrt

OpenVINO

Model: Machine Translation EN To DE FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.3Model: Machine Translation EN To DE FP16 - Device: CPUCore i5 124001240013400Core i5 1340071421283525.4925.5732.0832.001. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared

OpenVINO

Model: Machine Translation EN To DE FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.3Model: Machine Translation EN To DE FP16 - Device: CPUCore i5 124001240013400Core i5 13400306090120150156.75156.31124.62124.93MIN: 149.92 / MAX: 175.47MIN: 149.83 / MAX: 167MIN: 111.98 / MAX: 178.7MIN: 111.3 / MAX: 183.581. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared

Kvazaar

Video Input: Bosphorus 4K - Video Preset: Super Fast

OpenBenchmarking.orgFrames Per Second, More Is BetterKvazaar 2.2Video Input: Bosphorus 4K - Video Preset: Super FastCore i5 124001240013400Core i5 1340071421283522.2222.2627.9327.741. (CC) gcc options: -pthread -ftree-vectorize -fvisibility=hidden -O2 -lpthread -lm -lrt

Kvazaar

Video Input: Bosphorus 4K - Video Preset: Slow

OpenBenchmarking.orgFrames Per Second, More Is BetterKvazaar 2.2Video Input: Bosphorus 4K - Video Preset: SlowCore i5 124001240013400Core i5 134002468106.936.948.678.671. (CC) gcc options: -pthread -ftree-vectorize -fvisibility=hidden -O2 -lpthread -lm -lrt

Kvazaar

Video Input: Bosphorus 4K - Video Preset: Medium

OpenBenchmarking.orgFrames Per Second, More Is BetterKvazaar 2.2Video Input: Bosphorus 4K - Video Preset: MediumCore i5 124001240013400Core i5 134002468107.137.128.908.881. (CC) gcc options: -pthread -ftree-vectorize -fvisibility=hidden -O2 -lpthread -lm -lrt

Kvazaar

Video Input: Bosphorus 4K - Video Preset: Ultra Fast

OpenBenchmarking.orgFrames Per Second, More Is BetterKvazaar 2.2Video Input: Bosphorus 4K - Video Preset: Ultra FastCore i5 124001240013400Core i5 1340091827364530.7030.6638.3138.181. (CC) gcc options: -pthread -ftree-vectorize -fvisibility=hidden -O2 -lpthread -lm -lrt

Kvazaar

Video Input: Bosphorus 4K - Video Preset: Very Fast

OpenBenchmarking.orgFrames Per Second, More Is BetterKvazaar 2.2Video Input: Bosphorus 4K - Video Preset: Very FastCore i5 124001240013400Core i5 1340051015202517.7917.8422.2122.111. (CC) gcc options: -pthread -ftree-vectorize -fvisibility=hidden -O2 -lpthread -lm -lrt

uvg266

Video Input: Bosphorus 4K - Video Preset: Slow

OpenBenchmarking.orgFrames Per Second, More Is Betteruvg266 0.4.1Video Input: Bosphorus 4K - Video Preset: SlowCore i5 124001240013400Core i5 134001.25552.5113.76655.0226.27754.484.495.585.57

uvg266

Video Input: Bosphorus 4K - Video Preset: Medium

OpenBenchmarking.orgFrames Per Second, More Is Betteruvg266 0.4.1Video Input: Bosphorus 4K - Video Preset: MediumCore i5 124001240013400Core i5 134002468105.065.066.306.29

OpenVKL

Benchmark: vklBenchmark Scalar

OpenBenchmarking.orgItems / Sec, More Is BetterOpenVKL 1.3.1Benchmark: vklBenchmark ScalarCore i5 124001240013400Core i5 1340020406080100SE +/- 0.00, N = 375759393MIN: 7 / MAX: 1382MIN: 7 / MAX: 1385MIN: 9 / MAX: 1775MIN: 9 / MAX: 1779

OpenRadioss

Model: INIVOL and Fluid Structure Interaction Drop Container

OpenBenchmarking.orgSeconds, Fewer Is BetterOpenRadioss 2022.10.13Model: INIVOL and Fluid Structure Interaction Drop ContainerCore i5 124001240013400Core i5 134002004006008001000SE +/- 3.17, N = 3644.83644.80796.75785.44

Kvazaar

Video Input: Bosphorus 1080p - Video Preset: Very Fast

OpenBenchmarking.orgFrames Per Second, More Is BetterKvazaar 2.2Video Input: Bosphorus 1080p - Video Preset: Very FastCore i5 124001240013400Core i5 134002040608010075.4575.6392.7192.561. (CC) gcc options: -pthread -ftree-vectorize -fvisibility=hidden -O2 -lpthread -lm -lrt

OpenVINO

Model: Vehicle Detection FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.3Model: Vehicle Detection FP16 - Device: CPUCore i5 124001240013400Core i5 1340051015202519.4519.4316.0016.04MIN: 18.39 / MAX: 25.47MIN: 18.46 / MAX: 26.18MIN: 14.09 / MAX: 25.84MIN: 13.66 / MAX: 25.821. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared

OpenVINO

Model: Vehicle Detection FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.3Model: Vehicle Detection FP16 - Device: CPUCore i5 124001240013400Core i5 1340050100150200250205.52205.79249.83249.211. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared

OpenVKL

Benchmark: vklBenchmark ISPC

OpenBenchmarking.orgItems / Sec, More Is BetterOpenVKL 1.3.1Benchmark: vklBenchmark ISPCCore i5 124001240013400Core i5 134004080120160200SE +/- 0.58, N = 3146147175176MIN: 15 / MAX: 2301MIN: 15 / MAX: 2299MIN: 18 / MAX: 2713MIN: 19 / MAX: 2712

SVT-AV1

Encoder Mode: Preset 8 - Input: Bosphorus 4K

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.4Encoder Mode: Preset 8 - Input: Bosphorus 4KCore i5 124001240013400Core i5 13400918273645SE +/- 0.10, N = 331.6131.5538.0037.931. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

SVT-AV1

Encoder Mode: Preset 4 - Input: Bosphorus 4K

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.4Encoder Mode: Preset 4 - Input: Bosphorus 4KCore i5 124001240013400Core i5 134000.651.31.952.63.25SE +/- 0.004, N = 32.4052.4082.8732.8891. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

SVT-AV1

Encoder Mode: Preset 8 - Input: Bosphorus 1080p

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.4Encoder Mode: Preset 8 - Input: Bosphorus 1080pCore i5 124001240013400Core i5 1340020406080100SE +/- 0.36, N = 387.1186.71103.93103.771. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

CockroachDB

Workload: KV, 95% Reads - Concurrency: 512

OpenBenchmarking.orgops/s, More Is BetterCockroachDB 22.2Workload: KV, 95% Reads - Concurrency: 512Core i5 124001240013400Core i5 1340014K28K42K56K70KSE +/- 241.43, N = 356455.556109.567125.866905.6

OpenVINO

Model: Person Vehicle Bike Detection FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.3Model: Person Vehicle Bike Detection FP16 - Device: CPUCore i5 124001240013400Core i5 13400369121512.5512.6510.6010.62MIN: 12.23 / MAX: 20.14MIN: 12.01 / MAX: 18.99MIN: 9.52 / MAX: 16.08MIN: 9.14 / MAX: 16.531. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared

OpenVINO

Model: Person Vehicle Bike Detection FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.3Model: Person Vehicle Bike Detection FP16 - Device: CPUCore i5 124001240013400Core i5 1340080160240320400318.63316.13377.00376.181. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared

libavif avifenc

Encoder Speed: 10, Lossless

OpenBenchmarking.orgSeconds, Fewer Is Betterlibavif avifenc 0.11Encoder Speed: 10, LosslessCore i5 124001240013400Core i5 134001.31422.62843.94265.25686.571SE +/- 0.021, N = 35.8415.7474.9064.9831. (CXX) g++ options: -O3 -fPIC -lm

CockroachDB

Workload: KV, 95% Reads - Concurrency: 256

OpenBenchmarking.orgops/s, More Is BetterCockroachDB 22.2Workload: KV, 95% Reads - Concurrency: 256Core i5 124001240013400Core i5 1340015K30K45K60K75KSE +/- 126.38, N = 357642.857470.068318.568289.1

CockroachDB

Workload: KV, 95% Reads - Concurrency: 128

OpenBenchmarking.orgops/s, More Is BetterCockroachDB 22.2Workload: KV, 95% Reads - Concurrency: 128Core i5 124001240013400Core i5 1340015K30K45K60K75KSE +/- 104.96, N = 359000.659140.669633.969900.2

CockroachDB

Workload: KV, 95% Reads - Concurrency: 1024

OpenBenchmarking.orgops/s, More Is BetterCockroachDB 22.2Workload: KV, 95% Reads - Concurrency: 1024Core i5 124001240013400Core i5 1340014K28K42K56K70KSE +/- 72.44, N = 355187.655093.565255.665146.2

EnCodec

Target Bandwidth: 6 kbps

OpenBenchmarking.orgSeconds, Fewer Is BetterEnCodec 0.1.1Target Bandwidth: 6 kbpsCore i5 124001240013400Core i5 1340071421283527.2026.2131.0430.82

OpenVINO

Model: Vehicle Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.3Model: Vehicle Detection FP16-INT8 - Device: CPUCore i5 124001240013400Core i5 13400369121510.2510.258.688.72MIN: 10.08 / MAX: 16.3MIN: 10.11 / MAX: 17.66MIN: 7.54 / MAX: 17.41MIN: 7.54 / MAX: 22.251. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared

OpenVINO

Model: Vehicle Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.3Model: Vehicle Detection FP16-INT8 - Device: CPUCore i5 124001240013400Core i5 13400100200300400500390.02390.03460.22458.381. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared

EnCodec

Target Bandwidth: 24 kbps

OpenBenchmarking.orgSeconds, Fewer Is BetterEnCodec 0.1.1Target Bandwidth: 24 kbpsCore i5 124001240013400Core i5 1340081624324031.1829.9034.6935.28

ClickHouse

100M Rows Hits Dataset, First Run / Cold Cache

OpenBenchmarking.orgQueries Per Minute, Geo Mean, More Is BetterClickHouse 22.12.3.5100M Rows Hits Dataset, First Run / Cold Cache12400Core i5 1240013400Core i5 1340050100150200250185.39180.38212.37209.34MIN: 6.57 / MAX: 6666.67MIN: 6.59 / MAX: 6666.67MIN: 9.19 / MAX: 7500MIN: 9.46 / MAX: 7500

CockroachDB

Workload: KV, 50% Reads - Concurrency: 1024

OpenBenchmarking.orgops/s, More Is BetterCockroachDB 22.2Workload: KV, 50% Reads - Concurrency: 1024Core i5 124001240013400Core i5 1340011K22K33K44K55KSE +/- 93.19, N = 341950.841862.449206.749201.1

ClickHouse

100M Rows Hits Dataset, Second Run

OpenBenchmarking.orgQueries Per Minute, Geo Mean, More Is BetterClickHouse 22.12.3.5100M Rows Hits Dataset, Second Run12400Core i5 1240013400Core i5 1340050100150200250194.52200.59228.27222.15MIN: 6.8 / MAX: 7500MIN: 6.72 / MAX: 7500MIN: 9.34 / MAX: 8571.43MIN: 9.54 / MAX: 7500

CockroachDB

Workload: KV, 60% Reads - Concurrency: 1024

OpenBenchmarking.orgops/s, More Is BetterCockroachDB 22.2Workload: KV, 60% Reads - Concurrency: 1024Core i5 124001240013400Core i5 1340011K22K33K44K55KSE +/- 106.59, N = 344079.644239.551715.551692.8

EnCodec

Target Bandwidth: 1.5 kbps

OpenBenchmarking.orgSeconds, Fewer Is BetterEnCodec 0.1.1Target Bandwidth: 1.5 kbpsCore i5 124001240013400Core i5 1340071421283526.0525.0129.1329.32

OpenVINO

Model: Face Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.3Model: Face Detection FP16-INT8 - Device: CPUCore i5 124001240013400Core i5 13400110220330440550503.59503.11429.89432.13MIN: 492.41 / MAX: 512.07MIN: 498.88 / MAX: 511.99MIN: 339.29 / MAX: 913.71MIN: 360.39 / MAX: 940.271. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared

OpenVINO

Model: Face Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.3Model: Face Detection FP16-INT8 - Device: CPUCore i5 124001240013400Core i5 1340036912157.937.959.269.171. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared

OpenRadioss

Model: Bird Strike on Windshield

OpenBenchmarking.orgSeconds, Fewer Is BetterOpenRadioss 2022.10.13Model: Bird Strike on WindshieldCore i5 124001240013400Core i5 1340080160240320400SE +/- 1.87, N = 3333.39333.43387.78388.70

EnCodec

Target Bandwidth: 3 kbps

OpenBenchmarking.orgSeconds, Fewer Is BetterEnCodec 0.1.1Target Bandwidth: 3 kbpsCore i5 124001240013400Core i5 1340071421283527.0826.1430.3130.43

OpenVINO

Model: Weld Porosity Detection FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.3Model: Weld Porosity Detection FP16 - Device: CPUCore i5 124001240013400Core i5 1340050100150200250207.49209.02181.19179.691. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared

SVT-AV1

Encoder Mode: Preset 13 - Input: Bosphorus 4K

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.4Encoder Mode: Preset 13 - Input: Bosphorus 4KCore i5 124001240013400Core i5 13400306090120150SE +/- 0.71, N = 3123.34123.73141.41142.941. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

CockroachDB

Workload: KV, 10% Reads - Concurrency: 1024

OpenBenchmarking.orgops/s, More Is BetterCockroachDB 22.2Workload: KV, 10% Reads - Concurrency: 1024Core i5 124001240013400Core i5 134009K18K27K36K45KSE +/- 24.23, N = 336820.536894.842546.142551.0

Xmrig

Variant: Wownero - Hash Count: 1M

OpenBenchmarking.orgH/s, More Is BetterXmrig 6.18.1Variant: Wownero - Hash Count: 1MCore i5 124001240013400Core i5 1340015003000450060007500SE +/- 15.59, N = 36231.76201.57122.97156.91. (CXX) g++ options: -fexceptions -fno-rtti -maes -O3 -Ofast -static-libgcc -static-libstdc++ -rdynamic -lssl -lcrypto -luv -lpthread -lrt -ldl -lhwloc

OpenVINO

Model: Weld Porosity Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.3Model: Weld Porosity Detection FP16-INT8 - Device: CPUCore i5 124001240013400Core i5 134002004006008001000788.77790.35684.89694.551. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared

SVT-AV1

Encoder Mode: Preset 12 - Input: Bosphorus 4K

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.4Encoder Mode: Preset 12 - Input: Bosphorus 4KCore i5 124001240013400Core i5 13400306090120150SE +/- 0.26, N = 3117.30116.98134.95134.251. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

SVT-AV1

Encoder Mode: Preset 4 - Input: Bosphorus 1080p

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.4Encoder Mode: Preset 4 - Input: Bosphorus 1080pCore i5 124001240013400Core i5 134003691215SE +/- 0.055, N = 37.8997.9159.0989.0121. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

TensorFlow

Device: CPU - Batch Size: 64 - Model: GoogLeNet

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.10Device: CPU - Batch Size: 64 - Model: GoogLeNetCore i5 124001240013400Core i5 134001326395265SE +/- 0.13, N = 349.9449.9757.5157.50

CockroachDB

Workload: KV, 60% Reads - Concurrency: 512

OpenBenchmarking.orgops/s, More Is BetterCockroachDB 22.2Workload: KV, 60% Reads - Concurrency: 512Core i5 124001240013400Core i5 1340011K22K33K44K55KSE +/- 42.65, N = 343959.343981.050477.050413.5

ClickHouse

100M Rows Hits Dataset, Third Run

OpenBenchmarking.orgQueries Per Minute, Geo Mean, More Is BetterClickHouse 22.12.3.5100M Rows Hits Dataset, Third Run12400Core i5 1240013400Core i5 1340050100150200250196.91202.90225.55224.48MIN: 6.79 / MAX: 7500MIN: 6.79 / MAX: 8571.43MIN: 9.32 / MAX: 7500MIN: 9.15 / MAX: 7500

TensorFlow

Device: CPU - Batch Size: 16 - Model: GoogLeNet

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.10Device: CPU - Batch Size: 16 - Model: GoogLeNetCore i5 124001240013400Core i5 134001224364860SE +/- 0.11, N = 347.9948.0954.7454.72

TensorFlow

Device: CPU - Batch Size: 32 - Model: GoogLeNet

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.10Device: CPU - Batch Size: 32 - Model: GoogLeNetCore i5 124001240013400Core i5 134001326395265SE +/- 0.07, N = 349.2949.1756.0055.95

Xmrig

Variant: Monero - Hash Count: 1M

OpenBenchmarking.orgH/s, More Is BetterXmrig 6.18.1Variant: Monero - Hash Count: 1MCore i5 124001240013400Core i5 1340011002200330044005500SE +/- 5.44, N = 34585.34590.05168.45164.31. (CXX) g++ options: -fexceptions -fno-rtti -maes -O3 -Ofast -static-libgcc -static-libstdc++ -rdynamic -lssl -lcrypto -luv -lpthread -lrt -ldl -lhwloc

JPEG XL Decoding libjxl

CPU Threads: All

OpenBenchmarking.orgMP/s, More Is BetterJPEG XL Decoding libjxl 0.7CPU Threads: AllCore i5 124001240013400Core i5 1340070140210280350SE +/- 0.38, N = 3269.98271.97304.22304.23

SVT-AV1

Encoder Mode: Preset 12 - Input: Bosphorus 1080p

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.4Encoder Mode: Preset 12 - Input: Bosphorus 1080pCore i5 124001240013400Core i5 13400110220330440550SE +/- 3.43, N = 3453.39447.69502.96500.431. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

CockroachDB

Workload: KV, 50% Reads - Concurrency: 512

OpenBenchmarking.orgops/s, More Is BetterCockroachDB 22.2Workload: KV, 50% Reads - Concurrency: 512Core i5 124001240013400Core i5 1340010K20K30K40K50KSE +/- 45.17, N = 341073.540974.945770.245816.5

Neural Magic DeepSparse

Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-StreamCore i5 124001240013400Core i5 134001224364860SE +/- 0.05, N = 349.7548.8254.5154.58

CockroachDB

Workload: KV, 10% Reads - Concurrency: 512

OpenBenchmarking.orgops/s, More Is BetterCockroachDB 22.2Workload: KV, 10% Reads - Concurrency: 512Core i5 124001240013400Core i5 134007K14K21K28K35KSE +/- 56.87, N = 330654.130683.934012.034253.8

JPEG XL libjxl

Input: JPEG - Quality: 90

OpenBenchmarking.orgMP/s, More Is BetterJPEG XL libjxl 0.7Input: JPEG - Quality: 90Core i5 124001240013400Core i5 134003691215SE +/- 0.01, N = 38.688.929.599.611. (CXX) g++ options: -fno-rtti -funwind-tables -O3 -O2 -fPIE -pie -lm -latomic

Neural Magic DeepSparse

Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-StreamCore i5 124001240013400Core i5 1340020406080100SE +/- 0.33, N = 378.7578.5686.3686.88

Neural Magic DeepSparse

Model: CV Detection,YOLOv5s COCO - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: CV Detection,YOLOv5s COCO - Scenario: Asynchronous Multi-StreamCore i5 124001240013400Core i5 134001020304050SE +/- 0.17, N = 338.7139.2542.0842.75

JPEG XL libjxl

Input: JPEG - Quality: 80

OpenBenchmarking.orgMP/s, More Is BetterJPEG XL libjxl 0.7Input: JPEG - Quality: 80Core i5 124001240013400Core i5 134003691215SE +/- 0.00, N = 38.879.099.759.771. (CXX) g++ options: -fno-rtti -funwind-tables -O3 -O2 -fPIE -pie -lm -latomic

Neural Magic DeepSparse

Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-StreamCore i5 124001240013400Core i5 13400246810SE +/- 0.0214, N = 36.03365.96666.47796.5295

Neural Magic DeepSparse

Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-StreamCore i5 124001240013400Core i5 13400612182430SE +/- 0.07, N = 325.0524.6926.9326.81

JPEG XL libjxl

Input: PNG - Quality: 90

OpenBenchmarking.orgMP/s, More Is BetterJPEG XL libjxl 0.7Input: PNG - Quality: 90Core i5 124001240013400Core i5 134003691215SE +/- 0.01, N = 38.939.089.719.721. (CXX) g++ options: -fno-rtti -funwind-tables -O3 -O2 -fPIE -pie -lm -latomic

Neural Magic DeepSparse

Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Synchronous Single-StreamCore i5 124001240013400Core i5 13400246810SE +/- 0.0097, N = 35.77765.71226.19616.1829

Neural Magic DeepSparse

Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Synchronous Single-StreamCore i5 124001240013400Core i5 134004080120160200SE +/- 0.25, N = 3173.08175.06161.39161.73

SVT-AV1

Encoder Mode: Preset 13 - Input: Bosphorus 1080p

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.4Encoder Mode: Preset 13 - Input: Bosphorus 1080pCore i5 124001240013400Core i5 13400120240360480600SE +/- 2.55, N = 3497.71497.22537.89533.941. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

JPEG XL libjxl

Input: PNG - Quality: 80

OpenBenchmarking.orgMP/s, More Is BetterJPEG XL libjxl 0.7Input: PNG - Quality: 80Core i5 124001240013400Core i5 134003691215SE +/- 0.01, N = 39.149.259.889.871. (CXX) g++ options: -fno-rtti -funwind-tables -O3 -O2 -fPIE -pie -lm -latomic

Neural Magic DeepSparse

Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-StreamCore i5 124001240013400Core i5 13400246810SE +/- 0.0278, N = 36.03386.01976.50686.4929

Neural Magic DeepSparse

Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Synchronous Single-StreamCore i5 124001240013400Core i5 134004080120160200SE +/- 0.02, N = 3172.73174.38161.46161.69

Neural Magic DeepSparse

Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Synchronous Single-StreamCore i5 124001240013400Core i5 13400246810SE +/- 0.0006, N = 35.78945.73466.19326.1844

Neural Magic DeepSparse

Model: NLP Text Classification, DistilBERT mnli - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: NLP Text Classification, DistilBERT mnli - Scenario: Synchronous Single-StreamCore i5 124001240013400Core i5 13400510152025SE +/- 0.04, N = 322.1522.8221.4221.14

Neural Magic DeepSparse

Model: NLP Text Classification, DistilBERT mnli - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: NLP Text Classification, DistilBERT mnli - Scenario: Synchronous Single-StreamCore i5 124001240013400Core i5 134001122334455SE +/- 0.09, N = 345.1343.8146.6947.30

TensorFlow

Device: CPU - Batch Size: 64 - Model: AlexNet

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.10Device: CPU - Batch Size: 64 - Model: AlexNetCore i5 124001240013400Core i5 13400306090120150SE +/- 0.25, N = 3109.57109.35117.43117.14

Neural Magic DeepSparse

Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-StreamCore i5 124001240013400Core i5 13400714212835SE +/- 0.10, N = 326.8426.7528.6728.70

OpenVINO

Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.3Model: Age Gender Recognition Retail 0013 FP16 - Device: CPUCore i5 124001240013400Core i5 13400140028004200560070006329.926317.975970.936046.321. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared

Neural Magic DeepSparse

Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Synchronous Single-StreamCore i5 124001240013400Core i5 134001020304050SE +/- 0.05, N = 343.8445.6043.0643.15

Neural Magic DeepSparse

Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Synchronous Single-StreamCore i5 124001240013400Core i5 13400612182430SE +/- 0.02, N = 322.8121.9323.2223.17

TensorFlow

Device: CPU - Batch Size: 32 - Model: AlexNet

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.10Device: CPU - Batch Size: 32 - Model: AlexNetCore i5 124001240013400Core i5 1340020406080100SE +/- 0.40, N = 3102.40102.84108.31107.89

OpenVINO

Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.3Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPUCore i5 124001240013400Core i5 13400150030004500600075006963.176960.146606.336605.861. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared

TensorFlow

Device: CPU - Batch Size: 16 - Model: AlexNet

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.10Device: CPU - Batch Size: 16 - Model: AlexNetCore i5 124001240013400Core i5 1340020406080100SE +/- 0.07, N = 390.3189.9694.0594.38

JPEG XL libjxl

Input: PNG - Quality: 100

OpenBenchmarking.orgMP/s, More Is BetterJPEG XL libjxl 0.7Input: PNG - Quality: 100Core i5 124001240013400Core i5 134000.1980.3960.5940.7920.99SE +/- 0.00, N = 30.840.840.880.881. (CXX) g++ options: -fno-rtti -funwind-tables -O3 -O2 -fPIE -pie -lm -latomic

spaCy

Model: en_core_web_lg

OpenBenchmarking.orgtokens/sec, More Is BetterspaCy 3.4.1Model: en_core_web_lgCore i5 124001240013400Core i5 134004K8K12K16K20KSE +/- 53.42, N = 315907158851645916632

Y-Cruncher

Pi Digits To Calculate: 500M

OpenBenchmarking.orgSeconds, Fewer Is BetterY-Cruncher 0.7.10.9513Pi Digits To Calculate: 500MCore i5 124001240013400Core i5 13400510152025SE +/- 0.06, N = 319.5919.6520.4620.43

JPEG XL Decoding libjxl

CPU Threads: 1

OpenBenchmarking.orgMP/s, More Is BetterJPEG XL Decoding libjxl 0.7CPU Threads: 1Core i5 124001240013400Core i5 134001326395265SE +/- 0.12, N = 355.7456.8857.9957.91

Neural Magic DeepSparse

Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Synchronous Single-StreamCore i5 124001240013400Core i5 134001020304050SE +/- 0.11, N = 342.3642.8244.0443.96

Neural Magic DeepSparse

Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Synchronous Single-StreamCore i5 124001240013400Core i5 13400612182430SE +/- 0.06, N = 323.6023.3522.7122.75

JPEG XL libjxl

Input: JPEG - Quality: 100

OpenBenchmarking.orgMP/s, More Is BetterJPEG XL libjxl 0.7Input: JPEG - Quality: 100Core i5 124001240013400Core i5 134000.19350.3870.58050.7740.9675SE +/- 0.00, N = 30.830.830.860.861. (CXX) g++ options: -fno-rtti -funwind-tables -O3 -O2 -fPIE -pie -lm -latomic

CockroachDB

Workload: KV, 50% Reads - Concurrency: 128

OpenBenchmarking.orgops/s, More Is BetterCockroachDB 22.2Workload: KV, 50% Reads - Concurrency: 128Core i5 124001240013400Core i5 134003K6K9K12K15KSE +/- 141.12, N = 311841.811716.512043.812118.2

CockroachDB

Workload: KV, 10% Reads - Concurrency: 256

OpenBenchmarking.orgops/s, More Is BetterCockroachDB 22.2Workload: KV, 10% Reads - Concurrency: 256Core i5 124001240013400Core i5 134003K6K9K12K15KSE +/- 57.49, N = 313343.213478.113657.013704.0

CockroachDB

Workload: KV, 60% Reads - Concurrency: 128

OpenBenchmarking.orgops/s, More Is BetterCockroachDB 22.2Workload: KV, 60% Reads - Concurrency: 128Core i5 124001240013400Core i5 134003K6K9K12K15KSE +/- 39.43, N = 314590.114628.714829.214961.3

CockroachDB

Workload: KV, 10% Reads - Concurrency: 128

OpenBenchmarking.orgops/s, More Is BetterCockroachDB 22.2Workload: KV, 10% Reads - Concurrency: 128Core i5 124001240013400Core i5 1340015003000450060007500SE +/- 28.90, N = 36631.26622.06690.86770.5

Y-Cruncher

Pi Digits To Calculate: 1B

OpenBenchmarking.orgSeconds, Fewer Is BetterY-Cruncher 0.7.10.9513Pi Digits To Calculate: 1BCore i5 124001240013400Core i5 134001020304050SE +/- 0.13, N = 342.6642.7743.3743.61

TensorFlow

Device: CPU - Batch Size: 32 - Model: ResNet-50

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.10Device: CPU - Batch Size: 32 - Model: ResNet-50Core i5 124001240013400Core i5 13400510152025SE +/- 0.02, N = 319.2819.3218.9218.94

CockroachDB

Workload: KV, 50% Reads - Concurrency: 256

OpenBenchmarking.orgops/s, More Is BetterCockroachDB 22.2Workload: KV, 50% Reads - Concurrency: 256Core i5 124001240013400Core i5 134005K10K15K20K25KSE +/- 42.71, N = 323659.623631.123946.224114.2

TensorFlow

Device: CPU - Batch Size: 64 - Model: ResNet-50

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.10Device: CPU - Batch Size: 64 - Model: ResNet-50Core i5 124001240013400Core i5 13400510152025SE +/- 0.02, N = 319.7119.7219.4719.43

TensorFlow

Device: CPU - Batch Size: 16 - Model: ResNet-50

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.10Device: CPU - Batch Size: 16 - Model: ResNet-50Core i5 124001240013400Core i5 13400510152025SE +/- 0.01, N = 318.7018.7318.9418.97

CockroachDB

Workload: MoVR - Concurrency: 1024

OpenBenchmarking.orgops/s, More Is BetterCockroachDB 22.2Workload: MoVR - Concurrency: 1024Core i5 124001240013400Core i5 13400306090120150SE +/- 0.07, N = 3125.8124.8124.4124.6

CockroachDB

Workload: MoVR - Concurrency: 128

OpenBenchmarking.orgops/s, More Is BetterCockroachDB 22.2Workload: MoVR - Concurrency: 128Core i5 124001240013400Core i5 13400306090120150SE +/- 0.07, N = 3125.3125.3124.2124.8

Neural Magic DeepSparse

Model: CV Classification, ResNet-50 ImageNet - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: CV Classification, ResNet-50 ImageNet - Scenario: Synchronous Single-StreamCore i5 124001240013400Core i5 1340048121620SE +/- 0.01, N = 314.7214.6814.6014.61

Neural Magic DeepSparse

Model: CV Classification, ResNet-50 ImageNet - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: CV Classification, ResNet-50 ImageNet - Scenario: Synchronous Single-StreamCore i5 124001240013400Core i5 134001530456075SE +/- 0.04, N = 367.9168.0968.4868.45

Neural Magic DeepSparse

Model: CV Detection,YOLOv5s COCO - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: CV Detection,YOLOv5s COCO - Scenario: Synchronous Single-StreamCore i5 124001240013400Core i5 13400816243240SE +/- 0.06, N = 334.7634.7635.0535.04

Neural Magic DeepSparse

Model: CV Detection,YOLOv5s COCO - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: CV Detection,YOLOv5s COCO - Scenario: Synchronous Single-StreamCore i5 124001240013400Core i5 13400714212835SE +/- 0.05, N = 328.7628.7628.5228.53

CockroachDB

Workload: MoVR - Concurrency: 512

OpenBenchmarking.orgops/s, More Is BetterCockroachDB 22.2Workload: MoVR - Concurrency: 512Core i5 124001240013400Core i5 13400306090120150SE +/- 0.10, N = 3125.4124.9124.4124.6

CockroachDB

Workload: KV, 60% Reads - Concurrency: 256

OpenBenchmarking.orgops/s, More Is BetterCockroachDB 22.2Workload: KV, 60% Reads - Concurrency: 256Core i5 124001240013400Core i5 134006K12K18K24K30KSE +/- 213.65, N = 329557.229540.229512.329664.7

CockroachDB

Workload: MoVR - Concurrency: 256

OpenBenchmarking.orgops/s, More Is BetterCockroachDB 22.2Workload: MoVR - Concurrency: 256Core i5 124001240013400Core i5 13400306090120150SE +/- 0.00, N = 3124.9124.9124.3124.9

Phoronix Test Suite v10.8.5