AVX-512 - AMD Ryzen 7 7700X vs. Intel Core i9 Rocket Lake

Benchmarks for a future article.

Compare your own system(s) to this result file with the Phoronix Test Suite by running the command: phoronix-test-suite benchmark 2210317-NE-AVX51263784
Jump To Table - Results

View

Do Not Show Noisy Results
Do Not Show Results With Incomplete Data
Do Not Show Results With Little Change/Spread
List Notable Results

Limit displaying results to tests within:

CPU Massive 6 Tests
Creator Workloads 7 Tests
HPC - High Performance Computing 11 Tests
Machine Learning 10 Tests
Multi-Core 8 Tests
NVIDIA GPU Compute 2 Tests
Intel oneAPI 6 Tests
Python Tests 6 Tests
Raytracing 2 Tests
Renderers 2 Tests
Server CPU Tests 4 Tests

Statistics

Show Overall Harmonic Mean(s)
Show Overall Geometric Mean
Show Geometric Means Per-Suite/Category
Show Wins / Losses Counts (Pie Chart)
Normalize Results
Remove Outliers Before Calculating Averages

Graph Settings

Force Line Graphs Where Applicable
Convert To Scalar Where Applicable
Prefer Vertical Bar Graphs
No Box Plots
On Line Graphs With Missing Data, Connect The Line Gaps

Multi-Way Comparison

Condense Comparison
Transpose Comparison

Table

Show Detailed System Result Table

Run Management

Highlight
Result
Hide
Result
Result
Identifier
Performance Per
Dollar
Date
Run
  Test
  Duration
i9-11900K: AVX-512 Off
October 19 2022
  19 Hours, 14 Minutes
i9-11900K: AVX-512 On
October 20 2022
  16 Hours, 47 Minutes
7700X: AVX-512 Off
October 29 2022
  15 Hours, 43 Minutes
7700X: AVX-512 On
October 30 2022
  13 Hours, 3 Minutes
Invert Hiding All Results Option
  16 Hours, 12 Minutes

Only show results where is faster than
Only show results matching title/arguments (delimit multiple options with a comma):
Do not show results matching title/arguments (delimit multiple options with a comma):


ProcessorMotherboardChipsetMemoryDiskGraphicsAudioMonitorNetworkOSKernelDesktopDisplay ServerOpenGLVulkanCompilerFile-SystemScreen Resolutioni9-11900K7700X AVX-512 Off AVX-512 On AVX-512 Off AVX-512 OnIntel Core i9-11900K @ 5.10GHz (8 Cores / 16 Threads)ASUS ROG MAXIMUS XIII HERO (1402 BIOS)Intel Tiger Lake-H32GB1000GB Western Digital WDS100T1X0E-00AFY0XFX AMD Radeon RX 6400 4GB (2320/1000MHz)AMD Navi 21/23ASUS MG28U2 x Intel I225-V + Intel Wi-Fi 6 AX210/AX211/AX411Ubuntu 22.105.19.0-21-generic (x86_64)GNOME Shell 43.0X Server + Wayland4.6 Mesa 22.2.1 (LLVM 15.0.2 DRM 3.47)1.3.224GCC 12.2.0ext43840x2160AMD Ryzen 7 7700X 8-Core @ 5.57GHz (8 Cores / 16 Threads)ASRock X670E PG Lightning (1.11 BIOS)AMD Device 14d8Realtek RTL8125 2.5GbE5.19.0-23-generic (x86_64)OpenBenchmarking.orgKernel Details- Transparent Huge Pages: madviseEnvironment Details- i9-11900K: AVX-512 Off: CXXFLAGS="-O3 -march=native -mno-avx512f" CFLAGS="-O3 -march=native -mno-avx512f"- i9-11900K: AVX-512 On: CXXFLAGS="-O3 -march=native -mprefer-vector-width=512" CFLAGS="-O3 -march=native -mprefer-vector-width=512"- 7700X: AVX-512 Off: CXXFLAGS="-O3 -march=native -mno-avx512f" CFLAGS="-O3 -march=native -mno-avx512f"- 7700X: AVX-512 On: CXXFLAGS="-O3 -march=native -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi -mprefer-vector-width=512" CFLAGS="-O3 -march=native -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi -mprefer-vector-width=512" Compiler Details- --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-defaulted --enable-offload-targets=nvptx-none=/build/gcc-12-U8K4Qv/gcc-12-12.2.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-12-U8K4Qv/gcc-12-12.2.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v Processor Details- i9-11900K: AVX-512 Off: Scaling Governor: intel_pstate performance (EPP: performance) - CPU Microcode: 0x54 - Thermald 2.5.1- i9-11900K: AVX-512 On: Scaling Governor: intel_pstate performance (EPP: performance) - CPU Microcode: 0x54 - Thermald 2.5.1- 7700X: AVX-512 Off: Scaling Governor: amd-pstate performance (Boost: Enabled) - CPU Microcode: 0xa601203- 7700X: AVX-512 On: Scaling Governor: amd-pstate performance (Boost: Enabled) - CPU Microcode: 0xa601203Python Details- Python 3.10.7Security Details- i9-11900K: AVX-512 Off: itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Mitigation of Clear buffers; SMT vulnerable + retbleed: Mitigation of Enhanced IBRS + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Not affected - i9-11900K: AVX-512 On: itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Mitigation of Clear buffers; SMT vulnerable + retbleed: Mitigation of Enhanced IBRS + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Not affected - 7700X: AVX-512 Off: itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional IBRS_FW STIBP: always-on RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected - 7700X: AVX-512 On: itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional IBRS_FW STIBP: always-on RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected

ai-benchmark: Device Inference Scoreai-benchmark: Device Training Scoreai-benchmark: Device AI Scoredeepsparse: NLP Text Classification, BERT base uncased SST2 - Synchronous Single-Streamdeepsparse: NLP Text Classification, BERT base uncased SST2 - Synchronous Single-Streamdeepsparse: NLP Text Classification, BERT base uncased SST2 - Asynchronous Multi-Streamdeepsparse: NLP Text Classification, BERT base uncased SST2 - Asynchronous Multi-Streamdeepsparse: NLP Text Classification, DistilBERT mnli - Synchronous Single-Streamdeepsparse: NLP Text Classification, DistilBERT mnli - Synchronous Single-Streamdeepsparse: NLP Text Classification, DistilBERT mnli - Asynchronous Multi-Streamdeepsparse: NLP Text Classification, DistilBERT mnli - Asynchronous Multi-Streamdeepsparse: CV Classification, ResNet-50 ImageNet - Synchronous Single-Streamdeepsparse: CV Classification, ResNet-50 ImageNet - Synchronous Single-Streamdeepsparse: CV Classification, ResNet-50 ImageNet - Asynchronous Multi-Streamdeepsparse: CV Classification, ResNet-50 ImageNet - Asynchronous Multi-Streamdeepsparse: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Synchronous Single-Streamdeepsparse: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Synchronous Single-Streamdeepsparse: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Asynchronous Multi-Streamdeepsparse: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Asynchronous Multi-Streamdeepsparse: CV Detection,YOLOv5s COCO - Synchronous Single-Streamdeepsparse: CV Detection,YOLOv5s COCO - Synchronous Single-Streamdeepsparse: CV Detection,YOLOv5s COCO - Asynchronous Multi-Streamdeepsparse: CV Detection,YOLOv5s COCO - Asynchronous Multi-Streamopenradioss: Cell Phone Drop Testlczero: Eigensimdjson: PartialTweetssimdjson: LargeRandsimdjson: Kostyasimdjson: DistinctUserIDsimdjson: TopTweetdav1d: Summer Nature 1080pdav1d: Summer Nature 4Kdav1d: Chimera 1080pdav1d: Chimera 1080p 10-bitembree: Pathtracer ISPC - Asian Dragonembree: Pathtracer ISPC - Asian Dragon Objembree: Pathtracer ISPC - Crownopenvkl: vklBenchmark ISPCospray: gravity_spheres_volume/dim_512/ao/real_timeospray: gravity_spheres_volume/dim_512/scivis/real_timeospray: gravity_spheres_volume/dim_512/pathtracer/real_timeospray: particle_volume/pathtracer/real_timeospray-studio: 1 - 1080p - 1 - Path Tracerospray-studio: 1 - 1080p - 16 - Path Tracerospray-studio: 1 - 1080p - 32 - Path Tracerospray-studio: 1 - 4K - 1 - Path Tracerospray-studio: 1 - 4K - 16 - Path Tracerospray-studio: 1 - 4K - 32 - Path Tracerospray-studio: 3 - 1080p - 1 - Path Tracerospray-studio: 3 - 1080p - 16 - Path Tracerospray-studio: 3 - 1080p - 32 - Path Tracerospray-studio: 3 - 4K - 1 - Path Tracerospray-studio: 3 - 4K - 16 - Path Tracerospray-studio: 3 - 4K - 32 - Path Traceronednn: Convolution Batch Shapes Auto - f32 - CPUonednn: Convolution Batch Shapes Auto - u8s8f32 - CPUonednn: Deconvolution Batch shapes_1d - u8s8f32 - CPUonednn: Deconvolution Batch shapes_3d - f32 - CPUonednn: Deconvolution Batch shapes_3d - u8s8f32 - CPUonednn: IP Shapes 1D - u8s8f32 - CPUonednn: IP Shapes 3D - f32 - CPUonednn: Matrix Multiply Batch Shapes Transformer - f32 - CPUonednn: Matrix Multiply Batch Shapes Transformer - u8s8f32 - CPUonednn: Recurrent Neural Network Training - f32 - CPUonednn: Recurrent Neural Network Training - u8s8f32 - CPUonednn: Recurrent Neural Network Training - bf16bf16bf16 - CPUonednn: Recurrent Neural Network Inference - f32 - CPUonednn: Recurrent Neural Network Inference - u8s8f32 - CPUonednn: Recurrent Neural Network Inference - bf16bf16bf16 - CPUcpuminer-opt: Quad SHA-256, Pyritecpuminer-opt: Myriad-Groestlcpuminer-opt: Blake-2 Scpuminer-opt: Garlicoincpuminer-opt: Skeincoincpuminer-opt: LBC, LBRY Creditsmnn: squeezenetv1.1mnn: resnet-v2-50mnn: SqueezeNetV1.0mnn: inception-v3ncnn: CPU - vision_transformertensorflow: CPU - 16 - VGG-16tensorflow: CPU - 16 - ResNet-50tensorflow: CPU - 16 - AlexNettensorflow: CPU - 16 - GoogLeNettensorflow: CPU - 32 - VGG-16tensorflow: CPU - 32 - ResNet-50tensorflow: CPU - 32 - AlexNettensorflow: CPU - 32 - GoogLeNettensorflow: CPU - 64 - VGG-16tensorflow: CPU - 64 - ResNet-50tensorflow: CPU - 64 - AlexNettensorflow: CPU - 64 - GoogLeNettensorflow: CPU - 256 - VGG-16tensorflow: CPU - 256 - ResNet-50tensorflow: CPU - 256 - AlexNettensorflow: CPU - 256 - GoogLeNettensorflow: CPU - 512 - AlexNettensorflow: CPU - 512 - GoogLeNetopenvino: Face Detection FP16 - CPUopenvino: Face Detection FP16 - CPUopenvino: Face Detection FP16-INT8 - CPUopenvino: Face Detection FP16-INT8 - CPUopenvino: Age Gender Recognition Retail 0013 FP16 - CPUopenvino: Age Gender Recognition Retail 0013 FP16 - CPUopenvino: Age Gender Recognition Retail 0013 FP16-INT8 - CPUopenvino: Age Gender Recognition Retail 0013 FP16-INT8 - CPUopenvino: Person Detection FP16 - CPUopenvino: Person Detection FP16 - CPUopenvino: Person Detection FP32 - CPUopenvino: Person Detection FP32 - CPUopenvino: Weld Porosity Detection FP16-INT8 - CPUopenvino: Weld Porosity Detection FP16-INT8 - CPUopenvino: Weld Porosity Detection FP16 - CPUopenvino: Weld Porosity Detection FP16 - CPUopenvino: Vehicle Detection FP16-INT8 - CPUopenvino: Vehicle Detection FP16-INT8 - CPUopenvino: Vehicle Detection FP16 - CPUopenvino: Vehicle Detection FP16 - CPUopenvino: Person Vehicle Bike Detection FP16 - CPUopenvino: Person Vehicle Bike Detection FP16 - CPUopenvino: Machine Translation EN To DE FP16 - CPUopenvino: Machine Translation EN To DE FP16 - CPUonnx: fcn-resnet101-11 - CPU - Parallelonnx: GPT-2 - CPU - Standardonnx: GPT-2 - CPU - Parallelonnx: ArcFace ResNet-100 - CPU - Parallelnumpy: i9-11900K7700X AVX-512 Off AVX-512 On AVX-512 Off AVX-512 On14141282269628.967734.514535.5207112.598956.592817.664069.100557.876485.977711.6244101.636539.345025.540739.144826.5261150.766843.393323.035443.230692.5054128.1610626.201.363.866.336.35879.37192.71691.43487.0915.895214.022713.8618872.828212.723784.05745164.963213434112721458450139519275693256140948858541014816650832952715.609314.84111.778325.393272.311831.2439611.67713.673601.403303271.063270.553271.272000.122003.542006.0264663161503932132381.4570720272702.02318.0433.69423.418110.385.6912.2967.8036.225.9512.3287.7936.496.1112.37103.3136.946.2212.48117.4337.37107.7233.922.601525.184.88817.177956.781.0014973.880.531.542563.451.542563.87533.7914.98252.6915.81310.3812.88141.3028.29325.9512.2631.70126.0972695455571278575.7913632076343935.423828.224940.802198.028668.771514.535581.021649.3593133.74357.4707156.812125.494943.440823.013436.8617108.489049.991319.993951.357377.8730118.8911948.511.474.538.778.82902.92190.82727.76477.0916.454114.350214.61981124.469064.367725.35301173.73919513118065447773412754025069823643762078809937615310130396614.283512.01780.8463764.325641.469480.7159259.951133.217421.309063062.363073.172986.721739.491738.001715.75164790406638955134392.29112403763931.67510.3683.11419.40370.397.7620.5582.1063.838.2921.29113.2564.428.6921.88137.7565.159.4222.13163.0966.49172.6667.672.951352.0812.17328.089460.450.8422962.100.351.782227.691.772244.251242.456.42321.5124.86630.586.33109.0936.64285.7513.9935.55112.4873696255451368631.8618861876376237.305226.802041.767395.760574.270813.460283.497447.897299.685010.0263116.229534.405336.522227.373638.8934102.833253.580018.656555.454572.123987.3914101362.37322.86952.21779.0816.381914.569614.8802802.304682.188373.50231156.56523073669776956913114915429479527444356490723108511769533493727.596877.806841.438074.516471.920681.0046814.337851.295910.6106682206.972208.392206.611181.971179.911178.6995583235105233233169.05104763386831.53315.1342.67518.77188.007.5019.2095.6856.287.7718.50125.4855.187.9618.06146.4754.807.9817.74162.6253.04165.4052.923.601110.976.93577.2311758.070.6819638.380.402.291739.272.261753.08695.9811.49344.4511.60478.698.35278.6914.34483.478.2637.54106.4893837572851558829.9223233196551942.290523.642149.227081.249882.966612.049297.145941.1669128.99307.7468151.569526.380761.983316.127760.088966.555461.210816.329363.490262.989882.73156910.061.856.0710.139.771439.80337.761003.03809.3020.487117.983718.16941074.123484.009274.81427176.5171881300596363874811228802422942256360117535989161458252883477.343357.132630.7441823.683740.8991930.5499054.200541.213460.2407152093.412094.922092.041040.291040.491038.33163047462279096274733.18145600768471.2217.4462.30515.27356.4610.2633.36136.45101.1810.733.23183.1499.1110.9532.97219.2097.5311.1532.83249.4996.81252.8296.867.44536.8914.47276.0023278.240.3432722.350.244.13965.054.05984.601496.665.34739.935.40954.704.19463.878.62889.694.4976.6252.1896915178051669912.85OpenBenchmarking.org

AI Benchmark Alpha

AI Benchmark Alpha is a Python library for evaluating artificial intelligence (AI) performance on diverse hardware platforms and relies upon the TensorFlow machine learning library. Learn more via the OpenBenchmarking.org test page.

i9-11900K7700XOpenBenchmarking.orgScore, More Is BetterAI Benchmark Alpha 0.1.2Device Inference ScoreAVX-512 OffAVX-512 On50010001500200025001414136318862323

i9-11900K7700XOpenBenchmarking.orgScore, More Is BetterAI Benchmark Alpha 0.1.2Device Training ScoreAVX-512 OffAVX-512 On70014002100280035001282207618763196

i9-11900K7700XOpenBenchmarking.orgScore, More Is BetterAI Benchmark Alpha 0.1.2Device AI ScoreAVX-512 OffAVX-512 On120024003600480060002696343937625519

Neural Magic DeepSparse

i9-11900K7700XOpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Synchronous Single-StreamAVX-512 OffAVX-512 On1020304050SE +/- 0.02, N = 3SE +/- 0.11, N = 3SE +/- 0.09, N = 3SE +/- 0.07, N = 328.9735.4237.3142.29
i9-11900K7700XOpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Synchronous Single-StreamAVX-512 OffAVX-512 On918273645Min: 28.94 / Avg: 28.97 / Max: 29Min: 35.28 / Avg: 35.42 / Max: 35.63Min: 37.15 / Avg: 37.31 / Max: 37.45Min: 42.16 / Avg: 42.29 / Max: 42.39

i9-11900K7700XOpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Synchronous Single-StreamAVX-512 OffAVX-512 On816243240SE +/- 0.02, N = 3SE +/- 0.08, N = 3SE +/- 0.06, N = 3SE +/- 0.04, N = 334.5128.2226.8023.64
i9-11900K7700XOpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Synchronous Single-StreamAVX-512 OffAVX-512 On714212835Min: 34.47 / Avg: 34.51 / Max: 34.55Min: 28.06 / Avg: 28.22 / Max: 28.34Min: 26.7 / Avg: 26.8 / Max: 26.91Min: 23.59 / Avg: 23.64 / Max: 23.71

i9-11900K7700XOpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-StreamAVX-512 OffAVX-512 On1122334455SE +/- 0.02, N = 3SE +/- 0.22, N = 3SE +/- 0.10, N = 3SE +/- 0.20, N = 335.5240.8041.7749.23
i9-11900K7700XOpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-StreamAVX-512 OffAVX-512 On1020304050Min: 35.49 / Avg: 35.52 / Max: 35.56Min: 40.37 / Avg: 40.8 / Max: 41.12Min: 41.58 / Avg: 41.77 / Max: 41.92Min: 48.84 / Avg: 49.23 / Max: 49.53

i9-11900K7700XOpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-StreamAVX-512 OffAVX-512 On306090120150SE +/- 0.07, N = 3SE +/- 0.54, N = 3SE +/- 0.23, N = 3SE +/- 0.33, N = 3112.6098.0395.7681.25
i9-11900K7700XOpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-StreamAVX-512 OffAVX-512 On20406080100Min: 112.47 / Avg: 112.6 / Max: 112.7Min: 97.26 / Avg: 98.03 / Max: 99.07Min: 95.41 / Avg: 95.76 / Max: 96.19Min: 80.75 / Avg: 81.25 / Max: 81.89

i9-11900K7700XOpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: NLP Text Classification, DistilBERT mnli - Scenario: Synchronous Single-StreamAVX-512 OffAVX-512 On20406080100SE +/- 0.03, N = 3SE +/- 0.03, N = 3SE +/- 0.04, N = 3SE +/- 0.11, N = 356.5968.7774.2782.97
i9-11900K7700XOpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: NLP Text Classification, DistilBERT mnli - Scenario: Synchronous Single-StreamAVX-512 OffAVX-512 On1632486480Min: 56.54 / Avg: 56.59 / Max: 56.65Min: 68.71 / Avg: 68.77 / Max: 68.81Min: 74.22 / Avg: 74.27 / Max: 74.34Min: 82.8 / Avg: 82.97 / Max: 83.16

i9-11900K7700XOpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: NLP Text Classification, DistilBERT mnli - Scenario: Synchronous Single-StreamAVX-512 OffAVX-512 On48121620SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.02, N = 317.6614.5413.4612.05
i9-11900K7700XOpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: NLP Text Classification, DistilBERT mnli - Scenario: Synchronous Single-StreamAVX-512 OffAVX-512 On48121620Min: 17.65 / Avg: 17.66 / Max: 17.68Min: 14.53 / Avg: 14.54 / Max: 14.55Min: 13.45 / Avg: 13.46 / Max: 13.47Min: 12.02 / Avg: 12.05 / Max: 12.07

i9-11900K7700XOpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-StreamAVX-512 OffAVX-512 On20406080100SE +/- 0.03, N = 3SE +/- 0.06, N = 3SE +/- 0.06, N = 3SE +/- 0.11, N = 369.1081.0283.5097.15
i9-11900K7700XOpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-StreamAVX-512 OffAVX-512 On20406080100Min: 69.04 / Avg: 69.1 / Max: 69.16Min: 80.94 / Avg: 81.02 / Max: 81.13Min: 83.43 / Avg: 83.5 / Max: 83.61Min: 96.94 / Avg: 97.15 / Max: 97.32

i9-11900K7700XOpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-StreamAVX-512 OffAVX-512 On1326395265SE +/- 0.03, N = 3SE +/- 0.03, N = 3SE +/- 0.03, N = 3SE +/- 0.05, N = 357.8849.3647.9041.17
i9-11900K7700XOpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-StreamAVX-512 OffAVX-512 On1122334455Min: 57.83 / Avg: 57.88 / Max: 57.93Min: 49.3 / Avg: 49.36 / Max: 49.41Min: 47.83 / Avg: 47.9 / Max: 47.94Min: 41.09 / Avg: 41.17 / Max: 41.25

i9-11900K7700XOpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: CV Classification, ResNet-50 ImageNet - Scenario: Synchronous Single-StreamAVX-512 OffAVX-512 On306090120150SE +/- 0.04, N = 3SE +/- 0.12, N = 3SE +/- 0.02, N = 3SE +/- 0.09, N = 385.98133.7499.69128.99
i9-11900K7700XOpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: CV Classification, ResNet-50 ImageNet - Scenario: Synchronous Single-StreamAVX-512 OffAVX-512 On306090120150Min: 85.89 / Avg: 85.98 / Max: 86.04Min: 133.57 / Avg: 133.74 / Max: 133.98Min: 99.65 / Avg: 99.68 / Max: 99.71Min: 128.85 / Avg: 128.99 / Max: 129.15

i9-11900K7700XOpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: CV Classification, ResNet-50 ImageNet - Scenario: Synchronous Single-StreamAVX-512 OffAVX-512 On3691215SE +/- 0.0062, N = 3SE +/- 0.0069, N = 3SE +/- 0.0017, N = 3SE +/- 0.0052, N = 311.62447.470710.02637.7468
i9-11900K7700XOpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: CV Classification, ResNet-50 ImageNet - Scenario: Synchronous Single-StreamAVX-512 OffAVX-512 On3691215Min: 11.62 / Avg: 11.62 / Max: 11.64Min: 7.46 / Avg: 7.47 / Max: 7.48Min: 10.02 / Avg: 10.03 / Max: 10.03Min: 7.74 / Avg: 7.75 / Max: 7.76

i9-11900K7700XOpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-StreamAVX-512 OffAVX-512 On306090120150SE +/- 0.14, N = 3SE +/- 0.68, N = 3SE +/- 0.17, N = 3SE +/- 0.15, N = 3101.64156.81116.23151.57
i9-11900K7700XOpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-StreamAVX-512 OffAVX-512 On306090120150Min: 101.48 / Avg: 101.64 / Max: 101.92Min: 155.49 / Avg: 156.81 / Max: 157.74Min: 116.01 / Avg: 116.23 / Max: 116.56Min: 151.37 / Avg: 151.57 / Max: 151.86

i9-11900K7700XOpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-StreamAVX-512 OffAVX-512 On918273645SE +/- 0.05, N = 3SE +/- 0.11, N = 3SE +/- 0.05, N = 3SE +/- 0.03, N = 339.3525.4934.4126.38
i9-11900K7700XOpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-StreamAVX-512 OffAVX-512 On816243240Min: 39.24 / Avg: 39.34 / Max: 39.41Min: 25.35 / Avg: 25.49 / Max: 25.71Min: 34.31 / Avg: 34.41 / Max: 34.47Min: 26.33 / Avg: 26.38 / Max: 26.42

i9-11900K7700XOpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Synchronous Single-StreamAVX-512 OffAVX-512 On1428425670SE +/- 0.05, N = 3SE +/- 0.19, N = 3SE +/- 0.07, N = 3SE +/- 0.09, N = 325.5443.4436.5261.98
i9-11900K7700XOpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Synchronous Single-StreamAVX-512 OffAVX-512 On1224364860Min: 25.44 / Avg: 25.54 / Max: 25.62Min: 43.14 / Avg: 43.44 / Max: 43.79Min: 36.38 / Avg: 36.52 / Max: 36.62Min: 61.79 / Avg: 61.98 / Max: 62.09

i9-11900K7700XOpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Synchronous Single-StreamAVX-512 OffAVX-512 On918273645SE +/- 0.08, N = 3SE +/- 0.10, N = 3SE +/- 0.05, N = 3SE +/- 0.02, N = 339.1423.0127.3716.13
i9-11900K7700XOpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Synchronous Single-StreamAVX-512 OffAVX-512 On816243240Min: 39.03 / Avg: 39.14 / Max: 39.3Min: 22.83 / Avg: 23.01 / Max: 23.17Min: 27.3 / Avg: 27.37 / Max: 27.48Min: 16.1 / Avg: 16.13 / Max: 16.18

i9-11900K7700XOpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-StreamAVX-512 OffAVX-512 On1326395265SE +/- 0.15, N = 3SE +/- 0.02, N = 3SE +/- 0.05, N = 3SE +/- 0.10, N = 326.5336.8638.8960.09
i9-11900K7700XOpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-StreamAVX-512 OffAVX-512 On1224364860Min: 26.23 / Avg: 26.53 / Max: 26.7Min: 36.82 / Avg: 36.86 / Max: 36.89Min: 38.79 / Avg: 38.89 / Max: 38.97Min: 59.97 / Avg: 60.09 / Max: 60.28

i9-11900K7700XOpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-StreamAVX-512 OffAVX-512 On306090120150SE +/- 0.85, N = 3SE +/- 0.07, N = 3SE +/- 0.14, N = 3SE +/- 0.10, N = 3150.77108.49102.8366.56
i9-11900K7700XOpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-StreamAVX-512 OffAVX-512 On306090120150Min: 149.8 / Avg: 150.77 / Max: 152.45Min: 108.38 / Avg: 108.49 / Max: 108.61Min: 102.63 / Avg: 102.83 / Max: 103.11Min: 66.35 / Avg: 66.56 / Max: 66.68

i9-11900K7700XOpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: CV Detection,YOLOv5s COCO - Scenario: Synchronous Single-StreamAVX-512 OffAVX-512 On1428425670SE +/- 0.01, N = 3SE +/- 0.04, N = 3SE +/- 0.01, N = 3SE +/- 0.06, N = 343.3949.9953.5861.21
i9-11900K7700XOpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: CV Detection,YOLOv5s COCO - Scenario: Synchronous Single-StreamAVX-512 OffAVX-512 On1224364860Min: 43.38 / Avg: 43.39 / Max: 43.4Min: 49.91 / Avg: 49.99 / Max: 50.05Min: 53.57 / Avg: 53.58 / Max: 53.6Min: 61.12 / Avg: 61.21 / Max: 61.31

i9-11900K7700XOpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: CV Detection,YOLOv5s COCO - Scenario: Synchronous Single-StreamAVX-512 OffAVX-512 On612182430SE +/- 0.00, N = 3SE +/- 0.02, N = 3SE +/- 0.00, N = 3SE +/- 0.01, N = 323.0419.9918.6616.33
i9-11900K7700XOpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: CV Detection,YOLOv5s COCO - Scenario: Synchronous Single-StreamAVX-512 OffAVX-512 On510152025Min: 23.03 / Avg: 23.04 / Max: 23.04Min: 19.97 / Avg: 19.99 / Max: 20.03Min: 18.65 / Avg: 18.66 / Max: 18.66Min: 16.3 / Avg: 16.33 / Max: 16.35

i9-11900K7700XOpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: CV Detection,YOLOv5s COCO - Scenario: Asynchronous Multi-StreamAVX-512 OffAVX-512 On1428425670SE +/- 0.08, N = 3SE +/- 0.37, N = 3SE +/- 0.49, N = 3SE +/- 0.05, N = 343.2351.3655.4563.49
i9-11900K7700XOpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: CV Detection,YOLOv5s COCO - Scenario: Asynchronous Multi-StreamAVX-512 OffAVX-512 On1224364860Min: 43.14 / Avg: 43.23 / Max: 43.4Min: 50.99 / Avg: 51.36 / Max: 52.09Min: 54.83 / Avg: 55.45 / Max: 56.42Min: 63.42 / Avg: 63.49 / Max: 63.57

i9-11900K7700XOpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: CV Detection,YOLOv5s COCO - Scenario: Asynchronous Multi-StreamAVX-512 OffAVX-512 On20406080100SE +/- 0.19, N = 3SE +/- 0.56, N = 3SE +/- 0.63, N = 3SE +/- 0.04, N = 392.5177.8772.1262.99
i9-11900K7700XOpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: CV Detection,YOLOv5s COCO - Scenario: Asynchronous Multi-StreamAVX-512 OffAVX-512 On20406080100Min: 92.13 / Avg: 92.51 / Max: 92.7Min: 76.76 / Avg: 77.87 / Max: 78.44Min: 70.87 / Avg: 72.12 / Max: 72.93Min: 62.91 / Avg: 62.99 / Max: 63.06

OpenRadioss

OpenRadioss is an open-source AGPL-licensed finite element solver for dynamic event analysis OpenRadioss is based on Altair Radioss and open-sourced in 2022. This open-source finite element solver is benchmarked with various example models available from https://www.openradioss.org/models/. This test is currently using a reference OpenRadioss binary build offered via GitHub. Learn more via the OpenBenchmarking.org test page.

i9-11900K7700XOpenBenchmarking.orgSeconds, Fewer Is BetterOpenRadioss 2022.10.13Model: Cell Phone Drop TestAVX-512 OffAVX-512 On306090120150SE +/- 0.52, N = 3SE +/- 0.31, N = 3SE +/- 0.07, N = 3SE +/- 0.19, N = 3128.16118.8987.3982.73
i9-11900K7700XOpenBenchmarking.orgSeconds, Fewer Is BetterOpenRadioss 2022.10.13Model: Cell Phone Drop TestAVX-512 OffAVX-512 On20406080100Min: 127.24 / Avg: 128.16 / Max: 129.03Min: 118.32 / Avg: 118.89 / Max: 119.39Min: 87.3 / Avg: 87.39 / Max: 87.52Min: 82.38 / Avg: 82.73 / Max: 83.04

LeelaChessZero

LeelaChessZero (lc0 / lczero) is a chess engine automated vian neural networks. This test profile can be used for OpenCL, CUDA + cuDNN, and BLAS (CPU-based) benchmarking. Learn more via the OpenBenchmarking.org test page.

i9-11900K7700XOpenBenchmarking.orgNodes Per Second, More Is BetterLeelaChessZero 0.28Backend: EigenAVX-512 OffAVX-512 On30060090012001500SE +/- 10.84, N = 5SE +/- 14.97, N = 3SE +/- 7.69, N = 3SE +/- 15.10, N = 310621194141015691. (CXX) g++ options: -flto -O3 -march=native -pthread
i9-11900K7700XOpenBenchmarking.orgNodes Per Second, More Is BetterLeelaChessZero 0.28Backend: EigenAVX-512 OffAVX-512 On30060090012001500Min: 1031 / Avg: 1062.4 / Max: 1087Min: 1176 / Avg: 1194.33 / Max: 1224Min: 1399 / Avg: 1410.33 / Max: 1425Min: 1539 / Avg: 1569 / Max: 15871. (CXX) g++ options: -flto -O3 -march=native -pthread

simdjson

This is a benchmark of SIMDJSON, a high performance JSON parser. SIMDJSON aims to be the fastest JSON parser and is used by projects like Microsoft FishStore, Yandex ClickHouse, Shopify, and others. Learn more via the OpenBenchmarking.org test page.

i9-11900K7700XOpenBenchmarking.orgGB/s, More Is Bettersimdjson 2.0Throughput Test: PartialTweetsAVX-512 OffAVX-512 On3691215SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.01, N = 36.208.5110.061. (CXX) g++ options: -O3 -march=native
i9-11900K7700XOpenBenchmarking.orgGB/s, More Is Bettersimdjson 2.0Throughput Test: PartialTweetsAVX-512 OffAVX-512 On3691215Min: 6.2 / Avg: 6.2 / Max: 6.21Min: 8.5 / Avg: 8.51 / Max: 8.51Min: 10.04 / Avg: 10.06 / Max: 10.081. (CXX) g++ options: -O3 -march=native

Throughput Test: PartialTweets

7700X: AVX-512 Off: The test quit with a non-zero exit status.

i9-11900K7700XOpenBenchmarking.orgGB/s, More Is Bettersimdjson 2.0Throughput Test: LargeRandomAVX-512 OffAVX-512 On0.41630.83261.24891.66522.0815SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 31.361.471.851. (CXX) g++ options: -O3 -march=native
i9-11900K7700XOpenBenchmarking.orgGB/s, More Is Bettersimdjson 2.0Throughput Test: LargeRandomAVX-512 OffAVX-512 On246810Min: 1.36 / Avg: 1.36 / Max: 1.36Min: 1.47 / Avg: 1.47 / Max: 1.47Min: 1.85 / Avg: 1.85 / Max: 1.861. (CXX) g++ options: -O3 -march=native

Throughput Test: LargeRandom

7700X: AVX-512 Off: The test quit with a non-zero exit status.

i9-11900K7700XOpenBenchmarking.orgGB/s, More Is Bettersimdjson 2.0Throughput Test: KostyaAVX-512 OffAVX-512 On246810SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.03, N = 33.864.536.071. (CXX) g++ options: -O3 -march=native
i9-11900K7700XOpenBenchmarking.orgGB/s, More Is Bettersimdjson 2.0Throughput Test: KostyaAVX-512 OffAVX-512 On246810Min: 3.86 / Avg: 3.86 / Max: 3.86Min: 4.52 / Avg: 4.53 / Max: 4.53Min: 6.01 / Avg: 6.07 / Max: 6.131. (CXX) g++ options: -O3 -march=native

Throughput Test: Kostya

7700X: AVX-512 Off: The test quit with a non-zero exit status.

i9-11900K7700XOpenBenchmarking.orgGB/s, More Is Bettersimdjson 2.0Throughput Test: DistinctUserIDAVX-512 OffAVX-512 On3691215SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.04, N = 36.338.7710.131. (CXX) g++ options: -O3 -march=native
i9-11900K7700XOpenBenchmarking.orgGB/s, More Is Bettersimdjson 2.0Throughput Test: DistinctUserIDAVX-512 OffAVX-512 On3691215Min: 6.33 / Avg: 6.33 / Max: 6.34Min: 8.77 / Avg: 8.77 / Max: 8.78Min: 10.07 / Avg: 10.13 / Max: 10.211. (CXX) g++ options: -O3 -march=native

Throughput Test: DistinctUserID

7700X: AVX-512 Off: The test quit with a non-zero exit status.

i9-11900K7700XOpenBenchmarking.orgGB/s, More Is Bettersimdjson 2.0Throughput Test: TopTweetAVX-512 OffAVX-512 On3691215SE +/- 0.01, N = 3SE +/- 0.00, N = 3SE +/- 0.08, N = 36.358.829.771. (CXX) g++ options: -O3 -march=native
i9-11900K7700XOpenBenchmarking.orgGB/s, More Is Bettersimdjson 2.0Throughput Test: TopTweetAVX-512 OffAVX-512 On3691215Min: 6.34 / Avg: 6.35 / Max: 6.36Min: 8.81 / Avg: 8.82 / Max: 8.82Min: 9.64 / Avg: 9.77 / Max: 9.921. (CXX) g++ options: -O3 -march=native

Throughput Test: TopTweet

7700X: AVX-512 Off: The test quit with a non-zero exit status.

dav1d

Dav1d is an open-source, speedy AV1 video decoder. This test profile times how long it takes to decode sample AV1 video content. Learn more via the OpenBenchmarking.org test page.

i9-11900K7700XOpenBenchmarking.orgFPS, More Is Betterdav1d 1.0Video Input: Summer Nature 1080pAVX-512 OffAVX-512 On30060090012001500SE +/- 0.63, N = 8SE +/- 0.57, N = 8SE +/- 2.39, N = 10SE +/- 0.87, N = 10879.37902.921362.371439.801. (CC) gcc options: -O3 -march=native -pthread -lm
i9-11900K7700XOpenBenchmarking.orgFPS, More Is Betterdav1d 1.0Video Input: Summer Nature 1080pAVX-512 OffAVX-512 On30060090012001500Min: 876.53 / Avg: 879.37 / Max: 882.38Min: 901.34 / Avg: 902.92 / Max: 905.37Min: 1353.87 / Avg: 1362.37 / Max: 1381.44Min: 1434.05 / Avg: 1439.8 / Max: 1442.511. (CC) gcc options: -O3 -march=native -pthread -lm

i9-11900K7700XOpenBenchmarking.orgFPS, More Is Betterdav1d 1.0Video Input: Summer Nature 4KAVX-512 OffAVX-512 On70140210280350SE +/- 0.10, N = 3SE +/- 0.11, N = 3SE +/- 0.30, N = 5SE +/- 0.27, N = 5192.71190.82322.86337.761. (CC) gcc options: -O3 -march=native -pthread -lm
i9-11900K7700XOpenBenchmarking.orgFPS, More Is Betterdav1d 1.0Video Input: Summer Nature 4KAVX-512 OffAVX-512 On60120180240300Min: 192.52 / Avg: 192.71 / Max: 192.81Min: 190.68 / Avg: 190.82 / Max: 191.05Min: 321.98 / Avg: 322.86 / Max: 323.79Min: 337.01 / Avg: 337.76 / Max: 338.581. (CC) gcc options: -O3 -march=native -pthread -lm

i9-11900K7700XOpenBenchmarking.orgFPS, More Is Betterdav1d 1.0Video Input: Chimera 1080pAVX-512 OffAVX-512 On2004006008001000SE +/- 0.49, N = 4SE +/- 0.36, N = 4SE +/- 0.45, N = 5SE +/- 1.03, N = 5691.43727.76952.211003.031. (CC) gcc options: -O3 -march=native -pthread -lm
i9-11900K7700XOpenBenchmarking.orgFPS, More Is Betterdav1d 1.0Video Input: Chimera 1080pAVX-512 OffAVX-512 On2004006008001000Min: 690.5 / Avg: 691.43 / Max: 692.76Min: 726.71 / Avg: 727.76 / Max: 728.25Min: 950.75 / Avg: 952.21 / Max: 953.21Min: 1000.54 / Avg: 1003.03 / Max: 1006.071. (CC) gcc options: -O3 -march=native -pthread -lm

i9-11900K7700XOpenBenchmarking.orgFPS, More Is Betterdav1d 1.0Video Input: Chimera 1080p 10-bitAVX-512 OffAVX-512 On2004006008001000SE +/- 0.38, N = 3SE +/- 0.21, N = 3SE +/- 0.46, N = 4SE +/- 0.81, N = 5487.09477.09779.08809.301. (CC) gcc options: -O3 -march=native -pthread -lm
i9-11900K7700XOpenBenchmarking.orgFPS, More Is Betterdav1d 1.0Video Input: Chimera 1080p 10-bitAVX-512 OffAVX-512 On140280420560700Min: 486.35 / Avg: 487.09 / Max: 487.63Min: 476.68 / Avg: 477.09 / Max: 477.4Min: 777.92 / Avg: 779.08 / Max: 780.11Min: 806.58 / Avg: 809.3 / Max: 810.981. (CC) gcc options: -O3 -march=native -pthread -lm

Embree

Intel Embree is a collection of high-performance ray-tracing kernels for execution on CPUs and supporting instruction sets such as SSE, AVX, AVX2, and AVX-512. Embree also supports making use of the Intel SPMD Program Compiler (ISPC). Learn more via the OpenBenchmarking.org test page.

i9-11900K7700XOpenBenchmarking.orgFrames Per Second, More Is BetterEmbree 3.13Binary: Pathtracer ISPC - Model: Asian DragonAVX-512 OffAVX-512 On510152025SE +/- 0.10, N = 3SE +/- 0.06, N = 3SE +/- 0.05, N = 3SE +/- 0.01, N = 315.9016.4516.3820.49
i9-11900K7700XOpenBenchmarking.orgFrames Per Second, More Is BetterEmbree 3.13Binary: Pathtracer ISPC - Model: Asian DragonAVX-512 OffAVX-512 On510152025Min: 15.78 / Avg: 15.9 / Max: 16.1Min: 16.33 / Avg: 16.45 / Max: 16.52Min: 16.3 / Avg: 16.38 / Max: 16.47Min: 20.47 / Avg: 20.49 / Max: 20.51

i9-11900K7700XOpenBenchmarking.orgFrames Per Second, More Is BetterEmbree 3.13Binary: Pathtracer ISPC - Model: Asian Dragon ObjAVX-512 OffAVX-512 On48121620SE +/- 0.02, N = 3SE +/- 0.03, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 314.0214.3514.5717.98
i9-11900K7700XOpenBenchmarking.orgFrames Per Second, More Is BetterEmbree 3.13Binary: Pathtracer ISPC - Model: Asian Dragon ObjAVX-512 OffAVX-512 On510152025Min: 13.99 / Avg: 14.02 / Max: 14.07Min: 14.3 / Avg: 14.35 / Max: 14.38Min: 14.56 / Avg: 14.57 / Max: 14.58Min: 17.97 / Avg: 17.98 / Max: 18

i9-11900K7700XOpenBenchmarking.orgFrames Per Second, More Is BetterEmbree 3.13Binary: Pathtracer ISPC - Model: CrownAVX-512 OffAVX-512 On48121620SE +/- 0.11, N = 3SE +/- 0.03, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 313.8614.6214.8818.17
i9-11900K7700XOpenBenchmarking.orgFrames Per Second, More Is BetterEmbree 3.13Binary: Pathtracer ISPC - Model: CrownAVX-512 OffAVX-512 On510152025Min: 13.64 / Avg: 13.86 / Max: 14Min: 14.56 / Avg: 14.62 / Max: 14.66Min: 14.85 / Avg: 14.88 / Max: 14.9Min: 18.15 / Avg: 18.17 / Max: 18.19

OpenVKL

OpenVKL is the Intel Open Volume Kernel Library that offers high-performance volume computation kernels and part of the Intel oneAPI rendering toolkit. Learn more via the OpenBenchmarking.org test page.

i9-11900K7700XOpenBenchmarking.orgItems / Sec, More Is BetterOpenVKL 1.0Benchmark: vklBenchmark ISPCAVX-512 OffAVX-512 On306090120150SE +/- 0.00, N = 3SE +/- 0.67, N = 3SE +/- 0.33, N = 3SE +/- 0.00, N = 38711280107
i9-11900K7700XOpenBenchmarking.orgItems / Sec, More Is BetterOpenVKL 1.0Benchmark: vklBenchmark ISPCAVX-512 OffAVX-512 On20406080100Min: 87 / Avg: 87 / Max: 87Min: 111 / Avg: 111.67 / Max: 113Min: 79 / Avg: 79.67 / Max: 80Min: 107 / Avg: 107 / Max: 107

OSPRay

Intel OSPRay is a portable ray-tracing engine for high-performance, high-fidelity scientific visualizations. OSPRay builds off Intel's Embree and Intel SPMD Program Compiler (ISPC) components as part of the oneAPI rendering toolkit. Learn more via the OpenBenchmarking.org test page.

i9-11900K7700XOpenBenchmarking.orgItems Per Second, More Is BetterOSPRay 2.10Benchmark: gravity_spheres_volume/dim_512/ao/real_timeAVX-512 OffAVX-512 On1.00552.0113.01654.0225.0275SE +/- 0.01595, N = 3SE +/- 0.01309, N = 3SE +/- 0.00252, N = 3SE +/- 0.01470, N = 32.828214.469062.304684.12348
i9-11900K7700XOpenBenchmarking.orgItems Per Second, More Is BetterOSPRay 2.10Benchmark: gravity_spheres_volume/dim_512/ao/real_timeAVX-512 OffAVX-512 On246810Min: 2.8 / Avg: 2.83 / Max: 2.85Min: 4.45 / Avg: 4.47 / Max: 4.49Min: 2.3 / Avg: 2.3 / Max: 2.31Min: 4.09 / Avg: 4.12 / Max: 4.14

i9-11900K7700XOpenBenchmarking.orgItems Per Second, More Is BetterOSPRay 2.10Benchmark: gravity_spheres_volume/dim_512/scivis/real_timeAVX-512 OffAVX-512 On0.98271.96542.94813.93084.9135SE +/- 0.00481, N = 3SE +/- 0.02096, N = 3SE +/- 0.00449, N = 3SE +/- 0.00175, N = 32.723784.367722.188374.00927
i9-11900K7700XOpenBenchmarking.orgItems Per Second, More Is BetterOSPRay 2.10Benchmark: gravity_spheres_volume/dim_512/scivis/real_timeAVX-512 OffAVX-512 On246810Min: 2.72 / Avg: 2.72 / Max: 2.73Min: 4.34 / Avg: 4.37 / Max: 4.41Min: 2.18 / Avg: 2.19 / Max: 2.2Min: 4.01 / Avg: 4.01 / Max: 4.01

i9-11900K7700XOpenBenchmarking.orgItems Per Second, More Is BetterOSPRay 2.10Benchmark: gravity_spheres_volume/dim_512/pathtracer/real_timeAVX-512 OffAVX-512 On1.20442.40883.61324.81766.022SE +/- 0.01158, N = 3SE +/- 0.02156, N = 3SE +/- 0.00104, N = 3SE +/- 0.00288, N = 34.057455.353013.502314.81427
i9-11900K7700XOpenBenchmarking.orgItems Per Second, More Is BetterOSPRay 2.10Benchmark: gravity_spheres_volume/dim_512/pathtracer/real_timeAVX-512 OffAVX-512 On246810Min: 4.04 / Avg: 4.06 / Max: 4.08Min: 5.32 / Avg: 5.35 / Max: 5.39Min: 3.5 / Avg: 3.5 / Max: 3.5Min: 4.81 / Avg: 4.81 / Max: 4.82

i9-11900K7700XOpenBenchmarking.orgItems Per Second, More Is BetterOSPRay 2.10Benchmark: particle_volume/pathtracer/real_timeAVX-512 OffAVX-512 On4080120160200SE +/- 0.37, N = 3SE +/- 0.56, N = 3SE +/- 0.06, N = 3SE +/- 0.15, N = 3164.96173.74156.57176.52
i9-11900K7700XOpenBenchmarking.orgItems Per Second, More Is BetterOSPRay 2.10Benchmark: particle_volume/pathtracer/real_timeAVX-512 OffAVX-512 On306090120150Min: 164.42 / Avg: 164.96 / Max: 165.68Min: 172.93 / Avg: 173.74 / Max: 174.82Min: 156.45 / Avg: 156.57 / Max: 156.66Min: 176.28 / Avg: 176.52 / Max: 176.8

OSPRay Studio

Intel OSPRay Studio is an open-source, interactive visualization and ray-tracing software package. OSPRay Studio makes use of Intel OSPRay, a portable ray-tracing engine for high-performance, high-fidelity visualizations. OSPRay builds off Intel's Embree and Intel SPMD Program Compiler (ISPC) components as part of the oneAPI rendering toolkit. Learn more via the OpenBenchmarking.org test page.

i9-11900K7700XOpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.11Camera: 1 - Resolution: 1080p - Samples Per Pixel: 1 - Renderer: Path TracerAVX-512 OffAVX-512 On5001000150020002500SE +/- 1.45, N = 3SE +/- 3.51, N = 3SE +/- 3.84, N = 3SE +/- 1.86, N = 321341951230718811. (CXX) g++ options: -O3 -march=native -ldl
i9-11900K7700XOpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.11Camera: 1 - Resolution: 1080p - Samples Per Pixel: 1 - Renderer: Path TracerAVX-512 OffAVX-512 On400800120016002000Min: 2132 / Avg: 2134.33 / Max: 2137Min: 1944 / Avg: 1951 / Max: 1955Min: 2303 / Avg: 2307.33 / Max: 2315Min: 1879 / Avg: 1881.33 / Max: 18851. (CXX) g++ options: -O3 -march=native -ldl

i9-11900K7700XOpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.11Camera: 1 - Resolution: 1080p - Samples Per Pixel: 16 - Renderer: Path TracerAVX-512 OffAVX-512 On8K16K24K32K40KSE +/- 5.46, N = 3SE +/- 206.81, N = 3SE +/- 46.51, N = 3SE +/- 72.56, N = 3341123118036697300591. (CXX) g++ options: -O3 -march=native -ldl
i9-11900K7700XOpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.11Camera: 1 - Resolution: 1080p - Samples Per Pixel: 16 - Renderer: Path TracerAVX-512 OffAVX-512 On6K12K18K24K30KMin: 34101 / Avg: 34111.67 / Max: 34119Min: 30883 / Avg: 31180.33 / Max: 31578Min: 36634 / Avg: 36697.33 / Max: 36788Min: 29963 / Avg: 30058.67 / Max: 302011. (CXX) g++ options: -O3 -march=native -ldl

i9-11900K7700XOpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.11Camera: 1 - Resolution: 1080p - Samples Per Pixel: 32 - Renderer: Path TracerAVX-512 OffAVX-512 On16K32K48K64K80KSE +/- 50.78, N = 3SE +/- 140.32, N = 3SE +/- 102.78, N = 3SE +/- 104.25, N = 3721456544776956636381. (CXX) g++ options: -O3 -march=native -ldl
i9-11900K7700XOpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.11Camera: 1 - Resolution: 1080p - Samples Per Pixel: 32 - Renderer: Path TracerAVX-512 OffAVX-512 On13K26K39K52K65KMin: 72063 / Avg: 72145.33 / Max: 72238Min: 65171 / Avg: 65447 / Max: 65629Min: 76786 / Avg: 76955.67 / Max: 77141Min: 63515 / Avg: 63637.67 / Max: 638451. (CXX) g++ options: -O3 -march=native -ldl

i9-11900K7700XOpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.11Camera: 1 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path TracerAVX-512 OffAVX-512 On2K4K6K8K10KSE +/- 2.40, N = 3SE +/- 11.53, N = 3SE +/- 11.79, N = 3SE +/- 12.22, N = 384507734913174811. (CXX) g++ options: -O3 -march=native -ldl
i9-11900K7700XOpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.11Camera: 1 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path TracerAVX-512 OffAVX-512 On16003200480064008000Min: 8447 / Avg: 8450.33 / Max: 8455Min: 7711 / Avg: 7734 / Max: 7747Min: 9108 / Avg: 9131.33 / Max: 9146Min: 7457 / Avg: 7481 / Max: 74971. (CXX) g++ options: -O3 -march=native -ldl

i9-11900K7700XOpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.11Camera: 1 - Resolution: 4K - Samples Per Pixel: 16 - Renderer: Path TracerAVX-512 OffAVX-512 On30K60K90K120K150KSE +/- 39.26, N = 3SE +/- 430.68, N = 3SE +/- 135.26, N = 3SE +/- 382.61, N = 31395191275401491541228801. (CXX) g++ options: -O3 -march=native -ldl
i9-11900K7700XOpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.11Camera: 1 - Resolution: 4K - Samples Per Pixel: 16 - Renderer: Path TracerAVX-512 OffAVX-512 On30K60K90K120K150KMin: 139451 / Avg: 139519 / Max: 139587Min: 127039 / Avg: 127539.67 / Max: 128397Min: 148913 / Avg: 149153.67 / Max: 149381Min: 122117 / Avg: 122879.67 / Max: 1233151. (CXX) g++ options: -O3 -march=native -ldl

i9-11900K7700XOpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.11Camera: 1 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path TracerAVX-512 OffAVX-512 On60K120K180K240K300KSE +/- 100.66, N = 3SE +/- 784.12, N = 3SE +/- 92.44, N = 3SE +/- 201.93, N = 32756932506982947952422941. (CXX) g++ options: -O3 -march=native -ldl
i9-11900K7700XOpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.11Camera: 1 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path TracerAVX-512 OffAVX-512 On50K100K150K200K250KMin: 275573 / Avg: 275693 / Max: 275893Min: 249144 / Avg: 250698.33 / Max: 251656Min: 294638 / Avg: 294794.67 / Max: 294958Min: 241891 / Avg: 242294.33 / Max: 2425141. (CXX) g++ options: -O3 -march=native -ldl

i9-11900K7700XOpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.11Camera: 3 - Resolution: 1080p - Samples Per Pixel: 1 - Renderer: Path TracerAVX-512 OffAVX-512 On6001200180024003000SE +/- 2.85, N = 3SE +/- 2.33, N = 3SE +/- 2.89, N = 3SE +/- 2.96, N = 325612364274422561. (CXX) g++ options: -O3 -march=native -ldl
i9-11900K7700XOpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.11Camera: 3 - Resolution: 1080p - Samples Per Pixel: 1 - Renderer: Path TracerAVX-512 OffAVX-512 On5001000150020002500Min: 2558 / Avg: 2561.33 / Max: 2567Min: 2360 / Avg: 2363.67 / Max: 2368Min: 2739 / Avg: 2744 / Max: 2749Min: 2252 / Avg: 2256.33 / Max: 22621. (CXX) g++ options: -O3 -march=native -ldl

i9-11900K7700XOpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.11Camera: 3 - Resolution: 1080p - Samples Per Pixel: 16 - Renderer: Path TracerAVX-512 OffAVX-512 On9K18K27K36K45KSE +/- 14.77, N = 3SE +/- 9.61, N = 3SE +/- 62.72, N = 3SE +/- 61.03, N = 3409483762043564360111. (CXX) g++ options: -O3 -march=native -ldl
i9-11900K7700XOpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.11Camera: 3 - Resolution: 1080p - Samples Per Pixel: 16 - Renderer: Path TracerAVX-512 OffAVX-512 On8K16K24K32K40KMin: 40930 / Avg: 40947.67 / Max: 40977Min: 37601 / Avg: 37619.67 / Max: 37633Min: 43439 / Avg: 43563.67 / Max: 43638Min: 35889 / Avg: 36010.67 / Max: 360801. (CXX) g++ options: -O3 -march=native -ldl

i9-11900K7700XOpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.11Camera: 3 - Resolution: 1080p - Samples Per Pixel: 32 - Renderer: Path TracerAVX-512 OffAVX-512 On20K40K60K80K100KSE +/- 31.80, N = 3SE +/- 171.11, N = 3SE +/- 86.36, N = 3SE +/- 144.91, N = 3858547880990723753591. (CXX) g++ options: -O3 -march=native -ldl
i9-11900K7700XOpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.11Camera: 3 - Resolution: 1080p - Samples Per Pixel: 32 - Renderer: Path TracerAVX-512 OffAVX-512 On16K32K48K64K80KMin: 85797 / Avg: 85853.67 / Max: 85907Min: 78534 / Avg: 78809.33 / Max: 79123Min: 90621 / Avg: 90723.33 / Max: 90895Min: 75083 / Avg: 75358.67 / Max: 755741. (CXX) g++ options: -O3 -march=native -ldl

i9-11900K7700XOpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.11Camera: 3 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path TracerAVX-512 OffAVX-512 On2K4K6K8K10KSE +/- 5.70, N = 3SE +/- 5.51, N = 3SE +/- 10.07, N = 3SE +/- 2.65, N = 31014893761085189161. (CXX) g++ options: -O3 -march=native -ldl
i9-11900K7700XOpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.11Camera: 3 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path TracerAVX-512 OffAVX-512 On2K4K6K8K10KMin: 10137 / Avg: 10148.33 / Max: 10155Min: 9367 / Avg: 9376 / Max: 9386Min: 10831 / Avg: 10851 / Max: 10863Min: 8911 / Avg: 8916 / Max: 89201. (CXX) g++ options: -O3 -march=native -ldl

i9-11900K7700XOpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.11Camera: 3 - Resolution: 4K - Samples Per Pixel: 16 - Renderer: Path TracerAVX-512 OffAVX-512 On40K80K120K160K200KSE +/- 189.77, N = 3SE +/- 494.14, N = 3SE +/- 137.87, N = 3SE +/- 281.81, N = 31665081531011769531458251. (CXX) g++ options: -O3 -march=native -ldl
i9-11900K7700XOpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.11Camera: 3 - Resolution: 4K - Samples Per Pixel: 16 - Renderer: Path TracerAVX-512 OffAVX-512 On30K60K90K120K150KMin: 166301 / Avg: 166508 / Max: 166887Min: 152120 / Avg: 153100.67 / Max: 153697Min: 176755 / Avg: 176952.67 / Max: 177218Min: 145467 / Avg: 145825 / Max: 1463811. (CXX) g++ options: -O3 -march=native -ldl

i9-11900K7700XOpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.11Camera: 3 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path TracerAVX-512 OffAVX-512 On70K140K210K280K350KSE +/- 178.71, N = 3SE +/- 378.84, N = 3SE +/- 544.33, N = 3SE +/- 279.15, N = 33295273039663493722883471. (CXX) g++ options: -O3 -march=native -ldl
i9-11900K7700XOpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.11Camera: 3 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path TracerAVX-512 OffAVX-512 On60K120K180K240K300KMin: 329215 / Avg: 329527 / Max: 329834Min: 303583 / Avg: 303966.33 / Max: 304724Min: 348767 / Avg: 349371.67 / Max: 350458Min: 287805 / Avg: 288347 / Max: 2887341. (CXX) g++ options: -O3 -march=native -ldl

oneDNN

i9-11900K7700XOpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.7Harness: Convolution Batch Shapes Auto - Data Type: f32 - Engine: CPUAVX-512 OffAVX-512 On48121620SE +/- 0.01072, N = 7SE +/- 0.00575, N = 7SE +/- 0.00349, N = 7SE +/- 0.00335, N = 715.6093014.283507.596877.343351. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl
i9-11900K7700XOpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.7Harness: Convolution Batch Shapes Auto - Data Type: f32 - Engine: CPUAVX-512 OffAVX-512 On48121620Min: 15.56 / Avg: 15.61 / Max: 15.65Min: 14.25 / Avg: 14.28 / Max: 14.3Min: 7.58 / Avg: 7.6 / Max: 7.61Min: 7.33 / Avg: 7.34 / Max: 7.361. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl

i9-11900K7700XOpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.7Harness: Convolution Batch Shapes Auto - Data Type: u8s8f32 - Engine: CPUAVX-512 OffAVX-512 On48121620SE +/- 0.01457, N = 7SE +/- 0.00331, N = 7SE +/- 0.00617, N = 7SE +/- 0.00920, N = 714.8411012.017807.806847.132631. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl
i9-11900K7700XOpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.7Harness: Convolution Batch Shapes Auto - Data Type: u8s8f32 - Engine: CPUAVX-512 OffAVX-512 On48121620Min: 14.77 / Avg: 14.84 / Max: 14.9Min: 12.01 / Avg: 12.02 / Max: 12.03Min: 7.79 / Avg: 7.81 / Max: 7.84Min: 7.11 / Avg: 7.13 / Max: 7.161. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl

i9-11900K7700XOpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.7Harness: Deconvolution Batch shapes_1d - Data Type: u8s8f32 - Engine: CPUAVX-512 OffAVX-512 On0.40010.80021.20031.60042.0005SE +/- 0.003095, N = 3SE +/- 0.003829, N = 3SE +/- 0.001155, N = 3SE +/- 0.000635, N = 31.7783200.8463761.4380700.7441821. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl
i9-11900K7700XOpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.7Harness: Deconvolution Batch shapes_1d - Data Type: u8s8f32 - Engine: CPUAVX-512 OffAVX-512 On246810Min: 1.77 / Avg: 1.78 / Max: 1.78Min: 0.84 / Avg: 0.85 / Max: 0.85Min: 1.44 / Avg: 1.44 / Max: 1.44Min: 0.74 / Avg: 0.74 / Max: 0.741. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl

i9-11900K7700XOpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.7Harness: Deconvolution Batch shapes_3d - Data Type: f32 - Engine: CPUAVX-512 OffAVX-512 On1.21352.4273.64054.8546.0675SE +/- 0.00507, N = 9SE +/- 0.00516, N = 9SE +/- 0.00439, N = 9SE +/- 0.00118, N = 95.393274.325644.516473.683741. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl
i9-11900K7700XOpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.7Harness: Deconvolution Batch shapes_3d - Data Type: f32 - Engine: CPUAVX-512 OffAVX-512 On246810Min: 5.36 / Avg: 5.39 / Max: 5.41Min: 4.31 / Avg: 4.33 / Max: 4.35Min: 4.49 / Avg: 4.52 / Max: 4.53Min: 3.68 / Avg: 3.68 / Max: 3.691. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl

i9-11900K7700XOpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.7Harness: Deconvolution Batch shapes_3d - Data Type: u8s8f32 - Engine: CPUAVX-512 OffAVX-512 On0.52021.04041.56062.08082.601SE +/- 0.009968, N = 9SE +/- 0.002806, N = 9SE +/- 0.003998, N = 9SE +/- 0.001720, N = 92.3118301.4694801.9206800.8991931. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl
i9-11900K7700XOpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.7Harness: Deconvolution Batch shapes_3d - Data Type: u8s8f32 - Engine: CPUAVX-512 OffAVX-512 On246810Min: 2.27 / Avg: 2.31 / Max: 2.37Min: 1.46 / Avg: 1.47 / Max: 1.48Min: 1.9 / Avg: 1.92 / Max: 1.94Min: 0.89 / Avg: 0.9 / Max: 0.911. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl

i9-11900K7700XOpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.7Harness: IP Shapes 1D - Data Type: u8s8f32 - Engine: CPUAVX-512 OffAVX-512 On0.27990.55980.83971.11961.3995SE +/- 0.000314, N = 4SE +/- 0.001828, N = 4SE +/- 0.004141, N = 4SE +/- 0.000245, N = 41.2439600.7159251.0046810.5499051. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl
i9-11900K7700XOpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.7Harness: IP Shapes 1D - Data Type: u8s8f32 - Engine: CPUAVX-512 OffAVX-512 On246810Min: 1.24 / Avg: 1.24 / Max: 1.24Min: 0.71 / Avg: 0.72 / Max: 0.72Min: 1 / Avg: 1 / Max: 1.02Min: 0.55 / Avg: 0.55 / Max: 0.551. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl

i9-11900K7700XOpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.7Harness: IP Shapes 3D - Data Type: f32 - Engine: CPUAVX-512 OffAVX-512 On3691215SE +/- 0.00748, N = 5SE +/- 0.01026, N = 5SE +/- 0.01045, N = 5SE +/- 0.00880, N = 511.677109.951134.337854.200541. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl
i9-11900K7700XOpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.7Harness: IP Shapes 3D - Data Type: f32 - Engine: CPUAVX-512 OffAVX-512 On3691215Min: 11.65 / Avg: 11.68 / Max: 11.69Min: 9.94 / Avg: 9.95 / Max: 9.99Min: 4.32 / Avg: 4.34 / Max: 4.38Min: 4.19 / Avg: 4.2 / Max: 4.241. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl

i9-11900K7700XOpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.7Harness: Matrix Multiply Batch Shapes Transformer - Data Type: f32 - Engine: CPUAVX-512 OffAVX-512 On0.82661.65322.47983.30644.133SE +/- 0.03921, N = 4SE +/- 0.00586, N = 4SE +/- 0.00144, N = 4SE +/- 0.00117, N = 43.673603.217421.295911.213461. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl
i9-11900K7700XOpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.7Harness: Matrix Multiply Batch Shapes Transformer - Data Type: f32 - Engine: CPUAVX-512 OffAVX-512 On246810Min: 3.61 / Avg: 3.67 / Max: 3.78Min: 3.2 / Avg: 3.22 / Max: 3.23Min: 1.29 / Avg: 1.3 / Max: 1.3Min: 1.21 / Avg: 1.21 / Max: 1.221. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl

i9-11900K7700XOpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.7Harness: Matrix Multiply Batch Shapes Transformer - Data Type: u8s8f32 - Engine: CPUAVX-512 OffAVX-512 On0.31570.63140.94711.26281.5785SE +/- 0.003732, N = 4SE +/- 0.003777, N = 4SE +/- 0.001160, N = 4SE +/- 0.000272, N = 41.4033001.3090600.6106680.2407151. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl
i9-11900K7700XOpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.7Harness: Matrix Multiply Batch Shapes Transformer - Data Type: u8s8f32 - Engine: CPUAVX-512 OffAVX-512 On246810Min: 1.4 / Avg: 1.4 / Max: 1.41Min: 1.3 / Avg: 1.31 / Max: 1.31Min: 0.61 / Avg: 0.61 / Max: 0.61Min: 0.24 / Avg: 0.24 / Max: 0.241. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl

i9-11900K7700XOpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.7Harness: Recurrent Neural Network Training - Data Type: f32 - Engine: CPUAVX-512 OffAVX-512 On7001400210028003500SE +/- 1.15, N = 3SE +/- 2.98, N = 3SE +/- 0.88, N = 3SE +/- 1.86, N = 33271.063062.362206.972093.411. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl
i9-11900K7700XOpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.7Harness: Recurrent Neural Network Training - Data Type: f32 - Engine: CPUAVX-512 OffAVX-512 On6001200180024003000Min: 3268.84 / Avg: 3271.06 / Max: 3272.71Min: 3056.47 / Avg: 3062.36 / Max: 3066.02Min: 2205.93 / Avg: 2206.97 / Max: 2208.71Min: 2090.55 / Avg: 2093.41 / Max: 2096.911. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl

i9-11900K7700XOpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.7Harness: Recurrent Neural Network Training - Data Type: u8s8f32 - Engine: CPUAVX-512 OffAVX-512 On7001400210028003500SE +/- 1.82, N = 3SE +/- 89.39, N = 15SE +/- 2.17, N = 3SE +/- 1.95, N = 33270.553073.172208.392094.921. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl
i9-11900K7700XOpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.7Harness: Recurrent Neural Network Training - Data Type: u8s8f32 - Engine: CPUAVX-512 OffAVX-512 On6001200180024003000Min: 3268.67 / Avg: 3270.55 / Max: 3274.19Min: 2934.9 / Avg: 3073.17 / Max: 4315.97Min: 2204.06 / Avg: 2208.39 / Max: 2210.81Min: 2091.15 / Avg: 2094.92 / Max: 2097.651. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl

i9-11900K7700XOpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.7Harness: Recurrent Neural Network Training - Data Type: bf16bf16bf16 - Engine: CPUAVX-512 OffAVX-512 On7001400210028003500SE +/- 2.45, N = 3SE +/- 38.98, N = 3SE +/- 0.62, N = 3SE +/- 0.81, N = 33271.272986.722206.612092.041. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl
i9-11900K7700XOpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.7Harness: Recurrent Neural Network Training - Data Type: bf16bf16bf16 - Engine: CPUAVX-512 OffAVX-512 On6001200180024003000Min: 3266.71 / Avg: 3271.27 / Max: 3275.12Min: 2943.91 / Avg: 2986.72 / Max: 3064.55Min: 2205.86 / Avg: 2206.61 / Max: 2207.85Min: 2090.44 / Avg: 2092.04 / Max: 2093.051. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl

i9-11900K7700XOpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.7Harness: Recurrent Neural Network Inference - Data Type: f32 - Engine: CPUAVX-512 OffAVX-512 On400800120016002000SE +/- 3.47, N = 3SE +/- 20.46, N = 4SE +/- 1.15, N = 3SE +/- 0.43, N = 32000.121739.491181.971040.291. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl
i9-11900K7700XOpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.7Harness: Recurrent Neural Network Inference - Data Type: f32 - Engine: CPUAVX-512 OffAVX-512 On30060090012001500Min: 1995.29 / Avg: 2000.12 / Max: 2006.85Min: 1678.71 / Avg: 1739.49 / Max: 1764.29Min: 1179.7 / Avg: 1181.97 / Max: 1183.43Min: 1039.83 / Avg: 1040.29 / Max: 1041.141. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl

i9-11900K7700XOpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.7Harness: Recurrent Neural Network Inference - Data Type: u8s8f32 - Engine: CPUAVX-512 OffAVX-512 On400800120016002000SE +/- 1.98, N = 3SE +/- 14.49, N = 3SE +/- 1.18, N = 3SE +/- 1.21, N = 32003.541738.001179.911040.491. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl
i9-11900K7700XOpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.7Harness: Recurrent Neural Network Inference - Data Type: u8s8f32 - Engine: CPUAVX-512 OffAVX-512 On30060090012001500Min: 1999.63 / Avg: 2003.54 / Max: 2005.97Min: 1709.2 / Avg: 1738 / Max: 1755.14Min: 1177.57 / Avg: 1179.91 / Max: 1181.39Min: 1038.09 / Avg: 1040.49 / Max: 1042.011. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl

i9-11900K7700XOpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.7Harness: Recurrent Neural Network Inference - Data Type: bf16bf16bf16 - Engine: CPUAVX-512 OffAVX-512 On400800120016002000SE +/- 0.87, N = 3SE +/- 18.65, N = 5SE +/- 2.20, N = 3SE +/- 0.63, N = 32006.021715.751178.691038.331. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl
i9-11900K7700XOpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.7Harness: Recurrent Neural Network Inference - Data Type: bf16bf16bf16 - Engine: CPUAVX-512 OffAVX-512 On30060090012001500Min: 2004.54 / Avg: 2006.02 / Max: 2007.56Min: 1684.17 / Avg: 1715.75 / Max: 1779.12Min: 1174.99 / Avg: 1178.69 / Max: 1182.6Min: 1037.17 / Avg: 1038.33 / Max: 1039.331. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl

Cpuminer-Opt

Cpuminer-Opt is a fork of cpuminer-multi that carries a wide range of CPU performance optimizations for measuring the potential cryptocurrency mining performance of the CPU/processor with a wide variety of cryptocurrencies. The benchmark reports the hash speed for the CPU mining performance for the selected cryptocurrency. Learn more via the OpenBenchmarking.org test page.

i9-11900K7700XOpenBenchmarking.orgkH/s, More Is BetterCpuminer-Opt 3.18Algorithm: Quad SHA-256, PyriteAVX-512 OffAVX-512 On40K80K120K160K200KSE +/- 42.56, N = 3SE +/- 346.55, N = 3SE +/- 298.07, N = 3SE +/- 548.49, N = 364663164790955831630471. (CXX) g++ options: -O3 -march=native -lcurl -lz -lpthread -lssl -lcrypto -lgmp
i9-11900K7700XOpenBenchmarking.orgkH/s, More Is BetterCpuminer-Opt 3.18Algorithm: Quad SHA-256, PyriteAVX-512 OffAVX-512 On30K60K90K120K150KMin: 64580 / Avg: 64663.33 / Max: 64720Min: 164180 / Avg: 164790 / Max: 165380Min: 94990 / Avg: 95583.33 / Max: 95930Min: 162100 / Avg: 163046.67 / Max: 1640001. (CXX) g++ options: -O3 -march=native -lcurl -lz -lpthread -lssl -lcrypto -lgmp

i9-11900K7700XOpenBenchmarking.orgkH/s, More Is BetterCpuminer-Opt 3.18Algorithm: Myriad-GroestlAVX-512 OffAVX-512 On10K20K30K40K50KSE +/- 17.32, N = 3SE +/- 164.55, N = 3SE +/- 64.29, N = 3SE +/- 256.93, N = 3161504066323510462271. (CXX) g++ options: -O3 -march=native -lcurl -lz -lpthread -lssl -lcrypto -lgmp
i9-11900K7700XOpenBenchmarking.orgkH/s, More Is BetterCpuminer-Opt 3.18Algorithm: Myriad-GroestlAVX-512 OffAVX-512 On8K16K24K32K40KMin: 16120 / Avg: 16150 / Max: 16180Min: 40380 / Avg: 40663.33 / Max: 40950Min: 23390 / Avg: 23510 / Max: 23610Min: 45950 / Avg: 46226.67 / Max: 467401. (CXX) g++ options: -O3 -march=native -lcurl -lz -lpthread -lssl -lcrypto -lgmp

i9-11900K7700XOpenBenchmarking.orgkH/s, More Is BetterCpuminer-Opt 3.18Algorithm: Blake-2 SAVX-512 OffAVX-512 On200K400K600K800K1000KSE +/- 382.81, N = 3SE +/- 7851.09, N = 15SE +/- 2931.70, N = 3SE +/- 7042.12, N = 33932138955135233239096271. (CXX) g++ options: -O3 -march=native -lcurl -lz -lpthread -lssl -lcrypto -lgmp
i9-11900K7700XOpenBenchmarking.orgkH/s, More Is BetterCpuminer-Opt 3.18Algorithm: Blake-2 SAVX-512 OffAVX-512 On160K320K480K640K800KMin: 392590 / Avg: 393213.33 / Max: 393910Min: 871390 / Avg: 895512.67 / Max: 999020Min: 518150 / Avg: 523323.33 / Max: 528300Min: 896050 / Avg: 909626.67 / Max: 9196601. (CXX) g++ options: -O3 -march=native -lcurl -lz -lpthread -lssl -lcrypto -lgmp

i9-11900K7700XOpenBenchmarking.orgkH/s, More Is BetterCpuminer-Opt 3.18Algorithm: GarlicoinAVX-512 OffAVX-512 On10002000300040005000SE +/- 6.13, N = 3SE +/- 10.30, N = 3SE +/- 15.44, N = 3SE +/- 12.43, N = 32381.454392.293169.054733.181. (CXX) g++ options: -O3 -march=native -lcurl -lz -lpthread -lssl -lcrypto -lgmp
i9-11900K7700XOpenBenchmarking.orgkH/s, More Is BetterCpuminer-Opt 3.18Algorithm: GarlicoinAVX-512 OffAVX-512 On8001600240032004000Min: 2370.02 / Avg: 2381.45 / Max: 2391Min: 4375.47 / Avg: 4392.29 / Max: 4411.01Min: 3152.55 / Avg: 3169.05 / Max: 3199.91Min: 4708.33 / Avg: 4733.18 / Max: 4745.761. (CXX) g++ options: -O3 -march=native -lcurl -lz -lpthread -lssl -lcrypto -lgmp

i9-11900K7700XOpenBenchmarking.orgkH/s, More Is BetterCpuminer-Opt 3.18Algorithm: SkeincoinAVX-512 OffAVX-512 On30K60K90K120K150KSE +/- 85.44, N = 3SE +/- 146.55, N = 3SE +/- 479.80, N = 3SE +/- 323.47, N = 3707201124031047631456001. (CXX) g++ options: -O3 -march=native -lcurl -lz -lpthread -lssl -lcrypto -lgmp
i9-11900K7700XOpenBenchmarking.orgkH/s, More Is BetterCpuminer-Opt 3.18Algorithm: SkeincoinAVX-512 OffAVX-512 On30K60K90K120K150KMin: 70620 / Avg: 70720 / Max: 70890Min: 112120 / Avg: 112403.33 / Max: 112610Min: 104220 / Avg: 104763.33 / Max: 105720Min: 145130 / Avg: 145600 / Max: 1462201. (CXX) g++ options: -O3 -march=native -lcurl -lz -lpthread -lssl -lcrypto -lgmp

i9-11900K7700XOpenBenchmarking.orgkH/s, More Is BetterCpuminer-Opt 3.18Algorithm: LBC, LBRY CreditsAVX-512 OffAVX-512 On16K32K48K64K80KSE +/- 20.00, N = 3SE +/- 116.81, N = 3SE +/- 171.88, N = 3SE +/- 459.36, N = 3272707639338683768471. (CXX) g++ options: -O3 -march=native -lcurl -lz -lpthread -lssl -lcrypto -lgmp
i9-11900K7700XOpenBenchmarking.orgkH/s, More Is BetterCpuminer-Opt 3.18Algorithm: LBC, LBRY CreditsAVX-512 OffAVX-512 On13K26K39K52K65KMin: 27230 / Avg: 27270 / Max: 27290Min: 76160 / Avg: 76393.33 / Max: 76520Min: 38340 / Avg: 38683.33 / Max: 38870Min: 76070 / Avg: 76846.67 / Max: 776601. (CXX) g++ options: -O3 -march=native -lcurl -lz -lpthread -lssl -lcrypto -lgmp

Mobile Neural Network

MNN is the Mobile Neural Network as a highly efficient, lightweight deep learning framework developed by Alibaba. This MNN test profile is building the OpenMP / CPU threaded version for processor benchmarking and not any GPU-accelerated test. MNN does allow making use of AVX-512 extensions. Learn more via the OpenBenchmarking.org test page.

i9-11900K7700XOpenBenchmarking.orgms, Fewer Is BetterMobile Neural Network 2.1Model: squeezenetv1.1AVX-512 OffAVX-512 On0.45520.91041.36561.82082.276SE +/- 0.014, N = 3SE +/- 0.014, N = 15SE +/- 0.029, N = 3SE +/- 0.011, N = 122.0231.6751.5331.2211. (CXX) g++ options: -O3 -march=native -std=c++11 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl
i9-11900K7700XOpenBenchmarking.orgms, Fewer Is BetterMobile Neural Network 2.1Model: squeezenetv1.1AVX-512 OffAVX-512 On246810Min: 2 / Avg: 2.02 / Max: 2.05Min: 1.58 / Avg: 1.68 / Max: 1.76Min: 1.5 / Avg: 1.53 / Max: 1.59Min: 1.17 / Avg: 1.22 / Max: 1.271. (CXX) g++ options: -O3 -march=native -std=c++11 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl

i9-11900K7700XOpenBenchmarking.orgms, Fewer Is BetterMobile Neural Network 2.1Model: resnet-v2-50AVX-512 OffAVX-512 On48121620SE +/- 0.080, N = 3SE +/- 0.042, N = 15SE +/- 0.173, N = 3SE +/- 0.082, N = 1218.04310.36815.1347.4461. (CXX) g++ options: -O3 -march=native -std=c++11 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl
i9-11900K7700XOpenBenchmarking.orgms, Fewer Is BetterMobile Neural Network 2.1Model: resnet-v2-50AVX-512 OffAVX-512 On510152025Min: 17.9 / Avg: 18.04 / Max: 18.18Min: 10.23 / Avg: 10.37 / Max: 10.61Min: 14.93 / Avg: 15.13 / Max: 15.48Min: 7.02 / Avg: 7.45 / Max: 7.731. (CXX) g++ options: -O3 -march=native -std=c++11 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl

i9-11900K7700XOpenBenchmarking.orgms, Fewer Is BetterMobile Neural Network 2.1Model: SqueezeNetV1.0AVX-512 OffAVX-512 On0.83121.66242.49363.32484.156SE +/- 0.032, N = 3SE +/- 0.022, N = 15SE +/- 0.075, N = 3SE +/- 0.027, N = 123.6943.1142.6752.3051. (CXX) g++ options: -O3 -march=native -std=c++11 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl
i9-11900K7700XOpenBenchmarking.orgms, Fewer Is BetterMobile Neural Network 2.1Model: SqueezeNetV1.0AVX-512 OffAVX-512 On246810Min: 3.63 / Avg: 3.69 / Max: 3.74Min: 3 / Avg: 3.11 / Max: 3.3Min: 2.59 / Avg: 2.67 / Max: 2.82Min: 2.21 / Avg: 2.31 / Max: 2.411. (CXX) g++ options: -O3 -march=native -std=c++11 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl

i9-11900K7700XOpenBenchmarking.orgms, Fewer Is BetterMobile Neural Network 2.1Model: inception-v3AVX-512 OffAVX-512 On612182430SE +/- 0.02, N = 3SE +/- 0.27, N = 15SE +/- 0.09, N = 3SE +/- 0.34, N = 1223.4219.4018.7715.271. (CXX) g++ options: -O3 -march=native -std=c++11 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl
i9-11900K7700XOpenBenchmarking.orgms, Fewer Is BetterMobile Neural Network 2.1Model: inception-v3AVX-512 OffAVX-512 On510152025Min: 23.39 / Avg: 23.42 / Max: 23.46Min: 17.97 / Avg: 19.4 / Max: 20.71Min: 18.65 / Avg: 18.77 / Max: 18.94Min: 13.71 / Avg: 15.27 / Max: 16.321. (CXX) g++ options: -O3 -march=native -std=c++11 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl

NCNN

NCNN is a high performance neural network inference framework optimized for mobile and other platforms developed by Tencent. Learn more via the OpenBenchmarking.org test page.

i9-11900K7700XOpenBenchmarking.orgms, Fewer Is BetterNCNN 20220729Target: CPU - Model: vision_transformerAVX-512 OffAVX-512 On20406080100SE +/- 0.39, N = 3SE +/- 0.12, N = 3SE +/- 0.03, N = 3SE +/- 0.08, N = 3110.3870.3988.0056.461. (CXX) g++ options: -O3 -march=native -rdynamic -lgomp -lpthread
i9-11900K7700XOpenBenchmarking.orgms, Fewer Is BetterNCNN 20220729Target: CPU - Model: vision_transformerAVX-512 OffAVX-512 On20406080100Min: 109.75 / Avg: 110.38 / Max: 111.1Min: 70.24 / Avg: 70.39 / Max: 70.63Min: 87.96 / Avg: 88 / Max: 88.06Min: 56.36 / Avg: 56.46 / Max: 56.621. (CXX) g++ options: -O3 -march=native -rdynamic -lgomp -lpthread

TensorFlow

This is a benchmark of the TensorFlow deep learning framework using the TensorFlow reference benchmarks (tensorflow/benchmarks with tf_cnn_benchmarks.py). Note with the Phoronix Test Suite there is also pts/tensorflow-lite for benchmarking the TensorFlow Lite binaries too. Learn more via the OpenBenchmarking.org test page.

i9-11900K7700XOpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.10Device: CPU - Batch Size: 16 - Model: VGG-16AVX-512 OffAVX-512 On3691215SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.01, N = 35.697.767.5010.26
i9-11900K7700XOpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.10Device: CPU - Batch Size: 16 - Model: VGG-16AVX-512 OffAVX-512 On3691215Min: 5.69 / Avg: 5.69 / Max: 5.69Min: 7.75 / Avg: 7.76 / Max: 7.76Min: 7.49 / Avg: 7.5 / Max: 7.5Min: 10.25 / Avg: 10.26 / Max: 10.27

i9-11900K7700XOpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.10Device: CPU - Batch Size: 16 - Model: ResNet-50AVX-512 OffAVX-512 On816243240SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.02, N = 3SE +/- 0.01, N = 312.2920.5519.2033.36
i9-11900K7700XOpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.10Device: CPU - Batch Size: 16 - Model: ResNet-50AVX-512 OffAVX-512 On714212835Min: 12.28 / Avg: 12.29 / Max: 12.32Min: 20.53 / Avg: 20.55 / Max: 20.56Min: 19.16 / Avg: 19.2 / Max: 19.23Min: 33.34 / Avg: 33.36 / Max: 33.37

i9-11900K7700XOpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.10Device: CPU - Batch Size: 16 - Model: AlexNetAVX-512 OffAVX-512 On306090120150SE +/- 0.03, N = 3SE +/- 0.12, N = 3SE +/- 0.05, N = 3SE +/- 0.02, N = 467.8082.1095.68136.45
i9-11900K7700XOpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.10Device: CPU - Batch Size: 16 - Model: AlexNetAVX-512 OffAVX-512 On306090120150Min: 67.76 / Avg: 67.8 / Max: 67.85Min: 81.87 / Avg: 82.1 / Max: 82.24Min: 95.58 / Avg: 95.68 / Max: 95.75Min: 136.4 / Avg: 136.45 / Max: 136.48

i9-11900K7700XOpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.10Device: CPU - Batch Size: 16 - Model: GoogLeNetAVX-512 OffAVX-512 On20406080100SE +/- 0.02, N = 3SE +/- 0.16, N = 3SE +/- 0.07, N = 3SE +/- 0.10, N = 336.2263.8356.28101.18
i9-11900K7700XOpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.10Device: CPU - Batch Size: 16 - Model: GoogLeNetAVX-512 OffAVX-512 On20406080100Min: 36.18 / Avg: 36.22 / Max: 36.25Min: 63.56 / Avg: 63.83 / Max: 64.1Min: 56.16 / Avg: 56.28 / Max: 56.41Min: 101.01 / Avg: 101.18 / Max: 101.34

i9-11900K7700XOpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.10Device: CPU - Batch Size: 32 - Model: VGG-16AVX-512 OffAVX-512 On3691215SE +/- 0.00, N = 3SE +/- 0.01, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 35.958.297.7710.70
i9-11900K7700XOpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.10Device: CPU - Batch Size: 32 - Model: VGG-16AVX-512 OffAVX-512 On3691215Min: 5.95 / Avg: 5.95 / Max: 5.96Min: 8.28 / Avg: 8.29 / Max: 8.3Min: 7.77 / Avg: 7.77 / Max: 7.77Min: 10.7 / Avg: 10.7 / Max: 10.7

i9-11900K7700XOpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.10Device: CPU - Batch Size: 32 - Model: ResNet-50AVX-512 OffAVX-512 On816243240SE +/- 0.01, N = 3SE +/- 0.00, N = 3SE +/- 0.02, N = 3SE +/- 0.01, N = 312.3221.2918.5033.23
i9-11900K7700XOpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.10Device: CPU - Batch Size: 32 - Model: ResNet-50AVX-512 OffAVX-512 On714212835Min: 12.31 / Avg: 12.32 / Max: 12.33Min: 21.28 / Avg: 21.29 / Max: 21.29Min: 18.47 / Avg: 18.5 / Max: 18.52Min: 33.2 / Avg: 33.23 / Max: 33.25

i9-11900K7700XOpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.10Device: CPU - Batch Size: 32 - Model: AlexNetAVX-512 OffAVX-512 On4080120160200SE +/- 0.05, N = 3SE +/- 0.26, N = 3SE +/- 0.14, N = 3SE +/- 0.40, N = 387.79113.25125.48183.14
i9-11900K7700XOpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.10Device: CPU - Batch Size: 32 - Model: AlexNetAVX-512 OffAVX-512 On306090120150Min: 87.71 / Avg: 87.79 / Max: 87.87Min: 112.83 / Avg: 113.25 / Max: 113.73Min: 125.22 / Avg: 125.48 / Max: 125.69Min: 182.36 / Avg: 183.14 / Max: 183.69

i9-11900K7700XOpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.10Device: CPU - Batch Size: 32 - Model: GoogLeNetAVX-512 OffAVX-512 On20406080100SE +/- 0.04, N = 3SE +/- 0.06, N = 3SE +/- 0.02, N = 3SE +/- 0.10, N = 336.4964.4255.1899.11
i9-11900K7700XOpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.10Device: CPU - Batch Size: 32 - Model: GoogLeNetAVX-512 OffAVX-512 On20406080100Min: 36.43 / Avg: 36.49 / Max: 36.56Min: 64.34 / Avg: 64.42 / Max: 64.54Min: 55.14 / Avg: 55.18 / Max: 55.21Min: 98.98 / Avg: 99.11 / Max: 99.31

i9-11900K7700XOpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.10Device: CPU - Batch Size: 64 - Model: VGG-16AVX-512 OffAVX-512 On3691215SE +/- 0.00, N = 3SE +/- 0.01, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 36.118.697.9610.95
i9-11900K7700XOpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.10Device: CPU - Batch Size: 64 - Model: VGG-16AVX-512 OffAVX-512 On3691215Min: 6.11 / Avg: 6.11 / Max: 6.12Min: 8.67 / Avg: 8.69 / Max: 8.7Min: 7.96 / Avg: 7.96 / Max: 7.96Min: 10.94 / Avg: 10.95 / Max: 10.95

i9-11900K7700XOpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.10Device: CPU - Batch Size: 64 - Model: ResNet-50AVX-512 OffAVX-512 On816243240SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 312.3721.8818.0632.97
i9-11900K7700XOpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.10Device: CPU - Batch Size: 64 - Model: ResNet-50AVX-512 OffAVX-512 On714212835Min: 12.36 / Avg: 12.37 / Max: 12.38Min: 21.87 / Avg: 21.88 / Max: 21.89Min: 18.05 / Avg: 18.06 / Max: 18.07Min: 32.95 / Avg: 32.97 / Max: 32.98

i9-11900K7700XOpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.10Device: CPU - Batch Size: 64 - Model: AlexNetAVX-512 OffAVX-512 On50100150200250SE +/- 0.07, N = 3SE +/- 0.13, N = 3SE +/- 0.09, N = 3SE +/- 0.12, N = 3103.31137.75146.47219.20
i9-11900K7700XOpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.10Device: CPU - Batch Size: 64 - Model: AlexNetAVX-512 OffAVX-512 On4080120160200Min: 103.17 / Avg: 103.31 / Max: 103.42Min: 137.5 / Avg: 137.75 / Max: 137.9Min: 146.35 / Avg: 146.47 / Max: 146.64Min: 218.99 / Avg: 219.2 / Max: 219.4

i9-11900K7700XOpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.10Device: CPU - Batch Size: 64 - Model: GoogLeNetAVX-512 OffAVX-512 On20406080100SE +/- 0.01, N = 3SE +/- 0.07, N = 3SE +/- 0.06, N = 3SE +/- 0.02, N = 336.9465.1554.8097.53
i9-11900K7700XOpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.10Device: CPU - Batch Size: 64 - Model: GoogLeNetAVX-512 OffAVX-512 On20406080100Min: 36.92 / Avg: 36.94 / Max: 36.96Min: 65.08 / Avg: 65.15 / Max: 65.29Min: 54.69 / Avg: 54.8 / Max: 54.91Min: 97.51 / Avg: 97.53 / Max: 97.56

i9-11900K7700XOpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.10Device: CPU - Batch Size: 256 - Model: VGG-16AVX-512 OffAVX-512 On3691215SE +/- 0.00, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 36.229.427.9811.15
i9-11900K7700XOpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.10Device: CPU - Batch Size: 256 - Model: VGG-16AVX-512 OffAVX-512 On3691215Min: 6.21 / Avg: 6.22 / Max: 6.22Min: 9.41 / Avg: 9.42 / Max: 9.43Min: 7.97 / Avg: 7.98 / Max: 7.99Min: 11.14 / Avg: 11.15 / Max: 11.16

i9-11900K7700XOpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.10Device: CPU - Batch Size: 256 - Model: ResNet-50AVX-512 OffAVX-512 On816243240SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.01, N = 3SE +/- 0.00, N = 312.4822.1317.7432.83
i9-11900K7700XOpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.10Device: CPU - Batch Size: 256 - Model: ResNet-50AVX-512 OffAVX-512 On714212835Min: 12.48 / Avg: 12.48 / Max: 12.49Min: 22.12 / Avg: 22.13 / Max: 22.13Min: 17.73 / Avg: 17.74 / Max: 17.75Min: 32.82 / Avg: 32.83 / Max: 32.83

i9-11900K7700XOpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.10Device: CPU - Batch Size: 256 - Model: AlexNetAVX-512 OffAVX-512 On50100150200250SE +/- 0.05, N = 3SE +/- 0.22, N = 3SE +/- 0.07, N = 3SE +/- 0.03, N = 3117.43163.09162.62249.49
i9-11900K7700XOpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.10Device: CPU - Batch Size: 256 - Model: AlexNetAVX-512 OffAVX-512 On50100150200250Min: 117.38 / Avg: 117.43 / Max: 117.54Min: 162.66 / Avg: 163.09 / Max: 163.34Min: 162.48 / Avg: 162.62 / Max: 162.72Min: 249.45 / Avg: 249.49 / Max: 249.54

i9-11900K7700XOpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.10Device: CPU - Batch Size: 256 - Model: GoogLeNetAVX-512 OffAVX-512 On20406080100SE +/- 0.02, N = 3SE +/- 0.06, N = 3SE +/- 0.01, N = 3SE +/- 0.02, N = 337.3766.4953.0496.81
i9-11900K7700XOpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.10Device: CPU - Batch Size: 256 - Model: GoogLeNetAVX-512 OffAVX-512 On20406080100Min: 37.35 / Avg: 37.37 / Max: 37.4Min: 66.41 / Avg: 66.49 / Max: 66.62Min: 53.03 / Avg: 53.04 / Max: 53.06Min: 96.77 / Avg: 96.81 / Max: 96.85

i9-11900K7700XOpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.10Device: CPU - Batch Size: 512 - Model: AlexNetAVX-512 OffAVX-512 On60120180240300SE +/- 0.09, N = 3SE +/- 0.21, N = 3SE +/- 0.04, N = 3SE +/- 0.05, N = 3107.72172.66165.40252.82
i9-11900K7700XOpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.10Device: CPU - Batch Size: 512 - Model: AlexNetAVX-512 OffAVX-512 On50100150200250Min: 107.55 / Avg: 107.72 / Max: 107.86Min: 172.24 / Avg: 172.66 / Max: 172.93Min: 165.32 / Avg: 165.4 / Max: 165.45Min: 252.75 / Avg: 252.82 / Max: 252.91

i9-11900K7700XOpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.10Device: CPU - Batch Size: 512 - Model: GoogLeNetAVX-512 OffAVX-512 On20406080100SE +/- 0.06, N = 3SE +/- 0.03, N = 3SE +/- 0.01, N = 3SE +/- 0.05, N = 333.9267.6752.9296.86
i9-11900K7700XOpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.10Device: CPU - Batch Size: 512 - Model: GoogLeNetAVX-512 OffAVX-512 On20406080100Min: 33.85 / Avg: 33.92 / Max: 34.05Min: 67.6 / Avg: 67.67 / Max: 67.71Min: 52.9 / Avg: 52.92 / Max: 52.93Min: 96.78 / Avg: 96.86 / Max: 96.96

OpenVINO

This is a test of the Intel OpenVINO, a toolkit around neural networks, using its built-in benchmarking support and analyzing the throughput and latency for various models. Learn more via the OpenBenchmarking.org test page.

i9-11900K7700XOpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.2.devModel: Face Detection FP16 - Device: CPUAVX-512 OffAVX-512 On246810SE +/- 0.01, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.01, N = 32.602.953.607.441. (CXX) g++ options: -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -pie -ldl
i9-11900K7700XOpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.2.devModel: Face Detection FP16 - Device: CPUAVX-512 OffAVX-512 On3691215Min: 2.58 / Avg: 2.6 / Max: 2.61Min: 2.95 / Avg: 2.95 / Max: 2.96Min: 3.59 / Avg: 3.6 / Max: 3.6Min: 7.43 / Avg: 7.44 / Max: 7.451. (CXX) g++ options: -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -pie -ldl

i9-11900K7700XOpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.2.devModel: Face Detection FP16 - Device: CPUAVX-512 OffAVX-512 On30060090012001500SE +/- 4.24, N = 3SE +/- 1.26, N = 3SE +/- 0.74, N = 3SE +/- 0.49, N = 31525.181352.081110.97536.891. (CXX) g++ options: -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -pie -ldl
i9-11900K7700XOpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.2.devModel: Face Detection FP16 - Device: CPUAVX-512 OffAVX-512 On30060090012001500Min: 1520.21 / Avg: 1525.18 / Max: 1533.61Min: 1350.58 / Avg: 1352.08 / Max: 1354.59Min: 1109.49 / Avg: 1110.97 / Max: 1111.85Min: 536.18 / Avg: 536.89 / Max: 537.841. (CXX) g++ options: -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -pie -ldl

i9-11900K7700XOpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.2.devModel: Face Detection FP16-INT8 - Device: CPUAVX-512 OffAVX-512 On48121620SE +/- 0.02, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.05, N = 34.8812.176.9314.471. (CXX) g++ options: -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -pie -ldl
i9-11900K7700XOpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.2.devModel: Face Detection FP16-INT8 - Device: CPUAVX-512 OffAVX-512 On48121620Min: 4.86 / Avg: 4.88 / Max: 4.91Min: 12.15 / Avg: 12.17 / Max: 12.2Min: 6.9 / Avg: 6.93 / Max: 6.94Min: 14.42 / Avg: 14.47 / Max: 14.581. (CXX) g++ options: -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -pie -ldl

i9-11900K7700XOpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.2.devModel: Face Detection FP16-INT8 - Device: CPUAVX-512 OffAVX-512 On2004006008001000SE +/- 3.19, N = 3SE +/- 0.43, N = 3SE +/- 0.81, N = 3SE +/- 0.92, N = 3817.17328.08577.23276.001. (CXX) g++ options: -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -pie -ldl
i9-11900K7700XOpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.2.devModel: Face Detection FP16-INT8 - Device: CPUAVX-512 OffAVX-512 On140280420560700Min: 810.9 / Avg: 817.17 / Max: 821.33Min: 327.33 / Avg: 328.08 / Max: 328.83Min: 576.22 / Avg: 577.23 / Max: 578.83Min: 274.17 / Avg: 276 / Max: 276.931. (CXX) g++ options: -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -pie -ldl

i9-11900K7700XOpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.2.devModel: Age Gender Recognition Retail 0013 FP16 - Device: CPUAVX-512 OffAVX-512 On5K10K15K20K25KSE +/- 34.03, N = 3SE +/- 54.72, N = 3SE +/- 6.83, N = 3SE +/- 14.09, N = 37956.789460.4511758.0723278.241. (CXX) g++ options: -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -pie -ldl
i9-11900K7700XOpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.2.devModel: Age Gender Recognition Retail 0013 FP16 - Device: CPUAVX-512 OffAVX-512 On4K8K12K16K20KMin: 7911 / Avg: 7956.78 / Max: 8023.29Min: 9379.38 / Avg: 9460.45 / Max: 9564.64Min: 11744.45 / Avg: 11758.07 / Max: 11765.74Min: 23251.59 / Avg: 23278.24 / Max: 23299.51. (CXX) g++ options: -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -pie -ldl

i9-11900K7700XOpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.2.devModel: Age Gender Recognition Retail 0013 FP16 - Device: CPUAVX-512 OffAVX-512 On0.2250.450.6750.91.125SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 31.000.840.680.341. (CXX) g++ options: -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -pie -ldl
i9-11900K7700XOpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.2.devModel: Age Gender Recognition Retail 0013 FP16 - Device: CPUAVX-512 OffAVX-512 On246810Min: 0.99 / Avg: 1 / Max: 1Min: 0.83 / Avg: 0.84 / Max: 0.84Min: 0.68 / Avg: 0.68 / Max: 0.68Min: 0.34 / Avg: 0.34 / Max: 0.341. (CXX) g++ options: -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -pie -ldl

i9-11900K7700XOpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.2.devModel: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPUAVX-512 OffAVX-512 On7K14K21K28K35KSE +/- 47.04, N = 3SE +/- 387.31, N = 15SE +/- 51.72, N = 3SE +/- 36.14, N = 314973.8822962.1019638.3832722.351. (CXX) g++ options: -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -pie -ldl
i9-11900K7700XOpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.2.devModel: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPUAVX-512 OffAVX-512 On6K12K18K24K30KMin: 14923.91 / Avg: 14973.88 / Max: 15067.91Min: 20238.11 / Avg: 22962.1 / Max: 25365.44Min: 19544.9 / Avg: 19638.38 / Max: 19723.49Min: 32660.41 / Avg: 32722.35 / Max: 32785.581. (CXX) g++ options: -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -pie -ldl

i9-11900K7700XOpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.2.devModel: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPUAVX-512 OffAVX-512 On0.11930.23860.35790.47720.5965SE +/- 0.00, N = 3SE +/- 0.01, N = 15SE +/- 0.00, N = 3SE +/- 0.00, N = 30.530.350.400.241. (CXX) g++ options: -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -pie -ldl
i9-11900K7700XOpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.2.devModel: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPUAVX-512 OffAVX-512 On246810Min: 0.53 / Avg: 0.53 / Max: 0.53Min: 0.31 / Avg: 0.35 / Max: 0.39Min: 0.4 / Avg: 0.4 / Max: 0.41Min: 0.24 / Avg: 0.24 / Max: 0.241. (CXX) g++ options: -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -pie -ldl

i9-11900K7700XOpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.2.devModel: Person Detection FP16 - Device: CPUAVX-512 OffAVX-512 On0.92931.85862.78793.71724.6465SE +/- 0.01, N = 3SE +/- 0.00, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 31.541.782.294.131. (CXX) g++ options: -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -pie -ldl
i9-11900K7700XOpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.2.devModel: Person Detection FP16 - Device: CPUAVX-512 OffAVX-512 On246810Min: 1.53 / Avg: 1.54 / Max: 1.55Min: 1.77 / Avg: 1.78 / Max: 1.78Min: 2.27 / Avg: 2.29 / Max: 2.3Min: 4.11 / Avg: 4.13 / Max: 4.141. (CXX) g++ options: -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -pie -ldl

i9-11900K7700XOpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.2.devModel: Person Detection FP16 - Device: CPUAVX-512 OffAVX-512 On6001200180024003000SE +/- 7.35, N = 3SE +/- 7.01, N = 3SE +/- 4.31, N = 3SE +/- 1.79, N = 32563.452227.691739.27965.051. (CXX) g++ options: -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -pie -ldl
i9-11900K7700XOpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.2.devModel: Person Detection FP16 - Device: CPUAVX-512 OffAVX-512 On400800120016002000Min: 2548.75 / Avg: 2563.45 / Max: 2571.28Min: 2218.16 / Avg: 2227.69 / Max: 2241.37Min: 1730.72 / Avg: 1739.27 / Max: 1744.43Min: 961.53 / Avg: 965.05 / Max: 967.381. (CXX) g++ options: -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -pie -ldl

i9-11900K7700XOpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.2.devModel: Person Detection FP32 - Device: CPUAVX-512 OffAVX-512 On0.91131.82262.73393.64524.5565SE +/- 0.01, N = 3SE +/- 0.00, N = 3SE +/- 0.01, N = 3SE +/- 0.04, N = 31.541.772.264.051. (CXX) g++ options: -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -pie -ldl
i9-11900K7700XOpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.2.devModel: Person Detection FP32 - Device: CPUAVX-512 OffAVX-512 On246810Min: 1.53 / Avg: 1.54 / Max: 1.55Min: 1.76 / Avg: 1.77 / Max: 1.77Min: 2.25 / Avg: 2.26 / Max: 2.27Min: 3.99 / Avg: 4.05 / Max: 4.131. (CXX) g++ options: -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -pie -ldl

i9-11900K7700XOpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.2.devModel: Person Detection FP32 - Device: CPUAVX-512 OffAVX-512 On6001200180024003000SE +/- 9.17, N = 3SE +/- 8.02, N = 3SE +/- 4.62, N = 3SE +/- 9.62, N = 32563.872244.251753.08984.601. (CXX) g++ options: -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -pie -ldl
i9-11900K7700XOpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.2.devModel: Person Detection FP32 - Device: CPUAVX-512 OffAVX-512 On400800120016002000Min: 2550.94 / Avg: 2563.87 / Max: 2581.59Min: 2233.07 / Avg: 2244.25 / Max: 2259.79Min: 1745.23 / Avg: 1753.08 / Max: 1761.23Min: 966.67 / Avg: 984.6 / Max: 999.61. (CXX) g++ options: -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -pie -ldl

i9-11900K7700XOpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.2.devModel: Weld Porosity Detection FP16-INT8 - Device: CPUAVX-512 OffAVX-512 On30060090012001500SE +/- 2.18, N = 3SE +/- 4.58, N = 3SE +/- 0.40, N = 3SE +/- 0.36, N = 3533.791242.45695.981496.661. (CXX) g++ options: -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -pie -ldl
i9-11900K7700XOpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.2.devModel: Weld Porosity Detection FP16-INT8 - Device: CPUAVX-512 OffAVX-512 On30060090012001500Min: 531.3 / Avg: 533.79 / Max: 538.13Min: 1237.1 / Avg: 1242.45 / Max: 1251.57Min: 695.18 / Avg: 695.98 / Max: 696.41Min: 1495.99 / Avg: 1496.66 / Max: 1497.221. (CXX) g++ options: -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -pie -ldl

i9-11900K7700XOpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.2.devModel: Weld Porosity Detection FP16-INT8 - Device: CPUAVX-512 OffAVX-512 On48121620SE +/- 0.06, N = 3SE +/- 0.02, N = 3SE +/- 0.01, N = 3SE +/- 0.00, N = 314.986.4211.495.341. (CXX) g++ options: -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -pie -ldl
i9-11900K7700XOpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.2.devModel: Weld Porosity Detection FP16-INT8 - Device: CPUAVX-512 OffAVX-512 On48121620Min: 14.86 / Avg: 14.98 / Max: 15.05Min: 6.38 / Avg: 6.42 / Max: 6.45Min: 11.48 / Avg: 11.49 / Max: 11.5Min: 5.34 / Avg: 5.34 / Max: 5.341. (CXX) g++ options: -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -pie -ldl

i9-11900K7700XOpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.2.devModel: Weld Porosity Detection FP16 - Device: CPUAVX-512 OffAVX-512 On160320480640800SE +/- 0.05, N = 3SE +/- 1.00, N = 3SE +/- 0.29, N = 3SE +/- 0.39, N = 3252.69321.51344.45739.931. (CXX) g++ options: -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -pie -ldl
i9-11900K7700XOpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.2.devModel: Weld Porosity Detection FP16 - Device: CPUAVX-512 OffAVX-512 On130260390520650Min: 252.59 / Avg: 252.69 / Max: 252.76Min: 319.55 / Avg: 321.51 / Max: 322.81Min: 343.88 / Avg: 344.45 / Max: 344.86Min: 739.16 / Avg: 739.93 / Max: 740.441. (CXX) g++ options: -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -pie -ldl

i9-11900K7700XOpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.2.devModel: Weld Porosity Detection FP16 - Device: CPUAVX-512 OffAVX-512 On612182430SE +/- 0.00, N = 3SE +/- 0.08, N = 3SE +/- 0.01, N = 3SE +/- 0.00, N = 315.8124.8611.605.401. (CXX) g++ options: -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -pie -ldl
i9-11900K7700XOpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.2.devModel: Weld Porosity Detection FP16 - Device: CPUAVX-512 OffAVX-512 On612182430Min: 15.81 / Avg: 15.81 / Max: 15.82Min: 24.76 / Avg: 24.86 / Max: 25.02Min: 11.59 / Avg: 11.6 / Max: 11.62Min: 5.4 / Avg: 5.4 / Max: 5.411. (CXX) g++ options: -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -pie -ldl

i9-11900K7700XOpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.2.devModel: Vehicle Detection FP16-INT8 - Device: CPUAVX-512 OffAVX-512 On2004006008001000SE +/- 1.58, N = 3SE +/- 1.77, N = 3SE +/- 0.95, N = 3SE +/- 1.60, N = 3310.38630.58478.69954.701. (CXX) g++ options: -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -pie -ldl
i9-11900K7700XOpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.2.devModel: Vehicle Detection FP16-INT8 - Device: CPUAVX-512 OffAVX-512 On2004006008001000Min: 308.4 / Avg: 310.38 / Max: 313.51Min: 627.3 / Avg: 630.58 / Max: 633.36Min: 477 / Avg: 478.69 / Max: 480.3Min: 951.51 / Avg: 954.7 / Max: 956.451. (CXX) g++ options: -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -pie -ldl

i9-11900K7700XOpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.2.devModel: Vehicle Detection FP16-INT8 - Device: CPUAVX-512 OffAVX-512 On3691215SE +/- 0.06, N = 3SE +/- 0.02, N = 3SE +/- 0.02, N = 3SE +/- 0.01, N = 312.886.338.354.191. (CXX) g++ options: -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -pie -ldl
i9-11900K7700XOpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.2.devModel: Vehicle Detection FP16-INT8 - Device: CPUAVX-512 OffAVX-512 On48121620Min: 12.75 / Avg: 12.88 / Max: 12.96Min: 6.3 / Avg: 6.33 / Max: 6.36Min: 8.32 / Avg: 8.35 / Max: 8.38Min: 4.18 / Avg: 4.19 / Max: 4.21. (CXX) g++ options: -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -pie -ldl

i9-11900K7700XOpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.2.devModel: Vehicle Detection FP16 - Device: CPUAVX-512 OffAVX-512 On100200300400500SE +/- 1.44, N = 3SE +/- 0.25, N = 3SE +/- 0.29, N = 3SE +/- 2.17, N = 3141.30109.09278.69463.871. (CXX) g++ options: -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -pie -ldl
i9-11900K7700XOpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.2.devModel: Vehicle Detection FP16 - Device: CPUAVX-512 OffAVX-512 On80160240320400Min: 138.68 / Avg: 141.3 / Max: 143.63Min: 108.73 / Avg: 109.09 / Max: 109.56Min: 278.19 / Avg: 278.69 / Max: 279.19Min: 460.87 / Avg: 463.87 / Max: 468.081. (CXX) g++ options: -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -pie -ldl

i9-11900K7700XOpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.2.devModel: Vehicle Detection FP16 - Device: CPUAVX-512 OffAVX-512 On816243240SE +/- 0.29, N = 3SE +/- 0.08, N = 3SE +/- 0.01, N = 3SE +/- 0.04, N = 328.2936.6414.348.621. (CXX) g++ options: -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -pie -ldl
i9-11900K7700XOpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.2.devModel: Vehicle Detection FP16 - Device: CPUAVX-512 OffAVX-512 On816243240Min: 27.82 / Avg: 28.29 / Max: 28.82Min: 36.48 / Avg: 36.64 / Max: 36.76Min: 14.32 / Avg: 14.34 / Max: 14.37Min: 8.54 / Avg: 8.62 / Max: 8.671. (CXX) g++ options: -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -pie -ldl

i9-11900K7700XOpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.2.devModel: Person Vehicle Bike Detection FP16 - Device: CPUAVX-512 OffAVX-512 On2004006008001000SE +/- 3.32, N = 6SE +/- 2.59, N = 7SE +/- 5.34, N = 3SE +/- 1.38, N = 3325.95285.75483.47889.691. (CXX) g++ options: -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -pie -ldl
i9-11900K7700XOpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.2.devModel: Person Vehicle Bike Detection FP16 - Device: CPUAVX-512 OffAVX-512 On160320480640800Min: 318.08 / Avg: 325.95 / Max: 339.21Min: 282.16 / Avg: 285.75 / Max: 301.23Min: 477.51 / Avg: 483.47 / Max: 494.13Min: 886.99 / Avg: 889.69 / Max: 891.521. (CXX) g++ options: -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -pie -ldl

i9-11900K7700XOpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.2.devModel: Person Vehicle Bike Detection FP16 - Device: CPUAVX-512 OffAVX-512 On48121620SE +/- 0.12, N = 6SE +/- 0.12, N = 7SE +/- 0.09, N = 3SE +/- 0.01, N = 312.2613.998.264.491. (CXX) g++ options: -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -pie -ldl
i9-11900K7700XOpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.2.devModel: Person Vehicle Bike Detection FP16 - Device: CPUAVX-512 OffAVX-512 On48121620Min: 11.77 / Avg: 12.26 / Max: 12.56Min: 13.26 / Avg: 13.99 / Max: 14.16Min: 8.08 / Avg: 8.26 / Max: 8.37Min: 4.48 / Avg: 4.49 / Max: 4.51. (CXX) g++ options: -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -pie -ldl

i9-11900K7700XOpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.2.devModel: Machine Translation EN To DE FP16 - Device: CPUAVX-512 OffAVX-512 On20406080100SE +/- 0.04, N = 3SE +/- 0.18, N = 3SE +/- 0.05, N = 3SE +/- 0.23, N = 331.7035.5537.5476.621. (CXX) g++ options: -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -pie -ldl
i9-11900K7700XOpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.2.devModel: Machine Translation EN To DE FP16 - Device: CPUAVX-512 OffAVX-512 On1530456075Min: 31.65 / Avg: 31.7 / Max: 31.78Min: 35.21 / Avg: 35.55 / Max: 35.83Min: 37.45 / Avg: 37.54 / Max: 37.61Min: 76.19 / Avg: 76.62 / Max: 76.951. (CXX) g++ options: -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -pie -ldl

i9-11900K7700XOpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.2.devModel: Machine Translation EN To DE FP16 - Device: CPUAVX-512 OffAVX-512 On306090120150SE +/- 0.14, N = 3SE +/- 0.59, N = 3SE +/- 0.14, N = 3SE +/- 0.16, N = 3126.09112.48106.4852.181. (CXX) g++ options: -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -pie -ldl
i9-11900K7700XOpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.2.devModel: Machine Translation EN To DE FP16 - Device: CPUAVX-512 OffAVX-512 On20406080100Min: 125.81 / Avg: 126.09 / Max: 126.28Min: 111.57 / Avg: 112.48 / Max: 113.59Min: 106.28 / Avg: 106.48 / Max: 106.74Min: 51.95 / Avg: 52.18 / Max: 52.481. (CXX) g++ options: -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -pie -ldl

ONNX Runtime

ONNX Runtime is developed by Microsoft and partners as a open-source, cross-platform, high performance machine learning inferencing and training accelerator. This test profile runs the ONNX Runtime with various models available from the ONNX Zoo. Learn more via the OpenBenchmarking.org test page.

i9-11900K7700XOpenBenchmarking.orgInferences Per Minute, More Is BetterONNX Runtime 1.11Model: fcn-resnet101-11 - Device: CPU - Executor: ParallelAVX-512 OffAVX-512 On20406080100SE +/- 0.33, N = 3SE +/- 0.44, N = 3SE +/- 0.17, N = 3SE +/- 0.29, N = 3727393961. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt
i9-11900K7700XOpenBenchmarking.orgInferences Per Minute, More Is BetterONNX Runtime 1.11Model: fcn-resnet101-11 - Device: CPU - Executor: ParallelAVX-512 OffAVX-512 On20406080100Min: 71 / Avg: 71.67 / Max: 72Min: 72.5 / Avg: 73.33 / Max: 74Min: 92.5 / Avg: 92.67 / Max: 93Min: 95.5 / Avg: 96 / Max: 96.51. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

i9-11900K7700XOpenBenchmarking.orgInferences Per Minute, More Is BetterONNX Runtime 1.11Model: GPT-2 - Device: CPU - Executor: StandardAVX-512 OffAVX-512 On2K4K6K8K10KSE +/- 4.16, N = 3SE +/- 9.16, N = 3SE +/- 60.58, N = 12SE +/- 57.70, N = 369546962837591511. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt
i9-11900K7700XOpenBenchmarking.orgInferences Per Minute, More Is BetterONNX Runtime 1.11Model: GPT-2 - Device: CPU - Executor: StandardAVX-512 OffAVX-512 On16003200480064008000Min: 6945.5 / Avg: 6953.5 / Max: 6959.5Min: 6947.5 / Avg: 6962.17 / Max: 6979Min: 8245 / Avg: 8375.25 / Max: 8945.5Min: 9035.5 / Avg: 9150.83 / Max: 92121. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

i9-11900K7700XOpenBenchmarking.orgInferences Per Minute, More Is BetterONNX Runtime 1.11Model: GPT-2 - Device: CPU - Executor: ParallelAVX-512 OffAVX-512 On2K4K6K8K10KSE +/- 1.76, N = 3SE +/- 3.18, N = 3SE +/- 63.02, N = 8SE +/- 49.86, N = 355575545728578051. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt
i9-11900K7700XOpenBenchmarking.orgInferences Per Minute, More Is BetterONNX Runtime 1.11Model: GPT-2 - Device: CPU - Executor: ParallelAVX-512 OffAVX-512 On14002800420056007000Min: 5555 / Avg: 5557 / Max: 5560.5Min: 5541 / Avg: 5544.67 / Max: 5551Min: 7119.5 / Avg: 7284.94 / Max: 7658Min: 7713.5 / Avg: 7805.17 / Max: 78851. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

i9-11900K7700XOpenBenchmarking.orgInferences Per Minute, More Is BetterONNX Runtime 1.11Model: ArcFace ResNet-100 - Device: CPU - Executor: ParallelAVX-512 OffAVX-512 On400800120016002000SE +/- 1.76, N = 3SE +/- 4.33, N = 3SE +/- 4.54, N = 3SE +/- 5.21, N = 312781368155816691. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt
i9-11900K7700XOpenBenchmarking.orgInferences Per Minute, More Is BetterONNX Runtime 1.11Model: ArcFace ResNet-100 - Device: CPU - Executor: ParallelAVX-512 OffAVX-512 On30060090012001500Min: 1274.5 / Avg: 1277.83 / Max: 1280.5Min: 1360.5 / Avg: 1368 / Max: 1375.5Min: 1548.5 / Avg: 1557.5 / Max: 1563Min: 1660 / Avg: 1669.33 / Max: 16781. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

Numpy Benchmark

This is a test to obtain the general Numpy performance. Learn more via the OpenBenchmarking.org test page.

i9-11900K7700XOpenBenchmarking.orgScore, More Is BetterNumpy BenchmarkAVX-512 OffAVX-512 On2004006008001000SE +/- 0.90, N = 3SE +/- 0.87, N = 3SE +/- 1.60, N = 3SE +/- 2.21, N = 3575.79631.86829.92912.85
i9-11900K7700XOpenBenchmarking.orgScore, More Is BetterNumpy BenchmarkAVX-512 OffAVX-512 On160320480640800Min: 574.03 / Avg: 575.79 / Max: 577.02Min: 630.43 / Avg: 631.86 / Max: 633.42Min: 828.31 / Avg: 829.92 / Max: 833.11Min: 908.74 / Avg: 912.85 / Max: 916.31

CPU Peak Freq (Highest CPU Core Frequency) Monitor

i9-11900K7700XOpenBenchmarking.orgMegahertzCPU Peak Freq (Highest CPU Core Frequency) MonitorPhoronix Test Suite System MonitoringAVX-512 OffAVX-512 On10002000300040005000Min: 3500 / Avg: 4781.84 / Max: 5621Min: 2700 / Avg: 4722.22 / Max: 5323Min: 4965 / Avg: 5296.02 / Max: 5586Min: 5020 / Avg: 5357.92 / Max: 5579

CPU Power Consumption Monitor

i9-11900K7700XOpenBenchmarking.orgWattsCPU Power Consumption MonitorPhoronix Test Suite System MonitoringAVX-512 OffAVX-512 On50100150200250Min: 6.36 / Avg: 173.58 / Max: 251.93Min: 6.3 / Avg: 192.29 / Max: 280.23Min: 11.01 / Avg: 122.24 / Max: 145.73Min: 10.75 / Avg: 118.63 / Max: 145.61

129 Results Shown

AI Benchmark Alpha:
  Device Inference Score
  Device Training Score
  Device AI Score
Neural Magic DeepSparse:
  NLP Text Classification, BERT base uncased SST2 - Synchronous Single-Stream:
    items/sec
    ms/batch
  NLP Text Classification, BERT base uncased SST2 - Asynchronous Multi-Stream:
    items/sec
    ms/batch
  NLP Text Classification, DistilBERT mnli - Synchronous Single-Stream:
    items/sec
    ms/batch
  NLP Text Classification, DistilBERT mnli - Asynchronous Multi-Stream:
    items/sec
    ms/batch
  CV Classification, ResNet-50 ImageNet - Synchronous Single-Stream:
    items/sec
    ms/batch
  CV Classification, ResNet-50 ImageNet - Asynchronous Multi-Stream:
    items/sec
    ms/batch
  NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Synchronous Single-Stream:
    items/sec
    ms/batch
  NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Asynchronous Multi-Stream:
    items/sec
    ms/batch
  CV Detection,YOLOv5s COCO - Synchronous Single-Stream:
    items/sec
    ms/batch
  CV Detection,YOLOv5s COCO - Asynchronous Multi-Stream:
    items/sec
    ms/batch
OpenRadioss
LeelaChessZero
simdjson:
  PartialTweets
  LargeRand
  Kostya
  DistinctUserID
  TopTweet
dav1d:
  Summer Nature 1080p
  Summer Nature 4K
  Chimera 1080p
  Chimera 1080p 10-bit
Embree:
  Pathtracer ISPC - Asian Dragon
  Pathtracer ISPC - Asian Dragon Obj
  Pathtracer ISPC - Crown
OpenVKL
OSPRay:
  gravity_spheres_volume/dim_512/ao/real_time
  gravity_spheres_volume/dim_512/scivis/real_time
  gravity_spheres_volume/dim_512/pathtracer/real_time
  particle_volume/pathtracer/real_time
OSPRay Studio:
  1 - 1080p - 1 - Path Tracer
  1 - 1080p - 16 - Path Tracer
  1 - 1080p - 32 - Path Tracer
  1 - 4K - 1 - Path Tracer
  1 - 4K - 16 - Path Tracer
  1 - 4K - 32 - Path Tracer
  3 - 1080p - 1 - Path Tracer
  3 - 1080p - 16 - Path Tracer
  3 - 1080p - 32 - Path Tracer
  3 - 4K - 1 - Path Tracer
  3 - 4K - 16 - Path Tracer
  3 - 4K - 32 - Path Tracer
oneDNN:
  Convolution Batch Shapes Auto - f32 - CPU
  Convolution Batch Shapes Auto - u8s8f32 - CPU
  Deconvolution Batch shapes_1d - u8s8f32 - CPU
  Deconvolution Batch shapes_3d - f32 - CPU
  Deconvolution Batch shapes_3d - u8s8f32 - CPU
  IP Shapes 1D - u8s8f32 - CPU
  IP Shapes 3D - f32 - CPU
  Matrix Multiply Batch Shapes Transformer - f32 - CPU
  Matrix Multiply Batch Shapes Transformer - u8s8f32 - CPU
  Recurrent Neural Network Training - f32 - CPU
  Recurrent Neural Network Training - u8s8f32 - CPU
  Recurrent Neural Network Training - bf16bf16bf16 - CPU
  Recurrent Neural Network Inference - f32 - CPU
  Recurrent Neural Network Inference - u8s8f32 - CPU
  Recurrent Neural Network Inference - bf16bf16bf16 - CPU
Cpuminer-Opt:
  Quad SHA-256, Pyrite
  Myriad-Groestl
  Blake-2 S
  Garlicoin
  Skeincoin
  LBC, LBRY Credits
Mobile Neural Network:
  squeezenetv1.1
  resnet-v2-50
  SqueezeNetV1.0
  inception-v3
NCNN
TensorFlow:
  CPU - 16 - VGG-16
  CPU - 16 - ResNet-50
  CPU - 16 - AlexNet
  CPU - 16 - GoogLeNet
  CPU - 32 - VGG-16
  CPU - 32 - ResNet-50
  CPU - 32 - AlexNet
  CPU - 32 - GoogLeNet
  CPU - 64 - VGG-16
  CPU - 64 - ResNet-50
  CPU - 64 - AlexNet
  CPU - 64 - GoogLeNet
  CPU - 256 - VGG-16
  CPU - 256 - ResNet-50
  CPU - 256 - AlexNet
  CPU - 256 - GoogLeNet
  CPU - 512 - AlexNet
  CPU - 512 - GoogLeNet
OpenVINO:
  Face Detection FP16 - CPU:
    FPS
    ms
  Face Detection FP16-INT8 - CPU:
    FPS
    ms
  Age Gender Recognition Retail 0013 FP16 - CPU:
    FPS
    ms
  Age Gender Recognition Retail 0013 FP16-INT8 - CPU:
    FPS
    ms
  Person Detection FP16 - CPU:
    FPS
    ms
  Person Detection FP32 - CPU:
    FPS
    ms
  Weld Porosity Detection FP16-INT8 - CPU:
    FPS
    ms
  Weld Porosity Detection FP16 - CPU:
    FPS
    ms
  Vehicle Detection FP16-INT8 - CPU:
    FPS
    ms
  Vehicle Detection FP16 - CPU:
    FPS
    ms
  Person Vehicle Bike Detection FP16 - CPU:
    FPS
    ms
  Machine Translation EN To DE FP16 - CPU:
    FPS
    ms
ONNX Runtime:
  fcn-resnet101-11 - CPU - Parallel
  GPT-2 - CPU - Standard
  GPT-2 - CPU - Parallel
  ArcFace ResNet-100 - CPU - Parallel
Numpy Benchmark
CPU Peak Freq (Highest CPU Core Frequency) Monitor:
  Phoronix Test Suite System Monitoring:
    Megahertz
    Watts