AVX-512 Core i9 Intel Rocket Lake

Benchmarks for a future article. Intel Core i9-11900K testing with a ASUS ROG MAXIMUS XIII HERO (1402 BIOS) and ASUS Intel RKL GT1 31GB on Ubuntu 22.10 via the Phoronix Test Suite.

Compare your own system(s) to this result file with the Phoronix Test Suite by running the command: phoronix-test-suite benchmark 2210210-NE-AVX512ROC09
Jump To Table - Results

View

Do Not Show Noisy Results
Do Not Show Results With Incomplete Data
Do Not Show Results With Little Change/Spread
List Notable Results
Show Result Confidence Charts

Limit displaying results to tests within:

C/C++ Compiler Tests 2 Tests
CPU Massive 6 Tests
Creator Workloads 8 Tests
Cryptocurrency Benchmarks, CPU Mining Tests 2 Tests
Cryptography 2 Tests
Game Development 2 Tests
HPC - High Performance Computing 14 Tests
Machine Learning 11 Tests
Molecular Dynamics 2 Tests
Multi-Core 10 Tests
NVIDIA GPU Compute 3 Tests
Intel oneAPI 7 Tests
OpenMPI Tests 3 Tests
Python Tests 6 Tests
Raytracing 2 Tests
Renderers 2 Tests
Scientific Computing 2 Tests
Server CPU Tests 4 Tests

Statistics

Show Overall Harmonic Mean(s)
Show Overall Geometric Mean
Show Geometric Means Per-Suite/Category
Show Wins / Losses Counts (Pie Chart)
Normalize Results
Remove Outliers Before Calculating Averages

Graph Settings

Force Line Graphs Where Applicable
Convert To Scalar Where Applicable
Prefer Vertical Bar Graphs
No Box Plots
On Line Graphs With Missing Data, Connect The Line Gaps

Multi-Way Comparison

Condense Comparison
Transpose Comparison

Table

Show Detailed System Result Table

Run Management

Highlight
Result
Hide
Result
Result
Identifier
Performance Per
Dollar
Date
Run
  Test
  Duration
i9-11900K: AVX-512 On
October 18 2022
  1 Day, 1 Hour, 48 Minutes
i9-11900K: AVX-512 Off
October 19 2022
  1 Day, 2 Hours, 28 Minutes
i9-11900K: AVX-512 On 512
October 20 2022
  1 Day, 1 Hour, 45 Minutes
Invert Hiding All Results Option
  1 Day, 2 Hours

Only show results where is faster than
Only show results matching title/arguments (delimit multiple options with a comma):
Do not show results matching title/arguments (delimit multiple options with a comma):


AVX-512 Core i9 Intel Rocket LakeOpenBenchmarking.orgPhoronix Test SuiteIntel Core i9-11900K @ 5.10GHz (8 Cores / 16 Threads)ASUS ROG MAXIMUS XIII HERO (1402 BIOS)Intel Tiger Lake-H32GB2000GB Corsair Force MP600 + 32GB Flash DriveASUS Intel RKL GT1 31GB (1300MHz)Intel Tiger Lake-H HD AudioASUS MG28U2 x Intel I225-V + Intel Wi-Fi 6 AX210/AX211/AX411Ubuntu 22.105.19.0-21-generic (x86_64)GNOME Shell 43.0X Server + Wayland4.6 Mesa 22.2.11.3.224GCC 12.2.0ext43840x2160ProcessorMotherboardChipsetMemoryDiskGraphicsAudioMonitorNetworkOSKernelDesktopDisplay ServerOpenGLVulkanCompilerFile-SystemScreen ResolutionAVX-512 Core I9 Intel Rocket Lake BenchmarksSystem Logs- Transparent Huge Pages: madvise- i9-11900K: AVX-512 On: CXXFLAGS="-O3 -march=native" CFLAGS="-O3 -march=native" - i9-11900K: AVX-512 Off: CXXFLAGS="-O3 -march=native -mno-avx512f" CFLAGS="-O3 -march=native -mno-avx512f" - i9-11900K: AVX-512 On 512: CXXFLAGS="-O3 -march=native -mprefer-vector-width=512" CFLAGS="-O3 -march=native -mprefer-vector-width=512" - --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-defaulted --enable-offload-targets=nvptx-none=/build/gcc-12-U8K4Qv/gcc-12-12.2.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-12-U8K4Qv/gcc-12-12.2.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v - Scaling Governor: intel_pstate performance (EPP: performance) - CPU Microcode: 0x54 - Thermald 2.5.1 - Python 3.10.7- itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Mitigation of Clear buffers; SMT vulnerable + retbleed: Mitigation of Enhanced IBRS + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Not affected

dav1d: Summer Nature 1080pdav1d: Summer Nature 4Kdav1d: Chimera 1080pdav1d: Chimera 1080p 10-bitopenvino: Face Detection FP16 - CPUopenvino: Face Detection FP16-INT8 - CPUopenvino: Age Gender Recognition Retail 0013 FP16 - CPUopenvino: Age Gender Recognition Retail 0013 FP16-INT8 - CPUopenvino: Person Detection FP16 - CPUopenvino: Person Detection FP32 - CPUopenvino: Weld Porosity Detection FP16-INT8 - CPUopenvino: Weld Porosity Detection FP16 - CPUopenvino: Vehicle Detection FP16-INT8 - CPUopenvino: Vehicle Detection FP16 - CPUopenvino: Person Vehicle Bike Detection FP16 - CPUopenvino: Machine Translation EN To DE FP16 - CPUembree: Pathtracer ISPC - Asian Dragonembree: Pathtracer ISPC - Asian Dragon Objembree: Pathtracer ISPC - Crownsimdjson: PartialTweetssimdjson: LargeRandsimdjson: Kostyasimdjson: DistinctUserIDsimdjson: TopTweetxmrig: Monero - 1Mxmrig: Wownero - 1Moidn: RT.hdr_alb_nrm.3840x2160oidn: RT.ldr_alb_nrm.3840x2160oidn: RTLightmap.hdr.4096x4096tensorflow: CPU - 16 - VGG-16tensorflow: CPU - 16 - ResNet-50tensorflow: CPU - 64 - ResNet-50tensorflow: CPU - 16 - AlexNettensorflow: CPU - 16 - GoogLeNettensorflow: CPU - 32 - VGG-16tensorflow: CPU - 32 - ResNet-50tensorflow: CPU - 32 - AlexNettensorflow: CPU - 32 - GoogLeNettensorflow: CPU - 64 - VGG-16tensorflow: CPU - 64 - AlexNettensorflow: CPU - 64 - GoogLeNettensorflow: CPU - 256 - VGG-16tensorflow: CPU - 256 - ResNet-50tensorflow: CPU - 256 - AlexNettensorflow: CPU - 256 - GoogLeNettensorflow: CPU - 512 - AlexNettensorflow: CPU - 512 - GoogLeNetonnx: yolov4 - CPU - Standardonnx: yolov4 - CPU - Parallelonnx: fcn-resnet101-11 - CPU - Standardonnx: fcn-resnet101-11 - CPU - Parallelonnx: super-resolution-10 - CPU - Standardonnx: super-resolution-10 - CPU - Parallelonnx: bertsquad-12 - CPU - Standardonnx: bertsquad-12 - CPU - Parallelonnx: GPT-2 - CPU - Standardonnx: GPT-2 - CPU - Parallelonnx: ArcFace ResNet-100 - CPU - Standardonnx: ArcFace ResNet-100 - CPU - Parallelopenvkl: vklBenchmark ISPCospray: gravity_spheres_volume/dim_512/ao/real_timeospray: gravity_spheres_volume/dim_512/scivis/real_timeospray: gravity_spheres_volume/dim_512/pathtracer/real_timeospray: particle_volume/ao/real_timeospray: particle_volume/scivis/real_timeospray: particle_volume/pathtracer/real_timedeepsparse: NLP Text Classification, BERT base uncased SST2 - Synchronous Single-Streamdeepsparse: NLP Text Classification, BERT base uncased SST2 - Asynchronous Multi-Streamdeepsparse: NLP Text Classification, DistilBERT mnli - Synchronous Single-Streamdeepsparse: NLP Text Classification, DistilBERT mnli - Asynchronous Multi-Streamdeepsparse: CV Classification, ResNet-50 ImageNet - Synchronous Single-Streamdeepsparse: CV Classification, ResNet-50 ImageNet - Asynchronous Multi-Streamdeepsparse: NLP Token Classification, BERT base uncased conll2003 - Synchronous Single-Streamdeepsparse: NLP Token Classification, BERT base uncased conll2003 - Asynchronous Multi-Streamdeepsparse: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Synchronous Single-Streamdeepsparse: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Asynchronous Multi-Streamdeepsparse: CV Detection,YOLOv5s COCO - Synchronous Single-Streamdeepsparse: CV Detection,YOLOv5s COCO - Asynchronous Multi-Streamdeepsparse: NLP Document Classification, oBERT base uncased on IMDB - Synchronous Single-Streamdeepsparse: NLP Document Classification, oBERT base uncased on IMDB - Asynchronous Multi-Streamcpuminer-opt: Triple SHA-256, Onecoincpuminer-opt: Magicpuminer-opt: Ringcoincpuminer-opt: Deepcoincpuminer-opt: Quad SHA-256, Pyritecpuminer-opt: Garlicoincpuminer-opt: Skeincoincpuminer-opt: LBC, LBRY Creditscpuminer-opt: Myriad-Groestlcpuminer-opt: Blake-2 Scpuminer-opt: x25xlczero: BLASlczero: Eigengromacs: MPI CPU - water_GMX50_bareai-benchmark: Device Inference Scoreai-benchmark: Device Training Scoreai-benchmark: Device AI Scorenumpy: ospray-studio: 1 - 1080p - 1 - Path Tracerospray-studio: 1 - 1080p - 16 - Path Tracerospray-studio: 1 - 1080p - 32 - Path Tracerospray-studio: 1 - 4K - 1 - Path Tracerospray-studio: 1 - 4K - 16 - Path Tracerospray-studio: 1 - 4K - 32 - Path Tracerospray-studio: 3 - 1080p - 1 - Path Tracerospray-studio: 3 - 1080p - 16 - Path Tracerospray-studio: 3 - 1080p - 32 - Path Tracerospray-studio: 3 - 4K - 1 - Path Tracerospray-studio: 3 - 4K - 16 - Path Tracerospray-studio: 3 - 4K - 32 - Path Traceronednn: Convolution Batch Shapes Auto - f32 - CPUonednn: Convolution Batch Shapes Auto - u8s8f32 - CPUonednn: Convolution Batch Shapes Auto - bf16bf16bf16 - CPUonednn: Deconvolution Batch shapes_1d - f32 - CPUonednn: Deconvolution Batch shapes_1d - u8s8f32 - CPUonednn: Deconvolution Batch shapes_1d - bf16bf16bf16 - CPUonednn: Deconvolution Batch shapes_3d - f32 - CPUonednn: Deconvolution Batch shapes_3d - u8s8f32 - CPUonednn: Deconvolution Batch shapes_3d - bf16bf16bf16 - CPUonednn: IP Shapes 1D - f32 - CPUonednn: IP Shapes 1D - u8s8f32 - CPUonednn: IP Shapes 1D - bf16bf16bf16 - CPUonednn: IP Shapes 3D - f32 - CPUonednn: IP Shapes 3D - u8s8f32 - CPUonednn: IP Shapes 3D - bf16bf16bf16 - CPUonednn: Matrix Multiply Batch Shapes Transformer - f32 - CPUonednn: Matrix Multiply Batch Shapes Transformer - u8s8f32 - CPUonednn: Matrix Multiply Batch Shapes Transformer - bf16bf16bf16 - CPUonednn: Recurrent Neural Network Training - f32 - CPUonednn: Recurrent Neural Network Training - u8s8f32 - CPUonednn: Recurrent Neural Network Training - bf16bf16bf16 - CPUonednn: Recurrent Neural Network Inference - f32 - CPUonednn: Recurrent Neural Network Inference - u8s8f32 - CPUonednn: Recurrent Neural Network Inference - bf16bf16bf16 - CPUmnn: nasnetmnn: mobilenetV3mnn: squeezenetv1.1mnn: resnet-v2-50mnn: SqueezeNetV1.0mnn: MobileNetV2_224mnn: mobilenet-v1-1.0mnn: inception-v3ncnn: CPU - mobilenetncnn: CPU-v2-v2 - mobilenet-v2ncnn: CPU-v3-v3 - mobilenet-v3ncnn: CPU - shufflenet-v2ncnn: CPU - mnasnetncnn: CPU - efficientnet-b0ncnn: CPU - blazefacencnn: CPU - googlenetncnn: CPU - vgg16ncnn: CPU - resnet18ncnn: CPU - alexnetncnn: CPU - resnet50ncnn: CPU - yolov4-tinyncnn: CPU - squeezenet_ssdncnn: CPU - regnety_400mncnn: CPU - vision_transformerncnn: CPU - FastestDettnn: CPU - DenseNettnn: CPU - MobileNet v2tnn: CPU - SqueezeNet v1.1tnn: CPU - SqueezeNet v2openvino: Face Detection FP16 - CPUopenvino: Face Detection FP16-INT8 - CPUopenvino: Age Gender Recognition Retail 0013 FP16 - CPUopenvino: Age Gender Recognition Retail 0013 FP16-INT8 - CPUopenvino: Person Detection FP16 - CPUopenvino: Person Detection FP32 - CPUopenvino: Weld Porosity Detection FP16-INT8 - CPUopenvino: Weld Porosity Detection FP16 - CPUopenvino: Vehicle Detection FP16-INT8 - CPUopenvino: Vehicle Detection FP16 - CPUopenvino: Person Vehicle Bike Detection FP16 - CPUopenvino: Machine Translation EN To DE FP16 - CPUdeepsparse: NLP Text Classification, BERT base uncased SST2 - Synchronous Single-Streamdeepsparse: NLP Text Classification, BERT base uncased SST2 - Asynchronous Multi-Streamdeepsparse: NLP Text Classification, DistilBERT mnli - Synchronous Single-Streamdeepsparse: NLP Text Classification, DistilBERT mnli - Asynchronous Multi-Streamdeepsparse: CV Classification, ResNet-50 ImageNet - Synchronous Single-Streamdeepsparse: CV Classification, ResNet-50 ImageNet - Asynchronous Multi-Streamdeepsparse: NLP Token Classification, BERT base uncased conll2003 - Synchronous Single-Streamdeepsparse: NLP Token Classification, BERT base uncased conll2003 - Asynchronous Multi-Streamdeepsparse: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Synchronous Single-Streamdeepsparse: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Asynchronous Multi-Streamdeepsparse: CV Detection,YOLOv5s COCO - Synchronous Single-Streamdeepsparse: CV Detection,YOLOv5s COCO - Asynchronous Multi-Streamdeepsparse: NLP Document Classification, oBERT base uncased on IMDB - Synchronous Single-Streamdeepsparse: NLP Document Classification, oBERT base uncased on IMDB - Asynchronous Multi-Streamopenradioss: Bird Strike on Windshieldopenradioss: Rubber O-Ring Seal Installationopenradioss: Cell Phone Drop Testopenradioss: Bumper Beamopenradioss: INIVOL and Fluid Structure Interaction Drop Containeropenfoam: drivaerFastback, Small Mesh Size - Mesh Timeopenfoam: drivaerFastback, Small Mesh Size - Execution Timei9-11900K AVX-512 On AVX-512 Off AVX-512 On 512894.73207.14734.61510.882.9712.239379.2723074.821.781.761240.56320.80623.17108.61286.4335.6216.512914.429814.62528.521.474.548.788.822239.54015.00.430.430.217.7620.4621.8680.7563.348.3221.24112.1064.228.73136.9265.029.4222.20163.8766.63173.6767.685293191027373564950100851969545548224913881134.420724.370425.364614.958224.98037173.13435.383440.866868.760780.6747132.9124155.38528.87598.951643.675336.597949.665150.76708.91358.9588231700452.822152.9411148.961675004384.381117307708340573862110387.72126811861.031137620693445631.2419583105465723774312726725126123583766278746937315290330258214.361912.109916.16408.551930.84066020.80584.330631.4704917.30844.035540.7207028.5527410.63473.013774.819043.267731.321343.817933079.963088.893093.581814.651817.591814.037.4680.9381.67010.2953.0732.1311.97219.58012.283.732.682.332.624.860.8010.1644.748.696.9815.9920.9917.197.0587.292.982704.934245.952230.81947.1931346.99326.760.850.342235.542250.026.4324.926.4136.8013.95112.2728.256797.848114.538149.56827.517325.7285112.6756446.881422.8900109.280820.125978.7761112.1891446.4889309.21250.33120.62177.40759.2345.488465538.97618879.37192.71691.43487.092.604.887956.7814973.881.541.54533.79252.69310.38141.30325.9531.7015.895214.022713.86186.201.363.866.336.352256.14076.40.430.430.215.6912.2912.3767.8036.225.9512.3287.7936.496.11103.3136.946.2212.48117.4337.37107.7233.92517315100727279451510425156954555719511278872.828212.723784.057456.024465.91636164.96328.967735.520756.592869.100585.9777101.63657.80898.121325.540726.526143.393343.23067.83378.1425106137453.392130.499966.10646632381.45707202727016150393213359.01124010621.020141412822696575.79213434112721458450139519275693256140948858541014816650832952715.609314.84118.397721.778325.393272.311833.226801.2439611.67712.186703.673601.403303271.063270.553271.272000.122003.542006.027.1390.9422.02318.0433.6941.9341.79823.41811.433.342.492.332.374.350.769.5545.688.246.3315.4018.8013.896.70110.382.852703.558241.314228.68346.3601525.18817.171.000.532563.452563.8714.9815.8112.8828.2912.26126.0934.5145112.598917.664057.876411.624439.3450128.0523492.376739.1448150.766823.035492.5054127.6469491.1153311.82243.47128.16174.60713.3546.532622538.29062902.92190.82727.76477.092.9512.179460.4522962.101.781.771242.45321.51630.58109.09285.7535.5516.454114.350214.61988.511.474.538.778.822252.64075.50.430.430.217.7620.5521.8882.1063.838.2921.29113.2564.428.69137.7565.159.4222.13163.0966.49172.6667.675273191037368244626101252469625545225013681124.469064.367725.353014.952804.95148173.73935.423840.802168.771581.0216133.7435156.81218.99059.088643.440836.861749.991351.35739.01189.0792230687449.422190.91112701647904392.291124037639340663895513379.94127311941.035136320763439631.8619513118065447773412754025069823643762078809937615310130396614.283512.017816.16058.508910.84637620.26124.325641.4694817.26874.032940.7159258.553749.951132.752464.648143.217421.309063.669453062.363073.172986.721739.491738.001715.757.5270.9631.67510.3683.1142.1251.98919.40312.283.772.712.332.584.790.809.9644.598.646.6916.2422.0117.347.1070.392.982695.646240.410228.42445.6791352.08328.080.840.352227.692244.256.4224.866.3336.6413.99112.4828.224998.028614.535549.35937.470725.4949111.2249440.099423.0134108.489019.993977.8730110.9617440.5608315.86240.62118.89175.69755.6045.3321535.10825OpenBenchmarking.org

CPU Temperature Monitor

OpenBenchmarking.orgCelsiusCPU Temperature MonitorPhoronix Test Suite System MonitoringAVX-512 OffAVX-512 OnAVX-512 On 51220406080100Min: 27 / Avg: 72.98 / Max: 95Min: 29 / Avg: 78.17 / Max: 100Min: 31 / Avg: 79.47 / Max: 100

CPU Peak Freq (Highest CPU Core Frequency) Monitor

OpenBenchmarking.orgMegahertzCPU Peak Freq (Highest CPU Core Frequency) MonitorPhoronix Test Suite System MonitoringAVX-512 OffAVX-512 OnAVX-512 On 51210002000300040005000Min: 3500 / Avg: 4781.84 / Max: 5621Min: 3350 / Avg: 4733.96 / Max: 5541Min: 2700 / Avg: 4722.22 / Max: 5323

CPU Power Consumption Monitor

OpenBenchmarking.orgWattsCPU Power Consumption MonitorPhoronix Test Suite System MonitoringAVX-512 OffAVX-512 OnAVX-512 On 51250100150200250Min: 6.36 / Avg: 173.58 / Max: 251.93Min: 6.37 / Avg: 188.45 / Max: 283.94Min: 6.3 / Avg: 192.29 / Max: 280.23

dav1d

Dav1d is an open-source, speedy AV1 video decoder. This test profile times how long it takes to decode sample AV1 video content. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgFPS, More Is Betterdav1d 1.0Video Input: Summer Nature 1080pAVX-512 OffAVX-512 OnAVX-512 On 5122004006008001000SE +/- 0.63, N = 8SE +/- 0.63, N = 8SE +/- 0.57, N = 8879.37894.73902.92-mno-avx512f1. (CC) gcc options: -O3 -march=native -pthread -lm

OpenBenchmarking.orgFPS, More Is Betterdav1d 1.0Video Input: Summer Nature 4KAVX-512 OffAVX-512 OnAVX-512 On 51250100150200250SE +/- 0.10, N = 3SE +/- 0.18, N = 3SE +/- 0.11, N = 3192.71207.14190.82-mno-avx512f1. (CC) gcc options: -O3 -march=native -pthread -lm

OpenBenchmarking.orgFPS, More Is Betterdav1d 1.0Video Input: Chimera 1080pAVX-512 OffAVX-512 OnAVX-512 On 512160320480640800SE +/- 0.49, N = 4SE +/- 0.58, N = 4SE +/- 0.36, N = 4691.43734.61727.76-mno-avx512f1. (CC) gcc options: -O3 -march=native -pthread -lm

OpenBenchmarking.orgFPS, More Is Betterdav1d 1.0Video Input: Chimera 1080p 10-bitAVX-512 OffAVX-512 OnAVX-512 On 512110220330440550SE +/- 0.38, N = 3SE +/- 0.34, N = 3SE +/- 0.21, N = 3487.09510.88477.09-mno-avx512f1. (CC) gcc options: -O3 -march=native -pthread -lm

OpenVINO

This is a test of the Intel OpenVINO, a toolkit around neural networks, using its built-in benchmarking support and analyzing the throughput and latency for various models. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.2.devModel: Face Detection FP16 - Device: CPUAVX-512 OffAVX-512 OnAVX-512 On 5120.66831.33662.00492.67323.3415SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.00, N = 32.602.972.95-mno-avx512f-ldl-ldl1. (CXX) g++ options: -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -pie

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.2.devModel: Face Detection FP16-INT8 - Device: CPUAVX-512 OffAVX-512 OnAVX-512 On 5123691215SE +/- 0.02, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 34.8812.2312.17-mno-avx512f-ldl-ldl1. (CXX) g++ options: -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -pie

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.2.devModel: Age Gender Recognition Retail 0013 FP16 - Device: CPUAVX-512 OffAVX-512 OnAVX-512 On 5122K4K6K8K10KSE +/- 34.03, N = 3SE +/- 94.72, N = 3SE +/- 54.72, N = 37956.789379.279460.45-mno-avx512f-ldl-ldl1. (CXX) g++ options: -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -pie

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.2.devModel: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPUAVX-512 OffAVX-512 OnAVX-512 On 5125K10K15K20K25KSE +/- 47.04, N = 3SE +/- 411.52, N = 15SE +/- 387.31, N = 1514973.8823074.8222962.10-mno-avx512f-ldl-ldl1. (CXX) g++ options: -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -pie

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.2.devModel: Person Detection FP16 - Device: CPUAVX-512 OffAVX-512 OnAVX-512 On 5120.40050.8011.20151.6022.0025SE +/- 0.01, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 31.541.781.78-mno-avx512f-ldl-ldl1. (CXX) g++ options: -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -pie

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.2.devModel: Person Detection FP32 - Device: CPUAVX-512 OffAVX-512 OnAVX-512 On 5120.39830.79661.19491.59321.9915SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.00, N = 31.541.761.77-mno-avx512f-ldl-ldl1. (CXX) g++ options: -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -pie

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.2.devModel: Weld Porosity Detection FP16-INT8 - Device: CPUAVX-512 OffAVX-512 OnAVX-512 On 51230060090012001500SE +/- 2.18, N = 3SE +/- 5.38, N = 3SE +/- 4.58, N = 3533.791240.561242.45-mno-avx512f-ldl-ldl1. (CXX) g++ options: -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -pie

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.2.devModel: Weld Porosity Detection FP16 - Device: CPUAVX-512 OffAVX-512 OnAVX-512 On 51270140210280350SE +/- 0.05, N = 3SE +/- 0.40, N = 3SE +/- 1.00, N = 3252.69320.80321.51-mno-avx512f-ldl-ldl1. (CXX) g++ options: -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -pie

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.2.devModel: Vehicle Detection FP16-INT8 - Device: CPUAVX-512 OffAVX-512 OnAVX-512 On 512140280420560700SE +/- 1.58, N = 3SE +/- 3.77, N = 3SE +/- 1.77, N = 3310.38623.17630.58-mno-avx512f-ldl-ldl1. (CXX) g++ options: -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -pie

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.2.devModel: Vehicle Detection FP16 - Device: CPUAVX-512 OffAVX-512 OnAVX-512 On 512306090120150SE +/- 1.44, N = 3SE +/- 0.12, N = 3SE +/- 0.25, N = 3141.30108.61109.09-mno-avx512f-ldl-ldl1. (CXX) g++ options: -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -pie

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.2.devModel: Person Vehicle Bike Detection FP16 - Device: CPUAVX-512 OffAVX-512 OnAVX-512 On 51270140210280350SE +/- 3.32, N = 6SE +/- 2.42, N = 3SE +/- 2.59, N = 7325.95286.43285.75-mno-avx512f-ldl-ldl1. (CXX) g++ options: -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -pie

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.2.devModel: Machine Translation EN To DE FP16 - Device: CPUAVX-512 OffAVX-512 OnAVX-512 On 512816243240SE +/- 0.04, N = 3SE +/- 0.27, N = 3SE +/- 0.18, N = 331.7035.6235.55-mno-avx512f-ldl-ldl1. (CXX) g++ options: -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -pie

Embree

OpenBenchmarking.orgFrames Per Second Per Watt, More Is BetterEmbree 3.13Binary: Pathtracer ISPC - Model: Asian DragonAVX-512 OffAVX-512 OnAVX-512 On 5120.02030.04060.06090.08120.10150.0900.0780.077

OpenBenchmarking.orgFrames Per Second Per Watt, More Is BetterEmbree 3.13Binary: Pathtracer ISPC - Model: Asian Dragon ObjAVX-512 OffAVX-512 OnAVX-512 On 5120.020.040.060.080.10.0890.0770.076

OpenBenchmarking.orgFrames Per Second Per Watt, More Is BetterEmbree 3.13Binary: Pathtracer ISPC - Model: CrownAVX-512 OffAVX-512 OnAVX-512 On 5120.01640.03280.04920.06560.0820.0730.0630.063

OpenBenchmarking.orgFrames Per Second, More Is BetterEmbree 3.13Binary: Pathtracer ISPC - Model: Asian DragonAVX-512 OffAVX-512 OnAVX-512 On 51248121620SE +/- 0.10, N = 3SE +/- 0.07, N = 3SE +/- 0.06, N = 315.9016.5116.45MIN: 15.66 / MAX: 16.42MIN: 16.3 / MAX: 17.02MIN: 16.21 / MAX: 16.89

OpenBenchmarking.orgFrames Per Second, More Is BetterEmbree 3.13Binary: Pathtracer ISPC - Model: Asian Dragon ObjAVX-512 OffAVX-512 OnAVX-512 On 51248121620SE +/- 0.02, N = 3SE +/- 0.01, N = 3SE +/- 0.03, N = 314.0214.4314.35MIN: 13.89 / MAX: 14.33MIN: 14.31 / MAX: 14.74MIN: 14.2 / MAX: 14.69

OpenBenchmarking.orgFrames Per Second, More Is BetterEmbree 3.13Binary: Pathtracer ISPC - Model: CrownAVX-512 OffAVX-512 OnAVX-512 On 51248121620SE +/- 0.11, N = 3SE +/- 0.03, N = 3SE +/- 0.03, N = 313.8614.6314.62MIN: 13.49 / MAX: 14.34MIN: 14.41 / MAX: 15.16MIN: 14.37 / MAX: 15.18

simdjson

OpenBenchmarking.orgGB/s Per Watt, More Is Bettersimdjson 2.0Throughput Test: PartialTweetsAVX-512 OffAVX-512 OnAVX-512 On 5120.03040.06080.09120.12160.1520.1040.1350.135

OpenBenchmarking.orgGB/s, More Is Bettersimdjson 2.0Throughput Test: PartialTweetsAVX-512 OffAVX-512 OnAVX-512 On 512246810SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 36.208.528.51-mno-avx512f1. (CXX) g++ options: -O3 -march=native

OpenBenchmarking.orgGB/s Per Watt, More Is Bettersimdjson 2.0Throughput Test: LargeRandomAVX-512 OffAVX-512 OnAVX-512 On 5120.00590.01180.01770.02360.02950.0250.0260.026

OpenBenchmarking.orgGB/s, More Is Bettersimdjson 2.0Throughput Test: LargeRandomAVX-512 OffAVX-512 OnAVX-512 On 5120.33080.66160.99241.32321.654SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 31.361.471.47-mno-avx512f1. (CXX) g++ options: -O3 -march=native

OpenBenchmarking.orgGB/s, More Is Bettersimdjson 2.0Throughput Test: KostyaAVX-512 OffAVX-512 OnAVX-512 On 5121.02152.0433.06454.0865.1075SE +/- 0.00, N = 3SE +/- 0.01, N = 3SE +/- 0.00, N = 33.864.544.53-mno-avx512f1. (CXX) g++ options: -O3 -march=native

OpenBenchmarking.orgGB/s, More Is Bettersimdjson 2.0Throughput Test: DistinctUserIDAVX-512 OffAVX-512 OnAVX-512 On 512246810SE +/- 0.00, N = 3SE +/- 0.01, N = 3SE +/- 0.00, N = 36.338.788.77-mno-avx512f1. (CXX) g++ options: -O3 -march=native

OpenBenchmarking.orgGB/s, More Is Bettersimdjson 2.0Throughput Test: TopTweetAVX-512 OffAVX-512 OnAVX-512 On 512246810SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.00, N = 36.358.828.82-mno-avx512f1. (CXX) g++ options: -O3 -march=native

Xmrig

OpenBenchmarking.orgH/s Per Watt, More Is BetterXmrig 6.12.1Variant: Monero - Hash Count: 1MAVX-512 OffAVX-512 OnAVX-512 On 5124812162016.6816.0812.40

OpenBenchmarking.orgH/s Per Watt, More Is BetterXmrig 6.12.1Variant: Wownero - Hash Count: 1MAVX-512 OffAVX-512 OnAVX-512 On 51261218243027.0426.0720.54

OpenBenchmarking.orgH/s, More Is BetterXmrig 6.12.1Variant: Monero - Hash Count: 1MAVX-512 OffAVX-512 OnAVX-512 On 5125001000150020002500SE +/- 6.72, N = 3SE +/- 3.33, N = 3SE +/- 6.87, N = 32256.12239.52252.6-mno-avx512f1. (CXX) g++ options: -O3 -march=native -fexceptions -fno-rtti -maes -Ofast -static-libgcc -static-libstdc++ -rdynamic -lssl -lcrypto -luv -lpthread -lrt -ldl -lhwloc

OpenBenchmarking.orgH/s, More Is BetterXmrig 6.12.1Variant: Wownero - Hash Count: 1MAVX-512 OffAVX-512 OnAVX-512 On 5129001800270036004500SE +/- 5.83, N = 3SE +/- 44.80, N = 3SE +/- 21.46, N = 34076.44015.04075.5-mno-avx512f1. (CXX) g++ options: -O3 -march=native -fexceptions -fno-rtti -maes -Ofast -static-libgcc -static-libstdc++ -rdynamic -lssl -lcrypto -luv -lpthread -lrt -ldl -lhwloc

Intel Open Image Denoise

Open Image Denoise is a denoising library for ray-tracing and part of the oneAPI rendering toolkit. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgImages / Sec, More Is BetterIntel Open Image Denoise 1.4.0Run: RT.hdr_alb_nrm.3840x2160AVX-512 OffAVX-512 OnAVX-512 On 5120.09680.19360.29040.38720.484SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 30.430.430.43

OpenBenchmarking.orgImages / Sec, More Is BetterIntel Open Image Denoise 1.4.0Run: RT.ldr_alb_nrm.3840x2160AVX-512 OffAVX-512 OnAVX-512 On 5120.09680.19360.29040.38720.484SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 30.430.430.43

OpenBenchmarking.orgImages / Sec, More Is BetterIntel Open Image Denoise 1.4.0Run: RTLightmap.hdr.4096x4096AVX-512 OffAVX-512 OnAVX-512 On 5120.04730.09460.14190.18920.2365SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 30.210.210.21

TensorFlow

OpenBenchmarking.orgimages/sec Per Watt, More Is BetterTensorFlow 2.10Device: CPU - Batch Size: 16 - Model: VGG-16AVX-512 OffAVX-512 OnAVX-512 On 5120.00880.01760.02640.03520.0440.0330.0390.039

OpenBenchmarking.orgimages/sec Per Watt, More Is BetterTensorFlow 2.10Device: CPU - Batch Size: 16 - Model: ResNet-50AVX-512 OffAVX-512 OnAVX-512 On 5120.02590.05180.07770.10360.12950.0720.1150.115

OpenBenchmarking.orgimages/sec Per Watt, More Is BetterTensorFlow 2.10Device: CPU - Batch Size: 16 - Model: AlexNetAVX-512 OffAVX-512 OnAVX-512 On 5120.12960.25920.38880.51840.6480.4600.5690.576

OpenBenchmarking.orgimages/sec Per Watt, More Is BetterTensorFlow 2.10Device: CPU - Batch Size: 16 - Model: GoogLeNetAVX-512 OffAVX-512 OnAVX-512 On 5120.08530.17060.25590.34120.42650.2190.3790.379

OpenBenchmarking.orgimages/sec Per Watt, More Is BetterTensorFlow 2.10Device: CPU - Batch Size: 32 - Model: VGG-16AVX-512 OffAVX-512 OnAVX-512 On 5120.00920.01840.02760.03680.0460.0340.0410.041

OpenBenchmarking.orgimages/sec Per Watt, More Is BetterTensorFlow 2.10Device: CPU - Batch Size: 32 - Model: ResNet-50AVX-512 OffAVX-512 OnAVX-512 On 5120.02610.05220.07830.10440.13050.0710.1150.116

OpenBenchmarking.orgimages/sec Per Watt, More Is BetterTensorFlow 2.10Device: CPU - Batch Size: 32 - Model: AlexNetAVX-512 OffAVX-512 OnAVX-512 On 5120.16630.33260.49890.66520.83150.5520.7310.739

OpenBenchmarking.orgimages/sec Per Watt, More Is BetterTensorFlow 2.10Device: CPU - Batch Size: 32 - Model: GoogLeNetAVX-512 OffAVX-512 OnAVX-512 On 5120.08030.16060.24090.32120.40150.2120.3570.356

OpenBenchmarking.orgimages/sec Per Watt, More Is BetterTensorFlow 2.10Device: CPU - Batch Size: 64 - Model: VGG-16AVX-512 OffAVX-512 OnAVX-512 On 5120.00950.0190.02850.0380.04750.0350.0420.042

OpenBenchmarking.orgimages/sec Per Watt, More Is BetterTensorFlow 2.10Device: CPU - Batch Size: 64 - Model: ResNet-50AVX-512 OffAVX-512 OnAVX-512 On 5120.02610.05220.07830.10440.13050.0710.1150.116

OpenBenchmarking.orgimages/sec Per Watt, More Is BetterTensorFlow 2.10Device: CPU - Batch Size: 64 - Model: AlexNetAVX-512 OffAVX-512 OnAVX-512 On 5120.19330.38660.57990.77320.96650.6140.8330.859

OpenBenchmarking.orgimages/sec Per Watt, More Is BetterTensorFlow 2.10Device: CPU - Batch Size: 64 - Model: GoogLeNetAVX-512 OffAVX-512 OnAVX-512 On 5120.07830.15660.23490.31320.39150.2090.3460.348

OpenBenchmarking.orgimages/sec Per Watt, More Is BetterTensorFlow 2.10Device: CPU - Batch Size: 256 - Model: VGG-16AVX-512 OffAVX-512 OnAVX-512 On 5120.00970.01940.02910.03880.04850.0320.0430.043

OpenBenchmarking.orgimages/sec Per Watt, More Is BetterTensorFlow 2.10Device: CPU - Batch Size: 256 - Model: ResNet-50AVX-512 OffAVX-512 OnAVX-512 On 5120.02590.05180.07770.10360.12950.0710.1150.115

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.10Device: CPU - Batch Size: 16 - Model: VGG-16AVX-512 OffAVX-512 OnAVX-512 On 512246810SE +/- 0.00, N = 3SE +/- 0.01, N = 3SE +/- 0.00, N = 35.697.767.76

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.10Device: CPU - Batch Size: 16 - Model: ResNet-50AVX-512 OffAVX-512 OnAVX-512 On 512510152025SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 312.2920.4620.55

OpenBenchmarking.orgimages/sec Per Watt, More Is BetterTensorFlow 2.10Device: CPU - Batch Size: 256 - Model: AlexNetAVX-512 OffAVX-512 OnAVX-512 On 5120.20480.40960.61440.81921.0240.6540.9090.910

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.10Device: CPU - Batch Size: 64 - Model: ResNet-50AVX-512 OffAVX-512 OnAVX-512 On 512510152025SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 312.3721.8621.88

OpenBenchmarking.orgimages/sec Per Watt, More Is BetterTensorFlow 2.10Device: CPU - Batch Size: 256 - Model: GoogLeNetAVX-512 OffAVX-512 OnAVX-512 On 5120.07630.15260.22890.30520.38150.2060.3380.339

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.10Device: CPU - Batch Size: 16 - Model: AlexNetAVX-512 OffAVX-512 OnAVX-512 On 51220406080100SE +/- 0.03, N = 3SE +/- 0.06, N = 3SE +/- 0.12, N = 367.8080.7582.10

OpenBenchmarking.orgimages/sec Per Watt, More Is BetterTensorFlow 2.10Device: CPU - Batch Size: 512 - Model: AlexNetAVX-512 OffAVX-512 OnAVX-512 On 5120.2070.4140.6210.8281.0350.5940.9200.920

OpenBenchmarking.orgimages/sec Per Watt, More Is BetterTensorFlow 2.10Device: CPU - Batch Size: 512 - Model: GoogLeNetAVX-512 OffAVX-512 OnAVX-512 On 5120.07670.15340.23010.30680.38350.1880.3410.339

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.10Device: CPU - Batch Size: 16 - Model: GoogLeNetAVX-512 OffAVX-512 OnAVX-512 On 5121428425670SE +/- 0.02, N = 3SE +/- 0.03, N = 3SE +/- 0.16, N = 336.2263.3463.83

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.10Device: CPU - Batch Size: 32 - Model: VGG-16AVX-512 OffAVX-512 OnAVX-512 On 512246810SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.01, N = 35.958.328.29

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.10Device: CPU - Batch Size: 32 - Model: ResNet-50AVX-512 OffAVX-512 OnAVX-512 On 512510152025SE +/- 0.01, N = 3SE +/- 0.02, N = 3SE +/- 0.00, N = 312.3221.2421.29

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.10Device: CPU - Batch Size: 32 - Model: AlexNetAVX-512 OffAVX-512 OnAVX-512 On 512306090120150SE +/- 0.05, N = 3SE +/- 0.17, N = 3SE +/- 0.26, N = 387.79112.10113.25

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.10Device: CPU - Batch Size: 32 - Model: GoogLeNetAVX-512 OffAVX-512 OnAVX-512 On 5121428425670SE +/- 0.04, N = 3SE +/- 0.01, N = 3SE +/- 0.06, N = 336.4964.2264.42

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.10Device: CPU - Batch Size: 64 - Model: VGG-16AVX-512 OffAVX-512 OnAVX-512 On 512246810SE +/- 0.00, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 36.118.738.69

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.10Device: CPU - Batch Size: 64 - Model: AlexNetAVX-512 OffAVX-512 OnAVX-512 On 512306090120150SE +/- 0.07, N = 3SE +/- 0.11, N = 3SE +/- 0.13, N = 3103.31136.92137.75

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.10Device: CPU - Batch Size: 64 - Model: GoogLeNetAVX-512 OffAVX-512 OnAVX-512 On 5121530456075SE +/- 0.01, N = 3SE +/- 0.05, N = 3SE +/- 0.07, N = 336.9465.0265.15

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.10Device: CPU - Batch Size: 256 - Model: VGG-16AVX-512 OffAVX-512 OnAVX-512 On 5123691215SE +/- 0.00, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 36.229.429.42

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.10Device: CPU - Batch Size: 256 - Model: ResNet-50AVX-512 OffAVX-512 OnAVX-512 On 512510152025SE +/- 0.00, N = 3SE +/- 0.01, N = 3SE +/- 0.00, N = 312.4822.2022.13

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.10Device: CPU - Batch Size: 256 - Model: AlexNetAVX-512 OffAVX-512 OnAVX-512 On 5124080120160200SE +/- 0.05, N = 3SE +/- 0.42, N = 3SE +/- 0.22, N = 3117.43163.87163.09

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.10Device: CPU - Batch Size: 256 - Model: GoogLeNetAVX-512 OffAVX-512 OnAVX-512 On 5121530456075SE +/- 0.02, N = 3SE +/- 0.11, N = 3SE +/- 0.06, N = 337.3766.6366.49

Device: CPU - Batch Size: 512 - Model: VGG-16

i9-11900K: AVX-512 On: The test quit with a non-zero exit status.

i9-11900K: AVX-512 Off: The test quit with a non-zero exit status. E: Fatal Python error: Aborted

i9-11900K: AVX-512 On 512: The test quit with a non-zero exit status. E: Fatal Python error: Segmentation fault

Device: CPU - Batch Size: 512 - Model: ResNet-50

i9-11900K: AVX-512 On: The test quit with a non-zero exit status.

i9-11900K: AVX-512 Off: The test quit with a non-zero exit status.

i9-11900K: AVX-512 On 512: The test quit with a non-zero exit status.

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.10Device: CPU - Batch Size: 512 - Model: AlexNetAVX-512 OffAVX-512 OnAVX-512 On 5124080120160200SE +/- 0.09, N = 3SE +/- 0.14, N = 3SE +/- 0.21, N = 3107.72173.67172.66

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.10Device: CPU - Batch Size: 512 - Model: GoogLeNetAVX-512 OffAVX-512 OnAVX-512 On 5121530456075SE +/- 0.06, N = 3SE +/- 0.02, N = 3SE +/- 0.03, N = 333.9267.6867.67

ONNX Runtime

OpenBenchmarking.orgInferences Per Minute Per Watt, More Is BetterONNX Runtime 1.11Model: yolov4 - Device: CPU - Executor: StandardAVX-512 OffAVX-512 OnAVX-512 On 5120.63521.27041.90562.54083.1762.8232.6162.598

OpenBenchmarking.orgInferences Per Minute, More Is BetterONNX Runtime 1.11Model: yolov4 - Device: CPU - Executor: StandardAVX-512 OffAVX-512 OnAVX-512 On 512110220330440550SE +/- 0.76, N = 3SE +/- 0.60, N = 3SE +/- 1.09, N = 3517529527-mno-avx512f1. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

OpenBenchmarking.orgInferences Per Minute Per Watt, More Is BetterONNX Runtime 1.11Model: fcn-resnet101-11 - Device: CPU - Executor: StandardAVX-512 OffAVX-512 OnAVX-512 On 5120.10820.21640.32460.43280.5410.4810.4700.472

OpenBenchmarking.orgInferences Per Minute Per Watt, More Is BetterONNX Runtime 1.11Model: fcn-resnet101-11 - Device: CPU - Executor: ParallelAVX-512 OffAVX-512 OnAVX-512 On 5120.09250.1850.27750.370.46250.4110.3750.374

OpenBenchmarking.orgInferences Per Minute, More Is BetterONNX Runtime 1.11Model: yolov4 - Device: CPU - Executor: ParallelAVX-512 OffAVX-512 OnAVX-512 On 51270140210280350SE +/- 0.33, N = 3SE +/- 0.29, N = 3SE +/- 0.33, N = 3315319319-mno-avx512f1. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

OpenBenchmarking.orgInferences Per Minute, More Is BetterONNX Runtime 1.11Model: fcn-resnet101-11 - Device: CPU - Executor: StandardAVX-512 OffAVX-512 OnAVX-512 On 51220406080100SE +/- 0.17, N = 3SE +/- 0.88, N = 8SE +/- 0.17, N = 3100102103-mno-avx512f1. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

OpenBenchmarking.orgInferences Per Minute, More Is BetterONNX Runtime 1.11Model: fcn-resnet101-11 - Device: CPU - Executor: ParallelAVX-512 OffAVX-512 OnAVX-512 On 5121632486480SE +/- 0.33, N = 3SE +/- 0.00, N = 3SE +/- 0.44, N = 3727373-mno-avx512f1. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

OpenBenchmarking.orgInferences Per Minute Per Watt, More Is BetterONNX Runtime 1.11Model: super-resolution-10 - Device: CPU - Executor: StandardAVX-512 OffAVX-512 OnAVX-512 On 51281624324033.2131.6829.78

OpenBenchmarking.orgInferences Per Minute Per Watt, More Is BetterONNX Runtime 1.11Model: ArcFace ResNet-100 - Device: CPU - Executor: ParallelAVX-512 OffAVX-512 OnAVX-512 On 5122468107.6987.0136.988

OpenBenchmarking.orgInferences Per Minute, More Is BetterONNX Runtime 1.11Model: super-resolution-10 - Device: CPU - Executor: StandardAVX-512 OffAVX-512 OnAVX-512 On 51216003200480064008000SE +/- 44.00, N = 3SE +/- 80.51, N = 4SE +/- 64.19, N = 12727973566824-mno-avx512f1. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

OpenBenchmarking.orgInferences Per Minute Per Watt, More Is BetterONNX Runtime 1.11Model: super-resolution-10 - Device: CPU - Executor: ParallelAVX-512 OffAVX-512 OnAVX-512 On 51261218243026.3423.5522.48

OpenBenchmarking.orgInferences Per Minute Per Watt, More Is BetterONNX Runtime 1.11Model: bertsquad-12 - Device: CPU - Executor: StandardAVX-512 OffAVX-512 OnAVX-512 On 5121.09912.19823.29734.39645.49554.8854.5424.528

OpenBenchmarking.orgInferences Per Minute Per Watt, More Is BetterONNX Runtime 1.11Model: bertsquad-12 - Device: CPU - Executor: ParallelAVX-512 OffAVX-512 OnAVX-512 On 5120.69121.38242.07362.76483.4563.0722.6002.626

OpenBenchmarking.orgInferences Per Minute Per Watt, More Is BetterONNX Runtime 1.11Model: GPT-2 - Device: CPU - Executor: StandardAVX-512 OffAVX-512 OnAVX-512 On 512102030405045.4139.7539.57

OpenBenchmarking.orgInferences Per Minute Per Watt, More Is BetterONNX Runtime 1.11Model: GPT-2 - Device: CPU - Executor: ParallelAVX-512 OffAVX-512 OnAVX-512 On 51281624324036.6531.8231.65

OpenBenchmarking.orgInferences Per Minute Per Watt, More Is BetterONNX Runtime 1.11Model: ArcFace ResNet-100 - Device: CPU - Executor: StandardAVX-512 OffAVX-512 OnAVX-512 On 51236912159.88110.45110.464

OpenBenchmarking.orgInferences Per Minute, More Is BetterONNX Runtime 1.11Model: super-resolution-10 - Device: CPU - Executor: ParallelAVX-512 OffAVX-512 OnAVX-512 On 51211002200330044005500SE +/- 8.93, N = 3SE +/- 5.95, N = 3SE +/- 25.62, N = 3451549504626-mno-avx512f1. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

OpenBenchmarking.orgInferences Per Minute, More Is BetterONNX Runtime 1.11Model: bertsquad-12 - Device: CPU - Executor: StandardAVX-512 OffAVX-512 OnAVX-512 On 5122004006008001000SE +/- 8.55, N = 9SE +/- 2.67, N = 3SE +/- 5.77, N = 3104210081012-mno-avx512f1. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

OpenBenchmarking.orgInferences Per Minute, More Is BetterONNX Runtime 1.11Model: bertsquad-12 - Device: CPU - Executor: ParallelAVX-512 OffAVX-512 OnAVX-512 On 512110220330440550SE +/- 2.46, N = 3SE +/- 0.44, N = 3SE +/- 0.60, N = 3515519524-mno-avx512f1. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

OpenBenchmarking.orgInferences Per Minute, More Is BetterONNX Runtime 1.11Model: GPT-2 - Device: CPU - Executor: StandardAVX-512 OffAVX-512 OnAVX-512 On 51215003000450060007500SE +/- 4.16, N = 3SE +/- 4.94, N = 3SE +/- 9.16, N = 3695469546962-mno-avx512f1. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

OpenBenchmarking.orgInferences Per Minute, More Is BetterONNX Runtime 1.11Model: GPT-2 - Device: CPU - Executor: ParallelAVX-512 OffAVX-512 OnAVX-512 On 51212002400360048006000SE +/- 1.76, N = 3SE +/- 7.10, N = 3SE +/- 3.18, N = 3555755485545-mno-avx512f1. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

OpenBenchmarking.orgInferences Per Minute, More Is BetterONNX Runtime 1.11Model: ArcFace ResNet-100 - Device: CPU - Executor: StandardAVX-512 OffAVX-512 OnAVX-512 On 5125001000150020002500SE +/- 35.14, N = 12SE +/- 2.02, N = 3SE +/- 1.92, N = 3195122492250-mno-avx512f1. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

OpenBenchmarking.orgInferences Per Minute, More Is BetterONNX Runtime 1.11Model: ArcFace ResNet-100 - Device: CPU - Executor: ParallelAVX-512 OffAVX-512 OnAVX-512 On 51230060090012001500SE +/- 1.76, N = 3SE +/- 1.36, N = 3SE +/- 4.33, N = 3127813881368-mno-avx512f1. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

OpenVKL

OpenBenchmarking.orgItems / Sec Per Watt, More Is BetterOpenVKL 1.0Benchmark: vklBenchmark ISPCAVX-512 OffAVX-512 OnAVX-512 On 5120.13140.26280.39420.52560.6570.5250.5840.578

OpenBenchmarking.orgItems / Sec, More Is BetterOpenVKL 1.0Benchmark: vklBenchmark ISPCAVX-512 OffAVX-512 OnAVX-512 On 512306090120150SE +/- 0.00, N = 3SE +/- 0.33, N = 3SE +/- 0.67, N = 387113112MIN: 7 / MAX: 901MIN: 10 / MAX: 1116MIN: 9 / MAX: 1115

OSPRay

Intel OSPRay is a portable ray-tracing engine for high-performance, high-fidelity scientific visualizations. OSPRay builds off Intel's Embree and Intel SPMD Program Compiler (ISPC) components as part of the oneAPI rendering toolkit. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgItems Per Second, More Is BetterOSPRay 2.10Benchmark: gravity_spheres_volume/dim_512/ao/real_timeAVX-512 OffAVX-512 OnAVX-512 On 5121.00552.0113.01654.0225.0275SE +/- 0.01595, N = 3SE +/- 0.02867, N = 3SE +/- 0.01309, N = 32.828214.420724.46906

OpenBenchmarking.orgItems Per Second, More Is BetterOSPRay 2.10Benchmark: gravity_spheres_volume/dim_512/scivis/real_timeAVX-512 OffAVX-512 OnAVX-512 On 5120.98331.96662.94993.93324.9165SE +/- 0.00481, N = 3SE +/- 0.01025, N = 3SE +/- 0.02096, N = 32.723784.370424.36772

OpenBenchmarking.orgItems Per Second, More Is BetterOSPRay 2.10Benchmark: gravity_spheres_volume/dim_512/pathtracer/real_timeAVX-512 OffAVX-512 OnAVX-512 On 5121.2072.4143.6214.8286.035SE +/- 0.01158, N = 3SE +/- 0.01274, N = 3SE +/- 0.02156, N = 34.057455.364615.35301

OpenBenchmarking.orgItems Per Second, More Is BetterOSPRay 2.10Benchmark: particle_volume/ao/real_timeAVX-512 OffAVX-512 OnAVX-512 On 512246810SE +/- 0.00177, N = 3SE +/- 0.01187, N = 3SE +/- 0.03653, N = 36.024464.958224.95280

OpenBenchmarking.orgItems Per Second, More Is BetterOSPRay 2.10Benchmark: particle_volume/scivis/real_timeAVX-512 OffAVX-512 OnAVX-512 On 5121.33122.66243.99365.32486.656SE +/- 0.02016, N = 3SE +/- 0.04966, N = 3SE +/- 0.01748, N = 35.916364.980374.95148

OpenBenchmarking.orgItems Per Second, More Is BetterOSPRay 2.10Benchmark: particle_volume/pathtracer/real_timeAVX-512 OffAVX-512 OnAVX-512 On 5124080120160200SE +/- 0.37, N = 3SE +/- 0.21, N = 3SE +/- 0.56, N = 3164.96173.13173.74

Neural Magic DeepSparse

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Synchronous Single-StreamAVX-512 OffAVX-512 OnAVX-512 On 512816243240SE +/- 0.02, N = 3SE +/- 0.07, N = 3SE +/- 0.11, N = 328.9735.3835.42

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-StreamAVX-512 OffAVX-512 OnAVX-512 On 512918273645SE +/- 0.02, N = 3SE +/- 0.12, N = 3SE +/- 0.22, N = 335.5240.8740.80

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: NLP Text Classification, DistilBERT mnli - Scenario: Synchronous Single-StreamAVX-512 OffAVX-512 OnAVX-512 On 5121530456075SE +/- 0.03, N = 3SE +/- 0.05, N = 3SE +/- 0.03, N = 356.5968.7668.77

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-StreamAVX-512 OffAVX-512 OnAVX-512 On 51220406080100SE +/- 0.03, N = 3SE +/- 0.12, N = 3SE +/- 0.06, N = 369.1080.6781.02

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: CV Classification, ResNet-50 ImageNet - Scenario: Synchronous Single-StreamAVX-512 OffAVX-512 OnAVX-512 On 512306090120150SE +/- 0.04, N = 3SE +/- 0.48, N = 3SE +/- 0.12, N = 385.98132.91133.74

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-StreamAVX-512 OffAVX-512 OnAVX-512 On 512306090120150SE +/- 0.14, N = 3SE +/- 0.92, N = 3SE +/- 0.68, N = 3101.64155.39156.81

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Synchronous Single-StreamAVX-512 OffAVX-512 OnAVX-512 On 5123691215SE +/- 0.0071, N = 3SE +/- 0.0785, N = 3SE +/- 0.0301, N = 37.80898.87598.9905

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-StreamAVX-512 OffAVX-512 OnAVX-512 On 5123691215SE +/- 0.0060, N = 3SE +/- 0.0648, N = 3SE +/- 0.0140, N = 38.12138.95169.0886

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Synchronous Single-StreamAVX-512 OffAVX-512 OnAVX-512 On 5121020304050SE +/- 0.05, N = 3SE +/- 0.20, N = 3SE +/- 0.19, N = 325.5443.6843.44

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-StreamAVX-512 OffAVX-512 OnAVX-512 On 512816243240SE +/- 0.15, N = 3SE +/- 0.03, N = 3SE +/- 0.02, N = 326.5336.6036.86

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: CV Detection,YOLOv5s COCO - Scenario: Synchronous Single-StreamAVX-512 OffAVX-512 OnAVX-512 On 5121122334455SE +/- 0.01, N = 3SE +/- 0.15, N = 3SE +/- 0.04, N = 343.3949.6749.99

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: CV Detection,YOLOv5s COCO - Scenario: Asynchronous Multi-StreamAVX-512 OffAVX-512 OnAVX-512 On 5121224364860SE +/- 0.08, N = 3SE +/- 0.15, N = 3SE +/- 0.37, N = 343.2350.7751.36

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Synchronous Single-StreamAVX-512 OffAVX-512 OnAVX-512 On 5123691215SE +/- 0.0041, N = 3SE +/- 0.0463, N = 3SE +/- 0.0265, N = 37.83378.91359.0118

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-StreamAVX-512 OffAVX-512 OnAVX-512 On 5123691215SE +/- 0.0056, N = 3SE +/- 0.0383, N = 3SE +/- 0.0265, N = 38.14258.95889.0792

Cpuminer-Opt

OpenBenchmarking.orgkH/s Per Watt, More Is BetterCpuminer-Opt 3.18Algorithm: Triple SHA-256, OnecoinAVX-512 OffAVX-512 OnAVX-512 On 51230060090012001500820.321366.281361.66

OpenBenchmarking.orgkH/s Per Watt, More Is BetterCpuminer-Opt 3.18Algorithm: Quad SHA-256, PyriteAVX-512 OffAVX-512 OnAVX-512 On 5122004006008001000460.38953.89930.90

OpenBenchmarking.orgkH/s Per Watt, More Is BetterCpuminer-Opt 3.18Algorithm: Myriad-GroestlAVX-512 OffAVX-512 OnAVX-512 On 5124080120160200101.32198.30197.49

OpenBenchmarking.orgkH/s, More Is BetterCpuminer-Opt 3.18Algorithm: Triple SHA-256, OnecoinAVX-512 OffAVX-512 OnAVX-512 On 51250K100K150K200K250KSE +/- 627.84, N = 3SE +/- 1895.81, N = 3SE +/- 1461.35, N = 3106137231700230687-mno-avx512f1. (CXX) g++ options: -O3 -march=native -lcurl -lz -lpthread -lssl -lcrypto -lgmp

OpenBenchmarking.orgkH/s, More Is BetterCpuminer-Opt 3.18Algorithm: MagiAVX-512 OffAVX-512 OnAVX-512 On 512100200300400500SE +/- 0.84, N = 3SE +/- 0.67, N = 3SE +/- 3.36, N = 3453.39452.82449.42-mno-avx512f1. (CXX) g++ options: -O3 -march=native -lcurl -lz -lpthread -lssl -lcrypto -lgmp

OpenBenchmarking.orgkH/s, More Is BetterCpuminer-Opt 3.18Algorithm: RingcoinAVX-512 OffAVX-512 OnAVX-512 On 5125001000150020002500SE +/- 5.83, N = 3SE +/- 40.17, N = 13SE +/- 16.96, N = 152130.492152.942190.91-mno-avx512f1. (CXX) g++ options: -O3 -march=native -lcurl -lz -lpthread -lssl -lcrypto -lgmp

OpenBenchmarking.orgkH/s, More Is BetterCpuminer-Opt 3.18Algorithm: DeepcoinAVX-512 OffAVX-512 OnAVX-512 On 5122K4K6K8K10KSE +/- 3.11, N = 3SE +/- 226.60, N = 12SE +/- 25.17, N = 39966.1011148.9611270.00-mno-avx512f1. (CXX) g++ options: -O3 -march=native -lcurl -lz -lpthread -lssl -lcrypto -lgmp

OpenBenchmarking.orgkH/s Per Watt, More Is BetterCpuminer-Opt 3.18Algorithm: Blake-2 SAVX-512 OffAVX-512 OnAVX-512 On 512120024003600480060003255.015427.525541.06

OpenBenchmarking.orgkH/s Per Watt, More Is BetterCpuminer-Opt 3.18Algorithm: x25xAVX-512 OffAVX-512 OnAVX-512 On 5120.51481.02961.54442.05922.5742.2881.8461.847

OpenBenchmarking.orgkH/s Per Watt, More Is BetterCpuminer-Opt 3.18Algorithm: GarlicoinAVX-512 OffAVX-512 OnAVX-512 On 51251015202513.6419.4019.90

OpenBenchmarking.orgkH/s Per Watt, More Is BetterCpuminer-Opt 3.18Algorithm: SkeincoinAVX-512 OffAVX-512 OnAVX-512 On 512140280420560700493.49647.91651.49

OpenBenchmarking.orgkH/s, More Is BetterCpuminer-Opt 3.18Algorithm: Quad SHA-256, PyriteAVX-512 OffAVX-512 OnAVX-512 On 51240K80K120K160K200KSE +/- 42.56, N = 3SE +/- 280.42, N = 3SE +/- 346.55, N = 364663167500164790-mno-avx512f1. (CXX) g++ options: -O3 -march=native -lcurl -lz -lpthread -lssl -lcrypto -lgmp

OpenBenchmarking.orgkH/s, More Is BetterCpuminer-Opt 3.18Algorithm: GarlicoinAVX-512 OffAVX-512 OnAVX-512 On 5129001800270036004500SE +/- 6.13, N = 3SE +/- 25.90, N = 3SE +/- 10.30, N = 32381.454384.384392.29-mno-avx512f1. (CXX) g++ options: -O3 -march=native -lcurl -lz -lpthread -lssl -lcrypto -lgmp

OpenBenchmarking.orgkH/s, More Is BetterCpuminer-Opt 3.18Algorithm: SkeincoinAVX-512 OffAVX-512 OnAVX-512 On 51220K40K60K80K100KSE +/- 85.44, N = 3SE +/- 394.25, N = 3SE +/- 146.55, N = 370720111730112403-mno-avx512f1. (CXX) g++ options: -O3 -march=native -lcurl -lz -lpthread -lssl -lcrypto -lgmp

OpenBenchmarking.orgkH/s, More Is BetterCpuminer-Opt 3.18Algorithm: LBC, LBRY CreditsAVX-512 OffAVX-512 OnAVX-512 On 51217K34K51K68K85KSE +/- 20.00, N = 3SE +/- 84.13, N = 3SE +/- 116.81, N = 3272707708376393-mno-avx512f1. (CXX) g++ options: -O3 -march=native -lcurl -lz -lpthread -lssl -lcrypto -lgmp

OpenBenchmarking.orgkH/s, More Is BetterCpuminer-Opt 3.18Algorithm: Myriad-GroestlAVX-512 OffAVX-512 OnAVX-512 On 5129K18K27K36K45KSE +/- 17.32, N = 3SE +/- 58.12, N = 3SE +/- 164.55, N = 3161504057340663-mno-avx512f1. (CXX) g++ options: -O3 -march=native -lcurl -lz -lpthread -lssl -lcrypto -lgmp

OpenBenchmarking.orgkH/s, More Is BetterCpuminer-Opt 3.18Algorithm: Blake-2 SAVX-512 OffAVX-512 OnAVX-512 On 512200K400K600K800K1000KSE +/- 382.81, N = 3SE +/- 9836.24, N = 3SE +/- 7851.09, N = 15393213862110895513-mno-avx512f1. (CXX) g++ options: -O3 -march=native -lcurl -lz -lpthread -lssl -lcrypto -lgmp

OpenBenchmarking.orgkH/s, More Is BetterCpuminer-Opt 3.18Algorithm: x25xAVX-512 OffAVX-512 OnAVX-512 On 51280160240320400SE +/- 0.48, N = 3SE +/- 1.89, N = 3SE +/- 7.53, N = 12359.01387.72379.94-mno-avx512f1. (CXX) g++ options: -O3 -march=native -lcurl -lz -lpthread -lssl -lcrypto -lgmp

AI Benchmark Alpha

OpenBenchmarking.orgMegahertz, More Is BetterAI Benchmark Alpha 0.1.2CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 OnAVX-512 On 5129001800270036004500Min: 4700 / Avg: 4852.05 / Max: 5308Min: 3500 / Avg: 4834.52 / Max: 5302Min: 3475 / Avg: 4839.25 / Max: 5311

Neural Magic DeepSparse

OpenBenchmarking.orgMegahertz, More Is BetterNeural Magic DeepSparse 1.1CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 OnAVX-512 On 5129001800270036004500Min: 4700 / Avg: 4850.7 / Max: 5301Min: 4651 / Avg: 4793.56 / Max: 5300Min: 4669 / Avg: 4825.21 / Max: 5300

OpenBenchmarking.orgMegahertz, More Is BetterNeural Magic DeepSparse 1.1CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 OnAVX-512 On 5129001800270036004500Min: 4700 / Avg: 4864.38 / Max: 5300Min: 4550 / Avg: 4788.85 / Max: 5300Min: 3500 / Avg: 4771.09 / Max: 5310

OpenBenchmarking.orgMegahertz, More Is BetterNeural Magic DeepSparse 1.1CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 OnAVX-512 On 5129001800270036004500Min: 4700 / Avg: 4829.28 / Max: 5301Min: 4700 / Avg: 4769.5 / Max: 5309Min: 4700 / Avg: 4800.61 / Max: 5310

OpenBenchmarking.orgMegahertz, More Is BetterNeural Magic DeepSparse 1.1CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 OnAVX-512 On 5129001800270036004500Min: 4700 / Avg: 4802.88 / Max: 5301Min: 4700 / Avg: 4777.02 / Max: 5300Min: 4700 / Avg: 4777.6 / Max: 5301

OpenBenchmarking.orgMegahertz, More Is BetterNeural Magic DeepSparse 1.1CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 OnAVX-512 On 5129001800270036004500Min: 4700 / Avg: 4780.8 / Max: 5312Min: 3556 / Avg: 4766.8 / Max: 5302Min: 4631 / Avg: 4780.28 / Max: 5300

OpenBenchmarking.orgMegahertz, More Is BetterNeural Magic DeepSparse 1.1CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 OnAVX-512 On 5129001800270036004500Min: 4700 / Avg: 4768.47 / Max: 5302Min: 3500 / Avg: 4648.5 / Max: 5302Min: 3500 / Avg: 4682.19 / Max: 5300

OpenBenchmarking.orgMegahertz, More Is BetterNeural Magic DeepSparse 1.1CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 OnAVX-512 On 5129001800270036004500Min: 4700 / Avg: 4847.56 / Max: 5310Min: 3500 / Avg: 4747.88 / Max: 5310Min: 4575 / Avg: 4802.05 / Max: 5300

OpenBenchmarking.orgMegahertz, More Is BetterNeural Magic DeepSparse 1.1CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 OnAVX-512 On 5129001800270036004500Min: 4700 / Avg: 4862.17 / Max: 5301Min: 3500 / Avg: 4711.32 / Max: 5304Min: 4389 / Avg: 4809.78 / Max: 5300

OpenBenchmarking.orgMegahertz, More Is BetterNeural Magic DeepSparse 1.1CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 OnAVX-512 On 5129001800270036004500Min: 4700 / Avg: 4884.74 / Max: 5310Min: 4700 / Avg: 4810.87 / Max: 5300Min: 4700 / Avg: 4865.03 / Max: 5312

OpenBenchmarking.orgMegahertz, More Is BetterNeural Magic DeepSparse 1.1CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 OnAVX-512 On 5129001800270036004500Min: 4700 / Avg: 4899.77 / Max: 5314Min: 4700 / Avg: 4803.42 / Max: 5300Min: 4700 / Avg: 4813.34 / Max: 5300

OpenBenchmarking.orgMegahertz, More Is BetterNeural Magic DeepSparse 1.1CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 OnAVX-512 On 5129001800270036004500Min: 4700 / Avg: 4792.9 / Max: 5300Min: 4700 / Avg: 4785.87 / Max: 5309Min: 4700 / Avg: 4796.86 / Max: 5302

OpenBenchmarking.orgMegahertz, More Is BetterNeural Magic DeepSparse 1.1CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 OnAVX-512 On 5129001800270036004500Min: 4700 / Avg: 4785.41 / Max: 5300Min: 3578 / Avg: 4752.98 / Max: 5300Min: 4700 / Avg: 4783.64 / Max: 5301

OpenBenchmarking.orgMegahertz, More Is BetterNeural Magic DeepSparse 1.1CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 OnAVX-512 On 5129001800270036004500Min: 4700 / Avg: 4854.95 / Max: 5363Min: 3500 / Avg: 4768.23 / Max: 5302Min: 4587 / Avg: 4805.51 / Max: 5300

OpenBenchmarking.orgMegahertz, More Is BetterNeural Magic DeepSparse 1.1CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 OnAVX-512 On 5129001800270036004500Min: 4700 / Avg: 4864.76 / Max: 5300Min: 3500 / Avg: 4712.83 / Max: 5302Min: 3500 / Avg: 4792.63 / Max: 5301

OpenRadioss

OpenBenchmarking.orgMegahertz, More Is BetterOpenRadioss 2022.10.13CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 OnAVX-512 On 5129001800270036004500Min: 4700 / Avg: 4764.39 / Max: 5301Min: 4700 / Avg: 4738.14 / Max: 5300Min: 4700 / Avg: 4752.2 / Max: 5302

OpenBenchmarking.orgMegahertz, More Is BetterOpenRadioss 2022.10.13CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 OnAVX-512 On 5129001800270036004500Min: 4700 / Avg: 4789.33 / Max: 5302Min: 4700 / Avg: 4744.78 / Max: 5300Min: 4700 / Avg: 4746.34 / Max: 5300

OpenBenchmarking.orgMegahertz, More Is BetterOpenRadioss 2022.10.13CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 OnAVX-512 On 5129001800270036004500Min: 4700 / Avg: 4779.68 / Max: 5309Min: 4700 / Avg: 4776.23 / Max: 5300Min: 4700 / Avg: 4779.74 / Max: 5300

OpenBenchmarking.orgMegahertz, More Is BetterOpenRadioss 2022.10.13CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 OnAVX-512 On 5129001800270036004500Min: 4700 / Avg: 4725.71 / Max: 5303Min: 4700 / Avg: 4728.36 / Max: 5300Min: 4700 / Avg: 4723.82 / Max: 5299

OpenBenchmarking.orgMegahertz, More Is BetterOpenRadioss 2022.10.13CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 OnAVX-512 On 5129001800270036004500Min: 4700 / Avg: 4796.02 / Max: 5300Min: 4700 / Avg: 4786.9 / Max: 5311Min: 4700 / Avg: 4786.28 / Max: 5301

OpenFOAM

OpenBenchmarking.orgMegahertz, More Is BetterOpenFOAM 10CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 OnAVX-512 On 5129001800270036004500Min: 4731 / Avg: 4807.69 / Max: 5300Min: 4700 / Avg: 4805.98 / Max: 5300Min: 4700 / Avg: 4808.62 / Max: 5301

LeelaChessZero

OpenBenchmarking.orgMegahertz, More Is BetterLeelaChessZero 0.28CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 OnAVX-512 On 5129001800270036004500Min: 4700 / Avg: 4730.95 / Max: 5300Min: 4700 / Avg: 4714.39 / Max: 5302Min: 4700 / Avg: 4715.02 / Max: 5309

OpenBenchmarking.orgMegahertz, More Is BetterLeelaChessZero 0.28CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 OnAVX-512 On 5129001800270036004500Min: 4700 / Avg: 4742.26 / Max: 5300Min: 4700 / Avg: 4716.16 / Max: 5309Min: 4700 / Avg: 4714.46 / Max: 5300

OSPRay Studio

OpenBenchmarking.orgMegahertz, More Is BetterOSPRay Studio 0.11CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 OnAVX-512 On 5129001800270036004500Min: 4700 / Avg: 4759.8 / Max: 5300Min: 3500 / Avg: 4719.74 / Max: 5310Min: 4572 / Avg: 4702.26 / Max: 5300

OpenBenchmarking.orgMegahertz, More Is BetterOSPRay Studio 0.11CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 OnAVX-512 On 5129001800270036004500Min: 4700 / Avg: 4759.97 / Max: 5300Min: 4567 / Avg: 4716.26 / Max: 5300Min: 3453 / Avg: 4694.88 / Max: 5301

OpenBenchmarking.orgMegahertz, More Is BetterOSPRay Studio 0.11CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 OnAVX-512 On 5129001800270036004500Min: 4700 / Avg: 4791.69 / Max: 5308Min: 3426 / Avg: 4746.5 / Max: 5300Min: 4600 / Avg: 4754.09 / Max: 5300

OpenBenchmarking.orgMegahertz, More Is BetterOSPRay Studio 0.11CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 OnAVX-512 On 5129001800270036004500Min: 4700 / Avg: 4745.23 / Max: 5313Min: 3461 / Avg: 4676.99 / Max: 5300Min: 4570 / Avg: 4680.41 / Max: 5300

OpenBenchmarking.orgMegahertz, More Is BetterOSPRay Studio 0.11CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 OnAVX-512 On 5129001800270036004500Min: 4700 / Avg: 4747.54 / Max: 5300Min: 3477 / Avg: 4691.4 / Max: 5300Min: 3446 / Avg: 4670.53 / Max: 5310

OpenBenchmarking.orgMegahertz, More Is BetterOSPRay Studio 0.11CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 OnAVX-512 On 5129001800270036004500Min: 4700 / Avg: 4726.06 / Max: 5300Min: 3450 / Avg: 4627.77 / Max: 5304Min: 4546 / Avg: 4639.07 / Max: 5300

OpenBenchmarking.orgMegahertz, More Is BetterOSPRay Studio 0.11CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 OnAVX-512 On 5129001800270036004500Min: 4700 / Avg: 4753.65 / Max: 5300Min: 4576 / Avg: 4701.44 / Max: 5300Min: 4571 / Avg: 4680.45 / Max: 5300

OpenBenchmarking.orgMegahertz, More Is BetterOSPRay Studio 0.11CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 OnAVX-512 On 5129001800270036004500Min: 4700 / Avg: 4753.09 / Max: 5326Min: 4561 / Avg: 4700.89 / Max: 5300Min: 4570 / Avg: 4692.8 / Max: 5300

OpenBenchmarking.orgMegahertz, More Is BetterOSPRay Studio 0.11CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 OnAVX-512 On 5129001800270036004500Min: 4700 / Avg: 4778.13 / Max: 5310Min: 3465 / Avg: 4730.1 / Max: 5300Min: 4570 / Avg: 4723.71 / Max: 5300

OpenBenchmarking.orgMegahertz, More Is BetterOSPRay Studio 0.11CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 OnAVX-512 On 5129001800270036004500Min: 4700 / Avg: 4785.08 / Max: 5300Min: 4564 / Avg: 4690.88 / Max: 5300Min: 3500 / Avg: 4665.37 / Max: 5300

OpenBenchmarking.orgMegahertz, More Is BetterOSPRay Studio 0.11CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 OnAVX-512 On 5129001800270036004500Min: 4700 / Avg: 4740.31 / Max: 5310Min: 4564 / Avg: 4689.08 / Max: 5307Min: 3500 / Avg: 4671.61 / Max: 5300

OpenBenchmarking.orgMegahertz, More Is BetterOSPRay Studio 0.11CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 OnAVX-512 On 5129001800270036004500Min: 4700 / Avg: 4722.23 / Max: 5309Min: 4557 / Avg: 4641.27 / Max: 5300Min: 4550 / Avg: 4626.21 / Max: 5300

oneDNN

OpenBenchmarking.orgMegahertz, More Is BetteroneDNN 2.7CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 OnAVX-512 On 5129001800270036004500Min: 4800 / Avg: 4945.85 / Max: 5300Min: 4700 / Avg: 4896.54 / Max: 5300Min: 4700 / Avg: 4879.13 / Max: 5300

OpenBenchmarking.orgMegahertz, More Is BetteroneDNN 2.7CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 OnAVX-512 On 5129001800270036004500Min: 4800 / Avg: 4940.32 / Max: 5300Min: 4700 / Avg: 4892.18 / Max: 5300Min: 4700 / Avg: 4884.79 / Max: 5300

OpenBenchmarking.orgMegahertz, More Is BetteroneDNN 2.7CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OnAVX-512 On 5129001800270036004500Min: 4700 / Avg: 4894.72 / Max: 5300Min: 4700 / Avg: 4872.99 / Max: 5300

OpenBenchmarking.orgMegahertz, More Is BetteroneDNN 2.7CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 OnAVX-512 On 5129001800270036004500Min: 4700 / Avg: 4788.28 / Max: 5100Min: 4700 / Avg: 4787.19 / Max: 5300Min: 4700 / Avg: 4787.63 / Max: 5228

OpenBenchmarking.orgMegahertz, More Is BetteroneDNN 2.7CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 OnAVX-512 On 5129001800270036004500Min: 4700 / Avg: 4797.64 / Max: 5309Min: 3426 / Avg: 4750.48 / Max: 5310Min: 3430 / Avg: 4699.55 / Max: 5139

OpenBenchmarking.orgMegahertz, More Is BetteroneDNN 2.7CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OnAVX-512 On 5129001800270036004500Min: 4700 / Avg: 4772.18 / Max: 5298Min: 4700 / Avg: 4768.42 / Max: 5101

OpenBenchmarking.orgMegahertz, More Is BetteroneDNN 2.7CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 OnAVX-512 On 5129001800270036004500Min: 4721 / Avg: 4966.06 / Max: 5300Min: 4700 / Avg: 4987.92 / Max: 5312Min: 4700 / Avg: 4931.38 / Max: 5267

OpenBenchmarking.orgMegahertz, More Is BetteroneDNN 2.7CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 OnAVX-512 On 5129001800270036004500Min: 4700 / Avg: 4953.98 / Max: 5300Min: 4700 / Avg: 4984.13 / Max: 5309Min: 4700 / Avg: 4983.09 / Max: 5312

OpenBenchmarking.orgMegahertz, More Is BetteroneDNN 2.7CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OnAVX-512 On 5129001800270036004500Min: 4700 / Avg: 4987.32 / Max: 5308Min: 4700 / Avg: 4940.08 / Max: 5300

OpenBenchmarking.orgMegahertz, More Is BetteroneDNN 2.7CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 OnAVX-512 On 5129001800270036004500Min: 4700 / Avg: 4801.83 / Max: 5299Min: 4700 / Avg: 4798.47 / Max: 5302Min: 4700 / Avg: 4796.3 / Max: 5300

OpenBenchmarking.orgMegahertz, More Is BetteroneDNN 2.7CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 OnAVX-512 On 5129001800270036004500Min: 4700 / Avg: 4797.83 / Max: 5306Min: 4700 / Avg: 4792.74 / Max: 5301Min: 4700 / Avg: 4794.07 / Max: 5308

OpenBenchmarking.orgMegahertz, More Is BetteroneDNN 2.7CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OnAVX-512 On 5129001800270036004500Min: 4700 / Avg: 4799.03 / Max: 5300Min: 4700 / Avg: 4796.12 / Max: 5300

OpenBenchmarking.orgMegahertz, More Is BetteroneDNN 2.7CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 OnAVX-512 On 5129001800270036004500Min: 4789 / Avg: 4907.45 / Max: 5306Min: 4700 / Avg: 4834.06 / Max: 5301Min: 4700 / Avg: 4835.06 / Max: 5300

OpenBenchmarking.orgMegahertz, More Is BetteroneDNN 2.7CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 OnAVX-512 On 5129001800270036004500Min: 4753 / Avg: 4904.44 / Max: 5300Min: 4700 / Avg: 4847.06 / Max: 5310Min: 4700 / Avg: 4828.02 / Max: 5149

OpenBenchmarking.orgMegahertz, More Is BetteroneDNN 2.7CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OnAVX-512 On 5129001800270036004500Min: 4700 / Avg: 4840.23 / Max: 5303Min: 4700 / Avg: 4825.21 / Max: 5297

OpenBenchmarking.orgMegahertz, More Is BetteroneDNN 2.7CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 OnAVX-512 On 5129001800270036004500Min: 4800 / Avg: 4883.85 / Max: 5307Min: 4700 / Avg: 4817.98 / Max: 5300Min: 4700 / Avg: 4805.17 / Max: 5300

OpenBenchmarking.orgMegahertz, More Is BetteroneDNN 2.7CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 OnAVX-512 On 5129001800270036004500Min: 4700 / Avg: 4857.73 / Max: 5270Min: 4700 / Avg: 4831.27 / Max: 5300Min: 4700 / Avg: 4824.57 / Max: 5300

OpenBenchmarking.orgMegahertz, More Is BetteroneDNN 2.7CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OnAVX-512 On 5129001800270036004500Min: 4700 / Avg: 4826.46 / Max: 5302Min: 4700 / Avg: 4807.8 / Max: 5221

OpenBenchmarking.orgMegahertz, More Is BetteroneDNN 2.7CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 OnAVX-512 On 5129001800270036004500Min: 4700 / Avg: 4733.47 / Max: 5312Min: 4649 / Avg: 4725.14 / Max: 5300Min: 3500 / Avg: 4710.26 / Max: 5301

OpenBenchmarking.orgMegahertz, More Is BetteroneDNN 2.7CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 OnAVX-512 On 5129001800270036004500Min: 4700 / Avg: 4726.9 / Max: 5300Min: 3500 / Avg: 4678.34 / Max: 5300Min: 3500 / Avg: 4667.49 / Max: 5300

OpenBenchmarking.orgMegahertz, More Is BetteroneDNN 2.7CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 OnAVX-512 On 5129001800270036004500Min: 4700 / Avg: 4729.18 / Max: 5303Min: 3500 / Avg: 4672.78 / Max: 5309Min: 3500 / Avg: 4674.91 / Max: 5181

OpenBenchmarking.orgMegahertz, More Is BetteroneDNN 2.7CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 OnAVX-512 On 5129001800270036004500Min: 4700 / Avg: 4732.36 / Max: 5300Min: 3500 / Avg: 4683.06 / Max: 5300Min: 4573 / Avg: 4707.8 / Max: 5300

OpenBenchmarking.orgMegahertz, More Is BetteroneDNN 2.7CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 OnAVX-512 On 5129001800270036004500Min: 4700 / Avg: 4725.04 / Max: 5303Min: 3524 / Avg: 4668.41 / Max: 5291Min: 3500 / Avg: 4673.77 / Max: 5300

OpenBenchmarking.orgMegahertz, More Is BetteroneDNN 2.7CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 OnAVX-512 On 5129001800270036004500Min: 4700 / Avg: 4729.07 / Max: 5300Min: 3545 / Avg: 4698.05 / Max: 5302Min: 3500 / Avg: 4678.88 / Max: 5300

Mobile Neural Network

OpenBenchmarking.orgMegahertz, More Is BetterMobile Neural Network 2.1CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 OnAVX-512 On 5129001800270036004500Min: 4700 / Avg: 4718.12 / Max: 5300Min: 3483 / Avg: 4653.2 / Max: 5308Min: 3500 / Avg: 4644.38 / Max: 5300

NCNN

OpenBenchmarking.orgMegahertz, More Is BetterNCNN 20220729CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 OnAVX-512 On 5129001800270036004500Min: 4724 / Avg: 4816.34 / Max: 5306Min: 4700 / Avg: 4729.61 / Max: 5300Min: 4700 / Avg: 4737.32 / Max: 5298

TNN

OpenBenchmarking.orgMegahertz, More Is BetterTNN 0.3CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 OnAVX-512 On 5129001800270036004500Min: 4800 / Avg: 5120.83 / Max: 5304Min: 4800 / Avg: 5103.01 / Max: 5306Min: 4800 / Avg: 5095.33 / Max: 5300

OpenBenchmarking.orgMegahertz, More Is BetterTNN 0.3CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 OnAVX-512 On 5129001800270036004500Min: 4800 / Avg: 5114.03 / Max: 5304Min: 4800 / Avg: 5109.16 / Max: 5300Min: 4800 / Avg: 5072.03 / Max: 5313

OpenBenchmarking.orgMegahertz, More Is BetterTNN 0.3CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 OnAVX-512 On 5129001800270036004500Min: 5100 / Avg: 5253.76 / Max: 5300Min: 5100 / Avg: 5282.12 / Max: 5304Min: 5099 / Avg: 5261.41 / Max: 5300

OpenBenchmarking.orgMegahertz, More Is BetterTNN 0.3CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 OnAVX-512 On 5129001800270036004500Min: 5100 / Avg: 5198.88 / Max: 5304Min: 5099 / Avg: 5219.48 / Max: 5310Min: 5100 / Avg: 5205.02 / Max: 5305

OpenVINO

OpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2022.2.devCPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 OnAVX-512 On 5129001800270036004500Min: 3689 / Avg: 4731.52 / Max: 5300Min: 3429 / Avg: 4599.8 / Max: 5310Min: 3424 / Avg: 4605.82 / Max: 5143

OpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2022.2.devCPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 OnAVX-512 On 5129001800270036004500Min: 3600 / Avg: 4630.48 / Max: 5300Min: 3486 / Avg: 4562.25 / Max: 5300Min: 3417 / Avg: 4571.49 / Max: 5308

OpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2022.2.devCPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 OnAVX-512 On 5129001800270036004500Min: 4700 / Avg: 4741.63 / Max: 5304Min: 3467 / Avg: 4665.94 / Max: 5302Min: 3400 / Avg: 4621.94 / Max: 5300

OpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2022.2.devCPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 OnAVX-512 On 5129001800270036004500Min: 4700 / Avg: 4738.5 / Max: 5300Min: 3400 / Avg: 4624.71 / Max: 5302Min: 3408 / Avg: 4610.19 / Max: 5310

OpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2022.2.devCPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 OnAVX-512 On 5129001800270036004500Min: 4700 / Avg: 4762.25 / Max: 5300Min: 3434 / Avg: 4623.02 / Max: 5300Min: 3439 / Avg: 4662.38 / Max: 5300

OpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2022.2.devCPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 OnAVX-512 On 5129001800270036004500Min: 4700 / Avg: 4766.42 / Max: 5300Min: 3400 / Avg: 4531.88 / Max: 5300Min: 3400 / Avg: 4584.47 / Max: 5300

OpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2022.2.devCPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 OnAVX-512 On 5129001800270036004500Min: 3600 / Avg: 4614.52 / Max: 5300Min: 3500 / Avg: 4589.65 / Max: 5300Min: 3500 / Avg: 4603.65 / Max: 5199

OpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2022.2.devCPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 OnAVX-512 On 5129001800270036004500Min: 4007 / Avg: 4734.73 / Max: 5300Min: 3500 / Avg: 4571.82 / Max: 5303Min: 3000 / Avg: 4570.85 / Max: 5186

OpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2022.2.devCPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 OnAVX-512 On 5129001800270036004500Min: 3648 / Avg: 4621.73 / Max: 5300Min: 3451 / Avg: 4568.22 / Max: 5300Min: 2700 / Avg: 4559.24 / Max: 5300

OpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2022.2.devCPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 OnAVX-512 On 51210002000300040005000Min: 4700 / Avg: 4746.45 / Max: 5621Min: 4700 / Avg: 4730.05 / Max: 5300Min: 4700 / Avg: 4729.11 / Max: 5314

OpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2022.2.devCPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 OnAVX-512 On 5129001800270036004500Min: 4700 / Avg: 4735.41 / Max: 5311Min: 4700 / Avg: 4733.54 / Max: 5300Min: 4700 / Avg: 4730.67 / Max: 5300

OpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2022.2.devCPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 OnAVX-512 On 5129001800270036004500Min: 4700 / Avg: 4731.38 / Max: 5300Min: 3422 / Avg: 4604.88 / Max: 5300Min: 3403 / Avg: 4632.52 / Max: 5130

Numpy Benchmark

OpenBenchmarking.orgMegahertz, More Is BetterNumpy BenchmarkCPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 OnAVX-512 On 5129001800270036004500Min: 5086 / Avg: 5292.12 / Max: 5306Min: 4905 / Avg: 5065.67 / Max: 5305Min: 4910 / Avg: 5058.87 / Max: 5300

GROMACS

OpenBenchmarking.orgMegahertz, More Is BetterGROMACS 2022.1CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 OnAVX-512 On 5129001800270036004500Min: 4700 / Avg: 4781.57 / Max: 5267Min: 4700 / Avg: 4784 / Max: 5300Min: 4700 / Avg: 4778.77 / Max: 5300

LeelaChessZero

OpenBenchmarking.orgNodes Per Second Per Watt, More Is BetterLeelaChessZero 0.28Backend: BLASAVX-512 OffAVX-512 OnAVX-512 On 5122468107.2956.0806.061

OpenBenchmarking.orgNodes Per Second, More Is BetterLeelaChessZero 0.28Backend: BLASAVX-512 OffAVX-512 OnAVX-512 On 51230060090012001500SE +/- 8.35, N = 3SE +/- 17.53, N = 3SE +/- 11.26, N = 9124012681273-mno-avx512f1. (CXX) g++ options: -flto -O3 -march=native -pthread

OpenBenchmarking.orgNodes Per Second, More Is BetterLeelaChessZero 0.28Backend: EigenAVX-512 OffAVX-512 OnAVX-512 On 51230060090012001500SE +/- 10.84, N = 5SE +/- 11.35, N = 3SE +/- 14.97, N = 3106211861194-mno-avx512f1. (CXX) g++ options: -flto -O3 -march=native -pthread

GROMACS

The GROMACS (GROningen MAchine for Chemical Simulations) molecular dynamics package testing with the water_GMX50 data. This test profile allows selecting between CPU and GPU-based GROMACS builds. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgNs Per Day, More Is BetterGROMACS 2022.1Implementation: MPI CPU - Input: water_GMX50_bareAVX-512 OffAVX-512 OnAVX-512 On 5120.23290.46580.69870.93161.1645SE +/- 0.002, N = 3SE +/- 0.004, N = 3SE +/- 0.001, N = 31.0201.0311.035-mno-avx512f1. (CXX) g++ options: -O3 -march=native

Meta Performance Per Watts

OpenBenchmarking.orgPerformance Per Watts, More Is BetterMeta Performance Per WattsPerformance Per WattsAVX-512 OffAVX-512 OnAVX-512 On 5124080120160200133.30170.75170.21

AI Benchmark Alpha

OpenBenchmarking.orgScore Per Watt, More Is BetterAI Benchmark Alpha 0.1.2Device AI ScoreAVX-512 OffAVX-512 OnAVX-512 On 51251015202516.7621.1721.26

OpenBenchmarking.orgScore, More Is BetterAI Benchmark Alpha 0.1.2Device Inference ScoreAVX-512 OffAVX-512 OnAVX-512 On 51230060090012001500141413761363

OpenBenchmarking.orgScore, More Is BetterAI Benchmark Alpha 0.1.2Device Training ScoreAVX-512 OffAVX-512 OnAVX-512 On 512400800120016002000128220692076

Numpy Benchmark

OpenBenchmarking.orgScore Per Watt, More Is BetterNumpy BenchmarkAVX-512 OffAVX-512 OnAVX-512 On 51236912159.73510.21110.293

AI Benchmark Alpha

AI Benchmark Alpha is a Python library for evaluating artificial intelligence (AI) performance on diverse hardware platforms and relies upon the TensorFlow machine learning library. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgScore, More Is BetterAI Benchmark Alpha 0.1.2Device AI ScoreAVX-512 OffAVX-512 OnAVX-512 On 5127001400210028003500269634453439

Numpy Benchmark

This is a test to obtain the general Numpy performance. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgScore, More Is BetterNumpy BenchmarkAVX-512 OffAVX-512 OnAVX-512 On 512140280420560700SE +/- 0.90, N = 3SE +/- 1.23, N = 3SE +/- 0.87, N = 3575.79631.24631.86

Neural Magic DeepSparse

OpenBenchmarking.orgCelsius, Fewer Is BetterNeural Magic DeepSparse 1.1CPU Temperature MonitorAVX-512 OffAVX-512 OnAVX-512 On 51220406080100Min: 35 / Avg: 69.17 / Max: 81Min: 39 / Avg: 79.78 / Max: 91Min: 38 / Avg: 77.04 / Max: 92

OpenBenchmarking.orgCelsius, Fewer Is BetterNeural Magic DeepSparse 1.1CPU Temperature MonitorAVX-512 OffAVX-512 OnAVX-512 On 51220406080100Min: 38 / Avg: 72.32 / Max: 85Min: 40 / Avg: 78.33 / Max: 92Min: 39 / Avg: 78.25 / Max: 94

OpenBenchmarking.orgCelsius, Fewer Is BetterNeural Magic DeepSparse 1.1CPU Temperature MonitorAVX-512 OffAVX-512 OnAVX-512 On 5121530456075Min: 38 / Avg: 66.44 / Max: 73Min: 40 / Avg: 72.9 / Max: 79Min: 38 / Avg: 69.89 / Max: 79

OpenBenchmarking.orgCelsius, Fewer Is BetterNeural Magic DeepSparse 1.1CPU Temperature MonitorAVX-512 OffAVX-512 OnAVX-512 On 5121632486480Min: 39 / Avg: 69.87 / Max: 78Min: 40 / Avg: 73.39 / Max: 81Min: 39 / Avg: 73.25 / Max: 82

OpenBenchmarking.orgCelsius, Fewer Is BetterNeural Magic DeepSparse 1.1CPU Temperature MonitorAVX-512 OffAVX-512 OnAVX-512 On 51220406080100Min: 39 / Avg: 74.18 / Max: 83Min: 38 / Avg: 79.49 / Max: 92Min: 39 / Avg: 81.82 / Max: 92

OpenBenchmarking.orgCelsius, Fewer Is BetterNeural Magic DeepSparse 1.1CPU Temperature MonitorAVX-512 OffAVX-512 OnAVX-512 On 51220406080100Min: 40 / Avg: 78.22 / Max: 86Min: 40 / Avg: 82.42 / Max: 94Min: 41 / Avg: 82.64 / Max: 96

OpenBenchmarking.orgCelsius, Fewer Is BetterNeural Magic DeepSparse 1.1CPU Temperature MonitorAVX-512 OffAVX-512 OnAVX-512 On 51220406080100Min: 38 / Avg: 71.71 / Max: 85Min: 39 / Avg: 78.7 / Max: 94Min: 39 / Avg: 79.14 / Max: 92

OpenBenchmarking.orgCelsius, Fewer Is BetterNeural Magic DeepSparse 1.1CPU Temperature MonitorAVX-512 OffAVX-512 OnAVX-512 On 51220406080100Min: 39 / Avg: 72.83 / Max: 87Min: 41 / Avg: 76.64 / Max: 95Min: 40 / Avg: 78.69 / Max: 92

OpenBenchmarking.orgCelsius, Fewer Is BetterNeural Magic DeepSparse 1.1CPU Temperature MonitorAVX-512 OffAVX-512 OnAVX-512 On 51220406080100Min: 38 / Avg: 64.6 / Max: 73Min: 39 / Avg: 75.07 / Max: 90Min: 38 / Avg: 73.65 / Max: 89

OpenBenchmarking.orgCelsius, Fewer Is BetterNeural Magic DeepSparse 1.1CPU Temperature MonitorAVX-512 OffAVX-512 OnAVX-512 On 51220406080100Min: 39 / Avg: 65.01 / Max: 75Min: 40 / Avg: 74.99 / Max: 88Min: 37 / Avg: 73.66 / Max: 88

OpenBenchmarking.orgCelsius, Fewer Is BetterNeural Magic DeepSparse 1.1CPU Temperature MonitorAVX-512 OffAVX-512 OnAVX-512 On 51220406080100Min: 38 / Avg: 73.22 / Max: 82Min: 39 / Avg: 80.23 / Max: 93Min: 39 / Avg: 80.25 / Max: 92

OpenBenchmarking.orgCelsius, Fewer Is BetterNeural Magic DeepSparse 1.1CPU Temperature MonitorAVX-512 OffAVX-512 OnAVX-512 On 51220406080100Min: 39 / Avg: 74.07 / Max: 85Min: 40 / Avg: 80.82 / Max: 93Min: 39 / Avg: 80.84 / Max: 95

OpenBenchmarking.orgCelsius, Fewer Is BetterNeural Magic DeepSparse 1.1CPU Temperature MonitorAVX-512 OffAVX-512 OnAVX-512 On 51220406080100Min: 38 / Avg: 71.94 / Max: 85Min: 38 / Avg: 79.14 / Max: 93Min: 39 / Avg: 79.22 / Max: 92

OpenBenchmarking.orgCelsius, Fewer Is BetterNeural Magic DeepSparse 1.1CPU Temperature MonitorAVX-512 OffAVX-512 OnAVX-512 On 51220406080100Min: 39 / Avg: 72.53 / Max: 86Min: 39 / Avg: 77.07 / Max: 96Min: 40 / Avg: 78.84 / Max: 95

OpenRadioss

OpenBenchmarking.orgCelsius, Fewer Is BetterOpenRadioss 2022.10.13CPU Temperature MonitorAVX-512 OffAVX-512 OnAVX-512 On 5121428425670Min: 38 / Avg: 70.2 / Max: 74Min: 39 / Avg: 70.71 / Max: 75Min: 40 / Avg: 70.47 / Max: 75

OpenBenchmarking.orgCelsius, Fewer Is BetterOpenRadioss 2022.10.13CPU Temperature MonitorAVX-512 OffAVX-512 OnAVX-512 On 5121428425670Min: 38 / Avg: 69.59 / Max: 73Min: 38 / Avg: 70.36 / Max: 75Min: 38 / Avg: 70.17 / Max: 75

OpenBenchmarking.orgCelsius, Fewer Is BetterOpenRadioss 2022.10.13CPU Temperature MonitorAVX-512 OffAVX-512 OnAVX-512 On 5121530456075Min: 39 / Avg: 69.57 / Max: 75Min: 39 / Avg: 69.91 / Max: 76Min: 39 / Avg: 69.64 / Max: 75

OpenBenchmarking.orgCelsius, Fewer Is BetterOpenRadioss 2022.10.13CPU Temperature MonitorAVX-512 OffAVX-512 OnAVX-512 On 5121530456075Min: 39 / Avg: 72.15 / Max: 77Min: 39 / Avg: 72.25 / Max: 77Min: 39 / Avg: 72.17 / Max: 77

OpenBenchmarking.orgCelsius, Fewer Is BetterOpenRadioss 2022.10.13CPU Temperature MonitorAVX-512 OffAVX-512 OnAVX-512 On 5121530456075Min: 38 / Avg: 69.5 / Max: 75Min: 39 / Avg: 70.02 / Max: 75Min: 38 / Avg: 69.98 / Max: 76

OpenFOAM

OpenBenchmarking.orgCelsius, Fewer Is BetterOpenFOAM 10CPU Temperature MonitorAVX-512 OffAVX-512 OnAVX-512 On 5121428425670Min: 38 / Avg: 60.32 / Max: 71Min: 38 / Avg: 61.46 / Max: 73Min: 38 / Avg: 61.09 / Max: 71

OSPRay Studio

OpenBenchmarking.orgCelsius, Fewer Is BetterOSPRay Studio 0.11CPU Temperature MonitorAVX-512 OffAVX-512 OnAVX-512 On 51220406080100Min: 38 / Avg: 78.1 / Max: 84Min: 38 / Avg: 85.39 / Max: 96Min: 38 / Avg: 86.37 / Max: 93

OpenBenchmarking.orgCelsius, Fewer Is BetterOSPRay Studio 0.11CPU Temperature MonitorAVX-512 OffAVX-512 OnAVX-512 On 51220406080100Min: 40 / Avg: 78.59 / Max: 84Min: 41 / Avg: 86.33 / Max: 94Min: 41 / Avg: 86.12 / Max: 95

OpenBenchmarking.orgCelsius, Fewer Is BetterOSPRay Studio 0.11CPU Temperature MonitorAVX-512 OffAVX-512 OnAVX-512 On 51220406080100Min: 40 / Avg: 76.62 / Max: 83Min: 42 / Avg: 84.38 / Max: 94Min: 41 / Avg: 84.26 / Max: 91

OpenBenchmarking.orgCelsius, Fewer Is BetterOSPRay Studio 0.11CPU Temperature MonitorAVX-512 OffAVX-512 OnAVX-512 On 51220406080100Min: 41 / Avg: 79.36 / Max: 84Min: 40 / Avg: 87.2 / Max: 96Min: 41 / Avg: 87.44 / Max: 93

OpenBenchmarking.orgCelsius, Fewer Is BetterOSPRay Studio 0.11CPU Temperature MonitorAVX-512 OffAVX-512 OnAVX-512 On 51220406080100Min: 40 / Avg: 79.03 / Max: 84Min: 41 / Avg: 86.52 / Max: 93Min: 42 / Avg: 87.16 / Max: 95

OpenBenchmarking.orgCelsius, Fewer Is BetterOSPRay Studio 0.11CPU Temperature MonitorAVX-512 OffAVX-512 OnAVX-512 On 51220406080100Min: 40 / Avg: 80.21 / Max: 84Min: 42 / Avg: 88.05 / Max: 96Min: 41 / Avg: 88.34 / Max: 94

OpenBenchmarking.orgCelsius, Fewer Is BetterOSPRay Studio 0.11CPU Temperature MonitorAVX-512 OffAVX-512 OnAVX-512 On 51220406080100Min: 39 / Avg: 78.14 / Max: 88Min: 41 / Avg: 86.94 / Max: 91Min: 42 / Avg: 87.08 / Max: 93

OpenBenchmarking.orgCelsius, Fewer Is BetterOSPRay Studio 0.11CPU Temperature MonitorAVX-512 OffAVX-512 OnAVX-512 On 51220406080100Min: 40 / Avg: 78.9 / Max: 84Min: 41 / Avg: 86.58 / Max: 95Min: 42 / Avg: 86.55 / Max: 92

OpenBenchmarking.orgCelsius, Fewer Is BetterOSPRay Studio 0.11CPU Temperature MonitorAVX-512 OffAVX-512 OnAVX-512 On 51220406080100Min: 40 / Avg: 76.99 / Max: 83Min: 41 / Avg: 84.31 / Max: 94Min: 42 / Avg: 85.88 / Max: 91

OpenBenchmarking.orgCelsius, Fewer Is BetterOSPRay Studio 0.11CPU Temperature MonitorAVX-512 OffAVX-512 OnAVX-512 On 51220406080100Min: 40 / Avg: 76.25 / Max: 85Min: 41 / Avg: 87.29 / Max: 92Min: 41 / Avg: 87.49 / Max: 93

OpenBenchmarking.orgCelsius, Fewer Is BetterOSPRay Studio 0.11CPU Temperature MonitorAVX-512 OffAVX-512 OnAVX-512 On 51220406080100Min: 39 / Avg: 78.83 / Max: 83Min: 41 / Avg: 87.07 / Max: 91Min: 41 / Avg: 87.32 / Max: 93

OpenBenchmarking.orgCelsius, Fewer Is BetterOSPRay Studio 0.11CPU Temperature MonitorAVX-512 OffAVX-512 OnAVX-512 On 51220406080100Min: 40 / Avg: 80.67 / Max: 84Min: 42 / Avg: 88.64 / Max: 93Min: 43 / Avg: 88.73 / Max: 96

oneDNN

OpenBenchmarking.orgCelsius, Fewer Is BetteroneDNN 2.7CPU Temperature MonitorAVX-512 OffAVX-512 OnAVX-512 On 5121326395265Min: 39 / Avg: 54 / Max: 63Min: 40 / Avg: 56.59 / Max: 68Min: 41 / Avg: 57.77 / Max: 69

OpenBenchmarking.orgCelsius, Fewer Is BetteroneDNN 2.7CPU Temperature MonitorAVX-512 OffAVX-512 OnAVX-512 On 5121326395265Min: 36 / Avg: 50.61 / Max: 60Min: 38 / Avg: 53.03 / Max: 64Min: 37 / Avg: 53.8 / Max: 65

OpenBenchmarking.orgCelsius, Fewer Is BetteroneDNN 2.7CPU Temperature MonitorAVX-512 OnAVX-512 On 5121530456075Min: 36 / Avg: 59.56 / Max: 76Min: 36 / Avg: 59.45 / Max: 76

OpenBenchmarking.orgCelsius, Fewer Is BetteroneDNN 2.7CPU Temperature MonitorAVX-512 OffAVX-512 OnAVX-512 On 51220406080100Min: 32 / Avg: 63.64 / Max: 79Min: 36 / Avg: 73.12 / Max: 90Min: 38 / Avg: 73.45 / Max: 90

OpenBenchmarking.orgCelsius, Fewer Is BetteroneDNN 2.7CPU Temperature MonitorAVX-512 OffAVX-512 OnAVX-512 On 51220406080100Min: 37 / Avg: 68.37 / Max: 81Min: 39 / Avg: 76.57 / Max: 97Min: 40 / Avg: 76.51 / Max: 95

OpenBenchmarking.orgCelsius, Fewer Is BetteroneDNN 2.7CPU Temperature MonitorAVX-512 OnAVX-512 On 51220406080100Min: 39 / Avg: 74.22 / Max: 90Min: 39 / Avg: 74.99 / Max: 90

OpenBenchmarking.orgCelsius, Fewer Is BetteroneDNN 2.7CPU Temperature MonitorAVX-512 OffAVX-512 OnAVX-512 On 5121632486480Min: 34 / Avg: 51.76 / Max: 71Min: 39 / Avg: 56.03 / Max: 81Min: 39 / Avg: 58.3 / Max: 82

OpenBenchmarking.orgCelsius, Fewer Is BetteroneDNN 2.7CPU Temperature MonitorAVX-512 OffAVX-512 OnAVX-512 On 5121530456075Min: 35 / Avg: 52.66 / Max: 74Min: 35 / Avg: 53.89 / Max: 78Min: 36 / Avg: 55.78 / Max: 79

OpenBenchmarking.orgCelsius, Fewer Is BetteroneDNN 2.7CPU Temperature MonitorAVX-512 OnAVX-512 On 5121428425670Min: 34 / Avg: 49.81 / Max: 71Min: 36 / Avg: 53.02 / Max: 71

OpenBenchmarking.orgCelsius, Fewer Is BetteroneDNN 2.7CPU Temperature MonitorAVX-512 OffAVX-512 OnAVX-512 On 51220406080100Min: 31 / Avg: 66.53 / Max: 80Min: 34 / Avg: 71.48 / Max: 87Min: 35 / Avg: 71.51 / Max: 88

OpenBenchmarking.orgCelsius, Fewer Is BetteroneDNN 2.7CPU Temperature MonitorAVX-512 OffAVX-512 OnAVX-512 On 51220406080100Min: 38 / Avg: 67.95 / Max: 80Min: 39 / Avg: 75.8 / Max: 90Min: 40 / Avg: 76.38 / Max: 90

OpenBenchmarking.orgCelsius, Fewer Is BetteroneDNN 2.7CPU Temperature MonitorAVX-512 OnAVX-512 On 5121530456075Min: 39 / Avg: 68.31 / Max: 79Min: 41 / Avg: 68.97 / Max: 80

OpenBenchmarking.orgCelsius, Fewer Is BetteroneDNN 2.7CPU Temperature MonitorAVX-512 OffAVX-512 OnAVX-512 On 5121428425670Min: 34 / Avg: 54.35 / Max: 70Min: 39 / Avg: 59.67 / Max: 73Min: 40 / Avg: 59.91 / Max: 74

OpenBenchmarking.orgCelsius, Fewer Is BetteroneDNN 2.7CPU Temperature MonitorAVX-512 OffAVX-512 OnAVX-512 On 5121530456075Min: 35 / Avg: 56.98 / Max: 70Min: 38 / Avg: 61.41 / Max: 78Min: 38 / Avg: 61.88 / Max: 79

OpenBenchmarking.orgCelsius, Fewer Is BetteroneDNN 2.7CPU Temperature MonitorAVX-512 OnAVX-512 On 5121530456075Min: 37 / Avg: 62.76 / Max: 75Min: 38 / Avg: 63.8 / Max: 78

OpenBenchmarking.orgCelsius, Fewer Is BetteroneDNN 2.7CPU Temperature MonitorAVX-512 OffAVX-512 OnAVX-512 On 5121530456075Min: 32 / Avg: 54.62 / Max: 65Min: 38 / Avg: 62.72 / Max: 76Min: 39 / Avg: 63.95 / Max: 76

OpenBenchmarking.orgCelsius, Fewer Is BetteroneDNN 2.7CPU Temperature MonitorAVX-512 OffAVX-512 OnAVX-512 On 5121428425670Min: 36 / Avg: 60.25 / Max: 74Min: 38 / Avg: 64.16 / Max: 75Min: 38 / Avg: 63.12 / Max: 74

OpenBenchmarking.orgCelsius, Fewer Is BetteroneDNN 2.7CPU Temperature MonitorAVX-512 OnAVX-512 On 5121530456075Min: 38 / Avg: 63.03 / Max: 77Min: 39 / Avg: 64.2 / Max: 78

OpenBenchmarking.orgCelsius, Fewer Is BetteroneDNN 2.7CPU Temperature MonitorAVX-512 OffAVX-512 OnAVX-512 On 51220406080100Min: 33 / Avg: 78.87 / Max: 87Min: 37 / Avg: 84.81 / Max: 94Min: 38 / Avg: 84.54 / Max: 94

OpenBenchmarking.orgCelsius, Fewer Is BetteroneDNN 2.7CPU Temperature MonitorAVX-512 OffAVX-512 OnAVX-512 On 51220406080100Min: 39 / Avg: 80.93 / Max: 87Min: 40 / Avg: 84.18 / Max: 95Min: 41 / Avg: 85.38 / Max: 95

OpenBenchmarking.orgCelsius, Fewer Is BetteroneDNN 2.7CPU Temperature MonitorAVX-512 OffAVX-512 OnAVX-512 On 51220406080100Min: 40 / Avg: 80.45 / Max: 88Min: 41 / Avg: 83.9 / Max: 95Min: 41 / Avg: 84.88 / Max: 94

OpenBenchmarking.orgCelsius, Fewer Is BetteroneDNN 2.7CPU Temperature MonitorAVX-512 OffAVX-512 OnAVX-512 On 51220406080100Min: 40 / Avg: 79.82 / Max: 87Min: 41 / Avg: 83.26 / Max: 94Min: 42 / Avg: 85.26 / Max: 95

OpenBenchmarking.orgCelsius, Fewer Is BetteroneDNN 2.7CPU Temperature MonitorAVX-512 OffAVX-512 OnAVX-512 On 51220406080100Min: 40 / Avg: 79.86 / Max: 87Min: 40 / Avg: 84.09 / Max: 94Min: 42 / Avg: 84.75 / Max: 94

OpenBenchmarking.orgCelsius, Fewer Is BetteroneDNN 2.7CPU Temperature MonitorAVX-512 OffAVX-512 OnAVX-512 On 51220406080100Min: 39 / Avg: 79.8 / Max: 88Min: 41 / Avg: 83.69 / Max: 93Min: 41 / Avg: 85.51 / Max: 95

Mobile Neural Network

OpenBenchmarking.orgCelsius, Fewer Is BetterMobile Neural Network 2.1CPU Temperature MonitorAVX-512 OffAVX-512 OnAVX-512 On 51220406080100Min: 38 / Avg: 78.24 / Max: 84Min: 39 / Avg: 85.37 / Max: 95Min: 41 / Avg: 86.3 / Max: 95

NCNN

OpenBenchmarking.orgCelsius, Fewer Is BetterNCNN 20220729CPU Temperature MonitorAVX-512 OffAVX-512 OnAVX-512 On 5121632486480Min: 40 / Avg: 65.4 / Max: 71Min: 40 / Avg: 70.36 / Max: 80Min: 42 / Avg: 71.88 / Max: 87

TNN

OpenBenchmarking.orgCelsius, Fewer Is BetterTNN 0.3CPU Temperature MonitorAVX-512 OffAVX-512 OnAVX-512 On 5121326395265Min: 36 / Avg: 57.3 / Max: 67Min: 36 / Avg: 57.79 / Max: 68Min: 36 / Avg: 58.88 / Max: 69

OpenBenchmarking.orgCelsius, Fewer Is BetterTNN 0.3CPU Temperature MonitorAVX-512 OffAVX-512 OnAVX-512 On 5121326395265Min: 33 / Avg: 51.92 / Max: 64Min: 33 / Avg: 53.27 / Max: 64Min: 35 / Avg: 53.49 / Max: 67

OpenBenchmarking.orgCelsius, Fewer Is BetterTNN 0.3CPU Temperature MonitorAVX-512 OffAVX-512 OnAVX-512 On 5121224364860Min: 31 / Avg: 48.23 / Max: 58Min: 31 / Avg: 48.98 / Max: 58Min: 33 / Avg: 50.06 / Max: 61

OpenBenchmarking.orgCelsius, Fewer Is BetterTNN 0.3CPU Temperature MonitorAVX-512 OffAVX-512 OnAVX-512 On 5121326395265Min: 30 / Avg: 44.53 / Max: 64Min: 30 / Avg: 45.12 / Max: 64Min: 32 / Avg: 46.23 / Max: 65

OpenVINO

OpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2022.2.devCPU Temperature MonitorAVX-512 OffAVX-512 OnAVX-512 On 51220406080100Min: 61 / Avg: 84.02 / Max: 93Min: 35 / Avg: 84.78 / Max: 98Min: 39 / Avg: 86.41 / Max: 99

OpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2022.2.devCPU Temperature MonitorAVX-512 OffAVX-512 OnAVX-512 On 51220406080100Min: 60 / Avg: 84.66 / Max: 94Min: 40 / Avg: 85.93 / Max: 98Min: 40 / Avg: 82.79 / Max: 99

OpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2022.2.devCPU Temperature MonitorAVX-512 OffAVX-512 OnAVX-512 On 51220406080100Min: 60 / Avg: 83.29 / Max: 89Min: 39 / Avg: 87.24 / Max: 97Min: 38 / Avg: 85.65 / Max: 96

OpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2022.2.devCPU Temperature MonitorAVX-512 OffAVX-512 OnAVX-512 On 51220406080100Min: 61 / Avg: 85.95 / Max: 90Min: 40 / Avg: 87.04 / Max: 95Min: 41 / Avg: 86.73 / Max: 95

OpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2022.2.devCPU Temperature MonitorAVX-512 OffAVX-512 OnAVX-512 On 51220406080100Min: 61 / Avg: 84.05 / Max: 95Min: 40 / Avg: 86.76 / Max: 97Min: 41 / Avg: 87.35 / Max: 100

OpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2022.2.devCPU Temperature MonitorAVX-512 OffAVX-512 OnAVX-512 On 51220406080100Min: 59 / Avg: 84.96 / Max: 95Min: 40 / Avg: 86.02 / Max: 100Min: 41 / Avg: 86.88 / Max: 100

OpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2022.2.devCPU Temperature MonitorAVX-512 OffAVX-512 OnAVX-512 On 51220406080100Min: 60 / Avg: 87.45 / Max: 94Min: 41 / Avg: 86.74 / Max: 97Min: 41 / Avg: 87 / Max: 97

OpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2022.2.devCPU Temperature MonitorAVX-512 OffAVX-512 OnAVX-512 On 51220406080100Min: 61 / Avg: 86.8 / Max: 92Min: 42 / Avg: 86.73 / Max: 97Min: 40 / Avg: 87.33 / Max: 96

OpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2022.2.devCPU Temperature MonitorAVX-512 OffAVX-512 OnAVX-512 On 51220406080100Min: 63 / Avg: 85.86 / Max: 93Min: 41 / Avg: 87.16 / Max: 98Min: 41 / Avg: 87.07 / Max: 99

OpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2022.2.devCPU Temperature MonitorAVX-512 OffAVX-512 OnAVX-512 On 5121632486480Min: 60 / Avg: 73.94 / Max: 80Min: 41 / Avg: 76.53 / Max: 85Min: 40 / Avg: 76.21 / Max: 84

OpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2022.2.devCPU Temperature MonitorAVX-512 OffAVX-512 OnAVX-512 On 51220406080100Min: 44 / Avg: 76.67 / Max: 83Min: 40 / Avg: 80.87 / Max: 89Min: 40 / Avg: 81.03 / Max: 89

OpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2022.2.devCPU Temperature MonitorAVX-512 OffAVX-512 OnAVX-512 On 51220406080100Min: 40 / Avg: 80.98 / Max: 89Min: 40 / Avg: 84.75 / Max: 97Min: 40 / Avg: 85.67 / Max: 95

OSPRay Studio

Intel OSPRay Studio is an open-source, interactive visualization and ray-tracing software package. OSPRay Studio makes use of Intel OSPRay, a portable ray-tracing engine for high-performance, high-fidelity visualizations. OSPRay builds off Intel's Embree and Intel SPMD Program Compiler (ISPC) components as part of the oneAPI rendering toolkit. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.11Camera: 1 - Resolution: 1080p - Samples Per Pixel: 1 - Renderer: Path TracerAVX-512 OffAVX-512 OnAVX-512 On 5125001000150020002500SE +/- 1.45, N = 3SE +/- 18.66, N = 3SE +/- 3.51, N = 3213419581951-mno-avx512f1. (CXX) g++ options: -O3 -march=native -ldl

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.11Camera: 1 - Resolution: 1080p - Samples Per Pixel: 16 - Renderer: Path TracerAVX-512 OffAVX-512 OnAVX-512 On 5127K14K21K28K35KSE +/- 5.46, N = 3SE +/- 32.95, N = 3SE +/- 206.81, N = 3341123105431180-mno-avx512f1. (CXX) g++ options: -O3 -march=native -ldl

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.11Camera: 1 - Resolution: 1080p - Samples Per Pixel: 32 - Renderer: Path TracerAVX-512 OffAVX-512 OnAVX-512 On 51215K30K45K60K75KSE +/- 50.78, N = 3SE +/- 55.47, N = 3SE +/- 140.32, N = 3721456572365447-mno-avx512f1. (CXX) g++ options: -O3 -march=native -ldl

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.11Camera: 1 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path TracerAVX-512 OffAVX-512 OnAVX-512 On 5122K4K6K8K10KSE +/- 2.40, N = 3SE +/- 26.87, N = 3SE +/- 11.53, N = 3845077437734-mno-avx512f1. (CXX) g++ options: -O3 -march=native -ldl

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.11Camera: 1 - Resolution: 4K - Samples Per Pixel: 16 - Renderer: Path TracerAVX-512 OffAVX-512 OnAVX-512 On 51230K60K90K120K150KSE +/- 39.26, N = 3SE +/- 834.11, N = 3SE +/- 430.68, N = 3139519127267127540-mno-avx512f1. (CXX) g++ options: -O3 -march=native -ldl

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.11Camera: 1 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path TracerAVX-512 OffAVX-512 OnAVX-512 On 51260K120K180K240K300KSE +/- 100.66, N = 3SE +/- 259.35, N = 3SE +/- 784.12, N = 3275693251261250698-mno-avx512f1. (CXX) g++ options: -O3 -march=native -ldl

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.11Camera: 3 - Resolution: 1080p - Samples Per Pixel: 1 - Renderer: Path TracerAVX-512 OffAVX-512 OnAVX-512 On 5125001000150020002500SE +/- 2.85, N = 3SE +/- 3.76, N = 3SE +/- 2.33, N = 3256123582364-mno-avx512f1. (CXX) g++ options: -O3 -march=native -ldl

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.11Camera: 3 - Resolution: 1080p - Samples Per Pixel: 16 - Renderer: Path TracerAVX-512 OffAVX-512 OnAVX-512 On 5129K18K27K36K45KSE +/- 14.77, N = 3SE +/- 89.45, N = 3SE +/- 9.61, N = 3409483766237620-mno-avx512f1. (CXX) g++ options: -O3 -march=native -ldl

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.11Camera: 3 - Resolution: 1080p - Samples Per Pixel: 32 - Renderer: Path TracerAVX-512 OffAVX-512 OnAVX-512 On 51220K40K60K80K100KSE +/- 31.80, N = 3SE +/- 263.45, N = 3SE +/- 171.11, N = 3858547874678809-mno-avx512f1. (CXX) g++ options: -O3 -march=native -ldl

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.11Camera: 3 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path TracerAVX-512 OffAVX-512 OnAVX-512 On 5122K4K6K8K10KSE +/- 5.70, N = 3SE +/- 6.67, N = 3SE +/- 5.51, N = 31014893739376-mno-avx512f1. (CXX) g++ options: -O3 -march=native -ldl

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.11Camera: 3 - Resolution: 4K - Samples Per Pixel: 16 - Renderer: Path TracerAVX-512 OffAVX-512 OnAVX-512 On 51240K80K120K160K200KSE +/- 189.77, N = 3SE +/- 313.74, N = 3SE +/- 494.14, N = 3166508152903153101-mno-avx512f1. (CXX) g++ options: -O3 -march=native -ldl

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.11Camera: 3 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path TracerAVX-512 OffAVX-512 OnAVX-512 On 51270K140K210K280K350KSE +/- 178.71, N = 3SE +/- 646.03, N = 3SE +/- 378.84, N = 3329527302582303966-mno-avx512f1. (CXX) g++ options: -O3 -march=native -ldl

oneDNN

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.7Harness: Convolution Batch Shapes Auto - Data Type: f32 - Engine: CPUAVX-512 OffAVX-512 OnAVX-512 On 51248121620SE +/- 0.01, N = 7SE +/- 0.01, N = 7SE +/- 0.01, N = 715.6114.3614.28-mno-avx512f - MIN: 15.43MIN: 14.18MIN: 14.091. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.7Harness: Convolution Batch Shapes Auto - Data Type: u8s8f32 - Engine: CPUAVX-512 OffAVX-512 OnAVX-512 On 51248121620SE +/- 0.01, N = 7SE +/- 0.01, N = 7SE +/- 0.00, N = 714.8412.1112.02-mno-avx512f - MIN: 14.31MIN: 11.95MIN: 11.851. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.7Harness: Convolution Batch Shapes Auto - Data Type: bf16bf16bf16 - Engine: CPUAVX-512 OnAVX-512 On 51248121620SE +/- 0.00, N = 7SE +/- 0.00, N = 716.1616.16MIN: 16.07MIN: 16.061. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl

Harness: Convolution Batch Shapes Auto - Data Type: bf16bf16bf16 - Engine: CPU

i9-11900K: AVX-512 Off: The test run did not produce a result.

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.7Harness: Deconvolution Batch shapes_1d - Data Type: f32 - Engine: CPUAVX-512 OffAVX-512 OnAVX-512 On 512246810SE +/- 0.04615, N = 3SE +/- 0.02566, N = 3SE +/- 0.02594, N = 38.397728.551938.50891-mno-avx512f - MIN: 4.7MIN: 4.79MIN: 4.81. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.7Harness: Deconvolution Batch shapes_1d - Data Type: u8s8f32 - Engine: CPUAVX-512 OffAVX-512 OnAVX-512 On 5120.40010.80021.20031.60042.0005SE +/- 0.003095, N = 3SE +/- 0.003322, N = 3SE +/- 0.003829, N = 31.7783200.8406600.846376-mno-avx512f - MIN: 1.73MIN: 0.82MIN: 0.811. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.7Harness: Deconvolution Batch shapes_1d - Data Type: bf16bf16bf16 - Engine: CPUAVX-512 OnAVX-512 On 512510152025SE +/- 0.01, N = 3SE +/- 0.00, N = 320.8120.26MIN: 20.45MIN: 19.821. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl

Harness: Deconvolution Batch shapes_1d - Data Type: bf16bf16bf16 - Engine: CPU

i9-11900K: AVX-512 Off: The test run did not produce a result.

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.7Harness: Deconvolution Batch shapes_3d - Data Type: f32 - Engine: CPUAVX-512 OffAVX-512 OnAVX-512 On 5121.21352.4273.64054.8546.0675SE +/- 0.00507, N = 9SE +/- 0.00401, N = 9SE +/- 0.00516, N = 95.393274.330634.32564-mno-avx512f - MIN: 5.31MIN: 4.21MIN: 4.211. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.7Harness: Deconvolution Batch shapes_3d - Data Type: u8s8f32 - Engine: CPUAVX-512 OffAVX-512 OnAVX-512 On 5120.52021.04041.56062.08082.601SE +/- 0.00997, N = 9SE +/- 0.00510, N = 9SE +/- 0.00281, N = 92.311831.470491.46948-mno-avx512f - MIN: 2.22MIN: 1.35MIN: 1.361. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.7Harness: Deconvolution Batch shapes_3d - Data Type: bf16bf16bf16 - Engine: CPUAVX-512 OnAVX-512 On 51248121620SE +/- 0.00, N = 9SE +/- 0.00, N = 917.3117.27MIN: 16.91MIN: 16.851. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl

Harness: Deconvolution Batch shapes_3d - Data Type: bf16bf16bf16 - Engine: CPU

i9-11900K: AVX-512 Off: The test run did not produce a result.

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.7Harness: IP Shapes 1D - Data Type: f32 - Engine: CPUAVX-512 OffAVX-512 OnAVX-512 On 5120.9081.8162.7243.6324.54SE +/- 0.00517, N = 4SE +/- 0.00337, N = 4SE +/- 0.00488, N = 43.226804.035544.03294-mno-avx512f - MIN: 3.09MIN: 3.9MIN: 3.891. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.7Harness: IP Shapes 1D - Data Type: u8s8f32 - Engine: CPUAVX-512 OffAVX-512 OnAVX-512 On 5120.27990.55980.83971.11961.3995SE +/- 0.000314, N = 4SE +/- 0.001991, N = 4SE +/- 0.001828, N = 41.2439600.7207020.715925-mno-avx512f - MIN: 1.22MIN: 0.67MIN: 0.661. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.7Harness: IP Shapes 1D - Data Type: bf16bf16bf16 - Engine: CPUAVX-512 OnAVX-512 On 512246810SE +/- 0.00165, N = 4SE +/- 0.00438, N = 48.552748.55374MIN: 8.4MIN: 8.331. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl

Harness: IP Shapes 1D - Data Type: bf16bf16bf16 - Engine: CPU

i9-11900K: AVX-512 Off: The test run did not produce a result.

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.7Harness: IP Shapes 3D - Data Type: f32 - Engine: CPUAVX-512 OffAVX-512 OnAVX-512 On 5123691215SE +/- 0.00748, N = 5SE +/- 0.00598, N = 5SE +/- 0.01026, N = 511.6771010.634709.95113-mno-avx512f - MIN: 11.41MIN: 10.54MIN: 9.831. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.7Harness: IP Shapes 3D - Data Type: u8s8f32 - Engine: CPUAVX-512 OffAVX-512 OnAVX-512 On 5120.67811.35622.03432.71243.3905SE +/- 0.00482, N = 5SE +/- 0.00593, N = 5SE +/- 0.01183, N = 52.186703.013772.75246-mno-avx512f - MIN: 2.11MIN: 2.91MIN: 2.641. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.7Harness: IP Shapes 3D - Data Type: bf16bf16bf16 - Engine: CPUAVX-512 OnAVX-512 On 5121.08432.16863.25294.33725.4215SE +/- 0.03916, N = 9SE +/- 0.02954, N = 154.819044.64814MIN: 4.15MIN: 4.011. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl

Harness: IP Shapes 3D - Data Type: bf16bf16bf16 - Engine: CPU

i9-11900K: AVX-512 Off: The test run did not produce a result.

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.7Harness: Matrix Multiply Batch Shapes Transformer - Data Type: f32 - Engine: CPUAVX-512 OffAVX-512 OnAVX-512 On 5120.82661.65322.47983.30644.133SE +/- 0.03921, N = 4SE +/- 0.00624, N = 4SE +/- 0.00586, N = 43.673603.267733.21742-mno-avx512f - MIN: 3.39MIN: 3.18MIN: 3.141. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.7Harness: Matrix Multiply Batch Shapes Transformer - Data Type: u8s8f32 - Engine: CPUAVX-512 OffAVX-512 OnAVX-512 On 5120.31570.63140.94711.26281.5785SE +/- 0.00373, N = 4SE +/- 0.00334, N = 4SE +/- 0.00378, N = 41.403301.321341.30906-mno-avx512f - MIN: 1.31MIN: 1.26MIN: 1.241. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.7Harness: Matrix Multiply Batch Shapes Transformer - Data Type: bf16bf16bf16 - Engine: CPUAVX-512 OnAVX-512 On 5120.8591.7182.5773.4364.295SE +/- 0.04459, N = 4SE +/- 0.03397, N = 43.817933.66945MIN: 3.28MIN: 3.281. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl

Harness: Matrix Multiply Batch Shapes Transformer - Data Type: bf16bf16bf16 - Engine: CPU

i9-11900K: AVX-512 Off: The test run did not produce a result.

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.7Harness: Recurrent Neural Network Training - Data Type: f32 - Engine: CPUAVX-512 OffAVX-512 OnAVX-512 On 5127001400210028003500SE +/- 1.15, N = 3SE +/- 2.36, N = 3SE +/- 2.98, N = 33271.063079.963062.36-mno-avx512f - MIN: 3261.78MIN: 3061.76MIN: 3040.471. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.7Harness: Recurrent Neural Network Training - Data Type: u8s8f32 - Engine: CPUAVX-512 OffAVX-512 OnAVX-512 On 5127001400210028003500SE +/- 1.82, N = 3SE +/- 3.05, N = 3SE +/- 89.39, N = 153270.553088.893073.17-mno-avx512f - MIN: 3260.73MIN: 3071.02MIN: 2922.721. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.7Harness: Recurrent Neural Network Training - Data Type: bf16bf16bf16 - Engine: CPUAVX-512 OffAVX-512 OnAVX-512 On 5127001400210028003500SE +/- 2.45, N = 3SE +/- 4.17, N = 3SE +/- 38.98, N = 33271.273093.582986.72-mno-avx512f - MIN: 3259.85MIN: 3075.2MIN: 2932.851. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.7Harness: Recurrent Neural Network Inference - Data Type: f32 - Engine: CPUAVX-512 OffAVX-512 OnAVX-512 On 512400800120016002000SE +/- 3.47, N = 3SE +/- 0.41, N = 3SE +/- 20.46, N = 42000.121814.651739.49-mno-avx512f - MIN: 1987.76MIN: 1805.32MIN: 1670.861. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.7Harness: Recurrent Neural Network Inference - Data Type: u8s8f32 - Engine: CPUAVX-512 OffAVX-512 OnAVX-512 On 512400800120016002000SE +/- 1.98, N = 3SE +/- 7.10, N = 3SE +/- 14.49, N = 32003.541817.591738.00-mno-avx512f - MIN: 1993.54MIN: 1801.35MIN: 1697.551. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.7Harness: Recurrent Neural Network Inference - Data Type: bf16bf16bf16 - Engine: CPUAVX-512 OffAVX-512 OnAVX-512 On 512400800120016002000SE +/- 0.87, N = 3SE +/- 2.62, N = 3SE +/- 18.65, N = 52006.021814.031715.75-mno-avx512f - MIN: 1997.88MIN: 1799.95MIN: 1674.741. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl

Mobile Neural Network

MNN is the Mobile Neural Network as a highly efficient, lightweight deep learning framework developed by Alibaba. This MNN test profile is building the OpenMP / CPU threaded version for processor benchmarking and not any GPU-accelerated test. MNN does allow making use of AVX-512 extensions. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgms, Fewer Is BetterMobile Neural Network 2.1Model: nasnetAVX-512 OffAVX-512 OnAVX-512 On 512246810SE +/- 0.056, N = 3SE +/- 0.077, N = 15SE +/- 0.087, N = 157.1397.4687.527-mno-avx512f - MIN: 6.92 / MAX: 7.99MIN: 6.73 / MAX: 13.9MIN: 6.72 / MAX: 17.921. (CXX) g++ options: -O3 -march=native -std=c++11 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl

OpenBenchmarking.orgms, Fewer Is BetterMobile Neural Network 2.1Model: mobilenetV3AVX-512 OffAVX-512 OnAVX-512 On 5120.21670.43340.65010.86681.0835SE +/- 0.003, N = 3SE +/- 0.005, N = 15SE +/- 0.012, N = 150.9420.9380.963-mno-avx512f - MIN: 0.92 / MAX: 1.64MIN: 0.89 / MAX: 3.62MIN: 0.89 / MAX: 10.541. (CXX) g++ options: -O3 -march=native -std=c++11 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl

OpenBenchmarking.orgms, Fewer Is BetterMobile Neural Network 2.1Model: squeezenetv1.1AVX-512 OffAVX-512 OnAVX-512 On 5120.45520.91041.36561.82082.276SE +/- 0.014, N = 3SE +/- 0.013, N = 15SE +/- 0.014, N = 152.0231.6701.675-mno-avx512f - MIN: 1.97 / MAX: 2.72MIN: 1.54 / MAX: 11.33MIN: 1.55 / MAX: 7.761. (CXX) g++ options: -O3 -march=native -std=c++11 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl

OpenBenchmarking.orgms, Fewer Is BetterMobile Neural Network 2.1Model: resnet-v2-50AVX-512 OffAVX-512 OnAVX-512 On 51248121620SE +/- 0.08, N = 3SE +/- 0.05, N = 15SE +/- 0.04, N = 1518.0410.3010.37-mno-avx512f - MIN: 17.67 / MAX: 24.46MIN: 9.74 / MAX: 33.88MIN: 10.05 / MAX: 22.641. (CXX) g++ options: -O3 -march=native -std=c++11 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl

OpenBenchmarking.orgms, Fewer Is BetterMobile Neural Network 2.1Model: SqueezeNetV1.0AVX-512 OffAVX-512 OnAVX-512 On 5120.83121.66242.49363.32484.156SE +/- 0.032, N = 3SE +/- 0.020, N = 15SE +/- 0.022, N = 153.6943.0733.114-mno-avx512f - MIN: 3.57 / MAX: 4.37MIN: 2.89 / MAX: 8.65MIN: 2.9 / MAX: 9.421. (CXX) g++ options: -O3 -march=native -std=c++11 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl

OpenBenchmarking.orgms, Fewer Is BetterMobile Neural Network 2.1Model: MobileNetV2_224AVX-512 OffAVX-512 OnAVX-512 On 5120.47950.9591.43851.9182.3975SE +/- 0.019, N = 3SE +/- 0.014, N = 15SE +/- 0.014, N = 151.9342.1312.125-mno-avx512f - MIN: 1.84 / MAX: 11.59MIN: 2.03 / MAX: 8.46MIN: 2.03 / MAX: 8.621. (CXX) g++ options: -O3 -march=native -std=c++11 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl

OpenBenchmarking.orgms, Fewer Is BetterMobile Neural Network 2.1Model: mobilenet-v1-1.0AVX-512 OffAVX-512 OnAVX-512 On 5120.44750.8951.34251.792.2375SE +/- 0.007, N = 3SE +/- 0.005, N = 15SE +/- 0.007, N = 151.7981.9721.989-mno-avx512f - MIN: 1.74 / MAX: 2.69MIN: 1.8 / MAX: 8.03MIN: 1.9 / MAX: 8.11. (CXX) g++ options: -O3 -march=native -std=c++11 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl

OpenBenchmarking.orgms, Fewer Is BetterMobile Neural Network 2.1Model: inception-v3AVX-512 OffAVX-512 OnAVX-512 On 512612182430SE +/- 0.02, N = 3SE +/- 0.26, N = 15SE +/- 0.27, N = 1523.4219.5819.40-mno-avx512f - MIN: 22.95 / MAX: 30.84MIN: 17.25 / MAX: 32.64MIN: 17.18 / MAX: 49.21. (CXX) g++ options: -O3 -march=native -std=c++11 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl

NCNN

NCNN is a high performance neural network inference framework optimized for mobile and other platforms developed by Tencent. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20220729Target: CPU - Model: mobilenetAVX-512 OffAVX-512 OnAVX-512 On 5123691215SE +/- 0.02, N = 3SE +/- 0.15, N = 3SE +/- 0.13, N = 311.4312.2812.28-mno-avx512f - MIN: 11.21 / MAX: 16.87MIN: 11.79 / MAX: 13.67MIN: 11.87 / MAX: 18.861. (CXX) g++ options: -O3 -march=native -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20220729Target: CPU-v2-v2 - Model: mobilenet-v2AVX-512 OffAVX-512 OnAVX-512 On 5120.84831.69662.54493.39324.2415SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.05, N = 33.343.733.77-mno-avx512f - MIN: 3.16 / MAX: 5.05MIN: 3.56 / MAX: 5.05MIN: 3.53 / MAX: 4.41. (CXX) g++ options: -O3 -march=native -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20220729Target: CPU-v3-v3 - Model: mobilenet-v3AVX-512 OffAVX-512 OnAVX-512 On 5120.60981.21961.82942.43923.049SE +/- 0.01, N = 3SE +/- 0.03, N = 3SE +/- 0.05, N = 32.492.682.71-mno-avx512f - MIN: 2.4 / MAX: 3.36MIN: 2.56 / MAX: 3.63MIN: 2.55 / MAX: 3.51. (CXX) g++ options: -O3 -march=native -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20220729Target: CPU - Model: shufflenet-v2AVX-512 OffAVX-512 OnAVX-512 On 5120.52431.04861.57292.09722.6215SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 32.332.332.33-mno-avx512f - MIN: 2.27 / MAX: 3.18MIN: 2.26 / MAX: 3.21MIN: 2.27 / MAX: 2.811. (CXX) g++ options: -O3 -march=native -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20220729Target: CPU - Model: mnasnetAVX-512 OffAVX-512 OnAVX-512 On 5120.58951.1791.76852.3582.9475SE +/- 0.03, N = 3SE +/- 0.03, N = 3SE +/- 0.03, N = 32.372.622.58-mno-avx512f - MIN: 2.28 / MAX: 3.27MIN: 2.48 / MAX: 3.81MIN: 2.48 / MAX: 3.141. (CXX) g++ options: -O3 -march=native -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20220729Target: CPU - Model: efficientnet-b0AVX-512 OffAVX-512 OnAVX-512 On 5121.09352.1873.28054.3745.4675SE +/- 0.05, N = 3SE +/- 0.06, N = 3SE +/- 0.05, N = 34.354.864.79-mno-avx512f - MIN: 4.2 / MAX: 5.22MIN: 4.6 / MAX: 6.13MIN: 4.61 / MAX: 9.91. (CXX) g++ options: -O3 -march=native -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20220729Target: CPU - Model: blazefaceAVX-512 OffAVX-512 OnAVX-512 On 5120.180.360.540.720.9SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.01, N = 30.760.800.80-mno-avx512f - MIN: 0.73 / MAX: 1.52MIN: 0.77 / MAX: 1.52MIN: 0.77 / MAX: 1.281. (CXX) g++ options: -O3 -march=native -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20220729Target: CPU - Model: googlenetAVX-512 OffAVX-512 OnAVX-512 On 5123691215SE +/- 0.03, N = 3SE +/- 0.00, N = 3SE +/- 0.13, N = 39.5510.169.96-mno-avx512f - MIN: 9.33 / MAX: 10.86MIN: 9.92 / MAX: 11.36MIN: 9.52 / MAX: 10.981. (CXX) g++ options: -O3 -march=native -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20220729Target: CPU - Model: vgg16AVX-512 OffAVX-512 OnAVX-512 On 5121020304050SE +/- 0.13, N = 3SE +/- 0.13, N = 3SE +/- 0.23, N = 345.6844.7444.59-mno-avx512f - MIN: 44.98 / MAX: 50.56MIN: 44.1 / MAX: 49.06MIN: 43.87 / MAX: 50.431. (CXX) g++ options: -O3 -march=native -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20220729Target: CPU - Model: resnet18AVX-512 OffAVX-512 OnAVX-512 On 512246810SE +/- 0.00, N = 3SE +/- 0.02, N = 3SE +/- 0.02, N = 38.248.698.64-mno-avx512f - MIN: 8.06 / MAX: 9.19MIN: 8.51 / MAX: 14.15MIN: 8.45 / MAX: 9.391. (CXX) g++ options: -O3 -march=native -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20220729Target: CPU - Model: alexnetAVX-512 OffAVX-512 OnAVX-512 On 512246810SE +/- 0.01, N = 3SE +/- 0.02, N = 3SE +/- 0.19, N = 36.336.986.69-mno-avx512f - MIN: 6.2 / MAX: 7.75MIN: 6.82 / MAX: 7.88MIN: 6.2 / MAX: 7.351. (CXX) g++ options: -O3 -march=native -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20220729Target: CPU - Model: resnet50AVX-512 OffAVX-512 OnAVX-512 On 51248121620SE +/- 0.02, N = 3SE +/- 0.42, N = 3SE +/- 0.42, N = 315.4015.9916.24-mno-avx512f - MIN: 15.07 / MAX: 24.51MIN: 15.25 / MAX: 18.48MIN: 15.19 / MAX: 17.461. (CXX) g++ options: -O3 -march=native -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20220729Target: CPU - Model: yolov4-tinyAVX-512 OffAVX-512 OnAVX-512 On 512510152025SE +/- 0.06, N = 3SE +/- 0.41, N = 3SE +/- 0.44, N = 318.8020.9922.01-mno-avx512f - MIN: 18.51 / MAX: 19.88MIN: 20.36 / MAX: 37.15MIN: 21.29 / MAX: 26.711. (CXX) g++ options: -O3 -march=native -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20220729Target: CPU - Model: squeezenet_ssdAVX-512 OffAVX-512 OnAVX-512 On 51248121620SE +/- 0.04, N = 3SE +/- 0.18, N = 3SE +/- 0.05, N = 313.8917.1917.34-mno-avx512f - MIN: 13.58 / MAX: 15.32MIN: 16.54 / MAX: 25.09MIN: 17.03 / MAX: 18.981. (CXX) g++ options: -O3 -march=native -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20220729Target: CPU - Model: regnety_400mAVX-512 OffAVX-512 OnAVX-512 On 512246810SE +/- 0.02, N = 3SE +/- 0.02, N = 3SE +/- 0.03, N = 36.707.057.10-mno-avx512f - MIN: 6.54 / MAX: 7.93MIN: 6.87 / MAX: 8.31MIN: 6.91 / MAX: 11.121. (CXX) g++ options: -O3 -march=native -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20220729Target: CPU - Model: vision_transformerAVX-512 OffAVX-512 OnAVX-512 On 51220406080100SE +/- 0.39, N = 3SE +/- 0.11, N = 3SE +/- 0.12, N = 3110.3887.2970.39-mno-avx512f - MIN: 109.43 / MAX: 116.1MIN: 86.63 / MAX: 92.92MIN: 69.62 / MAX: 71.721. (CXX) g++ options: -O3 -march=native -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20220729Target: CPU - Model: FastestDetAVX-512 OffAVX-512 OnAVX-512 On 5120.67051.3412.01152.6823.3525SE +/- 0.02, N = 3SE +/- 0.08, N = 3SE +/- 0.08, N = 32.852.982.98-mno-avx512f - MIN: 2.78 / MAX: 3.41MIN: 2.81 / MAX: 3.62MIN: 2.84 / MAX: 3.61. (CXX) g++ options: -O3 -march=native -rdynamic -lgomp -lpthread

TNN

TNN is an open-source deep learning reasoning framework developed by Tencent. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgms, Fewer Is BetterTNN 0.3Target: CPU - Model: DenseNetAVX-512 OffAVX-512 OnAVX-512 On 5126001200180024003000SE +/- 0.35, N = 3SE +/- 2.72, N = 3SE +/- 1.39, N = 32703.562704.932695.65-mno-avx512f - MIN: 2643.22 / MAX: 2776.22MIN: 2642.6 / MAX: 2789.25MIN: 2633.85 / MAX: 2768.471. (CXX) g++ options: -O3 -march=native -fopenmp -pthread -fvisibility=hidden -fvisibility=default -rdynamic -ldl

OpenBenchmarking.orgms, Fewer Is BetterTNN 0.3Target: CPU - Model: MobileNet v2AVX-512 OffAVX-512 OnAVX-512 On 51250100150200250SE +/- 0.28, N = 3SE +/- 0.25, N = 3SE +/- 0.06, N = 3241.31245.95240.41-mno-avx512f - MIN: 238.09 / MAX: 252.58MIN: 242.61 / MAX: 266.39MIN: 237.96 / MAX: 252.771. (CXX) g++ options: -O3 -march=native -fopenmp -pthread -fvisibility=hidden -fvisibility=default -rdynamic -ldl

OpenBenchmarking.orgms, Fewer Is BetterTNN 0.3Target: CPU - Model: SqueezeNet v1.1AVX-512 OffAVX-512 OnAVX-512 On 51250100150200250SE +/- 0.07, N = 4SE +/- 0.08, N = 4SE +/- 0.09, N = 4228.68230.82228.42-mno-avx512f - MIN: 227.32 / MAX: 231.38MIN: 229.65 / MAX: 231.83MIN: 227.09 / MAX: 230.261. (CXX) g++ options: -O3 -march=native -fopenmp -pthread -fvisibility=hidden -fvisibility=default -rdynamic -ldl

OpenBenchmarking.orgms, Fewer Is BetterTNN 0.3Target: CPU - Model: SqueezeNet v2AVX-512 OffAVX-512 OnAVX-512 On 5121122334455SE +/- 0.17, N = 9SE +/- 0.07, N = 9SE +/- 0.11, N = 946.3647.1945.68-mno-avx512f - MIN: 45.49 / MAX: 48.72MIN: 46.52 / MAX: 48.8MIN: 45.02 / MAX: 47.451. (CXX) g++ options: -O3 -march=native -fopenmp -pthread -fvisibility=hidden -fvisibility=default -rdynamic -ldl

OpenVINO

This is a test of the Intel OpenVINO, a toolkit around neural networks, using its built-in benchmarking support and analyzing the throughput and latency for various models. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.2.devModel: Face Detection FP16 - Device: CPUAVX-512 OffAVX-512 OnAVX-512 On 51230060090012001500SE +/- 4.24, N = 3SE +/- 3.79, N = 3SE +/- 1.26, N = 31525.181346.991352.08-mno-avx512f - MIN: 825.15 / MAX: 2479.54-ldl - MIN: 1224.1 / MAX: 1502.9-ldl - MIN: 1184.99 / MAX: 1541.851. (CXX) g++ options: -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -pie

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.2.devModel: Face Detection FP16-INT8 - Device: CPUAVX-512 OffAVX-512 OnAVX-512 On 5122004006008001000SE +/- 3.19, N = 3SE +/- 0.34, N = 3SE +/- 0.43, N = 3817.17326.76328.08-mno-avx512f - MIN: 559.45 / MAX: 1507.03-ldl - MIN: 183.35 / MAX: 422.57-ldl - MIN: 193.4 / MAX: 422.421. (CXX) g++ options: -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -pie

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.2.devModel: Age Gender Recognition Retail 0013 FP16 - Device: CPUAVX-512 OffAVX-512 OnAVX-512 On 5120.2250.450.6750.91.125SE +/- 0.00, N = 3SE +/- 0.01, N = 3SE +/- 0.00, N = 31.000.850.84-mno-avx512f - MIN: 0.48 / MAX: 89.55-ldl - MIN: 0.45 / MAX: 10.27-ldl - MIN: 0.48 / MAX: 9.991. (CXX) g++ options: -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -pie

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.2.devModel: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPUAVX-512 OffAVX-512 OnAVX-512 On 5120.11930.23860.35790.47720.5965SE +/- 0.00, N = 3SE +/- 0.01, N = 15SE +/- 0.01, N = 150.530.340.35-mno-avx512f - MIN: 0.28 / MAX: 83.77-ldl - MIN: 0.18 / MAX: 82.47-ldl - MIN: 0.18 / MAX: 11.281. (CXX) g++ options: -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -pie

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.2.devModel: Person Detection FP16 - Device: CPUAVX-512 OffAVX-512 OnAVX-512 On 5126001200180024003000SE +/- 7.35, N = 3SE +/- 0.33, N = 3SE +/- 7.01, N = 32563.452235.542227.69-mno-avx512f - MIN: 1711.34 / MAX: 3871.27-ldl - MIN: 1874.94 / MAX: 2477.63-ldl - MIN: 1807.91 / MAX: 2513.611. (CXX) g++ options: -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -pie

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.2.devModel: Person Detection FP32 - Device: CPUAVX-512 OffAVX-512 OnAVX-512 On 5126001200180024003000SE +/- 9.17, N = 3SE +/- 9.13, N = 3SE +/- 8.02, N = 32563.872250.022244.25-mno-avx512f - MIN: 1540.87 / MAX: 3813.98-ldl - MIN: 1294.64 / MAX: 2438.65-ldl - MIN: 1760.66 / MAX: 2505.491. (CXX) g++ options: -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -pie

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.2.devModel: Weld Porosity Detection FP16-INT8 - Device: CPUAVX-512 OffAVX-512 OnAVX-512 On 51248121620SE +/- 0.06, N = 3SE +/- 0.03, N = 3SE +/- 0.02, N = 314.986.436.42-mno-avx512f - MIN: 8.89 / MAX: 192.81-ldl - MIN: 3.29 / MAX: 13.76-ldl - MIN: 3.32 / MAX: 13.511. (CXX) g++ options: -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -pie

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.2.devModel: Weld Porosity Detection FP16 - Device: CPUAVX-512 OffAVX-512 OnAVX-512 On 512612182430SE +/- 0.00, N = 3SE +/- 0.03, N = 3SE +/- 0.08, N = 315.8124.9224.86-mno-avx512f - MIN: 7.14 / MAX: 105.25-ldl - MIN: 12.72 / MAX: 35.46-ldl - MIN: 12.43 / MAX: 42.381. (CXX) g++ options: -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -pie

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.2.devModel: Vehicle Detection FP16-INT8 - Device: CPUAVX-512 OffAVX-512 OnAVX-512 On 5123691215SE +/- 0.06, N = 3SE +/- 0.04, N = 3SE +/- 0.02, N = 312.886.416.33-mno-avx512f - MIN: 7.49 / MAX: 109.79-ldl - MIN: 3.21 / MAX: 14.83-ldl - MIN: 4.22 / MAX: 15.171. (CXX) g++ options: -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -pie

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.2.devModel: Vehicle Detection FP16 - Device: CPUAVX-512 OffAVX-512 OnAVX-512 On 512816243240SE +/- 0.29, N = 3SE +/- 0.04, N = 3SE +/- 0.08, N = 328.2936.8036.64-mno-avx512f - MIN: 11.7 / MAX: 274.34-ldl - MIN: 12.79 / MAX: 55.71-ldl - MIN: 13.62 / MAX: 58.491. (CXX) g++ options: -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -pie

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.2.devModel: Person Vehicle Bike Detection FP16 - Device: CPUAVX-512 OffAVX-512 OnAVX-512 On 51248121620SE +/- 0.12, N = 6SE +/- 0.12, N = 3SE +/- 0.12, N = 712.2613.9513.99-mno-avx512f - MIN: 6.09 / MAX: 23.07-ldl - MIN: 6.25 / MAX: 52.24-ldl - MIN: 6.28 / MAX: 24.011. (CXX) g++ options: -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -pie

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.2.devModel: Machine Translation EN To DE FP16 - Device: CPUAVX-512 OffAVX-512 OnAVX-512 On 512306090120150SE +/- 0.14, N = 3SE +/- 0.88, N = 3SE +/- 0.59, N = 3126.09112.27112.48-mno-avx512f - MIN: 58.5 / MAX: 136.1-ldl - MIN: 60.98 / MAX: 140.63-ldl - MIN: 53.91 / MAX: 140.821. (CXX) g++ options: -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -pie

Neural Magic DeepSparse

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Synchronous Single-StreamAVX-512 OffAVX-512 OnAVX-512 On 512816243240SE +/- 0.02, N = 3SE +/- 0.06, N = 3SE +/- 0.08, N = 334.5128.2628.22

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-StreamAVX-512 OffAVX-512 OnAVX-512 On 512306090120150SE +/- 0.07, N = 3SE +/- 0.31, N = 3SE +/- 0.54, N = 3112.6097.8598.03

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: NLP Text Classification, DistilBERT mnli - Scenario: Synchronous Single-StreamAVX-512 OffAVX-512 OnAVX-512 On 51248121620SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 317.6614.5414.54

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-StreamAVX-512 OffAVX-512 OnAVX-512 On 5121326395265SE +/- 0.03, N = 3SE +/- 0.07, N = 3SE +/- 0.03, N = 357.8849.5749.36

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: CV Classification, ResNet-50 ImageNet - Scenario: Synchronous Single-StreamAVX-512 OffAVX-512 OnAVX-512 On 5123691215SE +/- 0.0062, N = 3SE +/- 0.0274, N = 3SE +/- 0.0069, N = 311.62447.51737.4707

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-StreamAVX-512 OffAVX-512 OnAVX-512 On 512918273645SE +/- 0.05, N = 3SE +/- 0.15, N = 3SE +/- 0.11, N = 339.3525.7325.49

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Synchronous Single-StreamAVX-512 OffAVX-512 OnAVX-512 On 512306090120150SE +/- 0.12, N = 3SE +/- 1.00, N = 3SE +/- 0.37, N = 3128.05112.68111.22

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-StreamAVX-512 OffAVX-512 OnAVX-512 On 512110220330440550SE +/- 0.40, N = 3SE +/- 3.25, N = 3SE +/- 0.68, N = 3492.38446.88440.10

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Synchronous Single-StreamAVX-512 OffAVX-512 OnAVX-512 On 512918273645SE +/- 0.08, N = 3SE +/- 0.10, N = 3SE +/- 0.10, N = 339.1422.8923.01

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-StreamAVX-512 OffAVX-512 OnAVX-512 On 512306090120150SE +/- 0.85, N = 3SE +/- 0.09, N = 3SE +/- 0.07, N = 3150.77109.28108.49

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: CV Detection,YOLOv5s COCO - Scenario: Synchronous Single-StreamAVX-512 OffAVX-512 OnAVX-512 On 512612182430SE +/- 0.00, N = 3SE +/- 0.06, N = 3SE +/- 0.02, N = 323.0420.1319.99

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: CV Detection,YOLOv5s COCO - Scenario: Asynchronous Multi-StreamAVX-512 OffAVX-512 OnAVX-512 On 51220406080100SE +/- 0.19, N = 3SE +/- 0.23, N = 3SE +/- 0.56, N = 392.5178.7877.87

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Synchronous Single-StreamAVX-512 OffAVX-512 OnAVX-512 On 512306090120150SE +/- 0.07, N = 3SE +/- 0.58, N = 3SE +/- 0.33, N = 3127.65112.19110.96

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-StreamAVX-512 OffAVX-512 OnAVX-512 On 512110220330440550SE +/- 0.41, N = 3SE +/- 1.90, N = 3SE +/- 1.29, N = 3491.12446.49440.56

OpenRadioss

OpenRadioss is an open-source AGPL-licensed finite element solver for dynamic event analysis OpenRadioss is based on Altair Radioss and open-sourced in 2022. This open-source finite element solver is benchmarked with various example models available from https://www.openradioss.org/models/. This test is currently using a reference OpenRadioss binary build offered via GitHub. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterOpenRadioss 2022.10.13Model: Bird Strike on WindshieldAVX-512 OffAVX-512 OnAVX-512 On 51270140210280350SE +/- 3.86, N = 4SE +/- 0.35, N = 3SE +/- 3.22, N = 5311.82309.21315.86

OpenBenchmarking.orgSeconds, Fewer Is BetterOpenRadioss 2022.10.13Model: Rubber O-Ring Seal InstallationAVX-512 OffAVX-512 OnAVX-512 On 51250100150200250SE +/- 2.54, N = 5SE +/- 2.27, N = 7SE +/- 2.53, N = 4243.47250.33240.62

OpenBenchmarking.orgSeconds, Fewer Is BetterOpenRadioss 2022.10.13Model: Cell Phone Drop TestAVX-512 OffAVX-512 OnAVX-512 On 512306090120150SE +/- 0.52, N = 3SE +/- 1.35, N = 3SE +/- 0.31, N = 3128.16120.62118.89

OpenBenchmarking.orgSeconds, Fewer Is BetterOpenRadioss 2022.10.13Model: Bumper BeamAVX-512 OffAVX-512 OnAVX-512 On 5124080120160200SE +/- 1.56, N = 7SE +/- 2.45, N = 3SE +/- 1.21, N = 3174.60177.40175.69

OpenBenchmarking.orgSeconds, Fewer Is BetterOpenRadioss 2022.10.13Model: INIVOL and Fluid Structure Interaction Drop ContainerAVX-512 OffAVX-512 OnAVX-512 On 512160320480640800SE +/- 4.20, N = 3SE +/- 7.20, N = 9SE +/- 10.28, N = 3713.35759.23755.60

OpenFOAM

OpenFOAM is the leading free, open-source software for computational fluid dynamics (CFD). This test profile currently uses the drivaerFastback test case for analyzing automotive aerodynamics or alternatively the older motorBike input. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterOpenFOAM 10Input: drivaerFastback, Small Mesh Size - Mesh TimeAVX-512 OffAVX-512 OnAVX-512 On 512112233445546.5345.4945.331. (CXX) g++ options: -std=c++14 -m64 -O3 -ftemplate-depth-100 -fPIC -fuse-ld=bfd -Xlinker --add-needed --no-as-needed -lfoamToVTK -ldynamicMesh -llagrangian -lgenericPatchFields -lfileFormats -lOpenFOAM -ldl -lm

OpenBenchmarking.orgSeconds, Fewer Is BetterOpenFOAM 10Input: drivaerFastback, Small Mesh Size - Execution TimeAVX-512 OffAVX-512 OnAVX-512 On 512120240360480600538.29538.98535.111. (CXX) g++ options: -std=c++14 -m64 -O3 -ftemplate-depth-100 -fPIC -fuse-ld=bfd -Xlinker --add-needed --no-as-needed -lfoamToVTK -ldynamicMesh -llagrangian -lgenericPatchFields -lfileFormats -lOpenFOAM -ldl -lm

400 Results Shown

CPU Temperature Monitor:
  Phoronix Test Suite System Monitoring:
    Celsius
    Megahertz
    Watts
dav1d:
  Summer Nature 1080p
  Summer Nature 4K
  Chimera 1080p
  Chimera 1080p 10-bit
OpenVINO:
  Face Detection FP16 - CPU
  Face Detection FP16-INT8 - CPU
  Age Gender Recognition Retail 0013 FP16 - CPU
  Age Gender Recognition Retail 0013 FP16-INT8 - CPU
  Person Detection FP16 - CPU
  Person Detection FP32 - CPU
  Weld Porosity Detection FP16-INT8 - CPU
  Weld Porosity Detection FP16 - CPU
  Vehicle Detection FP16-INT8 - CPU
  Vehicle Detection FP16 - CPU
  Person Vehicle Bike Detection FP16 - CPU
  Machine Translation EN To DE FP16 - CPU
Embree:
  Pathtracer ISPC - Asian Dragon
  Pathtracer ISPC - Asian Dragon Obj
  Pathtracer ISPC - Crown
Embree:
  Pathtracer ISPC - Asian Dragon
  Pathtracer ISPC - Asian Dragon Obj
  Pathtracer ISPC - Crown
simdjson
simdjson
simdjson
simdjson:
  LargeRand
  Kostya
  DistinctUserID
  TopTweet
Xmrig:
  Monero - 1M
  Wownero - 1M
Xmrig:
  Monero - 1M
  Wownero - 1M
Intel Open Image Denoise:
  RT.hdr_alb_nrm.3840x2160
  RT.ldr_alb_nrm.3840x2160
  RTLightmap.hdr.4096x4096
TensorFlow:
  CPU - 16 - VGG-16
  CPU - 16 - ResNet-50
  CPU - 16 - AlexNet
  CPU - 16 - GoogLeNet
  CPU - 32 - VGG-16
  CPU - 32 - ResNet-50
  CPU - 32 - AlexNet
  CPU - 32 - GoogLeNet
  CPU - 64 - VGG-16
  CPU - 64 - ResNet-50
  CPU - 64 - AlexNet
  CPU - 64 - GoogLeNet
  CPU - 256 - VGG-16
  CPU - 256 - ResNet-50
TensorFlow:
  CPU - 16 - VGG-16
  CPU - 16 - ResNet-50
TensorFlow
TensorFlow
TensorFlow
TensorFlow
TensorFlow:
  CPU - 512 - AlexNet
  CPU - 512 - GoogLeNet
TensorFlow:
  CPU - 16 - GoogLeNet
  CPU - 32 - VGG-16
  CPU - 32 - ResNet-50
  CPU - 32 - AlexNet
  CPU - 32 - GoogLeNet
  CPU - 64 - VGG-16
  CPU - 64 - AlexNet
  CPU - 64 - GoogLeNet
  CPU - 256 - VGG-16
  CPU - 256 - ResNet-50
  CPU - 256 - AlexNet
  CPU - 256 - GoogLeNet
  CPU - 512 - AlexNet
  CPU - 512 - GoogLeNet
ONNX Runtime
ONNX Runtime
ONNX Runtime:
  fcn-resnet101-11 - CPU - Standard
  fcn-resnet101-11 - CPU - Parallel
ONNX Runtime:
  yolov4 - CPU - Parallel
  fcn-resnet101-11 - CPU - Standard
  fcn-resnet101-11 - CPU - Parallel
ONNX Runtime:
  super-resolution-10 - CPU - Standard
  ArcFace ResNet-100 - CPU - Parallel
ONNX Runtime
ONNX Runtime:
  super-resolution-10 - CPU - Parallel
  bertsquad-12 - CPU - Standard
  bertsquad-12 - CPU - Parallel
  GPT-2 - CPU - Standard
  GPT-2 - CPU - Parallel
  ArcFace ResNet-100 - CPU - Standard
ONNX Runtime:
  super-resolution-10 - CPU - Parallel
  bertsquad-12 - CPU - Standard
  bertsquad-12 - CPU - Parallel
  GPT-2 - CPU - Standard
  GPT-2 - CPU - Parallel
  ArcFace ResNet-100 - CPU - Standard
  ArcFace ResNet-100 - CPU - Parallel
OpenVKL
OpenVKL
OSPRay:
  gravity_spheres_volume/dim_512/ao/real_time
  gravity_spheres_volume/dim_512/scivis/real_time
  gravity_spheres_volume/dim_512/pathtracer/real_time
  particle_volume/ao/real_time
  particle_volume/scivis/real_time
  particle_volume/pathtracer/real_time
Neural Magic DeepSparse:
  NLP Text Classification, BERT base uncased SST2 - Synchronous Single-Stream
  NLP Text Classification, BERT base uncased SST2 - Asynchronous Multi-Stream
  NLP Text Classification, DistilBERT mnli - Synchronous Single-Stream
  NLP Text Classification, DistilBERT mnli - Asynchronous Multi-Stream
  CV Classification, ResNet-50 ImageNet - Synchronous Single-Stream
  CV Classification, ResNet-50 ImageNet - Asynchronous Multi-Stream
  NLP Token Classification, BERT base uncased conll2003 - Synchronous Single-Stream
  NLP Token Classification, BERT base uncased conll2003 - Asynchronous Multi-Stream
  NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Synchronous Single-Stream
  NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Asynchronous Multi-Stream
  CV Detection,YOLOv5s COCO - Synchronous Single-Stream
  CV Detection,YOLOv5s COCO - Asynchronous Multi-Stream
  NLP Document Classification, oBERT base uncased on IMDB - Synchronous Single-Stream
  NLP Document Classification, oBERT base uncased on IMDB - Asynchronous Multi-Stream
Cpuminer-Opt:
  Triple SHA-256, Onecoin
  Quad SHA-256, Pyrite
  Myriad-Groestl
Cpuminer-Opt:
  Triple SHA-256, Onecoin
  Magi
  Ringcoin
  Deepcoin
Cpuminer-Opt:
  Blake-2 S
  x25x
  Garlicoin
  Skeincoin
Cpuminer-Opt:
  Quad SHA-256, Pyrite
  Garlicoin
  Skeincoin
  LBC, LBRY Credits
  Myriad-Groestl
  Blake-2 S
  x25x
AI Benchmark Alpha:
  CPU Peak Freq (Highest CPU Core Frequency) Monitor:
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
  BLAS:
    Nodes Per Second Per Watt
LeelaChessZero:
  BLAS
  Eigen
GROMACS
Meta Performance Per Watts:
  Performance Per Watts
  Device AI Score
AI Benchmark Alpha:
  Device Inference Score
  Device Training Score
Numpy Benchmark
AI Benchmark Alpha
Numpy Benchmark
Neural Magic DeepSparse:
  CPU Temp Monitor:
    Celsius
    Celsius
    Celsius
    Celsius
    Celsius
    Celsius
    Celsius
    Celsius
    Celsius
    Celsius
    Celsius
    Celsius
    Celsius
    Celsius
    Celsius
    Celsius
    Celsius
    Celsius
    Celsius
    Celsius
    Celsius
    Celsius
    Celsius
    Celsius
    Celsius
    Celsius
    Celsius
    Celsius
    Celsius
    Celsius
    Celsius
    Celsius
    Celsius
    Celsius
    Celsius
    Celsius
    Celsius
    Celsius
    Celsius
    Celsius
    Celsius
    Celsius
    Celsius
    Celsius
    Celsius
    Celsius
    Celsius
    Celsius
    Celsius
    Celsius
    Celsius
    Celsius
    Celsius
    Celsius
    Celsius
    Celsius
    Celsius
    Celsius
    Celsius
    Celsius
    Celsius
    Celsius
    Celsius
    Celsius
    Celsius
    Celsius
    Celsius
    Celsius
    Celsius
    Celsius
    Celsius
    Celsius
    Celsius
    Celsius
OSPRay Studio:
  1 - 1080p - 1 - Path Tracer
  1 - 1080p - 16 - Path Tracer
  1 - 1080p - 32 - Path Tracer
  1 - 4K - 1 - Path Tracer
  1 - 4K - 16 - Path Tracer
  1 - 4K - 32 - Path Tracer
  3 - 1080p - 1 - Path Tracer
  3 - 1080p - 16 - Path Tracer
  3 - 1080p - 32 - Path Tracer
  3 - 4K - 1 - Path Tracer
  3 - 4K - 16 - Path Tracer
  3 - 4K - 32 - Path Tracer
oneDNN:
  Convolution Batch Shapes Auto - f32 - CPU
  Convolution Batch Shapes Auto - u8s8f32 - CPU
  Convolution Batch Shapes Auto - bf16bf16bf16 - CPU
  Deconvolution Batch shapes_1d - f32 - CPU
  Deconvolution Batch shapes_1d - u8s8f32 - CPU
  Deconvolution Batch shapes_1d - bf16bf16bf16 - CPU
  Deconvolution Batch shapes_3d - f32 - CPU
  Deconvolution Batch shapes_3d - u8s8f32 - CPU
  Deconvolution Batch shapes_3d - bf16bf16bf16 - CPU
  IP Shapes 1D - f32 - CPU
  IP Shapes 1D - u8s8f32 - CPU
  IP Shapes 1D - bf16bf16bf16 - CPU
  IP Shapes 3D - f32 - CPU
  IP Shapes 3D - u8s8f32 - CPU
  IP Shapes 3D - bf16bf16bf16 - CPU
  Matrix Multiply Batch Shapes Transformer - f32 - CPU
  Matrix Multiply Batch Shapes Transformer - u8s8f32 - CPU
  Matrix Multiply Batch Shapes Transformer - bf16bf16bf16 - CPU
  Recurrent Neural Network Training - f32 - CPU
  Recurrent Neural Network Training - u8s8f32 - CPU
  Recurrent Neural Network Training - bf16bf16bf16 - CPU
  Recurrent Neural Network Inference - f32 - CPU
  Recurrent Neural Network Inference - u8s8f32 - CPU
  Recurrent Neural Network Inference - bf16bf16bf16 - CPU
Mobile Neural Network:
  nasnet
  mobilenetV3
  squeezenetv1.1
  resnet-v2-50
  SqueezeNetV1.0
  MobileNetV2_224
  mobilenet-v1-1.0
  inception-v3
NCNN:
  CPU - mobilenet
  CPU-v2-v2 - mobilenet-v2
  CPU-v3-v3 - mobilenet-v3
  CPU - shufflenet-v2
  CPU - mnasnet
  CPU - efficientnet-b0
  CPU - blazeface
  CPU - googlenet
  CPU - vgg16
  CPU - resnet18
  CPU - alexnet
  CPU - resnet50
  CPU - yolov4-tiny
  CPU - squeezenet_ssd
  CPU - regnety_400m
  CPU - vision_transformer
  CPU - FastestDet
TNN:
  CPU - DenseNet
  CPU - MobileNet v2
  CPU - SqueezeNet v1.1
  CPU - SqueezeNet v2
OpenVINO:
  Face Detection FP16 - CPU
  Face Detection FP16-INT8 - CPU
  Age Gender Recognition Retail 0013 FP16 - CPU
  Age Gender Recognition Retail 0013 FP16-INT8 - CPU
  Person Detection FP16 - CPU
  Person Detection FP32 - CPU
  Weld Porosity Detection FP16-INT8 - CPU
  Weld Porosity Detection FP16 - CPU
  Vehicle Detection FP16-INT8 - CPU
  Vehicle Detection FP16 - CPU
  Person Vehicle Bike Detection FP16 - CPU
  Machine Translation EN To DE FP16 - CPU
Neural Magic DeepSparse:
  NLP Text Classification, BERT base uncased SST2 - Synchronous Single-Stream
  NLP Text Classification, BERT base uncased SST2 - Asynchronous Multi-Stream
  NLP Text Classification, DistilBERT mnli - Synchronous Single-Stream
  NLP Text Classification, DistilBERT mnli - Asynchronous Multi-Stream
  CV Classification, ResNet-50 ImageNet - Synchronous Single-Stream
  CV Classification, ResNet-50 ImageNet - Asynchronous Multi-Stream
  NLP Token Classification, BERT base uncased conll2003 - Synchronous Single-Stream
  NLP Token Classification, BERT base uncased conll2003 - Asynchronous Multi-Stream
  NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Synchronous Single-Stream
  NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Asynchronous Multi-Stream
  CV Detection,YOLOv5s COCO - Synchronous Single-Stream
  CV Detection,YOLOv5s COCO - Asynchronous Multi-Stream
  NLP Document Classification, oBERT base uncased on IMDB - Synchronous Single-Stream
  NLP Document Classification, oBERT base uncased on IMDB - Asynchronous Multi-Stream
OpenRadioss:
  Bird Strike on Windshield
  Rubber O-Ring Seal Installation
  Cell Phone Drop Test
  Bumper Beam
  INIVOL and Fluid Structure Interaction Drop Container
OpenFOAM:
  drivaerFastback, Small Mesh Size - Mesh Time
  drivaerFastback, Small Mesh Size - Execution Time