AMD Ryzen 9 7950X AVX-512

AMD Ryzen 9 7950X AVX-512 benchmark comparison by Michael Larabel launch day embargo lift review. Stock/out-of-the-box build with AVX-512. For lack of any AVX-512 toggle from the ASUS BIOS, the AVX2 / non-AVX-512 run was carried out by booting kernel with "clearcpuid=304" to clear AVX-512 support from the kernel and for the binary programs that scan /proc/cpuinfo for avx512* extensions. Plus for the open-source benchmarks specifying CFLAGS/CXXFLAGS without AVX-512 extensions. See full launch day review @ https://www.phoronix.com/review/amd-zen4-avx512

HTML result view exported from: https://openbenchmarking.org/result/2209253-NE-RYZEN795065&gru&rdt.

AMD Ryzen 9 7950X AVX-512ProcessorMotherboardChipsetMemoryDiskGraphicsAudioMonitorNetworkOSKernelDesktopDisplay ServerOpenGLVulkanCompilerFile-SystemScreen ResolutionWithout AVX-512Default, AVX-512 EnabledAMD Ryzen 9 7950X 16-Core @ 5.88GHz (16 Cores / 32 Threads)ASUS ROG CROSSHAIR X670E HERO (0604 BIOS)AMD Device 14d832GB2000GB Samsung SSD 980 PRO 2TB + 2000GBAMD Radeon RX 6800 XT 16GB (2575/1000MHz)AMD Navi 21 HDMI AudioASUS VP28UIntel I225-V + Intel Wi-Fi 6 AX210/AX211/AX411Ubuntu 22.046.0.0-060000rc1daily20220820-generic (x86_64)GNOME Shell 42.2X Server + Wayland4.6 Mesa 22.3.0-devel (git-4685385 2022-08-23 jammy-oibaf-ppa) (LLVM 14.0.6 DRM 3.48)1.3.224GCC 12.0.1 20220319ext43840x2160OpenBenchmarking.orgKernel Details- Transparent Huge Pages: madviseEnvironment Details- Without AVX-512: CXXFLAGS="-O3 -march=native -mno-avx512f" CFLAGS="-O3 -march=native -mno-avx512f"- Default, AVX-512 Enabled: CXXFLAGS="-O3 -march=native -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi -mprefer-vector-width=512" CFLAGS="-O3 -march=native -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi -mprefer-vector-width=512" Compiler Details- --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-defaulted --enable-offload-targets=nvptx-none=/build/gcc-12-OcsLtf/gcc-12-12-20220319/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-12-OcsLtf/gcc-12-12-20220319/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v Processor Details- Scaling Governor: amd-pstate performance (Boost: Enabled) - CPU Microcode: 0xa601203Python Details- Python 3.10.4Security Details- itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional IBRS_FW STIBP: always-on RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected

AMD Ryzen 9 7950X AVX-512dav1d: Summer Nature 4Kdav1d: Summer Nature 1080popenvino: Face Detection FP16 - CPUopenvino: Person Detection FP16 - CPUopenvino: Person Detection FP32 - CPUopenvino: Vehicle Detection FP16 - CPUopenvino: Face Detection FP16-INT8 - CPUopenvino: Vehicle Detection FP16-INT8 - CPUopenvino: Weld Porosity Detection FP16 - CPUopenvino: Machine Translation EN To DE FP16 - CPUopenvino: Weld Porosity Detection FP16-INT8 - CPUopenvino: Person Vehicle Bike Detection FP16 - CPUopenvino: Age Gender Recognition Retail 0013 FP16-INT8 - CPUopenvino: Age Gender Recognition Retail 0013 FP16 - CPUembree: Pathtracer ISPC - Crownembree: Pathtracer ISPC - Asian Dragonsimdjson: TopTweetsimdjson: LargeRandsimdjson: PartialTweetssimdjson: DistinctUserIDsimdjson: Kostyaopenvkl: vklBenchmark ISPCospray: particle_volume/pathtracer/real_timeospray: gravity_spheres_volume/dim_512/ao/real_timeospray: gravity_spheres_volume/dim_512/scivis/real_timeospray: gravity_spheres_volume/dim_512/pathtracer/real_timecpuminer-opt: Blake-2 Scpuminer-opt: Garlicoincpuminer-opt: Skeincoincpuminer-opt: Myriad-Groestlcpuminer-opt: LBC, LBRY Creditscpuminer-opt: Quad SHA-256, Pyritelczero: Eigenonednn: IP Shapes 1D - u8s8f32 - CPUonednn: Convolution Batch Shapes Auto - u8s8f32 - CPUonednn: Deconvolution Batch shapes_1d - u8s8f32 - CPUonednn: Deconvolution Batch shapes_3d - u8s8f32 - CPUonednn: Recurrent Neural Network Training - u8s8f32 - CPUonednn: Recurrent Neural Network Inference - u8s8f32 - CPUonednn: Recurrent Neural Network Training - bf16bf16bf16 - CPUonednn: Recurrent Neural Network Inference - bf16bf16bf16 - CPUospray-studio: 1 - 4K - 1 - Path Tracerospray-studio: 3 - 4K - 1 - Path Tracerospray-studio: 1 - 4K - 16 - Path Tracerospray-studio: 1 - 4K - 32 - Path Tracerospray-studio: 3 - 4K - 16 - Path Tracerospray-studio: 3 - 4K - 32 - Path Tracermnn: SqueezeNetV1.0ncnn: CPU - vision_transformeropenvino: Face Detection FP16 - CPUopenvino: Person Detection FP16 - CPUopenvino: Person Detection FP32 - CPUopenvino: Vehicle Detection FP16 - CPUopenvino: Face Detection FP16-INT8 - CPUopenvino: Vehicle Detection FP16-INT8 - CPUopenvino: Weld Porosity Detection FP16 - CPUopenvino: Machine Translation EN To DE FP16 - CPUopenvino: Weld Porosity Detection FP16-INT8 - CPUopenvino: Person Vehicle Bike Detection FP16 - CPUopenvino: Age Gender Recognition Retail 0013 FP16 - CPUopenvino: Age Gender Recognition Retail 0013 FP16-INT8 - CPUWithout AVX-512Default, AVX-512 Enabled380.321412.276.744.204.20502.2813.60953.79681.3766.031353.84907.3638316.8722781.7029.117030.38707.901.577.697.744.95153231.3784.535294.333986.9222710337002597.65204320163937696019266715780.6259427.449360.8001161.083961566.09910.4601544.39902.1024502534874844146156883441728723.99762.741178.811889.401887.1315.92585.818.3811.73121.0611.818.800.70.41393.401451.9414.507.577.55742.9028.441890.251455.45134.592938.131696.8264463.9445555.6735.229335.12179.961.799.6410.266.01199250.6558.053977.934329.5090621134343977.802846675995715172032150317350.4171965.321270.4159400.5764321137.29583.3161137.96582.9013659436862029120727736171439813.54339.57549.941050.371054.9210.76280.864.235.4959.395.444.710.350.24OpenBenchmarking.org

CPU Temperature Monitor

Phoronix Test Suite System Monitoring

OpenBenchmarking.orgCelsiusCPU Temperature MonitorPhoronix Test Suite System MonitoringWithout AVX-512Default, AVX-512 Enabled20406080100Min: 36.13 / Avg: 84.12 / Max: 96.75Min: 33.63 / Avg: 81.24 / Max: 96.25

CPU Peak Freq (Highest CPU Core Frequency) Monitor

Phoronix Test Suite System Monitoring

OpenBenchmarking.orgMegahertzCPU Peak Freq (Highest CPU Core Frequency) MonitorPhoronix Test Suite System MonitoringWithout AVX-512Default, AVX-512 Enabled10002000300040005000Min: 4495 / Avg: 5334.93 / Max: 5881Min: 4421 / Avg: 5372.19 / Max: 5881

CPU Power Consumption Monitor

Phoronix Test Suite System Monitoring

OpenBenchmarking.orgWattsCPU Power Consumption MonitorPhoronix Test Suite System MonitoringWithout AVX-512Default, AVX-512 Enabled4080120160200Min: 10.2 / Avg: 161.11 / Max: 235.88Min: 11.53 / Avg: 158.06 / Max: 237.76

dav1d

Video Input: Summer Nature 4K

OpenBenchmarking.orgFPS, More Is Betterdav1d 1.0Video Input: Summer Nature 4KWithout AVX-512Default, AVX-512 Enabled90180270360450SE +/- 3.22, N = 5SE +/- 1.37, N = 5380.32393.40-mno-avx512f-mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi -lm1. (CC) gcc options: -O3 -march=native -pthread

dav1d

Video Input: Summer Nature 1080p

OpenBenchmarking.orgFPS, More Is Betterdav1d 1.0Video Input: Summer Nature 1080pWithout AVX-512Default, AVX-512 Enabled30060090012001500SE +/- 2.53, N = 10SE +/- 1.72, N = 101412.271451.94-mno-avx512f-mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi -lm1. (CC) gcc options: -O3 -march=native -pthread

OpenVINO

Model: Face Detection FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.2.devModel: Face Detection FP16 - Device: CPUWithout AVX-512Default, AVX-512 Enabled48121620SE +/- 0.01, N = 3SE +/- 0.01, N = 36.7414.50-mno-avx512f-mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi1. (CXX) g++ options: -fPIC -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -flto -shared

OpenVINO

Model: Person Detection FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.2.devModel: Person Detection FP16 - Device: CPUWithout AVX-512Default, AVX-512 Enabled246810SE +/- 0.00, N = 3SE +/- 0.02, N = 34.207.57-mno-avx512f-mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi1. (CXX) g++ options: -fPIC -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -flto -shared

OpenVINO

Model: Person Detection FP32 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.2.devModel: Person Detection FP32 - Device: CPUWithout AVX-512Default, AVX-512 Enabled246810SE +/- 0.02, N = 3SE +/- 0.02, N = 34.207.55-mno-avx512f-mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi1. (CXX) g++ options: -fPIC -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -flto -shared

OpenVINO

Model: Vehicle Detection FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.2.devModel: Vehicle Detection FP16 - Device: CPUWithout AVX-512Default, AVX-512 Enabled160320480640800SE +/- 5.20, N = 3SE +/- 8.04, N = 3502.28742.90-mno-avx512f-mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi1. (CXX) g++ options: -fPIC -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -flto -shared

OpenVINO

Model: Face Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.2.devModel: Face Detection FP16-INT8 - Device: CPUWithout AVX-512Default, AVX-512 Enabled714212835SE +/- 0.02, N = 3SE +/- 0.01, N = 313.6028.44-mno-avx512f-mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi1. (CXX) g++ options: -fPIC -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -flto -shared

OpenVINO

Model: Vehicle Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.2.devModel: Vehicle Detection FP16-INT8 - Device: CPUWithout AVX-512Default, AVX-512 Enabled400800120016002000SE +/- 0.65, N = 3SE +/- 2.10, N = 3953.791890.25-mno-avx512f-mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi1. (CXX) g++ options: -fPIC -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -flto -shared

OpenVINO

Model: Weld Porosity Detection FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.2.devModel: Weld Porosity Detection FP16 - Device: CPUWithout AVX-512Default, AVX-512 Enabled30060090012001500SE +/- 0.52, N = 3SE +/- 1.06, N = 3681.371455.45-mno-avx512f-mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi1. (CXX) g++ options: -fPIC -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -flto -shared

OpenVINO

Model: Machine Translation EN To DE FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.2.devModel: Machine Translation EN To DE FP16 - Device: CPUWithout AVX-512Default, AVX-512 Enabled306090120150SE +/- 0.12, N = 3SE +/- 0.42, N = 366.03134.59-mno-avx512f-mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi1. (CXX) g++ options: -fPIC -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -flto -shared

OpenVINO

Model: Weld Porosity Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.2.devModel: Weld Porosity Detection FP16-INT8 - Device: CPUWithout AVX-512Default, AVX-512 Enabled6001200180024003000SE +/- 2.11, N = 3SE +/- 4.82, N = 31353.842938.13-mno-avx512f-mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi1. (CXX) g++ options: -fPIC -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -flto -shared

dav1d

Video Input: Summer Nature 1080p

OpenBenchmarking.orgFPS Per Watt, More Is Betterdav1d 1.0Video Input: Summer Nature 1080pWithout AVX-512Default, AVX-512 Enabled4812162017.2118.11

OpenVINO

Model: Person Vehicle Bike Detection FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.2.devModel: Person Vehicle Bike Detection FP16 - Device: CPUWithout AVX-512Default, AVX-512 Enabled400800120016002000SE +/- 1.39, N = 3SE +/- 3.05, N = 3907.361696.82-mno-avx512f-mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi1. (CXX) g++ options: -fPIC -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -flto -shared

OpenVINO

Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.2.devModel: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPUWithout AVX-512Default, AVX-512 Enabled14K28K42K56K70KSE +/- 43.53, N = 3SE +/- 24.16, N = 338316.8764463.94-mno-avx512f-mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi1. (CXX) g++ options: -fPIC -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -flto -shared

dav1d

Video Input: Summer Nature 4K

OpenBenchmarking.orgFPS Per Watt, More Is Betterdav1d 1.0Video Input: Summer Nature 4KWithout AVX-512Default, AVX-512 Enabled0.70181.40362.10542.80723.5092.9373.119

OpenVINO

Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.2.devModel: Age Gender Recognition Retail 0013 FP16 - Device: CPUWithout AVX-512Default, AVX-512 Enabled10K20K30K40K50KSE +/- 51.81, N = 3SE +/- 43.30, N = 322781.7045555.67-mno-avx512f-mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi1. (CXX) g++ options: -fPIC -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -flto -shared

Embree

Binary: Pathtracer ISPC - Model: Crown

OpenBenchmarking.orgFrames Per Second, More Is BetterEmbree 3.13Binary: Pathtracer ISPC - Model: CrownWithout AVX-512Default, AVX-512 Enabled816243240SE +/- 0.11, N = 3SE +/- 0.08, N = 329.1235.23MIN: 28.7 / MAX: 29.86MIN: 34.75 / MAX: 36.08

Embree

Binary: Pathtracer ISPC - Model: Asian Dragon

OpenBenchmarking.orgFrames Per Second, More Is BetterEmbree 3.13Binary: Pathtracer ISPC - Model: Asian DragonWithout AVX-512Default, AVX-512 Enabled816243240SE +/- 0.16, N = 3SE +/- 0.08, N = 330.3935.12MIN: 29.85 / MAX: 30.94MIN: 34.64 / MAX: 36.13

Embree

Binary: Pathtracer ISPC - Model: Crown

OpenBenchmarking.orgFrames Per Second Per Watt, More Is BetterEmbree 3.13Binary: Pathtracer ISPC - Model: CrownWithout AVX-512Default, AVX-512 Enabled0.04230.08460.12690.16920.21150.1530.188

Embree

Binary: Pathtracer ISPC - Model: Asian Dragon

OpenBenchmarking.orgFrames Per Second Per Watt, More Is BetterEmbree 3.13Binary: Pathtracer ISPC - Model: Asian DragonWithout AVX-512Default, AVX-512 Enabled0.04770.09540.14310.19080.23850.1710.212

simdjson

Throughput Test: TopTweet

OpenBenchmarking.orgGB/s, More Is Bettersimdjson 2.0Throughput Test: TopTweetWithout AVX-512Default, AVX-512 Enabled3691215SE +/- 0.02, N = 3SE +/- 0.09, N = 37.909.96-mno-avx512f-mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi1. (CXX) g++ options: -O3 -march=native

simdjson

Throughput Test: Kostya

OpenBenchmarking.orgGB/s Per Watt, More Is Bettersimdjson 2.0Throughput Test: KostyaWithout AVX-512Default, AVX-512 Enabled0.02120.04240.06360.08480.1060.0760.094

simdjson

Throughput Test: TopTweet

OpenBenchmarking.orgGB/s Per Watt, More Is Bettersimdjson 2.0Throughput Test: TopTweetWithout AVX-512Default, AVX-512 Enabled0.03560.07120.10680.14240.1780.1250.158

simdjson

Throughput Test: LargeRandom

OpenBenchmarking.orgGB/s, More Is Bettersimdjson 2.0Throughput Test: LargeRandomWithout AVX-512Default, AVX-512 Enabled0.40280.80561.20841.61122.014SE +/- 0.00, N = 3SE +/- 0.00, N = 31.571.79-mno-avx512f-mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi1. (CXX) g++ options: -O3 -march=native

simdjson

Throughput Test: PartialTweets

OpenBenchmarking.orgGB/s, More Is Bettersimdjson 2.0Throughput Test: PartialTweetsWithout AVX-512Default, AVX-512 Enabled3691215SE +/- 0.01, N = 3SE +/- 0.08, N = 37.699.64-mno-avx512f-mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi1. (CXX) g++ options: -O3 -march=native

simdjson

Throughput Test: DistinctUserID

OpenBenchmarking.orgGB/s, More Is Bettersimdjson 2.0Throughput Test: DistinctUserIDWithout AVX-512Default, AVX-512 Enabled3691215SE +/- 0.07, N = 3SE +/- 0.06, N = 37.7410.26-mno-avx512f-mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi1. (CXX) g++ options: -O3 -march=native

simdjson

Throughput Test: LargeRandom

OpenBenchmarking.orgGB/s Per Watt, More Is Bettersimdjson 2.0Throughput Test: LargeRandomWithout AVX-512Default, AVX-512 Enabled0.00650.0130.01950.0260.03250.0250.029

simdjson

Throughput Test: PartialTweets

OpenBenchmarking.orgGB/s Per Watt, More Is Bettersimdjson 2.0Throughput Test: PartialTweetsWithout AVX-512Default, AVX-512 Enabled0.03490.06980.10470.13960.17450.1210.155

simdjson

Throughput Test: Kostya

OpenBenchmarking.orgGB/s, More Is Bettersimdjson 2.0Throughput Test: KostyaWithout AVX-512Default, AVX-512 Enabled246810SE +/- 0.00, N = 3SE +/- 0.04, N = 34.956.01-mno-avx512f-mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi1. (CXX) g++ options: -O3 -march=native

simdjson

Throughput Test: DistinctUserID

OpenBenchmarking.orgGB/s Per Watt, More Is Bettersimdjson 2.0Throughput Test: DistinctUserIDWithout AVX-512Default, AVX-512 Enabled0.03710.07420.11130.14840.18550.1220.165

OpenVKL

Benchmark: vklBenchmark ISPC

OpenBenchmarking.orgItems / Sec Per Watt, More Is BetterOpenVKL 1.0Benchmark: vklBenchmark ISPCWithout AVX-512Default, AVX-512 Enabled0.28730.57460.86191.14921.43650.9121.277

OpenVKL

Benchmark: vklBenchmark ISPC

OpenBenchmarking.orgItems / Sec, More Is BetterOpenVKL 1.0Benchmark: vklBenchmark ISPCWithout AVX-512Default, AVX-512 Enabled4080120160200SE +/- 0.00, N = 3SE +/- 0.33, N = 3153199MIN: 14 / MAX: 1843MIN: 17 / MAX: 2254

OSPRay

Benchmark: particle_volume/pathtracer/real_time

OpenBenchmarking.orgItems Per Second, More Is BetterOSPRay 2.10Benchmark: particle_volume/pathtracer/real_timeWithout AVX-512Default, AVX-512 Enabled50100150200250SE +/- 0.59, N = 3SE +/- 0.91, N = 3231.38250.66

OSPRay

Benchmark: particle_volume/pathtracer/real_time

OpenBenchmarking.orgItems Per Second Per Watt, More Is BetterOSPRay 2.10Benchmark: particle_volume/pathtracer/real_timeWithout AVX-512Default, AVX-512 Enabled0.31370.62740.94111.25481.56851.2371.394

OSPRay

Benchmark: gravity_spheres_volume/dim_512/ao/real_time

OpenBenchmarking.orgItems Per Second, More Is BetterOSPRay 2.10Benchmark: gravity_spheres_volume/dim_512/ao/real_timeWithout AVX-512Default, AVX-512 Enabled246810SE +/- 0.00574, N = 3SE +/- 0.00437, N = 34.535298.05397

OSPRay

Benchmark: gravity_spheres_volume/dim_512/scivis/real_time

OpenBenchmarking.orgItems Per Second, More Is BetterOSPRay 2.10Benchmark: gravity_spheres_volume/dim_512/scivis/real_timeWithout AVX-512Default, AVX-512 Enabled246810SE +/- 0.00159, N = 3SE +/- 0.03212, N = 34.333987.93432

OSPRay

Benchmark: gravity_spheres_volume/dim_512/pathtracer/real_time

OpenBenchmarking.orgItems Per Second, More Is BetterOSPRay 2.10Benchmark: gravity_spheres_volume/dim_512/pathtracer/real_timeWithout AVX-512Default, AVX-512 Enabled3691215SE +/- 0.00119, N = 3SE +/- 0.00541, N = 36.922279.50906

OSPRay

Benchmark: gravity_spheres_volume/dim_512/ao/real_time

OpenBenchmarking.orgItems Per Second Per Watt, More Is BetterOSPRay 2.10Benchmark: gravity_spheres_volume/dim_512/ao/real_timeWithout AVX-512Default, AVX-512 Enabled0.00970.01940.02910.03880.04850.0230.043

OSPRay

Benchmark: gravity_spheres_volume/dim_512/scivis/real_time

OpenBenchmarking.orgItems Per Second Per Watt, More Is BetterOSPRay 2.10Benchmark: gravity_spheres_volume/dim_512/scivis/real_timeWithout AVX-512Default, AVX-512 Enabled0.00950.0190.02850.0380.04750.0220.042

OSPRay

Benchmark: gravity_spheres_volume/dim_512/pathtracer/real_time

OpenBenchmarking.orgItems Per Second Per Watt, More Is BetterOSPRay 2.10Benchmark: gravity_spheres_volume/dim_512/pathtracer/real_timeWithout AVX-512Default, AVX-512 Enabled0.01130.02260.03390.04520.05650.0350.050

Cpuminer-Opt

Algorithm: Garlicoin

OpenBenchmarking.orgkH/s Per Watt, More Is BetterCpuminer-Opt 3.18Algorithm: GarlicoinWithout AVX-512Default, AVX-512 Enabled61218243015.4524.63

Cpuminer-Opt

Algorithm: Skeincoin

OpenBenchmarking.orgkH/s Per Watt, More Is BetterCpuminer-Opt 3.18Algorithm: SkeincoinWithout AVX-512Default, AVX-512 Enabled60012001800240030001926.962696.44

Cpuminer-Opt

Algorithm: Blake-2 S

OpenBenchmarking.orgkH/s, More Is BetterCpuminer-Opt 3.18Algorithm: Blake-2 SWithout AVX-512Default, AVX-512 Enabled500K1000K1500K2000K2500KSE +/- 4192.40, N = 3SE +/- 38034.65, N = 1210337002113434-mno-avx512f-mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi1. (CXX) g++ options: -O3 -march=native -lcurl -lz -lpthread -lssl -lcrypto -lgmp

Cpuminer-Opt

Algorithm: Blake-2 S

OpenBenchmarking.orgkH/s Per Watt, More Is BetterCpuminer-Opt 3.18Algorithm: Blake-2 SWithout AVX-512Default, AVX-512 Enabled4K8K12K16K20K9800.3719614.14

Cpuminer-Opt

Algorithm: Myriad-Groestl

OpenBenchmarking.orgkH/s Per Watt, More Is BetterCpuminer-Opt 3.18Algorithm: Myriad-GroestlWithout AVX-512Default, AVX-512 Enabled110220330440550128.78496.89

Cpuminer-Opt

Algorithm: LBC, LBRY Credits

OpenBenchmarking.orgkH/s Per Watt, More Is BetterCpuminer-Opt 3.18Algorithm: LBC, LBRY CreditsWithout AVX-512Default, AVX-512 Enabled30060090012001500579.301370.92

Cpuminer-Opt

Algorithm: Quad SHA-256, Pyrite

OpenBenchmarking.orgkH/s Per Watt, More Is BetterCpuminer-Opt 3.18Algorithm: Quad SHA-256, PyriteWithout AVX-512Default, AVX-512 Enabled60012001800240030001788.773025.64

Cpuminer-Opt

Algorithm: Garlicoin

OpenBenchmarking.orgkH/s, More Is BetterCpuminer-Opt 3.18Algorithm: GarlicoinWithout AVX-512Default, AVX-512 Enabled9001800270036004500SE +/- 25.96, N = 3SE +/- 75.31, N = 122597.653977.80-mno-avx512f-mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi1. (CXX) g++ options: -O3 -march=native -lcurl -lz -lpthread -lssl -lcrypto -lgmp

Cpuminer-Opt

Algorithm: Skeincoin

OpenBenchmarking.orgkH/s, More Is BetterCpuminer-Opt 3.18Algorithm: SkeincoinWithout AVX-512Default, AVX-512 Enabled60K120K180K240K300KSE +/- 1803.62, N = 3SE +/- 424.91, N = 3204320284667-mno-avx512f-mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi1. (CXX) g++ options: -O3 -march=native -lcurl -lz -lpthread -lssl -lcrypto -lgmp

Cpuminer-Opt

Algorithm: Myriad-Groestl

OpenBenchmarking.orgkH/s, More Is BetterCpuminer-Opt 3.18Algorithm: Myriad-GroestlWithout AVX-512Default, AVX-512 Enabled13K26K39K52K65KSE +/- 105.88, N = 3SE +/- 669.95, N = 151639359957-mno-avx512f-mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi1. (CXX) g++ options: -O3 -march=native -lcurl -lz -lpthread -lssl -lcrypto -lgmp

Cpuminer-Opt

Algorithm: LBC, LBRY Credits

OpenBenchmarking.orgkH/s, More Is BetterCpuminer-Opt 3.18Algorithm: LBC, LBRY CreditsWithout AVX-512Default, AVX-512 Enabled30K60K90K120K150KSE +/- 40.41, N = 3SE +/- 177.76, N = 376960151720-mno-avx512f-mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi1. (CXX) g++ options: -O3 -march=native -lcurl -lz -lpthread -lssl -lcrypto -lgmp

Cpuminer-Opt

Algorithm: Quad SHA-256, Pyrite

OpenBenchmarking.orgkH/s, More Is BetterCpuminer-Opt 3.18Algorithm: Quad SHA-256, PyriteWithout AVX-512Default, AVX-512 Enabled70K140K210K280K350KSE +/- 177.04, N = 3SE +/- 1040.42, N = 3192667321503-mno-avx512f-mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi1. (CXX) g++ options: -O3 -march=native -lcurl -lz -lpthread -lssl -lcrypto -lgmp

LeelaChessZero

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxWithout AVX-512515253075881Default, AVX-512 Enabled519153215881OpenBenchmarking.orgMegahertz, More Is BetterLeelaChessZero 0.28CPU Peak Freq (Highest CPU Core Frequency) Monitor16003200480064008000

simdjson

CPU Peak Freq (Highest CPU Core Frequency) Monitor

OpenBenchmarking.orgMegahertz, More Is Bettersimdjson 2.0CPU Peak Freq (Highest CPU Core Frequency) MonitorDefault, AVX-512 Enabled130026003900520065005881

simdjson

CPU Peak Freq (Highest CPU Core Frequency) Monitor

OpenBenchmarking.orgMegahertz, More Is Bettersimdjson 2.0CPU Peak Freq (Highest CPU Core Frequency) MonitorDefault, AVX-512 Enabled130026003900520065005881

simdjson

CPU Peak Freq (Highest CPU Core Frequency) Monitor

OpenBenchmarking.orgMegahertz, More Is Bettersimdjson 2.0CPU Peak Freq (Highest CPU Core Frequency) MonitorDefault, AVX-512 Enabled130026003900520065005881

simdjson

CPU Peak Freq (Highest CPU Core Frequency) Monitor

OpenBenchmarking.orgMegahertz, More Is Bettersimdjson 2.0CPU Peak Freq (Highest CPU Core Frequency) MonitorDefault, AVX-512 Enabled130026003900520065005881

simdjson

CPU Peak Freq (Highest CPU Core Frequency) Monitor

OpenBenchmarking.orgMegahertz, More Is Bettersimdjson 2.0CPU Peak Freq (Highest CPU Core Frequency) MonitorDefault, AVX-512 Enabled130026003900520065005881

dav1d

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxWithout AVX-512525854925881Default, AVX-512 Enabled523954935881OpenBenchmarking.orgMegahertz, More Is Betterdav1d 1.0CPU Peak Freq (Highest CPU Core Frequency) Monitor16003200480064008000

dav1d

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxWithout AVX-512526356865881Default, AVX-512 Enabled528256745881OpenBenchmarking.orgMegahertz, More Is Betterdav1d 1.0CPU Peak Freq (Highest CPU Core Frequency) Monitor16003200480064008000

Embree

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxWithout AVX-512515253005881Default, AVX-512 Enabled514653245881OpenBenchmarking.orgMegahertz, More Is BetterEmbree 3.13CPU Peak Freq (Highest CPU Core Frequency) Monitor16003200480064008000

Embree

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxWithout AVX-512519753545881Default, AVX-512 Enabled522253755881OpenBenchmarking.orgMegahertz, More Is BetterEmbree 3.13CPU Peak Freq (Highest CPU Core Frequency) Monitor16003200480064008000

OpenVKL

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxWithout AVX-512507253465881Default, AVX-512 Enabled516854035881OpenBenchmarking.orgMegahertz, More Is BetterOpenVKL 1.0CPU Peak Freq (Highest CPU Core Frequency) Monitor16003200480064008000

OSPRay

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxWithout AVX-512507051855881Default, AVX-512 Enabled512752705881OpenBenchmarking.orgMegahertz, More Is BetterOSPRay 2.10CPU Peak Freq (Highest CPU Core Frequency) Monitor16003200480064008000

OSPRay

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxWithout AVX-512513152015881Default, AVX-512 Enabled516552435881OpenBenchmarking.orgMegahertz, More Is BetterOSPRay 2.10CPU Peak Freq (Highest CPU Core Frequency) Monitor16003200480064008000

OSPRay

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxWithout AVX-512512152015881Default, AVX-512 Enabled516652355881OpenBenchmarking.orgMegahertz, More Is BetterOSPRay 2.10CPU Peak Freq (Highest CPU Core Frequency) Monitor16003200480064008000

OSPRay

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxWithout AVX-512510751875881Default, AVX-512 Enabled515552255881OpenBenchmarking.orgMegahertz, More Is BetterOSPRay 2.10CPU Peak Freq (Highest CPU Core Frequency) Monitor16003200480064008000

oneDNN

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxWithout AVX-512512553675881Default, AVX-512 Enabled512754195881OpenBenchmarking.orgMegahertz, More Is BetteroneDNN 2.6CPU Peak Freq (Highest CPU Core Frequency) Monitor16003200480064008000

oneDNN

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxWithout AVX-512531855855881Default, AVX-512 Enabled491054755881OpenBenchmarking.orgMegahertz, More Is BetteroneDNN 2.6CPU Peak Freq (Highest CPU Core Frequency) Monitor16003200480064008000

oneDNN

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxWithout AVX-512499253485881Default, AVX-512 Enabled518053815881OpenBenchmarking.orgMegahertz, More Is BetteroneDNN 2.6CPU Peak Freq (Highest CPU Core Frequency) Monitor16003200480064008000

oneDNN

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxWithout AVX-512515755855881Default, AVX-512 Enabled520856135881OpenBenchmarking.orgMegahertz, More Is BetteroneDNN 2.6CPU Peak Freq (Highest CPU Core Frequency) Monitor16003200480064008000

oneDNN

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxWithout AVX-512477250075881Default, AVX-512 Enabled482251665881OpenBenchmarking.orgMegahertz, More Is BetteroneDNN 2.6CPU Peak Freq (Highest CPU Core Frequency) Monitor16003200480064008000

oneDNN

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxWithout AVX-512480450515881Default, AVX-512 Enabled480250915881OpenBenchmarking.orgMegahertz, More Is BetteroneDNN 2.6CPU Peak Freq (Highest CPU Core Frequency) Monitor16003200480064008000

oneDNN

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxWithout AVX-512474549855881Default, AVX-512 Enabled456051635881OpenBenchmarking.orgMegahertz, More Is BetteroneDNN 2.6CPU Peak Freq (Highest CPU Core Frequency) Monitor16003200480064008000

oneDNN

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxWithout AVX-512449550585881Default, AVX-512 Enabled442150885881OpenBenchmarking.orgMegahertz, More Is BetteroneDNN 2.6CPU Peak Freq (Highest CPU Core Frequency) Monitor16003200480064008000

OSPRay Studio

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxWithout AVX-512512352125881Default, AVX-512 Enabled513652305881OpenBenchmarking.orgMegahertz, More Is BetterOSPRay Studio 0.11CPU Peak Freq (Highest CPU Core Frequency) Monitor16003200480064008000

OSPRay Studio

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxWithout AVX-512511752075881Default, AVX-512 Enabled513452275881OpenBenchmarking.orgMegahertz, More Is BetterOSPRay Studio 0.11CPU Peak Freq (Highest CPU Core Frequency) Monitor16003200480064008000

OSPRay Studio

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxWithout AVX-512511852545881Default, AVX-512 Enabled514252955881OpenBenchmarking.orgMegahertz, More Is BetterOSPRay Studio 0.11CPU Peak Freq (Highest CPU Core Frequency) Monitor16003200480064008000

OSPRay Studio

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxWithout AVX-512510652025881Default, AVX-512 Enabled511852295881OpenBenchmarking.orgMegahertz, More Is BetterOSPRay Studio 0.11CPU Peak Freq (Highest CPU Core Frequency) Monitor16003200480064008000

OSPRay Studio

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxWithout AVX-512512252405881Default, AVX-512 Enabled512852645881OpenBenchmarking.orgMegahertz, More Is BetterOSPRay Studio 0.11CPU Peak Freq (Highest CPU Core Frequency) Monitor16003200480064008000

OSPRay Studio

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxWithout AVX-512511851945881Default, AVX-512 Enabled513152205881OpenBenchmarking.orgMegahertz, More Is BetterOSPRay Studio 0.11CPU Peak Freq (Highest CPU Core Frequency) Monitor16003200480064008000

Cpuminer-Opt

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxWithout AVX-512520455215881Default, AVX-512 Enabled526055425881OpenBenchmarking.orgMegahertz, More Is BetterCpuminer-Opt 3.18CPU Peak Freq (Highest CPU Core Frequency) Monitor16003200480064008000

Cpuminer-Opt

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxWithout AVX-512524453395881Default, AVX-512 Enabled528353745881OpenBenchmarking.orgMegahertz, More Is BetterCpuminer-Opt 3.18CPU Peak Freq (Highest CPU Core Frequency) Monitor16003200480064008000

Cpuminer-Opt

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxWithout AVX-512518955175881Default, AVX-512 Enabled515755355881OpenBenchmarking.orgMegahertz, More Is BetterCpuminer-Opt 3.18CPU Peak Freq (Highest CPU Core Frequency) Monitor16003200480064008000

Cpuminer-Opt

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxWithout AVX-512534454495881Default, AVX-512 Enabled529855035881OpenBenchmarking.orgMegahertz, More Is BetterCpuminer-Opt 3.18CPU Peak Freq (Highest CPU Core Frequency) Monitor16003200480064008000

Cpuminer-Opt

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxWithout AVX-512516454595881Default, AVX-512 Enabled520855205881OpenBenchmarking.orgMegahertz, More Is BetterCpuminer-Opt 3.18CPU Peak Freq (Highest CPU Core Frequency) Monitor16003200480064008000

Cpuminer-Opt

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxWithout AVX-512520755225881Default, AVX-512 Enabled522455405881OpenBenchmarking.orgMegahertz, More Is BetterCpuminer-Opt 3.18CPU Peak Freq (Highest CPU Core Frequency) Monitor16003200480064008000

OpenVINO

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxWithout AVX-512498851515881Default, AVX-512 Enabled503851805881OpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2022.2.devCPU Peak Freq (Highest CPU Core Frequency) Monitor16003200480064008000

OpenVINO

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxWithout AVX-512494751895881Default, AVX-512 Enabled503552295881OpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2022.2.devCPU Peak Freq (Highest CPU Core Frequency) Monitor16003200480064008000

OpenVINO

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxWithout AVX-512491751575881Default, AVX-512 Enabled505952195881OpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2022.2.devCPU Peak Freq (Highest CPU Core Frequency) Monitor16003200480064008000

OpenVINO

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxWithout AVX-512506251735881Default, AVX-512 Enabled514452655881OpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2022.2.devCPU Peak Freq (Highest CPU Core Frequency) Monitor16003200480064008000

OpenVINO

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxWithout AVX-512496351015881Default, AVX-512 Enabled506951885881OpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2022.2.devCPU Peak Freq (Highest CPU Core Frequency) Monitor16003200480064008000

OpenVINO

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxWithout AVX-512502751255881Default, AVX-512 Enabled506651475881OpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2022.2.devCPU Peak Freq (Highest CPU Core Frequency) Monitor16003200480064008000

OpenVINO

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxWithout AVX-512500851035881Default, AVX-512 Enabled507551595881OpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2022.2.devCPU Peak Freq (Highest CPU Core Frequency) Monitor16003200480064008000

OpenVINO

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxWithout AVX-512488851405881Default, AVX-512 Enabled513952435881OpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2022.2.devCPU Peak Freq (Highest CPU Core Frequency) Monitor16003200480064008000

OpenVINO

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxWithout AVX-512498250935881Default, AVX-512 Enabled458251635881OpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2022.2.devCPU Peak Freq (Highest CPU Core Frequency) Monitor16003200480064008000

OpenVINO

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxWithout AVX-512489951145881Default, AVX-512 Enabled510051885881OpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2022.2.devCPU Peak Freq (Highest CPU Core Frequency) Monitor16003200480064008000

OpenVINO

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxWithout AVX-512494550535881Default, AVX-512 Enabled500651075881OpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2022.2.devCPU Peak Freq (Highest CPU Core Frequency) Monitor16003200480064008000

OpenVINO

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxWithout AVX-512499951145881Default, AVX-512 Enabled506251425881OpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2022.2.devCPU Peak Freq (Highest CPU Core Frequency) Monitor16003200480064008000

LeelaChessZero

Backend: Eigen

OpenBenchmarking.orgNodes Per Second, More Is BetterLeelaChessZero 0.28Backend: EigenWithout AVX-512Default, AVX-512 Enabled400800120016002000SE +/- 16.33, N = 3SE +/- 7.31, N = 315781735-mno-avx512f-mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi1. (CXX) g++ options: -flto -O3 -march=native -pthread

LeelaChessZero

Backend: Eigen

OpenBenchmarking.orgNodes Per Second Per Watt, More Is BetterLeelaChessZero 0.28Backend: EigenWithout AVX-512Default, AVX-512 Enabled36912159.10710.156

LeelaChessZero

CPU Temperature Monitor

MinAvgMaxWithout AVX-51236.188.391.0Default, AVX-512 Enabled33.684.487.4OpenBenchmarking.orgCelsius, Fewer Is BetterLeelaChessZero 0.28CPU Temperature Monitor20406080100

simdjson

CPU Temperature Monitor

MinAvgMaxWithout AVX-51239.467.768.8Default, AVX-512 Enabled39.067.168.8OpenBenchmarking.orgCelsius, Fewer Is Bettersimdjson 2.0CPU Temperature Monitor20406080100

simdjson

CPU Temperature Monitor

MinAvgMaxWithout AVX-51239.566.767.9Default, AVX-512 Enabled39.065.466.6OpenBenchmarking.orgCelsius, Fewer Is Bettersimdjson 2.0CPU Temperature Monitor20406080100

simdjson

CPU Temperature Monitor

MinAvgMaxWithout AVX-51238.968.869.9Default, AVX-512 Enabled38.566.668.0OpenBenchmarking.orgCelsius, Fewer Is Bettersimdjson 2.0CPU Temperature Monitor20406080100

simdjson

CPU Temperature Monitor

MinAvgMaxWithout AVX-51239.366.367.6Default, AVX-512 Enabled39.065.368.4OpenBenchmarking.orgCelsius, Fewer Is Bettersimdjson 2.0CPU Temperature Monitor20406080100

simdjson

CPU Temperature Monitor

MinAvgMaxWithout AVX-51238.967.269.5Default, AVX-512 Enabled38.966.768.6OpenBenchmarking.orgCelsius, Fewer Is Bettersimdjson 2.0CPU Temperature Monitor20406080100

dav1d

CPU Temperature Monitor

MinAvgMaxWithout AVX-51238.870.980.3Default, AVX-512 Enabled38.670.079.0OpenBenchmarking.orgCelsius, Fewer Is Betterdav1d 1.0CPU Temperature Monitor20406080100

dav1d

CPU Temperature Monitor

MinAvgMaxWithout AVX-51241.365.174.4Default, AVX-512 Enabled41.364.573.3OpenBenchmarking.orgCelsius, Fewer Is Betterdav1d 1.0CPU Temperature Monitor20406080100

Embree

CPU Temperature Monitor

MinAvgMaxWithout AVX-51240.084.991.0Default, AVX-512 Enabled40.383.290.9OpenBenchmarking.orgCelsius, Fewer Is BetterEmbree 3.13CPU Temperature Monitor20406080100

Embree

CPU Temperature Monitor

MinAvgMaxWithout AVX-51244.681.085.9Default, AVX-512 Enabled44.175.180.8OpenBenchmarking.orgCelsius, Fewer Is BetterEmbree 3.13CPU Temperature Monitor20406080100

OpenVKL

CPU Temperature Monitor

MinAvgMaxWithout AVX-51243.984.995.4Default, AVX-512 Enabled43.879.189.5OpenBenchmarking.orgCelsius, Fewer Is BetterOpenVKL 1.0CPU Temperature Monitor20406080100

OSPRay

CPU Temperature Monitor

MinAvgMaxWithout AVX-51245.090.895.8Default, AVX-512 Enabled43.186.393.0OpenBenchmarking.orgCelsius, Fewer Is BetterOSPRay 2.10CPU Temperature Monitor20406080100

OSPRay

CPU Temperature Monitor

MinAvgMaxWithout AVX-51244.891.493.5Default, AVX-512 Enabled42.587.089.1OpenBenchmarking.orgCelsius, Fewer Is BetterOSPRay 2.10CPU Temperature Monitor20406080100

OSPRay

CPU Temperature Monitor

MinAvgMaxWithout AVX-51247.492.093.9Default, AVX-512 Enabled46.487.389.4OpenBenchmarking.orgCelsius, Fewer Is BetterOSPRay 2.10CPU Temperature Monitor20406080100

OSPRay

CPU Temperature Monitor

MinAvgMaxWithout AVX-51248.093.395.1Default, AVX-512 Enabled46.388.991.0OpenBenchmarking.orgCelsius, Fewer Is BetterOSPRay 2.10CPU Temperature Monitor20406080100

oneDNN

CPU Temperature Monitor

MinAvgMaxWithout AVX-51248.180.293.6Default, AVX-512 Enabled48.470.887.5OpenBenchmarking.orgCelsius, Fewer Is BetteroneDNN 2.6CPU Temperature Monitor20406080100

oneDNN

CPU Temperature Monitor

MinAvgMaxWithout AVX-51245.158.865.6Default, AVX-512 Enabled42.069.782.9OpenBenchmarking.orgCelsius, Fewer Is BetteroneDNN 2.6CPU Temperature Monitor20406080100

oneDNN

CPU Temperature Monitor

MinAvgMaxWithout AVX-51240.981.994.9Default, AVX-512 Enabled41.375.886.6OpenBenchmarking.orgCelsius, Fewer Is BetteroneDNN 2.6CPU Temperature Monitor20406080100

oneDNN

CPU Temperature Monitor

MinAvgMaxWithout AVX-51244.877.991.6Default, AVX-512 Enabled43.572.482.6OpenBenchmarking.orgCelsius, Fewer Is BetteroneDNN 2.6CPU Temperature Monitor20406080100

oneDNN

CPU Temperature Monitor

MinAvgMaxWithout AVX-51243.588.195.9Default, AVX-512 Enabled42.587.892.0OpenBenchmarking.orgCelsius, Fewer Is BetteroneDNN 2.6CPU Temperature Monitor20406080100

oneDNN

CPU Temperature Monitor

MinAvgMaxWithout AVX-51247.586.495.8Default, AVX-512 Enabled47.089.292.6OpenBenchmarking.orgCelsius, Fewer Is BetteroneDNN 2.6CPU Temperature Monitor20406080100

oneDNN

CPU Temperature Monitor

MinAvgMaxWithout AVX-51247.389.896.1Default, AVX-512 Enabled47.588.892.0OpenBenchmarking.orgCelsius, Fewer Is BetteroneDNN 2.6CPU Temperature Monitor20406080100

oneDNN

CPU Temperature Monitor

MinAvgMaxWithout AVX-51247.686.896.0Default, AVX-512 Enabled47.588.992.8OpenBenchmarking.orgCelsius, Fewer Is BetteroneDNN 2.6CPU Temperature Monitor20406080100

OSPRay Studio

CPU Temperature Monitor

MinAvgMaxWithout AVX-51241.991.094.1Default, AVX-512 Enabled44.989.592.5OpenBenchmarking.orgCelsius, Fewer Is BetterOSPRay Studio 0.11CPU Temperature Monitor20406080100

OSPRay Studio

CPU Temperature Monitor

MinAvgMaxWithout AVX-51247.691.894.5Default, AVX-512 Enabled47.089.792.5OpenBenchmarking.orgCelsius, Fewer Is BetterOSPRay Studio 0.11CPU Temperature Monitor20406080100

OSPRay Studio

CPU Temperature Monitor

MinAvgMaxWithout AVX-51248.090.295.0Default, AVX-512 Enabled46.987.892.4OpenBenchmarking.orgCelsius, Fewer Is BetterOSPRay Studio 0.11CPU Temperature Monitor20406080100

OSPRay Studio

CPU Temperature Monitor

MinAvgMaxWithout AVX-51248.192.395.3Default, AVX-512 Enabled46.690.093.5OpenBenchmarking.orgCelsius, Fewer Is BetterOSPRay Studio 0.11CPU Temperature Monitor20406080100

OSPRay Studio

CPU Temperature Monitor

MinAvgMaxWithout AVX-51248.390.494.5Default, AVX-512 Enabled47.588.393.0OpenBenchmarking.orgCelsius, Fewer Is BetterOSPRay Studio 0.11CPU Temperature Monitor20406080100

OSPRay Studio

CPU Temperature Monitor

MinAvgMaxWithout AVX-51248.092.395.1Default, AVX-512 Enabled47.490.093.4OpenBenchmarking.orgCelsius, Fewer Is BetterOSPRay Studio 0.11CPU Temperature Monitor20406080100

Cpuminer-Opt

CPU Temperature Monitor

MinAvgMaxWithout AVX-51248.669.285.9Default, AVX-512 Enabled47.166.479.6OpenBenchmarking.orgCelsius, Fewer Is BetterCpuminer-Opt 3.18CPU Temperature Monitor20406080100

Cpuminer-Opt

CPU Temperature Monitor

MinAvgMaxWithout AVX-51244.375.979.9Default, AVX-512 Enabled40.872.976.3OpenBenchmarking.orgCelsius, Fewer Is BetterCpuminer-Opt 3.18CPU Temperature Monitor20406080100

Cpuminer-Opt

CPU Temperature Monitor

MinAvgMaxWithout AVX-51244.868.584.1Default, AVX-512 Enabled43.366.685.6OpenBenchmarking.orgCelsius, Fewer Is BetterCpuminer-Opt 3.18CPU Temperature Monitor20406080100

Cpuminer-Opt

CPU Temperature Monitor

MinAvgMaxWithout AVX-51243.367.773.0Default, AVX-512 Enabled42.167.671.3OpenBenchmarking.orgCelsius, Fewer Is BetterCpuminer-Opt 3.18CPU Temperature Monitor20406080100

Cpuminer-Opt

CPU Temperature Monitor

MinAvgMaxWithout AVX-51241.973.086.5Default, AVX-512 Enabled40.566.683.9OpenBenchmarking.orgCelsius, Fewer Is BetterCpuminer-Opt 3.18CPU Temperature Monitor20406080100

Cpuminer-Opt

CPU Temperature Monitor

MinAvgMaxWithout AVX-51244.067.780.0Default, AVX-512 Enabled41.464.781.5OpenBenchmarking.orgCelsius, Fewer Is BetterCpuminer-Opt 3.18CPU Temperature Monitor20406080100

OpenVINO

CPU Temperature Monitor

MinAvgMaxWithout AVX-51241.893.096.3Default, AVX-512 Enabled40.993.195.9OpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2022.2.devCPU Temperature Monitor20406080100

OpenVINO

CPU Temperature Monitor

MinAvgMaxWithout AVX-51247.694.096.6Default, AVX-512 Enabled47.193.296.1OpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2022.2.devCPU Temperature Monitor20406080100

OpenVINO

CPU Temperature Monitor

MinAvgMaxWithout AVX-51248.494.196.8Default, AVX-512 Enabled47.393.396.3OpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2022.2.devCPU Temperature Monitor20406080100

OpenVINO

CPU Temperature Monitor

MinAvgMaxWithout AVX-51247.991.294.1Default, AVX-512 Enabled47.583.486.0OpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2022.2.devCPU Temperature Monitor20406080100

OpenVINO

CPU Temperature Monitor

MinAvgMaxWithout AVX-51248.393.395.6Default, AVX-512 Enabled45.893.296.0OpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2022.2.devCPU Temperature Monitor20406080100

OpenVINO

CPU Temperature Monitor

MinAvgMaxWithout AVX-51248.393.595.4Default, AVX-512 Enabled47.393.395.4OpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2022.2.devCPU Temperature Monitor20406080100

OpenVINO

CPU Temperature Monitor

MinAvgMaxWithout AVX-51248.093.995.8Default, AVX-512 Enabled47.893.395.4OpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2022.2.devCPU Temperature Monitor20406080100

OpenVINO

CPU Temperature Monitor

MinAvgMaxWithout AVX-51248.693.796.8Default, AVX-512 Enabled47.387.290.1OpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2022.2.devCPU Temperature Monitor20406080100

OpenVINO

CPU Temperature Monitor

MinAvgMaxWithout AVX-51247.993.595.4Default, AVX-512 Enabled45.993.195.3OpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2022.2.devCPU Temperature Monitor20406080100

OpenVINO

CPU Temperature Monitor

MinAvgMaxWithout AVX-51248.393.496.0Default, AVX-512 Enabled47.591.194.1OpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2022.2.devCPU Temperature Monitor20406080100

OpenVINO

CPU Temperature Monitor

MinAvgMaxWithout AVX-51248.693.295.5Default, AVX-512 Enabled47.093.295.5OpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2022.2.devCPU Temperature Monitor20406080100

OpenVINO

CPU Temperature Monitor

MinAvgMaxWithout AVX-51248.593.795.6Default, AVX-512 Enabled48.093.295.5OpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2022.2.devCPU Temperature Monitor20406080100

oneDNN

Harness: IP Shapes 1D - Data Type: u8s8f32 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.6Harness: IP Shapes 1D - Data Type: u8s8f32 - Engine: CPUWithout AVX-512Default, AVX-512 Enabled0.14080.28160.42240.56320.704SE +/- 0.006181, N = 5SE +/- 0.007969, N = 150.6259420.417196-mno-avx512f - MIN: 0.58-mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi - MIN: 0.341. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -std=c++11 -pie -ldl -lpthread

oneDNN

Harness: Convolution Batch Shapes Auto - Data Type: u8s8f32 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.6Harness: Convolution Batch Shapes Auto - Data Type: u8s8f32 - Engine: CPUWithout AVX-512Default, AVX-512 Enabled246810SE +/- 0.00637, N = 7SE +/- 0.00255, N = 77.449365.32127-mno-avx512f - MIN: 7.29-mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi - MIN: 5.261. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -std=c++11 -pie -ldl -lpthread

oneDNN

Harness: Deconvolution Batch shapes_1d - Data Type: u8s8f32 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.6Harness: Deconvolution Batch shapes_1d - Data Type: u8s8f32 - Engine: CPUWithout AVX-512Default, AVX-512 Enabled0.180.360.540.720.9SE +/- 0.010456, N = 3SE +/- 0.000107, N = 30.8001160.415940-mno-avx512f - MIN: 0.76-mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi - MIN: 0.41. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -std=c++11 -pie -ldl -lpthread

oneDNN

Harness: Deconvolution Batch shapes_3d - Data Type: u8s8f32 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.6Harness: Deconvolution Batch shapes_3d - Data Type: u8s8f32 - Engine: CPUWithout AVX-512Default, AVX-512 Enabled0.24390.48780.73170.97561.2195SE +/- 0.006665, N = 9SE +/- 0.001581, N = 91.0839600.576432-mno-avx512f - MIN: 1.03-mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi - MIN: 0.561. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -std=c++11 -pie -ldl -lpthread

oneDNN

Harness: Recurrent Neural Network Training - Data Type: u8s8f32 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.6Harness: Recurrent Neural Network Training - Data Type: u8s8f32 - Engine: CPUWithout AVX-512Default, AVX-512 Enabled30060090012001500SE +/- 8.37, N = 3SE +/- 1.54, N = 31566.091137.29-mno-avx512f - MIN: 1541.57-mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi - MIN: 1130.881. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -std=c++11 -pie -ldl -lpthread

oneDNN

Harness: Recurrent Neural Network Inference - Data Type: u8s8f32 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.6Harness: Recurrent Neural Network Inference - Data Type: u8s8f32 - Engine: CPUWithout AVX-512Default, AVX-512 Enabled2004006008001000SE +/- 3.36, N = 3SE +/- 0.21, N = 3910.46583.32-mno-avx512f - MIN: 898.05-mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi - MIN: 579.291. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -std=c++11 -pie -ldl -lpthread

oneDNN

Harness: Recurrent Neural Network Training - Data Type: bf16bf16bf16 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.6Harness: Recurrent Neural Network Training - Data Type: bf16bf16bf16 - Engine: CPUWithout AVX-512Default, AVX-512 Enabled30060090012001500SE +/- 19.60, N = 3SE +/- 1.66, N = 31544.391137.96-mno-avx512f - MIN: 1494.51-mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi - MIN: 1131.231. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -std=c++11 -pie -ldl -lpthread

oneDNN

Harness: Recurrent Neural Network Inference - Data Type: bf16bf16bf16 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.6Harness: Recurrent Neural Network Inference - Data Type: bf16bf16bf16 - Engine: CPUWithout AVX-512Default, AVX-512 Enabled2004006008001000SE +/- 5.88, N = 3SE +/- 1.02, N = 3902.10582.90-mno-avx512f - MIN: 885.67-mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi - MIN: 578.181. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -std=c++11 -pie -ldl -lpthread

OSPRay Studio

Camera: 1 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path Tracer

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.11Camera: 1 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path TracerWithout AVX-512Default, AVX-512 Enabled10002000300040005000SE +/- 6.51, N = 3SE +/- 5.21, N = 345023659-mno-avx512f-mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi1. (CXX) g++ options: -O3 -march=native -ldl

OSPRay Studio

Camera: 3 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path Tracer

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.11Camera: 3 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path TracerWithout AVX-512Default, AVX-512 Enabled11002200330044005500SE +/- 3.28, N = 3SE +/- 5.55, N = 353484368-mno-avx512f-mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi1. (CXX) g++ options: -O3 -march=native -ldl

OSPRay Studio

Camera: 1 - Resolution: 4K - Samples Per Pixel: 16 - Renderer: Path Tracer

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.11Camera: 1 - Resolution: 4K - Samples Per Pixel: 16 - Renderer: Path TracerWithout AVX-512Default, AVX-512 Enabled16K32K48K64K80KSE +/- 91.34, N = 3SE +/- 138.54, N = 37484462029-mno-avx512f-mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi1. (CXX) g++ options: -O3 -march=native -ldl

OSPRay Studio

Camera: 1 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path Tracer

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.11Camera: 1 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path TracerWithout AVX-512Default, AVX-512 Enabled30K60K90K120K150KSE +/- 168.25, N = 3SE +/- 140.99, N = 3146156120727-mno-avx512f-mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi1. (CXX) g++ options: -O3 -march=native -ldl

OSPRay Studio

Camera: 3 - Resolution: 4K - Samples Per Pixel: 16 - Renderer: Path Tracer

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.11Camera: 3 - Resolution: 4K - Samples Per Pixel: 16 - Renderer: Path TracerWithout AVX-512Default, AVX-512 Enabled20K40K60K80K100KSE +/- 7.57, N = 3SE +/- 149.41, N = 38834473617-mno-avx512f-mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi1. (CXX) g++ options: -O3 -march=native -ldl

OSPRay Studio

Camera: 3 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path Tracer

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.11Camera: 3 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path TracerWithout AVX-512Default, AVX-512 Enabled40K80K120K160K200KSE +/- 155.59, N = 3SE +/- 116.66, N = 3172872143981-mno-avx512f-mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi1. (CXX) g++ options: -O3 -march=native -ldl

Mobile Neural Network

Model: SqueezeNetV1.0

OpenBenchmarking.orgms, Fewer Is BetterMobile Neural Network 2.1Model: SqueezeNetV1.0Without AVX-512Default, AVX-512 Enabled0.89931.79862.69793.59724.4965SE +/- 0.121, N = 3SE +/- 0.015, N = 63.9973.543-mno-avx512f - MIN: 3.72 / MAX: 5.69-mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi - MIN: 3.43 / MAX: 10.231. (CXX) g++ options: -O3 -march=native -std=c++11 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl

NCNN

Target: CPU - Model: vision_transformer

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20220729Target: CPU - Model: vision_transformerWithout AVX-512Default, AVX-512 Enabled1428425670SE +/- 0.91, N = 3SE +/- 0.03, N = 362.7439.57-mno-avx512f - MIN: 61.57 / MAX: 65.21-mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi - MIN: 39.32 / MAX: 41.991. (CXX) g++ options: -O3 -march=native -rdynamic -lgomp -lpthread

OpenVINO

Model: Face Detection FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.2.devModel: Face Detection FP16 - Device: CPUWithout AVX-512Default, AVX-512 Enabled30060090012001500SE +/- 0.92, N = 3SE +/- 0.48, N = 31178.81549.94-mno-avx512f - MIN: 596.16 / MAX: 1250.72-mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi - MIN: 282.71 / MAX: 577.011. (CXX) g++ options: -fPIC -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -flto -shared

OpenVINO

Model: Person Detection FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.2.devModel: Person Detection FP16 - Device: CPUWithout AVX-512Default, AVX-512 Enabled400800120016002000SE +/- 0.47, N = 3SE +/- 2.40, N = 31889.401050.37-mno-avx512f - MIN: 1032.21 / MAX: 2215.28-mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi - MIN: 604.91 / MAX: 1254.321. (CXX) g++ options: -fPIC -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -flto -shared

OpenVINO

Model: Person Detection FP32 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.2.devModel: Person Detection FP32 - Device: CPUWithout AVX-512Default, AVX-512 Enabled400800120016002000SE +/- 5.93, N = 3SE +/- 3.05, N = 31887.131054.92-mno-avx512f - MIN: 1054.92 / MAX: 2161.5-mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi - MIN: 641.2 / MAX: 1276.511. (CXX) g++ options: -fPIC -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -flto -shared

OpenVINO

Model: Vehicle Detection FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.2.devModel: Vehicle Detection FP16 - Device: CPUWithout AVX-512Default, AVX-512 Enabled48121620SE +/- 0.16, N = 3SE +/- 0.12, N = 315.9210.76-mno-avx512f - MIN: 6.75 / MAX: 34.35-mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi - MIN: 4.25 / MAX: 23.391. (CXX) g++ options: -fPIC -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -flto -shared

OpenVINO

Model: Face Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.2.devModel: Face Detection FP16-INT8 - Device: CPUWithout AVX-512Default, AVX-512 Enabled130260390520650SE +/- 0.73, N = 3SE +/- 0.17, N = 3585.81280.86-mno-avx512f - MIN: 556.1 / MAX: 596-mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi - MIN: 263.49 / MAX: 294.781. (CXX) g++ options: -fPIC -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -flto -shared

OpenVINO

Model: Vehicle Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.2.devModel: Vehicle Detection FP16-INT8 - Device: CPUWithout AVX-512Default, AVX-512 Enabled246810SE +/- 0.01, N = 3SE +/- 0.01, N = 38.384.23-mno-avx512f - MIN: 4.65 / MAX: 17.13-mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi - MIN: 2.63 / MAX: 12.451. (CXX) g++ options: -fPIC -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -flto -shared

OpenVINO

Model: Weld Porosity Detection FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.2.devModel: Weld Porosity Detection FP16 - Device: CPUWithout AVX-512Default, AVX-512 Enabled3691215SE +/- 0.01, N = 3SE +/- 0.00, N = 311.735.49-mno-avx512f - MIN: 6.24 / MAX: 20.45-mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi - MIN: 2.89 / MAX: 13.221. (CXX) g++ options: -fPIC -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -flto -shared

OpenVINO

Model: Machine Translation EN To DE FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.2.devModel: Machine Translation EN To DE FP16 - Device: CPUWithout AVX-512Default, AVX-512 Enabled306090120150SE +/- 0.21, N = 3SE +/- 0.18, N = 3121.0659.39-mno-avx512f - MIN: 57.76 / MAX: 141.8-mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi - MIN: 26.85 / MAX: 70.781. (CXX) g++ options: -fPIC -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -flto -shared

OpenVINO

Model: Weld Porosity Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.2.devModel: Weld Porosity Detection FP16-INT8 - Device: CPUWithout AVX-512Default, AVX-512 Enabled3691215SE +/- 0.02, N = 3SE +/- 0.01, N = 311.815.44-mno-avx512f - MIN: 6.9 / MAX: 19.2-mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi - MIN: 2.88 / MAX: 13.321. (CXX) g++ options: -fPIC -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -flto -shared

OpenVINO

Model: Person Vehicle Bike Detection FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.2.devModel: Person Vehicle Bike Detection FP16 - Device: CPUWithout AVX-512Default, AVX-512 Enabled246810SE +/- 0.01, N = 3SE +/- 0.01, N = 38.804.71-mno-avx512f - MIN: 5.34 / MAX: 19.18-mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi - MIN: 3.46 / MAX: 12.81. (CXX) g++ options: -fPIC -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -flto -shared

OpenVINO

Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.2.devModel: Age Gender Recognition Retail 0013 FP16 - Device: CPUWithout AVX-512Default, AVX-512 Enabled0.15750.3150.47250.630.7875SE +/- 0.00, N = 3SE +/- 0.00, N = 30.700.35-mno-avx512f - MIN: 0.39 / MAX: 8.82-mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi - MIN: 0.21 / MAX: 7.781. (CXX) g++ options: -fPIC -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -flto -shared

OpenVINO

Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.2.devModel: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPUWithout AVX-512Default, AVX-512 Enabled0.09230.18460.27690.36920.4615SE +/- 0.00, N = 3SE +/- 0.00, N = 30.410.24-mno-avx512f - MIN: 0.22 / MAX: 7.87-mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi - MIN: 0.15 / MAX: 7.551. (CXX) g++ options: -fPIC -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -flto -shared

LeelaChessZero

CPU Power Consumption Monitor

MinAvgMaxWithout AVX-51223.3173.3195.1Default, AVX-512 Enabled22.5170.8192.1OpenBenchmarking.orgWatts, Fewer Is BetterLeelaChessZero 0.28CPU Power Consumption Monitor50100150200250

simdjson

CPU Power Consumption Monitor

MinAvgMaxWithout AVX-51216.765.668.6Default, AVX-512 Enabled21.963.766.4OpenBenchmarking.orgWatts, Fewer Is Bettersimdjson 2.0CPU Power Consumption Monitor20406080100

simdjson

CPU Power Consumption Monitor

MinAvgMaxWithout AVX-51223.263.467.0Default, AVX-512 Enabled22.062.966.5OpenBenchmarking.orgWatts, Fewer Is Bettersimdjson 2.0CPU Power Consumption Monitor20406080100

simdjson

CPU Power Consumption Monitor

MinAvgMaxWithout AVX-51222.962.665.3Default, AVX-512 Enabled22.262.765.8OpenBenchmarking.orgWatts, Fewer Is Bettersimdjson 2.0CPU Power Consumption Monitor20406080100

simdjson

CPU Power Consumption Monitor

MinAvgMaxWithout AVX-51223.563.867.3Default, AVX-512 Enabled22.462.366.2OpenBenchmarking.orgWatts, Fewer Is Bettersimdjson 2.0CPU Power Consumption Monitor20406080100

simdjson

CPU Power Consumption Monitor

MinAvgMaxWithout AVX-51223.163.467.0Default, AVX-512 Enabled22.362.166.4OpenBenchmarking.orgWatts, Fewer Is Bettersimdjson 2.0CPU Power Consumption Monitor20406080100

dav1d

CPU Power Consumption Monitor

MinAvgMaxWithout AVX-51223.9129.5187.9Default, AVX-512 Enabled23.2126.1185.4OpenBenchmarking.orgWatts, Fewer Is Betterdav1d 1.0CPU Power Consumption Monitor50100150200250

dav1d

CPU Power Consumption Monitor

MinAvgMaxWithout AVX-51223.682.1180.6Default, AVX-512 Enabled23.280.2178.7OpenBenchmarking.orgWatts, Fewer Is Betterdav1d 1.0CPU Power Consumption Monitor50100150200250

Embree

CPU Power Consumption Monitor

MinAvgMaxWithout AVX-51223.3190.5227.8Default, AVX-512 Enabled22.6187.3235.9OpenBenchmarking.orgWatts, Fewer Is BetterEmbree 3.13CPU Power Consumption Monitor60120180240300

Embree

CPU Power Consumption Monitor

MinAvgMaxWithout AVX-51224.3177.3210.0Default, AVX-512 Enabled22.6166.0203.7OpenBenchmarking.orgWatts, Fewer Is BetterEmbree 3.13CPU Power Consumption Monitor60120180240300

OpenVKL

CPU Power Consumption Monitor

MinAvgMaxWithout AVX-51223.6167.7228.1Default, AVX-512 Enabled22.4155.8211.8OpenBenchmarking.orgWatts, Fewer Is BetterOpenVKL 1.0CPU Power Consumption Monitor60120180240300

OSPRay

CPU Power Consumption Monitor

MinAvgMaxWithout AVX-51222.9187.0222.6Default, AVX-512 Enabled22.4179.8215.5OpenBenchmarking.orgWatts, Fewer Is BetterOSPRay 2.10CPU Power Consumption Monitor60120180240300

OSPRay

CPU Power Consumption Monitor

MinAvgMaxWithout AVX-51223.1193.5209.6Default, AVX-512 Enabled22.5189.2205.4OpenBenchmarking.orgWatts, Fewer Is BetterOSPRay 2.10CPU Power Consumption Monitor60120180240300

OSPRay

CPU Power Consumption Monitor

MinAvgMaxWithout AVX-51223.1193.1207.2Default, AVX-512 Enabled22.4188.0204.2OpenBenchmarking.orgWatts, Fewer Is BetterOSPRay 2.10CPU Power Consumption Monitor60120180240300

OSPRay

CPU Power Consumption Monitor

MinAvgMaxWithout AVX-51223.4197.7214.7Default, AVX-512 Enabled22.8191.7209.5OpenBenchmarking.orgWatts, Fewer Is BetterOSPRay 2.10CPU Power Consumption Monitor60120180240300

oneDNN

CPU Power Consumption Monitor

MinAvgMaxWithout AVX-51223.9140.4221.2Default, AVX-512 Enabled20.1124.9214.3OpenBenchmarking.orgWatts, Fewer Is BetteroneDNN 2.6CPU Power Consumption Monitor60120180240300

oneDNN

CPU Power Consumption Monitor

MinAvgMaxWithout AVX-51223.593.1166.1Default, AVX-512 Enabled11.5107.7218.9OpenBenchmarking.orgWatts, Fewer Is BetteroneDNN 2.6CPU Power Consumption Monitor60120180240300

oneDNN

CPU Power Consumption Monitor

MinAvgMaxWithout AVX-51217.5152.3233.2Default, AVX-512 Enabled23.0149.1219.8OpenBenchmarking.orgWatts, Fewer Is BetteroneDNN 2.6CPU Power Consumption Monitor60120180240300

oneDNN

CPU Power Consumption Monitor

MinAvgMaxWithout AVX-51222.8108.1230.7Default, AVX-512 Enabled23.1102.3213.6OpenBenchmarking.orgWatts, Fewer Is BetteroneDNN 2.6CPU Power Consumption Monitor60120180240300

oneDNN

CPU Power Consumption Monitor

MinAvgMaxWithout AVX-51223.2187.5219.5Default, AVX-512 Enabled22.8200.9226.3OpenBenchmarking.orgWatts, Fewer Is BetteroneDNN 2.6CPU Power Consumption Monitor60120180240300

oneDNN

CPU Power Consumption Monitor

MinAvgMaxWithout AVX-51223.3181.1224.4Default, AVX-512 Enabled23.8200.3227.2OpenBenchmarking.orgWatts, Fewer Is BetteroneDNN 2.6CPU Power Consumption Monitor60120180240300

oneDNN

CPU Power Consumption Monitor

MinAvgMaxWithout AVX-51223.4189.5220.2Default, AVX-512 Enabled20.3200.1223.4OpenBenchmarking.orgWatts, Fewer Is BetteroneDNN 2.6CPU Power Consumption Monitor60120180240300

oneDNN

CPU Power Consumption Monitor

MinAvgMaxWithout AVX-51223.1180.3220.1Default, AVX-512 Enabled22.4200.3226.4OpenBenchmarking.orgWatts, Fewer Is BetteroneDNN 2.6CPU Power Consumption Monitor60120180240300

OSPRay Studio

CPU Power Consumption Monitor

MinAvgMaxWithout AVX-51217.7198.8223.6Default, AVX-512 Enabled17.2198.2221.8OpenBenchmarking.orgWatts, Fewer Is BetterOSPRay Studio 0.11CPU Power Consumption Monitor60120180240300

OSPRay Studio

CPU Power Consumption Monitor

MinAvgMaxWithout AVX-51222.8197.3224.0Default, AVX-512 Enabled22.9198.4217.9OpenBenchmarking.orgWatts, Fewer Is BetterOSPRay Studio 0.11CPU Power Consumption Monitor60120180240300

OSPRay Studio

CPU Power Consumption Monitor

MinAvgMaxWithout AVX-51212.7189.2223.7Default, AVX-512 Enabled19.2185.5223.2OpenBenchmarking.orgWatts, Fewer Is BetterOSPRay Studio 0.11CPU Power Consumption Monitor60120180240300

OSPRay Studio

CPU Power Consumption Monitor

MinAvgMaxWithout AVX-51216.1199.9221.5Default, AVX-512 Enabled14.7198.1226.1OpenBenchmarking.orgWatts, Fewer Is BetterOSPRay Studio 0.11CPU Power Consumption Monitor60120180240300

OSPRay Studio

CPU Power Consumption Monitor

MinAvgMaxWithout AVX-51223.0192.2220.6Default, AVX-512 Enabled22.9188.7219.2OpenBenchmarking.orgWatts, Fewer Is BetterOSPRay Studio 0.11CPU Power Consumption Monitor60120180240300

OSPRay Studio

CPU Power Consumption Monitor

MinAvgMaxWithout AVX-51223.1201.2218.3Default, AVX-512 Enabled22.9199.7222.9OpenBenchmarking.orgWatts, Fewer Is BetterOSPRay Studio 0.11CPU Power Consumption Monitor60120180240300

Cpuminer-Opt

CPU Power Consumption Monitor

MinAvgMaxWithout AVX-51221.0105.5175.6Default, AVX-512 Enabled19.2107.8200.8OpenBenchmarking.orgWatts, Fewer Is BetterCpuminer-Opt 3.18CPU Power Consumption Monitor50100150200250

Cpuminer-Opt

CPU Power Consumption Monitor

MinAvgMaxWithout AVX-51223.1168.2190.7Default, AVX-512 Enabled22.9161.5185.7OpenBenchmarking.orgWatts, Fewer Is BetterCpuminer-Opt 3.18CPU Power Consumption Monitor50100150200250

Cpuminer-Opt

CPU Power Consumption Monitor

MinAvgMaxWithout AVX-51222.9106.0219.4Default, AVX-512 Enabled22.7105.6218.2OpenBenchmarking.orgWatts, Fewer Is BetterCpuminer-Opt 3.18CPU Power Consumption Monitor60120180240300

Cpuminer-Opt

CPU Power Consumption Monitor

MinAvgMaxWithout AVX-51223.6127.3150.7Default, AVX-512 Enabled21.7120.7179.8OpenBenchmarking.orgWatts, Fewer Is BetterCpuminer-Opt 3.18CPU Power Consumption Monitor50100150200250

Cpuminer-Opt

CPU Power Consumption Monitor

MinAvgMaxWithout AVX-51223.5132.8181.2Default, AVX-512 Enabled23.3110.7206.7OpenBenchmarking.orgWatts, Fewer Is BetterCpuminer-Opt 3.18CPU Power Consumption Monitor60120180240300

Cpuminer-Opt

CPU Power Consumption Monitor

MinAvgMaxWithout AVX-51223.2107.7185.5Default, AVX-512 Enabled23.3106.3178.0OpenBenchmarking.orgWatts, Fewer Is BetterCpuminer-Opt 3.18CPU Power Consumption Monitor50100150200250

OpenVINO

CPU Power Consumption Monitor

MinAvgMaxWithout AVX-51220.6212.4235.9Default, AVX-512 Enabled23.3209.6235.1OpenBenchmarking.orgWatts, Fewer Is BetterOpenVINO 2022.2.devCPU Power Consumption Monitor60120180240300

OpenVINO

CPU Power Consumption Monitor

MinAvgMaxWithout AVX-51210.2206.7232.4Default, AVX-512 Enabled23.2199.4219.9OpenBenchmarking.orgWatts, Fewer Is BetterOpenVINO 2022.2.devCPU Power Consumption Monitor60120180240300

OpenVINO

CPU Power Consumption Monitor

MinAvgMaxWithout AVX-51223.4205.1233.4Default, AVX-512 Enabled23.0199.5219.7OpenBenchmarking.orgWatts, Fewer Is BetterOpenVINO 2022.2.devCPU Power Consumption Monitor60120180240300

OpenVINO

CPU Power Consumption Monitor

MinAvgMaxWithout AVX-51220.6207.2225.3Default, AVX-512 Enabled21.9188.8207.3OpenBenchmarking.orgWatts, Fewer Is BetterOpenVINO 2022.2.devCPU Power Consumption Monitor60120180240300

OpenVINO

CPU Power Consumption Monitor

MinAvgMaxWithout AVX-51222.9206.6233.0Default, AVX-512 Enabled22.2207.0227.9OpenBenchmarking.orgWatts, Fewer Is BetterOpenVINO 2022.2.devCPU Power Consumption Monitor60120180240300

OpenVINO

CPU Power Consumption Monitor

MinAvgMaxWithout AVX-51223.5209.4234.1Default, AVX-512 Enabled22.8212.9234.8OpenBenchmarking.orgWatts, Fewer Is BetterOpenVINO 2022.2.devCPU Power Consumption Monitor60120180240300

OpenVINO

CPU Power Consumption Monitor

MinAvgMaxWithout AVX-51223.1212.2232.9Default, AVX-512 Enabled22.8208.9234.0OpenBenchmarking.orgWatts, Fewer Is BetterOpenVINO 2022.2.devCPU Power Consumption Monitor60120180240300

OpenVINO

CPU Power Consumption Monitor

MinAvgMaxWithout AVX-51223.2205.1225.9Default, AVX-512 Enabled23.6191.8217.6OpenBenchmarking.orgWatts, Fewer Is BetterOpenVINO 2022.2.devCPU Power Consumption Monitor60120180240300

OpenVINO

CPU Power Consumption Monitor

MinAvgMaxWithout AVX-51223.1211.2232.0Default, AVX-512 Enabled23.3212.3236.0OpenBenchmarking.orgWatts, Fewer Is BetterOpenVINO 2022.2.devCPU Power Consumption Monitor60120180240300

OpenVINO

CPU Power Consumption Monitor

MinAvgMaxWithout AVX-51223.7209.7228.7Default, AVX-512 Enabled19.8209.2227.6OpenBenchmarking.orgWatts, Fewer Is BetterOpenVINO 2022.2.devCPU Power Consumption Monitor60120180240300

OpenVINO

CPU Power Consumption Monitor

MinAvgMaxWithout AVX-51223.3209.3228.7Default, AVX-512 Enabled23.2214.9234.4OpenBenchmarking.orgWatts, Fewer Is BetterOpenVINO 2022.2.devCPU Power Consumption Monitor60120180240300

OpenVINO

CPU Power Consumption Monitor

MinAvgMaxWithout AVX-51223.1208.4234.1Default, AVX-512 Enabled20.0217.4237.8OpenBenchmarking.orgWatts, Fewer Is BetterOpenVINO 2022.2.devCPU Power Consumption Monitor60120180240300


Phoronix Test Suite v10.8.5