AMD Ryzen 9 7950X AVX-512 AMD Ryzen 9 7950X AVX-512 benchmark comparison by Michael Larabel launch day embargo lift review. Stock/out-of-the-box build with AVX-512. For lack of any AVX-512 toggle from the ASUS BIOS, the AVX2 / non-AVX-512 run was carried out by booting kernel with "clearcpuid=304" to clear AVX-512 support from the kernel and for the binary programs that scan /proc/cpuinfo for avx512* extensions. Plus for the open-source benchmarks specifying CFLAGS/CXXFLAGS without AVX-512 extensions. See full launch day review @ https://www.phoronix.com/review/amd-zen4-avx512
HTML result view exported from: https://openbenchmarking.org/result/2209253-NE-RYZEN795065&grt&sro .
AMD Ryzen 9 7950X AVX-512 Processor Motherboard Chipset Memory Disk Graphics Audio Monitor Network OS Kernel Desktop Display Server OpenGL Vulkan Compiler File-System Screen Resolution Default, AVX-512 Enabled Without AVX-512 AMD Ryzen 9 7950X 16-Core @ 5.88GHz (16 Cores / 32 Threads) ASUS ROG CROSSHAIR X670E HERO (0604 BIOS) AMD Device 14d8 32GB 2000GB Samsung SSD 980 PRO 2TB + 2000GB AMD Radeon RX 6800 XT 16GB (2575/1000MHz) AMD Navi 21 HDMI Audio ASUS VP28U Intel I225-V + Intel Wi-Fi 6 AX210/AX211/AX411 Ubuntu 22.04 6.0.0-060000rc1daily20220820-generic (x86_64) GNOME Shell 42.2 X Server + Wayland 4.6 Mesa 22.3.0-devel (git-4685385 2022-08-23 jammy-oibaf-ppa) (LLVM 14.0.6 DRM 3.48) 1.3.224 GCC 12.0.1 20220319 ext4 3840x2160 OpenBenchmarking.org Kernel Details - Transparent Huge Pages: madvise Environment Details - Default, AVX-512 Enabled: CXXFLAGS="-O3 -march=native -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi -mprefer-vector-width=512" CFLAGS="-O3 -march=native -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi -mprefer-vector-width=512" - Without AVX-512: CXXFLAGS="-O3 -march=native -mno-avx512f" CFLAGS="-O3 -march=native -mno-avx512f" Compiler Details - --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-defaulted --enable-offload-targets=nvptx-none=/build/gcc-12-OcsLtf/gcc-12-12-20220319/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-12-OcsLtf/gcc-12-12-20220319/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v Processor Details - Scaling Governor: amd-pstate performance (Boost: Enabled) - CPU Microcode: 0xa601203 Python Details - Python 3.10.4 Security Details - itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional IBRS_FW STIBP: always-on RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected
AMD Ryzen 9 7950X AVX-512 cpuminer-opt: Blake-2 S cpuminer-opt: Garlicoin cpuminer-opt: Skeincoin cpuminer-opt: Myriad-Groestl cpuminer-opt: LBC, LBRY Credits cpuminer-opt: Quad SHA-256, Pyrite dav1d: Summer Nature 4K dav1d: Summer Nature 1080p embree: Pathtracer ISPC - Crown embree: Pathtracer ISPC - Asian Dragon lczero: Eigen mnn: SqueezeNetV1.0 ncnn: CPU - vision_transformer onednn: IP Shapes 1D - u8s8f32 - CPU onednn: Convolution Batch Shapes Auto - u8s8f32 - CPU onednn: Deconvolution Batch shapes_1d - u8s8f32 - CPU onednn: Deconvolution Batch shapes_3d - u8s8f32 - CPU onednn: Recurrent Neural Network Training - u8s8f32 - CPU onednn: Recurrent Neural Network Inference - u8s8f32 - CPU onednn: Recurrent Neural Network Training - bf16bf16bf16 - CPU onednn: Recurrent Neural Network Inference - bf16bf16bf16 - CPU openvino: Face Detection FP16 - CPU openvino: Face Detection FP16 - CPU openvino: Person Detection FP16 - CPU openvino: Person Detection FP16 - CPU openvino: Person Detection FP32 - CPU openvino: Person Detection FP32 - CPU openvino: Vehicle Detection FP16 - CPU openvino: Vehicle Detection FP16 - CPU openvino: Face Detection FP16-INT8 - CPU openvino: Face Detection FP16-INT8 - CPU openvino: Vehicle Detection FP16-INT8 - CPU openvino: Vehicle Detection FP16-INT8 - CPU openvino: Weld Porosity Detection FP16 - CPU openvino: Weld Porosity Detection FP16 - CPU openvino: Machine Translation EN To DE FP16 - CPU openvino: Machine Translation EN To DE FP16 - CPU openvino: Weld Porosity Detection FP16-INT8 - CPU openvino: Weld Porosity Detection FP16-INT8 - CPU openvino: Person Vehicle Bike Detection FP16 - CPU openvino: Person Vehicle Bike Detection FP16 - CPU openvino: Age Gender Recognition Retail 0013 FP16 - CPU openvino: Age Gender Recognition Retail 0013 FP16 - CPU openvino: Age Gender Recognition Retail 0013 FP16-INT8 - CPU openvino: Age Gender Recognition Retail 0013 FP16-INT8 - CPU openvkl: vklBenchmark ISPC ospray: particle_volume/pathtracer/real_time ospray: gravity_spheres_volume/dim_512/ao/real_time ospray: gravity_spheres_volume/dim_512/scivis/real_time ospray: gravity_spheres_volume/dim_512/pathtracer/real_time ospray-studio: 1 - 4K - 1 - Path Tracer ospray-studio: 3 - 4K - 1 - Path Tracer ospray-studio: 1 - 4K - 16 - Path Tracer ospray-studio: 1 - 4K - 32 - Path Tracer ospray-studio: 3 - 4K - 16 - Path Tracer ospray-studio: 3 - 4K - 32 - Path Tracer simdjson: Kostya simdjson: TopTweet simdjson: LargeRand simdjson: PartialTweets simdjson: DistinctUserID Default, AVX-512 Enabled Without AVX-512 2113434 3977.80 284667 59957 151720 321503 393.40 1451.94 35.2293 35.1217 1735 3.543 39.57 0.417196 5.32127 0.415940 0.576432 1137.29 583.316 1137.96 582.901 14.50 549.94 7.57 1050.37 7.55 1054.92 742.90 10.76 28.44 280.86 1890.25 4.23 1455.45 5.49 134.59 59.39 2938.13 5.44 1696.82 4.71 45555.67 0.35 64463.94 0.24 199 250.655 8.05397 7.93432 9.50906 3659 4368 62029 120727 73617 143981 6.01 9.96 1.79 9.64 10.26 1033700 2597.65 204320 16393 76960 192667 380.32 1412.27 29.1170 30.3870 1578 3.997 62.74 0.625942 7.44936 0.800116 1.08396 1566.09 910.460 1544.39 902.102 6.74 1178.81 4.20 1889.40 4.20 1887.13 502.28 15.92 13.60 585.81 953.79 8.38 681.37 11.73 66.03 121.06 1353.84 11.81 907.36 8.80 22781.70 0.7 38316.87 0.41 153 231.378 4.53529 4.33398 6.92227 4502 5348 74844 146156 88344 172872 4.95 7.90 1.57 7.69 7.74 OpenBenchmarking.org
CPU Peak Freq (Highest CPU Core Frequency) Monitor Phoronix Test Suite System Monitoring OpenBenchmarking.org Megahertz CPU Peak Freq (Highest CPU Core Frequency) Monitor Phoronix Test Suite System Monitoring Default, AVX-512 Enabled Without AVX-512 1000 2000 3000 4000 5000 Min: 4421 / Avg: 5372.19 / Max: 5881 Min: 4495 / Avg: 5334.93 / Max: 5881
CPU Power Consumption Monitor Phoronix Test Suite System Monitoring OpenBenchmarking.org Watts CPU Power Consumption Monitor Phoronix Test Suite System Monitoring Default, AVX-512 Enabled Without AVX-512 40 80 120 160 200 Min: 11.53 / Avg: 158.06 / Max: 237.76 Min: 10.2 / Avg: 161.11 / Max: 235.88
CPU Temperature Monitor Phoronix Test Suite System Monitoring OpenBenchmarking.org Celsius CPU Temperature Monitor Phoronix Test Suite System Monitoring Default, AVX-512 Enabled Without AVX-512 20 40 60 80 100 Min: 33.63 / Avg: 81.24 / Max: 96.25 Min: 36.13 / Avg: 84.12 / Max: 96.75
Cpuminer-Opt Algorithm: Blake-2 S OpenBenchmarking.org kH/s, More Is Better Cpuminer-Opt 3.18 Algorithm: Blake-2 S Default, AVX-512 Enabled Without AVX-512 500K 1000K 1500K 2000K 2500K SE +/- 38034.65, N = 12 SE +/- 4192.40, N = 3 2113434 1033700 -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi -mno-avx512f 1. (CXX) g++ options: -O3 -march=native -lcurl -lz -lpthread -lssl -lcrypto -lgmp
Cpuminer-Opt Algorithm: Blake-2 S OpenBenchmarking.org kH/s Per Watt, More Is Better Cpuminer-Opt 3.18 Algorithm: Blake-2 S Default, AVX-512 Enabled Without AVX-512 4K 8K 12K 16K 20K 19614.14 9800.37
Cpuminer-Opt CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max Default, AVX-512 Enabled 5260 5542 5881 Without AVX-512 5204 5521 5881 OpenBenchmarking.org Megahertz, More Is Better Cpuminer-Opt 3.18 CPU Peak Freq (Highest CPU Core Frequency) Monitor 1600 3200 4800 6400 8000
Cpuminer-Opt CPU Power Consumption Monitor Min Avg Max Default, AVX-512 Enabled 19.2 107.8 200.8 Without AVX-512 21.0 105.5 175.6 OpenBenchmarking.org Watts, Fewer Is Better Cpuminer-Opt 3.18 CPU Power Consumption Monitor 50 100 150 200 250
Cpuminer-Opt CPU Temperature Monitor Min Avg Max Default, AVX-512 Enabled 47.1 66.4 79.6 Without AVX-512 48.6 69.2 85.9 OpenBenchmarking.org Celsius, Fewer Is Better Cpuminer-Opt 3.18 CPU Temperature Monitor 20 40 60 80 100
Cpuminer-Opt Algorithm: Garlicoin OpenBenchmarking.org kH/s, More Is Better Cpuminer-Opt 3.18 Algorithm: Garlicoin Default, AVX-512 Enabled Without AVX-512 900 1800 2700 3600 4500 SE +/- 75.31, N = 12 SE +/- 25.96, N = 3 3977.80 2597.65 -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi -mno-avx512f 1. (CXX) g++ options: -O3 -march=native -lcurl -lz -lpthread -lssl -lcrypto -lgmp
Cpuminer-Opt Algorithm: Garlicoin OpenBenchmarking.org kH/s Per Watt, More Is Better Cpuminer-Opt 3.18 Algorithm: Garlicoin Default, AVX-512 Enabled Without AVX-512 6 12 18 24 30 24.63 15.45
Cpuminer-Opt CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max Default, AVX-512 Enabled 5283 5374 5881 Without AVX-512 5244 5339 5881 OpenBenchmarking.org Megahertz, More Is Better Cpuminer-Opt 3.18 CPU Peak Freq (Highest CPU Core Frequency) Monitor 1600 3200 4800 6400 8000
Cpuminer-Opt CPU Power Consumption Monitor Min Avg Max Default, AVX-512 Enabled 22.9 161.5 185.7 Without AVX-512 23.1 168.2 190.7 OpenBenchmarking.org Watts, Fewer Is Better Cpuminer-Opt 3.18 CPU Power Consumption Monitor 50 100 150 200 250
Cpuminer-Opt CPU Temperature Monitor Min Avg Max Default, AVX-512 Enabled 40.8 72.9 76.3 Without AVX-512 44.3 75.9 79.9 OpenBenchmarking.org Celsius, Fewer Is Better Cpuminer-Opt 3.18 CPU Temperature Monitor 20 40 60 80 100
Cpuminer-Opt Algorithm: Skeincoin OpenBenchmarking.org kH/s, More Is Better Cpuminer-Opt 3.18 Algorithm: Skeincoin Default, AVX-512 Enabled Without AVX-512 60K 120K 180K 240K 300K SE +/- 424.91, N = 3 SE +/- 1803.62, N = 3 284667 204320 -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi -mno-avx512f 1. (CXX) g++ options: -O3 -march=native -lcurl -lz -lpthread -lssl -lcrypto -lgmp
Cpuminer-Opt Algorithm: Skeincoin OpenBenchmarking.org kH/s Per Watt, More Is Better Cpuminer-Opt 3.18 Algorithm: Skeincoin Default, AVX-512 Enabled Without AVX-512 600 1200 1800 2400 3000 2696.44 1926.96
Cpuminer-Opt CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max Default, AVX-512 Enabled 5157 5535 5881 Without AVX-512 5189 5517 5881 OpenBenchmarking.org Megahertz, More Is Better Cpuminer-Opt 3.18 CPU Peak Freq (Highest CPU Core Frequency) Monitor 1600 3200 4800 6400 8000
Cpuminer-Opt CPU Power Consumption Monitor Min Avg Max Default, AVX-512 Enabled 22.7 105.6 218.2 Without AVX-512 22.9 106.0 219.4 OpenBenchmarking.org Watts, Fewer Is Better Cpuminer-Opt 3.18 CPU Power Consumption Monitor 60 120 180 240 300
Cpuminer-Opt CPU Temperature Monitor Min Avg Max Default, AVX-512 Enabled 43.3 66.6 85.6 Without AVX-512 44.8 68.5 84.1 OpenBenchmarking.org Celsius, Fewer Is Better Cpuminer-Opt 3.18 CPU Temperature Monitor 20 40 60 80 100
Cpuminer-Opt Algorithm: Myriad-Groestl OpenBenchmarking.org kH/s, More Is Better Cpuminer-Opt 3.18 Algorithm: Myriad-Groestl Default, AVX-512 Enabled Without AVX-512 13K 26K 39K 52K 65K SE +/- 669.95, N = 15 SE +/- 105.88, N = 3 59957 16393 -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi -mno-avx512f 1. (CXX) g++ options: -O3 -march=native -lcurl -lz -lpthread -lssl -lcrypto -lgmp
Cpuminer-Opt Algorithm: Myriad-Groestl OpenBenchmarking.org kH/s Per Watt, More Is Better Cpuminer-Opt 3.18 Algorithm: Myriad-Groestl Default, AVX-512 Enabled Without AVX-512 110 220 330 440 550 496.89 128.78
Cpuminer-Opt CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max Default, AVX-512 Enabled 5298 5503 5881 Without AVX-512 5344 5449 5881 OpenBenchmarking.org Megahertz, More Is Better Cpuminer-Opt 3.18 CPU Peak Freq (Highest CPU Core Frequency) Monitor 1600 3200 4800 6400 8000
Cpuminer-Opt CPU Power Consumption Monitor Min Avg Max Default, AVX-512 Enabled 21.7 120.7 179.8 Without AVX-512 23.6 127.3 150.7 OpenBenchmarking.org Watts, Fewer Is Better Cpuminer-Opt 3.18 CPU Power Consumption Monitor 50 100 150 200 250
Cpuminer-Opt CPU Temperature Monitor Min Avg Max Default, AVX-512 Enabled 42.1 67.6 71.3 Without AVX-512 43.3 67.7 73.0 OpenBenchmarking.org Celsius, Fewer Is Better Cpuminer-Opt 3.18 CPU Temperature Monitor 20 40 60 80 100
Cpuminer-Opt Algorithm: LBC, LBRY Credits OpenBenchmarking.org kH/s, More Is Better Cpuminer-Opt 3.18 Algorithm: LBC, LBRY Credits Default, AVX-512 Enabled Without AVX-512 30K 60K 90K 120K 150K SE +/- 177.76, N = 3 SE +/- 40.41, N = 3 151720 76960 -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi -mno-avx512f 1. (CXX) g++ options: -O3 -march=native -lcurl -lz -lpthread -lssl -lcrypto -lgmp
Cpuminer-Opt Algorithm: LBC, LBRY Credits OpenBenchmarking.org kH/s Per Watt, More Is Better Cpuminer-Opt 3.18 Algorithm: LBC, LBRY Credits Default, AVX-512 Enabled Without AVX-512 300 600 900 1200 1500 1370.92 579.30
Cpuminer-Opt CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max Default, AVX-512 Enabled 5208 5520 5881 Without AVX-512 5164 5459 5881 OpenBenchmarking.org Megahertz, More Is Better Cpuminer-Opt 3.18 CPU Peak Freq (Highest CPU Core Frequency) Monitor 1600 3200 4800 6400 8000
Cpuminer-Opt CPU Power Consumption Monitor Min Avg Max Default, AVX-512 Enabled 23.3 110.7 206.7 Without AVX-512 23.5 132.8 181.2 OpenBenchmarking.org Watts, Fewer Is Better Cpuminer-Opt 3.18 CPU Power Consumption Monitor 60 120 180 240 300
Cpuminer-Opt CPU Temperature Monitor Min Avg Max Default, AVX-512 Enabled 40.5 66.6 83.9 Without AVX-512 41.9 73.0 86.5 OpenBenchmarking.org Celsius, Fewer Is Better Cpuminer-Opt 3.18 CPU Temperature Monitor 20 40 60 80 100
Cpuminer-Opt Algorithm: Quad SHA-256, Pyrite OpenBenchmarking.org kH/s, More Is Better Cpuminer-Opt 3.18 Algorithm: Quad SHA-256, Pyrite Default, AVX-512 Enabled Without AVX-512 70K 140K 210K 280K 350K SE +/- 1040.42, N = 3 SE +/- 177.04, N = 3 321503 192667 -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi -mno-avx512f 1. (CXX) g++ options: -O3 -march=native -lcurl -lz -lpthread -lssl -lcrypto -lgmp
Cpuminer-Opt Algorithm: Quad SHA-256, Pyrite OpenBenchmarking.org kH/s Per Watt, More Is Better Cpuminer-Opt 3.18 Algorithm: Quad SHA-256, Pyrite Default, AVX-512 Enabled Without AVX-512 600 1200 1800 2400 3000 3025.64 1788.77
Cpuminer-Opt CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max Default, AVX-512 Enabled 5224 5540 5881 Without AVX-512 5207 5522 5881 OpenBenchmarking.org Megahertz, More Is Better Cpuminer-Opt 3.18 CPU Peak Freq (Highest CPU Core Frequency) Monitor 1600 3200 4800 6400 8000
Cpuminer-Opt CPU Power Consumption Monitor Min Avg Max Default, AVX-512 Enabled 23.3 106.3 178.0 Without AVX-512 23.2 107.7 185.5 OpenBenchmarking.org Watts, Fewer Is Better Cpuminer-Opt 3.18 CPU Power Consumption Monitor 50 100 150 200 250
Cpuminer-Opt CPU Temperature Monitor Min Avg Max Default, AVX-512 Enabled 41.4 64.7 81.5 Without AVX-512 44.0 67.7 80.0 OpenBenchmarking.org Celsius, Fewer Is Better Cpuminer-Opt 3.18 CPU Temperature Monitor 20 40 60 80 100
dav1d Video Input: Summer Nature 4K OpenBenchmarking.org FPS, More Is Better dav1d 1.0 Video Input: Summer Nature 4K Default, AVX-512 Enabled Without AVX-512 90 180 270 360 450 SE +/- 1.37, N = 5 SE +/- 3.22, N = 5 393.40 380.32 -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi -lm -mno-avx512f 1. (CC) gcc options: -O3 -march=native -pthread
dav1d Video Input: Summer Nature 4K OpenBenchmarking.org FPS Per Watt, More Is Better dav1d 1.0 Video Input: Summer Nature 4K Default, AVX-512 Enabled Without AVX-512 0.7018 1.4036 2.1054 2.8072 3.509 3.119 2.937
dav1d CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max Default, AVX-512 Enabled 5239 5493 5881 Without AVX-512 5258 5492 5881 OpenBenchmarking.org Megahertz, More Is Better dav1d 1.0 CPU Peak Freq (Highest CPU Core Frequency) Monitor 1600 3200 4800 6400 8000
dav1d CPU Power Consumption Monitor Min Avg Max Default, AVX-512 Enabled 23.2 126.1 185.4 Without AVX-512 23.9 129.5 187.9 OpenBenchmarking.org Watts, Fewer Is Better dav1d 1.0 CPU Power Consumption Monitor 50 100 150 200 250
dav1d CPU Temperature Monitor Min Avg Max Default, AVX-512 Enabled 38.6 70.0 79.0 Without AVX-512 38.8 70.9 80.3 OpenBenchmarking.org Celsius, Fewer Is Better dav1d 1.0 CPU Temperature Monitor 20 40 60 80 100
dav1d Video Input: Summer Nature 1080p OpenBenchmarking.org FPS, More Is Better dav1d 1.0 Video Input: Summer Nature 1080p Default, AVX-512 Enabled Without AVX-512 300 600 900 1200 1500 SE +/- 1.72, N = 10 SE +/- 2.53, N = 10 1451.94 1412.27 -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi -lm -mno-avx512f 1. (CC) gcc options: -O3 -march=native -pthread
dav1d Video Input: Summer Nature 1080p OpenBenchmarking.org FPS Per Watt, More Is Better dav1d 1.0 Video Input: Summer Nature 1080p Default, AVX-512 Enabled Without AVX-512 4 8 12 16 20 18.11 17.21
dav1d CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max Default, AVX-512 Enabled 5282 5674 5881 Without AVX-512 5263 5686 5881 OpenBenchmarking.org Megahertz, More Is Better dav1d 1.0 CPU Peak Freq (Highest CPU Core Frequency) Monitor 1600 3200 4800 6400 8000
dav1d CPU Power Consumption Monitor Min Avg Max Default, AVX-512 Enabled 23.2 80.2 178.7 Without AVX-512 23.6 82.1 180.6 OpenBenchmarking.org Watts, Fewer Is Better dav1d 1.0 CPU Power Consumption Monitor 50 100 150 200 250
dav1d CPU Temperature Monitor Min Avg Max Default, AVX-512 Enabled 41.3 64.5 73.3 Without AVX-512 41.3 65.1 74.4 OpenBenchmarking.org Celsius, Fewer Is Better dav1d 1.0 CPU Temperature Monitor 20 40 60 80 100
Embree Binary: Pathtracer ISPC - Model: Crown OpenBenchmarking.org Frames Per Second, More Is Better Embree 3.13 Binary: Pathtracer ISPC - Model: Crown Default, AVX-512 Enabled Without AVX-512 8 16 24 32 40 SE +/- 0.08, N = 3 SE +/- 0.11, N = 3 35.23 29.12 MIN: 34.75 / MAX: 36.08 MIN: 28.7 / MAX: 29.86
Embree Binary: Pathtracer ISPC - Model: Crown OpenBenchmarking.org Frames Per Second Per Watt, More Is Better Embree 3.13 Binary: Pathtracer ISPC - Model: Crown Default, AVX-512 Enabled Without AVX-512 0.0423 0.0846 0.1269 0.1692 0.2115 0.188 0.153
Embree CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max Default, AVX-512 Enabled 5146 5324 5881 Without AVX-512 5152 5300 5881 OpenBenchmarking.org Megahertz, More Is Better Embree 3.13 CPU Peak Freq (Highest CPU Core Frequency) Monitor 1600 3200 4800 6400 8000
Embree CPU Power Consumption Monitor Min Avg Max Default, AVX-512 Enabled 22.6 187.3 235.9 Without AVX-512 23.3 190.5 227.8 OpenBenchmarking.org Watts, Fewer Is Better Embree 3.13 CPU Power Consumption Monitor 60 120 180 240 300
Embree CPU Temperature Monitor Min Avg Max Default, AVX-512 Enabled 40.3 83.2 90.9 Without AVX-512 40.0 84.9 91.0 OpenBenchmarking.org Celsius, Fewer Is Better Embree 3.13 CPU Temperature Monitor 20 40 60 80 100
Embree Binary: Pathtracer ISPC - Model: Asian Dragon OpenBenchmarking.org Frames Per Second, More Is Better Embree 3.13 Binary: Pathtracer ISPC - Model: Asian Dragon Default, AVX-512 Enabled Without AVX-512 8 16 24 32 40 SE +/- 0.08, N = 3 SE +/- 0.16, N = 3 35.12 30.39 MIN: 34.64 / MAX: 36.13 MIN: 29.85 / MAX: 30.94
Embree Binary: Pathtracer ISPC - Model: Asian Dragon OpenBenchmarking.org Frames Per Second Per Watt, More Is Better Embree 3.13 Binary: Pathtracer ISPC - Model: Asian Dragon Default, AVX-512 Enabled Without AVX-512 0.0477 0.0954 0.1431 0.1908 0.2385 0.212 0.171
Embree CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max Default, AVX-512 Enabled 5222 5375 5881 Without AVX-512 5197 5354 5881 OpenBenchmarking.org Megahertz, More Is Better Embree 3.13 CPU Peak Freq (Highest CPU Core Frequency) Monitor 1600 3200 4800 6400 8000
Embree CPU Power Consumption Monitor Min Avg Max Default, AVX-512 Enabled 22.6 166.0 203.7 Without AVX-512 24.3 177.3 210.0 OpenBenchmarking.org Watts, Fewer Is Better Embree 3.13 CPU Power Consumption Monitor 60 120 180 240 300
Embree CPU Temperature Monitor Min Avg Max Default, AVX-512 Enabled 44.1 75.1 80.8 Without AVX-512 44.6 81.0 85.9 OpenBenchmarking.org Celsius, Fewer Is Better Embree 3.13 CPU Temperature Monitor 20 40 60 80 100
LeelaChessZero Backend: Eigen OpenBenchmarking.org Nodes Per Second, More Is Better LeelaChessZero 0.28 Backend: Eigen Default, AVX-512 Enabled Without AVX-512 400 800 1200 1600 2000 SE +/- 7.31, N = 3 SE +/- 16.33, N = 3 1735 1578 -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi -mno-avx512f 1. (CXX) g++ options: -flto -O3 -march=native -pthread
LeelaChessZero Backend: Eigen OpenBenchmarking.org Nodes Per Second Per Watt, More Is Better LeelaChessZero 0.28 Backend: Eigen Default, AVX-512 Enabled Without AVX-512 3 6 9 12 15 10.156 9.107
LeelaChessZero CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max Default, AVX-512 Enabled 5191 5321 5881 Without AVX-512 5152 5307 5881 OpenBenchmarking.org Megahertz, More Is Better LeelaChessZero 0.28 CPU Peak Freq (Highest CPU Core Frequency) Monitor 1600 3200 4800 6400 8000
LeelaChessZero CPU Power Consumption Monitor Min Avg Max Default, AVX-512 Enabled 22.5 170.8 192.1 Without AVX-512 23.3 173.3 195.1 OpenBenchmarking.org Watts, Fewer Is Better LeelaChessZero 0.28 CPU Power Consumption Monitor 50 100 150 200 250
LeelaChessZero CPU Temperature Monitor Min Avg Max Default, AVX-512 Enabled 33.6 84.4 87.4 Without AVX-512 36.1 88.3 91.0 OpenBenchmarking.org Celsius, Fewer Is Better LeelaChessZero 0.28 CPU Temperature Monitor 20 40 60 80 100
Mobile Neural Network Model: SqueezeNetV1.0 OpenBenchmarking.org ms, Fewer Is Better Mobile Neural Network 2.1 Model: SqueezeNetV1.0 Default, AVX-512 Enabled Without AVX-512 0.8993 1.7986 2.6979 3.5972 4.4965 SE +/- 0.015, N = 6 SE +/- 0.121, N = 3 3.543 3.997 -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi - MIN: 3.43 / MAX: 10.23 -mno-avx512f - MIN: 3.72 / MAX: 5.69 1. (CXX) g++ options: -O3 -march=native -std=c++11 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl
NCNN Target: CPU - Model: vision_transformer OpenBenchmarking.org ms, Fewer Is Better NCNN 20220729 Target: CPU - Model: vision_transformer Default, AVX-512 Enabled Without AVX-512 14 28 42 56 70 SE +/- 0.03, N = 3 SE +/- 0.91, N = 3 39.57 62.74 -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi - MIN: 39.32 / MAX: 41.99 -mno-avx512f - MIN: 61.57 / MAX: 65.21 1. (CXX) g++ options: -O3 -march=native -rdynamic -lgomp -lpthread
oneDNN Harness: IP Shapes 1D - Data Type: u8s8f32 - Engine: CPU OpenBenchmarking.org ms, Fewer Is Better oneDNN 2.6 Harness: IP Shapes 1D - Data Type: u8s8f32 - Engine: CPU Default, AVX-512 Enabled Without AVX-512 0.1408 0.2816 0.4224 0.5632 0.704 SE +/- 0.007969, N = 15 SE +/- 0.006181, N = 5 0.417196 0.625942 -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi - MIN: 0.34 -mno-avx512f - MIN: 0.58 1. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -std=c++11 -pie -ldl -lpthread
oneDNN CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max Default, AVX-512 Enabled 5127 5419 5881 Without AVX-512 5125 5367 5881 OpenBenchmarking.org Megahertz, More Is Better oneDNN 2.6 CPU Peak Freq (Highest CPU Core Frequency) Monitor 1600 3200 4800 6400 8000
oneDNN CPU Power Consumption Monitor Min Avg Max Default, AVX-512 Enabled 20.1 124.9 214.3 Without AVX-512 23.9 140.4 221.2 OpenBenchmarking.org Watts, Fewer Is Better oneDNN 2.6 CPU Power Consumption Monitor 60 120 180 240 300
oneDNN CPU Temperature Monitor Min Avg Max Default, AVX-512 Enabled 48.4 70.8 87.5 Without AVX-512 48.1 80.2 93.6 OpenBenchmarking.org Celsius, Fewer Is Better oneDNN 2.6 CPU Temperature Monitor 20 40 60 80 100
oneDNN Harness: Convolution Batch Shapes Auto - Data Type: u8s8f32 - Engine: CPU OpenBenchmarking.org ms, Fewer Is Better oneDNN 2.6 Harness: Convolution Batch Shapes Auto - Data Type: u8s8f32 - Engine: CPU Default, AVX-512 Enabled Without AVX-512 2 4 6 8 10 SE +/- 0.00255, N = 7 SE +/- 0.00637, N = 7 5.32127 7.44936 -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi - MIN: 5.26 -mno-avx512f - MIN: 7.29 1. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -std=c++11 -pie -ldl -lpthread
oneDNN CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max Default, AVX-512 Enabled 4910 5475 5881 Without AVX-512 5318 5585 5881 OpenBenchmarking.org Megahertz, More Is Better oneDNN 2.6 CPU Peak Freq (Highest CPU Core Frequency) Monitor 1600 3200 4800 6400 8000
oneDNN CPU Power Consumption Monitor Min Avg Max Default, AVX-512 Enabled 11.5 107.7 218.9 Without AVX-512 23.5 93.1 166.1 OpenBenchmarking.org Watts, Fewer Is Better oneDNN 2.6 CPU Power Consumption Monitor 60 120 180 240 300
oneDNN CPU Temperature Monitor Min Avg Max Default, AVX-512 Enabled 42.0 69.7 82.9 Without AVX-512 45.1 58.8 65.6 OpenBenchmarking.org Celsius, Fewer Is Better oneDNN 2.6 CPU Temperature Monitor 20 40 60 80 100
oneDNN Harness: Deconvolution Batch shapes_1d - Data Type: u8s8f32 - Engine: CPU OpenBenchmarking.org ms, Fewer Is Better oneDNN 2.6 Harness: Deconvolution Batch shapes_1d - Data Type: u8s8f32 - Engine: CPU Default, AVX-512 Enabled Without AVX-512 0.18 0.36 0.54 0.72 0.9 SE +/- 0.000107, N = 3 SE +/- 0.010456, N = 3 0.415940 0.800116 -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi - MIN: 0.4 -mno-avx512f - MIN: 0.76 1. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -std=c++11 -pie -ldl -lpthread
oneDNN CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max Default, AVX-512 Enabled 5180 5381 5881 Without AVX-512 4992 5348 5881 OpenBenchmarking.org Megahertz, More Is Better oneDNN 2.6 CPU Peak Freq (Highest CPU Core Frequency) Monitor 1600 3200 4800 6400 8000
oneDNN CPU Power Consumption Monitor Min Avg Max Default, AVX-512 Enabled 23.0 149.1 219.8 Without AVX-512 17.5 152.3 233.2 OpenBenchmarking.org Watts, Fewer Is Better oneDNN 2.6 CPU Power Consumption Monitor 60 120 180 240 300
oneDNN CPU Temperature Monitor Min Avg Max Default, AVX-512 Enabled 41.3 75.8 86.6 Without AVX-512 40.9 81.9 94.9 OpenBenchmarking.org Celsius, Fewer Is Better oneDNN 2.6 CPU Temperature Monitor 20 40 60 80 100
oneDNN Harness: Deconvolution Batch shapes_3d - Data Type: u8s8f32 - Engine: CPU OpenBenchmarking.org ms, Fewer Is Better oneDNN 2.6 Harness: Deconvolution Batch shapes_3d - Data Type: u8s8f32 - Engine: CPU Default, AVX-512 Enabled Without AVX-512 0.2439 0.4878 0.7317 0.9756 1.2195 SE +/- 0.001581, N = 9 SE +/- 0.006665, N = 9 0.576432 1.083960 -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi - MIN: 0.56 -mno-avx512f - MIN: 1.03 1. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -std=c++11 -pie -ldl -lpthread
oneDNN CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max Default, AVX-512 Enabled 5208 5613 5881 Without AVX-512 5157 5585 5881 OpenBenchmarking.org Megahertz, More Is Better oneDNN 2.6 CPU Peak Freq (Highest CPU Core Frequency) Monitor 1600 3200 4800 6400 8000
oneDNN CPU Power Consumption Monitor Min Avg Max Default, AVX-512 Enabled 23.1 102.3 213.6 Without AVX-512 22.8 108.1 230.7 OpenBenchmarking.org Watts, Fewer Is Better oneDNN 2.6 CPU Power Consumption Monitor 60 120 180 240 300
oneDNN CPU Temperature Monitor Min Avg Max Default, AVX-512 Enabled 43.5 72.4 82.6 Without AVX-512 44.8 77.9 91.6 OpenBenchmarking.org Celsius, Fewer Is Better oneDNN 2.6 CPU Temperature Monitor 20 40 60 80 100
oneDNN Harness: Recurrent Neural Network Training - Data Type: u8s8f32 - Engine: CPU OpenBenchmarking.org ms, Fewer Is Better oneDNN 2.6 Harness: Recurrent Neural Network Training - Data Type: u8s8f32 - Engine: CPU Default, AVX-512 Enabled Without AVX-512 300 600 900 1200 1500 SE +/- 1.54, N = 3 SE +/- 8.37, N = 3 1137.29 1566.09 -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi - MIN: 1130.88 -mno-avx512f - MIN: 1541.57 1. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -std=c++11 -pie -ldl -lpthread
oneDNN CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max Default, AVX-512 Enabled 4822 5166 5881 Without AVX-512 4772 5007 5881 OpenBenchmarking.org Megahertz, More Is Better oneDNN 2.6 CPU Peak Freq (Highest CPU Core Frequency) Monitor 1600 3200 4800 6400 8000
oneDNN CPU Power Consumption Monitor Min Avg Max Default, AVX-512 Enabled 22.8 200.9 226.3 Without AVX-512 23.2 187.5 219.5 OpenBenchmarking.org Watts, Fewer Is Better oneDNN 2.6 CPU Power Consumption Monitor 60 120 180 240 300
oneDNN CPU Temperature Monitor Min Avg Max Default, AVX-512 Enabled 42.5 87.8 92.0 Without AVX-512 43.5 88.1 95.9 OpenBenchmarking.org Celsius, Fewer Is Better oneDNN 2.6 CPU Temperature Monitor 20 40 60 80 100
oneDNN Harness: Recurrent Neural Network Inference - Data Type: u8s8f32 - Engine: CPU OpenBenchmarking.org ms, Fewer Is Better oneDNN 2.6 Harness: Recurrent Neural Network Inference - Data Type: u8s8f32 - Engine: CPU Default, AVX-512 Enabled Without AVX-512 200 400 600 800 1000 SE +/- 0.21, N = 3 SE +/- 3.36, N = 3 583.32 910.46 -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi - MIN: 579.29 -mno-avx512f - MIN: 898.05 1. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -std=c++11 -pie -ldl -lpthread
oneDNN CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max Default, AVX-512 Enabled 4802 5091 5881 Without AVX-512 4804 5051 5881 OpenBenchmarking.org Megahertz, More Is Better oneDNN 2.6 CPU Peak Freq (Highest CPU Core Frequency) Monitor 1600 3200 4800 6400 8000
oneDNN CPU Power Consumption Monitor Min Avg Max Default, AVX-512 Enabled 23.8 200.3 227.2 Without AVX-512 23.3 181.1 224.4 OpenBenchmarking.org Watts, Fewer Is Better oneDNN 2.6 CPU Power Consumption Monitor 60 120 180 240 300
oneDNN CPU Temperature Monitor Min Avg Max Default, AVX-512 Enabled 47.0 89.2 92.6 Without AVX-512 47.5 86.4 95.8 OpenBenchmarking.org Celsius, Fewer Is Better oneDNN 2.6 CPU Temperature Monitor 20 40 60 80 100
oneDNN Harness: Recurrent Neural Network Training - Data Type: bf16bf16bf16 - Engine: CPU OpenBenchmarking.org ms, Fewer Is Better oneDNN 2.6 Harness: Recurrent Neural Network Training - Data Type: bf16bf16bf16 - Engine: CPU Default, AVX-512 Enabled Without AVX-512 300 600 900 1200 1500 SE +/- 1.66, N = 3 SE +/- 19.60, N = 3 1137.96 1544.39 -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi - MIN: 1131.23 -mno-avx512f - MIN: 1494.51 1. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -std=c++11 -pie -ldl -lpthread
oneDNN CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max Default, AVX-512 Enabled 4560 5163 5881 Without AVX-512 4745 4985 5881 OpenBenchmarking.org Megahertz, More Is Better oneDNN 2.6 CPU Peak Freq (Highest CPU Core Frequency) Monitor 1600 3200 4800 6400 8000
oneDNN CPU Power Consumption Monitor Min Avg Max Default, AVX-512 Enabled 20.3 200.1 223.4 Without AVX-512 23.4 189.5 220.2 OpenBenchmarking.org Watts, Fewer Is Better oneDNN 2.6 CPU Power Consumption Monitor 60 120 180 240 300
oneDNN CPU Temperature Monitor Min Avg Max Default, AVX-512 Enabled 47.5 88.8 92.0 Without AVX-512 47.3 89.8 96.1 OpenBenchmarking.org Celsius, Fewer Is Better oneDNN 2.6 CPU Temperature Monitor 20 40 60 80 100
oneDNN Harness: Recurrent Neural Network Inference - Data Type: bf16bf16bf16 - Engine: CPU OpenBenchmarking.org ms, Fewer Is Better oneDNN 2.6 Harness: Recurrent Neural Network Inference - Data Type: bf16bf16bf16 - Engine: CPU Default, AVX-512 Enabled Without AVX-512 200 400 600 800 1000 SE +/- 1.02, N = 3 SE +/- 5.88, N = 3 582.90 902.10 -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi - MIN: 578.18 -mno-avx512f - MIN: 885.67 1. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -std=c++11 -pie -ldl -lpthread
oneDNN CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max Default, AVX-512 Enabled 4421 5088 5881 Without AVX-512 4495 5058 5881 OpenBenchmarking.org Megahertz, More Is Better oneDNN 2.6 CPU Peak Freq (Highest CPU Core Frequency) Monitor 1600 3200 4800 6400 8000
oneDNN CPU Power Consumption Monitor Min Avg Max Default, AVX-512 Enabled 22.4 200.3 226.4 Without AVX-512 23.1 180.3 220.1 OpenBenchmarking.org Watts, Fewer Is Better oneDNN 2.6 CPU Power Consumption Monitor 60 120 180 240 300
oneDNN CPU Temperature Monitor Min Avg Max Default, AVX-512 Enabled 47.5 88.9 92.8 Without AVX-512 47.6 86.8 96.0 OpenBenchmarking.org Celsius, Fewer Is Better oneDNN 2.6 CPU Temperature Monitor 20 40 60 80 100
OpenVINO Model: Face Detection FP16 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2022.2.dev Model: Face Detection FP16 - Device: CPU Default, AVX-512 Enabled Without AVX-512 4 8 12 16 20 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 14.50 6.74 -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi -mno-avx512f 1. (CXX) g++ options: -fPIC -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -flto -shared
OpenVINO Model: Face Detection FP16 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2022.2.dev Model: Face Detection FP16 - Device: CPU Default, AVX-512 Enabled Without AVX-512 300 600 900 1200 1500 SE +/- 0.48, N = 3 SE +/- 0.92, N = 3 549.94 1178.81 -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi - MIN: 282.71 / MAX: 577.01 -mno-avx512f - MIN: 596.16 / MAX: 1250.72 1. (CXX) g++ options: -fPIC -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -flto -shared
OpenVINO CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max Default, AVX-512 Enabled 5038 5180 5881 Without AVX-512 4988 5151 5881 OpenBenchmarking.org Megahertz, More Is Better OpenVINO 2022.2.dev CPU Peak Freq (Highest CPU Core Frequency) Monitor 1600 3200 4800 6400 8000
OpenVINO CPU Power Consumption Monitor Min Avg Max Default, AVX-512 Enabled 23.3 209.6 235.1 Without AVX-512 20.6 212.4 235.9 OpenBenchmarking.org Watts, Fewer Is Better OpenVINO 2022.2.dev CPU Power Consumption Monitor 60 120 180 240 300
OpenVINO CPU Temperature Monitor Min Avg Max Default, AVX-512 Enabled 40.9 93.1 95.9 Without AVX-512 41.8 93.0 96.3 OpenBenchmarking.org Celsius, Fewer Is Better OpenVINO 2022.2.dev CPU Temperature Monitor 20 40 60 80 100
OpenVINO Model: Person Detection FP16 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2022.2.dev Model: Person Detection FP16 - Device: CPU Default, AVX-512 Enabled Without AVX-512 2 4 6 8 10 SE +/- 0.02, N = 3 SE +/- 0.00, N = 3 7.57 4.20 -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi -mno-avx512f 1. (CXX) g++ options: -fPIC -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -flto -shared
OpenVINO Model: Person Detection FP16 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2022.2.dev Model: Person Detection FP16 - Device: CPU Default, AVX-512 Enabled Without AVX-512 400 800 1200 1600 2000 SE +/- 2.40, N = 3 SE +/- 0.47, N = 3 1050.37 1889.40 -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi - MIN: 604.91 / MAX: 1254.32 -mno-avx512f - MIN: 1032.21 / MAX: 2215.28 1. (CXX) g++ options: -fPIC -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -flto -shared
OpenVINO CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max Default, AVX-512 Enabled 5035 5229 5881 Without AVX-512 4947 5189 5881 OpenBenchmarking.org Megahertz, More Is Better OpenVINO 2022.2.dev CPU Peak Freq (Highest CPU Core Frequency) Monitor 1600 3200 4800 6400 8000
OpenVINO CPU Power Consumption Monitor Min Avg Max Default, AVX-512 Enabled 23.2 199.4 219.9 Without AVX-512 10.2 206.7 232.4 OpenBenchmarking.org Watts, Fewer Is Better OpenVINO 2022.2.dev CPU Power Consumption Monitor 60 120 180 240 300
OpenVINO CPU Temperature Monitor Min Avg Max Default, AVX-512 Enabled 47.1 93.2 96.1 Without AVX-512 47.6 94.0 96.6 OpenBenchmarking.org Celsius, Fewer Is Better OpenVINO 2022.2.dev CPU Temperature Monitor 20 40 60 80 100
OpenVINO Model: Person Detection FP32 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2022.2.dev Model: Person Detection FP32 - Device: CPU Default, AVX-512 Enabled Without AVX-512 2 4 6 8 10 SE +/- 0.02, N = 3 SE +/- 0.02, N = 3 7.55 4.20 -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi -mno-avx512f 1. (CXX) g++ options: -fPIC -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -flto -shared
OpenVINO Model: Person Detection FP32 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2022.2.dev Model: Person Detection FP32 - Device: CPU Default, AVX-512 Enabled Without AVX-512 400 800 1200 1600 2000 SE +/- 3.05, N = 3 SE +/- 5.93, N = 3 1054.92 1887.13 -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi - MIN: 641.2 / MAX: 1276.51 -mno-avx512f - MIN: 1054.92 / MAX: 2161.5 1. (CXX) g++ options: -fPIC -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -flto -shared
OpenVINO CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max Default, AVX-512 Enabled 5059 5219 5881 Without AVX-512 4917 5157 5881 OpenBenchmarking.org Megahertz, More Is Better OpenVINO 2022.2.dev CPU Peak Freq (Highest CPU Core Frequency) Monitor 1600 3200 4800 6400 8000
OpenVINO CPU Power Consumption Monitor Min Avg Max Default, AVX-512 Enabled 23.0 199.5 219.7 Without AVX-512 23.4 205.1 233.4 OpenBenchmarking.org Watts, Fewer Is Better OpenVINO 2022.2.dev CPU Power Consumption Monitor 60 120 180 240 300
OpenVINO CPU Temperature Monitor Min Avg Max Default, AVX-512 Enabled 47.3 93.3 96.3 Without AVX-512 48.4 94.1 96.8 OpenBenchmarking.org Celsius, Fewer Is Better OpenVINO 2022.2.dev CPU Temperature Monitor 20 40 60 80 100
OpenVINO Model: Vehicle Detection FP16 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2022.2.dev Model: Vehicle Detection FP16 - Device: CPU Default, AVX-512 Enabled Without AVX-512 160 320 480 640 800 SE +/- 8.04, N = 3 SE +/- 5.20, N = 3 742.90 502.28 -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi -mno-avx512f 1. (CXX) g++ options: -fPIC -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -flto -shared
OpenVINO Model: Vehicle Detection FP16 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2022.2.dev Model: Vehicle Detection FP16 - Device: CPU Default, AVX-512 Enabled Without AVX-512 4 8 12 16 20 SE +/- 0.12, N = 3 SE +/- 0.16, N = 3 10.76 15.92 -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi - MIN: 4.25 / MAX: 23.39 -mno-avx512f - MIN: 6.75 / MAX: 34.35 1. (CXX) g++ options: -fPIC -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -flto -shared
OpenVINO CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max Default, AVX-512 Enabled 5144 5265 5881 Without AVX-512 5062 5173 5881 OpenBenchmarking.org Megahertz, More Is Better OpenVINO 2022.2.dev CPU Peak Freq (Highest CPU Core Frequency) Monitor 1600 3200 4800 6400 8000
OpenVINO CPU Power Consumption Monitor Min Avg Max Default, AVX-512 Enabled 21.9 188.8 207.3 Without AVX-512 20.6 207.2 225.3 OpenBenchmarking.org Watts, Fewer Is Better OpenVINO 2022.2.dev CPU Power Consumption Monitor 60 120 180 240 300
OpenVINO CPU Temperature Monitor Min Avg Max Default, AVX-512 Enabled 47.5 83.4 86.0 Without AVX-512 47.9 91.2 94.1 OpenBenchmarking.org Celsius, Fewer Is Better OpenVINO 2022.2.dev CPU Temperature Monitor 20 40 60 80 100
OpenVINO Model: Face Detection FP16-INT8 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2022.2.dev Model: Face Detection FP16-INT8 - Device: CPU Default, AVX-512 Enabled Without AVX-512 7 14 21 28 35 SE +/- 0.01, N = 3 SE +/- 0.02, N = 3 28.44 13.60 -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi -mno-avx512f 1. (CXX) g++ options: -fPIC -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -flto -shared
OpenVINO Model: Face Detection FP16-INT8 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2022.2.dev Model: Face Detection FP16-INT8 - Device: CPU Default, AVX-512 Enabled Without AVX-512 130 260 390 520 650 SE +/- 0.17, N = 3 SE +/- 0.73, N = 3 280.86 585.81 -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi - MIN: 263.49 / MAX: 294.78 -mno-avx512f - MIN: 556.1 / MAX: 596 1. (CXX) g++ options: -fPIC -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -flto -shared
OpenVINO CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max Default, AVX-512 Enabled 5069 5188 5881 Without AVX-512 4963 5101 5881 OpenBenchmarking.org Megahertz, More Is Better OpenVINO 2022.2.dev CPU Peak Freq (Highest CPU Core Frequency) Monitor 1600 3200 4800 6400 8000
OpenVINO CPU Power Consumption Monitor Min Avg Max Default, AVX-512 Enabled 22.2 207.0 227.9 Without AVX-512 22.9 206.6 233.0 OpenBenchmarking.org Watts, Fewer Is Better OpenVINO 2022.2.dev CPU Power Consumption Monitor 60 120 180 240 300
OpenVINO CPU Temperature Monitor Min Avg Max Default, AVX-512 Enabled 45.8 93.2 96.0 Without AVX-512 48.3 93.3 95.6 OpenBenchmarking.org Celsius, Fewer Is Better OpenVINO 2022.2.dev CPU Temperature Monitor 20 40 60 80 100
OpenVINO Model: Vehicle Detection FP16-INT8 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2022.2.dev Model: Vehicle Detection FP16-INT8 - Device: CPU Default, AVX-512 Enabled Without AVX-512 400 800 1200 1600 2000 SE +/- 2.10, N = 3 SE +/- 0.65, N = 3 1890.25 953.79 -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi -mno-avx512f 1. (CXX) g++ options: -fPIC -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -flto -shared
OpenVINO Model: Vehicle Detection FP16-INT8 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2022.2.dev Model: Vehicle Detection FP16-INT8 - Device: CPU Default, AVX-512 Enabled Without AVX-512 2 4 6 8 10 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 4.23 8.38 -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi - MIN: 2.63 / MAX: 12.45 -mno-avx512f - MIN: 4.65 / MAX: 17.13 1. (CXX) g++ options: -fPIC -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -flto -shared
OpenVINO CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max Default, AVX-512 Enabled 5066 5147 5881 Without AVX-512 5027 5125 5881 OpenBenchmarking.org Megahertz, More Is Better OpenVINO 2022.2.dev CPU Peak Freq (Highest CPU Core Frequency) Monitor 1600 3200 4800 6400 8000
OpenVINO CPU Power Consumption Monitor Min Avg Max Default, AVX-512 Enabled 22.8 212.9 234.8 Without AVX-512 23.5 209.4 234.1 OpenBenchmarking.org Watts, Fewer Is Better OpenVINO 2022.2.dev CPU Power Consumption Monitor 60 120 180 240 300
OpenVINO CPU Temperature Monitor Min Avg Max Default, AVX-512 Enabled 47.3 93.3 95.4 Without AVX-512 48.3 93.5 95.4 OpenBenchmarking.org Celsius, Fewer Is Better OpenVINO 2022.2.dev CPU Temperature Monitor 20 40 60 80 100
OpenVINO Model: Weld Porosity Detection FP16 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2022.2.dev Model: Weld Porosity Detection FP16 - Device: CPU Default, AVX-512 Enabled Without AVX-512 300 600 900 1200 1500 SE +/- 1.06, N = 3 SE +/- 0.52, N = 3 1455.45 681.37 -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi -mno-avx512f 1. (CXX) g++ options: -fPIC -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -flto -shared
OpenVINO Model: Weld Porosity Detection FP16 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2022.2.dev Model: Weld Porosity Detection FP16 - Device: CPU Default, AVX-512 Enabled Without AVX-512 3 6 9 12 15 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 5.49 11.73 -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi - MIN: 2.89 / MAX: 13.22 -mno-avx512f - MIN: 6.24 / MAX: 20.45 1. (CXX) g++ options: -fPIC -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -flto -shared
OpenVINO CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max Default, AVX-512 Enabled 5075 5159 5881 Without AVX-512 5008 5103 5881 OpenBenchmarking.org Megahertz, More Is Better OpenVINO 2022.2.dev CPU Peak Freq (Highest CPU Core Frequency) Monitor 1600 3200 4800 6400 8000
OpenVINO CPU Power Consumption Monitor Min Avg Max Default, AVX-512 Enabled 22.8 208.9 234.0 Without AVX-512 23.1 212.2 232.9 OpenBenchmarking.org Watts, Fewer Is Better OpenVINO 2022.2.dev CPU Power Consumption Monitor 60 120 180 240 300
OpenVINO CPU Temperature Monitor Min Avg Max Default, AVX-512 Enabled 47.8 93.3 95.4 Without AVX-512 48.0 93.9 95.8 OpenBenchmarking.org Celsius, Fewer Is Better OpenVINO 2022.2.dev CPU Temperature Monitor 20 40 60 80 100
OpenVINO Model: Machine Translation EN To DE FP16 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2022.2.dev Model: Machine Translation EN To DE FP16 - Device: CPU Default, AVX-512 Enabled Without AVX-512 30 60 90 120 150 SE +/- 0.42, N = 3 SE +/- 0.12, N = 3 134.59 66.03 -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi -mno-avx512f 1. (CXX) g++ options: -fPIC -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -flto -shared
OpenVINO Model: Machine Translation EN To DE FP16 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2022.2.dev Model: Machine Translation EN To DE FP16 - Device: CPU Default, AVX-512 Enabled Without AVX-512 30 60 90 120 150 SE +/- 0.18, N = 3 SE +/- 0.21, N = 3 59.39 121.06 -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi - MIN: 26.85 / MAX: 70.78 -mno-avx512f - MIN: 57.76 / MAX: 141.8 1. (CXX) g++ options: -fPIC -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -flto -shared
OpenVINO CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max Default, AVX-512 Enabled 5139 5243 5881 Without AVX-512 4888 5140 5881 OpenBenchmarking.org Megahertz, More Is Better OpenVINO 2022.2.dev CPU Peak Freq (Highest CPU Core Frequency) Monitor 1600 3200 4800 6400 8000
OpenVINO CPU Power Consumption Monitor Min Avg Max Default, AVX-512 Enabled 23.6 191.8 217.6 Without AVX-512 23.2 205.1 225.9 OpenBenchmarking.org Watts, Fewer Is Better OpenVINO 2022.2.dev CPU Power Consumption Monitor 60 120 180 240 300
OpenVINO CPU Temperature Monitor Min Avg Max Default, AVX-512 Enabled 47.3 87.2 90.1 Without AVX-512 48.6 93.7 96.8 OpenBenchmarking.org Celsius, Fewer Is Better OpenVINO 2022.2.dev CPU Temperature Monitor 20 40 60 80 100
OpenVINO Model: Weld Porosity Detection FP16-INT8 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2022.2.dev Model: Weld Porosity Detection FP16-INT8 - Device: CPU Default, AVX-512 Enabled Without AVX-512 600 1200 1800 2400 3000 SE +/- 4.82, N = 3 SE +/- 2.11, N = 3 2938.13 1353.84 -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi -mno-avx512f 1. (CXX) g++ options: -fPIC -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -flto -shared
OpenVINO Model: Weld Porosity Detection FP16-INT8 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2022.2.dev Model: Weld Porosity Detection FP16-INT8 - Device: CPU Default, AVX-512 Enabled Without AVX-512 3 6 9 12 15 SE +/- 0.01, N = 3 SE +/- 0.02, N = 3 5.44 11.81 -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi - MIN: 2.88 / MAX: 13.32 -mno-avx512f - MIN: 6.9 / MAX: 19.2 1. (CXX) g++ options: -fPIC -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -flto -shared
OpenVINO CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max Default, AVX-512 Enabled 4582 5163 5881 Without AVX-512 4982 5093 5881 OpenBenchmarking.org Megahertz, More Is Better OpenVINO 2022.2.dev CPU Peak Freq (Highest CPU Core Frequency) Monitor 1600 3200 4800 6400 8000
OpenVINO CPU Power Consumption Monitor Min Avg Max Default, AVX-512 Enabled 23.3 212.3 236.0 Without AVX-512 23.1 211.2 232.0 OpenBenchmarking.org Watts, Fewer Is Better OpenVINO 2022.2.dev CPU Power Consumption Monitor 60 120 180 240 300
OpenVINO CPU Temperature Monitor Min Avg Max Default, AVX-512 Enabled 45.9 93.1 95.3 Without AVX-512 47.9 93.5 95.4 OpenBenchmarking.org Celsius, Fewer Is Better OpenVINO 2022.2.dev CPU Temperature Monitor 20 40 60 80 100
OpenVINO Model: Person Vehicle Bike Detection FP16 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2022.2.dev Model: Person Vehicle Bike Detection FP16 - Device: CPU Default, AVX-512 Enabled Without AVX-512 400 800 1200 1600 2000 SE +/- 3.05, N = 3 SE +/- 1.39, N = 3 1696.82 907.36 -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi -mno-avx512f 1. (CXX) g++ options: -fPIC -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -flto -shared
OpenVINO Model: Person Vehicle Bike Detection FP16 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2022.2.dev Model: Person Vehicle Bike Detection FP16 - Device: CPU Default, AVX-512 Enabled Without AVX-512 2 4 6 8 10 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 4.71 8.80 -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi - MIN: 3.46 / MAX: 12.8 -mno-avx512f - MIN: 5.34 / MAX: 19.18 1. (CXX) g++ options: -fPIC -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -flto -shared
OpenVINO CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max Default, AVX-512 Enabled 5100 5188 5881 Without AVX-512 4899 5114 5881 OpenBenchmarking.org Megahertz, More Is Better OpenVINO 2022.2.dev CPU Peak Freq (Highest CPU Core Frequency) Monitor 1600 3200 4800 6400 8000
OpenVINO CPU Power Consumption Monitor Min Avg Max Default, AVX-512 Enabled 19.8 209.2 227.6 Without AVX-512 23.7 209.7 228.7 OpenBenchmarking.org Watts, Fewer Is Better OpenVINO 2022.2.dev CPU Power Consumption Monitor 60 120 180 240 300
OpenVINO CPU Temperature Monitor Min Avg Max Default, AVX-512 Enabled 47.5 91.1 94.1 Without AVX-512 48.3 93.4 96.0 OpenBenchmarking.org Celsius, Fewer Is Better OpenVINO 2022.2.dev CPU Temperature Monitor 20 40 60 80 100
OpenVINO Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2022.2.dev Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU Default, AVX-512 Enabled Without AVX-512 10K 20K 30K 40K 50K SE +/- 43.30, N = 3 SE +/- 51.81, N = 3 45555.67 22781.70 -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi -mno-avx512f 1. (CXX) g++ options: -fPIC -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -flto -shared
OpenVINO Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2022.2.dev Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU Default, AVX-512 Enabled Without AVX-512 0.1575 0.315 0.4725 0.63 0.7875 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 0.35 0.70 -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi - MIN: 0.21 / MAX: 7.78 -mno-avx512f - MIN: 0.39 / MAX: 8.82 1. (CXX) g++ options: -fPIC -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -flto -shared
OpenVINO CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max Default, AVX-512 Enabled 5006 5107 5881 Without AVX-512 4945 5053 5881 OpenBenchmarking.org Megahertz, More Is Better OpenVINO 2022.2.dev CPU Peak Freq (Highest CPU Core Frequency) Monitor 1600 3200 4800 6400 8000
OpenVINO CPU Power Consumption Monitor Min Avg Max Default, AVX-512 Enabled 23.2 214.9 234.4 Without AVX-512 23.3 209.3 228.7 OpenBenchmarking.org Watts, Fewer Is Better OpenVINO 2022.2.dev CPU Power Consumption Monitor 60 120 180 240 300
OpenVINO CPU Temperature Monitor Min Avg Max Default, AVX-512 Enabled 47.0 93.2 95.5 Without AVX-512 48.6 93.2 95.5 OpenBenchmarking.org Celsius, Fewer Is Better OpenVINO 2022.2.dev CPU Temperature Monitor 20 40 60 80 100
OpenVINO Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2022.2.dev Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU Default, AVX-512 Enabled Without AVX-512 14K 28K 42K 56K 70K SE +/- 24.16, N = 3 SE +/- 43.53, N = 3 64463.94 38316.87 -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi -mno-avx512f 1. (CXX) g++ options: -fPIC -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -flto -shared
OpenVINO Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2022.2.dev Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU Default, AVX-512 Enabled Without AVX-512 0.0923 0.1846 0.2769 0.3692 0.4615 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 0.24 0.41 -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi - MIN: 0.15 / MAX: 7.55 -mno-avx512f - MIN: 0.22 / MAX: 7.87 1. (CXX) g++ options: -fPIC -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -flto -shared
OpenVINO CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max Default, AVX-512 Enabled 5062 5142 5881 Without AVX-512 4999 5114 5881 OpenBenchmarking.org Megahertz, More Is Better OpenVINO 2022.2.dev CPU Peak Freq (Highest CPU Core Frequency) Monitor 1600 3200 4800 6400 8000
OpenVINO CPU Power Consumption Monitor Min Avg Max Default, AVX-512 Enabled 20.0 217.4 237.8 Without AVX-512 23.1 208.4 234.1 OpenBenchmarking.org Watts, Fewer Is Better OpenVINO 2022.2.dev CPU Power Consumption Monitor 60 120 180 240 300
OpenVINO CPU Temperature Monitor Min Avg Max Default, AVX-512 Enabled 48.0 93.2 95.5 Without AVX-512 48.5 93.7 95.6 OpenBenchmarking.org Celsius, Fewer Is Better OpenVINO 2022.2.dev CPU Temperature Monitor 20 40 60 80 100
OpenVKL Benchmark: vklBenchmark ISPC OpenBenchmarking.org Items / Sec, More Is Better OpenVKL 1.0 Benchmark: vklBenchmark ISPC Default, AVX-512 Enabled Without AVX-512 40 80 120 160 200 SE +/- 0.33, N = 3 SE +/- 0.00, N = 3 199 153 MIN: 17 / MAX: 2254 MIN: 14 / MAX: 1843
OpenVKL Benchmark: vklBenchmark ISPC OpenBenchmarking.org Items / Sec Per Watt, More Is Better OpenVKL 1.0 Benchmark: vklBenchmark ISPC Default, AVX-512 Enabled Without AVX-512 0.2873 0.5746 0.8619 1.1492 1.4365 1.277 0.912
OpenVKL CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max Default, AVX-512 Enabled 5168 5403 5881 Without AVX-512 5072 5346 5881 OpenBenchmarking.org Megahertz, More Is Better OpenVKL 1.0 CPU Peak Freq (Highest CPU Core Frequency) Monitor 1600 3200 4800 6400 8000
OpenVKL CPU Power Consumption Monitor Min Avg Max Default, AVX-512 Enabled 22.4 155.8 211.8 Without AVX-512 23.6 167.7 228.1 OpenBenchmarking.org Watts, Fewer Is Better OpenVKL 1.0 CPU Power Consumption Monitor 60 120 180 240 300
OpenVKL CPU Temperature Monitor Min Avg Max Default, AVX-512 Enabled 43.8 79.1 89.5 Without AVX-512 43.9 84.9 95.4 OpenBenchmarking.org Celsius, Fewer Is Better OpenVKL 1.0 CPU Temperature Monitor 20 40 60 80 100
OSPRay Benchmark: particle_volume/pathtracer/real_time OpenBenchmarking.org Items Per Second, More Is Better OSPRay 2.10 Benchmark: particle_volume/pathtracer/real_time Default, AVX-512 Enabled Without AVX-512 50 100 150 200 250 SE +/- 0.91, N = 3 SE +/- 0.59, N = 3 250.66 231.38
OSPRay Benchmark: particle_volume/pathtracer/real_time OpenBenchmarking.org Items Per Second Per Watt, More Is Better OSPRay 2.10 Benchmark: particle_volume/pathtracer/real_time Default, AVX-512 Enabled Without AVX-512 0.3137 0.6274 0.9411 1.2548 1.5685 1.394 1.237
OSPRay CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max Default, AVX-512 Enabled 5127 5270 5881 Without AVX-512 5070 5185 5881 OpenBenchmarking.org Megahertz, More Is Better OSPRay 2.10 CPU Peak Freq (Highest CPU Core Frequency) Monitor 1600 3200 4800 6400 8000
OSPRay CPU Power Consumption Monitor Min Avg Max Default, AVX-512 Enabled 22.4 179.8 215.5 Without AVX-512 22.9 187.0 222.6 OpenBenchmarking.org Watts, Fewer Is Better OSPRay 2.10 CPU Power Consumption Monitor 60 120 180 240 300
OSPRay CPU Temperature Monitor Min Avg Max Default, AVX-512 Enabled 43.1 86.3 93.0 Without AVX-512 45.0 90.8 95.8 OpenBenchmarking.org Celsius, Fewer Is Better OSPRay 2.10 CPU Temperature Monitor 20 40 60 80 100
OSPRay Benchmark: gravity_spheres_volume/dim_512/ao/real_time OpenBenchmarking.org Items Per Second, More Is Better OSPRay 2.10 Benchmark: gravity_spheres_volume/dim_512/ao/real_time Default, AVX-512 Enabled Without AVX-512 2 4 6 8 10 SE +/- 0.00437, N = 3 SE +/- 0.00574, N = 3 8.05397 4.53529
OSPRay Benchmark: gravity_spheres_volume/dim_512/ao/real_time OpenBenchmarking.org Items Per Second Per Watt, More Is Better OSPRay 2.10 Benchmark: gravity_spheres_volume/dim_512/ao/real_time Default, AVX-512 Enabled Without AVX-512 0.0097 0.0194 0.0291 0.0388 0.0485 0.043 0.023
OSPRay CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max Default, AVX-512 Enabled 5165 5243 5881 Without AVX-512 5131 5201 5881 OpenBenchmarking.org Megahertz, More Is Better OSPRay 2.10 CPU Peak Freq (Highest CPU Core Frequency) Monitor 1600 3200 4800 6400 8000
OSPRay CPU Power Consumption Monitor Min Avg Max Default, AVX-512 Enabled 22.5 189.2 205.4 Without AVX-512 23.1 193.5 209.6 OpenBenchmarking.org Watts, Fewer Is Better OSPRay 2.10 CPU Power Consumption Monitor 60 120 180 240 300
OSPRay CPU Temperature Monitor Min Avg Max Default, AVX-512 Enabled 42.5 87.0 89.1 Without AVX-512 44.8 91.4 93.5 OpenBenchmarking.org Celsius, Fewer Is Better OSPRay 2.10 CPU Temperature Monitor 20 40 60 80 100
OSPRay Benchmark: gravity_spheres_volume/dim_512/scivis/real_time OpenBenchmarking.org Items Per Second, More Is Better OSPRay 2.10 Benchmark: gravity_spheres_volume/dim_512/scivis/real_time Default, AVX-512 Enabled Without AVX-512 2 4 6 8 10 SE +/- 0.03212, N = 3 SE +/- 0.00159, N = 3 7.93432 4.33398
OSPRay Benchmark: gravity_spheres_volume/dim_512/scivis/real_time OpenBenchmarking.org Items Per Second Per Watt, More Is Better OSPRay 2.10 Benchmark: gravity_spheres_volume/dim_512/scivis/real_time Default, AVX-512 Enabled Without AVX-512 0.0095 0.019 0.0285 0.038 0.0475 0.042 0.022
OSPRay CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max Default, AVX-512 Enabled 5166 5235 5881 Without AVX-512 5121 5201 5881 OpenBenchmarking.org Megahertz, More Is Better OSPRay 2.10 CPU Peak Freq (Highest CPU Core Frequency) Monitor 1600 3200 4800 6400 8000
OSPRay CPU Power Consumption Monitor Min Avg Max Default, AVX-512 Enabled 22.4 188.0 204.2 Without AVX-512 23.1 193.1 207.2 OpenBenchmarking.org Watts, Fewer Is Better OSPRay 2.10 CPU Power Consumption Monitor 60 120 180 240 300
OSPRay CPU Temperature Monitor Min Avg Max Default, AVX-512 Enabled 46.4 87.3 89.4 Without AVX-512 47.4 92.0 93.9 OpenBenchmarking.org Celsius, Fewer Is Better OSPRay 2.10 CPU Temperature Monitor 20 40 60 80 100
OSPRay Benchmark: gravity_spheres_volume/dim_512/pathtracer/real_time OpenBenchmarking.org Items Per Second, More Is Better OSPRay 2.10 Benchmark: gravity_spheres_volume/dim_512/pathtracer/real_time Default, AVX-512 Enabled Without AVX-512 3 6 9 12 15 SE +/- 0.00541, N = 3 SE +/- 0.00119, N = 3 9.50906 6.92227
OSPRay Benchmark: gravity_spheres_volume/dim_512/pathtracer/real_time OpenBenchmarking.org Items Per Second Per Watt, More Is Better OSPRay 2.10 Benchmark: gravity_spheres_volume/dim_512/pathtracer/real_time Default, AVX-512 Enabled Without AVX-512 0.0113 0.0226 0.0339 0.0452 0.0565 0.050 0.035
OSPRay CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max Default, AVX-512 Enabled 5155 5225 5881 Without AVX-512 5107 5187 5881 OpenBenchmarking.org Megahertz, More Is Better OSPRay 2.10 CPU Peak Freq (Highest CPU Core Frequency) Monitor 1600 3200 4800 6400 8000
OSPRay CPU Power Consumption Monitor Min Avg Max Default, AVX-512 Enabled 22.8 191.7 209.5 Without AVX-512 23.4 197.7 214.7 OpenBenchmarking.org Watts, Fewer Is Better OSPRay 2.10 CPU Power Consumption Monitor 60 120 180 240 300
OSPRay CPU Temperature Monitor Min Avg Max Default, AVX-512 Enabled 46.3 88.9 91.0 Without AVX-512 48.0 93.3 95.1 OpenBenchmarking.org Celsius, Fewer Is Better OSPRay 2.10 CPU Temperature Monitor 20 40 60 80 100
OSPRay Studio Camera: 1 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path Tracer OpenBenchmarking.org ms, Fewer Is Better OSPRay Studio 0.11 Camera: 1 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path Tracer Default, AVX-512 Enabled Without AVX-512 1000 2000 3000 4000 5000 SE +/- 5.21, N = 3 SE +/- 6.51, N = 3 3659 4502 -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi -mno-avx512f 1. (CXX) g++ options: -O3 -march=native -ldl
OSPRay Studio CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max Default, AVX-512 Enabled 5136 5230 5881 Without AVX-512 5123 5212 5881 OpenBenchmarking.org Megahertz, More Is Better OSPRay Studio 0.11 CPU Peak Freq (Highest CPU Core Frequency) Monitor 1600 3200 4800 6400 8000
OSPRay Studio CPU Power Consumption Monitor Min Avg Max Default, AVX-512 Enabled 17.2 198.2 221.8 Without AVX-512 17.7 198.8 223.6 OpenBenchmarking.org Watts, Fewer Is Better OSPRay Studio 0.11 CPU Power Consumption Monitor 60 120 180 240 300
OSPRay Studio CPU Temperature Monitor Min Avg Max Default, AVX-512 Enabled 44.9 89.5 92.5 Without AVX-512 41.9 91.0 94.1 OpenBenchmarking.org Celsius, Fewer Is Better OSPRay Studio 0.11 CPU Temperature Monitor 20 40 60 80 100
OSPRay Studio Camera: 3 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path Tracer OpenBenchmarking.org ms, Fewer Is Better OSPRay Studio 0.11 Camera: 3 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path Tracer Default, AVX-512 Enabled Without AVX-512 1100 2200 3300 4400 5500 SE +/- 5.55, N = 3 SE +/- 3.28, N = 3 4368 5348 -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi -mno-avx512f 1. (CXX) g++ options: -O3 -march=native -ldl
OSPRay Studio CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max Default, AVX-512 Enabled 5134 5227 5881 Without AVX-512 5117 5207 5881 OpenBenchmarking.org Megahertz, More Is Better OSPRay Studio 0.11 CPU Peak Freq (Highest CPU Core Frequency) Monitor 1600 3200 4800 6400 8000
OSPRay Studio CPU Power Consumption Monitor Min Avg Max Default, AVX-512 Enabled 22.9 198.4 217.9 Without AVX-512 22.8 197.3 224.0 OpenBenchmarking.org Watts, Fewer Is Better OSPRay Studio 0.11 CPU Power Consumption Monitor 60 120 180 240 300
OSPRay Studio CPU Temperature Monitor Min Avg Max Default, AVX-512 Enabled 47.0 89.7 92.5 Without AVX-512 47.6 91.8 94.5 OpenBenchmarking.org Celsius, Fewer Is Better OSPRay Studio 0.11 CPU Temperature Monitor 20 40 60 80 100
OSPRay Studio Camera: 1 - Resolution: 4K - Samples Per Pixel: 16 - Renderer: Path Tracer OpenBenchmarking.org ms, Fewer Is Better OSPRay Studio 0.11 Camera: 1 - Resolution: 4K - Samples Per Pixel: 16 - Renderer: Path Tracer Default, AVX-512 Enabled Without AVX-512 16K 32K 48K 64K 80K SE +/- 138.54, N = 3 SE +/- 91.34, N = 3 62029 74844 -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi -mno-avx512f 1. (CXX) g++ options: -O3 -march=native -ldl
OSPRay Studio CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max Default, AVX-512 Enabled 5142 5295 5881 Without AVX-512 5118 5254 5881 OpenBenchmarking.org Megahertz, More Is Better OSPRay Studio 0.11 CPU Peak Freq (Highest CPU Core Frequency) Monitor 1600 3200 4800 6400 8000
OSPRay Studio CPU Power Consumption Monitor Min Avg Max Default, AVX-512 Enabled 19.2 185.5 223.2 Without AVX-512 12.7 189.2 223.7 OpenBenchmarking.org Watts, Fewer Is Better OSPRay Studio 0.11 CPU Power Consumption Monitor 60 120 180 240 300
OSPRay Studio CPU Temperature Monitor Min Avg Max Default, AVX-512 Enabled 46.9 87.8 92.4 Without AVX-512 48.0 90.2 95.0 OpenBenchmarking.org Celsius, Fewer Is Better OSPRay Studio 0.11 CPU Temperature Monitor 20 40 60 80 100
OSPRay Studio Camera: 1 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path Tracer OpenBenchmarking.org ms, Fewer Is Better OSPRay Studio 0.11 Camera: 1 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path Tracer Default, AVX-512 Enabled Without AVX-512 30K 60K 90K 120K 150K SE +/- 140.99, N = 3 SE +/- 168.25, N = 3 120727 146156 -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi -mno-avx512f 1. (CXX) g++ options: -O3 -march=native -ldl
OSPRay Studio CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max Default, AVX-512 Enabled 5118 5229 5881 Without AVX-512 5106 5202 5881 OpenBenchmarking.org Megahertz, More Is Better OSPRay Studio 0.11 CPU Peak Freq (Highest CPU Core Frequency) Monitor 1600 3200 4800 6400 8000
OSPRay Studio CPU Power Consumption Monitor Min Avg Max Default, AVX-512 Enabled 14.7 198.1 226.1 Without AVX-512 16.1 199.9 221.5 OpenBenchmarking.org Watts, Fewer Is Better OSPRay Studio 0.11 CPU Power Consumption Monitor 60 120 180 240 300
OSPRay Studio CPU Temperature Monitor Min Avg Max Default, AVX-512 Enabled 46.6 90.0 93.5 Without AVX-512 48.1 92.3 95.3 OpenBenchmarking.org Celsius, Fewer Is Better OSPRay Studio 0.11 CPU Temperature Monitor 20 40 60 80 100
OSPRay Studio Camera: 3 - Resolution: 4K - Samples Per Pixel: 16 - Renderer: Path Tracer OpenBenchmarking.org ms, Fewer Is Better OSPRay Studio 0.11 Camera: 3 - Resolution: 4K - Samples Per Pixel: 16 - Renderer: Path Tracer Default, AVX-512 Enabled Without AVX-512 20K 40K 60K 80K 100K SE +/- 149.41, N = 3 SE +/- 7.57, N = 3 73617 88344 -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi -mno-avx512f 1. (CXX) g++ options: -O3 -march=native -ldl
OSPRay Studio CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max Default, AVX-512 Enabled 5128 5264 5881 Without AVX-512 5122 5240 5881 OpenBenchmarking.org Megahertz, More Is Better OSPRay Studio 0.11 CPU Peak Freq (Highest CPU Core Frequency) Monitor 1600 3200 4800 6400 8000
OSPRay Studio CPU Power Consumption Monitor Min Avg Max Default, AVX-512 Enabled 22.9 188.7 219.2 Without AVX-512 23.0 192.2 220.6 OpenBenchmarking.org Watts, Fewer Is Better OSPRay Studio 0.11 CPU Power Consumption Monitor 60 120 180 240 300
OSPRay Studio CPU Temperature Monitor Min Avg Max Default, AVX-512 Enabled 47.5 88.3 93.0 Without AVX-512 48.3 90.4 94.5 OpenBenchmarking.org Celsius, Fewer Is Better OSPRay Studio 0.11 CPU Temperature Monitor 20 40 60 80 100
OSPRay Studio Camera: 3 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path Tracer OpenBenchmarking.org ms, Fewer Is Better OSPRay Studio 0.11 Camera: 3 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path Tracer Default, AVX-512 Enabled Without AVX-512 40K 80K 120K 160K 200K SE +/- 116.66, N = 3 SE +/- 155.59, N = 3 143981 172872 -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi -mno-avx512f 1. (CXX) g++ options: -O3 -march=native -ldl
OSPRay Studio CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max Default, AVX-512 Enabled 5131 5220 5881 Without AVX-512 5118 5194 5881 OpenBenchmarking.org Megahertz, More Is Better OSPRay Studio 0.11 CPU Peak Freq (Highest CPU Core Frequency) Monitor 1600 3200 4800 6400 8000
OSPRay Studio CPU Power Consumption Monitor Min Avg Max Default, AVX-512 Enabled 22.9 199.7 222.9 Without AVX-512 23.1 201.2 218.3 OpenBenchmarking.org Watts, Fewer Is Better OSPRay Studio 0.11 CPU Power Consumption Monitor 60 120 180 240 300
OSPRay Studio CPU Temperature Monitor Min Avg Max Default, AVX-512 Enabled 47.4 90.0 93.4 Without AVX-512 48.0 92.3 95.1 OpenBenchmarking.org Celsius, Fewer Is Better OSPRay Studio 0.11 CPU Temperature Monitor 20 40 60 80 100
simdjson Throughput Test: Kostya OpenBenchmarking.org GB/s, More Is Better simdjson 2.0 Throughput Test: Kostya Default, AVX-512 Enabled Without AVX-512 2 4 6 8 10 SE +/- 0.04, N = 3 SE +/- 0.00, N = 3 6.01 4.95 -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi -mno-avx512f 1. (CXX) g++ options: -O3 -march=native
simdjson Throughput Test: Kostya OpenBenchmarking.org GB/s Per Watt, More Is Better simdjson 2.0 Throughput Test: Kostya Default, AVX-512 Enabled Without AVX-512 0.0212 0.0424 0.0636 0.0848 0.106 0.094 0.076
simdjson CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better simdjson 2.0 CPU Peak Freq (Highest CPU Core Frequency) Monitor Without AVX-512 1300 2600 3900 5200 6500 5881
simdjson CPU Power Consumption Monitor Min Avg Max Default, AVX-512 Enabled 21.9 63.7 66.4 Without AVX-512 16.7 65.6 68.6 OpenBenchmarking.org Watts, Fewer Is Better simdjson 2.0 CPU Power Consumption Monitor 20 40 60 80 100
simdjson CPU Temperature Monitor Min Avg Max Default, AVX-512 Enabled 39.0 67.1 68.8 Without AVX-512 39.4 67.7 68.8 OpenBenchmarking.org Celsius, Fewer Is Better simdjson 2.0 CPU Temperature Monitor 20 40 60 80 100
simdjson Throughput Test: TopTweet OpenBenchmarking.org GB/s, More Is Better simdjson 2.0 Throughput Test: TopTweet Default, AVX-512 Enabled Without AVX-512 3 6 9 12 15 SE +/- 0.09, N = 3 SE +/- 0.02, N = 3 9.96 7.90 -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi -mno-avx512f 1. (CXX) g++ options: -O3 -march=native
simdjson Throughput Test: TopTweet OpenBenchmarking.org GB/s Per Watt, More Is Better simdjson 2.0 Throughput Test: TopTweet Default, AVX-512 Enabled Without AVX-512 0.0356 0.0712 0.1068 0.1424 0.178 0.158 0.125
simdjson CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better simdjson 2.0 CPU Peak Freq (Highest CPU Core Frequency) Monitor Without AVX-512 1300 2600 3900 5200 6500 5881
simdjson CPU Power Consumption Monitor Min Avg Max Default, AVX-512 Enabled 22.0 62.9 66.5 Without AVX-512 23.2 63.4 67.0 OpenBenchmarking.org Watts, Fewer Is Better simdjson 2.0 CPU Power Consumption Monitor 20 40 60 80 100
simdjson CPU Temperature Monitor Min Avg Max Default, AVX-512 Enabled 39.0 65.4 66.6 Without AVX-512 39.5 66.7 67.9 OpenBenchmarking.org Celsius, Fewer Is Better simdjson 2.0 CPU Temperature Monitor 20 40 60 80 100
simdjson Throughput Test: LargeRandom OpenBenchmarking.org GB/s, More Is Better simdjson 2.0 Throughput Test: LargeRandom Default, AVX-512 Enabled Without AVX-512 0.4028 0.8056 1.2084 1.6112 2.014 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 1.79 1.57 -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi -mno-avx512f 1. (CXX) g++ options: -O3 -march=native
simdjson Throughput Test: LargeRandom OpenBenchmarking.org GB/s Per Watt, More Is Better simdjson 2.0 Throughput Test: LargeRandom Default, AVX-512 Enabled Without AVX-512 0.0065 0.013 0.0195 0.026 0.0325 0.029 0.025
simdjson CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better simdjson 2.0 CPU Peak Freq (Highest CPU Core Frequency) Monitor Without AVX-512 1300 2600 3900 5200 6500 5881
simdjson CPU Power Consumption Monitor Min Avg Max Default, AVX-512 Enabled 22.2 62.7 65.8 Without AVX-512 22.9 62.6 65.3 OpenBenchmarking.org Watts, Fewer Is Better simdjson 2.0 CPU Power Consumption Monitor 20 40 60 80 100
simdjson CPU Temperature Monitor Min Avg Max Default, AVX-512 Enabled 38.5 66.6 68.0 Without AVX-512 38.9 68.8 69.9 OpenBenchmarking.org Celsius, Fewer Is Better simdjson 2.0 CPU Temperature Monitor 20 40 60 80 100
simdjson Throughput Test: PartialTweets OpenBenchmarking.org GB/s, More Is Better simdjson 2.0 Throughput Test: PartialTweets Default, AVX-512 Enabled Without AVX-512 3 6 9 12 15 SE +/- 0.08, N = 3 SE +/- 0.01, N = 3 9.64 7.69 -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi -mno-avx512f 1. (CXX) g++ options: -O3 -march=native
simdjson Throughput Test: PartialTweets OpenBenchmarking.org GB/s Per Watt, More Is Better simdjson 2.0 Throughput Test: PartialTweets Default, AVX-512 Enabled Without AVX-512 0.0349 0.0698 0.1047 0.1396 0.1745 0.155 0.121
simdjson CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better simdjson 2.0 CPU Peak Freq (Highest CPU Core Frequency) Monitor Without AVX-512 1300 2600 3900 5200 6500 5881
simdjson CPU Power Consumption Monitor Min Avg Max Default, AVX-512 Enabled 22.4 62.3 66.2 Without AVX-512 23.5 63.8 67.3 OpenBenchmarking.org Watts, Fewer Is Better simdjson 2.0 CPU Power Consumption Monitor 20 40 60 80 100
simdjson CPU Temperature Monitor Min Avg Max Default, AVX-512 Enabled 39.0 65.3 68.4 Without AVX-512 39.3 66.3 67.6 OpenBenchmarking.org Celsius, Fewer Is Better simdjson 2.0 CPU Temperature Monitor 20 40 60 80 100
simdjson Throughput Test: DistinctUserID OpenBenchmarking.org GB/s, More Is Better simdjson 2.0 Throughput Test: DistinctUserID Default, AVX-512 Enabled Without AVX-512 3 6 9 12 15 SE +/- 0.06, N = 3 SE +/- 0.07, N = 3 10.26 7.74 -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi -mno-avx512f 1. (CXX) g++ options: -O3 -march=native
simdjson Throughput Test: DistinctUserID OpenBenchmarking.org GB/s Per Watt, More Is Better simdjson 2.0 Throughput Test: DistinctUserID Default, AVX-512 Enabled Without AVX-512 0.0371 0.0742 0.1113 0.1484 0.1855 0.165 0.122
simdjson CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better simdjson 2.0 CPU Peak Freq (Highest CPU Core Frequency) Monitor Without AVX-512 1300 2600 3900 5200 6500 5881
simdjson CPU Power Consumption Monitor Min Avg Max Default, AVX-512 Enabled 22.3 62.1 66.4 Without AVX-512 23.1 63.4 67.0 OpenBenchmarking.org Watts, Fewer Is Better simdjson 2.0 CPU Power Consumption Monitor 20 40 60 80 100
simdjson CPU Temperature Monitor Min Avg Max Default, AVX-512 Enabled 38.9 66.7 68.6 Without AVX-512 38.9 67.2 69.5 OpenBenchmarking.org Celsius, Fewer Is Better simdjson 2.0 CPU Temperature Monitor 20 40 60 80 100
Phoronix Test Suite v10.8.5