AMD EPYC 9654 Genoa AVX-512 benchmark comparison by Michael Larabel for a future article.
Compare your own system(s) to this result file with the
Phoronix Test Suite by running the command:
phoronix-test-suite benchmark 2212195-NE-AVXCOMPAR69 AMD EPYC 4th Gen AVX-512 Comparison - Phoronix Test Suite AMD EPYC 4th Gen AVX-512 Comparison AMD EPYC 9654 Genoa AVX-512 benchmark comparison by Michael Larabel for a future article.
HTML result view exported from: https://openbenchmarking.org/result/2212195-NE-AVXCOMPAR69&export=txt&gru&sro&rro .
AMD EPYC 4th Gen AVX-512 Comparison Processor Motherboard Chipset Memory Disk Graphics Monitor Network OS Kernel Desktop Display Server Vulkan Compiler File-System Screen Resolution AVX-512 On AVX-512 Off 2 x AMD EPYC 9654 96-Core @ 2.40GHz (192 Cores / 384 Threads) AMD Titanite_4G (RTI1002E BIOS) AMD Device 14a4 1520GB 800GB INTEL SSDPF21Q800GB ASPEED VGA HDMI Broadcom NetXtreme BCM5720 PCIe Ubuntu 22.10 6.1.0-phx (x86_64) GNOME Shell 43.0 X Server 1.21.1.4 1.3.224 GCC 12.2.0 + Clang 15.0.2-1 ext4 1920x1080 OpenBenchmarking.org Kernel Details - Transparent Huge Pages: madvise Environment Details - AVX-512 On: CXXFLAGS="-O3 -march=native -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi -mprefer-vector-width=512" CFLAGS="-O3 -march=native -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi -mprefer-vector-width=512" - AVX-512 Off: CXXFLAGS="-O3 -march=native -mno-avx512f" CFLAGS="-O3 -march=native -mno-avx512f" Compiler Details - --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-defaulted --enable-offload-targets=nvptx-none=/build/gcc-12-U8K4Qv/gcc-12-12.2.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-12-U8K4Qv/gcc-12-12.2.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v Processor Details - Scaling Governor: acpi-cpufreq performance (Boost: Enabled) - CPU Microcode: 0xa10110d Python Details - Python 3.10.7 Security Details - itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional IBRS_FW STIBP: always-on RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected
AMD EPYC 4th Gen AVX-512 Comparison minibude: OpenMP - BM1 minibude: OpenMP - BM2 openvino: Face Detection FP16 - CPU openvino: Face Detection FP16-INT8 - CPU openvino: Age Gender Recognition Retail 0013 FP16 - CPU openvino: Age Gender Recognition Retail 0013 FP16-INT8 - CPU openvino: Person Detection FP16 - CPU openvino: Person Detection FP32 - CPU openvino: Weld Porosity Detection FP16-INT8 - CPU openvino: Weld Porosity Detection FP16 - CPU openvino: Vehicle Detection FP16-INT8 - CPU openvino: Vehicle Detection FP16 - CPU openvino: Person Vehicle Bike Detection FP16 - CPU openvino: Machine Translation EN To DE FP16 - CPU embree: Pathtracer ISPC - Asian Dragon Obj embree: Pathtracer ISPC - Asian Dragon embree: Pathtracer ISPC - Crown svt-av1: Preset 13 - Bosphorus 4K svt-av1: Preset 12 - Bosphorus 4K simdjson: PartialTweets simdjson: LargeRand simdjson: Kostya simdjson: DistinctUserID simdjson: TopTweet minibude: OpenMP - BM1 minibude: OpenMP - BM2 oidn: RT.hdr_alb_nrm.3840x2160 oidn: RT.ldr_alb_nrm.3840x2160 oidn: RTLightmap.hdr.4096x4096 tensorflow: CPU - 16 - ResNet-50 tensorflow: CPU - 16 - AlexNet tensorflow: CPU - 16 - GoogLeNet onnx: fcn-resnet101-11 - CPU - Standard onnx: super-resolution-10 - CPU - Standard onnx: bertsquad-12 - CPU - Standard onnx: ArcFace ResNet-100 - CPU - Standard openvkl: vklBenchmark ISPC ospray: gravity_spheres_volume/dim_512/ao/real_time ospray: gravity_spheres_volume/dim_512/scivis/real_time ospray: gravity_spheres_volume/dim_512/pathtracer/real_time deepsparse: NLP Text Classification, BERT base uncased SST2 - Synchronous Single-Stream deepsparse: NLP Text Classification, BERT base uncased SST2 - Asynchronous Multi-Stream deepsparse: NLP Text Classification, DistilBERT mnli - Synchronous Single-Stream deepsparse: NLP Text Classification, DistilBERT mnli - Asynchronous Multi-Stream deepsparse: CV Classification, ResNet-50 ImageNet - Asynchronous Multi-Stream deepsparse: NLP Token Classification, BERT base uncased conll2003 - Synchronous Single-Stream deepsparse: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Synchronous Single-Stream deepsparse: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Asynchronous Multi-Stream deepsparse: CV Detection,YOLOv5s COCO - Synchronous Single-Stream deepsparse: CV Detection,YOLOv5s COCO - Asynchronous Multi-Stream deepsparse: NLP Document Classification, oBERT base uncased on IMDB - Synchronous Single-Stream cpuminer-opt: scrypt cpuminer-opt: Quad SHA-256, Pyrite cpuminer-opt: x25x cpuminer-opt: Garlicoin cpuminer-opt: Skeincoin cpuminer-opt: LBC, LBRY Credits smhasher: FarmHash32 x86_64 AVX jpegxl: JPEG - 90 jpegxl: JPEG - 100 jpegxl: PNG - 90 lczero: BLAS lczero: Eigen gromacs: MPI CPU - water_GMX50_bare ai-benchmark: Device Inference Score ai-benchmark: Device Training Score ai-benchmark: Device AI Score numpy: daphne: OpenMP - NDT Mapping daphne: OpenMP - Points2Image smhasher: FarmHash32 x86_64 AVX ospray-studio: 1 - 1080p - 1 - Path Tracer ospray-studio: 1 - 1080p - 16 - Path Tracer ospray-studio: 1 - 1080p - 32 - Path Tracer ospray-studio: 1 - 4K - 1 - Path Tracer ospray-studio: 1 - 4K - 16 - Path Tracer ospray-studio: 1 - 4K - 32 - Path Tracer ospray-studio: 2 - 1080p - 1 - Path Tracer ospray-studio: 2 - 1080p - 16 - Path Tracer ospray-studio: 2 - 1080p - 32 - Path Tracer ospray-studio: 2 - 4K - 1 - Path Tracer ospray-studio: 2 - 4K - 16 - Path Tracer ospray-studio: 2 - 4K - 32 - Path Tracer ospray-studio: 3 - 1080p - 1 - Path Tracer ospray-studio: 3 - 1080p - 16 - Path Tracer ospray-studio: 3 - 1080p - 32 - Path Tracer ospray-studio: 3 - 4K - 1 - Path Tracer ospray-studio: 3 - 4K - 16 - Path Tracer ospray-studio: 3 - 4K - 32 - Path Tracer onednn: Convolution Batch Shapes Auto - f32 - CPU onednn: Deconvolution Batch shapes_1d - f32 - CPU onednn: Deconvolution Batch shapes_3d - f32 - CPU onednn: Recurrent Neural Network Training - f32 - CPU onednn: Recurrent Neural Network Training - bf16bf16bf16 - CPU onednn: Recurrent Neural Network Inference - bf16bf16bf16 - CPU mnn: resnet-v2-50 mnn: SqueezeNetV1.0 mnn: inception-v3 ncnn: CPU - mnasnet ncnn: CPU - efficientnet-b0 ncnn: CPU - blazeface ncnn: CPU - googlenet ncnn: CPU - resnet50 ncnn: CPU - regnety_400m ncnn: CPU - vision_transformer ncnn: CPU - FastestDet openvino: Face Detection FP16 - CPU openvino: Face Detection FP16-INT8 - CPU openvino: Age Gender Recognition Retail 0013 FP16 - CPU openvino: Age Gender Recognition Retail 0013 FP16-INT8 - CPU openvino: Person Detection FP16 - CPU openvino: Person Detection FP32 - CPU openvino: Weld Porosity Detection FP16-INT8 - CPU openvino: Weld Porosity Detection FP16 - CPU openvino: Vehicle Detection FP16-INT8 - CPU openvino: Vehicle Detection FP16 - CPU openvino: Person Vehicle Bike Detection FP16 - CPU openvino: Machine Translation EN To DE FP16 - CPU deepsparse: NLP Text Classification, BERT base uncased SST2 - Synchronous Single-Stream deepsparse: NLP Text Classification, BERT base uncased SST2 - Asynchronous Multi-Stream deepsparse: NLP Text Classification, DistilBERT mnli - Synchronous Single-Stream deepsparse: NLP Text Classification, DistilBERT mnli - Asynchronous Multi-Stream deepsparse: CV Classification, ResNet-50 ImageNet - Asynchronous Multi-Stream deepsparse: NLP Token Classification, BERT base uncased conll2003 - Synchronous Single-Stream deepsparse: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Synchronous Single-Stream deepsparse: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Asynchronous Multi-Stream deepsparse: CV Detection,YOLOv5s COCO - Synchronous Single-Stream deepsparse: CV Detection,YOLOv5s COCO - Asynchronous Multi-Stream deepsparse: NLP Document Classification, oBERT base uncased on IMDB - Synchronous Single-Stream numenta-nab: Bayesian Changepoint numenta-nab: Windowed Gaussian numenta-nab: Relative Entropy openfoam: drivaerFastback, Medium Mesh Size - Mesh Time openfoam: drivaerFastback, Medium Mesh Size - Execution Time cp2k: Fayalite-FIST AVX-512 On AVX-512 Off 291.982 346.081 102.04 193.93 148967.98 170652.71 43.34 43.34 19800.20 9988.44 11202.62 7452.96 9065.34 956.88 184.4701 212.9364 180.9315 246.572 245.555 6.70 1.26 4.18 6.86 6.52 7299.545 8652.005 3.51 3.51 1.66 22.15 157.29 60.17 271 7401 516 1051 1332 44.1566 43.0711 54.2187 84.9988 616.6804 187.0837 1195.9367 1953.0255 34.5206 100.5458 761.2241 189.5611 857.2265 34.2518 4800.61 2260680 7696.06 71553 1951330 1066950 39794.44 9.55 0.74 9.95 9077 9096 18.764 3510 2701 6211 575.66 1371.18 13677.764494843 26.387 148 2353 4698 581 9271 18546 154 2384 4764 604 9385 18808 177 2804 5608 694 11070 22184 0.516167 22.5875 0.989591 1962.06 1955.39 2361.27 15.441 8.579 45.812 42.30 57.71 25.88 72.80 66.34 247.32 74.93 58.95 469.29 246.98 0.55 0.36 1100.25 1101.00 9.63 4.79 4.28 6.43 5.29 50.11 11.7586 155.3462 5.3413 80.0826 49.0328 28.9609 9.9408 125.7860 5.2712 111.7282 29.1892 16.677 4.727 9.898 135.77418 113.63733 1122.725 202.604 255.661 43.94 94.97 108449.49 151239.60 25.50 25.74 9672.94 4110.49 6065.76 3782.08 5135.56 445.59 153.4476 176.8831 151.0558 239.881 233.944 5.14 1.04 3.39 5.25 5.38 5065.096 6391.519 3.50 3.51 1.72 12.75 55.11 31.12 250 6288 499 918 1155 26.3794 25.1354 40.5117 73.5380 509.4462 177.5387 1005.1615 1410.8051 30.6062 71.0437 490.3658 157.819 690.8722 30.5267 2946.08 1322960 5784.25 48827 1427543 491740 36483.70 9.13 0.72 9.52 8423 8162 18.467 1821 1066 2887 548.83 1335.63 11521.38 26.412 181 2871 5749 710 11321 22647 184 2924 5861 722 11524 22985 214 3413 6820 841 13398 26785 0.537682 22.8354 1.76336 4953.98 4989.13 1715.76 24.098 9.146 30.436 44.19 62.86 29.00 76.13 67.48 270.12 86.16 60.73 1088.50 503.50 1.21 0.57 1864.93 1845.95 19.69 11.66 7.90 12.67 9.33 107.62 13.5907 187.8540 5.6282 95.3347 67.9118 32.6647 14.0655 195.1656 6.3313 138.5861 32.7505 17.389 4.882 10.035 144.3478 135.21648 1198.408 OpenBenchmarking.org
CPU Temperature Monitor Phoronix Test Suite System Monitoring OpenBenchmarking.org Celsius CPU Temperature Monitor Phoronix Test Suite System Monitoring AVX-512 On AVX-512 Off 14 28 42 56 70 Min: 30.13 / Avg: 49.97 / Max: 73.38 Min: 35.5 / Avg: 51.26 / Max: 73.75
CPU Power Consumption Monitor Phoronix Test Suite System Monitoring OpenBenchmarking.org Watts CPU Power Consumption Monitor Phoronix Test Suite System Monitoring AVX-512 On AVX-512 Off 130 260 390 520 650 Min: 26.37 / Avg: 434.8 / Max: 766.01 Min: 106.95 / Avg: 449.58 / Max: 735.32
miniBUDE Implementation: OpenMP - Input Deck: BM1 OpenBenchmarking.org Billion Interactions/s, More Is Better miniBUDE 20210901 Implementation: OpenMP - Input Deck: BM1 AVX-512 On AVX-512 Off 60 120 180 240 300 SE +/- 0.23, N = 10 SE +/- 1.06, N = 8 291.98 202.60 1. (CC) gcc options: -std=c99 -Ofast -ffast-math -fopenmp -march=native -lm
miniBUDE Implementation: OpenMP - Input Deck: BM2 OpenBenchmarking.org Billion Interactions/s, More Is Better miniBUDE 20210901 Implementation: OpenMP - Input Deck: BM2 AVX-512 On AVX-512 Off 80 160 240 320 400 SE +/- 0.46, N = 4 SE +/- 1.27, N = 3 346.08 255.66 1. (CC) gcc options: -std=c99 -Ofast -ffast-math -fopenmp -march=native -lm
miniBUDE Implementation: OpenMP - Input Deck: BM1 OpenBenchmarking.org Billion Interactions/s Per Watt, More Is Better miniBUDE 20210901 Implementation: OpenMP - Input Deck: BM1 AVX-512 On AVX-512 Off 0.2342 0.4684 0.7026 0.9368 1.171 1.041 0.489
miniBUDE Implementation: OpenMP - Input Deck: BM2 OpenBenchmarking.org Billion Interactions/s Per Watt, More Is Better miniBUDE 20210901 Implementation: OpenMP - Input Deck: BM2 AVX-512 On AVX-512 Off 0.1562 0.3124 0.4686 0.6248 0.781 0.694 0.453
OpenVINO Model: Face Detection FP16 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2022.2.dev Model: Face Detection FP16 - Device: CPU AVX-512 On AVX-512 Off 20 40 60 80 100 SE +/- 0.07, N = 3 SE +/- 0.01, N = 3 102.04 43.94 -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi -mno-avx512f 1. (CXX) g++ options: -fPIC -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -flto -shared
OpenVINO Model: Face Detection FP16-INT8 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2022.2.dev Model: Face Detection FP16-INT8 - Device: CPU AVX-512 On AVX-512 Off 40 80 120 160 200 SE +/- 0.05, N = 3 SE +/- 0.02, N = 3 193.93 94.97 -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi -mno-avx512f 1. (CXX) g++ options: -fPIC -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -flto -shared
OpenVINO Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2022.2.dev Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU AVX-512 On AVX-512 Off 30K 60K 90K 120K 150K SE +/- 1328.20, N = 3 SE +/- 1130.85, N = 4 148967.98 108449.49 -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi -mno-avx512f 1. (CXX) g++ options: -fPIC -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -flto -shared
OpenVINO Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2022.2.dev Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU AVX-512 On AVX-512 Off 40K 80K 120K 160K 200K SE +/- 127.59, N = 3 SE +/- 1455.37, N = 3 170652.71 151239.60 -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi -mno-avx512f 1. (CXX) g++ options: -fPIC -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -flto -shared
OpenVINO Model: Person Detection FP16 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2022.2.dev Model: Person Detection FP16 - Device: CPU AVX-512 On AVX-512 Off 10 20 30 40 50 SE +/- 0.20, N = 3 SE +/- 0.22, N = 3 43.34 25.50 -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi -mno-avx512f 1. (CXX) g++ options: -fPIC -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -flto -shared
OpenVINO Model: Person Detection FP32 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2022.2.dev Model: Person Detection FP32 - Device: CPU AVX-512 On AVX-512 Off 10 20 30 40 50 SE +/- 0.18, N = 3 SE +/- 0.04, N = 3 43.34 25.74 -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi -mno-avx512f 1. (CXX) g++ options: -fPIC -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -flto -shared
OpenVINO Model: Weld Porosity Detection FP16-INT8 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2022.2.dev Model: Weld Porosity Detection FP16-INT8 - Device: CPU AVX-512 On AVX-512 Off 4K 8K 12K 16K 20K SE +/- 12.72, N = 3 SE +/- 1.81, N = 3 19800.20 9672.94 -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi -mno-avx512f 1. (CXX) g++ options: -fPIC -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -flto -shared
OpenVINO Model: Weld Porosity Detection FP16 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2022.2.dev Model: Weld Porosity Detection FP16 - Device: CPU AVX-512 On AVX-512 Off 2K 4K 6K 8K 10K SE +/- 6.96, N = 3 SE +/- 4.29, N = 3 9988.44 4110.49 -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi -mno-avx512f 1. (CXX) g++ options: -fPIC -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -flto -shared
OpenVINO Model: Vehicle Detection FP16-INT8 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2022.2.dev Model: Vehicle Detection FP16-INT8 - Device: CPU AVX-512 On AVX-512 Off 2K 4K 6K 8K 10K SE +/- 2.53, N = 3 SE +/- 1.39, N = 3 11202.62 6065.76 -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi -mno-avx512f 1. (CXX) g++ options: -fPIC -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -flto -shared
OpenVINO Model: Vehicle Detection FP16 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2022.2.dev Model: Vehicle Detection FP16 - Device: CPU AVX-512 On AVX-512 Off 1600 3200 4800 6400 8000 SE +/- 3.52, N = 3 SE +/- 10.17, N = 3 7452.96 3782.08 -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi -mno-avx512f 1. (CXX) g++ options: -fPIC -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -flto -shared
OpenVINO Model: Person Vehicle Bike Detection FP16 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2022.2.dev Model: Person Vehicle Bike Detection FP16 - Device: CPU AVX-512 On AVX-512 Off 2K 4K 6K 8K 10K SE +/- 4.01, N = 3 SE +/- 2.17, N = 3 9065.34 5135.56 -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi -mno-avx512f 1. (CXX) g++ options: -fPIC -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -flto -shared
OpenVINO Model: Machine Translation EN To DE FP16 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2022.2.dev Model: Machine Translation EN To DE FP16 - Device: CPU AVX-512 On AVX-512 Off 200 400 600 800 1000 SE +/- 4.00, N = 3 SE +/- 3.04, N = 3 956.88 445.59 -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi -mno-avx512f 1. (CXX) g++ options: -fPIC -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -flto -shared
Embree Binary: Pathtracer ISPC - Model: Asian Dragon Obj OpenBenchmarking.org Frames Per Second, More Is Better Embree 3.13 Binary: Pathtracer ISPC - Model: Asian Dragon Obj AVX-512 On AVX-512 Off 40 80 120 160 200 SE +/- 0.62, N = 4 SE +/- 0.36, N = 4 184.47 153.45 MIN: 178.83 / MAX: 196.34 MIN: 130.31 / MAX: 166.17
Embree Binary: Pathtracer ISPC - Model: Asian Dragon OpenBenchmarking.org Frames Per Second Per Watt, More Is Better Embree 3.13 Binary: Pathtracer ISPC - Model: Asian Dragon AVX-512 On AVX-512 Off 0.1591 0.3182 0.4773 0.6364 0.7955 0.707 0.431
Embree Binary: Pathtracer ISPC - Model: Asian Dragon OpenBenchmarking.org Frames Per Second, More Is Better Embree 3.13 Binary: Pathtracer ISPC - Model: Asian Dragon AVX-512 On AVX-512 Off 50 100 150 200 250 SE +/- 0.22, N = 9 SE +/- 0.21, N = 8 212.94 176.88 MIN: 207.72 / MAX: 227.11 MIN: 170.19 / MAX: 190
Embree Binary: Pathtracer ISPC - Model: Asian Dragon Obj OpenBenchmarking.org Frames Per Second Per Watt, More Is Better Embree 3.13 Binary: Pathtracer ISPC - Model: Asian Dragon Obj AVX-512 On AVX-512 Off 0.1631 0.3262 0.4893 0.6524 0.8155 0.725 0.481
Embree Binary: Pathtracer ISPC - Model: Crown OpenBenchmarking.org Frames Per Second, More Is Better Embree 3.13 Binary: Pathtracer ISPC - Model: Crown AVX-512 On AVX-512 Off 40 80 120 160 200 SE +/- 0.62, N = 8 SE +/- 0.25, N = 7 180.93 151.06 MIN: 124.41 / MAX: 209.74 MIN: 114.4 / MAX: 176.43
SVT-AV1 Encoder Mode: Preset 13 - Input: Bosphorus 4K OpenBenchmarking.org Frames Per Second, More Is Better SVT-AV1 1.4 Encoder Mode: Preset 13 - Input: Bosphorus 4K AVX-512 On AVX-512 Off 50 100 150 200 250 SE +/- 4.74, N = 15 SE +/- 4.01, N = 15 246.57 239.88
SVT-AV1 Encoder Mode: Preset 12 - Input: Bosphorus 4K OpenBenchmarking.org Frames Per Second, More Is Better SVT-AV1 1.4 Encoder Mode: Preset 12 - Input: Bosphorus 4K AVX-512 On AVX-512 Off 50 100 150 200 250 SE +/- 4.78, N = 15 SE +/- 3.57, N = 15 245.56 233.94
Embree Binary: Pathtracer ISPC - Model: Crown OpenBenchmarking.org Frames Per Second Per Watt, More Is Better Embree 3.13 Binary: Pathtracer ISPC - Model: Crown AVX-512 On AVX-512 Off 0.1179 0.2358 0.3537 0.4716 0.5895 0.524 0.344
SVT-AV1 Encoder Mode: Preset 13 - Input: Bosphorus 4K OpenBenchmarking.org Frames Per Second Per Watt, More Is Better SVT-AV1 1.4 Encoder Mode: Preset 13 - Input: Bosphorus 4K AVX-512 On AVX-512 Off 0.3404 0.6808 1.0212 1.3616 1.702 1.513 0.986
SVT-AV1 Encoder Mode: Preset 12 - Input: Bosphorus 4K OpenBenchmarking.org Frames Per Second Per Watt, More Is Better SVT-AV1 1.4 Encoder Mode: Preset 12 - Input: Bosphorus 4K AVX-512 On AVX-512 Off 0.315 0.63 0.945 1.26 1.575 1.400 0.968
simdjson Throughput Test: PartialTweets OpenBenchmarking.org GB/s Per Watt, More Is Better simdjson 2.0 Throughput Test: PartialTweets AVX-512 On AVX-512 Off 0.0072 0.0144 0.0216 0.0288 0.036 0.032 0.023
simdjson Throughput Test: PartialTweets OpenBenchmarking.org GB/s, More Is Better simdjson 2.0 Throughput Test: PartialTweets AVX-512 On AVX-512 Off 2 4 6 8 10 SE +/- 0.04, N = 3 SE +/- 0.01, N = 3 6.70 5.14 -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi -mno-avx512f 1. (CXX) g++ options: -O3 -march=native
simdjson Throughput Test: LargeRandom OpenBenchmarking.org GB/s, More Is Better simdjson 2.0 Throughput Test: LargeRandom AVX-512 On AVX-512 Off 0.2835 0.567 0.8505 1.134 1.4175 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 1.26 1.04 -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi -mno-avx512f 1. (CXX) g++ options: -O3 -march=native
simdjson Throughput Test: Kostya OpenBenchmarking.org GB/s, More Is Better simdjson 2.0 Throughput Test: Kostya AVX-512 On AVX-512 Off 0.9405 1.881 2.8215 3.762 4.7025 SE +/- 0.02, N = 3 SE +/- 0.00, N = 3 4.18 3.39 -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi -mno-avx512f 1. (CXX) g++ options: -O3 -march=native
simdjson Throughput Test: DistinctUserID OpenBenchmarking.org GB/s, More Is Better simdjson 2.0 Throughput Test: DistinctUserID AVX-512 On AVX-512 Off 2 4 6 8 10 SE +/- 0.02, N = 3 SE +/- 0.01, N = 3 6.86 5.25 -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi -mno-avx512f 1. (CXX) g++ options: -O3 -march=native
simdjson Throughput Test: LargeRandom OpenBenchmarking.org GB/s Per Watt, More Is Better simdjson 2.0 Throughput Test: LargeRandom AVX-512 On AVX-512 Off 0.0014 0.0028 0.0042 0.0056 0.007 0.006 0.005
simdjson Throughput Test: Kostya OpenBenchmarking.org GB/s Per Watt, More Is Better simdjson 2.0 Throughput Test: Kostya AVX-512 On AVX-512 Off 0.0045 0.009 0.0135 0.018 0.0225 0.020 0.015
simdjson Throughput Test: DistinctUserID OpenBenchmarking.org GB/s Per Watt, More Is Better simdjson 2.0 Throughput Test: DistinctUserID AVX-512 On AVX-512 Off 0.0074 0.0148 0.0222 0.0296 0.037 0.033 0.024
simdjson Throughput Test: TopTweet OpenBenchmarking.org GB/s, More Is Better simdjson 2.0 Throughput Test: TopTweet AVX-512 On AVX-512 Off 2 4 6 8 10 SE +/- 0.08, N = 4 SE +/- 0.01, N = 3 6.52 5.38 -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi -mno-avx512f 1. (CXX) g++ options: -O3 -march=native
simdjson Throughput Test: TopTweet OpenBenchmarking.org GB/s Per Watt, More Is Better simdjson 2.0 Throughput Test: TopTweet AVX-512 On AVX-512 Off 0.007 0.014 0.021 0.028 0.035 0.031 0.024
miniBUDE Implementation: OpenMP - Input Deck: BM1 OpenBenchmarking.org GFInst/s, More Is Better miniBUDE 20210901 Implementation: OpenMP - Input Deck: BM1 AVX-512 On AVX-512 Off 1600 3200 4800 6400 8000 SE +/- 5.79, N = 10 SE +/- 26.42, N = 8 7299.55 5065.10 1. (CC) gcc options: -std=c99 -Ofast -ffast-math -fopenmp -march=native -lm
miniBUDE Implementation: OpenMP - Input Deck: BM2 OpenBenchmarking.org GFInst/s, More Is Better miniBUDE 20210901 Implementation: OpenMP - Input Deck: BM2 AVX-512 On AVX-512 Off 2K 4K 6K 8K 10K SE +/- 11.62, N = 4 SE +/- 31.65, N = 3 8652.01 6391.52 1. (CC) gcc options: -std=c99 -Ofast -ffast-math -fopenmp -march=native -lm
Intel Open Image Denoise Run: RT.hdr_alb_nrm.3840x2160 OpenBenchmarking.org Images / Sec, More Is Better Intel Open Image Denoise 1.4.0 Run: RT.hdr_alb_nrm.3840x2160 AVX-512 On AVX-512 Off 0.7898 1.5796 2.3694 3.1592 3.949 SE +/- 0.01, N = 5 SE +/- 0.03, N = 5 3.51 3.50
Intel Open Image Denoise Run: RT.hdr_alb_nrm.3840x2160 OpenBenchmarking.org Images / Sec Per Watt, More Is Better Intel Open Image Denoise 1.4.0 Run: RT.hdr_alb_nrm.3840x2160 AVX-512 On AVX-512 Off 0.0027 0.0054 0.0081 0.0108 0.0135 0.012 0.010
Intel Open Image Denoise Run: RT.ldr_alb_nrm.3840x2160 OpenBenchmarking.org Images / Sec Per Watt, More Is Better Intel Open Image Denoise 1.4.0 Run: RT.ldr_alb_nrm.3840x2160 AVX-512 On AVX-512 Off 0.0027 0.0054 0.0081 0.0108 0.0135 0.012 0.010
Intel Open Image Denoise Run: RTLightmap.hdr.4096x4096 OpenBenchmarking.org Images / Sec Per Watt, More Is Better Intel Open Image Denoise 1.4.0 Run: RTLightmap.hdr.4096x4096 AVX-512 On AVX-512 Off 0.0011 0.0022 0.0033 0.0044 0.0055 0.005 0.004
Intel Open Image Denoise Run: RT.ldr_alb_nrm.3840x2160 OpenBenchmarking.org Images / Sec, More Is Better Intel Open Image Denoise 1.4.0 Run: RT.ldr_alb_nrm.3840x2160 AVX-512 On AVX-512 Off 0.7898 1.5796 2.3694 3.1592 3.949 SE +/- 0.01, N = 5 SE +/- 0.01, N = 5 3.51 3.51
Intel Open Image Denoise Run: RTLightmap.hdr.4096x4096 OpenBenchmarking.org Images / Sec, More Is Better Intel Open Image Denoise 1.4.0 Run: RTLightmap.hdr.4096x4096 AVX-512 On AVX-512 Off 0.387 0.774 1.161 1.548 1.935 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 1.66 1.72
TensorFlow Device: CPU - Batch Size: 16 - Model: ResNet-50 OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.10 Device: CPU - Batch Size: 16 - Model: ResNet-50 AVX-512 On AVX-512 Off 5 10 15 20 25 SE +/- 0.11, N = 3 SE +/- 0.01, N = 3 22.15 12.75
TensorFlow Device: CPU - Batch Size: 16 - Model: AlexNet OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.10 Device: CPU - Batch Size: 16 - Model: AlexNet AVX-512 On AVX-512 Off 30 60 90 120 150 SE +/- 2.35, N = 12 SE +/- 0.19, N = 3 157.29 55.11
TensorFlow Device: CPU - Batch Size: 16 - Model: GoogLeNet OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.10 Device: CPU - Batch Size: 16 - Model: GoogLeNet AVX-512 On AVX-512 Off 13 26 39 52 65 SE +/- 1.01, N = 15 SE +/- 0.25, N = 3 60.17 31.12
TensorFlow Device: CPU - Batch Size: 16 - Model: ResNet-50 OpenBenchmarking.org images/sec Per Watt, More Is Better TensorFlow 2.10 Device: CPU - Batch Size: 16 - Model: ResNet-50 AVX-512 On AVX-512 Off 0.0162 0.0324 0.0486 0.0648 0.081 0.072 0.038
TensorFlow Device: CPU - Batch Size: 16 - Model: AlexNet OpenBenchmarking.org images/sec Per Watt, More Is Better TensorFlow 2.10 Device: CPU - Batch Size: 16 - Model: AlexNet AVX-512 On AVX-512 Off 0.1181 0.2362 0.3543 0.4724 0.5905 0.525 0.173
TensorFlow Device: CPU - Batch Size: 16 - Model: GoogLeNet OpenBenchmarking.org images/sec Per Watt, More Is Better TensorFlow 2.10 Device: CPU - Batch Size: 16 - Model: GoogLeNet AVX-512 On AVX-512 Off 0.0439 0.0878 0.1317 0.1756 0.2195 0.195 0.104
ONNX Runtime Model: fcn-resnet101-11 - Device: CPU - Executor: Standard OpenBenchmarking.org Inferences Per Minute Per Watt, More Is Better ONNX Runtime 1.11 Model: fcn-resnet101-11 - Device: CPU - Executor: Standard AVX-512 On AVX-512 Off 0.1233 0.2466 0.3699 0.4932 0.6165 0.548 0.497
ONNX Runtime Model: super-resolution-10 - Device: CPU - Executor: Standard OpenBenchmarking.org Inferences Per Minute Per Watt, More Is Better ONNX Runtime 1.11 Model: super-resolution-10 - Device: CPU - Executor: Standard AVX-512 On AVX-512 Off 7 14 21 28 35 28.54 23.57
ONNX Runtime Model: ArcFace ResNet-100 - Device: CPU - Executor: Standard OpenBenchmarking.org Inferences Per Minute Per Watt, More Is Better ONNX Runtime 1.11 Model: ArcFace ResNet-100 - Device: CPU - Executor: Standard AVX-512 On AVX-512 Off 0.5353 1.0706 1.6059 2.1412 2.6765 2.379 2.051
ONNX Runtime Model: fcn-resnet101-11 - Device: CPU - Executor: Standard OpenBenchmarking.org Inferences Per Minute, More Is Better ONNX Runtime 1.11 Model: fcn-resnet101-11 - Device: CPU - Executor: Standard AVX-512 On AVX-512 Off 60 120 180 240 300 SE +/- 0.44, N = 3 SE +/- 2.36, N = 12 271 250 -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi -mno-avx512f 1. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt
ONNX Runtime Model: super-resolution-10 - Device: CPU - Executor: Standard OpenBenchmarking.org Inferences Per Minute, More Is Better ONNX Runtime 1.11 Model: super-resolution-10 - Device: CPU - Executor: Standard AVX-512 On AVX-512 Off 1600 3200 4800 6400 8000 SE +/- 5.46, N = 3 SE +/- 260.54, N = 12 7401 6288 -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi -mno-avx512f 1. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt
ONNX Runtime Model: bertsquad-12 - Device: CPU - Executor: Standard OpenBenchmarking.org Inferences Per Minute Per Watt, More Is Better ONNX Runtime 1.11 Model: bertsquad-12 - Device: CPU - Executor: Standard AVX-512 On AVX-512 Off 0.3134 0.6268 0.9402 1.2536 1.567 1.393 1.315
ONNX Runtime Model: bertsquad-12 - Device: CPU - Executor: Standard OpenBenchmarking.org Inferences Per Minute, More Is Better ONNX Runtime 1.11 Model: bertsquad-12 - Device: CPU - Executor: Standard AVX-512 On AVX-512 Off 110 220 330 440 550 SE +/- 1.86, N = 3 SE +/- 3.11, N = 3 516 499 -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi -mno-avx512f 1. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt
ONNX Runtime Model: ArcFace ResNet-100 - Device: CPU - Executor: Standard OpenBenchmarking.org Inferences Per Minute, More Is Better ONNX Runtime 1.11 Model: ArcFace ResNet-100 - Device: CPU - Executor: Standard AVX-512 On AVX-512 Off 200 400 600 800 1000 SE +/- 39.92, N = 12 SE +/- 20.83, N = 12 1051 918 -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi -mno-avx512f 1. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt
OpenVKL Benchmark: vklBenchmark ISPC OpenBenchmarking.org Items / Sec, More Is Better OpenVKL 1.3.1 Benchmark: vklBenchmark ISPC AVX-512 On AVX-512 Off 300 600 900 1200 1500 SE +/- 13.58, N = 3 SE +/- 8.11, N = 3 1332 1155 MIN: 329 / MAX: 4770 MIN: 251 / MAX: 5181
OpenVKL Benchmark: vklBenchmark ISPC OpenBenchmarking.org Items / Sec Per Watt, More Is Better OpenVKL 1.3.1 Benchmark: vklBenchmark ISPC AVX-512 On AVX-512 Off 0.6419 1.2838 1.9257 2.5676 3.2095 2.853 2.355
OSPRay Benchmark: gravity_spheres_volume/dim_512/ao/real_time OpenBenchmarking.org Items Per Second, More Is Better OSPRay 2.10 Benchmark: gravity_spheres_volume/dim_512/ao/real_time AVX-512 On AVX-512 Off 10 20 30 40 50 SE +/- 0.21, N = 3 SE +/- 0.02, N = 3 44.16 26.38
OSPRay Benchmark: gravity_spheres_volume/dim_512/scivis/real_time OpenBenchmarking.org Items Per Second, More Is Better OSPRay 2.10 Benchmark: gravity_spheres_volume/dim_512/scivis/real_time AVX-512 On AVX-512 Off 10 20 30 40 50 SE +/- 0.10, N = 3 SE +/- 0.04, N = 3 43.07 25.14
OSPRay Benchmark: gravity_spheres_volume/dim_512/scivis/real_time OpenBenchmarking.org Items Per Second Per Watt, More Is Better OSPRay 2.10 Benchmark: gravity_spheres_volume/dim_512/scivis/real_time AVX-512 On AVX-512 Off 0.0167 0.0334 0.0501 0.0668 0.0835 0.074 0.041
OSPRay Benchmark: gravity_spheres_volume/dim_512/pathtracer/real_time OpenBenchmarking.org Items Per Second, More Is Better OSPRay 2.10 Benchmark: gravity_spheres_volume/dim_512/pathtracer/real_time AVX-512 On AVX-512 Off 12 24 36 48 60 SE +/- 0.05, N = 3 SE +/- 0.03, N = 3 54.22 40.51
OSPRay Benchmark: gravity_spheres_volume/dim_512/ao/real_time OpenBenchmarking.org Items Per Second Per Watt, More Is Better OSPRay 2.10 Benchmark: gravity_spheres_volume/dim_512/ao/real_time AVX-512 On AVX-512 Off 0.0171 0.0342 0.0513 0.0684 0.0855 0.076 0.043
OSPRay Benchmark: gravity_spheres_volume/dim_512/pathtracer/real_time OpenBenchmarking.org Items Per Second Per Watt, More Is Better OSPRay 2.10 Benchmark: gravity_spheres_volume/dim_512/pathtracer/real_time AVX-512 On AVX-512 Off 0.0205 0.041 0.0615 0.082 0.1025 0.091 0.065
Neural Magic DeepSparse Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Synchronous Single-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.1 Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Synchronous Single-Stream AVX-512 On AVX-512 Off 20 40 60 80 100 SE +/- 0.45, N = 3 SE +/- 0.27, N = 3 85.00 73.54
Neural Magic DeepSparse Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.1 Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-Stream AVX-512 On AVX-512 Off 130 260 390 520 650 SE +/- 1.92, N = 3 SE +/- 0.33, N = 3 616.68 509.45
Neural Magic DeepSparse Model: NLP Text Classification, DistilBERT mnli - Scenario: Synchronous Single-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.1 Model: NLP Text Classification, DistilBERT mnli - Scenario: Synchronous Single-Stream AVX-512 On AVX-512 Off 40 80 120 160 200 SE +/- 0.11, N = 3 SE +/- 0.29, N = 3 187.08 177.54
Neural Magic DeepSparse Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.1 Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream AVX-512 On AVX-512 Off 300 600 900 1200 1500 SE +/- 2.39, N = 3 SE +/- 0.78, N = 3 1195.94 1005.16
Neural Magic DeepSparse Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.1 Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream AVX-512 On AVX-512 Off 400 800 1200 1600 2000 SE +/- 4.32, N = 3 SE +/- 0.17, N = 3 1953.03 1410.81
Neural Magic DeepSparse Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Synchronous Single-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.1 Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Synchronous Single-Stream AVX-512 On AVX-512 Off 8 16 24 32 40 SE +/- 0.03, N = 3 SE +/- 0.03, N = 3 34.52 30.61
Neural Magic DeepSparse Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Synchronous Single-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.1 Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Synchronous Single-Stream AVX-512 On AVX-512 Off 20 40 60 80 100 SE +/- 0.17, N = 3 SE +/- 0.17, N = 3 100.55 71.04
Neural Magic DeepSparse Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.1 Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-Stream AVX-512 On AVX-512 Off 160 320 480 640 800 SE +/- 0.79, N = 3 SE +/- 0.61, N = 3 761.22 490.37
Neural Magic DeepSparse Model: CV Detection,YOLOv5s COCO - Scenario: Synchronous Single-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.1 Model: CV Detection,YOLOv5s COCO - Scenario: Synchronous Single-Stream AVX-512 On AVX-512 Off 40 80 120 160 200 SE +/- 0.22, N = 3 SE +/- 0.17, N = 3 189.56 157.82
Neural Magic DeepSparse Model: CV Detection,YOLOv5s COCO - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.1 Model: CV Detection,YOLOv5s COCO - Scenario: Asynchronous Multi-Stream AVX-512 On AVX-512 Off 200 400 600 800 1000 SE +/- 0.77, N = 3 SE +/- 1.12, N = 3 857.23 690.87
Neural Magic DeepSparse Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Synchronous Single-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.1 Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Synchronous Single-Stream AVX-512 On AVX-512 Off 8 16 24 32 40 SE +/- 0.08, N = 3 SE +/- 0.10, N = 3 34.25 30.53
Cpuminer-Opt Algorithm: scrypt OpenBenchmarking.org kH/s, More Is Better Cpuminer-Opt 3.20.3 Algorithm: scrypt AVX-512 On AVX-512 Off 1000 2000 3000 4000 5000 SE +/- 0.45, N = 3 SE +/- 0.31, N = 3 4800.61 2946.08 -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi -mno-avx512f 1. (CXX) g++ options: -O3 -march=native -lcurl -lz -lpthread -lssl -lcrypto -lgmp
Cpuminer-Opt Algorithm: scrypt OpenBenchmarking.org kH/s Per Watt, More Is Better Cpuminer-Opt 3.20.3 Algorithm: scrypt AVX-512 On AVX-512 Off 2 4 6 8 10 8.076 5.279
Cpuminer-Opt Algorithm: Quad SHA-256, Pyrite OpenBenchmarking.org kH/s, More Is Better Cpuminer-Opt 3.20.3 Algorithm: Quad SHA-256, Pyrite AVX-512 On AVX-512 Off 500K 1000K 1500K 2000K 2500K SE +/- 9040.25, N = 3 SE +/- 276.83, N = 3 2260680 1322960 -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi -mno-avx512f 1. (CXX) g++ options: -O3 -march=native -lcurl -lz -lpthread -lssl -lcrypto -lgmp
Cpuminer-Opt Algorithm: Quad SHA-256, Pyrite OpenBenchmarking.org kH/s Per Watt, More Is Better Cpuminer-Opt 3.20.3 Algorithm: Quad SHA-256, Pyrite AVX-512 On AVX-512 Off 800 1600 2400 3200 4000 3657.53 2252.99
Cpuminer-Opt Algorithm: x25x OpenBenchmarking.org kH/s, More Is Better Cpuminer-Opt 3.20.3 Algorithm: x25x AVX-512 On AVX-512 Off 1600 3200 4800 6400 8000 SE +/- 16.58, N = 3 SE +/- 14.41, N = 3 7696.06 5784.25 -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi -mno-avx512f 1. (CXX) g++ options: -O3 -march=native -lcurl -lz -lpthread -lssl -lcrypto -lgmp
Cpuminer-Opt Algorithm: x25x OpenBenchmarking.org kH/s Per Watt, More Is Better Cpuminer-Opt 3.20.3 Algorithm: x25x AVX-512 On AVX-512 Off 3 6 9 12 15 13.548 9.971
Cpuminer-Opt Algorithm: Garlicoin OpenBenchmarking.org kH/s, More Is Better Cpuminer-Opt 3.20.3 Algorithm: Garlicoin AVX-512 On AVX-512 Off 15K 30K 45K 60K 75K SE +/- 89.69, N = 3 SE +/- 13.33, N = 3 71553 48827 -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi -mno-avx512f 1. (CXX) g++ options: -O3 -march=native -lcurl -lz -lpthread -lssl -lcrypto -lgmp
Cpuminer-Opt Algorithm: Garlicoin OpenBenchmarking.org kH/s Per Watt, More Is Better Cpuminer-Opt 3.20.3 Algorithm: Garlicoin AVX-512 On AVX-512 Off 30 60 90 120 150 119.97 83.22
Cpuminer-Opt Algorithm: Skeincoin OpenBenchmarking.org kH/s Per Watt, More Is Better Cpuminer-Opt 3.20.3 Algorithm: Skeincoin AVX-512 On AVX-512 Off 700 1400 2100 2800 3500 3137.56 2381.94
Cpuminer-Opt Algorithm: LBC, LBRY Credits OpenBenchmarking.org kH/s Per Watt, More Is Better Cpuminer-Opt 3.20.3 Algorithm: LBC, LBRY Credits AVX-512 On AVX-512 Off 400 800 1200 1600 2000 1658.51 802.76
Cpuminer-Opt Algorithm: Skeincoin OpenBenchmarking.org kH/s, More Is Better Cpuminer-Opt 3.20.3 Algorithm: Skeincoin AVX-512 On AVX-512 Off 400K 800K 1200K 1600K 2000K SE +/- 13005.55, N = 3 SE +/- 3964.01, N = 3 1951330 1427543 -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi -mno-avx512f 1. (CXX) g++ options: -O3 -march=native -lcurl -lz -lpthread -lssl -lcrypto -lgmp
Cpuminer-Opt Algorithm: LBC, LBRY Credits OpenBenchmarking.org kH/s, More Is Better Cpuminer-Opt 3.20.3 Algorithm: LBC, LBRY Credits AVX-512 On AVX-512 Off 200K 400K 600K 800K 1000K SE +/- 7645.47, N = 3 SE +/- 667.26, N = 3 1066950 491740 -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi -mno-avx512f 1. (CXX) g++ options: -O3 -march=native -lcurl -lz -lpthread -lssl -lcrypto -lgmp
AI Benchmark Alpha CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max AVX-512 On 2400 3655 4107 AVX-512 Off 3068 3710 4285 OpenBenchmarking.org Megahertz, More Is Better AI Benchmark Alpha 0.1.2 CPU Peak Freq (Highest CPU Core Frequency) Monitor 1100 2200 3300 4400 5500
Neural Magic DeepSparse CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max AVX-512 On 2400 3559 3801 AVX-512 Off 3507 3698 3967 OpenBenchmarking.org Megahertz, More Is Better Neural Magic DeepSparse 1.1 CPU Peak Freq (Highest CPU Core Frequency) Monitor 1100 2200 3300 4400 5500
Neural Magic DeepSparse CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max AVX-512 On 2400 3109 3928 AVX-512 Off 2589 3135 4299 OpenBenchmarking.org Megahertz, More Is Better Neural Magic DeepSparse 1.1 CPU Peak Freq (Highest CPU Core Frequency) Monitor 1100 2200 3300 4400 5500
Neural Magic DeepSparse CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max AVX-512 On 2400 3541 3702 AVX-512 Off 3692 3712 4154 OpenBenchmarking.org Megahertz, More Is Better Neural Magic DeepSparse 1.1 CPU Peak Freq (Highest CPU Core Frequency) Monitor 1100 2200 3300 4400 5500
Neural Magic DeepSparse CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max AVX-512 On 2400 2868 3737 AVX-512 Off 2623 2987 4137 OpenBenchmarking.org Megahertz, More Is Better Neural Magic DeepSparse 1.1 CPU Peak Freq (Highest CPU Core Frequency) Monitor 1100 2200 3300 4400 5500
Neural Magic DeepSparse CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max AVX-512 On 2400 3003 3730 AVX-512 Off 2552 2938 3959 OpenBenchmarking.org Megahertz, More Is Better Neural Magic DeepSparse 1.1 CPU Peak Freq (Highest CPU Core Frequency) Monitor 1000 2000 3000 4000 5000
Neural Magic DeepSparse CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max AVX-512 On 2400 3551 3868 AVX-512 Off 3686 3711 4893 OpenBenchmarking.org Megahertz, More Is Better Neural Magic DeepSparse 1.1 CPU Peak Freq (Highest CPU Core Frequency) Monitor 1200 2400 3600 4800 6000
Neural Magic DeepSparse CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max AVX-512 On 2400 3571 3764 AVX-512 Off 3678 3702 4150 OpenBenchmarking.org Megahertz, More Is Better Neural Magic DeepSparse 1.1 CPU Peak Freq (Highest CPU Core Frequency) Monitor 1100 2200 3300 4400 5500
Neural Magic DeepSparse CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max AVX-512 On 2400 2945 3885 AVX-512 Off 2568 3214 4450 OpenBenchmarking.org Megahertz, More Is Better Neural Magic DeepSparse 1.1 CPU Peak Freq (Highest CPU Core Frequency) Monitor 1200 2400 3600 4800 6000
Neural Magic DeepSparse CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max AVX-512 On 2400 3527 3821 AVX-512 Off 3068 3641 4426 OpenBenchmarking.org Megahertz, More Is Better Neural Magic DeepSparse 1.1 CPU Peak Freq (Highest CPU Core Frequency) Monitor 1100 2200 3300 4400 5500
Neural Magic DeepSparse CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max AVX-512 On 2400 2879 3730 AVX-512 Off 2535 2908 3834 OpenBenchmarking.org Megahertz, More Is Better Neural Magic DeepSparse 1.1 CPU Peak Freq (Highest CPU Core Frequency) Monitor 1000 2000 3000 4000 5000
Neural Magic DeepSparse CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max AVX-512 On 2400 3533 3703 AVX-512 Off 3089 3679 4336 OpenBenchmarking.org Megahertz, More Is Better Neural Magic DeepSparse 1.1 CPU Peak Freq (Highest CPU Core Frequency) Monitor 1100 2200 3300 4400 5500
TensorFlow CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max AVX-512 On 2400 3664 4099 AVX-512 Off 3694 3713 4254 OpenBenchmarking.org Megahertz, More Is Better TensorFlow 2.10 CPU Peak Freq (Highest CPU Core Frequency) Monitor 1100 2200 3300 4400 5500
TensorFlow CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max AVX-512 On 2400 3458 3812 AVX-512 Off 3694 3732 4340 OpenBenchmarking.org Megahertz, More Is Better TensorFlow 2.10 CPU Peak Freq (Highest CPU Core Frequency) Monitor 1100 2200 3300 4400 5500
TensorFlow CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max AVX-512 On 2400 3586 4161 AVX-512 Off 3694 3727 4474 OpenBenchmarking.org Megahertz, More Is Better TensorFlow 2.10 CPU Peak Freq (Highest CPU Core Frequency) Monitor 1200 2400 3600 4800 6000
LeelaChessZero CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better LeelaChessZero 0.28 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 On AVX-512 Off 900 1800 2700 3600 4500 Min: 2400 / Avg: 3683.95 / Max: 3952 Min: 3383 / Avg: 3700.34 / Max: 4961
LeelaChessZero CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max AVX-512 On 2400 3685 4074 AVX-512 Off 3694 3699 4052 OpenBenchmarking.org Megahertz, More Is Better LeelaChessZero 0.28 CPU Peak Freq (Highest CPU Core Frequency) Monitor 1100 2200 3300 4400 5500
Embree CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max AVX-512 On 2400 2974 3695 AVX-512 Off 2899 3508 4437 OpenBenchmarking.org Megahertz, More Is Better Embree 3.13 CPU Peak Freq (Highest CPU Core Frequency) Monitor 1200 2400 3600 4800 6000
Embree CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max AVX-512 On 2400 3372 3699 AVX-512 Off 2889 3592 4020 OpenBenchmarking.org Megahertz, More Is Better Embree 3.13 CPU Peak Freq (Highest CPU Core Frequency) Monitor 1100 2200 3300 4400 5500
Embree CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max AVX-512 On 2400 2928 3696 AVX-512 Off 2726 3446 5379 OpenBenchmarking.org Megahertz, More Is Better Embree 3.13 CPU Peak Freq (Highest CPU Core Frequency) Monitor 1400 2800 4200 5600 7000
OpenVKL CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better OpenVKL 1.3.1 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 On AVX-512 Off 700 1400 2100 2800 3500 Min: 2400 / Avg: 3408.84 / Max: 3732 Min: 2621 / Avg: 3373.13 / Max: 4085
OSPRay CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max AVX-512 On 2400 3081 3695 AVX-512 Off 2771 3073 4018 OpenBenchmarking.org Megahertz, More Is Better OSPRay 2.10 CPU Peak Freq (Highest CPU Core Frequency) Monitor 1100 2200 3300 4400 5500
OSPRay CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max AVX-512 On 2400 3051 3695 AVX-512 Off 2768 3083 4016 OpenBenchmarking.org Megahertz, More Is Better OSPRay 2.10 CPU Peak Freq (Highest CPU Core Frequency) Monitor 1100 2200 3300 4400 5500
OSPRay CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max AVX-512 On 2400 3055 3720 AVX-512 Off 2766 3104 4475 OpenBenchmarking.org Megahertz, More Is Better OSPRay 2.10 CPU Peak Freq (Highest CPU Core Frequency) Monitor 1200 2400 3600 4800 6000
OSPRay Studio CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max AVX-512 On 2400 2939 3695 AVX-512 Off 2708 2997 3911 OpenBenchmarking.org Megahertz, More Is Better OSPRay Studio 0.11 CPU Peak Freq (Highest CPU Core Frequency) Monitor 1000 2000 3000 4000 5000
OSPRay Studio CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max AVX-512 On 2400 2930 3699 AVX-512 Off 2696 2979 4041 OpenBenchmarking.org Megahertz, More Is Better OSPRay Studio 0.11 CPU Peak Freq (Highest CPU Core Frequency) Monitor 1100 2200 3300 4400 5500
OSPRay Studio CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max AVX-512 On 2400 2904 3702 AVX-512 Off 2802 2978 4050 OpenBenchmarking.org Megahertz, More Is Better OSPRay Studio 0.11 CPU Peak Freq (Highest CPU Core Frequency) Monitor 1100 2200 3300 4400 5500
OSPRay Studio CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max AVX-512 On 2400 2950 3701 AVX-512 Off 2696 3001 3902 OpenBenchmarking.org Megahertz, More Is Better OSPRay Studio 0.11 CPU Peak Freq (Highest CPU Core Frequency) Monitor 1000 2000 3000 4000 5000
OSPRay Studio CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max AVX-512 On 2400 2888 3699 AVX-512 Off 2709 2937 3983 OpenBenchmarking.org Megahertz, More Is Better OSPRay Studio 0.11 CPU Peak Freq (Highest CPU Core Frequency) Monitor 1100 2200 3300 4400 5500
OSPRay Studio CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max AVX-512 On 2400 2876 3752 AVX-512 Off 2769 2989 3982 OpenBenchmarking.org Megahertz, More Is Better OSPRay Studio 0.11 CPU Peak Freq (Highest CPU Core Frequency) Monitor 1100 2200 3300 4400 5500
OSPRay Studio CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max AVX-512 On 2400 2859 3697 AVX-512 Off 2702 2995 3808 OpenBenchmarking.org Megahertz, More Is Better OSPRay Studio 0.11 CPU Peak Freq (Highest CPU Core Frequency) Monitor 1000 2000 3000 4000 5000
OSPRay Studio CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max AVX-512 On 2400 2922 3700 AVX-512 Off 2783 2993 3739 OpenBenchmarking.org Megahertz, More Is Better OSPRay Studio 0.11 CPU Peak Freq (Highest CPU Core Frequency) Monitor 1000 2000 3000 4000 5000
OSPRay Studio CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max AVX-512 On 2400 2935 3696 AVX-512 Off 2771 2972 3740 OpenBenchmarking.org Megahertz, More Is Better OSPRay Studio 0.11 CPU Peak Freq (Highest CPU Core Frequency) Monitor 1000 2000 3000 4000 5000
OSPRay Studio CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max AVX-512 On 2400 2868 3857 AVX-512 Off 2712 3004 3940 OpenBenchmarking.org Megahertz, More Is Better OSPRay Studio 0.11 CPU Peak Freq (Highest CPU Core Frequency) Monitor 1000 2000 3000 4000 5000
OSPRay Studio CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max AVX-512 On 2400 2906 3696 AVX-512 Off 2721 2960 3862 OpenBenchmarking.org Megahertz, More Is Better OSPRay Studio 0.11 CPU Peak Freq (Highest CPU Core Frequency) Monitor 1000 2000 3000 4000 5000
OSPRay Studio CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max AVX-512 On 2400 2907 3700 AVX-512 Off 2726 3007 4349 OpenBenchmarking.org Megahertz, More Is Better OSPRay Studio 0.11 CPU Peak Freq (Highest CPU Core Frequency) Monitor 1100 2200 3300 4400 5500
OSPRay Studio CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max AVX-512 On 2400 2931 3701 AVX-512 Off 2705 3001 3951 OpenBenchmarking.org Megahertz, More Is Better OSPRay Studio 0.11 CPU Peak Freq (Highest CPU Core Frequency) Monitor 1000 2000 3000 4000 5000
OSPRay Studio CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max AVX-512 On 2400 2926 3699 AVX-512 Off 2721 2971 4031 OpenBenchmarking.org Megahertz, More Is Better OSPRay Studio 0.11 CPU Peak Freq (Highest CPU Core Frequency) Monitor 1100 2200 3300 4400 5500
OSPRay Studio CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max AVX-512 On 2400 2923 3697 AVX-512 Off 2715 2972 4286 OpenBenchmarking.org Megahertz, More Is Better OSPRay Studio 0.11 CPU Peak Freq (Highest CPU Core Frequency) Monitor 1100 2200 3300 4400 5500
OSPRay Studio CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max AVX-512 On 2400 2937 3698 AVX-512 Off 2721 2996 4398 OpenBenchmarking.org Megahertz, More Is Better OSPRay Studio 0.11 CPU Peak Freq (Highest CPU Core Frequency) Monitor 1100 2200 3300 4400 5500
OSPRay Studio CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max AVX-512 On 2400 2910 3697 AVX-512 Off 2752 2956 4184 OpenBenchmarking.org Megahertz, More Is Better OSPRay Studio 0.11 CPU Peak Freq (Highest CPU Core Frequency) Monitor 1100 2200 3300 4400 5500
OSPRay Studio CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max AVX-512 On 2400 2943 3701 AVX-512 Off 2727 2973 3711 OpenBenchmarking.org Megahertz, More Is Better OSPRay Studio 0.11 CPU Peak Freq (Highest CPU Core Frequency) Monitor 1000 2000 3000 4000 5000
oneDNN CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max AVX-512 On 2400 3182 3695 AVX-512 Off 2860 3348 3869 OpenBenchmarking.org Megahertz, More Is Better oneDNN 2.7 CPU Peak Freq (Highest CPU Core Frequency) Monitor 1000 2000 3000 4000 5000
oneDNN CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max AVX-512 On 2400 3394 3729 AVX-512 Off 2933 3526 3802 OpenBenchmarking.org Megahertz, More Is Better oneDNN 2.7 CPU Peak Freq (Highest CPU Core Frequency) Monitor 1000 2000 3000 4000 5000
oneDNN CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max AVX-512 On 2400 3008 3695 AVX-512 Off 3569 3666 4064 OpenBenchmarking.org Megahertz, More Is Better oneDNN 2.7 CPU Peak Freq (Highest CPU Core Frequency) Monitor 1100 2200 3300 4400 5500
oneDNN CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max AVX-512 On 2400 3571 3711 AVX-512 Off 3581 3623 3818 OpenBenchmarking.org Megahertz, More Is Better oneDNN 2.7 CPU Peak Freq (Highest CPU Core Frequency) Monitor 1000 2000 3000 4000 5000
oneDNN CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better oneDNN 2.7 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 On AVX-512 Off 700 1400 2100 2800 3500 Min: 2400 / Avg: 3567.66 / Max: 3704 Min: 3582 / Avg: 3626.86 / Max: 4223
oneDNN CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max AVX-512 On 2400 3507 3700 AVX-512 Off 3570 3612 4005 OpenBenchmarking.org Megahertz, More Is Better oneDNN 2.7 CPU Peak Freq (Highest CPU Core Frequency) Monitor 1100 2200 3300 4400 5500
Mobile Neural Network CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better Mobile Neural Network 2.1 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 On AVX-512 Off 700 1400 2100 2800 3500 Min: 2400 / Avg: 3679.28 / Max: 3704 Min: 3694 / Avg: 3699.72 / Max: 4041
Cpuminer-Opt CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max AVX-512 On 2400 3009 3697 AVX-512 Off 2933 3058 3896 OpenBenchmarking.org Megahertz, More Is Better Cpuminer-Opt 3.20.3 CPU Peak Freq (Highest CPU Core Frequency) Monitor 1000 2000 3000 4000 5000
Cpuminer-Opt CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max AVX-512 On 2400 3112 3695 AVX-512 Off 3001 3155 4285 OpenBenchmarking.org Megahertz, More Is Better Cpuminer-Opt 3.20.3 CPU Peak Freq (Highest CPU Core Frequency) Monitor 1100 2200 3300 4400 5500
Cpuminer-Opt CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max AVX-512 On 2400 3105 3697 AVX-512 Off 3256 3351 4121 OpenBenchmarking.org Megahertz, More Is Better Cpuminer-Opt 3.20.3 CPU Peak Freq (Highest CPU Core Frequency) Monitor 1100 2200 3300 4400 5500
Cpuminer-Opt CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max AVX-512 On 2400 3079 3830 AVX-512 Off 2878 3030 3783 OpenBenchmarking.org Megahertz, More Is Better Cpuminer-Opt 3.20.3 CPU Peak Freq (Highest CPU Core Frequency) Monitor 1000 2000 3000 4000 5000
Cpuminer-Opt CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max AVX-512 On 2400 3002 3696 AVX-512 Off 2895 3068 3848 OpenBenchmarking.org Megahertz, More Is Better Cpuminer-Opt 3.20.3 CPU Peak Freq (Highest CPU Core Frequency) Monitor 1000 2000 3000 4000 5000
Cpuminer-Opt CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max AVX-512 On 2400 3060 3703 AVX-512 Off 2729 2933 4111 OpenBenchmarking.org Megahertz, More Is Better Cpuminer-Opt 3.20.3 CPU Peak Freq (Highest CPU Core Frequency) Monitor 1100 2200 3300 4400 5500
NCNN CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better NCNN 20220729 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 On AVX-512 Off 700 1400 2100 2800 3500 Min: 2400 / Avg: 3565.67 / Max: 3699 Min: 3563 / Avg: 3574.38 / Max: 3815
OpenVINO CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max AVX-512 On 2400 3126 3696 AVX-512 Off 2652 2906 4086 OpenBenchmarking.org Megahertz, More Is Better OpenVINO 2022.2.dev CPU Peak Freq (Highest CPU Core Frequency) Monitor 1100 2200 3300 4400 5500
OpenVINO CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max AVX-512 On 2400 3129 3696 AVX-512 Off 2920 3081 3713 OpenBenchmarking.org Megahertz, More Is Better OpenVINO 2022.2.dev CPU Peak Freq (Highest CPU Core Frequency) Monitor 1000 2000 3000 4000 5000
OpenVINO CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max AVX-512 On 2400 3605 3828 AVX-512 Off 2992 3193 4056 OpenBenchmarking.org Megahertz, More Is Better OpenVINO 2022.2.dev CPU Peak Freq (Highest CPU Core Frequency) Monitor 1100 2200 3300 4400 5500
OpenVINO CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max AVX-512 On 2400 3630 3754 AVX-512 Off 3476 3674 3707 OpenBenchmarking.org Megahertz, More Is Better OpenVINO 2022.2.dev CPU Peak Freq (Highest CPU Core Frequency) Monitor 1000 2000 3000 4000 5000
OpenVINO CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max AVX-512 On 2400 3480 3726 AVX-512 Off 2709 3150 3863 OpenBenchmarking.org Megahertz, More Is Better OpenVINO 2022.2.dev CPU Peak Freq (Highest CPU Core Frequency) Monitor 1000 2000 3000 4000 5000
OpenVINO CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max AVX-512 On 2400 3466 3698 AVX-512 Off 2729 3100 3993 OpenBenchmarking.org Megahertz, More Is Better OpenVINO 2022.2.dev CPU Peak Freq (Highest CPU Core Frequency) Monitor 1100 2200 3300 4400 5500
OpenVINO CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max AVX-512 On 2400 3037 3696 AVX-512 Off 2930 3070 3969 OpenBenchmarking.org Megahertz, More Is Better OpenVINO 2022.2.dev CPU Peak Freq (Highest CPU Core Frequency) Monitor 1100 2200 3300 4400 5500
OpenVINO CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max AVX-512 On 2400 3060 3695 AVX-512 Off 2672 2848 3946 OpenBenchmarking.org Megahertz, More Is Better OpenVINO 2022.2.dev CPU Peak Freq (Highest CPU Core Frequency) Monitor 1000 2000 3000 4000 5000
OpenVINO CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max AVX-512 On 2400 3036 3900 AVX-512 Off 2988 3068 4270 OpenBenchmarking.org Megahertz, More Is Better OpenVINO 2022.2.dev CPU Peak Freq (Highest CPU Core Frequency) Monitor 1100 2200 3300 4400 5500
OpenVINO CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max AVX-512 On 2400 2972 3706 AVX-512 Off 2571 2730 4230 OpenBenchmarking.org Megahertz, More Is Better OpenVINO 2022.2.dev CPU Peak Freq (Highest CPU Core Frequency) Monitor 1100 2200 3300 4400 5500
OpenVINO CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max AVX-512 On 2400 3099 3699 AVX-512 Off 2799 2942 3941 OpenBenchmarking.org Megahertz, More Is Better OpenVINO 2022.2.dev CPU Peak Freq (Highest CPU Core Frequency) Monitor 1000 2000 3000 4000 5000
OpenVINO CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max AVX-512 On 2400 3256 3707 AVX-512 Off 2592 2966 3926 OpenBenchmarking.org Megahertz, More Is Better OpenVINO 2022.2.dev CPU Peak Freq (Highest CPU Core Frequency) Monitor 1000 2000 3000 4000 5000
GROMACS CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max AVX-512 On 2400 3168 3725 AVX-512 Off 2875 3358 4145 OpenBenchmarking.org Megahertz, More Is Better GROMACS 2022.1 CPU Peak Freq (Highest CPU Core Frequency) Monitor 1100 2200 3300 4400 5500
ONNX Runtime CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max AVX-512 On 2400 3577 3696 AVX-512 Off 3047 3612 4291 OpenBenchmarking.org Megahertz, More Is Better ONNX Runtime 1.11 CPU Peak Freq (Highest CPU Core Frequency) Monitor 1100 2200 3300 4400 5500
ONNX Runtime CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max AVX-512 On 2400 3665 3710 AVX-512 Off 3693 3702 4397 OpenBenchmarking.org Megahertz, More Is Better ONNX Runtime 1.11 CPU Peak Freq (Highest CPU Core Frequency) Monitor 1100 2200 3300 4400 5500
ONNX Runtime CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max AVX-512 On 2400 3663 3709 AVX-512 Off 3694 3701 3978 OpenBenchmarking.org Megahertz, More Is Better ONNX Runtime 1.11 CPU Peak Freq (Highest CPU Core Frequency) Monitor 1100 2200 3300 4400 5500
ONNX Runtime CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better ONNX Runtime 1.11 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 On AVX-512 Off 700 1400 2100 2800 3500 Min: 2400 / Avg: 3571.99 / Max: 3770 Min: 3593 / Avg: 3607.6 / Max: 4285
Numpy Benchmark CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max AVX-512 On 2400 3673 3705 AVX-512 Off 3694 3702 4024 OpenBenchmarking.org Megahertz, More Is Better Numpy Benchmark CPU Peak Freq (Highest CPU Core Frequency) Monitor 1100 2200 3300 4400 5500
miniBUDE CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max AVX-512 On 2400 2913 3739 AVX-512 Off 3107 3505 4044 OpenBenchmarking.org Megahertz, More Is Better miniBUDE 20210901 CPU Peak Freq (Highest CPU Core Frequency) Monitor 1100 2200 3300 4400 5500
miniBUDE CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max AVX-512 On 2400 3201 3697 AVX-512 Off 2905 3288 3891 OpenBenchmarking.org Megahertz, More Is Better miniBUDE 20210901 CPU Peak Freq (Highest CPU Core Frequency) Monitor 1000 2000 3000 4000 5000
SVT-AV1 CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max AVX-512 On 2400 3202 3756 AVX-512 Off 3694 3728 4349 OpenBenchmarking.org Megahertz, More Is Better SVT-AV1 1.4 CPU Peak Freq (Highest CPU Core Frequency) Monitor 1100 2200 3300 4400 5500
SVT-AV1 CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max AVX-512 On 2400 3274 3770 AVX-512 Off 3694 3718 3985 OpenBenchmarking.org Megahertz, More Is Better SVT-AV1 1.4 CPU Peak Freq (Highest CPU Core Frequency) Monitor 1100 2200 3300 4400 5500
Numenta Anomaly Benchmark CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max AVX-512 On 2400 3532 3699 AVX-512 Off 3694 3707 4079 OpenBenchmarking.org Megahertz, More Is Better Numenta Anomaly Benchmark 1.1 CPU Peak Freq (Highest CPU Core Frequency) Monitor 1100 2200 3300 4400 5500
Numenta Anomaly Benchmark CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max AVX-512 On 2400 3237 3715 AVX-512 Off 3694 3718 3948 OpenBenchmarking.org Megahertz, More Is Better Numenta Anomaly Benchmark 1.1 CPU Peak Freq (Highest CPU Core Frequency) Monitor 1000 2000 3000 4000 5000
Numenta Anomaly Benchmark CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max AVX-512 On 2400 3437 3911 AVX-512 Off 3694 3702 3768 OpenBenchmarking.org Megahertz, More Is Better Numenta Anomaly Benchmark 1.1 CPU Peak Freq (Highest CPU Core Frequency) Monitor 1000 2000 3000 4000 5000
Intel Open Image Denoise CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max AVX-512 On 2400 3124 3699 AVX-512 Off 2718 3626 4090 OpenBenchmarking.org Megahertz, More Is Better Intel Open Image Denoise 1.4.0 CPU Peak Freq (Highest CPU Core Frequency) Monitor 1100 2200 3300 4400 5500
Intel Open Image Denoise CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max AVX-512 On 2400 3212 3702 AVX-512 Off 2854 3610 3919 OpenBenchmarking.org Megahertz, More Is Better Intel Open Image Denoise 1.4.0 CPU Peak Freq (Highest CPU Core Frequency) Monitor 1000 2000 3000 4000 5000
Intel Open Image Denoise CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max AVX-512 On 2400 3216 3699 AVX-512 Off 3017 3636 4215 OpenBenchmarking.org Megahertz, More Is Better Intel Open Image Denoise 1.4.0 CPU Peak Freq (Highest CPU Core Frequency) Monitor 1100 2200 3300 4400 5500
Darmstadt Automotive Parallel Heterogeneous Suite CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max AVX-512 On 2400 3516 3702 AVX-512 Off 3694 3719 4426 OpenBenchmarking.org Megahertz, More Is Better Darmstadt Automotive Parallel Heterogeneous Suite CPU Peak Freq (Highest CPU Core Frequency) Monitor 1100 2200 3300 4400 5500
Darmstadt Automotive Parallel Heterogeneous Suite CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better Darmstadt Automotive Parallel Heterogeneous Suite CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 On AVX-512 Off 800 1600 2400 3200 4000 Min: 2400 / Avg: 3647.5 / Max: 3715 Min: 3694 / Avg: 3698.64 / Max: 4768
simdjson CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max AVX-512 On 2400 3639 3702 AVX-512 Off 3694 3702 4016 OpenBenchmarking.org Megahertz, More Is Better simdjson 2.0 CPU Peak Freq (Highest CPU Core Frequency) Monitor 1100 2200 3300 4400 5500
simdjson CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max AVX-512 On 2400 3601 3700 AVX-512 Off 3694 3701 3788 OpenBenchmarking.org Megahertz, More Is Better simdjson 2.0 CPU Peak Freq (Highest CPU Core Frequency) Monitor 1000 2000 3000 4000 5000
simdjson CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max AVX-512 On 2400 3625 3702 AVX-512 Off 3694 3704 3981 OpenBenchmarking.org Megahertz, More Is Better simdjson 2.0 CPU Peak Freq (Highest CPU Core Frequency) Monitor 1100 2200 3300 4400 5500
simdjson CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max AVX-512 On 2400 3643 3754 AVX-512 Off 3694 3703 3925 OpenBenchmarking.org Megahertz, More Is Better simdjson 2.0 CPU Peak Freq (Highest CPU Core Frequency) Monitor 1000 2000 3000 4000 5000
simdjson CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max AVX-512 On 2400 3640 3701 AVX-512 Off 3694 3701 3912 OpenBenchmarking.org Megahertz, More Is Better simdjson 2.0 CPU Peak Freq (Highest CPU Core Frequency) Monitor 1000 2000 3000 4000 5000
OpenFOAM CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max AVX-512 On 2400 3186 3701 AVX-512 Off 2917 3265 3714 OpenBenchmarking.org Megahertz, More Is Better OpenFOAM 10 CPU Peak Freq (Highest CPU Core Frequency) Monitor 1000 2000 3000 4000 5000
CP2K Molecular Dynamics CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max AVX-512 On 2400 3661 3700 AVX-512 Off 3569 3665 3808 OpenBenchmarking.org Megahertz, More Is Better CP2K Molecular Dynamics 8.2 CPU Peak Freq (Highest CPU Core Frequency) Monitor 1000 2000 3000 4000 5000
JPEG XL libjxl CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max AVX-512 On 2400 3657 3712 AVX-512 Off 3669 3701 3814 OpenBenchmarking.org Megahertz, More Is Better JPEG XL libjxl 0.7 CPU Peak Freq (Highest CPU Core Frequency) Monitor 1000 2000 3000 4000 5000
JPEG XL libjxl CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better JPEG XL libjxl 0.7 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 On AVX-512 Off 800 1600 2400 3200 4000 Min: 2400 / Avg: 3682.16 / Max: 4023 Min: 3414 / Avg: 3701.38 / Max: 4381
JPEG XL libjxl CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max AVX-512 On 2400 3643 3712 AVX-512 Off 2439 3696 3828 OpenBenchmarking.org Megahertz, More Is Better JPEG XL libjxl 0.7 CPU Peak Freq (Highest CPU Core Frequency) Monitor 1000 2000 3000 4000 5000
SMHasher Hash: FarmHash32 x86_64 AVX OpenBenchmarking.org MiB/sec, More Is Better SMHasher 2022-08-22 Hash: FarmHash32 x86_64 AVX AVX-512 On AVX-512 Off 9K 18K 27K 36K 45K SE +/- 0.46, N = 5 SE +/- 28.78, N = 5 39794.44 36483.70 -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi -mno-avx512f 1. (CXX) g++ options: -O3 -march=native -flto=auto -fno-fat-lto-objects
JPEG XL libjxl Input: JPEG - Quality: 90 OpenBenchmarking.org MP/s, More Is Better JPEG XL libjxl 0.7 Input: JPEG - Quality: 90 AVX-512 On AVX-512 Off 3 6 9 12 15 SE +/- 0.04, N = 3 SE +/- 0.03, N = 3 9.55 9.13 -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi -mno-avx512f 1. (CXX) g++ options: -O3 -march=native -fno-rtti -funwind-tables -O2 -fPIE -pie -lm -latomic
JPEG XL libjxl Input: JPEG - Quality: 100 OpenBenchmarking.org MP/s, More Is Better JPEG XL libjxl 0.7 Input: JPEG - Quality: 100 AVX-512 On AVX-512 Off 0.1665 0.333 0.4995 0.666 0.8325 SE +/- 0.01, N = 9 SE +/- 0.01, N = 9 0.74 0.72 -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi -mno-avx512f 1. (CXX) g++ options: -O3 -march=native -fno-rtti -funwind-tables -O2 -fPIE -pie -lm -latomic
JPEG XL libjxl Input: PNG - Quality: 90 OpenBenchmarking.org MP/s, More Is Better JPEG XL libjxl 0.7 Input: PNG - Quality: 90 AVX-512 On AVX-512 Off 3 6 9 12 15 SE +/- 0.02, N = 3 SE +/- 0.02, N = 3 9.95 9.52 -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi -mno-avx512f 1. (CXX) g++ options: -O3 -march=native -fno-rtti -funwind-tables -O2 -fPIE -pie -lm -latomic
JPEG XL libjxl Input: JPEG - Quality: 90 OpenBenchmarking.org MP/s Per Watt, More Is Better JPEG XL libjxl 0.7 Input: JPEG - Quality: 90 AVX-512 On AVX-512 Off 0.0097 0.0194 0.0291 0.0388 0.0485 0.043 0.039
JPEG XL libjxl Input: JPEG - Quality: 100 OpenBenchmarking.org MP/s Per Watt, More Is Better JPEG XL libjxl 0.7 Input: JPEG - Quality: 100 AVX-512 On AVX-512 Off 0.0007 0.0014 0.0021 0.0028 0.0035 0.003 0.003
JPEG XL libjxl Input: PNG - Quality: 90 OpenBenchmarking.org MP/s Per Watt, More Is Better JPEG XL libjxl 0.7 Input: PNG - Quality: 90 AVX-512 On AVX-512 Off 0.0101 0.0202 0.0303 0.0404 0.0505 0.045 0.041
LeelaChessZero Backend: BLAS OpenBenchmarking.org Nodes Per Second, More Is Better LeelaChessZero 0.28 Backend: BLAS AVX-512 On AVX-512 Off 2K 4K 6K 8K 10K SE +/- 103.04, N = 4 SE +/- 21.53, N = 3 9077 8423 -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi -mno-avx512f 1. (CXX) g++ options: -flto -O3 -march=native -pthread
LeelaChessZero Backend: Eigen OpenBenchmarking.org Nodes Per Second, More Is Better LeelaChessZero 0.28 Backend: Eigen AVX-512 On AVX-512 Off 2K 4K 6K 8K 10K SE +/- 45.37, N = 3 SE +/- 43.59, N = 3 9096 8162 -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi -mno-avx512f 1. (CXX) g++ options: -flto -O3 -march=native -pthread
LeelaChessZero Backend: BLAS OpenBenchmarking.org Nodes Per Second Per Watt, More Is Better LeelaChessZero 0.28 Backend: BLAS AVX-512 On AVX-512 Off 6 12 18 24 30 23.78 21.93
LeelaChessZero Backend: Eigen OpenBenchmarking.org Nodes Per Second Per Watt, More Is Better LeelaChessZero 0.28 Backend: Eigen AVX-512 On AVX-512 Off 6 12 18 24 30 24.89 21.29
GROMACS Implementation: MPI CPU - Input: water_GMX50_bare OpenBenchmarking.org Ns Per Day, More Is Better GROMACS 2022.1 Implementation: MPI CPU - Input: water_GMX50_bare AVX-512 On AVX-512 Off 5 10 15 20 25 SE +/- 0.24, N = 3 SE +/- 0.10, N = 3 18.76 18.47 -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi -mno-avx512f 1. (CXX) g++ options: -O3 -march=native
GROMACS Implementation: MPI CPU - Input: water_GMX50_bare OpenBenchmarking.org Ns Per Day Per Watt, More Is Better GROMACS 2022.1 Implementation: MPI CPU - Input: water_GMX50_bare AVX-512 On AVX-512 Off 0.0079 0.0158 0.0237 0.0316 0.0395 0.035 0.033
AI Benchmark Alpha Device AI Score OpenBenchmarking.org Score Per Watt, More Is Better AI Benchmark Alpha 0.1.2 Device AI Score AVX-512 On AVX-512 Off 5 10 15 20 25 20.522 9.349
AI Benchmark Alpha Device Inference Score OpenBenchmarking.org Score, More Is Better AI Benchmark Alpha 0.1.2 Device Inference Score AVX-512 On AVX-512 Off 800 1600 2400 3200 4000 3510 1821
AI Benchmark Alpha Device Training Score OpenBenchmarking.org Score, More Is Better AI Benchmark Alpha 0.1.2 Device Training Score AVX-512 On AVX-512 Off 600 1200 1800 2400 3000 2701 1066
Numpy Benchmark OpenBenchmarking.org Score Per Watt, More Is Better Numpy Benchmark AVX-512 On AVX-512 Off 0.6046 1.2092 1.8138 2.4184 3.023 2.687 2.474
AI Benchmark Alpha Device AI Score OpenBenchmarking.org Score, More Is Better AI Benchmark Alpha 0.1.2 Device AI Score AVX-512 On AVX-512 Off 1300 2600 3900 5200 6500 6211 2887
Numpy Benchmark OpenBenchmarking.org Score, More Is Better Numpy Benchmark AVX-512 On AVX-512 Off 120 240 360 480 600 SE +/- 2.18, N = 3 SE +/- 0.59, N = 3 575.66 548.83
Darmstadt Automotive Parallel Heterogeneous Suite Backend: OpenMP - Kernel: NDT Mapping OpenBenchmarking.org Test Cases Per Minute, More Is Better Darmstadt Automotive Parallel Heterogeneous Suite Backend: OpenMP - Kernel: NDT Mapping AVX-512 On AVX-512 Off 300 600 900 1200 1500 SE +/- 5.94, N = 3 SE +/- 8.66, N = 3 1371.18 1335.63 1. (CXX) g++ options: -O3 -std=c++11 -fopenmp
Darmstadt Automotive Parallel Heterogeneous Suite Backend: OpenMP - Kernel: Points2Image OpenBenchmarking.org Test Cases Per Minute, More Is Better Darmstadt Automotive Parallel Heterogeneous Suite Backend: OpenMP - Kernel: Points2Image AVX-512 On AVX-512 Off 3K 6K 9K 12K 15K SE +/- 126.17, N = 15 SE +/- 269.82, N = 15 13677.76 11521.38 1. (CXX) g++ options: -O3 -std=c++11 -fopenmp
Darmstadt Automotive Parallel Heterogeneous Suite Backend: OpenMP - Kernel: NDT Mapping OpenBenchmarking.org Test Cases Per Minute Per Watt, More Is Better Darmstadt Automotive Parallel Heterogeneous Suite Backend: OpenMP - Kernel: NDT Mapping AVX-512 On AVX-512 Off 2 4 6 8 10 6.416 5.455
Darmstadt Automotive Parallel Heterogeneous Suite Backend: OpenMP - Kernel: Points2Image OpenBenchmarking.org Test Cases Per Minute Per Watt, More Is Better Darmstadt Automotive Parallel Heterogeneous Suite Backend: OpenMP - Kernel: Points2Image AVX-512 On AVX-512 Off 12 24 36 48 60 52.82 42.19
AI Benchmark Alpha CPU Temperature Monitor Min Avg Max AVX-512 On 30.1 39.2 47.0 AVX-512 Off 36.4 40.6 49.3 OpenBenchmarking.org Celsius, Fewer Is Better AI Benchmark Alpha 0.1.2 CPU Temperature Monitor 14 28 42 56 70
Neural Magic DeepSparse CPU Temperature Monitor Min Avg Max AVX-512 On 32.4 43.7 51.5 AVX-512 Off 36.8 45.2 52.4 OpenBenchmarking.org Celsius, Fewer Is Better Neural Magic DeepSparse 1.1 CPU Temperature Monitor 15 30 45 60 75
Neural Magic DeepSparse CPU Temperature Monitor Min Avg Max AVX-512 On 38.6 49.4 57.0 AVX-512 Off 41.8 51.5 60.0 OpenBenchmarking.org Celsius, Fewer Is Better Neural Magic DeepSparse 1.1 CPU Temperature Monitor 16 32 48 64 80
Neural Magic DeepSparse CPU Temperature Monitor Min Avg Max AVX-512 On 39.0 48.0 52.4 AVX-512 Off 43.0 50.5 54.3 OpenBenchmarking.org Celsius, Fewer Is Better Neural Magic DeepSparse 1.1 CPU Temperature Monitor 15 30 45 60 75
Neural Magic DeepSparse CPU Temperature Monitor Min Avg Max AVX-512 On 39.9 51.2 55.5 AVX-512 Off 43.9 54.4 59.1 OpenBenchmarking.org Celsius, Fewer Is Better Neural Magic DeepSparse 1.1 CPU Temperature Monitor 16 32 48 64 80
Neural Magic DeepSparse CPU Temperature Monitor Min Avg Max AVX-512 On 38.1 51.9 57.3 AVX-512 Off 44.4 54.9 59.1 OpenBenchmarking.org Celsius, Fewer Is Better Neural Magic DeepSparse 1.1 CPU Temperature Monitor 16 32 48 64 80
Neural Magic DeepSparse CPU Temperature Monitor Min Avg Max AVX-512 On 38.9 47.8 53.8 AVX-512 Off 43.9 50.7 55.5 OpenBenchmarking.org Celsius, Fewer Is Better Neural Magic DeepSparse 1.1 CPU Temperature Monitor 15 30 45 60 75
Neural Magic DeepSparse CPU Temperature Monitor Min Avg Max AVX-512 On 38.1 48.5 54.8 AVX-512 Off 43.0 50.6 56.9 OpenBenchmarking.org Celsius, Fewer Is Better Neural Magic DeepSparse 1.1 CPU Temperature Monitor 16 32 48 64 80
Neural Magic DeepSparse CPU Temperature Monitor Min Avg Max AVX-512 On 39.3 51.9 58.3 AVX-512 Off 43.5 51.5 59.1 OpenBenchmarking.org Celsius, Fewer Is Better Neural Magic DeepSparse 1.1 CPU Temperature Monitor 16 32 48 64 80
Neural Magic DeepSparse CPU Temperature Monitor Min Avg Max AVX-512 On 39.8 50.1 54.6 AVX-512 Off 44.4 52.1 55.6 OpenBenchmarking.org Celsius, Fewer Is Better Neural Magic DeepSparse 1.1 CPU Temperature Monitor 15 30 45 60 75
Neural Magic DeepSparse CPU Temperature Monitor Min Avg Max AVX-512 On 40.1 52.9 57.9 AVX-512 Off 44.9 54.4 61.8 OpenBenchmarking.org Celsius, Fewer Is Better Neural Magic DeepSparse 1.1 CPU Temperature Monitor 20 40 60 80 100
Neural Magic DeepSparse CPU Temperature Monitor Min Avg Max AVX-512 On 40.6 48.7 54.3 AVX-512 Off 43.5 50.7 56.9 OpenBenchmarking.org Celsius, Fewer Is Better Neural Magic DeepSparse 1.1 CPU Temperature Monitor 16 32 48 64 80
TensorFlow CPU Temperature Monitor Min Avg Max AVX-512 On 36.8 41.7 48.6 AVX-512 Off 40.9 43.4 53.5 OpenBenchmarking.org Celsius, Fewer Is Better TensorFlow 2.10 CPU Temperature Monitor 15 30 45 60 75
TensorFlow CPU Temperature Monitor Min Avg Max AVX-512 On 35.0 40.5 48.9 AVX-512 Off 39.0 41.0 47.5 OpenBenchmarking.org Celsius, Fewer Is Better TensorFlow 2.10 CPU Temperature Monitor 14 28 42 56 70
TensorFlow CPU Temperature Monitor Min Avg Max AVX-512 On 34.6 41.7 48.9 AVX-512 Off 38.6 40.5 50.4 OpenBenchmarking.org Celsius, Fewer Is Better TensorFlow 2.10 CPU Temperature Monitor 14 28 42 56 70
LeelaChessZero CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better LeelaChessZero 0.28 CPU Temperature Monitor AVX-512 On AVX-512 Off 13 26 39 52 65 Min: 36.75 / Avg: 51.98 / Max: 63.13 Min: 47.5 / Avg: 57.42 / Max: 64.5
LeelaChessZero CPU Temperature Monitor Min Avg Max AVX-512 On 32.4 53.4 61.0 AVX-512 Off 37.3 39.9 56.9 OpenBenchmarking.org Celsius, Fewer Is Better LeelaChessZero 0.28 CPU Temperature Monitor 20 40 60 80 100
Embree CPU Temperature Monitor Min Avg Max AVX-512 On 35.5 40.4 47.0 AVX-512 Off 41.8 45.8 51.1 OpenBenchmarking.org Celsius, Fewer Is Better Embree 3.13 CPU Temperature Monitor 15 30 45 60 75
Embree CPU Temperature Monitor Min Avg Max AVX-512 On 34.6 38.4 46.6 AVX-512 Off 39.9 42.4 49.3 OpenBenchmarking.org Celsius, Fewer Is Better Embree 3.13 CPU Temperature Monitor 14 28 42 56 70
Embree CPU Temperature Monitor Min Avg Max AVX-512 On 33.3 40.5 48.0 AVX-512 Off 39.5 45.8 52.0 OpenBenchmarking.org Celsius, Fewer Is Better Embree 3.13 CPU Temperature Monitor 15 30 45 60 75
OpenVKL CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better OpenVKL 1.3.1 CPU Temperature Monitor AVX-512 On AVX-512 Off 12 24 36 48 60 Min: 41.25 / Avg: 49.91 / Max: 58.25 Min: 42.63 / Avg: 52.24 / Max: 60.88
OSPRay CPU Temperature Monitor Min Avg Max AVX-512 On 39.9 56.2 59.5 AVX-512 Off 45.3 59.8 65.0 OpenBenchmarking.org Celsius, Fewer Is Better OSPRay 2.10 CPU Temperature Monitor 20 40 60 80 100
OSPRay CPU Temperature Monitor Min Avg Max AVX-512 On 41.8 56.8 60.4 AVX-512 Off 48.4 60.3 63.5 OpenBenchmarking.org Celsius, Fewer Is Better OSPRay 2.10 CPU Temperature Monitor 20 40 60 80 100
OSPRay CPU Temperature Monitor Min Avg Max AVX-512 On 42.9 57.8 60.9 AVX-512 Off 47.5 61.3 64.9 OpenBenchmarking.org Celsius, Fewer Is Better OSPRay 2.10 CPU Temperature Monitor 20 40 60 80 100
OSPRay Studio CPU Temperature Monitor Min Avg Max AVX-512 On 36.4 56.3 62.3 AVX-512 Off 41.8 58.9 64.5 OpenBenchmarking.org Celsius, Fewer Is Better OSPRay Studio 0.11 CPU Temperature Monitor 20 40 60 80 100
OSPRay Studio CPU Temperature Monitor Min Avg Max AVX-512 On 43.5 58.4 65.0 AVX-512 Off 46.6 60.7 64.9 OpenBenchmarking.org Celsius, Fewer Is Better OSPRay Studio 0.11 CPU Temperature Monitor 20 40 60 80 100
OSPRay Studio CPU Temperature Monitor Min Avg Max AVX-512 On 44.0 59.0 64.0 AVX-512 Off 46.6 61.3 68.0 OpenBenchmarking.org Celsius, Fewer Is Better OSPRay Studio 0.11 CPU Temperature Monitor 20 40 60 80 100
OSPRay Studio CPU Temperature Monitor Min Avg Max AVX-512 On 44.1 57.9 62.3 AVX-512 Off 48.0 60.2 64.0 OpenBenchmarking.org Celsius, Fewer Is Better OSPRay Studio 0.11 CPU Temperature Monitor 20 40 60 80 100
OSPRay Studio CPU Temperature Monitor Min Avg Max AVX-512 On 43.8 59.7 64.9 AVX-512 Off 46.6 62.0 65.4 OpenBenchmarking.org Celsius, Fewer Is Better OSPRay Studio 0.11 CPU Temperature Monitor 20 40 60 80 100
OSPRay Studio CPU Temperature Monitor Min Avg Max AVX-512 On 44.9 60.3 65.4 AVX-512 Off 47.5 60.3 66.3 OpenBenchmarking.org Celsius, Fewer Is Better OSPRay Studio 0.11 CPU Temperature Monitor 20 40 60 80 100
OSPRay Studio CPU Temperature Monitor Min Avg Max AVX-512 On 44.9 57.7 61.8 AVX-512 Off 47.0 59.9 64.0 OpenBenchmarking.org Celsius, Fewer Is Better OSPRay Studio 0.11 CPU Temperature Monitor 20 40 60 80 100
OSPRay Studio CPU Temperature Monitor Min Avg Max AVX-512 On 43.8 58.4 62.6 AVX-512 Off 46.6 60.6 64.9 OpenBenchmarking.org Celsius, Fewer Is Better OSPRay Studio 0.11 CPU Temperature Monitor 20 40 60 80 100
OSPRay Studio CPU Temperature Monitor Min Avg Max AVX-512 On 43.8 58.9 63.1 AVX-512 Off 46.6 61.3 65.8 OpenBenchmarking.org Celsius, Fewer Is Better OSPRay Studio 0.11 CPU Temperature Monitor 20 40 60 80 100
OSPRay Studio CPU Temperature Monitor Min Avg Max AVX-512 On 44.4 57.0 61.4 AVX-512 Off 46.6 59.9 64.0 OpenBenchmarking.org Celsius, Fewer Is Better OSPRay Studio 0.11 CPU Temperature Monitor 20 40 60 80 100
OSPRay Studio CPU Temperature Monitor Min Avg Max AVX-512 On 43.5 59.7 64.0 AVX-512 Off 46.1 61.6 65.4 OpenBenchmarking.org Celsius, Fewer Is Better OSPRay Studio 0.11 CPU Temperature Monitor 20 40 60 80 100
OSPRay Studio CPU Temperature Monitor Min Avg Max AVX-512 On 45.3 59.8 64.9 AVX-512 Off 47.5 59.9 64.1 OpenBenchmarking.org Celsius, Fewer Is Better OSPRay Studio 0.11 CPU Temperature Monitor 20 40 60 80 100
OSPRay Studio CPU Temperature Monitor Min Avg Max AVX-512 On 44.1 58.4 62.3 AVX-512 Off 46.6 60.3 64.5 OpenBenchmarking.org Celsius, Fewer Is Better OSPRay Studio 0.11 CPU Temperature Monitor 20 40 60 80 100
OSPRay Studio CPU Temperature Monitor Min Avg Max AVX-512 On 43.8 58.7 65.4 AVX-512 Off 47.0 60.8 64.9 OpenBenchmarking.org Celsius, Fewer Is Better OSPRay Studio 0.11 CPU Temperature Monitor 20 40 60 80 100
OSPRay Studio CPU Temperature Monitor Min Avg Max AVX-512 On 43.8 59.3 64.0 AVX-512 Off 46.6 61.3 66.3 OpenBenchmarking.org Celsius, Fewer Is Better OSPRay Studio 0.11 CPU Temperature Monitor 20 40 60 80 100
OSPRay Studio CPU Temperature Monitor Min Avg Max AVX-512 On 44.9 58.2 62.8 AVX-512 Off 46.6 60.0 64.0 OpenBenchmarking.org Celsius, Fewer Is Better OSPRay Studio 0.11 CPU Temperature Monitor 20 40 60 80 100
OSPRay Studio CPU Temperature Monitor Min Avg Max AVX-512 On 44.6 59.9 64.9 AVX-512 Off 46.6 61.6 64.9 OpenBenchmarking.org Celsius, Fewer Is Better OSPRay Studio 0.11 CPU Temperature Monitor 20 40 60 80 100
OSPRay Studio CPU Temperature Monitor Min Avg Max AVX-512 On 44.6 57.9 62.6 AVX-512 Off 47.0 60.8 65.4 OpenBenchmarking.org Celsius, Fewer Is Better OSPRay Studio 0.11 CPU Temperature Monitor 20 40 60 80 100
oneDNN CPU Temperature Monitor Min Avg Max AVX-512 On 40.9 46.0 51.1 AVX-512 Off 43.5 47.7 53.8 OpenBenchmarking.org Celsius, Fewer Is Better oneDNN 2.7 CPU Temperature Monitor 15 30 45 60 75
oneDNN CPU Temperature Monitor Min Avg Max AVX-512 On 37.3 43.5 46.1 AVX-512 Off 39.5 43.8 47.0 OpenBenchmarking.org Celsius, Fewer Is Better oneDNN 2.7 CPU Temperature Monitor 14 28 42 56 70
oneDNN CPU Temperature Monitor Min Avg Max AVX-512 On 35.9 39.3 44.4 AVX-512 Off 39.0 41.4 43.9 OpenBenchmarking.org Celsius, Fewer Is Better oneDNN 2.7 CPU Temperature Monitor 12 24 36 48 60
oneDNN CPU Temperature Monitor Min Avg Max AVX-512 On 35.5 46.0 50.6 AVX-512 Off 38.6 45.9 50.1 OpenBenchmarking.org Celsius, Fewer Is Better oneDNN 2.7 CPU Temperature Monitor 14 28 42 56 70
oneDNN CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better oneDNN 2.7 CPU Temperature Monitor AVX-512 On AVX-512 Off 10 20 30 40 50 Min: 37.75 / Avg: 46.67 / Max: 51.5 Min: 42.63 / Avg: 46.63 / Max: 50.63
oneDNN CPU Temperature Monitor Min Avg Max AVX-512 On 37.8 45.8 48.9 AVX-512 Off 42.6 46.8 49.8 OpenBenchmarking.org Celsius, Fewer Is Better oneDNN 2.7 CPU Temperature Monitor 14 28 42 56 70
Mobile Neural Network CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better Mobile Neural Network 2.1 CPU Temperature Monitor AVX-512 On AVX-512 Off 11 22 33 44 55 Min: 35.88 / Avg: 48.36 / Max: 52 Min: 40.38 / Avg: 49.52 / Max: 52.88
Cpuminer-Opt CPU Temperature Monitor Min Avg Max AVX-512 On 34.1 52.2 58.3 AVX-512 Off 39.5 52.4 56.9 OpenBenchmarking.org Celsius, Fewer Is Better Cpuminer-Opt 3.20.3 CPU Temperature Monitor 16 32 48 64 80
Cpuminer-Opt CPU Temperature Monitor Min Avg Max AVX-512 On 43.0 58.6 62.8 AVX-512 Off 46.6 57.9 61.4 OpenBenchmarking.org Celsius, Fewer Is Better Cpuminer-Opt 3.20.3 CPU Temperature Monitor 20 40 60 80 100
Cpuminer-Opt CPU Temperature Monitor Min Avg Max AVX-512 On 42.0 57.1 60.4 AVX-512 Off 46.6 58.2 60.9 OpenBenchmarking.org Celsius, Fewer Is Better Cpuminer-Opt 3.20.3 CPU Temperature Monitor 20 40 60 80 100
Cpuminer-Opt CPU Temperature Monitor Min Avg Max AVX-512 On 41.3 56.3 60.9 AVX-512 Off 45.8 57.1 60.9 OpenBenchmarking.org Celsius, Fewer Is Better Cpuminer-Opt 3.20.3 CPU Temperature Monitor 20 40 60 80 100
Cpuminer-Opt CPU Temperature Monitor Min Avg Max AVX-512 On 41.3 57.9 62.8 AVX-512 Off 47.0 58.7 61.8 OpenBenchmarking.org Celsius, Fewer Is Better Cpuminer-Opt 3.20.3 CPU Temperature Monitor 20 40 60 80 100
Cpuminer-Opt CPU Temperature Monitor Min Avg Max AVX-512 On 42.4 59.0 63.5 AVX-512 Off 47.0 59.2 62.3 OpenBenchmarking.org Celsius, Fewer Is Better Cpuminer-Opt 3.20.3 CPU Temperature Monitor 20 40 60 80 100
NCNN CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better NCNN 20220729 CPU Temperature Monitor AVX-512 On AVX-512 Off 10 20 30 40 50 Min: 38.63 / Avg: 44.45 / Max: 48 Min: 43 / Avg: 46.1 / Max: 50.13
OpenVINO CPU Temperature Monitor Min Avg Max AVX-512 On 35.9 57.3 64.1 AVX-512 Off 41.3 56.2 61.9 OpenBenchmarking.org Celsius, Fewer Is Better OpenVINO 2022.2.dev CPU Temperature Monitor 20 40 60 80 100
OpenVINO CPU Temperature Monitor Min Avg Max AVX-512 On 43.0 58.1 61.9 AVX-512 Off 47.0 62.5 66.8 OpenBenchmarking.org Celsius, Fewer Is Better OpenVINO 2022.2.dev CPU Temperature Monitor 20 40 60 80 100
OpenVINO CPU Temperature Monitor Min Avg Max AVX-512 On 42.1 55.4 59.5 AVX-512 Off 49.3 59.9 62.6 OpenBenchmarking.org Celsius, Fewer Is Better OpenVINO 2022.2.dev CPU Temperature Monitor 20 40 60 80 100
OpenVINO CPU Temperature Monitor Min Avg Max AVX-512 On 41.8 52.2 55.1 AVX-512 Off 48.0 59.2 62.3 OpenBenchmarking.org Celsius, Fewer Is Better OpenVINO 2022.2.dev CPU Temperature Monitor 20 40 60 80 100
OpenVINO CPU Temperature Monitor Min Avg Max AVX-512 On 39.5 57.4 65.9 AVX-512 Off 47.0 58.2 67.6 OpenBenchmarking.org Celsius, Fewer Is Better OpenVINO 2022.2.dev CPU Temperature Monitor 20 40 60 80 100
OpenVINO CPU Temperature Monitor Min Avg Max AVX-512 On 42.1 58.0 67.3 AVX-512 Off 46.1 58.7 66.8 OpenBenchmarking.org Celsius, Fewer Is Better OpenVINO 2022.2.dev CPU Temperature Monitor 20 40 60 80 100
OpenVINO CPU Temperature Monitor Min Avg Max AVX-512 On 42.6 59.4 62.8 AVX-512 Off 45.8 63.0 67.1 OpenBenchmarking.org Celsius, Fewer Is Better OpenVINO 2022.2.dev CPU Temperature Monitor 20 40 60 80 100
OpenVINO CPU Temperature Monitor Min Avg Max AVX-512 On 43.0 60.9 64.5 AVX-512 Off 49.8 60.0 61.8 OpenBenchmarking.org Celsius, Fewer Is Better OpenVINO 2022.2.dev CPU Temperature Monitor 20 40 60 80 100
OpenVINO CPU Temperature Monitor Min Avg Max AVX-512 On 44.4 57.9 60.1 AVX-512 Off 48.0 61.1 64.0 OpenBenchmarking.org Celsius, Fewer Is Better OpenVINO 2022.2.dev CPU Temperature Monitor 20 40 60 80 100
OpenVINO CPU Temperature Monitor Min Avg Max AVX-512 On 42.1 59.0 62.4 AVX-512 Off 48.9 59.9 62.3 OpenBenchmarking.org Celsius, Fewer Is Better OpenVINO 2022.2.dev CPU Temperature Monitor 20 40 60 80 100
OpenVINO CPU Temperature Monitor Min Avg Max AVX-512 On 43.8 56.8 59.6 AVX-512 Off 46.6 58.0 61.4 OpenBenchmarking.org Celsius, Fewer Is Better OpenVINO 2022.2.dev CPU Temperature Monitor 20 40 60 80 100
OpenVINO CPU Temperature Monitor Min Avg Max AVX-512 On 42.6 58.4 61.9 AVX-512 Off 46.1 56.3 61.4 OpenBenchmarking.org Celsius, Fewer Is Better OpenVINO 2022.2.dev CPU Temperature Monitor 20 40 60 80 100
GROMACS CPU Temperature Monitor Min Avg Max AVX-512 On 43.3 56.1 62.6 AVX-512 Off 43.0 54.8 64.5 OpenBenchmarking.org Celsius, Fewer Is Better GROMACS 2022.1 CPU Temperature Monitor 20 40 60 80 100
ONNX Runtime CPU Temperature Monitor Min Avg Max AVX-512 On 37.8 51.1 57.5 AVX-512 Off 43.0 53.4 59.3 OpenBenchmarking.org Celsius, Fewer Is Better ONNX Runtime 1.11 CPU Temperature Monitor 16 32 48 64 80
ONNX Runtime CPU Temperature Monitor Min Avg Max AVX-512 On 36.4 39.9 42.6 AVX-512 Off 39.5 43.2 53.0 OpenBenchmarking.org Celsius, Fewer Is Better ONNX Runtime 1.11 CPU Temperature Monitor 15 30 45 60 75
ONNX Runtime CPU Temperature Monitor Min Avg Max AVX-512 On 34.6 46.5 48.9 AVX-512 Off 39.0 48.4 52.0 OpenBenchmarking.org Celsius, Fewer Is Better ONNX Runtime 1.11 CPU Temperature Monitor 15 30 45 60 75
ONNX Runtime CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better ONNX Runtime 1.11 CPU Temperature Monitor AVX-512 On AVX-512 Off 11 22 33 44 55 Min: 32.75 / Avg: 48.03 / Max: 50.63 Min: 38.13 / Avg: 50.46 / Max: 57.25
Numpy Benchmark CPU Temperature Monitor Min Avg Max AVX-512 On 32.8 36.3 40.4 AVX-512 Off 36.4 37.9 43.5 OpenBenchmarking.org Celsius, Fewer Is Better Numpy Benchmark CPU Temperature Monitor 12 24 36 48 60
miniBUDE CPU Temperature Monitor Min Avg Max AVX-512 On 31.5 38.5 47.4 AVX-512 Off 38.6 45.5 52.4 OpenBenchmarking.org Celsius, Fewer Is Better miniBUDE 20210901 CPU Temperature Monitor 15 30 45 60 75
miniBUDE CPU Temperature Monitor Min Avg Max AVX-512 On 32.8 47.7 56.0 AVX-512 Off 40.4 53.0 60.1 OpenBenchmarking.org Celsius, Fewer Is Better miniBUDE 20210901 CPU Temperature Monitor 16 32 48 64 80
SVT-AV1 CPU Temperature Monitor Min Avg Max AVX-512 On 32.4 36.8 49.3 AVX-512 Off 39.0 42.4 49.3 OpenBenchmarking.org Celsius, Fewer Is Better SVT-AV1 1.4 CPU Temperature Monitor 14 28 42 56 70
SVT-AV1 CPU Temperature Monitor Min Avg Max AVX-512 On 30.6 34.6 43.0 AVX-512 Off 37.8 40.5 48.1 OpenBenchmarking.org Celsius, Fewer Is Better SVT-AV1 1.4 CPU Temperature Monitor 14 28 42 56 70
Numenta Anomaly Benchmark CPU Temperature Monitor Min Avg Max AVX-512 On 32.4 40.4 50.1 AVX-512 Off 38.6 43.2 49.9 OpenBenchmarking.org Celsius, Fewer Is Better Numenta Anomaly Benchmark 1.1 CPU Temperature Monitor 14 28 42 56 70
Numenta Anomaly Benchmark CPU Temperature Monitor Min Avg Max AVX-512 On 32.4 39.2 53.3 AVX-512 Off 37.8 42.8 60.4 OpenBenchmarking.org Celsius, Fewer Is Better Numenta Anomaly Benchmark 1.1 CPU Temperature Monitor 20 40 60 80 100
Numenta Anomaly Benchmark CPU Temperature Monitor Min Avg Max AVX-512 On 31.5 38.8 47.0 AVX-512 Off 37.8 41.5 50.4 OpenBenchmarking.org Celsius, Fewer Is Better Numenta Anomaly Benchmark 1.1 CPU Temperature Monitor 14 28 42 56 70
Intel Open Image Denoise CPU Temperature Monitor Min Avg Max AVX-512 On 32.4 38.1 44.9 AVX-512 Off 36.8 41.6 47.0 OpenBenchmarking.org Celsius, Fewer Is Better Intel Open Image Denoise 1.4.0 CPU Temperature Monitor 14 28 42 56 70
Intel Open Image Denoise CPU Temperature Monitor Min Avg Max AVX-512 On 32.8 38.2 44.1 AVX-512 Off 39.5 43.3 48.4 OpenBenchmarking.org Celsius, Fewer Is Better Intel Open Image Denoise 1.4.0 CPU Temperature Monitor 14 28 42 56 70
Intel Open Image Denoise CPU Temperature Monitor Min Avg Max AVX-512 On 32.8 39.8 46.4 AVX-512 Off 39.9 44.7 49.8 OpenBenchmarking.org Celsius, Fewer Is Better Intel Open Image Denoise 1.4.0 CPU Temperature Monitor 14 28 42 56 70
Darmstadt Automotive Parallel Heterogeneous Suite CPU Temperature Monitor Min Avg Max AVX-512 On 32.4 35.4 36.4 AVX-512 Off 37.8 39.4 49.5 OpenBenchmarking.org Celsius, Fewer Is Better Darmstadt Automotive Parallel Heterogeneous Suite CPU Temperature Monitor 14 28 42 56 70
Darmstadt Automotive Parallel Heterogeneous Suite CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better Darmstadt Automotive Parallel Heterogeneous Suite CPU Temperature Monitor AVX-512 On AVX-512 Off 10 20 30 40 50 Min: 31.25 / Avg: 38.03 / Max: 47.5 Min: 36.75 / Avg: 39.2 / Max: 49.75
simdjson CPU Temperature Monitor Min Avg Max AVX-512 On 36.4 40.5 47.5 AVX-512 Off 39.0 51.0 60.1 OpenBenchmarking.org Celsius, Fewer Is Better simdjson 2.0 CPU Temperature Monitor 16 32 48 64 80
simdjson CPU Temperature Monitor Min Avg Max AVX-512 On 33.3 36.7 37.8 AVX-512 Off 37.8 47.0 49.8 OpenBenchmarking.org Celsius, Fewer Is Better simdjson 2.0 CPU Temperature Monitor 14 28 42 56 70
simdjson CPU Temperature Monitor Min Avg Max AVX-512 On 33.3 36.4 37.3 AVX-512 Off 37.3 46.3 48.6 OpenBenchmarking.org Celsius, Fewer Is Better simdjson 2.0 CPU Temperature Monitor 14 28 42 56 70
simdjson CPU Temperature Monitor Min Avg Max AVX-512 On 32.4 36.2 37.3 AVX-512 Off 37.3 46.9 48.1 OpenBenchmarking.org Celsius, Fewer Is Better simdjson 2.0 CPU Temperature Monitor 14 28 42 56 70
simdjson CPU Temperature Monitor Min Avg Max AVX-512 On 32.4 36.1 37.3 AVX-512 Off 36.8 46.2 47.5 OpenBenchmarking.org Celsius, Fewer Is Better simdjson 2.0 CPU Temperature Monitor 14 28 42 56 70
OpenFOAM CPU Temperature Monitor Min Avg Max AVX-512 On 41.3 62.6 68.5 AVX-512 Off 47.0 64.9 70.3 OpenBenchmarking.org Celsius, Fewer Is Better OpenFOAM 10 CPU Temperature Monitor 20 40 60 80 100
CP2K Molecular Dynamics CPU Temperature Monitor Min Avg Max AVX-512 On 42.1 44.5 53.5 AVX-512 Off 42.1 44.4 56.9 OpenBenchmarking.org Celsius, Fewer Is Better CP2K Molecular Dynamics 8.2 CPU Temperature Monitor 16 32 48 64 80
JPEG XL libjxl CPU Temperature Monitor Min Avg Max AVX-512 On 35.0 39.7 46.6 AVX-512 Off 36.8 39.4 48.9 OpenBenchmarking.org Celsius, Fewer Is Better JPEG XL libjxl 0.7 CPU Temperature Monitor 14 28 42 56 70
JPEG XL libjxl CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better JPEG XL libjxl 0.7 CPU Temperature Monitor AVX-512 On AVX-512 Off 10 20 30 40 50 Min: 32.75 / Avg: 36.48 / Max: 49.75 Min: 35.5 / Avg: 36.56 / Max: 46.63
JPEG XL libjxl CPU Temperature Monitor Min Avg Max AVX-512 On 32.4 37.0 49.3 AVX-512 Off 35.9 36.7 44.9 OpenBenchmarking.org Celsius, Fewer Is Better JPEG XL libjxl 0.7 CPU Temperature Monitor 14 28 42 56 70
SMHasher Hash: FarmHash32 x86_64 AVX OpenBenchmarking.org cycles/hash, Fewer Is Better SMHasher 2022-08-22 Hash: FarmHash32 x86_64 AVX AVX-512 On AVX-512 Off 6 12 18 24 30 SE +/- 0.00, N = 5 SE +/- 0.00, N = 5 26.39 26.41 -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi -mno-avx512f 1. (CXX) g++ options: -O3 -march=native -flto=auto -fno-fat-lto-objects
OSPRay Studio Camera: 1 - Resolution: 1080p - Samples Per Pixel: 1 - Renderer: Path Tracer OpenBenchmarking.org ms, Fewer Is Better OSPRay Studio 0.11 Camera: 1 - Resolution: 1080p - Samples Per Pixel: 1 - Renderer: Path Tracer AVX-512 On AVX-512 Off 40 80 120 160 200 SE +/- 0.33, N = 3 SE +/- 0.33, N = 3 148 181 -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi -mno-avx512f 1. (CXX) g++ options: -O3 -march=native -ldl
OSPRay Studio Camera: 1 - Resolution: 1080p - Samples Per Pixel: 16 - Renderer: Path Tracer OpenBenchmarking.org ms, Fewer Is Better OSPRay Studio 0.11 Camera: 1 - Resolution: 1080p - Samples Per Pixel: 16 - Renderer: Path Tracer AVX-512 On AVX-512 Off 600 1200 1800 2400 3000 SE +/- 2.33, N = 3 SE +/- 1.20, N = 3 2353 2871 -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi -mno-avx512f 1. (CXX) g++ options: -O3 -march=native -ldl
OSPRay Studio Camera: 1 - Resolution: 1080p - Samples Per Pixel: 32 - Renderer: Path Tracer OpenBenchmarking.org ms, Fewer Is Better OSPRay Studio 0.11 Camera: 1 - Resolution: 1080p - Samples Per Pixel: 32 - Renderer: Path Tracer AVX-512 On AVX-512 Off 1200 2400 3600 4800 6000 SE +/- 3.71, N = 3 SE +/- 6.56, N = 3 4698 5749 -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi -mno-avx512f 1. (CXX) g++ options: -O3 -march=native -ldl
OSPRay Studio Camera: 1 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path Tracer OpenBenchmarking.org ms, Fewer Is Better OSPRay Studio 0.11 Camera: 1 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path Tracer AVX-512 On AVX-512 Off 150 300 450 600 750 SE +/- 1.00, N = 3 SE +/- 2.08, N = 3 581 710 -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi -mno-avx512f 1. (CXX) g++ options: -O3 -march=native -ldl
OSPRay Studio Camera: 1 - Resolution: 4K - Samples Per Pixel: 16 - Renderer: Path Tracer OpenBenchmarking.org ms, Fewer Is Better OSPRay Studio 0.11 Camera: 1 - Resolution: 4K - Samples Per Pixel: 16 - Renderer: Path Tracer AVX-512 On AVX-512 Off 2K 4K 6K 8K 10K SE +/- 10.17, N = 3 SE +/- 24.46, N = 3 9271 11321 -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi -mno-avx512f 1. (CXX) g++ options: -O3 -march=native -ldl
OSPRay Studio Camera: 1 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path Tracer OpenBenchmarking.org ms, Fewer Is Better OSPRay Studio 0.11 Camera: 1 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path Tracer AVX-512 On AVX-512 Off 5K 10K 15K 20K 25K SE +/- 13.75, N = 3 SE +/- 27.41, N = 3 18546 22647 -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi -mno-avx512f 1. (CXX) g++ options: -O3 -march=native -ldl
OSPRay Studio Camera: 2 - Resolution: 1080p - Samples Per Pixel: 1 - Renderer: Path Tracer OpenBenchmarking.org ms, Fewer Is Better OSPRay Studio 0.11 Camera: 2 - Resolution: 1080p - Samples Per Pixel: 1 - Renderer: Path Tracer AVX-512 On AVX-512 Off 40 80 120 160 200 SE +/- 0.00, N = 3 SE +/- 0.33, N = 3 154 184 -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi -mno-avx512f 1. (CXX) g++ options: -O3 -march=native -ldl
OSPRay Studio Camera: 2 - Resolution: 1080p - Samples Per Pixel: 16 - Renderer: Path Tracer OpenBenchmarking.org ms, Fewer Is Better OSPRay Studio 0.11 Camera: 2 - Resolution: 1080p - Samples Per Pixel: 16 - Renderer: Path Tracer AVX-512 On AVX-512 Off 600 1200 1800 2400 3000 SE +/- 9.17, N = 3 SE +/- 0.88, N = 3 2384 2924 -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi -mno-avx512f 1. (CXX) g++ options: -O3 -march=native -ldl
OSPRay Studio Camera: 2 - Resolution: 1080p - Samples Per Pixel: 32 - Renderer: Path Tracer OpenBenchmarking.org ms, Fewer Is Better OSPRay Studio 0.11 Camera: 2 - Resolution: 1080p - Samples Per Pixel: 32 - Renderer: Path Tracer AVX-512 On AVX-512 Off 1300 2600 3900 5200 6500 SE +/- 6.24, N = 3 SE +/- 8.25, N = 3 4764 5861 -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi -mno-avx512f 1. (CXX) g++ options: -O3 -march=native -ldl
OSPRay Studio Camera: 2 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path Tracer OpenBenchmarking.org ms, Fewer Is Better OSPRay Studio 0.11 Camera: 2 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path Tracer AVX-512 On AVX-512 Off 160 320 480 640 800 SE +/- 1.00, N = 3 SE +/- 0.67, N = 3 604 722 -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi -mno-avx512f 1. (CXX) g++ options: -O3 -march=native -ldl
OSPRay Studio Camera: 2 - Resolution: 4K - Samples Per Pixel: 16 - Renderer: Path Tracer OpenBenchmarking.org ms, Fewer Is Better OSPRay Studio 0.11 Camera: 2 - Resolution: 4K - Samples Per Pixel: 16 - Renderer: Path Tracer AVX-512 On AVX-512 Off 2K 4K 6K 8K 10K SE +/- 2.19, N = 3 SE +/- 15.51, N = 3 9385 11524 -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi -mno-avx512f 1. (CXX) g++ options: -O3 -march=native -ldl
OSPRay Studio Camera: 2 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path Tracer OpenBenchmarking.org ms, Fewer Is Better OSPRay Studio 0.11 Camera: 2 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path Tracer AVX-512 On AVX-512 Off 5K 10K 15K 20K 25K SE +/- 20.34, N = 3 SE +/- 30.02, N = 3 18808 22985 -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi -mno-avx512f 1. (CXX) g++ options: -O3 -march=native -ldl
OSPRay Studio Camera: 3 - Resolution: 1080p - Samples Per Pixel: 1 - Renderer: Path Tracer OpenBenchmarking.org ms, Fewer Is Better OSPRay Studio 0.11 Camera: 3 - Resolution: 1080p - Samples Per Pixel: 1 - Renderer: Path Tracer AVX-512 On AVX-512 Off 50 100 150 200 250 SE +/- 0.00, N = 3 SE +/- 0.58, N = 3 177 214 -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi -mno-avx512f 1. (CXX) g++ options: -O3 -march=native -ldl
OSPRay Studio Camera: 3 - Resolution: 1080p - Samples Per Pixel: 16 - Renderer: Path Tracer OpenBenchmarking.org ms, Fewer Is Better OSPRay Studio 0.11 Camera: 3 - Resolution: 1080p - Samples Per Pixel: 16 - Renderer: Path Tracer AVX-512 On AVX-512 Off 700 1400 2100 2800 3500 SE +/- 3.06, N = 3 SE +/- 7.00, N = 3 2804 3413 -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi -mno-avx512f 1. (CXX) g++ options: -O3 -march=native -ldl
OSPRay Studio Camera: 3 - Resolution: 1080p - Samples Per Pixel: 32 - Renderer: Path Tracer OpenBenchmarking.org ms, Fewer Is Better OSPRay Studio 0.11 Camera: 3 - Resolution: 1080p - Samples Per Pixel: 32 - Renderer: Path Tracer AVX-512 On AVX-512 Off 1500 3000 4500 6000 7500 SE +/- 9.54, N = 3 SE +/- 5.51, N = 3 5608 6820 -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi -mno-avx512f 1. (CXX) g++ options: -O3 -march=native -ldl
OSPRay Studio Camera: 3 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path Tracer OpenBenchmarking.org ms, Fewer Is Better OSPRay Studio 0.11 Camera: 3 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path Tracer AVX-512 On AVX-512 Off 200 400 600 800 1000 SE +/- 1.53, N = 3 SE +/- 1.15, N = 3 694 841 -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi -mno-avx512f 1. (CXX) g++ options: -O3 -march=native -ldl
OSPRay Studio Camera: 3 - Resolution: 4K - Samples Per Pixel: 16 - Renderer: Path Tracer OpenBenchmarking.org ms, Fewer Is Better OSPRay Studio 0.11 Camera: 3 - Resolution: 4K - Samples Per Pixel: 16 - Renderer: Path Tracer AVX-512 On AVX-512 Off 3K 6K 9K 12K 15K SE +/- 27.14, N = 3 SE +/- 22.81, N = 3 11070 13398 -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi -mno-avx512f 1. (CXX) g++ options: -O3 -march=native -ldl
OSPRay Studio Camera: 3 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path Tracer OpenBenchmarking.org ms, Fewer Is Better OSPRay Studio 0.11 Camera: 3 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path Tracer AVX-512 On AVX-512 Off 6K 12K 18K 24K 30K SE +/- 21.63, N = 3 SE +/- 15.62, N = 3 22184 26785 -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi -mno-avx512f 1. (CXX) g++ options: -O3 -march=native -ldl
oneDNN Harness: Convolution Batch Shapes Auto - Data Type: f32 - Engine: CPU OpenBenchmarking.org ms, Fewer Is Better oneDNN 2.7 Harness: Convolution Batch Shapes Auto - Data Type: f32 - Engine: CPU AVX-512 On AVX-512 Off 0.121 0.242 0.363 0.484 0.605 SE +/- 0.004067, N = 7 SE +/- 0.004200, N = 15 0.516167 0.537682 -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi - MIN: 0.42 -mno-avx512f - MIN: 0.42 1. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread
oneDNN Harness: Deconvolution Batch shapes_1d - Data Type: f32 - Engine: CPU OpenBenchmarking.org ms, Fewer Is Better oneDNN 2.7 Harness: Deconvolution Batch shapes_1d - Data Type: f32 - Engine: CPU AVX-512 On AVX-512 Off 5 10 15 20 25 SE +/- 0.16, N = 3 SE +/- 0.06, N = 3 22.59 22.84 -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi - MIN: 19.6 -mno-avx512f - MIN: 20.22 1. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread
oneDNN Harness: Deconvolution Batch shapes_3d - Data Type: f32 - Engine: CPU OpenBenchmarking.org ms, Fewer Is Better oneDNN 2.7 Harness: Deconvolution Batch shapes_3d - Data Type: f32 - Engine: CPU AVX-512 On AVX-512 Off 0.3968 0.7936 1.1904 1.5872 1.984 SE +/- 0.001906, N = 9 SE +/- 0.004550, N = 9 0.989591 1.763360 -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi - MIN: 0.9 -mno-avx512f - MIN: 1.55 1. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread
oneDNN Harness: Recurrent Neural Network Training - Data Type: f32 - Engine: CPU OpenBenchmarking.org ms, Fewer Is Better oneDNN 2.7 Harness: Recurrent Neural Network Training - Data Type: f32 - Engine: CPU AVX-512 On AVX-512 Off 1100 2200 3300 4400 5500 SE +/- 20.13, N = 5 SE +/- 60.12, N = 4 1962.06 4953.98 -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi - MIN: 1899.34 -mno-avx512f - MIN: 4690.85 1. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread
oneDNN Harness: Recurrent Neural Network Training - Data Type: bf16bf16bf16 - Engine: CPU OpenBenchmarking.org ms, Fewer Is Better oneDNN 2.7 Harness: Recurrent Neural Network Training - Data Type: bf16bf16bf16 - Engine: CPU AVX-512 On AVX-512 Off 1100 2200 3300 4400 5500 SE +/- 19.67, N = 15 SE +/- 41.71, N = 3 1955.39 4989.13 -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi - MIN: 1769.7 -mno-avx512f - MIN: 4767.22 1. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread
oneDNN Harness: Recurrent Neural Network Inference - Data Type: bf16bf16bf16 - Engine: CPU OpenBenchmarking.org ms, Fewer Is Better oneDNN 2.7 Harness: Recurrent Neural Network Inference - Data Type: bf16bf16bf16 - Engine: CPU AVX-512 On AVX-512 Off 500 1000 1500 2000 2500 SE +/- 24.41, N = 4 SE +/- 22.32, N = 3 2361.27 1715.76 -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi - MIN: 2265.7 -mno-avx512f - MIN: 1607.13 1. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread
Mobile Neural Network Model: resnet-v2-50 OpenBenchmarking.org ms, Fewer Is Better Mobile Neural Network 2.1 Model: resnet-v2-50 AVX-512 On AVX-512 Off 6 12 18 24 30 SE +/- 0.08, N = 9 SE +/- 0.08, N = 8 15.44 24.10 -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi - MIN: 14.79 / MAX: 54.05 -mno-avx512f - MIN: 23.44 / MAX: 71.32 1. (CXX) g++ options: -O3 -march=native -std=c++11 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl
Mobile Neural Network Model: SqueezeNetV1.0 OpenBenchmarking.org ms, Fewer Is Better Mobile Neural Network 2.1 Model: SqueezeNetV1.0 AVX-512 On AVX-512 Off 3 6 9 12 15 SE +/- 0.147, N = 9 SE +/- 0.091, N = 8 8.579 9.146 -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi - MIN: 6.67 / MAX: 21.5 -mno-avx512f - MIN: 7.72 / MAX: 19.03 1. (CXX) g++ options: -O3 -march=native -std=c++11 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl
Mobile Neural Network Model: inception-v3 OpenBenchmarking.org ms, Fewer Is Better Mobile Neural Network 2.1 Model: inception-v3 AVX-512 On AVX-512 Off 10 20 30 40 50 SE +/- 0.23, N = 9 SE +/- 0.13, N = 8 45.81 30.44 -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi - MIN: 44.13 / MAX: 87.28 -mno-avx512f - MIN: 28.75 / MAX: 109.22 1. (CXX) g++ options: -O3 -march=native -std=c++11 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl
NCNN Target: CPU - Model: mnasnet OpenBenchmarking.org ms, Fewer Is Better NCNN 20220729 Target: CPU - Model: mnasnet AVX-512 On AVX-512 Off 10 20 30 40 50 SE +/- 0.26, N = 8 SE +/- 0.49, N = 3 42.30 44.19 -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi - MIN: 39.64 / MAX: 571.78 -mno-avx512f - MIN: 41.56 / MAX: 148.98 1. (CXX) g++ options: -O3 -march=native -rdynamic -lgomp -lpthread
NCNN Target: CPU - Model: efficientnet-b0 OpenBenchmarking.org ms, Fewer Is Better NCNN 20220729 Target: CPU - Model: efficientnet-b0 AVX-512 On AVX-512 Off 14 28 42 56 70 SE +/- 0.35, N = 8 SE +/- 0.31, N = 3 57.71 62.86 -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi - MIN: 54.52 / MAX: 522.74 -mno-avx512f - MIN: 59.46 / MAX: 154.82 1. (CXX) g++ options: -O3 -march=native -rdynamic -lgomp -lpthread
NCNN Target: CPU - Model: blazeface OpenBenchmarking.org ms, Fewer Is Better NCNN 20220729 Target: CPU - Model: blazeface AVX-512 On AVX-512 Off 7 14 21 28 35 SE +/- 0.18, N = 8 SE +/- 0.54, N = 3 25.88 29.00 -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi - MIN: 24.45 / MAX: 112.37 -mno-avx512f - MIN: 26.03 / MAX: 144.12 1. (CXX) g++ options: -O3 -march=native -rdynamic -lgomp -lpthread
NCNN Target: CPU - Model: googlenet OpenBenchmarking.org ms, Fewer Is Better NCNN 20220729 Target: CPU - Model: googlenet AVX-512 On AVX-512 Off 20 40 60 80 100 SE +/- 0.76, N = 8 SE +/- 1.35, N = 3 72.80 76.13 -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi - MIN: 67.13 / MAX: 388.52 -mno-avx512f - MIN: 70.13 / MAX: 155.61 1. (CXX) g++ options: -O3 -march=native -rdynamic -lgomp -lpthread
NCNN Target: CPU - Model: resnet50 OpenBenchmarking.org ms, Fewer Is Better NCNN 20220729 Target: CPU - Model: resnet50 AVX-512 On AVX-512 Off 15 30 45 60 75 SE +/- 0.50, N = 8 SE +/- 0.89, N = 3 66.34 67.48 -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi - MIN: 62.92 / MAX: 194.74 -mno-avx512f - MIN: 63.4 / MAX: 170.14 1. (CXX) g++ options: -O3 -march=native -rdynamic -lgomp -lpthread
NCNN Target: CPU - Model: regnety_400m OpenBenchmarking.org ms, Fewer Is Better NCNN 20220729 Target: CPU - Model: regnety_400m AVX-512 On AVX-512 Off 60 120 180 240 300 SE +/- 2.25, N = 8 SE +/- 3.75, N = 3 247.32 270.12 -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi - MIN: 232.61 / MAX: 506.55 -mno-avx512f - MIN: 245.47 / MAX: 498.8 1. (CXX) g++ options: -O3 -march=native -rdynamic -lgomp -lpthread
NCNN Target: CPU - Model: vision_transformer OpenBenchmarking.org ms, Fewer Is Better NCNN 20220729 Target: CPU - Model: vision_transformer AVX-512 On AVX-512 Off 20 40 60 80 100 SE +/- 1.59, N = 8 SE +/- 5.82, N = 3 74.93 86.16 -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi - MIN: 65.04 / MAX: 2154.62 -mno-avx512f - MIN: 73.72 / MAX: 1760.74 1. (CXX) g++ options: -O3 -march=native -rdynamic -lgomp -lpthread
NCNN Target: CPU - Model: FastestDet OpenBenchmarking.org ms, Fewer Is Better NCNN 20220729 Target: CPU - Model: FastestDet AVX-512 On AVX-512 Off 14 28 42 56 70 SE +/- 0.49, N = 8 SE +/- 2.90, N = 3 58.95 60.73 -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi - MIN: 55.11 / MAX: 282.72 -mno-avx512f - MIN: 52.89 / MAX: 236.85 1. (CXX) g++ options: -O3 -march=native -rdynamic -lgomp -lpthread
OpenVINO Model: Face Detection FP16 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2022.2.dev Model: Face Detection FP16 - Device: CPU AVX-512 On AVX-512 Off 200 400 600 800 1000 SE +/- 0.24, N = 3 SE +/- 0.51, N = 3 469.29 1088.50 -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi - MIN: 410.93 / MAX: 547.33 -mno-avx512f - MIN: 937.5 / MAX: 1231.55 1. (CXX) g++ options: -fPIC -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -flto -shared
OpenVINO Model: Face Detection FP16-INT8 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2022.2.dev Model: Face Detection FP16-INT8 - Device: CPU AVX-512 On AVX-512 Off 110 220 330 440 550 SE +/- 0.01, N = 3 SE +/- 0.07, N = 3 246.98 503.50 -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi - MIN: 204.5 / MAX: 299.54 -mno-avx512f - MIN: 402.47 / MAX: 569.65 1. (CXX) g++ options: -fPIC -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -flto -shared
OpenVINO Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2022.2.dev Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU AVX-512 On AVX-512 Off 0.2723 0.5446 0.8169 1.0892 1.3615 SE +/- 0.00, N = 3 SE +/- 0.01, N = 4 0.55 1.21 -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi - MIN: 0.5 / MAX: 29.57 -mno-avx512f - MIN: 0.98 / MAX: 47.37 1. (CXX) g++ options: -fPIC -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -flto -shared
OpenVINO Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2022.2.dev Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU AVX-512 On AVX-512 Off 0.1283 0.2566 0.3849 0.5132 0.6415 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 0.36 0.57 -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi - MIN: 0.34 / MAX: 33.7 -mno-avx512f - MIN: 0.52 / MAX: 47.93 1. (CXX) g++ options: -fPIC -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -flto -shared
OpenVINO Model: Person Detection FP16 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2022.2.dev Model: Person Detection FP16 - Device: CPU AVX-512 On AVX-512 Off 400 800 1200 1600 2000 SE +/- 4.83, N = 3 SE +/- 15.65, N = 3 1100.25 1864.93 -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi - MIN: 783.9 / MAX: 1824.92 -mno-avx512f - MIN: 1371.29 / MAX: 2532.74 1. (CXX) g++ options: -fPIC -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -flto -shared
OpenVINO Model: Person Detection FP32 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2022.2.dev Model: Person Detection FP32 - Device: CPU AVX-512 On AVX-512 Off 400 800 1200 1600 2000 SE +/- 4.44, N = 3 SE +/- 3.32, N = 3 1101.00 1845.95 -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi - MIN: 840.82 / MAX: 1792.51 -mno-avx512f - MIN: 1386.31 / MAX: 2798 1. (CXX) g++ options: -fPIC -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -flto -shared
OpenVINO Model: Weld Porosity Detection FP16-INT8 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2022.2.dev Model: Weld Porosity Detection FP16-INT8 - Device: CPU AVX-512 On AVX-512 Off 5 10 15 20 25 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 9.63 19.69 -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi - MIN: 8.29 / MAX: 57.53 -mno-avx512f - MIN: 16.4 / MAX: 74.85 1. (CXX) g++ options: -fPIC -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -flto -shared
OpenVINO Model: Weld Porosity Detection FP16 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2022.2.dev Model: Weld Porosity Detection FP16 - Device: CPU AVX-512 On AVX-512 Off 3 6 9 12 15 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 4.79 11.66 -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi - MIN: 3.98 / MAX: 28.79 -mno-avx512f - MIN: 9.72 / MAX: 43.7 1. (CXX) g++ options: -fPIC -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -flto -shared
OpenVINO Model: Vehicle Detection FP16-INT8 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2022.2.dev Model: Vehicle Detection FP16-INT8 - Device: CPU AVX-512 On AVX-512 Off 2 4 6 8 10 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 4.28 7.90 -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi - MIN: 3.5 / MAX: 42.62 -mno-avx512f - MIN: 6.37 / MAX: 41.53 1. (CXX) g++ options: -fPIC -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -flto -shared
OpenVINO Model: Vehicle Detection FP16 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2022.2.dev Model: Vehicle Detection FP16 - Device: CPU AVX-512 On AVX-512 Off 3 6 9 12 15 SE +/- 0.00, N = 3 SE +/- 0.03, N = 3 6.43 12.67 -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi - MIN: 5.22 / MAX: 61.26 -mno-avx512f - MIN: 9.58 / MAX: 77.91 1. (CXX) g++ options: -fPIC -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -flto -shared
OpenVINO Model: Person Vehicle Bike Detection FP16 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2022.2.dev Model: Person Vehicle Bike Detection FP16 - Device: CPU AVX-512 On AVX-512 Off 3 6 9 12 15 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 5.29 9.33 -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi - MIN: 4.36 / MAX: 45.25 -mno-avx512f - MIN: 7.39 / MAX: 57.57 1. (CXX) g++ options: -fPIC -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -flto -shared
OpenVINO Model: Machine Translation EN To DE FP16 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2022.2.dev Model: Machine Translation EN To DE FP16 - Device: CPU AVX-512 On AVX-512 Off 20 40 60 80 100 SE +/- 0.21, N = 3 SE +/- 0.74, N = 3 50.11 107.62 -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi - MIN: 38.98 / MAX: 166.69 -mno-avx512f - MIN: 83.48 / MAX: 216.07 1. (CXX) g++ options: -fPIC -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -flto -shared
Neural Magic DeepSparse Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Synchronous Single-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.1 Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Synchronous Single-Stream AVX-512 On AVX-512 Off 3 6 9 12 15 SE +/- 0.06, N = 3 SE +/- 0.05, N = 3 11.76 13.59
Neural Magic DeepSparse Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.1 Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-Stream AVX-512 On AVX-512 Off 40 80 120 160 200 SE +/- 0.47, N = 3 SE +/- 0.10, N = 3 155.35 187.85
Neural Magic DeepSparse Model: NLP Text Classification, DistilBERT mnli - Scenario: Synchronous Single-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.1 Model: NLP Text Classification, DistilBERT mnli - Scenario: Synchronous Single-Stream AVX-512 On AVX-512 Off 1.2663 2.5326 3.7989 5.0652 6.3315 SE +/- 0.0031, N = 3 SE +/- 0.0091, N = 3 5.3413 5.6282
Neural Magic DeepSparse Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.1 Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream AVX-512 On AVX-512 Off 20 40 60 80 100 SE +/- 0.14, N = 3 SE +/- 0.05, N = 3 80.08 95.33
Neural Magic DeepSparse Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.1 Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream AVX-512 On AVX-512 Off 15 30 45 60 75 SE +/- 0.11, N = 3 SE +/- 0.02, N = 3 49.03 67.91
Neural Magic DeepSparse Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Synchronous Single-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.1 Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Synchronous Single-Stream AVX-512 On AVX-512 Off 8 16 24 32 40 SE +/- 0.03, N = 3 SE +/- 0.04, N = 3 28.96 32.66
Neural Magic DeepSparse Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Synchronous Single-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.1 Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Synchronous Single-Stream AVX-512 On AVX-512 Off 4 8 12 16 20 SE +/- 0.0172, N = 3 SE +/- 0.0334, N = 3 9.9408 14.0655
Neural Magic DeepSparse Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.1 Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-Stream AVX-512 On AVX-512 Off 40 80 120 160 200 SE +/- 0.11, N = 3 SE +/- 0.23, N = 3 125.79 195.17
Neural Magic DeepSparse Model: CV Detection,YOLOv5s COCO - Scenario: Synchronous Single-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.1 Model: CV Detection,YOLOv5s COCO - Scenario: Synchronous Single-Stream AVX-512 On AVX-512 Off 2 4 6 8 10 SE +/- 0.0061, N = 3 SE +/- 0.0068, N = 3 5.2712 6.3313
Neural Magic DeepSparse Model: CV Detection,YOLOv5s COCO - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.1 Model: CV Detection,YOLOv5s COCO - Scenario: Asynchronous Multi-Stream AVX-512 On AVX-512 Off 30 60 90 120 150 SE +/- 0.12, N = 3 SE +/- 0.25, N = 3 111.73 138.59
Neural Magic DeepSparse Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Synchronous Single-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.1 Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Synchronous Single-Stream AVX-512 On AVX-512 Off 8 16 24 32 40 SE +/- 0.07, N = 3 SE +/- 0.11, N = 3 29.19 32.75
Numenta Anomaly Benchmark Detector: Bayesian Changepoint OpenBenchmarking.org Seconds, Fewer Is Better Numenta Anomaly Benchmark 1.1 Detector: Bayesian Changepoint AVX-512 On AVX-512 Off 4 8 12 16 20 SE +/- 0.21, N = 4 SE +/- 0.19, N = 5 16.68 17.39
Numenta Anomaly Benchmark Detector: Windowed Gaussian OpenBenchmarking.org Seconds, Fewer Is Better Numenta Anomaly Benchmark 1.1 Detector: Windowed Gaussian AVX-512 On AVX-512 Off 1.0985 2.197 3.2955 4.394 5.4925 SE +/- 0.032, N = 15 SE +/- 0.044, N = 7 4.727 4.882
Numenta Anomaly Benchmark Detector: Relative Entropy OpenBenchmarking.org Seconds, Fewer Is Better Numenta Anomaly Benchmark 1.1 Detector: Relative Entropy AVX-512 On AVX-512 Off 3 6 9 12 15 SE +/- 0.089, N = 5 SE +/- 0.082, N = 5 9.898 10.035
OpenFOAM Input: drivaerFastback, Medium Mesh Size - Mesh Time OpenBenchmarking.org Seconds, Fewer Is Better OpenFOAM 10 Input: drivaerFastback, Medium Mesh Size - Mesh Time AVX-512 On AVX-512 Off 30 60 90 120 150 135.77 144.35 1. (CXX) g++ options: -std=c++14 -m64 -O3 -ftemplate-depth-100 -fPIC -fuse-ld=bfd -Xlinker --add-needed --no-as-needed -lfiniteVolume -lmeshTools -lparallel -llagrangian -lregionModels -lgenericPatchFields -lOpenFOAM -ldl -lm
OpenFOAM Input: drivaerFastback, Medium Mesh Size - Execution Time OpenBenchmarking.org Seconds, Fewer Is Better OpenFOAM 10 Input: drivaerFastback, Medium Mesh Size - Execution Time AVX-512 On AVX-512 Off 30 60 90 120 150 113.64 135.22 1. (CXX) g++ options: -std=c++14 -m64 -O3 -ftemplate-depth-100 -fPIC -fuse-ld=bfd -Xlinker --add-needed --no-as-needed -lfiniteVolume -lmeshTools -lparallel -llagrangian -lregionModels -lgenericPatchFields -lOpenFOAM -ldl -lm
CP2K Molecular Dynamics Input: Fayalite-FIST OpenBenchmarking.org Seconds, Fewer Is Better CP2K Molecular Dynamics 8.2 Input: Fayalite-FIST AVX-512 On AVX-512 Off 300 600 900 1200 1500 1122.73 1198.41
AI Benchmark Alpha CPU Power Consumption Monitor Min Avg Max AVX-512 On 52.9 302.7 502.0 AVX-512 Off 130.7 308.8 452.7 OpenBenchmarking.org Watts, Fewer Is Better AI Benchmark Alpha 0.1.2 CPU Power Consumption Monitor 130 260 390 520 650
Neural Magic DeepSparse CPU Power Consumption Monitor Min Avg Max AVX-512 On 50.9 306.4 407.9 AVX-512 Off 111.5 321.8 409.9 OpenBenchmarking.org Watts, Fewer Is Better Neural Magic DeepSparse 1.1 CPU Power Consumption Monitor 110 220 330 440 550
Neural Magic DeepSparse CPU Power Consumption Monitor Min Avg Max AVX-512 On 53 479 679 AVX-512 Off 216 508 705 OpenBenchmarking.org Watts, Fewer Is Better Neural Magic DeepSparse 1.1 CPU Power Consumption Monitor 200 400 600 800 1000
Neural Magic DeepSparse CPU Power Consumption Monitor Min Avg Max AVX-512 On 37.8 324.6 394.5 AVX-512 Off 197.4 352.2 401.6 OpenBenchmarking.org Watts, Fewer Is Better Neural Magic DeepSparse 1.1 CPU Power Consumption Monitor 110 220 330 440 550
Neural Magic DeepSparse CPU Power Consumption Monitor Min Avg Max AVX-512 On 49 517 625 AVX-512 Off 217 552 659 OpenBenchmarking.org Watts, Fewer Is Better Neural Magic DeepSparse 1.1 CPU Power Consumption Monitor 200 400 600 800 1000
Neural Magic DeepSparse CPU Power Consumption Monitor Min Avg Max AVX-512 On 56 531 630 AVX-512 Off 216 558 637 OpenBenchmarking.org Watts, Fewer Is Better Neural Magic DeepSparse 1.1 CPU Power Consumption Monitor 200 400 600 800 1000
Neural Magic DeepSparse CPU Power Consumption Monitor Min Avg Max AVX-512 On 49.8 321.8 419.4 AVX-512 Off 110.4 350.8 422.9 OpenBenchmarking.org Watts, Fewer Is Better Neural Magic DeepSparse 1.1 CPU Power Consumption Monitor 110 220 330 440 550
Neural Magic DeepSparse CPU Power Consumption Monitor Min Avg Max AVX-512 On 57.7 334.2 406.1 AVX-512 Off 124.0 352.9 412.6 OpenBenchmarking.org Watts, Fewer Is Better Neural Magic DeepSparse 1.1 CPU Power Consumption Monitor 110 220 330 440 550
Neural Magic DeepSparse CPU Power Consumption Monitor Min Avg Max AVX-512 On 54 537 700 AVX-512 Off 114 503 700 OpenBenchmarking.org Watts, Fewer Is Better Neural Magic DeepSparse 1.1 CPU Power Consumption Monitor 200 400 600 800 1000
Neural Magic DeepSparse CPU Power Consumption Monitor Min Avg Max AVX-512 On 52.3 341.3 408.7 AVX-512 Off 202.0 364.8 414.2 OpenBenchmarking.org Watts, Fewer Is Better Neural Magic DeepSparse 1.1 CPU Power Consumption Monitor 110 220 330 440 550
Neural Magic DeepSparse CPU Power Consumption Monitor Min Avg Max AVX-512 On 28 553 664 AVX-512 Off 217 552 656 OpenBenchmarking.org Watts, Fewer Is Better Neural Magic DeepSparse 1.1 CPU Power Consumption Monitor 200 400 600 800 1000
Neural Magic DeepSparse CPU Power Consumption Monitor Min Avg Max AVX-512 On 30.2 328.4 418.5 AVX-512 Off 210.0 351.1 423.9 OpenBenchmarking.org Watts, Fewer Is Better Neural Magic DeepSparse 1.1 CPU Power Consumption Monitor 110 220 330 440 550
TensorFlow CPU Power Consumption Monitor Min Avg Max AVX-512 On 53.5 307.1 397.4 AVX-512 Off 165.7 338.8 379.7 OpenBenchmarking.org Watts, Fewer Is Better TensorFlow 2.10 CPU Power Consumption Monitor 110 220 330 440 550
TensorFlow CPU Power Consumption Monitor Min Avg Max AVX-512 On 48.9 299.7 409.2 AVX-512 Off 169.7 318.9 350.5 OpenBenchmarking.org Watts, Fewer Is Better TensorFlow 2.10 CPU Power Consumption Monitor 110 220 330 440 550
TensorFlow CPU Power Consumption Monitor Min Avg Max AVX-512 On 53.1 308.0 379.5 AVX-512 Off 156.1 298.9 329.3 OpenBenchmarking.org Watts, Fewer Is Better TensorFlow 2.10 CPU Power Consumption Monitor 100 200 300 400 500
LeelaChessZero CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better LeelaChessZero 0.28 CPU Power Consumption Monitor AVX-512 On AVX-512 Off 90 180 270 360 450 Min: 55.6 / Avg: 381.67 / Max: 513.97 Min: 153.23 / Avg: 384.04 / Max: 522.79
LeelaChessZero CPU Power Consumption Monitor Min Avg Max AVX-512 On 56.3 365.4 500.1 AVX-512 Off 112.5 383.3 519.6 OpenBenchmarking.org Watts, Fewer Is Better LeelaChessZero 0.28 CPU Power Consumption Monitor 130 260 390 520 650
Embree CPU Power Consumption Monitor Min Avg Max AVX-512 On 50 301 635 AVX-512 Off 132 410 637 OpenBenchmarking.org Watts, Fewer Is Better Embree 3.13 CPU Power Consumption Monitor 200 400 600 800 1000
Embree CPU Power Consumption Monitor Min Avg Max AVX-512 On 56 254 632 AVX-512 Off 217 319 632 OpenBenchmarking.org Watts, Fewer Is Better Embree 3.13 CPU Power Consumption Monitor 200 400 600 800 1000
Embree CPU Power Consumption Monitor Min Avg Max AVX-512 On 54 346 646 AVX-512 Off 174 439 660 OpenBenchmarking.org Watts, Fewer Is Better Embree 3.13 CPU Power Consumption Monitor 200 400 600 800 1000
OpenVKL CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better OpenVKL 1.3.1 CPU Power Consumption Monitor AVX-512 On AVX-512 Off 120 240 360 480 600 Min: 55.92 / Avg: 466.92 / Max: 669.54 Min: 113.56 / Avg: 490.53 / Max: 691.71
OSPRay CPU Power Consumption Monitor Min Avg Max AVX-512 On 56 580 633 AVX-512 Off 222 618 662 OpenBenchmarking.org Watts, Fewer Is Better OSPRay 2.10 CPU Power Consumption Monitor 200 400 600 800 1000
OSPRay CPU Power Consumption Monitor Min Avg Max AVX-512 On 56 582 632 AVX-512 Off 177 620 662 OpenBenchmarking.org Watts, Fewer Is Better OSPRay 2.10 CPU Power Consumption Monitor 200 400 600 800 1000
OSPRay CPU Power Consumption Monitor Min Avg Max AVX-512 On 58 593 646 AVX-512 Off 221 628 677 OpenBenchmarking.org Watts, Fewer Is Better OSPRay 2.10 CPU Power Consumption Monitor 200 400 600 800 1000
OSPRay Studio CPU Power Consumption Monitor Min Avg Max AVX-512 On 55 593 680 AVX-512 Off 218 614 692 OpenBenchmarking.org Watts, Fewer Is Better OSPRay Studio 0.11 CPU Power Consumption Monitor 200 400 600 800 1000
OSPRay Studio CPU Power Consumption Monitor Min Avg Max AVX-512 On 56 599 685 AVX-512 Off 223 622 699 OpenBenchmarking.org Watts, Fewer Is Better OSPRay Studio 0.11 CPU Power Consumption Monitor 200 400 600 800 1000
OSPRay Studio CPU Power Consumption Monitor Min Avg Max AVX-512 On 58 606 687 AVX-512 Off 222 629 702 OpenBenchmarking.org Watts, Fewer Is Better OSPRay Studio 0.11 CPU Power Consumption Monitor 200 400 600 800 1000
OSPRay Studio CPU Power Consumption Monitor Min Avg Max AVX-512 On 51 590 687 AVX-512 Off 225 610 697 OpenBenchmarking.org Watts, Fewer Is Better OSPRay Studio 0.11 CPU Power Consumption Monitor 200 400 600 800 1000
OSPRay Studio CPU Power Consumption Monitor Min Avg Max AVX-512 On 56 618 684 AVX-512 Off 223 638 703 OpenBenchmarking.org Watts, Fewer Is Better OSPRay Studio 0.11 CPU Power Consumption Monitor 200 400 600 800 1000
OSPRay Studio CPU Power Consumption Monitor Min Avg Max AVX-512 On 58 623 687 AVX-512 Off 128 610 701 OpenBenchmarking.org Watts, Fewer Is Better OSPRay Studio 0.11 CPU Power Consumption Monitor 200 400 600 800 1000
OSPRay Studio CPU Power Consumption Monitor Min Avg Max AVX-512 On 59 591 670 AVX-512 Off 203 613 697 OpenBenchmarking.org Watts, Fewer Is Better OSPRay Studio 0.11 CPU Power Consumption Monitor 200 400 600 800 1000
OSPRay Studio CPU Power Consumption Monitor Min Avg Max AVX-512 On 29 599 684 AVX-512 Off 116 621 701 OpenBenchmarking.org Watts, Fewer Is Better OSPRay Studio 0.11 CPU Power Consumption Monitor 200 400 600 800 1000
OSPRay Studio CPU Power Consumption Monitor Min Avg Max AVX-512 On 54 604 686 AVX-512 Off 224 627 702 OpenBenchmarking.org Watts, Fewer Is Better OSPRay Studio 0.11 CPU Power Consumption Monitor 200 400 600 800 1000
OSPRay Studio CPU Power Consumption Monitor Min Avg Max AVX-512 On 55 578 672 AVX-512 Off 223 609 696 OpenBenchmarking.org Watts, Fewer Is Better OSPRay Studio 0.11 CPU Power Consumption Monitor 200 400 600 800 1000
OSPRay Studio CPU Power Consumption Monitor Min Avg Max AVX-512 On 57 616 688 AVX-512 Off 114 635 701 OpenBenchmarking.org Watts, Fewer Is Better OSPRay Studio 0.11 CPU Power Consumption Monitor 200 400 600 800 1000
OSPRay Studio CPU Power Consumption Monitor Min Avg Max AVX-512 On 60 616 683 AVX-512 Off 224 609 700 OpenBenchmarking.org Watts, Fewer Is Better OSPRay Studio 0.11 CPU Power Consumption Monitor 200 400 600 800 1000
OSPRay Studio CPU Power Consumption Monitor Min Avg Max AVX-512 On 38 597 682 AVX-512 Off 223 621 696 OpenBenchmarking.org Watts, Fewer Is Better OSPRay Studio 0.11 CPU Power Consumption Monitor 200 400 600 800 1000
OSPRay Studio CPU Power Consumption Monitor Min Avg Max AVX-512 On 31 602 684 AVX-512 Off 223 621 699 OpenBenchmarking.org Watts, Fewer Is Better OSPRay Studio 0.11 CPU Power Consumption Monitor 200 400 600 800 1000
OSPRay Studio CPU Power Consumption Monitor Min Avg Max AVX-512 On 58 611 684 AVX-512 Off 222 630 700 OpenBenchmarking.org Watts, Fewer Is Better OSPRay Studio 0.11 CPU Power Consumption Monitor 200 400 600 800 1000
OSPRay Studio CPU Power Consumption Monitor Min Avg Max AVX-512 On 39 591 684 AVX-512 Off 221 612 698 OpenBenchmarking.org Watts, Fewer Is Better OSPRay Studio 0.11 CPU Power Consumption Monitor 200 400 600 800 1000
OSPRay Studio CPU Power Consumption Monitor Min Avg Max AVX-512 On 60 618 690 AVX-512 Off 114 637 703 OpenBenchmarking.org Watts, Fewer Is Better OSPRay Studio 0.11 CPU Power Consumption Monitor 200 400 600 800 1000
OSPRay Studio CPU Power Consumption Monitor Min Avg Max AVX-512 On 57 590 687 AVX-512 Off 224 620 702 OpenBenchmarking.org Watts, Fewer Is Better OSPRay Studio 0.11 CPU Power Consumption Monitor 200 400 600 800 1000
oneDNN CPU Power Consumption Monitor Min Avg Max AVX-512 On 54.1 327.3 548.8 AVX-512 Off 216.4 379.5 540.9 OpenBenchmarking.org Watts, Fewer Is Better oneDNN 2.7 CPU Power Consumption Monitor 140 280 420 560 700
oneDNN CPU Power Consumption Monitor Min Avg Max AVX-512 On 52.1 376.1 492.5 AVX-512 Off 215.5 392.5 509.7 OpenBenchmarking.org Watts, Fewer Is Better oneDNN 2.7 CPU Power Consumption Monitor 130 260 390 520 650
oneDNN CPU Power Consumption Monitor Min Avg Max AVX-512 On 54.0 248.8 512.8 AVX-512 Off 215.2 323.9 475.6 OpenBenchmarking.org Watts, Fewer Is Better oneDNN 2.7 CPU Power Consumption Monitor 130 260 390 520 650
oneDNN CPU Power Consumption Monitor Min Avg Max AVX-512 On 55.5 418.6 541.1 AVX-512 Off 215.2 412.5 499.6 OpenBenchmarking.org Watts, Fewer Is Better oneDNN 2.7 CPU Power Consumption Monitor 140 280 420 560 700
oneDNN CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better oneDNN 2.7 CPU Power Consumption Monitor AVX-512 On AVX-512 Off 100 200 300 400 500 Min: 52.5 / Avg: 419.24 / Max: 543.13 Min: 195.71 / Avg: 412.52 / Max: 498.86
oneDNN CPU Power Consumption Monitor Min Avg Max AVX-512 On 55.2 413.8 581.1 AVX-512 Off 204.0 413.9 482.1 OpenBenchmarking.org Watts, Fewer Is Better oneDNN 2.7 CPU Power Consumption Monitor 160 320 480 640 800
Mobile Neural Network CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better Mobile Neural Network 2.1 CPU Power Consumption Monitor AVX-512 On AVX-512 Off 60 120 180 240 300 Min: 53.81 / Avg: 327.57 / Max: 340 Min: 165 / Avg: 334.93 / Max: 346.27
Cpuminer-Opt CPU Power Consumption Monitor Min Avg Max AVX-512 On 55 594 682 AVX-512 Off 215 558 618 OpenBenchmarking.org Watts, Fewer Is Better Cpuminer-Opt 3.20.3 CPU Power Consumption Monitor 200 400 600 800 1000
Cpuminer-Opt CPU Power Consumption Monitor Min Avg Max AVX-512 On 57 618 724 AVX-512 Off 134 587 654 OpenBenchmarking.org Watts, Fewer Is Better Cpuminer-Opt 3.20.3 CPU Power Consumption Monitor 200 400 600 800 1000
Cpuminer-Opt CPU Power Consumption Monitor Min Avg Max AVX-512 On 39 568 650 AVX-512 Off 221 580 645 OpenBenchmarking.org Watts, Fewer Is Better Cpuminer-Opt 3.20.3 CPU Power Consumption Monitor 200 400 600 800 1000
Cpuminer-Opt CPU Power Consumption Monitor Min Avg Max AVX-512 On 57 596 694 AVX-512 Off 220 587 657 OpenBenchmarking.org Watts, Fewer Is Better Cpuminer-Opt 3.20.3 CPU Power Consumption Monitor 200 400 600 800 1000
Cpuminer-Opt CPU Power Consumption Monitor Min Avg Max AVX-512 On 58 622 720 AVX-512 Off 221 599 665 OpenBenchmarking.org Watts, Fewer Is Better Cpuminer-Opt 3.20.3 CPU Power Consumption Monitor 200 400 600 800 1000
Cpuminer-Opt CPU Power Consumption Monitor Min Avg Max AVX-512 On 59 643 743 AVX-512 Off 222 613 684 OpenBenchmarking.org Watts, Fewer Is Better Cpuminer-Opt 3.20.3 CPU Power Consumption Monitor 200 400 600 800 1000
NCNN CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better NCNN 20220729 CPU Power Consumption Monitor AVX-512 On AVX-512 Off 80 160 240 320 400 Min: 54.96 / Avg: 396.44 / Max: 451.5 Min: 199.1 / Avg: 400.13 / Max: 450.41
OpenVINO CPU Power Consumption Monitor Min Avg Max AVX-512 On 54 639 725 AVX-512 Off 218 585 645 OpenBenchmarking.org Watts, Fewer Is Better OpenVINO 2022.2.dev CPU Power Consumption Monitor 200 400 600 800 1000
OpenVINO CPU Power Consumption Monitor Min Avg Max AVX-512 On 58 612 687 AVX-512 Off 216 662 733 OpenBenchmarking.org Watts, Fewer Is Better OpenVINO 2022.2.dev CPU Power Consumption Monitor 200 400 600 800 1000
OpenVINO CPU Power Consumption Monitor Min Avg Max AVX-512 On 48 566 622 AVX-512 Off 219 592 636 OpenBenchmarking.org Watts, Fewer Is Better OpenVINO 2022.2.dev CPU Power Consumption Monitor 200 400 600 800 1000
OpenVINO CPU Power Consumption Monitor Min Avg Max AVX-512 On 29 514 564 AVX-512 Off 217 592 630 OpenBenchmarking.org Watts, Fewer Is Better OpenVINO 2022.2.dev CPU Power Consumption Monitor 200 400 600 800 1000
OpenVINO CPU Power Consumption Monitor Min Avg Max AVX-512 On 56 605 699 AVX-512 Off 114 579 650 OpenBenchmarking.org Watts, Fewer Is Better OpenVINO 2022.2.dev CPU Power Consumption Monitor 200 400 600 800 1000
OpenVINO CPU Power Consumption Monitor Min Avg Max AVX-512 On 38 607 700 AVX-512 Off 215 593 665 OpenBenchmarking.org Watts, Fewer Is Better OpenVINO 2022.2.dev CPU Power Consumption Monitor 200 400 600 800 1000
OpenVINO CPU Power Consumption Monitor Min Avg Max AVX-512 On 57 639 696 AVX-512 Off 216 684 729 OpenBenchmarking.org Watts, Fewer Is Better OpenVINO 2022.2.dev CPU Power Consumption Monitor 200 400 600 800 1000
OpenVINO CPU Power Consumption Monitor Min Avg Max AVX-512 On 58 660 712 AVX-512 Off 221 598 639 OpenBenchmarking.org Watts, Fewer Is Better OpenVINO 2022.2.dev CPU Power Consumption Monitor 200 400 600 800 1000
OpenVINO CPU Power Consumption Monitor Min Avg Max AVX-512 On 33 598 646 AVX-512 Off 214 634 676 OpenBenchmarking.org Watts, Fewer Is Better OpenVINO 2022.2.dev CPU Power Consumption Monitor 200 400 600 800 1000
OpenVINO CPU Power Consumption Monitor Min Avg Max AVX-512 On 59 633 690 AVX-512 Off 217 613 655 OpenBenchmarking.org Watts, Fewer Is Better OpenVINO 2022.2.dev CPU Power Consumption Monitor 200 400 600 800 1000
OpenVINO CPU Power Consumption Monitor Min Avg Max AVX-512 On 51 588 657 AVX-512 Off 218 588 640 OpenBenchmarking.org Watts, Fewer Is Better OpenVINO 2022.2.dev CPU Power Consumption Monitor 200 400 600 800 1000
OpenVINO CPU Power Consumption Monitor Min Avg Max AVX-512 On 57 636 701 AVX-512 Off 213 595 648 OpenBenchmarking.org Watts, Fewer Is Better OpenVINO 2022.2.dev CPU Power Consumption Monitor 200 400 600 800 1000
GROMACS CPU Power Consumption Monitor Min Avg Max AVX-512 On 58 535 698 AVX-512 Off 216 553 700 OpenBenchmarking.org Watts, Fewer Is Better GROMACS 2022.1 CPU Power Consumption Monitor 200 400 600 800 1000
ONNX Runtime CPU Power Consumption Monitor Min Avg Max AVX-512 On 51.7 494.2 532.0 AVX-512 Off 211.3 503.0 528.2 OpenBenchmarking.org Watts, Fewer Is Better ONNX Runtime 1.11 CPU Power Consumption Monitor 140 280 420 560 700
ONNX Runtime CPU Power Consumption Monitor Min Avg Max AVX-512 On 53.2 259.3 268.4 AVX-512 Off 132.5 266.8 278.0 OpenBenchmarking.org Watts, Fewer Is Better ONNX Runtime 1.11 CPU Power Consumption Monitor 70 140 210 280 350
ONNX Runtime CPU Power Consumption Monitor Min Avg Max AVX-512 On 50.3 370.5 385.5 AVX-512 Off 193.6 379.6 388.9 OpenBenchmarking.org Watts, Fewer Is Better ONNX Runtime 1.11 CPU Power Consumption Monitor 100 200 300 400 500
ONNX Runtime CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better ONNX Runtime 1.11 CPU Power Consumption Monitor AVX-512 On AVX-512 Off 80 160 240 320 400 Min: 51.25 / Avg: 441.77 / Max: 464.82 Min: 107.66 / Avg: 447.6 / Max: 464.67
Numpy Benchmark CPU Power Consumption Monitor Min Avg Max AVX-512 On 54.1 214.2 222.9 AVX-512 Off 110.9 221.9 228.1 OpenBenchmarking.org Watts, Fewer Is Better Numpy Benchmark CPU Power Consumption Monitor 60 120 180 240 300
miniBUDE CPU Power Consumption Monitor Min Avg Max AVX-512 On 52 281 624 AVX-512 Off 212 414 630 OpenBenchmarking.org Watts, Fewer Is Better miniBUDE 20210901 CPU Power Consumption Monitor 200 400 600 800 1000
miniBUDE CPU Power Consumption Monitor Min Avg Max AVX-512 On 54 499 647 AVX-512 Off 211 564 661 OpenBenchmarking.org Watts, Fewer Is Better miniBUDE 20210901 CPU Power Consumption Monitor 200 400 600 800 1000
SVT-AV1 CPU Power Consumption Monitor Min Avg Max AVX-512 On 52.7 162.9 323.1 AVX-512 Off 108.8 243.3 325.0 OpenBenchmarking.org Watts, Fewer Is Better SVT-AV1 1.4 CPU Power Consumption Monitor 80 160 240 320 400
SVT-AV1 CPU Power Consumption Monitor Min Avg Max AVX-512 On 52.7 175.4 338.1 AVX-512 Off 127.1 241.8 338.9 OpenBenchmarking.org Watts, Fewer Is Better SVT-AV1 1.4 CPU Power Consumption Monitor 80 160 240 320 400
Numenta Anomaly Benchmark CPU Power Consumption Monitor Min Avg Max AVX-512 On 55.1 216.0 378.8 AVX-512 Off 137.1 251.1 391.0 OpenBenchmarking.org Watts, Fewer Is Better Numenta Anomaly Benchmark 1.1 CPU Power Consumption Monitor 100 200 300 400 500
Numenta Anomaly Benchmark CPU Power Consumption Monitor Min Avg Max AVX-512 On 53.3 184.7 388.1 AVX-512 Off 212.5 259.2 394.2 OpenBenchmarking.org Watts, Fewer Is Better Numenta Anomaly Benchmark 1.1 CPU Power Consumption Monitor 110 220 330 440 550
Numenta Anomaly Benchmark CPU Power Consumption Monitor Min Avg Max AVX-512 On 53.6 202.8 367.2 AVX-512 Off 213.2 250.8 339.2 OpenBenchmarking.org Watts, Fewer Is Better Numenta Anomaly Benchmark 1.1 CPU Power Consumption Monitor 100 200 300 400 500
Intel Open Image Denoise CPU Power Consumption Monitor Min Avg Max AVX-512 On 48.8 287.6 572.9 AVX-512 Off 206.5 366.7 574.9 OpenBenchmarking.org Watts, Fewer Is Better Intel Open Image Denoise 1.4.0 CPU Power Consumption Monitor 140 280 420 560 700
Intel Open Image Denoise CPU Power Consumption Monitor Min Avg Max AVX-512 On 52.1 288.6 574.3 AVX-512 Off 208.7 365.6 577.3 OpenBenchmarking.org Watts, Fewer Is Better Intel Open Image Denoise 1.4.0 CPU Power Consumption Monitor 140 280 420 560 700
Intel Open Image Denoise CPU Power Consumption Monitor Min Avg Max AVX-512 On 52.8 325.6 574.0 AVX-512 Off 207.2 399.0 572.6 OpenBenchmarking.org Watts, Fewer Is Better Intel Open Image Denoise 1.4.0 CPU Power Consumption Monitor 140 280 420 560 700
Darmstadt Automotive Parallel Heterogeneous Suite CPU Power Consumption Monitor Min Avg Max AVX-512 On 37.8 213.7 282.2 AVX-512 Off 215.0 244.8 282.7 OpenBenchmarking.org Watts, Fewer Is Better Darmstadt Automotive Parallel Heterogeneous Suite CPU Power Consumption Monitor 70 140 210 280 350
Darmstadt Automotive Parallel Heterogeneous Suite CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better Darmstadt Automotive Parallel Heterogeneous Suite CPU Power Consumption Monitor AVX-512 On AVX-512 Off 50 100 150 200 250 Min: 49.36 / Avg: 258.94 / Max: 283.12 Min: 136.19 / Avg: 273.1 / Max: 289.31
simdjson CPU Power Consumption Monitor Min Avg Max AVX-512 On 50.2 211.4 225.1 AVX-512 Off 113.7 224.4 230.2 OpenBenchmarking.org Watts, Fewer Is Better simdjson 2.0 CPU Power Consumption Monitor 60 120 180 240 300
simdjson CPU Power Consumption Monitor Min Avg Max AVX-512 On 53.8 207.0 220.8 AVX-512 Off 111.6 222.5 224.6 OpenBenchmarking.org Watts, Fewer Is Better simdjson 2.0 CPU Power Consumption Monitor 60 120 180 240 300
simdjson CPU Power Consumption Monitor Min Avg Max AVX-512 On 54.4 209.9 221.6 AVX-512 Off 112.5 223.5 225.7 OpenBenchmarking.org Watts, Fewer Is Better simdjson 2.0 CPU Power Consumption Monitor 60 120 180 240 300
simdjson CPU Power Consumption Monitor Min Avg Max AVX-512 On 35.8 209.0 219.1 AVX-512 Off 111.3 221.2 223.7 OpenBenchmarking.org Watts, Fewer Is Better simdjson 2.0 CPU Power Consumption Monitor 60 120 180 240 300
simdjson CPU Power Consumption Monitor Min Avg Max AVX-512 On 55.3 209.4 219.2 AVX-512 Off 111.2 221.5 223.4 OpenBenchmarking.org Watts, Fewer Is Better simdjson 2.0 CPU Power Consumption Monitor 60 120 180 240 300
OpenFOAM CPU Power Consumption Monitor Min Avg Max AVX-512 On 57 662 731 AVX-512 Off 220 674 735 OpenBenchmarking.org Watts, Fewer Is Better OpenFOAM 10 CPU Power Consumption Monitor 200 400 600 800 1000
CP2K Molecular Dynamics CPU Power Consumption Monitor Min Avg Max AVX-512 On 58.1 358.0 402.6 AVX-512 Off 118.3 361.5 403.0 OpenBenchmarking.org Watts, Fewer Is Better CP2K Molecular Dynamics 8.2 CPU Power Consumption Monitor 110 220 330 440 550
JPEG XL libjxl CPU Power Consumption Monitor Min Avg Max AVX-512 On 54.8 223.4 308.1 AVX-512 Off 142.6 233.9 323.3 OpenBenchmarking.org Watts, Fewer Is Better JPEG XL libjxl 0.7 CPU Power Consumption Monitor 80 160 240 320 400
JPEG XL libjxl CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better JPEG XL libjxl 0.7 CPU Power Consumption Monitor AVX-512 On AVX-512 Off 50 100 150 200 250 Min: 28.84 / Avg: 217.33 / Max: 256.47 Min: 110.34 / Avg: 222.62 / Max: 261.2
JPEG XL libjxl CPU Power Consumption Monitor Min Avg Max AVX-512 On 56.1 222.2 318.2 AVX-512 Off 134.0 232.4 317.2 OpenBenchmarking.org Watts, Fewer Is Better JPEG XL libjxl 0.7 CPU Power Consumption Monitor 80 160 240 320 400
Phoronix Test Suite v10.8.4