AMD EPYC 9654 Genoa AVX-512 benchmark comparison by Michael Larabel for a future article.
Compare your own system(s) to this result file with the
Phoronix Test Suite by running the command:
phoronix-test-suite benchmark 2212195-NE-AVXCOMPAR69 AMD EPYC 4th Gen AVX-512 Comparison - Phoronix Test Suite AMD EPYC 4th Gen AVX-512 Comparison AMD EPYC 9654 Genoa AVX-512 benchmark comparison by Michael Larabel for a future article.
HTML result view exported from: https://openbenchmarking.org/result/2212195-NE-AVXCOMPAR69&grs&sro .
AMD EPYC 4th Gen AVX-512 Comparison Processor Motherboard Chipset Memory Disk Graphics Monitor Network OS Kernel Desktop Display Server Vulkan Compiler File-System Screen Resolution AVX-512 On AVX-512 Off 2 x AMD EPYC 9654 96-Core @ 2.40GHz (192 Cores / 384 Threads) AMD Titanite_4G (RTI1002E BIOS) AMD Device 14a4 1520GB 800GB INTEL SSDPF21Q800GB ASPEED VGA HDMI Broadcom NetXtreme BCM5720 PCIe Ubuntu 22.10 6.1.0-phx (x86_64) GNOME Shell 43.0 X Server 1.21.1.4 1.3.224 GCC 12.2.0 + Clang 15.0.2-1 ext4 1920x1080 OpenBenchmarking.org Kernel Details - Transparent Huge Pages: madvise Environment Details - AVX-512 On: CXXFLAGS="-O3 -march=native -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi -mprefer-vector-width=512" CFLAGS="-O3 -march=native -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi -mprefer-vector-width=512" - AVX-512 Off: CXXFLAGS="-O3 -march=native -mno-avx512f" CFLAGS="-O3 -march=native -mno-avx512f" Compiler Details - --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-defaulted --enable-offload-targets=nvptx-none=/build/gcc-12-U8K4Qv/gcc-12-12.2.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-12-U8K4Qv/gcc-12-12.2.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v Processor Details - Scaling Governor: acpi-cpufreq performance (Boost: Enabled) - CPU Microcode: 0xa10110d Python Details - Python 3.10.7 Security Details - itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional IBRS_FW STIBP: always-on RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected
AMD EPYC 4th Gen AVX-512 Comparison tensorflow: CPU - 16 - AlexNet onednn: Recurrent Neural Network Training - bf16bf16bf16 - CPU ai-benchmark: Device Training Score onednn: Recurrent Neural Network Training - f32 - CPU openvino: Weld Porosity Detection FP16 - CPU openvino: Weld Porosity Detection FP16 - CPU openvino: Face Detection FP16 - CPU openvino: Face Detection FP16 - CPU openvino: Age Gender Recognition Retail 0013 FP16 - CPU cpuminer-opt: LBC, LBRY Credits ai-benchmark: Device AI Score openvino: Machine Translation EN To DE FP16 - CPU openvino: Machine Translation EN To DE FP16 - CPU openvino: Weld Porosity Detection FP16-INT8 - CPU openvino: Weld Porosity Detection FP16-INT8 - CPU openvino: Face Detection FP16-INT8 - CPU openvino: Face Detection FP16-INT8 - CPU openvino: Vehicle Detection FP16 - CPU openvino: Vehicle Detection FP16 - CPU ai-benchmark: Device Inference Score openvino: Vehicle Detection FP16-INT8 - CPU openvino: Vehicle Detection FP16-INT8 - CPU onednn: Deconvolution Batch shapes_3d - f32 - CPU openvino: Person Vehicle Bike Detection FP16 - CPU openvino: Person Vehicle Bike Detection FP16 - CPU tensorflow: CPU - 16 - ResNet-50 ospray: gravity_spheres_volume/dim_512/scivis/real_time cpuminer-opt: Quad SHA-256, Pyrite openvino: Person Detection FP16 - CPU openvino: Person Detection FP16 - CPU openvino: Person Detection FP32 - CPU openvino: Person Detection FP32 - CPU ospray: gravity_spheres_volume/dim_512/ao/real_time cpuminer-opt: scrypt openvino: Age Gender Recognition Retail 0013 FP16-INT8 - CPU mnn: resnet-v2-50 deepsparse: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Asynchronous Multi-Stream deepsparse: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Asynchronous Multi-Stream mnn: inception-v3 cpuminer-opt: Garlicoin minibude: OpenMP - BM1 minibude: OpenMP - BM1 deepsparse: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Synchronous Single-Stream deepsparse: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Synchronous Single-Stream deepsparse: CV Classification, ResNet-50 ImageNet - Asynchronous Multi-Stream deepsparse: CV Classification, ResNet-50 ImageNet - Asynchronous Multi-Stream onednn: Recurrent Neural Network Inference - bf16bf16bf16 - CPU openvino: Age Gender Recognition Retail 0013 FP16 - CPU cpuminer-opt: Skeincoin minibude: OpenMP - BM2 minibude: OpenMP - BM2 ospray: gravity_spheres_volume/dim_512/pathtracer/real_time cpuminer-opt: x25x simdjson: DistinctUserID simdjson: PartialTweets deepsparse: CV Detection,YOLOv5s COCO - Asynchronous Multi-Stream deepsparse: CV Detection,YOLOv5s COCO - Asynchronous Multi-Stream simdjson: Kostya ospray-studio: 2 - 1080p - 32 - Path Tracer ospray-studio: 2 - 4K - 16 - Path Tracer ospray-studio: 2 - 1080p - 16 - Path Tracer ospray-studio: 1 - 1080p - 32 - Path Tracer ospray-studio: 1 - 1080p - 1 - Path Tracer ospray-studio: 2 - 4K - 32 - Path Tracer ospray-studio: 1 - 4K - 1 - Path Tracer ospray-studio: 1 - 4K - 32 - Path Tracer ospray-studio: 1 - 4K - 16 - Path Tracer ospray-studio: 1 - 1080p - 16 - Path Tracer ospray-studio: 3 - 1080p - 16 - Path Tracer ospray-studio: 3 - 1080p - 32 - Path Tracer simdjson: TopTweet ospray-studio: 3 - 4K - 1 - Path Tracer simdjson: LargeRand deepsparse: NLP Text Classification, BERT base uncased SST2 - Asynchronous Multi-Stream ospray-studio: 3 - 4K - 16 - Path Tracer deepsparse: NLP Text Classification, BERT base uncased SST2 - Asynchronous Multi-Stream ospray-studio: 3 - 1080p - 1 - Path Tracer ospray-studio: 3 - 4K - 32 - Path Tracer embree: Pathtracer ISPC - Asian Dragon embree: Pathtracer ISPC - Asian Dragon Obj deepsparse: CV Detection,YOLOv5s COCO - Synchronous Single-Stream deepsparse: CV Detection,YOLOv5s COCO - Synchronous Single-Stream embree: Pathtracer ISPC - Crown ospray-studio: 2 - 4K - 1 - Path Tracer ospray-studio: 2 - 1080p - 1 - Path Tracer deepsparse: NLP Text Classification, DistilBERT mnli - Asynchronous Multi-Stream openfoam: drivaerFastback, Medium Mesh Size - Execution Time deepsparse: NLP Text Classification, DistilBERT mnli - Asynchronous Multi-Stream deepsparse: NLP Text Classification, BERT base uncased SST2 - Synchronous Single-Stream deepsparse: NLP Text Classification, BERT base uncased SST2 - Synchronous Single-Stream openvkl: vklBenchmark ISPC openvino: Age Gender Recognition Retail 0013 FP16-INT8 - CPU deepsparse: NLP Token Classification, BERT base uncased conll2003 - Synchronous Single-Stream deepsparse: NLP Token Classification, BERT base uncased conll2003 - Synchronous Single-Stream deepsparse: NLP Document Classification, oBERT base uncased on IMDB - Synchronous Single-Stream deepsparse: NLP Document Classification, oBERT base uncased on IMDB - Synchronous Single-Stream ncnn: CPU - blazeface lczero: Eigen ncnn: CPU - regnety_400m smhasher: FarmHash32 x86_64 AVX ncnn: CPU - efficientnet-b0 onnx: fcn-resnet101-11 - CPU - Standard lczero: BLAS cp2k: Fayalite-FIST mnn: SqueezeNetV1.0 openfoam: drivaerFastback, Medium Mesh Size - Mesh Time deepsparse: NLP Text Classification, DistilBERT mnli - Synchronous Single-Stream deepsparse: NLP Text Classification, DistilBERT mnli - Synchronous Single-Stream numpy: jpegxl: JPEG - 90 ncnn: CPU - googlenet jpegxl: PNG - 90 ncnn: CPU - mnasnet numenta-nab: Bayesian Changepoint onednn: Convolution Batch Shapes Auto - f32 - CPU oidn: RTLightmap.hdr.4096x4096 onnx: bertsquad-12 - CPU - Standard numenta-nab: Windowed Gaussian jpegxl: JPEG - 100 daphne: OpenMP - NDT Mapping ncnn: CPU - resnet50 gromacs: MPI CPU - water_GMX50_bare numenta-nab: Relative Entropy onednn: Deconvolution Batch shapes_1d - f32 - CPU oidn: RT.hdr_alb_nrm.3840x2160 oidn: RT.ldr_alb_nrm.3840x2160 smhasher: FarmHash32 x86_64 AVX daphne: OpenMP - Points2Image svt-av1: Preset 12 - Bosphorus 4K svt-av1: Preset 13 - Bosphorus 4K onnx: ArcFace ResNet-100 - CPU - Standard onnx: super-resolution-10 - CPU - Standard ncnn: CPU - FastestDet ncnn: CPU - vision_transformer tensorflow: CPU - 16 - GoogLeNet AVX-512 On AVX-512 Off 157.29 1955.39 2701 1962.06 4.79 9988.44 102.04 469.29 0.55 1066950 6211 50.11 956.88 19800.20 9.63 193.93 246.98 7452.96 6.43 3510 11202.62 4.28 0.989591 9065.34 5.29 22.15 43.0711 2260680 43.34 1100.25 43.34 1101.00 44.1566 4800.61 0.36 15.441 761.2241 125.7860 45.812 71553 7299.545 291.982 100.5458 9.9408 49.0328 1953.0255 2361.27 148967.98 1951330 346.081 8652.005 54.2187 7696.06 6.86 6.70 857.2265 111.7282 4.18 4764 9385 2384 4698 148 18808 581 18546 9271 2353 2804 5608 6.52 694 1.26 616.6804 11070 155.3462 177 22184 212.9364 184.4701 189.5611 5.2712 180.9315 604 154 80.0826 113.63733 1195.9367 84.9988 11.7586 1332 170652.71 34.5206 28.9609 34.2518 29.1892 25.88 9096 247.32 39794.44 57.71 271 9077 1122.725 8.579 135.77418 187.0837 5.3413 575.66 9.55 72.80 9.95 42.30 16.677 0.516167 1.66 516 4.727 0.74 1371.18 66.34 18.764 9.898 22.5875 3.51 3.51 26.387 13677.764494843 245.555 246.572 1051 7401 58.95 74.93 60.17 55.11 4989.13 1066 4953.98 11.66 4110.49 43.94 1088.50 1.21 491740 2887 107.62 445.59 9672.94 19.69 94.97 503.50 3782.08 12.67 1821 6065.76 7.90 1.76336 5135.56 9.33 12.75 25.1354 1322960 25.50 1864.93 25.74 1845.95 26.3794 2946.08 0.57 24.098 490.3658 195.1656 30.436 48827 5065.096 202.604 71.0437 14.0655 67.9118 1410.8051 1715.76 108449.49 1427543 255.661 6391.519 40.5117 5784.25 5.25 5.14 690.8722 138.5861 3.39 5861 11524 2924 5749 181 22985 710 22647 11321 2871 3413 6820 5.38 841 1.04 509.4462 13398 187.8540 214 26785 176.8831 153.4476 157.819 6.3313 151.0558 722 184 95.3347 135.21648 1005.1615 73.5380 13.5907 1155 151239.60 30.6062 32.6647 30.5267 32.7505 29.00 8162 270.12 36483.70 62.86 250 8423 1198.408 9.146 144.3478 177.5387 5.6282 548.83 9.13 76.13 9.52 44.19 17.389 0.537682 1.72 499 4.882 0.72 1335.63 67.48 18.467 10.035 22.8354 3.50 3.51 26.412 11521.38 233.944 239.881 918 6288 60.73 86.16 31.12 OpenBenchmarking.org
TensorFlow Device: CPU - Batch Size: 16 - Model: AlexNet OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.10 Device: CPU - Batch Size: 16 - Model: AlexNet AVX-512 Off AVX-512 On 30 60 90 120 150 SE +/- 0.19, N = 3 SE +/- 2.35, N = 12 55.11 157.29
oneDNN Harness: Recurrent Neural Network Training - Data Type: bf16bf16bf16 - Engine: CPU OpenBenchmarking.org ms, Fewer Is Better oneDNN 2.7 Harness: Recurrent Neural Network Training - Data Type: bf16bf16bf16 - Engine: CPU AVX-512 Off AVX-512 On 1100 2200 3300 4400 5500 SE +/- 41.71, N = 3 SE +/- 19.67, N = 15 4989.13 1955.39 -mno-avx512f - MIN: 4767.22 -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi - MIN: 1769.7 1. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread
AI Benchmark Alpha Device Training Score OpenBenchmarking.org Score, More Is Better AI Benchmark Alpha 0.1.2 Device Training Score AVX-512 Off AVX-512 On 600 1200 1800 2400 3000 1066 2701
oneDNN Harness: Recurrent Neural Network Training - Data Type: f32 - Engine: CPU OpenBenchmarking.org ms, Fewer Is Better oneDNN 2.7 Harness: Recurrent Neural Network Training - Data Type: f32 - Engine: CPU AVX-512 Off AVX-512 On 1100 2200 3300 4400 5500 SE +/- 60.12, N = 4 SE +/- 20.13, N = 5 4953.98 1962.06 -mno-avx512f - MIN: 4690.85 -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi - MIN: 1899.34 1. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread
OpenVINO Model: Weld Porosity Detection FP16 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2022.2.dev Model: Weld Porosity Detection FP16 - Device: CPU AVX-512 Off AVX-512 On 3 6 9 12 15 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 11.66 4.79 -mno-avx512f - MIN: 9.72 / MAX: 43.7 -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi - MIN: 3.98 / MAX: 28.79 1. (CXX) g++ options: -fPIC -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -flto -shared
OpenVINO Model: Weld Porosity Detection FP16 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2022.2.dev Model: Weld Porosity Detection FP16 - Device: CPU AVX-512 Off AVX-512 On 2K 4K 6K 8K 10K SE +/- 4.29, N = 3 SE +/- 6.96, N = 3 4110.49 9988.44 -mno-avx512f -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi 1. (CXX) g++ options: -fPIC -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -flto -shared
OpenVINO Model: Face Detection FP16 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2022.2.dev Model: Face Detection FP16 - Device: CPU AVX-512 Off AVX-512 On 20 40 60 80 100 SE +/- 0.01, N = 3 SE +/- 0.07, N = 3 43.94 102.04 -mno-avx512f -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi 1. (CXX) g++ options: -fPIC -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -flto -shared
OpenVINO Model: Face Detection FP16 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2022.2.dev Model: Face Detection FP16 - Device: CPU AVX-512 Off AVX-512 On 200 400 600 800 1000 SE +/- 0.51, N = 3 SE +/- 0.24, N = 3 1088.50 469.29 -mno-avx512f - MIN: 937.5 / MAX: 1231.55 -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi - MIN: 410.93 / MAX: 547.33 1. (CXX) g++ options: -fPIC -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -flto -shared
OpenVINO Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2022.2.dev Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU AVX-512 Off AVX-512 On 0.2723 0.5446 0.8169 1.0892 1.3615 SE +/- 0.01, N = 4 SE +/- 0.00, N = 3 1.21 0.55 -mno-avx512f - MIN: 0.98 / MAX: 47.37 -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi - MIN: 0.5 / MAX: 29.57 1. (CXX) g++ options: -fPIC -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -flto -shared
Cpuminer-Opt Algorithm: LBC, LBRY Credits OpenBenchmarking.org kH/s, More Is Better Cpuminer-Opt 3.20.3 Algorithm: LBC, LBRY Credits AVX-512 Off AVX-512 On 200K 400K 600K 800K 1000K SE +/- 667.26, N = 3 SE +/- 7645.47, N = 3 491740 1066950 -mno-avx512f -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi 1. (CXX) g++ options: -O3 -march=native -lcurl -lz -lpthread -lssl -lcrypto -lgmp
AI Benchmark Alpha Device AI Score OpenBenchmarking.org Score, More Is Better AI Benchmark Alpha 0.1.2 Device AI Score AVX-512 Off AVX-512 On 1300 2600 3900 5200 6500 2887 6211
OpenVINO Model: Machine Translation EN To DE FP16 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2022.2.dev Model: Machine Translation EN To DE FP16 - Device: CPU AVX-512 Off AVX-512 On 20 40 60 80 100 SE +/- 0.74, N = 3 SE +/- 0.21, N = 3 107.62 50.11 -mno-avx512f - MIN: 83.48 / MAX: 216.07 -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi - MIN: 38.98 / MAX: 166.69 1. (CXX) g++ options: -fPIC -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -flto -shared
OpenVINO Model: Machine Translation EN To DE FP16 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2022.2.dev Model: Machine Translation EN To DE FP16 - Device: CPU AVX-512 Off AVX-512 On 200 400 600 800 1000 SE +/- 3.04, N = 3 SE +/- 4.00, N = 3 445.59 956.88 -mno-avx512f -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi 1. (CXX) g++ options: -fPIC -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -flto -shared
OpenVINO Model: Weld Porosity Detection FP16-INT8 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2022.2.dev Model: Weld Porosity Detection FP16-INT8 - Device: CPU AVX-512 Off AVX-512 On 4K 8K 12K 16K 20K SE +/- 1.81, N = 3 SE +/- 12.72, N = 3 9672.94 19800.20 -mno-avx512f -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi 1. (CXX) g++ options: -fPIC -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -flto -shared
OpenVINO Model: Weld Porosity Detection FP16-INT8 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2022.2.dev Model: Weld Porosity Detection FP16-INT8 - Device: CPU AVX-512 Off AVX-512 On 5 10 15 20 25 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 19.69 9.63 -mno-avx512f - MIN: 16.4 / MAX: 74.85 -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi - MIN: 8.29 / MAX: 57.53 1. (CXX) g++ options: -fPIC -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -flto -shared
OpenVINO Model: Face Detection FP16-INT8 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2022.2.dev Model: Face Detection FP16-INT8 - Device: CPU AVX-512 Off AVX-512 On 40 80 120 160 200 SE +/- 0.02, N = 3 SE +/- 0.05, N = 3 94.97 193.93 -mno-avx512f -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi 1. (CXX) g++ options: -fPIC -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -flto -shared
OpenVINO Model: Face Detection FP16-INT8 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2022.2.dev Model: Face Detection FP16-INT8 - Device: CPU AVX-512 Off AVX-512 On 110 220 330 440 550 SE +/- 0.07, N = 3 SE +/- 0.01, N = 3 503.50 246.98 -mno-avx512f - MIN: 402.47 / MAX: 569.65 -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi - MIN: 204.5 / MAX: 299.54 1. (CXX) g++ options: -fPIC -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -flto -shared
OpenVINO Model: Vehicle Detection FP16 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2022.2.dev Model: Vehicle Detection FP16 - Device: CPU AVX-512 Off AVX-512 On 1600 3200 4800 6400 8000 SE +/- 10.17, N = 3 SE +/- 3.52, N = 3 3782.08 7452.96 -mno-avx512f -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi 1. (CXX) g++ options: -fPIC -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -flto -shared
OpenVINO Model: Vehicle Detection FP16 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2022.2.dev Model: Vehicle Detection FP16 - Device: CPU AVX-512 Off AVX-512 On 3 6 9 12 15 SE +/- 0.03, N = 3 SE +/- 0.00, N = 3 12.67 6.43 -mno-avx512f - MIN: 9.58 / MAX: 77.91 -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi - MIN: 5.22 / MAX: 61.26 1. (CXX) g++ options: -fPIC -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -flto -shared
AI Benchmark Alpha Device Inference Score OpenBenchmarking.org Score, More Is Better AI Benchmark Alpha 0.1.2 Device Inference Score AVX-512 Off AVX-512 On 800 1600 2400 3200 4000 1821 3510
OpenVINO Model: Vehicle Detection FP16-INT8 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2022.2.dev Model: Vehicle Detection FP16-INT8 - Device: CPU AVX-512 Off AVX-512 On 2K 4K 6K 8K 10K SE +/- 1.39, N = 3 SE +/- 2.53, N = 3 6065.76 11202.62 -mno-avx512f -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi 1. (CXX) g++ options: -fPIC -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -flto -shared
OpenVINO Model: Vehicle Detection FP16-INT8 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2022.2.dev Model: Vehicle Detection FP16-INT8 - Device: CPU AVX-512 Off AVX-512 On 2 4 6 8 10 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 7.90 4.28 -mno-avx512f - MIN: 6.37 / MAX: 41.53 -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi - MIN: 3.5 / MAX: 42.62 1. (CXX) g++ options: -fPIC -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -flto -shared
oneDNN Harness: Deconvolution Batch shapes_3d - Data Type: f32 - Engine: CPU OpenBenchmarking.org ms, Fewer Is Better oneDNN 2.7 Harness: Deconvolution Batch shapes_3d - Data Type: f32 - Engine: CPU AVX-512 Off AVX-512 On 0.3968 0.7936 1.1904 1.5872 1.984 SE +/- 0.004550, N = 9 SE +/- 0.001906, N = 9 1.763360 0.989591 -mno-avx512f - MIN: 1.55 -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi - MIN: 0.9 1. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread
OpenVINO Model: Person Vehicle Bike Detection FP16 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2022.2.dev Model: Person Vehicle Bike Detection FP16 - Device: CPU AVX-512 Off AVX-512 On 2K 4K 6K 8K 10K SE +/- 2.17, N = 3 SE +/- 4.01, N = 3 5135.56 9065.34 -mno-avx512f -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi 1. (CXX) g++ options: -fPIC -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -flto -shared
OpenVINO Model: Person Vehicle Bike Detection FP16 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2022.2.dev Model: Person Vehicle Bike Detection FP16 - Device: CPU AVX-512 Off AVX-512 On 3 6 9 12 15 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 9.33 5.29 -mno-avx512f - MIN: 7.39 / MAX: 57.57 -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi - MIN: 4.36 / MAX: 45.25 1. (CXX) g++ options: -fPIC -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -flto -shared
TensorFlow Device: CPU - Batch Size: 16 - Model: ResNet-50 OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.10 Device: CPU - Batch Size: 16 - Model: ResNet-50 AVX-512 Off AVX-512 On 5 10 15 20 25 SE +/- 0.01, N = 3 SE +/- 0.11, N = 3 12.75 22.15
OSPRay Benchmark: gravity_spheres_volume/dim_512/scivis/real_time OpenBenchmarking.org Items Per Second, More Is Better OSPRay 2.10 Benchmark: gravity_spheres_volume/dim_512/scivis/real_time AVX-512 Off AVX-512 On 10 20 30 40 50 SE +/- 0.04, N = 3 SE +/- 0.10, N = 3 25.14 43.07
Cpuminer-Opt Algorithm: Quad SHA-256, Pyrite OpenBenchmarking.org kH/s, More Is Better Cpuminer-Opt 3.20.3 Algorithm: Quad SHA-256, Pyrite AVX-512 Off AVX-512 On 500K 1000K 1500K 2000K 2500K SE +/- 276.83, N = 3 SE +/- 9040.25, N = 3 1322960 2260680 -mno-avx512f -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi 1. (CXX) g++ options: -O3 -march=native -lcurl -lz -lpthread -lssl -lcrypto -lgmp
OpenVINO Model: Person Detection FP16 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2022.2.dev Model: Person Detection FP16 - Device: CPU AVX-512 Off AVX-512 On 10 20 30 40 50 SE +/- 0.22, N = 3 SE +/- 0.20, N = 3 25.50 43.34 -mno-avx512f -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi 1. (CXX) g++ options: -fPIC -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -flto -shared
OpenVINO Model: Person Detection FP16 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2022.2.dev Model: Person Detection FP16 - Device: CPU AVX-512 Off AVX-512 On 400 800 1200 1600 2000 SE +/- 15.65, N = 3 SE +/- 4.83, N = 3 1864.93 1100.25 -mno-avx512f - MIN: 1371.29 / MAX: 2532.74 -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi - MIN: 783.9 / MAX: 1824.92 1. (CXX) g++ options: -fPIC -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -flto -shared
OpenVINO Model: Person Detection FP32 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2022.2.dev Model: Person Detection FP32 - Device: CPU AVX-512 Off AVX-512 On 10 20 30 40 50 SE +/- 0.04, N = 3 SE +/- 0.18, N = 3 25.74 43.34 -mno-avx512f -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi 1. (CXX) g++ options: -fPIC -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -flto -shared
OpenVINO Model: Person Detection FP32 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2022.2.dev Model: Person Detection FP32 - Device: CPU AVX-512 Off AVX-512 On 400 800 1200 1600 2000 SE +/- 3.32, N = 3 SE +/- 4.44, N = 3 1845.95 1101.00 -mno-avx512f - MIN: 1386.31 / MAX: 2798 -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi - MIN: 840.82 / MAX: 1792.51 1. (CXX) g++ options: -fPIC -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -flto -shared
OSPRay Benchmark: gravity_spheres_volume/dim_512/ao/real_time OpenBenchmarking.org Items Per Second, More Is Better OSPRay 2.10 Benchmark: gravity_spheres_volume/dim_512/ao/real_time AVX-512 Off AVX-512 On 10 20 30 40 50 SE +/- 0.02, N = 3 SE +/- 0.21, N = 3 26.38 44.16
Cpuminer-Opt Algorithm: scrypt OpenBenchmarking.org kH/s, More Is Better Cpuminer-Opt 3.20.3 Algorithm: scrypt AVX-512 Off AVX-512 On 1000 2000 3000 4000 5000 SE +/- 0.31, N = 3 SE +/- 0.45, N = 3 2946.08 4800.61 -mno-avx512f -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi 1. (CXX) g++ options: -O3 -march=native -lcurl -lz -lpthread -lssl -lcrypto -lgmp
OpenVINO Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2022.2.dev Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU AVX-512 Off AVX-512 On 0.1283 0.2566 0.3849 0.5132 0.6415 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 0.57 0.36 -mno-avx512f - MIN: 0.52 / MAX: 47.93 -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi - MIN: 0.34 / MAX: 33.7 1. (CXX) g++ options: -fPIC -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -flto -shared
Mobile Neural Network Model: resnet-v2-50 OpenBenchmarking.org ms, Fewer Is Better Mobile Neural Network 2.1 Model: resnet-v2-50 AVX-512 Off AVX-512 On 6 12 18 24 30 SE +/- 0.08, N = 8 SE +/- 0.08, N = 9 24.10 15.44 -mno-avx512f - MIN: 23.44 / MAX: 71.32 -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi - MIN: 14.79 / MAX: 54.05 1. (CXX) g++ options: -O3 -march=native -std=c++11 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl
Neural Magic DeepSparse Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.1 Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-Stream AVX-512 Off AVX-512 On 160 320 480 640 800 SE +/- 0.61, N = 3 SE +/- 0.79, N = 3 490.37 761.22
Neural Magic DeepSparse Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.1 Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-Stream AVX-512 Off AVX-512 On 40 80 120 160 200 SE +/- 0.23, N = 3 SE +/- 0.11, N = 3 195.17 125.79
Mobile Neural Network Model: inception-v3 OpenBenchmarking.org ms, Fewer Is Better Mobile Neural Network 2.1 Model: inception-v3 AVX-512 Off AVX-512 On 10 20 30 40 50 SE +/- 0.13, N = 8 SE +/- 0.23, N = 9 30.44 45.81 -mno-avx512f - MIN: 28.75 / MAX: 109.22 -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi - MIN: 44.13 / MAX: 87.28 1. (CXX) g++ options: -O3 -march=native -std=c++11 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl
Cpuminer-Opt Algorithm: Garlicoin OpenBenchmarking.org kH/s, More Is Better Cpuminer-Opt 3.20.3 Algorithm: Garlicoin AVX-512 Off AVX-512 On 15K 30K 45K 60K 75K SE +/- 13.33, N = 3 SE +/- 89.69, N = 3 48827 71553 -mno-avx512f -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi 1. (CXX) g++ options: -O3 -march=native -lcurl -lz -lpthread -lssl -lcrypto -lgmp
miniBUDE Implementation: OpenMP - Input Deck: BM1 OpenBenchmarking.org GFInst/s, More Is Better miniBUDE 20210901 Implementation: OpenMP - Input Deck: BM1 AVX-512 Off AVX-512 On 1600 3200 4800 6400 8000 SE +/- 26.42, N = 8 SE +/- 5.79, N = 10 5065.10 7299.55 1. (CC) gcc options: -std=c99 -Ofast -ffast-math -fopenmp -march=native -lm
miniBUDE Implementation: OpenMP - Input Deck: BM1 OpenBenchmarking.org Billion Interactions/s, More Is Better miniBUDE 20210901 Implementation: OpenMP - Input Deck: BM1 AVX-512 Off AVX-512 On 60 120 180 240 300 SE +/- 1.06, N = 8 SE +/- 0.23, N = 10 202.60 291.98 1. (CC) gcc options: -std=c99 -Ofast -ffast-math -fopenmp -march=native -lm
Neural Magic DeepSparse Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Synchronous Single-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.1 Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Synchronous Single-Stream AVX-512 Off AVX-512 On 20 40 60 80 100 SE +/- 0.17, N = 3 SE +/- 0.17, N = 3 71.04 100.55
Neural Magic DeepSparse Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Synchronous Single-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.1 Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Synchronous Single-Stream AVX-512 Off AVX-512 On 4 8 12 16 20 SE +/- 0.0334, N = 3 SE +/- 0.0172, N = 3 14.0655 9.9408
Neural Magic DeepSparse Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.1 Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream AVX-512 Off AVX-512 On 15 30 45 60 75 SE +/- 0.02, N = 3 SE +/- 0.11, N = 3 67.91 49.03
Neural Magic DeepSparse Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.1 Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream AVX-512 Off AVX-512 On 400 800 1200 1600 2000 SE +/- 0.17, N = 3 SE +/- 4.32, N = 3 1410.81 1953.03
oneDNN Harness: Recurrent Neural Network Inference - Data Type: bf16bf16bf16 - Engine: CPU OpenBenchmarking.org ms, Fewer Is Better oneDNN 2.7 Harness: Recurrent Neural Network Inference - Data Type: bf16bf16bf16 - Engine: CPU AVX-512 Off AVX-512 On 500 1000 1500 2000 2500 SE +/- 22.32, N = 3 SE +/- 24.41, N = 4 1715.76 2361.27 -mno-avx512f - MIN: 1607.13 -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi - MIN: 2265.7 1. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread
OpenVINO Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2022.2.dev Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU AVX-512 Off AVX-512 On 30K 60K 90K 120K 150K SE +/- 1130.85, N = 4 SE +/- 1328.20, N = 3 108449.49 148967.98 -mno-avx512f -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi 1. (CXX) g++ options: -fPIC -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -flto -shared
Cpuminer-Opt Algorithm: Skeincoin OpenBenchmarking.org kH/s, More Is Better Cpuminer-Opt 3.20.3 Algorithm: Skeincoin AVX-512 Off AVX-512 On 400K 800K 1200K 1600K 2000K SE +/- 3964.01, N = 3 SE +/- 13005.55, N = 3 1427543 1951330 -mno-avx512f -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi 1. (CXX) g++ options: -O3 -march=native -lcurl -lz -lpthread -lssl -lcrypto -lgmp
miniBUDE Implementation: OpenMP - Input Deck: BM2 OpenBenchmarking.org Billion Interactions/s, More Is Better miniBUDE 20210901 Implementation: OpenMP - Input Deck: BM2 AVX-512 Off AVX-512 On 80 160 240 320 400 SE +/- 1.27, N = 3 SE +/- 0.46, N = 4 255.66 346.08 1. (CC) gcc options: -std=c99 -Ofast -ffast-math -fopenmp -march=native -lm
miniBUDE Implementation: OpenMP - Input Deck: BM2 OpenBenchmarking.org GFInst/s, More Is Better miniBUDE 20210901 Implementation: OpenMP - Input Deck: BM2 AVX-512 Off AVX-512 On 2K 4K 6K 8K 10K SE +/- 31.65, N = 3 SE +/- 11.62, N = 4 6391.52 8652.01 1. (CC) gcc options: -std=c99 -Ofast -ffast-math -fopenmp -march=native -lm
OSPRay Benchmark: gravity_spheres_volume/dim_512/pathtracer/real_time OpenBenchmarking.org Items Per Second, More Is Better OSPRay 2.10 Benchmark: gravity_spheres_volume/dim_512/pathtracer/real_time AVX-512 Off AVX-512 On 12 24 36 48 60 SE +/- 0.03, N = 3 SE +/- 0.05, N = 3 40.51 54.22
Cpuminer-Opt Algorithm: x25x OpenBenchmarking.org kH/s, More Is Better Cpuminer-Opt 3.20.3 Algorithm: x25x AVX-512 Off AVX-512 On 1600 3200 4800 6400 8000 SE +/- 14.41, N = 3 SE +/- 16.58, N = 3 5784.25 7696.06 -mno-avx512f -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi 1. (CXX) g++ options: -O3 -march=native -lcurl -lz -lpthread -lssl -lcrypto -lgmp
simdjson Throughput Test: DistinctUserID OpenBenchmarking.org GB/s, More Is Better simdjson 2.0 Throughput Test: DistinctUserID AVX-512 Off AVX-512 On 2 4 6 8 10 SE +/- 0.01, N = 3 SE +/- 0.02, N = 3 5.25 6.86 -mno-avx512f -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi 1. (CXX) g++ options: -O3 -march=native
simdjson Throughput Test: PartialTweets OpenBenchmarking.org GB/s, More Is Better simdjson 2.0 Throughput Test: PartialTweets AVX-512 Off AVX-512 On 2 4 6 8 10 SE +/- 0.01, N = 3 SE +/- 0.04, N = 3 5.14 6.70 -mno-avx512f -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi 1. (CXX) g++ options: -O3 -march=native
Neural Magic DeepSparse Model: CV Detection,YOLOv5s COCO - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.1 Model: CV Detection,YOLOv5s COCO - Scenario: Asynchronous Multi-Stream AVX-512 Off AVX-512 On 200 400 600 800 1000 SE +/- 1.12, N = 3 SE +/- 0.77, N = 3 690.87 857.23
Neural Magic DeepSparse Model: CV Detection,YOLOv5s COCO - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.1 Model: CV Detection,YOLOv5s COCO - Scenario: Asynchronous Multi-Stream AVX-512 Off AVX-512 On 30 60 90 120 150 SE +/- 0.25, N = 3 SE +/- 0.12, N = 3 138.59 111.73
simdjson Throughput Test: Kostya OpenBenchmarking.org GB/s, More Is Better simdjson 2.0 Throughput Test: Kostya AVX-512 Off AVX-512 On 0.9405 1.881 2.8215 3.762 4.7025 SE +/- 0.00, N = 3 SE +/- 0.02, N = 3 3.39 4.18 -mno-avx512f -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi 1. (CXX) g++ options: -O3 -march=native
OSPRay Studio Camera: 2 - Resolution: 1080p - Samples Per Pixel: 32 - Renderer: Path Tracer OpenBenchmarking.org ms, Fewer Is Better OSPRay Studio 0.11 Camera: 2 - Resolution: 1080p - Samples Per Pixel: 32 - Renderer: Path Tracer AVX-512 Off AVX-512 On 1300 2600 3900 5200 6500 SE +/- 8.25, N = 3 SE +/- 6.24, N = 3 5861 4764 -mno-avx512f -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi 1. (CXX) g++ options: -O3 -march=native -ldl
OSPRay Studio Camera: 2 - Resolution: 4K - Samples Per Pixel: 16 - Renderer: Path Tracer OpenBenchmarking.org ms, Fewer Is Better OSPRay Studio 0.11 Camera: 2 - Resolution: 4K - Samples Per Pixel: 16 - Renderer: Path Tracer AVX-512 Off AVX-512 On 2K 4K 6K 8K 10K SE +/- 15.51, N = 3 SE +/- 2.19, N = 3 11524 9385 -mno-avx512f -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi 1. (CXX) g++ options: -O3 -march=native -ldl
OSPRay Studio Camera: 2 - Resolution: 1080p - Samples Per Pixel: 16 - Renderer: Path Tracer OpenBenchmarking.org ms, Fewer Is Better OSPRay Studio 0.11 Camera: 2 - Resolution: 1080p - Samples Per Pixel: 16 - Renderer: Path Tracer AVX-512 Off AVX-512 On 600 1200 1800 2400 3000 SE +/- 0.88, N = 3 SE +/- 9.17, N = 3 2924 2384 -mno-avx512f -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi 1. (CXX) g++ options: -O3 -march=native -ldl
OSPRay Studio Camera: 1 - Resolution: 1080p - Samples Per Pixel: 32 - Renderer: Path Tracer OpenBenchmarking.org ms, Fewer Is Better OSPRay Studio 0.11 Camera: 1 - Resolution: 1080p - Samples Per Pixel: 32 - Renderer: Path Tracer AVX-512 Off AVX-512 On 1200 2400 3600 4800 6000 SE +/- 6.56, N = 3 SE +/- 3.71, N = 3 5749 4698 -mno-avx512f -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi 1. (CXX) g++ options: -O3 -march=native -ldl
OSPRay Studio Camera: 1 - Resolution: 1080p - Samples Per Pixel: 1 - Renderer: Path Tracer OpenBenchmarking.org ms, Fewer Is Better OSPRay Studio 0.11 Camera: 1 - Resolution: 1080p - Samples Per Pixel: 1 - Renderer: Path Tracer AVX-512 Off AVX-512 On 40 80 120 160 200 SE +/- 0.33, N = 3 SE +/- 0.33, N = 3 181 148 -mno-avx512f -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi 1. (CXX) g++ options: -O3 -march=native -ldl
OSPRay Studio Camera: 2 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path Tracer OpenBenchmarking.org ms, Fewer Is Better OSPRay Studio 0.11 Camera: 2 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path Tracer AVX-512 Off AVX-512 On 5K 10K 15K 20K 25K SE +/- 30.02, N = 3 SE +/- 20.34, N = 3 22985 18808 -mno-avx512f -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi 1. (CXX) g++ options: -O3 -march=native -ldl
OSPRay Studio Camera: 1 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path Tracer OpenBenchmarking.org ms, Fewer Is Better OSPRay Studio 0.11 Camera: 1 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path Tracer AVX-512 Off AVX-512 On 150 300 450 600 750 SE +/- 2.08, N = 3 SE +/- 1.00, N = 3 710 581 -mno-avx512f -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi 1. (CXX) g++ options: -O3 -march=native -ldl
OSPRay Studio Camera: 1 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path Tracer OpenBenchmarking.org ms, Fewer Is Better OSPRay Studio 0.11 Camera: 1 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path Tracer AVX-512 Off AVX-512 On 5K 10K 15K 20K 25K SE +/- 27.41, N = 3 SE +/- 13.75, N = 3 22647 18546 -mno-avx512f -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi 1. (CXX) g++ options: -O3 -march=native -ldl
OSPRay Studio Camera: 1 - Resolution: 4K - Samples Per Pixel: 16 - Renderer: Path Tracer OpenBenchmarking.org ms, Fewer Is Better OSPRay Studio 0.11 Camera: 1 - Resolution: 4K - Samples Per Pixel: 16 - Renderer: Path Tracer AVX-512 Off AVX-512 On 2K 4K 6K 8K 10K SE +/- 24.46, N = 3 SE +/- 10.17, N = 3 11321 9271 -mno-avx512f -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi 1. (CXX) g++ options: -O3 -march=native -ldl
OSPRay Studio Camera: 1 - Resolution: 1080p - Samples Per Pixel: 16 - Renderer: Path Tracer OpenBenchmarking.org ms, Fewer Is Better OSPRay Studio 0.11 Camera: 1 - Resolution: 1080p - Samples Per Pixel: 16 - Renderer: Path Tracer AVX-512 Off AVX-512 On 600 1200 1800 2400 3000 SE +/- 1.20, N = 3 SE +/- 2.33, N = 3 2871 2353 -mno-avx512f -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi 1. (CXX) g++ options: -O3 -march=native -ldl
OSPRay Studio Camera: 3 - Resolution: 1080p - Samples Per Pixel: 16 - Renderer: Path Tracer OpenBenchmarking.org ms, Fewer Is Better OSPRay Studio 0.11 Camera: 3 - Resolution: 1080p - Samples Per Pixel: 16 - Renderer: Path Tracer AVX-512 Off AVX-512 On 700 1400 2100 2800 3500 SE +/- 7.00, N = 3 SE +/- 3.06, N = 3 3413 2804 -mno-avx512f -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi 1. (CXX) g++ options: -O3 -march=native -ldl
OSPRay Studio Camera: 3 - Resolution: 1080p - Samples Per Pixel: 32 - Renderer: Path Tracer OpenBenchmarking.org ms, Fewer Is Better OSPRay Studio 0.11 Camera: 3 - Resolution: 1080p - Samples Per Pixel: 32 - Renderer: Path Tracer AVX-512 Off AVX-512 On 1500 3000 4500 6000 7500 SE +/- 5.51, N = 3 SE +/- 9.54, N = 3 6820 5608 -mno-avx512f -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi 1. (CXX) g++ options: -O3 -march=native -ldl
simdjson Throughput Test: TopTweet OpenBenchmarking.org GB/s, More Is Better simdjson 2.0 Throughput Test: TopTweet AVX-512 Off AVX-512 On 2 4 6 8 10 SE +/- 0.01, N = 3 SE +/- 0.08, N = 4 5.38 6.52 -mno-avx512f -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi 1. (CXX) g++ options: -O3 -march=native
OSPRay Studio Camera: 3 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path Tracer OpenBenchmarking.org ms, Fewer Is Better OSPRay Studio 0.11 Camera: 3 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path Tracer AVX-512 Off AVX-512 On 200 400 600 800 1000 SE +/- 1.15, N = 3 SE +/- 1.53, N = 3 841 694 -mno-avx512f -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi 1. (CXX) g++ options: -O3 -march=native -ldl
simdjson Throughput Test: LargeRandom OpenBenchmarking.org GB/s, More Is Better simdjson 2.0 Throughput Test: LargeRandom AVX-512 Off AVX-512 On 0.2835 0.567 0.8505 1.134 1.4175 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 1.04 1.26 -mno-avx512f -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi 1. (CXX) g++ options: -O3 -march=native
Neural Magic DeepSparse Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.1 Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-Stream AVX-512 Off AVX-512 On 130 260 390 520 650 SE +/- 0.33, N = 3 SE +/- 1.92, N = 3 509.45 616.68
OSPRay Studio Camera: 3 - Resolution: 4K - Samples Per Pixel: 16 - Renderer: Path Tracer OpenBenchmarking.org ms, Fewer Is Better OSPRay Studio 0.11 Camera: 3 - Resolution: 4K - Samples Per Pixel: 16 - Renderer: Path Tracer AVX-512 Off AVX-512 On 3K 6K 9K 12K 15K SE +/- 22.81, N = 3 SE +/- 27.14, N = 3 13398 11070 -mno-avx512f -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi 1. (CXX) g++ options: -O3 -march=native -ldl
Neural Magic DeepSparse Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.1 Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-Stream AVX-512 Off AVX-512 On 40 80 120 160 200 SE +/- 0.10, N = 3 SE +/- 0.47, N = 3 187.85 155.35
OSPRay Studio Camera: 3 - Resolution: 1080p - Samples Per Pixel: 1 - Renderer: Path Tracer OpenBenchmarking.org ms, Fewer Is Better OSPRay Studio 0.11 Camera: 3 - Resolution: 1080p - Samples Per Pixel: 1 - Renderer: Path Tracer AVX-512 Off AVX-512 On 50 100 150 200 250 SE +/- 0.58, N = 3 SE +/- 0.00, N = 3 214 177 -mno-avx512f -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi 1. (CXX) g++ options: -O3 -march=native -ldl
OSPRay Studio Camera: 3 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path Tracer OpenBenchmarking.org ms, Fewer Is Better OSPRay Studio 0.11 Camera: 3 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path Tracer AVX-512 Off AVX-512 On 6K 12K 18K 24K 30K SE +/- 15.62, N = 3 SE +/- 21.63, N = 3 26785 22184 -mno-avx512f -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi 1. (CXX) g++ options: -O3 -march=native -ldl
Embree Binary: Pathtracer ISPC - Model: Asian Dragon OpenBenchmarking.org Frames Per Second, More Is Better Embree 3.13 Binary: Pathtracer ISPC - Model: Asian Dragon AVX-512 Off AVX-512 On 50 100 150 200 250 SE +/- 0.21, N = 8 SE +/- 0.22, N = 9 176.88 212.94 MIN: 170.19 / MAX: 190 MIN: 207.72 / MAX: 227.11
Embree Binary: Pathtracer ISPC - Model: Asian Dragon Obj OpenBenchmarking.org Frames Per Second, More Is Better Embree 3.13 Binary: Pathtracer ISPC - Model: Asian Dragon Obj AVX-512 Off AVX-512 On 40 80 120 160 200 SE +/- 0.36, N = 4 SE +/- 0.62, N = 4 153.45 184.47 MIN: 130.31 / MAX: 166.17 MIN: 178.83 / MAX: 196.34
Neural Magic DeepSparse Model: CV Detection,YOLOv5s COCO - Scenario: Synchronous Single-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.1 Model: CV Detection,YOLOv5s COCO - Scenario: Synchronous Single-Stream AVX-512 Off AVX-512 On 40 80 120 160 200 SE +/- 0.17, N = 3 SE +/- 0.22, N = 3 157.82 189.56
Neural Magic DeepSparse Model: CV Detection,YOLOv5s COCO - Scenario: Synchronous Single-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.1 Model: CV Detection,YOLOv5s COCO - Scenario: Synchronous Single-Stream AVX-512 Off AVX-512 On 2 4 6 8 10 SE +/- 0.0068, N = 3 SE +/- 0.0061, N = 3 6.3313 5.2712
Embree Binary: Pathtracer ISPC - Model: Crown OpenBenchmarking.org Frames Per Second, More Is Better Embree 3.13 Binary: Pathtracer ISPC - Model: Crown AVX-512 Off AVX-512 On 40 80 120 160 200 SE +/- 0.25, N = 7 SE +/- 0.62, N = 8 151.06 180.93 MIN: 114.4 / MAX: 176.43 MIN: 124.41 / MAX: 209.74
OSPRay Studio Camera: 2 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path Tracer OpenBenchmarking.org ms, Fewer Is Better OSPRay Studio 0.11 Camera: 2 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path Tracer AVX-512 Off AVX-512 On 160 320 480 640 800 SE +/- 0.67, N = 3 SE +/- 1.00, N = 3 722 604 -mno-avx512f -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi 1. (CXX) g++ options: -O3 -march=native -ldl
OSPRay Studio Camera: 2 - Resolution: 1080p - Samples Per Pixel: 1 - Renderer: Path Tracer OpenBenchmarking.org ms, Fewer Is Better OSPRay Studio 0.11 Camera: 2 - Resolution: 1080p - Samples Per Pixel: 1 - Renderer: Path Tracer AVX-512 Off AVX-512 On 40 80 120 160 200 SE +/- 0.33, N = 3 SE +/- 0.00, N = 3 184 154 -mno-avx512f -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi 1. (CXX) g++ options: -O3 -march=native -ldl
Neural Magic DeepSparse Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.1 Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream AVX-512 Off AVX-512 On 20 40 60 80 100 SE +/- 0.05, N = 3 SE +/- 0.14, N = 3 95.33 80.08
OpenFOAM Input: drivaerFastback, Medium Mesh Size - Execution Time OpenBenchmarking.org Seconds, Fewer Is Better OpenFOAM 10 Input: drivaerFastback, Medium Mesh Size - Execution Time AVX-512 Off AVX-512 On 30 60 90 120 150 135.22 113.64 1. (CXX) g++ options: -std=c++14 -m64 -O3 -ftemplate-depth-100 -fPIC -fuse-ld=bfd -Xlinker --add-needed --no-as-needed -lfiniteVolume -lmeshTools -lparallel -llagrangian -lregionModels -lgenericPatchFields -lOpenFOAM -ldl -lm
Neural Magic DeepSparse Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.1 Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream AVX-512 Off AVX-512 On 300 600 900 1200 1500 SE +/- 0.78, N = 3 SE +/- 2.39, N = 3 1005.16 1195.94
Neural Magic DeepSparse Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Synchronous Single-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.1 Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Synchronous Single-Stream AVX-512 Off AVX-512 On 20 40 60 80 100 SE +/- 0.27, N = 3 SE +/- 0.45, N = 3 73.54 85.00
Neural Magic DeepSparse Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Synchronous Single-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.1 Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Synchronous Single-Stream AVX-512 Off AVX-512 On 3 6 9 12 15 SE +/- 0.05, N = 3 SE +/- 0.06, N = 3 13.59 11.76
OpenVKL Benchmark: vklBenchmark ISPC OpenBenchmarking.org Items / Sec, More Is Better OpenVKL 1.3.1 Benchmark: vklBenchmark ISPC AVX-512 Off AVX-512 On 300 600 900 1200 1500 SE +/- 8.11, N = 3 SE +/- 13.58, N = 3 1155 1332 MIN: 251 / MAX: 5181 MIN: 329 / MAX: 4770
OpenVINO Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2022.2.dev Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU AVX-512 Off AVX-512 On 40K 80K 120K 160K 200K SE +/- 1455.37, N = 3 SE +/- 127.59, N = 3 151239.60 170652.71 -mno-avx512f -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi 1. (CXX) g++ options: -fPIC -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -flto -shared
Neural Magic DeepSparse Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Synchronous Single-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.1 Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Synchronous Single-Stream AVX-512 Off AVX-512 On 8 16 24 32 40 SE +/- 0.03, N = 3 SE +/- 0.03, N = 3 30.61 34.52
Neural Magic DeepSparse Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Synchronous Single-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.1 Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Synchronous Single-Stream AVX-512 Off AVX-512 On 8 16 24 32 40 SE +/- 0.04, N = 3 SE +/- 0.03, N = 3 32.66 28.96
Neural Magic DeepSparse Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Synchronous Single-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.1 Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Synchronous Single-Stream AVX-512 Off AVX-512 On 8 16 24 32 40 SE +/- 0.10, N = 3 SE +/- 0.08, N = 3 30.53 34.25
Neural Magic DeepSparse Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Synchronous Single-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.1 Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Synchronous Single-Stream AVX-512 Off AVX-512 On 8 16 24 32 40 SE +/- 0.11, N = 3 SE +/- 0.07, N = 3 32.75 29.19
NCNN Target: CPU - Model: blazeface OpenBenchmarking.org ms, Fewer Is Better NCNN 20220729 Target: CPU - Model: blazeface AVX-512 Off AVX-512 On 7 14 21 28 35 SE +/- 0.54, N = 3 SE +/- 0.18, N = 8 29.00 25.88 -mno-avx512f - MIN: 26.03 / MAX: 144.12 -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi - MIN: 24.45 / MAX: 112.37 1. (CXX) g++ options: -O3 -march=native -rdynamic -lgomp -lpthread
LeelaChessZero Backend: Eigen OpenBenchmarking.org Nodes Per Second, More Is Better LeelaChessZero 0.28 Backend: Eigen AVX-512 Off AVX-512 On 2K 4K 6K 8K 10K SE +/- 43.59, N = 3 SE +/- 45.37, N = 3 8162 9096 -mno-avx512f -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi 1. (CXX) g++ options: -flto -O3 -march=native -pthread
NCNN Target: CPU - Model: regnety_400m OpenBenchmarking.org ms, Fewer Is Better NCNN 20220729 Target: CPU - Model: regnety_400m AVX-512 Off AVX-512 On 60 120 180 240 300 SE +/- 3.75, N = 3 SE +/- 2.25, N = 8 270.12 247.32 -mno-avx512f - MIN: 245.47 / MAX: 498.8 -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi - MIN: 232.61 / MAX: 506.55 1. (CXX) g++ options: -O3 -march=native -rdynamic -lgomp -lpthread
SMHasher Hash: FarmHash32 x86_64 AVX OpenBenchmarking.org MiB/sec, More Is Better SMHasher 2022-08-22 Hash: FarmHash32 x86_64 AVX AVX-512 Off AVX-512 On 9K 18K 27K 36K 45K SE +/- 28.78, N = 5 SE +/- 0.46, N = 5 36483.70 39794.44 -mno-avx512f -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi 1. (CXX) g++ options: -O3 -march=native -flto=auto -fno-fat-lto-objects
NCNN Target: CPU - Model: efficientnet-b0 OpenBenchmarking.org ms, Fewer Is Better NCNN 20220729 Target: CPU - Model: efficientnet-b0 AVX-512 Off AVX-512 On 14 28 42 56 70 SE +/- 0.31, N = 3 SE +/- 0.35, N = 8 62.86 57.71 -mno-avx512f - MIN: 59.46 / MAX: 154.82 -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi - MIN: 54.52 / MAX: 522.74 1. (CXX) g++ options: -O3 -march=native -rdynamic -lgomp -lpthread
ONNX Runtime Model: fcn-resnet101-11 - Device: CPU - Executor: Standard OpenBenchmarking.org Inferences Per Minute, More Is Better ONNX Runtime 1.11 Model: fcn-resnet101-11 - Device: CPU - Executor: Standard AVX-512 Off AVX-512 On 60 120 180 240 300 SE +/- 2.36, N = 12 SE +/- 0.44, N = 3 250 271 -mno-avx512f -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi 1. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt
LeelaChessZero Backend: BLAS OpenBenchmarking.org Nodes Per Second, More Is Better LeelaChessZero 0.28 Backend: BLAS AVX-512 Off AVX-512 On 2K 4K 6K 8K 10K SE +/- 21.53, N = 3 SE +/- 103.04, N = 4 8423 9077 -mno-avx512f -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi 1. (CXX) g++ options: -flto -O3 -march=native -pthread
CP2K Molecular Dynamics Input: Fayalite-FIST OpenBenchmarking.org Seconds, Fewer Is Better CP2K Molecular Dynamics 8.2 Input: Fayalite-FIST AVX-512 Off AVX-512 On 300 600 900 1200 1500 1198.41 1122.73
Mobile Neural Network Model: SqueezeNetV1.0 OpenBenchmarking.org ms, Fewer Is Better Mobile Neural Network 2.1 Model: SqueezeNetV1.0 AVX-512 Off AVX-512 On 3 6 9 12 15 SE +/- 0.091, N = 8 SE +/- 0.147, N = 9 9.146 8.579 -mno-avx512f - MIN: 7.72 / MAX: 19.03 -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi - MIN: 6.67 / MAX: 21.5 1. (CXX) g++ options: -O3 -march=native -std=c++11 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl
OpenFOAM Input: drivaerFastback, Medium Mesh Size - Mesh Time OpenBenchmarking.org Seconds, Fewer Is Better OpenFOAM 10 Input: drivaerFastback, Medium Mesh Size - Mesh Time AVX-512 Off AVX-512 On 30 60 90 120 150 144.35 135.77 1. (CXX) g++ options: -std=c++14 -m64 -O3 -ftemplate-depth-100 -fPIC -fuse-ld=bfd -Xlinker --add-needed --no-as-needed -lfiniteVolume -lmeshTools -lparallel -llagrangian -lregionModels -lgenericPatchFields -lOpenFOAM -ldl -lm
Neural Magic DeepSparse Model: NLP Text Classification, DistilBERT mnli - Scenario: Synchronous Single-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.1 Model: NLP Text Classification, DistilBERT mnli - Scenario: Synchronous Single-Stream AVX-512 Off AVX-512 On 40 80 120 160 200 SE +/- 0.29, N = 3 SE +/- 0.11, N = 3 177.54 187.08
Neural Magic DeepSparse Model: NLP Text Classification, DistilBERT mnli - Scenario: Synchronous Single-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.1 Model: NLP Text Classification, DistilBERT mnli - Scenario: Synchronous Single-Stream AVX-512 Off AVX-512 On 1.2663 2.5326 3.7989 5.0652 6.3315 SE +/- 0.0091, N = 3 SE +/- 0.0031, N = 3 5.6282 5.3413
Numpy Benchmark OpenBenchmarking.org Score, More Is Better Numpy Benchmark AVX-512 Off AVX-512 On 120 240 360 480 600 SE +/- 0.59, N = 3 SE +/- 2.18, N = 3 548.83 575.66
JPEG XL libjxl Input: JPEG - Quality: 90 OpenBenchmarking.org MP/s, More Is Better JPEG XL libjxl 0.7 Input: JPEG - Quality: 90 AVX-512 Off AVX-512 On 3 6 9 12 15 SE +/- 0.03, N = 3 SE +/- 0.04, N = 3 9.13 9.55 -mno-avx512f -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi 1. (CXX) g++ options: -O3 -march=native -fno-rtti -funwind-tables -O2 -fPIE -pie -lm -latomic
NCNN Target: CPU - Model: googlenet OpenBenchmarking.org ms, Fewer Is Better NCNN 20220729 Target: CPU - Model: googlenet AVX-512 Off AVX-512 On 20 40 60 80 100 SE +/- 1.35, N = 3 SE +/- 0.76, N = 8 76.13 72.80 -mno-avx512f - MIN: 70.13 / MAX: 155.61 -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi - MIN: 67.13 / MAX: 388.52 1. (CXX) g++ options: -O3 -march=native -rdynamic -lgomp -lpthread
JPEG XL libjxl Input: PNG - Quality: 90 OpenBenchmarking.org MP/s, More Is Better JPEG XL libjxl 0.7 Input: PNG - Quality: 90 AVX-512 Off AVX-512 On 3 6 9 12 15 SE +/- 0.02, N = 3 SE +/- 0.02, N = 3 9.52 9.95 -mno-avx512f -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi 1. (CXX) g++ options: -O3 -march=native -fno-rtti -funwind-tables -O2 -fPIE -pie -lm -latomic
NCNN Target: CPU - Model: mnasnet OpenBenchmarking.org ms, Fewer Is Better NCNN 20220729 Target: CPU - Model: mnasnet AVX-512 Off AVX-512 On 10 20 30 40 50 SE +/- 0.49, N = 3 SE +/- 0.26, N = 8 44.19 42.30 -mno-avx512f - MIN: 41.56 / MAX: 148.98 -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi - MIN: 39.64 / MAX: 571.78 1. (CXX) g++ options: -O3 -march=native -rdynamic -lgomp -lpthread
Numenta Anomaly Benchmark Detector: Bayesian Changepoint OpenBenchmarking.org Seconds, Fewer Is Better Numenta Anomaly Benchmark 1.1 Detector: Bayesian Changepoint AVX-512 Off AVX-512 On 4 8 12 16 20 SE +/- 0.19, N = 5 SE +/- 0.21, N = 4 17.39 16.68
oneDNN Harness: Convolution Batch Shapes Auto - Data Type: f32 - Engine: CPU OpenBenchmarking.org ms, Fewer Is Better oneDNN 2.7 Harness: Convolution Batch Shapes Auto - Data Type: f32 - Engine: CPU AVX-512 Off AVX-512 On 0.121 0.242 0.363 0.484 0.605 SE +/- 0.004200, N = 15 SE +/- 0.004067, N = 7 0.537682 0.516167 -mno-avx512f - MIN: 0.42 -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi - MIN: 0.42 1. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread
Intel Open Image Denoise Run: RTLightmap.hdr.4096x4096 OpenBenchmarking.org Images / Sec, More Is Better Intel Open Image Denoise 1.4.0 Run: RTLightmap.hdr.4096x4096 AVX-512 Off AVX-512 On 0.387 0.774 1.161 1.548 1.935 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 1.72 1.66
ONNX Runtime Model: bertsquad-12 - Device: CPU - Executor: Standard OpenBenchmarking.org Inferences Per Minute, More Is Better ONNX Runtime 1.11 Model: bertsquad-12 - Device: CPU - Executor: Standard AVX-512 Off AVX-512 On 110 220 330 440 550 SE +/- 3.11, N = 3 SE +/- 1.86, N = 3 499 516 -mno-avx512f -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi 1. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt
Numenta Anomaly Benchmark Detector: Windowed Gaussian OpenBenchmarking.org Seconds, Fewer Is Better Numenta Anomaly Benchmark 1.1 Detector: Windowed Gaussian AVX-512 Off AVX-512 On 1.0985 2.197 3.2955 4.394 5.4925 SE +/- 0.044, N = 7 SE +/- 0.032, N = 15 4.882 4.727
JPEG XL libjxl Input: JPEG - Quality: 100 OpenBenchmarking.org MP/s, More Is Better JPEG XL libjxl 0.7 Input: JPEG - Quality: 100 AVX-512 Off AVX-512 On 0.1665 0.333 0.4995 0.666 0.8325 SE +/- 0.01, N = 9 SE +/- 0.01, N = 9 0.72 0.74 -mno-avx512f -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi 1. (CXX) g++ options: -O3 -march=native -fno-rtti -funwind-tables -O2 -fPIE -pie -lm -latomic
Darmstadt Automotive Parallel Heterogeneous Suite Backend: OpenMP - Kernel: NDT Mapping OpenBenchmarking.org Test Cases Per Minute, More Is Better Darmstadt Automotive Parallel Heterogeneous Suite Backend: OpenMP - Kernel: NDT Mapping AVX-512 Off AVX-512 On 300 600 900 1200 1500 SE +/- 8.66, N = 3 SE +/- 5.94, N = 3 1335.63 1371.18 1. (CXX) g++ options: -O3 -std=c++11 -fopenmp
NCNN Target: CPU - Model: resnet50 OpenBenchmarking.org ms, Fewer Is Better NCNN 20220729 Target: CPU - Model: resnet50 AVX-512 Off AVX-512 On 15 30 45 60 75 SE +/- 0.89, N = 3 SE +/- 0.50, N = 8 67.48 66.34 -mno-avx512f - MIN: 63.4 / MAX: 170.14 -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi - MIN: 62.92 / MAX: 194.74 1. (CXX) g++ options: -O3 -march=native -rdynamic -lgomp -lpthread
GROMACS Implementation: MPI CPU - Input: water_GMX50_bare OpenBenchmarking.org Ns Per Day, More Is Better GROMACS 2022.1 Implementation: MPI CPU - Input: water_GMX50_bare AVX-512 Off AVX-512 On 5 10 15 20 25 SE +/- 0.10, N = 3 SE +/- 0.24, N = 3 18.47 18.76 -mno-avx512f -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi 1. (CXX) g++ options: -O3 -march=native
Numenta Anomaly Benchmark Detector: Relative Entropy OpenBenchmarking.org Seconds, Fewer Is Better Numenta Anomaly Benchmark 1.1 Detector: Relative Entropy AVX-512 Off AVX-512 On 3 6 9 12 15 SE +/- 0.082, N = 5 SE +/- 0.089, N = 5 10.035 9.898
oneDNN Harness: Deconvolution Batch shapes_1d - Data Type: f32 - Engine: CPU OpenBenchmarking.org ms, Fewer Is Better oneDNN 2.7 Harness: Deconvolution Batch shapes_1d - Data Type: f32 - Engine: CPU AVX-512 Off AVX-512 On 5 10 15 20 25 SE +/- 0.06, N = 3 SE +/- 0.16, N = 3 22.84 22.59 -mno-avx512f - MIN: 20.22 -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi - MIN: 19.6 1. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread
Intel Open Image Denoise Run: RT.hdr_alb_nrm.3840x2160 OpenBenchmarking.org Images / Sec, More Is Better Intel Open Image Denoise 1.4.0 Run: RT.hdr_alb_nrm.3840x2160 AVX-512 Off AVX-512 On 0.7898 1.5796 2.3694 3.1592 3.949 SE +/- 0.03, N = 5 SE +/- 0.01, N = 5 3.50 3.51
Intel Open Image Denoise Run: RT.ldr_alb_nrm.3840x2160 OpenBenchmarking.org Images / Sec, More Is Better Intel Open Image Denoise 1.4.0 Run: RT.ldr_alb_nrm.3840x2160 AVX-512 Off AVX-512 On 0.7898 1.5796 2.3694 3.1592 3.949 SE +/- 0.01, N = 5 SE +/- 0.01, N = 5 3.51 3.51
CPU Temperature Monitor Phoronix Test Suite System Monitoring OpenBenchmarking.org Celsius CPU Temperature Monitor Phoronix Test Suite System Monitoring AVX-512 Off AVX-512 On 14 28 42 56 70 Min: 35.5 / Avg: 51.26 / Max: 73.75 Min: 30.13 / Avg: 49.97 / Max: 73.38
CPU Power Consumption Monitor Phoronix Test Suite System Monitoring OpenBenchmarking.org Watts CPU Power Consumption Monitor Phoronix Test Suite System Monitoring AVX-512 Off AVX-512 On 130 260 390 520 650 Min: 106.95 / Avg: 449.58 / Max: 735.32 Min: 26.37 / Avg: 434.8 / Max: 766.01
JPEG XL libjxl CPU Temperature Monitor Min Avg Max AVX-512 Off 35.9 36.7 44.9 AVX-512 On 32.4 37.0 49.3 OpenBenchmarking.org Celsius, Fewer Is Better JPEG XL libjxl 0.7 CPU Temperature Monitor 14 28 42 56 70
JPEG XL libjxl CPU Power Consumption Monitor Min Avg Max AVX-512 Off 134.0 232.4 317.2 AVX-512 On 56.1 222.2 318.2 OpenBenchmarking.org Watts, Fewer Is Better JPEG XL libjxl 0.7 CPU Power Consumption Monitor 80 160 240 320 400
JPEG XL libjxl CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max AVX-512 Off 2439 3696 3828 AVX-512 On 2400 3643 3712 OpenBenchmarking.org Megahertz, More Is Better JPEG XL libjxl 0.7 CPU Peak Freq (Highest CPU Core Frequency) Monitor 1000 2000 3000 4000 5000
JPEG XL libjxl Input: PNG - Quality: 90 OpenBenchmarking.org MP/s Per Watt, More Is Better JPEG XL libjxl 0.7 Input: PNG - Quality: 90 AVX-512 Off AVX-512 On 0.0101 0.0202 0.0303 0.0404 0.0505 0.041 0.045
JPEG XL libjxl CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better JPEG XL libjxl 0.7 CPU Temperature Monitor AVX-512 Off AVX-512 On 10 20 30 40 50 Min: 35.5 / Avg: 36.56 / Max: 46.63 Min: 32.75 / Avg: 36.48 / Max: 49.75
JPEG XL libjxl CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better JPEG XL libjxl 0.7 CPU Power Consumption Monitor AVX-512 Off AVX-512 On 50 100 150 200 250 Min: 110.34 / Avg: 222.62 / Max: 261.2 Min: 28.84 / Avg: 217.33 / Max: 256.47
JPEG XL libjxl CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better JPEG XL libjxl 0.7 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 Off AVX-512 On 800 1600 2400 3200 4000 Min: 3414 / Avg: 3701.38 / Max: 4381 Min: 2400 / Avg: 3682.16 / Max: 4023
JPEG XL libjxl Input: JPEG - Quality: 100 OpenBenchmarking.org MP/s Per Watt, More Is Better JPEG XL libjxl 0.7 Input: JPEG - Quality: 100 AVX-512 Off AVX-512 On 0.0007 0.0014 0.0021 0.0028 0.0035 0.003 0.003
JPEG XL libjxl CPU Temperature Monitor Min Avg Max AVX-512 Off 36.8 39.4 48.9 AVX-512 On 35.0 39.7 46.6 OpenBenchmarking.org Celsius, Fewer Is Better JPEG XL libjxl 0.7 CPU Temperature Monitor 14 28 42 56 70
JPEG XL libjxl CPU Power Consumption Monitor Min Avg Max AVX-512 Off 142.6 233.9 323.3 AVX-512 On 54.8 223.4 308.1 OpenBenchmarking.org Watts, Fewer Is Better JPEG XL libjxl 0.7 CPU Power Consumption Monitor 80 160 240 320 400
JPEG XL libjxl CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max AVX-512 Off 3669 3701 3814 AVX-512 On 2400 3657 3712 OpenBenchmarking.org Megahertz, More Is Better JPEG XL libjxl 0.7 CPU Peak Freq (Highest CPU Core Frequency) Monitor 1000 2000 3000 4000 5000
JPEG XL libjxl Input: JPEG - Quality: 90 OpenBenchmarking.org MP/s Per Watt, More Is Better JPEG XL libjxl 0.7 Input: JPEG - Quality: 90 AVX-512 Off AVX-512 On 0.0097 0.0194 0.0291 0.0388 0.0485 0.039 0.043
SMHasher Hash: FarmHash32 x86_64 AVX OpenBenchmarking.org cycles/hash, Fewer Is Better SMHasher 2022-08-22 Hash: FarmHash32 x86_64 AVX AVX-512 Off AVX-512 On 6 12 18 24 30 SE +/- 0.00, N = 5 SE +/- 0.00, N = 5 26.41 26.39 -mno-avx512f -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi 1. (CXX) g++ options: -O3 -march=native -flto=auto -fno-fat-lto-objects
CP2K Molecular Dynamics CPU Temperature Monitor Min Avg Max AVX-512 Off 42.1 44.4 56.9 AVX-512 On 42.1 44.5 53.5 OpenBenchmarking.org Celsius, Fewer Is Better CP2K Molecular Dynamics 8.2 CPU Temperature Monitor 16 32 48 64 80
CP2K Molecular Dynamics CPU Power Consumption Monitor Min Avg Max AVX-512 Off 118.3 361.5 403.0 AVX-512 On 58.1 358.0 402.6 OpenBenchmarking.org Watts, Fewer Is Better CP2K Molecular Dynamics 8.2 CPU Power Consumption Monitor 110 220 330 440 550
CP2K Molecular Dynamics CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max AVX-512 Off 3569 3665 3808 AVX-512 On 2400 3661 3700 OpenBenchmarking.org Megahertz, More Is Better CP2K Molecular Dynamics 8.2 CPU Peak Freq (Highest CPU Core Frequency) Monitor 1000 2000 3000 4000 5000
OpenFOAM CPU Temperature Monitor Min Avg Max AVX-512 Off 47.0 64.9 70.3 AVX-512 On 41.3 62.6 68.5 OpenBenchmarking.org Celsius, Fewer Is Better OpenFOAM 10 CPU Temperature Monitor 20 40 60 80 100
OpenFOAM CPU Power Consumption Monitor Min Avg Max AVX-512 Off 220 674 735 AVX-512 On 57 662 731 OpenBenchmarking.org Watts, Fewer Is Better OpenFOAM 10 CPU Power Consumption Monitor 200 400 600 800 1000
OpenFOAM CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max AVX-512 Off 2917 3265 3714 AVX-512 On 2400 3186 3701 OpenBenchmarking.org Megahertz, More Is Better OpenFOAM 10 CPU Peak Freq (Highest CPU Core Frequency) Monitor 1000 2000 3000 4000 5000
simdjson CPU Temperature Monitor Min Avg Max AVX-512 Off 36.8 46.2 47.5 AVX-512 On 32.4 36.1 37.3 OpenBenchmarking.org Celsius, Fewer Is Better simdjson 2.0 CPU Temperature Monitor 14 28 42 56 70
simdjson CPU Power Consumption Monitor Min Avg Max AVX-512 Off 111.2 221.5 223.4 AVX-512 On 55.3 209.4 219.2 OpenBenchmarking.org Watts, Fewer Is Better simdjson 2.0 CPU Power Consumption Monitor 60 120 180 240 300
simdjson CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max AVX-512 Off 3694 3701 3912 AVX-512 On 2400 3640 3701 OpenBenchmarking.org Megahertz, More Is Better simdjson 2.0 CPU Peak Freq (Highest CPU Core Frequency) Monitor 1000 2000 3000 4000 5000
simdjson Throughput Test: TopTweet OpenBenchmarking.org GB/s Per Watt, More Is Better simdjson 2.0 Throughput Test: TopTweet AVX-512 Off AVX-512 On 0.007 0.014 0.021 0.028 0.035 0.024 0.031
simdjson CPU Temperature Monitor Min Avg Max AVX-512 Off 37.3 46.9 48.1 AVX-512 On 32.4 36.2 37.3 OpenBenchmarking.org Celsius, Fewer Is Better simdjson 2.0 CPU Temperature Monitor 14 28 42 56 70
simdjson CPU Power Consumption Monitor Min Avg Max AVX-512 Off 111.3 221.2 223.7 AVX-512 On 35.8 209.0 219.1 OpenBenchmarking.org Watts, Fewer Is Better simdjson 2.0 CPU Power Consumption Monitor 60 120 180 240 300
simdjson CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max AVX-512 Off 3694 3703 3925 AVX-512 On 2400 3643 3754 OpenBenchmarking.org Megahertz, More Is Better simdjson 2.0 CPU Peak Freq (Highest CPU Core Frequency) Monitor 1000 2000 3000 4000 5000
simdjson Throughput Test: DistinctUserID OpenBenchmarking.org GB/s Per Watt, More Is Better simdjson 2.0 Throughput Test: DistinctUserID AVX-512 Off AVX-512 On 0.0074 0.0148 0.0222 0.0296 0.037 0.024 0.033
simdjson CPU Temperature Monitor Min Avg Max AVX-512 Off 37.3 46.3 48.6 AVX-512 On 33.3 36.4 37.3 OpenBenchmarking.org Celsius, Fewer Is Better simdjson 2.0 CPU Temperature Monitor 14 28 42 56 70
simdjson CPU Power Consumption Monitor Min Avg Max AVX-512 Off 112.5 223.5 225.7 AVX-512 On 54.4 209.9 221.6 OpenBenchmarking.org Watts, Fewer Is Better simdjson 2.0 CPU Power Consumption Monitor 60 120 180 240 300
simdjson CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max AVX-512 Off 3694 3704 3981 AVX-512 On 2400 3625 3702 OpenBenchmarking.org Megahertz, More Is Better simdjson 2.0 CPU Peak Freq (Highest CPU Core Frequency) Monitor 1100 2200 3300 4400 5500
simdjson Throughput Test: Kostya OpenBenchmarking.org GB/s Per Watt, More Is Better simdjson 2.0 Throughput Test: Kostya AVX-512 Off AVX-512 On 0.0045 0.009 0.0135 0.018 0.0225 0.015 0.020
simdjson CPU Temperature Monitor Min Avg Max AVX-512 Off 37.8 47.0 49.8 AVX-512 On 33.3 36.7 37.8 OpenBenchmarking.org Celsius, Fewer Is Better simdjson 2.0 CPU Temperature Monitor 14 28 42 56 70
simdjson CPU Power Consumption Monitor Min Avg Max AVX-512 Off 111.6 222.5 224.6 AVX-512 On 53.8 207.0 220.8 OpenBenchmarking.org Watts, Fewer Is Better simdjson 2.0 CPU Power Consumption Monitor 60 120 180 240 300
simdjson CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max AVX-512 Off 3694 3701 3788 AVX-512 On 2400 3601 3700 OpenBenchmarking.org Megahertz, More Is Better simdjson 2.0 CPU Peak Freq (Highest CPU Core Frequency) Monitor 1000 2000 3000 4000 5000
simdjson Throughput Test: LargeRandom OpenBenchmarking.org GB/s Per Watt, More Is Better simdjson 2.0 Throughput Test: LargeRandom AVX-512 Off AVX-512 On 0.0014 0.0028 0.0042 0.0056 0.007 0.005 0.006
simdjson CPU Temperature Monitor Min Avg Max AVX-512 Off 39.0 51.0 60.1 AVX-512 On 36.4 40.5 47.5 OpenBenchmarking.org Celsius, Fewer Is Better simdjson 2.0 CPU Temperature Monitor 16 32 48 64 80
simdjson CPU Power Consumption Monitor Min Avg Max AVX-512 Off 113.7 224.4 230.2 AVX-512 On 50.2 211.4 225.1 OpenBenchmarking.org Watts, Fewer Is Better simdjson 2.0 CPU Power Consumption Monitor 60 120 180 240 300
simdjson CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max AVX-512 Off 3694 3702 4016 AVX-512 On 2400 3639 3702 OpenBenchmarking.org Megahertz, More Is Better simdjson 2.0 CPU Peak Freq (Highest CPU Core Frequency) Monitor 1100 2200 3300 4400 5500
simdjson Throughput Test: PartialTweets OpenBenchmarking.org GB/s Per Watt, More Is Better simdjson 2.0 Throughput Test: PartialTweets AVX-512 Off AVX-512 On 0.0072 0.0144 0.0216 0.0288 0.036 0.023 0.032
Darmstadt Automotive Parallel Heterogeneous Suite CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better Darmstadt Automotive Parallel Heterogeneous Suite CPU Temperature Monitor AVX-512 Off AVX-512 On 10 20 30 40 50 Min: 36.75 / Avg: 39.2 / Max: 49.75 Min: 31.25 / Avg: 38.03 / Max: 47.5
Darmstadt Automotive Parallel Heterogeneous Suite CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better Darmstadt Automotive Parallel Heterogeneous Suite CPU Power Consumption Monitor AVX-512 Off AVX-512 On 50 100 150 200 250 Min: 136.19 / Avg: 273.1 / Max: 289.31 Min: 49.36 / Avg: 258.94 / Max: 283.12
Darmstadt Automotive Parallel Heterogeneous Suite CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better Darmstadt Automotive Parallel Heterogeneous Suite CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 Off AVX-512 On 800 1600 2400 3200 4000 Min: 3694 / Avg: 3698.64 / Max: 4768 Min: 2400 / Avg: 3647.5 / Max: 3715
Darmstadt Automotive Parallel Heterogeneous Suite Backend: OpenMP - Kernel: Points2Image OpenBenchmarking.org Test Cases Per Minute Per Watt, More Is Better Darmstadt Automotive Parallel Heterogeneous Suite Backend: OpenMP - Kernel: Points2Image AVX-512 Off AVX-512 On 12 24 36 48 60 42.19 52.82
Darmstadt Automotive Parallel Heterogeneous Suite Backend: OpenMP - Kernel: Points2Image OpenBenchmarking.org Test Cases Per Minute, More Is Better Darmstadt Automotive Parallel Heterogeneous Suite Backend: OpenMP - Kernel: Points2Image AVX-512 Off AVX-512 On 3K 6K 9K 12K 15K SE +/- 269.82, N = 15 SE +/- 126.17, N = 15 11521.38 13677.76 1. (CXX) g++ options: -O3 -std=c++11 -fopenmp
Darmstadt Automotive Parallel Heterogeneous Suite CPU Temperature Monitor Min Avg Max AVX-512 Off 37.8 39.4 49.5 AVX-512 On 32.4 35.4 36.4 OpenBenchmarking.org Celsius, Fewer Is Better Darmstadt Automotive Parallel Heterogeneous Suite CPU Temperature Monitor 14 28 42 56 70
Darmstadt Automotive Parallel Heterogeneous Suite CPU Power Consumption Monitor Min Avg Max AVX-512 Off 215.0 244.8 282.7 AVX-512 On 37.8 213.7 282.2 OpenBenchmarking.org Watts, Fewer Is Better Darmstadt Automotive Parallel Heterogeneous Suite CPU Power Consumption Monitor 70 140 210 280 350
Darmstadt Automotive Parallel Heterogeneous Suite CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max AVX-512 Off 3694 3719 4426 AVX-512 On 2400 3516 3702 OpenBenchmarking.org Megahertz, More Is Better Darmstadt Automotive Parallel Heterogeneous Suite CPU Peak Freq (Highest CPU Core Frequency) Monitor 1100 2200 3300 4400 5500
Darmstadt Automotive Parallel Heterogeneous Suite Backend: OpenMP - Kernel: NDT Mapping OpenBenchmarking.org Test Cases Per Minute Per Watt, More Is Better Darmstadt Automotive Parallel Heterogeneous Suite Backend: OpenMP - Kernel: NDT Mapping AVX-512 Off AVX-512 On 2 4 6 8 10 5.455 6.416
Intel Open Image Denoise CPU Temperature Monitor Min Avg Max AVX-512 Off 39.9 44.7 49.8 AVX-512 On 32.8 39.8 46.4 OpenBenchmarking.org Celsius, Fewer Is Better Intel Open Image Denoise 1.4.0 CPU Temperature Monitor 14 28 42 56 70
Intel Open Image Denoise CPU Power Consumption Monitor Min Avg Max AVX-512 Off 207.2 399.0 572.6 AVX-512 On 52.8 325.6 574.0 OpenBenchmarking.org Watts, Fewer Is Better Intel Open Image Denoise 1.4.0 CPU Power Consumption Monitor 140 280 420 560 700
Intel Open Image Denoise CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max AVX-512 Off 3017 3636 4215 AVX-512 On 2400 3216 3699 OpenBenchmarking.org Megahertz, More Is Better Intel Open Image Denoise 1.4.0 CPU Peak Freq (Highest CPU Core Frequency) Monitor 1100 2200 3300 4400 5500
Intel Open Image Denoise Run: RTLightmap.hdr.4096x4096 OpenBenchmarking.org Images / Sec Per Watt, More Is Better Intel Open Image Denoise 1.4.0 Run: RTLightmap.hdr.4096x4096 AVX-512 Off AVX-512 On 0.0011 0.0022 0.0033 0.0044 0.0055 0.004 0.005
Intel Open Image Denoise CPU Temperature Monitor Min Avg Max AVX-512 Off 39.5 43.3 48.4 AVX-512 On 32.8 38.2 44.1 OpenBenchmarking.org Celsius, Fewer Is Better Intel Open Image Denoise 1.4.0 CPU Temperature Monitor 14 28 42 56 70
Intel Open Image Denoise CPU Power Consumption Monitor Min Avg Max AVX-512 Off 208.7 365.6 577.3 AVX-512 On 52.1 288.6 574.3 OpenBenchmarking.org Watts, Fewer Is Better Intel Open Image Denoise 1.4.0 CPU Power Consumption Monitor 140 280 420 560 700
Intel Open Image Denoise CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max AVX-512 Off 2854 3610 3919 AVX-512 On 2400 3212 3702 OpenBenchmarking.org Megahertz, More Is Better Intel Open Image Denoise 1.4.0 CPU Peak Freq (Highest CPU Core Frequency) Monitor 1000 2000 3000 4000 5000
Intel Open Image Denoise Run: RT.ldr_alb_nrm.3840x2160 OpenBenchmarking.org Images / Sec Per Watt, More Is Better Intel Open Image Denoise 1.4.0 Run: RT.ldr_alb_nrm.3840x2160 AVX-512 Off AVX-512 On 0.0027 0.0054 0.0081 0.0108 0.0135 0.010 0.012
Intel Open Image Denoise CPU Temperature Monitor Min Avg Max AVX-512 Off 36.8 41.6 47.0 AVX-512 On 32.4 38.1 44.9 OpenBenchmarking.org Celsius, Fewer Is Better Intel Open Image Denoise 1.4.0 CPU Temperature Monitor 14 28 42 56 70
Intel Open Image Denoise CPU Power Consumption Monitor Min Avg Max AVX-512 Off 206.5 366.7 574.9 AVX-512 On 48.8 287.6 572.9 OpenBenchmarking.org Watts, Fewer Is Better Intel Open Image Denoise 1.4.0 CPU Power Consumption Monitor 140 280 420 560 700
Intel Open Image Denoise CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max AVX-512 Off 2718 3626 4090 AVX-512 On 2400 3124 3699 OpenBenchmarking.org Megahertz, More Is Better Intel Open Image Denoise 1.4.0 CPU Peak Freq (Highest CPU Core Frequency) Monitor 1100 2200 3300 4400 5500
Intel Open Image Denoise Run: RT.hdr_alb_nrm.3840x2160 OpenBenchmarking.org Images / Sec Per Watt, More Is Better Intel Open Image Denoise 1.4.0 Run: RT.hdr_alb_nrm.3840x2160 AVX-512 Off AVX-512 On 0.0027 0.0054 0.0081 0.0108 0.0135 0.010 0.012
Numenta Anomaly Benchmark CPU Temperature Monitor Min Avg Max AVX-512 Off 37.8 41.5 50.4 AVX-512 On 31.5 38.8 47.0 OpenBenchmarking.org Celsius, Fewer Is Better Numenta Anomaly Benchmark 1.1 CPU Temperature Monitor 14 28 42 56 70
Numenta Anomaly Benchmark CPU Power Consumption Monitor Min Avg Max AVX-512 Off 213.2 250.8 339.2 AVX-512 On 53.6 202.8 367.2 OpenBenchmarking.org Watts, Fewer Is Better Numenta Anomaly Benchmark 1.1 CPU Power Consumption Monitor 100 200 300 400 500
Numenta Anomaly Benchmark CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max AVX-512 Off 3694 3702 3768 AVX-512 On 2400 3437 3911 OpenBenchmarking.org Megahertz, More Is Better Numenta Anomaly Benchmark 1.1 CPU Peak Freq (Highest CPU Core Frequency) Monitor 1000 2000 3000 4000 5000
Numenta Anomaly Benchmark CPU Temperature Monitor Min Avg Max AVX-512 Off 37.8 42.8 60.4 AVX-512 On 32.4 39.2 53.3 OpenBenchmarking.org Celsius, Fewer Is Better Numenta Anomaly Benchmark 1.1 CPU Temperature Monitor 20 40 60 80 100
Numenta Anomaly Benchmark CPU Power Consumption Monitor Min Avg Max AVX-512 Off 212.5 259.2 394.2 AVX-512 On 53.3 184.7 388.1 OpenBenchmarking.org Watts, Fewer Is Better Numenta Anomaly Benchmark 1.1 CPU Power Consumption Monitor 110 220 330 440 550
Numenta Anomaly Benchmark CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max AVX-512 Off 3694 3718 3948 AVX-512 On 2400 3237 3715 OpenBenchmarking.org Megahertz, More Is Better Numenta Anomaly Benchmark 1.1 CPU Peak Freq (Highest CPU Core Frequency) Monitor 1000 2000 3000 4000 5000
Numenta Anomaly Benchmark CPU Temperature Monitor Min Avg Max AVX-512 Off 38.6 43.2 49.9 AVX-512 On 32.4 40.4 50.1 OpenBenchmarking.org Celsius, Fewer Is Better Numenta Anomaly Benchmark 1.1 CPU Temperature Monitor 14 28 42 56 70
Numenta Anomaly Benchmark CPU Power Consumption Monitor Min Avg Max AVX-512 Off 137.1 251.1 391.0 AVX-512 On 55.1 216.0 378.8 OpenBenchmarking.org Watts, Fewer Is Better Numenta Anomaly Benchmark 1.1 CPU Power Consumption Monitor 100 200 300 400 500
Numenta Anomaly Benchmark CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max AVX-512 Off 3694 3707 4079 AVX-512 On 2400 3532 3699 OpenBenchmarking.org Megahertz, More Is Better Numenta Anomaly Benchmark 1.1 CPU Peak Freq (Highest CPU Core Frequency) Monitor 1100 2200 3300 4400 5500
SVT-AV1 CPU Temperature Monitor Min Avg Max AVX-512 Off 37.8 40.5 48.1 AVX-512 On 30.6 34.6 43.0 OpenBenchmarking.org Celsius, Fewer Is Better SVT-AV1 1.4 CPU Temperature Monitor 14 28 42 56 70
SVT-AV1 CPU Power Consumption Monitor Min Avg Max AVX-512 Off 127.1 241.8 338.9 AVX-512 On 52.7 175.4 338.1 OpenBenchmarking.org Watts, Fewer Is Better SVT-AV1 1.4 CPU Power Consumption Monitor 80 160 240 320 400
SVT-AV1 CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max AVX-512 Off 3694 3718 3985 AVX-512 On 2400 3274 3770 OpenBenchmarking.org Megahertz, More Is Better SVT-AV1 1.4 CPU Peak Freq (Highest CPU Core Frequency) Monitor 1100 2200 3300 4400 5500
SVT-AV1 Encoder Mode: Preset 12 - Input: Bosphorus 4K OpenBenchmarking.org Frames Per Second Per Watt, More Is Better SVT-AV1 1.4 Encoder Mode: Preset 12 - Input: Bosphorus 4K AVX-512 Off AVX-512 On 0.315 0.63 0.945 1.26 1.575 0.968 1.400
SVT-AV1 Encoder Mode: Preset 12 - Input: Bosphorus 4K OpenBenchmarking.org Frames Per Second, More Is Better SVT-AV1 1.4 Encoder Mode: Preset 12 - Input: Bosphorus 4K AVX-512 Off AVX-512 On 50 100 150 200 250 SE +/- 3.57, N = 15 SE +/- 4.78, N = 15 233.94 245.56
SVT-AV1 CPU Temperature Monitor Min Avg Max AVX-512 Off 39.0 42.4 49.3 AVX-512 On 32.4 36.8 49.3 OpenBenchmarking.org Celsius, Fewer Is Better SVT-AV1 1.4 CPU Temperature Monitor 14 28 42 56 70
SVT-AV1 CPU Power Consumption Monitor Min Avg Max AVX-512 Off 108.8 243.3 325.0 AVX-512 On 52.7 162.9 323.1 OpenBenchmarking.org Watts, Fewer Is Better SVT-AV1 1.4 CPU Power Consumption Monitor 80 160 240 320 400
SVT-AV1 CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max AVX-512 Off 3694 3728 4349 AVX-512 On 2400 3202 3756 OpenBenchmarking.org Megahertz, More Is Better SVT-AV1 1.4 CPU Peak Freq (Highest CPU Core Frequency) Monitor 1100 2200 3300 4400 5500
SVT-AV1 Encoder Mode: Preset 13 - Input: Bosphorus 4K OpenBenchmarking.org Frames Per Second Per Watt, More Is Better SVT-AV1 1.4 Encoder Mode: Preset 13 - Input: Bosphorus 4K AVX-512 Off AVX-512 On 0.3404 0.6808 1.0212 1.3616 1.702 0.986 1.513
SVT-AV1 Encoder Mode: Preset 13 - Input: Bosphorus 4K OpenBenchmarking.org Frames Per Second, More Is Better SVT-AV1 1.4 Encoder Mode: Preset 13 - Input: Bosphorus 4K AVX-512 Off AVX-512 On 50 100 150 200 250 SE +/- 4.01, N = 15 SE +/- 4.74, N = 15 239.88 246.57
miniBUDE CPU Temperature Monitor Min Avg Max AVX-512 Off 40.4 53.0 60.1 AVX-512 On 32.8 47.7 56.0 OpenBenchmarking.org Celsius, Fewer Is Better miniBUDE 20210901 CPU Temperature Monitor 16 32 48 64 80
miniBUDE CPU Power Consumption Monitor Min Avg Max AVX-512 Off 211 564 661 AVX-512 On 54 499 647 OpenBenchmarking.org Watts, Fewer Is Better miniBUDE 20210901 CPU Power Consumption Monitor 200 400 600 800 1000
miniBUDE CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max AVX-512 Off 2905 3288 3891 AVX-512 On 2400 3201 3697 OpenBenchmarking.org Megahertz, More Is Better miniBUDE 20210901 CPU Peak Freq (Highest CPU Core Frequency) Monitor 1000 2000 3000 4000 5000
miniBUDE Implementation: OpenMP - Input Deck: BM2 OpenBenchmarking.org Billion Interactions/s Per Watt, More Is Better miniBUDE 20210901 Implementation: OpenMP - Input Deck: BM2 AVX-512 Off AVX-512 On 0.1562 0.3124 0.4686 0.6248 0.781 0.453 0.694
miniBUDE CPU Temperature Monitor Min Avg Max AVX-512 Off 38.6 45.5 52.4 AVX-512 On 31.5 38.5 47.4 OpenBenchmarking.org Celsius, Fewer Is Better miniBUDE 20210901 CPU Temperature Monitor 15 30 45 60 75
miniBUDE CPU Power Consumption Monitor Min Avg Max AVX-512 Off 212 414 630 AVX-512 On 52 281 624 OpenBenchmarking.org Watts, Fewer Is Better miniBUDE 20210901 CPU Power Consumption Monitor 200 400 600 800 1000
miniBUDE CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max AVX-512 Off 3107 3505 4044 AVX-512 On 2400 2913 3739 OpenBenchmarking.org Megahertz, More Is Better miniBUDE 20210901 CPU Peak Freq (Highest CPU Core Frequency) Monitor 1100 2200 3300 4400 5500
miniBUDE Implementation: OpenMP - Input Deck: BM1 OpenBenchmarking.org Billion Interactions/s Per Watt, More Is Better miniBUDE 20210901 Implementation: OpenMP - Input Deck: BM1 AVX-512 Off AVX-512 On 0.2342 0.4684 0.7026 0.9368 1.171 0.489 1.041
Numpy Benchmark CPU Temperature Monitor Min Avg Max AVX-512 Off 36.4 37.9 43.5 AVX-512 On 32.8 36.3 40.4 OpenBenchmarking.org Celsius, Fewer Is Better Numpy Benchmark CPU Temperature Monitor 12 24 36 48 60
Numpy Benchmark CPU Power Consumption Monitor Min Avg Max AVX-512 Off 110.9 221.9 228.1 AVX-512 On 54.1 214.2 222.9 OpenBenchmarking.org Watts, Fewer Is Better Numpy Benchmark CPU Power Consumption Monitor 60 120 180 240 300
Numpy Benchmark CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max AVX-512 Off 3694 3702 4024 AVX-512 On 2400 3673 3705 OpenBenchmarking.org Megahertz, More Is Better Numpy Benchmark CPU Peak Freq (Highest CPU Core Frequency) Monitor 1100 2200 3300 4400 5500
Numpy Benchmark OpenBenchmarking.org Score Per Watt, More Is Better Numpy Benchmark AVX-512 Off AVX-512 On 0.6046 1.2092 1.8138 2.4184 3.023 2.474 2.687
ONNX Runtime CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better ONNX Runtime 1.11 CPU Temperature Monitor AVX-512 Off AVX-512 On 11 22 33 44 55 Min: 38.13 / Avg: 50.46 / Max: 57.25 Min: 32.75 / Avg: 48.03 / Max: 50.63
ONNX Runtime CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better ONNX Runtime 1.11 CPU Power Consumption Monitor AVX-512 Off AVX-512 On 80 160 240 320 400 Min: 107.66 / Avg: 447.6 / Max: 464.67 Min: 51.25 / Avg: 441.77 / Max: 464.82
ONNX Runtime CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better ONNX Runtime 1.11 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 Off AVX-512 On 700 1400 2100 2800 3500 Min: 3593 / Avg: 3607.6 / Max: 4285 Min: 2400 / Avg: 3571.99 / Max: 3770
ONNX Runtime Model: ArcFace ResNet-100 - Device: CPU - Executor: Standard OpenBenchmarking.org Inferences Per Minute Per Watt, More Is Better ONNX Runtime 1.11 Model: ArcFace ResNet-100 - Device: CPU - Executor: Standard AVX-512 Off AVX-512 On 0.5353 1.0706 1.6059 2.1412 2.6765 2.051 2.379
ONNX Runtime Model: ArcFace ResNet-100 - Device: CPU - Executor: Standard OpenBenchmarking.org Inferences Per Minute, More Is Better ONNX Runtime 1.11 Model: ArcFace ResNet-100 - Device: CPU - Executor: Standard AVX-512 Off AVX-512 On 200 400 600 800 1000 SE +/- 20.83, N = 12 SE +/- 39.92, N = 12 918 1051 -mno-avx512f -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi 1. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt
ONNX Runtime CPU Temperature Monitor Min Avg Max AVX-512 Off 39.0 48.4 52.0 AVX-512 On 34.6 46.5 48.9 OpenBenchmarking.org Celsius, Fewer Is Better ONNX Runtime 1.11 CPU Temperature Monitor 15 30 45 60 75
ONNX Runtime CPU Power Consumption Monitor Min Avg Max AVX-512 Off 193.6 379.6 388.9 AVX-512 On 50.3 370.5 385.5 OpenBenchmarking.org Watts, Fewer Is Better ONNX Runtime 1.11 CPU Power Consumption Monitor 100 200 300 400 500
ONNX Runtime CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max AVX-512 Off 3694 3701 3978 AVX-512 On 2400 3663 3709 OpenBenchmarking.org Megahertz, More Is Better ONNX Runtime 1.11 CPU Peak Freq (Highest CPU Core Frequency) Monitor 1100 2200 3300 4400 5500
ONNX Runtime Model: bertsquad-12 - Device: CPU - Executor: Standard OpenBenchmarking.org Inferences Per Minute Per Watt, More Is Better ONNX Runtime 1.11 Model: bertsquad-12 - Device: CPU - Executor: Standard AVX-512 Off AVX-512 On 0.3134 0.6268 0.9402 1.2536 1.567 1.315 1.393
ONNX Runtime CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better ONNX Runtime 1.11 CPU Temperature Monitor AVX-512 Off AVX-512 On 11 22 33 44 55 Min: 39.5 / Avg: 43.19 / Max: 53 Min: 36.38 / Avg: 39.9 / Max: 42.63
ONNX Runtime CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better ONNX Runtime 1.11 CPU Power Consumption Monitor AVX-512 Off AVX-512 On 50 100 150 200 250 Min: 132.49 / Avg: 266.8 / Max: 278.02 Min: 53.19 / Avg: 259.31 / Max: 268.38
ONNX Runtime CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better ONNX Runtime 1.11 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 Off AVX-512 On 800 1600 2400 3200 4000 Min: 3693 / Avg: 3701.93 / Max: 4397 Min: 2400 / Avg: 3664.92 / Max: 3710
ONNX Runtime Model: super-resolution-10 - Device: CPU - Executor: Standard OpenBenchmarking.org Inferences Per Minute Per Watt, More Is Better ONNX Runtime 1.11 Model: super-resolution-10 - Device: CPU - Executor: Standard AVX-512 Off AVX-512 On 7 14 21 28 35 23.57 28.54
ONNX Runtime Model: super-resolution-10 - Device: CPU - Executor: Standard OpenBenchmarking.org Inferences Per Minute, More Is Better ONNX Runtime 1.11 Model: super-resolution-10 - Device: CPU - Executor: Standard AVX-512 Off AVX-512 On 1600 3200 4800 6400 8000 SE +/- 260.54, N = 12 SE +/- 5.46, N = 3 6288 7401 -mno-avx512f -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi 1. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt
ONNX Runtime CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better ONNX Runtime 1.11 CPU Temperature Monitor AVX-512 Off AVX-512 On 12 24 36 48 60 Min: 43 / Avg: 53.38 / Max: 59.25 Min: 37.75 / Avg: 51.09 / Max: 57.5
ONNX Runtime CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better ONNX Runtime 1.11 CPU Power Consumption Monitor AVX-512 Off AVX-512 On 90 180 270 360 450 Min: 211.3 / Avg: 502.96 / Max: 528.22 Min: 51.68 / Avg: 494.16 / Max: 531.99
ONNX Runtime CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better ONNX Runtime 1.11 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 Off AVX-512 On 700 1400 2100 2800 3500 Min: 3047 / Avg: 3611.53 / Max: 4291 Min: 2400 / Avg: 3577.02 / Max: 3696
ONNX Runtime Model: fcn-resnet101-11 - Device: CPU - Executor: Standard OpenBenchmarking.org Inferences Per Minute Per Watt, More Is Better ONNX Runtime 1.11 Model: fcn-resnet101-11 - Device: CPU - Executor: Standard AVX-512 Off AVX-512 On 0.1233 0.2466 0.3699 0.4932 0.6165 0.497 0.548
GROMACS CPU Temperature Monitor Min Avg Max AVX-512 Off 43.0 54.8 64.5 AVX-512 On 43.3 56.1 62.6 OpenBenchmarking.org Celsius, Fewer Is Better GROMACS 2022.1 CPU Temperature Monitor 20 40 60 80 100
GROMACS CPU Power Consumption Monitor Min Avg Max AVX-512 Off 216 553 700 AVX-512 On 58 535 698 OpenBenchmarking.org Watts, Fewer Is Better GROMACS 2022.1 CPU Power Consumption Monitor 200 400 600 800 1000
GROMACS CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max AVX-512 Off 2875 3358 4145 AVX-512 On 2400 3168 3725 OpenBenchmarking.org Megahertz, More Is Better GROMACS 2022.1 CPU Peak Freq (Highest CPU Core Frequency) Monitor 1100 2200 3300 4400 5500
GROMACS Implementation: MPI CPU - Input: water_GMX50_bare OpenBenchmarking.org Ns Per Day Per Watt, More Is Better GROMACS 2022.1 Implementation: MPI CPU - Input: water_GMX50_bare AVX-512 Off AVX-512 On 0.0079 0.0158 0.0237 0.0316 0.0395 0.033 0.035
OpenVINO CPU Temperature Monitor Min Avg Max AVX-512 Off 46.1 56.3 61.4 AVX-512 On 42.6 58.4 61.9 OpenBenchmarking.org Celsius, Fewer Is Better OpenVINO 2022.2.dev CPU Temperature Monitor 20 40 60 80 100
OpenVINO CPU Power Consumption Monitor Min Avg Max AVX-512 Off 213 595 648 AVX-512 On 57 636 701 OpenBenchmarking.org Watts, Fewer Is Better OpenVINO 2022.2.dev CPU Power Consumption Monitor 200 400 600 800 1000
OpenVINO CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max AVX-512 Off 2592 2966 3926 AVX-512 On 2400 3256 3707 OpenBenchmarking.org Megahertz, More Is Better OpenVINO 2022.2.dev CPU Peak Freq (Highest CPU Core Frequency) Monitor 1000 2000 3000 4000 5000
OpenVINO CPU Temperature Monitor Min Avg Max AVX-512 Off 46.6 58.0 61.4 AVX-512 On 43.8 56.8 59.6 OpenBenchmarking.org Celsius, Fewer Is Better OpenVINO 2022.2.dev CPU Temperature Monitor 20 40 60 80 100
OpenVINO CPU Power Consumption Monitor Min Avg Max AVX-512 Off 218 588 640 AVX-512 On 51 588 657 OpenBenchmarking.org Watts, Fewer Is Better OpenVINO 2022.2.dev CPU Power Consumption Monitor 200 400 600 800 1000
OpenVINO CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max AVX-512 Off 2799 2942 3941 AVX-512 On 2400 3099 3699 OpenBenchmarking.org Megahertz, More Is Better OpenVINO 2022.2.dev CPU Peak Freq (Highest CPU Core Frequency) Monitor 1000 2000 3000 4000 5000
OpenVINO CPU Temperature Monitor Min Avg Max AVX-512 Off 48.9 59.9 62.3 AVX-512 On 42.1 59.0 62.4 OpenBenchmarking.org Celsius, Fewer Is Better OpenVINO 2022.2.dev CPU Temperature Monitor 20 40 60 80 100
OpenVINO CPU Power Consumption Monitor Min Avg Max AVX-512 Off 217 613 655 AVX-512 On 59 633 690 OpenBenchmarking.org Watts, Fewer Is Better OpenVINO 2022.2.dev CPU Power Consumption Monitor 200 400 600 800 1000
OpenVINO CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max AVX-512 Off 2571 2730 4230 AVX-512 On 2400 2972 3706 OpenBenchmarking.org Megahertz, More Is Better OpenVINO 2022.2.dev CPU Peak Freq (Highest CPU Core Frequency) Monitor 1100 2200 3300 4400 5500
OpenVINO CPU Temperature Monitor Min Avg Max AVX-512 Off 48.0 61.1 64.0 AVX-512 On 44.4 57.9 60.1 OpenBenchmarking.org Celsius, Fewer Is Better OpenVINO 2022.2.dev CPU Temperature Monitor 20 40 60 80 100
OpenVINO CPU Power Consumption Monitor Min Avg Max AVX-512 Off 214 634 676 AVX-512 On 33 598 646 OpenBenchmarking.org Watts, Fewer Is Better OpenVINO 2022.2.dev CPU Power Consumption Monitor 200 400 600 800 1000
OpenVINO CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max AVX-512 Off 2988 3068 4270 AVX-512 On 2400 3036 3900 OpenBenchmarking.org Megahertz, More Is Better OpenVINO 2022.2.dev CPU Peak Freq (Highest CPU Core Frequency) Monitor 1100 2200 3300 4400 5500
OpenVINO CPU Temperature Monitor Min Avg Max AVX-512 Off 49.8 60.0 61.8 AVX-512 On 43.0 60.9 64.5 OpenBenchmarking.org Celsius, Fewer Is Better OpenVINO 2022.2.dev CPU Temperature Monitor 20 40 60 80 100
OpenVINO CPU Power Consumption Monitor Min Avg Max AVX-512 Off 221 598 639 AVX-512 On 58 660 712 OpenBenchmarking.org Watts, Fewer Is Better OpenVINO 2022.2.dev CPU Power Consumption Monitor 200 400 600 800 1000
OpenVINO CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max AVX-512 Off 2672 2848 3946 AVX-512 On 2400 3060 3695 OpenBenchmarking.org Megahertz, More Is Better OpenVINO 2022.2.dev CPU Peak Freq (Highest CPU Core Frequency) Monitor 1000 2000 3000 4000 5000
OpenVINO CPU Temperature Monitor Min Avg Max AVX-512 Off 45.8 63.0 67.1 AVX-512 On 42.6 59.4 62.8 OpenBenchmarking.org Celsius, Fewer Is Better OpenVINO 2022.2.dev CPU Temperature Monitor 20 40 60 80 100
OpenVINO CPU Power Consumption Monitor Min Avg Max AVX-512 Off 216 684 729 AVX-512 On 57 639 696 OpenBenchmarking.org Watts, Fewer Is Better OpenVINO 2022.2.dev CPU Power Consumption Monitor 200 400 600 800 1000
OpenVINO CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max AVX-512 Off 2930 3070 3969 AVX-512 On 2400 3037 3696 OpenBenchmarking.org Megahertz, More Is Better OpenVINO 2022.2.dev CPU Peak Freq (Highest CPU Core Frequency) Monitor 1100 2200 3300 4400 5500
OpenVINO CPU Temperature Monitor Min Avg Max AVX-512 Off 46.1 58.7 66.8 AVX-512 On 42.1 58.0 67.3 OpenBenchmarking.org Celsius, Fewer Is Better OpenVINO 2022.2.dev CPU Temperature Monitor 20 40 60 80 100
OpenVINO CPU Power Consumption Monitor Min Avg Max AVX-512 Off 215 593 665 AVX-512 On 38 607 700 OpenBenchmarking.org Watts, Fewer Is Better OpenVINO 2022.2.dev CPU Power Consumption Monitor 200 400 600 800 1000
OpenVINO CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max AVX-512 Off 2729 3100 3993 AVX-512 On 2400 3466 3698 OpenBenchmarking.org Megahertz, More Is Better OpenVINO 2022.2.dev CPU Peak Freq (Highest CPU Core Frequency) Monitor 1100 2200 3300 4400 5500
OpenVINO CPU Temperature Monitor Min Avg Max AVX-512 Off 47.0 58.2 67.6 AVX-512 On 39.5 57.4 65.9 OpenBenchmarking.org Celsius, Fewer Is Better OpenVINO 2022.2.dev CPU Temperature Monitor 20 40 60 80 100
OpenVINO CPU Power Consumption Monitor Min Avg Max AVX-512 Off 114 579 650 AVX-512 On 56 605 699 OpenBenchmarking.org Watts, Fewer Is Better OpenVINO 2022.2.dev CPU Power Consumption Monitor 200 400 600 800 1000
OpenVINO CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max AVX-512 Off 2709 3150 3863 AVX-512 On 2400 3480 3726 OpenBenchmarking.org Megahertz, More Is Better OpenVINO 2022.2.dev CPU Peak Freq (Highest CPU Core Frequency) Monitor 1000 2000 3000 4000 5000
OpenVINO CPU Temperature Monitor Min Avg Max AVX-512 Off 48.0 59.2 62.3 AVX-512 On 41.8 52.2 55.1 OpenBenchmarking.org Celsius, Fewer Is Better OpenVINO 2022.2.dev CPU Temperature Monitor 20 40 60 80 100
OpenVINO CPU Power Consumption Monitor Min Avg Max AVX-512 Off 217 592 630 AVX-512 On 29 514 564 OpenBenchmarking.org Watts, Fewer Is Better OpenVINO 2022.2.dev CPU Power Consumption Monitor 200 400 600 800 1000
OpenVINO CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max AVX-512 Off 3476 3674 3707 AVX-512 On 2400 3630 3754 OpenBenchmarking.org Megahertz, More Is Better OpenVINO 2022.2.dev CPU Peak Freq (Highest CPU Core Frequency) Monitor 1000 2000 3000 4000 5000
OpenVINO CPU Temperature Monitor Min Avg Max AVX-512 Off 49.3 59.9 62.6 AVX-512 On 42.1 55.4 59.5 OpenBenchmarking.org Celsius, Fewer Is Better OpenVINO 2022.2.dev CPU Temperature Monitor 20 40 60 80 100
OpenVINO CPU Power Consumption Monitor Min Avg Max AVX-512 Off 219 592 636 AVX-512 On 48 566 622 OpenBenchmarking.org Watts, Fewer Is Better OpenVINO 2022.2.dev CPU Power Consumption Monitor 200 400 600 800 1000
OpenVINO CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max AVX-512 Off 2992 3193 4056 AVX-512 On 2400 3605 3828 OpenBenchmarking.org Megahertz, More Is Better OpenVINO 2022.2.dev CPU Peak Freq (Highest CPU Core Frequency) Monitor 1100 2200 3300 4400 5500
OpenVINO CPU Temperature Monitor Min Avg Max AVX-512 Off 47.0 62.5 66.8 AVX-512 On 43.0 58.1 61.9 OpenBenchmarking.org Celsius, Fewer Is Better OpenVINO 2022.2.dev CPU Temperature Monitor 20 40 60 80 100
OpenVINO CPU Power Consumption Monitor Min Avg Max AVX-512 Off 216 662 733 AVX-512 On 58 612 687 OpenBenchmarking.org Watts, Fewer Is Better OpenVINO 2022.2.dev CPU Power Consumption Monitor 200 400 600 800 1000
OpenVINO CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max AVX-512 Off 2920 3081 3713 AVX-512 On 2400 3129 3696 OpenBenchmarking.org Megahertz, More Is Better OpenVINO 2022.2.dev CPU Peak Freq (Highest CPU Core Frequency) Monitor 1000 2000 3000 4000 5000
OpenVINO CPU Temperature Monitor Min Avg Max AVX-512 Off 41.3 56.2 61.9 AVX-512 On 35.9 57.3 64.1 OpenBenchmarking.org Celsius, Fewer Is Better OpenVINO 2022.2.dev CPU Temperature Monitor 20 40 60 80 100
OpenVINO CPU Power Consumption Monitor Min Avg Max AVX-512 Off 218 585 645 AVX-512 On 54 639 725 OpenBenchmarking.org Watts, Fewer Is Better OpenVINO 2022.2.dev CPU Power Consumption Monitor 200 400 600 800 1000
OpenVINO CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max AVX-512 Off 2652 2906 4086 AVX-512 On 2400 3126 3696 OpenBenchmarking.org Megahertz, More Is Better OpenVINO 2022.2.dev CPU Peak Freq (Highest CPU Core Frequency) Monitor 1100 2200 3300 4400 5500
NCNN CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better NCNN 20220729 CPU Temperature Monitor AVX-512 Off AVX-512 On 10 20 30 40 50 Min: 43 / Avg: 46.1 / Max: 50.13 Min: 38.63 / Avg: 44.45 / Max: 48
NCNN CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better NCNN 20220729 CPU Power Consumption Monitor AVX-512 Off AVX-512 On 80 160 240 320 400 Min: 199.1 / Avg: 400.13 / Max: 450.41 Min: 54.96 / Avg: 396.44 / Max: 451.5
NCNN CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better NCNN 20220729 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 Off AVX-512 On 700 1400 2100 2800 3500 Min: 3563 / Avg: 3574.38 / Max: 3815 Min: 2400 / Avg: 3565.67 / Max: 3699
NCNN Target: CPU - Model: FastestDet OpenBenchmarking.org ms, Fewer Is Better NCNN 20220729 Target: CPU - Model: FastestDet AVX-512 Off AVX-512 On 14 28 42 56 70 SE +/- 2.90, N = 3 SE +/- 0.49, N = 8 60.73 58.95 -mno-avx512f - MIN: 52.89 / MAX: 236.85 -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi - MIN: 55.11 / MAX: 282.72 1. (CXX) g++ options: -O3 -march=native -rdynamic -lgomp -lpthread
NCNN Target: CPU - Model: vision_transformer OpenBenchmarking.org ms, Fewer Is Better NCNN 20220729 Target: CPU - Model: vision_transformer AVX-512 Off AVX-512 On 20 40 60 80 100 SE +/- 5.82, N = 3 SE +/- 1.59, N = 8 86.16 74.93 -mno-avx512f - MIN: 73.72 / MAX: 1760.74 -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi - MIN: 65.04 / MAX: 2154.62 1. (CXX) g++ options: -O3 -march=native -rdynamic -lgomp -lpthread
Cpuminer-Opt CPU Temperature Monitor Min Avg Max AVX-512 Off 47.0 59.2 62.3 AVX-512 On 42.4 59.0 63.5 OpenBenchmarking.org Celsius, Fewer Is Better Cpuminer-Opt 3.20.3 CPU Temperature Monitor 20 40 60 80 100
Cpuminer-Opt CPU Power Consumption Monitor Min Avg Max AVX-512 Off 222 613 684 AVX-512 On 59 643 743 OpenBenchmarking.org Watts, Fewer Is Better Cpuminer-Opt 3.20.3 CPU Power Consumption Monitor 200 400 600 800 1000
Cpuminer-Opt CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max AVX-512 Off 2729 2933 4111 AVX-512 On 2400 3060 3703 OpenBenchmarking.org Megahertz, More Is Better Cpuminer-Opt 3.20.3 CPU Peak Freq (Highest CPU Core Frequency) Monitor 1100 2200 3300 4400 5500
Cpuminer-Opt Algorithm: LBC, LBRY Credits OpenBenchmarking.org kH/s Per Watt, More Is Better Cpuminer-Opt 3.20.3 Algorithm: LBC, LBRY Credits AVX-512 Off AVX-512 On 400 800 1200 1600 2000 802.76 1658.51
Cpuminer-Opt CPU Temperature Monitor Min Avg Max AVX-512 Off 47.0 58.7 61.8 AVX-512 On 41.3 57.9 62.8 OpenBenchmarking.org Celsius, Fewer Is Better Cpuminer-Opt 3.20.3 CPU Temperature Monitor 20 40 60 80 100
Cpuminer-Opt CPU Power Consumption Monitor Min Avg Max AVX-512 Off 221 599 665 AVX-512 On 58 622 720 OpenBenchmarking.org Watts, Fewer Is Better Cpuminer-Opt 3.20.3 CPU Power Consumption Monitor 200 400 600 800 1000
Cpuminer-Opt CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max AVX-512 Off 2895 3068 3848 AVX-512 On 2400 3002 3696 OpenBenchmarking.org Megahertz, More Is Better Cpuminer-Opt 3.20.3 CPU Peak Freq (Highest CPU Core Frequency) Monitor 1000 2000 3000 4000 5000
Cpuminer-Opt Algorithm: Skeincoin OpenBenchmarking.org kH/s Per Watt, More Is Better Cpuminer-Opt 3.20.3 Algorithm: Skeincoin AVX-512 Off AVX-512 On 700 1400 2100 2800 3500 2381.94 3137.56
Cpuminer-Opt CPU Temperature Monitor Min Avg Max AVX-512 Off 45.8 57.1 60.9 AVX-512 On 41.3 56.3 60.9 OpenBenchmarking.org Celsius, Fewer Is Better Cpuminer-Opt 3.20.3 CPU Temperature Monitor 20 40 60 80 100
Cpuminer-Opt CPU Power Consumption Monitor Min Avg Max AVX-512 Off 220 587 657 AVX-512 On 57 596 694 OpenBenchmarking.org Watts, Fewer Is Better Cpuminer-Opt 3.20.3 CPU Power Consumption Monitor 200 400 600 800 1000
Cpuminer-Opt CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max AVX-512 Off 2878 3030 3783 AVX-512 On 2400 3079 3830 OpenBenchmarking.org Megahertz, More Is Better Cpuminer-Opt 3.20.3 CPU Peak Freq (Highest CPU Core Frequency) Monitor 1000 2000 3000 4000 5000
Cpuminer-Opt Algorithm: Garlicoin OpenBenchmarking.org kH/s Per Watt, More Is Better Cpuminer-Opt 3.20.3 Algorithm: Garlicoin AVX-512 Off AVX-512 On 30 60 90 120 150 83.22 119.97
Cpuminer-Opt CPU Temperature Monitor Min Avg Max AVX-512 Off 46.6 58.2 60.9 AVX-512 On 42.0 57.1 60.4 OpenBenchmarking.org Celsius, Fewer Is Better Cpuminer-Opt 3.20.3 CPU Temperature Monitor 20 40 60 80 100
Cpuminer-Opt CPU Power Consumption Monitor Min Avg Max AVX-512 Off 221 580 645 AVX-512 On 39 568 650 OpenBenchmarking.org Watts, Fewer Is Better Cpuminer-Opt 3.20.3 CPU Power Consumption Monitor 200 400 600 800 1000
Cpuminer-Opt CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max AVX-512 Off 3256 3351 4121 AVX-512 On 2400 3105 3697 OpenBenchmarking.org Megahertz, More Is Better Cpuminer-Opt 3.20.3 CPU Peak Freq (Highest CPU Core Frequency) Monitor 1100 2200 3300 4400 5500
Cpuminer-Opt Algorithm: x25x OpenBenchmarking.org kH/s Per Watt, More Is Better Cpuminer-Opt 3.20.3 Algorithm: x25x AVX-512 Off AVX-512 On 3 6 9 12 15 9.971 13.548
Cpuminer-Opt CPU Temperature Monitor Min Avg Max AVX-512 Off 46.6 57.9 61.4 AVX-512 On 43.0 58.6 62.8 OpenBenchmarking.org Celsius, Fewer Is Better Cpuminer-Opt 3.20.3 CPU Temperature Monitor 20 40 60 80 100
Cpuminer-Opt CPU Power Consumption Monitor Min Avg Max AVX-512 Off 134 587 654 AVX-512 On 57 618 724 OpenBenchmarking.org Watts, Fewer Is Better Cpuminer-Opt 3.20.3 CPU Power Consumption Monitor 200 400 600 800 1000
Cpuminer-Opt CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max AVX-512 Off 3001 3155 4285 AVX-512 On 2400 3112 3695 OpenBenchmarking.org Megahertz, More Is Better Cpuminer-Opt 3.20.3 CPU Peak Freq (Highest CPU Core Frequency) Monitor 1100 2200 3300 4400 5500
Cpuminer-Opt Algorithm: Quad SHA-256, Pyrite OpenBenchmarking.org kH/s Per Watt, More Is Better Cpuminer-Opt 3.20.3 Algorithm: Quad SHA-256, Pyrite AVX-512 Off AVX-512 On 800 1600 2400 3200 4000 2252.99 3657.53
Cpuminer-Opt CPU Temperature Monitor Min Avg Max AVX-512 Off 39.5 52.4 56.9 AVX-512 On 34.1 52.2 58.3 OpenBenchmarking.org Celsius, Fewer Is Better Cpuminer-Opt 3.20.3 CPU Temperature Monitor 16 32 48 64 80
Cpuminer-Opt CPU Power Consumption Monitor Min Avg Max AVX-512 Off 215 558 618 AVX-512 On 55 594 682 OpenBenchmarking.org Watts, Fewer Is Better Cpuminer-Opt 3.20.3 CPU Power Consumption Monitor 200 400 600 800 1000
Cpuminer-Opt CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max AVX-512 Off 2933 3058 3896 AVX-512 On 2400 3009 3697 OpenBenchmarking.org Megahertz, More Is Better Cpuminer-Opt 3.20.3 CPU Peak Freq (Highest CPU Core Frequency) Monitor 1000 2000 3000 4000 5000
Cpuminer-Opt Algorithm: scrypt OpenBenchmarking.org kH/s Per Watt, More Is Better Cpuminer-Opt 3.20.3 Algorithm: scrypt AVX-512 Off AVX-512 On 2 4 6 8 10 5.279 8.076
Mobile Neural Network CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better Mobile Neural Network 2.1 CPU Temperature Monitor AVX-512 Off AVX-512 On 11 22 33 44 55 Min: 40.38 / Avg: 49.52 / Max: 52.88 Min: 35.88 / Avg: 48.36 / Max: 52
Mobile Neural Network CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better Mobile Neural Network 2.1 CPU Power Consumption Monitor AVX-512 Off AVX-512 On 60 120 180 240 300 Min: 165 / Avg: 334.93 / Max: 346.27 Min: 53.81 / Avg: 327.57 / Max: 340
Mobile Neural Network CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better Mobile Neural Network 2.1 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 Off AVX-512 On 700 1400 2100 2800 3500 Min: 3694 / Avg: 3699.72 / Max: 4041 Min: 2400 / Avg: 3679.28 / Max: 3704
oneDNN CPU Temperature Monitor Min Avg Max AVX-512 Off 42.6 46.8 49.8 AVX-512 On 37.8 45.8 48.9 OpenBenchmarking.org Celsius, Fewer Is Better oneDNN 2.7 CPU Temperature Monitor 14 28 42 56 70
oneDNN CPU Power Consumption Monitor Min Avg Max AVX-512 Off 204.0 413.9 482.1 AVX-512 On 55.2 413.8 581.1 OpenBenchmarking.org Watts, Fewer Is Better oneDNN 2.7 CPU Power Consumption Monitor 160 320 480 640 800
oneDNN CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max AVX-512 Off 3570 3612 4005 AVX-512 On 2400 3507 3700 OpenBenchmarking.org Megahertz, More Is Better oneDNN 2.7 CPU Peak Freq (Highest CPU Core Frequency) Monitor 1100 2200 3300 4400 5500
oneDNN CPU Temperature Monitor Min Avg Max AVX-512 Off 42.6 46.6 50.6 AVX-512 On 37.8 46.7 51.5 OpenBenchmarking.org Celsius, Fewer Is Better oneDNN 2.7 CPU Temperature Monitor 15 30 45 60 75
oneDNN CPU Power Consumption Monitor Min Avg Max AVX-512 Off 195.7 412.5 498.9 AVX-512 On 52.5 419.2 543.1 OpenBenchmarking.org Watts, Fewer Is Better oneDNN 2.7 CPU Power Consumption Monitor 140 280 420 560 700
oneDNN CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max AVX-512 Off 3582 3627 4223 AVX-512 On 2400 3568 3704 OpenBenchmarking.org Megahertz, More Is Better oneDNN 2.7 CPU Peak Freq (Highest CPU Core Frequency) Monitor 1100 2200 3300 4400 5500
oneDNN CPU Temperature Monitor Min Avg Max AVX-512 Off 38.6 45.9 50.1 AVX-512 On 35.5 46.0 50.6 OpenBenchmarking.org Celsius, Fewer Is Better oneDNN 2.7 CPU Temperature Monitor 14 28 42 56 70
oneDNN CPU Power Consumption Monitor Min Avg Max AVX-512 Off 215.2 412.5 499.6 AVX-512 On 55.5 418.6 541.1 OpenBenchmarking.org Watts, Fewer Is Better oneDNN 2.7 CPU Power Consumption Monitor 140 280 420 560 700
oneDNN CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max AVX-512 Off 3581 3623 3818 AVX-512 On 2400 3571 3711 OpenBenchmarking.org Megahertz, More Is Better oneDNN 2.7 CPU Peak Freq (Highest CPU Core Frequency) Monitor 1000 2000 3000 4000 5000
oneDNN CPU Temperature Monitor Min Avg Max AVX-512 Off 39.0 41.4 43.9 AVX-512 On 35.9 39.3 44.4 OpenBenchmarking.org Celsius, Fewer Is Better oneDNN 2.7 CPU Temperature Monitor 12 24 36 48 60
oneDNN CPU Power Consumption Monitor Min Avg Max AVX-512 Off 215.2 323.9 475.6 AVX-512 On 54.0 248.8 512.8 OpenBenchmarking.org Watts, Fewer Is Better oneDNN 2.7 CPU Power Consumption Monitor 130 260 390 520 650
oneDNN CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max AVX-512 Off 3569 3666 4064 AVX-512 On 2400 3008 3695 OpenBenchmarking.org Megahertz, More Is Better oneDNN 2.7 CPU Peak Freq (Highest CPU Core Frequency) Monitor 1100 2200 3300 4400 5500
oneDNN CPU Temperature Monitor Min Avg Max AVX-512 Off 39.5 43.8 47.0 AVX-512 On 37.3 43.5 46.1 OpenBenchmarking.org Celsius, Fewer Is Better oneDNN 2.7 CPU Temperature Monitor 14 28 42 56 70
oneDNN CPU Power Consumption Monitor Min Avg Max AVX-512 Off 215.5 392.5 509.7 AVX-512 On 52.1 376.1 492.5 OpenBenchmarking.org Watts, Fewer Is Better oneDNN 2.7 CPU Power Consumption Monitor 130 260 390 520 650
oneDNN CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max AVX-512 Off 2933 3526 3802 AVX-512 On 2400 3394 3729 OpenBenchmarking.org Megahertz, More Is Better oneDNN 2.7 CPU Peak Freq (Highest CPU Core Frequency) Monitor 1000 2000 3000 4000 5000
oneDNN CPU Temperature Monitor Min Avg Max AVX-512 Off 43.5 47.7 53.8 AVX-512 On 40.9 46.0 51.1 OpenBenchmarking.org Celsius, Fewer Is Better oneDNN 2.7 CPU Temperature Monitor 15 30 45 60 75
oneDNN CPU Power Consumption Monitor Min Avg Max AVX-512 Off 216.4 379.5 540.9 AVX-512 On 54.1 327.3 548.8 OpenBenchmarking.org Watts, Fewer Is Better oneDNN 2.7 CPU Power Consumption Monitor 140 280 420 560 700
oneDNN CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max AVX-512 Off 2860 3348 3869 AVX-512 On 2400 3182 3695 OpenBenchmarking.org Megahertz, More Is Better oneDNN 2.7 CPU Peak Freq (Highest CPU Core Frequency) Monitor 1000 2000 3000 4000 5000
OSPRay Studio CPU Temperature Monitor Min Avg Max AVX-512 Off 47.0 60.8 65.4 AVX-512 On 44.6 57.9 62.6 OpenBenchmarking.org Celsius, Fewer Is Better OSPRay Studio 0.11 CPU Temperature Monitor 20 40 60 80 100
OSPRay Studio CPU Power Consumption Monitor Min Avg Max AVX-512 Off 224 620 702 AVX-512 On 57 590 687 OpenBenchmarking.org Watts, Fewer Is Better OSPRay Studio 0.11 CPU Power Consumption Monitor 200 400 600 800 1000
OSPRay Studio CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max AVX-512 Off 2727 2973 3711 AVX-512 On 2400 2943 3701 OpenBenchmarking.org Megahertz, More Is Better OSPRay Studio 0.11 CPU Peak Freq (Highest CPU Core Frequency) Monitor 1000 2000 3000 4000 5000
OSPRay Studio CPU Temperature Monitor Min Avg Max AVX-512 Off 46.6 61.6 64.9 AVX-512 On 44.6 59.9 64.9 OpenBenchmarking.org Celsius, Fewer Is Better OSPRay Studio 0.11 CPU Temperature Monitor 20 40 60 80 100
OSPRay Studio CPU Power Consumption Monitor Min Avg Max AVX-512 Off 114 637 703 AVX-512 On 60 618 690 OpenBenchmarking.org Watts, Fewer Is Better OSPRay Studio 0.11 CPU Power Consumption Monitor 200 400 600 800 1000
OSPRay Studio CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max AVX-512 Off 2752 2956 4184 AVX-512 On 2400 2910 3697 OpenBenchmarking.org Megahertz, More Is Better OSPRay Studio 0.11 CPU Peak Freq (Highest CPU Core Frequency) Monitor 1100 2200 3300 4400 5500
OSPRay Studio CPU Temperature Monitor Min Avg Max AVX-512 Off 46.6 60.0 64.0 AVX-512 On 44.9 58.2 62.8 OpenBenchmarking.org Celsius, Fewer Is Better OSPRay Studio 0.11 CPU Temperature Monitor 20 40 60 80 100
OSPRay Studio CPU Power Consumption Monitor Min Avg Max AVX-512 Off 221 612 698 AVX-512 On 39 591 684 OpenBenchmarking.org Watts, Fewer Is Better OSPRay Studio 0.11 CPU Power Consumption Monitor 200 400 600 800 1000
OSPRay Studio CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max AVX-512 Off 2721 2996 4398 AVX-512 On 2400 2937 3698 OpenBenchmarking.org Megahertz, More Is Better OSPRay Studio 0.11 CPU Peak Freq (Highest CPU Core Frequency) Monitor 1100 2200 3300 4400 5500
OSPRay Studio CPU Temperature Monitor Min Avg Max AVX-512 Off 46.6 61.3 66.3 AVX-512 On 43.8 59.3 64.0 OpenBenchmarking.org Celsius, Fewer Is Better OSPRay Studio 0.11 CPU Temperature Monitor 20 40 60 80 100
OSPRay Studio CPU Power Consumption Monitor Min Avg Max AVX-512 Off 222 630 700 AVX-512 On 58 611 684 OpenBenchmarking.org Watts, Fewer Is Better OSPRay Studio 0.11 CPU Power Consumption Monitor 200 400 600 800 1000
OSPRay Studio CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max AVX-512 Off 2715 2972 4286 AVX-512 On 2400 2923 3697 OpenBenchmarking.org Megahertz, More Is Better OSPRay Studio 0.11 CPU Peak Freq (Highest CPU Core Frequency) Monitor 1100 2200 3300 4400 5500
OSPRay Studio CPU Temperature Monitor Min Avg Max AVX-512 Off 47.0 60.8 64.9 AVX-512 On 43.8 58.7 65.4 OpenBenchmarking.org Celsius, Fewer Is Better OSPRay Studio 0.11 CPU Temperature Monitor 20 40 60 80 100
OSPRay Studio CPU Power Consumption Monitor Min Avg Max AVX-512 Off 223 621 699 AVX-512 On 31 602 684 OpenBenchmarking.org Watts, Fewer Is Better OSPRay Studio 0.11 CPU Power Consumption Monitor 200 400 600 800 1000
OSPRay Studio CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max AVX-512 Off 2721 2971 4031 AVX-512 On 2400 2926 3699 OpenBenchmarking.org Megahertz, More Is Better OSPRay Studio 0.11 CPU Peak Freq (Highest CPU Core Frequency) Monitor 1100 2200 3300 4400 5500
OSPRay Studio CPU Temperature Monitor Min Avg Max AVX-512 Off 46.6 60.3 64.5 AVX-512 On 44.1 58.4 62.3 OpenBenchmarking.org Celsius, Fewer Is Better OSPRay Studio 0.11 CPU Temperature Monitor 20 40 60 80 100
OSPRay Studio CPU Power Consumption Monitor Min Avg Max AVX-512 Off 223 621 696 AVX-512 On 38 597 682 OpenBenchmarking.org Watts, Fewer Is Better OSPRay Studio 0.11 CPU Power Consumption Monitor 200 400 600 800 1000
OSPRay Studio CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max AVX-512 Off 2705 3001 3951 AVX-512 On 2400 2931 3701 OpenBenchmarking.org Megahertz, More Is Better OSPRay Studio 0.11 CPU Peak Freq (Highest CPU Core Frequency) Monitor 1000 2000 3000 4000 5000
OSPRay Studio CPU Temperature Monitor Min Avg Max AVX-512 Off 47.5 59.9 64.1 AVX-512 On 45.3 59.8 64.9 OpenBenchmarking.org Celsius, Fewer Is Better OSPRay Studio 0.11 CPU Temperature Monitor 20 40 60 80 100
OSPRay Studio CPU Power Consumption Monitor Min Avg Max AVX-512 Off 224 609 700 AVX-512 On 60 616 683 OpenBenchmarking.org Watts, Fewer Is Better OSPRay Studio 0.11 CPU Power Consumption Monitor 200 400 600 800 1000
OSPRay Studio CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max AVX-512 Off 2726 3007 4349 AVX-512 On 2400 2907 3700 OpenBenchmarking.org Megahertz, More Is Better OSPRay Studio 0.11 CPU Peak Freq (Highest CPU Core Frequency) Monitor 1100 2200 3300 4400 5500
OSPRay Studio CPU Temperature Monitor Min Avg Max AVX-512 Off 46.1 61.6 65.4 AVX-512 On 43.5 59.7 64.0 OpenBenchmarking.org Celsius, Fewer Is Better OSPRay Studio 0.11 CPU Temperature Monitor 20 40 60 80 100
OSPRay Studio CPU Power Consumption Monitor Min Avg Max AVX-512 Off 114 635 701 AVX-512 On 57 616 688 OpenBenchmarking.org Watts, Fewer Is Better OSPRay Studio 0.11 CPU Power Consumption Monitor 200 400 600 800 1000
OSPRay Studio CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max AVX-512 Off 2721 2960 3862 AVX-512 On 2400 2906 3696 OpenBenchmarking.org Megahertz, More Is Better OSPRay Studio 0.11 CPU Peak Freq (Highest CPU Core Frequency) Monitor 1000 2000 3000 4000 5000
OSPRay Studio CPU Temperature Monitor Min Avg Max AVX-512 Off 46.6 59.9 64.0 AVX-512 On 44.4 57.0 61.4 OpenBenchmarking.org Celsius, Fewer Is Better OSPRay Studio 0.11 CPU Temperature Monitor 20 40 60 80 100
OSPRay Studio CPU Power Consumption Monitor Min Avg Max AVX-512 Off 223 609 696 AVX-512 On 55 578 672 OpenBenchmarking.org Watts, Fewer Is Better OSPRay Studio 0.11 CPU Power Consumption Monitor 200 400 600 800 1000
OSPRay Studio CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max AVX-512 Off 2712 3004 3940 AVX-512 On 2400 2868 3857 OpenBenchmarking.org Megahertz, More Is Better OSPRay Studio 0.11 CPU Peak Freq (Highest CPU Core Frequency) Monitor 1000 2000 3000 4000 5000
OSPRay Studio CPU Temperature Monitor Min Avg Max AVX-512 Off 46.6 61.3 65.8 AVX-512 On 43.8 58.9 63.1 OpenBenchmarking.org Celsius, Fewer Is Better OSPRay Studio 0.11 CPU Temperature Monitor 20 40 60 80 100
OSPRay Studio CPU Power Consumption Monitor Min Avg Max AVX-512 Off 224 627 702 AVX-512 On 54 604 686 OpenBenchmarking.org Watts, Fewer Is Better OSPRay Studio 0.11 CPU Power Consumption Monitor 200 400 600 800 1000
OSPRay Studio CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max AVX-512 Off 2771 2972 3740 AVX-512 On 2400 2935 3696 OpenBenchmarking.org Megahertz, More Is Better OSPRay Studio 0.11 CPU Peak Freq (Highest CPU Core Frequency) Monitor 1000 2000 3000 4000 5000
OSPRay Studio CPU Temperature Monitor Min Avg Max AVX-512 Off 46.6 60.6 64.9 AVX-512 On 43.8 58.4 62.6 OpenBenchmarking.org Celsius, Fewer Is Better OSPRay Studio 0.11 CPU Temperature Monitor 20 40 60 80 100
OSPRay Studio CPU Power Consumption Monitor Min Avg Max AVX-512 Off 116 621 701 AVX-512 On 29 599 684 OpenBenchmarking.org Watts, Fewer Is Better OSPRay Studio 0.11 CPU Power Consumption Monitor 200 400 600 800 1000
OSPRay Studio CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max AVX-512 Off 2783 2993 3739 AVX-512 On 2400 2922 3700 OpenBenchmarking.org Megahertz, More Is Better OSPRay Studio 0.11 CPU Peak Freq (Highest CPU Core Frequency) Monitor 1000 2000 3000 4000 5000
OSPRay Studio CPU Temperature Monitor Min Avg Max AVX-512 Off 47.0 59.9 64.0 AVX-512 On 44.9 57.7 61.8 OpenBenchmarking.org Celsius, Fewer Is Better OSPRay Studio 0.11 CPU Temperature Monitor 20 40 60 80 100
OSPRay Studio CPU Power Consumption Monitor Min Avg Max AVX-512 Off 203 613 697 AVX-512 On 59 591 670 OpenBenchmarking.org Watts, Fewer Is Better OSPRay Studio 0.11 CPU Power Consumption Monitor 200 400 600 800 1000
OSPRay Studio CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max AVX-512 Off 2702 2995 3808 AVX-512 On 2400 2859 3697 OpenBenchmarking.org Megahertz, More Is Better OSPRay Studio 0.11 CPU Peak Freq (Highest CPU Core Frequency) Monitor 1000 2000 3000 4000 5000
OSPRay Studio CPU Temperature Monitor Min Avg Max AVX-512 Off 47.5 60.3 66.3 AVX-512 On 44.9 60.3 65.4 OpenBenchmarking.org Celsius, Fewer Is Better OSPRay Studio 0.11 CPU Temperature Monitor 20 40 60 80 100
OSPRay Studio CPU Power Consumption Monitor Min Avg Max AVX-512 Off 128 610 701 AVX-512 On 58 623 687 OpenBenchmarking.org Watts, Fewer Is Better OSPRay Studio 0.11 CPU Power Consumption Monitor 200 400 600 800 1000
OSPRay Studio CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max AVX-512 Off 2769 2989 3982 AVX-512 On 2400 2876 3752 OpenBenchmarking.org Megahertz, More Is Better OSPRay Studio 0.11 CPU Peak Freq (Highest CPU Core Frequency) Monitor 1100 2200 3300 4400 5500
OSPRay Studio CPU Temperature Monitor Min Avg Max AVX-512 Off 46.6 62.0 65.4 AVX-512 On 43.8 59.7 64.9 OpenBenchmarking.org Celsius, Fewer Is Better OSPRay Studio 0.11 CPU Temperature Monitor 20 40 60 80 100
OSPRay Studio CPU Power Consumption Monitor Min Avg Max AVX-512 Off 223 638 703 AVX-512 On 56 618 684 OpenBenchmarking.org Watts, Fewer Is Better OSPRay Studio 0.11 CPU Power Consumption Monitor 200 400 600 800 1000
OSPRay Studio CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max AVX-512 Off 2709 2937 3983 AVX-512 On 2400 2888 3699 OpenBenchmarking.org Megahertz, More Is Better OSPRay Studio 0.11 CPU Peak Freq (Highest CPU Core Frequency) Monitor 1100 2200 3300 4400 5500
OSPRay Studio CPU Temperature Monitor Min Avg Max AVX-512 Off 48.0 60.2 64.0 AVX-512 On 44.1 57.9 62.3 OpenBenchmarking.org Celsius, Fewer Is Better OSPRay Studio 0.11 CPU Temperature Monitor 20 40 60 80 100
OSPRay Studio CPU Power Consumption Monitor Min Avg Max AVX-512 Off 225 610 697 AVX-512 On 51 590 687 OpenBenchmarking.org Watts, Fewer Is Better OSPRay Studio 0.11 CPU Power Consumption Monitor 200 400 600 800 1000
OSPRay Studio CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max AVX-512 Off 2696 3001 3902 AVX-512 On 2400 2950 3701 OpenBenchmarking.org Megahertz, More Is Better OSPRay Studio 0.11 CPU Peak Freq (Highest CPU Core Frequency) Monitor 1000 2000 3000 4000 5000
OSPRay Studio CPU Temperature Monitor Min Avg Max AVX-512 Off 46.6 61.3 68.0 AVX-512 On 44.0 59.0 64.0 OpenBenchmarking.org Celsius, Fewer Is Better OSPRay Studio 0.11 CPU Temperature Monitor 20 40 60 80 100
OSPRay Studio CPU Power Consumption Monitor Min Avg Max AVX-512 Off 222 629 702 AVX-512 On 58 606 687 OpenBenchmarking.org Watts, Fewer Is Better OSPRay Studio 0.11 CPU Power Consumption Monitor 200 400 600 800 1000
OSPRay Studio CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max AVX-512 Off 2802 2978 4050 AVX-512 On 2400 2904 3702 OpenBenchmarking.org Megahertz, More Is Better OSPRay Studio 0.11 CPU Peak Freq (Highest CPU Core Frequency) Monitor 1100 2200 3300 4400 5500
OSPRay Studio CPU Temperature Monitor Min Avg Max AVX-512 Off 46.6 60.7 64.9 AVX-512 On 43.5 58.4 65.0 OpenBenchmarking.org Celsius, Fewer Is Better OSPRay Studio 0.11 CPU Temperature Monitor 20 40 60 80 100
OSPRay Studio CPU Power Consumption Monitor Min Avg Max AVX-512 Off 223 622 699 AVX-512 On 56 599 685 OpenBenchmarking.org Watts, Fewer Is Better OSPRay Studio 0.11 CPU Power Consumption Monitor 200 400 600 800 1000
OSPRay Studio CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max AVX-512 Off 2696 2979 4041 AVX-512 On 2400 2930 3699 OpenBenchmarking.org Megahertz, More Is Better OSPRay Studio 0.11 CPU Peak Freq (Highest CPU Core Frequency) Monitor 1100 2200 3300 4400 5500
OSPRay Studio CPU Temperature Monitor Min Avg Max AVX-512 Off 41.8 58.9 64.5 AVX-512 On 36.4 56.3 62.3 OpenBenchmarking.org Celsius, Fewer Is Better OSPRay Studio 0.11 CPU Temperature Monitor 20 40 60 80 100
OSPRay Studio CPU Power Consumption Monitor Min Avg Max AVX-512 Off 218 614 692 AVX-512 On 55 593 680 OpenBenchmarking.org Watts, Fewer Is Better OSPRay Studio 0.11 CPU Power Consumption Monitor 200 400 600 800 1000
OSPRay Studio CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max AVX-512 Off 2708 2997 3911 AVX-512 On 2400 2939 3695 OpenBenchmarking.org Megahertz, More Is Better OSPRay Studio 0.11 CPU Peak Freq (Highest CPU Core Frequency) Monitor 1000 2000 3000 4000 5000
OSPRay CPU Temperature Monitor Min Avg Max AVX-512 Off 47.5 61.3 64.9 AVX-512 On 42.9 57.8 60.9 OpenBenchmarking.org Celsius, Fewer Is Better OSPRay 2.10 CPU Temperature Monitor 20 40 60 80 100
OSPRay CPU Power Consumption Monitor Min Avg Max AVX-512 Off 221 628 677 AVX-512 On 58 593 646 OpenBenchmarking.org Watts, Fewer Is Better OSPRay 2.10 CPU Power Consumption Monitor 200 400 600 800 1000
OSPRay CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max AVX-512 Off 2766 3104 4475 AVX-512 On 2400 3055 3720 OpenBenchmarking.org Megahertz, More Is Better OSPRay 2.10 CPU Peak Freq (Highest CPU Core Frequency) Monitor 1200 2400 3600 4800 6000
OSPRay Benchmark: gravity_spheres_volume/dim_512/pathtracer/real_time OpenBenchmarking.org Items Per Second Per Watt, More Is Better OSPRay 2.10 Benchmark: gravity_spheres_volume/dim_512/pathtracer/real_time AVX-512 Off AVX-512 On 0.0205 0.041 0.0615 0.082 0.1025 0.065 0.091
OSPRay CPU Temperature Monitor Min Avg Max AVX-512 Off 48.4 60.3 63.5 AVX-512 On 41.8 56.8 60.4 OpenBenchmarking.org Celsius, Fewer Is Better OSPRay 2.10 CPU Temperature Monitor 20 40 60 80 100
OSPRay CPU Power Consumption Monitor Min Avg Max AVX-512 Off 177 620 662 AVX-512 On 56 582 632 OpenBenchmarking.org Watts, Fewer Is Better OSPRay 2.10 CPU Power Consumption Monitor 200 400 600 800 1000
OSPRay CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max AVX-512 Off 2768 3083 4016 AVX-512 On 2400 3051 3695 OpenBenchmarking.org Megahertz, More Is Better OSPRay 2.10 CPU Peak Freq (Highest CPU Core Frequency) Monitor 1100 2200 3300 4400 5500
OSPRay Benchmark: gravity_spheres_volume/dim_512/scivis/real_time OpenBenchmarking.org Items Per Second Per Watt, More Is Better OSPRay 2.10 Benchmark: gravity_spheres_volume/dim_512/scivis/real_time AVX-512 Off AVX-512 On 0.0167 0.0334 0.0501 0.0668 0.0835 0.041 0.074
OSPRay CPU Temperature Monitor Min Avg Max AVX-512 Off 45.3 59.8 65.0 AVX-512 On 39.9 56.2 59.5 OpenBenchmarking.org Celsius, Fewer Is Better OSPRay 2.10 CPU Temperature Monitor 20 40 60 80 100
OSPRay CPU Power Consumption Monitor Min Avg Max AVX-512 Off 222 618 662 AVX-512 On 56 580 633 OpenBenchmarking.org Watts, Fewer Is Better OSPRay 2.10 CPU Power Consumption Monitor 200 400 600 800 1000
OSPRay CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max AVX-512 Off 2771 3073 4018 AVX-512 On 2400 3081 3695 OpenBenchmarking.org Megahertz, More Is Better OSPRay 2.10 CPU Peak Freq (Highest CPU Core Frequency) Monitor 1100 2200 3300 4400 5500
OSPRay Benchmark: gravity_spheres_volume/dim_512/ao/real_time OpenBenchmarking.org Items Per Second Per Watt, More Is Better OSPRay 2.10 Benchmark: gravity_spheres_volume/dim_512/ao/real_time AVX-512 Off AVX-512 On 0.0171 0.0342 0.0513 0.0684 0.0855 0.043 0.076
OpenVKL CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better OpenVKL 1.3.1 CPU Temperature Monitor AVX-512 Off AVX-512 On 12 24 36 48 60 Min: 42.63 / Avg: 52.24 / Max: 60.88 Min: 41.25 / Avg: 49.91 / Max: 58.25
OpenVKL CPU Power Consumption Monitor Min Avg Max AVX-512 Off 114 491 692 AVX-512 On 56 467 670 OpenBenchmarking.org Watts, Fewer Is Better OpenVKL 1.3.1 CPU Power Consumption Monitor 200 400 600 800 1000
OpenVKL CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better OpenVKL 1.3.1 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 Off AVX-512 On 700 1400 2100 2800 3500 Min: 2621 / Avg: 3373.13 / Max: 4085 Min: 2400 / Avg: 3408.84 / Max: 3732
OpenVKL Benchmark: vklBenchmark ISPC OpenBenchmarking.org Items / Sec Per Watt, More Is Better OpenVKL 1.3.1 Benchmark: vklBenchmark ISPC AVX-512 Off AVX-512 On 0.6419 1.2838 1.9257 2.5676 3.2095 2.355 2.853
Embree CPU Temperature Monitor Min Avg Max AVX-512 Off 39.5 45.8 52.0 AVX-512 On 33.3 40.5 48.0 OpenBenchmarking.org Celsius, Fewer Is Better Embree 3.13 CPU Temperature Monitor 15 30 45 60 75
Embree CPU Power Consumption Monitor Min Avg Max AVX-512 Off 174 439 660 AVX-512 On 54 346 646 OpenBenchmarking.org Watts, Fewer Is Better Embree 3.13 CPU Power Consumption Monitor 200 400 600 800 1000
Embree CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max AVX-512 Off 2726 3446 5379 AVX-512 On 2400 2928 3696 OpenBenchmarking.org Megahertz, More Is Better Embree 3.13 CPU Peak Freq (Highest CPU Core Frequency) Monitor 1400 2800 4200 5600 7000
Embree Binary: Pathtracer ISPC - Model: Crown OpenBenchmarking.org Frames Per Second Per Watt, More Is Better Embree 3.13 Binary: Pathtracer ISPC - Model: Crown AVX-512 Off AVX-512 On 0.1179 0.2358 0.3537 0.4716 0.5895 0.344 0.524
Embree CPU Temperature Monitor Min Avg Max AVX-512 Off 39.9 42.4 49.3 AVX-512 On 34.6 38.4 46.6 OpenBenchmarking.org Celsius, Fewer Is Better Embree 3.13 CPU Temperature Monitor 14 28 42 56 70
Embree CPU Power Consumption Monitor Min Avg Max AVX-512 Off 217 319 632 AVX-512 On 56 254 632 OpenBenchmarking.org Watts, Fewer Is Better Embree 3.13 CPU Power Consumption Monitor 200 400 600 800 1000
Embree CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max AVX-512 Off 2889 3592 4020 AVX-512 On 2400 3372 3699 OpenBenchmarking.org Megahertz, More Is Better Embree 3.13 CPU Peak Freq (Highest CPU Core Frequency) Monitor 1100 2200 3300 4400 5500
Embree Binary: Pathtracer ISPC - Model: Asian Dragon Obj OpenBenchmarking.org Frames Per Second Per Watt, More Is Better Embree 3.13 Binary: Pathtracer ISPC - Model: Asian Dragon Obj AVX-512 Off AVX-512 On 0.1631 0.3262 0.4893 0.6524 0.8155 0.481 0.725
Embree CPU Temperature Monitor Min Avg Max AVX-512 Off 41.8 45.8 51.1 AVX-512 On 35.5 40.4 47.0 OpenBenchmarking.org Celsius, Fewer Is Better Embree 3.13 CPU Temperature Monitor 15 30 45 60 75
Embree CPU Power Consumption Monitor Min Avg Max AVX-512 Off 132 410 637 AVX-512 On 50 301 635 OpenBenchmarking.org Watts, Fewer Is Better Embree 3.13 CPU Power Consumption Monitor 200 400 600 800 1000
Embree CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max AVX-512 Off 2899 3508 4437 AVX-512 On 2400 2974 3695 OpenBenchmarking.org Megahertz, More Is Better Embree 3.13 CPU Peak Freq (Highest CPU Core Frequency) Monitor 1200 2400 3600 4800 6000
Embree Binary: Pathtracer ISPC - Model: Asian Dragon OpenBenchmarking.org Frames Per Second Per Watt, More Is Better Embree 3.13 Binary: Pathtracer ISPC - Model: Asian Dragon AVX-512 Off AVX-512 On 0.1591 0.3182 0.4773 0.6364 0.7955 0.431 0.707
LeelaChessZero CPU Temperature Monitor Min Avg Max AVX-512 Off 37.3 39.9 56.9 AVX-512 On 32.4 53.4 61.0 OpenBenchmarking.org Celsius, Fewer Is Better LeelaChessZero 0.28 CPU Temperature Monitor 20 40 60 80 100
LeelaChessZero CPU Power Consumption Monitor Min Avg Max AVX-512 Off 112.5 383.3 519.6 AVX-512 On 56.3 365.4 500.1 OpenBenchmarking.org Watts, Fewer Is Better LeelaChessZero 0.28 CPU Power Consumption Monitor 130 260 390 520 650
LeelaChessZero CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max AVX-512 Off 3694 3699 4052 AVX-512 On 2400 3685 4074 OpenBenchmarking.org Megahertz, More Is Better LeelaChessZero 0.28 CPU Peak Freq (Highest CPU Core Frequency) Monitor 1100 2200 3300 4400 5500
LeelaChessZero Backend: Eigen OpenBenchmarking.org Nodes Per Second Per Watt, More Is Better LeelaChessZero 0.28 Backend: Eigen AVX-512 Off AVX-512 On 6 12 18 24 30 21.29 24.89
LeelaChessZero CPU Temperature Monitor Min Avg Max AVX-512 Off 47.5 57.4 64.5 AVX-512 On 36.8 52.0 63.1 OpenBenchmarking.org Celsius, Fewer Is Better LeelaChessZero 0.28 CPU Temperature Monitor 20 40 60 80 100
LeelaChessZero CPU Power Consumption Monitor Min Avg Max AVX-512 Off 153.2 384.0 522.8 AVX-512 On 55.6 381.7 514.0 OpenBenchmarking.org Watts, Fewer Is Better LeelaChessZero 0.28 CPU Power Consumption Monitor 130 260 390 520 650
LeelaChessZero CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max AVX-512 Off 3383 3700 4961 AVX-512 On 2400 3684 3952 OpenBenchmarking.org Megahertz, More Is Better LeelaChessZero 0.28 CPU Peak Freq (Highest CPU Core Frequency) Monitor 1300 2600 3900 5200 6500
LeelaChessZero Backend: BLAS OpenBenchmarking.org Nodes Per Second Per Watt, More Is Better LeelaChessZero 0.28 Backend: BLAS AVX-512 Off AVX-512 On 6 12 18 24 30 21.93 23.78
TensorFlow CPU Temperature Monitor Min Avg Max AVX-512 Off 38.6 40.5 50.4 AVX-512 On 34.6 41.7 48.9 OpenBenchmarking.org Celsius, Fewer Is Better TensorFlow 2.10 CPU Temperature Monitor 14 28 42 56 70
TensorFlow CPU Power Consumption Monitor Min Avg Max AVX-512 Off 156.1 298.9 329.3 AVX-512 On 53.1 308.0 379.5 OpenBenchmarking.org Watts, Fewer Is Better TensorFlow 2.10 CPU Power Consumption Monitor 100 200 300 400 500
TensorFlow CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max AVX-512 Off 3694 3727 4474 AVX-512 On 2400 3586 4161 OpenBenchmarking.org Megahertz, More Is Better TensorFlow 2.10 CPU Peak Freq (Highest CPU Core Frequency) Monitor 1200 2400 3600 4800 6000
TensorFlow Device: CPU - Batch Size: 16 - Model: GoogLeNet OpenBenchmarking.org images/sec Per Watt, More Is Better TensorFlow 2.10 Device: CPU - Batch Size: 16 - Model: GoogLeNet AVX-512 Off AVX-512 On 0.0439 0.0878 0.1317 0.1756 0.2195 0.104 0.195
TensorFlow Device: CPU - Batch Size: 16 - Model: GoogLeNet OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.10 Device: CPU - Batch Size: 16 - Model: GoogLeNet AVX-512 Off AVX-512 On 13 26 39 52 65 SE +/- 0.25, N = 3 SE +/- 1.01, N = 15 31.12 60.17
TensorFlow CPU Temperature Monitor Min Avg Max AVX-512 Off 39.0 41.0 47.5 AVX-512 On 35.0 40.5 48.9 OpenBenchmarking.org Celsius, Fewer Is Better TensorFlow 2.10 CPU Temperature Monitor 14 28 42 56 70
TensorFlow CPU Power Consumption Monitor Min Avg Max AVX-512 Off 169.7 318.9 350.5 AVX-512 On 48.9 299.7 409.2 OpenBenchmarking.org Watts, Fewer Is Better TensorFlow 2.10 CPU Power Consumption Monitor 110 220 330 440 550
TensorFlow CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max AVX-512 Off 3694 3732 4340 AVX-512 On 2400 3458 3812 OpenBenchmarking.org Megahertz, More Is Better TensorFlow 2.10 CPU Peak Freq (Highest CPU Core Frequency) Monitor 1100 2200 3300 4400 5500
TensorFlow Device: CPU - Batch Size: 16 - Model: AlexNet OpenBenchmarking.org images/sec Per Watt, More Is Better TensorFlow 2.10 Device: CPU - Batch Size: 16 - Model: AlexNet AVX-512 Off AVX-512 On 0.1181 0.2362 0.3543 0.4724 0.5905 0.173 0.525
TensorFlow CPU Temperature Monitor Min Avg Max AVX-512 Off 40.9 43.4 53.5 AVX-512 On 36.8 41.7 48.6 OpenBenchmarking.org Celsius, Fewer Is Better TensorFlow 2.10 CPU Temperature Monitor 15 30 45 60 75
TensorFlow CPU Power Consumption Monitor Min Avg Max AVX-512 Off 165.7 338.8 379.7 AVX-512 On 53.5 307.1 397.4 OpenBenchmarking.org Watts, Fewer Is Better TensorFlow 2.10 CPU Power Consumption Monitor 110 220 330 440 550
TensorFlow CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max AVX-512 Off 3694 3713 4254 AVX-512 On 2400 3664 4099 OpenBenchmarking.org Megahertz, More Is Better TensorFlow 2.10 CPU Peak Freq (Highest CPU Core Frequency) Monitor 1100 2200 3300 4400 5500
TensorFlow Device: CPU - Batch Size: 16 - Model: ResNet-50 OpenBenchmarking.org images/sec Per Watt, More Is Better TensorFlow 2.10 Device: CPU - Batch Size: 16 - Model: ResNet-50 AVX-512 Off AVX-512 On 0.0162 0.0324 0.0486 0.0648 0.081 0.038 0.072
Neural Magic DeepSparse CPU Temperature Monitor Min Avg Max AVX-512 Off 43.5 50.7 56.9 AVX-512 On 40.6 48.7 54.3 OpenBenchmarking.org Celsius, Fewer Is Better Neural Magic DeepSparse 1.1 CPU Temperature Monitor 16 32 48 64 80
Neural Magic DeepSparse CPU Power Consumption Monitor Min Avg Max AVX-512 Off 210.0 351.1 423.9 AVX-512 On 30.2 328.4 418.5 OpenBenchmarking.org Watts, Fewer Is Better Neural Magic DeepSparse 1.1 CPU Power Consumption Monitor 110 220 330 440 550
Neural Magic DeepSparse CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max AVX-512 Off 3089 3679 4336 AVX-512 On 2400 3533 3703 OpenBenchmarking.org Megahertz, More Is Better Neural Magic DeepSparse 1.1 CPU Peak Freq (Highest CPU Core Frequency) Monitor 1100 2200 3300 4400 5500
Neural Magic DeepSparse CPU Temperature Monitor Min Avg Max AVX-512 Off 44.9 54.4 61.8 AVX-512 On 40.1 52.9 57.9 OpenBenchmarking.org Celsius, Fewer Is Better Neural Magic DeepSparse 1.1 CPU Temperature Monitor 20 40 60 80 100
Neural Magic DeepSparse CPU Power Consumption Monitor Min Avg Max AVX-512 Off 217 552 656 AVX-512 On 28 553 664 OpenBenchmarking.org Watts, Fewer Is Better Neural Magic DeepSparse 1.1 CPU Power Consumption Monitor 200 400 600 800 1000
Neural Magic DeepSparse CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max AVX-512 Off 2535 2908 3834 AVX-512 On 2400 2879 3730 OpenBenchmarking.org Megahertz, More Is Better Neural Magic DeepSparse 1.1 CPU Peak Freq (Highest CPU Core Frequency) Monitor 1000 2000 3000 4000 5000
Neural Magic DeepSparse CPU Temperature Monitor Min Avg Max AVX-512 Off 44.4 52.1 55.6 AVX-512 On 39.8 50.1 54.6 OpenBenchmarking.org Celsius, Fewer Is Better Neural Magic DeepSparse 1.1 CPU Temperature Monitor 15 30 45 60 75
Neural Magic DeepSparse CPU Power Consumption Monitor Min Avg Max AVX-512 Off 202.0 364.8 414.2 AVX-512 On 52.3 341.3 408.7 OpenBenchmarking.org Watts, Fewer Is Better Neural Magic DeepSparse 1.1 CPU Power Consumption Monitor 110 220 330 440 550
Neural Magic DeepSparse CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max AVX-512 Off 3068 3641 4426 AVX-512 On 2400 3527 3821 OpenBenchmarking.org Megahertz, More Is Better Neural Magic DeepSparse 1.1 CPU Peak Freq (Highest CPU Core Frequency) Monitor 1100 2200 3300 4400 5500
Neural Magic DeepSparse CPU Temperature Monitor Min Avg Max AVX-512 Off 43.5 51.5 59.1 AVX-512 On 39.3 51.9 58.3 OpenBenchmarking.org Celsius, Fewer Is Better Neural Magic DeepSparse 1.1 CPU Temperature Monitor 16 32 48 64 80
Neural Magic DeepSparse CPU Power Consumption Monitor Min Avg Max AVX-512 Off 114 503 700 AVX-512 On 54 537 700 OpenBenchmarking.org Watts, Fewer Is Better Neural Magic DeepSparse 1.1 CPU Power Consumption Monitor 200 400 600 800 1000
Neural Magic DeepSparse CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max AVX-512 Off 2568 3214 4450 AVX-512 On 2400 2945 3885 OpenBenchmarking.org Megahertz, More Is Better Neural Magic DeepSparse 1.1 CPU Peak Freq (Highest CPU Core Frequency) Monitor 1200 2400 3600 4800 6000
Neural Magic DeepSparse CPU Temperature Monitor Min Avg Max AVX-512 Off 43.0 50.6 56.9 AVX-512 On 38.1 48.5 54.8 OpenBenchmarking.org Celsius, Fewer Is Better Neural Magic DeepSparse 1.1 CPU Temperature Monitor 16 32 48 64 80
Neural Magic DeepSparse CPU Power Consumption Monitor Min Avg Max AVX-512 Off 124.0 352.9 412.6 AVX-512 On 57.7 334.2 406.1 OpenBenchmarking.org Watts, Fewer Is Better Neural Magic DeepSparse 1.1 CPU Power Consumption Monitor 110 220 330 440 550
Neural Magic DeepSparse CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max AVX-512 Off 3678 3702 4150 AVX-512 On 2400 3571 3764 OpenBenchmarking.org Megahertz, More Is Better Neural Magic DeepSparse 1.1 CPU Peak Freq (Highest CPU Core Frequency) Monitor 1100 2200 3300 4400 5500
Neural Magic DeepSparse CPU Temperature Monitor Min Avg Max AVX-512 Off 43.9 50.7 55.5 AVX-512 On 38.9 47.8 53.8 OpenBenchmarking.org Celsius, Fewer Is Better Neural Magic DeepSparse 1.1 CPU Temperature Monitor 15 30 45 60 75
Neural Magic DeepSparse CPU Power Consumption Monitor Min Avg Max AVX-512 Off 110.4 350.8 422.9 AVX-512 On 49.8 321.8 419.4 OpenBenchmarking.org Watts, Fewer Is Better Neural Magic DeepSparse 1.1 CPU Power Consumption Monitor 110 220 330 440 550
Neural Magic DeepSparse CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max AVX-512 Off 3686 3711 4893 AVX-512 On 2400 3551 3868 OpenBenchmarking.org Megahertz, More Is Better Neural Magic DeepSparse 1.1 CPU Peak Freq (Highest CPU Core Frequency) Monitor 1200 2400 3600 4800 6000
Neural Magic DeepSparse CPU Temperature Monitor Min Avg Max AVX-512 Off 44.4 54.9 59.1 AVX-512 On 38.1 51.9 57.3 OpenBenchmarking.org Celsius, Fewer Is Better Neural Magic DeepSparse 1.1 CPU Temperature Monitor 16 32 48 64 80
Neural Magic DeepSparse CPU Power Consumption Monitor Min Avg Max AVX-512 Off 216 558 637 AVX-512 On 56 531 630 OpenBenchmarking.org Watts, Fewer Is Better Neural Magic DeepSparse 1.1 CPU Power Consumption Monitor 200 400 600 800 1000
Neural Magic DeepSparse CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max AVX-512 Off 2552 2938 3959 AVX-512 On 2400 3003 3730 OpenBenchmarking.org Megahertz, More Is Better Neural Magic DeepSparse 1.1 CPU Peak Freq (Highest CPU Core Frequency) Monitor 1000 2000 3000 4000 5000
Neural Magic DeepSparse CPU Temperature Monitor Min Avg Max AVX-512 Off 43.9 54.4 59.1 AVX-512 On 39.9 51.2 55.5 OpenBenchmarking.org Celsius, Fewer Is Better Neural Magic DeepSparse 1.1 CPU Temperature Monitor 16 32 48 64 80
Neural Magic DeepSparse CPU Power Consumption Monitor Min Avg Max AVX-512 Off 217 552 659 AVX-512 On 49 517 625 OpenBenchmarking.org Watts, Fewer Is Better Neural Magic DeepSparse 1.1 CPU Power Consumption Monitor 200 400 600 800 1000
Neural Magic DeepSparse CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max AVX-512 Off 2623 2987 4137 AVX-512 On 2400 2868 3737 OpenBenchmarking.org Megahertz, More Is Better Neural Magic DeepSparse 1.1 CPU Peak Freq (Highest CPU Core Frequency) Monitor 1100 2200 3300 4400 5500
Neural Magic DeepSparse CPU Temperature Monitor Min Avg Max AVX-512 Off 43.0 50.5 54.3 AVX-512 On 39.0 48.0 52.4 OpenBenchmarking.org Celsius, Fewer Is Better Neural Magic DeepSparse 1.1 CPU Temperature Monitor 15 30 45 60 75
Neural Magic DeepSparse CPU Power Consumption Monitor Min Avg Max AVX-512 Off 197.4 352.2 401.6 AVX-512 On 37.8 324.6 394.5 OpenBenchmarking.org Watts, Fewer Is Better Neural Magic DeepSparse 1.1 CPU Power Consumption Monitor 110 220 330 440 550
Neural Magic DeepSparse CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max AVX-512 Off 3692 3712 4154 AVX-512 On 2400 3541 3702 OpenBenchmarking.org Megahertz, More Is Better Neural Magic DeepSparse 1.1 CPU Peak Freq (Highest CPU Core Frequency) Monitor 1100 2200 3300 4400 5500
Neural Magic DeepSparse CPU Temperature Monitor Min Avg Max AVX-512 Off 41.8 51.5 60.0 AVX-512 On 38.6 49.4 57.0 OpenBenchmarking.org Celsius, Fewer Is Better Neural Magic DeepSparse 1.1 CPU Temperature Monitor 16 32 48 64 80
Neural Magic DeepSparse CPU Power Consumption Monitor Min Avg Max AVX-512 Off 216 508 705 AVX-512 On 53 479 679 OpenBenchmarking.org Watts, Fewer Is Better Neural Magic DeepSparse 1.1 CPU Power Consumption Monitor 200 400 600 800 1000
Neural Magic DeepSparse CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max AVX-512 Off 2589 3135 4299 AVX-512 On 2400 3109 3928 OpenBenchmarking.org Megahertz, More Is Better Neural Magic DeepSparse 1.1 CPU Peak Freq (Highest CPU Core Frequency) Monitor 1100 2200 3300 4400 5500
Neural Magic DeepSparse CPU Temperature Monitor Min Avg Max AVX-512 Off 36.8 45.2 52.4 AVX-512 On 32.4 43.7 51.5 OpenBenchmarking.org Celsius, Fewer Is Better Neural Magic DeepSparse 1.1 CPU Temperature Monitor 15 30 45 60 75
Neural Magic DeepSparse CPU Power Consumption Monitor Min Avg Max AVX-512 Off 111.5 321.8 409.9 AVX-512 On 50.9 306.4 407.9 OpenBenchmarking.org Watts, Fewer Is Better Neural Magic DeepSparse 1.1 CPU Power Consumption Monitor 110 220 330 440 550
Neural Magic DeepSparse CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max AVX-512 Off 3507 3698 3967 AVX-512 On 2400 3559 3801 OpenBenchmarking.org Megahertz, More Is Better Neural Magic DeepSparse 1.1 CPU Peak Freq (Highest CPU Core Frequency) Monitor 1100 2200 3300 4400 5500
AI Benchmark Alpha CPU Temperature Monitor Min Avg Max AVX-512 Off 36.4 40.6 49.3 AVX-512 On 30.1 39.2 47.0 OpenBenchmarking.org Celsius, Fewer Is Better AI Benchmark Alpha 0.1.2 CPU Temperature Monitor 14 28 42 56 70
AI Benchmark Alpha CPU Power Consumption Monitor Min Avg Max AVX-512 Off 130.7 308.8 452.7 AVX-512 On 52.9 302.7 502.0 OpenBenchmarking.org Watts, Fewer Is Better AI Benchmark Alpha 0.1.2 CPU Power Consumption Monitor 130 260 390 520 650
AI Benchmark Alpha CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max AVX-512 Off 3068 3710 4285 AVX-512 On 2400 3655 4107 OpenBenchmarking.org Megahertz, More Is Better AI Benchmark Alpha 0.1.2 CPU Peak Freq (Highest CPU Core Frequency) Monitor 1100 2200 3300 4400 5500
AI Benchmark Alpha Device AI Score OpenBenchmarking.org Score Per Watt, More Is Better AI Benchmark Alpha 0.1.2 Device AI Score AVX-512 Off AVX-512 On 5 10 15 20 25 9.349 20.522
Phoronix Test Suite v10.8.4