AMD EPYC 9654 Genoa AVX-512 benchmark comparison by Michael Larabel for a future article.
Compare your own system(s) to this result file with the
Phoronix Test Suite by running the command:
phoronix-test-suite benchmark 2212195-NE-AVXCOMPAR69 AMD EPYC 4th Gen AVX-512 Comparison - Phoronix Test Suite AMD EPYC 4th Gen AVX-512 Comparison AMD EPYC 9654 Genoa AVX-512 benchmark comparison by Michael Larabel for a future article.
HTML result view exported from: https://openbenchmarking.org/result/2212195-NE-AVXCOMPAR69&export=txt&grr&rdt .
AMD EPYC 4th Gen AVX-512 Comparison Processor Motherboard Chipset Memory Disk Graphics Monitor Network OS Kernel Desktop Display Server Vulkan Compiler File-System Screen Resolution AVX-512 On AVX-512 Off 2 x AMD EPYC 9654 96-Core @ 2.40GHz (192 Cores / 384 Threads) AMD Titanite_4G (RTI1002E BIOS) AMD Device 14a4 1520GB 800GB INTEL SSDPF21Q800GB ASPEED VGA HDMI Broadcom NetXtreme BCM5720 PCIe Ubuntu 22.10 6.1.0-phx (x86_64) GNOME Shell 43.0 X Server 1.21.1.4 1.3.224 GCC 12.2.0 + Clang 15.0.2-1 ext4 1920x1080 OpenBenchmarking.org Kernel Details - Transparent Huge Pages: madvise Environment Details - AVX-512 On: CXXFLAGS="-O3 -march=native -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi -mprefer-vector-width=512" CFLAGS="-O3 -march=native -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi -mprefer-vector-width=512" - AVX-512 Off: CXXFLAGS="-O3 -march=native -mno-avx512f" CFLAGS="-O3 -march=native -mno-avx512f" Compiler Details - --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-defaulted --enable-offload-targets=nvptx-none=/build/gcc-12-U8K4Qv/gcc-12-12.2.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-12-U8K4Qv/gcc-12-12.2.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v Processor Details - Scaling Governor: acpi-cpufreq performance (Boost: Enabled) - CPU Microcode: 0xa10110d Python Details - Python 3.10.7 Security Details - itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional IBRS_FW STIBP: always-on RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected
AMD EPYC 4th Gen AVX-512 Comparison jpegxl: JPEG - 100 ncnn: CPU - FastestDet ncnn: CPU - vision_transformer ncnn: CPU - regnety_400m ncnn: CPU - resnet50 ncnn: CPU - googlenet ncnn: CPU - blazeface ncnn: CPU - efficientnet-b0 ncnn: CPU - mnasnet mnn: inception-v3 mnn: SqueezeNetV1.0 mnn: resnet-v2-50 onnx: ArcFace ResNet-100 - CPU - Standard lczero: BLAS openvkl: vklBenchmark ISPC daphne: OpenMP - Points2Image cp2k: Fayalite-FIST lczero: Eigen ai-benchmark: Device AI Score ai-benchmark: Device Training Score ai-benchmark: Device Inference Score onnx: fcn-resnet101-11 - CPU - Standard onnx: super-resolution-10 - CPU - Standard onednn: Recurrent Neural Network Training - bf16bf16bf16 - CPU ospray-studio: 1 - 4K - 16 - Path Tracer ospray-studio: 2 - 4K - 16 - Path Tracer ospray-studio: 3 - 4K - 16 - Path Tracer numpy: ospray-studio: 3 - 1080p - 32 - Path Tracer ospray-studio: 2 - 1080p - 32 - Path Tracer ospray-studio: 1 - 1080p - 32 - Path Tracer ospray-studio: 1 - 4K - 32 - Path Tracer ospray-studio: 2 - 4K - 32 - Path Tracer ospray-studio: 3 - 1080p - 16 - Path Tracer ospray-studio: 2 - 1080p - 16 - Path Tracer ospray-studio: 1 - 1080p - 16 - Path Tracer ospray: gravity_spheres_volume/dim_512/scivis/real_time ospray: gravity_spheres_volume/dim_512/ao/real_time ospray-studio: 3 - 1080p - 1 - Path Tracer onednn: Recurrent Neural Network Training - f32 - CPU onnx: bertsquad-12 - CPU - Standard ospray-studio: 2 - 1080p - 1 - Path Tracer ospray-studio: 1 - 1080p - 1 - Path Tracer ospray: gravity_spheres_volume/dim_512/pathtracer/real_time tensorflow: CPU - 16 - ResNet-50 ospray-studio: 3 - 4K - 32 - Path Tracer tensorflow: CPU - 16 - GoogLeNet ospray-studio: 3 - 4K - 1 - Path Tracer ospray-studio: 1 - 4K - 1 - Path Tracer jpegxl: JPEG - 90 ospray-studio: 2 - 4K - 1 - Path Tracer jpegxl: PNG - 90 onednn: Recurrent Neural Network Inference - bf16bf16bf16 - CPU simdjson: TopTweet openfoam: drivaerFastback, Medium Mesh Size - Execution Time openfoam: drivaerFastback, Medium Mesh Size - Mesh Time openvino: Age Gender Recognition Retail 0013 FP16 - CPU openvino: Age Gender Recognition Retail 0013 FP16 - CPU simdjson: DistinctUserID simdjson: PartialTweets openvino: Person Detection FP16 - CPU openvino: Person Detection FP16 - CPU openvino: Person Detection FP32 - CPU openvino: Person Detection FP32 - CPU openvino: Face Detection FP16 - CPU openvino: Face Detection FP16 - CPU openvino: Face Detection FP16-INT8 - CPU openvino: Face Detection FP16-INT8 - CPU openvino: Person Vehicle Bike Detection FP16 - CPU openvino: Person Vehicle Bike Detection FP16 - CPU deepsparse: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Asynchronous Multi-Stream deepsparse: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Asynchronous Multi-Stream openvino: Machine Translation EN To DE FP16 - CPU openvino: Machine Translation EN To DE FP16 - CPU openvino: Age Gender Recognition Retail 0013 FP16-INT8 - CPU openvino: Age Gender Recognition Retail 0013 FP16-INT8 - CPU openvino: Weld Porosity Detection FP16-INT8 - CPU openvino: Weld Porosity Detection FP16-INT8 - CPU openvino: Vehicle Detection FP16 - CPU openvino: Vehicle Detection FP16 - CPU openvino: Vehicle Detection FP16-INT8 - CPU openvino: Vehicle Detection FP16-INT8 - CPU openvino: Weld Porosity Detection FP16 - CPU openvino: Weld Porosity Detection FP16 - CPU deepsparse: NLP Text Classification, BERT base uncased SST2 - Synchronous Single-Stream deepsparse: NLP Text Classification, BERT base uncased SST2 - Synchronous Single-Stream simdjson: Kostya deepsparse: NLP Text Classification, BERT base uncased SST2 - Asynchronous Multi-Stream deepsparse: NLP Text Classification, BERT base uncased SST2 - Asynchronous Multi-Stream deepsparse: NLP Token Classification, BERT base uncased conll2003 - Synchronous Single-Stream deepsparse: NLP Token Classification, BERT base uncased conll2003 - Synchronous Single-Stream deepsparse: NLP Document Classification, oBERT base uncased on IMDB - Synchronous Single-Stream deepsparse: NLP Document Classification, oBERT base uncased on IMDB - Synchronous Single-Stream simdjson: LargeRand deepsparse: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Synchronous Single-Stream deepsparse: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Synchronous Single-Stream deepsparse: NLP Text Classification, DistilBERT mnli - Synchronous Single-Stream deepsparse: NLP Text Classification, DistilBERT mnli - Synchronous Single-Stream tensorflow: CPU - 16 - AlexNet deepsparse: NLP Text Classification, DistilBERT mnli - Asynchronous Multi-Stream deepsparse: NLP Text Classification, DistilBERT mnli - Asynchronous Multi-Stream deepsparse: CV Detection,YOLOv5s COCO - Asynchronous Multi-Stream deepsparse: CV Detection,YOLOv5s COCO - Asynchronous Multi-Stream deepsparse: CV Detection,YOLOv5s COCO - Synchronous Single-Stream deepsparse: CV Detection,YOLOv5s COCO - Synchronous Single-Stream deepsparse: CV Classification, ResNet-50 ImageNet - Asynchronous Multi-Stream deepsparse: CV Classification, ResNet-50 ImageNet - Asynchronous Multi-Stream cpuminer-opt: scrypt cpuminer-opt: LBC, LBRY Credits cpuminer-opt: x25x svt-av1: Preset 12 - Bosphorus 4K cpuminer-opt: Garlicoin cpuminer-opt: Quad SHA-256, Pyrite cpuminer-opt: Skeincoin numenta-nab: Bayesian Changepoint gromacs: MPI CPU - water_GMX50_bare onednn: Convolution Batch Shapes Auto - f32 - CPU onednn: Deconvolution Batch shapes_1d - f32 - CPU daphne: OpenMP - NDT Mapping svt-av1: Preset 13 - Bosphorus 4K minibude: OpenMP - BM2 minibude: OpenMP - BM2 embree: Pathtracer ISPC - Asian Dragon Obj oidn: RTLightmap.hdr.4096x4096 numenta-nab: Windowed Gaussian numenta-nab: Relative Entropy oidn: RT.hdr_alb_nrm.3840x2160 oidn: RT.ldr_alb_nrm.3840x2160 smhasher: FarmHash32 x86_64 AVX smhasher: FarmHash32 x86_64 AVX embree: Pathtracer ISPC - Crown embree: Pathtracer ISPC - Asian Dragon minibude: OpenMP - BM1 minibude: OpenMP - BM1 onednn: Deconvolution Batch shapes_3d - f32 - CPU AVX-512 On AVX-512 Off 0.74 58.95 74.93 247.32 66.34 72.80 25.88 57.71 42.30 45.812 8.579 15.441 1051 9077 1332 13677.764494843 1122.725 9096 6211 2701 3510 271 7401 1955.39 9271 9385 11070 575.66 5608 4764 4698 18546 18808 2804 2384 2353 43.0711 44.1566 177 1962.06 516 154 148 54.2187 22.15 22184 60.17 694 581 9.55 604 9.95 2361.27 6.52 113.63733 135.77418 0.55 148967.98 6.86 6.70 1100.25 43.34 1101.00 43.34 469.29 102.04 246.98 193.93 5.29 9065.34 125.7860 761.2241 50.11 956.88 0.36 170652.71 9.63 19800.20 6.43 7452.96 4.28 11202.62 4.79 9988.44 11.7586 84.9988 4.18 155.3462 616.6804 28.9609 34.5206 29.1892 34.2518 1.26 9.9408 100.5458 5.3413 187.0837 157.29 80.0826 1195.9367 111.7282 857.2265 5.2712 189.5611 49.0328 1953.0255 4800.61 1066950 7696.06 245.555 71553 2260680 1951330 16.677 18.764 0.516167 22.5875 1371.18 246.572 346.081 8652.005 184.4701 1.66 4.727 9.898 3.51 3.51 26.387 39794.44 180.9315 212.9364 291.982 7299.545 0.989591 0.72 60.73 86.16 270.12 67.48 76.13 29.00 62.86 44.19 30.436 9.146 24.098 918 8423 1155 11521.38 1198.408 8162 2887 1066 1821 250 6288 4989.13 11321 11524 13398 548.83 6820 5861 5749 22647 22985 3413 2924 2871 25.1354 26.3794 214 4953.98 499 184 181 40.5117 12.75 26785 31.12 841 710 9.13 722 9.52 1715.76 5.38 135.21648 144.3478 1.21 108449.49 5.25 5.14 1864.93 25.50 1845.95 25.74 1088.50 43.94 503.50 94.97 9.33 5135.56 195.1656 490.3658 107.62 445.59 0.57 151239.60 19.69 9672.94 12.67 3782.08 7.90 6065.76 11.66 4110.49 13.5907 73.5380 3.39 187.8540 509.4462 32.6647 30.6062 32.7505 30.5267 1.04 14.0655 71.0437 5.6282 177.5387 55.11 95.3347 1005.1615 138.5861 690.8722 6.3313 157.819 67.9118 1410.8051 2946.08 491740 5784.25 233.944 48827 1322960 1427543 17.389 18.467 0.537682 22.8354 1335.63 239.881 255.661 6391.519 153.4476 1.72 4.882 10.035 3.50 3.51 26.412 36483.70 151.0558 176.8831 202.604 5065.096 1.76336 OpenBenchmarking.org
JPEG XL libjxl Input: JPEG - Quality: 100 OpenBenchmarking.org MP/s, More Is Better JPEG XL libjxl 0.7 Input: JPEG - Quality: 100 AVX-512 On AVX-512 Off 0.1665 0.333 0.4995 0.666 0.8325 SE +/- 0.01, N = 9 SE +/- 0.01, N = 9 0.74 0.72 -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi -mno-avx512f 1. (CXX) g++ options: -O3 -march=native -fno-rtti -funwind-tables -O2 -fPIE -pie -lm -latomic
NCNN Target: CPU - Model: FastestDet OpenBenchmarking.org ms, Fewer Is Better NCNN 20220729 Target: CPU - Model: FastestDet AVX-512 On AVX-512 Off 14 28 42 56 70 SE +/- 0.49, N = 8 SE +/- 2.90, N = 3 58.95 60.73 -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi - MIN: 55.11 / MAX: 282.72 -mno-avx512f - MIN: 52.89 / MAX: 236.85 1. (CXX) g++ options: -O3 -march=native -rdynamic -lgomp -lpthread
NCNN Target: CPU - Model: vision_transformer OpenBenchmarking.org ms, Fewer Is Better NCNN 20220729 Target: CPU - Model: vision_transformer AVX-512 On AVX-512 Off 20 40 60 80 100 SE +/- 1.59, N = 8 SE +/- 5.82, N = 3 74.93 86.16 -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi - MIN: 65.04 / MAX: 2154.62 -mno-avx512f - MIN: 73.72 / MAX: 1760.74 1. (CXX) g++ options: -O3 -march=native -rdynamic -lgomp -lpthread
NCNN Target: CPU - Model: regnety_400m OpenBenchmarking.org ms, Fewer Is Better NCNN 20220729 Target: CPU - Model: regnety_400m AVX-512 On AVX-512 Off 60 120 180 240 300 SE +/- 2.25, N = 8 SE +/- 3.75, N = 3 247.32 270.12 -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi - MIN: 232.61 / MAX: 506.55 -mno-avx512f - MIN: 245.47 / MAX: 498.8 1. (CXX) g++ options: -O3 -march=native -rdynamic -lgomp -lpthread
NCNN Target: CPU - Model: resnet50 OpenBenchmarking.org ms, Fewer Is Better NCNN 20220729 Target: CPU - Model: resnet50 AVX-512 On AVX-512 Off 15 30 45 60 75 SE +/- 0.50, N = 8 SE +/- 0.89, N = 3 66.34 67.48 -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi - MIN: 62.92 / MAX: 194.74 -mno-avx512f - MIN: 63.4 / MAX: 170.14 1. (CXX) g++ options: -O3 -march=native -rdynamic -lgomp -lpthread
NCNN Target: CPU - Model: googlenet OpenBenchmarking.org ms, Fewer Is Better NCNN 20220729 Target: CPU - Model: googlenet AVX-512 On AVX-512 Off 20 40 60 80 100 SE +/- 0.76, N = 8 SE +/- 1.35, N = 3 72.80 76.13 -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi - MIN: 67.13 / MAX: 388.52 -mno-avx512f - MIN: 70.13 / MAX: 155.61 1. (CXX) g++ options: -O3 -march=native -rdynamic -lgomp -lpthread
NCNN Target: CPU - Model: blazeface OpenBenchmarking.org ms, Fewer Is Better NCNN 20220729 Target: CPU - Model: blazeface AVX-512 On AVX-512 Off 7 14 21 28 35 SE +/- 0.18, N = 8 SE +/- 0.54, N = 3 25.88 29.00 -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi - MIN: 24.45 / MAX: 112.37 -mno-avx512f - MIN: 26.03 / MAX: 144.12 1. (CXX) g++ options: -O3 -march=native -rdynamic -lgomp -lpthread
NCNN Target: CPU - Model: efficientnet-b0 OpenBenchmarking.org ms, Fewer Is Better NCNN 20220729 Target: CPU - Model: efficientnet-b0 AVX-512 On AVX-512 Off 14 28 42 56 70 SE +/- 0.35, N = 8 SE +/- 0.31, N = 3 57.71 62.86 -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi - MIN: 54.52 / MAX: 522.74 -mno-avx512f - MIN: 59.46 / MAX: 154.82 1. (CXX) g++ options: -O3 -march=native -rdynamic -lgomp -lpthread
NCNN Target: CPU - Model: mnasnet OpenBenchmarking.org ms, Fewer Is Better NCNN 20220729 Target: CPU - Model: mnasnet AVX-512 On AVX-512 Off 10 20 30 40 50 SE +/- 0.26, N = 8 SE +/- 0.49, N = 3 42.30 44.19 -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi - MIN: 39.64 / MAX: 571.78 -mno-avx512f - MIN: 41.56 / MAX: 148.98 1. (CXX) g++ options: -O3 -march=native -rdynamic -lgomp -lpthread
Mobile Neural Network Model: inception-v3 OpenBenchmarking.org ms, Fewer Is Better Mobile Neural Network 2.1 Model: inception-v3 AVX-512 On AVX-512 Off 10 20 30 40 50 SE +/- 0.23, N = 9 SE +/- 0.13, N = 8 45.81 30.44 -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi - MIN: 44.13 / MAX: 87.28 -mno-avx512f - MIN: 28.75 / MAX: 109.22 1. (CXX) g++ options: -O3 -march=native -std=c++11 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl
Mobile Neural Network Model: SqueezeNetV1.0 OpenBenchmarking.org ms, Fewer Is Better Mobile Neural Network 2.1 Model: SqueezeNetV1.0 AVX-512 On AVX-512 Off 3 6 9 12 15 SE +/- 0.147, N = 9 SE +/- 0.091, N = 8 8.579 9.146 -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi - MIN: 6.67 / MAX: 21.5 -mno-avx512f - MIN: 7.72 / MAX: 19.03 1. (CXX) g++ options: -O3 -march=native -std=c++11 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl
Mobile Neural Network Model: resnet-v2-50 OpenBenchmarking.org ms, Fewer Is Better Mobile Neural Network 2.1 Model: resnet-v2-50 AVX-512 On AVX-512 Off 6 12 18 24 30 SE +/- 0.08, N = 9 SE +/- 0.08, N = 8 15.44 24.10 -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi - MIN: 14.79 / MAX: 54.05 -mno-avx512f - MIN: 23.44 / MAX: 71.32 1. (CXX) g++ options: -O3 -march=native -std=c++11 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl
ONNX Runtime Model: ArcFace ResNet-100 - Device: CPU - Executor: Standard OpenBenchmarking.org Inferences Per Minute, More Is Better ONNX Runtime 1.11 Model: ArcFace ResNet-100 - Device: CPU - Executor: Standard AVX-512 On AVX-512 Off 200 400 600 800 1000 SE +/- 39.92, N = 12 SE +/- 20.83, N = 12 1051 918 -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi -mno-avx512f 1. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt
LeelaChessZero Backend: BLAS OpenBenchmarking.org Nodes Per Second, More Is Better LeelaChessZero 0.28 Backend: BLAS AVX-512 On AVX-512 Off 2K 4K 6K 8K 10K SE +/- 103.04, N = 4 SE +/- 21.53, N = 3 9077 8423 -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi -mno-avx512f 1. (CXX) g++ options: -flto -O3 -march=native -pthread
OpenVKL Benchmark: vklBenchmark ISPC OpenBenchmarking.org Items / Sec, More Is Better OpenVKL 1.3.1 Benchmark: vklBenchmark ISPC AVX-512 On AVX-512 Off 300 600 900 1200 1500 SE +/- 13.58, N = 3 SE +/- 8.11, N = 3 1332 1155 MIN: 329 / MAX: 4770 MIN: 251 / MAX: 5181
Darmstadt Automotive Parallel Heterogeneous Suite Backend: OpenMP - Kernel: Points2Image OpenBenchmarking.org Test Cases Per Minute, More Is Better Darmstadt Automotive Parallel Heterogeneous Suite Backend: OpenMP - Kernel: Points2Image AVX-512 On AVX-512 Off 3K 6K 9K 12K 15K SE +/- 126.17, N = 15 SE +/- 269.82, N = 15 13677.76 11521.38 1. (CXX) g++ options: -O3 -std=c++11 -fopenmp
CP2K Molecular Dynamics Input: Fayalite-FIST OpenBenchmarking.org Seconds, Fewer Is Better CP2K Molecular Dynamics 8.2 Input: Fayalite-FIST AVX-512 On AVX-512 Off 300 600 900 1200 1500 1122.73 1198.41
LeelaChessZero Backend: Eigen OpenBenchmarking.org Nodes Per Second, More Is Better LeelaChessZero 0.28 Backend: Eigen AVX-512 On AVX-512 Off 2K 4K 6K 8K 10K SE +/- 45.37, N = 3 SE +/- 43.59, N = 3 9096 8162 -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi -mno-avx512f 1. (CXX) g++ options: -flto -O3 -march=native -pthread
AI Benchmark Alpha Device AI Score OpenBenchmarking.org Score, More Is Better AI Benchmark Alpha 0.1.2 Device AI Score AVX-512 On AVX-512 Off 1300 2600 3900 5200 6500 6211 2887
AI Benchmark Alpha Device Training Score OpenBenchmarking.org Score, More Is Better AI Benchmark Alpha 0.1.2 Device Training Score AVX-512 On AVX-512 Off 600 1200 1800 2400 3000 2701 1066
AI Benchmark Alpha Device Inference Score OpenBenchmarking.org Score, More Is Better AI Benchmark Alpha 0.1.2 Device Inference Score AVX-512 On AVX-512 Off 800 1600 2400 3200 4000 3510 1821
ONNX Runtime Model: fcn-resnet101-11 - Device: CPU - Executor: Standard OpenBenchmarking.org Inferences Per Minute, More Is Better ONNX Runtime 1.11 Model: fcn-resnet101-11 - Device: CPU - Executor: Standard AVX-512 On AVX-512 Off 60 120 180 240 300 SE +/- 0.44, N = 3 SE +/- 2.36, N = 12 271 250 -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi -mno-avx512f 1. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt
ONNX Runtime Model: super-resolution-10 - Device: CPU - Executor: Standard OpenBenchmarking.org Inferences Per Minute, More Is Better ONNX Runtime 1.11 Model: super-resolution-10 - Device: CPU - Executor: Standard AVX-512 On AVX-512 Off 1600 3200 4800 6400 8000 SE +/- 5.46, N = 3 SE +/- 260.54, N = 12 7401 6288 -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi -mno-avx512f 1. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt
oneDNN Harness: Recurrent Neural Network Training - Data Type: bf16bf16bf16 - Engine: CPU OpenBenchmarking.org ms, Fewer Is Better oneDNN 2.7 Harness: Recurrent Neural Network Training - Data Type: bf16bf16bf16 - Engine: CPU AVX-512 On AVX-512 Off 1100 2200 3300 4400 5500 SE +/- 19.67, N = 15 SE +/- 41.71, N = 3 1955.39 4989.13 -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi - MIN: 1769.7 -mno-avx512f - MIN: 4767.22 1. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread
OSPRay Studio Camera: 1 - Resolution: 4K - Samples Per Pixel: 16 - Renderer: Path Tracer OpenBenchmarking.org ms, Fewer Is Better OSPRay Studio 0.11 Camera: 1 - Resolution: 4K - Samples Per Pixel: 16 - Renderer: Path Tracer AVX-512 On AVX-512 Off 2K 4K 6K 8K 10K SE +/- 10.17, N = 3 SE +/- 24.46, N = 3 9271 11321 -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi -mno-avx512f 1. (CXX) g++ options: -O3 -march=native -ldl
OSPRay Studio Camera: 2 - Resolution: 4K - Samples Per Pixel: 16 - Renderer: Path Tracer OpenBenchmarking.org ms, Fewer Is Better OSPRay Studio 0.11 Camera: 2 - Resolution: 4K - Samples Per Pixel: 16 - Renderer: Path Tracer AVX-512 On AVX-512 Off 2K 4K 6K 8K 10K SE +/- 2.19, N = 3 SE +/- 15.51, N = 3 9385 11524 -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi -mno-avx512f 1. (CXX) g++ options: -O3 -march=native -ldl
OSPRay Studio Camera: 3 - Resolution: 4K - Samples Per Pixel: 16 - Renderer: Path Tracer OpenBenchmarking.org ms, Fewer Is Better OSPRay Studio 0.11 Camera: 3 - Resolution: 4K - Samples Per Pixel: 16 - Renderer: Path Tracer AVX-512 On AVX-512 Off 3K 6K 9K 12K 15K SE +/- 27.14, N = 3 SE +/- 22.81, N = 3 11070 13398 -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi -mno-avx512f 1. (CXX) g++ options: -O3 -march=native -ldl
Numpy Benchmark OpenBenchmarking.org Score, More Is Better Numpy Benchmark AVX-512 On AVX-512 Off 120 240 360 480 600 SE +/- 2.18, N = 3 SE +/- 0.59, N = 3 575.66 548.83
OSPRay Studio Camera: 3 - Resolution: 1080p - Samples Per Pixel: 32 - Renderer: Path Tracer OpenBenchmarking.org ms, Fewer Is Better OSPRay Studio 0.11 Camera: 3 - Resolution: 1080p - Samples Per Pixel: 32 - Renderer: Path Tracer AVX-512 On AVX-512 Off 1500 3000 4500 6000 7500 SE +/- 9.54, N = 3 SE +/- 5.51, N = 3 5608 6820 -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi -mno-avx512f 1. (CXX) g++ options: -O3 -march=native -ldl
OSPRay Studio Camera: 2 - Resolution: 1080p - Samples Per Pixel: 32 - Renderer: Path Tracer OpenBenchmarking.org ms, Fewer Is Better OSPRay Studio 0.11 Camera: 2 - Resolution: 1080p - Samples Per Pixel: 32 - Renderer: Path Tracer AVX-512 On AVX-512 Off 1300 2600 3900 5200 6500 SE +/- 6.24, N = 3 SE +/- 8.25, N = 3 4764 5861 -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi -mno-avx512f 1. (CXX) g++ options: -O3 -march=native -ldl
OSPRay Studio Camera: 1 - Resolution: 1080p - Samples Per Pixel: 32 - Renderer: Path Tracer OpenBenchmarking.org ms, Fewer Is Better OSPRay Studio 0.11 Camera: 1 - Resolution: 1080p - Samples Per Pixel: 32 - Renderer: Path Tracer AVX-512 On AVX-512 Off 1200 2400 3600 4800 6000 SE +/- 3.71, N = 3 SE +/- 6.56, N = 3 4698 5749 -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi -mno-avx512f 1. (CXX) g++ options: -O3 -march=native -ldl
OSPRay Studio Camera: 1 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path Tracer OpenBenchmarking.org ms, Fewer Is Better OSPRay Studio 0.11 Camera: 1 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path Tracer AVX-512 On AVX-512 Off 5K 10K 15K 20K 25K SE +/- 13.75, N = 3 SE +/- 27.41, N = 3 18546 22647 -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi -mno-avx512f 1. (CXX) g++ options: -O3 -march=native -ldl
OSPRay Studio Camera: 2 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path Tracer OpenBenchmarking.org ms, Fewer Is Better OSPRay Studio 0.11 Camera: 2 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path Tracer AVX-512 On AVX-512 Off 5K 10K 15K 20K 25K SE +/- 20.34, N = 3 SE +/- 30.02, N = 3 18808 22985 -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi -mno-avx512f 1. (CXX) g++ options: -O3 -march=native -ldl
OSPRay Studio Camera: 3 - Resolution: 1080p - Samples Per Pixel: 16 - Renderer: Path Tracer OpenBenchmarking.org ms, Fewer Is Better OSPRay Studio 0.11 Camera: 3 - Resolution: 1080p - Samples Per Pixel: 16 - Renderer: Path Tracer AVX-512 On AVX-512 Off 700 1400 2100 2800 3500 SE +/- 3.06, N = 3 SE +/- 7.00, N = 3 2804 3413 -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi -mno-avx512f 1. (CXX) g++ options: -O3 -march=native -ldl
OSPRay Studio Camera: 2 - Resolution: 1080p - Samples Per Pixel: 16 - Renderer: Path Tracer OpenBenchmarking.org ms, Fewer Is Better OSPRay Studio 0.11 Camera: 2 - Resolution: 1080p - Samples Per Pixel: 16 - Renderer: Path Tracer AVX-512 On AVX-512 Off 600 1200 1800 2400 3000 SE +/- 9.17, N = 3 SE +/- 0.88, N = 3 2384 2924 -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi -mno-avx512f 1. (CXX) g++ options: -O3 -march=native -ldl
OSPRay Studio Camera: 1 - Resolution: 1080p - Samples Per Pixel: 16 - Renderer: Path Tracer OpenBenchmarking.org ms, Fewer Is Better OSPRay Studio 0.11 Camera: 1 - Resolution: 1080p - Samples Per Pixel: 16 - Renderer: Path Tracer AVX-512 On AVX-512 Off 600 1200 1800 2400 3000 SE +/- 2.33, N = 3 SE +/- 1.20, N = 3 2353 2871 -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi -mno-avx512f 1. (CXX) g++ options: -O3 -march=native -ldl
OSPRay Benchmark: gravity_spheres_volume/dim_512/scivis/real_time OpenBenchmarking.org Items Per Second, More Is Better OSPRay 2.10 Benchmark: gravity_spheres_volume/dim_512/scivis/real_time AVX-512 On AVX-512 Off 10 20 30 40 50 SE +/- 0.10, N = 3 SE +/- 0.04, N = 3 43.07 25.14
OSPRay Benchmark: gravity_spheres_volume/dim_512/ao/real_time OpenBenchmarking.org Items Per Second, More Is Better OSPRay 2.10 Benchmark: gravity_spheres_volume/dim_512/ao/real_time AVX-512 On AVX-512 Off 10 20 30 40 50 SE +/- 0.21, N = 3 SE +/- 0.02, N = 3 44.16 26.38
OSPRay Studio Camera: 3 - Resolution: 1080p - Samples Per Pixel: 1 - Renderer: Path Tracer OpenBenchmarking.org ms, Fewer Is Better OSPRay Studio 0.11 Camera: 3 - Resolution: 1080p - Samples Per Pixel: 1 - Renderer: Path Tracer AVX-512 On AVX-512 Off 50 100 150 200 250 SE +/- 0.00, N = 3 SE +/- 0.58, N = 3 177 214 -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi -mno-avx512f 1. (CXX) g++ options: -O3 -march=native -ldl
oneDNN Harness: Recurrent Neural Network Training - Data Type: f32 - Engine: CPU OpenBenchmarking.org ms, Fewer Is Better oneDNN 2.7 Harness: Recurrent Neural Network Training - Data Type: f32 - Engine: CPU AVX-512 On AVX-512 Off 1100 2200 3300 4400 5500 SE +/- 20.13, N = 5 SE +/- 60.12, N = 4 1962.06 4953.98 -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi - MIN: 1899.34 -mno-avx512f - MIN: 4690.85 1. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread
ONNX Runtime Model: bertsquad-12 - Device: CPU - Executor: Standard OpenBenchmarking.org Inferences Per Minute, More Is Better ONNX Runtime 1.11 Model: bertsquad-12 - Device: CPU - Executor: Standard AVX-512 On AVX-512 Off 110 220 330 440 550 SE +/- 1.86, N = 3 SE +/- 3.11, N = 3 516 499 -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi -mno-avx512f 1. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt
OSPRay Studio Camera: 2 - Resolution: 1080p - Samples Per Pixel: 1 - Renderer: Path Tracer OpenBenchmarking.org ms, Fewer Is Better OSPRay Studio 0.11 Camera: 2 - Resolution: 1080p - Samples Per Pixel: 1 - Renderer: Path Tracer AVX-512 On AVX-512 Off 40 80 120 160 200 SE +/- 0.00, N = 3 SE +/- 0.33, N = 3 154 184 -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi -mno-avx512f 1. (CXX) g++ options: -O3 -march=native -ldl
OSPRay Studio Camera: 1 - Resolution: 1080p - Samples Per Pixel: 1 - Renderer: Path Tracer OpenBenchmarking.org ms, Fewer Is Better OSPRay Studio 0.11 Camera: 1 - Resolution: 1080p - Samples Per Pixel: 1 - Renderer: Path Tracer AVX-512 On AVX-512 Off 40 80 120 160 200 SE +/- 0.33, N = 3 SE +/- 0.33, N = 3 148 181 -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi -mno-avx512f 1. (CXX) g++ options: -O3 -march=native -ldl
OSPRay Benchmark: gravity_spheres_volume/dim_512/pathtracer/real_time OpenBenchmarking.org Items Per Second, More Is Better OSPRay 2.10 Benchmark: gravity_spheres_volume/dim_512/pathtracer/real_time AVX-512 On AVX-512 Off 12 24 36 48 60 SE +/- 0.05, N = 3 SE +/- 0.03, N = 3 54.22 40.51
TensorFlow Device: CPU - Batch Size: 16 - Model: ResNet-50 OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.10 Device: CPU - Batch Size: 16 - Model: ResNet-50 AVX-512 On AVX-512 Off 5 10 15 20 25 SE +/- 0.11, N = 3 SE +/- 0.01, N = 3 22.15 12.75
OSPRay Studio Camera: 3 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path Tracer OpenBenchmarking.org ms, Fewer Is Better OSPRay Studio 0.11 Camera: 3 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path Tracer AVX-512 On AVX-512 Off 6K 12K 18K 24K 30K SE +/- 21.63, N = 3 SE +/- 15.62, N = 3 22184 26785 -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi -mno-avx512f 1. (CXX) g++ options: -O3 -march=native -ldl
TensorFlow Device: CPU - Batch Size: 16 - Model: GoogLeNet OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.10 Device: CPU - Batch Size: 16 - Model: GoogLeNet AVX-512 On AVX-512 Off 13 26 39 52 65 SE +/- 1.01, N = 15 SE +/- 0.25, N = 3 60.17 31.12
OSPRay Studio Camera: 3 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path Tracer OpenBenchmarking.org ms, Fewer Is Better OSPRay Studio 0.11 Camera: 3 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path Tracer AVX-512 On AVX-512 Off 200 400 600 800 1000 SE +/- 1.53, N = 3 SE +/- 1.15, N = 3 694 841 -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi -mno-avx512f 1. (CXX) g++ options: -O3 -march=native -ldl
OSPRay Studio Camera: 1 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path Tracer OpenBenchmarking.org ms, Fewer Is Better OSPRay Studio 0.11 Camera: 1 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path Tracer AVX-512 On AVX-512 Off 150 300 450 600 750 SE +/- 1.00, N = 3 SE +/- 2.08, N = 3 581 710 -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi -mno-avx512f 1. (CXX) g++ options: -O3 -march=native -ldl
JPEG XL libjxl Input: JPEG - Quality: 90 OpenBenchmarking.org MP/s, More Is Better JPEG XL libjxl 0.7 Input: JPEG - Quality: 90 AVX-512 On AVX-512 Off 3 6 9 12 15 SE +/- 0.04, N = 3 SE +/- 0.03, N = 3 9.55 9.13 -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi -mno-avx512f 1. (CXX) g++ options: -O3 -march=native -fno-rtti -funwind-tables -O2 -fPIE -pie -lm -latomic
OSPRay Studio Camera: 2 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path Tracer OpenBenchmarking.org ms, Fewer Is Better OSPRay Studio 0.11 Camera: 2 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path Tracer AVX-512 On AVX-512 Off 160 320 480 640 800 SE +/- 1.00, N = 3 SE +/- 0.67, N = 3 604 722 -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi -mno-avx512f 1. (CXX) g++ options: -O3 -march=native -ldl
JPEG XL libjxl Input: PNG - Quality: 90 OpenBenchmarking.org MP/s, More Is Better JPEG XL libjxl 0.7 Input: PNG - Quality: 90 AVX-512 On AVX-512 Off 3 6 9 12 15 SE +/- 0.02, N = 3 SE +/- 0.02, N = 3 9.95 9.52 -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi -mno-avx512f 1. (CXX) g++ options: -O3 -march=native -fno-rtti -funwind-tables -O2 -fPIE -pie -lm -latomic
oneDNN Harness: Recurrent Neural Network Inference - Data Type: bf16bf16bf16 - Engine: CPU OpenBenchmarking.org ms, Fewer Is Better oneDNN 2.7 Harness: Recurrent Neural Network Inference - Data Type: bf16bf16bf16 - Engine: CPU AVX-512 On AVX-512 Off 500 1000 1500 2000 2500 SE +/- 24.41, N = 4 SE +/- 22.32, N = 3 2361.27 1715.76 -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi - MIN: 2265.7 -mno-avx512f - MIN: 1607.13 1. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread
simdjson Throughput Test: TopTweet OpenBenchmarking.org GB/s, More Is Better simdjson 2.0 Throughput Test: TopTweet AVX-512 On AVX-512 Off 2 4 6 8 10 SE +/- 0.08, N = 4 SE +/- 0.01, N = 3 6.52 5.38 -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi -mno-avx512f 1. (CXX) g++ options: -O3 -march=native
OpenFOAM Input: drivaerFastback, Medium Mesh Size - Execution Time OpenBenchmarking.org Seconds, Fewer Is Better OpenFOAM 10 Input: drivaerFastback, Medium Mesh Size - Execution Time AVX-512 On AVX-512 Off 30 60 90 120 150 113.64 135.22 1. (CXX) g++ options: -std=c++14 -m64 -O3 -ftemplate-depth-100 -fPIC -fuse-ld=bfd -Xlinker --add-needed --no-as-needed -lfiniteVolume -lmeshTools -lparallel -llagrangian -lregionModels -lgenericPatchFields -lOpenFOAM -ldl -lm
OpenFOAM Input: drivaerFastback, Medium Mesh Size - Mesh Time OpenBenchmarking.org Seconds, Fewer Is Better OpenFOAM 10 Input: drivaerFastback, Medium Mesh Size - Mesh Time AVX-512 On AVX-512 Off 30 60 90 120 150 135.77 144.35 1. (CXX) g++ options: -std=c++14 -m64 -O3 -ftemplate-depth-100 -fPIC -fuse-ld=bfd -Xlinker --add-needed --no-as-needed -lfiniteVolume -lmeshTools -lparallel -llagrangian -lregionModels -lgenericPatchFields -lOpenFOAM -ldl -lm
OpenVINO Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2022.2.dev Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU AVX-512 On AVX-512 Off 0.2723 0.5446 0.8169 1.0892 1.3615 SE +/- 0.00, N = 3 SE +/- 0.01, N = 4 0.55 1.21 -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi - MIN: 0.5 / MAX: 29.57 -mno-avx512f - MIN: 0.98 / MAX: 47.37 1. (CXX) g++ options: -fPIC -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -flto -shared
OpenVINO Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2022.2.dev Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU AVX-512 On AVX-512 Off 30K 60K 90K 120K 150K SE +/- 1328.20, N = 3 SE +/- 1130.85, N = 4 148967.98 108449.49 -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi -mno-avx512f 1. (CXX) g++ options: -fPIC -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -flto -shared
simdjson Throughput Test: DistinctUserID OpenBenchmarking.org GB/s, More Is Better simdjson 2.0 Throughput Test: DistinctUserID AVX-512 On AVX-512 Off 2 4 6 8 10 SE +/- 0.02, N = 3 SE +/- 0.01, N = 3 6.86 5.25 -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi -mno-avx512f 1. (CXX) g++ options: -O3 -march=native
simdjson Throughput Test: PartialTweets OpenBenchmarking.org GB/s, More Is Better simdjson 2.0 Throughput Test: PartialTweets AVX-512 On AVX-512 Off 2 4 6 8 10 SE +/- 0.04, N = 3 SE +/- 0.01, N = 3 6.70 5.14 -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi -mno-avx512f 1. (CXX) g++ options: -O3 -march=native
OpenVINO Model: Person Detection FP16 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2022.2.dev Model: Person Detection FP16 - Device: CPU AVX-512 On AVX-512 Off 400 800 1200 1600 2000 SE +/- 4.83, N = 3 SE +/- 15.65, N = 3 1100.25 1864.93 -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi - MIN: 783.9 / MAX: 1824.92 -mno-avx512f - MIN: 1371.29 / MAX: 2532.74 1. (CXX) g++ options: -fPIC -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -flto -shared
OpenVINO Model: Person Detection FP16 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2022.2.dev Model: Person Detection FP16 - Device: CPU AVX-512 On AVX-512 Off 10 20 30 40 50 SE +/- 0.20, N = 3 SE +/- 0.22, N = 3 43.34 25.50 -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi -mno-avx512f 1. (CXX) g++ options: -fPIC -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -flto -shared
OpenVINO Model: Person Detection FP32 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2022.2.dev Model: Person Detection FP32 - Device: CPU AVX-512 On AVX-512 Off 400 800 1200 1600 2000 SE +/- 4.44, N = 3 SE +/- 3.32, N = 3 1101.00 1845.95 -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi - MIN: 840.82 / MAX: 1792.51 -mno-avx512f - MIN: 1386.31 / MAX: 2798 1. (CXX) g++ options: -fPIC -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -flto -shared
OpenVINO Model: Person Detection FP32 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2022.2.dev Model: Person Detection FP32 - Device: CPU AVX-512 On AVX-512 Off 10 20 30 40 50 SE +/- 0.18, N = 3 SE +/- 0.04, N = 3 43.34 25.74 -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi -mno-avx512f 1. (CXX) g++ options: -fPIC -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -flto -shared
OpenVINO Model: Face Detection FP16 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2022.2.dev Model: Face Detection FP16 - Device: CPU AVX-512 On AVX-512 Off 200 400 600 800 1000 SE +/- 0.24, N = 3 SE +/- 0.51, N = 3 469.29 1088.50 -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi - MIN: 410.93 / MAX: 547.33 -mno-avx512f - MIN: 937.5 / MAX: 1231.55 1. (CXX) g++ options: -fPIC -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -flto -shared
OpenVINO Model: Face Detection FP16 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2022.2.dev Model: Face Detection FP16 - Device: CPU AVX-512 On AVX-512 Off 20 40 60 80 100 SE +/- 0.07, N = 3 SE +/- 0.01, N = 3 102.04 43.94 -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi -mno-avx512f 1. (CXX) g++ options: -fPIC -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -flto -shared
OpenVINO Model: Face Detection FP16-INT8 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2022.2.dev Model: Face Detection FP16-INT8 - Device: CPU AVX-512 On AVX-512 Off 110 220 330 440 550 SE +/- 0.01, N = 3 SE +/- 0.07, N = 3 246.98 503.50 -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi - MIN: 204.5 / MAX: 299.54 -mno-avx512f - MIN: 402.47 / MAX: 569.65 1. (CXX) g++ options: -fPIC -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -flto -shared
OpenVINO Model: Face Detection FP16-INT8 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2022.2.dev Model: Face Detection FP16-INT8 - Device: CPU AVX-512 On AVX-512 Off 40 80 120 160 200 SE +/- 0.05, N = 3 SE +/- 0.02, N = 3 193.93 94.97 -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi -mno-avx512f 1. (CXX) g++ options: -fPIC -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -flto -shared
OpenVINO Model: Person Vehicle Bike Detection FP16 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2022.2.dev Model: Person Vehicle Bike Detection FP16 - Device: CPU AVX-512 On AVX-512 Off 3 6 9 12 15 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 5.29 9.33 -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi - MIN: 4.36 / MAX: 45.25 -mno-avx512f - MIN: 7.39 / MAX: 57.57 1. (CXX) g++ options: -fPIC -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -flto -shared
OpenVINO Model: Person Vehicle Bike Detection FP16 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2022.2.dev Model: Person Vehicle Bike Detection FP16 - Device: CPU AVX-512 On AVX-512 Off 2K 4K 6K 8K 10K SE +/- 4.01, N = 3 SE +/- 2.17, N = 3 9065.34 5135.56 -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi -mno-avx512f 1. (CXX) g++ options: -fPIC -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -flto -shared
Neural Magic DeepSparse Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.1 Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-Stream AVX-512 On AVX-512 Off 40 80 120 160 200 SE +/- 0.11, N = 3 SE +/- 0.23, N = 3 125.79 195.17
Neural Magic DeepSparse Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.1 Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-Stream AVX-512 On AVX-512 Off 160 320 480 640 800 SE +/- 0.79, N = 3 SE +/- 0.61, N = 3 761.22 490.37
OpenVINO Model: Machine Translation EN To DE FP16 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2022.2.dev Model: Machine Translation EN To DE FP16 - Device: CPU AVX-512 On AVX-512 Off 20 40 60 80 100 SE +/- 0.21, N = 3 SE +/- 0.74, N = 3 50.11 107.62 -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi - MIN: 38.98 / MAX: 166.69 -mno-avx512f - MIN: 83.48 / MAX: 216.07 1. (CXX) g++ options: -fPIC -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -flto -shared
OpenVINO Model: Machine Translation EN To DE FP16 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2022.2.dev Model: Machine Translation EN To DE FP16 - Device: CPU AVX-512 On AVX-512 Off 200 400 600 800 1000 SE +/- 4.00, N = 3 SE +/- 3.04, N = 3 956.88 445.59 -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi -mno-avx512f 1. (CXX) g++ options: -fPIC -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -flto -shared
OpenVINO Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2022.2.dev Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU AVX-512 On AVX-512 Off 0.1283 0.2566 0.3849 0.5132 0.6415 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 0.36 0.57 -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi - MIN: 0.34 / MAX: 33.7 -mno-avx512f - MIN: 0.52 / MAX: 47.93 1. (CXX) g++ options: -fPIC -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -flto -shared
OpenVINO Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2022.2.dev Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU AVX-512 On AVX-512 Off 40K 80K 120K 160K 200K SE +/- 127.59, N = 3 SE +/- 1455.37, N = 3 170652.71 151239.60 -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi -mno-avx512f 1. (CXX) g++ options: -fPIC -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -flto -shared
OpenVINO Model: Weld Porosity Detection FP16-INT8 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2022.2.dev Model: Weld Porosity Detection FP16-INT8 - Device: CPU AVX-512 On AVX-512 Off 5 10 15 20 25 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 9.63 19.69 -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi - MIN: 8.29 / MAX: 57.53 -mno-avx512f - MIN: 16.4 / MAX: 74.85 1. (CXX) g++ options: -fPIC -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -flto -shared
OpenVINO Model: Weld Porosity Detection FP16-INT8 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2022.2.dev Model: Weld Porosity Detection FP16-INT8 - Device: CPU AVX-512 On AVX-512 Off 4K 8K 12K 16K 20K SE +/- 12.72, N = 3 SE +/- 1.81, N = 3 19800.20 9672.94 -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi -mno-avx512f 1. (CXX) g++ options: -fPIC -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -flto -shared
OpenVINO Model: Vehicle Detection FP16 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2022.2.dev Model: Vehicle Detection FP16 - Device: CPU AVX-512 On AVX-512 Off 3 6 9 12 15 SE +/- 0.00, N = 3 SE +/- 0.03, N = 3 6.43 12.67 -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi - MIN: 5.22 / MAX: 61.26 -mno-avx512f - MIN: 9.58 / MAX: 77.91 1. (CXX) g++ options: -fPIC -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -flto -shared
OpenVINO Model: Vehicle Detection FP16 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2022.2.dev Model: Vehicle Detection FP16 - Device: CPU AVX-512 On AVX-512 Off 1600 3200 4800 6400 8000 SE +/- 3.52, N = 3 SE +/- 10.17, N = 3 7452.96 3782.08 -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi -mno-avx512f 1. (CXX) g++ options: -fPIC -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -flto -shared
OpenVINO Model: Vehicle Detection FP16-INT8 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2022.2.dev Model: Vehicle Detection FP16-INT8 - Device: CPU AVX-512 On AVX-512 Off 2 4 6 8 10 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 4.28 7.90 -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi - MIN: 3.5 / MAX: 42.62 -mno-avx512f - MIN: 6.37 / MAX: 41.53 1. (CXX) g++ options: -fPIC -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -flto -shared
OpenVINO Model: Vehicle Detection FP16-INT8 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2022.2.dev Model: Vehicle Detection FP16-INT8 - Device: CPU AVX-512 On AVX-512 Off 2K 4K 6K 8K 10K SE +/- 2.53, N = 3 SE +/- 1.39, N = 3 11202.62 6065.76 -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi -mno-avx512f 1. (CXX) g++ options: -fPIC -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -flto -shared
OpenVINO Model: Weld Porosity Detection FP16 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2022.2.dev Model: Weld Porosity Detection FP16 - Device: CPU AVX-512 On AVX-512 Off 3 6 9 12 15 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 4.79 11.66 -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi - MIN: 3.98 / MAX: 28.79 -mno-avx512f - MIN: 9.72 / MAX: 43.7 1. (CXX) g++ options: -fPIC -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -flto -shared
OpenVINO Model: Weld Porosity Detection FP16 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2022.2.dev Model: Weld Porosity Detection FP16 - Device: CPU AVX-512 On AVX-512 Off 2K 4K 6K 8K 10K SE +/- 6.96, N = 3 SE +/- 4.29, N = 3 9988.44 4110.49 -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi -mno-avx512f 1. (CXX) g++ options: -fPIC -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -flto -shared
Neural Magic DeepSparse Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Synchronous Single-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.1 Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Synchronous Single-Stream AVX-512 On AVX-512 Off 3 6 9 12 15 SE +/- 0.06, N = 3 SE +/- 0.05, N = 3 11.76 13.59
Neural Magic DeepSparse Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Synchronous Single-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.1 Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Synchronous Single-Stream AVX-512 On AVX-512 Off 20 40 60 80 100 SE +/- 0.45, N = 3 SE +/- 0.27, N = 3 85.00 73.54
simdjson Throughput Test: Kostya OpenBenchmarking.org GB/s, More Is Better simdjson 2.0 Throughput Test: Kostya AVX-512 On AVX-512 Off 0.9405 1.881 2.8215 3.762 4.7025 SE +/- 0.02, N = 3 SE +/- 0.00, N = 3 4.18 3.39 -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi -mno-avx512f 1. (CXX) g++ options: -O3 -march=native
Neural Magic DeepSparse Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.1 Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-Stream AVX-512 On AVX-512 Off 40 80 120 160 200 SE +/- 0.47, N = 3 SE +/- 0.10, N = 3 155.35 187.85
Neural Magic DeepSparse Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.1 Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-Stream AVX-512 On AVX-512 Off 130 260 390 520 650 SE +/- 1.92, N = 3 SE +/- 0.33, N = 3 616.68 509.45
Neural Magic DeepSparse Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Synchronous Single-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.1 Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Synchronous Single-Stream AVX-512 On AVX-512 Off 8 16 24 32 40 SE +/- 0.03, N = 3 SE +/- 0.04, N = 3 28.96 32.66
Neural Magic DeepSparse Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Synchronous Single-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.1 Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Synchronous Single-Stream AVX-512 On AVX-512 Off 8 16 24 32 40 SE +/- 0.03, N = 3 SE +/- 0.03, N = 3 34.52 30.61
Neural Magic DeepSparse Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Synchronous Single-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.1 Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Synchronous Single-Stream AVX-512 On AVX-512 Off 8 16 24 32 40 SE +/- 0.07, N = 3 SE +/- 0.11, N = 3 29.19 32.75
Neural Magic DeepSparse Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Synchronous Single-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.1 Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Synchronous Single-Stream AVX-512 On AVX-512 Off 8 16 24 32 40 SE +/- 0.08, N = 3 SE +/- 0.10, N = 3 34.25 30.53
simdjson Throughput Test: LargeRandom OpenBenchmarking.org GB/s, More Is Better simdjson 2.0 Throughput Test: LargeRandom AVX-512 On AVX-512 Off 0.2835 0.567 0.8505 1.134 1.4175 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 1.26 1.04 -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi -mno-avx512f 1. (CXX) g++ options: -O3 -march=native
Neural Magic DeepSparse Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Synchronous Single-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.1 Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Synchronous Single-Stream AVX-512 On AVX-512 Off 4 8 12 16 20 SE +/- 0.0172, N = 3 SE +/- 0.0334, N = 3 9.9408 14.0655
Neural Magic DeepSparse Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Synchronous Single-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.1 Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Synchronous Single-Stream AVX-512 On AVX-512 Off 20 40 60 80 100 SE +/- 0.17, N = 3 SE +/- 0.17, N = 3 100.55 71.04
Neural Magic DeepSparse Model: NLP Text Classification, DistilBERT mnli - Scenario: Synchronous Single-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.1 Model: NLP Text Classification, DistilBERT mnli - Scenario: Synchronous Single-Stream AVX-512 On AVX-512 Off 1.2663 2.5326 3.7989 5.0652 6.3315 SE +/- 0.0031, N = 3 SE +/- 0.0091, N = 3 5.3413 5.6282
Neural Magic DeepSparse Model: NLP Text Classification, DistilBERT mnli - Scenario: Synchronous Single-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.1 Model: NLP Text Classification, DistilBERT mnli - Scenario: Synchronous Single-Stream AVX-512 On AVX-512 Off 40 80 120 160 200 SE +/- 0.11, N = 3 SE +/- 0.29, N = 3 187.08 177.54
TensorFlow Device: CPU - Batch Size: 16 - Model: AlexNet OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.10 Device: CPU - Batch Size: 16 - Model: AlexNet AVX-512 On AVX-512 Off 30 60 90 120 150 SE +/- 2.35, N = 12 SE +/- 0.19, N = 3 157.29 55.11
Neural Magic DeepSparse Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.1 Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream AVX-512 On AVX-512 Off 20 40 60 80 100 SE +/- 0.14, N = 3 SE +/- 0.05, N = 3 80.08 95.33
Neural Magic DeepSparse Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.1 Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream AVX-512 On AVX-512 Off 300 600 900 1200 1500 SE +/- 2.39, N = 3 SE +/- 0.78, N = 3 1195.94 1005.16
Neural Magic DeepSparse Model: CV Detection,YOLOv5s COCO - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.1 Model: CV Detection,YOLOv5s COCO - Scenario: Asynchronous Multi-Stream AVX-512 On AVX-512 Off 30 60 90 120 150 SE +/- 0.12, N = 3 SE +/- 0.25, N = 3 111.73 138.59
Neural Magic DeepSparse Model: CV Detection,YOLOv5s COCO - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.1 Model: CV Detection,YOLOv5s COCO - Scenario: Asynchronous Multi-Stream AVX-512 On AVX-512 Off 200 400 600 800 1000 SE +/- 0.77, N = 3 SE +/- 1.12, N = 3 857.23 690.87
Neural Magic DeepSparse Model: CV Detection,YOLOv5s COCO - Scenario: Synchronous Single-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.1 Model: CV Detection,YOLOv5s COCO - Scenario: Synchronous Single-Stream AVX-512 On AVX-512 Off 2 4 6 8 10 SE +/- 0.0061, N = 3 SE +/- 0.0068, N = 3 5.2712 6.3313
Neural Magic DeepSparse Model: CV Detection,YOLOv5s COCO - Scenario: Synchronous Single-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.1 Model: CV Detection,YOLOv5s COCO - Scenario: Synchronous Single-Stream AVX-512 On AVX-512 Off 40 80 120 160 200 SE +/- 0.22, N = 3 SE +/- 0.17, N = 3 189.56 157.82
Neural Magic DeepSparse Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.1 Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream AVX-512 On AVX-512 Off 15 30 45 60 75 SE +/- 0.11, N = 3 SE +/- 0.02, N = 3 49.03 67.91
Neural Magic DeepSparse Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.1 Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream AVX-512 On AVX-512 Off 400 800 1200 1600 2000 SE +/- 4.32, N = 3 SE +/- 0.17, N = 3 1953.03 1410.81
Cpuminer-Opt Algorithm: scrypt OpenBenchmarking.org kH/s, More Is Better Cpuminer-Opt 3.20.3 Algorithm: scrypt AVX-512 On AVX-512 Off 1000 2000 3000 4000 5000 SE +/- 0.45, N = 3 SE +/- 0.31, N = 3 4800.61 2946.08 -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi -mno-avx512f 1. (CXX) g++ options: -O3 -march=native -lcurl -lz -lpthread -lssl -lcrypto -lgmp
Cpuminer-Opt Algorithm: LBC, LBRY Credits OpenBenchmarking.org kH/s, More Is Better Cpuminer-Opt 3.20.3 Algorithm: LBC, LBRY Credits AVX-512 On AVX-512 Off 200K 400K 600K 800K 1000K SE +/- 7645.47, N = 3 SE +/- 667.26, N = 3 1066950 491740 -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi -mno-avx512f 1. (CXX) g++ options: -O3 -march=native -lcurl -lz -lpthread -lssl -lcrypto -lgmp
Cpuminer-Opt Algorithm: x25x OpenBenchmarking.org kH/s, More Is Better Cpuminer-Opt 3.20.3 Algorithm: x25x AVX-512 On AVX-512 Off 1600 3200 4800 6400 8000 SE +/- 16.58, N = 3 SE +/- 14.41, N = 3 7696.06 5784.25 -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi -mno-avx512f 1. (CXX) g++ options: -O3 -march=native -lcurl -lz -lpthread -lssl -lcrypto -lgmp
SVT-AV1 Encoder Mode: Preset 12 - Input: Bosphorus 4K OpenBenchmarking.org Frames Per Second, More Is Better SVT-AV1 1.4 Encoder Mode: Preset 12 - Input: Bosphorus 4K AVX-512 On AVX-512 Off 50 100 150 200 250 SE +/- 4.78, N = 15 SE +/- 3.57, N = 15 245.56 233.94
Cpuminer-Opt Algorithm: Garlicoin OpenBenchmarking.org kH/s, More Is Better Cpuminer-Opt 3.20.3 Algorithm: Garlicoin AVX-512 On AVX-512 Off 15K 30K 45K 60K 75K SE +/- 89.69, N = 3 SE +/- 13.33, N = 3 71553 48827 -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi -mno-avx512f 1. (CXX) g++ options: -O3 -march=native -lcurl -lz -lpthread -lssl -lcrypto -lgmp
Cpuminer-Opt Algorithm: Quad SHA-256, Pyrite OpenBenchmarking.org kH/s, More Is Better Cpuminer-Opt 3.20.3 Algorithm: Quad SHA-256, Pyrite AVX-512 On AVX-512 Off 500K 1000K 1500K 2000K 2500K SE +/- 9040.25, N = 3 SE +/- 276.83, N = 3 2260680 1322960 -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi -mno-avx512f 1. (CXX) g++ options: -O3 -march=native -lcurl -lz -lpthread -lssl -lcrypto -lgmp
Cpuminer-Opt Algorithm: Skeincoin OpenBenchmarking.org kH/s, More Is Better Cpuminer-Opt 3.20.3 Algorithm: Skeincoin AVX-512 On AVX-512 Off 400K 800K 1200K 1600K 2000K SE +/- 13005.55, N = 3 SE +/- 3964.01, N = 3 1951330 1427543 -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi -mno-avx512f 1. (CXX) g++ options: -O3 -march=native -lcurl -lz -lpthread -lssl -lcrypto -lgmp
Numenta Anomaly Benchmark Detector: Bayesian Changepoint OpenBenchmarking.org Seconds, Fewer Is Better Numenta Anomaly Benchmark 1.1 Detector: Bayesian Changepoint AVX-512 On AVX-512 Off 4 8 12 16 20 SE +/- 0.21, N = 4 SE +/- 0.19, N = 5 16.68 17.39
GROMACS Implementation: MPI CPU - Input: water_GMX50_bare OpenBenchmarking.org Ns Per Day, More Is Better GROMACS 2022.1 Implementation: MPI CPU - Input: water_GMX50_bare AVX-512 On AVX-512 Off 5 10 15 20 25 SE +/- 0.24, N = 3 SE +/- 0.10, N = 3 18.76 18.47 -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi -mno-avx512f 1. (CXX) g++ options: -O3 -march=native
oneDNN Harness: Convolution Batch Shapes Auto - Data Type: f32 - Engine: CPU OpenBenchmarking.org ms, Fewer Is Better oneDNN 2.7 Harness: Convolution Batch Shapes Auto - Data Type: f32 - Engine: CPU AVX-512 On AVX-512 Off 0.121 0.242 0.363 0.484 0.605 SE +/- 0.004067, N = 7 SE +/- 0.004200, N = 15 0.516167 0.537682 -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi - MIN: 0.42 -mno-avx512f - MIN: 0.42 1. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread
oneDNN Harness: Deconvolution Batch shapes_1d - Data Type: f32 - Engine: CPU OpenBenchmarking.org ms, Fewer Is Better oneDNN 2.7 Harness: Deconvolution Batch shapes_1d - Data Type: f32 - Engine: CPU AVX-512 On AVX-512 Off 5 10 15 20 25 SE +/- 0.16, N = 3 SE +/- 0.06, N = 3 22.59 22.84 -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi - MIN: 19.6 -mno-avx512f - MIN: 20.22 1. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread
Darmstadt Automotive Parallel Heterogeneous Suite Backend: OpenMP - Kernel: NDT Mapping OpenBenchmarking.org Test Cases Per Minute, More Is Better Darmstadt Automotive Parallel Heterogeneous Suite Backend: OpenMP - Kernel: NDT Mapping AVX-512 On AVX-512 Off 300 600 900 1200 1500 SE +/- 5.94, N = 3 SE +/- 8.66, N = 3 1371.18 1335.63 1. (CXX) g++ options: -O3 -std=c++11 -fopenmp
SVT-AV1 Encoder Mode: Preset 13 - Input: Bosphorus 4K OpenBenchmarking.org Frames Per Second, More Is Better SVT-AV1 1.4 Encoder Mode: Preset 13 - Input: Bosphorus 4K AVX-512 On AVX-512 Off 50 100 150 200 250 SE +/- 4.74, N = 15 SE +/- 4.01, N = 15 246.57 239.88
miniBUDE Implementation: OpenMP - Input Deck: BM2 OpenBenchmarking.org Billion Interactions/s, More Is Better miniBUDE 20210901 Implementation: OpenMP - Input Deck: BM2 AVX-512 On AVX-512 Off 80 160 240 320 400 SE +/- 0.46, N = 4 SE +/- 1.27, N = 3 346.08 255.66 1. (CC) gcc options: -std=c99 -Ofast -ffast-math -fopenmp -march=native -lm
miniBUDE Implementation: OpenMP - Input Deck: BM2 OpenBenchmarking.org GFInst/s, More Is Better miniBUDE 20210901 Implementation: OpenMP - Input Deck: BM2 AVX-512 On AVX-512 Off 2K 4K 6K 8K 10K SE +/- 11.62, N = 4 SE +/- 31.65, N = 3 8652.01 6391.52 1. (CC) gcc options: -std=c99 -Ofast -ffast-math -fopenmp -march=native -lm
Embree Binary: Pathtracer ISPC - Model: Asian Dragon Obj OpenBenchmarking.org Frames Per Second, More Is Better Embree 3.13 Binary: Pathtracer ISPC - Model: Asian Dragon Obj AVX-512 On AVX-512 Off 40 80 120 160 200 SE +/- 0.62, N = 4 SE +/- 0.36, N = 4 184.47 153.45 MIN: 178.83 / MAX: 196.34 MIN: 130.31 / MAX: 166.17
Intel Open Image Denoise Run: RTLightmap.hdr.4096x4096 OpenBenchmarking.org Images / Sec, More Is Better Intel Open Image Denoise 1.4.0 Run: RTLightmap.hdr.4096x4096 AVX-512 On AVX-512 Off 0.387 0.774 1.161 1.548 1.935 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 1.66 1.72
Numenta Anomaly Benchmark Detector: Windowed Gaussian OpenBenchmarking.org Seconds, Fewer Is Better Numenta Anomaly Benchmark 1.1 Detector: Windowed Gaussian AVX-512 On AVX-512 Off 1.0985 2.197 3.2955 4.394 5.4925 SE +/- 0.032, N = 15 SE +/- 0.044, N = 7 4.727 4.882
Numenta Anomaly Benchmark Detector: Relative Entropy OpenBenchmarking.org Seconds, Fewer Is Better Numenta Anomaly Benchmark 1.1 Detector: Relative Entropy AVX-512 On AVX-512 Off 3 6 9 12 15 SE +/- 0.089, N = 5 SE +/- 0.082, N = 5 9.898 10.035
Intel Open Image Denoise Run: RT.hdr_alb_nrm.3840x2160 OpenBenchmarking.org Images / Sec, More Is Better Intel Open Image Denoise 1.4.0 Run: RT.hdr_alb_nrm.3840x2160 AVX-512 On AVX-512 Off 0.7898 1.5796 2.3694 3.1592 3.949 SE +/- 0.01, N = 5 SE +/- 0.03, N = 5 3.51 3.50
Intel Open Image Denoise Run: RT.ldr_alb_nrm.3840x2160 OpenBenchmarking.org Images / Sec, More Is Better Intel Open Image Denoise 1.4.0 Run: RT.ldr_alb_nrm.3840x2160 AVX-512 On AVX-512 Off 0.7898 1.5796 2.3694 3.1592 3.949 SE +/- 0.01, N = 5 SE +/- 0.01, N = 5 3.51 3.51
SMHasher Hash: FarmHash32 x86_64 AVX OpenBenchmarking.org cycles/hash, Fewer Is Better SMHasher 2022-08-22 Hash: FarmHash32 x86_64 AVX AVX-512 On AVX-512 Off 6 12 18 24 30 SE +/- 0.00, N = 5 SE +/- 0.00, N = 5 26.39 26.41 -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi -mno-avx512f 1. (CXX) g++ options: -O3 -march=native -flto=auto -fno-fat-lto-objects
SMHasher Hash: FarmHash32 x86_64 AVX OpenBenchmarking.org MiB/sec, More Is Better SMHasher 2022-08-22 Hash: FarmHash32 x86_64 AVX AVX-512 On AVX-512 Off 9K 18K 27K 36K 45K SE +/- 0.46, N = 5 SE +/- 28.78, N = 5 39794.44 36483.70 -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi -mno-avx512f 1. (CXX) g++ options: -O3 -march=native -flto=auto -fno-fat-lto-objects
Embree Binary: Pathtracer ISPC - Model: Crown OpenBenchmarking.org Frames Per Second, More Is Better Embree 3.13 Binary: Pathtracer ISPC - Model: Crown AVX-512 On AVX-512 Off 40 80 120 160 200 SE +/- 0.62, N = 8 SE +/- 0.25, N = 7 180.93 151.06 MIN: 124.41 / MAX: 209.74 MIN: 114.4 / MAX: 176.43
Embree Binary: Pathtracer ISPC - Model: Asian Dragon OpenBenchmarking.org Frames Per Second, More Is Better Embree 3.13 Binary: Pathtracer ISPC - Model: Asian Dragon AVX-512 On AVX-512 Off 50 100 150 200 250 SE +/- 0.22, N = 9 SE +/- 0.21, N = 8 212.94 176.88 MIN: 207.72 / MAX: 227.11 MIN: 170.19 / MAX: 190
miniBUDE Implementation: OpenMP - Input Deck: BM1 OpenBenchmarking.org Billion Interactions/s, More Is Better miniBUDE 20210901 Implementation: OpenMP - Input Deck: BM1 AVX-512 On AVX-512 Off 60 120 180 240 300 SE +/- 0.23, N = 10 SE +/- 1.06, N = 8 291.98 202.60 1. (CC) gcc options: -std=c99 -Ofast -ffast-math -fopenmp -march=native -lm
miniBUDE Implementation: OpenMP - Input Deck: BM1 OpenBenchmarking.org GFInst/s, More Is Better miniBUDE 20210901 Implementation: OpenMP - Input Deck: BM1 AVX-512 On AVX-512 Off 1600 3200 4800 6400 8000 SE +/- 5.79, N = 10 SE +/- 26.42, N = 8 7299.55 5065.10 1. (CC) gcc options: -std=c99 -Ofast -ffast-math -fopenmp -march=native -lm
oneDNN Harness: Deconvolution Batch shapes_3d - Data Type: f32 - Engine: CPU OpenBenchmarking.org ms, Fewer Is Better oneDNN 2.7 Harness: Deconvolution Batch shapes_3d - Data Type: f32 - Engine: CPU AVX-512 On AVX-512 Off 0.3968 0.7936 1.1904 1.5872 1.984 SE +/- 0.001906, N = 9 SE +/- 0.004550, N = 9 0.989591 1.763360 -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi - MIN: 0.9 -mno-avx512f - MIN: 1.55 1. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread
CPU Temperature Monitor Phoronix Test Suite System Monitoring OpenBenchmarking.org Celsius CPU Temperature Monitor Phoronix Test Suite System Monitoring AVX-512 On AVX-512 Off 14 28 42 56 70 Min: 30.13 / Avg: 49.97 / Max: 73.38 Min: 35.5 / Avg: 51.26 / Max: 73.75
CPU Power Consumption Monitor Phoronix Test Suite System Monitoring OpenBenchmarking.org Watts CPU Power Consumption Monitor Phoronix Test Suite System Monitoring AVX-512 On AVX-512 Off 130 260 390 520 650 Min: 26.37 / Avg: 434.8 / Max: 766.01 Min: 106.95 / Avg: 449.58 / Max: 735.32
JPEG XL libjxl CPU Temperature Monitor Min Avg Max AVX-512 On 32.4 37.0 49.3 AVX-512 Off 35.9 36.7 44.9 OpenBenchmarking.org Celsius, Fewer Is Better JPEG XL libjxl 0.7 CPU Temperature Monitor 14 28 42 56 70
JPEG XL libjxl CPU Power Consumption Monitor Min Avg Max AVX-512 On 56.1 222.2 318.2 AVX-512 Off 134.0 232.4 317.2 OpenBenchmarking.org Watts, Fewer Is Better JPEG XL libjxl 0.7 CPU Power Consumption Monitor 80 160 240 320 400
JPEG XL libjxl CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max AVX-512 On 2400 3643 3712 AVX-512 Off 2439 3696 3828 OpenBenchmarking.org Megahertz, More Is Better JPEG XL libjxl 0.7 CPU Peak Freq (Highest CPU Core Frequency) Monitor 1000 2000 3000 4000 5000
JPEG XL libjxl Input: PNG - Quality: 90 OpenBenchmarking.org MP/s Per Watt, More Is Better JPEG XL libjxl 0.7 Input: PNG - Quality: 90 AVX-512 On AVX-512 Off 0.0101 0.0202 0.0303 0.0404 0.0505 0.045 0.041
JPEG XL libjxl CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better JPEG XL libjxl 0.7 CPU Temperature Monitor AVX-512 On AVX-512 Off 10 20 30 40 50 Min: 32.75 / Avg: 36.48 / Max: 49.75 Min: 35.5 / Avg: 36.56 / Max: 46.63
JPEG XL libjxl CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better JPEG XL libjxl 0.7 CPU Power Consumption Monitor AVX-512 On AVX-512 Off 50 100 150 200 250 Min: 28.84 / Avg: 217.33 / Max: 256.47 Min: 110.34 / Avg: 222.62 / Max: 261.2
JPEG XL libjxl CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better JPEG XL libjxl 0.7 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 On AVX-512 Off 800 1600 2400 3200 4000 Min: 2400 / Avg: 3682.16 / Max: 4023 Min: 3414 / Avg: 3701.38 / Max: 4381
JPEG XL libjxl Input: JPEG - Quality: 100 OpenBenchmarking.org MP/s Per Watt, More Is Better JPEG XL libjxl 0.7 Input: JPEG - Quality: 100 AVX-512 On AVX-512 Off 0.0007 0.0014 0.0021 0.0028 0.0035 0.003 0.003
JPEG XL libjxl CPU Temperature Monitor Min Avg Max AVX-512 On 35.0 39.7 46.6 AVX-512 Off 36.8 39.4 48.9 OpenBenchmarking.org Celsius, Fewer Is Better JPEG XL libjxl 0.7 CPU Temperature Monitor 14 28 42 56 70
JPEG XL libjxl CPU Power Consumption Monitor Min Avg Max AVX-512 On 54.8 223.4 308.1 AVX-512 Off 142.6 233.9 323.3 OpenBenchmarking.org Watts, Fewer Is Better JPEG XL libjxl 0.7 CPU Power Consumption Monitor 80 160 240 320 400
JPEG XL libjxl CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max AVX-512 On 2400 3657 3712 AVX-512 Off 3669 3701 3814 OpenBenchmarking.org Megahertz, More Is Better JPEG XL libjxl 0.7 CPU Peak Freq (Highest CPU Core Frequency) Monitor 1000 2000 3000 4000 5000
JPEG XL libjxl Input: JPEG - Quality: 90 OpenBenchmarking.org MP/s Per Watt, More Is Better JPEG XL libjxl 0.7 Input: JPEG - Quality: 90 AVX-512 On AVX-512 Off 0.0097 0.0194 0.0291 0.0388 0.0485 0.043 0.039
CP2K Molecular Dynamics CPU Temperature Monitor Min Avg Max AVX-512 On 42.1 44.5 53.5 AVX-512 Off 42.1 44.4 56.9 OpenBenchmarking.org Celsius, Fewer Is Better CP2K Molecular Dynamics 8.2 CPU Temperature Monitor 16 32 48 64 80
CP2K Molecular Dynamics CPU Power Consumption Monitor Min Avg Max AVX-512 On 58.1 358.0 402.6 AVX-512 Off 118.3 361.5 403.0 OpenBenchmarking.org Watts, Fewer Is Better CP2K Molecular Dynamics 8.2 CPU Power Consumption Monitor 110 220 330 440 550
CP2K Molecular Dynamics CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max AVX-512 On 2400 3661 3700 AVX-512 Off 3569 3665 3808 OpenBenchmarking.org Megahertz, More Is Better CP2K Molecular Dynamics 8.2 CPU Peak Freq (Highest CPU Core Frequency) Monitor 1000 2000 3000 4000 5000
OpenFOAM CPU Temperature Monitor Min Avg Max AVX-512 On 41.3 62.6 68.5 AVX-512 Off 47.0 64.9 70.3 OpenBenchmarking.org Celsius, Fewer Is Better OpenFOAM 10 CPU Temperature Monitor 20 40 60 80 100
OpenFOAM CPU Power Consumption Monitor Min Avg Max AVX-512 On 57 662 731 AVX-512 Off 220 674 735 OpenBenchmarking.org Watts, Fewer Is Better OpenFOAM 10 CPU Power Consumption Monitor 200 400 600 800 1000
OpenFOAM CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max AVX-512 On 2400 3186 3701 AVX-512 Off 2917 3265 3714 OpenBenchmarking.org Megahertz, More Is Better OpenFOAM 10 CPU Peak Freq (Highest CPU Core Frequency) Monitor 1000 2000 3000 4000 5000
simdjson CPU Temperature Monitor Min Avg Max AVX-512 On 32.4 36.1 37.3 AVX-512 Off 36.8 46.2 47.5 OpenBenchmarking.org Celsius, Fewer Is Better simdjson 2.0 CPU Temperature Monitor 14 28 42 56 70
simdjson CPU Power Consumption Monitor Min Avg Max AVX-512 On 55.3 209.4 219.2 AVX-512 Off 111.2 221.5 223.4 OpenBenchmarking.org Watts, Fewer Is Better simdjson 2.0 CPU Power Consumption Monitor 60 120 180 240 300
simdjson CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max AVX-512 On 2400 3640 3701 AVX-512 Off 3694 3701 3912 OpenBenchmarking.org Megahertz, More Is Better simdjson 2.0 CPU Peak Freq (Highest CPU Core Frequency) Monitor 1000 2000 3000 4000 5000
simdjson Throughput Test: TopTweet OpenBenchmarking.org GB/s Per Watt, More Is Better simdjson 2.0 Throughput Test: TopTweet AVX-512 On AVX-512 Off 0.007 0.014 0.021 0.028 0.035 0.031 0.024
simdjson CPU Temperature Monitor Min Avg Max AVX-512 On 32.4 36.2 37.3 AVX-512 Off 37.3 46.9 48.1 OpenBenchmarking.org Celsius, Fewer Is Better simdjson 2.0 CPU Temperature Monitor 14 28 42 56 70
simdjson CPU Power Consumption Monitor Min Avg Max AVX-512 On 35.8 209.0 219.1 AVX-512 Off 111.3 221.2 223.7 OpenBenchmarking.org Watts, Fewer Is Better simdjson 2.0 CPU Power Consumption Monitor 60 120 180 240 300
simdjson CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max AVX-512 On 2400 3643 3754 AVX-512 Off 3694 3703 3925 OpenBenchmarking.org Megahertz, More Is Better simdjson 2.0 CPU Peak Freq (Highest CPU Core Frequency) Monitor 1000 2000 3000 4000 5000
simdjson Throughput Test: DistinctUserID OpenBenchmarking.org GB/s Per Watt, More Is Better simdjson 2.0 Throughput Test: DistinctUserID AVX-512 On AVX-512 Off 0.0074 0.0148 0.0222 0.0296 0.037 0.033 0.024
simdjson CPU Temperature Monitor Min Avg Max AVX-512 On 33.3 36.4 37.3 AVX-512 Off 37.3 46.3 48.6 OpenBenchmarking.org Celsius, Fewer Is Better simdjson 2.0 CPU Temperature Monitor 14 28 42 56 70
simdjson CPU Power Consumption Monitor Min Avg Max AVX-512 On 54.4 209.9 221.6 AVX-512 Off 112.5 223.5 225.7 OpenBenchmarking.org Watts, Fewer Is Better simdjson 2.0 CPU Power Consumption Monitor 60 120 180 240 300
simdjson CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max AVX-512 On 2400 3625 3702 AVX-512 Off 3694 3704 3981 OpenBenchmarking.org Megahertz, More Is Better simdjson 2.0 CPU Peak Freq (Highest CPU Core Frequency) Monitor 1100 2200 3300 4400 5500
simdjson Throughput Test: Kostya OpenBenchmarking.org GB/s Per Watt, More Is Better simdjson 2.0 Throughput Test: Kostya AVX-512 On AVX-512 Off 0.0045 0.009 0.0135 0.018 0.0225 0.020 0.015
simdjson CPU Temperature Monitor Min Avg Max AVX-512 On 33.3 36.7 37.8 AVX-512 Off 37.8 47.0 49.8 OpenBenchmarking.org Celsius, Fewer Is Better simdjson 2.0 CPU Temperature Monitor 14 28 42 56 70
simdjson CPU Power Consumption Monitor Min Avg Max AVX-512 On 53.8 207.0 220.8 AVX-512 Off 111.6 222.5 224.6 OpenBenchmarking.org Watts, Fewer Is Better simdjson 2.0 CPU Power Consumption Monitor 60 120 180 240 300
simdjson CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max AVX-512 On 2400 3601 3700 AVX-512 Off 3694 3701 3788 OpenBenchmarking.org Megahertz, More Is Better simdjson 2.0 CPU Peak Freq (Highest CPU Core Frequency) Monitor 1000 2000 3000 4000 5000
simdjson Throughput Test: LargeRandom OpenBenchmarking.org GB/s Per Watt, More Is Better simdjson 2.0 Throughput Test: LargeRandom AVX-512 On AVX-512 Off 0.0014 0.0028 0.0042 0.0056 0.007 0.006 0.005
simdjson CPU Temperature Monitor Min Avg Max AVX-512 On 36.4 40.5 47.5 AVX-512 Off 39.0 51.0 60.1 OpenBenchmarking.org Celsius, Fewer Is Better simdjson 2.0 CPU Temperature Monitor 16 32 48 64 80
simdjson CPU Power Consumption Monitor Min Avg Max AVX-512 On 50.2 211.4 225.1 AVX-512 Off 113.7 224.4 230.2 OpenBenchmarking.org Watts, Fewer Is Better simdjson 2.0 CPU Power Consumption Monitor 60 120 180 240 300
simdjson CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max AVX-512 On 2400 3639 3702 AVX-512 Off 3694 3702 4016 OpenBenchmarking.org Megahertz, More Is Better simdjson 2.0 CPU Peak Freq (Highest CPU Core Frequency) Monitor 1100 2200 3300 4400 5500
simdjson Throughput Test: PartialTweets OpenBenchmarking.org GB/s Per Watt, More Is Better simdjson 2.0 Throughput Test: PartialTweets AVX-512 On AVX-512 Off 0.0072 0.0144 0.0216 0.0288 0.036 0.032 0.023
Darmstadt Automotive Parallel Heterogeneous Suite CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better Darmstadt Automotive Parallel Heterogeneous Suite CPU Temperature Monitor AVX-512 On AVX-512 Off 10 20 30 40 50 Min: 31.25 / Avg: 38.03 / Max: 47.5 Min: 36.75 / Avg: 39.2 / Max: 49.75
Darmstadt Automotive Parallel Heterogeneous Suite CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better Darmstadt Automotive Parallel Heterogeneous Suite CPU Power Consumption Monitor AVX-512 On AVX-512 Off 50 100 150 200 250 Min: 49.36 / Avg: 258.94 / Max: 283.12 Min: 136.19 / Avg: 273.1 / Max: 289.31
Darmstadt Automotive Parallel Heterogeneous Suite CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better Darmstadt Automotive Parallel Heterogeneous Suite CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 On AVX-512 Off 800 1600 2400 3200 4000 Min: 2400 / Avg: 3647.5 / Max: 3715 Min: 3694 / Avg: 3698.64 / Max: 4768
Darmstadt Automotive Parallel Heterogeneous Suite Backend: OpenMP - Kernel: Points2Image OpenBenchmarking.org Test Cases Per Minute Per Watt, More Is Better Darmstadt Automotive Parallel Heterogeneous Suite Backend: OpenMP - Kernel: Points2Image AVX-512 On AVX-512 Off 12 24 36 48 60 52.82 42.19
Darmstadt Automotive Parallel Heterogeneous Suite CPU Temperature Monitor Min Avg Max AVX-512 On 32.4 35.4 36.4 AVX-512 Off 37.8 39.4 49.5 OpenBenchmarking.org Celsius, Fewer Is Better Darmstadt Automotive Parallel Heterogeneous Suite CPU Temperature Monitor 14 28 42 56 70
Darmstadt Automotive Parallel Heterogeneous Suite CPU Power Consumption Monitor Min Avg Max AVX-512 On 37.8 213.7 282.2 AVX-512 Off 215.0 244.8 282.7 OpenBenchmarking.org Watts, Fewer Is Better Darmstadt Automotive Parallel Heterogeneous Suite CPU Power Consumption Monitor 70 140 210 280 350
Darmstadt Automotive Parallel Heterogeneous Suite CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max AVX-512 On 2400 3516 3702 AVX-512 Off 3694 3719 4426 OpenBenchmarking.org Megahertz, More Is Better Darmstadt Automotive Parallel Heterogeneous Suite CPU Peak Freq (Highest CPU Core Frequency) Monitor 1100 2200 3300 4400 5500
Darmstadt Automotive Parallel Heterogeneous Suite Backend: OpenMP - Kernel: NDT Mapping OpenBenchmarking.org Test Cases Per Minute Per Watt, More Is Better Darmstadt Automotive Parallel Heterogeneous Suite Backend: OpenMP - Kernel: NDT Mapping AVX-512 On AVX-512 Off 2 4 6 8 10 6.416 5.455
Intel Open Image Denoise CPU Temperature Monitor Min Avg Max AVX-512 On 32.8 39.8 46.4 AVX-512 Off 39.9 44.7 49.8 OpenBenchmarking.org Celsius, Fewer Is Better Intel Open Image Denoise 1.4.0 CPU Temperature Monitor 14 28 42 56 70
Intel Open Image Denoise CPU Power Consumption Monitor Min Avg Max AVX-512 On 52.8 325.6 574.0 AVX-512 Off 207.2 399.0 572.6 OpenBenchmarking.org Watts, Fewer Is Better Intel Open Image Denoise 1.4.0 CPU Power Consumption Monitor 140 280 420 560 700
Intel Open Image Denoise CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max AVX-512 On 2400 3216 3699 AVX-512 Off 3017 3636 4215 OpenBenchmarking.org Megahertz, More Is Better Intel Open Image Denoise 1.4.0 CPU Peak Freq (Highest CPU Core Frequency) Monitor 1100 2200 3300 4400 5500
Intel Open Image Denoise Run: RTLightmap.hdr.4096x4096 OpenBenchmarking.org Images / Sec Per Watt, More Is Better Intel Open Image Denoise 1.4.0 Run: RTLightmap.hdr.4096x4096 AVX-512 On AVX-512 Off 0.0011 0.0022 0.0033 0.0044 0.0055 0.005 0.004
Intel Open Image Denoise CPU Temperature Monitor Min Avg Max AVX-512 On 32.8 38.2 44.1 AVX-512 Off 39.5 43.3 48.4 OpenBenchmarking.org Celsius, Fewer Is Better Intel Open Image Denoise 1.4.0 CPU Temperature Monitor 14 28 42 56 70
Intel Open Image Denoise CPU Power Consumption Monitor Min Avg Max AVX-512 On 52.1 288.6 574.3 AVX-512 Off 208.7 365.6 577.3 OpenBenchmarking.org Watts, Fewer Is Better Intel Open Image Denoise 1.4.0 CPU Power Consumption Monitor 140 280 420 560 700
Intel Open Image Denoise CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max AVX-512 On 2400 3212 3702 AVX-512 Off 2854 3610 3919 OpenBenchmarking.org Megahertz, More Is Better Intel Open Image Denoise 1.4.0 CPU Peak Freq (Highest CPU Core Frequency) Monitor 1000 2000 3000 4000 5000
Intel Open Image Denoise Run: RT.ldr_alb_nrm.3840x2160 OpenBenchmarking.org Images / Sec Per Watt, More Is Better Intel Open Image Denoise 1.4.0 Run: RT.ldr_alb_nrm.3840x2160 AVX-512 On AVX-512 Off 0.0027 0.0054 0.0081 0.0108 0.0135 0.012 0.010
Intel Open Image Denoise CPU Temperature Monitor Min Avg Max AVX-512 On 32.4 38.1 44.9 AVX-512 Off 36.8 41.6 47.0 OpenBenchmarking.org Celsius, Fewer Is Better Intel Open Image Denoise 1.4.0 CPU Temperature Monitor 14 28 42 56 70
Intel Open Image Denoise CPU Power Consumption Monitor Min Avg Max AVX-512 On 48.8 287.6 572.9 AVX-512 Off 206.5 366.7 574.9 OpenBenchmarking.org Watts, Fewer Is Better Intel Open Image Denoise 1.4.0 CPU Power Consumption Monitor 140 280 420 560 700
Intel Open Image Denoise CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max AVX-512 On 2400 3124 3699 AVX-512 Off 2718 3626 4090 OpenBenchmarking.org Megahertz, More Is Better Intel Open Image Denoise 1.4.0 CPU Peak Freq (Highest CPU Core Frequency) Monitor 1100 2200 3300 4400 5500
Intel Open Image Denoise Run: RT.hdr_alb_nrm.3840x2160 OpenBenchmarking.org Images / Sec Per Watt, More Is Better Intel Open Image Denoise 1.4.0 Run: RT.hdr_alb_nrm.3840x2160 AVX-512 On AVX-512 Off 0.0027 0.0054 0.0081 0.0108 0.0135 0.012 0.010
Numenta Anomaly Benchmark CPU Temperature Monitor Min Avg Max AVX-512 On 31.5 38.8 47.0 AVX-512 Off 37.8 41.5 50.4 OpenBenchmarking.org Celsius, Fewer Is Better Numenta Anomaly Benchmark 1.1 CPU Temperature Monitor 14 28 42 56 70
Numenta Anomaly Benchmark CPU Power Consumption Monitor Min Avg Max AVX-512 On 53.6 202.8 367.2 AVX-512 Off 213.2 250.8 339.2 OpenBenchmarking.org Watts, Fewer Is Better Numenta Anomaly Benchmark 1.1 CPU Power Consumption Monitor 100 200 300 400 500
Numenta Anomaly Benchmark CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max AVX-512 On 2400 3437 3911 AVX-512 Off 3694 3702 3768 OpenBenchmarking.org Megahertz, More Is Better Numenta Anomaly Benchmark 1.1 CPU Peak Freq (Highest CPU Core Frequency) Monitor 1000 2000 3000 4000 5000
Numenta Anomaly Benchmark CPU Temperature Monitor Min Avg Max AVX-512 On 32.4 39.2 53.3 AVX-512 Off 37.8 42.8 60.4 OpenBenchmarking.org Celsius, Fewer Is Better Numenta Anomaly Benchmark 1.1 CPU Temperature Monitor 20 40 60 80 100
Numenta Anomaly Benchmark CPU Power Consumption Monitor Min Avg Max AVX-512 On 53.3 184.7 388.1 AVX-512 Off 212.5 259.2 394.2 OpenBenchmarking.org Watts, Fewer Is Better Numenta Anomaly Benchmark 1.1 CPU Power Consumption Monitor 110 220 330 440 550
Numenta Anomaly Benchmark CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max AVX-512 On 2400 3237 3715 AVX-512 Off 3694 3718 3948 OpenBenchmarking.org Megahertz, More Is Better Numenta Anomaly Benchmark 1.1 CPU Peak Freq (Highest CPU Core Frequency) Monitor 1000 2000 3000 4000 5000
Numenta Anomaly Benchmark CPU Temperature Monitor Min Avg Max AVX-512 On 32.4 40.4 50.1 AVX-512 Off 38.6 43.2 49.9 OpenBenchmarking.org Celsius, Fewer Is Better Numenta Anomaly Benchmark 1.1 CPU Temperature Monitor 14 28 42 56 70
Numenta Anomaly Benchmark CPU Power Consumption Monitor Min Avg Max AVX-512 On 55.1 216.0 378.8 AVX-512 Off 137.1 251.1 391.0 OpenBenchmarking.org Watts, Fewer Is Better Numenta Anomaly Benchmark 1.1 CPU Power Consumption Monitor 100 200 300 400 500
Numenta Anomaly Benchmark CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max AVX-512 On 2400 3532 3699 AVX-512 Off 3694 3707 4079 OpenBenchmarking.org Megahertz, More Is Better Numenta Anomaly Benchmark 1.1 CPU Peak Freq (Highest CPU Core Frequency) Monitor 1100 2200 3300 4400 5500
SVT-AV1 CPU Temperature Monitor Min Avg Max AVX-512 On 30.6 34.6 43.0 AVX-512 Off 37.8 40.5 48.1 OpenBenchmarking.org Celsius, Fewer Is Better SVT-AV1 1.4 CPU Temperature Monitor 14 28 42 56 70
SVT-AV1 CPU Power Consumption Monitor Min Avg Max AVX-512 On 52.7 175.4 338.1 AVX-512 Off 127.1 241.8 338.9 OpenBenchmarking.org Watts, Fewer Is Better SVT-AV1 1.4 CPU Power Consumption Monitor 80 160 240 320 400
SVT-AV1 CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max AVX-512 On 2400 3274 3770 AVX-512 Off 3694 3718 3985 OpenBenchmarking.org Megahertz, More Is Better SVT-AV1 1.4 CPU Peak Freq (Highest CPU Core Frequency) Monitor 1100 2200 3300 4400 5500
SVT-AV1 Encoder Mode: Preset 12 - Input: Bosphorus 4K OpenBenchmarking.org Frames Per Second Per Watt, More Is Better SVT-AV1 1.4 Encoder Mode: Preset 12 - Input: Bosphorus 4K AVX-512 On AVX-512 Off 0.315 0.63 0.945 1.26 1.575 1.400 0.968
SVT-AV1 CPU Temperature Monitor Min Avg Max AVX-512 On 32.4 36.8 49.3 AVX-512 Off 39.0 42.4 49.3 OpenBenchmarking.org Celsius, Fewer Is Better SVT-AV1 1.4 CPU Temperature Monitor 14 28 42 56 70
SVT-AV1 CPU Power Consumption Monitor Min Avg Max AVX-512 On 52.7 162.9 323.1 AVX-512 Off 108.8 243.3 325.0 OpenBenchmarking.org Watts, Fewer Is Better SVT-AV1 1.4 CPU Power Consumption Monitor 80 160 240 320 400
SVT-AV1 CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max AVX-512 On 2400 3202 3756 AVX-512 Off 3694 3728 4349 OpenBenchmarking.org Megahertz, More Is Better SVT-AV1 1.4 CPU Peak Freq (Highest CPU Core Frequency) Monitor 1100 2200 3300 4400 5500
SVT-AV1 Encoder Mode: Preset 13 - Input: Bosphorus 4K OpenBenchmarking.org Frames Per Second Per Watt, More Is Better SVT-AV1 1.4 Encoder Mode: Preset 13 - Input: Bosphorus 4K AVX-512 On AVX-512 Off 0.3404 0.6808 1.0212 1.3616 1.702 1.513 0.986
miniBUDE CPU Temperature Monitor Min Avg Max AVX-512 On 32.8 47.7 56.0 AVX-512 Off 40.4 53.0 60.1 OpenBenchmarking.org Celsius, Fewer Is Better miniBUDE 20210901 CPU Temperature Monitor 16 32 48 64 80
miniBUDE CPU Power Consumption Monitor Min Avg Max AVX-512 On 54 499 647 AVX-512 Off 211 564 661 OpenBenchmarking.org Watts, Fewer Is Better miniBUDE 20210901 CPU Power Consumption Monitor 200 400 600 800 1000
miniBUDE CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max AVX-512 On 2400 3201 3697 AVX-512 Off 2905 3288 3891 OpenBenchmarking.org Megahertz, More Is Better miniBUDE 20210901 CPU Peak Freq (Highest CPU Core Frequency) Monitor 1000 2000 3000 4000 5000
miniBUDE Implementation: OpenMP - Input Deck: BM2 OpenBenchmarking.org Billion Interactions/s Per Watt, More Is Better miniBUDE 20210901 Implementation: OpenMP - Input Deck: BM2 AVX-512 On AVX-512 Off 0.1562 0.3124 0.4686 0.6248 0.781 0.694 0.453
miniBUDE CPU Temperature Monitor Min Avg Max AVX-512 On 31.5 38.5 47.4 AVX-512 Off 38.6 45.5 52.4 OpenBenchmarking.org Celsius, Fewer Is Better miniBUDE 20210901 CPU Temperature Monitor 15 30 45 60 75
miniBUDE CPU Power Consumption Monitor Min Avg Max AVX-512 On 52 281 624 AVX-512 Off 212 414 630 OpenBenchmarking.org Watts, Fewer Is Better miniBUDE 20210901 CPU Power Consumption Monitor 200 400 600 800 1000
miniBUDE CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max AVX-512 On 2400 2913 3739 AVX-512 Off 3107 3505 4044 OpenBenchmarking.org Megahertz, More Is Better miniBUDE 20210901 CPU Peak Freq (Highest CPU Core Frequency) Monitor 1100 2200 3300 4400 5500
miniBUDE Implementation: OpenMP - Input Deck: BM1 OpenBenchmarking.org Billion Interactions/s Per Watt, More Is Better miniBUDE 20210901 Implementation: OpenMP - Input Deck: BM1 AVX-512 On AVX-512 Off 0.2342 0.4684 0.7026 0.9368 1.171 1.041 0.489
Numpy Benchmark CPU Temperature Monitor Min Avg Max AVX-512 On 32.8 36.3 40.4 AVX-512 Off 36.4 37.9 43.5 OpenBenchmarking.org Celsius, Fewer Is Better Numpy Benchmark CPU Temperature Monitor 12 24 36 48 60
Numpy Benchmark CPU Power Consumption Monitor Min Avg Max AVX-512 On 54.1 214.2 222.9 AVX-512 Off 110.9 221.9 228.1 OpenBenchmarking.org Watts, Fewer Is Better Numpy Benchmark CPU Power Consumption Monitor 60 120 180 240 300
Numpy Benchmark CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max AVX-512 On 2400 3673 3705 AVX-512 Off 3694 3702 4024 OpenBenchmarking.org Megahertz, More Is Better Numpy Benchmark CPU Peak Freq (Highest CPU Core Frequency) Monitor 1100 2200 3300 4400 5500
Numpy Benchmark OpenBenchmarking.org Score Per Watt, More Is Better Numpy Benchmark AVX-512 On AVX-512 Off 0.6046 1.2092 1.8138 2.4184 3.023 2.687 2.474
ONNX Runtime CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better ONNX Runtime 1.11 CPU Temperature Monitor AVX-512 On AVX-512 Off 11 22 33 44 55 Min: 32.75 / Avg: 48.03 / Max: 50.63 Min: 38.13 / Avg: 50.46 / Max: 57.25
ONNX Runtime CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better ONNX Runtime 1.11 CPU Power Consumption Monitor AVX-512 On AVX-512 Off 80 160 240 320 400 Min: 51.25 / Avg: 441.77 / Max: 464.82 Min: 107.66 / Avg: 447.6 / Max: 464.67
ONNX Runtime CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better ONNX Runtime 1.11 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 On AVX-512 Off 700 1400 2100 2800 3500 Min: 2400 / Avg: 3571.99 / Max: 3770 Min: 3593 / Avg: 3607.6 / Max: 4285
ONNX Runtime Model: ArcFace ResNet-100 - Device: CPU - Executor: Standard OpenBenchmarking.org Inferences Per Minute Per Watt, More Is Better ONNX Runtime 1.11 Model: ArcFace ResNet-100 - Device: CPU - Executor: Standard AVX-512 On AVX-512 Off 0.5353 1.0706 1.6059 2.1412 2.6765 2.379 2.051
ONNX Runtime CPU Temperature Monitor Min Avg Max AVX-512 On 34.6 46.5 48.9 AVX-512 Off 39.0 48.4 52.0 OpenBenchmarking.org Celsius, Fewer Is Better ONNX Runtime 1.11 CPU Temperature Monitor 15 30 45 60 75
ONNX Runtime CPU Power Consumption Monitor Min Avg Max AVX-512 On 50.3 370.5 385.5 AVX-512 Off 193.6 379.6 388.9 OpenBenchmarking.org Watts, Fewer Is Better ONNX Runtime 1.11 CPU Power Consumption Monitor 100 200 300 400 500
ONNX Runtime CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max AVX-512 On 2400 3663 3709 AVX-512 Off 3694 3701 3978 OpenBenchmarking.org Megahertz, More Is Better ONNX Runtime 1.11 CPU Peak Freq (Highest CPU Core Frequency) Monitor 1100 2200 3300 4400 5500
ONNX Runtime Model: bertsquad-12 - Device: CPU - Executor: Standard OpenBenchmarking.org Inferences Per Minute Per Watt, More Is Better ONNX Runtime 1.11 Model: bertsquad-12 - Device: CPU - Executor: Standard AVX-512 On AVX-512 Off 0.3134 0.6268 0.9402 1.2536 1.567 1.393 1.315
ONNX Runtime CPU Temperature Monitor Min Avg Max AVX-512 On 36.4 39.9 42.6 AVX-512 Off 39.5 43.2 53.0 OpenBenchmarking.org Celsius, Fewer Is Better ONNX Runtime 1.11 CPU Temperature Monitor 15 30 45 60 75
ONNX Runtime CPU Power Consumption Monitor Min Avg Max AVX-512 On 53.2 259.3 268.4 AVX-512 Off 132.5 266.8 278.0 OpenBenchmarking.org Watts, Fewer Is Better ONNX Runtime 1.11 CPU Power Consumption Monitor 70 140 210 280 350
ONNX Runtime CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max AVX-512 On 2400 3665 3710 AVX-512 Off 3693 3702 4397 OpenBenchmarking.org Megahertz, More Is Better ONNX Runtime 1.11 CPU Peak Freq (Highest CPU Core Frequency) Monitor 1100 2200 3300 4400 5500
ONNX Runtime Model: super-resolution-10 - Device: CPU - Executor: Standard OpenBenchmarking.org Inferences Per Minute Per Watt, More Is Better ONNX Runtime 1.11 Model: super-resolution-10 - Device: CPU - Executor: Standard AVX-512 On AVX-512 Off 7 14 21 28 35 28.54 23.57
ONNX Runtime CPU Temperature Monitor Min Avg Max AVX-512 On 37.8 51.1 57.5 AVX-512 Off 43.0 53.4 59.3 OpenBenchmarking.org Celsius, Fewer Is Better ONNX Runtime 1.11 CPU Temperature Monitor 16 32 48 64 80
ONNX Runtime CPU Power Consumption Monitor Min Avg Max AVX-512 On 51.7 494.2 532.0 AVX-512 Off 211.3 503.0 528.2 OpenBenchmarking.org Watts, Fewer Is Better ONNX Runtime 1.11 CPU Power Consumption Monitor 140 280 420 560 700
ONNX Runtime CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max AVX-512 On 2400 3577 3696 AVX-512 Off 3047 3612 4291 OpenBenchmarking.org Megahertz, More Is Better ONNX Runtime 1.11 CPU Peak Freq (Highest CPU Core Frequency) Monitor 1100 2200 3300 4400 5500
ONNX Runtime Model: fcn-resnet101-11 - Device: CPU - Executor: Standard OpenBenchmarking.org Inferences Per Minute Per Watt, More Is Better ONNX Runtime 1.11 Model: fcn-resnet101-11 - Device: CPU - Executor: Standard AVX-512 On AVX-512 Off 0.1233 0.2466 0.3699 0.4932 0.6165 0.548 0.497
GROMACS CPU Temperature Monitor Min Avg Max AVX-512 On 43.3 56.1 62.6 AVX-512 Off 43.0 54.8 64.5 OpenBenchmarking.org Celsius, Fewer Is Better GROMACS 2022.1 CPU Temperature Monitor 20 40 60 80 100
GROMACS CPU Power Consumption Monitor Min Avg Max AVX-512 On 58 535 698 AVX-512 Off 216 553 700 OpenBenchmarking.org Watts, Fewer Is Better GROMACS 2022.1 CPU Power Consumption Monitor 200 400 600 800 1000
GROMACS CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max AVX-512 On 2400 3168 3725 AVX-512 Off 2875 3358 4145 OpenBenchmarking.org Megahertz, More Is Better GROMACS 2022.1 CPU Peak Freq (Highest CPU Core Frequency) Monitor 1100 2200 3300 4400 5500
GROMACS Implementation: MPI CPU - Input: water_GMX50_bare OpenBenchmarking.org Ns Per Day Per Watt, More Is Better GROMACS 2022.1 Implementation: MPI CPU - Input: water_GMX50_bare AVX-512 On AVX-512 Off 0.0079 0.0158 0.0237 0.0316 0.0395 0.035 0.033
OpenVINO CPU Temperature Monitor Min Avg Max AVX-512 On 42.6 58.4 61.9 AVX-512 Off 46.1 56.3 61.4 OpenBenchmarking.org Celsius, Fewer Is Better OpenVINO 2022.2.dev CPU Temperature Monitor 20 40 60 80 100
OpenVINO CPU Power Consumption Monitor Min Avg Max AVX-512 On 57 636 701 AVX-512 Off 213 595 648 OpenBenchmarking.org Watts, Fewer Is Better OpenVINO 2022.2.dev CPU Power Consumption Monitor 200 400 600 800 1000
OpenVINO CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max AVX-512 On 2400 3256 3707 AVX-512 Off 2592 2966 3926 OpenBenchmarking.org Megahertz, More Is Better OpenVINO 2022.2.dev CPU Peak Freq (Highest CPU Core Frequency) Monitor 1000 2000 3000 4000 5000
OpenVINO CPU Temperature Monitor Min Avg Max AVX-512 On 43.8 56.8 59.6 AVX-512 Off 46.6 58.0 61.4 OpenBenchmarking.org Celsius, Fewer Is Better OpenVINO 2022.2.dev CPU Temperature Monitor 20 40 60 80 100
OpenVINO CPU Power Consumption Monitor Min Avg Max AVX-512 On 51 588 657 AVX-512 Off 218 588 640 OpenBenchmarking.org Watts, Fewer Is Better OpenVINO 2022.2.dev CPU Power Consumption Monitor 200 400 600 800 1000
OpenVINO CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max AVX-512 On 2400 3099 3699 AVX-512 Off 2799 2942 3941 OpenBenchmarking.org Megahertz, More Is Better OpenVINO 2022.2.dev CPU Peak Freq (Highest CPU Core Frequency) Monitor 1000 2000 3000 4000 5000
OpenVINO CPU Temperature Monitor Min Avg Max AVX-512 On 42.1 59.0 62.4 AVX-512 Off 48.9 59.9 62.3 OpenBenchmarking.org Celsius, Fewer Is Better OpenVINO 2022.2.dev CPU Temperature Monitor 20 40 60 80 100
OpenVINO CPU Power Consumption Monitor Min Avg Max AVX-512 On 59 633 690 AVX-512 Off 217 613 655 OpenBenchmarking.org Watts, Fewer Is Better OpenVINO 2022.2.dev CPU Power Consumption Monitor 200 400 600 800 1000
OpenVINO CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max AVX-512 On 2400 2972 3706 AVX-512 Off 2571 2730 4230 OpenBenchmarking.org Megahertz, More Is Better OpenVINO 2022.2.dev CPU Peak Freq (Highest CPU Core Frequency) Monitor 1100 2200 3300 4400 5500
OpenVINO CPU Temperature Monitor Min Avg Max AVX-512 On 44.4 57.9 60.1 AVX-512 Off 48.0 61.1 64.0 OpenBenchmarking.org Celsius, Fewer Is Better OpenVINO 2022.2.dev CPU Temperature Monitor 20 40 60 80 100
OpenVINO CPU Power Consumption Monitor Min Avg Max AVX-512 On 33 598 646 AVX-512 Off 214 634 676 OpenBenchmarking.org Watts, Fewer Is Better OpenVINO 2022.2.dev CPU Power Consumption Monitor 200 400 600 800 1000
OpenVINO CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max AVX-512 On 2400 3036 3900 AVX-512 Off 2988 3068 4270 OpenBenchmarking.org Megahertz, More Is Better OpenVINO 2022.2.dev CPU Peak Freq (Highest CPU Core Frequency) Monitor 1100 2200 3300 4400 5500
OpenVINO CPU Temperature Monitor Min Avg Max AVX-512 On 43.0 60.9 64.5 AVX-512 Off 49.8 60.0 61.8 OpenBenchmarking.org Celsius, Fewer Is Better OpenVINO 2022.2.dev CPU Temperature Monitor 20 40 60 80 100
OpenVINO CPU Power Consumption Monitor Min Avg Max AVX-512 On 58 660 712 AVX-512 Off 221 598 639 OpenBenchmarking.org Watts, Fewer Is Better OpenVINO 2022.2.dev CPU Power Consumption Monitor 200 400 600 800 1000
OpenVINO CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max AVX-512 On 2400 3060 3695 AVX-512 Off 2672 2848 3946 OpenBenchmarking.org Megahertz, More Is Better OpenVINO 2022.2.dev CPU Peak Freq (Highest CPU Core Frequency) Monitor 1000 2000 3000 4000 5000
OpenVINO CPU Temperature Monitor Min Avg Max AVX-512 On 42.6 59.4 62.8 AVX-512 Off 45.8 63.0 67.1 OpenBenchmarking.org Celsius, Fewer Is Better OpenVINO 2022.2.dev CPU Temperature Monitor 20 40 60 80 100
OpenVINO CPU Power Consumption Monitor Min Avg Max AVX-512 On 57 639 696 AVX-512 Off 216 684 729 OpenBenchmarking.org Watts, Fewer Is Better OpenVINO 2022.2.dev CPU Power Consumption Monitor 200 400 600 800 1000
OpenVINO CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max AVX-512 On 2400 3037 3696 AVX-512 Off 2930 3070 3969 OpenBenchmarking.org Megahertz, More Is Better OpenVINO 2022.2.dev CPU Peak Freq (Highest CPU Core Frequency) Monitor 1100 2200 3300 4400 5500
OpenVINO CPU Temperature Monitor Min Avg Max AVX-512 On 42.1 58.0 67.3 AVX-512 Off 46.1 58.7 66.8 OpenBenchmarking.org Celsius, Fewer Is Better OpenVINO 2022.2.dev CPU Temperature Monitor 20 40 60 80 100
OpenVINO CPU Power Consumption Monitor Min Avg Max AVX-512 On 38 607 700 AVX-512 Off 215 593 665 OpenBenchmarking.org Watts, Fewer Is Better OpenVINO 2022.2.dev CPU Power Consumption Monitor 200 400 600 800 1000
OpenVINO CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max AVX-512 On 2400 3466 3698 AVX-512 Off 2729 3100 3993 OpenBenchmarking.org Megahertz, More Is Better OpenVINO 2022.2.dev CPU Peak Freq (Highest CPU Core Frequency) Monitor 1100 2200 3300 4400 5500
OpenVINO CPU Temperature Monitor Min Avg Max AVX-512 On 39.5 57.4 65.9 AVX-512 Off 47.0 58.2 67.6 OpenBenchmarking.org Celsius, Fewer Is Better OpenVINO 2022.2.dev CPU Temperature Monitor 20 40 60 80 100
OpenVINO CPU Power Consumption Monitor Min Avg Max AVX-512 On 56 605 699 AVX-512 Off 114 579 650 OpenBenchmarking.org Watts, Fewer Is Better OpenVINO 2022.2.dev CPU Power Consumption Monitor 200 400 600 800 1000
OpenVINO CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max AVX-512 On 2400 3480 3726 AVX-512 Off 2709 3150 3863 OpenBenchmarking.org Megahertz, More Is Better OpenVINO 2022.2.dev CPU Peak Freq (Highest CPU Core Frequency) Monitor 1000 2000 3000 4000 5000
OpenVINO CPU Temperature Monitor Min Avg Max AVX-512 On 41.8 52.2 55.1 AVX-512 Off 48.0 59.2 62.3 OpenBenchmarking.org Celsius, Fewer Is Better OpenVINO 2022.2.dev CPU Temperature Monitor 20 40 60 80 100
OpenVINO CPU Power Consumption Monitor Min Avg Max AVX-512 On 29 514 564 AVX-512 Off 217 592 630 OpenBenchmarking.org Watts, Fewer Is Better OpenVINO 2022.2.dev CPU Power Consumption Monitor 200 400 600 800 1000
OpenVINO CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max AVX-512 On 2400 3630 3754 AVX-512 Off 3476 3674 3707 OpenBenchmarking.org Megahertz, More Is Better OpenVINO 2022.2.dev CPU Peak Freq (Highest CPU Core Frequency) Monitor 1000 2000 3000 4000 5000
OpenVINO CPU Temperature Monitor Min Avg Max AVX-512 On 42.1 55.4 59.5 AVX-512 Off 49.3 59.9 62.6 OpenBenchmarking.org Celsius, Fewer Is Better OpenVINO 2022.2.dev CPU Temperature Monitor 20 40 60 80 100
OpenVINO CPU Power Consumption Monitor Min Avg Max AVX-512 On 48 566 622 AVX-512 Off 219 592 636 OpenBenchmarking.org Watts, Fewer Is Better OpenVINO 2022.2.dev CPU Power Consumption Monitor 200 400 600 800 1000
OpenVINO CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max AVX-512 On 2400 3605 3828 AVX-512 Off 2992 3193 4056 OpenBenchmarking.org Megahertz, More Is Better OpenVINO 2022.2.dev CPU Peak Freq (Highest CPU Core Frequency) Monitor 1100 2200 3300 4400 5500
OpenVINO CPU Temperature Monitor Min Avg Max AVX-512 On 43.0 58.1 61.9 AVX-512 Off 47.0 62.5 66.8 OpenBenchmarking.org Celsius, Fewer Is Better OpenVINO 2022.2.dev CPU Temperature Monitor 20 40 60 80 100
OpenVINO CPU Power Consumption Monitor Min Avg Max AVX-512 On 58 612 687 AVX-512 Off 216 662 733 OpenBenchmarking.org Watts, Fewer Is Better OpenVINO 2022.2.dev CPU Power Consumption Monitor 200 400 600 800 1000
OpenVINO CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max AVX-512 On 2400 3129 3696 AVX-512 Off 2920 3081 3713 OpenBenchmarking.org Megahertz, More Is Better OpenVINO 2022.2.dev CPU Peak Freq (Highest CPU Core Frequency) Monitor 1000 2000 3000 4000 5000
OpenVINO CPU Temperature Monitor Min Avg Max AVX-512 On 35.9 57.3 64.1 AVX-512 Off 41.3 56.2 61.9 OpenBenchmarking.org Celsius, Fewer Is Better OpenVINO 2022.2.dev CPU Temperature Monitor 20 40 60 80 100
OpenVINO CPU Power Consumption Monitor Min Avg Max AVX-512 On 54 639 725 AVX-512 Off 218 585 645 OpenBenchmarking.org Watts, Fewer Is Better OpenVINO 2022.2.dev CPU Power Consumption Monitor 200 400 600 800 1000
OpenVINO CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max AVX-512 On 2400 3126 3696 AVX-512 Off 2652 2906 4086 OpenBenchmarking.org Megahertz, More Is Better OpenVINO 2022.2.dev CPU Peak Freq (Highest CPU Core Frequency) Monitor 1100 2200 3300 4400 5500
NCNN CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better NCNN 20220729 CPU Temperature Monitor AVX-512 On AVX-512 Off 10 20 30 40 50 Min: 38.63 / Avg: 44.45 / Max: 48 Min: 43 / Avg: 46.1 / Max: 50.13
NCNN CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better NCNN 20220729 CPU Power Consumption Monitor AVX-512 On AVX-512 Off 80 160 240 320 400 Min: 54.96 / Avg: 396.44 / Max: 451.5 Min: 199.1 / Avg: 400.13 / Max: 450.41
NCNN CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better NCNN 20220729 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 On AVX-512 Off 700 1400 2100 2800 3500 Min: 2400 / Avg: 3565.67 / Max: 3699 Min: 3563 / Avg: 3574.38 / Max: 3815
Cpuminer-Opt CPU Temperature Monitor Min Avg Max AVX-512 On 42.4 59.0 63.5 AVX-512 Off 47.0 59.2 62.3 OpenBenchmarking.org Celsius, Fewer Is Better Cpuminer-Opt 3.20.3 CPU Temperature Monitor 20 40 60 80 100
Cpuminer-Opt CPU Power Consumption Monitor Min Avg Max AVX-512 On 59 643 743 AVX-512 Off 222 613 684 OpenBenchmarking.org Watts, Fewer Is Better Cpuminer-Opt 3.20.3 CPU Power Consumption Monitor 200 400 600 800 1000
Cpuminer-Opt CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max AVX-512 On 2400 3060 3703 AVX-512 Off 2729 2933 4111 OpenBenchmarking.org Megahertz, More Is Better Cpuminer-Opt 3.20.3 CPU Peak Freq (Highest CPU Core Frequency) Monitor 1100 2200 3300 4400 5500
Cpuminer-Opt Algorithm: LBC, LBRY Credits OpenBenchmarking.org kH/s Per Watt, More Is Better Cpuminer-Opt 3.20.3 Algorithm: LBC, LBRY Credits AVX-512 On AVX-512 Off 400 800 1200 1600 2000 1658.51 802.76
Cpuminer-Opt CPU Temperature Monitor Min Avg Max AVX-512 On 41.3 57.9 62.8 AVX-512 Off 47.0 58.7 61.8 OpenBenchmarking.org Celsius, Fewer Is Better Cpuminer-Opt 3.20.3 CPU Temperature Monitor 20 40 60 80 100
Cpuminer-Opt CPU Power Consumption Monitor Min Avg Max AVX-512 On 58 622 720 AVX-512 Off 221 599 665 OpenBenchmarking.org Watts, Fewer Is Better Cpuminer-Opt 3.20.3 CPU Power Consumption Monitor 200 400 600 800 1000
Cpuminer-Opt CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max AVX-512 On 2400 3002 3696 AVX-512 Off 2895 3068 3848 OpenBenchmarking.org Megahertz, More Is Better Cpuminer-Opt 3.20.3 CPU Peak Freq (Highest CPU Core Frequency) Monitor 1000 2000 3000 4000 5000
Cpuminer-Opt Algorithm: Skeincoin OpenBenchmarking.org kH/s Per Watt, More Is Better Cpuminer-Opt 3.20.3 Algorithm: Skeincoin AVX-512 On AVX-512 Off 700 1400 2100 2800 3500 3137.56 2381.94
Cpuminer-Opt CPU Temperature Monitor Min Avg Max AVX-512 On 41.3 56.3 60.9 AVX-512 Off 45.8 57.1 60.9 OpenBenchmarking.org Celsius, Fewer Is Better Cpuminer-Opt 3.20.3 CPU Temperature Monitor 20 40 60 80 100
Cpuminer-Opt CPU Power Consumption Monitor Min Avg Max AVX-512 On 57 596 694 AVX-512 Off 220 587 657 OpenBenchmarking.org Watts, Fewer Is Better Cpuminer-Opt 3.20.3 CPU Power Consumption Monitor 200 400 600 800 1000
Cpuminer-Opt CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max AVX-512 On 2400 3079 3830 AVX-512 Off 2878 3030 3783 OpenBenchmarking.org Megahertz, More Is Better Cpuminer-Opt 3.20.3 CPU Peak Freq (Highest CPU Core Frequency) Monitor 1000 2000 3000 4000 5000
Cpuminer-Opt Algorithm: Garlicoin OpenBenchmarking.org kH/s Per Watt, More Is Better Cpuminer-Opt 3.20.3 Algorithm: Garlicoin AVX-512 On AVX-512 Off 30 60 90 120 150 119.97 83.22
Cpuminer-Opt CPU Temperature Monitor Min Avg Max AVX-512 On 42.0 57.1 60.4 AVX-512 Off 46.6 58.2 60.9 OpenBenchmarking.org Celsius, Fewer Is Better Cpuminer-Opt 3.20.3 CPU Temperature Monitor 20 40 60 80 100
Cpuminer-Opt CPU Power Consumption Monitor Min Avg Max AVX-512 On 39 568 650 AVX-512 Off 221 580 645 OpenBenchmarking.org Watts, Fewer Is Better Cpuminer-Opt 3.20.3 CPU Power Consumption Monitor 200 400 600 800 1000
Cpuminer-Opt CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max AVX-512 On 2400 3105 3697 AVX-512 Off 3256 3351 4121 OpenBenchmarking.org Megahertz, More Is Better Cpuminer-Opt 3.20.3 CPU Peak Freq (Highest CPU Core Frequency) Monitor 1100 2200 3300 4400 5500
Cpuminer-Opt Algorithm: x25x OpenBenchmarking.org kH/s Per Watt, More Is Better Cpuminer-Opt 3.20.3 Algorithm: x25x AVX-512 On AVX-512 Off 3 6 9 12 15 13.548 9.971
Cpuminer-Opt CPU Temperature Monitor Min Avg Max AVX-512 On 43.0 58.6 62.8 AVX-512 Off 46.6 57.9 61.4 OpenBenchmarking.org Celsius, Fewer Is Better Cpuminer-Opt 3.20.3 CPU Temperature Monitor 20 40 60 80 100
Cpuminer-Opt CPU Power Consumption Monitor Min Avg Max AVX-512 On 57 618 724 AVX-512 Off 134 587 654 OpenBenchmarking.org Watts, Fewer Is Better Cpuminer-Opt 3.20.3 CPU Power Consumption Monitor 200 400 600 800 1000
Cpuminer-Opt CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max AVX-512 On 2400 3112 3695 AVX-512 Off 3001 3155 4285 OpenBenchmarking.org Megahertz, More Is Better Cpuminer-Opt 3.20.3 CPU Peak Freq (Highest CPU Core Frequency) Monitor 1100 2200 3300 4400 5500
Cpuminer-Opt Algorithm: Quad SHA-256, Pyrite OpenBenchmarking.org kH/s Per Watt, More Is Better Cpuminer-Opt 3.20.3 Algorithm: Quad SHA-256, Pyrite AVX-512 On AVX-512 Off 800 1600 2400 3200 4000 3657.53 2252.99
Cpuminer-Opt CPU Temperature Monitor Min Avg Max AVX-512 On 34.1 52.2 58.3 AVX-512 Off 39.5 52.4 56.9 OpenBenchmarking.org Celsius, Fewer Is Better Cpuminer-Opt 3.20.3 CPU Temperature Monitor 16 32 48 64 80
Cpuminer-Opt CPU Power Consumption Monitor Min Avg Max AVX-512 On 55 594 682 AVX-512 Off 215 558 618 OpenBenchmarking.org Watts, Fewer Is Better Cpuminer-Opt 3.20.3 CPU Power Consumption Monitor 200 400 600 800 1000
Cpuminer-Opt CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max AVX-512 On 2400 3009 3697 AVX-512 Off 2933 3058 3896 OpenBenchmarking.org Megahertz, More Is Better Cpuminer-Opt 3.20.3 CPU Peak Freq (Highest CPU Core Frequency) Monitor 1000 2000 3000 4000 5000
Cpuminer-Opt Algorithm: scrypt OpenBenchmarking.org kH/s Per Watt, More Is Better Cpuminer-Opt 3.20.3 Algorithm: scrypt AVX-512 On AVX-512 Off 2 4 6 8 10 8.076 5.279
Mobile Neural Network CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better Mobile Neural Network 2.1 CPU Temperature Monitor AVX-512 On AVX-512 Off 11 22 33 44 55 Min: 35.88 / Avg: 48.36 / Max: 52 Min: 40.38 / Avg: 49.52 / Max: 52.88
Mobile Neural Network CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better Mobile Neural Network 2.1 CPU Power Consumption Monitor AVX-512 On AVX-512 Off 60 120 180 240 300 Min: 53.81 / Avg: 327.57 / Max: 340 Min: 165 / Avg: 334.93 / Max: 346.27
Mobile Neural Network CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better Mobile Neural Network 2.1 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 On AVX-512 Off 700 1400 2100 2800 3500 Min: 2400 / Avg: 3679.28 / Max: 3704 Min: 3694 / Avg: 3699.72 / Max: 4041
oneDNN CPU Temperature Monitor Min Avg Max AVX-512 On 37.8 45.8 48.9 AVX-512 Off 42.6 46.8 49.8 OpenBenchmarking.org Celsius, Fewer Is Better oneDNN 2.7 CPU Temperature Monitor 14 28 42 56 70
oneDNN CPU Power Consumption Monitor Min Avg Max AVX-512 On 55.2 413.8 581.1 AVX-512 Off 204.0 413.9 482.1 OpenBenchmarking.org Watts, Fewer Is Better oneDNN 2.7 CPU Power Consumption Monitor 160 320 480 640 800
oneDNN CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max AVX-512 On 2400 3507 3700 AVX-512 Off 3570 3612 4005 OpenBenchmarking.org Megahertz, More Is Better oneDNN 2.7 CPU Peak Freq (Highest CPU Core Frequency) Monitor 1100 2200 3300 4400 5500
oneDNN CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better oneDNN 2.7 CPU Temperature Monitor AVX-512 On AVX-512 Off 10 20 30 40 50 Min: 37.75 / Avg: 46.67 / Max: 51.5 Min: 42.63 / Avg: 46.63 / Max: 50.63
oneDNN CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better oneDNN 2.7 CPU Power Consumption Monitor AVX-512 On AVX-512 Off 100 200 300 400 500 Min: 52.5 / Avg: 419.24 / Max: 543.13 Min: 195.71 / Avg: 412.52 / Max: 498.86
oneDNN CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better oneDNN 2.7 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 On AVX-512 Off 700 1400 2100 2800 3500 Min: 2400 / Avg: 3567.66 / Max: 3704 Min: 3582 / Avg: 3626.86 / Max: 4223
oneDNN CPU Temperature Monitor Min Avg Max AVX-512 On 35.5 46.0 50.6 AVX-512 Off 38.6 45.9 50.1 OpenBenchmarking.org Celsius, Fewer Is Better oneDNN 2.7 CPU Temperature Monitor 14 28 42 56 70
oneDNN CPU Power Consumption Monitor Min Avg Max AVX-512 On 55.5 418.6 541.1 AVX-512 Off 215.2 412.5 499.6 OpenBenchmarking.org Watts, Fewer Is Better oneDNN 2.7 CPU Power Consumption Monitor 140 280 420 560 700
oneDNN CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max AVX-512 On 2400 3571 3711 AVX-512 Off 3581 3623 3818 OpenBenchmarking.org Megahertz, More Is Better oneDNN 2.7 CPU Peak Freq (Highest CPU Core Frequency) Monitor 1000 2000 3000 4000 5000
oneDNN CPU Temperature Monitor Min Avg Max AVX-512 On 35.9 39.3 44.4 AVX-512 Off 39.0 41.4 43.9 OpenBenchmarking.org Celsius, Fewer Is Better oneDNN 2.7 CPU Temperature Monitor 12 24 36 48 60
oneDNN CPU Power Consumption Monitor Min Avg Max AVX-512 On 54.0 248.8 512.8 AVX-512 Off 215.2 323.9 475.6 OpenBenchmarking.org Watts, Fewer Is Better oneDNN 2.7 CPU Power Consumption Monitor 130 260 390 520 650
oneDNN CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max AVX-512 On 2400 3008 3695 AVX-512 Off 3569 3666 4064 OpenBenchmarking.org Megahertz, More Is Better oneDNN 2.7 CPU Peak Freq (Highest CPU Core Frequency) Monitor 1100 2200 3300 4400 5500
oneDNN CPU Temperature Monitor Min Avg Max AVX-512 On 37.3 43.5 46.1 AVX-512 Off 39.5 43.8 47.0 OpenBenchmarking.org Celsius, Fewer Is Better oneDNN 2.7 CPU Temperature Monitor 14 28 42 56 70
oneDNN CPU Power Consumption Monitor Min Avg Max AVX-512 On 52.1 376.1 492.5 AVX-512 Off 215.5 392.5 509.7 OpenBenchmarking.org Watts, Fewer Is Better oneDNN 2.7 CPU Power Consumption Monitor 130 260 390 520 650
oneDNN CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max AVX-512 On 2400 3394 3729 AVX-512 Off 2933 3526 3802 OpenBenchmarking.org Megahertz, More Is Better oneDNN 2.7 CPU Peak Freq (Highest CPU Core Frequency) Monitor 1000 2000 3000 4000 5000
oneDNN CPU Temperature Monitor Min Avg Max AVX-512 On 40.9 46.0 51.1 AVX-512 Off 43.5 47.7 53.8 OpenBenchmarking.org Celsius, Fewer Is Better oneDNN 2.7 CPU Temperature Monitor 15 30 45 60 75
oneDNN CPU Power Consumption Monitor Min Avg Max AVX-512 On 54.1 327.3 548.8 AVX-512 Off 216.4 379.5 540.9 OpenBenchmarking.org Watts, Fewer Is Better oneDNN 2.7 CPU Power Consumption Monitor 140 280 420 560 700
oneDNN CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max AVX-512 On 2400 3182 3695 AVX-512 Off 2860 3348 3869 OpenBenchmarking.org Megahertz, More Is Better oneDNN 2.7 CPU Peak Freq (Highest CPU Core Frequency) Monitor 1000 2000 3000 4000 5000
OSPRay Studio CPU Temperature Monitor Min Avg Max AVX-512 On 44.6 57.9 62.6 AVX-512 Off 47.0 60.8 65.4 OpenBenchmarking.org Celsius, Fewer Is Better OSPRay Studio 0.11 CPU Temperature Monitor 20 40 60 80 100
OSPRay Studio CPU Power Consumption Monitor Min Avg Max AVX-512 On 57 590 687 AVX-512 Off 224 620 702 OpenBenchmarking.org Watts, Fewer Is Better OSPRay Studio 0.11 CPU Power Consumption Monitor 200 400 600 800 1000
OSPRay Studio CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max AVX-512 On 2400 2943 3701 AVX-512 Off 2727 2973 3711 OpenBenchmarking.org Megahertz, More Is Better OSPRay Studio 0.11 CPU Peak Freq (Highest CPU Core Frequency) Monitor 1000 2000 3000 4000 5000
OSPRay Studio CPU Temperature Monitor Min Avg Max AVX-512 On 44.6 59.9 64.9 AVX-512 Off 46.6 61.6 64.9 OpenBenchmarking.org Celsius, Fewer Is Better OSPRay Studio 0.11 CPU Temperature Monitor 20 40 60 80 100
OSPRay Studio CPU Power Consumption Monitor Min Avg Max AVX-512 On 60 618 690 AVX-512 Off 114 637 703 OpenBenchmarking.org Watts, Fewer Is Better OSPRay Studio 0.11 CPU Power Consumption Monitor 200 400 600 800 1000
OSPRay Studio CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max AVX-512 On 2400 2910 3697 AVX-512 Off 2752 2956 4184 OpenBenchmarking.org Megahertz, More Is Better OSPRay Studio 0.11 CPU Peak Freq (Highest CPU Core Frequency) Monitor 1100 2200 3300 4400 5500
OSPRay Studio CPU Temperature Monitor Min Avg Max AVX-512 On 44.9 58.2 62.8 AVX-512 Off 46.6 60.0 64.0 OpenBenchmarking.org Celsius, Fewer Is Better OSPRay Studio 0.11 CPU Temperature Monitor 20 40 60 80 100
OSPRay Studio CPU Power Consumption Monitor Min Avg Max AVX-512 On 39 591 684 AVX-512 Off 221 612 698 OpenBenchmarking.org Watts, Fewer Is Better OSPRay Studio 0.11 CPU Power Consumption Monitor 200 400 600 800 1000
OSPRay Studio CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max AVX-512 On 2400 2937 3698 AVX-512 Off 2721 2996 4398 OpenBenchmarking.org Megahertz, More Is Better OSPRay Studio 0.11 CPU Peak Freq (Highest CPU Core Frequency) Monitor 1100 2200 3300 4400 5500
OSPRay Studio CPU Temperature Monitor Min Avg Max AVX-512 On 43.8 59.3 64.0 AVX-512 Off 46.6 61.3 66.3 OpenBenchmarking.org Celsius, Fewer Is Better OSPRay Studio 0.11 CPU Temperature Monitor 20 40 60 80 100
OSPRay Studio CPU Power Consumption Monitor Min Avg Max AVX-512 On 58 611 684 AVX-512 Off 222 630 700 OpenBenchmarking.org Watts, Fewer Is Better OSPRay Studio 0.11 CPU Power Consumption Monitor 200 400 600 800 1000
OSPRay Studio CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max AVX-512 On 2400 2923 3697 AVX-512 Off 2715 2972 4286 OpenBenchmarking.org Megahertz, More Is Better OSPRay Studio 0.11 CPU Peak Freq (Highest CPU Core Frequency) Monitor 1100 2200 3300 4400 5500
OSPRay Studio CPU Temperature Monitor Min Avg Max AVX-512 On 43.8 58.7 65.4 AVX-512 Off 47.0 60.8 64.9 OpenBenchmarking.org Celsius, Fewer Is Better OSPRay Studio 0.11 CPU Temperature Monitor 20 40 60 80 100
OSPRay Studio CPU Power Consumption Monitor Min Avg Max AVX-512 On 31 602 684 AVX-512 Off 223 621 699 OpenBenchmarking.org Watts, Fewer Is Better OSPRay Studio 0.11 CPU Power Consumption Monitor 200 400 600 800 1000
OSPRay Studio CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max AVX-512 On 2400 2926 3699 AVX-512 Off 2721 2971 4031 OpenBenchmarking.org Megahertz, More Is Better OSPRay Studio 0.11 CPU Peak Freq (Highest CPU Core Frequency) Monitor 1100 2200 3300 4400 5500
OSPRay Studio CPU Temperature Monitor Min Avg Max AVX-512 On 44.1 58.4 62.3 AVX-512 Off 46.6 60.3 64.5 OpenBenchmarking.org Celsius, Fewer Is Better OSPRay Studio 0.11 CPU Temperature Monitor 20 40 60 80 100
OSPRay Studio CPU Power Consumption Monitor Min Avg Max AVX-512 On 38 597 682 AVX-512 Off 223 621 696 OpenBenchmarking.org Watts, Fewer Is Better OSPRay Studio 0.11 CPU Power Consumption Monitor 200 400 600 800 1000
OSPRay Studio CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max AVX-512 On 2400 2931 3701 AVX-512 Off 2705 3001 3951 OpenBenchmarking.org Megahertz, More Is Better OSPRay Studio 0.11 CPU Peak Freq (Highest CPU Core Frequency) Monitor 1000 2000 3000 4000 5000
OSPRay Studio CPU Temperature Monitor Min Avg Max AVX-512 On 45.3 59.8 64.9 AVX-512 Off 47.5 59.9 64.1 OpenBenchmarking.org Celsius, Fewer Is Better OSPRay Studio 0.11 CPU Temperature Monitor 20 40 60 80 100
OSPRay Studio CPU Power Consumption Monitor Min Avg Max AVX-512 On 60 616 683 AVX-512 Off 224 609 700 OpenBenchmarking.org Watts, Fewer Is Better OSPRay Studio 0.11 CPU Power Consumption Monitor 200 400 600 800 1000
OSPRay Studio CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max AVX-512 On 2400 2907 3700 AVX-512 Off 2726 3007 4349 OpenBenchmarking.org Megahertz, More Is Better OSPRay Studio 0.11 CPU Peak Freq (Highest CPU Core Frequency) Monitor 1100 2200 3300 4400 5500
OSPRay Studio CPU Temperature Monitor Min Avg Max AVX-512 On 43.5 59.7 64.0 AVX-512 Off 46.1 61.6 65.4 OpenBenchmarking.org Celsius, Fewer Is Better OSPRay Studio 0.11 CPU Temperature Monitor 20 40 60 80 100
OSPRay Studio CPU Power Consumption Monitor Min Avg Max AVX-512 On 57 616 688 AVX-512 Off 114 635 701 OpenBenchmarking.org Watts, Fewer Is Better OSPRay Studio 0.11 CPU Power Consumption Monitor 200 400 600 800 1000
OSPRay Studio CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max AVX-512 On 2400 2906 3696 AVX-512 Off 2721 2960 3862 OpenBenchmarking.org Megahertz, More Is Better OSPRay Studio 0.11 CPU Peak Freq (Highest CPU Core Frequency) Monitor 1000 2000 3000 4000 5000
OSPRay Studio CPU Temperature Monitor Min Avg Max AVX-512 On 44.4 57.0 61.4 AVX-512 Off 46.6 59.9 64.0 OpenBenchmarking.org Celsius, Fewer Is Better OSPRay Studio 0.11 CPU Temperature Monitor 20 40 60 80 100
OSPRay Studio CPU Power Consumption Monitor Min Avg Max AVX-512 On 55 578 672 AVX-512 Off 223 609 696 OpenBenchmarking.org Watts, Fewer Is Better OSPRay Studio 0.11 CPU Power Consumption Monitor 200 400 600 800 1000
OSPRay Studio CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max AVX-512 On 2400 2868 3857 AVX-512 Off 2712 3004 3940 OpenBenchmarking.org Megahertz, More Is Better OSPRay Studio 0.11 CPU Peak Freq (Highest CPU Core Frequency) Monitor 1000 2000 3000 4000 5000
OSPRay Studio CPU Temperature Monitor Min Avg Max AVX-512 On 43.8 58.9 63.1 AVX-512 Off 46.6 61.3 65.8 OpenBenchmarking.org Celsius, Fewer Is Better OSPRay Studio 0.11 CPU Temperature Monitor 20 40 60 80 100
OSPRay Studio CPU Power Consumption Monitor Min Avg Max AVX-512 On 54 604 686 AVX-512 Off 224 627 702 OpenBenchmarking.org Watts, Fewer Is Better OSPRay Studio 0.11 CPU Power Consumption Monitor 200 400 600 800 1000
OSPRay Studio CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max AVX-512 On 2400 2935 3696 AVX-512 Off 2771 2972 3740 OpenBenchmarking.org Megahertz, More Is Better OSPRay Studio 0.11 CPU Peak Freq (Highest CPU Core Frequency) Monitor 1000 2000 3000 4000 5000
OSPRay Studio CPU Temperature Monitor Min Avg Max AVX-512 On 43.8 58.4 62.6 AVX-512 Off 46.6 60.6 64.9 OpenBenchmarking.org Celsius, Fewer Is Better OSPRay Studio 0.11 CPU Temperature Monitor 20 40 60 80 100
OSPRay Studio CPU Power Consumption Monitor Min Avg Max AVX-512 On 29 599 684 AVX-512 Off 116 621 701 OpenBenchmarking.org Watts, Fewer Is Better OSPRay Studio 0.11 CPU Power Consumption Monitor 200 400 600 800 1000
OSPRay Studio CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max AVX-512 On 2400 2922 3700 AVX-512 Off 2783 2993 3739 OpenBenchmarking.org Megahertz, More Is Better OSPRay Studio 0.11 CPU Peak Freq (Highest CPU Core Frequency) Monitor 1000 2000 3000 4000 5000
OSPRay Studio CPU Temperature Monitor Min Avg Max AVX-512 On 44.9 57.7 61.8 AVX-512 Off 47.0 59.9 64.0 OpenBenchmarking.org Celsius, Fewer Is Better OSPRay Studio 0.11 CPU Temperature Monitor 20 40 60 80 100
OSPRay Studio CPU Power Consumption Monitor Min Avg Max AVX-512 On 59 591 670 AVX-512 Off 203 613 697 OpenBenchmarking.org Watts, Fewer Is Better OSPRay Studio 0.11 CPU Power Consumption Monitor 200 400 600 800 1000
OSPRay Studio CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max AVX-512 On 2400 2859 3697 AVX-512 Off 2702 2995 3808 OpenBenchmarking.org Megahertz, More Is Better OSPRay Studio 0.11 CPU Peak Freq (Highest CPU Core Frequency) Monitor 1000 2000 3000 4000 5000
OSPRay Studio CPU Temperature Monitor Min Avg Max AVX-512 On 44.9 60.3 65.4 AVX-512 Off 47.5 60.3 66.3 OpenBenchmarking.org Celsius, Fewer Is Better OSPRay Studio 0.11 CPU Temperature Monitor 20 40 60 80 100
OSPRay Studio CPU Power Consumption Monitor Min Avg Max AVX-512 On 58 623 687 AVX-512 Off 128 610 701 OpenBenchmarking.org Watts, Fewer Is Better OSPRay Studio 0.11 CPU Power Consumption Monitor 200 400 600 800 1000
OSPRay Studio CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max AVX-512 On 2400 2876 3752 AVX-512 Off 2769 2989 3982 OpenBenchmarking.org Megahertz, More Is Better OSPRay Studio 0.11 CPU Peak Freq (Highest CPU Core Frequency) Monitor 1100 2200 3300 4400 5500
OSPRay Studio CPU Temperature Monitor Min Avg Max AVX-512 On 43.8 59.7 64.9 AVX-512 Off 46.6 62.0 65.4 OpenBenchmarking.org Celsius, Fewer Is Better OSPRay Studio 0.11 CPU Temperature Monitor 20 40 60 80 100
OSPRay Studio CPU Power Consumption Monitor Min Avg Max AVX-512 On 56 618 684 AVX-512 Off 223 638 703 OpenBenchmarking.org Watts, Fewer Is Better OSPRay Studio 0.11 CPU Power Consumption Monitor 200 400 600 800 1000
OSPRay Studio CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max AVX-512 On 2400 2888 3699 AVX-512 Off 2709 2937 3983 OpenBenchmarking.org Megahertz, More Is Better OSPRay Studio 0.11 CPU Peak Freq (Highest CPU Core Frequency) Monitor 1100 2200 3300 4400 5500
OSPRay Studio CPU Temperature Monitor Min Avg Max AVX-512 On 44.1 57.9 62.3 AVX-512 Off 48.0 60.2 64.0 OpenBenchmarking.org Celsius, Fewer Is Better OSPRay Studio 0.11 CPU Temperature Monitor 20 40 60 80 100
OSPRay Studio CPU Power Consumption Monitor Min Avg Max AVX-512 On 51 590 687 AVX-512 Off 225 610 697 OpenBenchmarking.org Watts, Fewer Is Better OSPRay Studio 0.11 CPU Power Consumption Monitor 200 400 600 800 1000
OSPRay Studio CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max AVX-512 On 2400 2950 3701 AVX-512 Off 2696 3001 3902 OpenBenchmarking.org Megahertz, More Is Better OSPRay Studio 0.11 CPU Peak Freq (Highest CPU Core Frequency) Monitor 1000 2000 3000 4000 5000
OSPRay Studio CPU Temperature Monitor Min Avg Max AVX-512 On 44.0 59.0 64.0 AVX-512 Off 46.6 61.3 68.0 OpenBenchmarking.org Celsius, Fewer Is Better OSPRay Studio 0.11 CPU Temperature Monitor 20 40 60 80 100
OSPRay Studio CPU Power Consumption Monitor Min Avg Max AVX-512 On 58 606 687 AVX-512 Off 222 629 702 OpenBenchmarking.org Watts, Fewer Is Better OSPRay Studio 0.11 CPU Power Consumption Monitor 200 400 600 800 1000
OSPRay Studio CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max AVX-512 On 2400 2904 3702 AVX-512 Off 2802 2978 4050 OpenBenchmarking.org Megahertz, More Is Better OSPRay Studio 0.11 CPU Peak Freq (Highest CPU Core Frequency) Monitor 1100 2200 3300 4400 5500
OSPRay Studio CPU Temperature Monitor Min Avg Max AVX-512 On 43.5 58.4 65.0 AVX-512 Off 46.6 60.7 64.9 OpenBenchmarking.org Celsius, Fewer Is Better OSPRay Studio 0.11 CPU Temperature Monitor 20 40 60 80 100
OSPRay Studio CPU Power Consumption Monitor Min Avg Max AVX-512 On 56 599 685 AVX-512 Off 223 622 699 OpenBenchmarking.org Watts, Fewer Is Better OSPRay Studio 0.11 CPU Power Consumption Monitor 200 400 600 800 1000
OSPRay Studio CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max AVX-512 On 2400 2930 3699 AVX-512 Off 2696 2979 4041 OpenBenchmarking.org Megahertz, More Is Better OSPRay Studio 0.11 CPU Peak Freq (Highest CPU Core Frequency) Monitor 1100 2200 3300 4400 5500
OSPRay Studio CPU Temperature Monitor Min Avg Max AVX-512 On 36.4 56.3 62.3 AVX-512 Off 41.8 58.9 64.5 OpenBenchmarking.org Celsius, Fewer Is Better OSPRay Studio 0.11 CPU Temperature Monitor 20 40 60 80 100
OSPRay Studio CPU Power Consumption Monitor Min Avg Max AVX-512 On 55 593 680 AVX-512 Off 218 614 692 OpenBenchmarking.org Watts, Fewer Is Better OSPRay Studio 0.11 CPU Power Consumption Monitor 200 400 600 800 1000
OSPRay Studio CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max AVX-512 On 2400 2939 3695 AVX-512 Off 2708 2997 3911 OpenBenchmarking.org Megahertz, More Is Better OSPRay Studio 0.11 CPU Peak Freq (Highest CPU Core Frequency) Monitor 1000 2000 3000 4000 5000
OSPRay CPU Temperature Monitor Min Avg Max AVX-512 On 42.9 57.8 60.9 AVX-512 Off 47.5 61.3 64.9 OpenBenchmarking.org Celsius, Fewer Is Better OSPRay 2.10 CPU Temperature Monitor 20 40 60 80 100
OSPRay CPU Power Consumption Monitor Min Avg Max AVX-512 On 58 593 646 AVX-512 Off 221 628 677 OpenBenchmarking.org Watts, Fewer Is Better OSPRay 2.10 CPU Power Consumption Monitor 200 400 600 800 1000
OSPRay CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max AVX-512 On 2400 3055 3720 AVX-512 Off 2766 3104 4475 OpenBenchmarking.org Megahertz, More Is Better OSPRay 2.10 CPU Peak Freq (Highest CPU Core Frequency) Monitor 1200 2400 3600 4800 6000
OSPRay Benchmark: gravity_spheres_volume/dim_512/pathtracer/real_time OpenBenchmarking.org Items Per Second Per Watt, More Is Better OSPRay 2.10 Benchmark: gravity_spheres_volume/dim_512/pathtracer/real_time AVX-512 On AVX-512 Off 0.0205 0.041 0.0615 0.082 0.1025 0.091 0.065
OSPRay CPU Temperature Monitor Min Avg Max AVX-512 On 41.8 56.8 60.4 AVX-512 Off 48.4 60.3 63.5 OpenBenchmarking.org Celsius, Fewer Is Better OSPRay 2.10 CPU Temperature Monitor 20 40 60 80 100
OSPRay CPU Power Consumption Monitor Min Avg Max AVX-512 On 56 582 632 AVX-512 Off 177 620 662 OpenBenchmarking.org Watts, Fewer Is Better OSPRay 2.10 CPU Power Consumption Monitor 200 400 600 800 1000
OSPRay CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max AVX-512 On 2400 3051 3695 AVX-512 Off 2768 3083 4016 OpenBenchmarking.org Megahertz, More Is Better OSPRay 2.10 CPU Peak Freq (Highest CPU Core Frequency) Monitor 1100 2200 3300 4400 5500
OSPRay Benchmark: gravity_spheres_volume/dim_512/scivis/real_time OpenBenchmarking.org Items Per Second Per Watt, More Is Better OSPRay 2.10 Benchmark: gravity_spheres_volume/dim_512/scivis/real_time AVX-512 On AVX-512 Off 0.0167 0.0334 0.0501 0.0668 0.0835 0.074 0.041
OSPRay CPU Temperature Monitor Min Avg Max AVX-512 On 39.9 56.2 59.5 AVX-512 Off 45.3 59.8 65.0 OpenBenchmarking.org Celsius, Fewer Is Better OSPRay 2.10 CPU Temperature Monitor 20 40 60 80 100
OSPRay CPU Power Consumption Monitor Min Avg Max AVX-512 On 56 580 633 AVX-512 Off 222 618 662 OpenBenchmarking.org Watts, Fewer Is Better OSPRay 2.10 CPU Power Consumption Monitor 200 400 600 800 1000
OSPRay CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max AVX-512 On 2400 3081 3695 AVX-512 Off 2771 3073 4018 OpenBenchmarking.org Megahertz, More Is Better OSPRay 2.10 CPU Peak Freq (Highest CPU Core Frequency) Monitor 1100 2200 3300 4400 5500
OSPRay Benchmark: gravity_spheres_volume/dim_512/ao/real_time OpenBenchmarking.org Items Per Second Per Watt, More Is Better OSPRay 2.10 Benchmark: gravity_spheres_volume/dim_512/ao/real_time AVX-512 On AVX-512 Off 0.0171 0.0342 0.0513 0.0684 0.0855 0.076 0.043
OpenVKL CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better OpenVKL 1.3.1 CPU Temperature Monitor AVX-512 On AVX-512 Off 12 24 36 48 60 Min: 41.25 / Avg: 49.91 / Max: 58.25 Min: 42.63 / Avg: 52.24 / Max: 60.88
OpenVKL CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better OpenVKL 1.3.1 CPU Power Consumption Monitor AVX-512 On AVX-512 Off 120 240 360 480 600 Min: 55.92 / Avg: 466.92 / Max: 669.54 Min: 113.56 / Avg: 490.53 / Max: 691.71
OpenVKL CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better OpenVKL 1.3.1 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 On AVX-512 Off 700 1400 2100 2800 3500 Min: 2400 / Avg: 3408.84 / Max: 3732 Min: 2621 / Avg: 3373.13 / Max: 4085
OpenVKL Benchmark: vklBenchmark ISPC OpenBenchmarking.org Items / Sec Per Watt, More Is Better OpenVKL 1.3.1 Benchmark: vklBenchmark ISPC AVX-512 On AVX-512 Off 0.6419 1.2838 1.9257 2.5676 3.2095 2.853 2.355
Embree CPU Temperature Monitor Min Avg Max AVX-512 On 33.3 40.5 48.0 AVX-512 Off 39.5 45.8 52.0 OpenBenchmarking.org Celsius, Fewer Is Better Embree 3.13 CPU Temperature Monitor 15 30 45 60 75
Embree CPU Power Consumption Monitor Min Avg Max AVX-512 On 54 346 646 AVX-512 Off 174 439 660 OpenBenchmarking.org Watts, Fewer Is Better Embree 3.13 CPU Power Consumption Monitor 200 400 600 800 1000
Embree CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max AVX-512 On 2400 2928 3696 AVX-512 Off 2726 3446 5379 OpenBenchmarking.org Megahertz, More Is Better Embree 3.13 CPU Peak Freq (Highest CPU Core Frequency) Monitor 1400 2800 4200 5600 7000
Embree Binary: Pathtracer ISPC - Model: Crown OpenBenchmarking.org Frames Per Second Per Watt, More Is Better Embree 3.13 Binary: Pathtracer ISPC - Model: Crown AVX-512 On AVX-512 Off 0.1179 0.2358 0.3537 0.4716 0.5895 0.524 0.344
Embree CPU Temperature Monitor Min Avg Max AVX-512 On 34.6 38.4 46.6 AVX-512 Off 39.9 42.4 49.3 OpenBenchmarking.org Celsius, Fewer Is Better Embree 3.13 CPU Temperature Monitor 14 28 42 56 70
Embree CPU Power Consumption Monitor Min Avg Max AVX-512 On 56 254 632 AVX-512 Off 217 319 632 OpenBenchmarking.org Watts, Fewer Is Better Embree 3.13 CPU Power Consumption Monitor 200 400 600 800 1000
Embree CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max AVX-512 On 2400 3372 3699 AVX-512 Off 2889 3592 4020 OpenBenchmarking.org Megahertz, More Is Better Embree 3.13 CPU Peak Freq (Highest CPU Core Frequency) Monitor 1100 2200 3300 4400 5500
Embree Binary: Pathtracer ISPC - Model: Asian Dragon Obj OpenBenchmarking.org Frames Per Second Per Watt, More Is Better Embree 3.13 Binary: Pathtracer ISPC - Model: Asian Dragon Obj AVX-512 On AVX-512 Off 0.1631 0.3262 0.4893 0.6524 0.8155 0.725 0.481
Embree CPU Temperature Monitor Min Avg Max AVX-512 On 35.5 40.4 47.0 AVX-512 Off 41.8 45.8 51.1 OpenBenchmarking.org Celsius, Fewer Is Better Embree 3.13 CPU Temperature Monitor 15 30 45 60 75
Embree CPU Power Consumption Monitor Min Avg Max AVX-512 On 50 301 635 AVX-512 Off 132 410 637 OpenBenchmarking.org Watts, Fewer Is Better Embree 3.13 CPU Power Consumption Monitor 200 400 600 800 1000
Embree CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max AVX-512 On 2400 2974 3695 AVX-512 Off 2899 3508 4437 OpenBenchmarking.org Megahertz, More Is Better Embree 3.13 CPU Peak Freq (Highest CPU Core Frequency) Monitor 1200 2400 3600 4800 6000
Embree Binary: Pathtracer ISPC - Model: Asian Dragon OpenBenchmarking.org Frames Per Second Per Watt, More Is Better Embree 3.13 Binary: Pathtracer ISPC - Model: Asian Dragon AVX-512 On AVX-512 Off 0.1591 0.3182 0.4773 0.6364 0.7955 0.707 0.431
LeelaChessZero CPU Temperature Monitor Min Avg Max AVX-512 On 32.4 53.4 61.0 AVX-512 Off 37.3 39.9 56.9 OpenBenchmarking.org Celsius, Fewer Is Better LeelaChessZero 0.28 CPU Temperature Monitor 20 40 60 80 100
LeelaChessZero CPU Power Consumption Monitor Min Avg Max AVX-512 On 56.3 365.4 500.1 AVX-512 Off 112.5 383.3 519.6 OpenBenchmarking.org Watts, Fewer Is Better LeelaChessZero 0.28 CPU Power Consumption Monitor 130 260 390 520 650
LeelaChessZero CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max AVX-512 On 2400 3685 4074 AVX-512 Off 3694 3699 4052 OpenBenchmarking.org Megahertz, More Is Better LeelaChessZero 0.28 CPU Peak Freq (Highest CPU Core Frequency) Monitor 1100 2200 3300 4400 5500
LeelaChessZero Backend: Eigen OpenBenchmarking.org Nodes Per Second Per Watt, More Is Better LeelaChessZero 0.28 Backend: Eigen AVX-512 On AVX-512 Off 6 12 18 24 30 24.89 21.29
LeelaChessZero CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better LeelaChessZero 0.28 CPU Temperature Monitor AVX-512 On AVX-512 Off 13 26 39 52 65 Min: 36.75 / Avg: 51.98 / Max: 63.13 Min: 47.5 / Avg: 57.42 / Max: 64.5
LeelaChessZero CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better LeelaChessZero 0.28 CPU Power Consumption Monitor AVX-512 On AVX-512 Off 90 180 270 360 450 Min: 55.6 / Avg: 381.67 / Max: 513.97 Min: 153.23 / Avg: 384.04 / Max: 522.79
LeelaChessZero CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better LeelaChessZero 0.28 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 On AVX-512 Off 900 1800 2700 3600 4500 Min: 2400 / Avg: 3683.95 / Max: 3952 Min: 3383 / Avg: 3700.34 / Max: 4961
LeelaChessZero Backend: BLAS OpenBenchmarking.org Nodes Per Second Per Watt, More Is Better LeelaChessZero 0.28 Backend: BLAS AVX-512 On AVX-512 Off 6 12 18 24 30 23.78 21.93
TensorFlow CPU Temperature Monitor Min Avg Max AVX-512 On 34.6 41.7 48.9 AVX-512 Off 38.6 40.5 50.4 OpenBenchmarking.org Celsius, Fewer Is Better TensorFlow 2.10 CPU Temperature Monitor 14 28 42 56 70
TensorFlow CPU Power Consumption Monitor Min Avg Max AVX-512 On 53.1 308.0 379.5 AVX-512 Off 156.1 298.9 329.3 OpenBenchmarking.org Watts, Fewer Is Better TensorFlow 2.10 CPU Power Consumption Monitor 100 200 300 400 500
TensorFlow CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max AVX-512 On 2400 3586 4161 AVX-512 Off 3694 3727 4474 OpenBenchmarking.org Megahertz, More Is Better TensorFlow 2.10 CPU Peak Freq (Highest CPU Core Frequency) Monitor 1200 2400 3600 4800 6000
TensorFlow Device: CPU - Batch Size: 16 - Model: GoogLeNet OpenBenchmarking.org images/sec Per Watt, More Is Better TensorFlow 2.10 Device: CPU - Batch Size: 16 - Model: GoogLeNet AVX-512 On AVX-512 Off 0.0439 0.0878 0.1317 0.1756 0.2195 0.195 0.104
TensorFlow CPU Temperature Monitor Min Avg Max AVX-512 On 35.0 40.5 48.9 AVX-512 Off 39.0 41.0 47.5 OpenBenchmarking.org Celsius, Fewer Is Better TensorFlow 2.10 CPU Temperature Monitor 14 28 42 56 70
TensorFlow CPU Power Consumption Monitor Min Avg Max AVX-512 On 48.9 299.7 409.2 AVX-512 Off 169.7 318.9 350.5 OpenBenchmarking.org Watts, Fewer Is Better TensorFlow 2.10 CPU Power Consumption Monitor 110 220 330 440 550
TensorFlow CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max AVX-512 On 2400 3458 3812 AVX-512 Off 3694 3732 4340 OpenBenchmarking.org Megahertz, More Is Better TensorFlow 2.10 CPU Peak Freq (Highest CPU Core Frequency) Monitor 1100 2200 3300 4400 5500
TensorFlow Device: CPU - Batch Size: 16 - Model: AlexNet OpenBenchmarking.org images/sec Per Watt, More Is Better TensorFlow 2.10 Device: CPU - Batch Size: 16 - Model: AlexNet AVX-512 On AVX-512 Off 0.1181 0.2362 0.3543 0.4724 0.5905 0.525 0.173
TensorFlow CPU Temperature Monitor Min Avg Max AVX-512 On 36.8 41.7 48.6 AVX-512 Off 40.9 43.4 53.5 OpenBenchmarking.org Celsius, Fewer Is Better TensorFlow 2.10 CPU Temperature Monitor 15 30 45 60 75
TensorFlow CPU Power Consumption Monitor Min Avg Max AVX-512 On 53.5 307.1 397.4 AVX-512 Off 165.7 338.8 379.7 OpenBenchmarking.org Watts, Fewer Is Better TensorFlow 2.10 CPU Power Consumption Monitor 110 220 330 440 550
TensorFlow CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max AVX-512 On 2400 3664 4099 AVX-512 Off 3694 3713 4254 OpenBenchmarking.org Megahertz, More Is Better TensorFlow 2.10 CPU Peak Freq (Highest CPU Core Frequency) Monitor 1100 2200 3300 4400 5500
TensorFlow Device: CPU - Batch Size: 16 - Model: ResNet-50 OpenBenchmarking.org images/sec Per Watt, More Is Better TensorFlow 2.10 Device: CPU - Batch Size: 16 - Model: ResNet-50 AVX-512 On AVX-512 Off 0.0162 0.0324 0.0486 0.0648 0.081 0.072 0.038
Neural Magic DeepSparse CPU Temperature Monitor Min Avg Max AVX-512 On 40.6 48.7 54.3 AVX-512 Off 43.5 50.7 56.9 OpenBenchmarking.org Celsius, Fewer Is Better Neural Magic DeepSparse 1.1 CPU Temperature Monitor 16 32 48 64 80
Neural Magic DeepSparse CPU Power Consumption Monitor Min Avg Max AVX-512 On 30.2 328.4 418.5 AVX-512 Off 210.0 351.1 423.9 OpenBenchmarking.org Watts, Fewer Is Better Neural Magic DeepSparse 1.1 CPU Power Consumption Monitor 110 220 330 440 550
Neural Magic DeepSparse CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max AVX-512 On 2400 3533 3703 AVX-512 Off 3089 3679 4336 OpenBenchmarking.org Megahertz, More Is Better Neural Magic DeepSparse 1.1 CPU Peak Freq (Highest CPU Core Frequency) Monitor 1100 2200 3300 4400 5500
Neural Magic DeepSparse CPU Temperature Monitor Min Avg Max AVX-512 On 40.1 52.9 57.9 AVX-512 Off 44.9 54.4 61.8 OpenBenchmarking.org Celsius, Fewer Is Better Neural Magic DeepSparse 1.1 CPU Temperature Monitor 20 40 60 80 100
Neural Magic DeepSparse CPU Power Consumption Monitor Min Avg Max AVX-512 On 28 553 664 AVX-512 Off 217 552 656 OpenBenchmarking.org Watts, Fewer Is Better Neural Magic DeepSparse 1.1 CPU Power Consumption Monitor 200 400 600 800 1000
Neural Magic DeepSparse CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max AVX-512 On 2400 2879 3730 AVX-512 Off 2535 2908 3834 OpenBenchmarking.org Megahertz, More Is Better Neural Magic DeepSparse 1.1 CPU Peak Freq (Highest CPU Core Frequency) Monitor 1000 2000 3000 4000 5000
Neural Magic DeepSparse CPU Temperature Monitor Min Avg Max AVX-512 On 39.8 50.1 54.6 AVX-512 Off 44.4 52.1 55.6 OpenBenchmarking.org Celsius, Fewer Is Better Neural Magic DeepSparse 1.1 CPU Temperature Monitor 15 30 45 60 75
Neural Magic DeepSparse CPU Power Consumption Monitor Min Avg Max AVX-512 On 52.3 341.3 408.7 AVX-512 Off 202.0 364.8 414.2 OpenBenchmarking.org Watts, Fewer Is Better Neural Magic DeepSparse 1.1 CPU Power Consumption Monitor 110 220 330 440 550
Neural Magic DeepSparse CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max AVX-512 On 2400 3527 3821 AVX-512 Off 3068 3641 4426 OpenBenchmarking.org Megahertz, More Is Better Neural Magic DeepSparse 1.1 CPU Peak Freq (Highest CPU Core Frequency) Monitor 1100 2200 3300 4400 5500
Neural Magic DeepSparse CPU Temperature Monitor Min Avg Max AVX-512 On 39.3 51.9 58.3 AVX-512 Off 43.5 51.5 59.1 OpenBenchmarking.org Celsius, Fewer Is Better Neural Magic DeepSparse 1.1 CPU Temperature Monitor 16 32 48 64 80
Neural Magic DeepSparse CPU Power Consumption Monitor Min Avg Max AVX-512 On 54 537 700 AVX-512 Off 114 503 700 OpenBenchmarking.org Watts, Fewer Is Better Neural Magic DeepSparse 1.1 CPU Power Consumption Monitor 200 400 600 800 1000
Neural Magic DeepSparse CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max AVX-512 On 2400 2945 3885 AVX-512 Off 2568 3214 4450 OpenBenchmarking.org Megahertz, More Is Better Neural Magic DeepSparse 1.1 CPU Peak Freq (Highest CPU Core Frequency) Monitor 1200 2400 3600 4800 6000
Neural Magic DeepSparse CPU Temperature Monitor Min Avg Max AVX-512 On 38.1 48.5 54.8 AVX-512 Off 43.0 50.6 56.9 OpenBenchmarking.org Celsius, Fewer Is Better Neural Magic DeepSparse 1.1 CPU Temperature Monitor 16 32 48 64 80
Neural Magic DeepSparse CPU Power Consumption Monitor Min Avg Max AVX-512 On 57.7 334.2 406.1 AVX-512 Off 124.0 352.9 412.6 OpenBenchmarking.org Watts, Fewer Is Better Neural Magic DeepSparse 1.1 CPU Power Consumption Monitor 110 220 330 440 550
Neural Magic DeepSparse CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max AVX-512 On 2400 3571 3764 AVX-512 Off 3678 3702 4150 OpenBenchmarking.org Megahertz, More Is Better Neural Magic DeepSparse 1.1 CPU Peak Freq (Highest CPU Core Frequency) Monitor 1100 2200 3300 4400 5500
Neural Magic DeepSparse CPU Temperature Monitor Min Avg Max AVX-512 On 38.9 47.8 53.8 AVX-512 Off 43.9 50.7 55.5 OpenBenchmarking.org Celsius, Fewer Is Better Neural Magic DeepSparse 1.1 CPU Temperature Monitor 15 30 45 60 75
Neural Magic DeepSparse CPU Power Consumption Monitor Min Avg Max AVX-512 On 49.8 321.8 419.4 AVX-512 Off 110.4 350.8 422.9 OpenBenchmarking.org Watts, Fewer Is Better Neural Magic DeepSparse 1.1 CPU Power Consumption Monitor 110 220 330 440 550
Neural Magic DeepSparse CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max AVX-512 On 2400 3551 3868 AVX-512 Off 3686 3711 4893 OpenBenchmarking.org Megahertz, More Is Better Neural Magic DeepSparse 1.1 CPU Peak Freq (Highest CPU Core Frequency) Monitor 1200 2400 3600 4800 6000
Neural Magic DeepSparse CPU Temperature Monitor Min Avg Max AVX-512 On 38.1 51.9 57.3 AVX-512 Off 44.4 54.9 59.1 OpenBenchmarking.org Celsius, Fewer Is Better Neural Magic DeepSparse 1.1 CPU Temperature Monitor 16 32 48 64 80
Neural Magic DeepSparse CPU Power Consumption Monitor Min Avg Max AVX-512 On 56 531 630 AVX-512 Off 216 558 637 OpenBenchmarking.org Watts, Fewer Is Better Neural Magic DeepSparse 1.1 CPU Power Consumption Monitor 200 400 600 800 1000
Neural Magic DeepSparse CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max AVX-512 On 2400 3003 3730 AVX-512 Off 2552 2938 3959 OpenBenchmarking.org Megahertz, More Is Better Neural Magic DeepSparse 1.1 CPU Peak Freq (Highest CPU Core Frequency) Monitor 1000 2000 3000 4000 5000
Neural Magic DeepSparse CPU Temperature Monitor Min Avg Max AVX-512 On 39.9 51.2 55.5 AVX-512 Off 43.9 54.4 59.1 OpenBenchmarking.org Celsius, Fewer Is Better Neural Magic DeepSparse 1.1 CPU Temperature Monitor 16 32 48 64 80
Neural Magic DeepSparse CPU Power Consumption Monitor Min Avg Max AVX-512 On 49 517 625 AVX-512 Off 217 552 659 OpenBenchmarking.org Watts, Fewer Is Better Neural Magic DeepSparse 1.1 CPU Power Consumption Monitor 200 400 600 800 1000
Neural Magic DeepSparse CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max AVX-512 On 2400 2868 3737 AVX-512 Off 2623 2987 4137 OpenBenchmarking.org Megahertz, More Is Better Neural Magic DeepSparse 1.1 CPU Peak Freq (Highest CPU Core Frequency) Monitor 1100 2200 3300 4400 5500
Neural Magic DeepSparse CPU Temperature Monitor Min Avg Max AVX-512 On 39.0 48.0 52.4 AVX-512 Off 43.0 50.5 54.3 OpenBenchmarking.org Celsius, Fewer Is Better Neural Magic DeepSparse 1.1 CPU Temperature Monitor 15 30 45 60 75
Neural Magic DeepSparse CPU Power Consumption Monitor Min Avg Max AVX-512 On 37.8 324.6 394.5 AVX-512 Off 197.4 352.2 401.6 OpenBenchmarking.org Watts, Fewer Is Better Neural Magic DeepSparse 1.1 CPU Power Consumption Monitor 110 220 330 440 550
Neural Magic DeepSparse CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max AVX-512 On 2400 3541 3702 AVX-512 Off 3692 3712 4154 OpenBenchmarking.org Megahertz, More Is Better Neural Magic DeepSparse 1.1 CPU Peak Freq (Highest CPU Core Frequency) Monitor 1100 2200 3300 4400 5500
Neural Magic DeepSparse CPU Temperature Monitor Min Avg Max AVX-512 On 38.6 49.4 57.0 AVX-512 Off 41.8 51.5 60.0 OpenBenchmarking.org Celsius, Fewer Is Better Neural Magic DeepSparse 1.1 CPU Temperature Monitor 16 32 48 64 80
Neural Magic DeepSparse CPU Power Consumption Monitor Min Avg Max AVX-512 On 53 479 679 AVX-512 Off 216 508 705 OpenBenchmarking.org Watts, Fewer Is Better Neural Magic DeepSparse 1.1 CPU Power Consumption Monitor 200 400 600 800 1000
Neural Magic DeepSparse CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max AVX-512 On 2400 3109 3928 AVX-512 Off 2589 3135 4299 OpenBenchmarking.org Megahertz, More Is Better Neural Magic DeepSparse 1.1 CPU Peak Freq (Highest CPU Core Frequency) Monitor 1100 2200 3300 4400 5500
Neural Magic DeepSparse CPU Temperature Monitor Min Avg Max AVX-512 On 32.4 43.7 51.5 AVX-512 Off 36.8 45.2 52.4 OpenBenchmarking.org Celsius, Fewer Is Better Neural Magic DeepSparse 1.1 CPU Temperature Monitor 15 30 45 60 75
Neural Magic DeepSparse CPU Power Consumption Monitor Min Avg Max AVX-512 On 50.9 306.4 407.9 AVX-512 Off 111.5 321.8 409.9 OpenBenchmarking.org Watts, Fewer Is Better Neural Magic DeepSparse 1.1 CPU Power Consumption Monitor 110 220 330 440 550
Neural Magic DeepSparse CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max AVX-512 On 2400 3559 3801 AVX-512 Off 3507 3698 3967 OpenBenchmarking.org Megahertz, More Is Better Neural Magic DeepSparse 1.1 CPU Peak Freq (Highest CPU Core Frequency) Monitor 1100 2200 3300 4400 5500
AI Benchmark Alpha CPU Temperature Monitor Min Avg Max AVX-512 On 30.1 39.2 47.0 AVX-512 Off 36.4 40.6 49.3 OpenBenchmarking.org Celsius, Fewer Is Better AI Benchmark Alpha 0.1.2 CPU Temperature Monitor 14 28 42 56 70
AI Benchmark Alpha CPU Power Consumption Monitor Min Avg Max AVX-512 On 52.9 302.7 502.0 AVX-512 Off 130.7 308.8 452.7 OpenBenchmarking.org Watts, Fewer Is Better AI Benchmark Alpha 0.1.2 CPU Power Consumption Monitor 130 260 390 520 650
AI Benchmark Alpha CPU Peak Freq (Highest CPU Core Frequency) Monitor Min Avg Max AVX-512 On 2400 3655 4107 AVX-512 Off 3068 3710 4285 OpenBenchmarking.org Megahertz, More Is Better AI Benchmark Alpha 0.1.2 CPU Peak Freq (Highest CPU Core Frequency) Monitor 1100 2200 3300 4400 5500
AI Benchmark Alpha Device AI Score OpenBenchmarking.org Score Per Watt, More Is Better AI Benchmark Alpha 0.1.2 Device AI Score AVX-512 On AVX-512 Off 5 10 15 20 25 20.522 9.349
Phoronix Test Suite v10.8.4