AVX-512 Core i9 Intel Rocket Lake Benchmarks for a future article. Intel Core i9-11900K testing with a ASUS ROG MAXIMUS XIII HERO (1402 BIOS) and ASUS Intel RKL GT1 31GB on Ubuntu 22.10 via the Phoronix Test Suite.
HTML result view exported from: https://openbenchmarking.org/result/2210210-NE-AVX512ROC09&grt&sor&rro .
Processor Motherboard Chipset Memory Disk Graphics Audio Monitor Network OS Kernel Desktop Display Server OpenGL Vulkan Compiler File-System Screen Resolution i9-11900K AVX-512 On AVX-512 Off AVX-512 On 512 Intel Core i9-11900K @ 5.10GHz (8 Cores / 16 Threads) ASUS ROG MAXIMUS XIII HERO (1402 BIOS) Intel Tiger Lake-H 32GB 2000GB Corsair Force MP600 + 32GB Flash Drive ASUS Intel RKL GT1 31GB (1300MHz) Intel Tiger Lake-H HD Audio ASUS MG28U 2 x Intel I225-V + Intel Wi-Fi 6 AX210/AX211/AX411 Ubuntu 22.10 5.19.0-21-generic (x86_64) GNOME Shell 43.0 X Server + Wayland 4.6 Mesa 22.2.1 1.3.224 GCC 12.2.0 ext4 3840x2160 OpenBenchmarking.org Kernel Details - Transparent Huge Pages: madvise Environment Details - i9-11900K: AVX-512 On: CXXFLAGS="-O3 -march=native" CFLAGS="-O3 -march=native" - i9-11900K: AVX-512 Off: CXXFLAGS="-O3 -march=native -mno-avx512f" CFLAGS="-O3 -march=native -mno-avx512f" - i9-11900K: AVX-512 On 512: CXXFLAGS="-O3 -march=native -mprefer-vector-width=512" CFLAGS="-O3 -march=native -mprefer-vector-width=512" Compiler Details - --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-defaulted --enable-offload-targets=nvptx-none=/build/gcc-12-U8K4Qv/gcc-12-12.2.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-12-U8K4Qv/gcc-12-12.2.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v Processor Details - Scaling Governor: intel_pstate performance (EPP: performance) - CPU Microcode: 0x54 - Thermald 2.5.1 Python Details - Python 3.10.7 Security Details - itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Mitigation of Clear buffers; SMT vulnerable + retbleed: Mitigation of Enhanced IBRS + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Not affected
ai-benchmark: Device Inference Score ai-benchmark: Device Training Score ai-benchmark: Device AI Score cpuminer-opt: Triple SHA-256, Onecoin cpuminer-opt: Quad SHA-256, Pyrite cpuminer-opt: Myriad-Groestl cpuminer-opt: Magi cpuminer-opt: Blake-2 S cpuminer-opt: x25x cpuminer-opt: Garlicoin cpuminer-opt: Ringcoin cpuminer-opt: Deepcoin cpuminer-opt: Skeincoin cpuminer-opt: LBC, LBRY Credits dav1d: Summer Nature 1080p dav1d: Summer Nature 4K dav1d: Chimera 1080p dav1d: Chimera 1080p 10-bit embree: Pathtracer ISPC - Asian Dragon embree: Pathtracer ISPC - Asian Dragon Obj embree: Pathtracer ISPC - Crown gromacs: MPI CPU - water_GMX50_bare oidn: RT.hdr_alb_nrm.3840x2160 oidn: RT.ldr_alb_nrm.3840x2160 oidn: RTLightmap.hdr.4096x4096 lczero: BLAS lczero: Eigen mnn: nasnet mnn: mobilenetV3 mnn: squeezenetv1.1 mnn: resnet-v2-50 mnn: SqueezeNetV1.0 mnn: MobileNetV2_224 mnn: mobilenet-v1-1.0 mnn: inception-v3 ncnn: CPU - mobilenet ncnn: CPU-v2-v2 - mobilenet-v2 ncnn: CPU-v3-v3 - mobilenet-v3 ncnn: CPU - shufflenet-v2 ncnn: CPU - mnasnet ncnn: CPU - efficientnet-b0 ncnn: CPU - blazeface ncnn: CPU - googlenet ncnn: CPU - vgg16 ncnn: CPU - resnet18 ncnn: CPU - alexnet ncnn: CPU - resnet50 ncnn: CPU - yolov4-tiny ncnn: CPU - squeezenet_ssd ncnn: CPU - regnety_400m ncnn: CPU - vision_transformer ncnn: CPU - FastestDet deepsparse: NLP Text Classification, BERT base uncased SST2 - Synchronous Single-Stream deepsparse: NLP Text Classification, BERT base uncased SST2 - Synchronous Single-Stream deepsparse: NLP Text Classification, BERT base uncased SST2 - Asynchronous Multi-Stream deepsparse: NLP Text Classification, BERT base uncased SST2 - Asynchronous Multi-Stream deepsparse: NLP Text Classification, DistilBERT mnli - Synchronous Single-Stream deepsparse: NLP Text Classification, DistilBERT mnli - Synchronous Single-Stream deepsparse: NLP Text Classification, DistilBERT mnli - Asynchronous Multi-Stream deepsparse: NLP Text Classification, DistilBERT mnli - Asynchronous Multi-Stream deepsparse: CV Classification, ResNet-50 ImageNet - Synchronous Single-Stream deepsparse: CV Classification, ResNet-50 ImageNet - Synchronous Single-Stream deepsparse: CV Classification, ResNet-50 ImageNet - Asynchronous Multi-Stream deepsparse: CV Classification, ResNet-50 ImageNet - Asynchronous Multi-Stream deepsparse: NLP Token Classification, BERT base uncased conll2003 - Synchronous Single-Stream deepsparse: NLP Token Classification, BERT base uncased conll2003 - Synchronous Single-Stream deepsparse: NLP Token Classification, BERT base uncased conll2003 - Asynchronous Multi-Stream deepsparse: NLP Token Classification, BERT base uncased conll2003 - Asynchronous Multi-Stream deepsparse: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Synchronous Single-Stream deepsparse: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Synchronous Single-Stream deepsparse: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Asynchronous Multi-Stream deepsparse: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Asynchronous Multi-Stream deepsparse: CV Detection,YOLOv5s COCO - Synchronous Single-Stream deepsparse: CV Detection,YOLOv5s COCO - Synchronous Single-Stream deepsparse: CV Detection,YOLOv5s COCO - Asynchronous Multi-Stream deepsparse: CV Detection,YOLOv5s COCO - Asynchronous Multi-Stream deepsparse: NLP Document Classification, oBERT base uncased on IMDB - Synchronous Single-Stream deepsparse: NLP Document Classification, oBERT base uncased on IMDB - Synchronous Single-Stream deepsparse: NLP Document Classification, oBERT base uncased on IMDB - Asynchronous Multi-Stream deepsparse: NLP Document Classification, oBERT base uncased on IMDB - Asynchronous Multi-Stream numpy: onednn: Convolution Batch Shapes Auto - f32 - CPU onednn: Convolution Batch Shapes Auto - u8s8f32 - CPU onednn: Convolution Batch Shapes Auto - bf16bf16bf16 - CPU onednn: Deconvolution Batch shapes_1d - f32 - CPU onednn: Deconvolution Batch shapes_1d - u8s8f32 - CPU onednn: Deconvolution Batch shapes_1d - bf16bf16bf16 - CPU onednn: Deconvolution Batch shapes_3d - f32 - CPU onednn: Deconvolution Batch shapes_3d - u8s8f32 - CPU onednn: Deconvolution Batch shapes_3d - bf16bf16bf16 - CPU onednn: IP Shapes 1D - f32 - CPU onednn: IP Shapes 1D - u8s8f32 - CPU onednn: IP Shapes 1D - bf16bf16bf16 - CPU onednn: IP Shapes 3D - f32 - CPU onednn: IP Shapes 3D - u8s8f32 - CPU onednn: IP Shapes 3D - bf16bf16bf16 - CPU onednn: Matrix Multiply Batch Shapes Transformer - f32 - CPU onednn: Matrix Multiply Batch Shapes Transformer - u8s8f32 - CPU onednn: Matrix Multiply Batch Shapes Transformer - bf16bf16bf16 - CPU onednn: Recurrent Neural Network Training - f32 - CPU onednn: Recurrent Neural Network Training - u8s8f32 - CPU onednn: Recurrent Neural Network Training - bf16bf16bf16 - CPU onednn: Recurrent Neural Network Inference - f32 - CPU onednn: Recurrent Neural Network Inference - u8s8f32 - CPU onednn: Recurrent Neural Network Inference - bf16bf16bf16 - CPU onnx: yolov4 - CPU - Standard onnx: yolov4 - CPU - Parallel onnx: fcn-resnet101-11 - CPU - Standard onnx: fcn-resnet101-11 - CPU - Parallel onnx: super-resolution-10 - CPU - Standard onnx: super-resolution-10 - CPU - Parallel onnx: bertsquad-12 - CPU - Standard onnx: bertsquad-12 - CPU - Parallel onnx: GPT-2 - CPU - Standard onnx: GPT-2 - CPU - Parallel onnx: ArcFace ResNet-100 - CPU - Standard onnx: ArcFace ResNet-100 - CPU - Parallel openfoam: drivaerFastback, Small Mesh Size - Mesh Time openfoam: drivaerFastback, Small Mesh Size - Execution Time openradioss: Bird Strike on Windshield openradioss: Rubber O-Ring Seal Installation openradioss: Cell Phone Drop Test openradioss: Bumper Beam openradioss: INIVOL and Fluid Structure Interaction Drop Container openvino: Face Detection FP16 - CPU openvino: Face Detection FP16 - CPU openvino: Face Detection FP16-INT8 - CPU openvino: Face Detection FP16-INT8 - CPU openvino: Age Gender Recognition Retail 0013 FP16 - CPU openvino: Age Gender Recognition Retail 0013 FP16 - CPU openvino: Age Gender Recognition Retail 0013 FP16-INT8 - CPU openvino: Age Gender Recognition Retail 0013 FP16-INT8 - CPU openvino: Person Detection FP16 - CPU openvino: Person Detection FP16 - CPU openvino: Person Detection FP32 - CPU openvino: Person Detection FP32 - CPU openvino: Weld Porosity Detection FP16-INT8 - CPU openvino: Weld Porosity Detection FP16-INT8 - CPU openvino: Weld Porosity Detection FP16 - CPU openvino: Weld Porosity Detection FP16 - CPU openvino: Vehicle Detection FP16-INT8 - CPU openvino: Vehicle Detection FP16-INT8 - CPU openvino: Vehicle Detection FP16 - CPU openvino: Vehicle Detection FP16 - CPU openvino: Person Vehicle Bike Detection FP16 - CPU openvino: Person Vehicle Bike Detection FP16 - CPU openvino: Machine Translation EN To DE FP16 - CPU openvino: Machine Translation EN To DE FP16 - CPU openvkl: vklBenchmark ISPC ospray: gravity_spheres_volume/dim_512/ao/real_time ospray: gravity_spheres_volume/dim_512/scivis/real_time ospray: gravity_spheres_volume/dim_512/pathtracer/real_time ospray: particle_volume/ao/real_time ospray: particle_volume/scivis/real_time ospray: particle_volume/pathtracer/real_time ospray-studio: 1 - 1080p - 1 - Path Tracer ospray-studio: 1 - 1080p - 16 - Path Tracer ospray-studio: 1 - 1080p - 32 - Path Tracer ospray-studio: 1 - 4K - 1 - Path Tracer ospray-studio: 1 - 4K - 16 - Path Tracer ospray-studio: 1 - 4K - 32 - Path Tracer ospray-studio: 3 - 1080p - 1 - Path Tracer ospray-studio: 3 - 1080p - 16 - Path Tracer ospray-studio: 3 - 1080p - 32 - Path Tracer ospray-studio: 3 - 4K - 1 - Path Tracer ospray-studio: 3 - 4K - 16 - Path Tracer ospray-studio: 3 - 4K - 32 - Path Tracer simdjson: PartialTweets simdjson: LargeRand simdjson: Kostya simdjson: DistinctUserID simdjson: TopTweet tensorflow: CPU - 16 - VGG-16 tensorflow: CPU - 16 - ResNet-50 tensorflow: CPU - 16 - AlexNet tensorflow: CPU - 16 - GoogLeNet tensorflow: CPU - 32 - VGG-16 tensorflow: CPU - 32 - ResNet-50 tensorflow: CPU - 32 - AlexNet tensorflow: CPU - 32 - GoogLeNet tensorflow: CPU - 64 - VGG-16 tensorflow: CPU - 64 - ResNet-50 tensorflow: CPU - 64 - AlexNet tensorflow: CPU - 64 - GoogLeNet tensorflow: CPU - 256 - VGG-16 tensorflow: CPU - 256 - ResNet-50 tensorflow: CPU - 256 - AlexNet tensorflow: CPU - 256 - GoogLeNet tensorflow: CPU - 512 - AlexNet tensorflow: CPU - 512 - GoogLeNet tnn: CPU - DenseNet tnn: CPU - MobileNet v2 tnn: CPU - SqueezeNet v1.1 tnn: CPU - SqueezeNet v2 xmrig: Monero - 1M xmrig: Wownero - 1M i9-11900K AVX-512 On AVX-512 Off AVX-512 On 512 1376 2069 3445 231700 167500 40573 452.82 862110 387.72 4384.38 2152.94 11148.96 111730 77083 894.73 207.14 734.61 510.88 16.5129 14.4298 14.6252 1.031 0.43 0.43 0.21 1268 1186 7.468 0.938 1.670 10.295 3.073 2.131 1.972 19.580 12.28 3.73 2.68 2.33 2.62 4.86 0.80 10.16 44.74 8.69 6.98 15.99 20.99 17.19 7.05 87.29 2.98 35.3834 28.2567 40.8668 97.8481 68.7607 14.5381 80.6747 49.5682 132.9124 7.5173 155.3852 25.7285 8.8759 112.6756 8.9516 446.8814 43.6753 22.8900 36.5979 109.2808 49.6651 20.1259 50.7670 78.7761 8.9135 112.1891 8.9588 446.4889 631.24 14.3619 12.1099 16.1640 8.55193 0.840660 20.8058 4.33063 1.47049 17.3084 4.03554 0.720702 8.55274 10.6347 3.01377 4.81904 3.26773 1.32134 3.81793 3079.96 3088.89 3093.58 1814.65 1817.59 1814.03 529 319 102 73 7356 4950 1008 519 6954 5548 2249 1388 45.488465 538.97618 309.21 250.33 120.62 177.40 759.23 2.97 1346.99 12.23 326.76 9379.27 0.85 23074.82 0.34 1.78 2235.54 1.76 2250.02 1240.56 6.43 320.80 24.92 623.17 6.41 108.61 36.80 286.43 13.95 35.62 112.27 113 4.42072 4.37042 5.36461 4.95822 4.98037 173.134 1958 31054 65723 7743 127267 251261 2358 37662 78746 9373 152903 302582 8.52 1.47 4.54 8.78 8.82 7.76 20.46 80.75 63.34 8.32 21.24 112.10 64.22 8.73 21.86 136.92 65.02 9.42 22.20 163.87 66.63 173.67 67.68 2704.934 245.952 230.819 47.193 2239.5 4015.0 1414 1282 2696 106137 64663 16150 453.39 393213 359.01 2381.45 2130.49 9966.10 70720 27270 879.37 192.71 691.43 487.09 15.8952 14.0227 13.8618 1.020 0.43 0.43 0.21 1240 1062 7.139 0.942 2.023 18.043 3.694 1.934 1.798 23.418 11.43 3.34 2.49 2.33 2.37 4.35 0.76 9.55 45.68 8.24 6.33 15.40 18.80 13.89 6.70 110.38 2.85 28.9677 34.5145 35.5207 112.5989 56.5928 17.6640 69.1005 57.8764 85.9777 11.6244 101.6365 39.3450 7.8089 128.0523 8.1213 492.3767 25.5407 39.1448 26.5261 150.7668 43.3933 23.0354 43.2306 92.5054 7.8337 127.6469 8.1425 491.1153 575.79 15.6093 14.8411 8.39772 1.77832 5.39327 2.31183 3.22680 1.24396 11.6771 2.18670 3.67360 1.40330 3271.06 3270.55 3271.27 2000.12 2003.54 2006.02 517 315 100 72 7279 4515 1042 515 6954 5557 1951 1278 46.532622 538.29062 311.82 243.47 128.16 174.60 713.35 2.60 1525.18 4.88 817.17 7956.78 1.00 14973.88 0.53 1.54 2563.45 1.54 2563.87 533.79 14.98 252.69 15.81 310.38 12.88 141.30 28.29 325.95 12.26 31.70 126.09 87 2.82821 2.72378 4.05745 6.02446 5.91636 164.963 2134 34112 72145 8450 139519 275693 2561 40948 85854 10148 166508 329527 6.20 1.36 3.86 6.33 6.35 5.69 12.29 67.80 36.22 5.95 12.32 87.79 36.49 6.11 12.37 103.31 36.94 6.22 12.48 117.43 37.37 107.72 33.92 2703.558 241.314 228.683 46.360 2256.1 4076.4 1363 2076 3439 230687 164790 40663 449.42 895513 379.94 4392.29 2190.91 11270 112403 76393 902.92 190.82 727.76 477.09 16.4541 14.3502 14.6198 1.035 0.43 0.43 0.21 1273 1194 7.527 0.963 1.675 10.368 3.114 2.125 1.989 19.403 12.28 3.77 2.71 2.33 2.58 4.79 0.80 9.96 44.59 8.64 6.69 16.24 22.01 17.34 7.10 70.39 2.98 35.4238 28.2249 40.8021 98.0286 68.7715 14.5355 81.0216 49.3593 133.7435 7.4707 156.8121 25.4949 8.9905 111.2249 9.0886 440.0994 43.4408 23.0134 36.8617 108.4890 49.9913 19.9939 51.3573 77.8730 9.0118 110.9617 9.0792 440.5608 631.86 14.2835 12.0178 16.1605 8.50891 0.846376 20.2612 4.32564 1.46948 17.2687 4.03294 0.715925 8.55374 9.95113 2.75246 4.64814 3.21742 1.30906 3.66945 3062.36 3073.17 2986.72 1739.49 1738.00 1715.75 527 319 103 73 6824 4626 1012 524 6962 5545 2250 1368 45.3321 535.10825 315.86 240.62 118.89 175.69 755.60 2.95 1352.08 12.17 328.08 9460.45 0.84 22962.10 0.35 1.78 2227.69 1.77 2244.25 1242.45 6.42 321.51 24.86 630.58 6.33 109.09 36.64 285.75 13.99 35.55 112.48 112 4.46906 4.36772 5.35301 4.95280 4.95148 173.739 1951 31180 65447 7734 127540 250698 2364 37620 78809 9376 153101 303966 8.51 1.47 4.53 8.77 8.82 7.76 20.55 82.10 63.83 8.29 21.29 113.25 64.42 8.69 21.88 137.75 65.15 9.42 22.13 163.09 66.49 172.66 67.67 2695.646 240.410 228.424 45.679 2252.6 4075.5 OpenBenchmarking.org
AI Benchmark Alpha Device Inference Score OpenBenchmarking.org Score, More Is Better AI Benchmark Alpha 0.1.2 Device Inference Score AVX-512 On 512 AVX-512 On AVX-512 Off 300 600 900 1200 1500 1363 1376 1414
AI Benchmark Alpha Device Training Score OpenBenchmarking.org Score, More Is Better AI Benchmark Alpha 0.1.2 Device Training Score AVX-512 Off AVX-512 On AVX-512 On 512 400 800 1200 1600 2000 1282 2069 2076
AI Benchmark Alpha Device AI Score OpenBenchmarking.org Score, More Is Better AI Benchmark Alpha 0.1.2 Device AI Score AVX-512 Off AVX-512 On 512 AVX-512 On 700 1400 2100 2800 3500 2696 3439 3445
AI Benchmark Alpha Device AI Score OpenBenchmarking.org Score Per Watt, More Is Better AI Benchmark Alpha 0.1.2 Device AI Score AVX-512 Off AVX-512 On AVX-512 On 512 5 10 15 20 25 16.76 21.17 21.26
AI Benchmark Alpha CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better AI Benchmark Alpha 0.1.2 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 On AVX-512 On 512 AVX-512 Off 900 1800 2700 3600 4500 Min: 3500 / Avg: 4834.52 / Max: 5302 Min: 3475 / Avg: 4839.25 / Max: 5311 Min: 4700 / Avg: 4852.05 / Max: 5308
AI Benchmark Alpha CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better AI Benchmark Alpha 0.1.2 CPU Power Consumption Monitor AVX-512 On AVX-512 On 512 AVX-512 Off 50 100 150 200 250 Min: 11.95 / Avg: 162.75 / Max: 242.39 Min: 12.02 / Avg: 161.75 / Max: 239 Min: 11.83 / Avg: 160.88 / Max: 250.01
AI Benchmark Alpha CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better AI Benchmark Alpha 0.1.2 CPU Temperature Monitor AVX-512 On AVX-512 On 512 AVX-512 Off 20 40 60 80 100 Min: 29 / Avg: 75.69 / Max: 98 Min: 33 / Avg: 75.48 / Max: 97 Min: 27 / Avg: 70 / Max: 89
CPU Peak Freq (Highest CPU Core Frequency) Monitor Phoronix Test Suite System Monitoring OpenBenchmarking.org Megahertz CPU Peak Freq (Highest CPU Core Frequency) Monitor Phoronix Test Suite System Monitoring AVX-512 Off AVX-512 On AVX-512 On 512 1000 2000 3000 4000 5000 Min: 3500 / Avg: 4781.84 / Max: 5621 Min: 3350 / Avg: 4733.96 / Max: 5541 Min: 2700 / Avg: 4722.22 / Max: 5323
CPU Power Consumption Monitor Phoronix Test Suite System Monitoring OpenBenchmarking.org Watts CPU Power Consumption Monitor Phoronix Test Suite System Monitoring AVX-512 On 512 AVX-512 On AVX-512 Off 50 100 150 200 250 Min: 6.3 / Avg: 192.29 / Max: 280.23 Min: 6.37 / Avg: 188.45 / Max: 283.94 Min: 6.36 / Avg: 173.58 / Max: 251.93
CPU Temperature Monitor Phoronix Test Suite System Monitoring OpenBenchmarking.org Celsius CPU Temperature Monitor Phoronix Test Suite System Monitoring AVX-512 On 512 AVX-512 On AVX-512 Off 20 40 60 80 100 Min: 31 / Avg: 79.47 / Max: 100 Min: 29 / Avg: 78.17 / Max: 100 Min: 27 / Avg: 72.98 / Max: 95
Cpuminer-Opt Algorithm: Triple SHA-256, Onecoin OpenBenchmarking.org kH/s, More Is Better Cpuminer-Opt 3.18 Algorithm: Triple SHA-256, Onecoin AVX-512 Off AVX-512 On 512 AVX-512 On 50K 100K 150K 200K 250K SE +/- 627.84, N = 3 SE +/- 1461.35, N = 3 SE +/- 1895.81, N = 3 106137 230687 231700 -mno-avx512f 1. (CXX) g++ options: -O3 -march=native -lcurl -lz -lpthread -lssl -lcrypto -lgmp
Cpuminer-Opt Algorithm: Triple SHA-256, Onecoin OpenBenchmarking.org kH/s Per Watt, More Is Better Cpuminer-Opt 3.18 Algorithm: Triple SHA-256, Onecoin AVX-512 Off AVX-512 On 512 AVX-512 On 300 600 900 1200 1500 820.32 1361.66 1366.28
Cpuminer-Opt CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better Cpuminer-Opt 3.18 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 On 512 AVX-512 On AVX-512 Off 900 1800 2700 3600 4500 Min: 4700 / Avg: 4753.44 / Max: 5300 Min: 4700 / Avg: 4759.14 / Max: 5300 Min: 4700 / Avg: 4834.78 / Max: 5300
Cpuminer-Opt CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better Cpuminer-Opt 3.18 CPU Power Consumption Monitor AVX-512 On AVX-512 On 512 AVX-512 Off 50 100 150 200 250 Min: 12.5 / Avg: 169.58 / Max: 237.02 Min: 12.41 / Avg: 169.42 / Max: 278.89 Min: 12.4 / Avg: 129.38 / Max: 169.44
Cpuminer-Opt CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better Cpuminer-Opt 3.18 CPU Temperature Monitor AVX-512 On 512 AVX-512 On AVX-512 Off 20 40 60 80 100 Min: 42 / Avg: 75.38 / Max: 94 Min: 40 / Avg: 74.89 / Max: 92 Min: 39 / Avg: 64.76 / Max: 73
Cpuminer-Opt Algorithm: Quad SHA-256, Pyrite OpenBenchmarking.org kH/s, More Is Better Cpuminer-Opt 3.18 Algorithm: Quad SHA-256, Pyrite AVX-512 Off AVX-512 On 512 AVX-512 On 40K 80K 120K 160K 200K SE +/- 42.56, N = 3 SE +/- 346.55, N = 3 SE +/- 280.42, N = 3 64663 164790 167500 -mno-avx512f 1. (CXX) g++ options: -O3 -march=native -lcurl -lz -lpthread -lssl -lcrypto -lgmp
Cpuminer-Opt Algorithm: Quad SHA-256, Pyrite OpenBenchmarking.org kH/s Per Watt, More Is Better Cpuminer-Opt 3.18 Algorithm: Quad SHA-256, Pyrite AVX-512 Off AVX-512 On 512 AVX-512 On 200 400 600 800 1000 460.38 930.90 953.89
Cpuminer-Opt CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better Cpuminer-Opt 3.18 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 On AVX-512 On 512 AVX-512 Off 900 1800 2700 3600 4500 Min: 4700 / Avg: 4750.65 / Max: 5300 Min: 4700 / Avg: 4753.87 / Max: 5290 Min: 4700 / Avg: 4831.54 / Max: 5312
Cpuminer-Opt CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better Cpuminer-Opt 3.18 CPU Power Consumption Monitor AVX-512 On 512 AVX-512 On AVX-512 Off 50 100 150 200 250 Min: 12.25 / Avg: 177.02 / Max: 245.52 Min: 12.43 / Avg: 175.6 / Max: 252.11 Min: 12.24 / Avg: 140.46 / Max: 186.51
Cpuminer-Opt CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better Cpuminer-Opt 3.18 CPU Temperature Monitor AVX-512 On 512 AVX-512 On AVX-512 Off 20 40 60 80 100 Min: 39 / Avg: 75.84 / Max: 93 Min: 38 / Avg: 73.74 / Max: 92 Min: 36 / Avg: 65.33 / Max: 73
Cpuminer-Opt Algorithm: Myriad-Groestl OpenBenchmarking.org kH/s, More Is Better Cpuminer-Opt 3.18 Algorithm: Myriad-Groestl AVX-512 Off AVX-512 On AVX-512 On 512 9K 18K 27K 36K 45K SE +/- 17.32, N = 3 SE +/- 58.12, N = 3 SE +/- 164.55, N = 3 16150 40573 40663 -mno-avx512f 1. (CXX) g++ options: -O3 -march=native -lcurl -lz -lpthread -lssl -lcrypto -lgmp
Cpuminer-Opt Algorithm: Myriad-Groestl OpenBenchmarking.org kH/s Per Watt, More Is Better Cpuminer-Opt 3.18 Algorithm: Myriad-Groestl AVX-512 Off AVX-512 On 512 AVX-512 On 40 80 120 160 200 101.32 197.49 198.30
Cpuminer-Opt CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better Cpuminer-Opt 3.18 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 On AVX-512 On 512 AVX-512 Off 900 1800 2700 3600 4500 Min: 3500 / Avg: 4739.52 / Max: 5300 Min: 3500 / Avg: 4739.94 / Max: 5312 Min: 4700 / Avg: 4766.67 / Max: 5300
Cpuminer-Opt CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better Cpuminer-Opt 3.18 CPU Power Consumption Monitor AVX-512 On 512 AVX-512 On AVX-512 Off 50 100 150 200 250 Min: 12.06 / Avg: 205.9 / Max: 276.24 Min: 12.4 / Avg: 204.6 / Max: 277.24 Min: 12.36 / Avg: 159.39 / Max: 196.52
Cpuminer-Opt CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better Cpuminer-Opt 3.18 CPU Temperature Monitor AVX-512 On 512 AVX-512 On AVX-512 Off 20 40 60 80 100 Min: 39 / Avg: 80.53 / Max: 97 Min: 38 / Avg: 79.95 / Max: 97 Min: 37 / Avg: 68.83 / Max: 76
Cpuminer-Opt Algorithm: Magi OpenBenchmarking.org kH/s, More Is Better Cpuminer-Opt 3.18 Algorithm: Magi AVX-512 On 512 AVX-512 On AVX-512 Off 100 200 300 400 500 SE +/- 3.36, N = 3 SE +/- 0.67, N = 3 SE +/- 0.84, N = 3 449.42 452.82 453.39 -mno-avx512f 1. (CXX) g++ options: -O3 -march=native -lcurl -lz -lpthread -lssl -lcrypto -lgmp
Cpuminer-Opt Algorithm: Magi OpenBenchmarking.org kH/s Per Watt, More Is Better Cpuminer-Opt 3.18 Algorithm: Magi AVX-512 On 512 AVX-512 On AVX-512 Off 0.6158 1.2316 1.8474 2.4632 3.079 2.120 2.717 2.737
Cpuminer-Opt CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better Cpuminer-Opt 3.18 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 On 512 AVX-512 On AVX-512 Off 900 1800 2700 3600 4500 Min: 3555 / Avg: 4644.34 / Max: 5300 Min: 4700 / Avg: 4753.83 / Max: 5300 Min: 4700 / Avg: 4762.57 / Max: 5300
Cpuminer-Opt CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better Cpuminer-Opt 3.18 CPU Power Consumption Monitor AVX-512 On 512 AVX-512 On AVX-512 Off 50 100 150 200 250 Min: 12.13 / Avg: 212.02 / Max: 259.67 Min: 12.43 / Avg: 166.66 / Max: 190.11 Min: 12.44 / Avg: 165.63 / Max: 188.99
Cpuminer-Opt CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better Cpuminer-Opt 3.18 CPU Temperature Monitor AVX-512 On 512 AVX-512 On AVX-512 Off 20 40 60 80 100 Min: 40 / Avg: 82.2 / Max: 95 Min: 39 / Avg: 71.49 / Max: 79 Min: 38 / Avg: 71.08 / Max: 78
Cpuminer-Opt Algorithm: Blake-2 S OpenBenchmarking.org kH/s, More Is Better Cpuminer-Opt 3.18 Algorithm: Blake-2 S AVX-512 Off AVX-512 On AVX-512 On 512 200K 400K 600K 800K 1000K SE +/- 382.81, N = 3 SE +/- 9836.24, N = 3 SE +/- 7851.09, N = 15 393213 862110 895513 -mno-avx512f 1. (CXX) g++ options: -O3 -march=native -lcurl -lz -lpthread -lssl -lcrypto -lgmp
Cpuminer-Opt Algorithm: Blake-2 S OpenBenchmarking.org kH/s Per Watt, More Is Better Cpuminer-Opt 3.18 Algorithm: Blake-2 S AVX-512 Off AVX-512 On AVX-512 On 512 1200 2400 3600 4800 6000 3255.01 5427.52 5541.06
Cpuminer-Opt CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better Cpuminer-Opt 3.18 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 On 512 AVX-512 On AVX-512 Off 900 1800 2700 3600 4500 Min: 4700 / Avg: 4751.67 / Max: 5305 Min: 4700 / Avg: 4757.9 / Max: 5300 Min: 4700 / Avg: 4834.2 / Max: 5300
Cpuminer-Opt CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better Cpuminer-Opt 3.18 CPU Power Consumption Monitor AVX-512 On 512 AVX-512 On AVX-512 Off 50 100 150 200 250 Min: 12.31 / Avg: 161.61 / Max: 277.66 Min: 12.3 / Avg: 158.84 / Max: 274.55 Min: 12.46 / Avg: 120.8 / Max: 156.32
Cpuminer-Opt CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better Cpuminer-Opt 3.18 CPU Temperature Monitor AVX-512 On 512 AVX-512 On AVX-512 Off 20 40 60 80 100 Min: 42 / Avg: 74.3 / Max: 93 Min: 39 / Avg: 72.79 / Max: 89 Min: 38 / Avg: 62.38 / Max: 71
Cpuminer-Opt Algorithm: x25x OpenBenchmarking.org kH/s, More Is Better Cpuminer-Opt 3.18 Algorithm: x25x AVX-512 Off AVX-512 On 512 AVX-512 On 80 160 240 320 400 SE +/- 0.48, N = 3 SE +/- 7.53, N = 12 SE +/- 1.89, N = 3 359.01 379.94 387.72 -mno-avx512f 1. (CXX) g++ options: -O3 -march=native -lcurl -lz -lpthread -lssl -lcrypto -lgmp
Cpuminer-Opt Algorithm: x25x OpenBenchmarking.org kH/s Per Watt, More Is Better Cpuminer-Opt 3.18 Algorithm: x25x AVX-512 On AVX-512 On 512 AVX-512 Off 0.5148 1.0296 1.5444 2.0592 2.574 1.846 1.847 2.288
Cpuminer-Opt CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better Cpuminer-Opt 3.18 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 On 512 AVX-512 On AVX-512 Off 900 1800 2700 3600 4500 Min: 3500 / Avg: 4605.7 / Max: 5307 Min: 4650 / Avg: 4751.77 / Max: 5252 Min: 4700 / Avg: 4771.9 / Max: 5294
Cpuminer-Opt CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better Cpuminer-Opt 3.18 CPU Power Consumption Monitor AVX-512 On AVX-512 On 512 AVX-512 Off 50 100 150 200 250 Min: 12.61 / Avg: 210.01 / Max: 243.37 Min: 12.21 / Avg: 205.74 / Max: 250.13 Min: 12.29 / Avg: 156.93 / Max: 187.81
Cpuminer-Opt CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better Cpuminer-Opt 3.18 CPU Temperature Monitor AVX-512 On AVX-512 On 512 AVX-512 Off 20 40 60 80 100 Min: 38 / Avg: 82.81 / Max: 93 Min: 39 / Avg: 80.97 / Max: 94 Min: 35 / Avg: 67.7 / Max: 74
Cpuminer-Opt Algorithm: Garlicoin OpenBenchmarking.org kH/s, More Is Better Cpuminer-Opt 3.18 Algorithm: Garlicoin AVX-512 Off AVX-512 On AVX-512 On 512 900 1800 2700 3600 4500 SE +/- 6.13, N = 3 SE +/- 25.90, N = 3 SE +/- 10.30, N = 3 2381.45 4384.38 4392.29 -mno-avx512f 1. (CXX) g++ options: -O3 -march=native -lcurl -lz -lpthread -lssl -lcrypto -lgmp
Cpuminer-Opt Algorithm: Garlicoin OpenBenchmarking.org kH/s Per Watt, More Is Better Cpuminer-Opt 3.18 Algorithm: Garlicoin AVX-512 Off AVX-512 On AVX-512 On 512 5 10 15 20 25 13.64 19.40 19.90
Cpuminer-Opt CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better Cpuminer-Opt 3.18 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 On 512 AVX-512 On AVX-512 Off 900 1800 2700 3600 4500 Min: 4500 / Avg: 4645.86 / Max: 5300 Min: 4522 / Avg: 4667.89 / Max: 5311 Min: 4700 / Avg: 4755.84 / Max: 5300
Cpuminer-Opt CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better Cpuminer-Opt 3.18 CPU Power Consumption Monitor AVX-512 On AVX-512 On 512 AVX-512 Off 50 100 150 200 250 Min: 12.53 / Avg: 225.98 / Max: 278.7 Min: 12.3 / Avg: 220.67 / Max: 279.05 Min: 12.41 / Avg: 174.56 / Max: 204.63
Cpuminer-Opt CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better Cpuminer-Opt 3.18 CPU Temperature Monitor AVX-512 On 512 AVX-512 On AVX-512 Off 20 40 60 80 100 Min: 41 / Avg: 85.1 / Max: 98 Min: 39 / Avg: 84.38 / Max: 96 Min: 38 / Avg: 70.33 / Max: 78
Cpuminer-Opt Algorithm: Ringcoin OpenBenchmarking.org kH/s, More Is Better Cpuminer-Opt 3.18 Algorithm: Ringcoin AVX-512 Off AVX-512 On AVX-512 On 512 500 1000 1500 2000 2500 SE +/- 5.83, N = 3 SE +/- 40.17, N = 13 SE +/- 16.96, N = 15 2130.49 2152.94 2190.91 -mno-avx512f 1. (CXX) g++ options: -O3 -march=native -lcurl -lz -lpthread -lssl -lcrypto -lgmp
Cpuminer-Opt Algorithm: Ringcoin OpenBenchmarking.org kH/s Per Watt, More Is Better Cpuminer-Opt 3.18 Algorithm: Ringcoin AVX-512 On AVX-512 On 512 AVX-512 Off 3 6 9 12 15 10.11 10.35 12.81
Cpuminer-Opt CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better Cpuminer-Opt 3.18 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 On AVX-512 On 512 AVX-512 Off 900 1800 2700 3600 4500 Min: 3500 / Avg: 4653.7 / Max: 5308 Min: 3500 / Avg: 4689.84 / Max: 5300 Min: 4700 / Avg: 4750.11 / Max: 5297
Cpuminer-Opt CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better Cpuminer-Opt 3.18 CPU Power Consumption Monitor AVX-512 On AVX-512 On 512 AVX-512 Off 50 100 150 200 250 Min: 12.54 / Avg: 213.04 / Max: 259.5 Min: 12.63 / Avg: 211.76 / Max: 259.97 Min: 12.48 / Avg: 166.37 / Max: 191.48
Cpuminer-Opt CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better Cpuminer-Opt 3.18 CPU Temperature Monitor AVX-512 On AVX-512 On 512 AVX-512 Off 20 40 60 80 100 Min: 40 / Avg: 85.36 / Max: 94 Min: 41 / Avg: 85.18 / Max: 96 Min: 38 / Avg: 71.45 / Max: 78
Cpuminer-Opt Algorithm: Deepcoin OpenBenchmarking.org kH/s, More Is Better Cpuminer-Opt 3.18 Algorithm: Deepcoin AVX-512 Off AVX-512 On AVX-512 On 512 2K 4K 6K 8K 10K SE +/- 3.11, N = 3 SE +/- 226.60, N = 12 SE +/- 25.17, N = 3 9966.10 11148.96 11270.00 -mno-avx512f 1. (CXX) g++ options: -O3 -march=native -lcurl -lz -lpthread -lssl -lcrypto -lgmp
Cpuminer-Opt Algorithm: Deepcoin OpenBenchmarking.org kH/s Per Watt, More Is Better Cpuminer-Opt 3.18 Algorithm: Deepcoin AVX-512 On AVX-512 On 512 AVX-512 Off 13 26 39 52 65 50.76 51.80 58.94
Cpuminer-Opt CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better Cpuminer-Opt 3.18 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 On 512 AVX-512 On AVX-512 Off 900 1800 2700 3600 4500 Min: 3500 / Avg: 4700.75 / Max: 5100 Min: 4600 / Avg: 4719.95 / Max: 5301 Min: 4700 / Avg: 4759.57 / Max: 5303
Cpuminer-Opt CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better Cpuminer-Opt 3.18 CPU Power Consumption Monitor AVX-512 On AVX-512 On 512 AVX-512 Off 50 100 150 200 250 Min: 12.44 / Avg: 219.64 / Max: 263.83 Min: 12.34 / Avg: 217.57 / Max: 263.4 Min: 12.31 / Avg: 169.09 / Max: 198.24
Cpuminer-Opt CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better Cpuminer-Opt 3.18 CPU Temperature Monitor AVX-512 On AVX-512 On 512 AVX-512 Off 20 40 60 80 100 Min: 40 / Avg: 84.5 / Max: 93 Min: 42 / Avg: 83.16 / Max: 91 Min: 38 / Avg: 70.52 / Max: 77
Cpuminer-Opt Algorithm: Skeincoin OpenBenchmarking.org kH/s, More Is Better Cpuminer-Opt 3.18 Algorithm: Skeincoin AVX-512 Off AVX-512 On AVX-512 On 512 20K 40K 60K 80K 100K SE +/- 85.44, N = 3 SE +/- 394.25, N = 3 SE +/- 146.55, N = 3 70720 111730 112403 -mno-avx512f 1. (CXX) g++ options: -O3 -march=native -lcurl -lz -lpthread -lssl -lcrypto -lgmp
Cpuminer-Opt Algorithm: Skeincoin OpenBenchmarking.org kH/s Per Watt, More Is Better Cpuminer-Opt 3.18 Algorithm: Skeincoin AVX-512 Off AVX-512 On AVX-512 On 512 140 280 420 560 700 493.49 647.91 651.49
Cpuminer-Opt CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better Cpuminer-Opt 3.18 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 On AVX-512 On 512 AVX-512 Off 900 1800 2700 3600 4500 Min: 4700 / Avg: 4758.76 / Max: 5300 Min: 4700 / Avg: 4759.1 / Max: 5308 Min: 4700 / Avg: 4830.72 / Max: 5300
Cpuminer-Opt CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better Cpuminer-Opt 3.18 CPU Power Consumption Monitor AVX-512 On 512 AVX-512 On AVX-512 Off 50 100 150 200 250 Min: 12.36 / Avg: 172.53 / Max: 260.03 Min: 12.55 / Avg: 172.45 / Max: 244.87 Min: 6.67 / Avg: 143.31 / Max: 195.06
Cpuminer-Opt CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better Cpuminer-Opt 3.18 CPU Temperature Monitor AVX-512 On 512 AVX-512 On AVX-512 Off 20 40 60 80 100 Min: 42 / Avg: 75.17 / Max: 93 Min: 41 / Avg: 73.88 / Max: 81 Min: 38 / Avg: 65.65 / Max: 71
Cpuminer-Opt Algorithm: LBC, LBRY Credits OpenBenchmarking.org kH/s, More Is Better Cpuminer-Opt 3.18 Algorithm: LBC, LBRY Credits AVX-512 Off AVX-512 On 512 AVX-512 On 17K 34K 51K 68K 85K SE +/- 20.00, N = 3 SE +/- 116.81, N = 3 SE +/- 84.13, N = 3 27270 76393 77083 -mno-avx512f 1. (CXX) g++ options: -O3 -march=native -lcurl -lz -lpthread -lssl -lcrypto -lgmp
Cpuminer-Opt Algorithm: LBC, LBRY Credits OpenBenchmarking.org kH/s Per Watt, More Is Better Cpuminer-Opt 3.18 Algorithm: LBC, LBRY Credits AVX-512 Off AVX-512 On 512 AVX-512 On 90 180 270 360 450 165.49 393.49 397.33
Cpuminer-Opt CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better Cpuminer-Opt 3.18 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 On 512 AVX-512 On AVX-512 Off 900 1800 2700 3600 4500 Min: 4700 / Avg: 4753.32 / Max: 5289 Min: 4700 / Avg: 4754.62 / Max: 5300 Min: 4700 / Avg: 4769.7 / Max: 5300
Cpuminer-Opt CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better Cpuminer-Opt 3.18 CPU Power Consumption Monitor AVX-512 On 512 AVX-512 On AVX-512 Off 50 100 150 200 250 Min: 12.24 / Avg: 194.14 / Max: 277.39 Min: 12.52 / Avg: 194 / Max: 268.78 Min: 12.49 / Avg: 164.79 / Max: 203.1
Cpuminer-Opt CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better Cpuminer-Opt 3.18 CPU Temperature Monitor AVX-512 On 512 AVX-512 On AVX-512 Off 20 40 60 80 100 Min: 40 / Avg: 77.84 / Max: 95 Min: 39 / Avg: 77.28 / Max: 95 Min: 37 / Avg: 68.15 / Max: 76
dav1d Video Input: Summer Nature 1080p OpenBenchmarking.org FPS, More Is Better dav1d 1.0 Video Input: Summer Nature 1080p AVX-512 Off AVX-512 On AVX-512 On 512 200 400 600 800 1000 SE +/- 0.63, N = 8 SE +/- 0.63, N = 8 SE +/- 0.57, N = 8 879.37 894.73 902.92 -mno-avx512f 1. (CC) gcc options: -O3 -march=native -pthread -lm
dav1d Video Input: Summer Nature 1080p OpenBenchmarking.org FPS Per Watt, More Is Better dav1d 1.0 Video Input: Summer Nature 1080p AVX-512 On AVX-512 On 512 AVX-512 Off 2 4 6 8 10 7.283 7.349 8.435
dav1d CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better dav1d 1.0 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 On 512 AVX-512 On AVX-512 Off 900 1800 2700 3600 4500 Min: 4700 / Avg: 4943.85 / Max: 5300 Min: 4700 / Avg: 4954.03 / Max: 5302 Min: 4777 / Avg: 4979.34 / Max: 5300
dav1d CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better dav1d 1.0 CPU Power Consumption Monitor AVX-512 On 512 AVX-512 On AVX-512 Off 40 80 120 160 200 Min: 12.1 / Avg: 122.86 / Max: 243.01 Min: 12.01 / Avg: 122.85 / Max: 243.48 Min: 11.76 / Avg: 104.25 / Max: 203.56
dav1d CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better dav1d 1.0 CPU Temperature Monitor AVX-512 On 512 AVX-512 On AVX-512 Off 15 30 45 60 75 Min: 32 / Avg: 56.14 / Max: 79 Min: 31 / Avg: 55.32 / Max: 80 Min: 30 / Avg: 49.97 / Max: 70
dav1d Video Input: Summer Nature 4K OpenBenchmarking.org FPS, More Is Better dav1d 1.0 Video Input: Summer Nature 4K AVX-512 On 512 AVX-512 Off AVX-512 On 50 100 150 200 250 SE +/- 0.11, N = 3 SE +/- 0.10, N = 3 SE +/- 0.18, N = 3 190.82 192.71 207.14 -mno-avx512f 1. (CC) gcc options: -O3 -march=native -pthread -lm
dav1d Video Input: Summer Nature 4K OpenBenchmarking.org FPS Per Watt, More Is Better dav1d 1.0 Video Input: Summer Nature 4K AVX-512 On 512 AVX-512 On AVX-512 Off 0.2795 0.559 0.8385 1.118 1.3975 1.007 1.092 1.242
dav1d CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better dav1d 1.0 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 On AVX-512 On 512 AVX-512 Off 900 1800 2700 3600 4500 Min: 4700 / Avg: 4790.25 / Max: 5300 Min: 4700 / Avg: 4792.86 / Max: 5300 Min: 4700 / Avg: 4854.52 / Max: 5304
dav1d CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better dav1d 1.0 CPU Power Consumption Monitor AVX-512 On AVX-512 On 512 AVX-512 Off 40 80 120 160 200 Min: 12.01 / Avg: 189.65 / Max: 246.19 Min: 12.1 / Avg: 189.54 / Max: 242.47 Min: 6.5 / Avg: 155.12 / Max: 197.33
dav1d CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better dav1d 1.0 CPU Temperature Monitor AVX-512 On 512 AVX-512 On AVX-512 Off 16 32 48 64 80 Min: 36 / Avg: 70.99 / Max: 85 Min: 34 / Avg: 70.34 / Max: 86 Min: 35 / Avg: 62.8 / Max: 73
dav1d Video Input: Chimera 1080p OpenBenchmarking.org FPS, More Is Better dav1d 1.0 Video Input: Chimera 1080p AVX-512 Off AVX-512 On 512 AVX-512 On 160 320 480 640 800 SE +/- 0.49, N = 4 SE +/- 0.36, N = 4 SE +/- 0.58, N = 4 691.43 727.76 734.61 -mno-avx512f 1. (CC) gcc options: -O3 -march=native -pthread -lm
dav1d Video Input: Chimera 1080p OpenBenchmarking.org FPS Per Watt, More Is Better dav1d 1.0 Video Input: Chimera 1080p AVX-512 On 512 AVX-512 On AVX-512 Off 1.0757 2.1514 3.2271 4.3028 5.3785 4.141 4.220 4.781
dav1d CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better dav1d 1.0 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 On 512 AVX-512 On AVX-512 Off 900 1800 2700 3600 4500 Min: 4700 / Avg: 4815.92 / Max: 5300 Min: 4700 / Avg: 4821.12 / Max: 5300 Min: 4700 / Avg: 4858.22 / Max: 5310
dav1d CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better dav1d 1.0 CPU Power Consumption Monitor AVX-512 On 512 AVX-512 On AVX-512 Off 40 80 120 160 200 Min: 6.61 / Avg: 175.75 / Max: 241.88 Min: 12.51 / Avg: 174.06 / Max: 240.93 Min: 12.15 / Avg: 144.63 / Max: 196.82
dav1d CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better dav1d 1.0 CPU Temperature Monitor AVX-512 On AVX-512 On 512 AVX-512 Off 16 32 48 64 80 Min: 38 / Avg: 69.91 / Max: 85 Min: 39 / Avg: 69.68 / Max: 86 Min: 36 / Avg: 62.58 / Max: 73
dav1d Video Input: Chimera 1080p 10-bit OpenBenchmarking.org FPS, More Is Better dav1d 1.0 Video Input: Chimera 1080p 10-bit AVX-512 On 512 AVX-512 Off AVX-512 On 110 220 330 440 550 SE +/- 0.21, N = 3 SE +/- 0.38, N = 3 SE +/- 0.34, N = 3 477.09 487.09 510.88 -mno-avx512f 1. (CC) gcc options: -O3 -march=native -pthread -lm
dav1d Video Input: Chimera 1080p 10-bit OpenBenchmarking.org FPS Per Watt, More Is Better dav1d 1.0 Video Input: Chimera 1080p 10-bit AVX-512 On 512 AVX-512 On AVX-512 Off 0.7407 1.4814 2.2221 2.9628 3.7035 2.699 2.893 3.292
dav1d CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better dav1d 1.0 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 On AVX-512 On 512 AVX-512 Off 900 1800 2700 3600 4500 Min: 4700 / Avg: 4791.38 / Max: 5299 Min: 4700 / Avg: 4794.56 / Max: 5310 Min: 4700 / Avg: 4850.01 / Max: 5296
dav1d CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better dav1d 1.0 CPU Power Consumption Monitor AVX-512 On 512 AVX-512 On AVX-512 Off 40 80 120 160 200 Min: 12.28 / Avg: 176.77 / Max: 228.64 Min: 12.44 / Avg: 176.58 / Max: 231.88 Min: 12.37 / Avg: 147.97 / Max: 189.99
dav1d CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better dav1d 1.0 CPU Temperature Monitor AVX-512 On AVX-512 On 512 AVX-512 Off 15 30 45 60 75 Min: 38 / Avg: 69.14 / Max: 80 Min: 38 / Avg: 68.94 / Max: 81 Min: 36 / Avg: 62.16 / Max: 72
Embree Binary: Pathtracer ISPC - Model: Asian Dragon OpenBenchmarking.org Frames Per Second, More Is Better Embree 3.13 Binary: Pathtracer ISPC - Model: Asian Dragon AVX-512 Off AVX-512 On 512 AVX-512 On 4 8 12 16 20 SE +/- 0.10, N = 3 SE +/- 0.06, N = 3 SE +/- 0.07, N = 3 15.90 16.45 16.51 MIN: 15.66 / MAX: 16.42 MIN: 16.21 / MAX: 16.89 MIN: 16.3 / MAX: 17.02
Embree Binary: Pathtracer ISPC - Model: Asian Dragon OpenBenchmarking.org Frames Per Second Per Watt, More Is Better Embree 3.13 Binary: Pathtracer ISPC - Model: Asian Dragon AVX-512 On 512 AVX-512 On AVX-512 Off 0.0203 0.0406 0.0609 0.0812 0.1015 0.077 0.078 0.090
Embree CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better Embree 3.13 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 On 512 AVX-512 On AVX-512 Off 900 1800 2700 3600 4500 Min: 4700 / Avg: 4746.84 / Max: 5101 Min: 4700 / Avg: 4748.06 / Max: 5300 Min: 4700 / Avg: 4765.12 / Max: 5300
Embree CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better Embree 3.13 CPU Power Consumption Monitor AVX-512 On AVX-512 On 512 AVX-512 Off 40 80 120 160 200 Min: 12.6 / Avg: 212.97 / Max: 241.03 Min: 12.42 / Avg: 212.61 / Max: 240.22 Min: 12.16 / Avg: 176.35 / Max: 205.68
Embree CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better Embree 3.13 CPU Temperature Monitor AVX-512 On 512 AVX-512 On AVX-512 Off 16 32 48 64 80 Min: 39 / Avg: 76.82 / Max: 84 Min: 38 / Avg: 76.74 / Max: 85 Min: 37 / Avg: 69.41 / Max: 75
Embree Binary: Pathtracer ISPC - Model: Asian Dragon Obj OpenBenchmarking.org Frames Per Second, More Is Better Embree 3.13 Binary: Pathtracer ISPC - Model: Asian Dragon Obj AVX-512 Off AVX-512 On 512 AVX-512 On 4 8 12 16 20 SE +/- 0.02, N = 3 SE +/- 0.03, N = 3 SE +/- 0.01, N = 3 14.02 14.35 14.43 MIN: 13.89 / MAX: 14.33 MIN: 14.2 / MAX: 14.69 MIN: 14.31 / MAX: 14.74
Embree Binary: Pathtracer ISPC - Model: Asian Dragon Obj OpenBenchmarking.org Frames Per Second Per Watt, More Is Better Embree 3.13 Binary: Pathtracer ISPC - Model: Asian Dragon Obj AVX-512 On 512 AVX-512 On AVX-512 Off 0.02 0.04 0.06 0.08 0.1 0.076 0.077 0.089
Embree CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better Embree 3.13 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 On 512 AVX-512 Off AVX-512 On 900 1800 2700 3600 4500 Min: 4700 / Avg: 4798.01 / Max: 5300 Min: 4700 / Avg: 4803.53 / Max: 5224 Min: 4700 / Avg: 4808.92 / Max: 5300
Embree CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better Embree 3.13 CPU Power Consumption Monitor AVX-512 On 512 AVX-512 On AVX-512 Off 40 80 120 160 200 Min: 12.47 / Avg: 188.21 / Max: 237.49 Min: 12.36 / Avg: 186.7 / Max: 237.13 Min: 12.35 / Avg: 158.11 / Max: 203.56
Embree CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better Embree 3.13 CPU Temperature Monitor AVX-512 On 512 AVX-512 On AVX-512 Off 16 32 48 64 80 Min: 40 / Avg: 74.96 / Max: 83 Min: 40 / Avg: 74.66 / Max: 84 Min: 39 / Avg: 68.47 / Max: 75
Embree Binary: Pathtracer ISPC - Model: Crown OpenBenchmarking.org Frames Per Second, More Is Better Embree 3.13 Binary: Pathtracer ISPC - Model: Crown AVX-512 Off AVX-512 On 512 AVX-512 On 4 8 12 16 20 SE +/- 0.11, N = 3 SE +/- 0.03, N = 3 SE +/- 0.03, N = 3 13.86 14.62 14.63 MIN: 13.49 / MAX: 14.34 MIN: 14.37 / MAX: 15.18 MIN: 14.41 / MAX: 15.16
Embree Binary: Pathtracer ISPC - Model: Crown OpenBenchmarking.org Frames Per Second Per Watt, More Is Better Embree 3.13 Binary: Pathtracer ISPC - Model: Crown AVX-512 On AVX-512 On 512 AVX-512 Off 0.0164 0.0328 0.0492 0.0656 0.082 0.063 0.063 0.073
Embree CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better Embree 3.13 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 Off AVX-512 On 512 AVX-512 On 900 1800 2700 3600 4500 Min: 4700 / Avg: 4736.93 / Max: 5274 Min: 4700 / Avg: 4741.65 / Max: 5192 Min: 4700 / Avg: 4747.38 / Max: 5300
Embree CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better Embree 3.13 CPU Power Consumption Monitor AVX-512 On 512 AVX-512 On AVX-512 Off 50 100 150 200 250 Min: 12.42 / Avg: 231.69 / Max: 256.24 Min: 12.58 / Avg: 230.62 / Max: 256.43 Min: 12.19 / Avg: 190.79 / Max: 210.6
Embree CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better Embree 3.13 CPU Temperature Monitor AVX-512 On AVX-512 On 512 AVX-512 Off 20 40 60 80 100 Min: 40 / Avg: 82.82 / Max: 90 Min: 40 / Avg: 82.5 / Max: 90 Min: 39 / Avg: 74.03 / Max: 79
GROMACS Implementation: MPI CPU - Input: water_GMX50_bare OpenBenchmarking.org Ns Per Day, More Is Better GROMACS 2022.1 Implementation: MPI CPU - Input: water_GMX50_bare AVX-512 Off AVX-512 On AVX-512 On 512 0.2329 0.4658 0.6987 0.9316 1.1645 SE +/- 0.002, N = 3 SE +/- 0.004, N = 3 SE +/- 0.001, N = 3 1.020 1.031 1.035 -mno-avx512f 1. (CXX) g++ options: -O3 -march=native
GROMACS Implementation: MPI CPU - Input: water_GMX50_bare OpenBenchmarking.org Ns Per Day Per Watt, More Is Better GROMACS 2022.1 Implementation: MPI CPU - Input: water_GMX50_bare AVX-512 On AVX-512 Off AVX-512 On 512 0.0014 0.0028 0.0042 0.0056 0.007 0.006 0.006 0.006
GROMACS CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better GROMACS 2022.1 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 On 512 AVX-512 Off AVX-512 On 900 1800 2700 3600 4500 Min: 4700 / Avg: 4778.77 / Max: 5300 Min: 4700 / Avg: 4781.57 / Max: 5267 Min: 4700 / Avg: 4784 / Max: 5300
GROMACS CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better GROMACS 2022.1 CPU Power Consumption Monitor AVX-512 On 512 AVX-512 Off AVX-512 On 40 80 120 160 200 Min: 12.08 / Avg: 175.38 / Max: 240.72 Min: 11.7 / Avg: 172.11 / Max: 186.28 Min: 11.96 / Avg: 170.87 / Max: 188.26
GROMACS CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better GROMACS 2022.1 CPU Temperature Monitor AVX-512 On 512 AVX-512 On AVX-512 Off 20 40 60 80 100 Min: 32 / Avg: 71.71 / Max: 89 Min: 32 / Avg: 70.87 / Max: 87 Min: 31 / Avg: 70.7 / Max: 87
Intel Open Image Denoise Run: RT.hdr_alb_nrm.3840x2160 OpenBenchmarking.org Images / Sec, More Is Better Intel Open Image Denoise 1.4.0 Run: RT.hdr_alb_nrm.3840x2160 AVX-512 On AVX-512 Off AVX-512 On 512 0.0968 0.1936 0.2904 0.3872 0.484 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 0.43 0.43 0.43
Intel Open Image Denoise Run: RT.hdr_alb_nrm.3840x2160 OpenBenchmarking.org Images / Sec Per Watt, More Is Better Intel Open Image Denoise 1.4.0 Run: RT.hdr_alb_nrm.3840x2160 AVX-512 On AVX-512 Off AVX-512 On 512 0.0007 0.0014 0.0021 0.0028 0.0035 0.003 0.003 0.003
Intel Open Image Denoise CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better Intel Open Image Denoise 1.4.0 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 On 512 AVX-512 On AVX-512 Off 900 1800 2700 3600 4500 Min: 4700 / Avg: 4851.22 / Max: 5300 Min: 3571 / Avg: 4858.54 / Max: 5310 Min: 4700 / Avg: 4865.94 / Max: 5286
Intel Open Image Denoise CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better Intel Open Image Denoise 1.4.0 CPU Power Consumption Monitor AVX-512 On 512 AVX-512 On AVX-512 Off 40 80 120 160 200 Min: 12.06 / Avg: 150.88 / Max: 237.41 Min: 12.03 / Avg: 150.73 / Max: 237.19 Min: 12.01 / Avg: 141.33 / Max: 222.42
Intel Open Image Denoise CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better Intel Open Image Denoise 1.4.0 CPU Temperature Monitor AVX-512 On AVX-512 On 512 AVX-512 Off 20 40 60 80 100 Min: 37 / Avg: 69.29 / Max: 95 Min: 37 / Avg: 69 / Max: 95 Min: 36 / Avg: 65.5 / Max: 88
Intel Open Image Denoise Run: RT.ldr_alb_nrm.3840x2160 OpenBenchmarking.org Images / Sec, More Is Better Intel Open Image Denoise 1.4.0 Run: RT.ldr_alb_nrm.3840x2160 AVX-512 On AVX-512 Off AVX-512 On 512 0.0968 0.1936 0.2904 0.3872 0.484 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 0.43 0.43 0.43
Intel Open Image Denoise Run: RT.ldr_alb_nrm.3840x2160 OpenBenchmarking.org Images / Sec Per Watt, More Is Better Intel Open Image Denoise 1.4.0 Run: RT.ldr_alb_nrm.3840x2160 AVX-512 On AVX-512 Off AVX-512 On 512 0.0007 0.0014 0.0021 0.0028 0.0035 0.003 0.003 0.003
Intel Open Image Denoise CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better Intel Open Image Denoise 1.4.0 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 On 512 AVX-512 Off AVX-512 On 900 1800 2700 3600 4500 Min: 4700 / Avg: 4857.45 / Max: 5305 Min: 4700 / Avg: 4875.18 / Max: 5300 Min: 4700 / Avg: 4882.39 / Max: 5312
Intel Open Image Denoise CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better Intel Open Image Denoise 1.4.0 CPU Power Consumption Monitor AVX-512 On AVX-512 On 512 AVX-512 Off 40 80 120 160 200 Min: 11.99 / Avg: 150.87 / Max: 235.4 Min: 11.99 / Avg: 150.51 / Max: 235.87 Min: 11.88 / Avg: 141.62 / Max: 221.74
Intel Open Image Denoise CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better Intel Open Image Denoise 1.4.0 CPU Temperature Monitor AVX-512 On AVX-512 On 512 AVX-512 Off 20 40 60 80 100 Min: 34 / Avg: 68.43 / Max: 94 Min: 34 / Avg: 67.93 / Max: 95 Min: 34 / Avg: 66 / Max: 91
Intel Open Image Denoise Run: RTLightmap.hdr.4096x4096 OpenBenchmarking.org Images / Sec, More Is Better Intel Open Image Denoise 1.4.0 Run: RTLightmap.hdr.4096x4096 AVX-512 On AVX-512 Off AVX-512 On 512 0.0473 0.0946 0.1419 0.1892 0.2365 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 0.21 0.21 0.21
Intel Open Image Denoise Run: RTLightmap.hdr.4096x4096 OpenBenchmarking.org Images / Sec Per Watt, More Is Better Intel Open Image Denoise 1.4.0 Run: RTLightmap.hdr.4096x4096 AVX-512 On AVX-512 Off AVX-512 On 512 0.0002 0.0004 0.0006 0.0008 0.001 0.001 0.001 0.001
Intel Open Image Denoise CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better Intel Open Image Denoise 1.4.0 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 On 512 AVX-512 Off AVX-512 On 900 1800 2700 3600 4500 Min: 3603 / Avg: 4840.9 / Max: 5310 Min: 4700 / Avg: 4858.52 / Max: 5300 Min: 4119 / Avg: 4870.24 / Max: 5313
Intel Open Image Denoise CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better Intel Open Image Denoise 1.4.0 CPU Power Consumption Monitor AVX-512 On AVX-512 On 512 AVX-512 Off 40 80 120 160 200 Min: 11.76 / Avg: 152.88 / Max: 234.36 Min: 11.75 / Avg: 152.84 / Max: 237.4 Min: 11.72 / Avg: 146.54 / Max: 222.43
Intel Open Image Denoise CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better Intel Open Image Denoise 1.4.0 CPU Temperature Monitor AVX-512 On 512 AVX-512 On AVX-512 Off 20 40 60 80 100 Min: 33 / Avg: 68.65 / Max: 93 Min: 33 / Avg: 68.63 / Max: 93 Min: 33 / Avg: 66.75 / Max: 90
LeelaChessZero Backend: BLAS OpenBenchmarking.org Nodes Per Second, More Is Better LeelaChessZero 0.28 Backend: BLAS AVX-512 Off AVX-512 On AVX-512 On 512 300 600 900 1200 1500 SE +/- 8.35, N = 3 SE +/- 17.53, N = 3 SE +/- 11.26, N = 9 1240 1268 1273 -mno-avx512f 1. (CXX) g++ options: -flto -O3 -march=native -pthread
LeelaChessZero Backend: BLAS OpenBenchmarking.org Nodes Per Second Per Watt, More Is Better LeelaChessZero 0.28 Backend: BLAS AVX-512 On 512 AVX-512 On AVX-512 Off 2 4 6 8 10 6.061 6.080 7.295
LeelaChessZero CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better LeelaChessZero 0.28 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 On AVX-512 On 512 AVX-512 Off 900 1800 2700 3600 4500 Min: 4700 / Avg: 4714.39 / Max: 5302 Min: 4700 / Avg: 4715.02 / Max: 5309 Min: 4700 / Avg: 4730.95 / Max: 5300
LeelaChessZero CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better LeelaChessZero 0.28 CPU Power Consumption Monitor AVX-512 On 512 AVX-512 On AVX-512 Off 40 80 120 160 200 Min: 12.35 / Avg: 210.02 / Max: 231.6 Min: 12.29 / Avg: 208.54 / Max: 230.94 Min: 12.26 / Avg: 169.99 / Max: 187.33
LeelaChessZero CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better LeelaChessZero 0.28 CPU Temperature Monitor AVX-512 On 512 AVX-512 On AVX-512 Off 20 40 60 80 100 Min: 38 / Avg: 82.27 / Max: 94 Min: 37 / Avg: 81.96 / Max: 92 Min: 38 / Avg: 72.81 / Max: 86
LeelaChessZero Backend: Eigen OpenBenchmarking.org Nodes Per Second, More Is Better LeelaChessZero 0.28 Backend: Eigen AVX-512 Off AVX-512 On AVX-512 On 512 300 600 900 1200 1500 SE +/- 10.84, N = 5 SE +/- 11.35, N = 3 SE +/- 14.97, N = 3 1062 1186 1194 -mno-avx512f 1. (CXX) g++ options: -flto -O3 -march=native -pthread
LeelaChessZero Backend: Eigen OpenBenchmarking.org Nodes Per Second Per Watt, More Is Better LeelaChessZero 0.28 Backend: Eigen AVX-512 On AVX-512 On 512 AVX-512 Off 2 4 6 8 10 5.732 5.734 6.296
LeelaChessZero CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better LeelaChessZero 0.28 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 On 512 AVX-512 On AVX-512 Off 900 1800 2700 3600 4500 Min: 4700 / Avg: 4714.46 / Max: 5300 Min: 4700 / Avg: 4716.16 / Max: 5309 Min: 4700 / Avg: 4742.26 / Max: 5300
LeelaChessZero CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better LeelaChessZero 0.28 CPU Power Consumption Monitor AVX-512 On 512 AVX-512 On AVX-512 Off 40 80 120 160 200 Min: 12.29 / Avg: 208.24 / Max: 229.04 Min: 12.13 / Avg: 206.92 / Max: 228.93 Min: 12.39 / Avg: 168.69 / Max: 185.14
LeelaChessZero CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better LeelaChessZero 0.28 CPU Temperature Monitor AVX-512 On AVX-512 On 512 AVX-512 Off 20 40 60 80 100 Min: 39 / Avg: 82.03 / Max: 93 Min: 39 / Avg: 81.97 / Max: 94 Min: 39 / Avg: 72.12 / Max: 84
Meta Performance Per Watts Performance Per Watts OpenBenchmarking.org Performance Per Watts, More Is Better Meta Performance Per Watts Performance Per Watts AVX-512 Off AVX-512 On 512 AVX-512 On 40 80 120 160 200 133.30 170.21 170.75
Mobile Neural Network Model: nasnet OpenBenchmarking.org ms, Fewer Is Better Mobile Neural Network 2.1 Model: nasnet AVX-512 On 512 AVX-512 On AVX-512 Off 2 4 6 8 10 SE +/- 0.087, N = 15 SE +/- 0.077, N = 15 SE +/- 0.056, N = 3 7.527 7.468 7.139 MIN: 6.72 / MAX: 17.92 MIN: 6.73 / MAX: 13.9 -mno-avx512f - MIN: 6.92 / MAX: 7.99 1. (CXX) g++ options: -O3 -march=native -std=c++11 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl
Mobile Neural Network Model: mobilenetV3 OpenBenchmarking.org ms, Fewer Is Better Mobile Neural Network 2.1 Model: mobilenetV3 AVX-512 On 512 AVX-512 Off AVX-512 On 0.2167 0.4334 0.6501 0.8668 1.0835 SE +/- 0.012, N = 15 SE +/- 0.003, N = 3 SE +/- 0.005, N = 15 0.963 0.942 0.938 MIN: 0.89 / MAX: 10.54 -mno-avx512f - MIN: 0.92 / MAX: 1.64 MIN: 0.89 / MAX: 3.62 1. (CXX) g++ options: -O3 -march=native -std=c++11 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl
Mobile Neural Network Model: squeezenetv1.1 OpenBenchmarking.org ms, Fewer Is Better Mobile Neural Network 2.1 Model: squeezenetv1.1 AVX-512 Off AVX-512 On 512 AVX-512 On 0.4552 0.9104 1.3656 1.8208 2.276 SE +/- 0.014, N = 3 SE +/- 0.014, N = 15 SE +/- 0.013, N = 15 2.023 1.675 1.670 -mno-avx512f - MIN: 1.97 / MAX: 2.72 MIN: 1.55 / MAX: 7.76 MIN: 1.54 / MAX: 11.33 1. (CXX) g++ options: -O3 -march=native -std=c++11 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl
Mobile Neural Network Model: resnet-v2-50 OpenBenchmarking.org ms, Fewer Is Better Mobile Neural Network 2.1 Model: resnet-v2-50 AVX-512 Off AVX-512 On 512 AVX-512 On 4 8 12 16 20 SE +/- 0.08, N = 3 SE +/- 0.04, N = 15 SE +/- 0.05, N = 15 18.04 10.37 10.30 -mno-avx512f - MIN: 17.67 / MAX: 24.46 MIN: 10.05 / MAX: 22.64 MIN: 9.74 / MAX: 33.88 1. (CXX) g++ options: -O3 -march=native -std=c++11 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl
Mobile Neural Network Model: SqueezeNetV1.0 OpenBenchmarking.org ms, Fewer Is Better Mobile Neural Network 2.1 Model: SqueezeNetV1.0 AVX-512 Off AVX-512 On 512 AVX-512 On 0.8312 1.6624 2.4936 3.3248 4.156 SE +/- 0.032, N = 3 SE +/- 0.022, N = 15 SE +/- 0.020, N = 15 3.694 3.114 3.073 -mno-avx512f - MIN: 3.57 / MAX: 4.37 MIN: 2.9 / MAX: 9.42 MIN: 2.89 / MAX: 8.65 1. (CXX) g++ options: -O3 -march=native -std=c++11 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl
Mobile Neural Network Model: MobileNetV2_224 OpenBenchmarking.org ms, Fewer Is Better Mobile Neural Network 2.1 Model: MobileNetV2_224 AVX-512 On AVX-512 On 512 AVX-512 Off 0.4795 0.959 1.4385 1.918 2.3975 SE +/- 0.014, N = 15 SE +/- 0.014, N = 15 SE +/- 0.019, N = 3 2.131 2.125 1.934 MIN: 2.03 / MAX: 8.46 MIN: 2.03 / MAX: 8.62 -mno-avx512f - MIN: 1.84 / MAX: 11.59 1. (CXX) g++ options: -O3 -march=native -std=c++11 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl
Mobile Neural Network Model: mobilenet-v1-1.0 OpenBenchmarking.org ms, Fewer Is Better Mobile Neural Network 2.1 Model: mobilenet-v1-1.0 AVX-512 On 512 AVX-512 On AVX-512 Off 0.4475 0.895 1.3425 1.79 2.2375 SE +/- 0.007, N = 15 SE +/- 0.005, N = 15 SE +/- 0.007, N = 3 1.989 1.972 1.798 MIN: 1.9 / MAX: 8.1 MIN: 1.8 / MAX: 8.03 -mno-avx512f - MIN: 1.74 / MAX: 2.69 1. (CXX) g++ options: -O3 -march=native -std=c++11 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl
Mobile Neural Network Model: inception-v3 OpenBenchmarking.org ms, Fewer Is Better Mobile Neural Network 2.1 Model: inception-v3 AVX-512 Off AVX-512 On AVX-512 On 512 6 12 18 24 30 SE +/- 0.02, N = 3 SE +/- 0.26, N = 15 SE +/- 0.27, N = 15 23.42 19.58 19.40 -mno-avx512f - MIN: 22.95 / MAX: 30.84 MIN: 17.25 / MAX: 32.64 MIN: 17.18 / MAX: 49.2 1. (CXX) g++ options: -O3 -march=native -std=c++11 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl
Mobile Neural Network CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better Mobile Neural Network 2.1 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 On 512 AVX-512 On AVX-512 Off 900 1800 2700 3600 4500 Min: 3500 / Avg: 4644.38 / Max: 5300 Min: 3483 / Avg: 4653.2 / Max: 5308 Min: 4700 / Avg: 4718.12 / Max: 5300
Mobile Neural Network CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better Mobile Neural Network 2.1 CPU Power Consumption Monitor AVX-512 On 512 AVX-512 On AVX-512 Off 50 100 150 200 250 Min: 12.18 / Avg: 228.4 / Max: 260.3 Min: 12.33 / Avg: 226.92 / Max: 259.77 Min: 12.53 / Avg: 201.43 / Max: 226.39
Mobile Neural Network CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better Mobile Neural Network 2.1 CPU Temperature Monitor AVX-512 On 512 AVX-512 On AVX-512 Off 20 40 60 80 100 Min: 41 / Avg: 86.3 / Max: 95 Min: 39 / Avg: 85.37 / Max: 95 Min: 38 / Avg: 78.24 / Max: 84
NCNN Target: CPU - Model: mobilenet OpenBenchmarking.org ms, Fewer Is Better NCNN 20220729 Target: CPU - Model: mobilenet AVX-512 On 512 AVX-512 On AVX-512 Off 3 6 9 12 15 SE +/- 0.13, N = 3 SE +/- 0.15, N = 3 SE +/- 0.02, N = 3 12.28 12.28 11.43 MIN: 11.87 / MAX: 18.86 MIN: 11.79 / MAX: 13.67 -mno-avx512f - MIN: 11.21 / MAX: 16.87 1. (CXX) g++ options: -O3 -march=native -rdynamic -lgomp -lpthread
NCNN Target: CPU-v2-v2 - Model: mobilenet-v2 OpenBenchmarking.org ms, Fewer Is Better NCNN 20220729 Target: CPU-v2-v2 - Model: mobilenet-v2 AVX-512 On 512 AVX-512 On AVX-512 Off 0.8483 1.6966 2.5449 3.3932 4.2415 SE +/- 0.05, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 3.77 3.73 3.34 MIN: 3.53 / MAX: 4.4 MIN: 3.56 / MAX: 5.05 -mno-avx512f - MIN: 3.16 / MAX: 5.05 1. (CXX) g++ options: -O3 -march=native -rdynamic -lgomp -lpthread
NCNN Target: CPU-v3-v3 - Model: mobilenet-v3 OpenBenchmarking.org ms, Fewer Is Better NCNN 20220729 Target: CPU-v3-v3 - Model: mobilenet-v3 AVX-512 On 512 AVX-512 On AVX-512 Off 0.6098 1.2196 1.8294 2.4392 3.049 SE +/- 0.05, N = 3 SE +/- 0.03, N = 3 SE +/- 0.01, N = 3 2.71 2.68 2.49 MIN: 2.55 / MAX: 3.5 MIN: 2.56 / MAX: 3.63 -mno-avx512f - MIN: 2.4 / MAX: 3.36 1. (CXX) g++ options: -O3 -march=native -rdynamic -lgomp -lpthread
NCNN Target: CPU - Model: shufflenet-v2 OpenBenchmarking.org ms, Fewer Is Better NCNN 20220729 Target: CPU - Model: shufflenet-v2 AVX-512 On 512 AVX-512 Off AVX-512 On 0.5243 1.0486 1.5729 2.0972 2.6215 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 2.33 2.33 2.33 MIN: 2.27 / MAX: 2.81 -mno-avx512f - MIN: 2.27 / MAX: 3.18 MIN: 2.26 / MAX: 3.21 1. (CXX) g++ options: -O3 -march=native -rdynamic -lgomp -lpthread
NCNN Target: CPU - Model: mnasnet OpenBenchmarking.org ms, Fewer Is Better NCNN 20220729 Target: CPU - Model: mnasnet AVX-512 On AVX-512 On 512 AVX-512 Off 0.5895 1.179 1.7685 2.358 2.9475 SE +/- 0.03, N = 3 SE +/- 0.03, N = 3 SE +/- 0.03, N = 3 2.62 2.58 2.37 MIN: 2.48 / MAX: 3.81 MIN: 2.48 / MAX: 3.14 -mno-avx512f - MIN: 2.28 / MAX: 3.27 1. (CXX) g++ options: -O3 -march=native -rdynamic -lgomp -lpthread
NCNN Target: CPU - Model: efficientnet-b0 OpenBenchmarking.org ms, Fewer Is Better NCNN 20220729 Target: CPU - Model: efficientnet-b0 AVX-512 On AVX-512 On 512 AVX-512 Off 1.0935 2.187 3.2805 4.374 5.4675 SE +/- 0.06, N = 3 SE +/- 0.05, N = 3 SE +/- 0.05, N = 3 4.86 4.79 4.35 MIN: 4.6 / MAX: 6.13 MIN: 4.61 / MAX: 9.9 -mno-avx512f - MIN: 4.2 / MAX: 5.22 1. (CXX) g++ options: -O3 -march=native -rdynamic -lgomp -lpthread
NCNN Target: CPU - Model: blazeface OpenBenchmarking.org ms, Fewer Is Better NCNN 20220729 Target: CPU - Model: blazeface AVX-512 On 512 AVX-512 On AVX-512 Off 0.18 0.36 0.54 0.72 0.9 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 0.80 0.80 0.76 MIN: 0.77 / MAX: 1.28 MIN: 0.77 / MAX: 1.52 -mno-avx512f - MIN: 0.73 / MAX: 1.52 1. (CXX) g++ options: -O3 -march=native -rdynamic -lgomp -lpthread
NCNN Target: CPU - Model: googlenet OpenBenchmarking.org ms, Fewer Is Better NCNN 20220729 Target: CPU - Model: googlenet AVX-512 On AVX-512 On 512 AVX-512 Off 3 6 9 12 15 SE +/- 0.00, N = 3 SE +/- 0.13, N = 3 SE +/- 0.03, N = 3 10.16 9.96 9.55 MIN: 9.92 / MAX: 11.36 MIN: 9.52 / MAX: 10.98 -mno-avx512f - MIN: 9.33 / MAX: 10.86 1. (CXX) g++ options: -O3 -march=native -rdynamic -lgomp -lpthread
NCNN Target: CPU - Model: vgg16 OpenBenchmarking.org ms, Fewer Is Better NCNN 20220729 Target: CPU - Model: vgg16 AVX-512 Off AVX-512 On AVX-512 On 512 10 20 30 40 50 SE +/- 0.13, N = 3 SE +/- 0.13, N = 3 SE +/- 0.23, N = 3 45.68 44.74 44.59 -mno-avx512f - MIN: 44.98 / MAX: 50.56 MIN: 44.1 / MAX: 49.06 MIN: 43.87 / MAX: 50.43 1. (CXX) g++ options: -O3 -march=native -rdynamic -lgomp -lpthread
NCNN Target: CPU - Model: resnet18 OpenBenchmarking.org ms, Fewer Is Better NCNN 20220729 Target: CPU - Model: resnet18 AVX-512 On AVX-512 On 512 AVX-512 Off 2 4 6 8 10 SE +/- 0.02, N = 3 SE +/- 0.02, N = 3 SE +/- 0.00, N = 3 8.69 8.64 8.24 MIN: 8.51 / MAX: 14.15 MIN: 8.45 / MAX: 9.39 -mno-avx512f - MIN: 8.06 / MAX: 9.19 1. (CXX) g++ options: -O3 -march=native -rdynamic -lgomp -lpthread
NCNN Target: CPU - Model: alexnet OpenBenchmarking.org ms, Fewer Is Better NCNN 20220729 Target: CPU - Model: alexnet AVX-512 On AVX-512 On 512 AVX-512 Off 2 4 6 8 10 SE +/- 0.02, N = 3 SE +/- 0.19, N = 3 SE +/- 0.01, N = 3 6.98 6.69 6.33 MIN: 6.82 / MAX: 7.88 MIN: 6.2 / MAX: 7.35 -mno-avx512f - MIN: 6.2 / MAX: 7.75 1. (CXX) g++ options: -O3 -march=native -rdynamic -lgomp -lpthread
NCNN Target: CPU - Model: resnet50 OpenBenchmarking.org ms, Fewer Is Better NCNN 20220729 Target: CPU - Model: resnet50 AVX-512 On 512 AVX-512 On AVX-512 Off 4 8 12 16 20 SE +/- 0.42, N = 3 SE +/- 0.42, N = 3 SE +/- 0.02, N = 3 16.24 15.99 15.40 MIN: 15.19 / MAX: 17.46 MIN: 15.25 / MAX: 18.48 -mno-avx512f - MIN: 15.07 / MAX: 24.51 1. (CXX) g++ options: -O3 -march=native -rdynamic -lgomp -lpthread
NCNN Target: CPU - Model: yolov4-tiny OpenBenchmarking.org ms, Fewer Is Better NCNN 20220729 Target: CPU - Model: yolov4-tiny AVX-512 On 512 AVX-512 On AVX-512 Off 5 10 15 20 25 SE +/- 0.44, N = 3 SE +/- 0.41, N = 3 SE +/- 0.06, N = 3 22.01 20.99 18.80 MIN: 21.29 / MAX: 26.71 MIN: 20.36 / MAX: 37.15 -mno-avx512f - MIN: 18.51 / MAX: 19.88 1. (CXX) g++ options: -O3 -march=native -rdynamic -lgomp -lpthread
NCNN Target: CPU - Model: squeezenet_ssd OpenBenchmarking.org ms, Fewer Is Better NCNN 20220729 Target: CPU - Model: squeezenet_ssd AVX-512 On 512 AVX-512 On AVX-512 Off 4 8 12 16 20 SE +/- 0.05, N = 3 SE +/- 0.18, N = 3 SE +/- 0.04, N = 3 17.34 17.19 13.89 MIN: 17.03 / MAX: 18.98 MIN: 16.54 / MAX: 25.09 -mno-avx512f - MIN: 13.58 / MAX: 15.32 1. (CXX) g++ options: -O3 -march=native -rdynamic -lgomp -lpthread
NCNN Target: CPU - Model: regnety_400m OpenBenchmarking.org ms, Fewer Is Better NCNN 20220729 Target: CPU - Model: regnety_400m AVX-512 On 512 AVX-512 On AVX-512 Off 2 4 6 8 10 SE +/- 0.03, N = 3 SE +/- 0.02, N = 3 SE +/- 0.02, N = 3 7.10 7.05 6.70 MIN: 6.91 / MAX: 11.12 MIN: 6.87 / MAX: 8.31 -mno-avx512f - MIN: 6.54 / MAX: 7.93 1. (CXX) g++ options: -O3 -march=native -rdynamic -lgomp -lpthread
NCNN Target: CPU - Model: vision_transformer OpenBenchmarking.org ms, Fewer Is Better NCNN 20220729 Target: CPU - Model: vision_transformer AVX-512 Off AVX-512 On AVX-512 On 512 20 40 60 80 100 SE +/- 0.39, N = 3 SE +/- 0.11, N = 3 SE +/- 0.12, N = 3 110.38 87.29 70.39 -mno-avx512f - MIN: 109.43 / MAX: 116.1 MIN: 86.63 / MAX: 92.92 MIN: 69.62 / MAX: 71.72 1. (CXX) g++ options: -O3 -march=native -rdynamic -lgomp -lpthread
NCNN Target: CPU - Model: FastestDet OpenBenchmarking.org ms, Fewer Is Better NCNN 20220729 Target: CPU - Model: FastestDet AVX-512 On 512 AVX-512 On AVX-512 Off 0.6705 1.341 2.0115 2.682 3.3525 SE +/- 0.08, N = 3 SE +/- 0.08, N = 3 SE +/- 0.02, N = 3 2.98 2.98 2.85 MIN: 2.84 / MAX: 3.6 MIN: 2.81 / MAX: 3.62 -mno-avx512f - MIN: 2.78 / MAX: 3.41 1. (CXX) g++ options: -O3 -march=native -rdynamic -lgomp -lpthread
NCNN CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better NCNN 20220729 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 On AVX-512 On 512 AVX-512 Off 900 1800 2700 3600 4500 Min: 4700 / Avg: 4729.61 / Max: 5300 Min: 4700 / Avg: 4737.32 / Max: 5298 Min: 4724 / Avg: 4816.34 / Max: 5306
NCNN CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better NCNN 20220729 CPU Power Consumption Monitor AVX-512 On 512 AVX-512 On AVX-512 Off 40 80 120 160 200 Min: 12.42 / Avg: 165.72 / Max: 234.24 Min: 12.52 / Avg: 163.79 / Max: 200.07 Min: 12.39 / Avg: 148.04 / Max: 172.75
NCNN CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better NCNN 20220729 CPU Temperature Monitor AVX-512 On 512 AVX-512 On AVX-512 Off 16 32 48 64 80 Min: 42 / Avg: 71.88 / Max: 87 Min: 40 / Avg: 70.36 / Max: 80 Min: 40 / Avg: 65.4 / Max: 71
Neural Magic DeepSparse Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Synchronous Single-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.1 Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Synchronous Single-Stream AVX-512 Off AVX-512 On AVX-512 On 512 8 16 24 32 40 SE +/- 0.02, N = 3 SE +/- 0.07, N = 3 SE +/- 0.11, N = 3 28.97 35.38 35.42
Neural Magic DeepSparse Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Synchronous Single-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.1 Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Synchronous Single-Stream AVX-512 Off AVX-512 On AVX-512 On 512 8 16 24 32 40 SE +/- 0.02, N = 3 SE +/- 0.06, N = 3 SE +/- 0.08, N = 3 34.51 28.26 28.22
Neural Magic DeepSparse CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better Neural Magic DeepSparse 1.1 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 On AVX-512 On 512 AVX-512 Off 900 1800 2700 3600 4500 Min: 4651 / Avg: 4793.56 / Max: 5300 Min: 4669 / Avg: 4825.21 / Max: 5300 Min: 4700 / Avg: 4850.7 / Max: 5301
Neural Magic DeepSparse CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better Neural Magic DeepSparse 1.1 CPU Power Consumption Monitor AVX-512 On AVX-512 On 512 AVX-512 Off 40 80 120 160 200 Min: 12.52 / Avg: 194.6 / Max: 244.04 Min: 12.22 / Avg: 188.58 / Max: 244.57 Min: 12.18 / Avg: 155.44 / Max: 200.14
Neural Magic DeepSparse CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better Neural Magic DeepSparse 1.1 CPU Temperature Monitor AVX-512 On AVX-512 On 512 AVX-512 Off 20 40 60 80 100 Min: 39 / Avg: 79.78 / Max: 91 Min: 38 / Avg: 77.04 / Max: 92 Min: 35 / Avg: 69.17 / Max: 81
Neural Magic DeepSparse Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.1 Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-Stream AVX-512 Off AVX-512 On 512 AVX-512 On 9 18 27 36 45 SE +/- 0.02, N = 3 SE +/- 0.22, N = 3 SE +/- 0.12, N = 3 35.52 40.80 40.87
Neural Magic DeepSparse Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.1 Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-Stream AVX-512 Off AVX-512 On 512 AVX-512 On 30 60 90 120 150 SE +/- 0.07, N = 3 SE +/- 0.54, N = 3 SE +/- 0.31, N = 3 112.60 98.03 97.85
Neural Magic DeepSparse CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better Neural Magic DeepSparse 1.1 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 On 512 AVX-512 On AVX-512 Off 900 1800 2700 3600 4500 Min: 3500 / Avg: 4771.09 / Max: 5310 Min: 4550 / Avg: 4788.85 / Max: 5300 Min: 4700 / Avg: 4864.38 / Max: 5300
Neural Magic DeepSparse CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better Neural Magic DeepSparse 1.1 CPU Power Consumption Monitor AVX-512 On 512 AVX-512 On AVX-512 Off 50 100 150 200 250 Min: 12.38 / Avg: 190.62 / Max: 262.43 Min: 12.48 / Avg: 190.62 / Max: 260.18 Min: 12.38 / Avg: 167.33 / Max: 219.34
Neural Magic DeepSparse CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better Neural Magic DeepSparse 1.1 CPU Temperature Monitor AVX-512 On AVX-512 On 512 AVX-512 Off 20 40 60 80 100 Min: 40 / Avg: 78.33 / Max: 92 Min: 39 / Avg: 78.25 / Max: 94 Min: 38 / Avg: 72.32 / Max: 85
Neural Magic DeepSparse Model: NLP Text Classification, DistilBERT mnli - Scenario: Synchronous Single-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.1 Model: NLP Text Classification, DistilBERT mnli - Scenario: Synchronous Single-Stream AVX-512 Off AVX-512 On AVX-512 On 512 15 30 45 60 75 SE +/- 0.03, N = 3 SE +/- 0.05, N = 3 SE +/- 0.03, N = 3 56.59 68.76 68.77
Neural Magic DeepSparse Model: NLP Text Classification, DistilBERT mnli - Scenario: Synchronous Single-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.1 Model: NLP Text Classification, DistilBERT mnli - Scenario: Synchronous Single-Stream AVX-512 Off AVX-512 On AVX-512 On 512 4 8 12 16 20 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 17.66 14.54 14.54
Neural Magic DeepSparse CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better Neural Magic DeepSparse 1.1 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 On AVX-512 On 512 AVX-512 Off 900 1800 2700 3600 4500 Min: 4700 / Avg: 4769.5 / Max: 5309 Min: 4700 / Avg: 4800.61 / Max: 5310 Min: 4700 / Avg: 4829.28 / Max: 5301
Neural Magic DeepSparse CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better Neural Magic DeepSparse 1.1 CPU Power Consumption Monitor AVX-512 On AVX-512 On 512 AVX-512 Off 40 80 120 160 200 Min: 12.29 / Avg: 180.67 / Max: 210.72 Min: 12.32 / Avg: 171.93 / Max: 211.04 Min: 12.39 / Avg: 153.63 / Max: 193.33
Neural Magic DeepSparse CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better Neural Magic DeepSparse 1.1 CPU Temperature Monitor AVX-512 On AVX-512 On 512 AVX-512 Off 15 30 45 60 75 Min: 40 / Avg: 72.9 / Max: 79 Min: 38 / Avg: 69.89 / Max: 79 Min: 38 / Avg: 66.44 / Max: 73
Neural Magic DeepSparse Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.1 Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream AVX-512 Off AVX-512 On AVX-512 On 512 20 40 60 80 100 SE +/- 0.03, N = 3 SE +/- 0.12, N = 3 SE +/- 0.06, N = 3 69.10 80.67 81.02
Neural Magic DeepSparse Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.1 Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream AVX-512 Off AVX-512 On AVX-512 On 512 13 26 39 52 65 SE +/- 0.03, N = 3 SE +/- 0.07, N = 3 SE +/- 0.03, N = 3 57.88 49.57 49.36
Neural Magic DeepSparse CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better Neural Magic DeepSparse 1.1 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 On AVX-512 On 512 AVX-512 Off 900 1800 2700 3600 4500 Min: 4700 / Avg: 4777.02 / Max: 5300 Min: 4700 / Avg: 4777.6 / Max: 5301 Min: 4700 / Avg: 4802.88 / Max: 5301
Neural Magic DeepSparse CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better Neural Magic DeepSparse 1.1 CPU Power Consumption Monitor AVX-512 On 512 AVX-512 On AVX-512 Off 40 80 120 160 200 Min: 12.41 / Avg: 191.37 / Max: 225.56 Min: 12.55 / Avg: 190.88 / Max: 225.22 Min: 12.42 / Avg: 169 / Max: 204.27
Neural Magic DeepSparse CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better Neural Magic DeepSparse 1.1 CPU Temperature Monitor AVX-512 On AVX-512 On 512 AVX-512 Off 16 32 48 64 80 Min: 40 / Avg: 73.39 / Max: 81 Min: 39 / Avg: 73.25 / Max: 82 Min: 39 / Avg: 69.87 / Max: 78
Neural Magic DeepSparse Model: CV Classification, ResNet-50 ImageNet - Scenario: Synchronous Single-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.1 Model: CV Classification, ResNet-50 ImageNet - Scenario: Synchronous Single-Stream AVX-512 Off AVX-512 On AVX-512 On 512 30 60 90 120 150 SE +/- 0.04, N = 3 SE +/- 0.48, N = 3 SE +/- 0.12, N = 3 85.98 132.91 133.74
Neural Magic DeepSparse Model: CV Classification, ResNet-50 ImageNet - Scenario: Synchronous Single-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.1 Model: CV Classification, ResNet-50 ImageNet - Scenario: Synchronous Single-Stream AVX-512 Off AVX-512 On AVX-512 On 512 3 6 9 12 15 SE +/- 0.0062, N = 3 SE +/- 0.0274, N = 3 SE +/- 0.0069, N = 3 11.6244 7.5173 7.4707
Neural Magic DeepSparse CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better Neural Magic DeepSparse 1.1 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 On AVX-512 On 512 AVX-512 Off 900 1800 2700 3600 4500 Min: 3556 / Avg: 4766.8 / Max: 5302 Min: 4631 / Avg: 4780.28 / Max: 5300 Min: 4700 / Avg: 4780.8 / Max: 5312
Neural Magic DeepSparse CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better Neural Magic DeepSparse 1.1 CPU Power Consumption Monitor AVX-512 On 512 AVX-512 On AVX-512 Off 40 80 120 160 200 Min: 12.3 / Avg: 209.51 / Max: 246.88 Min: 12.32 / Avg: 201.37 / Max: 246.43 Min: 12.35 / Avg: 183.63 / Max: 214.9
Neural Magic DeepSparse CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better Neural Magic DeepSparse 1.1 CPU Temperature Monitor AVX-512 On 512 AVX-512 On AVX-512 Off 20 40 60 80 100 Min: 39 / Avg: 81.82 / Max: 92 Min: 38 / Avg: 79.49 / Max: 92 Min: 39 / Avg: 74.18 / Max: 83
Neural Magic DeepSparse Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.1 Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream AVX-512 Off AVX-512 On AVX-512 On 512 30 60 90 120 150 SE +/- 0.14, N = 3 SE +/- 0.92, N = 3 SE +/- 0.68, N = 3 101.64 155.39 156.81
Neural Magic DeepSparse Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.1 Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream AVX-512 Off AVX-512 On AVX-512 On 512 9 18 27 36 45 SE +/- 0.05, N = 3 SE +/- 0.15, N = 3 SE +/- 0.11, N = 3 39.35 25.73 25.49
Neural Magic DeepSparse CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better Neural Magic DeepSparse 1.1 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 On AVX-512 On 512 AVX-512 Off 900 1800 2700 3600 4500 Min: 3500 / Avg: 4648.5 / Max: 5302 Min: 3500 / Avg: 4682.19 / Max: 5300 Min: 4700 / Avg: 4768.47 / Max: 5302
Neural Magic DeepSparse CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better Neural Magic DeepSparse 1.1 CPU Power Consumption Monitor AVX-512 On 512 AVX-512 On AVX-512 Off 50 100 150 200 250 Min: 12.31 / Avg: 211.91 / Max: 258.7 Min: 12.48 / Avg: 211.14 / Max: 256.86 Min: 12.46 / Avg: 198.19 / Max: 227.43
Neural Magic DeepSparse CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better Neural Magic DeepSparse 1.1 CPU Temperature Monitor AVX-512 On 512 AVX-512 On AVX-512 Off 20 40 60 80 100 Min: 41 / Avg: 82.64 / Max: 96 Min: 40 / Avg: 82.42 / Max: 94 Min: 40 / Avg: 78.22 / Max: 86
Neural Magic DeepSparse Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Synchronous Single-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.1 Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Synchronous Single-Stream AVX-512 Off AVX-512 On AVX-512 On 512 3 6 9 12 15 SE +/- 0.0071, N = 3 SE +/- 0.0785, N = 3 SE +/- 0.0301, N = 3 7.8089 8.8759 8.9905
Neural Magic DeepSparse Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Synchronous Single-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.1 Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Synchronous Single-Stream AVX-512 Off AVX-512 On AVX-512 On 512 30 60 90 120 150 SE +/- 0.12, N = 3 SE +/- 1.00, N = 3 SE +/- 0.37, N = 3 128.05 112.68 111.22
Neural Magic DeepSparse CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better Neural Magic DeepSparse 1.1 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 On AVX-512 On 512 AVX-512 Off 900 1800 2700 3600 4500 Min: 3500 / Avg: 4747.88 / Max: 5310 Min: 4575 / Avg: 4802.05 / Max: 5300 Min: 4700 / Avg: 4847.56 / Max: 5310
Neural Magic DeepSparse CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better Neural Magic DeepSparse 1.1 CPU Power Consumption Monitor AVX-512 On 512 AVX-512 On AVX-512 Off 50 100 150 200 250 Min: 12.38 / Avg: 193.85 / Max: 256.16 Min: 12.46 / Avg: 192.59 / Max: 258.71 Min: 12.38 / Avg: 167.69 / Max: 217.29
Neural Magic DeepSparse CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better Neural Magic DeepSparse 1.1 CPU Temperature Monitor AVX-512 On 512 AVX-512 On AVX-512 Off 20 40 60 80 100 Min: 39 / Avg: 79.14 / Max: 92 Min: 39 / Avg: 78.7 / Max: 94 Min: 38 / Avg: 71.71 / Max: 85
Neural Magic DeepSparse Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.1 Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Stream AVX-512 Off AVX-512 On AVX-512 On 512 3 6 9 12 15 SE +/- 0.0060, N = 3 SE +/- 0.0648, N = 3 SE +/- 0.0140, N = 3 8.1213 8.9516 9.0886
Neural Magic DeepSparse Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.1 Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Stream AVX-512 Off AVX-512 On AVX-512 On 512 110 220 330 440 550 SE +/- 0.40, N = 3 SE +/- 3.25, N = 3 SE +/- 0.68, N = 3 492.38 446.88 440.10
Neural Magic DeepSparse CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better Neural Magic DeepSparse 1.1 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 On AVX-512 On 512 AVX-512 Off 900 1800 2700 3600 4500 Min: 3500 / Avg: 4711.32 / Max: 5304 Min: 4389 / Avg: 4809.78 / Max: 5300 Min: 4700 / Avg: 4862.17 / Max: 5301
Neural Magic DeepSparse CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better Neural Magic DeepSparse 1.1 CPU Power Consumption Monitor AVX-512 On 512 AVX-512 On AVX-512 Off 50 100 150 200 250 Min: 12.39 / Avg: 189.75 / Max: 259.61 Min: 12.5 / Avg: 186.42 / Max: 260.13 Min: 12.43 / Avg: 168.83 / Max: 221.42
Neural Magic DeepSparse CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better Neural Magic DeepSparse 1.1 CPU Temperature Monitor AVX-512 On 512 AVX-512 On AVX-512 Off 20 40 60 80 100 Min: 40 / Avg: 78.69 / Max: 92 Min: 41 / Avg: 76.64 / Max: 95 Min: 39 / Avg: 72.83 / Max: 87
Neural Magic DeepSparse Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Synchronous Single-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.1 Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Synchronous Single-Stream AVX-512 Off AVX-512 On 512 AVX-512 On 10 20 30 40 50 SE +/- 0.05, N = 3 SE +/- 0.19, N = 3 SE +/- 0.20, N = 3 25.54 43.44 43.68
Neural Magic DeepSparse Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Synchronous Single-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.1 Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Synchronous Single-Stream AVX-512 Off AVX-512 On 512 AVX-512 On 9 18 27 36 45 SE +/- 0.08, N = 3 SE +/- 0.10, N = 3 SE +/- 0.10, N = 3 39.14 23.01 22.89
Neural Magic DeepSparse CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better Neural Magic DeepSparse 1.1 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 On AVX-512 On 512 AVX-512 Off 900 1800 2700 3600 4500 Min: 4700 / Avg: 4810.87 / Max: 5300 Min: 4700 / Avg: 4865.03 / Max: 5312 Min: 4700 / Avg: 4884.74 / Max: 5310
Neural Magic DeepSparse CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better Neural Magic DeepSparse 1.1 CPU Power Consumption Monitor AVX-512 On AVX-512 On 512 AVX-512 Off 50 100 150 200 250 Min: 12.24 / Avg: 188.78 / Max: 249.74 Min: 12.27 / Avg: 178.55 / Max: 250.04 Min: 12.29 / Avg: 152.74 / Max: 206.29
Neural Magic DeepSparse CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better Neural Magic DeepSparse 1.1 CPU Temperature Monitor AVX-512 On AVX-512 On 512 AVX-512 Off 20 40 60 80 100 Min: 39 / Avg: 75.07 / Max: 90 Min: 38 / Avg: 73.65 / Max: 89 Min: 38 / Avg: 64.6 / Max: 73
Neural Magic DeepSparse Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.1 Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-Stream AVX-512 Off AVX-512 On AVX-512 On 512 8 16 24 32 40 SE +/- 0.15, N = 3 SE +/- 0.03, N = 3 SE +/- 0.02, N = 3 26.53 36.60 36.86
Neural Magic DeepSparse Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.1 Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-Stream AVX-512 Off AVX-512 On AVX-512 On 512 30 60 90 120 150 SE +/- 0.85, N = 3 SE +/- 0.09, N = 3 SE +/- 0.07, N = 3 150.77 109.28 108.49
Neural Magic DeepSparse CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better Neural Magic DeepSparse 1.1 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 On AVX-512 On 512 AVX-512 Off 900 1800 2700 3600 4500 Min: 4700 / Avg: 4803.42 / Max: 5300 Min: 4700 / Avg: 4813.34 / Max: 5300 Min: 4700 / Avg: 4899.77 / Max: 5314
Neural Magic DeepSparse CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better Neural Magic DeepSparse 1.1 CPU Power Consumption Monitor AVX-512 On AVX-512 On 512 AVX-512 Off 40 80 120 160 200 Min: 12.58 / Avg: 186.84 / Max: 241.51 Min: 12.39 / Avg: 185.33 / Max: 241.17 Min: 12.57 / Avg: 151.3 / Max: 208.63
Neural Magic DeepSparse CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better Neural Magic DeepSparse 1.1 CPU Temperature Monitor AVX-512 On AVX-512 On 512 AVX-512 Off 20 40 60 80 100 Min: 40 / Avg: 74.99 / Max: 88 Min: 37 / Avg: 73.66 / Max: 88 Min: 39 / Avg: 65.01 / Max: 75
Neural Magic DeepSparse Model: CV Detection,YOLOv5s COCO - Scenario: Synchronous Single-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.1 Model: CV Detection,YOLOv5s COCO - Scenario: Synchronous Single-Stream AVX-512 Off AVX-512 On AVX-512 On 512 11 22 33 44 55 SE +/- 0.01, N = 3 SE +/- 0.15, N = 3 SE +/- 0.04, N = 3 43.39 49.67 49.99
Neural Magic DeepSparse Model: CV Detection,YOLOv5s COCO - Scenario: Synchronous Single-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.1 Model: CV Detection,YOLOv5s COCO - Scenario: Synchronous Single-Stream AVX-512 Off AVX-512 On AVX-512 On 512 6 12 18 24 30 SE +/- 0.00, N = 3 SE +/- 0.06, N = 3 SE +/- 0.02, N = 3 23.04 20.13 19.99
Neural Magic DeepSparse CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better Neural Magic DeepSparse 1.1 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 On AVX-512 Off AVX-512 On 512 900 1800 2700 3600 4500 Min: 4700 / Avg: 4785.87 / Max: 5309 Min: 4700 / Avg: 4792.9 / Max: 5300 Min: 4700 / Avg: 4796.86 / Max: 5302
Neural Magic DeepSparse CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better Neural Magic DeepSparse 1.1 CPU Power Consumption Monitor AVX-512 On 512 AVX-512 On AVX-512 Off 40 80 120 160 200 Min: 12.46 / Avg: 200.45 / Max: 240.26 Min: 12.29 / Avg: 195.66 / Max: 239.75 Min: 12.46 / Avg: 178.55 / Max: 211.42
Neural Magic DeepSparse CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better Neural Magic DeepSparse 1.1 CPU Temperature Monitor AVX-512 On 512 AVX-512 On AVX-512 Off 20 40 60 80 100 Min: 39 / Avg: 80.25 / Max: 92 Min: 39 / Avg: 80.23 / Max: 93 Min: 38 / Avg: 73.22 / Max: 82
Neural Magic DeepSparse Model: CV Detection,YOLOv5s COCO - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.1 Model: CV Detection,YOLOv5s COCO - Scenario: Asynchronous Multi-Stream AVX-512 Off AVX-512 On AVX-512 On 512 12 24 36 48 60 SE +/- 0.08, N = 3 SE +/- 0.15, N = 3 SE +/- 0.37, N = 3 43.23 50.77 51.36
Neural Magic DeepSparse Model: CV Detection,YOLOv5s COCO - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.1 Model: CV Detection,YOLOv5s COCO - Scenario: Asynchronous Multi-Stream AVX-512 Off AVX-512 On AVX-512 On 512 20 40 60 80 100 SE +/- 0.19, N = 3 SE +/- 0.23, N = 3 SE +/- 0.56, N = 3 92.51 78.78 77.87
Neural Magic DeepSparse CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better Neural Magic DeepSparse 1.1 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 On AVX-512 On 512 AVX-512 Off 900 1800 2700 3600 4500 Min: 3578 / Avg: 4752.98 / Max: 5300 Min: 4700 / Avg: 4783.64 / Max: 5301 Min: 4700 / Avg: 4785.41 / Max: 5300
Neural Magic DeepSparse CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better Neural Magic DeepSparse 1.1 CPU Power Consumption Monitor AVX-512 On 512 AVX-512 On AVX-512 Off 40 80 120 160 200 Min: 12.46 / Avg: 204.1 / Max: 244.9 Min: 12.65 / Avg: 200.79 / Max: 239.52 Min: 12.46 / Avg: 181.5 / Max: 215.22
Neural Magic DeepSparse CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better Neural Magic DeepSparse 1.1 CPU Temperature Monitor AVX-512 On 512 AVX-512 On AVX-512 Off 20 40 60 80 100 Min: 39 / Avg: 80.84 / Max: 95 Min: 40 / Avg: 80.82 / Max: 93 Min: 39 / Avg: 74.07 / Max: 85
Neural Magic DeepSparse Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Synchronous Single-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.1 Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Synchronous Single-Stream AVX-512 Off AVX-512 On AVX-512 On 512 3 6 9 12 15 SE +/- 0.0041, N = 3 SE +/- 0.0463, N = 3 SE +/- 0.0265, N = 3 7.8337 8.9135 9.0118
Neural Magic DeepSparse Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Synchronous Single-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.1 Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Synchronous Single-Stream AVX-512 Off AVX-512 On AVX-512 On 512 30 60 90 120 150 SE +/- 0.07, N = 3 SE +/- 0.58, N = 3 SE +/- 0.33, N = 3 127.65 112.19 110.96
Neural Magic DeepSparse CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better Neural Magic DeepSparse 1.1 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 On AVX-512 On 512 AVX-512 Off 900 1800 2700 3600 4500 Min: 3500 / Avg: 4768.23 / Max: 5302 Min: 4587 / Avg: 4805.51 / Max: 5300 Min: 4700 / Avg: 4854.95 / Max: 5363
Neural Magic DeepSparse CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better Neural Magic DeepSparse 1.1 CPU Power Consumption Monitor AVX-512 On 512 AVX-512 On AVX-512 Off 50 100 150 200 250 Min: 12.35 / Avg: 194.31 / Max: 256.42 Min: 12.46 / Avg: 191.4 / Max: 257.39 Min: 12.27 / Avg: 168.07 / Max: 217.66
Neural Magic DeepSparse CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better Neural Magic DeepSparse 1.1 CPU Temperature Monitor AVX-512 On 512 AVX-512 On AVX-512 Off 20 40 60 80 100 Min: 39 / Avg: 79.22 / Max: 92 Min: 38 / Avg: 79.14 / Max: 93 Min: 38 / Avg: 71.94 / Max: 85
Neural Magic DeepSparse Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.1 Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Stream AVX-512 Off AVX-512 On AVX-512 On 512 3 6 9 12 15 SE +/- 0.0056, N = 3 SE +/- 0.0383, N = 3 SE +/- 0.0265, N = 3 8.1425 8.9588 9.0792
Neural Magic DeepSparse Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.1 Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Stream AVX-512 Off AVX-512 On AVX-512 On 512 110 220 330 440 550 SE +/- 0.41, N = 3 SE +/- 1.90, N = 3 SE +/- 1.29, N = 3 491.12 446.49 440.56
Neural Magic DeepSparse CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better Neural Magic DeepSparse 1.1 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 On AVX-512 On 512 AVX-512 Off 900 1800 2700 3600 4500 Min: 3500 / Avg: 4712.83 / Max: 5302 Min: 3500 / Avg: 4792.63 / Max: 5301 Min: 4700 / Avg: 4864.76 / Max: 5300
Neural Magic DeepSparse CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better Neural Magic DeepSparse 1.1 CPU Power Consumption Monitor AVX-512 On 512 AVX-512 On AVX-512 Off 50 100 150 200 250 Min: 12.54 / Avg: 189.06 / Max: 260.04 Min: 12.69 / Avg: 185.26 / Max: 260.57 Min: 12.4 / Avg: 167.72 / Max: 220.91
Neural Magic DeepSparse CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better Neural Magic DeepSparse 1.1 CPU Temperature Monitor AVX-512 On 512 AVX-512 On AVX-512 Off 20 40 60 80 100 Min: 40 / Avg: 78.84 / Max: 95 Min: 39 / Avg: 77.07 / Max: 96 Min: 39 / Avg: 72.53 / Max: 86
Numpy Benchmark OpenBenchmarking.org Score, More Is Better Numpy Benchmark AVX-512 Off AVX-512 On AVX-512 On 512 140 280 420 560 700 SE +/- 0.90, N = 3 SE +/- 1.23, N = 3 SE +/- 0.87, N = 3 575.79 631.24 631.86
Numpy Benchmark OpenBenchmarking.org Score Per Watt, More Is Better Numpy Benchmark AVX-512 Off AVX-512 On AVX-512 On 512 3 6 9 12 15 9.735 10.211 10.293
Numpy Benchmark CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better Numpy Benchmark CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 On 512 AVX-512 On AVX-512 Off 900 1800 2700 3600 4500 Min: 4910 / Avg: 5058.87 / Max: 5300 Min: 4905 / Avg: 5065.67 / Max: 5305 Min: 5086 / Avg: 5292.12 / Max: 5306
Numpy Benchmark CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better Numpy Benchmark CPU Power Consumption Monitor AVX-512 On AVX-512 On 512 AVX-512 Off 13 26 39 52 65 Min: 11.83 / Avg: 61.82 / Max: 67.42 Min: 11.84 / Avg: 61.39 / Max: 67.45 Min: 11.97 / Avg: 59.15 / Max: 65.44
Numpy Benchmark CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better Numpy Benchmark CPU Temperature Monitor AVX-512 On 512 AVX-512 On AVX-512 Off 14 28 42 56 70 Min: 34 / Avg: 62.39 / Max: 71 Min: 34 / Avg: 62.31 / Max: 71 Min: 32 / Avg: 61.15 / Max: 70
oneDNN Harness: Convolution Batch Shapes Auto - Data Type: f32 - Engine: CPU OpenBenchmarking.org ms, Fewer Is Better oneDNN 2.7 Harness: Convolution Batch Shapes Auto - Data Type: f32 - Engine: CPU AVX-512 Off AVX-512 On AVX-512 On 512 4 8 12 16 20 SE +/- 0.01, N = 7 SE +/- 0.01, N = 7 SE +/- 0.01, N = 7 15.61 14.36 14.28 -mno-avx512f - MIN: 15.43 MIN: 14.18 MIN: 14.09 1. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl
oneDNN CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better oneDNN 2.7 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 On 512 AVX-512 On AVX-512 Off 900 1800 2700 3600 4500 Min: 4700 / Avg: 4879.13 / Max: 5300 Min: 4700 / Avg: 4896.54 / Max: 5300 Min: 4800 / Avg: 4945.85 / Max: 5300
oneDNN CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better oneDNN 2.7 CPU Power Consumption Monitor AVX-512 On 512 AVX-512 On AVX-512 Off 30 60 90 120 150 Min: 12.56 / Avg: 116.37 / Max: 189.01 Min: 12.33 / Avg: 114.74 / Max: 188.88 Min: 12.3 / Avg: 101.38 / Max: 166.77
oneDNN CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better oneDNN 2.7 CPU Temperature Monitor AVX-512 On 512 AVX-512 On AVX-512 Off 13 26 39 52 65 Min: 41 / Avg: 57.77 / Max: 69 Min: 40 / Avg: 56.59 / Max: 68 Min: 39 / Avg: 54 / Max: 63
oneDNN Harness: Convolution Batch Shapes Auto - Data Type: u8s8f32 - Engine: CPU OpenBenchmarking.org ms, Fewer Is Better oneDNN 2.7 Harness: Convolution Batch Shapes Auto - Data Type: u8s8f32 - Engine: CPU AVX-512 Off AVX-512 On AVX-512 On 512 4 8 12 16 20 SE +/- 0.01, N = 7 SE +/- 0.01, N = 7 SE +/- 0.00, N = 7 14.84 12.11 12.02 -mno-avx512f - MIN: 14.31 MIN: 11.95 MIN: 11.85 1. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl
oneDNN CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better oneDNN 2.7 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 On 512 AVX-512 On AVX-512 Off 900 1800 2700 3600 4500 Min: 4700 / Avg: 4884.79 / Max: 5300 Min: 4700 / Avg: 4892.18 / Max: 5300 Min: 4800 / Avg: 4940.32 / Max: 5300
oneDNN CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better oneDNN 2.7 CPU Power Consumption Monitor AVX-512 On 512 AVX-512 On AVX-512 Off 30 60 90 120 150 Min: 12.31 / Avg: 109.54 / Max: 183.13 Min: 12.34 / Avg: 109.26 / Max: 184.33 Min: 12.03 / Avg: 95.8 / Max: 154.46
oneDNN CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better oneDNN 2.7 CPU Temperature Monitor AVX-512 On 512 AVX-512 On AVX-512 Off 13 26 39 52 65 Min: 37 / Avg: 53.8 / Max: 65 Min: 38 / Avg: 53.03 / Max: 64 Min: 36 / Avg: 50.61 / Max: 60
oneDNN Harness: Convolution Batch Shapes Auto - Data Type: bf16bf16bf16 - Engine: CPU OpenBenchmarking.org ms, Fewer Is Better oneDNN 2.7 Harness: Convolution Batch Shapes Auto - Data Type: bf16bf16bf16 - Engine: CPU AVX-512 On AVX-512 On 512 4 8 12 16 20 SE +/- 0.00, N = 7 SE +/- 0.00, N = 7 16.16 16.16 MIN: 16.07 MIN: 16.06 1. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl
oneDNN CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better oneDNN 2.7 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 On 512 AVX-512 On 900 1800 2700 3600 4500 Min: 4700 / Avg: 4872.99 / Max: 5300 Min: 4700 / Avg: 4894.72 / Max: 5300
oneDNN CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better oneDNN 2.7 CPU Power Consumption Monitor AVX-512 On AVX-512 On 512 40 80 120 160 200 Min: 11.99 / Avg: 128 / Max: 209.14 Min: 12.11 / Avg: 126.88 / Max: 209.9
oneDNN CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better oneDNN 2.7 CPU Temperature Monitor AVX-512 On AVX-512 On 512 15 30 45 60 75 Min: 36 / Avg: 59.56 / Max: 76 Min: 36 / Avg: 59.45 / Max: 76
oneDNN Harness: Deconvolution Batch shapes_1d - Data Type: f32 - Engine: CPU OpenBenchmarking.org ms, Fewer Is Better oneDNN 2.7 Harness: Deconvolution Batch shapes_1d - Data Type: f32 - Engine: CPU AVX-512 On AVX-512 On 512 AVX-512 Off 2 4 6 8 10 SE +/- 0.02566, N = 3 SE +/- 0.02594, N = 3 SE +/- 0.04615, N = 3 8.55193 8.50891 8.39772 MIN: 4.79 MIN: 4.8 -mno-avx512f - MIN: 4.7 1. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl
oneDNN CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better oneDNN 2.7 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 On AVX-512 On 512 AVX-512 Off 900 1800 2700 3600 4500 Min: 4700 / Avg: 4787.19 / Max: 5300 Min: 4700 / Avg: 4787.63 / Max: 5228 Min: 4700 / Avg: 4788.28 / Max: 5100
oneDNN CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better oneDNN 2.7 CPU Power Consumption Monitor AVX-512 On 512 AVX-512 On AVX-512 Off 50 100 150 200 250 Min: 12.31 / Avg: 186.16 / Max: 260.32 Min: 12.16 / Avg: 185.77 / Max: 260.53 Min: 12 / Avg: 154.65 / Max: 222.78
oneDNN CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better oneDNN 2.7 CPU Temperature Monitor AVX-512 On 512 AVX-512 On AVX-512 Off 20 40 60 80 100 Min: 38 / Avg: 73.45 / Max: 90 Min: 36 / Avg: 73.12 / Max: 90 Min: 32 / Avg: 63.64 / Max: 79
oneDNN Harness: Deconvolution Batch shapes_1d - Data Type: u8s8f32 - Engine: CPU OpenBenchmarking.org ms, Fewer Is Better oneDNN 2.7 Harness: Deconvolution Batch shapes_1d - Data Type: u8s8f32 - Engine: CPU AVX-512 Off AVX-512 On 512 AVX-512 On 0.4001 0.8002 1.2003 1.6004 2.0005 SE +/- 0.003095, N = 3 SE +/- 0.003829, N = 3 SE +/- 0.003322, N = 3 1.778320 0.846376 0.840660 -mno-avx512f - MIN: 1.73 MIN: 0.81 MIN: 0.82 1. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl
oneDNN CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better oneDNN 2.7 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 On 512 AVX-512 On AVX-512 Off 900 1800 2700 3600 4500 Min: 3430 / Avg: 4699.55 / Max: 5139 Min: 3426 / Avg: 4750.48 / Max: 5310 Min: 4700 / Avg: 4797.64 / Max: 5309
oneDNN CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better oneDNN 2.7 CPU Power Consumption Monitor AVX-512 On AVX-512 On 512 AVX-512 Off 50 100 150 200 250 Min: 12.23 / Avg: 183.19 / Max: 271.84 Min: 12.33 / Avg: 182.51 / Max: 273 Min: 12.49 / Avg: 157.07 / Max: 224.86
oneDNN CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better oneDNN 2.7 CPU Temperature Monitor AVX-512 On AVX-512 On 512 AVX-512 Off 20 40 60 80 100 Min: 39 / Avg: 76.57 / Max: 97 Min: 40 / Avg: 76.51 / Max: 95 Min: 37 / Avg: 68.37 / Max: 81
oneDNN Harness: Deconvolution Batch shapes_1d - Data Type: bf16bf16bf16 - Engine: CPU OpenBenchmarking.org ms, Fewer Is Better oneDNN 2.7 Harness: Deconvolution Batch shapes_1d - Data Type: bf16bf16bf16 - Engine: CPU AVX-512 On AVX-512 On 512 5 10 15 20 25 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 20.81 20.26 MIN: 20.45 MIN: 19.82 1. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl
oneDNN CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better oneDNN 2.7 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 On 512 AVX-512 On 900 1800 2700 3600 4500 Min: 4700 / Avg: 4768.42 / Max: 5101 Min: 4700 / Avg: 4772.18 / Max: 5298
oneDNN CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better oneDNN 2.7 CPU Power Consumption Monitor AVX-512 On 512 AVX-512 On 50 100 150 200 250 Min: 12.43 / Avg: 188.15 / Max: 256.3 Min: 12.48 / Avg: 187.07 / Max: 255.81
oneDNN CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better oneDNN 2.7 CPU Temperature Monitor AVX-512 On 512 AVX-512 On 20 40 60 80 100 Min: 39 / Avg: 74.99 / Max: 90 Min: 39 / Avg: 74.22 / Max: 90
oneDNN Harness: Deconvolution Batch shapes_3d - Data Type: f32 - Engine: CPU OpenBenchmarking.org ms, Fewer Is Better oneDNN 2.7 Harness: Deconvolution Batch shapes_3d - Data Type: f32 - Engine: CPU AVX-512 Off AVX-512 On AVX-512 On 512 1.2135 2.427 3.6405 4.854 6.0675 SE +/- 0.00507, N = 9 SE +/- 0.00401, N = 9 SE +/- 0.00516, N = 9 5.39327 4.33063 4.32564 -mno-avx512f - MIN: 5.31 MIN: 4.21 MIN: 4.21 1. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl
oneDNN CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better oneDNN 2.7 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 On 512 AVX-512 Off AVX-512 On 900 1800 2700 3600 4500 Min: 4700 / Avg: 4931.38 / Max: 5267 Min: 4721 / Avg: 4966.06 / Max: 5300 Min: 4700 / Avg: 4987.92 / Max: 5312
oneDNN CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better oneDNN 2.7 CPU Power Consumption Monitor AVX-512 On 512 AVX-512 On AVX-512 Off 40 80 120 160 200 Min: 12.27 / Avg: 110.93 / Max: 247.56 Min: 12.32 / Avg: 109.91 / Max: 245.61 Min: 12.12 / Avg: 99.49 / Max: 224.72
oneDNN CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better oneDNN 2.7 CPU Temperature Monitor AVX-512 On 512 AVX-512 On AVX-512 Off 16 32 48 64 80 Min: 39 / Avg: 58.3 / Max: 82 Min: 39 / Avg: 56.03 / Max: 81 Min: 34 / Avg: 51.76 / Max: 71
oneDNN Harness: Deconvolution Batch shapes_3d - Data Type: u8s8f32 - Engine: CPU OpenBenchmarking.org ms, Fewer Is Better oneDNN 2.7 Harness: Deconvolution Batch shapes_3d - Data Type: u8s8f32 - Engine: CPU AVX-512 Off AVX-512 On AVX-512 On 512 0.5202 1.0404 1.5606 2.0808 2.601 SE +/- 0.00997, N = 9 SE +/- 0.00510, N = 9 SE +/- 0.00281, N = 9 2.31183 1.47049 1.46948 -mno-avx512f - MIN: 2.22 MIN: 1.35 MIN: 1.36 1. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl
oneDNN CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better oneDNN 2.7 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 Off AVX-512 On 512 AVX-512 On 900 1800 2700 3600 4500 Min: 4700 / Avg: 4953.98 / Max: 5300 Min: 4700 / Avg: 4983.09 / Max: 5312 Min: 4700 / Avg: 4984.13 / Max: 5309
oneDNN CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better oneDNN 2.7 CPU Power Consumption Monitor AVX-512 On 512 AVX-512 On AVX-512 Off 40 80 120 160 200 Min: 12.27 / Avg: 108.7 / Max: 242.03 Min: 12.2 / Avg: 108.52 / Max: 242.72 Min: 12.03 / Avg: 101.88 / Max: 232.56
oneDNN CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better oneDNN 2.7 CPU Temperature Monitor AVX-512 On 512 AVX-512 On AVX-512 Off 15 30 45 60 75 Min: 36 / Avg: 55.78 / Max: 79 Min: 35 / Avg: 53.89 / Max: 78 Min: 35 / Avg: 52.66 / Max: 74
oneDNN Harness: Deconvolution Batch shapes_3d - Data Type: bf16bf16bf16 - Engine: CPU OpenBenchmarking.org ms, Fewer Is Better oneDNN 2.7 Harness: Deconvolution Batch shapes_3d - Data Type: bf16bf16bf16 - Engine: CPU AVX-512 On AVX-512 On 512 4 8 12 16 20 SE +/- 0.00, N = 9 SE +/- 0.00, N = 9 17.31 17.27 MIN: 16.91 MIN: 16.85 1. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl
oneDNN CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better oneDNN 2.7 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 On 512 AVX-512 On 900 1800 2700 3600 4500 Min: 4700 / Avg: 4940.08 / Max: 5300 Min: 4700 / Avg: 4987.32 / Max: 5308
oneDNN CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better oneDNN 2.7 CPU Power Consumption Monitor AVX-512 On 512 AVX-512 On 40 80 120 160 200 Min: 12.08 / Avg: 97.63 / Max: 215.11 Min: 12.22 / Avg: 97.45 / Max: 213.88
oneDNN CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better oneDNN 2.7 CPU Temperature Monitor AVX-512 On 512 AVX-512 On 14 28 42 56 70 Min: 36 / Avg: 53.02 / Max: 71 Min: 34 / Avg: 49.81 / Max: 71
oneDNN Harness: IP Shapes 1D - Data Type: f32 - Engine: CPU OpenBenchmarking.org ms, Fewer Is Better oneDNN 2.7 Harness: IP Shapes 1D - Data Type: f32 - Engine: CPU AVX-512 On AVX-512 On 512 AVX-512 Off 0.908 1.816 2.724 3.632 4.54 SE +/- 0.00337, N = 4 SE +/- 0.00488, N = 4 SE +/- 0.00517, N = 4 4.03554 4.03294 3.22680 MIN: 3.9 MIN: 3.89 -mno-avx512f - MIN: 3.09 1. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl
oneDNN CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better oneDNN 2.7 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 On 512 AVX-512 On AVX-512 Off 900 1800 2700 3600 4500 Min: 4700 / Avg: 4796.3 / Max: 5300 Min: 4700 / Avg: 4798.47 / Max: 5302 Min: 4700 / Avg: 4801.83 / Max: 5299
oneDNN CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better oneDNN 2.7 CPU Power Consumption Monitor AVX-512 On 512 AVX-512 On AVX-512 Off 50 100 150 200 250 Min: 12.2 / Avg: 187.14 / Max: 256.22 Min: 12.26 / Avg: 185.14 / Max: 254.54 Min: 11.91 / Avg: 174.01 / Max: 231.27
oneDNN CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better oneDNN 2.7 CPU Temperature Monitor AVX-512 On 512 AVX-512 On AVX-512 Off 20 40 60 80 100 Min: 35 / Avg: 71.51 / Max: 88 Min: 34 / Avg: 71.48 / Max: 87 Min: 31 / Avg: 66.53 / Max: 80
oneDNN Harness: IP Shapes 1D - Data Type: u8s8f32 - Engine: CPU OpenBenchmarking.org ms, Fewer Is Better oneDNN 2.7 Harness: IP Shapes 1D - Data Type: u8s8f32 - Engine: CPU AVX-512 Off AVX-512 On AVX-512 On 512 0.2799 0.5598 0.8397 1.1196 1.3995 SE +/- 0.000314, N = 4 SE +/- 0.001991, N = 4 SE +/- 0.001828, N = 4 1.243960 0.720702 0.715925 -mno-avx512f - MIN: 1.22 MIN: 0.67 MIN: 0.66 1. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl
oneDNN CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better oneDNN 2.7 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 On AVX-512 On 512 AVX-512 Off 900 1800 2700 3600 4500 Min: 4700 / Avg: 4792.74 / Max: 5301 Min: 4700 / Avg: 4794.07 / Max: 5308 Min: 4700 / Avg: 4797.83 / Max: 5306
oneDNN CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better oneDNN 2.7 CPU Power Consumption Monitor AVX-512 On 512 AVX-512 On AVX-512 Off 50 100 150 200 250 Min: 12.45 / Avg: 197.65 / Max: 260.01 Min: 12.39 / Avg: 197.09 / Max: 259.67 Min: 12.34 / Avg: 167.49 / Max: 223.12
oneDNN CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better oneDNN 2.7 CPU Temperature Monitor AVX-512 On 512 AVX-512 On AVX-512 Off 20 40 60 80 100 Min: 40 / Avg: 76.38 / Max: 90 Min: 39 / Avg: 75.8 / Max: 90 Min: 38 / Avg: 67.95 / Max: 80
oneDNN Harness: IP Shapes 1D - Data Type: bf16bf16bf16 - Engine: CPU OpenBenchmarking.org ms, Fewer Is Better oneDNN 2.7 Harness: IP Shapes 1D - Data Type: bf16bf16bf16 - Engine: CPU AVX-512 On 512 AVX-512 On 2 4 6 8 10 SE +/- 0.00438, N = 4 SE +/- 0.00165, N = 4 8.55374 8.55274 MIN: 8.33 MIN: 8.4 1. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl
oneDNN CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better oneDNN 2.7 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 On 512 AVX-512 On 900 1800 2700 3600 4500 Min: 4700 / Avg: 4796.12 / Max: 5300 Min: 4700 / Avg: 4799.03 / Max: 5300
oneDNN CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better oneDNN 2.7 CPU Power Consumption Monitor AVX-512 On AVX-512 On 512 40 80 120 160 200 Min: 12.64 / Avg: 166.08 / Max: 212.18 Min: 12.55 / Avg: 164.37 / Max: 212.69
oneDNN CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better oneDNN 2.7 CPU Temperature Monitor AVX-512 On 512 AVX-512 On 15 30 45 60 75 Min: 41 / Avg: 68.97 / Max: 80 Min: 39 / Avg: 68.31 / Max: 79
oneDNN Harness: IP Shapes 3D - Data Type: f32 - Engine: CPU OpenBenchmarking.org ms, Fewer Is Better oneDNN 2.7 Harness: IP Shapes 3D - Data Type: f32 - Engine: CPU AVX-512 Off AVX-512 On AVX-512 On 512 3 6 9 12 15 SE +/- 0.00748, N = 5 SE +/- 0.00598, N = 5 SE +/- 0.01026, N = 5 11.67710 10.63470 9.95113 -mno-avx512f - MIN: 11.41 MIN: 10.54 MIN: 9.83 1. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl
oneDNN CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better oneDNN 2.7 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 On AVX-512 On 512 AVX-512 Off 900 1800 2700 3600 4500 Min: 4700 / Avg: 4834.06 / Max: 5301 Min: 4700 / Avg: 4835.06 / Max: 5300 Min: 4789 / Avg: 4907.45 / Max: 5306
oneDNN CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better oneDNN 2.7 CPU Power Consumption Monitor AVX-512 On AVX-512 On 512 AVX-512 Off 40 80 120 160 200 Min: 12.41 / Avg: 142.22 / Max: 219.9 Min: 12.27 / Avg: 140.62 / Max: 220.8 Min: 11.99 / Avg: 110.48 / Max: 208.04
oneDNN CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better oneDNN 2.7 CPU Temperature Monitor AVX-512 On 512 AVX-512 On AVX-512 Off 14 28 42 56 70 Min: 40 / Avg: 59.91 / Max: 74 Min: 39 / Avg: 59.67 / Max: 73 Min: 34 / Avg: 54.35 / Max: 70
oneDNN Harness: IP Shapes 3D - Data Type: u8s8f32 - Engine: CPU OpenBenchmarking.org ms, Fewer Is Better oneDNN 2.7 Harness: IP Shapes 3D - Data Type: u8s8f32 - Engine: CPU AVX-512 On AVX-512 On 512 AVX-512 Off 0.6781 1.3562 2.0343 2.7124 3.3905 SE +/- 0.00593, N = 5 SE +/- 0.01183, N = 5 SE +/- 0.00482, N = 5 3.01377 2.75246 2.18670 MIN: 2.91 MIN: 2.64 -mno-avx512f - MIN: 2.11 1. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl
oneDNN CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better oneDNN 2.7 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 On 512 AVX-512 On AVX-512 Off 900 1800 2700 3600 4500 Min: 4700 / Avg: 4828.02 / Max: 5149 Min: 4700 / Avg: 4847.06 / Max: 5310 Min: 4753 / Avg: 4904.44 / Max: 5300
oneDNN CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better oneDNN 2.7 CPU Power Consumption Monitor AVX-512 On 512 AVX-512 On AVX-512 Off 40 80 120 160 200 Min: 12.46 / Avg: 138.07 / Max: 211.6 Min: 12.26 / Avg: 135.98 / Max: 211.15 Min: 12.18 / Avg: 117.33 / Max: 206.36
oneDNN CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better oneDNN 2.7 CPU Temperature Monitor AVX-512 On 512 AVX-512 On AVX-512 Off 15 30 45 60 75 Min: 38 / Avg: 61.88 / Max: 79 Min: 38 / Avg: 61.41 / Max: 78 Min: 35 / Avg: 56.98 / Max: 70
oneDNN Harness: IP Shapes 3D - Data Type: bf16bf16bf16 - Engine: CPU OpenBenchmarking.org ms, Fewer Is Better oneDNN 2.7 Harness: IP Shapes 3D - Data Type: bf16bf16bf16 - Engine: CPU AVX-512 On AVX-512 On 512 1.0843 2.1686 3.2529 4.3372 5.4215 SE +/- 0.03916, N = 9 SE +/- 0.02954, N = 15 4.81904 4.64814 MIN: 4.15 MIN: 4.01 1. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl
oneDNN CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better oneDNN 2.7 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 On 512 AVX-512 On 900 1800 2700 3600 4500 Min: 4700 / Avg: 4825.21 / Max: 5297 Min: 4700 / Avg: 4840.23 / Max: 5303
oneDNN CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better oneDNN 2.7 CPU Power Consumption Monitor AVX-512 On 512 AVX-512 On 40 80 120 160 200 Min: 12.44 / Avg: 147.87 / Max: 217.33 Min: 12.19 / Avg: 145.98 / Max: 216.11
oneDNN CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better oneDNN 2.7 CPU Temperature Monitor AVX-512 On 512 AVX-512 On 15 30 45 60 75 Min: 38 / Avg: 63.8 / Max: 78 Min: 37 / Avg: 62.76 / Max: 75
oneDNN Harness: Matrix Multiply Batch Shapes Transformer - Data Type: f32 - Engine: CPU OpenBenchmarking.org ms, Fewer Is Better oneDNN 2.7 Harness: Matrix Multiply Batch Shapes Transformer - Data Type: f32 - Engine: CPU AVX-512 Off AVX-512 On AVX-512 On 512 0.8266 1.6532 2.4798 3.3064 4.133 SE +/- 0.03921, N = 4 SE +/- 0.00624, N = 4 SE +/- 0.00586, N = 4 3.67360 3.26773 3.21742 -mno-avx512f - MIN: 3.39 MIN: 3.18 MIN: 3.14 1. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl
oneDNN CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better oneDNN 2.7 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 On 512 AVX-512 On AVX-512 Off 900 1800 2700 3600 4500 Min: 4700 / Avg: 4805.17 / Max: 5300 Min: 4700 / Avg: 4817.98 / Max: 5300 Min: 4800 / Avg: 4883.85 / Max: 5307
oneDNN CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better oneDNN 2.7 CPU Power Consumption Monitor AVX-512 On 512 AVX-512 On AVX-512 Off 40 80 120 160 200 Min: 12.48 / Avg: 154.47 / Max: 218.24 Min: 12.37 / Avg: 152.68 / Max: 217.03 Min: 12.06 / Avg: 127.79 / Max: 179.3
oneDNN CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better oneDNN 2.7 CPU Temperature Monitor AVX-512 On 512 AVX-512 On AVX-512 Off 15 30 45 60 75 Min: 39 / Avg: 63.95 / Max: 76 Min: 38 / Avg: 62.72 / Max: 76 Min: 32 / Avg: 54.62 / Max: 65
oneDNN Harness: Matrix Multiply Batch Shapes Transformer - Data Type: u8s8f32 - Engine: CPU OpenBenchmarking.org ms, Fewer Is Better oneDNN 2.7 Harness: Matrix Multiply Batch Shapes Transformer - Data Type: u8s8f32 - Engine: CPU AVX-512 Off AVX-512 On AVX-512 On 512 0.3157 0.6314 0.9471 1.2628 1.5785 SE +/- 0.00373, N = 4 SE +/- 0.00334, N = 4 SE +/- 0.00378, N = 4 1.40330 1.32134 1.30906 -mno-avx512f - MIN: 1.31 MIN: 1.26 MIN: 1.24 1. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl
oneDNN CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better oneDNN 2.7 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 On 512 AVX-512 On AVX-512 Off 900 1800 2700 3600 4500 Min: 4700 / Avg: 4824.57 / Max: 5300 Min: 4700 / Avg: 4831.27 / Max: 5300 Min: 4700 / Avg: 4857.73 / Max: 5270
oneDNN CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better oneDNN 2.7 CPU Power Consumption Monitor AVX-512 On AVX-512 On 512 AVX-512 Off 40 80 120 160 200 Min: 12.28 / Avg: 152.81 / Max: 217.07 Min: 12.46 / Avg: 151.73 / Max: 216.95 Min: 12.3 / Avg: 141.01 / Max: 214.89
oneDNN CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better oneDNN 2.7 CPU Temperature Monitor AVX-512 On AVX-512 On 512 AVX-512 Off 14 28 42 56 70 Min: 38 / Avg: 64.16 / Max: 75 Min: 38 / Avg: 63.12 / Max: 74 Min: 36 / Avg: 60.25 / Max: 74
oneDNN Harness: Matrix Multiply Batch Shapes Transformer - Data Type: bf16bf16bf16 - Engine: CPU OpenBenchmarking.org ms, Fewer Is Better oneDNN 2.7 Harness: Matrix Multiply Batch Shapes Transformer - Data Type: bf16bf16bf16 - Engine: CPU AVX-512 On AVX-512 On 512 0.859 1.718 2.577 3.436 4.295 SE +/- 0.04459, N = 4 SE +/- 0.03397, N = 4 3.81793 3.66945 MIN: 3.28 MIN: 3.28 1. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl
oneDNN CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better oneDNN 2.7 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 On 512 AVX-512 On 900 1800 2700 3600 4500 Min: 4700 / Avg: 4807.8 / Max: 5221 Min: 4700 / Avg: 4826.46 / Max: 5302
oneDNN CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better oneDNN 2.7 CPU Power Consumption Monitor AVX-512 On 512 AVX-512 On 40 80 120 160 200 Min: 12.45 / Avg: 147.95 / Max: 221.19 Min: 12.43 / Avg: 143.59 / Max: 212.38
oneDNN CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better oneDNN 2.7 CPU Temperature Monitor AVX-512 On 512 AVX-512 On 15 30 45 60 75 Min: 39 / Avg: 64.2 / Max: 78 Min: 38 / Avg: 63.03 / Max: 77
oneDNN Harness: Recurrent Neural Network Training - Data Type: f32 - Engine: CPU OpenBenchmarking.org ms, Fewer Is Better oneDNN 2.7 Harness: Recurrent Neural Network Training - Data Type: f32 - Engine: CPU AVX-512 Off AVX-512 On AVX-512 On 512 700 1400 2100 2800 3500 SE +/- 1.15, N = 3 SE +/- 2.36, N = 3 SE +/- 2.98, N = 3 3271.06 3079.96 3062.36 -mno-avx512f - MIN: 3261.78 MIN: 3061.76 MIN: 3040.47 1. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl
oneDNN CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better oneDNN 2.7 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 On 512 AVX-512 On AVX-512 Off 900 1800 2700 3600 4500 Min: 3500 / Avg: 4710.26 / Max: 5301 Min: 4649 / Avg: 4725.14 / Max: 5300 Min: 4700 / Avg: 4733.47 / Max: 5312
oneDNN CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better oneDNN 2.7 CPU Power Consumption Monitor AVX-512 On 512 AVX-512 On AVX-512 Off 50 100 150 200 250 Min: 12.36 / Avg: 225.11 / Max: 259.84 Min: 12.16 / Avg: 224.81 / Max: 259.66 Min: 12.16 / Avg: 214.34 / Max: 239.55
oneDNN CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better oneDNN 2.7 CPU Temperature Monitor AVX-512 On AVX-512 On 512 AVX-512 Off 20 40 60 80 100 Min: 37 / Avg: 84.81 / Max: 94 Min: 38 / Avg: 84.54 / Max: 94 Min: 33 / Avg: 78.87 / Max: 87
oneDNN Harness: Recurrent Neural Network Training - Data Type: u8s8f32 - Engine: CPU OpenBenchmarking.org ms, Fewer Is Better oneDNN 2.7 Harness: Recurrent Neural Network Training - Data Type: u8s8f32 - Engine: CPU AVX-512 Off AVX-512 On AVX-512 On 512 700 1400 2100 2800 3500 SE +/- 1.82, N = 3 SE +/- 3.05, N = 3 SE +/- 89.39, N = 15 3270.55 3088.89 3073.17 -mno-avx512f - MIN: 3260.73 MIN: 3071.02 MIN: 2922.72 1. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl
oneDNN CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better oneDNN 2.7 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 On 512 AVX-512 On AVX-512 Off 900 1800 2700 3600 4500 Min: 3500 / Avg: 4667.49 / Max: 5300 Min: 3500 / Avg: 4678.34 / Max: 5300 Min: 4700 / Avg: 4726.9 / Max: 5300
oneDNN CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better oneDNN 2.7 CPU Power Consumption Monitor AVX-512 On AVX-512 On 512 AVX-512 Off 50 100 150 200 250 Min: 12.72 / Avg: 223.66 / Max: 258.29 Min: 6.51 / Avg: 222.96 / Max: 260.16 Min: 12.57 / Avg: 214.65 / Max: 239.45
oneDNN CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better oneDNN 2.7 CPU Temperature Monitor AVX-512 On 512 AVX-512 On AVX-512 Off 20 40 60 80 100 Min: 41 / Avg: 85.38 / Max: 95 Min: 40 / Avg: 84.18 / Max: 95 Min: 39 / Avg: 80.93 / Max: 87
oneDNN Harness: Recurrent Neural Network Training - Data Type: bf16bf16bf16 - Engine: CPU OpenBenchmarking.org ms, Fewer Is Better oneDNN 2.7 Harness: Recurrent Neural Network Training - Data Type: bf16bf16bf16 - Engine: CPU AVX-512 Off AVX-512 On AVX-512 On 512 700 1400 2100 2800 3500 SE +/- 2.45, N = 3 SE +/- 4.17, N = 3 SE +/- 38.98, N = 3 3271.27 3093.58 2986.72 -mno-avx512f - MIN: 3259.85 MIN: 3075.2 MIN: 2932.85 1. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl
oneDNN CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better oneDNN 2.7 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 On AVX-512 On 512 AVX-512 Off 900 1800 2700 3600 4500 Min: 3500 / Avg: 4672.78 / Max: 5309 Min: 3500 / Avg: 4674.91 / Max: 5181 Min: 4700 / Avg: 4729.18 / Max: 5303
oneDNN CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better oneDNN 2.7 CPU Power Consumption Monitor AVX-512 On 512 AVX-512 On AVX-512 Off 50 100 150 200 250 Min: 12.32 / Avg: 225.38 / Max: 259.31 Min: 12.53 / Avg: 222.91 / Max: 259.24 Min: 12.67 / Avg: 214.52 / Max: 239.09
oneDNN CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better oneDNN 2.7 CPU Temperature Monitor AVX-512 On 512 AVX-512 On AVX-512 Off 20 40 60 80 100 Min: 41 / Avg: 84.88 / Max: 94 Min: 41 / Avg: 83.9 / Max: 95 Min: 40 / Avg: 80.45 / Max: 88
oneDNN Harness: Recurrent Neural Network Inference - Data Type: f32 - Engine: CPU OpenBenchmarking.org ms, Fewer Is Better oneDNN 2.7 Harness: Recurrent Neural Network Inference - Data Type: f32 - Engine: CPU AVX-512 Off AVX-512 On AVX-512 On 512 400 800 1200 1600 2000 SE +/- 3.47, N = 3 SE +/- 0.41, N = 3 SE +/- 20.46, N = 4 2000.12 1814.65 1739.49 -mno-avx512f - MIN: 1987.76 MIN: 1805.32 MIN: 1670.86 1. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl
oneDNN CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better oneDNN 2.7 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 On AVX-512 On 512 AVX-512 Off 900 1800 2700 3600 4500 Min: 3500 / Avg: 4683.06 / Max: 5300 Min: 4573 / Avg: 4707.8 / Max: 5300 Min: 4700 / Avg: 4732.36 / Max: 5300
oneDNN CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better oneDNN 2.7 CPU Power Consumption Monitor AVX-512 On 512 AVX-512 On AVX-512 Off 50 100 150 200 250 Min: 12.23 / Avg: 222.53 / Max: 259.06 Min: 12.6 / Avg: 221.72 / Max: 257.44 Min: 12.3 / Avg: 210.85 / Max: 239.17
oneDNN CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better oneDNN 2.7 CPU Temperature Monitor AVX-512 On 512 AVX-512 On AVX-512 Off 20 40 60 80 100 Min: 42 / Avg: 85.26 / Max: 95 Min: 41 / Avg: 83.26 / Max: 94 Min: 40 / Avg: 79.82 / Max: 87
oneDNN Harness: Recurrent Neural Network Inference - Data Type: u8s8f32 - Engine: CPU OpenBenchmarking.org ms, Fewer Is Better oneDNN 2.7 Harness: Recurrent Neural Network Inference - Data Type: u8s8f32 - Engine: CPU AVX-512 Off AVX-512 On AVX-512 On 512 400 800 1200 1600 2000 SE +/- 1.98, N = 3 SE +/- 7.10, N = 3 SE +/- 14.49, N = 3 2003.54 1817.59 1738.00 -mno-avx512f - MIN: 1993.54 MIN: 1801.35 MIN: 1697.55 1. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl
oneDNN CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better oneDNN 2.7 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 On AVX-512 On 512 AVX-512 Off 900 1800 2700 3600 4500 Min: 3524 / Avg: 4668.41 / Max: 5291 Min: 3500 / Avg: 4673.77 / Max: 5300 Min: 4700 / Avg: 4725.04 / Max: 5303
oneDNN CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better oneDNN 2.7 CPU Power Consumption Monitor AVX-512 On 512 AVX-512 On AVX-512 Off 50 100 150 200 250 Min: 12.38 / Avg: 222.38 / Max: 260.25 Min: 12.42 / Avg: 220.81 / Max: 258.47 Min: 12.61 / Avg: 210.67 / Max: 238.64
oneDNN CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better oneDNN 2.7 CPU Temperature Monitor AVX-512 On 512 AVX-512 On AVX-512 Off 20 40 60 80 100 Min: 42 / Avg: 84.75 / Max: 94 Min: 40 / Avg: 84.09 / Max: 94 Min: 40 / Avg: 79.86 / Max: 87
oneDNN Harness: Recurrent Neural Network Inference - Data Type: bf16bf16bf16 - Engine: CPU OpenBenchmarking.org ms, Fewer Is Better oneDNN 2.7 Harness: Recurrent Neural Network Inference - Data Type: bf16bf16bf16 - Engine: CPU AVX-512 Off AVX-512 On AVX-512 On 512 400 800 1200 1600 2000 SE +/- 0.87, N = 3 SE +/- 2.62, N = 3 SE +/- 18.65, N = 5 2006.02 1814.03 1715.75 -mno-avx512f - MIN: 1997.88 MIN: 1799.95 MIN: 1674.74 1. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl
oneDNN CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better oneDNN 2.7 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 On 512 AVX-512 On AVX-512 Off 900 1800 2700 3600 4500 Min: 3500 / Avg: 4678.88 / Max: 5300 Min: 3545 / Avg: 4698.05 / Max: 5302 Min: 4700 / Avg: 4729.07 / Max: 5300
oneDNN CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better oneDNN 2.7 CPU Power Consumption Monitor AVX-512 On 512 AVX-512 On AVX-512 Off 50 100 150 200 250 Min: 12.35 / Avg: 223.11 / Max: 259.32 Min: 12.62 / Avg: 222.99 / Max: 258.73 Min: 12.39 / Avg: 211.06 / Max: 238.35
oneDNN CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better oneDNN 2.7 CPU Temperature Monitor AVX-512 On 512 AVX-512 On AVX-512 Off 20 40 60 80 100 Min: 41 / Avg: 85.51 / Max: 95 Min: 41 / Avg: 83.69 / Max: 93 Min: 39 / Avg: 79.8 / Max: 88
ONNX Runtime Model: yolov4 - Device: CPU - Executor: Standard OpenBenchmarking.org Inferences Per Minute, More Is Better ONNX Runtime 1.11 Model: yolov4 - Device: CPU - Executor: Standard AVX-512 Off AVX-512 On 512 AVX-512 On 110 220 330 440 550 SE +/- 0.76, N = 3 SE +/- 1.09, N = 3 SE +/- 0.60, N = 3 517 527 529 -mno-avx512f 1. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt
ONNX Runtime Model: yolov4 - Device: CPU - Executor: Standard OpenBenchmarking.org Inferences Per Minute Per Watt, More Is Better ONNX Runtime 1.11 Model: yolov4 - Device: CPU - Executor: Standard AVX-512 On 512 AVX-512 On AVX-512 Off 0.6352 1.2704 1.9056 2.5408 3.176 2.598 2.616 2.823
ONNX Runtime CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better ONNX Runtime 1.11 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 On 512 AVX-512 On AVX-512 Off 900 1800 2700 3600 4500 Min: 4700 / Avg: 4716.47 / Max: 5301 Min: 4700 / Avg: 4722.26 / Max: 5300 Min: 4700 / Avg: 4748.49 / Max: 5300
ONNX Runtime CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better ONNX Runtime 1.11 CPU Power Consumption Monitor AVX-512 On 512 AVX-512 On AVX-512 Off 40 80 120 160 200 Min: 12.31 / Avg: 202.83 / Max: 212.6 Min: 12.3 / Avg: 202.2 / Max: 213.09 Min: 12.26 / Avg: 183.13 / Max: 192.75
ONNX Runtime CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better ONNX Runtime 1.11 CPU Temperature Monitor AVX-512 On AVX-512 On 512 AVX-512 Off 20 40 60 80 100 Min: 41 / Avg: 80.11 / Max: 94 Min: 41 / Avg: 79.4 / Max: 94 Min: 40 / Avg: 74.38 / Max: 87
ONNX Runtime Model: yolov4 - Device: CPU - Executor: Parallel OpenBenchmarking.org Inferences Per Minute, More Is Better ONNX Runtime 1.11 Model: yolov4 - Device: CPU - Executor: Parallel AVX-512 Off AVX-512 On AVX-512 On 512 70 140 210 280 350 SE +/- 0.33, N = 3 SE +/- 0.29, N = 3 SE +/- 0.33, N = 3 315 319 319 -mno-avx512f 1. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt
ONNX Runtime Model: yolov4 - Device: CPU - Executor: Parallel OpenBenchmarking.org Inferences Per Minute Per Watt, More Is Better ONNX Runtime 1.11 Model: yolov4 - Device: CPU - Executor: Parallel AVX-512 On AVX-512 On 512 AVX-512 Off 0.446 0.892 1.338 1.784 2.23 1.748 1.749 1.982
ONNX Runtime CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better ONNX Runtime 1.11 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 On AVX-512 On 512 AVX-512 Off 900 1800 2700 3600 4500 Min: 4700 / Avg: 4721.58 / Max: 5306 Min: 4700 / Avg: 4721.84 / Max: 5299 Min: 4700 / Avg: 4788.45 / Max: 5300
ONNX Runtime CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better ONNX Runtime 1.11 CPU Power Consumption Monitor AVX-512 On AVX-512 On 512 AVX-512 Off 40 80 120 160 200 Min: 12.18 / Avg: 182.51 / Max: 195.72 Min: 12.55 / Avg: 182.37 / Max: 194.6 Min: 12.26 / Avg: 158.94 / Max: 171.99
ONNX Runtime CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better ONNX Runtime 1.11 CPU Temperature Monitor AVX-512 On AVX-512 On 512 AVX-512 Off 20 40 60 80 100 Min: 39 / Avg: 75.62 / Max: 94 Min: 42 / Avg: 74.76 / Max: 95 Min: 40 / Avg: 69.43 / Max: 86
ONNX Runtime Model: fcn-resnet101-11 - Device: CPU - Executor: Standard OpenBenchmarking.org Inferences Per Minute, More Is Better ONNX Runtime 1.11 Model: fcn-resnet101-11 - Device: CPU - Executor: Standard AVX-512 Off AVX-512 On AVX-512 On 512 20 40 60 80 100 SE +/- 0.17, N = 3 SE +/- 0.88, N = 8 SE +/- 0.17, N = 3 100 102 103 -mno-avx512f 1. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt
ONNX Runtime Model: fcn-resnet101-11 - Device: CPU - Executor: Standard OpenBenchmarking.org Inferences Per Minute Per Watt, More Is Better ONNX Runtime 1.11 Model: fcn-resnet101-11 - Device: CPU - Executor: Standard AVX-512 On AVX-512 On 512 AVX-512 Off 0.1082 0.2164 0.3246 0.4328 0.541 0.470 0.472 0.481
ONNX Runtime CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better ONNX Runtime 1.11 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 On AVX-512 On 512 AVX-512 Off 900 1800 2700 3600 4500 Min: 3500 / Avg: 4662.15 / Max: 5300 Min: 3564 / Avg: 4670.77 / Max: 5300 Min: 4700 / Avg: 4720.87 / Max: 5300
ONNX Runtime CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better ONNX Runtime 1.11 CPU Power Consumption Monitor AVX-512 On 512 AVX-512 On AVX-512 Off 40 80 120 160 200 Min: 12.2 / Avg: 218.3 / Max: 237.54 Min: 12.29 / Avg: 216.9 / Max: 237.78 Min: 12.44 / Avg: 208.04 / Max: 219.8
ONNX Runtime CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better ONNX Runtime 1.11 CPU Temperature Monitor AVX-512 On AVX-512 On 512 AVX-512 Off 20 40 60 80 100 Min: 39 / Avg: 85.21 / Max: 98 Min: 39 / Avg: 85.21 / Max: 99 Min: 39 / Avg: 81.74 / Max: 92
ONNX Runtime Model: fcn-resnet101-11 - Device: CPU - Executor: Parallel OpenBenchmarking.org Inferences Per Minute, More Is Better ONNX Runtime 1.11 Model: fcn-resnet101-11 - Device: CPU - Executor: Parallel AVX-512 Off AVX-512 On AVX-512 On 512 16 32 48 64 80 SE +/- 0.33, N = 3 SE +/- 0.00, N = 3 SE +/- 0.44, N = 3 72 73 73 -mno-avx512f 1. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt
ONNX Runtime Model: fcn-resnet101-11 - Device: CPU - Executor: Parallel OpenBenchmarking.org Inferences Per Minute Per Watt, More Is Better ONNX Runtime 1.11 Model: fcn-resnet101-11 - Device: CPU - Executor: Parallel AVX-512 On 512 AVX-512 On AVX-512 Off 0.0925 0.185 0.2775 0.37 0.4625 0.374 0.375 0.411
ONNX Runtime CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better ONNX Runtime 1.11 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 On AVX-512 On 512 AVX-512 Off 900 1800 2700 3600 4500 Min: 4361 / Avg: 4716.76 / Max: 5300 Min: 4700 / Avg: 4718.48 / Max: 5203 Min: 4700 / Avg: 4741.29 / Max: 5300
ONNX Runtime CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better ONNX Runtime 1.11 CPU Power Consumption Monitor AVX-512 On 512 AVX-512 On AVX-512 Off 40 80 120 160 200 Min: 12.33 / Avg: 195.17 / Max: 218.64 Min: 12.2 / Avg: 194.83 / Max: 220.39 Min: 12.19 / Avg: 175.09 / Max: 200.07
ONNX Runtime CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better ONNX Runtime 1.11 CPU Temperature Monitor AVX-512 On AVX-512 On 512 AVX-512 Off 20 40 60 80 100 Min: 40 / Avg: 81.63 / Max: 94 Min: 41 / Avg: 81.09 / Max: 94 Min: 40 / Avg: 75.92 / Max: 88
ONNX Runtime Model: super-resolution-10 - Device: CPU - Executor: Standard OpenBenchmarking.org Inferences Per Minute, More Is Better ONNX Runtime 1.11 Model: super-resolution-10 - Device: CPU - Executor: Standard AVX-512 On 512 AVX-512 Off AVX-512 On 1600 3200 4800 6400 8000 SE +/- 64.19, N = 12 SE +/- 44.00, N = 3 SE +/- 80.51, N = 4 6824 7279 7356 -mno-avx512f 1. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt
ONNX Runtime Model: super-resolution-10 - Device: CPU - Executor: Standard OpenBenchmarking.org Inferences Per Minute Per Watt, More Is Better ONNX Runtime 1.11 Model: super-resolution-10 - Device: CPU - Executor: Standard AVX-512 On 512 AVX-512 On AVX-512 Off 8 16 24 32 40 29.78 31.68 33.21
ONNX Runtime CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better ONNX Runtime 1.11 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 On AVX-512 On 512 AVX-512 Off 900 1800 2700 3600 4500 Min: 3500 / Avg: 4629.79 / Max: 5300 Min: 3500 / Avg: 4653.64 / Max: 5308 Min: 4700 / Avg: 4716.1 / Max: 5305
ONNX Runtime CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better ONNX Runtime 1.11 CPU Power Consumption Monitor AVX-512 On AVX-512 On 512 AVX-512 Off 50 100 150 200 250 Min: 12.22 / Avg: 232.2 / Max: 259.58 Min: 12.18 / Avg: 229.09 / Max: 256.96 Min: 12.22 / Avg: 219.18 / Max: 229.39
ONNX Runtime CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better ONNX Runtime 1.11 CPU Temperature Monitor AVX-512 On AVX-512 On 512 AVX-512 Off 20 40 60 80 100 Min: 39 / Avg: 87.18 / Max: 97 Min: 39 / Avg: 87.15 / Max: 95 Min: 39 / Avg: 83.06 / Max: 88
ONNX Runtime Model: super-resolution-10 - Device: CPU - Executor: Parallel OpenBenchmarking.org Inferences Per Minute, More Is Better ONNX Runtime 1.11 Model: super-resolution-10 - Device: CPU - Executor: Parallel AVX-512 Off AVX-512 On 512 AVX-512 On 1100 2200 3300 4400 5500 SE +/- 8.93, N = 3 SE +/- 25.62, N = 3 SE +/- 5.95, N = 3 4515 4626 4950 -mno-avx512f 1. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt
ONNX Runtime Model: super-resolution-10 - Device: CPU - Executor: Parallel OpenBenchmarking.org Inferences Per Minute Per Watt, More Is Better ONNX Runtime 1.11 Model: super-resolution-10 - Device: CPU - Executor: Parallel AVX-512 On 512 AVX-512 On AVX-512 Off 6 12 18 24 30 22.48 23.55 26.34
ONNX Runtime CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better ONNX Runtime 1.11 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 On AVX-512 On 512 AVX-512 Off 900 1800 2700 3600 4500 Min: 3874 / Avg: 4710.34 / Max: 5302 Min: 4700 / Avg: 4715.24 / Max: 5300 Min: 4700 / Avg: 4718.23 / Max: 5295
ONNX Runtime CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better ONNX Runtime 1.11 CPU Power Consumption Monitor AVX-512 On AVX-512 On 512 AVX-512 Off 40 80 120 160 200 Min: 12.22 / Avg: 210.18 / Max: 224.25 Min: 12.41 / Avg: 205.81 / Max: 220.47 Min: 12.12 / Avg: 171.44 / Max: 185.67
ONNX Runtime CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better ONNX Runtime 1.11 CPU Temperature Monitor AVX-512 On AVX-512 On 512 AVX-512 Off 20 40 60 80 100 Min: 41 / Avg: 83.35 / Max: 93 Min: 41 / Avg: 82.41 / Max: 93 Min: 40 / Avg: 74.62 / Max: 83
ONNX Runtime Model: bertsquad-12 - Device: CPU - Executor: Standard OpenBenchmarking.org Inferences Per Minute, More Is Better ONNX Runtime 1.11 Model: bertsquad-12 - Device: CPU - Executor: Standard AVX-512 On AVX-512 On 512 AVX-512 Off 200 400 600 800 1000 SE +/- 2.67, N = 3 SE +/- 5.77, N = 3 SE +/- 8.55, N = 9 1008 1012 1042 -mno-avx512f 1. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt
ONNX Runtime Model: bertsquad-12 - Device: CPU - Executor: Standard OpenBenchmarking.org Inferences Per Minute Per Watt, More Is Better ONNX Runtime 1.11 Model: bertsquad-12 - Device: CPU - Executor: Standard AVX-512 On 512 AVX-512 On AVX-512 Off 1.0991 2.1982 3.2973 4.3964 5.4955 4.528 4.542 4.885
ONNX Runtime CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better ONNX Runtime 1.11 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 On 512 AVX-512 On AVX-512 Off 900 1800 2700 3600 4500 Min: 3561 / Avg: 4598.1 / Max: 5231 Min: 3500 / Avg: 4615.05 / Max: 5300 Min: 4700 / Avg: 4717.56 / Max: 5304
ONNX Runtime CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better ONNX Runtime 1.11 CPU Power Consumption Monitor AVX-512 On 512 AVX-512 On AVX-512 Off 50 100 150 200 250 Min: 12.1 / Avg: 223.48 / Max: 250.46 Min: 12.28 / Avg: 221.92 / Max: 249.13 Min: 12.1 / Avg: 213.3 / Max: 224.83
ONNX Runtime CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better ONNX Runtime 1.11 CPU Temperature Monitor AVX-512 On 512 AVX-512 On AVX-512 Off 20 40 60 80 100 Min: 40 / Avg: 87.16 / Max: 95 Min: 40 / Avg: 85.81 / Max: 95 Min: 40 / Avg: 83.73 / Max: 88
ONNX Runtime Model: bertsquad-12 - Device: CPU - Executor: Parallel OpenBenchmarking.org Inferences Per Minute, More Is Better ONNX Runtime 1.11 Model: bertsquad-12 - Device: CPU - Executor: Parallel AVX-512 Off AVX-512 On AVX-512 On 512 110 220 330 440 550 SE +/- 2.46, N = 3 SE +/- 0.44, N = 3 SE +/- 0.60, N = 3 515 519 524 -mno-avx512f 1. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt
ONNX Runtime Model: bertsquad-12 - Device: CPU - Executor: Parallel OpenBenchmarking.org Inferences Per Minute Per Watt, More Is Better ONNX Runtime 1.11 Model: bertsquad-12 - Device: CPU - Executor: Parallel AVX-512 On AVX-512 On 512 AVX-512 Off 0.6912 1.3824 2.0736 2.7648 3.456 2.600 2.626 3.072
ONNX Runtime CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better ONNX Runtime 1.11 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 On 512 AVX-512 On AVX-512 Off 900 1800 2700 3600 4500 Min: 4700 / Avg: 4717.76 / Max: 5300 Min: 4700 / Avg: 4718.96 / Max: 5300 Min: 4700 / Avg: 4732.41 / Max: 5295
ONNX Runtime CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better ONNX Runtime 1.11 CPU Power Consumption Monitor AVX-512 On AVX-512 On 512 AVX-512 Off 40 80 120 160 200 Min: 12.39 / Avg: 199.65 / Max: 210.74 Min: 12.5 / Avg: 199.53 / Max: 210.58 Min: 12.03 / Avg: 167.62 / Max: 180.22
ONNX Runtime CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better ONNX Runtime 1.11 CPU Temperature Monitor AVX-512 On AVX-512 On 512 AVX-512 Off 20 40 60 80 100 Min: 41 / Avg: 80.28 / Max: 91 Min: 41 / Avg: 79.02 / Max: 90 Min: 40 / Avg: 71.61 / Max: 81
ONNX Runtime Model: GPT-2 - Device: CPU - Executor: Standard OpenBenchmarking.org Inferences Per Minute, More Is Better ONNX Runtime 1.11 Model: GPT-2 - Device: CPU - Executor: Standard AVX-512 On AVX-512 Off AVX-512 On 512 1500 3000 4500 6000 7500 SE +/- 4.94, N = 3 SE +/- 4.16, N = 3 SE +/- 9.16, N = 3 6954 6954 6962 -mno-avx512f 1. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt
ONNX Runtime Model: GPT-2 - Device: CPU - Executor: Standard OpenBenchmarking.org Inferences Per Minute Per Watt, More Is Better ONNX Runtime 1.11 Model: GPT-2 - Device: CPU - Executor: Standard AVX-512 On 512 AVX-512 On AVX-512 Off 10 20 30 40 50 39.57 39.75 45.41
ONNX Runtime CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better ONNX Runtime 1.11 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 On AVX-512 On 512 AVX-512 Off 900 1800 2700 3600 4500 Min: 4700 / Avg: 4718.55 / Max: 5302 Min: 4700 / Avg: 4720.24 / Max: 5300 Min: 4800 / Avg: 4816.8 / Max: 5300
ONNX Runtime CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better ONNX Runtime 1.11 CPU Power Consumption Monitor AVX-512 On 512 AVX-512 On AVX-512 Off 30 60 90 120 150 Min: 12.2 / Avg: 175.95 / Max: 184.82 Min: 12.13 / Avg: 174.92 / Max: 183.06 Min: 12.04 / Avg: 153.13 / Max: 160.84
ONNX Runtime CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better ONNX Runtime 1.11 CPU Temperature Monitor AVX-512 On 512 AVX-512 On AVX-512 Off 14 28 42 56 70 Min: 40 / Avg: 68.89 / Max: 72 Min: 39 / Avg: 68.81 / Max: 71 Min: 39 / Avg: 63.86 / Max: 67
ONNX Runtime Model: GPT-2 - Device: CPU - Executor: Parallel OpenBenchmarking.org Inferences Per Minute, More Is Better ONNX Runtime 1.11 Model: GPT-2 - Device: CPU - Executor: Parallel AVX-512 On 512 AVX-512 On AVX-512 Off 1200 2400 3600 4800 6000 SE +/- 3.18, N = 3 SE +/- 7.10, N = 3 SE +/- 1.76, N = 3 5545 5548 5557 -mno-avx512f 1. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt
ONNX Runtime Model: GPT-2 - Device: CPU - Executor: Parallel OpenBenchmarking.org Inferences Per Minute Per Watt, More Is Better ONNX Runtime 1.11 Model: GPT-2 - Device: CPU - Executor: Parallel AVX-512 On 512 AVX-512 On AVX-512 Off 8 16 24 32 40 31.65 31.82 36.65
ONNX Runtime CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better ONNX Runtime 1.11 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 On AVX-512 On 512 AVX-512 Off 900 1800 2700 3600 4500 Min: 4700 / Avg: 4718.08 / Max: 5307 Min: 4700 / Avg: 4718.69 / Max: 5297 Min: 4800 / Avg: 4814.2 / Max: 5300
ONNX Runtime CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better ONNX Runtime 1.11 CPU Power Consumption Monitor AVX-512 On 512 AVX-512 On AVX-512 Off 30 60 90 120 150 Min: 12.21 / Avg: 175.17 / Max: 183.77 Min: 12.13 / Avg: 174.33 / Max: 184.01 Min: 12.21 / Avg: 151.62 / Max: 159.76
ONNX Runtime CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better ONNX Runtime 1.11 CPU Temperature Monitor AVX-512 On 512 AVX-512 On AVX-512 Off 14 28 42 56 70 Min: 40 / Avg: 70.87 / Max: 74 Min: 39 / Avg: 70.44 / Max: 74 Min: 38 / Avg: 64.71 / Max: 67
ONNX Runtime Model: ArcFace ResNet-100 - Device: CPU - Executor: Standard OpenBenchmarking.org Inferences Per Minute, More Is Better ONNX Runtime 1.11 Model: ArcFace ResNet-100 - Device: CPU - Executor: Standard AVX-512 Off AVX-512 On AVX-512 On 512 500 1000 1500 2000 2500 SE +/- 35.14, N = 12 SE +/- 2.02, N = 3 SE +/- 1.92, N = 3 1951 2249 2250 -mno-avx512f 1. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt
ONNX Runtime Model: ArcFace ResNet-100 - Device: CPU - Executor: Standard OpenBenchmarking.org Inferences Per Minute Per Watt, More Is Better ONNX Runtime 1.11 Model: ArcFace ResNet-100 - Device: CPU - Executor: Standard AVX-512 Off AVX-512 On AVX-512 On 512 3 6 9 12 15 9.881 10.451 10.464
ONNX Runtime CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better ONNX Runtime 1.11 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 On AVX-512 On 512 AVX-512 Off 900 1800 2700 3600 4500 Min: 3500 / Avg: 4585.07 / Max: 5300 Min: 3587 / Avg: 4590.75 / Max: 5143 Min: 4700 / Avg: 4719.81 / Max: 5300
ONNX Runtime CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better ONNX Runtime 1.11 CPU Power Consumption Monitor AVX-512 On AVX-512 On 512 AVX-512 Off 40 80 120 160 200 Min: 12.25 / Avg: 215.19 / Max: 242.31 Min: 12.17 / Avg: 215.02 / Max: 242.14 Min: 12.04 / Avg: 197.45 / Max: 208.91
ONNX Runtime CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better ONNX Runtime 1.11 CPU Temperature Monitor AVX-512 On 512 AVX-512 On AVX-512 Off 20 40 60 80 100 Min: 40 / Avg: 86.37 / Max: 96 Min: 40 / Avg: 85.67 / Max: 96 Min: 38 / Avg: 80.76 / Max: 86
ONNX Runtime Model: ArcFace ResNet-100 - Device: CPU - Executor: Parallel OpenBenchmarking.org Inferences Per Minute, More Is Better ONNX Runtime 1.11 Model: ArcFace ResNet-100 - Device: CPU - Executor: Parallel AVX-512 Off AVX-512 On 512 AVX-512 On 300 600 900 1200 1500 SE +/- 1.76, N = 3 SE +/- 4.33, N = 3 SE +/- 1.36, N = 3 1278 1368 1388 -mno-avx512f 1. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt
ONNX Runtime Model: ArcFace ResNet-100 - Device: CPU - Executor: Parallel OpenBenchmarking.org Inferences Per Minute Per Watt, More Is Better ONNX Runtime 1.11 Model: ArcFace ResNet-100 - Device: CPU - Executor: Parallel AVX-512 On 512 AVX-512 On AVX-512 Off 2 4 6 8 10 6.988 7.013 7.698
ONNX Runtime CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better ONNX Runtime 1.11 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 On 512 AVX-512 On AVX-512 Off 900 1800 2700 3600 4500 Min: 3850 / Avg: 4692.98 / Max: 5274 Min: 4700 / Avg: 4718.39 / Max: 5300 Min: 4700 / Avg: 4737.48 / Max: 5298
ONNX Runtime CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better ONNX Runtime 1.11 CPU Power Consumption Monitor AVX-512 On AVX-512 On 512 AVX-512 Off 40 80 120 160 200 Min: 12.31 / Avg: 197.92 / Max: 211.73 Min: 12.16 / Avg: 195.75 / Max: 212.83 Min: 12.13 / Avg: 166.02 / Max: 178.1
ONNX Runtime CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better ONNX Runtime 1.11 CPU Temperature Monitor AVX-512 On AVX-512 On 512 AVX-512 Off 20 40 60 80 100 Min: 41 / Avg: 83.51 / Max: 95 Min: 40 / Avg: 83.1 / Max: 97 Min: 39 / Avg: 74.86 / Max: 84
OpenFOAM Input: drivaerFastback, Small Mesh Size - Mesh Time OpenBenchmarking.org Seconds, Fewer Is Better OpenFOAM 10 Input: drivaerFastback, Small Mesh Size - Mesh Time AVX-512 Off AVX-512 On AVX-512 On 512 11 22 33 44 55 46.53 45.49 45.33 1. (CXX) g++ options: -std=c++14 -m64 -O3 -ftemplate-depth-100 -fPIC -fuse-ld=bfd -Xlinker --add-needed --no-as-needed -lfoamToVTK -ldynamicMesh -llagrangian -lgenericPatchFields -lfileFormats -lOpenFOAM -ldl -lm
OpenFOAM Input: drivaerFastback, Small Mesh Size - Execution Time OpenBenchmarking.org Seconds, Fewer Is Better OpenFOAM 10 Input: drivaerFastback, Small Mesh Size - Execution Time AVX-512 On AVX-512 Off AVX-512 On 512 120 240 360 480 600 538.98 538.29 535.11 1. (CXX) g++ options: -std=c++14 -m64 -O3 -ftemplate-depth-100 -fPIC -fuse-ld=bfd -Xlinker --add-needed --no-as-needed -lfoamToVTK -ldynamicMesh -llagrangian -lgenericPatchFields -lfileFormats -lOpenFOAM -ldl -lm
OpenFOAM CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better OpenFOAM 10 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 On AVX-512 Off AVX-512 On 512 900 1800 2700 3600 4500 Min: 4700 / Avg: 4805.98 / Max: 5300 Min: 4731 / Avg: 4807.69 / Max: 5300 Min: 4700 / Avg: 4808.62 / Max: 5301
OpenFOAM CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better OpenFOAM 10 CPU Power Consumption Monitor AVX-512 On 512 AVX-512 On AVX-512 Off 30 60 90 120 150 Min: 12.28 / Avg: 137.66 / Max: 174.47 Min: 12.47 / Avg: 137.27 / Max: 176.06 Min: 12.27 / Avg: 134.48 / Max: 185.27
OpenFOAM CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better OpenFOAM 10 CPU Temperature Monitor AVX-512 On AVX-512 On 512 AVX-512 Off 14 28 42 56 70 Min: 38 / Avg: 61.46 / Max: 73 Min: 38 / Avg: 61.09 / Max: 71 Min: 38 / Avg: 60.32 / Max: 71
OpenRadioss Model: Bird Strike on Windshield OpenBenchmarking.org Seconds, Fewer Is Better OpenRadioss 2022.10.13 Model: Bird Strike on Windshield AVX-512 On 512 AVX-512 Off AVX-512 On 70 140 210 280 350 SE +/- 3.22, N = 5 SE +/- 3.86, N = 4 SE +/- 0.35, N = 3 315.86 311.82 309.21
OpenRadioss CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better OpenRadioss 2022.10.13 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 On AVX-512 On 512 AVX-512 Off 900 1800 2700 3600 4500 Min: 4700 / Avg: 4738.14 / Max: 5300 Min: 4700 / Avg: 4752.2 / Max: 5302 Min: 4700 / Avg: 4764.39 / Max: 5301
OpenRadioss CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better OpenRadioss 2022.10.13 CPU Power Consumption Monitor AVX-512 On 512 AVX-512 On AVX-512 Off 30 60 90 120 150 Min: 12.45 / Avg: 165.14 / Max: 181.24 Min: 12.55 / Avg: 164.63 / Max: 179.72 Min: 12.24 / Avg: 164.06 / Max: 177.04
OpenRadioss CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better OpenRadioss 2022.10.13 CPU Temperature Monitor AVX-512 On AVX-512 On 512 AVX-512 Off 14 28 42 56 70 Min: 39 / Avg: 70.71 / Max: 75 Min: 40 / Avg: 70.47 / Max: 75 Min: 38 / Avg: 70.2 / Max: 74
OpenRadioss Model: Rubber O-Ring Seal Installation OpenBenchmarking.org Seconds, Fewer Is Better OpenRadioss 2022.10.13 Model: Rubber O-Ring Seal Installation AVX-512 On AVX-512 Off AVX-512 On 512 50 100 150 200 250 SE +/- 2.27, N = 7 SE +/- 2.54, N = 5 SE +/- 2.53, N = 4 250.33 243.47 240.62
OpenRadioss CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better OpenRadioss 2022.10.13 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 On AVX-512 On 512 AVX-512 Off 900 1800 2700 3600 4500 Min: 4700 / Avg: 4744.78 / Max: 5300 Min: 4700 / Avg: 4746.34 / Max: 5300 Min: 4700 / Avg: 4789.33 / Max: 5302
OpenRadioss CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better OpenRadioss 2022.10.13 CPU Power Consumption Monitor AVX-512 On 512 AVX-512 On AVX-512 Off 30 60 90 120 150 Min: 12.45 / Avg: 168.45 / Max: 185.36 Min: 12.59 / Avg: 167.03 / Max: 184.87 Min: 12.42 / Avg: 166.23 / Max: 179.39
OpenRadioss CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better OpenRadioss 2022.10.13 CPU Temperature Monitor AVX-512 On AVX-512 On 512 AVX-512 Off 14 28 42 56 70 Min: 38 / Avg: 70.36 / Max: 75 Min: 38 / Avg: 70.17 / Max: 75 Min: 38 / Avg: 69.59 / Max: 73
OpenRadioss Model: Cell Phone Drop Test OpenBenchmarking.org Seconds, Fewer Is Better OpenRadioss 2022.10.13 Model: Cell Phone Drop Test AVX-512 Off AVX-512 On AVX-512 On 512 30 60 90 120 150 SE +/- 0.52, N = 3 SE +/- 1.35, N = 3 SE +/- 0.31, N = 3 128.16 120.62 118.89
OpenRadioss CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better OpenRadioss 2022.10.13 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 On AVX-512 Off AVX-512 On 512 900 1800 2700 3600 4500 Min: 4700 / Avg: 4776.23 / Max: 5300 Min: 4700 / Avg: 4779.68 / Max: 5309 Min: 4700 / Avg: 4779.74 / Max: 5300
OpenRadioss CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better OpenRadioss 2022.10.13 CPU Power Consumption Monitor AVX-512 On 512 AVX-512 On AVX-512 Off 30 60 90 120 150 Min: 12.38 / Avg: 166.68 / Max: 187.69 Min: 12.46 / Avg: 165.44 / Max: 186 Min: 12.35 / Avg: 164.91 / Max: 183.91
OpenRadioss CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better OpenRadioss 2022.10.13 CPU Temperature Monitor AVX-512 On AVX-512 On 512 AVX-512 Off 15 30 45 60 75 Min: 39 / Avg: 69.91 / Max: 76 Min: 39 / Avg: 69.64 / Max: 75 Min: 39 / Avg: 69.57 / Max: 75
OpenRadioss Model: Bumper Beam OpenBenchmarking.org Seconds, Fewer Is Better OpenRadioss 2022.10.13 Model: Bumper Beam AVX-512 On AVX-512 On 512 AVX-512 Off 40 80 120 160 200 SE +/- 2.45, N = 3 SE +/- 1.21, N = 3 SE +/- 1.56, N = 7 177.40 175.69 174.60
OpenRadioss CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better OpenRadioss 2022.10.13 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 On 512 AVX-512 Off AVX-512 On 900 1800 2700 3600 4500 Min: 4700 / Avg: 4723.82 / Max: 5299 Min: 4700 / Avg: 4725.71 / Max: 5303 Min: 4700 / Avg: 4728.36 / Max: 5300
OpenRadioss CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better OpenRadioss 2022.10.13 CPU Power Consumption Monitor AVX-512 On 512 AVX-512 On AVX-512 Off 40 80 120 160 200 Min: 12.18 / Avg: 171.5 / Max: 195.54 Min: 12.46 / Avg: 170.68 / Max: 195.05 Min: 12.52 / Avg: 170 / Max: 193.93
OpenRadioss CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better OpenRadioss 2022.10.13 CPU Temperature Monitor AVX-512 On AVX-512 On 512 AVX-512 Off 15 30 45 60 75 Min: 39 / Avg: 72.25 / Max: 77 Min: 39 / Avg: 72.17 / Max: 77 Min: 39 / Avg: 72.15 / Max: 77
OpenRadioss Model: INIVOL and Fluid Structure Interaction Drop Container OpenBenchmarking.org Seconds, Fewer Is Better OpenRadioss 2022.10.13 Model: INIVOL and Fluid Structure Interaction Drop Container AVX-512 On AVX-512 On 512 AVX-512 Off 160 320 480 640 800 SE +/- 7.20, N = 9 SE +/- 10.28, N = 3 SE +/- 4.20, N = 3 759.23 755.60 713.35
OpenRadioss CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better OpenRadioss 2022.10.13 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 On 512 AVX-512 On AVX-512 Off 900 1800 2700 3600 4500 Min: 4700 / Avg: 4786.28 / Max: 5301 Min: 4700 / Avg: 4786.9 / Max: 5311 Min: 4700 / Avg: 4796.02 / Max: 5300
OpenRadioss CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better OpenRadioss 2022.10.13 CPU Power Consumption Monitor AVX-512 On 512 AVX-512 On AVX-512 Off 30 60 90 120 150 Min: 12.33 / Avg: 166.01 / Max: 172.07 Min: 12.49 / Avg: 165.47 / Max: 171.6 Min: 12.5 / Avg: 163.73 / Max: 168.75
OpenRadioss CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better OpenRadioss 2022.10.13 CPU Temperature Monitor AVX-512 On AVX-512 On 512 AVX-512 Off 15 30 45 60 75 Min: 39 / Avg: 70.02 / Max: 75 Min: 38 / Avg: 69.98 / Max: 76 Min: 38 / Avg: 69.5 / Max: 75
OpenVINO Model: Face Detection FP16 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2022.2.dev Model: Face Detection FP16 - Device: CPU AVX-512 Off AVX-512 On 512 AVX-512 On 0.6683 1.3366 2.0049 2.6732 3.3415 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 2.60 2.95 2.97 -mno-avx512f -ldl -ldl 1. (CXX) g++ options: -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -pie
OpenVINO Model: Face Detection FP16 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2022.2.dev Model: Face Detection FP16 - Device: CPU AVX-512 Off AVX-512 On 512 AVX-512 On 300 600 900 1200 1500 SE +/- 4.24, N = 3 SE +/- 1.26, N = 3 SE +/- 3.79, N = 3 1525.18 1352.08 1346.99 -mno-avx512f - MIN: 825.15 / MAX: 2479.54 -ldl - MIN: 1184.99 / MAX: 1541.85 -ldl - MIN: 1224.1 / MAX: 1502.9 1. (CXX) g++ options: -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -pie
OpenVINO CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better OpenVINO 2022.2.dev CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 On AVX-512 On 512 AVX-512 Off 900 1800 2700 3600 4500 Min: 3429 / Avg: 4599.8 / Max: 5310 Min: 3424 / Avg: 4605.82 / Max: 5143 Min: 3689 / Avg: 4731.52 / Max: 5300
OpenVINO CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better OpenVINO 2022.2.dev CPU Power Consumption Monitor AVX-512 On AVX-512 On 512 AVX-512 Off 50 100 150 200 250 Min: 11.88 / Avg: 218.42 / Max: 263.98 Min: 12.17 / Avg: 216.31 / Max: 263.21 Min: 54.89 / Avg: 202.96 / Max: 226.01
OpenVINO CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better OpenVINO 2022.2.dev CPU Temperature Monitor AVX-512 On 512 AVX-512 On AVX-512 Off 20 40 60 80 100 Min: 39 / Avg: 86.41 / Max: 99 Min: 35 / Avg: 84.78 / Max: 98 Min: 61 / Avg: 84.02 / Max: 93
OpenVINO Model: Face Detection FP16-INT8 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2022.2.dev Model: Face Detection FP16-INT8 - Device: CPU AVX-512 Off AVX-512 On 512 AVX-512 On 3 6 9 12 15 SE +/- 0.02, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 4.88 12.17 12.23 -mno-avx512f -ldl -ldl 1. (CXX) g++ options: -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -pie
OpenVINO Model: Face Detection FP16-INT8 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2022.2.dev Model: Face Detection FP16-INT8 - Device: CPU AVX-512 Off AVX-512 On 512 AVX-512 On 200 400 600 800 1000 SE +/- 3.19, N = 3 SE +/- 0.43, N = 3 SE +/- 0.34, N = 3 817.17 328.08 326.76 -mno-avx512f - MIN: 559.45 / MAX: 1507.03 -ldl - MIN: 193.4 / MAX: 422.42 -ldl - MIN: 183.35 / MAX: 422.57 1. (CXX) g++ options: -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -pie
OpenVINO CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better OpenVINO 2022.2.dev CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 On AVX-512 On 512 AVX-512 Off 900 1800 2700 3600 4500 Min: 3486 / Avg: 4562.25 / Max: 5300 Min: 3417 / Avg: 4571.49 / Max: 5308 Min: 3600 / Avg: 4630.48 / Max: 5300
OpenVINO CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better OpenVINO 2022.2.dev CPU Power Consumption Monitor AVX-512 On AVX-512 Off AVX-512 On 512 50 100 150 200 250 Min: 12.09 / Avg: 210.05 / Max: 263.04 Min: 55.05 / Avg: 200.47 / Max: 228.29 Min: 12.29 / Avg: 198.43 / Max: 264.85
OpenVINO CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better OpenVINO 2022.2.dev CPU Temperature Monitor AVX-512 On AVX-512 Off AVX-512 On 512 20 40 60 80 100 Min: 40 / Avg: 85.93 / Max: 98 Min: 60 / Avg: 84.66 / Max: 94 Min: 40 / Avg: 82.79 / Max: 99
OpenVINO Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2022.2.dev Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU AVX-512 Off AVX-512 On AVX-512 On 512 2K 4K 6K 8K 10K SE +/- 34.03, N = 3 SE +/- 94.72, N = 3 SE +/- 54.72, N = 3 7956.78 9379.27 9460.45 -mno-avx512f -ldl -ldl 1. (CXX) g++ options: -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -pie
OpenVINO Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2022.2.dev Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU AVX-512 Off AVX-512 On AVX-512 On 512 0.225 0.45 0.675 0.9 1.125 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 1.00 0.85 0.84 -mno-avx512f - MIN: 0.48 / MAX: 89.55 -ldl - MIN: 0.45 / MAX: 10.27 -ldl - MIN: 0.48 / MAX: 9.99 1. (CXX) g++ options: -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -pie
OpenVINO CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better OpenVINO 2022.2.dev CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 On 512 AVX-512 On AVX-512 Off 900 1800 2700 3600 4500 Min: 3400 / Avg: 4621.94 / Max: 5300 Min: 3467 / Avg: 4665.94 / Max: 5302 Min: 4700 / Avg: 4741.63 / Max: 5304
OpenVINO CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better OpenVINO 2022.2.dev CPU Power Consumption Monitor AVX-512 On 512 AVX-512 On AVX-512 Off 50 100 150 200 250 Min: 12.23 / Avg: 227.4 / Max: 268.33 Min: 12.26 / Avg: 225.84 / Max: 268.92 Min: 54.99 / Avg: 220.55 / Max: 236.23
OpenVINO CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better OpenVINO 2022.2.dev CPU Temperature Monitor AVX-512 On AVX-512 On 512 AVX-512 Off 20 40 60 80 100 Min: 39 / Avg: 87.24 / Max: 97 Min: 38 / Avg: 85.65 / Max: 96 Min: 60 / Avg: 83.29 / Max: 89
OpenVINO Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2022.2.dev Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU AVX-512 Off AVX-512 On 512 AVX-512 On 5K 10K 15K 20K 25K SE +/- 47.04, N = 3 SE +/- 387.31, N = 15 SE +/- 411.52, N = 15 14973.88 22962.10 23074.82 -mno-avx512f -ldl -ldl 1. (CXX) g++ options: -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -pie
OpenVINO Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2022.2.dev Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU AVX-512 Off AVX-512 On 512 AVX-512 On 0.1193 0.2386 0.3579 0.4772 0.5965 SE +/- 0.00, N = 3 SE +/- 0.01, N = 15 SE +/- 0.01, N = 15 0.53 0.35 0.34 -mno-avx512f - MIN: 0.28 / MAX: 83.77 -ldl - MIN: 0.18 / MAX: 11.28 -ldl - MIN: 0.18 / MAX: 82.47 1. (CXX) g++ options: -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -pie
OpenVINO CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better OpenVINO 2022.2.dev CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 On 512 AVX-512 On AVX-512 Off 900 1800 2700 3600 4500 Min: 3408 / Avg: 4610.19 / Max: 5310 Min: 3400 / Avg: 4624.71 / Max: 5302 Min: 4700 / Avg: 4738.5 / Max: 5300
OpenVINO CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better OpenVINO 2022.2.dev CPU Power Consumption Monitor AVX-512 On AVX-512 On 512 AVX-512 Off 50 100 150 200 250 Min: 12.32 / Avg: 232.01 / Max: 274.61 Min: 12.41 / Avg: 231.67 / Max: 274.84 Min: 55.78 / Avg: 221.82 / Max: 236.18
OpenVINO CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better OpenVINO 2022.2.dev CPU Temperature Monitor AVX-512 On AVX-512 On 512 AVX-512 Off 20 40 60 80 100 Min: 40 / Avg: 87.04 / Max: 95 Min: 41 / Avg: 86.73 / Max: 95 Min: 61 / Avg: 85.95 / Max: 90
OpenVINO Model: Person Detection FP16 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2022.2.dev Model: Person Detection FP16 - Device: CPU AVX-512 Off AVX-512 On AVX-512 On 512 0.4005 0.801 1.2015 1.602 2.0025 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 1.54 1.78 1.78 -mno-avx512f -ldl -ldl 1. (CXX) g++ options: -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -pie
OpenVINO Model: Person Detection FP16 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2022.2.dev Model: Person Detection FP16 - Device: CPU AVX-512 Off AVX-512 On AVX-512 On 512 600 1200 1800 2400 3000 SE +/- 7.35, N = 3 SE +/- 0.33, N = 3 SE +/- 7.01, N = 3 2563.45 2235.54 2227.69 -mno-avx512f - MIN: 1711.34 / MAX: 3871.27 -ldl - MIN: 1874.94 / MAX: 2477.63 -ldl - MIN: 1807.91 / MAX: 2513.61 1. (CXX) g++ options: -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -pie
OpenVINO CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better OpenVINO 2022.2.dev CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 On AVX-512 On 512 AVX-512 Off 900 1800 2700 3600 4500 Min: 3434 / Avg: 4623.02 / Max: 5300 Min: 3439 / Avg: 4662.38 / Max: 5300 Min: 4700 / Avg: 4762.25 / Max: 5300
OpenVINO CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better OpenVINO 2022.2.dev CPU Power Consumption Monitor AVX-512 On AVX-512 On 512 AVX-512 Off 50 100 150 200 250 Min: 12.5 / Avg: 211.57 / Max: 263.35 Min: 12.41 / Avg: 211.56 / Max: 263.47 Min: 55.69 / Avg: 197.83 / Max: 225.46
OpenVINO CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better OpenVINO 2022.2.dev CPU Temperature Monitor AVX-512 On 512 AVX-512 On AVX-512 Off 20 40 60 80 100 Min: 41 / Avg: 87.35 / Max: 100 Min: 40 / Avg: 86.76 / Max: 97 Min: 61 / Avg: 84.05 / Max: 95
OpenVINO Model: Person Detection FP32 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2022.2.dev Model: Person Detection FP32 - Device: CPU AVX-512 Off AVX-512 On AVX-512 On 512 0.3983 0.7966 1.1949 1.5932 1.9915 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 1.54 1.76 1.77 -mno-avx512f -ldl -ldl 1. (CXX) g++ options: -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -pie
OpenVINO Model: Person Detection FP32 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2022.2.dev Model: Person Detection FP32 - Device: CPU AVX-512 Off AVX-512 On AVX-512 On 512 600 1200 1800 2400 3000 SE +/- 9.17, N = 3 SE +/- 9.13, N = 3 SE +/- 8.02, N = 3 2563.87 2250.02 2244.25 -mno-avx512f - MIN: 1540.87 / MAX: 3813.98 -ldl - MIN: 1294.64 / MAX: 2438.65 -ldl - MIN: 1760.66 / MAX: 2505.49 1. (CXX) g++ options: -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -pie
OpenVINO CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better OpenVINO 2022.2.dev CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 On AVX-512 On 512 AVX-512 Off 900 1800 2700 3600 4500 Min: 3400 / Avg: 4531.88 / Max: 5300 Min: 3400 / Avg: 4584.47 / Max: 5300 Min: 4700 / Avg: 4766.42 / Max: 5300
OpenVINO CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better OpenVINO 2022.2.dev CPU Power Consumption Monitor AVX-512 On 512 AVX-512 On AVX-512 Off 50 100 150 200 250 Min: 12.33 / Avg: 207.04 / Max: 270.73 Min: 12.17 / Avg: 206.04 / Max: 269.05 Min: 54.81 / Avg: 199.09 / Max: 231.05
OpenVINO CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better OpenVINO 2022.2.dev CPU Temperature Monitor AVX-512 On 512 AVX-512 On AVX-512 Off 20 40 60 80 100 Min: 41 / Avg: 86.88 / Max: 100 Min: 40 / Avg: 86.02 / Max: 100 Min: 59 / Avg: 84.96 / Max: 95
OpenVINO Model: Weld Porosity Detection FP16-INT8 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2022.2.dev Model: Weld Porosity Detection FP16-INT8 - Device: CPU AVX-512 Off AVX-512 On AVX-512 On 512 300 600 900 1200 1500 SE +/- 2.18, N = 3 SE +/- 5.38, N = 3 SE +/- 4.58, N = 3 533.79 1240.56 1242.45 -mno-avx512f -ldl -ldl 1. (CXX) g++ options: -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -pie
OpenVINO Model: Weld Porosity Detection FP16-INT8 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2022.2.dev Model: Weld Porosity Detection FP16-INT8 - Device: CPU AVX-512 Off AVX-512 On AVX-512 On 512 4 8 12 16 20 SE +/- 0.06, N = 3 SE +/- 0.03, N = 3 SE +/- 0.02, N = 3 14.98 6.43 6.42 -mno-avx512f - MIN: 8.89 / MAX: 192.81 -ldl - MIN: 3.29 / MAX: 13.76 -ldl - MIN: 3.32 / MAX: 13.51 1. (CXX) g++ options: -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -pie
OpenVINO CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better OpenVINO 2022.2.dev CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 On AVX-512 On 512 AVX-512 Off 900 1800 2700 3600 4500 Min: 3500 / Avg: 4589.65 / Max: 5300 Min: 3500 / Avg: 4603.65 / Max: 5199 Min: 3600 / Avg: 4614.52 / Max: 5300
OpenVINO CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better OpenVINO 2022.2.dev CPU Power Consumption Monitor AVX-512 On 512 AVX-512 On AVX-512 Off 50 100 150 200 250 Min: 12.19 / Avg: 217.71 / Max: 260.02 Min: 12.59 / Avg: 216.16 / Max: 260.53 Min: 55.18 / Avg: 209.8 / Max: 238.87
OpenVINO CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better OpenVINO 2022.2.dev CPU Temperature Monitor AVX-512 Off AVX-512 On 512 AVX-512 On 20 40 60 80 100 Min: 60 / Avg: 87.45 / Max: 94 Min: 41 / Avg: 87 / Max: 97 Min: 41 / Avg: 86.74 / Max: 97
OpenVINO Model: Weld Porosity Detection FP16 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2022.2.dev Model: Weld Porosity Detection FP16 - Device: CPU AVX-512 Off AVX-512 On AVX-512 On 512 70 140 210 280 350 SE +/- 0.05, N = 3 SE +/- 0.40, N = 3 SE +/- 1.00, N = 3 252.69 320.80 321.51 -mno-avx512f -ldl -ldl 1. (CXX) g++ options: -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -pie
OpenVINO Model: Weld Porosity Detection FP16 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2022.2.dev Model: Weld Porosity Detection FP16 - Device: CPU AVX-512 On AVX-512 On 512 AVX-512 Off 6 12 18 24 30 SE +/- 0.03, N = 3 SE +/- 0.08, N = 3 SE +/- 0.00, N = 3 24.92 24.86 15.81 -ldl - MIN: 12.72 / MAX: 35.46 -ldl - MIN: 12.43 / MAX: 42.38 -mno-avx512f - MIN: 7.14 / MAX: 105.25 1. (CXX) g++ options: -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -pie
OpenVINO CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better OpenVINO 2022.2.dev CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 On 512 AVX-512 On AVX-512 Off 900 1800 2700 3600 4500 Min: 3000 / Avg: 4570.85 / Max: 5186 Min: 3500 / Avg: 4571.82 / Max: 5303 Min: 4007 / Avg: 4734.73 / Max: 5300
OpenVINO CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better OpenVINO 2022.2.dev CPU Power Consumption Monitor AVX-512 On 512 AVX-512 Off AVX-512 On 50 100 150 200 250 Min: 12.36 / Avg: 217.96 / Max: 268.63 Min: 55.78 / Avg: 216.3 / Max: 232.36 Min: 12.39 / Avg: 215.87 / Max: 266.83
OpenVINO CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better OpenVINO 2022.2.dev CPU Temperature Monitor AVX-512 On 512 AVX-512 Off AVX-512 On 20 40 60 80 100 Min: 40 / Avg: 87.33 / Max: 96 Min: 61 / Avg: 86.8 / Max: 92 Min: 42 / Avg: 86.73 / Max: 97
OpenVINO Model: Vehicle Detection FP16-INT8 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2022.2.dev Model: Vehicle Detection FP16-INT8 - Device: CPU AVX-512 Off AVX-512 On AVX-512 On 512 140 280 420 560 700 SE +/- 1.58, N = 3 SE +/- 3.77, N = 3 SE +/- 1.77, N = 3 310.38 623.17 630.58 -mno-avx512f -ldl -ldl 1. (CXX) g++ options: -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -pie
OpenVINO Model: Vehicle Detection FP16-INT8 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2022.2.dev Model: Vehicle Detection FP16-INT8 - Device: CPU AVX-512 Off AVX-512 On AVX-512 On 512 3 6 9 12 15 SE +/- 0.06, N = 3 SE +/- 0.04, N = 3 SE +/- 0.02, N = 3 12.88 6.41 6.33 -mno-avx512f - MIN: 7.49 / MAX: 109.79 -ldl - MIN: 3.21 / MAX: 14.83 -ldl - MIN: 4.22 / MAX: 15.17 1. (CXX) g++ options: -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -pie
OpenVINO CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better OpenVINO 2022.2.dev CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 On 512 AVX-512 On AVX-512 Off 900 1800 2700 3600 4500 Min: 2700 / Avg: 4559.24 / Max: 5300 Min: 3451 / Avg: 4568.22 / Max: 5300 Min: 3648 / Avg: 4621.73 / Max: 5300
OpenVINO CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better OpenVINO 2022.2.dev CPU Power Consumption Monitor AVX-512 On 512 AVX-512 On AVX-512 Off 50 100 150 200 250 Min: 12.25 / Avg: 215.41 / Max: 266.45 Min: 12.3 / Avg: 212.55 / Max: 269.62 Min: 56.17 / Avg: 203.83 / Max: 229.49
OpenVINO CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better OpenVINO 2022.2.dev CPU Temperature Monitor AVX-512 On AVX-512 On 512 AVX-512 Off 20 40 60 80 100 Min: 41 / Avg: 87.16 / Max: 98 Min: 41 / Avg: 87.07 / Max: 99 Min: 63 / Avg: 85.86 / Max: 93
OpenVINO Model: Vehicle Detection FP16 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2022.2.dev Model: Vehicle Detection FP16 - Device: CPU AVX-512 On AVX-512 On 512 AVX-512 Off 30 60 90 120 150 SE +/- 0.12, N = 3 SE +/- 0.25, N = 3 SE +/- 1.44, N = 3 108.61 109.09 141.30 -ldl -ldl -mno-avx512f 1. (CXX) g++ options: -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -pie
OpenVINO Model: Vehicle Detection FP16 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2022.2.dev Model: Vehicle Detection FP16 - Device: CPU AVX-512 On AVX-512 On 512 AVX-512 Off 8 16 24 32 40 SE +/- 0.04, N = 3 SE +/- 0.08, N = 3 SE +/- 0.29, N = 3 36.80 36.64 28.29 -ldl - MIN: 12.79 / MAX: 55.71 -ldl - MIN: 13.62 / MAX: 58.49 -mno-avx512f - MIN: 11.7 / MAX: 274.34 1. (CXX) g++ options: -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -pie
OpenVINO CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better OpenVINO 2022.2.dev CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 On 512 AVX-512 On AVX-512 Off 1000 2000 3000 4000 5000 Min: 4700 / Avg: 4729.11 / Max: 5314 Min: 4700 / Avg: 4730.05 / Max: 5300 Min: 4700 / Avg: 4746.45 / Max: 5621
OpenVINO CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better OpenVINO 2022.2.dev CPU Power Consumption Monitor AVX-512 On AVX-512 On 512 AVX-512 Off 40 80 120 160 200 Min: 12.26 / Avg: 198.22 / Max: 214.69 Min: 12.15 / Avg: 198.06 / Max: 213.93 Min: 55.1 / Avg: 178.79 / Max: 191.55
OpenVINO CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better OpenVINO 2022.2.dev CPU Temperature Monitor AVX-512 On AVX-512 On 512 AVX-512 Off 16 32 48 64 80 Min: 41 / Avg: 76.53 / Max: 85 Min: 40 / Avg: 76.21 / Max: 84 Min: 60 / Avg: 73.94 / Max: 80
OpenVINO Model: Person Vehicle Bike Detection FP16 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2022.2.dev Model: Person Vehicle Bike Detection FP16 - Device: CPU AVX-512 On 512 AVX-512 On AVX-512 Off 70 140 210 280 350 SE +/- 2.59, N = 7 SE +/- 2.42, N = 3 SE +/- 3.32, N = 6 285.75 286.43 325.95 -ldl -ldl -mno-avx512f 1. (CXX) g++ options: -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -pie
OpenVINO Model: Person Vehicle Bike Detection FP16 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2022.2.dev Model: Person Vehicle Bike Detection FP16 - Device: CPU AVX-512 On 512 AVX-512 On AVX-512 Off 4 8 12 16 20 SE +/- 0.12, N = 7 SE +/- 0.12, N = 3 SE +/- 0.12, N = 6 13.99 13.95 12.26 -ldl - MIN: 6.28 / MAX: 24.01 -ldl - MIN: 6.25 / MAX: 52.24 -mno-avx512f - MIN: 6.09 / MAX: 23.07 1. (CXX) g++ options: -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -pie
OpenVINO CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better OpenVINO 2022.2.dev CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 On 512 AVX-512 On AVX-512 Off 900 1800 2700 3600 4500 Min: 4700 / Avg: 4730.67 / Max: 5300 Min: 4700 / Avg: 4733.54 / Max: 5300 Min: 4700 / Avg: 4735.41 / Max: 5311
OpenVINO CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better OpenVINO 2022.2.dev CPU Power Consumption Monitor AVX-512 On 512 AVX-512 On AVX-512 Off 40 80 120 160 200 Min: 12.28 / Avg: 214.43 / Max: 245.42 Min: 12.31 / Avg: 213.54 / Max: 244.32 Min: 12.72 / Avg: 193.11 / Max: 217.17
OpenVINO CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better OpenVINO 2022.2.dev CPU Temperature Monitor AVX-512 On 512 AVX-512 On AVX-512 Off 20 40 60 80 100 Min: 40 / Avg: 81.03 / Max: 89 Min: 40 / Avg: 80.87 / Max: 89 Min: 44 / Avg: 76.67 / Max: 83
OpenVINO Model: Machine Translation EN To DE FP16 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2022.2.dev Model: Machine Translation EN To DE FP16 - Device: CPU AVX-512 Off AVX-512 On 512 AVX-512 On 8 16 24 32 40 SE +/- 0.04, N = 3 SE +/- 0.18, N = 3 SE +/- 0.27, N = 3 31.70 35.55 35.62 -mno-avx512f -ldl -ldl 1. (CXX) g++ options: -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -pie
OpenVINO Model: Machine Translation EN To DE FP16 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2022.2.dev Model: Machine Translation EN To DE FP16 - Device: CPU AVX-512 Off AVX-512 On 512 AVX-512 On 30 60 90 120 150 SE +/- 0.14, N = 3 SE +/- 0.59, N = 3 SE +/- 0.88, N = 3 126.09 112.48 112.27 -mno-avx512f - MIN: 58.5 / MAX: 136.1 -ldl - MIN: 53.91 / MAX: 140.82 -ldl - MIN: 60.98 / MAX: 140.63 1. (CXX) g++ options: -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -pie
OpenVINO CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better OpenVINO 2022.2.dev CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 On AVX-512 On 512 AVX-512 Off 900 1800 2700 3600 4500 Min: 3422 / Avg: 4604.88 / Max: 5300 Min: 3403 / Avg: 4632.52 / Max: 5130 Min: 4700 / Avg: 4731.38 / Max: 5300
OpenVINO CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better OpenVINO 2022.2.dev CPU Power Consumption Monitor AVX-512 On AVX-512 On 512 AVX-512 Off 50 100 150 200 250 Min: 12.32 / Avg: 220.48 / Max: 255.95 Min: 12.26 / Avg: 219.2 / Max: 255.83 Min: 12.2 / Avg: 207.39 / Max: 228.54
OpenVINO CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better OpenVINO 2022.2.dev CPU Temperature Monitor AVX-512 On 512 AVX-512 On AVX-512 Off 20 40 60 80 100 Min: 40 / Avg: 85.67 / Max: 95 Min: 40 / Avg: 84.75 / Max: 97 Min: 40 / Avg: 80.98 / Max: 89
OpenVKL Benchmark: vklBenchmark ISPC OpenBenchmarking.org Items / Sec, More Is Better OpenVKL 1.0 Benchmark: vklBenchmark ISPC AVX-512 Off AVX-512 On 512 AVX-512 On 30 60 90 120 150 SE +/- 0.00, N = 3 SE +/- 0.67, N = 3 SE +/- 0.33, N = 3 87 112 113 MIN: 7 / MAX: 901 MIN: 9 / MAX: 1115 MIN: 10 / MAX: 1116
OpenVKL Benchmark: vklBenchmark ISPC OpenBenchmarking.org Items / Sec Per Watt, More Is Better OpenVKL 1.0 Benchmark: vklBenchmark ISPC AVX-512 Off AVX-512 On 512 AVX-512 On 0.1314 0.2628 0.3942 0.5256 0.657 0.525 0.578 0.584
OpenVKL CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better OpenVKL 1.0 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 On AVX-512 On 512 AVX-512 Off 900 1800 2700 3600 4500 Min: 3451 / Avg: 4805.24 / Max: 5300 Min: 3472 / Avg: 4818.52 / Max: 5304 Min: 4700 / Avg: 4841.21 / Max: 5326
OpenVKL CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better OpenVKL 1.0 CPU Power Consumption Monitor AVX-512 On 512 AVX-512 On AVX-512 Off 50 100 150 200 250 Min: 12.63 / Avg: 193.7 / Max: 270.03 Min: 12.58 / Avg: 193.56 / Max: 269.81 Min: 12.4 / Avg: 165.67 / Max: 222.7
OpenVKL CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better OpenVKL 1.0 CPU Temperature Monitor AVX-512 On AVX-512 On 512 AVX-512 Off 20 40 60 80 100 Min: 41 / Avg: 79.75 / Max: 95 Min: 41 / Avg: 79.44 / Max: 92 Min: 40 / Avg: 72.95 / Max: 82
OSPRay Benchmark: gravity_spheres_volume/dim_512/ao/real_time OpenBenchmarking.org Items Per Second, More Is Better OSPRay 2.10 Benchmark: gravity_spheres_volume/dim_512/ao/real_time AVX-512 Off AVX-512 On AVX-512 On 512 1.0055 2.011 3.0165 4.022 5.0275 SE +/- 0.01595, N = 3 SE +/- 0.02867, N = 3 SE +/- 0.01309, N = 3 2.82821 4.42072 4.46906
OSPRay Benchmark: gravity_spheres_volume/dim_512/ao/real_time OpenBenchmarking.org Items Per Second Per Watt, More Is Better OSPRay 2.10 Benchmark: gravity_spheres_volume/dim_512/ao/real_time AVX-512 Off AVX-512 On AVX-512 On 512 0.0043 0.0086 0.0129 0.0172 0.0215 0.014 0.019 0.019
OSPRay CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better OSPRay 2.10 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 On AVX-512 On 512 AVX-512 Off 900 1800 2700 3600 4500 Min: 3419 / Avg: 4650.07 / Max: 5300 Min: 3422 / Avg: 4664.09 / Max: 5300 Min: 4700 / Avg: 4729.36 / Max: 5300
OSPRay CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better OSPRay 2.10 CPU Power Consumption Monitor AVX-512 On 512 AVX-512 On AVX-512 Off 50 100 150 200 250 Min: 12.34 / Avg: 237.72 / Max: 263.57 Min: 12.22 / Avg: 235.26 / Max: 262.25 Min: 12.22 / Avg: 198.05 / Max: 219.36
OSPRay CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better OSPRay 2.10 CPU Temperature Monitor AVX-512 On 512 AVX-512 On AVX-512 Off 20 40 60 80 100 Min: 32 / Avg: 85.49 / Max: 94 Min: 32 / Avg: 84.89 / Max: 94 Min: 33 / Avg: 77.15 / Max: 82
OSPRay Benchmark: gravity_spheres_volume/dim_512/scivis/real_time OpenBenchmarking.org Items Per Second, More Is Better OSPRay 2.10 Benchmark: gravity_spheres_volume/dim_512/scivis/real_time AVX-512 Off AVX-512 On 512 AVX-512 On 0.9833 1.9666 2.9499 3.9332 4.9165 SE +/- 0.00481, N = 3 SE +/- 0.02096, N = 3 SE +/- 0.01025, N = 3 2.72378 4.36772 4.37042
OSPRay Benchmark: gravity_spheres_volume/dim_512/scivis/real_time OpenBenchmarking.org Items Per Second Per Watt, More Is Better OSPRay 2.10 Benchmark: gravity_spheres_volume/dim_512/scivis/real_time AVX-512 Off AVX-512 On AVX-512 On 512 0.0043 0.0086 0.0129 0.0172 0.0215 0.014 0.018 0.019
OSPRay CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better OSPRay 2.10 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 On 512 AVX-512 On AVX-512 Off 900 1800 2700 3600 4500 Min: 3461 / Avg: 4640.61 / Max: 5300 Min: 3500 / Avg: 4674.77 / Max: 5300 Min: 4700 / Avg: 4727.24 / Max: 5300
OSPRay CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better OSPRay 2.10 CPU Power Consumption Monitor AVX-512 On AVX-512 On 512 AVX-512 Off 50 100 150 200 250 Min: 12.49 / Avg: 236.7 / Max: 264.63 Min: 12.57 / Avg: 234.34 / Max: 264.33 Min: 12.35 / Avg: 198.29 / Max: 211.32
OSPRay CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better OSPRay 2.10 CPU Temperature Monitor AVX-512 On AVX-512 On 512 AVX-512 Off 20 40 60 80 100 Min: 41 / Avg: 86.81 / Max: 93 Min: 41 / Avg: 85.73 / Max: 94 Min: 39 / Avg: 77.75 / Max: 82
OSPRay Benchmark: gravity_spheres_volume/dim_512/pathtracer/real_time OpenBenchmarking.org Items Per Second, More Is Better OSPRay 2.10 Benchmark: gravity_spheres_volume/dim_512/pathtracer/real_time AVX-512 Off AVX-512 On 512 AVX-512 On 1.207 2.414 3.621 4.828 6.035 SE +/- 0.01158, N = 3 SE +/- 0.02156, N = 3 SE +/- 0.01274, N = 3 4.05745 5.35301 5.36461
OSPRay Benchmark: gravity_spheres_volume/dim_512/pathtracer/real_time OpenBenchmarking.org Items Per Second Per Watt, More Is Better OSPRay 2.10 Benchmark: gravity_spheres_volume/dim_512/pathtracer/real_time AVX-512 Off AVX-512 On AVX-512 On 512 0.0052 0.0104 0.0156 0.0208 0.026 0.019 0.023 0.023
OSPRay CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better OSPRay 2.10 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 On AVX-512 On 512 AVX-512 Off 900 1800 2700 3600 4500 Min: 3400 / Avg: 4599.64 / Max: 5301 Min: 4521 / Avg: 4617.05 / Max: 5300 Min: 4700 / Avg: 4729.58 / Max: 5300
OSPRay CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better OSPRay 2.10 CPU Power Consumption Monitor AVX-512 On 512 AVX-512 On AVX-512 Off 50 100 150 200 250 Min: 12.54 / Avg: 237.53 / Max: 280.23 Min: 12.57 / Avg: 236.09 / Max: 283.94 Min: 12.55 / Avg: 216.29 / Max: 232.17
OSPRay CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better OSPRay 2.10 CPU Temperature Monitor AVX-512 On 512 AVX-512 On AVX-512 Off 20 40 60 80 100 Min: 42 / Avg: 87.79 / Max: 94 Min: 41 / Avg: 87.66 / Max: 96 Min: 40 / Avg: 82.51 / Max: 87
OSPRay Benchmark: particle_volume/ao/real_time OpenBenchmarking.org Items Per Second, More Is Better OSPRay 2.10 Benchmark: particle_volume/ao/real_time AVX-512 On 512 AVX-512 On AVX-512 Off 2 4 6 8 10 SE +/- 0.03653, N = 3 SE +/- 0.01187, N = 3 SE +/- 0.00177, N = 3 4.95280 4.95822 6.02446
OSPRay Benchmark: particle_volume/ao/real_time OpenBenchmarking.org Items Per Second Per Watt, More Is Better OSPRay 2.10 Benchmark: particle_volume/ao/real_time AVX-512 On AVX-512 On 512 AVX-512 Off 0.0068 0.0136 0.0204 0.0272 0.034 0.021 0.021 0.030
OSPRay CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better OSPRay 2.10 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 On 512 AVX-512 On AVX-512 Off 900 1800 2700 3600 4500 Min: 4652 / Avg: 4706.83 / Max: 5300 Min: 4656 / Avg: 4708 / Max: 5311 Min: 4700 / Avg: 4711.34 / Max: 5300
OSPRay CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better OSPRay 2.10 CPU Power Consumption Monitor AVX-512 On 512 AVX-512 On AVX-512 Off 40 80 120 160 200 Min: 12.62 / Avg: 232.11 / Max: 240.01 Min: 12.57 / Avg: 231.69 / Max: 239.43 Min: 12.62 / Avg: 203.23 / Max: 210.28
OSPRay CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better OSPRay 2.10 CPU Temperature Monitor AVX-512 On 512 AVX-512 On AVX-512 Off 20 40 60 80 100 Min: 42 / Avg: 88.47 / Max: 92 Min: 41 / Avg: 88.39 / Max: 92 Min: 41 / Avg: 79.36 / Max: 82
OSPRay Benchmark: particle_volume/scivis/real_time OpenBenchmarking.org Items Per Second, More Is Better OSPRay 2.10 Benchmark: particle_volume/scivis/real_time AVX-512 On 512 AVX-512 On AVX-512 Off 1.3312 2.6624 3.9936 5.3248 6.656 SE +/- 0.01748, N = 3 SE +/- 0.04966, N = 3 SE +/- 0.02016, N = 3 4.95148 4.98037 5.91636
OSPRay Benchmark: particle_volume/scivis/real_time OpenBenchmarking.org Items Per Second Per Watt, More Is Better OSPRay 2.10 Benchmark: particle_volume/scivis/real_time AVX-512 On AVX-512 On 512 AVX-512 Off 0.0072 0.0144 0.0216 0.0288 0.036 0.025 0.025 0.032
OSPRay CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better OSPRay 2.10 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 Off AVX-512 On 512 AVX-512 On 900 1800 2700 3600 4500 Min: 4700 / Avg: 4763.75 / Max: 5305 Min: 4700 / Avg: 4769.33 / Max: 5198 Min: 4700 / Avg: 4769.71 / Max: 5300
OSPRay CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better OSPRay 2.10 CPU Power Consumption Monitor AVX-512 On 512 AVX-512 On AVX-512 Off 40 80 120 160 200 Min: 12.55 / Avg: 198.87 / Max: 240.3 Min: 12.49 / Avg: 198.08 / Max: 238.61 Min: 12.9 / Avg: 184.06 / Max: 210.42
OSPRay CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better OSPRay 2.10 CPU Temperature Monitor AVX-512 On AVX-512 On 512 AVX-512 Off 20 40 60 80 100 Min: 41 / Avg: 82.31 / Max: 91 Min: 41 / Avg: 81.84 / Max: 91 Min: 40 / Avg: 76.45 / Max: 82
OSPRay Benchmark: particle_volume/pathtracer/real_time OpenBenchmarking.org Items Per Second, More Is Better OSPRay 2.10 Benchmark: particle_volume/pathtracer/real_time AVX-512 Off AVX-512 On AVX-512 On 512 40 80 120 160 200 SE +/- 0.37, N = 3 SE +/- 0.21, N = 3 SE +/- 0.56, N = 3 164.96 173.13 173.74
OSPRay Benchmark: particle_volume/pathtracer/real_time OpenBenchmarking.org Items Per Second Per Watt, More Is Better OSPRay 2.10 Benchmark: particle_volume/pathtracer/real_time AVX-512 Off AVX-512 On AVX-512 On 512 0.1888 0.3776 0.5664 0.7552 0.944 0.794 0.837 0.839
OSPRay CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better OSPRay 2.10 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 On AVX-512 On 512 AVX-512 Off 900 1800 2700 3600 4500 Min: 3500 / Avg: 4675.68 / Max: 5300 Min: 4500 / Avg: 4677.43 / Max: 5310 Min: 4700 / Avg: 4762.5 / Max: 5263
OSPRay CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better OSPRay 2.10 CPU Power Consumption Monitor AVX-512 Off AVX-512 On 512 AVX-512 On 50 100 150 200 250 Min: 12.34 / Avg: 207.64 / Max: 238.67 Min: 12.5 / Avg: 207.18 / Max: 278.74 Min: 12.35 / Avg: 206.8 / Max: 279.53
OSPRay CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better OSPRay 2.10 CPU Temperature Monitor AVX-512 On 512 AVX-512 On AVX-512 Off 20 40 60 80 100 Min: 40 / Avg: 82.89 / Max: 92 Min: 40 / Avg: 82.87 / Max: 95 Min: 39 / Avg: 81.5 / Max: 88
OSPRay Studio Camera: 1 - Resolution: 1080p - Samples Per Pixel: 1 - Renderer: Path Tracer OpenBenchmarking.org ms, Fewer Is Better OSPRay Studio 0.11 Camera: 1 - Resolution: 1080p - Samples Per Pixel: 1 - Renderer: Path Tracer AVX-512 Off AVX-512 On AVX-512 On 512 500 1000 1500 2000 2500 SE +/- 1.45, N = 3 SE +/- 18.66, N = 3 SE +/- 3.51, N = 3 2134 1958 1951 -mno-avx512f 1. (CXX) g++ options: -O3 -march=native -ldl
OSPRay Studio CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better OSPRay Studio 0.11 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 On 512 AVX-512 On AVX-512 Off 900 1800 2700 3600 4500 Min: 4572 / Avg: 4702.26 / Max: 5300 Min: 3500 / Avg: 4719.74 / Max: 5310 Min: 4700 / Avg: 4759.8 / Max: 5300
OSPRay Studio CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better OSPRay Studio 0.11 CPU Power Consumption Monitor AVX-512 On AVX-512 On 512 AVX-512 Off 50 100 150 200 250 Min: 12.47 / Avg: 227.36 / Max: 267.89 Min: 12.45 / Avg: 224.9 / Max: 263.86 Min: 12.2 / Avg: 196.81 / Max: 219.8
OSPRay Studio CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better OSPRay Studio 0.11 CPU Temperature Monitor AVX-512 On 512 AVX-512 On AVX-512 Off 20 40 60 80 100 Min: 38 / Avg: 86.37 / Max: 93 Min: 38 / Avg: 85.39 / Max: 96 Min: 38 / Avg: 78.1 / Max: 84
OSPRay Studio Camera: 1 - Resolution: 1080p - Samples Per Pixel: 16 - Renderer: Path Tracer OpenBenchmarking.org ms, Fewer Is Better OSPRay Studio 0.11 Camera: 1 - Resolution: 1080p - Samples Per Pixel: 16 - Renderer: Path Tracer AVX-512 Off AVX-512 On 512 AVX-512 On 7K 14K 21K 28K 35K SE +/- 5.46, N = 3 SE +/- 206.81, N = 3 SE +/- 32.95, N = 3 34112 31180 31054 -mno-avx512f 1. (CXX) g++ options: -O3 -march=native -ldl
OSPRay Studio CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better OSPRay Studio 0.11 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 On 512 AVX-512 On AVX-512 Off 900 1800 2700 3600 4500 Min: 3453 / Avg: 4694.88 / Max: 5301 Min: 4567 / Avg: 4716.26 / Max: 5300 Min: 4700 / Avg: 4759.97 / Max: 5300
OSPRay Studio CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better OSPRay Studio 0.11 CPU Power Consumption Monitor AVX-512 On AVX-512 On 512 AVX-512 Off 50 100 150 200 250 Min: 12.54 / Avg: 224.93 / Max: 265.94 Min: 12.59 / Avg: 223.34 / Max: 269.08 Min: 12.27 / Avg: 197.1 / Max: 221.49
OSPRay Studio CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better OSPRay Studio 0.11 CPU Temperature Monitor AVX-512 On AVX-512 On 512 AVX-512 Off 20 40 60 80 100 Min: 41 / Avg: 86.33 / Max: 94 Min: 41 / Avg: 86.12 / Max: 95 Min: 40 / Avg: 78.59 / Max: 84
OSPRay Studio Camera: 1 - Resolution: 1080p - Samples Per Pixel: 32 - Renderer: Path Tracer OpenBenchmarking.org ms, Fewer Is Better OSPRay Studio 0.11 Camera: 1 - Resolution: 1080p - Samples Per Pixel: 32 - Renderer: Path Tracer AVX-512 Off AVX-512 On AVX-512 On 512 15K 30K 45K 60K 75K SE +/- 50.78, N = 3 SE +/- 55.47, N = 3 SE +/- 140.32, N = 3 72145 65723 65447 -mno-avx512f 1. (CXX) g++ options: -O3 -march=native -ldl
OSPRay Studio CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better OSPRay Studio 0.11 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 On AVX-512 On 512 AVX-512 Off 900 1800 2700 3600 4500 Min: 3426 / Avg: 4746.5 / Max: 5300 Min: 4600 / Avg: 4754.09 / Max: 5300 Min: 4700 / Avg: 4791.69 / Max: 5308
OSPRay Studio CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better OSPRay Studio 0.11 CPU Power Consumption Monitor AVX-512 On 512 AVX-512 On AVX-512 Off 50 100 150 200 250 Min: 12.52 / Avg: 215.79 / Max: 268.64 Min: 12.67 / Avg: 212.47 / Max: 268.13 Min: 12.43 / Avg: 187.52 / Max: 220.7
OSPRay Studio CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better OSPRay Studio 0.11 CPU Temperature Monitor AVX-512 On AVX-512 On 512 AVX-512 Off 20 40 60 80 100 Min: 42 / Avg: 84.38 / Max: 94 Min: 41 / Avg: 84.26 / Max: 91 Min: 40 / Avg: 76.62 / Max: 83
OSPRay Studio Camera: 1 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path Tracer OpenBenchmarking.org ms, Fewer Is Better OSPRay Studio 0.11 Camera: 1 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path Tracer AVX-512 Off AVX-512 On AVX-512 On 512 2K 4K 6K 8K 10K SE +/- 2.40, N = 3 SE +/- 26.87, N = 3 SE +/- 11.53, N = 3 8450 7743 7734 -mno-avx512f 1. (CXX) g++ options: -O3 -march=native -ldl
OSPRay Studio CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better OSPRay Studio 0.11 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 On AVX-512 On 512 AVX-512 Off 900 1800 2700 3600 4500 Min: 3461 / Avg: 4676.99 / Max: 5300 Min: 4570 / Avg: 4680.41 / Max: 5300 Min: 4700 / Avg: 4745.23 / Max: 5313
OSPRay Studio CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better OSPRay Studio 0.11 CPU Power Consumption Monitor AVX-512 On AVX-512 On 512 AVX-512 Off 50 100 150 200 250 Min: 12.49 / Avg: 232 / Max: 270.49 Min: 12.57 / Avg: 231.83 / Max: 266.17 Min: 12.21 / Avg: 203.21 / Max: 220.23
OSPRay Studio CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better OSPRay Studio 0.11 CPU Temperature Monitor AVX-512 On 512 AVX-512 On AVX-512 Off 20 40 60 80 100 Min: 41 / Avg: 87.44 / Max: 93 Min: 40 / Avg: 87.2 / Max: 96 Min: 41 / Avg: 79.36 / Max: 84
OSPRay Studio Camera: 1 - Resolution: 4K - Samples Per Pixel: 16 - Renderer: Path Tracer OpenBenchmarking.org ms, Fewer Is Better OSPRay Studio 0.11 Camera: 1 - Resolution: 4K - Samples Per Pixel: 16 - Renderer: Path Tracer AVX-512 Off AVX-512 On 512 AVX-512 On 30K 60K 90K 120K 150K SE +/- 39.26, N = 3 SE +/- 430.68, N = 3 SE +/- 834.11, N = 3 139519 127540 127267 -mno-avx512f 1. (CXX) g++ options: -O3 -march=native -ldl
OSPRay Studio CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better OSPRay Studio 0.11 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 On 512 AVX-512 On AVX-512 Off 900 1800 2700 3600 4500 Min: 3446 / Avg: 4670.53 / Max: 5310 Min: 3477 / Avg: 4691.4 / Max: 5300 Min: 4700 / Avg: 4747.54 / Max: 5300
OSPRay Studio CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better OSPRay Studio 0.11 CPU Power Consumption Monitor AVX-512 On AVX-512 On 512 AVX-512 Off 50 100 150 200 250 Min: 12.63 / Avg: 229.98 / Max: 273.69 Min: 12.72 / Avg: 226.55 / Max: 269.83 Min: 12.44 / Avg: 201.82 / Max: 223.16
OSPRay Studio CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better OSPRay Studio 0.11 CPU Temperature Monitor AVX-512 On 512 AVX-512 On AVX-512 Off 20 40 60 80 100 Min: 42 / Avg: 87.16 / Max: 95 Min: 41 / Avg: 86.52 / Max: 93 Min: 40 / Avg: 79.03 / Max: 84
OSPRay Studio Camera: 1 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path Tracer OpenBenchmarking.org ms, Fewer Is Better OSPRay Studio 0.11 Camera: 1 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path Tracer AVX-512 Off AVX-512 On AVX-512 On 512 60K 120K 180K 240K 300K SE +/- 100.66, N = 3 SE +/- 259.35, N = 3 SE +/- 784.12, N = 3 275693 251261 250698 -mno-avx512f 1. (CXX) g++ options: -O3 -march=native -ldl
OSPRay Studio CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better OSPRay Studio 0.11 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 On AVX-512 On 512 AVX-512 Off 900 1800 2700 3600 4500 Min: 3450 / Avg: 4627.77 / Max: 5304 Min: 4546 / Avg: 4639.07 / Max: 5300 Min: 4700 / Avg: 4726.06 / Max: 5300
OSPRay Studio CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better OSPRay Studio 0.11 CPU Power Consumption Monitor AVX-512 On 512 AVX-512 On AVX-512 Off 50 100 150 200 250 Min: 12.53 / Avg: 235.59 / Max: 266.57 Min: 12.78 / Avg: 234.22 / Max: 270.6 Min: 12.51 / Avg: 209.79 / Max: 224.27
OSPRay Studio CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better OSPRay Studio 0.11 CPU Temperature Monitor AVX-512 On 512 AVX-512 On AVX-512 Off 20 40 60 80 100 Min: 41 / Avg: 88.34 / Max: 94 Min: 42 / Avg: 88.05 / Max: 96 Min: 40 / Avg: 80.21 / Max: 84
OSPRay Studio Camera: 3 - Resolution: 1080p - Samples Per Pixel: 1 - Renderer: Path Tracer OpenBenchmarking.org ms, Fewer Is Better OSPRay Studio 0.11 Camera: 3 - Resolution: 1080p - Samples Per Pixel: 1 - Renderer: Path Tracer AVX-512 Off AVX-512 On 512 AVX-512 On 500 1000 1500 2000 2500 SE +/- 2.85, N = 3 SE +/- 2.33, N = 3 SE +/- 3.76, N = 3 2561 2364 2358 -mno-avx512f 1. (CXX) g++ options: -O3 -march=native -ldl
OSPRay Studio CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better OSPRay Studio 0.11 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 On 512 AVX-512 On AVX-512 Off 900 1800 2700 3600 4500 Min: 4571 / Avg: 4680.45 / Max: 5300 Min: 4576 / Avg: 4701.44 / Max: 5300 Min: 4700 / Avg: 4753.65 / Max: 5300
OSPRay Studio CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better OSPRay Studio 0.11 CPU Power Consumption Monitor AVX-512 On AVX-512 On 512 AVX-512 Off 50 100 150 200 250 Min: 12.71 / Avg: 228.53 / Max: 263.37 Min: 12.48 / Avg: 225.22 / Max: 265.65 Min: 12.47 / Avg: 198.07 / Max: 218.51
OSPRay Studio CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better OSPRay Studio 0.11 CPU Temperature Monitor AVX-512 On 512 AVX-512 On AVX-512 Off 20 40 60 80 100 Min: 42 / Avg: 87.08 / Max: 93 Min: 41 / Avg: 86.94 / Max: 91 Min: 39 / Avg: 78.14 / Max: 88
OSPRay Studio Camera: 3 - Resolution: 1080p - Samples Per Pixel: 16 - Renderer: Path Tracer OpenBenchmarking.org ms, Fewer Is Better OSPRay Studio 0.11 Camera: 3 - Resolution: 1080p - Samples Per Pixel: 16 - Renderer: Path Tracer AVX-512 Off AVX-512 On AVX-512 On 512 9K 18K 27K 36K 45K SE +/- 14.77, N = 3 SE +/- 89.45, N = 3 SE +/- 9.61, N = 3 40948 37662 37620 -mno-avx512f 1. (CXX) g++ options: -O3 -march=native -ldl
OSPRay Studio CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better OSPRay Studio 0.11 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 On 512 AVX-512 On AVX-512 Off 900 1800 2700 3600 4500 Min: 4570 / Avg: 4692.8 / Max: 5300 Min: 4561 / Avg: 4700.89 / Max: 5300 Min: 4700 / Avg: 4753.09 / Max: 5326
OSPRay Studio CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better OSPRay Studio 0.11 CPU Power Consumption Monitor AVX-512 On AVX-512 On 512 AVX-512 Off 50 100 150 200 250 Min: 12.66 / Avg: 226.89 / Max: 265.02 Min: 6.41 / Avg: 226.74 / Max: 265.64 Min: 12.34 / Avg: 199.23 / Max: 219.6
OSPRay Studio CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better OSPRay Studio 0.11 CPU Temperature Monitor AVX-512 On AVX-512 On 512 AVX-512 Off 20 40 60 80 100 Min: 41 / Avg: 86.58 / Max: 95 Min: 42 / Avg: 86.55 / Max: 92 Min: 40 / Avg: 78.9 / Max: 84
OSPRay Studio Camera: 3 - Resolution: 1080p - Samples Per Pixel: 32 - Renderer: Path Tracer OpenBenchmarking.org ms, Fewer Is Better OSPRay Studio 0.11 Camera: 3 - Resolution: 1080p - Samples Per Pixel: 32 - Renderer: Path Tracer AVX-512 Off AVX-512 On 512 AVX-512 On 20K 40K 60K 80K 100K SE +/- 31.80, N = 3 SE +/- 171.11, N = 3 SE +/- 263.45, N = 3 85854 78809 78746 -mno-avx512f 1. (CXX) g++ options: -O3 -march=native -ldl
OSPRay Studio CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better OSPRay Studio 0.11 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 On 512 AVX-512 On AVX-512 Off 900 1800 2700 3600 4500 Min: 4570 / Avg: 4723.71 / Max: 5300 Min: 3465 / Avg: 4730.1 / Max: 5300 Min: 4700 / Avg: 4778.13 / Max: 5310
OSPRay Studio CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better OSPRay Studio 0.11 CPU Power Consumption Monitor AVX-512 On AVX-512 On 512 AVX-512 Off 50 100 150 200 250 Min: 12.56 / Avg: 219.94 / Max: 267.67 Min: 12.69 / Avg: 217.88 / Max: 264.37 Min: 12.3 / Avg: 191.08 / Max: 219.81
OSPRay Studio CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better OSPRay Studio 0.11 CPU Temperature Monitor AVX-512 On 512 AVX-512 On AVX-512 Off 20 40 60 80 100 Min: 42 / Avg: 85.88 / Max: 91 Min: 41 / Avg: 84.31 / Max: 94 Min: 40 / Avg: 76.99 / Max: 83
OSPRay Studio Camera: 3 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path Tracer OpenBenchmarking.org ms, Fewer Is Better OSPRay Studio 0.11 Camera: 3 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path Tracer AVX-512 Off AVX-512 On 512 AVX-512 On 2K 4K 6K 8K 10K SE +/- 5.70, N = 3 SE +/- 5.51, N = 3 SE +/- 6.67, N = 3 10148 9376 9373 -mno-avx512f 1. (CXX) g++ options: -O3 -march=native -ldl
OSPRay Studio CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better OSPRay Studio 0.11 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 On 512 AVX-512 On AVX-512 Off 900 1800 2700 3600 4500 Min: 3500 / Avg: 4665.37 / Max: 5300 Min: 4564 / Avg: 4690.88 / Max: 5300 Min: 4700 / Avg: 4785.08 / Max: 5300
OSPRay Studio CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better OSPRay Studio 0.11 CPU Power Consumption Monitor AVX-512 On AVX-512 On 512 AVX-512 Off 50 100 150 200 250 Min: 12.61 / Avg: 232.9 / Max: 264 Min: 12.82 / Avg: 227.75 / Max: 264.86 Min: 12.56 / Avg: 187.54 / Max: 219.01
OSPRay Studio CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better OSPRay Studio 0.11 CPU Temperature Monitor AVX-512 On 512 AVX-512 On AVX-512 Off 20 40 60 80 100 Min: 41 / Avg: 87.49 / Max: 93 Min: 41 / Avg: 87.29 / Max: 92 Min: 40 / Avg: 76.25 / Max: 85
OSPRay Studio Camera: 3 - Resolution: 4K - Samples Per Pixel: 16 - Renderer: Path Tracer OpenBenchmarking.org ms, Fewer Is Better OSPRay Studio 0.11 Camera: 3 - Resolution: 4K - Samples Per Pixel: 16 - Renderer: Path Tracer AVX-512 Off AVX-512 On 512 AVX-512 On 40K 80K 120K 160K 200K SE +/- 189.77, N = 3 SE +/- 494.14, N = 3 SE +/- 313.74, N = 3 166508 153101 152903 -mno-avx512f 1. (CXX) g++ options: -O3 -march=native -ldl
OSPRay Studio CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better OSPRay Studio 0.11 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 On 512 AVX-512 On AVX-512 Off 900 1800 2700 3600 4500 Min: 3500 / Avg: 4671.61 / Max: 5300 Min: 4564 / Avg: 4689.08 / Max: 5307 Min: 4700 / Avg: 4740.31 / Max: 5310
OSPRay Studio CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better OSPRay Studio 0.11 CPU Power Consumption Monitor AVX-512 On AVX-512 On 512 AVX-512 Off 50 100 150 200 250 Min: 12.74 / Avg: 232.51 / Max: 265.53 Min: 12.75 / Avg: 230.35 / Max: 267.14 Min: 12.41 / Avg: 203.49 / Max: 220.04
OSPRay Studio CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better OSPRay Studio 0.11 CPU Temperature Monitor AVX-512 On 512 AVX-512 On AVX-512 Off 20 40 60 80 100 Min: 41 / Avg: 87.32 / Max: 93 Min: 41 / Avg: 87.07 / Max: 91 Min: 39 / Avg: 78.83 / Max: 83
OSPRay Studio Camera: 3 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path Tracer OpenBenchmarking.org ms, Fewer Is Better OSPRay Studio 0.11 Camera: 3 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path Tracer AVX-512 Off AVX-512 On 512 AVX-512 On 70K 140K 210K 280K 350K SE +/- 178.71, N = 3 SE +/- 378.84, N = 3 SE +/- 646.03, N = 3 329527 303966 302582 -mno-avx512f 1. (CXX) g++ options: -O3 -march=native -ldl
OSPRay Studio CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better OSPRay Studio 0.11 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 On 512 AVX-512 On AVX-512 Off 900 1800 2700 3600 4500 Min: 4550 / Avg: 4626.21 / Max: 5300 Min: 4557 / Avg: 4641.27 / Max: 5300 Min: 4700 / Avg: 4722.23 / Max: 5309
OSPRay Studio CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better OSPRay Studio 0.11 CPU Power Consumption Monitor AVX-512 On AVX-512 On 512 AVX-512 Off 50 100 150 200 250 Min: 12.76 / Avg: 236.54 / Max: 265.22 Min: 12.63 / Avg: 233.36 / Max: 267.63 Min: 12.35 / Avg: 210.54 / Max: 220.82
OSPRay Studio CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better OSPRay Studio 0.11 CPU Temperature Monitor AVX-512 On 512 AVX-512 On AVX-512 Off 20 40 60 80 100 Min: 43 / Avg: 88.73 / Max: 96 Min: 42 / Avg: 88.64 / Max: 93 Min: 40 / Avg: 80.67 / Max: 84
simdjson Throughput Test: PartialTweets OpenBenchmarking.org GB/s, More Is Better simdjson 2.0 Throughput Test: PartialTweets AVX-512 Off AVX-512 On 512 AVX-512 On 2 4 6 8 10 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 6.20 8.51 8.52 -mno-avx512f 1. (CXX) g++ options: -O3 -march=native
simdjson Throughput Test: PartialTweets OpenBenchmarking.org GB/s Per Watt, More Is Better simdjson 2.0 Throughput Test: PartialTweets AVX-512 Off AVX-512 On AVX-512 On 512 0.0304 0.0608 0.0912 0.1216 0.152 0.104 0.135 0.135
simdjson CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better simdjson 2.0 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 On 512 AVX-512 On AVX-512 Off 900 1800 2700 3600 4500 Min: 4810 / Avg: 4978.7 / Max: 5258 Min: 4901 / Avg: 4982.12 / Max: 5233 Min: 5100 / Avg: 5289.95 / Max: 5318
simdjson CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better simdjson 2.0 CPU Power Consumption Monitor AVX-512 On AVX-512 On 512 AVX-512 Off 13 26 39 52 65 Min: 11.91 / Avg: 63.23 / Max: 67.98 Min: 12.12 / Avg: 62.94 / Max: 67.82 Min: 11.94 / Avg: 59.59 / Max: 65.08
simdjson CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better simdjson 2.0 CPU Temperature Monitor AVX-512 On AVX-512 On 512 AVX-512 Off 14 28 42 56 70 Min: 34 / Avg: 63.86 / Max: 68 Min: 33 / Avg: 63.44 / Max: 67 Min: 34 / Avg: 62.29 / Max: 70
simdjson Throughput Test: LargeRandom OpenBenchmarking.org GB/s, More Is Better simdjson 2.0 Throughput Test: LargeRandom AVX-512 Off AVX-512 On AVX-512 On 512 0.3308 0.6616 0.9924 1.3232 1.654 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 1.36 1.47 1.47 -mno-avx512f 1. (CXX) g++ options: -O3 -march=native
simdjson Throughput Test: LargeRandom OpenBenchmarking.org GB/s Per Watt, More Is Better simdjson 2.0 Throughput Test: LargeRandom AVX-512 Off AVX-512 On AVX-512 On 512 0.0059 0.0118 0.0177 0.0236 0.0295 0.025 0.026 0.026
simdjson CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better simdjson 2.0 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 On 512 AVX-512 On AVX-512 Off 1000 2000 3000 4000 5000 Min: 4994 / Avg: 5238.51 / Max: 5310 Min: 4975 / Avg: 5256.72 / Max: 5541 Min: 5100 / Avg: 5283.99 / Max: 5300
simdjson CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better simdjson 2.0 CPU Power Consumption Monitor AVX-512 On 512 AVX-512 On AVX-512 Off 12 24 36 48 60 Min: 11.92 / Avg: 56.3 / Max: 60.48 Min: 11.88 / Avg: 55.9 / Max: 60.31 Min: 11.95 / Avg: 55.09 / Max: 59.62
simdjson CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better simdjson 2.0 CPU Temperature Monitor AVX-512 On 512 AVX-512 Off AVX-512 On 12 24 36 48 60 Min: 32 / Avg: 58.34 / Max: 63 Min: 32 / Avg: 58.34 / Max: 63 Min: 32 / Avg: 58.29 / Max: 63
simdjson Throughput Test: Kostya OpenBenchmarking.org GB/s, More Is Better simdjson 2.0 Throughput Test: Kostya AVX-512 Off AVX-512 On 512 AVX-512 On 1.0215 2.043 3.0645 4.086 5.1075 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 3.86 4.53 4.54 -mno-avx512f 1. (CXX) g++ options: -O3 -march=native
simdjson Throughput Test: Kostya OpenBenchmarking.org GB/s Per Watt, More Is Better simdjson 2.0 Throughput Test: Kostya AVX-512 Off AVX-512 On 512 AVX-512 On 0.018 0.036 0.054 0.072 0.09 0.069 0.079 0.080
simdjson CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better simdjson 2.0 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 On 512 AVX-512 On AVX-512 Off 1000 2000 3000 4000 5000 Min: 4966 / Avg: 5223.47 / Max: 5300 Min: 4976 / Avg: 5227.59 / Max: 5300 Min: 5100 / Avg: 5288.13 / Max: 5498
simdjson CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better simdjson 2.0 CPU Power Consumption Monitor AVX-512 On 512 AVX-512 On AVX-512 Off 12 24 36 48 60 Min: 11.79 / Avg: 57.11 / Max: 61.15 Min: 11.9 / Avg: 56.95 / Max: 60.96 Min: 11.78 / Avg: 55.55 / Max: 59.77
simdjson CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better simdjson 2.0 CPU Temperature Monitor AVX-512 On 512 AVX-512 Off AVX-512 On 12 24 36 48 60 Min: 32 / Avg: 56.59 / Max: 63 Min: 31 / Avg: 56.21 / Max: 61 Min: 32 / Avg: 56.14 / Max: 63
simdjson Throughput Test: DistinctUserID OpenBenchmarking.org GB/s, More Is Better simdjson 2.0 Throughput Test: DistinctUserID AVX-512 Off AVX-512 On 512 AVX-512 On 2 4 6 8 10 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 6.33 8.77 8.78 -mno-avx512f 1. (CXX) g++ options: -O3 -march=native
simdjson Throughput Test: DistinctUserID OpenBenchmarking.org GB/s Per Watt, More Is Better simdjson 2.0 Throughput Test: DistinctUserID AVX-512 Off AVX-512 On AVX-512 On 512 0.0311 0.0622 0.0933 0.1244 0.1555 0.107 0.138 0.138
simdjson CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better simdjson 2.0 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 On 512 AVX-512 On AVX-512 Off 900 1800 2700 3600 4500 Min: 4900 / Avg: 4999.18 / Max: 5300 Min: 4901 / Avg: 5003.41 / Max: 5303 Min: 5100 / Avg: 5291.72 / Max: 5319
simdjson CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better simdjson 2.0 CPU Power Consumption Monitor AVX-512 On AVX-512 On 512 AVX-512 Off 13 26 39 52 65 Min: 11.84 / Avg: 63.44 / Max: 67.76 Min: 11.77 / Avg: 63.39 / Max: 67.58 Min: 11.88 / Avg: 59.01 / Max: 62.7
simdjson CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better simdjson 2.0 CPU Temperature Monitor AVX-512 On AVX-512 On 512 AVX-512 Off 13 26 39 52 65 Min: 32 / Avg: 62.56 / Max: 67 Min: 32 / Avg: 61.85 / Max: 66 Min: 31 / Avg: 60.86 / Max: 64
simdjson Throughput Test: TopTweet OpenBenchmarking.org GB/s, More Is Better simdjson 2.0 Throughput Test: TopTweet AVX-512 Off AVX-512 On AVX-512 On 512 2 4 6 8 10 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 6.35 8.82 8.82 -mno-avx512f 1. (CXX) g++ options: -O3 -march=native
simdjson Throughput Test: TopTweet OpenBenchmarking.org GB/s Per Watt, More Is Better simdjson 2.0 Throughput Test: TopTweet AVX-512 Off AVX-512 On AVX-512 On 512 0.0313 0.0626 0.0939 0.1252 0.1565 0.108 0.139 0.139
simdjson CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better simdjson 2.0 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 On 512 AVX-512 On AVX-512 Off 900 1800 2700 3600 4500 Min: 4901 / Avg: 4998.59 / Max: 5300 Min: 4928 / Avg: 5001.48 / Max: 5300 Min: 5100 / Avg: 5288.44 / Max: 5300
simdjson CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better simdjson 2.0 CPU Power Consumption Monitor AVX-512 On AVX-512 On 512 AVX-512 Off 13 26 39 52 65 Min: 11.88 / Avg: 63.33 / Max: 67.43 Min: 11.74 / Avg: 63.23 / Max: 67.46 Min: 11.88 / Avg: 58.68 / Max: 62.89
simdjson CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better simdjson 2.0 CPU Temperature Monitor AVX-512 On 512 AVX-512 On AVX-512 Off 13 26 39 52 65 Min: 32 / Avg: 62.1 / Max: 66 Min: 31 / Avg: 61.48 / Max: 66 Min: 31 / Avg: 59.16 / Max: 64
TensorFlow Device: CPU - Batch Size: 16 - Model: VGG-16 OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.10 Device: CPU - Batch Size: 16 - Model: VGG-16 AVX-512 Off AVX-512 On AVX-512 On 512 2 4 6 8 10 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 5.69 7.76 7.76
TensorFlow Device: CPU - Batch Size: 16 - Model: VGG-16 OpenBenchmarking.org images/sec Per Watt, More Is Better TensorFlow 2.10 Device: CPU - Batch Size: 16 - Model: VGG-16 AVX-512 Off AVX-512 On AVX-512 On 512 0.0088 0.0176 0.0264 0.0352 0.044 0.033 0.039 0.039
TensorFlow CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better TensorFlow 2.10 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 On AVX-512 On 512 AVX-512 Off 900 1800 2700 3600 4500 Min: 3436 / Avg: 4719.33 / Max: 5300 Min: 3441 / Avg: 4723.13 / Max: 5300 Min: 4700 / Avg: 4753.54 / Max: 5300
TensorFlow CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better TensorFlow 2.10 CPU Power Consumption Monitor AVX-512 On AVX-512 On 512 AVX-512 Off 40 80 120 160 200 Min: 11.91 / Avg: 198.07 / Max: 245.72 Min: 11.63 / Avg: 196.47 / Max: 246.65 Min: 11.86 / Avg: 171.94 / Max: 209.38
TensorFlow CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better TensorFlow 2.10 CPU Temperature Monitor AVX-512 On 512 AVX-512 On AVX-512 Off 20 40 60 80 100 Min: 31 / Avg: 82.6 / Max: 100 Min: 30 / Avg: 81.98 / Max: 100 Min: 30 / Avg: 71.96 / Max: 82
TensorFlow Device: CPU - Batch Size: 16 - Model: ResNet-50 OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.10 Device: CPU - Batch Size: 16 - Model: ResNet-50 AVX-512 Off AVX-512 On AVX-512 On 512 5 10 15 20 25 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 12.29 20.46 20.55
TensorFlow Device: CPU - Batch Size: 16 - Model: ResNet-50 OpenBenchmarking.org images/sec Per Watt, More Is Better TensorFlow 2.10 Device: CPU - Batch Size: 16 - Model: ResNet-50 AVX-512 Off AVX-512 On AVX-512 On 512 0.0259 0.0518 0.0777 0.1036 0.1295 0.072 0.115 0.115
TensorFlow CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better TensorFlow 2.10 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 On AVX-512 On 512 AVX-512 Off 900 1800 2700 3600 4500 Min: 4700 / Avg: 4775.16 / Max: 5300 Min: 4700 / Avg: 4778.43 / Max: 5300 Min: 4700 / Avg: 4779.37 / Max: 5300
TensorFlow CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better TensorFlow 2.10 CPU Power Consumption Monitor AVX-512 On 512 AVX-512 On AVX-512 Off 40 80 120 160 200 Min: 12.23 / Avg: 178.47 / Max: 201.45 Min: 12.57 / Avg: 178.26 / Max: 201.79 Min: 12.59 / Avg: 170.59 / Max: 185.9
TensorFlow CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better TensorFlow 2.10 CPU Temperature Monitor AVX-512 On 512 AVX-512 On AVX-512 Off 20 40 60 80 100 Min: 39 / Avg: 75.99 / Max: 90 Min: 39 / Avg: 75.6 / Max: 92 Min: 38 / Avg: 69.7 / Max: 81
TensorFlow Device: CPU - Batch Size: 16 - Model: AlexNet OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.10 Device: CPU - Batch Size: 16 - Model: AlexNet AVX-512 Off AVX-512 On AVX-512 On 512 20 40 60 80 100 SE +/- 0.03, N = 3 SE +/- 0.06, N = 3 SE +/- 0.12, N = 3 67.80 80.75 82.10
TensorFlow Device: CPU - Batch Size: 16 - Model: AlexNet OpenBenchmarking.org images/sec Per Watt, More Is Better TensorFlow 2.10 Device: CPU - Batch Size: 16 - Model: AlexNet AVX-512 Off AVX-512 On AVX-512 On 512 0.1296 0.2592 0.3888 0.5184 0.648 0.460 0.569 0.576
TensorFlow CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better TensorFlow 2.10 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 On AVX-512 On 512 AVX-512 Off 900 1800 2700 3600 4500 Min: 4700 / Avg: 4830.58 / Max: 5302 Min: 4700 / Avg: 4841.61 / Max: 5300 Min: 4700 / Avg: 4844.17 / Max: 5301
TensorFlow CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better TensorFlow 2.10 CPU Power Consumption Monitor AVX-512 Off AVX-512 On 512 AVX-512 On 30 60 90 120 150 Min: 6.49 / Avg: 147.48 / Max: 178.42 Min: 12.22 / Avg: 142.65 / Max: 174.16 Min: 12.38 / Avg: 141.92 / Max: 176.87
TensorFlow CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better TensorFlow 2.10 CPU Temperature Monitor AVX-512 Off AVX-512 On 512 AVX-512 On 14 28 42 56 70 Min: 39 / Avg: 64.1 / Max: 73 Min: 39 / Avg: 62.73 / Max: 74 Min: 40 / Avg: 61.85 / Max: 71
TensorFlow Device: CPU - Batch Size: 16 - Model: GoogLeNet OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.10 Device: CPU - Batch Size: 16 - Model: GoogLeNet AVX-512 Off AVX-512 On AVX-512 On 512 14 28 42 56 70 SE +/- 0.02, N = 3 SE +/- 0.03, N = 3 SE +/- 0.16, N = 3 36.22 63.34 63.83
TensorFlow Device: CPU - Batch Size: 16 - Model: GoogLeNet OpenBenchmarking.org images/sec Per Watt, More Is Better TensorFlow 2.10 Device: CPU - Batch Size: 16 - Model: GoogLeNet AVX-512 Off AVX-512 On AVX-512 On 512 0.0853 0.1706 0.2559 0.3412 0.4265 0.219 0.379 0.379
TensorFlow CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better TensorFlow 2.10 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 Off AVX-512 On 512 AVX-512 On 900 1800 2700 3600 4500 Min: 4700 / Avg: 4793.76 / Max: 5300 Min: 4700 / Avg: 4798.4 / Max: 5298 Min: 4700 / Avg: 4808.91 / Max: 5300
TensorFlow CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better TensorFlow 2.10 CPU Power Consumption Monitor AVX-512 On 512 AVX-512 On AVX-512 Off 40 80 120 160 200 Min: 12.24 / Avg: 168.34 / Max: 205.66 Min: 12.27 / Avg: 167.07 / Max: 202.74 Min: 12.53 / Avg: 165.22 / Max: 190.81
TensorFlow CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better TensorFlow 2.10 CPU Temperature Monitor AVX-512 On AVX-512 On 512 AVX-512 Off 20 40 60 80 100 Min: 38 / Avg: 72.19 / Max: 93 Min: 39 / Avg: 72.15 / Max: 91 Min: 38 / Avg: 69.01 / Max: 78
TensorFlow Device: CPU - Batch Size: 32 - Model: VGG-16 OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.10 Device: CPU - Batch Size: 32 - Model: VGG-16 AVX-512 Off AVX-512 On 512 AVX-512 On 2 4 6 8 10 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 5.95 8.29 8.32
TensorFlow Device: CPU - Batch Size: 32 - Model: VGG-16 OpenBenchmarking.org images/sec Per Watt, More Is Better TensorFlow 2.10 Device: CPU - Batch Size: 32 - Model: VGG-16 AVX-512 Off AVX-512 On AVX-512 On 512 0.0092 0.0184 0.0276 0.0368 0.046 0.034 0.041 0.041
TensorFlow CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better TensorFlow 2.10 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 On 512 AVX-512 On AVX-512 Off 900 1800 2700 3600 4500 Min: 3437 / Avg: 4669.85 / Max: 5300 Min: 3450 / Avg: 4685.15 / Max: 5302 Min: 4700 / Avg: 4747.94 / Max: 5300
TensorFlow CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better TensorFlow 2.10 CPU Power Consumption Monitor AVX-512 On AVX-512 On 512 AVX-512 Off 50 100 150 200 250 Min: 12.4 / Avg: 203.74 / Max: 255.04 Min: 12.29 / Avg: 202.82 / Max: 256.86 Min: 12.49 / Avg: 174.26 / Max: 233.2
TensorFlow CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better TensorFlow 2.10 CPU Temperature Monitor AVX-512 On 512 AVX-512 On AVX-512 Off 20 40 60 80 100 Min: 40 / Avg: 85.99 / Max: 100 Min: 39 / Avg: 85.46 / Max: 100 Min: 39 / Avg: 73.18 / Max: 82
TensorFlow Device: CPU - Batch Size: 32 - Model: ResNet-50 OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.10 Device: CPU - Batch Size: 32 - Model: ResNet-50 AVX-512 Off AVX-512 On AVX-512 On 512 5 10 15 20 25 SE +/- 0.01, N = 3 SE +/- 0.02, N = 3 SE +/- 0.00, N = 3 12.32 21.24 21.29
TensorFlow Device: CPU - Batch Size: 32 - Model: ResNet-50 OpenBenchmarking.org images/sec Per Watt, More Is Better TensorFlow 2.10 Device: CPU - Batch Size: 32 - Model: ResNet-50 AVX-512 Off AVX-512 On AVX-512 On 512 0.0261 0.0522 0.0783 0.1044 0.1305 0.071 0.115 0.116
TensorFlow CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better TensorFlow 2.10 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 Off AVX-512 On AVX-512 On 512 900 1800 2700 3600 4500 Min: 4671 / Avg: 4771.11 / Max: 5300 Min: 4700 / Avg: 4773.71 / Max: 5300 Min: 4700 / Avg: 4782.96 / Max: 5300
TensorFlow CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better TensorFlow 2.10 CPU Power Consumption Monitor AVX-512 On AVX-512 On 512 AVX-512 Off 40 80 120 160 200 Min: 12.27 / Avg: 184.03 / Max: 209.54 Min: 12.15 / Avg: 184.01 / Max: 210.17 Min: 12.39 / Avg: 172.96 / Max: 195.6
TensorFlow CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better TensorFlow 2.10 CPU Temperature Monitor AVX-512 On 512 AVX-512 On AVX-512 Off 20 40 60 80 100 Min: 40 / Avg: 79.09 / Max: 100 Min: 39 / Avg: 77.48 / Max: 95 Min: 39 / Avg: 70.59 / Max: 82
TensorFlow Device: CPU - Batch Size: 32 - Model: AlexNet OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.10 Device: CPU - Batch Size: 32 - Model: AlexNet AVX-512 Off AVX-512 On AVX-512 On 512 30 60 90 120 150 SE +/- 0.05, N = 3 SE +/- 0.17, N = 3 SE +/- 0.26, N = 3 87.79 112.10 113.25
TensorFlow Device: CPU - Batch Size: 32 - Model: AlexNet OpenBenchmarking.org images/sec Per Watt, More Is Better TensorFlow 2.10 Device: CPU - Batch Size: 32 - Model: AlexNet AVX-512 Off AVX-512 On AVX-512 On 512 0.1663 0.3326 0.4989 0.6652 0.8315 0.552 0.731 0.739
TensorFlow CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better TensorFlow 2.10 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 On AVX-512 Off AVX-512 On 512 900 1800 2700 3600 4500 Min: 4700 / Avg: 4809.19 / Max: 5302 Min: 4700 / Avg: 4812.15 / Max: 5300 Min: 4700 / Avg: 4812.35 / Max: 5300
TensorFlow CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better TensorFlow 2.10 CPU Power Consumption Monitor AVX-512 Off AVX-512 On 512 AVX-512 On 30 60 90 120 150 Min: 12.42 / Avg: 159.17 / Max: 185.93 Min: 12.25 / Avg: 153.32 / Max: 183.15 Min: 12.33 / Avg: 153.27 / Max: 183.98
TensorFlow CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better TensorFlow 2.10 CPU Temperature Monitor AVX-512 On 512 AVX-512 Off AVX-512 On 15 30 45 60 75 Min: 39 / Avg: 66.99 / Max: 77 Min: 39 / Avg: 65.93 / Max: 74 Min: 39 / Avg: 64.95 / Max: 75
TensorFlow Device: CPU - Batch Size: 32 - Model: GoogLeNet OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.10 Device: CPU - Batch Size: 32 - Model: GoogLeNet AVX-512 Off AVX-512 On AVX-512 On 512 14 28 42 56 70 SE +/- 0.04, N = 3 SE +/- 0.01, N = 3 SE +/- 0.06, N = 3 36.49 64.22 64.42
TensorFlow Device: CPU - Batch Size: 32 - Model: GoogLeNet OpenBenchmarking.org images/sec Per Watt, More Is Better TensorFlow 2.10 Device: CPU - Batch Size: 32 - Model: GoogLeNet AVX-512 Off AVX-512 On 512 AVX-512 On 0.0803 0.1606 0.2409 0.3212 0.4015 0.212 0.356 0.357
TensorFlow CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better TensorFlow 2.10 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 On 512 AVX-512 Off AVX-512 On 900 1800 2700 3600 4500 Min: 4700 / Avg: 4768.38 / Max: 5300 Min: 4700 / Avg: 4768.78 / Max: 5300 Min: 4700 / Avg: 4784.96 / Max: 5300
TensorFlow CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better TensorFlow 2.10 CPU Power Consumption Monitor AVX-512 On 512 AVX-512 On AVX-512 Off 40 80 120 160 200 Min: 6.52 / Avg: 180.79 / Max: 201.41 Min: 12.39 / Avg: 179.76 / Max: 202.8 Min: 12.6 / Avg: 172.16 / Max: 189.69
TensorFlow CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better TensorFlow 2.10 CPU Temperature Monitor AVX-512 On 512 AVX-512 On AVX-512 Off 20 40 60 80 100 Min: 39 / Avg: 76.91 / Max: 95 Min: 38 / Avg: 76.66 / Max: 93 Min: 38 / Avg: 70.7 / Max: 82
TensorFlow Device: CPU - Batch Size: 64 - Model: VGG-16 OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.10 Device: CPU - Batch Size: 64 - Model: VGG-16 AVX-512 Off AVX-512 On 512 AVX-512 On 2 4 6 8 10 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 6.11 8.69 8.73
TensorFlow Device: CPU - Batch Size: 64 - Model: VGG-16 OpenBenchmarking.org images/sec Per Watt, More Is Better TensorFlow 2.10 Device: CPU - Batch Size: 64 - Model: VGG-16 AVX-512 Off AVX-512 On AVX-512 On 512 0.0095 0.019 0.0285 0.038 0.0475 0.035 0.042 0.042
TensorFlow CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better TensorFlow 2.10 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 On 512 AVX-512 On AVX-512 Off 900 1800 2700 3600 4500 Min: 3448 / Avg: 4638.56 / Max: 5309 Min: 3431 / Avg: 4653.57 / Max: 5300 Min: 4700 / Avg: 4743.38 / Max: 5300
TensorFlow CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better TensorFlow 2.10 CPU Power Consumption Monitor AVX-512 On AVX-512 On 512 AVX-512 Off 50 100 150 200 250 Min: 12.6 / Avg: 210.35 / Max: 256.26 Min: 12.02 / Avg: 208.44 / Max: 258.78 Min: 12.51 / Avg: 175.98 / Max: 245.02
TensorFlow CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better TensorFlow 2.10 CPU Temperature Monitor AVX-512 On 512 AVX-512 On AVX-512 Off 20 40 60 80 100 Min: 40 / Avg: 87.14 / Max: 100 Min: 38 / Avg: 86.57 / Max: 100 Min: 39 / Avg: 73.93 / Max: 88
TensorFlow Device: CPU - Batch Size: 64 - Model: ResNet-50 OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.10 Device: CPU - Batch Size: 64 - Model: ResNet-50 AVX-512 Off AVX-512 On AVX-512 On 512 5 10 15 20 25 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 12.37 21.86 21.88
TensorFlow Device: CPU - Batch Size: 64 - Model: ResNet-50 OpenBenchmarking.org images/sec Per Watt, More Is Better TensorFlow 2.10 Device: CPU - Batch Size: 64 - Model: ResNet-50 AVX-512 Off AVX-512 On AVX-512 On 512 0.0261 0.0522 0.0783 0.1044 0.1305 0.071 0.115 0.116
TensorFlow CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better TensorFlow 2.10 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 On 512 AVX-512 Off AVX-512 On 900 1800 2700 3600 4500 Min: 3424 / Avg: 4756.76 / Max: 5300 Min: 4700 / Avg: 4765.23 / Max: 5300 Min: 3549 / Avg: 4765.25 / Max: 5310
TensorFlow CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better TensorFlow 2.10 CPU Power Consumption Monitor AVX-512 On AVX-512 On 512 AVX-512 Off 40 80 120 160 200 Min: 12.4 / Avg: 189.43 / Max: 229.65 Min: 12.14 / Avg: 189.26 / Max: 231.43 Min: 12.62 / Avg: 174.55 / Max: 197.59
TensorFlow CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better TensorFlow 2.10 CPU Temperature Monitor AVX-512 On 512 AVX-512 On AVX-512 Off 20 40 60 80 100 Min: 41 / Avg: 79.73 / Max: 100 Min: 39 / Avg: 79.12 / Max: 100 Min: 39 / Avg: 71.4 / Max: 84
TensorFlow Device: CPU - Batch Size: 64 - Model: AlexNet OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.10 Device: CPU - Batch Size: 64 - Model: AlexNet AVX-512 Off AVX-512 On AVX-512 On 512 30 60 90 120 150 SE +/- 0.07, N = 3 SE +/- 0.11, N = 3 SE +/- 0.13, N = 3 103.31 136.92 137.75
TensorFlow Device: CPU - Batch Size: 64 - Model: AlexNet OpenBenchmarking.org images/sec Per Watt, More Is Better TensorFlow 2.10 Device: CPU - Batch Size: 64 - Model: AlexNet AVX-512 Off AVX-512 On AVX-512 On 512 0.1933 0.3866 0.5799 0.7732 0.9665 0.614 0.833 0.859
TensorFlow CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better TensorFlow 2.10 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 Off AVX-512 On AVX-512 On 512 900 1800 2700 3600 4500 Min: 4700 / Avg: 4773.18 / Max: 5303 Min: 4700 / Avg: 4791.45 / Max: 5300 Min: 4700 / Avg: 4801.05 / Max: 5300
TensorFlow CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better TensorFlow 2.10 CPU Power Consumption Monitor AVX-512 Off AVX-512 On AVX-512 On 512 40 80 120 160 200 Min: 6.36 / Avg: 168.19 / Max: 198.49 Min: 12.19 / Avg: 164.43 / Max: 192.71 Min: 12.2 / Avg: 160.45 / Max: 196.55
TensorFlow CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better TensorFlow 2.10 CPU Temperature Monitor AVX-512 Off AVX-512 On 512 AVX-512 On 16 32 48 64 80 Min: 39 / Avg: 69.97 / Max: 77 Min: 39 / Avg: 69.91 / Max: 82 Min: 39 / Avg: 69.23 / Max: 83
TensorFlow Device: CPU - Batch Size: 64 - Model: GoogLeNet OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.10 Device: CPU - Batch Size: 64 - Model: GoogLeNet AVX-512 Off AVX-512 On AVX-512 On 512 15 30 45 60 75 SE +/- 0.01, N = 3 SE +/- 0.05, N = 3 SE +/- 0.07, N = 3 36.94 65.02 65.15
TensorFlow Device: CPU - Batch Size: 64 - Model: GoogLeNet OpenBenchmarking.org images/sec Per Watt, More Is Better TensorFlow 2.10 Device: CPU - Batch Size: 64 - Model: GoogLeNet AVX-512 Off AVX-512 On AVX-512 On 512 0.0783 0.1566 0.2349 0.3132 0.3915 0.209 0.346 0.348
TensorFlow CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better TensorFlow 2.10 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 On 512 AVX-512 Off AVX-512 On 900 1800 2700 3600 4500 Min: 3529 / Avg: 4743.6 / Max: 5300 Min: 4700 / Avg: 4747.96 / Max: 5300 Min: 4664 / Avg: 4758.71 / Max: 5300
TensorFlow CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better TensorFlow 2.10 CPU Power Consumption Monitor AVX-512 On AVX-512 On 512 AVX-512 Off 40 80 120 160 200 Min: 12.63 / Avg: 187.75 / Max: 210.7 Min: 12.16 / Avg: 187.24 / Max: 205.18 Min: 12.27 / Avg: 176.8 / Max: 195.47
TensorFlow CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better TensorFlow 2.10 CPU Temperature Monitor AVX-512 On 512 AVX-512 On AVX-512 Off 20 40 60 80 100 Min: 38 / Avg: 78.31 / Max: 98 Min: 39 / Avg: 77.98 / Max: 96 Min: 39 / Avg: 72.62 / Max: 84
TensorFlow Device: CPU - Batch Size: 256 - Model: VGG-16 OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.10 Device: CPU - Batch Size: 256 - Model: VGG-16 AVX-512 Off AVX-512 On AVX-512 On 512 3 6 9 12 15 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 6.22 9.42 9.42
TensorFlow Device: CPU - Batch Size: 256 - Model: VGG-16 OpenBenchmarking.org images/sec Per Watt, More Is Better TensorFlow 2.10 Device: CPU - Batch Size: 256 - Model: VGG-16 AVX-512 Off AVX-512 On AVX-512 On 512 0.0097 0.0194 0.0291 0.0388 0.0485 0.032 0.043 0.043
TensorFlow CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better TensorFlow 2.10 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 On 512 AVX-512 On AVX-512 Off 900 1800 2700 3600 4500 Min: 3406 / Avg: 4587.01 / Max: 5298 Min: 3412 / Avg: 4593.29 / Max: 5302 Min: 3500 / Avg: 4740.8 / Max: 5300
TensorFlow CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better TensorFlow 2.10 CPU Power Consumption Monitor AVX-512 On AVX-512 On 512 AVX-512 Off 50 100 150 200 250 Min: 12.64 / Avg: 218.14 / Max: 271.2 Min: 12.13 / Avg: 217.21 / Max: 270.46 Min: 12.64 / Avg: 193.81 / Max: 251.93
TensorFlow CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better TensorFlow 2.10 CPU Temperature Monitor AVX-512 On 512 AVX-512 On AVX-512 Off 20 40 60 80 100 Min: 39 / Avg: 87.55 / Max: 100 Min: 39 / Avg: 87.38 / Max: 100 Min: 39 / Avg: 78.01 / Max: 93
TensorFlow Device: CPU - Batch Size: 256 - Model: ResNet-50 OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.10 Device: CPU - Batch Size: 256 - Model: ResNet-50 AVX-512 Off AVX-512 On 512 AVX-512 On 5 10 15 20 25 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 12.48 22.13 22.20
TensorFlow Device: CPU - Batch Size: 256 - Model: ResNet-50 OpenBenchmarking.org images/sec Per Watt, More Is Better TensorFlow 2.10 Device: CPU - Batch Size: 256 - Model: ResNet-50 AVX-512 Off AVX-512 On AVX-512 On 512 0.0259 0.0518 0.0777 0.1036 0.1295 0.071 0.115 0.115
TensorFlow CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better TensorFlow 2.10 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 On 512 AVX-512 On AVX-512 Off 900 1800 2700 3600 4500 Min: 3337 / Avg: 4721.84 / Max: 5300 Min: 3350 / Avg: 4727.85 / Max: 5303 Min: 4700 / Avg: 4768.97 / Max: 5300
TensorFlow CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better TensorFlow 2.10 CPU Power Consumption Monitor AVX-512 On AVX-512 On 512 AVX-512 Off 40 80 120 160 200 Min: 6.72 / Avg: 192.97 / Max: 247.42 Min: 12.31 / Avg: 191.97 / Max: 247.16 Min: 12.55 / Avg: 176.58 / Max: 210.64
TensorFlow CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better TensorFlow 2.10 CPU Temperature Monitor AVX-512 On 512 AVX-512 On AVX-512 Off 20 40 60 80 100 Min: 41 / Avg: 80.63 / Max: 100 Min: 39 / Avg: 80.23 / Max: 100 Min: 39 / Avg: 71.84 / Max: 89
TensorFlow Device: CPU - Batch Size: 256 - Model: AlexNet OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.10 Device: CPU - Batch Size: 256 - Model: AlexNet AVX-512 Off AVX-512 On 512 AVX-512 On 40 80 120 160 200 SE +/- 0.05, N = 3 SE +/- 0.22, N = 3 SE +/- 0.42, N = 3 117.43 163.09 163.87
TensorFlow Device: CPU - Batch Size: 256 - Model: AlexNet OpenBenchmarking.org images/sec Per Watt, More Is Better TensorFlow 2.10 Device: CPU - Batch Size: 256 - Model: AlexNet AVX-512 Off AVX-512 On AVX-512 On 512 0.2048 0.4096 0.6144 0.8192 1.024 0.654 0.909 0.910
TensorFlow CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better TensorFlow 2.10 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 Off AVX-512 On AVX-512 On 512 900 1800 2700 3600 4500 Min: 4700 / Avg: 4741.91 / Max: 5300 Min: 4700 / Avg: 4754.47 / Max: 5300 Min: 4700 / Avg: 4756.54 / Max: 5300
TensorFlow CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better TensorFlow 2.10 CPU Power Consumption Monitor AVX-512 On AVX-512 Off AVX-512 On 512 40 80 120 160 200 Min: 12.49 / Avg: 180.37 / Max: 231.09 Min: 12.56 / Avg: 179.61 / Max: 210.75 Min: 12.27 / Avg: 179.14 / Max: 227.47
TensorFlow CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better TensorFlow 2.10 CPU Temperature Monitor AVX-512 On AVX-512 On 512 AVX-512 Off 20 40 60 80 100 Min: 39 / Avg: 75.22 / Max: 88 Min: 39 / Avg: 75.03 / Max: 94 Min: 38 / Avg: 73.1 / Max: 85
TensorFlow Device: CPU - Batch Size: 256 - Model: GoogLeNet OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.10 Device: CPU - Batch Size: 256 - Model: GoogLeNet AVX-512 Off AVX-512 On 512 AVX-512 On 15 30 45 60 75 SE +/- 0.02, N = 3 SE +/- 0.06, N = 3 SE +/- 0.11, N = 3 37.37 66.49 66.63
TensorFlow Device: CPU - Batch Size: 256 - Model: GoogLeNet OpenBenchmarking.org images/sec Per Watt, More Is Better TensorFlow 2.10 Device: CPU - Batch Size: 256 - Model: GoogLeNet AVX-512 Off AVX-512 On AVX-512 On 512 0.0763 0.1526 0.2289 0.3052 0.3815 0.206 0.338 0.339
TensorFlow CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better TensorFlow 2.10 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 On AVX-512 On 512 AVX-512 Off 900 1800 2700 3600 4500 Min: 3404 / Avg: 4735.04 / Max: 5312 Min: 3500 / Avg: 4736.16 / Max: 5300 Min: 4700 / Avg: 4745.56 / Max: 5300
TensorFlow CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better TensorFlow 2.10 CPU Power Consumption Monitor AVX-512 On AVX-512 On 512 AVX-512 Off 40 80 120 160 200 Min: 12.45 / Avg: 196.85 / Max: 222.31 Min: 12.19 / Avg: 196.37 / Max: 222.3 Min: 12.37 / Avg: 181.53 / Max: 217.34
TensorFlow CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better TensorFlow 2.10 CPU Temperature Monitor AVX-512 On AVX-512 On 512 AVX-512 Off 20 40 60 80 100 Min: 39 / Avg: 81.3 / Max: 99 Min: 39 / Avg: 80.86 / Max: 100 Min: 39 / Avg: 73.72 / Max: 88
TensorFlow Device: CPU - Batch Size: 512 - Model: AlexNet OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.10 Device: CPU - Batch Size: 512 - Model: AlexNet AVX-512 Off AVX-512 On 512 AVX-512 On 40 80 120 160 200 SE +/- 0.09, N = 3 SE +/- 0.21, N = 3 SE +/- 0.14, N = 3 107.72 172.66 173.67
TensorFlow Device: CPU - Batch Size: 512 - Model: AlexNet OpenBenchmarking.org images/sec Per Watt, More Is Better TensorFlow 2.10 Device: CPU - Batch Size: 512 - Model: AlexNet AVX-512 Off AVX-512 On AVX-512 On 512 0.207 0.414 0.621 0.828 1.035 0.594 0.920 0.920
TensorFlow CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better TensorFlow 2.10 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 Off AVX-512 On AVX-512 On 512 900 1800 2700 3600 4500 Min: 4700 / Avg: 4739.57 / Max: 5300 Min: 4700 / Avg: 4744.85 / Max: 5300 Min: 4700 / Avg: 4746.52 / Max: 5300
TensorFlow CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better TensorFlow 2.10 CPU Power Consumption Monitor AVX-512 On AVX-512 On 512 AVX-512 Off 40 80 120 160 200 Min: 12.17 / Avg: 188.69 / Max: 244.78 Min: 12.1 / Avg: 187.51 / Max: 247.19 Min: 52.34 / Avg: 181.46 / Max: 234.98
TensorFlow CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better TensorFlow 2.10 CPU Temperature Monitor AVX-512 On AVX-512 On 512 AVX-512 Off 20 40 60 80 100 Min: 35 / Avg: 76.2 / Max: 95 Min: 35 / Avg: 76.02 / Max: 93 Min: 54 / Avg: 74.43 / Max: 88
TensorFlow Device: CPU - Batch Size: 512 - Model: GoogLeNet OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.10 Device: CPU - Batch Size: 512 - Model: GoogLeNet AVX-512 Off AVX-512 On 512 AVX-512 On 15 30 45 60 75 SE +/- 0.06, N = 3 SE +/- 0.03, N = 3 SE +/- 0.02, N = 3 33.92 67.67 67.68
TensorFlow Device: CPU - Batch Size: 512 - Model: GoogLeNet OpenBenchmarking.org images/sec Per Watt, More Is Better TensorFlow 2.10 Device: CPU - Batch Size: 512 - Model: GoogLeNet AVX-512 Off AVX-512 On 512 AVX-512 On 0.0767 0.1534 0.2301 0.3068 0.3835 0.188 0.339 0.341
TensorFlow CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better TensorFlow 2.10 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 On 512 AVX-512 On AVX-512 Off 900 1800 2700 3600 4500 Min: 3400 / Avg: 4717.76 / Max: 5300 Min: 3424 / Avg: 4724.5 / Max: 5302 Min: 4700 / Avg: 4746.31 / Max: 5300
TensorFlow CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better TensorFlow 2.10 CPU Power Consumption Monitor AVX-512 On 512 AVX-512 On AVX-512 Off 40 80 120 160 200 Min: 12.21 / Avg: 199.88 / Max: 233.13 Min: 12.18 / Avg: 198.72 / Max: 231.12 Min: 54.66 / Avg: 180.33 / Max: 219.82
TensorFlow CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better TensorFlow 2.10 CPU Temperature Monitor AVX-512 On 512 AVX-512 On AVX-512 Off 20 40 60 80 100 Min: 39 / Avg: 81.85 / Max: 100 Min: 39 / Avg: 81.43 / Max: 100 Min: 57 / Avg: 74.26 / Max: 89
TNN Target: CPU - Model: DenseNet OpenBenchmarking.org ms, Fewer Is Better TNN 0.3 Target: CPU - Model: DenseNet AVX-512 On AVX-512 Off AVX-512 On 512 600 1200 1800 2400 3000 SE +/- 2.72, N = 3 SE +/- 0.35, N = 3 SE +/- 1.39, N = 3 2704.93 2703.56 2695.65 MIN: 2642.6 / MAX: 2789.25 -mno-avx512f - MIN: 2643.22 / MAX: 2776.22 MIN: 2633.85 / MAX: 2768.47 1. (CXX) g++ options: -O3 -march=native -fopenmp -pthread -fvisibility=hidden -fvisibility=default -rdynamic -ldl
TNN CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better TNN 0.3 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 On 512 AVX-512 On AVX-512 Off 900 1800 2700 3600 4500 Min: 4800 / Avg: 5095.33 / Max: 5300 Min: 4800 / Avg: 5103.01 / Max: 5306 Min: 4800 / Avg: 5120.83 / Max: 5304
TNN CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better TNN 0.3 CPU Power Consumption Monitor AVX-512 On 512 AVX-512 On AVX-512 Off 20 40 60 80 100 Min: 11.94 / Avg: 82.77 / Max: 92.94 Min: 12.03 / Avg: 81.72 / Max: 91.1 Min: 12.19 / Avg: 81.25 / Max: 91.18
TNN CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better TNN 0.3 CPU Temperature Monitor AVX-512 On 512 AVX-512 On AVX-512 Off 13 26 39 52 65 Min: 36 / Avg: 58.88 / Max: 69 Min: 36 / Avg: 57.79 / Max: 68 Min: 36 / Avg: 57.3 / Max: 67
TNN Target: CPU - Model: MobileNet v2 OpenBenchmarking.org ms, Fewer Is Better TNN 0.3 Target: CPU - Model: MobileNet v2 AVX-512 On AVX-512 Off AVX-512 On 512 50 100 150 200 250 SE +/- 0.25, N = 3 SE +/- 0.28, N = 3 SE +/- 0.06, N = 3 245.95 241.31 240.41 MIN: 242.61 / MAX: 266.39 -mno-avx512f - MIN: 238.09 / MAX: 252.58 MIN: 237.96 / MAX: 252.77 1. (CXX) g++ options: -O3 -march=native -fopenmp -pthread -fvisibility=hidden -fvisibility=default -rdynamic -ldl
TNN CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better TNN 0.3 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 On 512 AVX-512 On AVX-512 Off 900 1800 2700 3600 4500 Min: 4800 / Avg: 5072.03 / Max: 5313 Min: 4800 / Avg: 5109.16 / Max: 5300 Min: 4800 / Avg: 5114.03 / Max: 5304
TNN CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better TNN 0.3 CPU Power Consumption Monitor AVX-512 On 512 AVX-512 On AVX-512 Off 15 30 45 60 75 Min: 12.01 / Avg: 62.39 / Max: 76.7 Min: 12.02 / Avg: 61.6 / Max: 74.53 Min: 11.9 / Avg: 60.65 / Max: 74.9
TNN CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better TNN 0.3 CPU Temperature Monitor AVX-512 On 512 AVX-512 On AVX-512 Off 13 26 39 52 65 Min: 35 / Avg: 53.49 / Max: 67 Min: 33 / Avg: 53.27 / Max: 64 Min: 33 / Avg: 51.92 / Max: 64
TNN Target: CPU - Model: SqueezeNet v1.1 OpenBenchmarking.org ms, Fewer Is Better TNN 0.3 Target: CPU - Model: SqueezeNet v1.1 AVX-512 On AVX-512 Off AVX-512 On 512 50 100 150 200 250 SE +/- 0.08, N = 4 SE +/- 0.07, N = 4 SE +/- 0.09, N = 4 230.82 228.68 228.42 MIN: 229.65 / MAX: 231.83 -mno-avx512f - MIN: 227.32 / MAX: 231.38 MIN: 227.09 / MAX: 230.26 1. (CXX) g++ options: -O3 -march=native -fopenmp -pthread -fvisibility=hidden -fvisibility=default -rdynamic -ldl
TNN CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better TNN 0.3 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 Off AVX-512 On 512 AVX-512 On 900 1800 2700 3600 4500 Min: 5100 / Avg: 5253.76 / Max: 5300 Min: 5099 / Avg: 5261.41 / Max: 5300 Min: 5100 / Avg: 5282.12 / Max: 5304
TNN CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better TNN 0.3 CPU Power Consumption Monitor AVX-512 On AVX-512 On 512 AVX-512 Off 10 20 30 40 50 Min: 12 / Avg: 42.41 / Max: 50.81 Min: 11.78 / Avg: 41.5 / Max: 49.92 Min: 11.86 / Avg: 40.46 / Max: 48.51
TNN CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better TNN 0.3 CPU Temperature Monitor AVX-512 On 512 AVX-512 On AVX-512 Off 12 24 36 48 60 Min: 33 / Avg: 50.06 / Max: 61 Min: 31 / Avg: 48.98 / Max: 58 Min: 31 / Avg: 48.23 / Max: 58
TNN Target: CPU - Model: SqueezeNet v2 OpenBenchmarking.org ms, Fewer Is Better TNN 0.3 Target: CPU - Model: SqueezeNet v2 AVX-512 On AVX-512 Off AVX-512 On 512 11 22 33 44 55 SE +/- 0.07, N = 9 SE +/- 0.17, N = 9 SE +/- 0.11, N = 9 47.19 46.36 45.68 MIN: 46.52 / MAX: 48.8 -mno-avx512f - MIN: 45.49 / MAX: 48.72 MIN: 45.02 / MAX: 47.45 1. (CXX) g++ options: -O3 -march=native -fopenmp -pthread -fvisibility=hidden -fvisibility=default -rdynamic -ldl
TNN CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better TNN 0.3 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 Off AVX-512 On 512 AVX-512 On 900 1800 2700 3600 4500 Min: 5100 / Avg: 5198.88 / Max: 5304 Min: 5100 / Avg: 5205.02 / Max: 5305 Min: 5099 / Avg: 5219.48 / Max: 5310
TNN CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better TNN 0.3 CPU Power Consumption Monitor AVX-512 On AVX-512 On 512 AVX-512 Off 12 24 36 48 60 Min: 11.88 / Avg: 32.54 / Max: 58.56 Min: 11.71 / Avg: 32.45 / Max: 58.4 Min: 11.84 / Avg: 31.17 / Max: 57.74
TNN CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better TNN 0.3 CPU Temperature Monitor AVX-512 On 512 AVX-512 On AVX-512 Off 13 26 39 52 65 Min: 32 / Avg: 46.23 / Max: 65 Min: 30 / Avg: 45.12 / Max: 64 Min: 30 / Avg: 44.53 / Max: 64
Xmrig Variant: Monero - Hash Count: 1M OpenBenchmarking.org H/s, More Is Better Xmrig 6.12.1 Variant: Monero - Hash Count: 1M AVX-512 On AVX-512 On 512 AVX-512 Off 500 1000 1500 2000 2500 SE +/- 3.33, N = 3 SE +/- 6.87, N = 3 SE +/- 6.72, N = 3 2239.5 2252.6 2256.1 -mno-avx512f 1. (CXX) g++ options: -O3 -march=native -fexceptions -fno-rtti -maes -Ofast -static-libgcc -static-libstdc++ -rdynamic -lssl -lcrypto -luv -lpthread -lrt -ldl -lhwloc
Xmrig Variant: Monero - Hash Count: 1M OpenBenchmarking.org H/s Per Watt, More Is Better Xmrig 6.12.1 Variant: Monero - Hash Count: 1M AVX-512 On 512 AVX-512 On AVX-512 Off 4 8 12 16 20 12.40 16.08 16.68
Xmrig CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better Xmrig 6.12.1 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 On 512 AVX-512 Off AVX-512 On 900 1800 2700 3600 4500 Min: 4700 / Avg: 4704.64 / Max: 5245 Min: 4800 / Avg: 4803.2 / Max: 5300 Min: 4800 / Avg: 4803.31 / Max: 5300
Xmrig CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better Xmrig 6.12.1 CPU Power Consumption Monitor AVX-512 On 512 AVX-512 On AVX-512 Off 30 60 90 120 150 Min: 12.29 / Avg: 181.65 / Max: 184.85 Min: 12.42 / Avg: 139.26 / Max: 150.83 Min: 12.34 / Avg: 135.27 / Max: 150.47
Xmrig CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better Xmrig 6.12.1 CPU Temperature Monitor AVX-512 On 512 AVX-512 On AVX-512 Off 14 28 42 56 70 Min: 39 / Avg: 73.38 / Max: 75 Min: 39 / Avg: 61.9 / Max: 64 Min: 39 / Avg: 60.56 / Max: 63
Xmrig Variant: Wownero - Hash Count: 1M OpenBenchmarking.org H/s, More Is Better Xmrig 6.12.1 Variant: Wownero - Hash Count: 1M AVX-512 On AVX-512 On 512 AVX-512 Off 900 1800 2700 3600 4500 SE +/- 44.80, N = 3 SE +/- 21.46, N = 3 SE +/- 5.83, N = 3 4015.0 4075.5 4076.4 -mno-avx512f 1. (CXX) g++ options: -O3 -march=native -fexceptions -fno-rtti -maes -Ofast -static-libgcc -static-libstdc++ -rdynamic -lssl -lcrypto -luv -lpthread -lrt -ldl -lhwloc
Xmrig Variant: Wownero - Hash Count: 1M OpenBenchmarking.org H/s Per Watt, More Is Better Xmrig 6.12.1 Variant: Wownero - Hash Count: 1M AVX-512 On 512 AVX-512 On AVX-512 Off 6 12 18 24 30 20.54 26.07 27.04
Xmrig CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better Xmrig 6.12.1 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 On 512 AVX-512 Off AVX-512 On 900 1800 2700 3600 4500 Min: 4700 / Avg: 4708.31 / Max: 5300 Min: 4800 / Avg: 4806.2 / Max: 5300 Min: 4800 / Avg: 4806.25 / Max: 5300
Xmrig CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better Xmrig 6.12.1 CPU Power Consumption Monitor AVX-512 On 512 AVX-512 On AVX-512 Off 40 80 120 160 200 Min: 12.43 / Avg: 198.43 / Max: 204.05 Min: 12.39 / Avg: 154.02 / Max: 158.84 Min: 12.39 / Avg: 150.74 / Max: 154.51
Xmrig CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better Xmrig 6.12.1 CPU Temperature Monitor AVX-512 On 512 AVX-512 On AVX-512 Off 15 30 45 60 75 Min: 42 / Avg: 77.84 / Max: 79 Min: 38 / Avg: 65.69 / Max: 68 Min: 37 / Avg: 64.76 / Max: 67
Phoronix Test Suite v10.8.5