AVX-512 Core i9 Intel Rocket Lake Benchmarks for a future article. Intel Core i9-11900K testing with a ASUS ROG MAXIMUS XIII HERO (1402 BIOS) and ASUS Intel RKL GT1 31GB on Ubuntu 22.10 via the Phoronix Test Suite.
HTML result view exported from: https://openbenchmarking.org/result/2210210-NE-AVX512ROC09&sro&grr .
Processor Motherboard Chipset Memory Disk Graphics Audio Monitor Network OS Kernel Desktop Display Server OpenGL Vulkan Compiler File-System Screen Resolution i9-11900K AVX-512 On AVX-512 Off AVX-512 On 512 Intel Core i9-11900K @ 5.10GHz (8 Cores / 16 Threads) ASUS ROG MAXIMUS XIII HERO (1402 BIOS) Intel Tiger Lake-H 32GB 2000GB Corsair Force MP600 + 32GB Flash Drive ASUS Intel RKL GT1 31GB (1300MHz) Intel Tiger Lake-H HD Audio ASUS MG28U 2 x Intel I225-V + Intel Wi-Fi 6 AX210/AX211/AX411 Ubuntu 22.10 5.19.0-21-generic (x86_64) GNOME Shell 43.0 X Server + Wayland 4.6 Mesa 22.2.1 1.3.224 GCC 12.2.0 ext4 3840x2160 OpenBenchmarking.org Kernel Details - Transparent Huge Pages: madvise Environment Details - i9-11900K: AVX-512 On: CXXFLAGS="-O3 -march=native" CFLAGS="-O3 -march=native" - i9-11900K: AVX-512 Off: CXXFLAGS="-O3 -march=native -mno-avx512f" CFLAGS="-O3 -march=native -mno-avx512f" - i9-11900K: AVX-512 On 512: CXXFLAGS="-O3 -march=native -mprefer-vector-width=512" CFLAGS="-O3 -march=native -mprefer-vector-width=512" Compiler Details - --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-defaulted --enable-offload-targets=nvptx-none=/build/gcc-12-U8K4Qv/gcc-12-12.2.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-12-U8K4Qv/gcc-12-12.2.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v Processor Details - Scaling Governor: intel_pstate performance (EPP: performance) - CPU Microcode: 0x54 - Thermald 2.5.1 Python Details - Python 3.10.7 Security Details - itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Mitigation of Clear buffers; SMT vulnerable + retbleed: Mitigation of Enhanced IBRS + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Not affected
tensorflow: CPU - 256 - VGG-16 tensorflow: CPU - 256 - ResNet-50 openradioss: INIVOL and Fluid Structure Interaction Drop Container tensorflow: CPU - 512 - GoogLeNet tensorflow: CPU - 64 - VGG-16 lczero: BLAS tensorflow: CPU - 256 - GoogLeNet tensorflow: CPU - 32 - VGG-16 xmrig: Monero - 1M openradioss: Rubber O-Ring Seal Installation lczero: Eigen openradioss: Bird Strike on Windshield tensorflow: CPU - 64 - ResNet-50 tensorflow: CPU - 512 - AlexNet mnn: inception-v3 mnn: mobilenet-v1-1.0 mnn: MobileNetV2_224 mnn: SqueezeNetV1.0 mnn: resnet-v2-50 mnn: squeezenetv1.1 mnn: mobilenetV3 mnn: nasnet ai-benchmark: Device AI Score ai-benchmark: Device Training Score ai-benchmark: Device Inference Score ospray: particle_volume/pathtracer/real_time ospray: particle_volume/scivis/real_time ospray-studio: 3 - 4K - 32 - Path Tracer ospray-studio: 1 - 4K - 32 - Path Tracer openradioss: Bumper Beam tensorflow: CPU - 16 - VGG-16 onnx: super-resolution-10 - CPU - Standard xmrig: Wownero - 1M onnx: ArcFace ResNet-100 - CPU - Standard openvkl: vklBenchmark ISPC openvino: Age Gender Recognition Retail 0013 FP16-INT8 - CPU openvino: Age Gender Recognition Retail 0013 FP16-INT8 - CPU tensorflow: CPU - 32 - ResNet-50 ospray: particle_volume/ao/real_time onnx: bertsquad-12 - CPU - Standard openfoam: drivaerFastback, Small Mesh Size - Execution Time openfoam: drivaerFastback, Small Mesh Size - Mesh Time tensorflow: CPU - 256 - AlexNet tnn: CPU - DenseNet onednn: Recurrent Neural Network Training - u8s8f32 - CPU onnx: fcn-resnet101-11 - CPU - Standard gromacs: MPI CPU - water_GMX50_bare ospray-studio: 3 - 4K - 16 - Path Tracer ospray-studio: 1 - 4K - 1 - Path Tracer oidn: RTLightmap.hdr.4096x4096 tensorflow: CPU - 64 - GoogLeNet ospray-studio: 1 - 4K - 16 - Path Tracer ospray-studio: 3 - 4K - 1 - Path Tracer ospray-studio: 3 - 1080p - 1 - Path Tracer openradioss: Cell Phone Drop Test ospray-studio: 3 - 1080p - 16 - Path Tracer numpy: onnx: fcn-resnet101-11 - CPU - Parallel onnx: GPT-2 - CPU - Standard onnx: GPT-2 - CPU - Parallel onnx: bertsquad-12 - CPU - Parallel onnx: yolov4 - CPU - Parallel onnx: ArcFace ResNet-100 - CPU - Parallel onnx: yolov4 - CPU - Standard onnx: super-resolution-10 - CPU - Parallel ospray: gravity_spheres_volume/dim_512/scivis/real_time ospray: gravity_spheres_volume/dim_512/ao/real_time ospray-studio: 1 - 1080p - 1 - Path Tracer ospray: gravity_spheres_volume/dim_512/pathtracer/real_time tensorflow: CPU - 16 - ResNet-50 openvino: Person Vehicle Bike Detection FP16 - CPU openvino: Person Vehicle Bike Detection FP16 - CPU cpuminer-opt: Ringcoin ospray-studio: 1 - 1080p - 16 - Path Tracer onednn: Recurrent Neural Network Inference - bf16bf16bf16 - CPU ospray-studio: 3 - 1080p - 32 - Path Tracer onednn: Recurrent Neural Network Inference - f32 - CPU ncnn: CPU - FastestDet ncnn: CPU - vision_transformer ncnn: CPU - regnety_400m ncnn: CPU - squeezenet_ssd ncnn: CPU - yolov4-tiny ncnn: CPU - resnet50 ncnn: CPU - alexnet ncnn: CPU - resnet18 ncnn: CPU - vgg16 ncnn: CPU - googlenet ncnn: CPU - blazeface ncnn: CPU - efficientnet-b0 ncnn: CPU - mnasnet ncnn: CPU - shufflenet-v2 ncnn: CPU-v3-v3 - mobilenet-v3 ncnn: CPU-v2-v2 - mobilenet-v2 ncnn: CPU - mobilenet onednn: Recurrent Neural Network Training - bf16bf16bf16 - CPU onednn: Recurrent Neural Network Training - f32 - CPU onednn: Recurrent Neural Network Inference - u8s8f32 - CPU ospray-studio: 1 - 1080p - 32 - Path Tracer cpuminer-opt: Blake-2 S tensorflow: CPU - 32 - GoogLeNet oidn: RT.hdr_alb_nrm.3840x2160 oidn: RT.ldr_alb_nrm.3840x2160 openvino: Person Detection FP16 - CPU openvino: Person Detection FP16 - CPU openvino: Person Detection FP32 - CPU openvino: Person Detection FP32 - CPU openvino: Face Detection FP16 - CPU openvino: Face Detection FP16 - CPU simdjson: DistinctUserID openvino: Face Detection FP16-INT8 - CPU openvino: Face Detection FP16-INT8 - CPU cpuminer-opt: Deepcoin cpuminer-opt: x25x simdjson: PartialTweets simdjson: TopTweet openvino: Machine Translation EN To DE FP16 - CPU openvino: Machine Translation EN To DE FP16 - CPU openvino: Vehicle Detection FP16 - CPU openvino: Vehicle Detection FP16 - CPU openvino: Vehicle Detection FP16-INT8 - CPU openvino: Vehicle Detection FP16-INT8 - CPU openvino: Weld Porosity Detection FP16 - CPU openvino: Weld Porosity Detection FP16 - CPU openvino: Weld Porosity Detection FP16-INT8 - CPU openvino: Weld Porosity Detection FP16-INT8 - CPU openvino: Age Gender Recognition Retail 0013 FP16 - CPU openvino: Age Gender Recognition Retail 0013 FP16 - CPU tensorflow: CPU - 64 - AlexNet simdjson: Kostya embree: Pathtracer ISPC - Asian Dragon Obj simdjson: LargeRand deepsparse: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Asynchronous Multi-Stream deepsparse: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Asynchronous Multi-Stream deepsparse: NLP Document Classification, oBERT base uncased on IMDB - Asynchronous Multi-Stream deepsparse: NLP Document Classification, oBERT base uncased on IMDB - Asynchronous Multi-Stream deepsparse: NLP Token Classification, BERT base uncased conll2003 - Asynchronous Multi-Stream deepsparse: NLP Token Classification, BERT base uncased conll2003 - Asynchronous Multi-Stream deepsparse: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Synchronous Single-Stream deepsparse: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Synchronous Single-Stream deepsparse: NLP Text Classification, BERT base uncased SST2 - Asynchronous Multi-Stream deepsparse: NLP Text Classification, BERT base uncased SST2 - Asynchronous Multi-Stream deepsparse: NLP Document Classification, oBERT base uncased on IMDB - Synchronous Single-Stream deepsparse: NLP Document Classification, oBERT base uncased on IMDB - Synchronous Single-Stream deepsparse: NLP Token Classification, BERT base uncased conll2003 - Synchronous Single-Stream deepsparse: NLP Token Classification, BERT base uncased conll2003 - Synchronous Single-Stream deepsparse: NLP Text Classification, BERT base uncased SST2 - Synchronous Single-Stream deepsparse: NLP Text Classification, BERT base uncased SST2 - Synchronous Single-Stream embree: Pathtracer ISPC - Crown deepsparse: NLP Text Classification, DistilBERT mnli - Synchronous Single-Stream deepsparse: NLP Text Classification, DistilBERT mnli - Synchronous Single-Stream embree: Pathtracer ISPC - Asian Dragon deepsparse: CV Detection,YOLOv5s COCO - Synchronous Single-Stream deepsparse: CV Detection,YOLOv5s COCO - Synchronous Single-Stream deepsparse: NLP Text Classification, DistilBERT mnli - Asynchronous Multi-Stream deepsparse: NLP Text Classification, DistilBERT mnli - Asynchronous Multi-Stream deepsparse: CV Classification, ResNet-50 ImageNet - Synchronous Single-Stream deepsparse: CV Classification, ResNet-50 ImageNet - Synchronous Single-Stream deepsparse: CV Detection,YOLOv5s COCO - Asynchronous Multi-Stream deepsparse: CV Detection,YOLOv5s COCO - Asynchronous Multi-Stream tensorflow: CPU - 16 - GoogLeNet onednn: IP Shapes 3D - bf16bf16bf16 - CPU deepsparse: CV Classification, ResNet-50 ImageNet - Asynchronous Multi-Stream deepsparse: CV Classification, ResNet-50 ImageNet - Asynchronous Multi-Stream tensorflow: CPU - 32 - AlexNet cpuminer-opt: Magi cpuminer-opt: Myriad-Groestl cpuminer-opt: LBC, LBRY Credits cpuminer-opt: Skeincoin cpuminer-opt: Quad SHA-256, Pyrite cpuminer-opt: Garlicoin cpuminer-opt: Triple SHA-256, Onecoin tensorflow: CPU - 16 - AlexNet tnn: CPU - SqueezeNet v1.1 onednn: Deconvolution Batch shapes_1d - bf16bf16bf16 - CPU onednn: Deconvolution Batch shapes_1d - f32 - CPU onednn: Deconvolution Batch shapes_1d - u8s8f32 - CPU onednn: IP Shapes 1D - f32 - CPU onednn: IP Shapes 1D - bf16bf16bf16 - CPU onednn: IP Shapes 1D - u8s8f32 - CPU dav1d: Summer Nature 4K dav1d: Chimera 1080p 10-bit tnn: CPU - MobileNet v2 dav1d: Chimera 1080p onednn: Matrix Multiply Batch Shapes Transformer - bf16bf16bf16 - CPU onednn: Matrix Multiply Batch Shapes Transformer - f32 - CPU onednn: Matrix Multiply Batch Shapes Transformer - u8s8f32 - CPU onednn: IP Shapes 3D - f32 - CPU onednn: IP Shapes 3D - u8s8f32 - CPU onednn: Convolution Batch Shapes Auto - f32 - CPU onednn: Convolution Batch Shapes Auto - u8s8f32 - CPU dav1d: Summer Nature 1080p tnn: CPU - SqueezeNet v2 onednn: Convolution Batch Shapes Auto - bf16bf16bf16 - CPU onednn: Deconvolution Batch shapes_3d - bf16bf16bf16 - CPU onednn: Deconvolution Batch shapes_3d - f32 - CPU onednn: Deconvolution Batch shapes_3d - u8s8f32 - CPU i9-11900K AVX-512 On AVX-512 Off AVX-512 On 512 9.42 22.20 759.23 67.68 8.73 1268 66.63 8.32 2239.5 250.33 1186 309.21 21.86 173.67 19.580 1.972 2.131 3.073 10.295 1.670 0.938 7.468 3445 2069 1376 173.134 4.98037 302582 251261 177.40 7.76 7356 4015.0 2249 113 0.34 23074.82 21.24 4.95822 1008 538.97618 45.488465 163.87 2704.934 3088.89 102 1.031 152903 7743 0.21 65.02 127267 9373 2358 120.62 37662 631.24 73 6954 5548 519 319 1388 529 4950 4.37042 4.42072 1958 5.36461 20.46 13.95 286.43 2152.94 31054 1814.03 78746 1814.65 2.98 87.29 7.05 17.19 20.99 15.99 6.98 8.69 44.74 10.16 0.80 4.86 2.62 2.33 2.68 3.73 12.28 3093.58 3079.96 1817.59 65723 862110 64.22 0.43 0.43 2235.54 1.78 2250.02 1.76 1346.99 2.97 8.78 326.76 12.23 11148.96 387.72 8.52 8.82 112.27 35.62 36.80 108.61 6.41 623.17 24.92 320.80 6.43 1240.56 0.85 9379.27 136.92 4.54 14.4298 1.47 109.2808 36.5979 446.4889 8.9588 446.8814 8.9516 22.8900 43.6753 97.8481 40.8668 112.1891 8.9135 112.6756 8.8759 28.2567 35.3834 14.6252 14.5381 68.7607 16.5129 20.1259 49.6651 49.5682 80.6747 7.5173 132.9124 78.7761 50.7670 63.34 4.81904 25.7285 155.3852 112.10 452.82 40573 77083 111730 167500 4384.38 231700 80.75 230.819 20.8058 8.55193 0.840660 4.03554 8.55274 0.720702 207.14 510.88 245.952 734.61 3.81793 3.26773 1.32134 10.6347 3.01377 14.3619 12.1099 894.73 47.193 16.1640 17.3084 4.33063 1.47049 6.22 12.48 713.35 33.92 6.11 1240 37.37 5.95 2256.1 243.47 1062 311.82 12.37 107.72 23.418 1.798 1.934 3.694 18.043 2.023 0.942 7.139 2696 1282 1414 164.963 5.91636 329527 275693 174.60 5.69 7279 4076.4 1951 87 0.53 14973.88 12.32 6.02446 1042 538.29062 46.532622 117.43 2703.558 3270.55 100 1.020 166508 8450 0.21 36.94 139519 10148 2561 128.16 40948 575.79 72 6954 5557 515 315 1278 517 4515 2.72378 2.82821 2134 4.05745 12.29 12.26 325.95 2130.49 34112 2006.02 85854 2000.12 2.85 110.38 6.70 13.89 18.80 15.40 6.33 8.24 45.68 9.55 0.76 4.35 2.37 2.33 2.49 3.34 11.43 3271.27 3271.06 2003.54 72145 393213 36.49 0.43 0.43 2563.45 1.54 2563.87 1.54 1525.18 2.60 6.33 817.17 4.88 9966.10 359.01 6.20 6.35 126.09 31.70 28.29 141.30 12.88 310.38 15.81 252.69 14.98 533.79 1.00 7956.78 103.31 3.86 14.0227 1.36 150.7668 26.5261 491.1153 8.1425 492.3767 8.1213 39.1448 25.5407 112.5989 35.5207 127.6469 7.8337 128.0523 7.8089 34.5145 28.9677 13.8618 17.6640 56.5928 15.8952 23.0354 43.3933 57.8764 69.1005 11.6244 85.9777 92.5054 43.2306 36.22 39.3450 101.6365 87.79 453.39 16150 27270 70720 64663 2381.45 106137 67.80 228.683 8.39772 1.77832 3.22680 1.24396 192.71 487.09 241.314 691.43 3.67360 1.40330 11.6771 2.18670 15.6093 14.8411 879.37 46.360 5.39327 2.31183 9.42 22.13 755.60 67.67 8.69 1273 66.49 8.29 2252.6 240.62 1194 315.86 21.88 172.66 19.403 1.989 2.125 3.114 10.368 1.675 0.963 7.527 3439 2076 1363 173.739 4.95148 303966 250698 175.69 7.76 6824 4075.5 2250 112 0.35 22962.10 21.29 4.95280 1012 535.10825 45.3321 163.09 2695.646 3073.17 103 1.035 153101 7734 0.21 65.15 127540 9376 2364 118.89 37620 631.86 73 6962 5545 524 319 1368 527 4626 4.36772 4.46906 1951 5.35301 20.55 13.99 285.75 2190.91 31180 1715.75 78809 1739.49 2.98 70.39 7.10 17.34 22.01 16.24 6.69 8.64 44.59 9.96 0.80 4.79 2.58 2.33 2.71 3.77 12.28 2986.72 3062.36 1738.00 65447 895513 64.42 0.43 0.43 2227.69 1.78 2244.25 1.77 1352.08 2.95 8.77 328.08 12.17 11270 379.94 8.51 8.82 112.48 35.55 36.64 109.09 6.33 630.58 24.86 321.51 6.42 1242.45 0.84 9460.45 137.75 4.53 14.3502 1.47 108.4890 36.8617 440.5608 9.0792 440.0994 9.0886 23.0134 43.4408 98.0286 40.8021 110.9617 9.0118 111.2249 8.9905 28.2249 35.4238 14.6198 14.5355 68.7715 16.4541 19.9939 49.9913 49.3593 81.0216 7.4707 133.7435 77.8730 51.3573 63.83 4.64814 25.4949 156.8121 113.25 449.42 40663 76393 112403 164790 4392.29 230687 82.10 228.424 20.2612 8.50891 0.846376 4.03294 8.55374 0.715925 190.82 477.09 240.410 727.76 3.66945 3.21742 1.30906 9.95113 2.75246 14.2835 12.0178 902.92 45.679 16.1605 17.2687 4.32564 1.46948 OpenBenchmarking.org
TensorFlow Device: CPU - Batch Size: 256 - Model: VGG-16 OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.10 Device: CPU - Batch Size: 256 - Model: VGG-16 AVX-512 Off AVX-512 On AVX-512 On 512 3 6 9 12 15 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 6.22 9.42 9.42
TensorFlow Device: CPU - Batch Size: 256 - Model: ResNet-50 OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.10 Device: CPU - Batch Size: 256 - Model: ResNet-50 AVX-512 Off AVX-512 On AVX-512 On 512 5 10 15 20 25 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 12.48 22.20 22.13
OpenRadioss Model: INIVOL and Fluid Structure Interaction Drop Container OpenBenchmarking.org Seconds, Fewer Is Better OpenRadioss 2022.10.13 Model: INIVOL and Fluid Structure Interaction Drop Container AVX-512 Off AVX-512 On AVX-512 On 512 160 320 480 640 800 SE +/- 4.20, N = 3 SE +/- 7.20, N = 9 SE +/- 10.28, N = 3 713.35 759.23 755.60
TensorFlow Device: CPU - Batch Size: 512 - Model: GoogLeNet OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.10 Device: CPU - Batch Size: 512 - Model: GoogLeNet AVX-512 Off AVX-512 On AVX-512 On 512 15 30 45 60 75 SE +/- 0.06, N = 3 SE +/- 0.02, N = 3 SE +/- 0.03, N = 3 33.92 67.68 67.67
TensorFlow Device: CPU - Batch Size: 64 - Model: VGG-16 OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.10 Device: CPU - Batch Size: 64 - Model: VGG-16 AVX-512 Off AVX-512 On AVX-512 On 512 2 4 6 8 10 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 6.11 8.73 8.69
LeelaChessZero Backend: BLAS OpenBenchmarking.org Nodes Per Second, More Is Better LeelaChessZero 0.28 Backend: BLAS AVX-512 Off AVX-512 On AVX-512 On 512 300 600 900 1200 1500 SE +/- 8.35, N = 3 SE +/- 17.53, N = 3 SE +/- 11.26, N = 9 1240 1268 1273 -mno-avx512f 1. (CXX) g++ options: -flto -O3 -march=native -pthread
TensorFlow Device: CPU - Batch Size: 256 - Model: GoogLeNet OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.10 Device: CPU - Batch Size: 256 - Model: GoogLeNet AVX-512 Off AVX-512 On AVX-512 On 512 15 30 45 60 75 SE +/- 0.02, N = 3 SE +/- 0.11, N = 3 SE +/- 0.06, N = 3 37.37 66.63 66.49
TensorFlow Device: CPU - Batch Size: 32 - Model: VGG-16 OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.10 Device: CPU - Batch Size: 32 - Model: VGG-16 AVX-512 Off AVX-512 On AVX-512 On 512 2 4 6 8 10 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 5.95 8.32 8.29
Xmrig Variant: Monero - Hash Count: 1M OpenBenchmarking.org H/s, More Is Better Xmrig 6.12.1 Variant: Monero - Hash Count: 1M AVX-512 Off AVX-512 On AVX-512 On 512 500 1000 1500 2000 2500 SE +/- 6.72, N = 3 SE +/- 3.33, N = 3 SE +/- 6.87, N = 3 2256.1 2239.5 2252.6 -mno-avx512f 1. (CXX) g++ options: -O3 -march=native -fexceptions -fno-rtti -maes -Ofast -static-libgcc -static-libstdc++ -rdynamic -lssl -lcrypto -luv -lpthread -lrt -ldl -lhwloc
OpenRadioss Model: Rubber O-Ring Seal Installation OpenBenchmarking.org Seconds, Fewer Is Better OpenRadioss 2022.10.13 Model: Rubber O-Ring Seal Installation AVX-512 Off AVX-512 On AVX-512 On 512 50 100 150 200 250 SE +/- 2.54, N = 5 SE +/- 2.27, N = 7 SE +/- 2.53, N = 4 243.47 250.33 240.62
LeelaChessZero Backend: Eigen OpenBenchmarking.org Nodes Per Second, More Is Better LeelaChessZero 0.28 Backend: Eigen AVX-512 Off AVX-512 On AVX-512 On 512 300 600 900 1200 1500 SE +/- 10.84, N = 5 SE +/- 11.35, N = 3 SE +/- 14.97, N = 3 1062 1186 1194 -mno-avx512f 1. (CXX) g++ options: -flto -O3 -march=native -pthread
OpenRadioss Model: Bird Strike on Windshield OpenBenchmarking.org Seconds, Fewer Is Better OpenRadioss 2022.10.13 Model: Bird Strike on Windshield AVX-512 Off AVX-512 On AVX-512 On 512 70 140 210 280 350 SE +/- 3.86, N = 4 SE +/- 0.35, N = 3 SE +/- 3.22, N = 5 311.82 309.21 315.86
TensorFlow Device: CPU - Batch Size: 64 - Model: ResNet-50 OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.10 Device: CPU - Batch Size: 64 - Model: ResNet-50 AVX-512 Off AVX-512 On AVX-512 On 512 5 10 15 20 25 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 12.37 21.86 21.88
TensorFlow Device: CPU - Batch Size: 512 - Model: AlexNet OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.10 Device: CPU - Batch Size: 512 - Model: AlexNet AVX-512 Off AVX-512 On AVX-512 On 512 40 80 120 160 200 SE +/- 0.09, N = 3 SE +/- 0.14, N = 3 SE +/- 0.21, N = 3 107.72 173.67 172.66
Mobile Neural Network Model: inception-v3 OpenBenchmarking.org ms, Fewer Is Better Mobile Neural Network 2.1 Model: inception-v3 AVX-512 Off AVX-512 On AVX-512 On 512 6 12 18 24 30 SE +/- 0.02, N = 3 SE +/- 0.26, N = 15 SE +/- 0.27, N = 15 23.42 19.58 19.40 -mno-avx512f - MIN: 22.95 / MAX: 30.84 MIN: 17.25 / MAX: 32.64 MIN: 17.18 / MAX: 49.2 1. (CXX) g++ options: -O3 -march=native -std=c++11 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl
Mobile Neural Network Model: mobilenet-v1-1.0 OpenBenchmarking.org ms, Fewer Is Better Mobile Neural Network 2.1 Model: mobilenet-v1-1.0 AVX-512 Off AVX-512 On AVX-512 On 512 0.4475 0.895 1.3425 1.79 2.2375 SE +/- 0.007, N = 3 SE +/- 0.005, N = 15 SE +/- 0.007, N = 15 1.798 1.972 1.989 -mno-avx512f - MIN: 1.74 / MAX: 2.69 MIN: 1.8 / MAX: 8.03 MIN: 1.9 / MAX: 8.1 1. (CXX) g++ options: -O3 -march=native -std=c++11 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl
Mobile Neural Network Model: MobileNetV2_224 OpenBenchmarking.org ms, Fewer Is Better Mobile Neural Network 2.1 Model: MobileNetV2_224 AVX-512 Off AVX-512 On AVX-512 On 512 0.4795 0.959 1.4385 1.918 2.3975 SE +/- 0.019, N = 3 SE +/- 0.014, N = 15 SE +/- 0.014, N = 15 1.934 2.131 2.125 -mno-avx512f - MIN: 1.84 / MAX: 11.59 MIN: 2.03 / MAX: 8.46 MIN: 2.03 / MAX: 8.62 1. (CXX) g++ options: -O3 -march=native -std=c++11 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl
Mobile Neural Network Model: SqueezeNetV1.0 OpenBenchmarking.org ms, Fewer Is Better Mobile Neural Network 2.1 Model: SqueezeNetV1.0 AVX-512 Off AVX-512 On AVX-512 On 512 0.8312 1.6624 2.4936 3.3248 4.156 SE +/- 0.032, N = 3 SE +/- 0.020, N = 15 SE +/- 0.022, N = 15 3.694 3.073 3.114 -mno-avx512f - MIN: 3.57 / MAX: 4.37 MIN: 2.89 / MAX: 8.65 MIN: 2.9 / MAX: 9.42 1. (CXX) g++ options: -O3 -march=native -std=c++11 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl
Mobile Neural Network Model: resnet-v2-50 OpenBenchmarking.org ms, Fewer Is Better Mobile Neural Network 2.1 Model: resnet-v2-50 AVX-512 Off AVX-512 On AVX-512 On 512 4 8 12 16 20 SE +/- 0.08, N = 3 SE +/- 0.05, N = 15 SE +/- 0.04, N = 15 18.04 10.30 10.37 -mno-avx512f - MIN: 17.67 / MAX: 24.46 MIN: 9.74 / MAX: 33.88 MIN: 10.05 / MAX: 22.64 1. (CXX) g++ options: -O3 -march=native -std=c++11 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl
Mobile Neural Network Model: squeezenetv1.1 OpenBenchmarking.org ms, Fewer Is Better Mobile Neural Network 2.1 Model: squeezenetv1.1 AVX-512 Off AVX-512 On AVX-512 On 512 0.4552 0.9104 1.3656 1.8208 2.276 SE +/- 0.014, N = 3 SE +/- 0.013, N = 15 SE +/- 0.014, N = 15 2.023 1.670 1.675 -mno-avx512f - MIN: 1.97 / MAX: 2.72 MIN: 1.54 / MAX: 11.33 MIN: 1.55 / MAX: 7.76 1. (CXX) g++ options: -O3 -march=native -std=c++11 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl
Mobile Neural Network Model: mobilenetV3 OpenBenchmarking.org ms, Fewer Is Better Mobile Neural Network 2.1 Model: mobilenetV3 AVX-512 Off AVX-512 On AVX-512 On 512 0.2167 0.4334 0.6501 0.8668 1.0835 SE +/- 0.003, N = 3 SE +/- 0.005, N = 15 SE +/- 0.012, N = 15 0.942 0.938 0.963 -mno-avx512f - MIN: 0.92 / MAX: 1.64 MIN: 0.89 / MAX: 3.62 MIN: 0.89 / MAX: 10.54 1. (CXX) g++ options: -O3 -march=native -std=c++11 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl
Mobile Neural Network Model: nasnet OpenBenchmarking.org ms, Fewer Is Better Mobile Neural Network 2.1 Model: nasnet AVX-512 Off AVX-512 On AVX-512 On 512 2 4 6 8 10 SE +/- 0.056, N = 3 SE +/- 0.077, N = 15 SE +/- 0.087, N = 15 7.139 7.468 7.527 -mno-avx512f - MIN: 6.92 / MAX: 7.99 MIN: 6.73 / MAX: 13.9 MIN: 6.72 / MAX: 17.92 1. (CXX) g++ options: -O3 -march=native -std=c++11 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl
AI Benchmark Alpha Device AI Score OpenBenchmarking.org Score, More Is Better AI Benchmark Alpha 0.1.2 Device AI Score AVX-512 Off AVX-512 On AVX-512 On 512 700 1400 2100 2800 3500 2696 3445 3439
AI Benchmark Alpha Device Training Score OpenBenchmarking.org Score, More Is Better AI Benchmark Alpha 0.1.2 Device Training Score AVX-512 Off AVX-512 On AVX-512 On 512 400 800 1200 1600 2000 1282 2069 2076
AI Benchmark Alpha Device Inference Score OpenBenchmarking.org Score, More Is Better AI Benchmark Alpha 0.1.2 Device Inference Score AVX-512 Off AVX-512 On AVX-512 On 512 300 600 900 1200 1500 1414 1376 1363
OSPRay Benchmark: particle_volume/pathtracer/real_time OpenBenchmarking.org Items Per Second, More Is Better OSPRay 2.10 Benchmark: particle_volume/pathtracer/real_time AVX-512 Off AVX-512 On AVX-512 On 512 40 80 120 160 200 SE +/- 0.37, N = 3 SE +/- 0.21, N = 3 SE +/- 0.56, N = 3 164.96 173.13 173.74
OSPRay Benchmark: particle_volume/scivis/real_time OpenBenchmarking.org Items Per Second, More Is Better OSPRay 2.10 Benchmark: particle_volume/scivis/real_time AVX-512 Off AVX-512 On AVX-512 On 512 1.3312 2.6624 3.9936 5.3248 6.656 SE +/- 0.02016, N = 3 SE +/- 0.04966, N = 3 SE +/- 0.01748, N = 3 5.91636 4.98037 4.95148
OSPRay Studio Camera: 3 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path Tracer OpenBenchmarking.org ms, Fewer Is Better OSPRay Studio 0.11 Camera: 3 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path Tracer AVX-512 Off AVX-512 On AVX-512 On 512 70K 140K 210K 280K 350K SE +/- 178.71, N = 3 SE +/- 646.03, N = 3 SE +/- 378.84, N = 3 329527 302582 303966 -mno-avx512f 1. (CXX) g++ options: -O3 -march=native -ldl
OSPRay Studio Camera: 1 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path Tracer OpenBenchmarking.org ms, Fewer Is Better OSPRay Studio 0.11 Camera: 1 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path Tracer AVX-512 Off AVX-512 On AVX-512 On 512 60K 120K 180K 240K 300K SE +/- 100.66, N = 3 SE +/- 259.35, N = 3 SE +/- 784.12, N = 3 275693 251261 250698 -mno-avx512f 1. (CXX) g++ options: -O3 -march=native -ldl
OpenRadioss Model: Bumper Beam OpenBenchmarking.org Seconds, Fewer Is Better OpenRadioss 2022.10.13 Model: Bumper Beam AVX-512 Off AVX-512 On AVX-512 On 512 40 80 120 160 200 SE +/- 1.56, N = 7 SE +/- 2.45, N = 3 SE +/- 1.21, N = 3 174.60 177.40 175.69
TensorFlow Device: CPU - Batch Size: 16 - Model: VGG-16 OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.10 Device: CPU - Batch Size: 16 - Model: VGG-16 AVX-512 Off AVX-512 On AVX-512 On 512 2 4 6 8 10 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 5.69 7.76 7.76
ONNX Runtime Model: super-resolution-10 - Device: CPU - Executor: Standard OpenBenchmarking.org Inferences Per Minute, More Is Better ONNX Runtime 1.11 Model: super-resolution-10 - Device: CPU - Executor: Standard AVX-512 Off AVX-512 On AVX-512 On 512 1600 3200 4800 6400 8000 SE +/- 44.00, N = 3 SE +/- 80.51, N = 4 SE +/- 64.19, N = 12 7279 7356 6824 -mno-avx512f 1. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt
Xmrig Variant: Wownero - Hash Count: 1M OpenBenchmarking.org H/s, More Is Better Xmrig 6.12.1 Variant: Wownero - Hash Count: 1M AVX-512 Off AVX-512 On AVX-512 On 512 900 1800 2700 3600 4500 SE +/- 5.83, N = 3 SE +/- 44.80, N = 3 SE +/- 21.46, N = 3 4076.4 4015.0 4075.5 -mno-avx512f 1. (CXX) g++ options: -O3 -march=native -fexceptions -fno-rtti -maes -Ofast -static-libgcc -static-libstdc++ -rdynamic -lssl -lcrypto -luv -lpthread -lrt -ldl -lhwloc
ONNX Runtime Model: ArcFace ResNet-100 - Device: CPU - Executor: Standard OpenBenchmarking.org Inferences Per Minute, More Is Better ONNX Runtime 1.11 Model: ArcFace ResNet-100 - Device: CPU - Executor: Standard AVX-512 Off AVX-512 On AVX-512 On 512 500 1000 1500 2000 2500 SE +/- 35.14, N = 12 SE +/- 2.02, N = 3 SE +/- 1.92, N = 3 1951 2249 2250 -mno-avx512f 1. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt
OpenVKL Benchmark: vklBenchmark ISPC OpenBenchmarking.org Items / Sec, More Is Better OpenVKL 1.0 Benchmark: vklBenchmark ISPC AVX-512 Off AVX-512 On AVX-512 On 512 30 60 90 120 150 SE +/- 0.00, N = 3 SE +/- 0.33, N = 3 SE +/- 0.67, N = 3 87 113 112 MIN: 7 / MAX: 901 MIN: 10 / MAX: 1116 MIN: 9 / MAX: 1115
OpenVINO Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2022.2.dev Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU AVX-512 Off AVX-512 On AVX-512 On 512 0.1193 0.2386 0.3579 0.4772 0.5965 SE +/- 0.00, N = 3 SE +/- 0.01, N = 15 SE +/- 0.01, N = 15 0.53 0.34 0.35 -mno-avx512f - MIN: 0.28 / MAX: 83.77 -ldl - MIN: 0.18 / MAX: 82.47 -ldl - MIN: 0.18 / MAX: 11.28 1. (CXX) g++ options: -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -pie
OpenVINO Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2022.2.dev Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU AVX-512 Off AVX-512 On AVX-512 On 512 5K 10K 15K 20K 25K SE +/- 47.04, N = 3 SE +/- 411.52, N = 15 SE +/- 387.31, N = 15 14973.88 23074.82 22962.10 -mno-avx512f -ldl -ldl 1. (CXX) g++ options: -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -pie
TensorFlow Device: CPU - Batch Size: 32 - Model: ResNet-50 OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.10 Device: CPU - Batch Size: 32 - Model: ResNet-50 AVX-512 Off AVX-512 On AVX-512 On 512 5 10 15 20 25 SE +/- 0.01, N = 3 SE +/- 0.02, N = 3 SE +/- 0.00, N = 3 12.32 21.24 21.29
OSPRay Benchmark: particle_volume/ao/real_time OpenBenchmarking.org Items Per Second, More Is Better OSPRay 2.10 Benchmark: particle_volume/ao/real_time AVX-512 Off AVX-512 On AVX-512 On 512 2 4 6 8 10 SE +/- 0.00177, N = 3 SE +/- 0.01187, N = 3 SE +/- 0.03653, N = 3 6.02446 4.95822 4.95280
ONNX Runtime Model: bertsquad-12 - Device: CPU - Executor: Standard OpenBenchmarking.org Inferences Per Minute, More Is Better ONNX Runtime 1.11 Model: bertsquad-12 - Device: CPU - Executor: Standard AVX-512 Off AVX-512 On AVX-512 On 512 200 400 600 800 1000 SE +/- 8.55, N = 9 SE +/- 2.67, N = 3 SE +/- 5.77, N = 3 1042 1008 1012 -mno-avx512f 1. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt
OpenFOAM Input: drivaerFastback, Small Mesh Size - Execution Time OpenBenchmarking.org Seconds, Fewer Is Better OpenFOAM 10 Input: drivaerFastback, Small Mesh Size - Execution Time AVX-512 Off AVX-512 On AVX-512 On 512 120 240 360 480 600 538.29 538.98 535.11 1. (CXX) g++ options: -std=c++14 -m64 -O3 -ftemplate-depth-100 -fPIC -fuse-ld=bfd -Xlinker --add-needed --no-as-needed -lfoamToVTK -ldynamicMesh -llagrangian -lgenericPatchFields -lfileFormats -lOpenFOAM -ldl -lm
OpenFOAM Input: drivaerFastback, Small Mesh Size - Mesh Time OpenBenchmarking.org Seconds, Fewer Is Better OpenFOAM 10 Input: drivaerFastback, Small Mesh Size - Mesh Time AVX-512 Off AVX-512 On AVX-512 On 512 11 22 33 44 55 46.53 45.49 45.33 1. (CXX) g++ options: -std=c++14 -m64 -O3 -ftemplate-depth-100 -fPIC -fuse-ld=bfd -Xlinker --add-needed --no-as-needed -lfoamToVTK -ldynamicMesh -llagrangian -lgenericPatchFields -lfileFormats -lOpenFOAM -ldl -lm
TensorFlow Device: CPU - Batch Size: 256 - Model: AlexNet OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.10 Device: CPU - Batch Size: 256 - Model: AlexNet AVX-512 Off AVX-512 On AVX-512 On 512 40 80 120 160 200 SE +/- 0.05, N = 3 SE +/- 0.42, N = 3 SE +/- 0.22, N = 3 117.43 163.87 163.09
TNN Target: CPU - Model: DenseNet OpenBenchmarking.org ms, Fewer Is Better TNN 0.3 Target: CPU - Model: DenseNet AVX-512 Off AVX-512 On AVX-512 On 512 600 1200 1800 2400 3000 SE +/- 0.35, N = 3 SE +/- 2.72, N = 3 SE +/- 1.39, N = 3 2703.56 2704.93 2695.65 -mno-avx512f - MIN: 2643.22 / MAX: 2776.22 MIN: 2642.6 / MAX: 2789.25 MIN: 2633.85 / MAX: 2768.47 1. (CXX) g++ options: -O3 -march=native -fopenmp -pthread -fvisibility=hidden -fvisibility=default -rdynamic -ldl
oneDNN Harness: Recurrent Neural Network Training - Data Type: u8s8f32 - Engine: CPU OpenBenchmarking.org ms, Fewer Is Better oneDNN 2.7 Harness: Recurrent Neural Network Training - Data Type: u8s8f32 - Engine: CPU AVX-512 Off AVX-512 On AVX-512 On 512 700 1400 2100 2800 3500 SE +/- 1.82, N = 3 SE +/- 3.05, N = 3 SE +/- 89.39, N = 15 3270.55 3088.89 3073.17 -mno-avx512f - MIN: 3260.73 MIN: 3071.02 MIN: 2922.72 1. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl
ONNX Runtime Model: fcn-resnet101-11 - Device: CPU - Executor: Standard OpenBenchmarking.org Inferences Per Minute, More Is Better ONNX Runtime 1.11 Model: fcn-resnet101-11 - Device: CPU - Executor: Standard AVX-512 Off AVX-512 On AVX-512 On 512 20 40 60 80 100 SE +/- 0.17, N = 3 SE +/- 0.88, N = 8 SE +/- 0.17, N = 3 100 102 103 -mno-avx512f 1. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt
GROMACS Implementation: MPI CPU - Input: water_GMX50_bare OpenBenchmarking.org Ns Per Day, More Is Better GROMACS 2022.1 Implementation: MPI CPU - Input: water_GMX50_bare AVX-512 Off AVX-512 On AVX-512 On 512 0.2329 0.4658 0.6987 0.9316 1.1645 SE +/- 0.002, N = 3 SE +/- 0.004, N = 3 SE +/- 0.001, N = 3 1.020 1.031 1.035 -mno-avx512f 1. (CXX) g++ options: -O3 -march=native
OSPRay Studio Camera: 3 - Resolution: 4K - Samples Per Pixel: 16 - Renderer: Path Tracer OpenBenchmarking.org ms, Fewer Is Better OSPRay Studio 0.11 Camera: 3 - Resolution: 4K - Samples Per Pixel: 16 - Renderer: Path Tracer AVX-512 Off AVX-512 On AVX-512 On 512 40K 80K 120K 160K 200K SE +/- 189.77, N = 3 SE +/- 313.74, N = 3 SE +/- 494.14, N = 3 166508 152903 153101 -mno-avx512f 1. (CXX) g++ options: -O3 -march=native -ldl
OSPRay Studio Camera: 1 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path Tracer OpenBenchmarking.org ms, Fewer Is Better OSPRay Studio 0.11 Camera: 1 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path Tracer AVX-512 Off AVX-512 On AVX-512 On 512 2K 4K 6K 8K 10K SE +/- 2.40, N = 3 SE +/- 26.87, N = 3 SE +/- 11.53, N = 3 8450 7743 7734 -mno-avx512f 1. (CXX) g++ options: -O3 -march=native -ldl
Intel Open Image Denoise Run: RTLightmap.hdr.4096x4096 OpenBenchmarking.org Images / Sec, More Is Better Intel Open Image Denoise 1.4.0 Run: RTLightmap.hdr.4096x4096 AVX-512 Off AVX-512 On AVX-512 On 512 0.0473 0.0946 0.1419 0.1892 0.2365 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 0.21 0.21 0.21
TensorFlow Device: CPU - Batch Size: 64 - Model: GoogLeNet OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.10 Device: CPU - Batch Size: 64 - Model: GoogLeNet AVX-512 Off AVX-512 On AVX-512 On 512 15 30 45 60 75 SE +/- 0.01, N = 3 SE +/- 0.05, N = 3 SE +/- 0.07, N = 3 36.94 65.02 65.15
OSPRay Studio Camera: 1 - Resolution: 4K - Samples Per Pixel: 16 - Renderer: Path Tracer OpenBenchmarking.org ms, Fewer Is Better OSPRay Studio 0.11 Camera: 1 - Resolution: 4K - Samples Per Pixel: 16 - Renderer: Path Tracer AVX-512 Off AVX-512 On AVX-512 On 512 30K 60K 90K 120K 150K SE +/- 39.26, N = 3 SE +/- 834.11, N = 3 SE +/- 430.68, N = 3 139519 127267 127540 -mno-avx512f 1. (CXX) g++ options: -O3 -march=native -ldl
OSPRay Studio Camera: 3 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path Tracer OpenBenchmarking.org ms, Fewer Is Better OSPRay Studio 0.11 Camera: 3 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path Tracer AVX-512 Off AVX-512 On AVX-512 On 512 2K 4K 6K 8K 10K SE +/- 5.70, N = 3 SE +/- 6.67, N = 3 SE +/- 5.51, N = 3 10148 9373 9376 -mno-avx512f 1. (CXX) g++ options: -O3 -march=native -ldl
OSPRay Studio Camera: 3 - Resolution: 1080p - Samples Per Pixel: 1 - Renderer: Path Tracer OpenBenchmarking.org ms, Fewer Is Better OSPRay Studio 0.11 Camera: 3 - Resolution: 1080p - Samples Per Pixel: 1 - Renderer: Path Tracer AVX-512 Off AVX-512 On AVX-512 On 512 500 1000 1500 2000 2500 SE +/- 2.85, N = 3 SE +/- 3.76, N = 3 SE +/- 2.33, N = 3 2561 2358 2364 -mno-avx512f 1. (CXX) g++ options: -O3 -march=native -ldl
OpenRadioss Model: Cell Phone Drop Test OpenBenchmarking.org Seconds, Fewer Is Better OpenRadioss 2022.10.13 Model: Cell Phone Drop Test AVX-512 Off AVX-512 On AVX-512 On 512 30 60 90 120 150 SE +/- 0.52, N = 3 SE +/- 1.35, N = 3 SE +/- 0.31, N = 3 128.16 120.62 118.89
OSPRay Studio Camera: 3 - Resolution: 1080p - Samples Per Pixel: 16 - Renderer: Path Tracer OpenBenchmarking.org ms, Fewer Is Better OSPRay Studio 0.11 Camera: 3 - Resolution: 1080p - Samples Per Pixel: 16 - Renderer: Path Tracer AVX-512 Off AVX-512 On AVX-512 On 512 9K 18K 27K 36K 45K SE +/- 14.77, N = 3 SE +/- 89.45, N = 3 SE +/- 9.61, N = 3 40948 37662 37620 -mno-avx512f 1. (CXX) g++ options: -O3 -march=native -ldl
Numpy Benchmark OpenBenchmarking.org Score, More Is Better Numpy Benchmark AVX-512 Off AVX-512 On AVX-512 On 512 140 280 420 560 700 SE +/- 0.90, N = 3 SE +/- 1.23, N = 3 SE +/- 0.87, N = 3 575.79 631.24 631.86
ONNX Runtime Model: fcn-resnet101-11 - Device: CPU - Executor: Parallel OpenBenchmarking.org Inferences Per Minute, More Is Better ONNX Runtime 1.11 Model: fcn-resnet101-11 - Device: CPU - Executor: Parallel AVX-512 Off AVX-512 On AVX-512 On 512 16 32 48 64 80 SE +/- 0.33, N = 3 SE +/- 0.00, N = 3 SE +/- 0.44, N = 3 72 73 73 -mno-avx512f 1. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt
ONNX Runtime Model: GPT-2 - Device: CPU - Executor: Standard OpenBenchmarking.org Inferences Per Minute, More Is Better ONNX Runtime 1.11 Model: GPT-2 - Device: CPU - Executor: Standard AVX-512 Off AVX-512 On AVX-512 On 512 1500 3000 4500 6000 7500 SE +/- 4.16, N = 3 SE +/- 4.94, N = 3 SE +/- 9.16, N = 3 6954 6954 6962 -mno-avx512f 1. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt
ONNX Runtime Model: GPT-2 - Device: CPU - Executor: Parallel OpenBenchmarking.org Inferences Per Minute, More Is Better ONNX Runtime 1.11 Model: GPT-2 - Device: CPU - Executor: Parallel AVX-512 Off AVX-512 On AVX-512 On 512 1200 2400 3600 4800 6000 SE +/- 1.76, N = 3 SE +/- 7.10, N = 3 SE +/- 3.18, N = 3 5557 5548 5545 -mno-avx512f 1. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt
ONNX Runtime Model: bertsquad-12 - Device: CPU - Executor: Parallel OpenBenchmarking.org Inferences Per Minute, More Is Better ONNX Runtime 1.11 Model: bertsquad-12 - Device: CPU - Executor: Parallel AVX-512 Off AVX-512 On AVX-512 On 512 110 220 330 440 550 SE +/- 2.46, N = 3 SE +/- 0.44, N = 3 SE +/- 0.60, N = 3 515 519 524 -mno-avx512f 1. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt
ONNX Runtime Model: yolov4 - Device: CPU - Executor: Parallel OpenBenchmarking.org Inferences Per Minute, More Is Better ONNX Runtime 1.11 Model: yolov4 - Device: CPU - Executor: Parallel AVX-512 Off AVX-512 On AVX-512 On 512 70 140 210 280 350 SE +/- 0.33, N = 3 SE +/- 0.29, N = 3 SE +/- 0.33, N = 3 315 319 319 -mno-avx512f 1. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt
ONNX Runtime Model: ArcFace ResNet-100 - Device: CPU - Executor: Parallel OpenBenchmarking.org Inferences Per Minute, More Is Better ONNX Runtime 1.11 Model: ArcFace ResNet-100 - Device: CPU - Executor: Parallel AVX-512 Off AVX-512 On AVX-512 On 512 300 600 900 1200 1500 SE +/- 1.76, N = 3 SE +/- 1.36, N = 3 SE +/- 4.33, N = 3 1278 1388 1368 -mno-avx512f 1. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt
ONNX Runtime Model: yolov4 - Device: CPU - Executor: Standard OpenBenchmarking.org Inferences Per Minute, More Is Better ONNX Runtime 1.11 Model: yolov4 - Device: CPU - Executor: Standard AVX-512 Off AVX-512 On AVX-512 On 512 110 220 330 440 550 SE +/- 0.76, N = 3 SE +/- 0.60, N = 3 SE +/- 1.09, N = 3 517 529 527 -mno-avx512f 1. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt
ONNX Runtime Model: super-resolution-10 - Device: CPU - Executor: Parallel OpenBenchmarking.org Inferences Per Minute, More Is Better ONNX Runtime 1.11 Model: super-resolution-10 - Device: CPU - Executor: Parallel AVX-512 Off AVX-512 On AVX-512 On 512 1100 2200 3300 4400 5500 SE +/- 8.93, N = 3 SE +/- 5.95, N = 3 SE +/- 25.62, N = 3 4515 4950 4626 -mno-avx512f 1. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt
OSPRay Benchmark: gravity_spheres_volume/dim_512/scivis/real_time OpenBenchmarking.org Items Per Second, More Is Better OSPRay 2.10 Benchmark: gravity_spheres_volume/dim_512/scivis/real_time AVX-512 Off AVX-512 On AVX-512 On 512 0.9833 1.9666 2.9499 3.9332 4.9165 SE +/- 0.00481, N = 3 SE +/- 0.01025, N = 3 SE +/- 0.02096, N = 3 2.72378 4.37042 4.36772
OSPRay Benchmark: gravity_spheres_volume/dim_512/ao/real_time OpenBenchmarking.org Items Per Second, More Is Better OSPRay 2.10 Benchmark: gravity_spheres_volume/dim_512/ao/real_time AVX-512 Off AVX-512 On AVX-512 On 512 1.0055 2.011 3.0165 4.022 5.0275 SE +/- 0.01595, N = 3 SE +/- 0.02867, N = 3 SE +/- 0.01309, N = 3 2.82821 4.42072 4.46906
OSPRay Studio Camera: 1 - Resolution: 1080p - Samples Per Pixel: 1 - Renderer: Path Tracer OpenBenchmarking.org ms, Fewer Is Better OSPRay Studio 0.11 Camera: 1 - Resolution: 1080p - Samples Per Pixel: 1 - Renderer: Path Tracer AVX-512 Off AVX-512 On AVX-512 On 512 500 1000 1500 2000 2500 SE +/- 1.45, N = 3 SE +/- 18.66, N = 3 SE +/- 3.51, N = 3 2134 1958 1951 -mno-avx512f 1. (CXX) g++ options: -O3 -march=native -ldl
OSPRay Benchmark: gravity_spheres_volume/dim_512/pathtracer/real_time OpenBenchmarking.org Items Per Second, More Is Better OSPRay 2.10 Benchmark: gravity_spheres_volume/dim_512/pathtracer/real_time AVX-512 Off AVX-512 On AVX-512 On 512 1.207 2.414 3.621 4.828 6.035 SE +/- 0.01158, N = 3 SE +/- 0.01274, N = 3 SE +/- 0.02156, N = 3 4.05745 5.36461 5.35301
TensorFlow Device: CPU - Batch Size: 16 - Model: ResNet-50 OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.10 Device: CPU - Batch Size: 16 - Model: ResNet-50 AVX-512 Off AVX-512 On AVX-512 On 512 5 10 15 20 25 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 12.29 20.46 20.55
OpenVINO Model: Person Vehicle Bike Detection FP16 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2022.2.dev Model: Person Vehicle Bike Detection FP16 - Device: CPU AVX-512 Off AVX-512 On AVX-512 On 512 4 8 12 16 20 SE +/- 0.12, N = 6 SE +/- 0.12, N = 3 SE +/- 0.12, N = 7 12.26 13.95 13.99 -mno-avx512f - MIN: 6.09 / MAX: 23.07 -ldl - MIN: 6.25 / MAX: 52.24 -ldl - MIN: 6.28 / MAX: 24.01 1. (CXX) g++ options: -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -pie
OpenVINO Model: Person Vehicle Bike Detection FP16 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2022.2.dev Model: Person Vehicle Bike Detection FP16 - Device: CPU AVX-512 Off AVX-512 On AVX-512 On 512 70 140 210 280 350 SE +/- 3.32, N = 6 SE +/- 2.42, N = 3 SE +/- 2.59, N = 7 325.95 286.43 285.75 -mno-avx512f -ldl -ldl 1. (CXX) g++ options: -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -pie
Cpuminer-Opt Algorithm: Ringcoin OpenBenchmarking.org kH/s, More Is Better Cpuminer-Opt 3.18 Algorithm: Ringcoin AVX-512 Off AVX-512 On AVX-512 On 512 500 1000 1500 2000 2500 SE +/- 5.83, N = 3 SE +/- 40.17, N = 13 SE +/- 16.96, N = 15 2130.49 2152.94 2190.91 -mno-avx512f 1. (CXX) g++ options: -O3 -march=native -lcurl -lz -lpthread -lssl -lcrypto -lgmp
OSPRay Studio Camera: 1 - Resolution: 1080p - Samples Per Pixel: 16 - Renderer: Path Tracer OpenBenchmarking.org ms, Fewer Is Better OSPRay Studio 0.11 Camera: 1 - Resolution: 1080p - Samples Per Pixel: 16 - Renderer: Path Tracer AVX-512 Off AVX-512 On AVX-512 On 512 7K 14K 21K 28K 35K SE +/- 5.46, N = 3 SE +/- 32.95, N = 3 SE +/- 206.81, N = 3 34112 31054 31180 -mno-avx512f 1. (CXX) g++ options: -O3 -march=native -ldl
oneDNN Harness: Recurrent Neural Network Inference - Data Type: bf16bf16bf16 - Engine: CPU OpenBenchmarking.org ms, Fewer Is Better oneDNN 2.7 Harness: Recurrent Neural Network Inference - Data Type: bf16bf16bf16 - Engine: CPU AVX-512 Off AVX-512 On AVX-512 On 512 400 800 1200 1600 2000 SE +/- 0.87, N = 3 SE +/- 2.62, N = 3 SE +/- 18.65, N = 5 2006.02 1814.03 1715.75 -mno-avx512f - MIN: 1997.88 MIN: 1799.95 MIN: 1674.74 1. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl
OSPRay Studio Camera: 3 - Resolution: 1080p - Samples Per Pixel: 32 - Renderer: Path Tracer OpenBenchmarking.org ms, Fewer Is Better OSPRay Studio 0.11 Camera: 3 - Resolution: 1080p - Samples Per Pixel: 32 - Renderer: Path Tracer AVX-512 Off AVX-512 On AVX-512 On 512 20K 40K 60K 80K 100K SE +/- 31.80, N = 3 SE +/- 263.45, N = 3 SE +/- 171.11, N = 3 85854 78746 78809 -mno-avx512f 1. (CXX) g++ options: -O3 -march=native -ldl
oneDNN Harness: Recurrent Neural Network Inference - Data Type: f32 - Engine: CPU OpenBenchmarking.org ms, Fewer Is Better oneDNN 2.7 Harness: Recurrent Neural Network Inference - Data Type: f32 - Engine: CPU AVX-512 Off AVX-512 On AVX-512 On 512 400 800 1200 1600 2000 SE +/- 3.47, N = 3 SE +/- 0.41, N = 3 SE +/- 20.46, N = 4 2000.12 1814.65 1739.49 -mno-avx512f - MIN: 1987.76 MIN: 1805.32 MIN: 1670.86 1. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl
NCNN Target: CPU - Model: FastestDet OpenBenchmarking.org ms, Fewer Is Better NCNN 20220729 Target: CPU - Model: FastestDet AVX-512 Off AVX-512 On AVX-512 On 512 0.6705 1.341 2.0115 2.682 3.3525 SE +/- 0.02, N = 3 SE +/- 0.08, N = 3 SE +/- 0.08, N = 3 2.85 2.98 2.98 -mno-avx512f - MIN: 2.78 / MAX: 3.41 MIN: 2.81 / MAX: 3.62 MIN: 2.84 / MAX: 3.6 1. (CXX) g++ options: -O3 -march=native -rdynamic -lgomp -lpthread
NCNN Target: CPU - Model: vision_transformer OpenBenchmarking.org ms, Fewer Is Better NCNN 20220729 Target: CPU - Model: vision_transformer AVX-512 Off AVX-512 On AVX-512 On 512 20 40 60 80 100 SE +/- 0.39, N = 3 SE +/- 0.11, N = 3 SE +/- 0.12, N = 3 110.38 87.29 70.39 -mno-avx512f - MIN: 109.43 / MAX: 116.1 MIN: 86.63 / MAX: 92.92 MIN: 69.62 / MAX: 71.72 1. (CXX) g++ options: -O3 -march=native -rdynamic -lgomp -lpthread
NCNN Target: CPU - Model: regnety_400m OpenBenchmarking.org ms, Fewer Is Better NCNN 20220729 Target: CPU - Model: regnety_400m AVX-512 Off AVX-512 On AVX-512 On 512 2 4 6 8 10 SE +/- 0.02, N = 3 SE +/- 0.02, N = 3 SE +/- 0.03, N = 3 6.70 7.05 7.10 -mno-avx512f - MIN: 6.54 / MAX: 7.93 MIN: 6.87 / MAX: 8.31 MIN: 6.91 / MAX: 11.12 1. (CXX) g++ options: -O3 -march=native -rdynamic -lgomp -lpthread
NCNN Target: CPU - Model: squeezenet_ssd OpenBenchmarking.org ms, Fewer Is Better NCNN 20220729 Target: CPU - Model: squeezenet_ssd AVX-512 Off AVX-512 On AVX-512 On 512 4 8 12 16 20 SE +/- 0.04, N = 3 SE +/- 0.18, N = 3 SE +/- 0.05, N = 3 13.89 17.19 17.34 -mno-avx512f - MIN: 13.58 / MAX: 15.32 MIN: 16.54 / MAX: 25.09 MIN: 17.03 / MAX: 18.98 1. (CXX) g++ options: -O3 -march=native -rdynamic -lgomp -lpthread
NCNN Target: CPU - Model: yolov4-tiny OpenBenchmarking.org ms, Fewer Is Better NCNN 20220729 Target: CPU - Model: yolov4-tiny AVX-512 Off AVX-512 On AVX-512 On 512 5 10 15 20 25 SE +/- 0.06, N = 3 SE +/- 0.41, N = 3 SE +/- 0.44, N = 3 18.80 20.99 22.01 -mno-avx512f - MIN: 18.51 / MAX: 19.88 MIN: 20.36 / MAX: 37.15 MIN: 21.29 / MAX: 26.71 1. (CXX) g++ options: -O3 -march=native -rdynamic -lgomp -lpthread
NCNN Target: CPU - Model: resnet50 OpenBenchmarking.org ms, Fewer Is Better NCNN 20220729 Target: CPU - Model: resnet50 AVX-512 Off AVX-512 On AVX-512 On 512 4 8 12 16 20 SE +/- 0.02, N = 3 SE +/- 0.42, N = 3 SE +/- 0.42, N = 3 15.40 15.99 16.24 -mno-avx512f - MIN: 15.07 / MAX: 24.51 MIN: 15.25 / MAX: 18.48 MIN: 15.19 / MAX: 17.46 1. (CXX) g++ options: -O3 -march=native -rdynamic -lgomp -lpthread
NCNN Target: CPU - Model: alexnet OpenBenchmarking.org ms, Fewer Is Better NCNN 20220729 Target: CPU - Model: alexnet AVX-512 Off AVX-512 On AVX-512 On 512 2 4 6 8 10 SE +/- 0.01, N = 3 SE +/- 0.02, N = 3 SE +/- 0.19, N = 3 6.33 6.98 6.69 -mno-avx512f - MIN: 6.2 / MAX: 7.75 MIN: 6.82 / MAX: 7.88 MIN: 6.2 / MAX: 7.35 1. (CXX) g++ options: -O3 -march=native -rdynamic -lgomp -lpthread
NCNN Target: CPU - Model: resnet18 OpenBenchmarking.org ms, Fewer Is Better NCNN 20220729 Target: CPU - Model: resnet18 AVX-512 Off AVX-512 On AVX-512 On 512 2 4 6 8 10 SE +/- 0.00, N = 3 SE +/- 0.02, N = 3 SE +/- 0.02, N = 3 8.24 8.69 8.64 -mno-avx512f - MIN: 8.06 / MAX: 9.19 MIN: 8.51 / MAX: 14.15 MIN: 8.45 / MAX: 9.39 1. (CXX) g++ options: -O3 -march=native -rdynamic -lgomp -lpthread
NCNN Target: CPU - Model: vgg16 OpenBenchmarking.org ms, Fewer Is Better NCNN 20220729 Target: CPU - Model: vgg16 AVX-512 Off AVX-512 On AVX-512 On 512 10 20 30 40 50 SE +/- 0.13, N = 3 SE +/- 0.13, N = 3 SE +/- 0.23, N = 3 45.68 44.74 44.59 -mno-avx512f - MIN: 44.98 / MAX: 50.56 MIN: 44.1 / MAX: 49.06 MIN: 43.87 / MAX: 50.43 1. (CXX) g++ options: -O3 -march=native -rdynamic -lgomp -lpthread
NCNN Target: CPU - Model: googlenet OpenBenchmarking.org ms, Fewer Is Better NCNN 20220729 Target: CPU - Model: googlenet AVX-512 Off AVX-512 On AVX-512 On 512 3 6 9 12 15 SE +/- 0.03, N = 3 SE +/- 0.00, N = 3 SE +/- 0.13, N = 3 9.55 10.16 9.96 -mno-avx512f - MIN: 9.33 / MAX: 10.86 MIN: 9.92 / MAX: 11.36 MIN: 9.52 / MAX: 10.98 1. (CXX) g++ options: -O3 -march=native -rdynamic -lgomp -lpthread
NCNN Target: CPU - Model: blazeface OpenBenchmarking.org ms, Fewer Is Better NCNN 20220729 Target: CPU - Model: blazeface AVX-512 Off AVX-512 On AVX-512 On 512 0.18 0.36 0.54 0.72 0.9 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 0.76 0.80 0.80 -mno-avx512f - MIN: 0.73 / MAX: 1.52 MIN: 0.77 / MAX: 1.52 MIN: 0.77 / MAX: 1.28 1. (CXX) g++ options: -O3 -march=native -rdynamic -lgomp -lpthread
NCNN Target: CPU - Model: efficientnet-b0 OpenBenchmarking.org ms, Fewer Is Better NCNN 20220729 Target: CPU - Model: efficientnet-b0 AVX-512 Off AVX-512 On AVX-512 On 512 1.0935 2.187 3.2805 4.374 5.4675 SE +/- 0.05, N = 3 SE +/- 0.06, N = 3 SE +/- 0.05, N = 3 4.35 4.86 4.79 -mno-avx512f - MIN: 4.2 / MAX: 5.22 MIN: 4.6 / MAX: 6.13 MIN: 4.61 / MAX: 9.9 1. (CXX) g++ options: -O3 -march=native -rdynamic -lgomp -lpthread
NCNN Target: CPU - Model: mnasnet OpenBenchmarking.org ms, Fewer Is Better NCNN 20220729 Target: CPU - Model: mnasnet AVX-512 Off AVX-512 On AVX-512 On 512 0.5895 1.179 1.7685 2.358 2.9475 SE +/- 0.03, N = 3 SE +/- 0.03, N = 3 SE +/- 0.03, N = 3 2.37 2.62 2.58 -mno-avx512f - MIN: 2.28 / MAX: 3.27 MIN: 2.48 / MAX: 3.81 MIN: 2.48 / MAX: 3.14 1. (CXX) g++ options: -O3 -march=native -rdynamic -lgomp -lpthread
NCNN Target: CPU - Model: shufflenet-v2 OpenBenchmarking.org ms, Fewer Is Better NCNN 20220729 Target: CPU - Model: shufflenet-v2 AVX-512 Off AVX-512 On AVX-512 On 512 0.5243 1.0486 1.5729 2.0972 2.6215 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 2.33 2.33 2.33 -mno-avx512f - MIN: 2.27 / MAX: 3.18 MIN: 2.26 / MAX: 3.21 MIN: 2.27 / MAX: 2.81 1. (CXX) g++ options: -O3 -march=native -rdynamic -lgomp -lpthread
NCNN Target: CPU-v3-v3 - Model: mobilenet-v3 OpenBenchmarking.org ms, Fewer Is Better NCNN 20220729 Target: CPU-v3-v3 - Model: mobilenet-v3 AVX-512 Off AVX-512 On AVX-512 On 512 0.6098 1.2196 1.8294 2.4392 3.049 SE +/- 0.01, N = 3 SE +/- 0.03, N = 3 SE +/- 0.05, N = 3 2.49 2.68 2.71 -mno-avx512f - MIN: 2.4 / MAX: 3.36 MIN: 2.56 / MAX: 3.63 MIN: 2.55 / MAX: 3.5 1. (CXX) g++ options: -O3 -march=native -rdynamic -lgomp -lpthread
NCNN Target: CPU-v2-v2 - Model: mobilenet-v2 OpenBenchmarking.org ms, Fewer Is Better NCNN 20220729 Target: CPU-v2-v2 - Model: mobilenet-v2 AVX-512 Off AVX-512 On AVX-512 On 512 0.8483 1.6966 2.5449 3.3932 4.2415 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.05, N = 3 3.34 3.73 3.77 -mno-avx512f - MIN: 3.16 / MAX: 5.05 MIN: 3.56 / MAX: 5.05 MIN: 3.53 / MAX: 4.4 1. (CXX) g++ options: -O3 -march=native -rdynamic -lgomp -lpthread
NCNN Target: CPU - Model: mobilenet OpenBenchmarking.org ms, Fewer Is Better NCNN 20220729 Target: CPU - Model: mobilenet AVX-512 Off AVX-512 On AVX-512 On 512 3 6 9 12 15 SE +/- 0.02, N = 3 SE +/- 0.15, N = 3 SE +/- 0.13, N = 3 11.43 12.28 12.28 -mno-avx512f - MIN: 11.21 / MAX: 16.87 MIN: 11.79 / MAX: 13.67 MIN: 11.87 / MAX: 18.86 1. (CXX) g++ options: -O3 -march=native -rdynamic -lgomp -lpthread
oneDNN Harness: Recurrent Neural Network Training - Data Type: bf16bf16bf16 - Engine: CPU OpenBenchmarking.org ms, Fewer Is Better oneDNN 2.7 Harness: Recurrent Neural Network Training - Data Type: bf16bf16bf16 - Engine: CPU AVX-512 Off AVX-512 On AVX-512 On 512 700 1400 2100 2800 3500 SE +/- 2.45, N = 3 SE +/- 4.17, N = 3 SE +/- 38.98, N = 3 3271.27 3093.58 2986.72 -mno-avx512f - MIN: 3259.85 MIN: 3075.2 MIN: 2932.85 1. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl
oneDNN Harness: Recurrent Neural Network Training - Data Type: f32 - Engine: CPU OpenBenchmarking.org ms, Fewer Is Better oneDNN 2.7 Harness: Recurrent Neural Network Training - Data Type: f32 - Engine: CPU AVX-512 Off AVX-512 On AVX-512 On 512 700 1400 2100 2800 3500 SE +/- 1.15, N = 3 SE +/- 2.36, N = 3 SE +/- 2.98, N = 3 3271.06 3079.96 3062.36 -mno-avx512f - MIN: 3261.78 MIN: 3061.76 MIN: 3040.47 1. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl
oneDNN Harness: Recurrent Neural Network Inference - Data Type: u8s8f32 - Engine: CPU OpenBenchmarking.org ms, Fewer Is Better oneDNN 2.7 Harness: Recurrent Neural Network Inference - Data Type: u8s8f32 - Engine: CPU AVX-512 Off AVX-512 On AVX-512 On 512 400 800 1200 1600 2000 SE +/- 1.98, N = 3 SE +/- 7.10, N = 3 SE +/- 14.49, N = 3 2003.54 1817.59 1738.00 -mno-avx512f - MIN: 1993.54 MIN: 1801.35 MIN: 1697.55 1. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl
OSPRay Studio Camera: 1 - Resolution: 1080p - Samples Per Pixel: 32 - Renderer: Path Tracer OpenBenchmarking.org ms, Fewer Is Better OSPRay Studio 0.11 Camera: 1 - Resolution: 1080p - Samples Per Pixel: 32 - Renderer: Path Tracer AVX-512 Off AVX-512 On AVX-512 On 512 15K 30K 45K 60K 75K SE +/- 50.78, N = 3 SE +/- 55.47, N = 3 SE +/- 140.32, N = 3 72145 65723 65447 -mno-avx512f 1. (CXX) g++ options: -O3 -march=native -ldl
Cpuminer-Opt Algorithm: Blake-2 S OpenBenchmarking.org kH/s, More Is Better Cpuminer-Opt 3.18 Algorithm: Blake-2 S AVX-512 Off AVX-512 On AVX-512 On 512 200K 400K 600K 800K 1000K SE +/- 382.81, N = 3 SE +/- 9836.24, N = 3 SE +/- 7851.09, N = 15 393213 862110 895513 -mno-avx512f 1. (CXX) g++ options: -O3 -march=native -lcurl -lz -lpthread -lssl -lcrypto -lgmp
TensorFlow Device: CPU - Batch Size: 32 - Model: GoogLeNet OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.10 Device: CPU - Batch Size: 32 - Model: GoogLeNet AVX-512 Off AVX-512 On AVX-512 On 512 14 28 42 56 70 SE +/- 0.04, N = 3 SE +/- 0.01, N = 3 SE +/- 0.06, N = 3 36.49 64.22 64.42
Intel Open Image Denoise Run: RT.hdr_alb_nrm.3840x2160 OpenBenchmarking.org Images / Sec, More Is Better Intel Open Image Denoise 1.4.0 Run: RT.hdr_alb_nrm.3840x2160 AVX-512 Off AVX-512 On AVX-512 On 512 0.0968 0.1936 0.2904 0.3872 0.484 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 0.43 0.43 0.43
Intel Open Image Denoise Run: RT.ldr_alb_nrm.3840x2160 OpenBenchmarking.org Images / Sec, More Is Better Intel Open Image Denoise 1.4.0 Run: RT.ldr_alb_nrm.3840x2160 AVX-512 Off AVX-512 On AVX-512 On 512 0.0968 0.1936 0.2904 0.3872 0.484 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 0.43 0.43 0.43
OpenVINO Model: Person Detection FP16 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2022.2.dev Model: Person Detection FP16 - Device: CPU AVX-512 Off AVX-512 On AVX-512 On 512 600 1200 1800 2400 3000 SE +/- 7.35, N = 3 SE +/- 0.33, N = 3 SE +/- 7.01, N = 3 2563.45 2235.54 2227.69 -mno-avx512f - MIN: 1711.34 / MAX: 3871.27 -ldl - MIN: 1874.94 / MAX: 2477.63 -ldl - MIN: 1807.91 / MAX: 2513.61 1. (CXX) g++ options: -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -pie
OpenVINO Model: Person Detection FP16 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2022.2.dev Model: Person Detection FP16 - Device: CPU AVX-512 Off AVX-512 On AVX-512 On 512 0.4005 0.801 1.2015 1.602 2.0025 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 1.54 1.78 1.78 -mno-avx512f -ldl -ldl 1. (CXX) g++ options: -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -pie
OpenVINO Model: Person Detection FP32 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2022.2.dev Model: Person Detection FP32 - Device: CPU AVX-512 Off AVX-512 On AVX-512 On 512 600 1200 1800 2400 3000 SE +/- 9.17, N = 3 SE +/- 9.13, N = 3 SE +/- 8.02, N = 3 2563.87 2250.02 2244.25 -mno-avx512f - MIN: 1540.87 / MAX: 3813.98 -ldl - MIN: 1294.64 / MAX: 2438.65 -ldl - MIN: 1760.66 / MAX: 2505.49 1. (CXX) g++ options: -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -pie
OpenVINO Model: Person Detection FP32 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2022.2.dev Model: Person Detection FP32 - Device: CPU AVX-512 Off AVX-512 On AVX-512 On 512 0.3983 0.7966 1.1949 1.5932 1.9915 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 1.54 1.76 1.77 -mno-avx512f -ldl -ldl 1. (CXX) g++ options: -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -pie
OpenVINO Model: Face Detection FP16 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2022.2.dev Model: Face Detection FP16 - Device: CPU AVX-512 Off AVX-512 On AVX-512 On 512 300 600 900 1200 1500 SE +/- 4.24, N = 3 SE +/- 3.79, N = 3 SE +/- 1.26, N = 3 1525.18 1346.99 1352.08 -mno-avx512f - MIN: 825.15 / MAX: 2479.54 -ldl - MIN: 1224.1 / MAX: 1502.9 -ldl - MIN: 1184.99 / MAX: 1541.85 1. (CXX) g++ options: -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -pie
OpenVINO Model: Face Detection FP16 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2022.2.dev Model: Face Detection FP16 - Device: CPU AVX-512 Off AVX-512 On AVX-512 On 512 0.6683 1.3366 2.0049 2.6732 3.3415 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 2.60 2.97 2.95 -mno-avx512f -ldl -ldl 1. (CXX) g++ options: -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -pie
simdjson Throughput Test: DistinctUserID OpenBenchmarking.org GB/s, More Is Better simdjson 2.0 Throughput Test: DistinctUserID AVX-512 Off AVX-512 On AVX-512 On 512 2 4 6 8 10 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 6.33 8.78 8.77 -mno-avx512f 1. (CXX) g++ options: -O3 -march=native
OpenVINO Model: Face Detection FP16-INT8 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2022.2.dev Model: Face Detection FP16-INT8 - Device: CPU AVX-512 Off AVX-512 On AVX-512 On 512 200 400 600 800 1000 SE +/- 3.19, N = 3 SE +/- 0.34, N = 3 SE +/- 0.43, N = 3 817.17 326.76 328.08 -mno-avx512f - MIN: 559.45 / MAX: 1507.03 -ldl - MIN: 183.35 / MAX: 422.57 -ldl - MIN: 193.4 / MAX: 422.42 1. (CXX) g++ options: -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -pie
OpenVINO Model: Face Detection FP16-INT8 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2022.2.dev Model: Face Detection FP16-INT8 - Device: CPU AVX-512 Off AVX-512 On AVX-512 On 512 3 6 9 12 15 SE +/- 0.02, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 4.88 12.23 12.17 -mno-avx512f -ldl -ldl 1. (CXX) g++ options: -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -pie
Cpuminer-Opt Algorithm: Deepcoin OpenBenchmarking.org kH/s, More Is Better Cpuminer-Opt 3.18 Algorithm: Deepcoin AVX-512 Off AVX-512 On AVX-512 On 512 2K 4K 6K 8K 10K SE +/- 3.11, N = 3 SE +/- 226.60, N = 12 SE +/- 25.17, N = 3 9966.10 11148.96 11270.00 -mno-avx512f 1. (CXX) g++ options: -O3 -march=native -lcurl -lz -lpthread -lssl -lcrypto -lgmp
Cpuminer-Opt Algorithm: x25x OpenBenchmarking.org kH/s, More Is Better Cpuminer-Opt 3.18 Algorithm: x25x AVX-512 Off AVX-512 On AVX-512 On 512 80 160 240 320 400 SE +/- 0.48, N = 3 SE +/- 1.89, N = 3 SE +/- 7.53, N = 12 359.01 387.72 379.94 -mno-avx512f 1. (CXX) g++ options: -O3 -march=native -lcurl -lz -lpthread -lssl -lcrypto -lgmp
simdjson Throughput Test: PartialTweets OpenBenchmarking.org GB/s, More Is Better simdjson 2.0 Throughput Test: PartialTweets AVX-512 Off AVX-512 On AVX-512 On 512 2 4 6 8 10 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 6.20 8.52 8.51 -mno-avx512f 1. (CXX) g++ options: -O3 -march=native
simdjson Throughput Test: TopTweet OpenBenchmarking.org GB/s, More Is Better simdjson 2.0 Throughput Test: TopTweet AVX-512 Off AVX-512 On AVX-512 On 512 2 4 6 8 10 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 6.35 8.82 8.82 -mno-avx512f 1. (CXX) g++ options: -O3 -march=native
OpenVINO Model: Machine Translation EN To DE FP16 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2022.2.dev Model: Machine Translation EN To DE FP16 - Device: CPU AVX-512 Off AVX-512 On AVX-512 On 512 30 60 90 120 150 SE +/- 0.14, N = 3 SE +/- 0.88, N = 3 SE +/- 0.59, N = 3 126.09 112.27 112.48 -mno-avx512f - MIN: 58.5 / MAX: 136.1 -ldl - MIN: 60.98 / MAX: 140.63 -ldl - MIN: 53.91 / MAX: 140.82 1. (CXX) g++ options: -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -pie
OpenVINO Model: Machine Translation EN To DE FP16 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2022.2.dev Model: Machine Translation EN To DE FP16 - Device: CPU AVX-512 Off AVX-512 On AVX-512 On 512 8 16 24 32 40 SE +/- 0.04, N = 3 SE +/- 0.27, N = 3 SE +/- 0.18, N = 3 31.70 35.62 35.55 -mno-avx512f -ldl -ldl 1. (CXX) g++ options: -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -pie
OpenVINO Model: Vehicle Detection FP16 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2022.2.dev Model: Vehicle Detection FP16 - Device: CPU AVX-512 Off AVX-512 On AVX-512 On 512 8 16 24 32 40 SE +/- 0.29, N = 3 SE +/- 0.04, N = 3 SE +/- 0.08, N = 3 28.29 36.80 36.64 -mno-avx512f - MIN: 11.7 / MAX: 274.34 -ldl - MIN: 12.79 / MAX: 55.71 -ldl - MIN: 13.62 / MAX: 58.49 1. (CXX) g++ options: -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -pie
OpenVINO Model: Vehicle Detection FP16 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2022.2.dev Model: Vehicle Detection FP16 - Device: CPU AVX-512 Off AVX-512 On AVX-512 On 512 30 60 90 120 150 SE +/- 1.44, N = 3 SE +/- 0.12, N = 3 SE +/- 0.25, N = 3 141.30 108.61 109.09 -mno-avx512f -ldl -ldl 1. (CXX) g++ options: -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -pie
OpenVINO Model: Vehicle Detection FP16-INT8 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2022.2.dev Model: Vehicle Detection FP16-INT8 - Device: CPU AVX-512 Off AVX-512 On AVX-512 On 512 3 6 9 12 15 SE +/- 0.06, N = 3 SE +/- 0.04, N = 3 SE +/- 0.02, N = 3 12.88 6.41 6.33 -mno-avx512f - MIN: 7.49 / MAX: 109.79 -ldl - MIN: 3.21 / MAX: 14.83 -ldl - MIN: 4.22 / MAX: 15.17 1. (CXX) g++ options: -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -pie
OpenVINO Model: Vehicle Detection FP16-INT8 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2022.2.dev Model: Vehicle Detection FP16-INT8 - Device: CPU AVX-512 Off AVX-512 On AVX-512 On 512 140 280 420 560 700 SE +/- 1.58, N = 3 SE +/- 3.77, N = 3 SE +/- 1.77, N = 3 310.38 623.17 630.58 -mno-avx512f -ldl -ldl 1. (CXX) g++ options: -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -pie
OpenVINO Model: Weld Porosity Detection FP16 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2022.2.dev Model: Weld Porosity Detection FP16 - Device: CPU AVX-512 Off AVX-512 On AVX-512 On 512 6 12 18 24 30 SE +/- 0.00, N = 3 SE +/- 0.03, N = 3 SE +/- 0.08, N = 3 15.81 24.92 24.86 -mno-avx512f - MIN: 7.14 / MAX: 105.25 -ldl - MIN: 12.72 / MAX: 35.46 -ldl - MIN: 12.43 / MAX: 42.38 1. (CXX) g++ options: -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -pie
OpenVINO Model: Weld Porosity Detection FP16 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2022.2.dev Model: Weld Porosity Detection FP16 - Device: CPU AVX-512 Off AVX-512 On AVX-512 On 512 70 140 210 280 350 SE +/- 0.05, N = 3 SE +/- 0.40, N = 3 SE +/- 1.00, N = 3 252.69 320.80 321.51 -mno-avx512f -ldl -ldl 1. (CXX) g++ options: -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -pie
OpenVINO Model: Weld Porosity Detection FP16-INT8 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2022.2.dev Model: Weld Porosity Detection FP16-INT8 - Device: CPU AVX-512 Off AVX-512 On AVX-512 On 512 4 8 12 16 20 SE +/- 0.06, N = 3 SE +/- 0.03, N = 3 SE +/- 0.02, N = 3 14.98 6.43 6.42 -mno-avx512f - MIN: 8.89 / MAX: 192.81 -ldl - MIN: 3.29 / MAX: 13.76 -ldl - MIN: 3.32 / MAX: 13.51 1. (CXX) g++ options: -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -pie
OpenVINO Model: Weld Porosity Detection FP16-INT8 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2022.2.dev Model: Weld Porosity Detection FP16-INT8 - Device: CPU AVX-512 Off AVX-512 On AVX-512 On 512 300 600 900 1200 1500 SE +/- 2.18, N = 3 SE +/- 5.38, N = 3 SE +/- 4.58, N = 3 533.79 1240.56 1242.45 -mno-avx512f -ldl -ldl 1. (CXX) g++ options: -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -pie
OpenVINO Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2022.2.dev Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU AVX-512 Off AVX-512 On AVX-512 On 512 0.225 0.45 0.675 0.9 1.125 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 1.00 0.85 0.84 -mno-avx512f - MIN: 0.48 / MAX: 89.55 -ldl - MIN: 0.45 / MAX: 10.27 -ldl - MIN: 0.48 / MAX: 9.99 1. (CXX) g++ options: -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -pie
OpenVINO Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2022.2.dev Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU AVX-512 Off AVX-512 On AVX-512 On 512 2K 4K 6K 8K 10K SE +/- 34.03, N = 3 SE +/- 94.72, N = 3 SE +/- 54.72, N = 3 7956.78 9379.27 9460.45 -mno-avx512f -ldl -ldl 1. (CXX) g++ options: -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -pie
TensorFlow Device: CPU - Batch Size: 64 - Model: AlexNet OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.10 Device: CPU - Batch Size: 64 - Model: AlexNet AVX-512 Off AVX-512 On AVX-512 On 512 30 60 90 120 150 SE +/- 0.07, N = 3 SE +/- 0.11, N = 3 SE +/- 0.13, N = 3 103.31 136.92 137.75
simdjson Throughput Test: Kostya OpenBenchmarking.org GB/s, More Is Better simdjson 2.0 Throughput Test: Kostya AVX-512 Off AVX-512 On AVX-512 On 512 1.0215 2.043 3.0645 4.086 5.1075 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 3.86 4.54 4.53 -mno-avx512f 1. (CXX) g++ options: -O3 -march=native
Embree Binary: Pathtracer ISPC - Model: Asian Dragon Obj OpenBenchmarking.org Frames Per Second, More Is Better Embree 3.13 Binary: Pathtracer ISPC - Model: Asian Dragon Obj AVX-512 Off AVX-512 On AVX-512 On 512 4 8 12 16 20 SE +/- 0.02, N = 3 SE +/- 0.01, N = 3 SE +/- 0.03, N = 3 14.02 14.43 14.35 MIN: 13.89 / MAX: 14.33 MIN: 14.31 / MAX: 14.74 MIN: 14.2 / MAX: 14.69
simdjson Throughput Test: LargeRandom OpenBenchmarking.org GB/s, More Is Better simdjson 2.0 Throughput Test: LargeRandom AVX-512 Off AVX-512 On AVX-512 On 512 0.3308 0.6616 0.9924 1.3232 1.654 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 1.36 1.47 1.47 -mno-avx512f 1. (CXX) g++ options: -O3 -march=native
Neural Magic DeepSparse Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.1 Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-Stream AVX-512 Off AVX-512 On AVX-512 On 512 30 60 90 120 150 SE +/- 0.85, N = 3 SE +/- 0.09, N = 3 SE +/- 0.07, N = 3 150.77 109.28 108.49
Neural Magic DeepSparse Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.1 Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-Stream AVX-512 Off AVX-512 On AVX-512 On 512 8 16 24 32 40 SE +/- 0.15, N = 3 SE +/- 0.03, N = 3 SE +/- 0.02, N = 3 26.53 36.60 36.86
Neural Magic DeepSparse Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.1 Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Stream AVX-512 Off AVX-512 On AVX-512 On 512 110 220 330 440 550 SE +/- 0.41, N = 3 SE +/- 1.90, N = 3 SE +/- 1.29, N = 3 491.12 446.49 440.56
Neural Magic DeepSparse Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.1 Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Stream AVX-512 Off AVX-512 On AVX-512 On 512 3 6 9 12 15 SE +/- 0.0056, N = 3 SE +/- 0.0383, N = 3 SE +/- 0.0265, N = 3 8.1425 8.9588 9.0792
Neural Magic DeepSparse Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.1 Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Stream AVX-512 Off AVX-512 On AVX-512 On 512 110 220 330 440 550 SE +/- 0.40, N = 3 SE +/- 3.25, N = 3 SE +/- 0.68, N = 3 492.38 446.88 440.10
Neural Magic DeepSparse Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.1 Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Stream AVX-512 Off AVX-512 On AVX-512 On 512 3 6 9 12 15 SE +/- 0.0060, N = 3 SE +/- 0.0648, N = 3 SE +/- 0.0140, N = 3 8.1213 8.9516 9.0886
Neural Magic DeepSparse Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Synchronous Single-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.1 Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Synchronous Single-Stream AVX-512 Off AVX-512 On AVX-512 On 512 9 18 27 36 45 SE +/- 0.08, N = 3 SE +/- 0.10, N = 3 SE +/- 0.10, N = 3 39.14 22.89 23.01
Neural Magic DeepSparse Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Synchronous Single-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.1 Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Synchronous Single-Stream AVX-512 Off AVX-512 On AVX-512 On 512 10 20 30 40 50 SE +/- 0.05, N = 3 SE +/- 0.20, N = 3 SE +/- 0.19, N = 3 25.54 43.68 43.44
Neural Magic DeepSparse Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.1 Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-Stream AVX-512 Off AVX-512 On AVX-512 On 512 30 60 90 120 150 SE +/- 0.07, N = 3 SE +/- 0.31, N = 3 SE +/- 0.54, N = 3 112.60 97.85 98.03
Neural Magic DeepSparse Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.1 Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-Stream AVX-512 Off AVX-512 On AVX-512 On 512 9 18 27 36 45 SE +/- 0.02, N = 3 SE +/- 0.12, N = 3 SE +/- 0.22, N = 3 35.52 40.87 40.80
Neural Magic DeepSparse Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Synchronous Single-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.1 Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Synchronous Single-Stream AVX-512 Off AVX-512 On AVX-512 On 512 30 60 90 120 150 SE +/- 0.07, N = 3 SE +/- 0.58, N = 3 SE +/- 0.33, N = 3 127.65 112.19 110.96
Neural Magic DeepSparse Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Synchronous Single-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.1 Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Synchronous Single-Stream AVX-512 Off AVX-512 On AVX-512 On 512 3 6 9 12 15 SE +/- 0.0041, N = 3 SE +/- 0.0463, N = 3 SE +/- 0.0265, N = 3 7.8337 8.9135 9.0118
Neural Magic DeepSparse Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Synchronous Single-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.1 Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Synchronous Single-Stream AVX-512 Off AVX-512 On AVX-512 On 512 30 60 90 120 150 SE +/- 0.12, N = 3 SE +/- 1.00, N = 3 SE +/- 0.37, N = 3 128.05 112.68 111.22
Neural Magic DeepSparse Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Synchronous Single-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.1 Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Synchronous Single-Stream AVX-512 Off AVX-512 On AVX-512 On 512 3 6 9 12 15 SE +/- 0.0071, N = 3 SE +/- 0.0785, N = 3 SE +/- 0.0301, N = 3 7.8089 8.8759 8.9905
Neural Magic DeepSparse Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Synchronous Single-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.1 Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Synchronous Single-Stream AVX-512 Off AVX-512 On AVX-512 On 512 8 16 24 32 40 SE +/- 0.02, N = 3 SE +/- 0.06, N = 3 SE +/- 0.08, N = 3 34.51 28.26 28.22
Neural Magic DeepSparse Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Synchronous Single-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.1 Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Synchronous Single-Stream AVX-512 Off AVX-512 On AVX-512 On 512 8 16 24 32 40 SE +/- 0.02, N = 3 SE +/- 0.07, N = 3 SE +/- 0.11, N = 3 28.97 35.38 35.42
Embree Binary: Pathtracer ISPC - Model: Crown OpenBenchmarking.org Frames Per Second, More Is Better Embree 3.13 Binary: Pathtracer ISPC - Model: Crown AVX-512 Off AVX-512 On AVX-512 On 512 4 8 12 16 20 SE +/- 0.11, N = 3 SE +/- 0.03, N = 3 SE +/- 0.03, N = 3 13.86 14.63 14.62 MIN: 13.49 / MAX: 14.34 MIN: 14.41 / MAX: 15.16 MIN: 14.37 / MAX: 15.18
Neural Magic DeepSparse Model: NLP Text Classification, DistilBERT mnli - Scenario: Synchronous Single-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.1 Model: NLP Text Classification, DistilBERT mnli - Scenario: Synchronous Single-Stream AVX-512 Off AVX-512 On AVX-512 On 512 4 8 12 16 20 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 17.66 14.54 14.54
Neural Magic DeepSparse Model: NLP Text Classification, DistilBERT mnli - Scenario: Synchronous Single-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.1 Model: NLP Text Classification, DistilBERT mnli - Scenario: Synchronous Single-Stream AVX-512 Off AVX-512 On AVX-512 On 512 15 30 45 60 75 SE +/- 0.03, N = 3 SE +/- 0.05, N = 3 SE +/- 0.03, N = 3 56.59 68.76 68.77
Embree Binary: Pathtracer ISPC - Model: Asian Dragon OpenBenchmarking.org Frames Per Second, More Is Better Embree 3.13 Binary: Pathtracer ISPC - Model: Asian Dragon AVX-512 Off AVX-512 On AVX-512 On 512 4 8 12 16 20 SE +/- 0.10, N = 3 SE +/- 0.07, N = 3 SE +/- 0.06, N = 3 15.90 16.51 16.45 MIN: 15.66 / MAX: 16.42 MIN: 16.3 / MAX: 17.02 MIN: 16.21 / MAX: 16.89
Neural Magic DeepSparse Model: CV Detection,YOLOv5s COCO - Scenario: Synchronous Single-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.1 Model: CV Detection,YOLOv5s COCO - Scenario: Synchronous Single-Stream AVX-512 Off AVX-512 On AVX-512 On 512 6 12 18 24 30 SE +/- 0.00, N = 3 SE +/- 0.06, N = 3 SE +/- 0.02, N = 3 23.04 20.13 19.99
Neural Magic DeepSparse Model: CV Detection,YOLOv5s COCO - Scenario: Synchronous Single-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.1 Model: CV Detection,YOLOv5s COCO - Scenario: Synchronous Single-Stream AVX-512 Off AVX-512 On AVX-512 On 512 11 22 33 44 55 SE +/- 0.01, N = 3 SE +/- 0.15, N = 3 SE +/- 0.04, N = 3 43.39 49.67 49.99
Neural Magic DeepSparse Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.1 Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream AVX-512 Off AVX-512 On AVX-512 On 512 13 26 39 52 65 SE +/- 0.03, N = 3 SE +/- 0.07, N = 3 SE +/- 0.03, N = 3 57.88 49.57 49.36
Neural Magic DeepSparse Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.1 Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream AVX-512 Off AVX-512 On AVX-512 On 512 20 40 60 80 100 SE +/- 0.03, N = 3 SE +/- 0.12, N = 3 SE +/- 0.06, N = 3 69.10 80.67 81.02
Neural Magic DeepSparse Model: CV Classification, ResNet-50 ImageNet - Scenario: Synchronous Single-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.1 Model: CV Classification, ResNet-50 ImageNet - Scenario: Synchronous Single-Stream AVX-512 Off AVX-512 On AVX-512 On 512 3 6 9 12 15 SE +/- 0.0062, N = 3 SE +/- 0.0274, N = 3 SE +/- 0.0069, N = 3 11.6244 7.5173 7.4707
Neural Magic DeepSparse Model: CV Classification, ResNet-50 ImageNet - Scenario: Synchronous Single-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.1 Model: CV Classification, ResNet-50 ImageNet - Scenario: Synchronous Single-Stream AVX-512 Off AVX-512 On AVX-512 On 512 30 60 90 120 150 SE +/- 0.04, N = 3 SE +/- 0.48, N = 3 SE +/- 0.12, N = 3 85.98 132.91 133.74
Neural Magic DeepSparse Model: CV Detection,YOLOv5s COCO - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.1 Model: CV Detection,YOLOv5s COCO - Scenario: Asynchronous Multi-Stream AVX-512 Off AVX-512 On AVX-512 On 512 20 40 60 80 100 SE +/- 0.19, N = 3 SE +/- 0.23, N = 3 SE +/- 0.56, N = 3 92.51 78.78 77.87
Neural Magic DeepSparse Model: CV Detection,YOLOv5s COCO - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.1 Model: CV Detection,YOLOv5s COCO - Scenario: Asynchronous Multi-Stream AVX-512 Off AVX-512 On AVX-512 On 512 12 24 36 48 60 SE +/- 0.08, N = 3 SE +/- 0.15, N = 3 SE +/- 0.37, N = 3 43.23 50.77 51.36
TensorFlow Device: CPU - Batch Size: 16 - Model: GoogLeNet OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.10 Device: CPU - Batch Size: 16 - Model: GoogLeNet AVX-512 Off AVX-512 On AVX-512 On 512 14 28 42 56 70 SE +/- 0.02, N = 3 SE +/- 0.03, N = 3 SE +/- 0.16, N = 3 36.22 63.34 63.83
oneDNN Harness: IP Shapes 3D - Data Type: bf16bf16bf16 - Engine: CPU OpenBenchmarking.org ms, Fewer Is Better oneDNN 2.7 Harness: IP Shapes 3D - Data Type: bf16bf16bf16 - Engine: CPU AVX-512 On AVX-512 On 512 1.0843 2.1686 3.2529 4.3372 5.4215 SE +/- 0.03916, N = 9 SE +/- 0.02954, N = 15 4.81904 4.64814 MIN: 4.15 MIN: 4.01 1. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl
Neural Magic DeepSparse Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.1 Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream AVX-512 Off AVX-512 On AVX-512 On 512 9 18 27 36 45 SE +/- 0.05, N = 3 SE +/- 0.15, N = 3 SE +/- 0.11, N = 3 39.35 25.73 25.49
Neural Magic DeepSparse Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.1 Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream AVX-512 Off AVX-512 On AVX-512 On 512 30 60 90 120 150 SE +/- 0.14, N = 3 SE +/- 0.92, N = 3 SE +/- 0.68, N = 3 101.64 155.39 156.81
TensorFlow Device: CPU - Batch Size: 32 - Model: AlexNet OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.10 Device: CPU - Batch Size: 32 - Model: AlexNet AVX-512 Off AVX-512 On AVX-512 On 512 30 60 90 120 150 SE +/- 0.05, N = 3 SE +/- 0.17, N = 3 SE +/- 0.26, N = 3 87.79 112.10 113.25
Cpuminer-Opt Algorithm: Magi OpenBenchmarking.org kH/s, More Is Better Cpuminer-Opt 3.18 Algorithm: Magi AVX-512 Off AVX-512 On AVX-512 On 512 100 200 300 400 500 SE +/- 0.84, N = 3 SE +/- 0.67, N = 3 SE +/- 3.36, N = 3 453.39 452.82 449.42 -mno-avx512f 1. (CXX) g++ options: -O3 -march=native -lcurl -lz -lpthread -lssl -lcrypto -lgmp
Cpuminer-Opt Algorithm: Myriad-Groestl OpenBenchmarking.org kH/s, More Is Better Cpuminer-Opt 3.18 Algorithm: Myriad-Groestl AVX-512 Off AVX-512 On AVX-512 On 512 9K 18K 27K 36K 45K SE +/- 17.32, N = 3 SE +/- 58.12, N = 3 SE +/- 164.55, N = 3 16150 40573 40663 -mno-avx512f 1. (CXX) g++ options: -O3 -march=native -lcurl -lz -lpthread -lssl -lcrypto -lgmp
Cpuminer-Opt Algorithm: LBC, LBRY Credits OpenBenchmarking.org kH/s, More Is Better Cpuminer-Opt 3.18 Algorithm: LBC, LBRY Credits AVX-512 Off AVX-512 On AVX-512 On 512 17K 34K 51K 68K 85K SE +/- 20.00, N = 3 SE +/- 84.13, N = 3 SE +/- 116.81, N = 3 27270 77083 76393 -mno-avx512f 1. (CXX) g++ options: -O3 -march=native -lcurl -lz -lpthread -lssl -lcrypto -lgmp
Cpuminer-Opt Algorithm: Skeincoin OpenBenchmarking.org kH/s, More Is Better Cpuminer-Opt 3.18 Algorithm: Skeincoin AVX-512 Off AVX-512 On AVX-512 On 512 20K 40K 60K 80K 100K SE +/- 85.44, N = 3 SE +/- 394.25, N = 3 SE +/- 146.55, N = 3 70720 111730 112403 -mno-avx512f 1. (CXX) g++ options: -O3 -march=native -lcurl -lz -lpthread -lssl -lcrypto -lgmp
Cpuminer-Opt Algorithm: Quad SHA-256, Pyrite OpenBenchmarking.org kH/s, More Is Better Cpuminer-Opt 3.18 Algorithm: Quad SHA-256, Pyrite AVX-512 Off AVX-512 On AVX-512 On 512 40K 80K 120K 160K 200K SE +/- 42.56, N = 3 SE +/- 280.42, N = 3 SE +/- 346.55, N = 3 64663 167500 164790 -mno-avx512f 1. (CXX) g++ options: -O3 -march=native -lcurl -lz -lpthread -lssl -lcrypto -lgmp
Cpuminer-Opt Algorithm: Garlicoin OpenBenchmarking.org kH/s, More Is Better Cpuminer-Opt 3.18 Algorithm: Garlicoin AVX-512 Off AVX-512 On AVX-512 On 512 900 1800 2700 3600 4500 SE +/- 6.13, N = 3 SE +/- 25.90, N = 3 SE +/- 10.30, N = 3 2381.45 4384.38 4392.29 -mno-avx512f 1. (CXX) g++ options: -O3 -march=native -lcurl -lz -lpthread -lssl -lcrypto -lgmp
Cpuminer-Opt Algorithm: Triple SHA-256, Onecoin OpenBenchmarking.org kH/s, More Is Better Cpuminer-Opt 3.18 Algorithm: Triple SHA-256, Onecoin AVX-512 Off AVX-512 On AVX-512 On 512 50K 100K 150K 200K 250K SE +/- 627.84, N = 3 SE +/- 1895.81, N = 3 SE +/- 1461.35, N = 3 106137 231700 230687 -mno-avx512f 1. (CXX) g++ options: -O3 -march=native -lcurl -lz -lpthread -lssl -lcrypto -lgmp
TensorFlow Device: CPU - Batch Size: 16 - Model: AlexNet OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.10 Device: CPU - Batch Size: 16 - Model: AlexNet AVX-512 Off AVX-512 On AVX-512 On 512 20 40 60 80 100 SE +/- 0.03, N = 3 SE +/- 0.06, N = 3 SE +/- 0.12, N = 3 67.80 80.75 82.10
TNN Target: CPU - Model: SqueezeNet v1.1 OpenBenchmarking.org ms, Fewer Is Better TNN 0.3 Target: CPU - Model: SqueezeNet v1.1 AVX-512 Off AVX-512 On AVX-512 On 512 50 100 150 200 250 SE +/- 0.07, N = 4 SE +/- 0.08, N = 4 SE +/- 0.09, N = 4 228.68 230.82 228.42 -mno-avx512f - MIN: 227.32 / MAX: 231.38 MIN: 229.65 / MAX: 231.83 MIN: 227.09 / MAX: 230.26 1. (CXX) g++ options: -O3 -march=native -fopenmp -pthread -fvisibility=hidden -fvisibility=default -rdynamic -ldl
oneDNN Harness: Deconvolution Batch shapes_1d - Data Type: bf16bf16bf16 - Engine: CPU OpenBenchmarking.org ms, Fewer Is Better oneDNN 2.7 Harness: Deconvolution Batch shapes_1d - Data Type: bf16bf16bf16 - Engine: CPU AVX-512 On AVX-512 On 512 5 10 15 20 25 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 20.81 20.26 MIN: 20.45 MIN: 19.82 1. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl
oneDNN Harness: Deconvolution Batch shapes_1d - Data Type: f32 - Engine: CPU OpenBenchmarking.org ms, Fewer Is Better oneDNN 2.7 Harness: Deconvolution Batch shapes_1d - Data Type: f32 - Engine: CPU AVX-512 Off AVX-512 On AVX-512 On 512 2 4 6 8 10 SE +/- 0.04615, N = 3 SE +/- 0.02566, N = 3 SE +/- 0.02594, N = 3 8.39772 8.55193 8.50891 -mno-avx512f - MIN: 4.7 MIN: 4.79 MIN: 4.8 1. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl
oneDNN Harness: Deconvolution Batch shapes_1d - Data Type: u8s8f32 - Engine: CPU OpenBenchmarking.org ms, Fewer Is Better oneDNN 2.7 Harness: Deconvolution Batch shapes_1d - Data Type: u8s8f32 - Engine: CPU AVX-512 Off AVX-512 On AVX-512 On 512 0.4001 0.8002 1.2003 1.6004 2.0005 SE +/- 0.003095, N = 3 SE +/- 0.003322, N = 3 SE +/- 0.003829, N = 3 1.778320 0.840660 0.846376 -mno-avx512f - MIN: 1.73 MIN: 0.82 MIN: 0.81 1. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl
oneDNN Harness: IP Shapes 1D - Data Type: f32 - Engine: CPU OpenBenchmarking.org ms, Fewer Is Better oneDNN 2.7 Harness: IP Shapes 1D - Data Type: f32 - Engine: CPU AVX-512 Off AVX-512 On AVX-512 On 512 0.908 1.816 2.724 3.632 4.54 SE +/- 0.00517, N = 4 SE +/- 0.00337, N = 4 SE +/- 0.00488, N = 4 3.22680 4.03554 4.03294 -mno-avx512f - MIN: 3.09 MIN: 3.9 MIN: 3.89 1. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl
oneDNN Harness: IP Shapes 1D - Data Type: bf16bf16bf16 - Engine: CPU OpenBenchmarking.org ms, Fewer Is Better oneDNN 2.7 Harness: IP Shapes 1D - Data Type: bf16bf16bf16 - Engine: CPU AVX-512 On AVX-512 On 512 2 4 6 8 10 SE +/- 0.00165, N = 4 SE +/- 0.00438, N = 4 8.55274 8.55374 MIN: 8.4 MIN: 8.33 1. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl
oneDNN Harness: IP Shapes 1D - Data Type: u8s8f32 - Engine: CPU OpenBenchmarking.org ms, Fewer Is Better oneDNN 2.7 Harness: IP Shapes 1D - Data Type: u8s8f32 - Engine: CPU AVX-512 Off AVX-512 On AVX-512 On 512 0.2799 0.5598 0.8397 1.1196 1.3995 SE +/- 0.000314, N = 4 SE +/- 0.001991, N = 4 SE +/- 0.001828, N = 4 1.243960 0.720702 0.715925 -mno-avx512f - MIN: 1.22 MIN: 0.67 MIN: 0.66 1. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl
dav1d Video Input: Summer Nature 4K OpenBenchmarking.org FPS, More Is Better dav1d 1.0 Video Input: Summer Nature 4K AVX-512 Off AVX-512 On AVX-512 On 512 50 100 150 200 250 SE +/- 0.10, N = 3 SE +/- 0.18, N = 3 SE +/- 0.11, N = 3 192.71 207.14 190.82 -mno-avx512f 1. (CC) gcc options: -O3 -march=native -pthread -lm
dav1d Video Input: Chimera 1080p 10-bit OpenBenchmarking.org FPS, More Is Better dav1d 1.0 Video Input: Chimera 1080p 10-bit AVX-512 Off AVX-512 On AVX-512 On 512 110 220 330 440 550 SE +/- 0.38, N = 3 SE +/- 0.34, N = 3 SE +/- 0.21, N = 3 487.09 510.88 477.09 -mno-avx512f 1. (CC) gcc options: -O3 -march=native -pthread -lm
TNN Target: CPU - Model: MobileNet v2 OpenBenchmarking.org ms, Fewer Is Better TNN 0.3 Target: CPU - Model: MobileNet v2 AVX-512 Off AVX-512 On AVX-512 On 512 50 100 150 200 250 SE +/- 0.28, N = 3 SE +/- 0.25, N = 3 SE +/- 0.06, N = 3 241.31 245.95 240.41 -mno-avx512f - MIN: 238.09 / MAX: 252.58 MIN: 242.61 / MAX: 266.39 MIN: 237.96 / MAX: 252.77 1. (CXX) g++ options: -O3 -march=native -fopenmp -pthread -fvisibility=hidden -fvisibility=default -rdynamic -ldl
dav1d Video Input: Chimera 1080p OpenBenchmarking.org FPS, More Is Better dav1d 1.0 Video Input: Chimera 1080p AVX-512 Off AVX-512 On AVX-512 On 512 160 320 480 640 800 SE +/- 0.49, N = 4 SE +/- 0.58, N = 4 SE +/- 0.36, N = 4 691.43 734.61 727.76 -mno-avx512f 1. (CC) gcc options: -O3 -march=native -pthread -lm
oneDNN Harness: Matrix Multiply Batch Shapes Transformer - Data Type: bf16bf16bf16 - Engine: CPU OpenBenchmarking.org ms, Fewer Is Better oneDNN 2.7 Harness: Matrix Multiply Batch Shapes Transformer - Data Type: bf16bf16bf16 - Engine: CPU AVX-512 On AVX-512 On 512 0.859 1.718 2.577 3.436 4.295 SE +/- 0.04459, N = 4 SE +/- 0.03397, N = 4 3.81793 3.66945 MIN: 3.28 MIN: 3.28 1. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl
oneDNN Harness: Matrix Multiply Batch Shapes Transformer - Data Type: f32 - Engine: CPU OpenBenchmarking.org ms, Fewer Is Better oneDNN 2.7 Harness: Matrix Multiply Batch Shapes Transformer - Data Type: f32 - Engine: CPU AVX-512 Off AVX-512 On AVX-512 On 512 0.8266 1.6532 2.4798 3.3064 4.133 SE +/- 0.03921, N = 4 SE +/- 0.00624, N = 4 SE +/- 0.00586, N = 4 3.67360 3.26773 3.21742 -mno-avx512f - MIN: 3.39 MIN: 3.18 MIN: 3.14 1. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl
oneDNN Harness: Matrix Multiply Batch Shapes Transformer - Data Type: u8s8f32 - Engine: CPU OpenBenchmarking.org ms, Fewer Is Better oneDNN 2.7 Harness: Matrix Multiply Batch Shapes Transformer - Data Type: u8s8f32 - Engine: CPU AVX-512 Off AVX-512 On AVX-512 On 512 0.3157 0.6314 0.9471 1.2628 1.5785 SE +/- 0.00373, N = 4 SE +/- 0.00334, N = 4 SE +/- 0.00378, N = 4 1.40330 1.32134 1.30906 -mno-avx512f - MIN: 1.31 MIN: 1.26 MIN: 1.24 1. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl
oneDNN Harness: IP Shapes 3D - Data Type: f32 - Engine: CPU OpenBenchmarking.org ms, Fewer Is Better oneDNN 2.7 Harness: IP Shapes 3D - Data Type: f32 - Engine: CPU AVX-512 Off AVX-512 On AVX-512 On 512 3 6 9 12 15 SE +/- 0.00748, N = 5 SE +/- 0.00598, N = 5 SE +/- 0.01026, N = 5 11.67710 10.63470 9.95113 -mno-avx512f - MIN: 11.41 MIN: 10.54 MIN: 9.83 1. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl
oneDNN Harness: IP Shapes 3D - Data Type: u8s8f32 - Engine: CPU OpenBenchmarking.org ms, Fewer Is Better oneDNN 2.7 Harness: IP Shapes 3D - Data Type: u8s8f32 - Engine: CPU AVX-512 Off AVX-512 On AVX-512 On 512 0.6781 1.3562 2.0343 2.7124 3.3905 SE +/- 0.00482, N = 5 SE +/- 0.00593, N = 5 SE +/- 0.01183, N = 5 2.18670 3.01377 2.75246 -mno-avx512f - MIN: 2.11 MIN: 2.91 MIN: 2.64 1. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl
oneDNN Harness: Convolution Batch Shapes Auto - Data Type: f32 - Engine: CPU OpenBenchmarking.org ms, Fewer Is Better oneDNN 2.7 Harness: Convolution Batch Shapes Auto - Data Type: f32 - Engine: CPU AVX-512 Off AVX-512 On AVX-512 On 512 4 8 12 16 20 SE +/- 0.01, N = 7 SE +/- 0.01, N = 7 SE +/- 0.01, N = 7 15.61 14.36 14.28 -mno-avx512f - MIN: 15.43 MIN: 14.18 MIN: 14.09 1. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl
oneDNN Harness: Convolution Batch Shapes Auto - Data Type: u8s8f32 - Engine: CPU OpenBenchmarking.org ms, Fewer Is Better oneDNN 2.7 Harness: Convolution Batch Shapes Auto - Data Type: u8s8f32 - Engine: CPU AVX-512 Off AVX-512 On AVX-512 On 512 4 8 12 16 20 SE +/- 0.01, N = 7 SE +/- 0.01, N = 7 SE +/- 0.00, N = 7 14.84 12.11 12.02 -mno-avx512f - MIN: 14.31 MIN: 11.95 MIN: 11.85 1. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl
dav1d Video Input: Summer Nature 1080p OpenBenchmarking.org FPS, More Is Better dav1d 1.0 Video Input: Summer Nature 1080p AVX-512 Off AVX-512 On AVX-512 On 512 200 400 600 800 1000 SE +/- 0.63, N = 8 SE +/- 0.63, N = 8 SE +/- 0.57, N = 8 879.37 894.73 902.92 -mno-avx512f 1. (CC) gcc options: -O3 -march=native -pthread -lm
TNN Target: CPU - Model: SqueezeNet v2 OpenBenchmarking.org ms, Fewer Is Better TNN 0.3 Target: CPU - Model: SqueezeNet v2 AVX-512 Off AVX-512 On AVX-512 On 512 11 22 33 44 55 SE +/- 0.17, N = 9 SE +/- 0.07, N = 9 SE +/- 0.11, N = 9 46.36 47.19 45.68 -mno-avx512f - MIN: 45.49 / MAX: 48.72 MIN: 46.52 / MAX: 48.8 MIN: 45.02 / MAX: 47.45 1. (CXX) g++ options: -O3 -march=native -fopenmp -pthread -fvisibility=hidden -fvisibility=default -rdynamic -ldl
oneDNN Harness: Convolution Batch Shapes Auto - Data Type: bf16bf16bf16 - Engine: CPU OpenBenchmarking.org ms, Fewer Is Better oneDNN 2.7 Harness: Convolution Batch Shapes Auto - Data Type: bf16bf16bf16 - Engine: CPU AVX-512 On AVX-512 On 512 4 8 12 16 20 SE +/- 0.00, N = 7 SE +/- 0.00, N = 7 16.16 16.16 MIN: 16.07 MIN: 16.06 1. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl
oneDNN Harness: Deconvolution Batch shapes_3d - Data Type: bf16bf16bf16 - Engine: CPU OpenBenchmarking.org ms, Fewer Is Better oneDNN 2.7 Harness: Deconvolution Batch shapes_3d - Data Type: bf16bf16bf16 - Engine: CPU AVX-512 On AVX-512 On 512 4 8 12 16 20 SE +/- 0.00, N = 9 SE +/- 0.00, N = 9 17.31 17.27 MIN: 16.91 MIN: 16.85 1. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl
oneDNN Harness: Deconvolution Batch shapes_3d - Data Type: f32 - Engine: CPU OpenBenchmarking.org ms, Fewer Is Better oneDNN 2.7 Harness: Deconvolution Batch shapes_3d - Data Type: f32 - Engine: CPU AVX-512 Off AVX-512 On AVX-512 On 512 1.2135 2.427 3.6405 4.854 6.0675 SE +/- 0.00507, N = 9 SE +/- 0.00401, N = 9 SE +/- 0.00516, N = 9 5.39327 4.33063 4.32564 -mno-avx512f - MIN: 5.31 MIN: 4.21 MIN: 4.21 1. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl
oneDNN Harness: Deconvolution Batch shapes_3d - Data Type: u8s8f32 - Engine: CPU OpenBenchmarking.org ms, Fewer Is Better oneDNN 2.7 Harness: Deconvolution Batch shapes_3d - Data Type: u8s8f32 - Engine: CPU AVX-512 Off AVX-512 On AVX-512 On 512 0.5202 1.0404 1.5606 2.0808 2.601 SE +/- 0.00997, N = 9 SE +/- 0.00510, N = 9 SE +/- 0.00281, N = 9 2.31183 1.47049 1.46948 -mno-avx512f - MIN: 2.22 MIN: 1.35 MIN: 1.36 1. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl
CPU Temperature Monitor Phoronix Test Suite System Monitoring OpenBenchmarking.org Celsius CPU Temperature Monitor Phoronix Test Suite System Monitoring AVX-512 Off AVX-512 On AVX-512 On 512 20 40 60 80 100 Min: 27 / Avg: 72.98 / Max: 95 Min: 29 / Avg: 78.17 / Max: 100 Min: 31 / Avg: 79.47 / Max: 100
CPU Power Consumption Monitor Phoronix Test Suite System Monitoring OpenBenchmarking.org Watts CPU Power Consumption Monitor Phoronix Test Suite System Monitoring AVX-512 Off AVX-512 On AVX-512 On 512 50 100 150 200 250 Min: 6.36 / Avg: 173.58 / Max: 251.93 Min: 6.37 / Avg: 188.45 / Max: 283.94 Min: 6.3 / Avg: 192.29 / Max: 280.23
CPU Peak Freq (Highest CPU Core Frequency) Monitor Phoronix Test Suite System Monitoring OpenBenchmarking.org Megahertz CPU Peak Freq (Highest CPU Core Frequency) Monitor Phoronix Test Suite System Monitoring AVX-512 Off AVX-512 On AVX-512 On 512 1000 2000 3000 4000 5000 Min: 3500 / Avg: 4781.84 / Max: 5621 Min: 3350 / Avg: 4733.96 / Max: 5541 Min: 2700 / Avg: 4722.22 / Max: 5323
Meta Performance Per Watts Performance Per Watts OpenBenchmarking.org Performance Per Watts, More Is Better Meta Performance Per Watts Performance Per Watts AVX-512 Off AVX-512 On AVX-512 On 512 40 80 120 160 200 133.30 170.75 170.21
GROMACS CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better GROMACS 2022.1 CPU Temperature Monitor AVX-512 Off AVX-512 On AVX-512 On 512 20 40 60 80 100 Min: 31 / Avg: 70.7 / Max: 87 Min: 32 / Avg: 70.87 / Max: 87 Min: 32 / Avg: 71.71 / Max: 89
GROMACS CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better GROMACS 2022.1 CPU Power Consumption Monitor AVX-512 Off AVX-512 On AVX-512 On 512 40 80 120 160 200 Min: 11.7 / Avg: 172.11 / Max: 186.28 Min: 11.96 / Avg: 170.87 / Max: 188.26 Min: 12.08 / Avg: 175.38 / Max: 240.72
GROMACS CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better GROMACS 2022.1 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 Off AVX-512 On AVX-512 On 512 900 1800 2700 3600 4500 Min: 4700 / Avg: 4781.57 / Max: 5267 Min: 4700 / Avg: 4784 / Max: 5300 Min: 4700 / Avg: 4778.77 / Max: 5300
GROMACS Implementation: MPI CPU - Input: water_GMX50_bare OpenBenchmarking.org Ns Per Day Per Watt, More Is Better GROMACS 2022.1 Implementation: MPI CPU - Input: water_GMX50_bare AVX-512 Off AVX-512 On AVX-512 On 512 0.0014 0.0028 0.0042 0.0056 0.007 0.006 0.006 0.006
Numpy Benchmark CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better Numpy Benchmark CPU Temperature Monitor AVX-512 Off AVX-512 On AVX-512 On 512 14 28 42 56 70 Min: 32 / Avg: 61.15 / Max: 70 Min: 34 / Avg: 62.31 / Max: 71 Min: 34 / Avg: 62.39 / Max: 71
Numpy Benchmark CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better Numpy Benchmark CPU Power Consumption Monitor AVX-512 Off AVX-512 On AVX-512 On 512 13 26 39 52 65 Min: 11.97 / Avg: 59.15 / Max: 65.44 Min: 11.83 / Avg: 61.82 / Max: 67.42 Min: 11.84 / Avg: 61.39 / Max: 67.45
Numpy Benchmark CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better Numpy Benchmark CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 Off AVX-512 On AVX-512 On 512 900 1800 2700 3600 4500 Min: 5086 / Avg: 5292.12 / Max: 5306 Min: 4905 / Avg: 5065.67 / Max: 5305 Min: 4910 / Avg: 5058.87 / Max: 5300
Numpy Benchmark OpenBenchmarking.org Score Per Watt, More Is Better Numpy Benchmark AVX-512 Off AVX-512 On AVX-512 On 512 3 6 9 12 15 9.735 10.211 10.293
ONNX Runtime CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better ONNX Runtime 1.11 CPU Temperature Monitor AVX-512 Off AVX-512 On AVX-512 On 512 20 40 60 80 100 Min: 39 / Avg: 74.86 / Max: 84 Min: 41 / Avg: 83.51 / Max: 95 Min: 40 / Avg: 83.1 / Max: 97
ONNX Runtime CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better ONNX Runtime 1.11 CPU Power Consumption Monitor AVX-512 Off AVX-512 On AVX-512 On 512 40 80 120 160 200 Min: 12.13 / Avg: 166.02 / Max: 178.1 Min: 12.31 / Avg: 197.92 / Max: 211.73 Min: 12.16 / Avg: 195.75 / Max: 212.83
ONNX Runtime CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better ONNX Runtime 1.11 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 Off AVX-512 On AVX-512 On 512 900 1800 2700 3600 4500 Min: 4700 / Avg: 4737.48 / Max: 5298 Min: 4700 / Avg: 4718.39 / Max: 5300 Min: 3850 / Avg: 4692.98 / Max: 5274
ONNX Runtime Model: ArcFace ResNet-100 - Device: CPU - Executor: Parallel OpenBenchmarking.org Inferences Per Minute Per Watt, More Is Better ONNX Runtime 1.11 Model: ArcFace ResNet-100 - Device: CPU - Executor: Parallel AVX-512 Off AVX-512 On AVX-512 On 512 2 4 6 8 10 7.698 7.013 6.988
ONNX Runtime CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better ONNX Runtime 1.11 CPU Temperature Monitor AVX-512 Off AVX-512 On AVX-512 On 512 20 40 60 80 100 Min: 38 / Avg: 80.76 / Max: 86 Min: 40 / Avg: 85.67 / Max: 96 Min: 40 / Avg: 86.37 / Max: 96
ONNX Runtime CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better ONNX Runtime 1.11 CPU Power Consumption Monitor AVX-512 Off AVX-512 On AVX-512 On 512 40 80 120 160 200 Min: 12.04 / Avg: 197.45 / Max: 208.91 Min: 12.25 / Avg: 215.19 / Max: 242.31 Min: 12.17 / Avg: 215.02 / Max: 242.14
ONNX Runtime CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better ONNX Runtime 1.11 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 Off AVX-512 On AVX-512 On 512 900 1800 2700 3600 4500 Min: 4700 / Avg: 4719.81 / Max: 5300 Min: 3500 / Avg: 4585.07 / Max: 5300 Min: 3587 / Avg: 4590.75 / Max: 5143
ONNX Runtime Model: ArcFace ResNet-100 - Device: CPU - Executor: Standard OpenBenchmarking.org Inferences Per Minute Per Watt, More Is Better ONNX Runtime 1.11 Model: ArcFace ResNet-100 - Device: CPU - Executor: Standard AVX-512 Off AVX-512 On AVX-512 On 512 3 6 9 12 15 9.881 10.451 10.464
ONNX Runtime CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better ONNX Runtime 1.11 CPU Temperature Monitor AVX-512 Off AVX-512 On AVX-512 On 512 14 28 42 56 70 Min: 38 / Avg: 64.71 / Max: 67 Min: 39 / Avg: 70.44 / Max: 74 Min: 40 / Avg: 70.87 / Max: 74
ONNX Runtime CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better ONNX Runtime 1.11 CPU Power Consumption Monitor AVX-512 Off AVX-512 On AVX-512 On 512 30 60 90 120 150 Min: 12.21 / Avg: 151.62 / Max: 159.76 Min: 12.13 / Avg: 174.33 / Max: 184.01 Min: 12.21 / Avg: 175.17 / Max: 183.77
ONNX Runtime CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better ONNX Runtime 1.11 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 Off AVX-512 On AVX-512 On 512 900 1800 2700 3600 4500 Min: 4800 / Avg: 4814.2 / Max: 5300 Min: 4700 / Avg: 4718.08 / Max: 5307 Min: 4700 / Avg: 4718.69 / Max: 5297
ONNX Runtime Model: GPT-2 - Device: CPU - Executor: Parallel OpenBenchmarking.org Inferences Per Minute Per Watt, More Is Better ONNX Runtime 1.11 Model: GPT-2 - Device: CPU - Executor: Parallel AVX-512 Off AVX-512 On AVX-512 On 512 8 16 24 32 40 36.65 31.82 31.65
ONNX Runtime CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better ONNX Runtime 1.11 CPU Temperature Monitor AVX-512 Off AVX-512 On AVX-512 On 512 14 28 42 56 70 Min: 39 / Avg: 63.86 / Max: 67 Min: 39 / Avg: 68.81 / Max: 71 Min: 40 / Avg: 68.89 / Max: 72
ONNX Runtime CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better ONNX Runtime 1.11 CPU Power Consumption Monitor AVX-512 Off AVX-512 On AVX-512 On 512 30 60 90 120 150 Min: 12.04 / Avg: 153.13 / Max: 160.84 Min: 12.13 / Avg: 174.92 / Max: 183.06 Min: 12.2 / Avg: 175.95 / Max: 184.82
ONNX Runtime CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better ONNX Runtime 1.11 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 Off AVX-512 On AVX-512 On 512 900 1800 2700 3600 4500 Min: 4800 / Avg: 4816.8 / Max: 5300 Min: 4700 / Avg: 4718.55 / Max: 5302 Min: 4700 / Avg: 4720.24 / Max: 5300
ONNX Runtime Model: GPT-2 - Device: CPU - Executor: Standard OpenBenchmarking.org Inferences Per Minute Per Watt, More Is Better ONNX Runtime 1.11 Model: GPT-2 - Device: CPU - Executor: Standard AVX-512 Off AVX-512 On AVX-512 On 512 10 20 30 40 50 45.41 39.75 39.57
ONNX Runtime CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better ONNX Runtime 1.11 CPU Temperature Monitor AVX-512 Off AVX-512 On AVX-512 On 512 20 40 60 80 100 Min: 40 / Avg: 71.61 / Max: 81 Min: 41 / Avg: 80.28 / Max: 91 Min: 41 / Avg: 79.02 / Max: 90
ONNX Runtime CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better ONNX Runtime 1.11 CPU Power Consumption Monitor AVX-512 Off AVX-512 On AVX-512 On 512 40 80 120 160 200 Min: 12.03 / Avg: 167.62 / Max: 180.22 Min: 12.39 / Avg: 199.65 / Max: 210.74 Min: 12.5 / Avg: 199.53 / Max: 210.58
ONNX Runtime CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better ONNX Runtime 1.11 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 Off AVX-512 On AVX-512 On 512 900 1800 2700 3600 4500 Min: 4700 / Avg: 4732.41 / Max: 5295 Min: 4700 / Avg: 4718.96 / Max: 5300 Min: 4700 / Avg: 4717.76 / Max: 5300
ONNX Runtime Model: bertsquad-12 - Device: CPU - Executor: Parallel OpenBenchmarking.org Inferences Per Minute Per Watt, More Is Better ONNX Runtime 1.11 Model: bertsquad-12 - Device: CPU - Executor: Parallel AVX-512 Off AVX-512 On AVX-512 On 512 0.6912 1.3824 2.0736 2.7648 3.456 3.072 2.600 2.626
ONNX Runtime CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better ONNX Runtime 1.11 CPU Temperature Monitor AVX-512 Off AVX-512 On AVX-512 On 512 20 40 60 80 100 Min: 40 / Avg: 83.73 / Max: 88 Min: 40 / Avg: 85.81 / Max: 95 Min: 40 / Avg: 87.16 / Max: 95
ONNX Runtime CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better ONNX Runtime 1.11 CPU Power Consumption Monitor AVX-512 Off AVX-512 On AVX-512 On 512 50 100 150 200 250 Min: 12.1 / Avg: 213.3 / Max: 224.83 Min: 12.28 / Avg: 221.92 / Max: 249.13 Min: 12.1 / Avg: 223.48 / Max: 250.46
ONNX Runtime CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better ONNX Runtime 1.11 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 Off AVX-512 On AVX-512 On 512 900 1800 2700 3600 4500 Min: 4700 / Avg: 4717.56 / Max: 5304 Min: 3500 / Avg: 4615.05 / Max: 5300 Min: 3561 / Avg: 4598.1 / Max: 5231
ONNX Runtime Model: bertsquad-12 - Device: CPU - Executor: Standard OpenBenchmarking.org Inferences Per Minute Per Watt, More Is Better ONNX Runtime 1.11 Model: bertsquad-12 - Device: CPU - Executor: Standard AVX-512 Off AVX-512 On AVX-512 On 512 1.0991 2.1982 3.2973 4.3964 5.4955 4.885 4.542 4.528
ONNX Runtime CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better ONNX Runtime 1.11 CPU Temperature Monitor AVX-512 Off AVX-512 On AVX-512 On 512 20 40 60 80 100 Min: 40 / Avg: 74.62 / Max: 83 Min: 41 / Avg: 83.35 / Max: 93 Min: 41 / Avg: 82.41 / Max: 93
ONNX Runtime CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better ONNX Runtime 1.11 CPU Power Consumption Monitor AVX-512 Off AVX-512 On AVX-512 On 512 40 80 120 160 200 Min: 12.12 / Avg: 171.44 / Max: 185.67 Min: 12.22 / Avg: 210.18 / Max: 224.25 Min: 12.41 / Avg: 205.81 / Max: 220.47
ONNX Runtime CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better ONNX Runtime 1.11 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 Off AVX-512 On AVX-512 On 512 900 1800 2700 3600 4500 Min: 4700 / Avg: 4718.23 / Max: 5295 Min: 3874 / Avg: 4710.34 / Max: 5302 Min: 4700 / Avg: 4715.24 / Max: 5300
ONNX Runtime Model: super-resolution-10 - Device: CPU - Executor: Parallel OpenBenchmarking.org Inferences Per Minute Per Watt, More Is Better ONNX Runtime 1.11 Model: super-resolution-10 - Device: CPU - Executor: Parallel AVX-512 Off AVX-512 On AVX-512 On 512 6 12 18 24 30 26.34 23.55 22.48
ONNX Runtime CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better ONNX Runtime 1.11 CPU Temperature Monitor AVX-512 Off AVX-512 On AVX-512 On 512 20 40 60 80 100 Min: 39 / Avg: 83.06 / Max: 88 Min: 39 / Avg: 87.18 / Max: 97 Min: 39 / Avg: 87.15 / Max: 95
ONNX Runtime CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better ONNX Runtime 1.11 CPU Power Consumption Monitor AVX-512 Off AVX-512 On AVX-512 On 512 50 100 150 200 250 Min: 12.22 / Avg: 219.18 / Max: 229.39 Min: 12.22 / Avg: 232.2 / Max: 259.58 Min: 12.18 / Avg: 229.09 / Max: 256.96
ONNX Runtime CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better ONNX Runtime 1.11 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 Off AVX-512 On AVX-512 On 512 900 1800 2700 3600 4500 Min: 4700 / Avg: 4716.1 / Max: 5305 Min: 3500 / Avg: 4629.79 / Max: 5300 Min: 3500 / Avg: 4653.64 / Max: 5308
ONNX Runtime Model: super-resolution-10 - Device: CPU - Executor: Standard OpenBenchmarking.org Inferences Per Minute Per Watt, More Is Better ONNX Runtime 1.11 Model: super-resolution-10 - Device: CPU - Executor: Standard AVX-512 Off AVX-512 On AVX-512 On 512 8 16 24 32 40 33.21 31.68 29.78
ONNX Runtime CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better ONNX Runtime 1.11 CPU Temperature Monitor AVX-512 Off AVX-512 On AVX-512 On 512 20 40 60 80 100 Min: 40 / Avg: 75.92 / Max: 88 Min: 40 / Avg: 81.63 / Max: 94 Min: 41 / Avg: 81.09 / Max: 94
ONNX Runtime CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better ONNX Runtime 1.11 CPU Power Consumption Monitor AVX-512 Off AVX-512 On AVX-512 On 512 40 80 120 160 200 Min: 12.19 / Avg: 175.09 / Max: 200.07 Min: 12.2 / Avg: 194.83 / Max: 220.39 Min: 12.33 / Avg: 195.17 / Max: 218.64
ONNX Runtime CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better ONNX Runtime 1.11 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 Off AVX-512 On AVX-512 On 512 900 1800 2700 3600 4500 Min: 4700 / Avg: 4741.29 / Max: 5300 Min: 4361 / Avg: 4716.76 / Max: 5300 Min: 4700 / Avg: 4718.48 / Max: 5203
ONNX Runtime Model: fcn-resnet101-11 - Device: CPU - Executor: Parallel OpenBenchmarking.org Inferences Per Minute Per Watt, More Is Better ONNX Runtime 1.11 Model: fcn-resnet101-11 - Device: CPU - Executor: Parallel AVX-512 Off AVX-512 On AVX-512 On 512 0.0925 0.185 0.2775 0.37 0.4625 0.411 0.375 0.374
ONNX Runtime CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better ONNX Runtime 1.11 CPU Temperature Monitor AVX-512 Off AVX-512 On AVX-512 On 512 20 40 60 80 100 Min: 39 / Avg: 81.74 / Max: 92 Min: 39 / Avg: 85.21 / Max: 98 Min: 39 / Avg: 85.21 / Max: 99
ONNX Runtime CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better ONNX Runtime 1.11 CPU Power Consumption Monitor AVX-512 Off AVX-512 On AVX-512 On 512 40 80 120 160 200 Min: 12.44 / Avg: 208.04 / Max: 219.8 Min: 12.29 / Avg: 216.9 / Max: 237.78 Min: 12.2 / Avg: 218.3 / Max: 237.54
ONNX Runtime CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better ONNX Runtime 1.11 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 Off AVX-512 On AVX-512 On 512 900 1800 2700 3600 4500 Min: 4700 / Avg: 4720.87 / Max: 5300 Min: 3500 / Avg: 4662.15 / Max: 5300 Min: 3564 / Avg: 4670.77 / Max: 5300
ONNX Runtime Model: fcn-resnet101-11 - Device: CPU - Executor: Standard OpenBenchmarking.org Inferences Per Minute Per Watt, More Is Better ONNX Runtime 1.11 Model: fcn-resnet101-11 - Device: CPU - Executor: Standard AVX-512 Off AVX-512 On AVX-512 On 512 0.1082 0.2164 0.3246 0.4328 0.541 0.481 0.470 0.472
ONNX Runtime CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better ONNX Runtime 1.11 CPU Temperature Monitor AVX-512 Off AVX-512 On AVX-512 On 512 20 40 60 80 100 Min: 40 / Avg: 69.43 / Max: 86 Min: 39 / Avg: 75.62 / Max: 94 Min: 42 / Avg: 74.76 / Max: 95
ONNX Runtime CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better ONNX Runtime 1.11 CPU Power Consumption Monitor AVX-512 Off AVX-512 On AVX-512 On 512 40 80 120 160 200 Min: 12.26 / Avg: 158.94 / Max: 171.99 Min: 12.18 / Avg: 182.51 / Max: 195.72 Min: 12.55 / Avg: 182.37 / Max: 194.6
ONNX Runtime CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better ONNX Runtime 1.11 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 Off AVX-512 On AVX-512 On 512 900 1800 2700 3600 4500 Min: 4700 / Avg: 4788.45 / Max: 5300 Min: 4700 / Avg: 4721.58 / Max: 5306 Min: 4700 / Avg: 4721.84 / Max: 5299
ONNX Runtime Model: yolov4 - Device: CPU - Executor: Parallel OpenBenchmarking.org Inferences Per Minute Per Watt, More Is Better ONNX Runtime 1.11 Model: yolov4 - Device: CPU - Executor: Parallel AVX-512 Off AVX-512 On AVX-512 On 512 0.446 0.892 1.338 1.784 2.23 1.982 1.748 1.749
ONNX Runtime CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better ONNX Runtime 1.11 CPU Temperature Monitor AVX-512 Off AVX-512 On AVX-512 On 512 20 40 60 80 100 Min: 40 / Avg: 74.38 / Max: 87 Min: 41 / Avg: 80.11 / Max: 94 Min: 41 / Avg: 79.4 / Max: 94
ONNX Runtime CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better ONNX Runtime 1.11 CPU Power Consumption Monitor AVX-512 Off AVX-512 On AVX-512 On 512 40 80 120 160 200 Min: 12.26 / Avg: 183.13 / Max: 192.75 Min: 12.3 / Avg: 202.2 / Max: 213.09 Min: 12.31 / Avg: 202.83 / Max: 212.6
ONNX Runtime CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better ONNX Runtime 1.11 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 Off AVX-512 On AVX-512 On 512 900 1800 2700 3600 4500 Min: 4700 / Avg: 4748.49 / Max: 5300 Min: 4700 / Avg: 4722.26 / Max: 5300 Min: 4700 / Avg: 4716.47 / Max: 5301
ONNX Runtime Model: yolov4 - Device: CPU - Executor: Standard OpenBenchmarking.org Inferences Per Minute Per Watt, More Is Better ONNX Runtime 1.11 Model: yolov4 - Device: CPU - Executor: Standard AVX-512 Off AVX-512 On AVX-512 On 512 0.6352 1.2704 1.9056 2.5408 3.176 2.823 2.616 2.598
OpenVINO CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better OpenVINO 2022.2.dev CPU Temperature Monitor AVX-512 Off AVX-512 On AVX-512 On 512 20 40 60 80 100 Min: 40 / Avg: 80.98 / Max: 89 Min: 40 / Avg: 84.75 / Max: 97 Min: 40 / Avg: 85.67 / Max: 95
OpenVINO CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better OpenVINO 2022.2.dev CPU Power Consumption Monitor AVX-512 Off AVX-512 On AVX-512 On 512 50 100 150 200 250 Min: 12.2 / Avg: 207.39 / Max: 228.54 Min: 12.32 / Avg: 220.48 / Max: 255.95 Min: 12.26 / Avg: 219.2 / Max: 255.83
OpenVINO CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better OpenVINO 2022.2.dev CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 Off AVX-512 On AVX-512 On 512 900 1800 2700 3600 4500 Min: 4700 / Avg: 4731.38 / Max: 5300 Min: 3422 / Avg: 4604.88 / Max: 5300 Min: 3403 / Avg: 4632.52 / Max: 5130
OpenVINO CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better OpenVINO 2022.2.dev CPU Temperature Monitor AVX-512 Off AVX-512 On AVX-512 On 512 20 40 60 80 100 Min: 44 / Avg: 76.67 / Max: 83 Min: 40 / Avg: 80.87 / Max: 89 Min: 40 / Avg: 81.03 / Max: 89
OpenVINO CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better OpenVINO 2022.2.dev CPU Power Consumption Monitor AVX-512 Off AVX-512 On AVX-512 On 512 40 80 120 160 200 Min: 12.72 / Avg: 193.11 / Max: 217.17 Min: 12.31 / Avg: 213.54 / Max: 244.32 Min: 12.28 / Avg: 214.43 / Max: 245.42
OpenVINO CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better OpenVINO 2022.2.dev CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 Off AVX-512 On AVX-512 On 512 900 1800 2700 3600 4500 Min: 4700 / Avg: 4735.41 / Max: 5311 Min: 4700 / Avg: 4733.54 / Max: 5300 Min: 4700 / Avg: 4730.67 / Max: 5300
OpenVINO CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better OpenVINO 2022.2.dev CPU Temperature Monitor AVX-512 Off AVX-512 On AVX-512 On 512 16 32 48 64 80 Min: 60 / Avg: 73.94 / Max: 80 Min: 41 / Avg: 76.53 / Max: 85 Min: 40 / Avg: 76.21 / Max: 84
OpenVINO CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better OpenVINO 2022.2.dev CPU Power Consumption Monitor AVX-512 Off AVX-512 On AVX-512 On 512 40 80 120 160 200 Min: 55.1 / Avg: 178.79 / Max: 191.55 Min: 12.26 / Avg: 198.22 / Max: 214.69 Min: 12.15 / Avg: 198.06 / Max: 213.93
OpenVINO CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better OpenVINO 2022.2.dev CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 Off AVX-512 On AVX-512 On 512 1000 2000 3000 4000 5000 Min: 4700 / Avg: 4746.45 / Max: 5621 Min: 4700 / Avg: 4730.05 / Max: 5300 Min: 4700 / Avg: 4729.11 / Max: 5314
OpenVINO CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better OpenVINO 2022.2.dev CPU Temperature Monitor AVX-512 Off AVX-512 On AVX-512 On 512 20 40 60 80 100 Min: 63 / Avg: 85.86 / Max: 93 Min: 41 / Avg: 87.16 / Max: 98 Min: 41 / Avg: 87.07 / Max: 99
OpenVINO CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better OpenVINO 2022.2.dev CPU Power Consumption Monitor AVX-512 Off AVX-512 On AVX-512 On 512 50 100 150 200 250 Min: 56.17 / Avg: 203.83 / Max: 229.49 Min: 12.3 / Avg: 212.55 / Max: 269.62 Min: 12.25 / Avg: 215.41 / Max: 266.45
OpenVINO CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better OpenVINO 2022.2.dev CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 Off AVX-512 On AVX-512 On 512 900 1800 2700 3600 4500 Min: 3648 / Avg: 4621.73 / Max: 5300 Min: 3451 / Avg: 4568.22 / Max: 5300 Min: 2700 / Avg: 4559.24 / Max: 5300
OpenVINO CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better OpenVINO 2022.2.dev CPU Temperature Monitor AVX-512 Off AVX-512 On AVX-512 On 512 20 40 60 80 100 Min: 61 / Avg: 86.8 / Max: 92 Min: 42 / Avg: 86.73 / Max: 97 Min: 40 / Avg: 87.33 / Max: 96
OpenVINO CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better OpenVINO 2022.2.dev CPU Power Consumption Monitor AVX-512 Off AVX-512 On AVX-512 On 512 50 100 150 200 250 Min: 55.78 / Avg: 216.3 / Max: 232.36 Min: 12.39 / Avg: 215.87 / Max: 266.83 Min: 12.36 / Avg: 217.96 / Max: 268.63
OpenVINO CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better OpenVINO 2022.2.dev CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 Off AVX-512 On AVX-512 On 512 900 1800 2700 3600 4500 Min: 4007 / Avg: 4734.73 / Max: 5300 Min: 3500 / Avg: 4571.82 / Max: 5303 Min: 3000 / Avg: 4570.85 / Max: 5186
OpenVINO CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better OpenVINO 2022.2.dev CPU Temperature Monitor AVX-512 Off AVX-512 On AVX-512 On 512 20 40 60 80 100 Min: 60 / Avg: 87.45 / Max: 94 Min: 41 / Avg: 86.74 / Max: 97 Min: 41 / Avg: 87 / Max: 97
OpenVINO CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better OpenVINO 2022.2.dev CPU Power Consumption Monitor AVX-512 Off AVX-512 On AVX-512 On 512 50 100 150 200 250 Min: 55.18 / Avg: 209.8 / Max: 238.87 Min: 12.59 / Avg: 216.16 / Max: 260.53 Min: 12.19 / Avg: 217.71 / Max: 260.02
OpenVINO CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better OpenVINO 2022.2.dev CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 Off AVX-512 On AVX-512 On 512 900 1800 2700 3600 4500 Min: 3600 / Avg: 4614.52 / Max: 5300 Min: 3500 / Avg: 4589.65 / Max: 5300 Min: 3500 / Avg: 4603.65 / Max: 5199
OpenVINO CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better OpenVINO 2022.2.dev CPU Temperature Monitor AVX-512 Off AVX-512 On AVX-512 On 512 20 40 60 80 100 Min: 59 / Avg: 84.96 / Max: 95 Min: 40 / Avg: 86.02 / Max: 100 Min: 41 / Avg: 86.88 / Max: 100
OpenVINO CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better OpenVINO 2022.2.dev CPU Power Consumption Monitor AVX-512 Off AVX-512 On AVX-512 On 512 50 100 150 200 250 Min: 54.81 / Avg: 199.09 / Max: 231.05 Min: 12.17 / Avg: 206.04 / Max: 269.05 Min: 12.33 / Avg: 207.04 / Max: 270.73
OpenVINO CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better OpenVINO 2022.2.dev CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 Off AVX-512 On AVX-512 On 512 900 1800 2700 3600 4500 Min: 4700 / Avg: 4766.42 / Max: 5300 Min: 3400 / Avg: 4531.88 / Max: 5300 Min: 3400 / Avg: 4584.47 / Max: 5300
OpenVINO CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better OpenVINO 2022.2.dev CPU Temperature Monitor AVX-512 Off AVX-512 On AVX-512 On 512 20 40 60 80 100 Min: 61 / Avg: 84.05 / Max: 95 Min: 40 / Avg: 86.76 / Max: 97 Min: 41 / Avg: 87.35 / Max: 100
OpenVINO CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better OpenVINO 2022.2.dev CPU Power Consumption Monitor AVX-512 Off AVX-512 On AVX-512 On 512 50 100 150 200 250 Min: 55.69 / Avg: 197.83 / Max: 225.46 Min: 12.5 / Avg: 211.57 / Max: 263.35 Min: 12.41 / Avg: 211.56 / Max: 263.47
OpenVINO CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better OpenVINO 2022.2.dev CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 Off AVX-512 On AVX-512 On 512 900 1800 2700 3600 4500 Min: 4700 / Avg: 4762.25 / Max: 5300 Min: 3434 / Avg: 4623.02 / Max: 5300 Min: 3439 / Avg: 4662.38 / Max: 5300
OpenVINO CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better OpenVINO 2022.2.dev CPU Temperature Monitor AVX-512 Off AVX-512 On AVX-512 On 512 20 40 60 80 100 Min: 61 / Avg: 85.95 / Max: 90 Min: 40 / Avg: 87.04 / Max: 95 Min: 41 / Avg: 86.73 / Max: 95
OpenVINO CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better OpenVINO 2022.2.dev CPU Power Consumption Monitor AVX-512 Off AVX-512 On AVX-512 On 512 50 100 150 200 250 Min: 55.78 / Avg: 221.82 / Max: 236.18 Min: 12.32 / Avg: 232.01 / Max: 274.61 Min: 12.41 / Avg: 231.67 / Max: 274.84
OpenVINO CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better OpenVINO 2022.2.dev CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 Off AVX-512 On AVX-512 On 512 900 1800 2700 3600 4500 Min: 4700 / Avg: 4738.5 / Max: 5300 Min: 3400 / Avg: 4624.71 / Max: 5302 Min: 3408 / Avg: 4610.19 / Max: 5310
OpenVINO CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better OpenVINO 2022.2.dev CPU Temperature Monitor AVX-512 Off AVX-512 On AVX-512 On 512 20 40 60 80 100 Min: 60 / Avg: 83.29 / Max: 89 Min: 39 / Avg: 87.24 / Max: 97 Min: 38 / Avg: 85.65 / Max: 96
OpenVINO CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better OpenVINO 2022.2.dev CPU Power Consumption Monitor AVX-512 Off AVX-512 On AVX-512 On 512 50 100 150 200 250 Min: 54.99 / Avg: 220.55 / Max: 236.23 Min: 12.26 / Avg: 225.84 / Max: 268.92 Min: 12.23 / Avg: 227.4 / Max: 268.33
OpenVINO CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better OpenVINO 2022.2.dev CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 Off AVX-512 On AVX-512 On 512 900 1800 2700 3600 4500 Min: 4700 / Avg: 4741.63 / Max: 5304 Min: 3467 / Avg: 4665.94 / Max: 5302 Min: 3400 / Avg: 4621.94 / Max: 5300
OpenVINO CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better OpenVINO 2022.2.dev CPU Temperature Monitor AVX-512 Off AVX-512 On AVX-512 On 512 20 40 60 80 100 Min: 60 / Avg: 84.66 / Max: 94 Min: 40 / Avg: 85.93 / Max: 98 Min: 40 / Avg: 82.79 / Max: 99
OpenVINO CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better OpenVINO 2022.2.dev CPU Power Consumption Monitor AVX-512 Off AVX-512 On AVX-512 On 512 50 100 150 200 250 Min: 55.05 / Avg: 200.47 / Max: 228.29 Min: 12.09 / Avg: 210.05 / Max: 263.04 Min: 12.29 / Avg: 198.43 / Max: 264.85
OpenVINO CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better OpenVINO 2022.2.dev CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 Off AVX-512 On AVX-512 On 512 900 1800 2700 3600 4500 Min: 3600 / Avg: 4630.48 / Max: 5300 Min: 3486 / Avg: 4562.25 / Max: 5300 Min: 3417 / Avg: 4571.49 / Max: 5308
OpenVINO CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better OpenVINO 2022.2.dev CPU Temperature Monitor AVX-512 Off AVX-512 On AVX-512 On 512 20 40 60 80 100 Min: 61 / Avg: 84.02 / Max: 93 Min: 35 / Avg: 84.78 / Max: 98 Min: 39 / Avg: 86.41 / Max: 99
OpenVINO CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better OpenVINO 2022.2.dev CPU Power Consumption Monitor AVX-512 Off AVX-512 On AVX-512 On 512 50 100 150 200 250 Min: 54.89 / Avg: 202.96 / Max: 226.01 Min: 11.88 / Avg: 218.42 / Max: 263.98 Min: 12.17 / Avg: 216.31 / Max: 263.21
OpenVINO CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better OpenVINO 2022.2.dev CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 Off AVX-512 On AVX-512 On 512 900 1800 2700 3600 4500 Min: 3689 / Avg: 4731.52 / Max: 5300 Min: 3429 / Avg: 4599.8 / Max: 5310 Min: 3424 / Avg: 4605.82 / Max: 5143
TensorFlow CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better TensorFlow 2.10 CPU Temperature Monitor AVX-512 Off AVX-512 On AVX-512 On 512 20 40 60 80 100 Min: 57 / Avg: 74.26 / Max: 89 Min: 39 / Avg: 81.43 / Max: 100 Min: 39 / Avg: 81.85 / Max: 100
TensorFlow CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better TensorFlow 2.10 CPU Power Consumption Monitor AVX-512 Off AVX-512 On AVX-512 On 512 40 80 120 160 200 Min: 54.66 / Avg: 180.33 / Max: 219.82 Min: 12.18 / Avg: 198.72 / Max: 231.12 Min: 12.21 / Avg: 199.88 / Max: 233.13
TensorFlow CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better TensorFlow 2.10 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 Off AVX-512 On AVX-512 On 512 900 1800 2700 3600 4500 Min: 4700 / Avg: 4746.31 / Max: 5300 Min: 3424 / Avg: 4724.5 / Max: 5302 Min: 3400 / Avg: 4717.76 / Max: 5300
TensorFlow Device: CPU - Batch Size: 512 - Model: GoogLeNet OpenBenchmarking.org images/sec Per Watt, More Is Better TensorFlow 2.10 Device: CPU - Batch Size: 512 - Model: GoogLeNet AVX-512 Off AVX-512 On AVX-512 On 512 0.0767 0.1534 0.2301 0.3068 0.3835 0.188 0.341 0.339
TensorFlow CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better TensorFlow 2.10 CPU Temperature Monitor AVX-512 Off AVX-512 On AVX-512 On 512 20 40 60 80 100 Min: 54 / Avg: 74.43 / Max: 88 Min: 35 / Avg: 76.2 / Max: 95 Min: 35 / Avg: 76.02 / Max: 93
TensorFlow CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better TensorFlow 2.10 CPU Power Consumption Monitor AVX-512 Off AVX-512 On AVX-512 On 512 40 80 120 160 200 Min: 52.34 / Avg: 181.46 / Max: 234.98 Min: 12.17 / Avg: 188.69 / Max: 244.78 Min: 12.1 / Avg: 187.51 / Max: 247.19
TensorFlow CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better TensorFlow 2.10 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 Off AVX-512 On AVX-512 On 512 900 1800 2700 3600 4500 Min: 4700 / Avg: 4739.57 / Max: 5300 Min: 4700 / Avg: 4744.85 / Max: 5300 Min: 4700 / Avg: 4746.52 / Max: 5300
TensorFlow Device: CPU - Batch Size: 512 - Model: AlexNet OpenBenchmarking.org images/sec Per Watt, More Is Better TensorFlow 2.10 Device: CPU - Batch Size: 512 - Model: AlexNet AVX-512 Off AVX-512 On AVX-512 On 512 0.207 0.414 0.621 0.828 1.035 0.594 0.920 0.920
TensorFlow CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better TensorFlow 2.10 CPU Temperature Monitor AVX-512 Off AVX-512 On AVX-512 On 512 20 40 60 80 100 Min: 39 / Avg: 73.72 / Max: 88 Min: 39 / Avg: 81.3 / Max: 99 Min: 39 / Avg: 80.86 / Max: 100
TensorFlow CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better TensorFlow 2.10 CPU Power Consumption Monitor AVX-512 Off AVX-512 On AVX-512 On 512 40 80 120 160 200 Min: 12.37 / Avg: 181.53 / Max: 217.34 Min: 12.45 / Avg: 196.85 / Max: 222.31 Min: 12.19 / Avg: 196.37 / Max: 222.3
TensorFlow CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better TensorFlow 2.10 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 Off AVX-512 On AVX-512 On 512 900 1800 2700 3600 4500 Min: 4700 / Avg: 4745.56 / Max: 5300 Min: 3404 / Avg: 4735.04 / Max: 5312 Min: 3500 / Avg: 4736.16 / Max: 5300
TensorFlow Device: CPU - Batch Size: 256 - Model: GoogLeNet OpenBenchmarking.org images/sec Per Watt, More Is Better TensorFlow 2.10 Device: CPU - Batch Size: 256 - Model: GoogLeNet AVX-512 Off AVX-512 On AVX-512 On 512 0.0763 0.1526 0.2289 0.3052 0.3815 0.206 0.338 0.339
TensorFlow CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better TensorFlow 2.10 CPU Temperature Monitor AVX-512 Off AVX-512 On AVX-512 On 512 20 40 60 80 100 Min: 38 / Avg: 73.1 / Max: 85 Min: 39 / Avg: 75.22 / Max: 88 Min: 39 / Avg: 75.03 / Max: 94
TensorFlow CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better TensorFlow 2.10 CPU Power Consumption Monitor AVX-512 Off AVX-512 On AVX-512 On 512 40 80 120 160 200 Min: 12.56 / Avg: 179.61 / Max: 210.75 Min: 12.49 / Avg: 180.37 / Max: 231.09 Min: 12.27 / Avg: 179.14 / Max: 227.47
TensorFlow CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better TensorFlow 2.10 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 Off AVX-512 On AVX-512 On 512 900 1800 2700 3600 4500 Min: 4700 / Avg: 4741.91 / Max: 5300 Min: 4700 / Avg: 4754.47 / Max: 5300 Min: 4700 / Avg: 4756.54 / Max: 5300
TensorFlow Device: CPU - Batch Size: 256 - Model: AlexNet OpenBenchmarking.org images/sec Per Watt, More Is Better TensorFlow 2.10 Device: CPU - Batch Size: 256 - Model: AlexNet AVX-512 Off AVX-512 On AVX-512 On 512 0.2048 0.4096 0.6144 0.8192 1.024 0.654 0.909 0.910
TensorFlow CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better TensorFlow 2.10 CPU Temperature Monitor AVX-512 Off AVX-512 On AVX-512 On 512 20 40 60 80 100 Min: 39 / Avg: 71.84 / Max: 89 Min: 39 / Avg: 80.23 / Max: 100 Min: 41 / Avg: 80.63 / Max: 100
TensorFlow CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better TensorFlow 2.10 CPU Power Consumption Monitor AVX-512 Off AVX-512 On AVX-512 On 512 40 80 120 160 200 Min: 12.55 / Avg: 176.58 / Max: 210.64 Min: 6.72 / Avg: 192.97 / Max: 247.42 Min: 12.31 / Avg: 191.97 / Max: 247.16
TensorFlow CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better TensorFlow 2.10 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 Off AVX-512 On AVX-512 On 512 900 1800 2700 3600 4500 Min: 4700 / Avg: 4768.97 / Max: 5300 Min: 3350 / Avg: 4727.85 / Max: 5303 Min: 3337 / Avg: 4721.84 / Max: 5300
TensorFlow Device: CPU - Batch Size: 256 - Model: ResNet-50 OpenBenchmarking.org images/sec Per Watt, More Is Better TensorFlow 2.10 Device: CPU - Batch Size: 256 - Model: ResNet-50 AVX-512 Off AVX-512 On AVX-512 On 512 0.0259 0.0518 0.0777 0.1036 0.1295 0.071 0.115 0.115
TensorFlow CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better TensorFlow 2.10 CPU Temperature Monitor AVX-512 Off AVX-512 On AVX-512 On 512 20 40 60 80 100 Min: 39 / Avg: 78.01 / Max: 93 Min: 39 / Avg: 87.38 / Max: 100 Min: 39 / Avg: 87.55 / Max: 100
TensorFlow CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better TensorFlow 2.10 CPU Power Consumption Monitor AVX-512 Off AVX-512 On AVX-512 On 512 50 100 150 200 250 Min: 12.64 / Avg: 193.81 / Max: 251.93 Min: 12.64 / Avg: 218.14 / Max: 271.2 Min: 12.13 / Avg: 217.21 / Max: 270.46
TensorFlow CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better TensorFlow 2.10 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 Off AVX-512 On AVX-512 On 512 900 1800 2700 3600 4500 Min: 3500 / Avg: 4740.8 / Max: 5300 Min: 3412 / Avg: 4593.29 / Max: 5302 Min: 3406 / Avg: 4587.01 / Max: 5298
TensorFlow Device: CPU - Batch Size: 256 - Model: VGG-16 OpenBenchmarking.org images/sec Per Watt, More Is Better TensorFlow 2.10 Device: CPU - Batch Size: 256 - Model: VGG-16 AVX-512 Off AVX-512 On AVX-512 On 512 0.0097 0.0194 0.0291 0.0388 0.0485 0.032 0.043 0.043
TensorFlow CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better TensorFlow 2.10 CPU Temperature Monitor AVX-512 Off AVX-512 On AVX-512 On 512 20 40 60 80 100 Min: 39 / Avg: 72.62 / Max: 84 Min: 39 / Avg: 77.98 / Max: 96 Min: 38 / Avg: 78.31 / Max: 98
TensorFlow CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better TensorFlow 2.10 CPU Power Consumption Monitor AVX-512 Off AVX-512 On AVX-512 On 512 40 80 120 160 200 Min: 12.27 / Avg: 176.8 / Max: 195.47 Min: 12.63 / Avg: 187.75 / Max: 210.7 Min: 12.16 / Avg: 187.24 / Max: 205.18
TensorFlow CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better TensorFlow 2.10 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 Off AVX-512 On AVX-512 On 512 900 1800 2700 3600 4500 Min: 4700 / Avg: 4747.96 / Max: 5300 Min: 4664 / Avg: 4758.71 / Max: 5300 Min: 3529 / Avg: 4743.6 / Max: 5300
TensorFlow Device: CPU - Batch Size: 64 - Model: GoogLeNet OpenBenchmarking.org images/sec Per Watt, More Is Better TensorFlow 2.10 Device: CPU - Batch Size: 64 - Model: GoogLeNet AVX-512 Off AVX-512 On AVX-512 On 512 0.0783 0.1566 0.2349 0.3132 0.3915 0.209 0.346 0.348
TensorFlow CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better TensorFlow 2.10 CPU Temperature Monitor AVX-512 Off AVX-512 On AVX-512 On 512 16 32 48 64 80 Min: 39 / Avg: 69.97 / Max: 77 Min: 39 / Avg: 69.23 / Max: 83 Min: 39 / Avg: 69.91 / Max: 82
TensorFlow CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better TensorFlow 2.10 CPU Power Consumption Monitor AVX-512 Off AVX-512 On AVX-512 On 512 40 80 120 160 200 Min: 6.36 / Avg: 168.19 / Max: 198.49 Min: 12.19 / Avg: 164.43 / Max: 192.71 Min: 12.2 / Avg: 160.45 / Max: 196.55
TensorFlow CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better TensorFlow 2.10 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 Off AVX-512 On AVX-512 On 512 900 1800 2700 3600 4500 Min: 4700 / Avg: 4773.18 / Max: 5303 Min: 4700 / Avg: 4791.45 / Max: 5300 Min: 4700 / Avg: 4801.05 / Max: 5300
TensorFlow Device: CPU - Batch Size: 64 - Model: AlexNet OpenBenchmarking.org images/sec Per Watt, More Is Better TensorFlow 2.10 Device: CPU - Batch Size: 64 - Model: AlexNet AVX-512 Off AVX-512 On AVX-512 On 512 0.1933 0.3866 0.5799 0.7732 0.9665 0.614 0.833 0.859
TensorFlow CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better TensorFlow 2.10 CPU Temperature Monitor AVX-512 Off AVX-512 On AVX-512 On 512 20 40 60 80 100 Min: 39 / Avg: 71.4 / Max: 84 Min: 39 / Avg: 79.12 / Max: 100 Min: 41 / Avg: 79.73 / Max: 100
TensorFlow CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better TensorFlow 2.10 CPU Power Consumption Monitor AVX-512 Off AVX-512 On AVX-512 On 512 40 80 120 160 200 Min: 12.62 / Avg: 174.55 / Max: 197.59 Min: 12.4 / Avg: 189.43 / Max: 229.65 Min: 12.14 / Avg: 189.26 / Max: 231.43
TensorFlow CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better TensorFlow 2.10 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 Off AVX-512 On AVX-512 On 512 900 1800 2700 3600 4500 Min: 4700 / Avg: 4765.23 / Max: 5300 Min: 3549 / Avg: 4765.25 / Max: 5310 Min: 3424 / Avg: 4756.76 / Max: 5300
TensorFlow Device: CPU - Batch Size: 64 - Model: ResNet-50 OpenBenchmarking.org images/sec Per Watt, More Is Better TensorFlow 2.10 Device: CPU - Batch Size: 64 - Model: ResNet-50 AVX-512 Off AVX-512 On AVX-512 On 512 0.0261 0.0522 0.0783 0.1044 0.1305 0.071 0.115 0.116
TensorFlow CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better TensorFlow 2.10 CPU Temperature Monitor AVX-512 Off AVX-512 On AVX-512 On 512 20 40 60 80 100 Min: 39 / Avg: 73.93 / Max: 88 Min: 38 / Avg: 86.57 / Max: 100 Min: 40 / Avg: 87.14 / Max: 100
TensorFlow CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better TensorFlow 2.10 CPU Power Consumption Monitor AVX-512 Off AVX-512 On AVX-512 On 512 50 100 150 200 250 Min: 12.51 / Avg: 175.98 / Max: 245.02 Min: 12.6 / Avg: 210.35 / Max: 256.26 Min: 12.02 / Avg: 208.44 / Max: 258.78
TensorFlow CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better TensorFlow 2.10 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 Off AVX-512 On AVX-512 On 512 900 1800 2700 3600 4500 Min: 4700 / Avg: 4743.38 / Max: 5300 Min: 3431 / Avg: 4653.57 / Max: 5300 Min: 3448 / Avg: 4638.56 / Max: 5309
TensorFlow Device: CPU - Batch Size: 64 - Model: VGG-16 OpenBenchmarking.org images/sec Per Watt, More Is Better TensorFlow 2.10 Device: CPU - Batch Size: 64 - Model: VGG-16 AVX-512 Off AVX-512 On AVX-512 On 512 0.0095 0.019 0.0285 0.038 0.0475 0.035 0.042 0.042
TensorFlow CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better TensorFlow 2.10 CPU Temperature Monitor AVX-512 Off AVX-512 On AVX-512 On 512 20 40 60 80 100 Min: 38 / Avg: 70.7 / Max: 82 Min: 38 / Avg: 76.66 / Max: 93 Min: 39 / Avg: 76.91 / Max: 95
TensorFlow CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better TensorFlow 2.10 CPU Power Consumption Monitor AVX-512 Off AVX-512 On AVX-512 On 512 40 80 120 160 200 Min: 12.6 / Avg: 172.16 / Max: 189.69 Min: 12.39 / Avg: 179.76 / Max: 202.8 Min: 6.52 / Avg: 180.79 / Max: 201.41
TensorFlow CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better TensorFlow 2.10 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 Off AVX-512 On AVX-512 On 512 900 1800 2700 3600 4500 Min: 4700 / Avg: 4768.78 / Max: 5300 Min: 4700 / Avg: 4784.96 / Max: 5300 Min: 4700 / Avg: 4768.38 / Max: 5300
TensorFlow Device: CPU - Batch Size: 32 - Model: GoogLeNet OpenBenchmarking.org images/sec Per Watt, More Is Better TensorFlow 2.10 Device: CPU - Batch Size: 32 - Model: GoogLeNet AVX-512 Off AVX-512 On AVX-512 On 512 0.0803 0.1606 0.2409 0.3212 0.4015 0.212 0.357 0.356
TensorFlow CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better TensorFlow 2.10 CPU Temperature Monitor AVX-512 Off AVX-512 On AVX-512 On 512 15 30 45 60 75 Min: 39 / Avg: 65.93 / Max: 74 Min: 39 / Avg: 64.95 / Max: 75 Min: 39 / Avg: 66.99 / Max: 77
TensorFlow CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better TensorFlow 2.10 CPU Power Consumption Monitor AVX-512 Off AVX-512 On AVX-512 On 512 30 60 90 120 150 Min: 12.42 / Avg: 159.17 / Max: 185.93 Min: 12.33 / Avg: 153.27 / Max: 183.98 Min: 12.25 / Avg: 153.32 / Max: 183.15
TensorFlow CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better TensorFlow 2.10 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 Off AVX-512 On AVX-512 On 512 900 1800 2700 3600 4500 Min: 4700 / Avg: 4812.15 / Max: 5300 Min: 4700 / Avg: 4809.19 / Max: 5302 Min: 4700 / Avg: 4812.35 / Max: 5300
TensorFlow Device: CPU - Batch Size: 32 - Model: AlexNet OpenBenchmarking.org images/sec Per Watt, More Is Better TensorFlow 2.10 Device: CPU - Batch Size: 32 - Model: AlexNet AVX-512 Off AVX-512 On AVX-512 On 512 0.1663 0.3326 0.4989 0.6652 0.8315 0.552 0.731 0.739
TensorFlow CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better TensorFlow 2.10 CPU Temperature Monitor AVX-512 Off AVX-512 On AVX-512 On 512 20 40 60 80 100 Min: 39 / Avg: 70.59 / Max: 82 Min: 39 / Avg: 77.48 / Max: 95 Min: 40 / Avg: 79.09 / Max: 100
TensorFlow CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better TensorFlow 2.10 CPU Power Consumption Monitor AVX-512 Off AVX-512 On AVX-512 On 512 40 80 120 160 200 Min: 12.39 / Avg: 172.96 / Max: 195.6 Min: 12.27 / Avg: 184.03 / Max: 209.54 Min: 12.15 / Avg: 184.01 / Max: 210.17
TensorFlow CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better TensorFlow 2.10 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 Off AVX-512 On AVX-512 On 512 900 1800 2700 3600 4500 Min: 4671 / Avg: 4771.11 / Max: 5300 Min: 4700 / Avg: 4773.71 / Max: 5300 Min: 4700 / Avg: 4782.96 / Max: 5300
TensorFlow Device: CPU - Batch Size: 32 - Model: ResNet-50 OpenBenchmarking.org images/sec Per Watt, More Is Better TensorFlow 2.10 Device: CPU - Batch Size: 32 - Model: ResNet-50 AVX-512 Off AVX-512 On AVX-512 On 512 0.0261 0.0522 0.0783 0.1044 0.1305 0.071 0.115 0.116
TensorFlow CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better TensorFlow 2.10 CPU Temperature Monitor AVX-512 Off AVX-512 On AVX-512 On 512 20 40 60 80 100 Min: 39 / Avg: 73.18 / Max: 82 Min: 39 / Avg: 85.46 / Max: 100 Min: 40 / Avg: 85.99 / Max: 100
TensorFlow CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better TensorFlow 2.10 CPU Power Consumption Monitor AVX-512 Off AVX-512 On AVX-512 On 512 50 100 150 200 250 Min: 12.49 / Avg: 174.26 / Max: 233.2 Min: 12.4 / Avg: 203.74 / Max: 255.04 Min: 12.29 / Avg: 202.82 / Max: 256.86
TensorFlow CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better TensorFlow 2.10 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 Off AVX-512 On AVX-512 On 512 900 1800 2700 3600 4500 Min: 4700 / Avg: 4747.94 / Max: 5300 Min: 3450 / Avg: 4685.15 / Max: 5302 Min: 3437 / Avg: 4669.85 / Max: 5300
TensorFlow Device: CPU - Batch Size: 32 - Model: VGG-16 OpenBenchmarking.org images/sec Per Watt, More Is Better TensorFlow 2.10 Device: CPU - Batch Size: 32 - Model: VGG-16 AVX-512 Off AVX-512 On AVX-512 On 512 0.0092 0.0184 0.0276 0.0368 0.046 0.034 0.041 0.041
TensorFlow CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better TensorFlow 2.10 CPU Temperature Monitor AVX-512 Off AVX-512 On AVX-512 On 512 20 40 60 80 100 Min: 38 / Avg: 69.01 / Max: 78 Min: 38 / Avg: 72.19 / Max: 93 Min: 39 / Avg: 72.15 / Max: 91
TensorFlow CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better TensorFlow 2.10 CPU Power Consumption Monitor AVX-512 Off AVX-512 On AVX-512 On 512 40 80 120 160 200 Min: 12.53 / Avg: 165.22 / Max: 190.81 Min: 12.27 / Avg: 167.07 / Max: 202.74 Min: 12.24 / Avg: 168.34 / Max: 205.66
TensorFlow CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better TensorFlow 2.10 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 Off AVX-512 On AVX-512 On 512 900 1800 2700 3600 4500 Min: 4700 / Avg: 4793.76 / Max: 5300 Min: 4700 / Avg: 4808.91 / Max: 5300 Min: 4700 / Avg: 4798.4 / Max: 5298
TensorFlow Device: CPU - Batch Size: 16 - Model: GoogLeNet OpenBenchmarking.org images/sec Per Watt, More Is Better TensorFlow 2.10 Device: CPU - Batch Size: 16 - Model: GoogLeNet AVX-512 Off AVX-512 On AVX-512 On 512 0.0853 0.1706 0.2559 0.3412 0.4265 0.219 0.379 0.379
TensorFlow CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better TensorFlow 2.10 CPU Temperature Monitor AVX-512 Off AVX-512 On AVX-512 On 512 14 28 42 56 70 Min: 39 / Avg: 64.1 / Max: 73 Min: 40 / Avg: 61.85 / Max: 71 Min: 39 / Avg: 62.73 / Max: 74
TensorFlow CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better TensorFlow 2.10 CPU Power Consumption Monitor AVX-512 Off AVX-512 On AVX-512 On 512 30 60 90 120 150 Min: 6.49 / Avg: 147.48 / Max: 178.42 Min: 12.38 / Avg: 141.92 / Max: 176.87 Min: 12.22 / Avg: 142.65 / Max: 174.16
TensorFlow CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better TensorFlow 2.10 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 Off AVX-512 On AVX-512 On 512 900 1800 2700 3600 4500 Min: 4700 / Avg: 4844.17 / Max: 5301 Min: 4700 / Avg: 4830.58 / Max: 5302 Min: 4700 / Avg: 4841.61 / Max: 5300
TensorFlow Device: CPU - Batch Size: 16 - Model: AlexNet OpenBenchmarking.org images/sec Per Watt, More Is Better TensorFlow 2.10 Device: CPU - Batch Size: 16 - Model: AlexNet AVX-512 Off AVX-512 On AVX-512 On 512 0.1296 0.2592 0.3888 0.5184 0.648 0.460 0.569 0.576
TensorFlow CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better TensorFlow 2.10 CPU Temperature Monitor AVX-512 Off AVX-512 On AVX-512 On 512 20 40 60 80 100 Min: 38 / Avg: 69.7 / Max: 81 Min: 39 / Avg: 75.6 / Max: 92 Min: 39 / Avg: 75.99 / Max: 90
TensorFlow CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better TensorFlow 2.10 CPU Power Consumption Monitor AVX-512 Off AVX-512 On AVX-512 On 512 40 80 120 160 200 Min: 12.59 / Avg: 170.59 / Max: 185.9 Min: 12.57 / Avg: 178.26 / Max: 201.79 Min: 12.23 / Avg: 178.47 / Max: 201.45
TensorFlow CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better TensorFlow 2.10 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 Off AVX-512 On AVX-512 On 512 900 1800 2700 3600 4500 Min: 4700 / Avg: 4779.37 / Max: 5300 Min: 4700 / Avg: 4775.16 / Max: 5300 Min: 4700 / Avg: 4778.43 / Max: 5300
TensorFlow Device: CPU - Batch Size: 16 - Model: ResNet-50 OpenBenchmarking.org images/sec Per Watt, More Is Better TensorFlow 2.10 Device: CPU - Batch Size: 16 - Model: ResNet-50 AVX-512 Off AVX-512 On AVX-512 On 512 0.0259 0.0518 0.0777 0.1036 0.1295 0.072 0.115 0.115
TensorFlow CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better TensorFlow 2.10 CPU Temperature Monitor AVX-512 Off AVX-512 On AVX-512 On 512 20 40 60 80 100 Min: 30 / Avg: 71.96 / Max: 82 Min: 30 / Avg: 81.98 / Max: 100 Min: 31 / Avg: 82.6 / Max: 100
TensorFlow CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better TensorFlow 2.10 CPU Power Consumption Monitor AVX-512 Off AVX-512 On AVX-512 On 512 40 80 120 160 200 Min: 11.86 / Avg: 171.94 / Max: 209.38 Min: 11.91 / Avg: 198.07 / Max: 245.72 Min: 11.63 / Avg: 196.47 / Max: 246.65
TensorFlow CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better TensorFlow 2.10 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 Off AVX-512 On AVX-512 On 512 900 1800 2700 3600 4500 Min: 4700 / Avg: 4753.54 / Max: 5300 Min: 3436 / Avg: 4719.33 / Max: 5300 Min: 3441 / Avg: 4723.13 / Max: 5300
TensorFlow Device: CPU - Batch Size: 16 - Model: VGG-16 OpenBenchmarking.org images/sec Per Watt, More Is Better TensorFlow 2.10 Device: CPU - Batch Size: 16 - Model: VGG-16 AVX-512 Off AVX-512 On AVX-512 On 512 0.0088 0.0176 0.0264 0.0352 0.044 0.033 0.039 0.039
TNN CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better TNN 0.3 CPU Temperature Monitor AVX-512 Off AVX-512 On AVX-512 On 512 13 26 39 52 65 Min: 30 / Avg: 44.53 / Max: 64 Min: 30 / Avg: 45.12 / Max: 64 Min: 32 / Avg: 46.23 / Max: 65
TNN CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better TNN 0.3 CPU Power Consumption Monitor AVX-512 Off AVX-512 On AVX-512 On 512 12 24 36 48 60 Min: 11.84 / Avg: 31.17 / Max: 57.74 Min: 11.88 / Avg: 32.54 / Max: 58.56 Min: 11.71 / Avg: 32.45 / Max: 58.4
TNN CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better TNN 0.3 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 Off AVX-512 On AVX-512 On 512 900 1800 2700 3600 4500 Min: 5100 / Avg: 5198.88 / Max: 5304 Min: 5099 / Avg: 5219.48 / Max: 5310 Min: 5100 / Avg: 5205.02 / Max: 5305
TNN CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better TNN 0.3 CPU Temperature Monitor AVX-512 Off AVX-512 On AVX-512 On 512 12 24 36 48 60 Min: 31 / Avg: 48.23 / Max: 58 Min: 31 / Avg: 48.98 / Max: 58 Min: 33 / Avg: 50.06 / Max: 61
TNN CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better TNN 0.3 CPU Power Consumption Monitor AVX-512 Off AVX-512 On AVX-512 On 512 10 20 30 40 50 Min: 11.86 / Avg: 40.46 / Max: 48.51 Min: 12 / Avg: 42.41 / Max: 50.81 Min: 11.78 / Avg: 41.5 / Max: 49.92
TNN CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better TNN 0.3 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 Off AVX-512 On AVX-512 On 512 900 1800 2700 3600 4500 Min: 5100 / Avg: 5253.76 / Max: 5300 Min: 5100 / Avg: 5282.12 / Max: 5304 Min: 5099 / Avg: 5261.41 / Max: 5300
TNN CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better TNN 0.3 CPU Temperature Monitor AVX-512 Off AVX-512 On AVX-512 On 512 13 26 39 52 65 Min: 33 / Avg: 51.92 / Max: 64 Min: 33 / Avg: 53.27 / Max: 64 Min: 35 / Avg: 53.49 / Max: 67
TNN CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better TNN 0.3 CPU Power Consumption Monitor AVX-512 Off AVX-512 On AVX-512 On 512 15 30 45 60 75 Min: 11.9 / Avg: 60.65 / Max: 74.9 Min: 12.02 / Avg: 61.6 / Max: 74.53 Min: 12.01 / Avg: 62.39 / Max: 76.7
TNN CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better TNN 0.3 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 Off AVX-512 On AVX-512 On 512 900 1800 2700 3600 4500 Min: 4800 / Avg: 5114.03 / Max: 5304 Min: 4800 / Avg: 5109.16 / Max: 5300 Min: 4800 / Avg: 5072.03 / Max: 5313
TNN CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better TNN 0.3 CPU Temperature Monitor AVX-512 Off AVX-512 On AVX-512 On 512 13 26 39 52 65 Min: 36 / Avg: 57.3 / Max: 67 Min: 36 / Avg: 57.79 / Max: 68 Min: 36 / Avg: 58.88 / Max: 69
TNN CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better TNN 0.3 CPU Power Consumption Monitor AVX-512 Off AVX-512 On AVX-512 On 512 20 40 60 80 100 Min: 12.19 / Avg: 81.25 / Max: 91.18 Min: 12.03 / Avg: 81.72 / Max: 91.1 Min: 11.94 / Avg: 82.77 / Max: 92.94
TNN CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better TNN 0.3 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 Off AVX-512 On AVX-512 On 512 900 1800 2700 3600 4500 Min: 4800 / Avg: 5120.83 / Max: 5304 Min: 4800 / Avg: 5103.01 / Max: 5306 Min: 4800 / Avg: 5095.33 / Max: 5300
NCNN CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better NCNN 20220729 CPU Temperature Monitor AVX-512 Off AVX-512 On AVX-512 On 512 16 32 48 64 80 Min: 40 / Avg: 65.4 / Max: 71 Min: 40 / Avg: 70.36 / Max: 80 Min: 42 / Avg: 71.88 / Max: 87
NCNN CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better NCNN 20220729 CPU Power Consumption Monitor AVX-512 Off AVX-512 On AVX-512 On 512 40 80 120 160 200 Min: 12.39 / Avg: 148.04 / Max: 172.75 Min: 12.52 / Avg: 163.79 / Max: 200.07 Min: 12.42 / Avg: 165.72 / Max: 234.24
NCNN CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better NCNN 20220729 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 Off AVX-512 On AVX-512 On 512 900 1800 2700 3600 4500 Min: 4724 / Avg: 4816.34 / Max: 5306 Min: 4700 / Avg: 4729.61 / Max: 5300 Min: 4700 / Avg: 4737.32 / Max: 5298
Mobile Neural Network CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better Mobile Neural Network 2.1 CPU Temperature Monitor AVX-512 Off AVX-512 On AVX-512 On 512 20 40 60 80 100 Min: 38 / Avg: 78.24 / Max: 84 Min: 39 / Avg: 85.37 / Max: 95 Min: 41 / Avg: 86.3 / Max: 95
Mobile Neural Network CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better Mobile Neural Network 2.1 CPU Power Consumption Monitor AVX-512 Off AVX-512 On AVX-512 On 512 50 100 150 200 250 Min: 12.53 / Avg: 201.43 / Max: 226.39 Min: 12.33 / Avg: 226.92 / Max: 259.77 Min: 12.18 / Avg: 228.4 / Max: 260.3
Mobile Neural Network CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better Mobile Neural Network 2.1 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 Off AVX-512 On AVX-512 On 512 900 1800 2700 3600 4500 Min: 4700 / Avg: 4718.12 / Max: 5300 Min: 3483 / Avg: 4653.2 / Max: 5308 Min: 3500 / Avg: 4644.38 / Max: 5300
Xmrig CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better Xmrig 6.12.1 CPU Temperature Monitor AVX-512 Off AVX-512 On AVX-512 On 512 15 30 45 60 75 Min: 37 / Avg: 64.76 / Max: 67 Min: 38 / Avg: 65.69 / Max: 68 Min: 42 / Avg: 77.84 / Max: 79
Xmrig CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better Xmrig 6.12.1 CPU Power Consumption Monitor AVX-512 Off AVX-512 On AVX-512 On 512 40 80 120 160 200 Min: 12.39 / Avg: 150.74 / Max: 154.51 Min: 12.39 / Avg: 154.02 / Max: 158.84 Min: 12.43 / Avg: 198.43 / Max: 204.05
Xmrig CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better Xmrig 6.12.1 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 Off AVX-512 On AVX-512 On 512 900 1800 2700 3600 4500 Min: 4800 / Avg: 4806.2 / Max: 5300 Min: 4800 / Avg: 4806.25 / Max: 5300 Min: 4700 / Avg: 4708.31 / Max: 5300
Xmrig Variant: Wownero - Hash Count: 1M OpenBenchmarking.org H/s Per Watt, More Is Better Xmrig 6.12.1 Variant: Wownero - Hash Count: 1M AVX-512 Off AVX-512 On AVX-512 On 512 6 12 18 24 30 27.04 26.07 20.54
Xmrig CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better Xmrig 6.12.1 CPU Temperature Monitor AVX-512 Off AVX-512 On AVX-512 On 512 14 28 42 56 70 Min: 39 / Avg: 60.56 / Max: 63 Min: 39 / Avg: 61.9 / Max: 64 Min: 39 / Avg: 73.38 / Max: 75
Xmrig CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better Xmrig 6.12.1 CPU Power Consumption Monitor AVX-512 Off AVX-512 On AVX-512 On 512 30 60 90 120 150 Min: 12.34 / Avg: 135.27 / Max: 150.47 Min: 12.42 / Avg: 139.26 / Max: 150.83 Min: 12.29 / Avg: 181.65 / Max: 184.85
Xmrig CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better Xmrig 6.12.1 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 Off AVX-512 On AVX-512 On 512 900 1800 2700 3600 4500 Min: 4800 / Avg: 4803.2 / Max: 5300 Min: 4800 / Avg: 4803.31 / Max: 5300 Min: 4700 / Avg: 4704.64 / Max: 5245
Xmrig Variant: Monero - Hash Count: 1M OpenBenchmarking.org H/s Per Watt, More Is Better Xmrig 6.12.1 Variant: Monero - Hash Count: 1M AVX-512 Off AVX-512 On AVX-512 On 512 4 8 12 16 20 16.68 16.08 12.40
Cpuminer-Opt CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better Cpuminer-Opt 3.18 CPU Temperature Monitor AVX-512 Off AVX-512 On AVX-512 On 512 20 40 60 80 100 Min: 37 / Avg: 68.15 / Max: 76 Min: 39 / Avg: 77.28 / Max: 95 Min: 40 / Avg: 77.84 / Max: 95
Cpuminer-Opt CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better Cpuminer-Opt 3.18 CPU Power Consumption Monitor AVX-512 Off AVX-512 On AVX-512 On 512 50 100 150 200 250 Min: 12.49 / Avg: 164.79 / Max: 203.1 Min: 12.52 / Avg: 194 / Max: 268.78 Min: 12.24 / Avg: 194.14 / Max: 277.39
Cpuminer-Opt CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better Cpuminer-Opt 3.18 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 Off AVX-512 On AVX-512 On 512 900 1800 2700 3600 4500 Min: 4700 / Avg: 4769.7 / Max: 5300 Min: 4700 / Avg: 4754.62 / Max: 5300 Min: 4700 / Avg: 4753.32 / Max: 5289
Cpuminer-Opt Algorithm: LBC, LBRY Credits OpenBenchmarking.org kH/s Per Watt, More Is Better Cpuminer-Opt 3.18 Algorithm: LBC, LBRY Credits AVX-512 Off AVX-512 On AVX-512 On 512 90 180 270 360 450 165.49 397.33 393.49
Cpuminer-Opt CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better Cpuminer-Opt 3.18 CPU Temperature Monitor AVX-512 Off AVX-512 On AVX-512 On 512 20 40 60 80 100 Min: 38 / Avg: 65.65 / Max: 71 Min: 41 / Avg: 73.88 / Max: 81 Min: 42 / Avg: 75.17 / Max: 93
Cpuminer-Opt CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better Cpuminer-Opt 3.18 CPU Power Consumption Monitor AVX-512 Off AVX-512 On AVX-512 On 512 50 100 150 200 250 Min: 6.67 / Avg: 143.31 / Max: 195.06 Min: 12.55 / Avg: 172.45 / Max: 244.87 Min: 12.36 / Avg: 172.53 / Max: 260.03
Cpuminer-Opt CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better Cpuminer-Opt 3.18 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 Off AVX-512 On AVX-512 On 512 900 1800 2700 3600 4500 Min: 4700 / Avg: 4830.72 / Max: 5300 Min: 4700 / Avg: 4758.76 / Max: 5300 Min: 4700 / Avg: 4759.1 / Max: 5308
Cpuminer-Opt Algorithm: Skeincoin OpenBenchmarking.org kH/s Per Watt, More Is Better Cpuminer-Opt 3.18 Algorithm: Skeincoin AVX-512 Off AVX-512 On AVX-512 On 512 140 280 420 560 700 493.49 647.91 651.49
Cpuminer-Opt CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better Cpuminer-Opt 3.18 CPU Temperature Monitor AVX-512 Off AVX-512 On AVX-512 On 512 20 40 60 80 100 Min: 38 / Avg: 70.52 / Max: 77 Min: 40 / Avg: 84.5 / Max: 93 Min: 42 / Avg: 83.16 / Max: 91
Cpuminer-Opt CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better Cpuminer-Opt 3.18 CPU Power Consumption Monitor AVX-512 Off AVX-512 On AVX-512 On 512 50 100 150 200 250 Min: 12.31 / Avg: 169.09 / Max: 198.24 Min: 12.44 / Avg: 219.64 / Max: 263.83 Min: 12.34 / Avg: 217.57 / Max: 263.4
Cpuminer-Opt CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better Cpuminer-Opt 3.18 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 Off AVX-512 On AVX-512 On 512 900 1800 2700 3600 4500 Min: 4700 / Avg: 4759.57 / Max: 5303 Min: 4600 / Avg: 4719.95 / Max: 5301 Min: 3500 / Avg: 4700.75 / Max: 5100
Cpuminer-Opt Algorithm: Deepcoin OpenBenchmarking.org kH/s Per Watt, More Is Better Cpuminer-Opt 3.18 Algorithm: Deepcoin AVX-512 Off AVX-512 On AVX-512 On 512 13 26 39 52 65 58.94 50.76 51.80
Cpuminer-Opt CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better Cpuminer-Opt 3.18 CPU Temperature Monitor AVX-512 Off AVX-512 On AVX-512 On 512 20 40 60 80 100 Min: 38 / Avg: 71.45 / Max: 78 Min: 40 / Avg: 85.36 / Max: 94 Min: 41 / Avg: 85.18 / Max: 96
Cpuminer-Opt CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better Cpuminer-Opt 3.18 CPU Power Consumption Monitor AVX-512 Off AVX-512 On AVX-512 On 512 50 100 150 200 250 Min: 12.48 / Avg: 166.37 / Max: 191.48 Min: 12.54 / Avg: 213.04 / Max: 259.5 Min: 12.63 / Avg: 211.76 / Max: 259.97
Cpuminer-Opt CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better Cpuminer-Opt 3.18 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 Off AVX-512 On AVX-512 On 512 900 1800 2700 3600 4500 Min: 4700 / Avg: 4750.11 / Max: 5297 Min: 3500 / Avg: 4653.7 / Max: 5308 Min: 3500 / Avg: 4689.84 / Max: 5300
Cpuminer-Opt Algorithm: Ringcoin OpenBenchmarking.org kH/s Per Watt, More Is Better Cpuminer-Opt 3.18 Algorithm: Ringcoin AVX-512 Off AVX-512 On AVX-512 On 512 3 6 9 12 15 12.81 10.11 10.35
Cpuminer-Opt CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better Cpuminer-Opt 3.18 CPU Temperature Monitor AVX-512 Off AVX-512 On AVX-512 On 512 20 40 60 80 100 Min: 38 / Avg: 70.33 / Max: 78 Min: 39 / Avg: 84.38 / Max: 96 Min: 41 / Avg: 85.1 / Max: 98
Cpuminer-Opt CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better Cpuminer-Opt 3.18 CPU Power Consumption Monitor AVX-512 Off AVX-512 On AVX-512 On 512 50 100 150 200 250 Min: 12.41 / Avg: 174.56 / Max: 204.63 Min: 12.53 / Avg: 225.98 / Max: 278.7 Min: 12.3 / Avg: 220.67 / Max: 279.05
Cpuminer-Opt CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better Cpuminer-Opt 3.18 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 Off AVX-512 On AVX-512 On 512 900 1800 2700 3600 4500 Min: 4700 / Avg: 4755.84 / Max: 5300 Min: 4522 / Avg: 4667.89 / Max: 5311 Min: 4500 / Avg: 4645.86 / Max: 5300
Cpuminer-Opt Algorithm: Garlicoin OpenBenchmarking.org kH/s Per Watt, More Is Better Cpuminer-Opt 3.18 Algorithm: Garlicoin AVX-512 Off AVX-512 On AVX-512 On 512 5 10 15 20 25 13.64 19.40 19.90
Cpuminer-Opt CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better Cpuminer-Opt 3.18 CPU Temperature Monitor AVX-512 Off AVX-512 On AVX-512 On 512 20 40 60 80 100 Min: 35 / Avg: 67.7 / Max: 74 Min: 38 / Avg: 82.81 / Max: 93 Min: 39 / Avg: 80.97 / Max: 94
Cpuminer-Opt CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better Cpuminer-Opt 3.18 CPU Power Consumption Monitor AVX-512 Off AVX-512 On AVX-512 On 512 50 100 150 200 250 Min: 12.29 / Avg: 156.93 / Max: 187.81 Min: 12.61 / Avg: 210.01 / Max: 243.37 Min: 12.21 / Avg: 205.74 / Max: 250.13
Cpuminer-Opt CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better Cpuminer-Opt 3.18 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 Off AVX-512 On AVX-512 On 512 900 1800 2700 3600 4500 Min: 4700 / Avg: 4771.9 / Max: 5294 Min: 4650 / Avg: 4751.77 / Max: 5252 Min: 3500 / Avg: 4605.7 / Max: 5307
Cpuminer-Opt Algorithm: x25x OpenBenchmarking.org kH/s Per Watt, More Is Better Cpuminer-Opt 3.18 Algorithm: x25x AVX-512 Off AVX-512 On AVX-512 On 512 0.5148 1.0296 1.5444 2.0592 2.574 2.288 1.846 1.847
Cpuminer-Opt CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better Cpuminer-Opt 3.18 CPU Temperature Monitor AVX-512 Off AVX-512 On AVX-512 On 512 20 40 60 80 100 Min: 38 / Avg: 62.38 / Max: 71 Min: 39 / Avg: 72.79 / Max: 89 Min: 42 / Avg: 74.3 / Max: 93
Cpuminer-Opt CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better Cpuminer-Opt 3.18 CPU Power Consumption Monitor AVX-512 Off AVX-512 On AVX-512 On 512 50 100 150 200 250 Min: 12.46 / Avg: 120.8 / Max: 156.32 Min: 12.3 / Avg: 158.84 / Max: 274.55 Min: 12.31 / Avg: 161.61 / Max: 277.66
Cpuminer-Opt CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better Cpuminer-Opt 3.18 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 Off AVX-512 On AVX-512 On 512 900 1800 2700 3600 4500 Min: 4700 / Avg: 4834.2 / Max: 5300 Min: 4700 / Avg: 4757.9 / Max: 5300 Min: 4700 / Avg: 4751.67 / Max: 5305
Cpuminer-Opt Algorithm: Blake-2 S OpenBenchmarking.org kH/s Per Watt, More Is Better Cpuminer-Opt 3.18 Algorithm: Blake-2 S AVX-512 Off AVX-512 On AVX-512 On 512 1200 2400 3600 4800 6000 3255.01 5427.52 5541.06
Cpuminer-Opt CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better Cpuminer-Opt 3.18 CPU Temperature Monitor AVX-512 Off AVX-512 On AVX-512 On 512 20 40 60 80 100 Min: 38 / Avg: 71.08 / Max: 78 Min: 39 / Avg: 71.49 / Max: 79 Min: 40 / Avg: 82.2 / Max: 95
Cpuminer-Opt CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better Cpuminer-Opt 3.18 CPU Power Consumption Monitor AVX-512 Off AVX-512 On AVX-512 On 512 50 100 150 200 250 Min: 12.44 / Avg: 165.63 / Max: 188.99 Min: 12.43 / Avg: 166.66 / Max: 190.11 Min: 12.13 / Avg: 212.02 / Max: 259.67
Cpuminer-Opt CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better Cpuminer-Opt 3.18 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 Off AVX-512 On AVX-512 On 512 900 1800 2700 3600 4500 Min: 4700 / Avg: 4762.57 / Max: 5300 Min: 4700 / Avg: 4753.83 / Max: 5300 Min: 3555 / Avg: 4644.34 / Max: 5300
Cpuminer-Opt Algorithm: Magi OpenBenchmarking.org kH/s Per Watt, More Is Better Cpuminer-Opt 3.18 Algorithm: Magi AVX-512 Off AVX-512 On AVX-512 On 512 0.6158 1.2316 1.8474 2.4632 3.079 2.737 2.717 2.120
Cpuminer-Opt CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better Cpuminer-Opt 3.18 CPU Temperature Monitor AVX-512 Off AVX-512 On AVX-512 On 512 20 40 60 80 100 Min: 37 / Avg: 68.83 / Max: 76 Min: 38 / Avg: 79.95 / Max: 97 Min: 39 / Avg: 80.53 / Max: 97
Cpuminer-Opt CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better Cpuminer-Opt 3.18 CPU Power Consumption Monitor AVX-512 Off AVX-512 On AVX-512 On 512 50 100 150 200 250 Min: 12.36 / Avg: 159.39 / Max: 196.52 Min: 12.4 / Avg: 204.6 / Max: 277.24 Min: 12.06 / Avg: 205.9 / Max: 276.24
Cpuminer-Opt CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better Cpuminer-Opt 3.18 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 Off AVX-512 On AVX-512 On 512 900 1800 2700 3600 4500 Min: 4700 / Avg: 4766.67 / Max: 5300 Min: 3500 / Avg: 4739.52 / Max: 5300 Min: 3500 / Avg: 4739.94 / Max: 5312
Cpuminer-Opt Algorithm: Myriad-Groestl OpenBenchmarking.org kH/s Per Watt, More Is Better Cpuminer-Opt 3.18 Algorithm: Myriad-Groestl AVX-512 Off AVX-512 On AVX-512 On 512 40 80 120 160 200 101.32 198.30 197.49
Cpuminer-Opt CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better Cpuminer-Opt 3.18 CPU Temperature Monitor AVX-512 Off AVX-512 On AVX-512 On 512 20 40 60 80 100 Min: 36 / Avg: 65.33 / Max: 73 Min: 38 / Avg: 73.74 / Max: 92 Min: 39 / Avg: 75.84 / Max: 93
Cpuminer-Opt CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better Cpuminer-Opt 3.18 CPU Power Consumption Monitor AVX-512 Off AVX-512 On AVX-512 On 512 50 100 150 200 250 Min: 12.24 / Avg: 140.46 / Max: 186.51 Min: 12.43 / Avg: 175.6 / Max: 252.11 Min: 12.25 / Avg: 177.02 / Max: 245.52
Cpuminer-Opt CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better Cpuminer-Opt 3.18 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 Off AVX-512 On AVX-512 On 512 900 1800 2700 3600 4500 Min: 4700 / Avg: 4831.54 / Max: 5312 Min: 4700 / Avg: 4750.65 / Max: 5300 Min: 4700 / Avg: 4753.87 / Max: 5290
Cpuminer-Opt Algorithm: Quad SHA-256, Pyrite OpenBenchmarking.org kH/s Per Watt, More Is Better Cpuminer-Opt 3.18 Algorithm: Quad SHA-256, Pyrite AVX-512 Off AVX-512 On AVX-512 On 512 200 400 600 800 1000 460.38 953.89 930.90
Cpuminer-Opt CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better Cpuminer-Opt 3.18 CPU Temperature Monitor AVX-512 Off AVX-512 On AVX-512 On 512 20 40 60 80 100 Min: 39 / Avg: 64.76 / Max: 73 Min: 40 / Avg: 74.89 / Max: 92 Min: 42 / Avg: 75.38 / Max: 94
Cpuminer-Opt CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better Cpuminer-Opt 3.18 CPU Power Consumption Monitor AVX-512 Off AVX-512 On AVX-512 On 512 50 100 150 200 250 Min: 12.4 / Avg: 129.38 / Max: 169.44 Min: 12.5 / Avg: 169.58 / Max: 237.02 Min: 12.41 / Avg: 169.42 / Max: 278.89
Cpuminer-Opt CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better Cpuminer-Opt 3.18 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 Off AVX-512 On AVX-512 On 512 900 1800 2700 3600 4500 Min: 4700 / Avg: 4834.78 / Max: 5300 Min: 4700 / Avg: 4759.14 / Max: 5300 Min: 4700 / Avg: 4753.44 / Max: 5300
Cpuminer-Opt Algorithm: Triple SHA-256, Onecoin OpenBenchmarking.org kH/s Per Watt, More Is Better Cpuminer-Opt 3.18 Algorithm: Triple SHA-256, Onecoin AVX-512 Off AVX-512 On AVX-512 On 512 300 600 900 1200 1500 820.32 1366.28 1361.66
oneDNN CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better oneDNN 2.7 CPU Temperature Monitor AVX-512 Off AVX-512 On AVX-512 On 512 20 40 60 80 100 Min: 39 / Avg: 79.8 / Max: 88 Min: 41 / Avg: 83.69 / Max: 93 Min: 41 / Avg: 85.51 / Max: 95
oneDNN CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better oneDNN 2.7 CPU Power Consumption Monitor AVX-512 Off AVX-512 On AVX-512 On 512 50 100 150 200 250 Min: 12.39 / Avg: 211.06 / Max: 238.35 Min: 12.62 / Avg: 222.99 / Max: 258.73 Min: 12.35 / Avg: 223.11 / Max: 259.32
oneDNN CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better oneDNN 2.7 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 Off AVX-512 On AVX-512 On 512 900 1800 2700 3600 4500 Min: 4700 / Avg: 4729.07 / Max: 5300 Min: 3545 / Avg: 4698.05 / Max: 5302 Min: 3500 / Avg: 4678.88 / Max: 5300
oneDNN CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better oneDNN 2.7 CPU Temperature Monitor AVX-512 Off AVX-512 On AVX-512 On 512 20 40 60 80 100 Min: 40 / Avg: 79.86 / Max: 87 Min: 40 / Avg: 84.09 / Max: 94 Min: 42 / Avg: 84.75 / Max: 94
oneDNN CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better oneDNN 2.7 CPU Power Consumption Monitor AVX-512 Off AVX-512 On AVX-512 On 512 50 100 150 200 250 Min: 12.61 / Avg: 210.67 / Max: 238.64 Min: 12.42 / Avg: 220.81 / Max: 258.47 Min: 12.38 / Avg: 222.38 / Max: 260.25
oneDNN CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better oneDNN 2.7 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 Off AVX-512 On AVX-512 On 512 900 1800 2700 3600 4500 Min: 4700 / Avg: 4725.04 / Max: 5303 Min: 3524 / Avg: 4668.41 / Max: 5291 Min: 3500 / Avg: 4673.77 / Max: 5300
oneDNN CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better oneDNN 2.7 CPU Temperature Monitor AVX-512 Off AVX-512 On AVX-512 On 512 20 40 60 80 100 Min: 40 / Avg: 79.82 / Max: 87 Min: 41 / Avg: 83.26 / Max: 94 Min: 42 / Avg: 85.26 / Max: 95
oneDNN CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better oneDNN 2.7 CPU Power Consumption Monitor AVX-512 Off AVX-512 On AVX-512 On 512 50 100 150 200 250 Min: 12.3 / Avg: 210.85 / Max: 239.17 Min: 12.6 / Avg: 221.72 / Max: 257.44 Min: 12.23 / Avg: 222.53 / Max: 259.06
oneDNN CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better oneDNN 2.7 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 Off AVX-512 On AVX-512 On 512 900 1800 2700 3600 4500 Min: 4700 / Avg: 4732.36 / Max: 5300 Min: 3500 / Avg: 4683.06 / Max: 5300 Min: 4573 / Avg: 4707.8 / Max: 5300
oneDNN CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better oneDNN 2.7 CPU Temperature Monitor AVX-512 Off AVX-512 On AVX-512 On 512 20 40 60 80 100 Min: 40 / Avg: 80.45 / Max: 88 Min: 41 / Avg: 83.9 / Max: 95 Min: 41 / Avg: 84.88 / Max: 94
oneDNN CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better oneDNN 2.7 CPU Power Consumption Monitor AVX-512 Off AVX-512 On AVX-512 On 512 50 100 150 200 250 Min: 12.67 / Avg: 214.52 / Max: 239.09 Min: 12.53 / Avg: 222.91 / Max: 259.24 Min: 12.32 / Avg: 225.38 / Max: 259.31
oneDNN CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better oneDNN 2.7 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 Off AVX-512 On AVX-512 On 512 900 1800 2700 3600 4500 Min: 4700 / Avg: 4729.18 / Max: 5303 Min: 3500 / Avg: 4672.78 / Max: 5309 Min: 3500 / Avg: 4674.91 / Max: 5181
oneDNN CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better oneDNN 2.7 CPU Temperature Monitor AVX-512 Off AVX-512 On AVX-512 On 512 20 40 60 80 100 Min: 39 / Avg: 80.93 / Max: 87 Min: 40 / Avg: 84.18 / Max: 95 Min: 41 / Avg: 85.38 / Max: 95
oneDNN CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better oneDNN 2.7 CPU Power Consumption Monitor AVX-512 Off AVX-512 On AVX-512 On 512 50 100 150 200 250 Min: 12.57 / Avg: 214.65 / Max: 239.45 Min: 12.72 / Avg: 223.66 / Max: 258.29 Min: 6.51 / Avg: 222.96 / Max: 260.16
oneDNN CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better oneDNN 2.7 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 Off AVX-512 On AVX-512 On 512 900 1800 2700 3600 4500 Min: 4700 / Avg: 4726.9 / Max: 5300 Min: 3500 / Avg: 4678.34 / Max: 5300 Min: 3500 / Avg: 4667.49 / Max: 5300
oneDNN CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better oneDNN 2.7 CPU Temperature Monitor AVX-512 Off AVX-512 On AVX-512 On 512 20 40 60 80 100 Min: 33 / Avg: 78.87 / Max: 87 Min: 37 / Avg: 84.81 / Max: 94 Min: 38 / Avg: 84.54 / Max: 94
oneDNN CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better oneDNN 2.7 CPU Power Consumption Monitor AVX-512 Off AVX-512 On AVX-512 On 512 50 100 150 200 250 Min: 12.16 / Avg: 214.34 / Max: 239.55 Min: 12.16 / Avg: 224.81 / Max: 259.66 Min: 12.36 / Avg: 225.11 / Max: 259.84
oneDNN CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better oneDNN 2.7 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 Off AVX-512 On AVX-512 On 512 900 1800 2700 3600 4500 Min: 4700 / Avg: 4733.47 / Max: 5312 Min: 4649 / Avg: 4725.14 / Max: 5300 Min: 3500 / Avg: 4710.26 / Max: 5301
oneDNN CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better oneDNN 2.7 CPU Temperature Monitor AVX-512 On AVX-512 On 512 15 30 45 60 75 Min: 38 / Avg: 63.03 / Max: 77 Min: 39 / Avg: 64.2 / Max: 78
oneDNN CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better oneDNN 2.7 CPU Power Consumption Monitor AVX-512 On AVX-512 On 512 40 80 120 160 200 Min: 12.43 / Avg: 143.59 / Max: 212.38 Min: 12.45 / Avg: 147.95 / Max: 221.19
oneDNN CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better oneDNN 2.7 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 On AVX-512 On 512 900 1800 2700 3600 4500 Min: 4700 / Avg: 4826.46 / Max: 5302 Min: 4700 / Avg: 4807.8 / Max: 5221
oneDNN CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better oneDNN 2.7 CPU Temperature Monitor AVX-512 Off AVX-512 On AVX-512 On 512 14 28 42 56 70 Min: 36 / Avg: 60.25 / Max: 74 Min: 38 / Avg: 64.16 / Max: 75 Min: 38 / Avg: 63.12 / Max: 74
oneDNN CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better oneDNN 2.7 CPU Power Consumption Monitor AVX-512 Off AVX-512 On AVX-512 On 512 40 80 120 160 200 Min: 12.3 / Avg: 141.01 / Max: 214.89 Min: 12.28 / Avg: 152.81 / Max: 217.07 Min: 12.46 / Avg: 151.73 / Max: 216.95
oneDNN CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better oneDNN 2.7 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 Off AVX-512 On AVX-512 On 512 900 1800 2700 3600 4500 Min: 4700 / Avg: 4857.73 / Max: 5270 Min: 4700 / Avg: 4831.27 / Max: 5300 Min: 4700 / Avg: 4824.57 / Max: 5300
oneDNN CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better oneDNN 2.7 CPU Temperature Monitor AVX-512 Off AVX-512 On AVX-512 On 512 15 30 45 60 75 Min: 32 / Avg: 54.62 / Max: 65 Min: 38 / Avg: 62.72 / Max: 76 Min: 39 / Avg: 63.95 / Max: 76
oneDNN CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better oneDNN 2.7 CPU Power Consumption Monitor AVX-512 Off AVX-512 On AVX-512 On 512 40 80 120 160 200 Min: 12.06 / Avg: 127.79 / Max: 179.3 Min: 12.37 / Avg: 152.68 / Max: 217.03 Min: 12.48 / Avg: 154.47 / Max: 218.24
oneDNN CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better oneDNN 2.7 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 Off AVX-512 On AVX-512 On 512 900 1800 2700 3600 4500 Min: 4800 / Avg: 4883.85 / Max: 5307 Min: 4700 / Avg: 4817.98 / Max: 5300 Min: 4700 / Avg: 4805.17 / Max: 5300
oneDNN CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better oneDNN 2.7 CPU Temperature Monitor AVX-512 On AVX-512 On 512 15 30 45 60 75 Min: 37 / Avg: 62.76 / Max: 75 Min: 38 / Avg: 63.8 / Max: 78
oneDNN CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better oneDNN 2.7 CPU Power Consumption Monitor AVX-512 On AVX-512 On 512 40 80 120 160 200 Min: 12.19 / Avg: 145.98 / Max: 216.11 Min: 12.44 / Avg: 147.87 / Max: 217.33
oneDNN CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better oneDNN 2.7 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 On AVX-512 On 512 900 1800 2700 3600 4500 Min: 4700 / Avg: 4840.23 / Max: 5303 Min: 4700 / Avg: 4825.21 / Max: 5297
oneDNN CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better oneDNN 2.7 CPU Temperature Monitor AVX-512 Off AVX-512 On AVX-512 On 512 15 30 45 60 75 Min: 35 / Avg: 56.98 / Max: 70 Min: 38 / Avg: 61.41 / Max: 78 Min: 38 / Avg: 61.88 / Max: 79
oneDNN CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better oneDNN 2.7 CPU Power Consumption Monitor AVX-512 Off AVX-512 On AVX-512 On 512 40 80 120 160 200 Min: 12.18 / Avg: 117.33 / Max: 206.36 Min: 12.26 / Avg: 135.98 / Max: 211.15 Min: 12.46 / Avg: 138.07 / Max: 211.6
oneDNN CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better oneDNN 2.7 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 Off AVX-512 On AVX-512 On 512 900 1800 2700 3600 4500 Min: 4753 / Avg: 4904.44 / Max: 5300 Min: 4700 / Avg: 4847.06 / Max: 5310 Min: 4700 / Avg: 4828.02 / Max: 5149
oneDNN CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better oneDNN 2.7 CPU Temperature Monitor AVX-512 Off AVX-512 On AVX-512 On 512 14 28 42 56 70 Min: 34 / Avg: 54.35 / Max: 70 Min: 39 / Avg: 59.67 / Max: 73 Min: 40 / Avg: 59.91 / Max: 74
oneDNN CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better oneDNN 2.7 CPU Power Consumption Monitor AVX-512 Off AVX-512 On AVX-512 On 512 40 80 120 160 200 Min: 11.99 / Avg: 110.48 / Max: 208.04 Min: 12.41 / Avg: 142.22 / Max: 219.9 Min: 12.27 / Avg: 140.62 / Max: 220.8
oneDNN CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better oneDNN 2.7 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 Off AVX-512 On AVX-512 On 512 900 1800 2700 3600 4500 Min: 4789 / Avg: 4907.45 / Max: 5306 Min: 4700 / Avg: 4834.06 / Max: 5301 Min: 4700 / Avg: 4835.06 / Max: 5300
oneDNN CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better oneDNN 2.7 CPU Temperature Monitor AVX-512 On AVX-512 On 512 15 30 45 60 75 Min: 39 / Avg: 68.31 / Max: 79 Min: 41 / Avg: 68.97 / Max: 80
oneDNN CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better oneDNN 2.7 CPU Power Consumption Monitor AVX-512 On AVX-512 On 512 40 80 120 160 200 Min: 12.64 / Avg: 166.08 / Max: 212.18 Min: 12.55 / Avg: 164.37 / Max: 212.69
oneDNN CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better oneDNN 2.7 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 On AVX-512 On 512 900 1800 2700 3600 4500 Min: 4700 / Avg: 4799.03 / Max: 5300 Min: 4700 / Avg: 4796.12 / Max: 5300
oneDNN CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better oneDNN 2.7 CPU Temperature Monitor AVX-512 Off AVX-512 On AVX-512 On 512 20 40 60 80 100 Min: 38 / Avg: 67.95 / Max: 80 Min: 39 / Avg: 75.8 / Max: 90 Min: 40 / Avg: 76.38 / Max: 90
oneDNN CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better oneDNN 2.7 CPU Power Consumption Monitor AVX-512 Off AVX-512 On AVX-512 On 512 50 100 150 200 250 Min: 12.34 / Avg: 167.49 / Max: 223.12 Min: 12.39 / Avg: 197.09 / Max: 259.67 Min: 12.45 / Avg: 197.65 / Max: 260.01
oneDNN CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better oneDNN 2.7 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 Off AVX-512 On AVX-512 On 512 900 1800 2700 3600 4500 Min: 4700 / Avg: 4797.83 / Max: 5306 Min: 4700 / Avg: 4792.74 / Max: 5301 Min: 4700 / Avg: 4794.07 / Max: 5308
oneDNN CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better oneDNN 2.7 CPU Temperature Monitor AVX-512 Off AVX-512 On AVX-512 On 512 20 40 60 80 100 Min: 31 / Avg: 66.53 / Max: 80 Min: 34 / Avg: 71.48 / Max: 87 Min: 35 / Avg: 71.51 / Max: 88
oneDNN CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better oneDNN 2.7 CPU Power Consumption Monitor AVX-512 Off AVX-512 On AVX-512 On 512 50 100 150 200 250 Min: 11.91 / Avg: 174.01 / Max: 231.27 Min: 12.26 / Avg: 185.14 / Max: 254.54 Min: 12.2 / Avg: 187.14 / Max: 256.22
oneDNN CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better oneDNN 2.7 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 Off AVX-512 On AVX-512 On 512 900 1800 2700 3600 4500 Min: 4700 / Avg: 4801.83 / Max: 5299 Min: 4700 / Avg: 4798.47 / Max: 5302 Min: 4700 / Avg: 4796.3 / Max: 5300
oneDNN CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better oneDNN 2.7 CPU Temperature Monitor AVX-512 On AVX-512 On 512 14 28 42 56 70 Min: 34 / Avg: 49.81 / Max: 71 Min: 36 / Avg: 53.02 / Max: 71
oneDNN CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better oneDNN 2.7 CPU Power Consumption Monitor AVX-512 On AVX-512 On 512 40 80 120 160 200 Min: 12.22 / Avg: 97.45 / Max: 213.88 Min: 12.08 / Avg: 97.63 / Max: 215.11
oneDNN CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better oneDNN 2.7 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 On AVX-512 On 512 900 1800 2700 3600 4500 Min: 4700 / Avg: 4987.32 / Max: 5308 Min: 4700 / Avg: 4940.08 / Max: 5300
oneDNN CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better oneDNN 2.7 CPU Temperature Monitor AVX-512 Off AVX-512 On AVX-512 On 512 15 30 45 60 75 Min: 35 / Avg: 52.66 / Max: 74 Min: 35 / Avg: 53.89 / Max: 78 Min: 36 / Avg: 55.78 / Max: 79
oneDNN CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better oneDNN 2.7 CPU Power Consumption Monitor AVX-512 Off AVX-512 On AVX-512 On 512 40 80 120 160 200 Min: 12.03 / Avg: 101.88 / Max: 232.56 Min: 12.2 / Avg: 108.52 / Max: 242.72 Min: 12.27 / Avg: 108.7 / Max: 242.03
oneDNN CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better oneDNN 2.7 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 Off AVX-512 On AVX-512 On 512 900 1800 2700 3600 4500 Min: 4700 / Avg: 4953.98 / Max: 5300 Min: 4700 / Avg: 4984.13 / Max: 5309 Min: 4700 / Avg: 4983.09 / Max: 5312
oneDNN CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better oneDNN 2.7 CPU Temperature Monitor AVX-512 Off AVX-512 On AVX-512 On 512 16 32 48 64 80 Min: 34 / Avg: 51.76 / Max: 71 Min: 39 / Avg: 56.03 / Max: 81 Min: 39 / Avg: 58.3 / Max: 82
oneDNN CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better oneDNN 2.7 CPU Power Consumption Monitor AVX-512 Off AVX-512 On AVX-512 On 512 40 80 120 160 200 Min: 12.12 / Avg: 99.49 / Max: 224.72 Min: 12.32 / Avg: 109.91 / Max: 245.61 Min: 12.27 / Avg: 110.93 / Max: 247.56
oneDNN CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better oneDNN 2.7 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 Off AVX-512 On AVX-512 On 512 900 1800 2700 3600 4500 Min: 4721 / Avg: 4966.06 / Max: 5300 Min: 4700 / Avg: 4987.92 / Max: 5312 Min: 4700 / Avg: 4931.38 / Max: 5267
oneDNN CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better oneDNN 2.7 CPU Temperature Monitor AVX-512 On AVX-512 On 512 20 40 60 80 100 Min: 39 / Avg: 74.22 / Max: 90 Min: 39 / Avg: 74.99 / Max: 90
oneDNN CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better oneDNN 2.7 CPU Power Consumption Monitor AVX-512 On AVX-512 On 512 50 100 150 200 250 Min: 12.48 / Avg: 187.07 / Max: 255.81 Min: 12.43 / Avg: 188.15 / Max: 256.3
oneDNN CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better oneDNN 2.7 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 On AVX-512 On 512 900 1800 2700 3600 4500 Min: 4700 / Avg: 4772.18 / Max: 5298 Min: 4700 / Avg: 4768.42 / Max: 5101
oneDNN CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better oneDNN 2.7 CPU Temperature Monitor AVX-512 Off AVX-512 On AVX-512 On 512 20 40 60 80 100 Min: 37 / Avg: 68.37 / Max: 81 Min: 39 / Avg: 76.57 / Max: 97 Min: 40 / Avg: 76.51 / Max: 95
oneDNN CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better oneDNN 2.7 CPU Power Consumption Monitor AVX-512 Off AVX-512 On AVX-512 On 512 50 100 150 200 250 Min: 12.49 / Avg: 157.07 / Max: 224.86 Min: 12.23 / Avg: 183.19 / Max: 271.84 Min: 12.33 / Avg: 182.51 / Max: 273
oneDNN CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better oneDNN 2.7 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 Off AVX-512 On AVX-512 On 512 900 1800 2700 3600 4500 Min: 4700 / Avg: 4797.64 / Max: 5309 Min: 3426 / Avg: 4750.48 / Max: 5310 Min: 3430 / Avg: 4699.55 / Max: 5139
oneDNN CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better oneDNN 2.7 CPU Temperature Monitor AVX-512 Off AVX-512 On AVX-512 On 512 20 40 60 80 100 Min: 32 / Avg: 63.64 / Max: 79 Min: 36 / Avg: 73.12 / Max: 90 Min: 38 / Avg: 73.45 / Max: 90
oneDNN CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better oneDNN 2.7 CPU Power Consumption Monitor AVX-512 Off AVX-512 On AVX-512 On 512 50 100 150 200 250 Min: 12 / Avg: 154.65 / Max: 222.78 Min: 12.16 / Avg: 185.77 / Max: 260.53 Min: 12.31 / Avg: 186.16 / Max: 260.32
oneDNN CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better oneDNN 2.7 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 Off AVX-512 On AVX-512 On 512 900 1800 2700 3600 4500 Min: 4700 / Avg: 4788.28 / Max: 5100 Min: 4700 / Avg: 4787.19 / Max: 5300 Min: 4700 / Avg: 4787.63 / Max: 5228
oneDNN CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better oneDNN 2.7 CPU Temperature Monitor AVX-512 On AVX-512 On 512 15 30 45 60 75 Min: 36 / Avg: 59.56 / Max: 76 Min: 36 / Avg: 59.45 / Max: 76
oneDNN CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better oneDNN 2.7 CPU Power Consumption Monitor AVX-512 On AVX-512 On 512 40 80 120 160 200 Min: 11.99 / Avg: 128 / Max: 209.14 Min: 12.11 / Avg: 126.88 / Max: 209.9
oneDNN CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better oneDNN 2.7 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 On AVX-512 On 512 900 1800 2700 3600 4500 Min: 4700 / Avg: 4894.72 / Max: 5300 Min: 4700 / Avg: 4872.99 / Max: 5300
oneDNN CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better oneDNN 2.7 CPU Temperature Monitor AVX-512 Off AVX-512 On AVX-512 On 512 13 26 39 52 65 Min: 36 / Avg: 50.61 / Max: 60 Min: 38 / Avg: 53.03 / Max: 64 Min: 37 / Avg: 53.8 / Max: 65
oneDNN CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better oneDNN 2.7 CPU Power Consumption Monitor AVX-512 Off AVX-512 On AVX-512 On 512 30 60 90 120 150 Min: 12.03 / Avg: 95.8 / Max: 154.46 Min: 12.34 / Avg: 109.26 / Max: 184.33 Min: 12.31 / Avg: 109.54 / Max: 183.13
oneDNN CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better oneDNN 2.7 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 Off AVX-512 On AVX-512 On 512 900 1800 2700 3600 4500 Min: 4800 / Avg: 4940.32 / Max: 5300 Min: 4700 / Avg: 4892.18 / Max: 5300 Min: 4700 / Avg: 4884.79 / Max: 5300
oneDNN CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better oneDNN 2.7 CPU Temperature Monitor AVX-512 Off AVX-512 On AVX-512 On 512 13 26 39 52 65 Min: 39 / Avg: 54 / Max: 63 Min: 40 / Avg: 56.59 / Max: 68 Min: 41 / Avg: 57.77 / Max: 69
oneDNN CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better oneDNN 2.7 CPU Power Consumption Monitor AVX-512 Off AVX-512 On AVX-512 On 512 30 60 90 120 150 Min: 12.3 / Avg: 101.38 / Max: 166.77 Min: 12.33 / Avg: 114.74 / Max: 188.88 Min: 12.56 / Avg: 116.37 / Max: 189.01
oneDNN CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better oneDNN 2.7 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 Off AVX-512 On AVX-512 On 512 900 1800 2700 3600 4500 Min: 4800 / Avg: 4945.85 / Max: 5300 Min: 4700 / Avg: 4896.54 / Max: 5300 Min: 4700 / Avg: 4879.13 / Max: 5300
OSPRay Studio CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better OSPRay Studio 0.11 CPU Temperature Monitor AVX-512 Off AVX-512 On AVX-512 On 512 20 40 60 80 100 Min: 40 / Avg: 80.67 / Max: 84 Min: 42 / Avg: 88.64 / Max: 93 Min: 43 / Avg: 88.73 / Max: 96
OSPRay Studio CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better OSPRay Studio 0.11 CPU Power Consumption Monitor AVX-512 Off AVX-512 On AVX-512 On 512 50 100 150 200 250 Min: 12.35 / Avg: 210.54 / Max: 220.82 Min: 12.76 / Avg: 236.54 / Max: 265.22 Min: 12.63 / Avg: 233.36 / Max: 267.63
OSPRay Studio CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better OSPRay Studio 0.11 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 Off AVX-512 On AVX-512 On 512 900 1800 2700 3600 4500 Min: 4700 / Avg: 4722.23 / Max: 5309 Min: 4557 / Avg: 4641.27 / Max: 5300 Min: 4550 / Avg: 4626.21 / Max: 5300
OSPRay Studio CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better OSPRay Studio 0.11 CPU Temperature Monitor AVX-512 Off AVX-512 On AVX-512 On 512 20 40 60 80 100 Min: 39 / Avg: 78.83 / Max: 83 Min: 41 / Avg: 87.07 / Max: 91 Min: 41 / Avg: 87.32 / Max: 93
OSPRay Studio CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better OSPRay Studio 0.11 CPU Power Consumption Monitor AVX-512 Off AVX-512 On AVX-512 On 512 50 100 150 200 250 Min: 12.41 / Avg: 203.49 / Max: 220.04 Min: 12.74 / Avg: 232.51 / Max: 265.53 Min: 12.75 / Avg: 230.35 / Max: 267.14
OSPRay Studio CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better OSPRay Studio 0.11 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 Off AVX-512 On AVX-512 On 512 900 1800 2700 3600 4500 Min: 4700 / Avg: 4740.31 / Max: 5310 Min: 4564 / Avg: 4689.08 / Max: 5307 Min: 3500 / Avg: 4671.61 / Max: 5300
OSPRay Studio CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better OSPRay Studio 0.11 CPU Temperature Monitor AVX-512 Off AVX-512 On AVX-512 On 512 20 40 60 80 100 Min: 40 / Avg: 76.25 / Max: 85 Min: 41 / Avg: 87.29 / Max: 92 Min: 41 / Avg: 87.49 / Max: 93
OSPRay Studio CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better OSPRay Studio 0.11 CPU Power Consumption Monitor AVX-512 Off AVX-512 On AVX-512 On 512 50 100 150 200 250 Min: 12.56 / Avg: 187.54 / Max: 219.01 Min: 12.61 / Avg: 232.9 / Max: 264 Min: 12.82 / Avg: 227.75 / Max: 264.86
OSPRay Studio CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better OSPRay Studio 0.11 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 Off AVX-512 On AVX-512 On 512 900 1800 2700 3600 4500 Min: 4700 / Avg: 4785.08 / Max: 5300 Min: 4564 / Avg: 4690.88 / Max: 5300 Min: 3500 / Avg: 4665.37 / Max: 5300
OSPRay Studio CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better OSPRay Studio 0.11 CPU Temperature Monitor AVX-512 Off AVX-512 On AVX-512 On 512 20 40 60 80 100 Min: 40 / Avg: 76.99 / Max: 83 Min: 41 / Avg: 84.31 / Max: 94 Min: 42 / Avg: 85.88 / Max: 91
OSPRay Studio CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better OSPRay Studio 0.11 CPU Power Consumption Monitor AVX-512 Off AVX-512 On AVX-512 On 512 50 100 150 200 250 Min: 12.3 / Avg: 191.08 / Max: 219.81 Min: 12.56 / Avg: 219.94 / Max: 267.67 Min: 12.69 / Avg: 217.88 / Max: 264.37
OSPRay Studio CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better OSPRay Studio 0.11 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 Off AVX-512 On AVX-512 On 512 900 1800 2700 3600 4500 Min: 4700 / Avg: 4778.13 / Max: 5310 Min: 3465 / Avg: 4730.1 / Max: 5300 Min: 4570 / Avg: 4723.71 / Max: 5300
OSPRay Studio CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better OSPRay Studio 0.11 CPU Temperature Monitor AVX-512 Off AVX-512 On AVX-512 On 512 20 40 60 80 100 Min: 40 / Avg: 78.9 / Max: 84 Min: 41 / Avg: 86.58 / Max: 95 Min: 42 / Avg: 86.55 / Max: 92
OSPRay Studio CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better OSPRay Studio 0.11 CPU Power Consumption Monitor AVX-512 Off AVX-512 On AVX-512 On 512 50 100 150 200 250 Min: 12.34 / Avg: 199.23 / Max: 219.6 Min: 12.66 / Avg: 226.89 / Max: 265.02 Min: 6.41 / Avg: 226.74 / Max: 265.64
OSPRay Studio CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better OSPRay Studio 0.11 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 Off AVX-512 On AVX-512 On 512 900 1800 2700 3600 4500 Min: 4700 / Avg: 4753.09 / Max: 5326 Min: 4561 / Avg: 4700.89 / Max: 5300 Min: 4570 / Avg: 4692.8 / Max: 5300
OSPRay Studio CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better OSPRay Studio 0.11 CPU Temperature Monitor AVX-512 Off AVX-512 On AVX-512 On 512 20 40 60 80 100 Min: 39 / Avg: 78.14 / Max: 88 Min: 41 / Avg: 86.94 / Max: 91 Min: 42 / Avg: 87.08 / Max: 93
OSPRay Studio CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better OSPRay Studio 0.11 CPU Power Consumption Monitor AVX-512 Off AVX-512 On AVX-512 On 512 50 100 150 200 250 Min: 12.47 / Avg: 198.07 / Max: 218.51 Min: 12.71 / Avg: 228.53 / Max: 263.37 Min: 12.48 / Avg: 225.22 / Max: 265.65
OSPRay Studio CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better OSPRay Studio 0.11 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 Off AVX-512 On AVX-512 On 512 900 1800 2700 3600 4500 Min: 4700 / Avg: 4753.65 / Max: 5300 Min: 4576 / Avg: 4701.44 / Max: 5300 Min: 4571 / Avg: 4680.45 / Max: 5300
OSPRay Studio CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better OSPRay Studio 0.11 CPU Temperature Monitor AVX-512 Off AVX-512 On AVX-512 On 512 20 40 60 80 100 Min: 40 / Avg: 80.21 / Max: 84 Min: 42 / Avg: 88.05 / Max: 96 Min: 41 / Avg: 88.34 / Max: 94
OSPRay Studio CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better OSPRay Studio 0.11 CPU Power Consumption Monitor AVX-512 Off AVX-512 On AVX-512 On 512 50 100 150 200 250 Min: 12.51 / Avg: 209.79 / Max: 224.27 Min: 12.78 / Avg: 234.22 / Max: 270.6 Min: 12.53 / Avg: 235.59 / Max: 266.57
OSPRay Studio CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better OSPRay Studio 0.11 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 Off AVX-512 On AVX-512 On 512 900 1800 2700 3600 4500 Min: 4700 / Avg: 4726.06 / Max: 5300 Min: 3450 / Avg: 4627.77 / Max: 5304 Min: 4546 / Avg: 4639.07 / Max: 5300
OSPRay Studio CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better OSPRay Studio 0.11 CPU Temperature Monitor AVX-512 Off AVX-512 On AVX-512 On 512 20 40 60 80 100 Min: 40 / Avg: 79.03 / Max: 84 Min: 41 / Avg: 86.52 / Max: 93 Min: 42 / Avg: 87.16 / Max: 95
OSPRay Studio CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better OSPRay Studio 0.11 CPU Power Consumption Monitor AVX-512 Off AVX-512 On AVX-512 On 512 50 100 150 200 250 Min: 12.44 / Avg: 201.82 / Max: 223.16 Min: 12.63 / Avg: 229.98 / Max: 273.69 Min: 12.72 / Avg: 226.55 / Max: 269.83
OSPRay Studio CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better OSPRay Studio 0.11 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 Off AVX-512 On AVX-512 On 512 900 1800 2700 3600 4500 Min: 4700 / Avg: 4747.54 / Max: 5300 Min: 3477 / Avg: 4691.4 / Max: 5300 Min: 3446 / Avg: 4670.53 / Max: 5310
OSPRay Studio CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better OSPRay Studio 0.11 CPU Temperature Monitor AVX-512 Off AVX-512 On AVX-512 On 512 20 40 60 80 100 Min: 41 / Avg: 79.36 / Max: 84 Min: 40 / Avg: 87.2 / Max: 96 Min: 41 / Avg: 87.44 / Max: 93
OSPRay Studio CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better OSPRay Studio 0.11 CPU Power Consumption Monitor AVX-512 Off AVX-512 On AVX-512 On 512 50 100 150 200 250 Min: 12.21 / Avg: 203.21 / Max: 220.23 Min: 12.49 / Avg: 232 / Max: 270.49 Min: 12.57 / Avg: 231.83 / Max: 266.17
OSPRay Studio CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better OSPRay Studio 0.11 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 Off AVX-512 On AVX-512 On 512 900 1800 2700 3600 4500 Min: 4700 / Avg: 4745.23 / Max: 5313 Min: 3461 / Avg: 4676.99 / Max: 5300 Min: 4570 / Avg: 4680.41 / Max: 5300
OSPRay Studio CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better OSPRay Studio 0.11 CPU Temperature Monitor AVX-512 Off AVX-512 On AVX-512 On 512 20 40 60 80 100 Min: 40 / Avg: 76.62 / Max: 83 Min: 42 / Avg: 84.38 / Max: 94 Min: 41 / Avg: 84.26 / Max: 91
OSPRay Studio CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better OSPRay Studio 0.11 CPU Power Consumption Monitor AVX-512 Off AVX-512 On AVX-512 On 512 50 100 150 200 250 Min: 12.43 / Avg: 187.52 / Max: 220.7 Min: 12.67 / Avg: 212.47 / Max: 268.13 Min: 12.52 / Avg: 215.79 / Max: 268.64
OSPRay Studio CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better OSPRay Studio 0.11 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 Off AVX-512 On AVX-512 On 512 900 1800 2700 3600 4500 Min: 4700 / Avg: 4791.69 / Max: 5308 Min: 3426 / Avg: 4746.5 / Max: 5300 Min: 4600 / Avg: 4754.09 / Max: 5300
OSPRay Studio CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better OSPRay Studio 0.11 CPU Temperature Monitor AVX-512 Off AVX-512 On AVX-512 On 512 20 40 60 80 100 Min: 40 / Avg: 78.59 / Max: 84 Min: 41 / Avg: 86.33 / Max: 94 Min: 41 / Avg: 86.12 / Max: 95
OSPRay Studio CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better OSPRay Studio 0.11 CPU Power Consumption Monitor AVX-512 Off AVX-512 On AVX-512 On 512 50 100 150 200 250 Min: 12.27 / Avg: 197.1 / Max: 221.49 Min: 12.54 / Avg: 224.93 / Max: 265.94 Min: 12.59 / Avg: 223.34 / Max: 269.08
OSPRay Studio CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better OSPRay Studio 0.11 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 Off AVX-512 On AVX-512 On 512 900 1800 2700 3600 4500 Min: 4700 / Avg: 4759.97 / Max: 5300 Min: 4567 / Avg: 4716.26 / Max: 5300 Min: 3453 / Avg: 4694.88 / Max: 5301
OSPRay Studio CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better OSPRay Studio 0.11 CPU Temperature Monitor AVX-512 Off AVX-512 On AVX-512 On 512 20 40 60 80 100 Min: 38 / Avg: 78.1 / Max: 84 Min: 38 / Avg: 85.39 / Max: 96 Min: 38 / Avg: 86.37 / Max: 93
OSPRay Studio CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better OSPRay Studio 0.11 CPU Power Consumption Monitor AVX-512 Off AVX-512 On AVX-512 On 512 50 100 150 200 250 Min: 12.2 / Avg: 196.81 / Max: 219.8 Min: 12.47 / Avg: 227.36 / Max: 267.89 Min: 12.45 / Avg: 224.9 / Max: 263.86
OSPRay Studio CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better OSPRay Studio 0.11 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 Off AVX-512 On AVX-512 On 512 900 1800 2700 3600 4500 Min: 4700 / Avg: 4759.8 / Max: 5300 Min: 3500 / Avg: 4719.74 / Max: 5310 Min: 4572 / Avg: 4702.26 / Max: 5300
OSPRay CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better OSPRay 2.10 CPU Temperature Monitor AVX-512 Off AVX-512 On AVX-512 On 512 20 40 60 80 100 Min: 39 / Avg: 81.5 / Max: 88 Min: 40 / Avg: 82.87 / Max: 95 Min: 40 / Avg: 82.89 / Max: 92
OSPRay CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better OSPRay 2.10 CPU Power Consumption Monitor AVX-512 Off AVX-512 On AVX-512 On 512 50 100 150 200 250 Min: 12.34 / Avg: 207.64 / Max: 238.67 Min: 12.35 / Avg: 206.8 / Max: 279.53 Min: 12.5 / Avg: 207.18 / Max: 278.74
OSPRay CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better OSPRay 2.10 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 Off AVX-512 On AVX-512 On 512 900 1800 2700 3600 4500 Min: 4700 / Avg: 4762.5 / Max: 5263 Min: 3500 / Avg: 4675.68 / Max: 5300 Min: 4500 / Avg: 4677.43 / Max: 5310
OSPRay Benchmark: particle_volume/pathtracer/real_time OpenBenchmarking.org Items Per Second Per Watt, More Is Better OSPRay 2.10 Benchmark: particle_volume/pathtracer/real_time AVX-512 Off AVX-512 On AVX-512 On 512 0.1888 0.3776 0.5664 0.7552 0.944 0.794 0.837 0.839
OSPRay CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better OSPRay 2.10 CPU Temperature Monitor AVX-512 Off AVX-512 On AVX-512 On 512 20 40 60 80 100 Min: 40 / Avg: 76.45 / Max: 82 Min: 41 / Avg: 82.31 / Max: 91 Min: 41 / Avg: 81.84 / Max: 91
OSPRay CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better OSPRay 2.10 CPU Power Consumption Monitor AVX-512 Off AVX-512 On AVX-512 On 512 40 80 120 160 200 Min: 12.9 / Avg: 184.06 / Max: 210.42 Min: 12.49 / Avg: 198.08 / Max: 238.61 Min: 12.55 / Avg: 198.87 / Max: 240.3
OSPRay CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better OSPRay 2.10 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 Off AVX-512 On AVX-512 On 512 900 1800 2700 3600 4500 Min: 4700 / Avg: 4763.75 / Max: 5305 Min: 4700 / Avg: 4769.71 / Max: 5300 Min: 4700 / Avg: 4769.33 / Max: 5198
OSPRay Benchmark: particle_volume/scivis/real_time OpenBenchmarking.org Items Per Second Per Watt, More Is Better OSPRay 2.10 Benchmark: particle_volume/scivis/real_time AVX-512 Off AVX-512 On AVX-512 On 512 0.0072 0.0144 0.0216 0.0288 0.036 0.032 0.025 0.025
OSPRay CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better OSPRay 2.10 CPU Temperature Monitor AVX-512 Off AVX-512 On AVX-512 On 512 20 40 60 80 100 Min: 41 / Avg: 79.36 / Max: 82 Min: 41 / Avg: 88.39 / Max: 92 Min: 42 / Avg: 88.47 / Max: 92
OSPRay CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better OSPRay 2.10 CPU Power Consumption Monitor AVX-512 Off AVX-512 On AVX-512 On 512 40 80 120 160 200 Min: 12.62 / Avg: 203.23 / Max: 210.28 Min: 12.57 / Avg: 231.69 / Max: 239.43 Min: 12.62 / Avg: 232.11 / Max: 240.01
OSPRay CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better OSPRay 2.10 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 Off AVX-512 On AVX-512 On 512 900 1800 2700 3600 4500 Min: 4700 / Avg: 4711.34 / Max: 5300 Min: 4656 / Avg: 4708 / Max: 5311 Min: 4652 / Avg: 4706.83 / Max: 5300
OSPRay Benchmark: particle_volume/ao/real_time OpenBenchmarking.org Items Per Second Per Watt, More Is Better OSPRay 2.10 Benchmark: particle_volume/ao/real_time AVX-512 Off AVX-512 On AVX-512 On 512 0.0068 0.0136 0.0204 0.0272 0.034 0.030 0.021 0.021
OSPRay CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better OSPRay 2.10 CPU Temperature Monitor AVX-512 Off AVX-512 On AVX-512 On 512 20 40 60 80 100 Min: 40 / Avg: 82.51 / Max: 87 Min: 41 / Avg: 87.66 / Max: 96 Min: 42 / Avg: 87.79 / Max: 94
OSPRay CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better OSPRay 2.10 CPU Power Consumption Monitor AVX-512 Off AVX-512 On AVX-512 On 512 50 100 150 200 250 Min: 12.55 / Avg: 216.29 / Max: 232.17 Min: 12.57 / Avg: 236.09 / Max: 283.94 Min: 12.54 / Avg: 237.53 / Max: 280.23
OSPRay CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better OSPRay 2.10 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 Off AVX-512 On AVX-512 On 512 900 1800 2700 3600 4500 Min: 4700 / Avg: 4729.58 / Max: 5300 Min: 3400 / Avg: 4599.64 / Max: 5301 Min: 4521 / Avg: 4617.05 / Max: 5300
OSPRay Benchmark: gravity_spheres_volume/dim_512/pathtracer/real_time OpenBenchmarking.org Items Per Second Per Watt, More Is Better OSPRay 2.10 Benchmark: gravity_spheres_volume/dim_512/pathtracer/real_time AVX-512 Off AVX-512 On AVX-512 On 512 0.0052 0.0104 0.0156 0.0208 0.026 0.019 0.023 0.023
OSPRay CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better OSPRay 2.10 CPU Temperature Monitor AVX-512 Off AVX-512 On AVX-512 On 512 20 40 60 80 100 Min: 39 / Avg: 77.75 / Max: 82 Min: 41 / Avg: 86.81 / Max: 93 Min: 41 / Avg: 85.73 / Max: 94
OSPRay CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better OSPRay 2.10 CPU Power Consumption Monitor AVX-512 Off AVX-512 On AVX-512 On 512 50 100 150 200 250 Min: 12.35 / Avg: 198.29 / Max: 211.32 Min: 12.49 / Avg: 236.7 / Max: 264.63 Min: 12.57 / Avg: 234.34 / Max: 264.33
OSPRay CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better OSPRay 2.10 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 Off AVX-512 On AVX-512 On 512 900 1800 2700 3600 4500 Min: 4700 / Avg: 4727.24 / Max: 5300 Min: 3500 / Avg: 4674.77 / Max: 5300 Min: 3461 / Avg: 4640.61 / Max: 5300
OSPRay Benchmark: gravity_spheres_volume/dim_512/scivis/real_time OpenBenchmarking.org Items Per Second Per Watt, More Is Better OSPRay 2.10 Benchmark: gravity_spheres_volume/dim_512/scivis/real_time AVX-512 Off AVX-512 On AVX-512 On 512 0.0043 0.0086 0.0129 0.0172 0.0215 0.014 0.018 0.019
OSPRay CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better OSPRay 2.10 CPU Temperature Monitor AVX-512 Off AVX-512 On AVX-512 On 512 20 40 60 80 100 Min: 33 / Avg: 77.15 / Max: 82 Min: 32 / Avg: 84.89 / Max: 94 Min: 32 / Avg: 85.49 / Max: 94
OSPRay CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better OSPRay 2.10 CPU Power Consumption Monitor AVX-512 Off AVX-512 On AVX-512 On 512 50 100 150 200 250 Min: 12.22 / Avg: 198.05 / Max: 219.36 Min: 12.22 / Avg: 235.26 / Max: 262.25 Min: 12.34 / Avg: 237.72 / Max: 263.57
OSPRay CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better OSPRay 2.10 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 Off AVX-512 On AVX-512 On 512 900 1800 2700 3600 4500 Min: 4700 / Avg: 4729.36 / Max: 5300 Min: 3419 / Avg: 4650.07 / Max: 5300 Min: 3422 / Avg: 4664.09 / Max: 5300
OSPRay Benchmark: gravity_spheres_volume/dim_512/ao/real_time OpenBenchmarking.org Items Per Second Per Watt, More Is Better OSPRay 2.10 Benchmark: gravity_spheres_volume/dim_512/ao/real_time AVX-512 Off AVX-512 On AVX-512 On 512 0.0043 0.0086 0.0129 0.0172 0.0215 0.014 0.019 0.019
Intel Open Image Denoise CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better Intel Open Image Denoise 1.4.0 CPU Temperature Monitor AVX-512 Off AVX-512 On AVX-512 On 512 20 40 60 80 100 Min: 33 / Avg: 66.75 / Max: 90 Min: 33 / Avg: 68.63 / Max: 93 Min: 33 / Avg: 68.65 / Max: 93
Intel Open Image Denoise CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better Intel Open Image Denoise 1.4.0 CPU Power Consumption Monitor AVX-512 Off AVX-512 On AVX-512 On 512 40 80 120 160 200 Min: 11.72 / Avg: 146.54 / Max: 222.43 Min: 11.76 / Avg: 152.88 / Max: 234.36 Min: 11.75 / Avg: 152.84 / Max: 237.4
Intel Open Image Denoise CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better Intel Open Image Denoise 1.4.0 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 Off AVX-512 On AVX-512 On 512 900 1800 2700 3600 4500 Min: 4700 / Avg: 4858.52 / Max: 5300 Min: 4119 / Avg: 4870.24 / Max: 5313 Min: 3603 / Avg: 4840.9 / Max: 5310
Intel Open Image Denoise Run: RTLightmap.hdr.4096x4096 OpenBenchmarking.org Images / Sec Per Watt, More Is Better Intel Open Image Denoise 1.4.0 Run: RTLightmap.hdr.4096x4096 AVX-512 Off AVX-512 On AVX-512 On 512 0.0002 0.0004 0.0006 0.0008 0.001 0.001 0.001 0.001
Intel Open Image Denoise CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better Intel Open Image Denoise 1.4.0 CPU Temperature Monitor AVX-512 Off AVX-512 On AVX-512 On 512 20 40 60 80 100 Min: 34 / Avg: 66 / Max: 91 Min: 34 / Avg: 68.43 / Max: 94 Min: 34 / Avg: 67.93 / Max: 95
Intel Open Image Denoise CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better Intel Open Image Denoise 1.4.0 CPU Power Consumption Monitor AVX-512 Off AVX-512 On AVX-512 On 512 40 80 120 160 200 Min: 11.88 / Avg: 141.62 / Max: 221.74 Min: 11.99 / Avg: 150.87 / Max: 235.4 Min: 11.99 / Avg: 150.51 / Max: 235.87
Intel Open Image Denoise CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better Intel Open Image Denoise 1.4.0 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 Off AVX-512 On AVX-512 On 512 900 1800 2700 3600 4500 Min: 4700 / Avg: 4875.18 / Max: 5300 Min: 4700 / Avg: 4882.39 / Max: 5312 Min: 4700 / Avg: 4857.45 / Max: 5305
Intel Open Image Denoise Run: RT.ldr_alb_nrm.3840x2160 OpenBenchmarking.org Images / Sec Per Watt, More Is Better Intel Open Image Denoise 1.4.0 Run: RT.ldr_alb_nrm.3840x2160 AVX-512 Off AVX-512 On AVX-512 On 512 0.0007 0.0014 0.0021 0.0028 0.0035 0.003 0.003 0.003
Intel Open Image Denoise CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better Intel Open Image Denoise 1.4.0 CPU Temperature Monitor AVX-512 Off AVX-512 On AVX-512 On 512 20 40 60 80 100 Min: 36 / Avg: 65.5 / Max: 88 Min: 37 / Avg: 69.29 / Max: 95 Min: 37 / Avg: 69 / Max: 95
Intel Open Image Denoise CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better Intel Open Image Denoise 1.4.0 CPU Power Consumption Monitor AVX-512 Off AVX-512 On AVX-512 On 512 40 80 120 160 200 Min: 12.01 / Avg: 141.33 / Max: 222.42 Min: 12.03 / Avg: 150.73 / Max: 237.19 Min: 12.06 / Avg: 150.88 / Max: 237.41
Intel Open Image Denoise CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better Intel Open Image Denoise 1.4.0 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 Off AVX-512 On AVX-512 On 512 900 1800 2700 3600 4500 Min: 4700 / Avg: 4865.94 / Max: 5286 Min: 3571 / Avg: 4858.54 / Max: 5310 Min: 4700 / Avg: 4851.22 / Max: 5300
Intel Open Image Denoise Run: RT.hdr_alb_nrm.3840x2160 OpenBenchmarking.org Images / Sec Per Watt, More Is Better Intel Open Image Denoise 1.4.0 Run: RT.hdr_alb_nrm.3840x2160 AVX-512 Off AVX-512 On AVX-512 On 512 0.0007 0.0014 0.0021 0.0028 0.0035 0.003 0.003 0.003
OpenVKL CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better OpenVKL 1.0 CPU Temperature Monitor AVX-512 Off AVX-512 On AVX-512 On 512 20 40 60 80 100 Min: 40 / Avg: 72.95 / Max: 82 Min: 41 / Avg: 79.75 / Max: 95 Min: 41 / Avg: 79.44 / Max: 92
OpenVKL CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better OpenVKL 1.0 CPU Power Consumption Monitor AVX-512 Off AVX-512 On AVX-512 On 512 50 100 150 200 250 Min: 12.4 / Avg: 165.67 / Max: 222.7 Min: 12.58 / Avg: 193.56 / Max: 269.81 Min: 12.63 / Avg: 193.7 / Max: 270.03
OpenVKL CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better OpenVKL 1.0 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 Off AVX-512 On AVX-512 On 512 900 1800 2700 3600 4500 Min: 4700 / Avg: 4841.21 / Max: 5326 Min: 3451 / Avg: 4805.24 / Max: 5300 Min: 3472 / Avg: 4818.52 / Max: 5304
OpenVKL Benchmark: vklBenchmark ISPC OpenBenchmarking.org Items / Sec Per Watt, More Is Better OpenVKL 1.0 Benchmark: vklBenchmark ISPC AVX-512 Off AVX-512 On AVX-512 On 512 0.1314 0.2628 0.3942 0.5256 0.657 0.525 0.584 0.578
Embree CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better Embree 3.13 CPU Temperature Monitor AVX-512 Off AVX-512 On AVX-512 On 512 20 40 60 80 100 Min: 39 / Avg: 74.03 / Max: 79 Min: 40 / Avg: 82.82 / Max: 90 Min: 40 / Avg: 82.5 / Max: 90
Embree CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better Embree 3.13 CPU Power Consumption Monitor AVX-512 Off AVX-512 On AVX-512 On 512 50 100 150 200 250 Min: 12.19 / Avg: 190.79 / Max: 210.6 Min: 12.58 / Avg: 230.62 / Max: 256.43 Min: 12.42 / Avg: 231.69 / Max: 256.24
Embree CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better Embree 3.13 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 Off AVX-512 On AVX-512 On 512 900 1800 2700 3600 4500 Min: 4700 / Avg: 4736.93 / Max: 5274 Min: 4700 / Avg: 4747.38 / Max: 5300 Min: 4700 / Avg: 4741.65 / Max: 5192
Embree Binary: Pathtracer ISPC - Model: Crown OpenBenchmarking.org Frames Per Second Per Watt, More Is Better Embree 3.13 Binary: Pathtracer ISPC - Model: Crown AVX-512 Off AVX-512 On AVX-512 On 512 0.0164 0.0328 0.0492 0.0656 0.082 0.073 0.063 0.063
Embree CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better Embree 3.13 CPU Temperature Monitor AVX-512 Off AVX-512 On AVX-512 On 512 16 32 48 64 80 Min: 39 / Avg: 68.47 / Max: 75 Min: 40 / Avg: 74.66 / Max: 84 Min: 40 / Avg: 74.96 / Max: 83
Embree CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better Embree 3.13 CPU Power Consumption Monitor AVX-512 Off AVX-512 On AVX-512 On 512 40 80 120 160 200 Min: 12.35 / Avg: 158.11 / Max: 203.56 Min: 12.36 / Avg: 186.7 / Max: 237.13 Min: 12.47 / Avg: 188.21 / Max: 237.49
Embree CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better Embree 3.13 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 Off AVX-512 On AVX-512 On 512 900 1800 2700 3600 4500 Min: 4700 / Avg: 4803.53 / Max: 5224 Min: 4700 / Avg: 4808.92 / Max: 5300 Min: 4700 / Avg: 4798.01 / Max: 5300
Embree Binary: Pathtracer ISPC - Model: Asian Dragon Obj OpenBenchmarking.org Frames Per Second Per Watt, More Is Better Embree 3.13 Binary: Pathtracer ISPC - Model: Asian Dragon Obj AVX-512 Off AVX-512 On AVX-512 On 512 0.02 0.04 0.06 0.08 0.1 0.089 0.077 0.076
Embree CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better Embree 3.13 CPU Temperature Monitor AVX-512 Off AVX-512 On AVX-512 On 512 16 32 48 64 80 Min: 37 / Avg: 69.41 / Max: 75 Min: 38 / Avg: 76.74 / Max: 85 Min: 39 / Avg: 76.82 / Max: 84
Embree CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better Embree 3.13 CPU Power Consumption Monitor AVX-512 Off AVX-512 On AVX-512 On 512 40 80 120 160 200 Min: 12.16 / Avg: 176.35 / Max: 205.68 Min: 12.6 / Avg: 212.97 / Max: 241.03 Min: 12.42 / Avg: 212.61 / Max: 240.22
Embree CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better Embree 3.13 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 Off AVX-512 On AVX-512 On 512 900 1800 2700 3600 4500 Min: 4700 / Avg: 4765.12 / Max: 5300 Min: 4700 / Avg: 4748.06 / Max: 5300 Min: 4700 / Avg: 4746.84 / Max: 5101
Embree Binary: Pathtracer ISPC - Model: Asian Dragon OpenBenchmarking.org Frames Per Second Per Watt, More Is Better Embree 3.13 Binary: Pathtracer ISPC - Model: Asian Dragon AVX-512 Off AVX-512 On AVX-512 On 512 0.0203 0.0406 0.0609 0.0812 0.1015 0.090 0.078 0.077
dav1d CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better dav1d 1.0 CPU Temperature Monitor AVX-512 Off AVX-512 On AVX-512 On 512 15 30 45 60 75 Min: 36 / Avg: 62.16 / Max: 72 Min: 38 / Avg: 69.14 / Max: 80 Min: 38 / Avg: 68.94 / Max: 81
dav1d CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better dav1d 1.0 CPU Power Consumption Monitor AVX-512 Off AVX-512 On AVX-512 On 512 40 80 120 160 200 Min: 12.37 / Avg: 147.97 / Max: 189.99 Min: 12.44 / Avg: 176.58 / Max: 231.88 Min: 12.28 / Avg: 176.77 / Max: 228.64
dav1d CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better dav1d 1.0 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 Off AVX-512 On AVX-512 On 512 900 1800 2700 3600 4500 Min: 4700 / Avg: 4850.01 / Max: 5296 Min: 4700 / Avg: 4791.38 / Max: 5299 Min: 4700 / Avg: 4794.56 / Max: 5310
dav1d Video Input: Chimera 1080p 10-bit OpenBenchmarking.org FPS Per Watt, More Is Better dav1d 1.0 Video Input: Chimera 1080p 10-bit AVX-512 Off AVX-512 On AVX-512 On 512 0.7407 1.4814 2.2221 2.9628 3.7035 3.292 2.893 2.699
dav1d CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better dav1d 1.0 CPU Temperature Monitor AVX-512 Off AVX-512 On AVX-512 On 512 16 32 48 64 80 Min: 36 / Avg: 62.58 / Max: 73 Min: 38 / Avg: 69.91 / Max: 85 Min: 39 / Avg: 69.68 / Max: 86
dav1d CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better dav1d 1.0 CPU Power Consumption Monitor AVX-512 Off AVX-512 On AVX-512 On 512 40 80 120 160 200 Min: 12.15 / Avg: 144.63 / Max: 196.82 Min: 12.51 / Avg: 174.06 / Max: 240.93 Min: 6.61 / Avg: 175.75 / Max: 241.88
dav1d CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better dav1d 1.0 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 Off AVX-512 On AVX-512 On 512 900 1800 2700 3600 4500 Min: 4700 / Avg: 4858.22 / Max: 5310 Min: 4700 / Avg: 4821.12 / Max: 5300 Min: 4700 / Avg: 4815.92 / Max: 5300
dav1d Video Input: Chimera 1080p OpenBenchmarking.org FPS Per Watt, More Is Better dav1d 1.0 Video Input: Chimera 1080p AVX-512 Off AVX-512 On AVX-512 On 512 1.0757 2.1514 3.2271 4.3028 5.3785 4.781 4.220 4.141
dav1d CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better dav1d 1.0 CPU Temperature Monitor AVX-512 Off AVX-512 On AVX-512 On 512 16 32 48 64 80 Min: 35 / Avg: 62.8 / Max: 73 Min: 34 / Avg: 70.34 / Max: 86 Min: 36 / Avg: 70.99 / Max: 85
dav1d CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better dav1d 1.0 CPU Power Consumption Monitor AVX-512 Off AVX-512 On AVX-512 On 512 40 80 120 160 200 Min: 6.5 / Avg: 155.12 / Max: 197.33 Min: 12.01 / Avg: 189.65 / Max: 246.19 Min: 12.1 / Avg: 189.54 / Max: 242.47
dav1d CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better dav1d 1.0 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 Off AVX-512 On AVX-512 On 512 900 1800 2700 3600 4500 Min: 4700 / Avg: 4854.52 / Max: 5304 Min: 4700 / Avg: 4790.25 / Max: 5300 Min: 4700 / Avg: 4792.86 / Max: 5300
dav1d Video Input: Summer Nature 4K OpenBenchmarking.org FPS Per Watt, More Is Better dav1d 1.0 Video Input: Summer Nature 4K AVX-512 Off AVX-512 On AVX-512 On 512 0.2795 0.559 0.8385 1.118 1.3975 1.242 1.092 1.007
dav1d CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better dav1d 1.0 CPU Temperature Monitor AVX-512 Off AVX-512 On AVX-512 On 512 15 30 45 60 75 Min: 30 / Avg: 49.97 / Max: 70 Min: 31 / Avg: 55.32 / Max: 80 Min: 32 / Avg: 56.14 / Max: 79
dav1d CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better dav1d 1.0 CPU Power Consumption Monitor AVX-512 Off AVX-512 On AVX-512 On 512 40 80 120 160 200 Min: 11.76 / Avg: 104.25 / Max: 203.56 Min: 12.01 / Avg: 122.85 / Max: 243.48 Min: 12.1 / Avg: 122.86 / Max: 243.01
dav1d CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better dav1d 1.0 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 Off AVX-512 On AVX-512 On 512 900 1800 2700 3600 4500 Min: 4777 / Avg: 4979.34 / Max: 5300 Min: 4700 / Avg: 4954.03 / Max: 5302 Min: 4700 / Avg: 4943.85 / Max: 5300
dav1d Video Input: Summer Nature 1080p OpenBenchmarking.org FPS Per Watt, More Is Better dav1d 1.0 Video Input: Summer Nature 1080p AVX-512 Off AVX-512 On AVX-512 On 512 2 4 6 8 10 8.435 7.283 7.349
simdjson CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better simdjson 2.0 CPU Temperature Monitor AVX-512 Off AVX-512 On AVX-512 On 512 13 26 39 52 65 Min: 31 / Avg: 59.16 / Max: 64 Min: 31 / Avg: 61.48 / Max: 66 Min: 32 / Avg: 62.1 / Max: 66
simdjson CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better simdjson 2.0 CPU Power Consumption Monitor AVX-512 Off AVX-512 On AVX-512 On 512 13 26 39 52 65 Min: 11.88 / Avg: 58.68 / Max: 62.89 Min: 11.88 / Avg: 63.33 / Max: 67.43 Min: 11.74 / Avg: 63.23 / Max: 67.46
simdjson CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better simdjson 2.0 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 Off AVX-512 On AVX-512 On 512 900 1800 2700 3600 4500 Min: 5100 / Avg: 5288.44 / Max: 5300 Min: 4928 / Avg: 5001.48 / Max: 5300 Min: 4901 / Avg: 4998.59 / Max: 5300
simdjson Throughput Test: TopTweet OpenBenchmarking.org GB/s Per Watt, More Is Better simdjson 2.0 Throughput Test: TopTweet AVX-512 Off AVX-512 On AVX-512 On 512 0.0313 0.0626 0.0939 0.1252 0.1565 0.108 0.139 0.139
simdjson CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better simdjson 2.0 CPU Temperature Monitor AVX-512 Off AVX-512 On AVX-512 On 512 13 26 39 52 65 Min: 31 / Avg: 60.86 / Max: 64 Min: 32 / Avg: 62.56 / Max: 67 Min: 32 / Avg: 61.85 / Max: 66
simdjson CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better simdjson 2.0 CPU Power Consumption Monitor AVX-512 Off AVX-512 On AVX-512 On 512 13 26 39 52 65 Min: 11.88 / Avg: 59.01 / Max: 62.7 Min: 11.84 / Avg: 63.44 / Max: 67.76 Min: 11.77 / Avg: 63.39 / Max: 67.58
simdjson CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better simdjson 2.0 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 Off AVX-512 On AVX-512 On 512 900 1800 2700 3600 4500 Min: 5100 / Avg: 5291.72 / Max: 5319 Min: 4901 / Avg: 5003.41 / Max: 5303 Min: 4900 / Avg: 4999.18 / Max: 5300
simdjson Throughput Test: DistinctUserID OpenBenchmarking.org GB/s Per Watt, More Is Better simdjson 2.0 Throughput Test: DistinctUserID AVX-512 Off AVX-512 On AVX-512 On 512 0.0311 0.0622 0.0933 0.1244 0.1555 0.107 0.138 0.138
simdjson CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better simdjson 2.0 CPU Temperature Monitor AVX-512 Off AVX-512 On AVX-512 On 512 12 24 36 48 60 Min: 31 / Avg: 56.21 / Max: 61 Min: 32 / Avg: 56.14 / Max: 63 Min: 32 / Avg: 56.59 / Max: 63
simdjson CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better simdjson 2.0 CPU Power Consumption Monitor AVX-512 Off AVX-512 On AVX-512 On 512 12 24 36 48 60 Min: 11.78 / Avg: 55.55 / Max: 59.77 Min: 11.9 / Avg: 56.95 / Max: 60.96 Min: 11.79 / Avg: 57.11 / Max: 61.15
simdjson CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better simdjson 2.0 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 Off AVX-512 On AVX-512 On 512 1000 2000 3000 4000 5000 Min: 5100 / Avg: 5288.13 / Max: 5498 Min: 4976 / Avg: 5227.59 / Max: 5300 Min: 4966 / Avg: 5223.47 / Max: 5300
simdjson Throughput Test: Kostya OpenBenchmarking.org GB/s Per Watt, More Is Better simdjson 2.0 Throughput Test: Kostya AVX-512 Off AVX-512 On AVX-512 On 512 0.018 0.036 0.054 0.072 0.09 0.069 0.080 0.079
simdjson CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better simdjson 2.0 CPU Temperature Monitor AVX-512 Off AVX-512 On AVX-512 On 512 12 24 36 48 60 Min: 32 / Avg: 58.34 / Max: 63 Min: 32 / Avg: 58.29 / Max: 63 Min: 32 / Avg: 58.34 / Max: 63
simdjson CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better simdjson 2.0 CPU Power Consumption Monitor AVX-512 Off AVX-512 On AVX-512 On 512 12 24 36 48 60 Min: 11.95 / Avg: 55.09 / Max: 59.62 Min: 11.88 / Avg: 55.9 / Max: 60.31 Min: 11.92 / Avg: 56.3 / Max: 60.48
simdjson CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better simdjson 2.0 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 Off AVX-512 On AVX-512 On 512 1000 2000 3000 4000 5000 Min: 5100 / Avg: 5283.99 / Max: 5300 Min: 4975 / Avg: 5256.72 / Max: 5541 Min: 4994 / Avg: 5238.51 / Max: 5310
simdjson Throughput Test: LargeRandom OpenBenchmarking.org GB/s Per Watt, More Is Better simdjson 2.0 Throughput Test: LargeRandom AVX-512 Off AVX-512 On AVX-512 On 512 0.0059 0.0118 0.0177 0.0236 0.0295 0.025 0.026 0.026
simdjson CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better simdjson 2.0 CPU Temperature Monitor AVX-512 Off AVX-512 On AVX-512 On 512 14 28 42 56 70 Min: 34 / Avg: 62.29 / Max: 70 Min: 34 / Avg: 63.86 / Max: 68 Min: 33 / Avg: 63.44 / Max: 67
simdjson CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better simdjson 2.0 CPU Power Consumption Monitor AVX-512 Off AVX-512 On AVX-512 On 512 13 26 39 52 65 Min: 11.94 / Avg: 59.59 / Max: 65.08 Min: 11.91 / Avg: 63.23 / Max: 67.98 Min: 12.12 / Avg: 62.94 / Max: 67.82
simdjson CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better simdjson 2.0 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 Off AVX-512 On AVX-512 On 512 900 1800 2700 3600 4500 Min: 5100 / Avg: 5289.95 / Max: 5318 Min: 4901 / Avg: 4982.12 / Max: 5233 Min: 4810 / Avg: 4978.7 / Max: 5258
simdjson Throughput Test: PartialTweets OpenBenchmarking.org GB/s Per Watt, More Is Better simdjson 2.0 Throughput Test: PartialTweets AVX-512 Off AVX-512 On AVX-512 On 512 0.0304 0.0608 0.0912 0.1216 0.152 0.104 0.135 0.135
LeelaChessZero CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better LeelaChessZero 0.28 CPU Temperature Monitor AVX-512 Off AVX-512 On AVX-512 On 512 20 40 60 80 100 Min: 39 / Avg: 72.12 / Max: 84 Min: 39 / Avg: 82.03 / Max: 93 Min: 39 / Avg: 81.97 / Max: 94
LeelaChessZero CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better LeelaChessZero 0.28 CPU Power Consumption Monitor AVX-512 Off AVX-512 On AVX-512 On 512 40 80 120 160 200 Min: 12.39 / Avg: 168.69 / Max: 185.14 Min: 12.13 / Avg: 206.92 / Max: 228.93 Min: 12.29 / Avg: 208.24 / Max: 229.04
LeelaChessZero CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better LeelaChessZero 0.28 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 Off AVX-512 On AVX-512 On 512 900 1800 2700 3600 4500 Min: 4700 / Avg: 4742.26 / Max: 5300 Min: 4700 / Avg: 4716.16 / Max: 5309 Min: 4700 / Avg: 4714.46 / Max: 5300
LeelaChessZero Backend: Eigen OpenBenchmarking.org Nodes Per Second Per Watt, More Is Better LeelaChessZero 0.28 Backend: Eigen AVX-512 Off AVX-512 On AVX-512 On 512 2 4 6 8 10 6.296 5.732 5.734
LeelaChessZero CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better LeelaChessZero 0.28 CPU Temperature Monitor AVX-512 Off AVX-512 On AVX-512 On 512 20 40 60 80 100 Min: 38 / Avg: 72.81 / Max: 86 Min: 37 / Avg: 81.96 / Max: 92 Min: 38 / Avg: 82.27 / Max: 94
LeelaChessZero CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better LeelaChessZero 0.28 CPU Power Consumption Monitor AVX-512 Off AVX-512 On AVX-512 On 512 40 80 120 160 200 Min: 12.26 / Avg: 169.99 / Max: 187.33 Min: 12.29 / Avg: 208.54 / Max: 230.94 Min: 12.35 / Avg: 210.02 / Max: 231.6
LeelaChessZero CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better LeelaChessZero 0.28 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 Off AVX-512 On AVX-512 On 512 900 1800 2700 3600 4500 Min: 4700 / Avg: 4730.95 / Max: 5300 Min: 4700 / Avg: 4714.39 / Max: 5302 Min: 4700 / Avg: 4715.02 / Max: 5309
LeelaChessZero Backend: BLAS OpenBenchmarking.org Nodes Per Second Per Watt, More Is Better LeelaChessZero 0.28 Backend: BLAS AVX-512 Off AVX-512 On AVX-512 On 512 2 4 6 8 10 7.295 6.080 6.061
OpenFOAM CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better OpenFOAM 10 CPU Temperature Monitor AVX-512 Off AVX-512 On AVX-512 On 512 14 28 42 56 70 Min: 38 / Avg: 60.32 / Max: 71 Min: 38 / Avg: 61.46 / Max: 73 Min: 38 / Avg: 61.09 / Max: 71
OpenFOAM CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better OpenFOAM 10 CPU Power Consumption Monitor AVX-512 Off AVX-512 On AVX-512 On 512 30 60 90 120 150 Min: 12.27 / Avg: 134.48 / Max: 185.27 Min: 12.47 / Avg: 137.27 / Max: 176.06 Min: 12.28 / Avg: 137.66 / Max: 174.47
OpenFOAM CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better OpenFOAM 10 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 Off AVX-512 On AVX-512 On 512 900 1800 2700 3600 4500 Min: 4731 / Avg: 4807.69 / Max: 5300 Min: 4700 / Avg: 4805.98 / Max: 5300 Min: 4700 / Avg: 4808.62 / Max: 5301
OpenRadioss CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better OpenRadioss 2022.10.13 CPU Temperature Monitor AVX-512 Off AVX-512 On AVX-512 On 512 15 30 45 60 75 Min: 38 / Avg: 69.5 / Max: 75 Min: 39 / Avg: 70.02 / Max: 75 Min: 38 / Avg: 69.98 / Max: 76
OpenRadioss CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better OpenRadioss 2022.10.13 CPU Power Consumption Monitor AVX-512 Off AVX-512 On AVX-512 On 512 30 60 90 120 150 Min: 12.5 / Avg: 163.73 / Max: 168.75 Min: 12.49 / Avg: 165.47 / Max: 171.6 Min: 12.33 / Avg: 166.01 / Max: 172.07
OpenRadioss CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better OpenRadioss 2022.10.13 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 Off AVX-512 On AVX-512 On 512 900 1800 2700 3600 4500 Min: 4700 / Avg: 4796.02 / Max: 5300 Min: 4700 / Avg: 4786.9 / Max: 5311 Min: 4700 / Avg: 4786.28 / Max: 5301
OpenRadioss CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better OpenRadioss 2022.10.13 CPU Temperature Monitor AVX-512 Off AVX-512 On AVX-512 On 512 15 30 45 60 75 Min: 39 / Avg: 72.15 / Max: 77 Min: 39 / Avg: 72.25 / Max: 77 Min: 39 / Avg: 72.17 / Max: 77
OpenRadioss CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better OpenRadioss 2022.10.13 CPU Power Consumption Monitor AVX-512 Off AVX-512 On AVX-512 On 512 40 80 120 160 200 Min: 12.52 / Avg: 170 / Max: 193.93 Min: 12.46 / Avg: 170.68 / Max: 195.05 Min: 12.18 / Avg: 171.5 / Max: 195.54
OpenRadioss CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better OpenRadioss 2022.10.13 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 Off AVX-512 On AVX-512 On 512 900 1800 2700 3600 4500 Min: 4700 / Avg: 4725.71 / Max: 5303 Min: 4700 / Avg: 4728.36 / Max: 5300 Min: 4700 / Avg: 4723.82 / Max: 5299
OpenRadioss CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better OpenRadioss 2022.10.13 CPU Temperature Monitor AVX-512 Off AVX-512 On AVX-512 On 512 15 30 45 60 75 Min: 39 / Avg: 69.57 / Max: 75 Min: 39 / Avg: 69.91 / Max: 76 Min: 39 / Avg: 69.64 / Max: 75
OpenRadioss CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better OpenRadioss 2022.10.13 CPU Power Consumption Monitor AVX-512 Off AVX-512 On AVX-512 On 512 30 60 90 120 150 Min: 12.35 / Avg: 164.91 / Max: 183.91 Min: 12.46 / Avg: 165.44 / Max: 186 Min: 12.38 / Avg: 166.68 / Max: 187.69
OpenRadioss CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better OpenRadioss 2022.10.13 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 Off AVX-512 On AVX-512 On 512 900 1800 2700 3600 4500 Min: 4700 / Avg: 4779.68 / Max: 5309 Min: 4700 / Avg: 4776.23 / Max: 5300 Min: 4700 / Avg: 4779.74 / Max: 5300
OpenRadioss CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better OpenRadioss 2022.10.13 CPU Temperature Monitor AVX-512 Off AVX-512 On AVX-512 On 512 14 28 42 56 70 Min: 38 / Avg: 69.59 / Max: 73 Min: 38 / Avg: 70.36 / Max: 75 Min: 38 / Avg: 70.17 / Max: 75
OpenRadioss CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better OpenRadioss 2022.10.13 CPU Power Consumption Monitor AVX-512 Off AVX-512 On AVX-512 On 512 30 60 90 120 150 Min: 12.42 / Avg: 166.23 / Max: 179.39 Min: 12.59 / Avg: 167.03 / Max: 184.87 Min: 12.45 / Avg: 168.45 / Max: 185.36
OpenRadioss CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better OpenRadioss 2022.10.13 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 Off AVX-512 On AVX-512 On 512 900 1800 2700 3600 4500 Min: 4700 / Avg: 4789.33 / Max: 5302 Min: 4700 / Avg: 4744.78 / Max: 5300 Min: 4700 / Avg: 4746.34 / Max: 5300
OpenRadioss CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better OpenRadioss 2022.10.13 CPU Temperature Monitor AVX-512 Off AVX-512 On AVX-512 On 512 14 28 42 56 70 Min: 38 / Avg: 70.2 / Max: 74 Min: 39 / Avg: 70.71 / Max: 75 Min: 40 / Avg: 70.47 / Max: 75
OpenRadioss CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better OpenRadioss 2022.10.13 CPU Power Consumption Monitor AVX-512 Off AVX-512 On AVX-512 On 512 30 60 90 120 150 Min: 12.24 / Avg: 164.06 / Max: 177.04 Min: 12.55 / Avg: 164.63 / Max: 179.72 Min: 12.45 / Avg: 165.14 / Max: 181.24
OpenRadioss CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better OpenRadioss 2022.10.13 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 Off AVX-512 On AVX-512 On 512 900 1800 2700 3600 4500 Min: 4700 / Avg: 4764.39 / Max: 5301 Min: 4700 / Avg: 4738.14 / Max: 5300 Min: 4700 / Avg: 4752.2 / Max: 5302
Neural Magic DeepSparse CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better Neural Magic DeepSparse 1.1 CPU Temperature Monitor AVX-512 Off AVX-512 On AVX-512 On 512 20 40 60 80 100 Min: 39 / Avg: 72.53 / Max: 86 Min: 39 / Avg: 77.07 / Max: 96 Min: 40 / Avg: 78.84 / Max: 95
Neural Magic DeepSparse CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better Neural Magic DeepSparse 1.1 CPU Power Consumption Monitor AVX-512 Off AVX-512 On AVX-512 On 512 50 100 150 200 250 Min: 12.4 / Avg: 167.72 / Max: 220.91 Min: 12.69 / Avg: 185.26 / Max: 260.57 Min: 12.54 / Avg: 189.06 / Max: 260.04
Neural Magic DeepSparse CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better Neural Magic DeepSparse 1.1 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 Off AVX-512 On AVX-512 On 512 900 1800 2700 3600 4500 Min: 4700 / Avg: 4864.76 / Max: 5300 Min: 3500 / Avg: 4712.83 / Max: 5302 Min: 3500 / Avg: 4792.63 / Max: 5301
Neural Magic DeepSparse CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better Neural Magic DeepSparse 1.1 CPU Temperature Monitor AVX-512 Off AVX-512 On AVX-512 On 512 20 40 60 80 100 Min: 38 / Avg: 71.94 / Max: 85 Min: 38 / Avg: 79.14 / Max: 93 Min: 39 / Avg: 79.22 / Max: 92
Neural Magic DeepSparse CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better Neural Magic DeepSparse 1.1 CPU Power Consumption Monitor AVX-512 Off AVX-512 On AVX-512 On 512 50 100 150 200 250 Min: 12.27 / Avg: 168.07 / Max: 217.66 Min: 12.46 / Avg: 191.4 / Max: 257.39 Min: 12.35 / Avg: 194.31 / Max: 256.42
Neural Magic DeepSparse CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better Neural Magic DeepSparse 1.1 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 Off AVX-512 On AVX-512 On 512 900 1800 2700 3600 4500 Min: 4700 / Avg: 4854.95 / Max: 5363 Min: 3500 / Avg: 4768.23 / Max: 5302 Min: 4587 / Avg: 4805.51 / Max: 5300
Neural Magic DeepSparse CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better Neural Magic DeepSparse 1.1 CPU Temperature Monitor AVX-512 Off AVX-512 On AVX-512 On 512 20 40 60 80 100 Min: 39 / Avg: 74.07 / Max: 85 Min: 40 / Avg: 80.82 / Max: 93 Min: 39 / Avg: 80.84 / Max: 95
Neural Magic DeepSparse CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better Neural Magic DeepSparse 1.1 CPU Power Consumption Monitor AVX-512 Off AVX-512 On AVX-512 On 512 40 80 120 160 200 Min: 12.46 / Avg: 181.5 / Max: 215.22 Min: 12.65 / Avg: 200.79 / Max: 239.52 Min: 12.46 / Avg: 204.1 / Max: 244.9
Neural Magic DeepSparse CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better Neural Magic DeepSparse 1.1 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 Off AVX-512 On AVX-512 On 512 900 1800 2700 3600 4500 Min: 4700 / Avg: 4785.41 / Max: 5300 Min: 3578 / Avg: 4752.98 / Max: 5300 Min: 4700 / Avg: 4783.64 / Max: 5301
Neural Magic DeepSparse CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better Neural Magic DeepSparse 1.1 CPU Temperature Monitor AVX-512 Off AVX-512 On AVX-512 On 512 20 40 60 80 100 Min: 38 / Avg: 73.22 / Max: 82 Min: 39 / Avg: 80.23 / Max: 93 Min: 39 / Avg: 80.25 / Max: 92
Neural Magic DeepSparse CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better Neural Magic DeepSparse 1.1 CPU Power Consumption Monitor AVX-512 Off AVX-512 On AVX-512 On 512 40 80 120 160 200 Min: 12.46 / Avg: 178.55 / Max: 211.42 Min: 12.29 / Avg: 195.66 / Max: 239.75 Min: 12.46 / Avg: 200.45 / Max: 240.26
Neural Magic DeepSparse CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better Neural Magic DeepSparse 1.1 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 Off AVX-512 On AVX-512 On 512 900 1800 2700 3600 4500 Min: 4700 / Avg: 4792.9 / Max: 5300 Min: 4700 / Avg: 4785.87 / Max: 5309 Min: 4700 / Avg: 4796.86 / Max: 5302
Neural Magic DeepSparse CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better Neural Magic DeepSparse 1.1 CPU Temperature Monitor AVX-512 Off AVX-512 On AVX-512 On 512 20 40 60 80 100 Min: 39 / Avg: 65.01 / Max: 75 Min: 40 / Avg: 74.99 / Max: 88 Min: 37 / Avg: 73.66 / Max: 88
Neural Magic DeepSparse CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better Neural Magic DeepSparse 1.1 CPU Power Consumption Monitor AVX-512 Off AVX-512 On AVX-512 On 512 40 80 120 160 200 Min: 12.57 / Avg: 151.3 / Max: 208.63 Min: 12.58 / Avg: 186.84 / Max: 241.51 Min: 12.39 / Avg: 185.33 / Max: 241.17
Neural Magic DeepSparse CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better Neural Magic DeepSparse 1.1 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 Off AVX-512 On AVX-512 On 512 900 1800 2700 3600 4500 Min: 4700 / Avg: 4899.77 / Max: 5314 Min: 4700 / Avg: 4803.42 / Max: 5300 Min: 4700 / Avg: 4813.34 / Max: 5300
Neural Magic DeepSparse CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better Neural Magic DeepSparse 1.1 CPU Temperature Monitor AVX-512 Off AVX-512 On AVX-512 On 512 20 40 60 80 100 Min: 38 / Avg: 64.6 / Max: 73 Min: 39 / Avg: 75.07 / Max: 90 Min: 38 / Avg: 73.65 / Max: 89
Neural Magic DeepSparse CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better Neural Magic DeepSparse 1.1 CPU Power Consumption Monitor AVX-512 Off AVX-512 On AVX-512 On 512 50 100 150 200 250 Min: 12.29 / Avg: 152.74 / Max: 206.29 Min: 12.24 / Avg: 188.78 / Max: 249.74 Min: 12.27 / Avg: 178.55 / Max: 250.04
Neural Magic DeepSparse CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better Neural Magic DeepSparse 1.1 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 Off AVX-512 On AVX-512 On 512 900 1800 2700 3600 4500 Min: 4700 / Avg: 4884.74 / Max: 5310 Min: 4700 / Avg: 4810.87 / Max: 5300 Min: 4700 / Avg: 4865.03 / Max: 5312
Neural Magic DeepSparse CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better Neural Magic DeepSparse 1.1 CPU Temperature Monitor AVX-512 Off AVX-512 On AVX-512 On 512 20 40 60 80 100 Min: 39 / Avg: 72.83 / Max: 87 Min: 41 / Avg: 76.64 / Max: 95 Min: 40 / Avg: 78.69 / Max: 92
Neural Magic DeepSparse CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better Neural Magic DeepSparse 1.1 CPU Power Consumption Monitor AVX-512 Off AVX-512 On AVX-512 On 512 50 100 150 200 250 Min: 12.43 / Avg: 168.83 / Max: 221.42 Min: 12.5 / Avg: 186.42 / Max: 260.13 Min: 12.39 / Avg: 189.75 / Max: 259.61
Neural Magic DeepSparse CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better Neural Magic DeepSparse 1.1 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 Off AVX-512 On AVX-512 On 512 900 1800 2700 3600 4500 Min: 4700 / Avg: 4862.17 / Max: 5301 Min: 3500 / Avg: 4711.32 / Max: 5304 Min: 4389 / Avg: 4809.78 / Max: 5300
Neural Magic DeepSparse CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better Neural Magic DeepSparse 1.1 CPU Temperature Monitor AVX-512 Off AVX-512 On AVX-512 On 512 20 40 60 80 100 Min: 38 / Avg: 71.71 / Max: 85 Min: 39 / Avg: 78.7 / Max: 94 Min: 39 / Avg: 79.14 / Max: 92
Neural Magic DeepSparse CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better Neural Magic DeepSparse 1.1 CPU Power Consumption Monitor AVX-512 Off AVX-512 On AVX-512 On 512 50 100 150 200 250 Min: 12.38 / Avg: 167.69 / Max: 217.29 Min: 12.46 / Avg: 192.59 / Max: 258.71 Min: 12.38 / Avg: 193.85 / Max: 256.16
Neural Magic DeepSparse CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better Neural Magic DeepSparse 1.1 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 Off AVX-512 On AVX-512 On 512 900 1800 2700 3600 4500 Min: 4700 / Avg: 4847.56 / Max: 5310 Min: 3500 / Avg: 4747.88 / Max: 5310 Min: 4575 / Avg: 4802.05 / Max: 5300
Neural Magic DeepSparse CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better Neural Magic DeepSparse 1.1 CPU Temperature Monitor AVX-512 Off AVX-512 On AVX-512 On 512 20 40 60 80 100 Min: 40 / Avg: 78.22 / Max: 86 Min: 40 / Avg: 82.42 / Max: 94 Min: 41 / Avg: 82.64 / Max: 96
Neural Magic DeepSparse CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better Neural Magic DeepSparse 1.1 CPU Power Consumption Monitor AVX-512 Off AVX-512 On AVX-512 On 512 50 100 150 200 250 Min: 12.46 / Avg: 198.19 / Max: 227.43 Min: 12.48 / Avg: 211.14 / Max: 256.86 Min: 12.31 / Avg: 211.91 / Max: 258.7
Neural Magic DeepSparse CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better Neural Magic DeepSparse 1.1 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 Off AVX-512 On AVX-512 On 512 900 1800 2700 3600 4500 Min: 4700 / Avg: 4768.47 / Max: 5302 Min: 3500 / Avg: 4648.5 / Max: 5302 Min: 3500 / Avg: 4682.19 / Max: 5300
Neural Magic DeepSparse CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better Neural Magic DeepSparse 1.1 CPU Temperature Monitor AVX-512 Off AVX-512 On AVX-512 On 512 20 40 60 80 100 Min: 39 / Avg: 74.18 / Max: 83 Min: 38 / Avg: 79.49 / Max: 92 Min: 39 / Avg: 81.82 / Max: 92
Neural Magic DeepSparse CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better Neural Magic DeepSparse 1.1 CPU Power Consumption Monitor AVX-512 Off AVX-512 On AVX-512 On 512 40 80 120 160 200 Min: 12.35 / Avg: 183.63 / Max: 214.9 Min: 12.32 / Avg: 201.37 / Max: 246.43 Min: 12.3 / Avg: 209.51 / Max: 246.88
Neural Magic DeepSparse CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better Neural Magic DeepSparse 1.1 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 Off AVX-512 On AVX-512 On 512 900 1800 2700 3600 4500 Min: 4700 / Avg: 4780.8 / Max: 5312 Min: 3556 / Avg: 4766.8 / Max: 5302 Min: 4631 / Avg: 4780.28 / Max: 5300
Neural Magic DeepSparse CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better Neural Magic DeepSparse 1.1 CPU Temperature Monitor AVX-512 Off AVX-512 On AVX-512 On 512 16 32 48 64 80 Min: 39 / Avg: 69.87 / Max: 78 Min: 40 / Avg: 73.39 / Max: 81 Min: 39 / Avg: 73.25 / Max: 82
Neural Magic DeepSparse CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better Neural Magic DeepSparse 1.1 CPU Power Consumption Monitor AVX-512 Off AVX-512 On AVX-512 On 512 40 80 120 160 200 Min: 12.42 / Avg: 169 / Max: 204.27 Min: 12.55 / Avg: 190.88 / Max: 225.22 Min: 12.41 / Avg: 191.37 / Max: 225.56
Neural Magic DeepSparse CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better Neural Magic DeepSparse 1.1 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 Off AVX-512 On AVX-512 On 512 900 1800 2700 3600 4500 Min: 4700 / Avg: 4802.88 / Max: 5301 Min: 4700 / Avg: 4777.02 / Max: 5300 Min: 4700 / Avg: 4777.6 / Max: 5301
Neural Magic DeepSparse CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better Neural Magic DeepSparse 1.1 CPU Temperature Monitor AVX-512 Off AVX-512 On AVX-512 On 512 15 30 45 60 75 Min: 38 / Avg: 66.44 / Max: 73 Min: 40 / Avg: 72.9 / Max: 79 Min: 38 / Avg: 69.89 / Max: 79
Neural Magic DeepSparse CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better Neural Magic DeepSparse 1.1 CPU Power Consumption Monitor AVX-512 Off AVX-512 On AVX-512 On 512 40 80 120 160 200 Min: 12.39 / Avg: 153.63 / Max: 193.33 Min: 12.29 / Avg: 180.67 / Max: 210.72 Min: 12.32 / Avg: 171.93 / Max: 211.04
Neural Magic DeepSparse CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better Neural Magic DeepSparse 1.1 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 Off AVX-512 On AVX-512 On 512 900 1800 2700 3600 4500 Min: 4700 / Avg: 4829.28 / Max: 5301 Min: 4700 / Avg: 4769.5 / Max: 5309 Min: 4700 / Avg: 4800.61 / Max: 5310
Neural Magic DeepSparse CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better Neural Magic DeepSparse 1.1 CPU Temperature Monitor AVX-512 Off AVX-512 On AVX-512 On 512 20 40 60 80 100 Min: 38 / Avg: 72.32 / Max: 85 Min: 40 / Avg: 78.33 / Max: 92 Min: 39 / Avg: 78.25 / Max: 94
Neural Magic DeepSparse CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better Neural Magic DeepSparse 1.1 CPU Power Consumption Monitor AVX-512 Off AVX-512 On AVX-512 On 512 50 100 150 200 250 Min: 12.38 / Avg: 167.33 / Max: 219.34 Min: 12.48 / Avg: 190.62 / Max: 260.18 Min: 12.38 / Avg: 190.62 / Max: 262.43
Neural Magic DeepSparse CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better Neural Magic DeepSparse 1.1 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 Off AVX-512 On AVX-512 On 512 900 1800 2700 3600 4500 Min: 4700 / Avg: 4864.38 / Max: 5300 Min: 4550 / Avg: 4788.85 / Max: 5300 Min: 3500 / Avg: 4771.09 / Max: 5310
Neural Magic DeepSparse CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better Neural Magic DeepSparse 1.1 CPU Temperature Monitor AVX-512 Off AVX-512 On AVX-512 On 512 20 40 60 80 100 Min: 35 / Avg: 69.17 / Max: 81 Min: 39 / Avg: 79.78 / Max: 91 Min: 38 / Avg: 77.04 / Max: 92
Neural Magic DeepSparse CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better Neural Magic DeepSparse 1.1 CPU Power Consumption Monitor AVX-512 Off AVX-512 On AVX-512 On 512 40 80 120 160 200 Min: 12.18 / Avg: 155.44 / Max: 200.14 Min: 12.52 / Avg: 194.6 / Max: 244.04 Min: 12.22 / Avg: 188.58 / Max: 244.57
Neural Magic DeepSparse CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better Neural Magic DeepSparse 1.1 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 Off AVX-512 On AVX-512 On 512 900 1800 2700 3600 4500 Min: 4700 / Avg: 4850.7 / Max: 5301 Min: 4651 / Avg: 4793.56 / Max: 5300 Min: 4669 / Avg: 4825.21 / Max: 5300
AI Benchmark Alpha CPU Temperature Monitor OpenBenchmarking.org Celsius, Fewer Is Better AI Benchmark Alpha 0.1.2 CPU Temperature Monitor AVX-512 Off AVX-512 On AVX-512 On 512 20 40 60 80 100 Min: 27 / Avg: 70 / Max: 89 Min: 29 / Avg: 75.69 / Max: 98 Min: 33 / Avg: 75.48 / Max: 97
AI Benchmark Alpha CPU Power Consumption Monitor OpenBenchmarking.org Watts, Fewer Is Better AI Benchmark Alpha 0.1.2 CPU Power Consumption Monitor AVX-512 Off AVX-512 On AVX-512 On 512 50 100 150 200 250 Min: 11.83 / Avg: 160.88 / Max: 250.01 Min: 11.95 / Avg: 162.75 / Max: 242.39 Min: 12.02 / Avg: 161.75 / Max: 239
AI Benchmark Alpha CPU Peak Freq (Highest CPU Core Frequency) Monitor OpenBenchmarking.org Megahertz, More Is Better AI Benchmark Alpha 0.1.2 CPU Peak Freq (Highest CPU Core Frequency) Monitor AVX-512 Off AVX-512 On AVX-512 On 512 900 1800 2700 3600 4500 Min: 4700 / Avg: 4852.05 / Max: 5308 Min: 3500 / Avg: 4834.52 / Max: 5302 Min: 3475 / Avg: 4839.25 / Max: 5311
AI Benchmark Alpha Device AI Score OpenBenchmarking.org Score Per Watt, More Is Better AI Benchmark Alpha 0.1.2 Device AI Score AVX-512 Off AVX-512 On AVX-512 On 512 5 10 15 20 25 16.76 21.17 21.26
Phoronix Test Suite v10.8.4