AMD EPYC Turin AVX-512 Comparison AMD EPYC 9755 AVX-512 comparison by Michael Larabel for a future article. AVX-512 Off: Processor: AMD EPYC 9755 128-Core @ 2.70GHz (128 Cores / 256 Threads), Motherboard: AMD VOLCANO (RVOT1000D BIOS), Chipset: AMD Device 153a, Memory: 12 x 64GB DDR5-6000MT/s Samsung M321R8GA0PB1-CCPKC, Disk: 2 x 1920GB KIOXIA KCD8XPUG1T92, Graphics: ASPEED, Network: Broadcom NetXtreme BCM5720 PCIe OS: Ubuntu 24.04, Kernel: 6.10.0-phx (x86_64), Compiler: GCC 13.2.0, File-System: ext4, Screen Resolution: 1920x1200 AVX-512 256b DP: Processor: AMD EPYC 9755 128-Core @ 2.70GHz (128 Cores / 256 Threads), Motherboard: AMD VOLCANO (RVOT1000D BIOS), Chipset: AMD Device 153a, Memory: 12 x 64GB DDR5-6000MT/s Samsung M321R8GA0PB1-CCPKC, Disk: 2 x 1920GB KIOXIA KCD8XPUG1T92, Graphics: ASPEED, Network: Broadcom NetXtreme BCM5720 PCIe OS: Ubuntu 24.04, Kernel: 6.10.0-phx (x86_64), Compiler: GCC 13.2.0, File-System: ext4, Screen Resolution: 1920x1200 AVX-512 512b DP: Processor: AMD EPYC 9755 128-Core @ 2.70GHz (128 Cores / 256 Threads), Motherboard: AMD VOLCANO (RVOT1000D BIOS), Chipset: AMD Device 153a, Memory: 12 x 64GB DDR5-6000MT/s Samsung M321R8GA0PB1-CCPKC, Disk: 2 x 1920GB KIOXIA KCD8XPUG1T92, Graphics: ASPEED, Network: Broadcom NetXtreme BCM5720 PCIe OS: Ubuntu 24.04, Kernel: 6.10.0-phx (x86_64), Compiler: GCC 13.2.0, File-System: ext4, Screen Resolution: 1920x1200 CPU Temperature Monitor Phoronix Test Suite System Monitoring Celsius AVX-512 Off ..... MIN: 26.1 AVG: 49.1 MAX: 63.5 AVX-512 256b DP . MIN: 25.1 AVG: 49.3 MAX: 63.8 AVX-512 512b DP . MIN: 23.9 AVG: 50.9 MAX: 66.0 CPU Peak Freq (Highest CPU Core Frequency) Monitor Phoronix Test Suite System Monitoring Megahertz AVX-512 Off ..... MIN: 2294 AVG: 3647 MAX: 4647 AVX-512 256b DP . MIN: 2172 AVG: 3712 MAX: 4195 AVX-512 512b DP . MIN: 1886 AVG: 3622 MAX: 4224 CPU Power Consumption Monitor Phoronix Test Suite System Monitoring Watts AVX-512 Off ..... MIN: 22 AVG: 298 MAX: 505 AVX-512 256b DP . MIN: 22 AVG: 306 MAX: 504 AVX-512 512b DP . MIN: 22 AVG: 293 MAX: 502 PyTorch 2.2.1 Device: CPU - Batch Size: 256 - Model: ResNet-50 batches/sec > Higher Is Better AVX-512 Off ..... 38.38 |=============================================== AVX-512 256b DP . 43.55 |====================================================== AVX-512 512b DP . 43.85 |====================================================== PyTorch 2.2.1 Device: CPU - Batch Size: 512 - Model: ResNet-50 batches/sec > Higher Is Better AVX-512 Off ..... 38.82 |================================================ AVX-512 256b DP . 43.50 |====================================================== AVX-512 512b DP . 43.39 |====================================================== PyTorch 2.2.1 Device: CPU - Batch Size: 1 - Model: ResNet-50 batches/sec Per Watt > Higher Is Better AVX-512 Off ..... 0.179 |============================================ AVX-512 256b DP . 0.219 |====================================================== AVX-512 512b DP . 0.217 |====================================================== PyTorch 2.2.1 Device: CPU - Batch Size: 256 - Model: ResNet-50 batches/sec Per Watt > Higher Is Better AVX-512 Off ..... 0.135 |============================================== AVX-512 256b DP . 0.159 |====================================================== AVX-512 512b DP . 0.158 |====================================================== PyTorch 2.2.1 Device: CPU - Batch Size: 512 - Model: ResNet-50 batches/sec Per Watt > Higher Is Better AVX-512 Off ..... 0.136 |============================================== AVX-512 256b DP . 0.159 |====================================================== AVX-512 512b DP . 0.156 |===================================================== PyTorch 2.2.1 Device: CPU - Batch Size: 1 - Model: ResNet-50 batches/sec > Higher Is Better AVX-512 Off ..... 45.05 |============================================== AVX-512 256b DP . 51.63 |===================================================== AVX-512 512b DP . 52.33 |====================================================== miniBUDE 20210901 Implementation: OpenMP - Input Deck: BM2 Billion Interactions/s Per Watt > Higher Is Better AVX-512 Off ..... 0.498 |======================== AVX-512 256b DP . 0.935 |============================================ AVX-512 512b DP . 1.138 |====================================================== miniBUDE 20210901 Implementation: OpenMP - Input Deck: BM1 Billion Interactions/s > Higher Is Better AVX-512 Off ..... 195.31 |========================== AVX-512 256b DP . 328.87 |============================================ AVX-512 512b DP . 395.37 |===================================================== miniBUDE 20210901 Implementation: OpenMP - Input Deck: BM2 Billion Interactions/s > Higher Is Better AVX-512 Off ..... 191.61 |========================== AVX-512 256b DP . 316.66 |=========================================== AVX-512 512b DP . 387.05 |===================================================== miniBUDE 20210901 Implementation: OpenMP - Input Deck: BM1 Billion Interactions/s Per Watt > Higher Is Better AVX-512 Off ..... 0.795 |=================== AVX-512 256b DP . 1.750 |=========================================== AVX-512 512b DP . 2.222 |====================================================== OpenVINO 2024.0 Model: Face Detection FP16-INT8 - Device: CPU FPS > Higher Is Better AVX-512 Off ..... 117.14 |================================ AVX-512 256b DP . 137.51 |====================================== AVX-512 512b DP . 194.04 |===================================================== OpenVINO 2024.0 Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU FPS > Higher Is Better AVX-512 Off ..... 165052.36 |=========================================== AVX-512 256b DP . 175156.04 |============================================== AVX-512 512b DP . 192118.56 |================================================== OpenVINO 2024.0 Model: Person Detection FP16 - Device: CPU FPS > Higher Is Better AVX-512 Off ..... 382.43 |========================== AVX-512 256b DP . 710.98 |================================================= AVX-512 512b DP . 766.99 |===================================================== OpenVINO 2024.0 Model: Weld Porosity Detection FP16-INT8 - Device: CPU FPS > Higher Is Better AVX-512 Off ..... 11702.44 |================================ AVX-512 256b DP . 13579.90 |===================================== AVX-512 512b DP . 18690.32 |=================================================== OpenVINO 2024.0 Model: Vehicle Detection FP16-INT8 - Device: CPU FPS > Higher Is Better AVX-512 Off ..... 6189.69 |============================ AVX-512 256b DP . 8450.68 |====================================== AVX-512 512b DP . 11239.49 |=================================================== OpenVINO 2024.0 Model: Person Vehicle Bike Detection FP16 - Device: CPU FPS > Higher Is Better AVX-512 Off ..... 4150.45 |========================= AVX-512 256b DP . 8024.13 |================================================ AVX-512 512b DP . 8755.75 |==================================================== OpenVINO 2024.0 Model: Machine Translation EN To DE FP16 - Device: CPU FPS > Higher Is Better AVX-512 Off ..... 398.57 |=================== AVX-512 256b DP . 866.83 |========================================= AVX-512 512b DP . 1111.69 |==================================================== OpenVINO 2024.0 Model: Face Detection Retail FP16-INT8 - Device: CPU FPS > Higher Is Better AVX-512 Off ..... 19828.79 |================================ AVX-512 256b DP . 24619.04 |======================================== AVX-512 512b DP . 31620.58 |=================================================== OpenVINO 2024.0 Model: Handwritten English Recognition FP16-INT8 - Device: CPU FPS > Higher Is Better AVX-512 Off ..... 1861.72 |==================== AVX-512 256b DP . 4203.21 |============================================== AVX-512 512b DP . 4780.24 |==================================================== OpenVINO 2024.0 Model: Road Segmentation ADAS FP16-INT8 - Device: CPU FPS > Higher Is Better AVX-512 Off ..... 2626.83 |========================================= AVX-512 256b DP . 2855.34 |============================================= AVX-512 512b DP . 3297.85 |==================================================== OpenVINO 2024.0 Model: Person Re-Identification Retail FP16 - Device: CPU FPS > Higher Is Better AVX-512 Off ..... 4727.35 |================= AVX-512 256b DP . 10058.84 |===================================== AVX-512 512b DP . 13925.76 |=================================================== OpenVINO 2024.0 Model: Noise Suppression Poconet-Like FP16 - Device: CPU FPS > Higher Is Better AVX-512 Off ..... 3010.63 |=============== AVX-512 256b DP . 10112.34 |================================================= AVX-512 512b DP . 10450.98 |=================================================== Embree 4.3 Binary: Pathtracer ISPC - Model: Asian Dragon Frames Per Second > Higher Is Better AVX-512 Off ..... 205.95 |================================================= AVX-512 256b DP . 221.38 |===================================================== AVX-512 512b DP . 223.14 |===================================================== SVT-AV1 2.2 Encoder Mode: Preset 13 - Input: Bosphorus 4K Frames Per Second Per Watt > Higher Is Better AVX-512 Off ..... 2.125 |=================================================== AVX-512 256b DP . 2.202 |===================================================== AVX-512 512b DP . 2.249 |====================================================== Embree 4.3 Binary: Pathtracer ISPC - Model: Asian Dragon Obj Frames Per Second > Higher Is Better AVX-512 Off ..... 178.48 |================================================= AVX-512 256b DP . 190.12 |===================================================== AVX-512 512b DP . 191.64 |===================================================== Embree 4.3 Binary: Pathtracer ISPC - Model: Crown Frames Per Second > Higher Is Better AVX-512 Off ..... 167.00 |================================================= AVX-512 256b DP . 178.13 |===================================================== AVX-512 512b DP . 179.68 |===================================================== SVT-AV1 2.2 Encoder Mode: Preset 13 - Input: Bosphorus 4K Frames Per Second > Higher Is Better AVX-512 Off ..... 378.43 |================================================== AVX-512 256b DP . 388.54 |=================================================== AVX-512 512b DP . 400.90 |===================================================== Embree 4.3 Binary: Pathtracer ISPC - Model: Crown Frames Per Second Per Watt > Higher Is Better AVX-512 Off ..... 0.638 |================================================= AVX-512 256b DP . 0.696 |===================================================== AVX-512 512b DP . 0.703 |====================================================== SVT-AV1 2.2 Encoder Mode: Preset 8 - Input: Bosphorus 4K Frames Per Second Per Watt > Higher Is Better AVX-512 Off ..... 0.462 |=============================================== AVX-512 256b DP . 0.510 |==================================================== AVX-512 512b DP . 0.526 |====================================================== SVT-AV1 2.2 Encoder Mode: Preset 5 - Input: Bosphorus 4K Frames Per Second Per Watt > Higher Is Better AVX-512 Off ..... 0.202 |================================================= AVX-512 256b DP . 0.220 |===================================================== AVX-512 512b DP . 0.224 |====================================================== SVT-AV1 2.2 Encoder Mode: Preset 3 - Input: Bosphorus 4K Frames Per Second Per Watt > Higher Is Better AVX-512 Off ..... 0.052 |================================================= AVX-512 256b DP . 0.056 |===================================================== AVX-512 512b DP . 0.057 |====================================================== SVT-AV1 2.2 Encoder Mode: Preset 8 - Input: Bosphorus 4K Frames Per Second > Higher Is Better AVX-512 Off ..... 101.84 |=============================================== AVX-512 256b DP . 108.12 |================================================== AVX-512 512b DP . 114.98 |===================================================== SVT-AV1 2.2 Encoder Mode: Preset 5 - Input: Bosphorus 4K Frames Per Second > Higher Is Better AVX-512 Off ..... 46.25 |================================================= AVX-512 256b DP . 48.60 |==================================================== AVX-512 512b DP . 50.74 |====================================================== SVT-AV1 2.2 Encoder Mode: Preset 3 - Input: Bosphorus 4K Frames Per Second > Higher Is Better AVX-512 Off ..... 13.04 |================================================= AVX-512 256b DP . 13.76 |==================================================== AVX-512 512b DP . 14.28 |====================================================== Embree 4.3 Binary: Pathtracer ISPC - Model: Asian Dragon Frames Per Second Per Watt > Higher Is Better AVX-512 Off ..... 0.885 |================================================ AVX-512 256b DP . 0.989 |====================================================== AVX-512 512b DP . 0.979 |===================================================== Embree 4.3 Binary: Pathtracer ISPC - Model: Asian Dragon Obj Frames Per Second Per Watt > Higher Is Better AVX-512 Off ..... 0.962 |================================================ AVX-512 256b DP . 1.088 |====================================================== AVX-512 512b DP . 1.093 |====================================================== simdjson 3.10 Throughput Test: PartialTweets GB/s > Higher Is Better AVX-512 Off ..... 7.30 |========================================== AVX-512 256b DP . 8.60 |================================================== AVX-512 512b DP . 9.46 |======================================================= simdjson 3.10 Throughput Test: LargeRandom GB/s > Higher Is Better AVX-512 Off ..... 1.40 |================================================ AVX-512 256b DP . 1.57 |====================================================== AVX-512 512b DP . 1.59 |======================================================= simdjson 3.10 Throughput Test: Kostya GB/s > Higher Is Better AVX-512 Off ..... 4.69 |============================================ AVX-512 256b DP . 5.66 |===================================================== AVX-512 512b DP . 5.90 |======================================================= simdjson 3.10 Throughput Test: DistinctUserID GB/s > Higher Is Better AVX-512 Off ..... 7.64 |========================================== AVX-512 256b DP . 8.99 |================================================== AVX-512 512b DP . 9.92 |======================================================= simdjson 3.10 Throughput Test: TopTweet GB/s > Higher Is Better AVX-512 Off ..... 7.49 |========================================== AVX-512 256b DP . 8.84 |================================================= AVX-512 512b DP . 9.87 |======================================================= simdjson 3.10 Throughput Test: PartialTweets GB/s Per Watt > Higher Is Better AVX-512 Off ..... 0.079 |========================================= AVX-512 256b DP . 0.095 |================================================= AVX-512 512b DP . 0.104 |====================================================== simdjson 3.10 Throughput Test: LargeRandom GB/s Per Watt > Higher Is Better AVX-512 Off ..... 0.015 |================================================ AVX-512 256b DP . 0.017 |====================================================== AVX-512 512b DP . 0.017 |====================================================== simdjson 3.10 Throughput Test: Kostya GB/s Per Watt > Higher Is Better AVX-512 Off ..... 0.048 |=========================================== AVX-512 256b DP . 0.058 |==================================================== AVX-512 512b DP . 0.060 |====================================================== simdjson 3.10 Throughput Test: DistinctUserID GB/s Per Watt > Higher Is Better AVX-512 Off ..... 0.084 |========================================== AVX-512 256b DP . 0.099 |================================================= AVX-512 512b DP . 0.109 |====================================================== simdjson 3.10 Throughput Test: TopTweet GB/s Per Watt > Higher Is Better AVX-512 Off ..... 0.082 |========================================= AVX-512 256b DP . 0.097 |================================================= AVX-512 512b DP . 0.108 |====================================================== miniBUDE 20210901 Implementation: OpenMP - Input Deck: BM1 GFInst/s > Higher Is Better AVX-512 Off ..... 4882.81 |========================== AVX-512 256b DP . 8221.74 |=========================================== AVX-512 512b DP . 9884.25 |==================================================== miniBUDE 20210901 Implementation: OpenMP - Input Deck: BM2 GFInst/s > Higher Is Better AVX-512 Off ..... 4790.13 |========================== AVX-512 256b DP . 7916.41 |=========================================== AVX-512 512b DP . 9676.25 |==================================================== libxsmm 2-1.17-3645 M N K: 128 GFLOPS/s Per Watt > Higher Is Better AVX-512 Off ..... 16.38 |========================================== AVX-512 256b DP . 21.01 |====================================================== AVX-512 512b DP . 20.74 |===================================================== libxsmm 2-1.17-3645 M N K: 128 GFLOPS/s > Higher Is Better AVX-512 Off ..... 3431.7 |================================================ AVX-512 256b DP . 3652.9 |=================================================== AVX-512 512b DP . 3764.4 |===================================================== Xmrig 6.21 Variant: GhostRider - Hash Count: 1M H/s Per Watt > Higher Is Better AVX-512 Off ..... 40.85 |=============================================== AVX-512 256b DP . 42.29 |================================================= AVX-512 512b DP . 47.07 |====================================================== Xmrig 6.21 Variant: GhostRider - Hash Count: 1M H/s > Higher Is Better AVX-512 Off ..... 16826.7 |============================================ AVX-512 256b DP . 17480.4 |============================================= AVX-512 512b DP . 20005.2 |==================================================== TensorFlow 2.16.1 Device: CPU - Batch Size: 256 - Model: ResNet-50 images/sec > Higher Is Better AVX-512 Off ..... 158.25 |========================================= AVX-512 256b DP . 190.08 |================================================== AVX-512 512b DP . 203.33 |===================================================== TensorFlow 2.16.1 Device: CPU - Batch Size: 256 - Model: ResNet-50 images/sec Per Watt > Higher Is Better AVX-512 Off ..... 0.477 |======================================= AVX-512 256b DP . 0.521 |=========================================== AVX-512 512b DP . 0.659 |====================================================== TensorFlow 2.16.1 Device: CPU - Batch Size: 512 - Model: ResNet-50 images/sec > Higher Is Better AVX-512 Off ..... 179.25 |======================================= AVX-512 256b DP . 221.25 |================================================ AVX-512 512b DP . 246.10 |===================================================== TensorFlow 2.16.1 Device: CPU - Batch Size: 512 - Model: ResNet-50 images/sec Per Watt > Higher Is Better AVX-512 Off ..... 0.491 |==================================== AVX-512 256b DP . 0.570 |========================================== AVX-512 512b DP . 0.729 |====================================================== ONNX Runtime 1.19 Model: fcn-resnet101-11 - Device: CPU - Executor: Standard Inferences Per Second > Higher Is Better AVX-512 Off ..... 7.89424 |======================================= AVX-512 256b DP . 8.92861 |============================================ AVX-512 512b DP . 10.32990 |=================================================== ONNX Runtime 1.19 Model: super-resolution-10 - Device: CPU - Executor: Standard Inferences Per Second > Higher Is Better AVX-512 Off ..... 161.96 |========================================== AVX-512 256b DP . 162.96 |========================================== AVX-512 512b DP . 206.82 |===================================================== ONNX Runtime 1.19 Model: bertsquad-12 - Device: CPU - Executor: Standard Inferences Per Second > Higher Is Better AVX-512 Off ..... 17.06 |=========================================== AVX-512 256b DP . 17.92 |============================================= AVX-512 512b DP . 21.60 |====================================================== ONNX Runtime 1.19 Model: GPT-2 - Device: CPU - Executor: Standard Inferences Per Second > Higher Is Better AVX-512 Off ..... 181.56 |================================================== AVX-512 256b DP . 191.18 |===================================================== AVX-512 512b DP . 192.84 |===================================================== ONNX Runtime 1.19 Model: ArcFace ResNet-100 - Device: CPU - Executor: Standard Inferences Per Second > Higher Is Better AVX-512 Off ..... 38.84 |=============================================== AVX-512 256b DP . 44.61 |====================================================== AVX-512 512b DP . 43.82 |===================================================== ONNX Runtime 1.19 Model: ResNet101_DUC_HDC-12 - Device: CPU - Executor: Standard Inferences Per Second > Higher Is Better AVX-512 Off ..... 5.50491 |========================================= AVX-512 256b DP . 5.67626 |========================================== AVX-512 512b DP . 6.96791 |==================================================== OpenVKL 2.0.0 Benchmark: vklBenchmarkCPU ISPC Items / Sec Per Watt > Higher Is Better AVX-512 Off ..... 7.791 |============================================== AVX-512 256b DP . 9.055 |===================================================== AVX-512 512b DP . 9.180 |====================================================== OpenVKL 2.0.0 Benchmark: vklBenchmarkCPU ISPC Items / Sec > Higher Is Better AVX-512 Off ..... 3099 |=============================================== AVX-512 256b DP . 3560 |===================================================== AVX-512 512b DP . 3660 |======================================================= OSPRay 3.2 Benchmark: gravity_spheres_volume/dim_512/ao/real_time Items Per Second Per Watt > Higher Is Better AVX-512 Off ..... 0.077 |======================================= AVX-512 256b DP . 0.108 |====================================================== AVX-512 512b DP . 0.108 |====================================================== OSPRay 3.2 Benchmark: gravity_spheres_volume/dim_512/scivis/real_time Items Per Second Per Watt > Higher Is Better AVX-512 Off ..... 0.074 |===================================== AVX-512 256b DP . 0.106 |===================================================== AVX-512 512b DP . 0.107 |====================================================== OSPRay 3.2 Benchmark: gravity_spheres_volume/dim_512/pathtracer/real_time Items Per Second Per Watt > Higher Is Better AVX-512 Off ..... 0.101 |============================================ AVX-512 256b DP . 0.121 |===================================================== AVX-512 512b DP . 0.124 |====================================================== OSPRay 3.2 Benchmark: gravity_spheres_volume/dim_512/ao/real_time Items Per Second > Higher Is Better AVX-512 Off ..... 31.72 |==================================== AVX-512 256b DP . 45.41 |==================================================== AVX-512 512b DP . 46.97 |====================================================== OSPRay 3.2 Benchmark: gravity_spheres_volume/dim_512/scivis/real_time Items Per Second > Higher Is Better AVX-512 Off ..... 30.61 |==================================== AVX-512 256b DP . 44.79 |==================================================== AVX-512 512b DP . 46.33 |====================================================== OSPRay 3.2 Benchmark: gravity_spheres_volume/dim_512/pathtracer/real_time Items Per Second > Higher Is Better AVX-512 Off ..... 42.13 |============================================= AVX-512 256b DP . 49.35 |==================================================== AVX-512 512b DP . 50.90 |====================================================== miniBUDE 20210901 CPU Peak Freq (Highest CPU Core Frequency) Monitor Megahertz > Higher Is Better AVX-512 Off ..... MIN: 2700 AVG: 3033 MAX: 4152 AVX-512 256b DP . MIN: 2700 AVG: 3039 MAX: 4174 AVX-512 512b DP . MIN: 2700 AVG: 2910 MAX: 4157 miniBUDE 20210901 CPU Peak Freq (Highest CPU Core Frequency) Monitor Megahertz > Higher Is Better AVX-512 Off ..... MIN: 2700 AVG: 3184 MAX: 4148 AVX-512 256b DP . MIN: 2700 AVG: 3304 MAX: 4147 AVX-512 512b DP . MIN: 2700 AVG: 3004 MAX: 4146 NAMD 3.0b6 CPU Peak Freq (Highest CPU Core Frequency) Monitor Megahertz > Higher Is Better AVX-512 Off ..... MIN: 2700 AVG: 3689 MAX: 4147 AVX-512 256b DP . MIN: 2700 AVG: 3338 MAX: 4158 AVX-512 512b DP . MIN: 2700 AVG: 3253 MAX: 4149 NAMD 3.0b6 CPU Peak Freq (Highest CPU Core Frequency) Monitor Megahertz > Higher Is Better AVX-512 Off ..... MIN: 2700 AVG: 3447 MAX: 4182 AVX-512 256b DP . MIN: 2700 AVG: 3480 MAX: 4149 AVX-512 512b DP . MIN: 2554 AVG: 3362 MAX: 4151 GROMACS 2024 CPU Peak Freq (Highest CPU Core Frequency) Monitor Megahertz > Higher Is Better AVX-512 Off ..... MIN: 2700 AVG: 3373 MAX: 4150 AVX-512 256b DP . MIN: 2700 AVG: 3504 MAX: 4148 AVX-512 512b DP . MIN: 2700 AVG: 3489 MAX: 4155 OpenFOAM 10 CPU Peak Freq (Highest CPU Core Frequency) Monitor Megahertz > Higher Is Better AVX-512 Off ..... MIN: 2700 AVG: 3413 MAX: 4156 AVX-512 256b DP . MIN: 2700 AVG: 3390 MAX: 4150 AVX-512 512b DP . MIN: 2700 AVG: 3387 MAX: 4174 OpenFOAM 10 CPU Peak Freq (Highest CPU Core Frequency) Monitor Megahertz > Higher Is Better AVX-512 Off ..... MIN: 2700 AVG: 3576 MAX: 4155 AVX-512 256b DP . MIN: 2700 AVG: 3576 MAX: 4152 AVX-512 512b DP . MIN: 2700 AVG: 3549 MAX: 4168 simdjson 3.10 CPU Peak Freq (Highest CPU Core Frequency) Monitor Megahertz > Higher Is Better AVX-512 Off ..... MIN: 2700 AVG: 4059 MAX: 4140 AVX-512 256b DP . MIN: 2700 AVG: 4058 MAX: 4146 AVX-512 512b DP . MIN: 2700 AVG: 4057 MAX: 4156 simdjson 3.10 CPU Peak Freq (Highest CPU Core Frequency) Monitor Megahertz > Higher Is Better AVX-512 Off ..... MIN: 2700 AVG: 4029 MAX: 4145 AVX-512 256b DP . MIN: 2700 AVG: 4071 MAX: 4152 AVX-512 512b DP . MIN: 2700 AVG: 4068 MAX: 4141 simdjson 3.10 CPU Peak Freq (Highest CPU Core Frequency) Monitor Megahertz > Higher Is Better AVX-512 Off ..... MIN: 2700 AVG: 4074 MAX: 4158 AVX-512 256b DP . MIN: 2700 AVG: 4065 MAX: 4146 AVX-512 512b DP . MIN: 2700 AVG: 4077 MAX: 4160 simdjson 3.10 CPU Peak Freq (Highest CPU Core Frequency) Monitor Megahertz > Higher Is Better AVX-512 Off ..... MIN: 2700 AVG: 4062 MAX: 4152 AVX-512 256b DP . MIN: 2700 AVG: 4048 MAX: 4138 AVX-512 512b DP . MIN: 2700 AVG: 4050 MAX: 4153 simdjson 3.10 CPU Peak Freq (Highest CPU Core Frequency) Monitor Megahertz > Higher Is Better AVX-512 Off ..... MIN: 2700 AVG: 4051 MAX: 4141 AVX-512 256b DP . MIN: 2700 AVG: 4059 MAX: 4158 AVX-512 512b DP . MIN: 2700 AVG: 4069 MAX: 4158 Embree 4.3 CPU Peak Freq (Highest CPU Core Frequency) Monitor Megahertz > Higher Is Better AVX-512 Off ..... MIN: 2700 AVG: 3062 MAX: 4146 AVX-512 256b DP . MIN: 2700 AVG: 3178 MAX: 4156 AVX-512 512b DP . MIN: 2700 AVG: 3166 MAX: 4157 Embree 4.3 CPU Peak Freq (Highest CPU Core Frequency) Monitor Megahertz > Higher Is Better AVX-512 Off ..... MIN: 2700 AVG: 3540 MAX: 4150 AVX-512 256b DP . MIN: 2700 AVG: 3575 MAX: 4146 AVX-512 512b DP . MIN: 2700 AVG: 3579 MAX: 4139 Embree 4.3 CPU Peak Freq (Highest CPU Core Frequency) Monitor Megahertz > Higher Is Better AVX-512 Off ..... MIN: 2700 AVG: 3100 MAX: 4146 AVX-512 256b DP . MIN: 2700 AVG: 3108 MAX: 4151 AVX-512 512b DP . MIN: 2700 AVG: 3114 MAX: 4169 OpenVKL 2.0.0 CPU Peak Freq (Highest CPU Core Frequency) Monitor Megahertz > Higher Is Better AVX-512 Off ..... MIN: 2700 AVG: 3535 MAX: 4152 AVX-512 256b DP . MIN: 2700 AVG: 3662 MAX: 4157 AVX-512 512b DP . MIN: 2700 AVG: 3603 MAX: 4154 OSPRay 3.2 CPU Peak Freq (Highest CPU Core Frequency) Monitor Megahertz > Higher Is Better AVX-512 Off ..... MIN: 2700 AVG: 3374 MAX: 4147 AVX-512 256b DP . MIN: 2700 AVG: 3444 MAX: 4141 AVX-512 512b DP . MIN: 2700 AVG: 3364 MAX: 4151 OSPRay 3.2 CPU Peak Freq (Highest CPU Core Frequency) Monitor Megahertz > Higher Is Better AVX-512 Off ..... MIN: 2700 AVG: 3376 MAX: 4149 AVX-512 256b DP . MIN: 2700 AVG: 3457 MAX: 4142 AVX-512 512b DP . MIN: 2700 AVG: 3372 MAX: 4148 OSPRay 3.2 CPU Peak Freq (Highest CPU Core Frequency) Monitor Megahertz > Higher Is Better AVX-512 Off ..... MIN: 2700 AVG: 3214 MAX: 4148 AVX-512 256b DP . MIN: 2700 AVG: 3288 MAX: 4150 AVX-512 512b DP . MIN: 2700 AVG: 3224 MAX: 4149 OSPRay Studio 1.0 CPU Peak Freq (Highest CPU Core Frequency) Monitor Megahertz > Higher Is Better AVX-512 Off ..... MIN: 2700 AVG: 3224 MAX: 4143 AVX-512 256b DP . MIN: 2700 AVG: 3329 MAX: 4145 AVX-512 512b DP . MIN: 2700 AVG: 3224 MAX: 4153 OSPRay Studio 1.0 CPU Peak Freq (Highest CPU Core Frequency) Monitor Megahertz > Higher Is Better AVX-512 Off ..... MIN: 2700 AVG: 3228 MAX: 4144 AVX-512 256b DP . MIN: 2700 AVG: 3334 MAX: 4151 AVX-512 512b DP . MIN: 2700 AVG: 3221 MAX: 4152 OSPRay Studio 1.0 CPU Peak Freq (Highest CPU Core Frequency) Monitor Megahertz > Higher Is Better AVX-512 Off ..... MIN: 2700 AVG: 3166 MAX: 4142 AVX-512 256b DP . MIN: 2700 AVG: 3272 MAX: 4134 AVX-512 512b DP . MIN: 2700 AVG: 3173 MAX: 4139 OSPRay Studio 1.0 CPU Peak Freq (Highest CPU Core Frequency) Monitor Megahertz > Higher Is Better AVX-512 Off ..... MIN: 2700 AVG: 3248 MAX: 4155 AVX-512 256b DP . MIN: 2700 AVG: 3331 MAX: 4145 AVX-512 512b DP . MIN: 2700 AVG: 3254 MAX: 4154 OSPRay Studio 1.0 CPU Peak Freq (Highest CPU Core Frequency) Monitor Megahertz > Higher Is Better AVX-512 Off ..... MIN: 2700 AVG: 3248 MAX: 4143 AVX-512 256b DP . MIN: 2700 AVG: 3342 MAX: 4155 AVX-512 512b DP . MIN: 2700 AVG: 3241 MAX: 4152 OSPRay Studio 1.0 CPU Peak Freq (Highest CPU Core Frequency) Monitor Megahertz > Higher Is Better AVX-512 Off ..... MIN: 2700 AVG: 3192 MAX: 4150 AVX-512 256b DP . MIN: 2700 AVG: 3302 MAX: 4150 AVX-512 512b DP . MIN: 2700 AVG: 3194 MAX: 4144 OSPRay Studio 1.0 CPU Peak Freq (Highest CPU Core Frequency) Monitor Megahertz > Higher Is Better AVX-512 Off ..... MIN: 2700 AVG: 3226 MAX: 4140 AVX-512 256b DP . MIN: 2700 AVG: 3312 MAX: 4144 AVX-512 512b DP . MIN: 2700 AVG: 3223 MAX: 4141 OSPRay Studio 1.0 CPU Peak Freq (Highest CPU Core Frequency) Monitor Megahertz > Higher Is Better AVX-512 Off ..... MIN: 2700 AVG: 3171 MAX: 4148 AVX-512 256b DP . MIN: 2700 AVG: 3319 MAX: 4144 AVX-512 512b DP . MIN: 2700 AVG: 3210 MAX: 4162 OSPRay Studio 1.0 CPU Peak Freq (Highest CPU Core Frequency) Monitor Megahertz > Higher Is Better AVX-512 Off ..... MIN: 2700 AVG: 3307 MAX: 4153 AVX-512 256b DP . MIN: 2700 AVG: 3284 MAX: 4151 AVX-512 512b DP . MIN: 2700 AVG: 3170 MAX: 4151 Y-Cruncher 0.8.5 CPU Peak Freq (Highest CPU Core Frequency) Monitor Megahertz > Higher Is Better AVX-512 Off ..... MIN: 2464 AVG: 3600 MAX: 4155 AVX-512 256b DP . MIN: 2695 AVG: 3692 MAX: 4151 AVX-512 512b DP . MIN: 2700 AVG: 3625 MAX: 4154 Y-Cruncher 0.8.5 CPU Peak Freq (Highest CPU Core Frequency) Monitor Megahertz > Higher Is Better AVX-512 Off ..... MIN: 2437 AVG: 3601 MAX: 4157 AVX-512 256b DP . MIN: 2638 AVG: 3616 MAX: 4146 AVX-512 512b DP . MIN: 2063 AVG: 3504 MAX: 4142 Y-Cruncher 0.8.5 CPU Peak Freq (Highest CPU Core Frequency) Monitor Megahertz > Higher Is Better AVX-512 Off ..... MIN: 2465 AVG: 3596 MAX: 4148 AVX-512 256b DP . MIN: 2613 AVG: 3638 MAX: 4155 AVX-512 512b DP . MIN: 2077 AVG: 3530 MAX: 4160 Xmrig 6.21 CPU Peak Freq (Highest CPU Core Frequency) Monitor Megahertz > Higher Is Better AVX-512 Off ..... MIN: 2700 AVG: 4011 MAX: 4140 AVX-512 256b DP . MIN: 2700 AVG: 4013 MAX: 4153 AVX-512 512b DP . MIN: 2700 AVG: 3955 MAX: 4136 oneDNN 3.4 CPU Peak Freq (Highest CPU Core Frequency) Monitor Megahertz > Higher Is Better AVX-512 Off ..... MIN: 2700 AVG: 3146 MAX: 4042 AVX-512 256b DP . MIN: 2700 AVG: 3289 MAX: 4145 AVX-512 512b DP . MIN: 2700 AVG: 2884 MAX: 4153 oneDNN 3.4 CPU Peak Freq (Highest CPU Core Frequency) Monitor Megahertz > Higher Is Better AVX-512 Off ..... MIN: 2700 AVG: 3160 MAX: 4144 AVX-512 256b DP . MIN: 2172 AVG: 3049 MAX: 4150 AVX-512 512b DP . MIN: 2559 AVG: 2730 MAX: 4150 oneDNN 3.4 CPU Peak Freq (Highest CPU Core Frequency) Monitor Megahertz > Higher Is Better AVX-512 Off ..... MIN: 2700 AVG: 3730 MAX: 4152 AVX-512 256b DP . MIN: 2700 AVG: 3536 MAX: 4145 AVX-512 512b DP . MIN: 2700 AVG: 3528 MAX: 4155 oneDNN 3.4 CPU Peak Freq (Highest CPU Core Frequency) Monitor Megahertz > Higher Is Better AVX-512 Off ..... MIN: 2487 AVG: 3193 MAX: 4143 AVX-512 256b DP . MIN: 2700 AVG: 3790 MAX: 4156 AVX-512 512b DP . MIN: 1886 AVG: 3298 MAX: 4162 PyTorch 2.2.1 CPU Peak Freq (Highest CPU Core Frequency) Monitor Megahertz > Higher Is Better AVX-512 Off ..... MIN: 2700 AVG: 3946 MAX: 4143 AVX-512 256b DP . MIN: 2700 AVG: 3927 MAX: 4157 AVX-512 512b DP . MIN: 2700 AVG: 3952 MAX: 4153 PyTorch 2.2.1 CPU Peak Freq (Highest CPU Core Frequency) Monitor Megahertz > Higher Is Better AVX-512 Off ..... MIN: 2700 AVG: 4030 MAX: 4144 AVX-512 256b DP . MIN: 2700 AVG: 4037 MAX: 4153 AVX-512 512b DP . MIN: 2700 AVG: 4037 MAX: 4151 PyTorch 2.2.1 CPU Peak Freq (Highest CPU Core Frequency) Monitor Megahertz > Higher Is Better AVX-512 Off ..... MIN: 2700 AVG: 4036 MAX: 4145 AVX-512 256b DP . MIN: 2700 AVG: 4039 MAX: 4151 AVX-512 512b DP . MIN: 2700 AVG: 4023 MAX: 4143 TensorFlow 2.16.1 CPU Peak Freq (Highest CPU Core Frequency) Monitor Megahertz > Higher Is Better AVX-512 Off ..... MIN: 2540 AVG: 3215 MAX: 4156 AVX-512 256b DP . MIN: 2700 AVG: 3835 MAX: 4148 AVX-512 512b DP . MIN: 2623 AVG: 3247 MAX: 4165 TensorFlow 2.16.1 CPU Peak Freq (Highest CPU Core Frequency) Monitor Megahertz > Higher Is Better AVX-512 Off ..... MIN: 2294 AVG: 3328 MAX: 4155 AVX-512 256b DP . MIN: 2700 AVG: 3802 MAX: 4147 AVX-512 512b DP . MIN: 1993 AVG: 3243 MAX: 4144 OpenVINO 2024.0 CPU Peak Freq (Highest CPU Core Frequency) Monitor Megahertz > Higher Is Better AVX-512 Off ..... MIN: 2563 AVG: 2767 MAX: 4146 AVX-512 256b DP . MIN: 2700 AVG: 3182 MAX: 4150 AVX-512 512b DP . MIN: 2280 AVG: 2475 MAX: 4150 OpenVINO 2024.0 CPU Peak Freq (Highest CPU Core Frequency) Monitor Megahertz > Higher Is Better AVX-512 Off ..... MIN: 2700 AVG: 3192 MAX: 4152 AVX-512 256b DP . MIN: 2700 AVG: 3442 MAX: 4163 AVX-512 512b DP . MIN: 2700 AVG: 3170 MAX: 4142 OpenVINO 2024.0 CPU Peak Freq (Highest CPU Core Frequency) Monitor Megahertz > Higher Is Better AVX-512 Off ..... MIN: 2700 AVG: 3031 MAX: 4147 AVX-512 256b DP . MIN: 2700 AVG: 3226 MAX: 4168 AVX-512 512b DP . MIN: 2642 AVG: 2768 MAX: 4162 OpenVINO 2024.0 CPU Peak Freq (Highest CPU Core Frequency) Monitor Megahertz > Higher Is Better AVX-512 Off ..... MIN: 2630 AVG: 2813 MAX: 4149 AVX-512 256b DP . MIN: 2700 AVG: 3101 MAX: 4145 AVX-512 512b DP . MIN: 2200 AVG: 2414 MAX: 4152 OpenVINO 2024.0 CPU Peak Freq (Highest CPU Core Frequency) Monitor Megahertz > Higher Is Better AVX-512 Off ..... MIN: 2688 AVG: 2823 MAX: 4156 AVX-512 256b DP . MIN: 2700 AVG: 3147 MAX: 4154 AVX-512 512b DP . MIN: 2380 AVG: 2573 MAX: 4150 OpenVINO 2024.0 CPU Peak Freq (Highest CPU Core Frequency) Monitor Megahertz > Higher Is Better AVX-512 Off ..... MIN: 2700 AVG: 2875 MAX: 4145 AVX-512 256b DP . MIN: 2700 AVG: 3146 MAX: 4153 AVX-512 512b DP . MIN: 2394 AVG: 2522 MAX: 4152 OpenVINO 2024.0 CPU Peak Freq (Highest CPU Core Frequency) Monitor Megahertz > Higher Is Better AVX-512 Off ..... MIN: 2541 AVG: 2723 MAX: 4153 AVX-512 256b DP . MIN: 2700 AVG: 3272 MAX: 4195 AVX-512 512b DP . MIN: 2416 AVG: 2733 MAX: 4152 OpenVINO 2024.0 CPU Peak Freq (Highest CPU Core Frequency) Monitor Megahertz > Higher Is Better AVX-512 Off ..... MIN: 2697 AVG: 2891 MAX: 4145 AVX-512 256b DP . MIN: 2700 AVG: 3097 MAX: 4152 AVX-512 512b DP . MIN: 2336 AVG: 2601 MAX: 4149 OpenVINO 2024.0 CPU Peak Freq (Highest CPU Core Frequency) Monitor Megahertz > Higher Is Better AVX-512 Off ..... MIN: 2520 AVG: 2614 MAX: 4162 AVX-512 256b DP . MIN: 2700 AVG: 2965 MAX: 4148 AVX-512 512b DP . MIN: 2613 AVG: 2767 MAX: 4147 OpenVINO 2024.0 CPU Peak Freq (Highest CPU Core Frequency) Monitor Megahertz > Higher Is Better AVX-512 Off ..... MIN: 2700 AVG: 3021 MAX: 4157 AVX-512 256b DP . MIN: 2700 AVG: 3187 MAX: 4144 AVX-512 512b DP . MIN: 2585 AVG: 2723 MAX: 4144 OpenVINO 2024.0 CPU Peak Freq (Highest CPU Core Frequency) Monitor Megahertz > Higher Is Better AVX-512 Off ..... MIN: 2682 AVG: 2832 MAX: 4151 AVX-512 256b DP . MIN: 2700 AVG: 3231 MAX: 4147 AVX-512 512b DP . MIN: 2488 AVG: 2700 MAX: 4154 OpenVINO 2024.0 CPU Peak Freq (Highest CPU Core Frequency) Monitor Megahertz > Higher Is Better AVX-512 Off ..... MIN: 2700 AVG: 3241 MAX: 4405 AVX-512 256b DP . MIN: 2700 AVG: 3087 MAX: 4153 AVX-512 512b DP . MIN: 2699 AVG: 2869 MAX: 4150 libxsmm 2-1.17-3645 CPU Peak Freq (Highest CPU Core Frequency) Monitor Megahertz > Higher Is Better AVX-512 Off ..... MIN: 2700 AVG: 4039 MAX: 4154 AVX-512 256b DP . MIN: 2700 AVG: 4020 MAX: 4151 AVX-512 512b DP . MIN: 2700 AVG: 4010 MAX: 4153 ONNX Runtime 1.19 CPU Peak Freq (Highest CPU Core Frequency) Monitor Megahertz > Higher Is Better AVX-512 Off ..... MIN: 2700 AVG: 3519 MAX: 4155 AVX-512 256b DP . MIN: 2700 AVG: 3822 MAX: 4161 AVX-512 512b DP . MIN: 2700 AVG: 3387 MAX: 4149 ONNX Runtime 1.19 CPU Peak Freq (Highest CPU Core Frequency) Monitor Megahertz > Higher Is Better AVX-512 Off ..... MIN: 2700 AVG: 4049 MAX: 4151 AVX-512 256b DP . MIN: 2700 AVG: 4038 MAX: 4137 AVX-512 512b DP . MIN: 2700 AVG: 4038 MAX: 4143 ONNX Runtime 1.19 CPU Peak Freq (Highest CPU Core Frequency) Monitor Megahertz > Higher Is Better AVX-512 Off ..... MIN: 2700 AVG: 4044 MAX: 4139 AVX-512 256b DP . MIN: 2700 AVG: 4052 MAX: 4148 AVX-512 512b DP . MIN: 2700 AVG: 4043 MAX: 4162 ONNX Runtime 1.19 CPU Peak Freq (Highest CPU Core Frequency) Monitor Megahertz > Higher Is Better AVX-512 Off ..... MIN: 2700 AVG: 4052 MAX: 4148 AVX-512 256b DP . MIN: 2700 AVG: 4032 MAX: 4138 AVX-512 512b DP . MIN: 2700 AVG: 4059 MAX: 4160 ONNX Runtime 1.19 CPU Peak Freq (Highest CPU Core Frequency) Monitor Megahertz > Higher Is Better AVX-512 Off ..... MIN: 2700 AVG: 4023 MAX: 4146 AVX-512 256b DP . MIN: 2700 AVG: 4048 MAX: 4153 AVX-512 512b DP . MIN: 2700 AVG: 4041 MAX: 4156 ONNX Runtime 1.19 CPU Peak Freq (Highest CPU Core Frequency) Monitor Megahertz > Higher Is Better AVX-512 Off ..... MIN: 2700 AVG: 3402 MAX: 4159 AVX-512 256b DP . MIN: 2700 AVG: 3694 MAX: 4148 AVX-512 512b DP . MIN: 2700 AVG: 3168 MAX: 4140 Numpy Benchmark CPU Peak Freq (Highest CPU Core Frequency) Monitor Megahertz > Higher Is Better AVX-512 Off ..... MIN: 2700 AVG: 4089 MAX: 4151 AVX-512 256b DP . MIN: 2700 AVG: 4079 MAX: 4154 AVX-512 512b DP . MIN: 2700 AVG: 4082 MAX: 4154 SVT-AV1 2.2 CPU Peak Freq (Highest CPU Core Frequency) Monitor Megahertz > Higher Is Better AVX-512 Off ..... MIN: 2700 AVG: 3679 MAX: 4157 AVX-512 256b DP . MIN: 2700 AVG: 3639 MAX: 4168 AVX-512 512b DP . MIN: 2700 AVG: 3634 MAX: 4159 SVT-AV1 2.2 CPU Peak Freq (Highest CPU Core Frequency) Monitor Megahertz > Higher Is Better AVX-512 Off ..... MIN: 2700 AVG: 3947 MAX: 4150 AVX-512 256b DP . MIN: 2700 AVG: 3943 MAX: 4153 AVX-512 512b DP . MIN: 2700 AVG: 3928 MAX: 4170 SVT-AV1 2.2 CPU Peak Freq (Highest CPU Core Frequency) Monitor Megahertz > Higher Is Better AVX-512 Off ..... MIN: 2700 AVG: 4031 MAX: 4163 AVX-512 256b DP . MIN: 2700 AVG: 4045 MAX: 4153 AVX-512 512b DP . MIN: 2700 AVG: 4035 MAX: 4159 SVT-AV1 2.2 CPU Peak Freq (Highest CPU Core Frequency) Monitor Megahertz > Higher Is Better AVX-512 Off ..... MIN: 2700 AVG: 4109 MAX: 4171 AVX-512 256b DP . MIN: 2700 AVG: 4108 MAX: 4167 AVX-512 512b DP . MIN: 2700 AVG: 4113 MAX: 4162 SMHasher 2022-08-22 Hash: FarmHash32 x86_64 AVX MiB/sec > Higher Is Better AVX-512 Off ..... 32099.03 |================================================ AVX-512 256b DP . 34422.41 |=================================================== AVX-512 512b DP . 34394.98 |=================================================== GROMACS 2024 Implementation: MPI CPU - Input: water_GMX50_bare Ns Per Day Per Watt > Higher Is Better AVX-512 Off ..... 0.052 |========================================== AVX-512 256b DP . 0.057 |============================================== AVX-512 512b DP . 0.067 |====================================================== GROMACS 2024 Implementation: MPI CPU - Input: water_GMX50_bare Ns Per Day > Higher Is Better AVX-512 Off ..... 18.35 |=========================================== AVX-512 256b DP . 19.54 |============================================== AVX-512 512b DP . 22.84 |====================================================== NAMD 3.0b6 Input: ATPase with 327,506 Atoms ns/day Per Watt > Higher Is Better AVX-512 Off ..... 0.040 |============================= AVX-512 256b DP . 0.067 |================================================ AVX-512 512b DP . 0.075 |====================================================== NAMD 3.0b6 Input: STMV with 1,066,628 Atoms ns/day Per Watt > Higher Is Better AVX-512 Off ..... 0.009 |========================== AVX-512 256b DP . 0.016 |============================================= AVX-512 512b DP . 0.019 |====================================================== NAMD 3.0b6 Input: ATPase with 327,506 Atoms ns/day > Higher Is Better AVX-512 Off ..... 7.00068 |========================= AVX-512 256b DP . 13.31002 |================================================ AVX-512 512b DP . 14.18293 |=================================================== NAMD 3.0b6 Input: STMV with 1,066,628 Atoms ns/day > Higher Is Better AVX-512 Off ..... 2.28097 |========================== AVX-512 256b DP . 4.17026 |=============================================== AVX-512 512b DP . 4.62565 |==================================================== Numpy Benchmark Score > Higher Is Better AVX-512 Off ..... 739.69 |================================================= AVX-512 256b DP . 794.98 |===================================================== AVX-512 512b DP . 795.31 |===================================================== Numpy Benchmark Score Per Watt > Higher Is Better AVX-512 Off ..... 8.029 |================================================== AVX-512 256b DP . 8.661 |====================================================== AVX-512 512b DP . 8.613 |====================================================== miniBUDE 20210901 CPU Temperature Monitor Celsius < Lower Is Better AVX-512 Off ..... MIN: 28.4 AVG: 46.0 MAX: 51.5 AVX-512 256b DP . MIN: 27.8 AVG: 42.6 MAX: 47.4 AVX-512 512b DP . MIN: 27.5 AVG: 41.2 MAX: 45.8 miniBUDE 20210901 CPU Temperature Monitor Celsius < Lower Is Better AVX-512 Off ..... MIN: 32.1 AVG: 55.0 MAX: 60.1 AVX-512 256b DP . MIN: 30.8 AVG: 52.7 MAX: 58.4 AVX-512 512b DP . MIN: 29.6 AVG: 51.8 MAX: 57.6 NAMD 3.0b6 CPU Temperature Monitor Celsius < Lower Is Better AVX-512 Off ..... MIN: 35.9 AVG: 44.5 MAX: 51.1 AVX-512 256b DP . MIN: 34.9 AVG: 43.7 MAX: 47.6 AVX-512 512b DP . MIN: 34.1 AVG: 41.9 MAX: 45.4 NAMD 3.0b6 CPU Temperature Monitor Celsius < Lower Is Better AVX-512 Off ..... MIN: 33.5 AVG: 47.8 MAX: 56.1 AVX-512 256b DP . MIN: 32.4 AVG: 47.3 MAX: 53.4 AVX-512 512b DP . MIN: 31.4 AVG: 44.8 MAX: 50.5 GROMACS 2024 CPU Temperature Monitor Celsius < Lower Is Better AVX-512 Off ..... MIN: 33.4 AVG: 53.6 MAX: 59.9 AVX-512 256b DP . MIN: 34.3 AVG: 52.7 MAX: 58.3 AVX-512 512b DP . MIN: 33.1 AVG: 51.7 MAX: 57.6 OpenFOAM 10 CPU Temperature Monitor Celsius < Lower Is Better AVX-512 Off ..... MIN: 36.4 AVG: 53.9 MAX: 60.4 AVX-512 256b DP . MIN: 37.1 AVG: 53.6 MAX: 59.8 AVX-512 512b DP . MIN: 35.3 AVG: 52.7 MAX: 59.0 OpenFOAM 10 CPU Temperature Monitor Celsius < Lower Is Better AVX-512 Off ..... MIN: 36.3 AVG: 59.9 MAX: 62.3 AVX-512 256b DP . MIN: 35.8 AVG: 59.5 MAX: 61.6 AVX-512 512b DP . MIN: 35.3 AVG: 59.3 MAX: 62.0 simdjson 3.10 CPU Temperature Monitor Celsius < Lower Is Better AVX-512 Off ..... MIN: 36.5 AVG: 41.8 MAX: 43.8 AVX-512 256b DP . MIN: 33.9 AVG: 37.9 MAX: 41.6 AVX-512 512b DP . MIN: 32.4 AVG: 37.9 MAX: 44.0 simdjson 3.10 CPU Temperature Monitor Celsius < Lower Is Better AVX-512 Off ..... MIN: 30.1 AVG: 39.6 MAX: 41.4 AVX-512 256b DP . MIN: 27.8 AVG: 36.9 MAX: 38.4 AVX-512 512b DP . MIN: 27.5 AVG: 37.1 MAX: 39.3 simdjson 3.10 CPU Temperature Monitor Celsius < Lower Is Better AVX-512 Off ..... MIN: 29.4 AVG: 39.9 MAX: 40.9 AVX-512 256b DP . MIN: 27.8 AVG: 39.4 MAX: 41.8 AVX-512 512b DP . MIN: 27.3 AVG: 38.5 MAX: 41.4 simdjson 3.10 CPU Temperature Monitor Celsius < Lower Is Better AVX-512 Off ..... MIN: 29.6 AVG: 39.1 MAX: 41.5 AVX-512 256b DP . MIN: 28.0 AVG: 36.5 MAX: 37.4 AVX-512 512b DP . MIN: 27.8 AVG: 37.6 MAX: 39.5 simdjson 3.10 CPU Temperature Monitor Celsius < Lower Is Better AVX-512 Off ..... MIN: 29.3 AVG: 39.5 MAX: 41.3 AVX-512 256b DP . MIN: 27.4 AVG: 37.9 MAX: 39.4 AVX-512 512b DP . MIN: 27.1 AVG: 37.8 MAX: 39.8 Embree 4.3 CPU Temperature Monitor Celsius < Lower Is Better AVX-512 Off ..... MIN: 29.4 AVG: 42.6 MAX: 47.1 AVX-512 256b DP . MIN: 27.6 AVG: 40.8 MAX: 45.4 AVX-512 512b DP . MIN: 27.3 AVG: 40.2 MAX: 45.0 Embree 4.3 CPU Temperature Monitor Celsius < Lower Is Better AVX-512 Off ..... MIN: 32.8 AVG: 43.9 MAX: 47.5 AVX-512 256b DP . MIN: 31.4 AVG: 42.1 MAX: 45.6 AVX-512 512b DP . MIN: 30.8 AVG: 41.7 MAX: 44.9 Embree 4.3 CPU Temperature Monitor Celsius < Lower Is Better AVX-512 Off ..... MIN: 33.0 AVG: 46.6 MAX: 51.6 AVX-512 256b DP . MIN: 31.1 AVG: 44.7 MAX: 49.3 AVX-512 512b DP . MIN: 30.8 AVG: 44.1 MAX: 48.8 OpenVKL 2.0.0 CPU Temperature Monitor Celsius < Lower Is Better AVX-512 Off ..... MIN: 34.8 AVG: 56.3 MAX: 61.6 AVX-512 256b DP . MIN: 32.9 AVG: 55.0 MAX: 60.5 AVX-512 512b DP . MIN: 32.6 AVG: 56.1 MAX: 61.9 OSPRay 3.2 CPU Temperature Monitor Celsius < Lower Is Better AVX-512 Off ..... MIN: 36.5 AVG: 56.8 MAX: 60.5 AVX-512 256b DP . MIN: 36.4 AVG: 57.2 MAX: 60.4 AVX-512 512b DP . MIN: 37.9 AVG: 59.6 MAX: 62.6 OSPRay 3.2 CPU Temperature Monitor Celsius < Lower Is Better AVX-512 Off ..... MIN: 37.8 AVG: 57.5 MAX: 61.0 AVX-512 256b DP . MIN: 37.6 AVG: 57.6 MAX: 60.9 AVX-512 512b DP . MIN: 39.1 AVG: 59.8 MAX: 62.9 OSPRay 3.2 CPU Temperature Monitor Celsius < Lower Is Better AVX-512 Off ..... MIN: 37.8 AVG: 57.5 MAX: 60.3 AVX-512 256b DP . MIN: 37.6 AVG: 55.9 MAX: 59.8 AVX-512 512b DP . MIN: 39.5 AVG: 58.2 MAX: 61.0 OSPRay Studio 1.0 CPU Temperature Monitor Celsius < Lower Is Better AVX-512 Off ..... MIN: 34.6 AVG: 53.9 MAX: 58.5 AVX-512 256b DP . MIN: 34.9 AVG: 54.0 MAX: 58.5 AVX-512 512b DP . MIN: 36.5 AVG: 55.7 MAX: 60.0 OSPRay Studio 1.0 CPU Temperature Monitor Celsius < Lower Is Better AVX-512 Off ..... MIN: 37.6 AVG: 53.7 MAX: 57.8 AVX-512 256b DP . MIN: 37.3 AVG: 53.7 MAX: 57.8 AVX-512 512b DP . MIN: 39.1 AVG: 55.1 MAX: 59.8 OSPRay Studio 1.0 CPU Temperature Monitor Celsius < Lower Is Better AVX-512 Off ..... MIN: 37.0 AVG: 54.7 MAX: 58.9 AVX-512 256b DP . MIN: 36.6 AVG: 54.5 MAX: 58.5 AVX-512 512b DP . MIN: 38.4 AVG: 56.7 MAX: 60.9 OSPRay Studio 1.0 CPU Temperature Monitor Celsius < Lower Is Better AVX-512 Off ..... MIN: 37.0 AVG: 54.4 MAX: 58.5 AVX-512 256b DP . MIN: 37.0 AVG: 53.8 MAX: 58.0 AVX-512 512b DP . MIN: 39.6 AVG: 56.3 MAX: 60.6 OSPRay Studio 1.0 CPU Temperature Monitor Celsius < Lower Is Better AVX-512 Off ..... MIN: 36.9 AVG: 53.5 MAX: 58.4 AVX-512 256b DP . MIN: 37.3 AVG: 53.9 MAX: 58.5 AVX-512 512b DP . MIN: 39.1 AVG: 56.0 MAX: 60.6 OSPRay Studio 1.0 CPU Temperature Monitor Celsius < Lower Is Better AVX-512 Off ..... MIN: 37.1 AVG: 55.2 MAX: 58.6 AVX-512 256b DP . MIN: 37.6 AVG: 55.1 MAX: 58.5 AVX-512 512b DP . MIN: 39.3 AVG: 57.3 MAX: 60.9 OSPRay Studio 1.0 CPU Temperature Monitor Celsius < Lower Is Better AVX-512 Off ..... MIN: 37.0 AVG: 54.1 MAX: 58.3 AVX-512 256b DP . MIN: 37.1 AVG: 54.1 MAX: 58.1 AVX-512 512b DP . MIN: 39.3 AVG: 56.7 MAX: 60.9 OSPRay Studio 1.0 CPU Temperature Monitor Celsius < Lower Is Better AVX-512 Off ..... MIN: 36.8 AVG: 55.3 MAX: 58.9 AVX-512 256b DP . MIN: 36.8 AVG: 54.5 MAX: 58.6 AVX-512 512b DP . MIN: 39.3 AVG: 56.2 MAX: 60.9 OSPRay Studio 1.0 CPU Temperature Monitor Celsius < Lower Is Better AVX-512 Off ..... MIN: 37.5 AVG: 51.5 MAX: 57.0 AVX-512 256b DP . MIN: 37.6 AVG: 55.4 MAX: 59.1 AVX-512 512b DP . MIN: 39.1 AVG: 57.6 MAX: 61.1 Y-Cruncher 0.8.5 CPU Temperature Monitor Celsius < Lower Is Better AVX-512 Off ..... MIN: 32.0 AVG: 44.3 MAX: 49.6 AVX-512 256b DP . MIN: 31.4 AVG: 42.3 MAX: 46.8 AVX-512 512b DP . MIN: 33.5 AVG: 44.2 MAX: 48.5 Y-Cruncher 0.8.5 CPU Temperature Monitor Celsius < Lower Is Better AVX-512 Off ..... MIN: 32.8 AVG: 51.8 MAX: 60.0 AVX-512 256b DP . MIN: 31.8 AVG: 48.2 MAX: 54.6 AVX-512 512b DP . MIN: 34.1 AVG: 49.6 MAX: 55.9 Y-Cruncher 0.8.5 CPU Temperature Monitor Celsius < Lower Is Better AVX-512 Off ..... MIN: 34.8 AVG: 54.6 MAX: 61.6 AVX-512 256b DP . MIN: 34.3 AVG: 50.8 MAX: 56.5 AVX-512 512b DP . MIN: 35.9 AVG: 51.9 MAX: 57.6 Xmrig 6.21 CPU Temperature Monitor Celsius < Lower Is Better AVX-512 Off ..... MIN: 26.1 AVG: 55.7 MAX: 60.3 AVX-512 256b DP . MIN: 25.6 AVG: 55.6 MAX: 60.1 AVX-512 512b DP . MIN: 28.9 AVG: 59.2 MAX: 63.0 oneDNN 3.4 CPU Temperature Monitor Celsius < Lower Is Better AVX-512 Off ..... MIN: 37.1 AVG: 45.6 MAX: 49.4 AVX-512 256b DP . MIN: 37.8 AVG: 45.2 MAX: 48.8 AVX-512 512b DP . MIN: 40.1 AVG: 45.8 MAX: 49.0 oneDNN 3.4 CPU Temperature Monitor Celsius < Lower Is Better AVX-512 Off ..... MIN: 31.9 AVG: 44.9 MAX: 48.6 AVX-512 256b DP . MIN: 32.5 AVG: 39.8 MAX: 42.4 AVX-512 512b DP . MIN: 33.9 AVG: 40.3 MAX: 42.5 oneDNN 3.4 CPU Temperature Monitor Celsius < Lower Is Better AVX-512 Off ..... MIN: 31.4 AVG: 38.0 MAX: 40.6 AVX-512 256b DP . MIN: 31.6 AVG: 38.0 MAX: 40.5 AVX-512 512b DP . MIN: 33.3 AVG: 40.4 MAX: 43.0 oneDNN 3.4 CPU Temperature Monitor Celsius < Lower Is Better AVX-512 Off ..... MIN: 30.1 AVG: 47.1 MAX: 52.4 AVX-512 256b DP . MIN: 30.8 AVG: 48.7 MAX: 51.6 AVX-512 512b DP . MIN: 33.3 AVG: 48.2 MAX: 50.9 PyTorch 2.2.1 CPU Temperature Monitor Celsius < Lower Is Better AVX-512 Off ..... MIN: 33.8 AVG: 41.8 MAX: 44.4 AVX-512 256b DP . MIN: 35.0 AVG: 40.9 MAX: 43.0 AVX-512 512b DP . MIN: 36.9 AVG: 44.2 MAX: 46.6 PyTorch 2.2.1 CPU Temperature Monitor Celsius < Lower Is Better AVX-512 Off ..... MIN: 31.6 AVG: 42.8 MAX: 44.9 AVX-512 256b DP . MIN: 31.3 AVG: 41.6 MAX: 44.1 AVX-512 512b DP . MIN: 34.8 AVG: 45.4 MAX: 47.6 PyTorch 2.2.1 CPU Temperature Monitor Celsius < Lower Is Better AVX-512 Off ..... MIN: 32.4 AVG: 43.2 MAX: 45.4 AVX-512 256b DP . MIN: 32.1 AVG: 42.0 MAX: 43.9 AVX-512 512b DP . MIN: 35.8 AVG: 45.7 MAX: 48.1 TensorFlow 2.16.1 CPU Temperature Monitor Celsius < Lower Is Better AVX-512 Off ..... MIN: 30.6 AVG: 47.1 MAX: 48.5 AVX-512 256b DP . MIN: 30.3 AVG: 49.5 MAX: 51.1 AVX-512 512b DP . MIN: 33.5 AVG: 47.8 MAX: 50.3 TensorFlow 2.16.1 CPU Temperature Monitor Celsius < Lower Is Better AVX-512 Off ..... MIN: 32.8 AVG: 50.2 MAX: 52.9 AVX-512 256b DP . MIN: 33.8 AVG: 51.7 MAX: 52.9 AVX-512 512b DP . MIN: 35.6 AVG: 50.6 MAX: 54.8 OpenVINO 2024.0 CPU Temperature Monitor Celsius < Lower Is Better AVX-512 Off ..... MIN: 33.8 AVG: 53.5 MAX: 56.8 AVX-512 256b DP . MIN: 34.5 AVG: 54.3 MAX: 57.6 AVX-512 512b DP . MIN: 37.0 AVG: 54.7 MAX: 57.5 OpenVINO 2024.0 CPU Temperature Monitor Celsius < Lower Is Better AVX-512 Off ..... MIN: 35.1 AVG: 51.4 MAX: 53.3 AVX-512 256b DP . MIN: 35.3 AVG: 51.1 MAX: 53.0 AVX-512 512b DP . MIN: 37.5 AVG: 51.6 MAX: 53.5 OpenVINO 2024.0 CPU Temperature Monitor Celsius < Lower Is Better AVX-512 Off ..... MIN: 34.3 AVG: 55.9 MAX: 58.8 AVX-512 256b DP . MIN: 34.1 AVG: 56.1 MAX: 58.9 AVX-512 512b DP . MIN: 36.6 AVG: 55.7 MAX: 57.9 OpenVINO 2024.0 CPU Temperature Monitor Celsius < Lower Is Better AVX-512 Off ..... MIN: 35.5 AVG: 53.9 MAX: 56.0 AVX-512 256b DP . MIN: 35.6 AVG: 54.4 MAX: 56.6 AVX-512 512b DP . MIN: 37.6 AVG: 54.2 MAX: 56.0 OpenVINO 2024.0 CPU Temperature Monitor Celsius < Lower Is Better AVX-512 Off ..... MIN: 34.8 AVG: 55.3 MAX: 57.8 AVX-512 256b DP . MIN: 35.4 AVG: 55.5 MAX: 58.0 AVX-512 512b DP . MIN: 37.4 AVG: 56.6 MAX: 58.9 OpenVINO 2024.0 CPU Temperature Monitor Celsius < Lower Is Better AVX-512 Off ..... MIN: 35.8 AVG: 53.4 MAX: 55.9 AVX-512 256b DP . MIN: 35.5 AVG: 55.3 MAX: 57.9 AVX-512 512b DP . MIN: 38.6 AVG: 53.0 MAX: 54.8 OpenVINO 2024.0 CPU Temperature Monitor Celsius < Lower Is Better AVX-512 Off ..... MIN: 34.8 AVG: 55.0 MAX: 57.6 AVX-512 256b DP . MIN: 35.6 AVG: 57.1 MAX: 60.0 AVX-512 512b DP . MIN: 36.6 AVG: 59.3 MAX: 62.1 OpenVINO 2024.0 CPU Temperature Monitor Celsius < Lower Is Better AVX-512 Off ..... MIN: 35.8 AVG: 55.1 MAX: 57.4 AVX-512 256b DP . MIN: 36.4 AVG: 55.0 MAX: 57.3 AVX-512 512b DP . MIN: 39.5 AVG: 56.0 MAX: 57.9 OpenVINO 2024.0 CPU Temperature Monitor Celsius < Lower Is Better AVX-512 Off ..... MIN: 35.1 AVG: 54.3 MAX: 56.5 AVX-512 256b DP . MIN: 35.1 AVG: 55.8 MAX: 58.3 AVX-512 512b DP . MIN: 38.0 AVG: 59.1 MAX: 61.5 OpenVINO 2024.0 CPU Temperature Monitor Celsius < Lower Is Better AVX-512 Off ..... MIN: 35.5 AVG: 56.6 MAX: 59.3 AVX-512 256b DP . MIN: 36.1 AVG: 55.2 MAX: 57.5 AVX-512 512b DP . MIN: 39.4 AVG: 54.5 MAX: 56.3 OpenVINO 2024.0 CPU Temperature Monitor Celsius < Lower Is Better AVX-512 Off ..... MIN: 36.3 AVG: 54.0 MAX: 56.4 AVX-512 256b DP . MIN: 35.4 AVG: 56.5 MAX: 59.1 AVX-512 512b DP . MIN: 37.6 AVG: 59.2 MAX: 61.8 OpenVINO 2024.0 CPU Temperature Monitor Celsius < Lower Is Better AVX-512 Off ..... MIN: 35.1 AVG: 48.0 MAX: 50.1 AVX-512 256b DP . MIN: 35.8 AVG: 53.4 MAX: 56.1 AVX-512 512b DP . MIN: 39.5 AVG: 54.9 MAX: 57.1 libxsmm 2-1.17-3645 CPU Temperature Monitor Celsius < Lower Is Better AVX-512 Off ..... MIN: 33.3 AVG: 42.1 MAX: 46.3 AVX-512 256b DP . MIN: 32.8 AVG: 40.4 MAX: 44.0 AVX-512 512b DP . MIN: 36.6 AVG: 45.7 MAX: 48.6 ONNX Runtime 1.19 CPU Temperature Monitor Celsius < Lower Is Better AVX-512 Off ..... MIN: 33.5 AVG: 49.2 MAX: 53.6 AVX-512 256b DP . MIN: 33.9 AVG: 52.2 MAX: 54.6 AVX-512 512b DP . MIN: 37.6 AVG: 49.8 MAX: 51.4 ONNX Runtime 1.19 CPU Temperature Monitor Celsius < Lower Is Better AVX-512 Off ..... MIN: 32.3 AVG: 47.6 MAX: 48.9 AVX-512 256b DP . MIN: 34.9 AVG: 45.5 MAX: 46.6 AVX-512 512b DP . MIN: 36.1 AVG: 50.8 MAX: 52.4 ONNX Runtime 1.19 CPU Temperature Monitor Celsius < Lower Is Better AVX-512 Off ..... MIN: 30.8 AVG: 53.6 MAX: 55.9 AVX-512 256b DP . MIN: 30.6 AVG: 51.6 MAX: 54.8 AVX-512 512b DP . MIN: 34.1 AVG: 55.8 MAX: 57.8 ONNX Runtime 1.19 CPU Temperature Monitor Celsius < Lower Is Better AVX-512 Off ..... MIN: 34.1 AVG: 37.3 MAX: 38.6 AVX-512 256b DP . MIN: 34.8 AVG: 37.8 MAX: 39.3 AVX-512 512b DP . MIN: 37.4 AVG: 41.0 MAX: 42.1 ONNX Runtime 1.19 CPU Temperature Monitor Celsius < Lower Is Better AVX-512 Off ..... MIN: 28.3 AVG: 47.8 MAX: 50.6 AVX-512 256b DP . MIN: 29.1 AVG: 49.7 MAX: 51.8 AVX-512 512b DP . MIN: 32.8 AVG: 53.0 MAX: 55.4 ONNX Runtime 1.19 CPU Temperature Monitor Celsius < Lower Is Better AVX-512 Off ..... MIN: 33.6 AVG: 52.4 MAX: 54.8 AVX-512 256b DP . MIN: 33.6 AVG: 53.8 MAX: 56.1 AVX-512 512b DP . MIN: 37.5 AVG: 51.5 MAX: 53.8 Numpy Benchmark CPU Temperature Monitor Celsius < Lower Is Better AVX-512 Off ..... MIN: 34.0 AVG: 40.3 MAX: 44.4 AVX-512 256b DP . MIN: 35.4 AVG: 40.9 MAX: 44.6 AVX-512 512b DP . MIN: 36.5 AVG: 43.1 MAX: 49.3 SVT-AV1 2.2 CPU Temperature Monitor Celsius < Lower Is Better AVX-512 Off ..... MIN: 28.6 AVG: 40.1 MAX: 44.5 AVX-512 256b DP . MIN: 28.6 AVG: 40.9 MAX: 44.8 AVX-512 512b DP . MIN: 31.9 AVG: 44.6 MAX: 49.0 SVT-AV1 2.2 CPU Temperature Monitor Celsius < Lower Is Better AVX-512 Off ..... MIN: 29.3 AVG: 45.5 MAX: 49.8 AVX-512 256b DP . MIN: 29.6 AVG: 44.3 MAX: 47.9 AVX-512 512b DP . MIN: 33.3 AVG: 48.5 MAX: 52.4 SVT-AV1 2.2 CPU Temperature Monitor Celsius < Lower Is Better AVX-512 Off ..... MIN: 30.3 AVG: 47.7 MAX: 50.9 AVX-512 256b DP . MIN: 30.8 AVG: 46.7 MAX: 51.6 AVX-512 512b DP . MIN: 34.5 AVG: 51.0 MAX: 53.8 SVT-AV1 2.2 CPU Temperature Monitor Celsius < Lower Is Better AVX-512 Off ..... MIN: 30.6 AVG: 51.1 MAX: 54.9 AVX-512 256b DP . MIN: 30.9 AVG: 50.4 MAX: 54.1 AVX-512 512b DP . MIN: 33.5 AVG: 53.6 MAX: 57.9 SMHasher 2022-08-22 Hash: FarmHash32 x86_64 AVX cycles/hash < Lower Is Better AVX-512 Off ..... 26.51 |===================================================== AVX-512 256b DP . 26.89 |====================================================== AVX-512 512b DP . 26.49 |===================================================== ONNX Runtime 1.19 Model: fcn-resnet101-11 - Device: CPU - Executor: Standard Inference Time Cost (ms) < Lower Is Better AVX-512 Off ..... 127.02 |===================================================== AVX-512 256b DP . 112.54 |=============================================== AVX-512 512b DP . 96.81 |======================================== ONNX Runtime 1.19 Model: super-resolution-10 - Device: CPU - Executor: Standard Inference Time Cost (ms) < Lower Is Better AVX-512 Off ..... 6.17395 |==================================================== AVX-512 256b DP . 6.13926 |==================================================== AVX-512 512b DP . 4.83481 |========================================= ONNX Runtime 1.19 Model: bertsquad-12 - Device: CPU - Executor: Standard Inference Time Cost (ms) < Lower Is Better AVX-512 Off ..... 59.03 |====================================================== AVX-512 256b DP . 55.82 |=================================================== AVX-512 512b DP . 46.34 |========================================== ONNX Runtime 1.19 Model: GPT-2 - Device: CPU - Executor: Standard Inference Time Cost (ms) < Lower Is Better AVX-512 Off ..... 5.50578 |==================================================== AVX-512 256b DP . 5.22862 |================================================= AVX-512 512b DP . 5.18369 |================================================= ONNX Runtime 1.19 Model: ArcFace ResNet-100 - Device: CPU - Executor: Standard Inference Time Cost (ms) < Lower Is Better AVX-512 Off ..... 25.75 |====================================================== AVX-512 256b DP . 22.44 |=============================================== AVX-512 512b DP . 22.85 |================================================ ONNX Runtime 1.19 Model: ResNet101_DUC_HDC-12 - Device: CPU - Executor: Standard Inference Time Cost (ms) < Lower Is Better AVX-512 Off ..... 181.74 |===================================================== AVX-512 256b DP . 177.49 |==================================================== AVX-512 512b DP . 143.94 |========================================== OSPRay Studio 1.0 Camera: 1 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path Tracer - Acceleration: CPU ms < Lower Is Better AVX-512 Off ..... 714 |======================================================== AVX-512 256b DP . 671 |===================================================== AVX-512 512b DP . 639 |================================================== OSPRay Studio 1.0 Camera: 1 - Resolution: 4K - Samples Per Pixel: 16 - Renderer: Path Tracer - Acceleration: CPU ms < Lower Is Better AVX-512 Off ..... 11396 |====================================================== AVX-512 256b DP . 10733 |=================================================== AVX-512 512b DP . 10169 |================================================ OSPRay Studio 1.0 Camera: 1 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path Tracer - Acceleration: CPU ms < Lower Is Better AVX-512 Off ..... 22869 |====================================================== AVX-512 256b DP . 21539 |=================================================== AVX-512 512b DP . 20379 |================================================ OSPRay Studio 1.0 Camera: 2 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path Tracer - Acceleration: CPU ms < Lower Is Better AVX-512 Off ..... 719 |======================================================== AVX-512 256b DP . 675 |===================================================== AVX-512 512b DP . 642 |================================================== OSPRay Studio 1.0 Camera: 2 - Resolution: 4K - Samples Per Pixel: 16 - Renderer: Path Tracer - Acceleration: CPU ms < Lower Is Better AVX-512 Off ..... 11451 |====================================================== AVX-512 256b DP . 10816 |=================================================== AVX-512 512b DP . 10231 |================================================ OSPRay Studio 1.0 Camera: 2 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path Tracer - Acceleration: CPU ms < Lower Is Better AVX-512 Off ..... 22955 |====================================================== AVX-512 256b DP . 21646 |=================================================== AVX-512 512b DP . 20438 |================================================ OSPRay Studio 1.0 Camera: 3 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path Tracer - Acceleration: CPU ms < Lower Is Better AVX-512 Off ..... 836 |======================================================== AVX-512 256b DP . 791 |===================================================== AVX-512 512b DP . 752 |================================================== OSPRay Studio 1.0 Camera: 3 - Resolution: 4K - Samples Per Pixel: 16 - Renderer: Path Tracer - Acceleration: CPU ms < Lower Is Better AVX-512 Off ..... 13357 |====================================================== AVX-512 256b DP . 12693 |=================================================== AVX-512 512b DP . 11963 |================================================ OSPRay Studio 1.0 Camera: 3 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path Tracer - Acceleration: CPU ms < Lower Is Better AVX-512 Off ..... 30820 |====================================================== AVX-512 256b DP . 25393 |============================================ AVX-512 512b DP . 24030 |========================================== oneDNN 3.4 Harness: Convolution Batch Shapes Auto - Engine: CPU ms < Lower Is Better AVX-512 Off ..... 0.373925 |=================================================== AVX-512 256b DP . 0.350034 |================================================ AVX-512 512b DP . 0.257632 |=================================== oneDNN 3.4 Harness: Deconvolution Batch shapes_3d - Engine: CPU ms < Lower Is Better AVX-512 Off ..... 1.312140 |=================================================== AVX-512 256b DP . 0.700379 |=========================== AVX-512 512b DP . 0.509019 |==================== oneDNN 3.4 Harness: IP Shapes 3D - Engine: CPU ms < Lower Is Better AVX-512 Off ..... 3.141980 |=================================================== AVX-512 256b DP . 0.323221 |===== AVX-512 512b DP . 0.322331 |===== oneDNN 3.4 Harness: Recurrent Neural Network Training - Engine: CPU ms < Lower Is Better AVX-512 Off ..... 447.80 |================================================= AVX-512 256b DP . 482.88 |===================================================== AVX-512 512b DP . 425.22 |=============================================== OpenVINO 2024.0 Model: Face Detection FP16-INT8 - Device: CPU ms < Lower Is Better AVX-512 Off ..... 544.38 |===================================================== AVX-512 256b DP . 463.88 |============================================= AVX-512 512b DP . 329.05 |================================ OpenVINO 2024.0 Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU ms < Lower Is Better AVX-512 Off ..... 0.57 |======================================================= AVX-512 256b DP . 0.55 |===================================================== AVX-512 512b DP . 0.48 |============================================== OpenVINO 2024.0 Model: Person Detection FP16 - Device: CPU ms < Lower Is Better AVX-512 Off ..... 167.07 |===================================================== AVX-512 256b DP . 89.90 |============================= AVX-512 512b DP . 83.32 |========================== OpenVINO 2024.0 Model: Weld Porosity Detection FP16-INT8 - Device: CPU ms < Lower Is Better AVX-512 Off ..... 10.75 |====================================================== AVX-512 256b DP . 9.25 |============================================== AVX-512 512b DP . 6.60 |================================= OpenVINO 2024.0 Model: Vehicle Detection FP16-INT8 - Device: CPU ms < Lower Is Better AVX-512 Off ..... 10.26 |====================================================== AVX-512 256b DP . 7.48 |======================================= AVX-512 512b DP . 5.61 |============================== OpenVINO 2024.0 Model: Person Vehicle Bike Detection FP16 - Device: CPU ms < Lower Is Better AVX-512 Off ..... 15.32 |====================================================== AVX-512 256b DP . 7.90 |============================ AVX-512 512b DP . 7.21 |========================= OpenVINO 2024.0 Model: Machine Translation EN To DE FP16 - Device: CPU ms < Lower Is Better AVX-512 Off ..... 160.34 |===================================================== AVX-512 256b DP . 73.73 |======================== AVX-512 512b DP . 57.47 |=================== OpenVINO 2024.0 Model: Face Detection Retail FP16-INT8 - Device: CPU ms < Lower Is Better AVX-512 Off ..... 6.29 |======================================================= AVX-512 256b DP . 5.04 |============================================ AVX-512 512b DP . 3.87 |================================== OpenVINO 2024.0 Model: Handwritten English Recognition FP16-INT8 - Device: CPU ms < Lower Is Better AVX-512 Off ..... 68.68 |====================================================== AVX-512 256b DP . 30.35 |======================== AVX-512 512b DP . 26.63 |===================== OpenVINO 2024.0 Model: Road Segmentation ADAS FP16-INT8 - Device: CPU ms < Lower Is Better AVX-512 Off ..... 24.30 |====================================================== AVX-512 256b DP . 22.36 |================================================== AVX-512 512b DP . 19.29 |=========================================== OpenVINO 2024.0 Model: Person Re-Identification Retail FP16 - Device: CPU ms < Lower Is Better AVX-512 Off ..... 13.35 |====================================================== AVX-512 256b DP . 6.29 |========================= AVX-512 512b DP . 4.49 |================== OpenVINO 2024.0 Model: Noise Suppression Poconet-Like FP16 - Device: CPU ms < Lower Is Better AVX-512 Off ..... 42.42 |====================================================== AVX-512 256b DP . 11.79 |=============== AVX-512 512b DP . 10.75 |============== Mobile Neural Network 2.9.b11b7037d Model: mobilenetV3 ms < Lower Is Better AVX-512 Off ..... 2.055 |====================================================== AVX-512 256b DP . 1.980 |==================================================== AVX-512 512b DP . 1.872 |================================================= Mobile Neural Network 2.9.b11b7037d Model: resnet-v2-50 ms < Lower Is Better AVX-512 Off ..... 10.053 |===================================================== AVX-512 256b DP . 8.851 |=============================================== AVX-512 512b DP . 7.674 |======================================== OpenFOAM 10 Input: drivaerFastback, Small Mesh Size - Execution Time Seconds < Lower Is Better AVX-512 Off ..... 20.42 |====================================================== AVX-512 256b DP . 19.98 |===================================================== AVX-512 512b DP . 20.25 |====================================================== OpenFOAM 10 Input: drivaerFastback, Medium Mesh Size - Execution Time Seconds < Lower Is Better AVX-512 Off ..... 161.95 |==================================================== AVX-512 256b DP . 163.51 |===================================================== AVX-512 512b DP . 161.00 |==================================================== Y-Cruncher 0.8.5 Pi Digits To Calculate: 1B Seconds < Lower Is Better AVX-512 Off ..... 8.020 |====================================================== AVX-512 256b DP . 7.751 |==================================================== AVX-512 512b DP . 7.789 |==================================================== Y-Cruncher 0.8.5 Pi Digits To Calculate: 5B Seconds < Lower Is Better AVX-512 Off ..... 31.25 |====================================================== AVX-512 256b DP . 24.60 |=========================================== AVX-512 512b DP . 24.07 |========================================== Y-Cruncher 0.8.5 Pi Digits To Calculate: 10B Seconds < Lower Is Better AVX-512 Off ..... 61.26 |====================================================== AVX-512 256b DP . 47.27 |========================================== AVX-512 512b DP . 45.86 |======================================== miniBUDE 20210901 CPU Power Consumption Monitor Watts < Lower Is Better AVX-512 Off ..... MIN: 45 AVG: 246 MAX: 458 AVX-512 256b DP . MIN: 44 AVG: 188 MAX: 444 AVX-512 512b DP . MIN: 44 AVG: 178 MAX: 461 miniBUDE 20210901 CPU Power Consumption Monitor Watts < Lower Is Better AVX-512 Off ..... MIN: 24 AVG: 385 MAX: 461 AVX-512 256b DP . MIN: 45 AVG: 339 MAX: 455 AVX-512 512b DP . MIN: 44 AVG: 340 MAX: 464 NAMD 3.0b6 CPU Power Consumption Monitor Watts < Lower Is Better AVX-512 Off ..... MIN: 45 AVG: 173 MAX: 453 AVX-512 256b DP . MIN: 45 AVG: 198 MAX: 428 AVX-512 512b DP . MIN: 45 AVG: 188 MAX: 411 NAMD 3.0b6 CPU Power Consumption Monitor Watts < Lower Is Better AVX-512 Off ..... MIN: 45 AVG: 249 MAX: 464 AVX-512 256b DP . MIN: 45 AVG: 265 MAX: 451 AVX-512 512b DP . MIN: 45 AVG: 248 MAX: 427 GROMACS 2024 CPU Power Consumption Monitor Watts < Lower Is Better AVX-512 Off ..... MIN: 45 AVG: 350 MAX: 476 AVX-512 256b DP . MIN: 45 AVG: 343 MAX: 467 AVX-512 512b DP . MIN: 22 AVG: 339 MAX: 488 OpenFOAM 10 CPU Power Consumption Monitor Watts < Lower Is Better AVX-512 Off ..... MIN: 45 AVG: 382 MAX: 491 AVX-512 256b DP . MIN: 45 AVG: 374 MAX: 491 AVX-512 512b DP . MIN: 44 AVG: 371 MAX: 490 OpenFOAM 10 CPU Power Consumption Monitor Watts < Lower Is Better AVX-512 Off ..... MIN: 45 AVG: 447 MAX: 490 AVX-512 256b DP . MIN: 45 AVG: 447 MAX: 491 AVX-512 512b DP . MIN: 44 AVG: 446 MAX: 488 simdjson 3.10 CPU Power Consumption Monitor Watts < Lower Is Better AVX-512 Off ..... MIN: 45 AVG: 92 MAX: 95 AVX-512 256b DP . MIN: 44 AVG: 91 MAX: 95 AVX-512 512b DP . MIN: 44 AVG: 91 MAX: 96 simdjson 3.10 CPU Power Consumption Monitor Watts < Lower Is Better AVX-512 Off ..... MIN: 45 AVG: 92 MAX: 97 AVX-512 256b DP . MIN: 45 AVG: 93 MAX: 97 AVX-512 512b DP . MIN: 44 AVG: 93 MAX: 97 simdjson 3.10 CPU Power Consumption Monitor Watts < Lower Is Better AVX-512 Off ..... MIN: 45 AVG: 98 MAX: 102 AVX-512 256b DP . MIN: 44 AVG: 98 MAX: 101 AVX-512 512b DP . MIN: 44 AVG: 98 MAX: 102 simdjson 3.10 CPU Power Consumption Monitor Watts < Lower Is Better AVX-512 Off ..... MIN: 45 AVG: 91 MAX: 97 AVX-512 256b DP . MIN: 44 AVG: 91 MAX: 95 AVX-512 512b DP . MIN: 44 AVG: 91 MAX: 95 simdjson 3.10 CPU Power Consumption Monitor Watts < Lower Is Better AVX-512 Off ..... MIN: 45 AVG: 92 MAX: 95 AVX-512 256b DP . MIN: 45 AVG: 91 MAX: 96 AVX-512 512b DP . MIN: 44 AVG: 92 MAX: 96 Embree 4.3 CPU Power Consumption Monitor Watts < Lower Is Better AVX-512 Off ..... MIN: 44 AVG: 233 MAX: 466 AVX-512 256b DP . MIN: 44 AVG: 224 MAX: 465 AVX-512 512b DP . MIN: 44 AVG: 228 MAX: 467 Embree 4.3 CPU Power Consumption Monitor Watts < Lower Is Better AVX-512 Off ..... MIN: 45 AVG: 186 MAX: 466 AVX-512 256b DP . MIN: 45 AVG: 175 MAX: 462 AVX-512 512b DP . MIN: 45 AVG: 175 MAX: 466 Embree 4.3 CPU Power Consumption Monitor Watts < Lower Is Better AVX-512 Off ..... MIN: 45 AVG: 262 MAX: 474 AVX-512 256b DP . MIN: 44 AVG: 256 MAX: 472 AVX-512 512b DP . MIN: 44 AVG: 256 MAX: 483 OpenVKL 2.0.0 CPU Power Consumption Monitor Watts < Lower Is Better AVX-512 Off ..... MIN: 45 AVG: 398 MAX: 491 AVX-512 256b DP . MIN: 44 AVG: 393 MAX: 473 AVX-512 512b DP . MIN: 45 AVG: 399 MAX: 482 OSPRay 3.2 CPU Power Consumption Monitor Watts < Lower Is Better AVX-512 Off ..... MIN: 45 AVG: 411 MAX: 479 AVX-512 256b DP . MIN: 45 AVG: 421 MAX: 481 AVX-512 512b DP . MIN: 45 AVG: 433 MAX: 492 OSPRay 3.2 CPU Power Consumption Monitor Watts < Lower Is Better AVX-512 Off ..... MIN: 45 AVG: 415 MAX: 485 AVX-512 256b DP . MIN: 45 AVG: 422 MAX: 482 AVX-512 512b DP . MIN: 45 AVG: 431 MAX: 492 OSPRay 3.2 CPU Power Consumption Monitor Watts < Lower Is Better AVX-512 Off ..... MIN: 45 AVG: 419 MAX: 472 AVX-512 256b DP . MIN: 45 AVG: 407 MAX: 463 AVX-512 512b DP . MIN: 45 AVG: 412 MAX: 470 OSPRay Studio 1.0 CPU Power Consumption Monitor Watts < Lower Is Better AVX-512 Off ..... MIN: 45 AVG: 369 MAX: 466 AVX-512 256b DP . MIN: 45 AVG: 367 MAX: 458 AVX-512 512b DP . MIN: 45 AVG: 370 MAX: 466 OSPRay Studio 1.0 CPU Power Consumption Monitor Watts < Lower Is Better AVX-512 Off ..... MIN: 45 AVG: 363 MAX: 473 AVX-512 256b DP . MIN: 45 AVG: 358 MAX: 461 AVX-512 512b DP . MIN: 45 AVG: 359 MAX: 465 OSPRay Studio 1.0 CPU Power Consumption Monitor Watts < Lower Is Better AVX-512 Off ..... MIN: 46 AVG: 388 MAX: 469 AVX-512 256b DP . MIN: 45 AVG: 386 MAX: 462 AVX-512 512b DP . MIN: 46 AVG: 383 MAX: 467 OSPRay Studio 1.0 CPU Power Consumption Monitor Watts < Lower Is Better AVX-512 Off ..... MIN: 45 AVG: 370 MAX: 472 AVX-512 256b DP . MIN: 45 AVG: 368 MAX: 462 AVX-512 512b DP . MIN: 45 AVG: 371 MAX: 468 OSPRay Studio 1.0 CPU Power Consumption Monitor Watts < Lower Is Better AVX-512 Off ..... MIN: 45 AVG: 366 MAX: 470 AVX-512 256b DP . MIN: 45 AVG: 358 MAX: 462 AVX-512 512b DP . MIN: 45 AVG: 361 MAX: 474 OSPRay Studio 1.0 CPU Power Consumption Monitor Watts < Lower Is Better AVX-512 Off ..... MIN: 45 AVG: 391 MAX: 472 AVX-512 256b DP . MIN: 45 AVG: 387 MAX: 463 AVX-512 512b DP . MIN: 45 AVG: 387 MAX: 475 OSPRay Studio 1.0 CPU Power Consumption Monitor Watts < Lower Is Better AVX-512 Off ..... MIN: 45 AVG: 370 MAX: 467 AVX-512 256b DP . MIN: 45 AVG: 368 MAX: 461 AVX-512 512b DP . MIN: 45 AVG: 374 MAX: 467 OSPRay Studio 1.0 CPU Power Consumption Monitor Watts < Lower Is Better AVX-512 Off ..... MIN: 45 AVG: 400 MAX: 472 AVX-512 256b DP . MIN: 45 AVG: 371 MAX: 461 AVX-512 512b DP . MIN: 45 AVG: 371 MAX: 472 OSPRay Studio 1.0 CPU Power Consumption Monitor Watts < Lower Is Better AVX-512 Off ..... MIN: 45 AVG: 321 MAX: 470 AVX-512 256b DP . MIN: 45 AVG: 394 MAX: 461 AVX-512 512b DP . MIN: 45 AVG: 394 MAX: 473 Y-Cruncher 0.8.5 CPU Power Consumption Monitor Watts < Lower Is Better AVX-512 Off ..... MIN: 45 AVG: 240 MAX: 448 AVX-512 256b DP . MIN: 45 AVG: 231 MAX: 415 AVX-512 512b DP . MIN: 45 AVG: 230 MAX: 409 Y-Cruncher 0.8.5 CPU Power Consumption Monitor Watts < Lower Is Better AVX-512 Off ..... MIN: 45 AVG: 321 MAX: 498 AVX-512 256b DP . MIN: 45 AVG: 316 MAX: 491 AVX-512 512b DP . MIN: 45 AVG: 311 MAX: 489 Y-Cruncher 0.8.5 CPU Power Consumption Monitor Watts < Lower Is Better AVX-512 Off ..... MIN: 45 AVG: 345 MAX: 505 AVX-512 256b DP . MIN: 45 AVG: 346 MAX: 504 AVX-512 512b DP . MIN: 45 AVG: 338 MAX: 497 Xmrig 6.21 CPU Power Consumption Monitor Watts < Lower Is Better AVX-512 Off ..... MIN: 45 AVG: 412 MAX: 481 AVX-512 256b DP . MIN: 23 AVG: 413 MAX: 484 AVX-512 512b DP . MIN: 45 AVG: 425 MAX: 483 oneDNN 3.4 CPU Power Consumption Monitor Watts < Lower Is Better AVX-512 Off ..... MIN: 45 AVG: 236 MAX: 416 AVX-512 256b DP . MIN: 45 AVG: 237 MAX: 398 AVX-512 512b DP . MIN: 45 AVG: 209 MAX: 377 oneDNN 3.4 CPU Power Consumption Monitor Watts < Lower Is Better AVX-512 Off ..... MIN: 45 AVG: 170 MAX: 341 AVX-512 256b DP . MIN: 44 AVG: 171 MAX: 350 AVX-512 512b DP . MIN: 45 AVG: 155 MAX: 308 oneDNN 3.4 CPU Power Consumption Monitor Watts < Lower Is Better AVX-512 Off ..... MIN: 45 AVG: 166 MAX: 309 AVX-512 256b DP . MIN: 44 AVG: 200 MAX: 293 AVX-512 512b DP . MIN: 45 AVG: 202 MAX: 294 oneDNN 3.4 CPU Power Consumption Monitor Watts < Lower Is Better AVX-512 Off ..... MIN: 45 AVG: 314 MAX: 425 AVX-512 256b DP . MIN: 44 AVG: 307 MAX: 401 AVX-512 512b DP . MIN: 45 AVG: 271 MAX: 371 PyTorch 2.2.1 CPU Power Consumption Monitor Watts < Lower Is Better AVX-512 Off ..... MIN: 22 AVG: 252 MAX: 309 AVX-512 256b DP . MIN: 45 AVG: 236 MAX: 298 AVX-512 512b DP . MIN: 45 AVG: 241 MAX: 304 PyTorch 2.2.1 CPU Power Consumption Monitor Watts < Lower Is Better AVX-512 Off ..... MIN: 45 AVG: 285 MAX: 324 AVX-512 256b DP . MIN: 44 AVG: 273 MAX: 315 AVX-512 512b DP . MIN: 45 AVG: 278 MAX: 320 PyTorch 2.2.1 CPU Power Consumption Monitor Watts < Lower Is Better AVX-512 Off ..... MIN: 45 AVG: 286 MAX: 324 AVX-512 256b DP . MIN: 44 AVG: 273 MAX: 314 AVX-512 512b DP . MIN: 45 AVG: 278 MAX: 321 TensorFlow 2.16.1 CPU Power Consumption Monitor Watts < Lower Is Better AVX-512 Off ..... MIN: 45 AVG: 331 MAX: 366 AVX-512 256b DP . MIN: 44 AVG: 365 MAX: 401 AVX-512 512b DP . MIN: 45 AVG: 308 MAX: 337 TensorFlow 2.16.1 CPU Power Consumption Monitor Watts < Lower Is Better AVX-512 Off ..... MIN: 45 AVG: 365 MAX: 400 AVX-512 256b DP . MIN: 45 AVG: 388 MAX: 431 AVX-512 512b DP . MIN: 45 AVG: 338 MAX: 366 OpenVINO 2024.0 CPU Power Consumption Monitor Watts < Lower Is Better AVX-512 Off ..... MIN: 45 AVG: 383 MAX: 430 AVX-512 256b DP . MIN: 45 AVG: 390 MAX: 438 AVX-512 512b DP . MIN: 45 AVG: 362 MAX: 406 OpenVINO 2024.0 CPU Power Consumption Monitor Watts < Lower Is Better AVX-512 Off ..... MIN: 45 AVG: 366 MAX: 402 AVX-512 256b DP . MIN: 45 AVG: 365 MAX: 402 AVX-512 512b DP . MIN: 45 AVG: 332 MAX: 366 OpenVINO 2024.0 CPU Power Consumption Monitor Watts < Lower Is Better AVX-512 Off ..... MIN: 45 AVG: 423 MAX: 469 AVX-512 256b DP . MIN: 45 AVG: 432 MAX: 480 AVX-512 512b DP . MIN: 45 AVG: 387 MAX: 432 OpenVINO 2024.0 CPU Power Consumption Monitor Watts < Lower Is Better AVX-512 Off ..... MIN: 45 AVG: 388 MAX: 425 AVX-512 256b DP . MIN: 45 AVG: 393 MAX: 427 AVX-512 512b DP . MIN: 45 AVG: 359 MAX: 391 OpenVINO 2024.0 CPU Power Consumption Monitor Watts < Lower Is Better AVX-512 Off ..... MIN: 23 AVG: 407 MAX: 446 AVX-512 256b DP . MIN: 45 AVG: 411 MAX: 449 AVX-512 512b DP . MIN: 45 AVG: 390 MAX: 427 OpenVINO 2024.0 CPU Power Consumption Monitor Watts < Lower Is Better AVX-512 Off ..... MIN: 45 AVG: 399 MAX: 450 AVX-512 256b DP . MIN: 45 AVG: 410 MAX: 453 AVX-512 512b DP . MIN: 28 AVG: 352 MAX: 395 OpenVINO 2024.0 CPU Power Consumption Monitor Watts < Lower Is Better AVX-512 Off ..... MIN: 45 AVG: 415 MAX: 463 AVX-512 256b DP . MIN: 45 AVG: 436 MAX: 487 AVX-512 512b DP . MIN: 45 AVG: 435 MAX: 493 OpenVINO 2024.0 CPU Power Consumption Monitor Watts < Lower Is Better AVX-512 Off ..... MIN: 45 AVG: 399 MAX: 438 AVX-512 256b DP . MIN: 45 AVG: 402 MAX: 441 AVX-512 512b DP . MIN: 45 AVG: 378 MAX: 414 OpenVINO 2024.0 CPU Power Consumption Monitor Watts < Lower Is Better AVX-512 Off ..... MIN: 45 AVG: 411 MAX: 448 AVX-512 256b DP . MIN: 44 AVG: 429 MAX: 468 AVX-512 512b DP . MIN: 45 AVG: 428 MAX: 472 OpenVINO 2024.0 CPU Power Consumption Monitor Watts < Lower Is Better AVX-512 Off ..... MIN: 46 AVG: 427 MAX: 472 AVX-512 256b DP . MIN: 45 AVG: 411 MAX: 456 AVX-512 512b DP . MIN: 45 AVG: 368 MAX: 408 OpenVINO 2024.0 CPU Power Consumption Monitor Watts < Lower Is Better AVX-512 Off ..... MIN: 45 AVG: 393 MAX: 434 AVX-512 256b DP . MIN: 45 AVG: 415 MAX: 459 AVX-512 512b DP . MIN: 45 AVG: 410 MAX: 450 OpenVINO 2024.0 CPU Power Consumption Monitor Watts < Lower Is Better AVX-512 Off ..... MIN: 45 AVG: 328 MAX: 368 AVX-512 256b DP . MIN: 45 AVG: 411 MAX: 466 AVX-512 512b DP . MIN: 45 AVG: 391 MAX: 438 libxsmm 2-1.17-3645 CPU Power Consumption Monitor Watts < Lower Is Better AVX-512 Off ..... MIN: 45 AVG: 210 MAX: 465 AVX-512 256b DP . MIN: 44 AVG: 174 MAX: 448 AVX-512 512b DP . MIN: 45 AVG: 182 MAX: 455 ONNX Runtime 1.19 CPU Power Consumption Monitor Watts < Lower Is Better AVX-512 Off ..... MIN: 45 AVG: 343 MAX: 380 AVX-512 256b DP . MIN: 28 AVG: 381 MAX: 420 AVX-512 512b DP . MIN: 45 AVG: 318 MAX: 346 ONNX Runtime 1.19 CPU Power Consumption Monitor Watts < Lower Is Better AVX-512 Off ..... MIN: 45 AVG: 174 MAX: 186 AVX-512 256b DP . MIN: 44 AVG: 164 MAX: 174 AVX-512 512b DP . MIN: 45 AVG: 175 MAX: 197 ONNX Runtime 1.19 CPU Power Consumption Monitor Watts < Lower Is Better AVX-512 Off ..... MIN: 24 AVG: 353 MAX: 382 AVX-512 256b DP . MIN: 45 AVG: 338 MAX: 367 AVX-512 512b DP . MIN: 45 AVG: 350 MAX: 377 ONNX Runtime 1.19 CPU Power Consumption Monitor Watts < Lower Is Better AVX-512 Off ..... MIN: 45 AVG: 144 MAX: 154 AVX-512 256b DP . MIN: 45 AVG: 143 MAX: 153 AVX-512 512b DP . MIN: 45 AVG: 145 MAX: 155 ONNX Runtime 1.19 CPU Power Consumption Monitor Watts < Lower Is Better AVX-512 Off ..... MIN: 45 AVG: 359 MAX: 393 AVX-512 256b DP . MIN: 45 AVG: 358 MAX: 389 AVX-512 512b DP . MIN: 45 AVG: 362 MAX: 393 ONNX Runtime 1.19 CPU Power Consumption Monitor Watts < Lower Is Better AVX-512 Off ..... MIN: 45 AVG: 381 MAX: 420 AVX-512 256b DP . MIN: 45 AVG: 394 MAX: 436 AVX-512 512b DP . MIN: 45 AVG: 336 MAX: 372 Numpy Benchmark CPU Power Consumption Monitor Watts < Lower Is Better AVX-512 Off ..... MIN: 45 AVG: 92 MAX: 100 AVX-512 256b DP . MIN: 44 AVG: 92 MAX: 99 AVX-512 512b DP . MIN: 45 AVG: 92 MAX: 100 SVT-AV1 2.2 CPU Power Consumption Monitor Watts < Lower Is Better AVX-512 Off ..... MIN: 45 AVG: 178 MAX: 294 AVX-512 256b DP . MIN: 44 AVG: 176 MAX: 292 AVX-512 512b DP . MIN: 45 AVG: 178 MAX: 298 SVT-AV1 2.2 CPU Power Consumption Monitor Watts < Lower Is Better AVX-512 Off ..... MIN: 45 AVG: 221 MAX: 284 AVX-512 256b DP . MIN: 45 AVG: 212 MAX: 282 AVX-512 512b DP . MIN: 44 AVG: 219 MAX: 287 SVT-AV1 2.2 CPU Power Consumption Monitor Watts < Lower Is Better AVX-512 Off ..... MIN: 45 AVG: 229 MAX: 302 AVX-512 256b DP . MIN: 44 AVG: 220 MAX: 286 AVX-512 512b DP . MIN: 45 AVG: 226 MAX: 292 SVT-AV1 2.2 CPU Power Consumption Monitor Watts < Lower Is Better AVX-512 Off ..... MIN: 45 AVG: 251 MAX: 389 AVX-512 256b DP . MIN: 45 AVG: 245 MAX: 380 AVX-512 512b DP . MIN: 45 AVG: 250 MAX: 396