AMD EPYC 9754 Bergamo AVX-512 AMD EPYC 9754 1P benchmarks with AVX-512 benchmarking and then AVX-512 disabled. Tests by Michael Larabel for a future article. AVX512 On: Processor: AMD EPYC 9754 128-Core @ 2.25GHz (128 Cores / 256 Threads), Motherboard: AMD Titanite_4G (RTI1007B BIOS), Chipset: AMD Device 14a4, Memory: 768GB, Disk: 2 x 1920GB SAMSUNG MZWLJ1T9HBJR-00007, Graphics: ASPEED, Network: Broadcom NetXtreme BCM5720 PCIe OS: Ubuntu 22.04, Kernel: 5.19.0-41-generic (x86_64), Desktop: GNOME Shell 42.5, Display Server: X Server 1.21.1.4, Vulkan: 1.3.224, Compiler: GCC 11.3.0, File-System: ext4, Screen Resolution: 1024x768 AVX512 Off: Processor: AMD EPYC 9754 128-Core @ 2.25GHz (128 Cores / 256 Threads), Motherboard: AMD Titanite_4G (RTI1007B BIOS), Chipset: AMD Device 14a4, Memory: 768GB, Disk: 2 x 1920GB SAMSUNG MZWLJ1T9HBJR-00007, Graphics: ASPEED, Network: Broadcom NetXtreme BCM5720 PCIe OS: Ubuntu 22.04, Kernel: 5.19.0-41-generic (x86_64), Desktop: GNOME Shell 42.5, Display Server: X Server 1.21.1.4, Vulkan: 1.3.224, Compiler: GCC 11.3.0, File-System: ext4, Screen Resolution: 1024x768 miniBUDE 20210901 Implementation: OpenMP - Input Deck: BM1 GFInst/s > Higher Is Better AVX512 On .. 5925.67 |========================================================= AVX512 Off . 4677.68 |============================================= miniBUDE 20210901 Implementation: OpenMP - Input Deck: BM1 Billion Interactions/s > Higher Is Better AVX512 On .. 237.03 |========================================================== AVX512 Off . 187.11 |============================================== miniBUDE 20210901 Implementation: OpenMP - Input Deck: BM1 Billion Interactions/s Per Watt > Higher Is Better AVX512 On .. 1.550 |=========================================================== AVX512 Off . 1.026 |======================================= miniBUDE 20210901 CPU Peak Freq (Highest CPU Core Frequency) Monitor Megahertz > Higher Is Better AVX512 On .. MIN: 2250 AVG: 2597 MAX: 3098 AVX512 Off . MIN: 2250 AVG: 2529 MAX: 3096 miniBUDE 20210901 CPU Power Consumption Monitor Watts < Lower Is Better AVX512 On .. MIN: 19 AVG: 153 MAX: 317 AVX512 Off . MIN: 20 AVG: 182 MAX: 337 miniBUDE 20210901 CPU Temperature Monitor Celsius < Lower Is Better AVX512 On .. MIN: 23.3 AVG: 36.3 MAX: 50.8 AVX512 Off . MIN: 20.8 AVG: 37.0 MAX: 52.8 miniBUDE 20210901 Implementation: OpenMP - Input Deck: BM2 GFInst/s > Higher Is Better AVX512 On .. 5972.19 |========================================================= AVX512 Off . 4528.31 |=========================================== miniBUDE 20210901 Implementation: OpenMP - Input Deck: BM2 Billion Interactions/s > Higher Is Better AVX512 On .. 238.89 |========================================================== AVX512 Off . 181.13 |============================================ miniBUDE 20210901 Implementation: OpenMP - Input Deck: BM2 Billion Interactions/s Per Watt > Higher Is Better AVX512 On .. 0.89 |============================================================ AVX512 Off . 0.62 |========================================== miniBUDE 20210901 CPU Peak Freq (Highest CPU Core Frequency) Monitor Megahertz > Higher Is Better AVX512 On .. MIN: 2250 AVG: 2796 MAX: 3014 AVX512 Off . MIN: 2250 AVG: 2696 MAX: 3098 miniBUDE 20210901 CPU Power Consumption Monitor Watts < Lower Is Better AVX512 On .. MIN: 20 AVG: 268 MAX: 323 AVX512 Off . MIN: 20 AVG: 292 MAX: 342 miniBUDE 20210901 CPU Temperature Monitor Celsius < Lower Is Better AVX512 On .. MIN: 29.3 AVG: 53.4 MAX: 62.3 AVX512 Off . MIN: 27.9 AVG: 55.1 MAX: 64.1 libxsmm 2-1.17-3645 M N K: 128 GFLOPS/s > Higher Is Better AVX512 On .. 2690.7 |========================================================== AVX512 Off . 2573.3 |======================================================= libxsmm 2-1.17-3645 M N K: 128 GFLOPS/s Per Watt > Higher Is Better AVX512 On .. 13.07 |=========================================================== AVX512 Off . 12.53 |========================================================= libxsmm 2-1.17-3645 CPU Peak Freq (Highest CPU Core Frequency) Monitor Megahertz > Higher Is Better AVX512 On .. MIN: 2250 AVG: 3088 MAX: 3133 AVX512 Off . MIN: 2250 AVG: 3086 MAX: 3117 libxsmm 2-1.17-3645 CPU Power Consumption Monitor Watts < Lower Is Better AVX512 On .. MIN: 20 AVG: 206 MAX: 330 AVX512 Off . MIN: 21 AVG: 205 MAX: 327 libxsmm 2-1.17-3645 CPU Temperature Monitor Celsius < Lower Is Better AVX512 On .. MIN: 35.8 AVG: 50.3 MAX: 53.3 AVX512 Off . MIN: 35.5 AVG: 49.1 MAX: 50.9 libxsmm 2-1.17-3645 M N K: 256 GFLOPS/s > Higher Is Better AVX512 On .. 3342.5 |========================================================== AVX512 Off . 2415.3 |========================================== libxsmm 2-1.17-3645 M N K: 256 GFLOPS/s Per Watt > Higher Is Better AVX512 On .. 15.90 |=========================================================== AVX512 Off . 11.40 |========================================== libxsmm 2-1.17-3645 CPU Peak Freq (Highest CPU Core Frequency) Monitor Megahertz > Higher Is Better AVX512 On .. MIN: 2250 AVG: 3054 MAX: 3135 AVX512 Off . MIN: 2239 AVG: 3038 MAX: 3143 libxsmm 2-1.17-3645 CPU Power Consumption Monitor Watts < Lower Is Better AVX512 On .. MIN: 20 AVG: 210 MAX: 340 AVX512 Off . MIN: 21 AVG: 212 MAX: 336 libxsmm 2-1.17-3645 CPU Temperature Monitor Celsius < Lower Is Better AVX512 On .. MIN: 34.4 AVG: 49.7 MAX: 54.3 AVX512 Off . MIN: 33.5 AVG: 49.4 MAX: 53.3 Embree 4.1 Binary: Pathtracer ISPC - Model: Crown Frames Per Second > Higher Is Better AVX512 On .. 125.54 |========================================================== AVX512 Off . 112.23 |==================================================== Embree 4.1 Binary: Pathtracer ISPC - Model: Crown Frames Per Second Per Watt > Higher Is Better AVX512 On .. 0.672 |=========================================================== AVX512 Off . 0.560 |================================================= Embree 4.1 CPU Peak Freq (Highest CPU Core Frequency) Monitor Megahertz > Higher Is Better AVX512 On .. MIN: 2250 AVG: 2511 MAX: 3101 AVX512 Off . MIN: 2250 AVG: 2627 MAX: 3097 Embree 4.1 CPU Power Consumption Monitor Watts < Lower Is Better AVX512 On .. MIN: 20 AVG: 187 MAX: 334 AVX512 Off . MIN: 21 AVG: 200 MAX: 340 Embree 4.1 CPU Temperature Monitor Celsius < Lower Is Better AVX512 On .. MIN: 33.5 AVG: 43.2 MAX: 51.3 AVX512 Off . MIN: 33.3 AVG: 44.2 MAX: 52.8 Embree 4.1 Binary: Pathtracer ISPC - Model: Asian Dragon Frames Per Second > Higher Is Better AVX512 On .. 157.65 |========================================================== AVX512 Off . 132.95 |================================================= Embree 4.1 Binary: Pathtracer ISPC - Model: Asian Dragon Frames Per Second Per Watt > Higher Is Better AVX512 On .. 0.920 |=========================================================== AVX512 Off . 0.715 |============================================== Embree 4.1 CPU Peak Freq (Highest CPU Core Frequency) Monitor Megahertz > Higher Is Better AVX512 On .. MIN: 2250 AVG: 2565 MAX: 3098 AVX512 Off . MIN: 2250 AVG: 2584 MAX: 3096 Embree 4.1 CPU Power Consumption Monitor Watts < Lower Is Better AVX512 On .. MIN: 20 AVG: 171 MAX: 327 AVX512 Off . MIN: 20 AVG: 186 MAX: 333 Embree 4.1 CPU Temperature Monitor Celsius < Lower Is Better AVX512 On .. MIN: 33.5 AVG: 41.4 MAX: 48.9 AVX512 Off . MIN: 33.5 AVG: 42.2 MAX: 50.0 Embree 4.1 Binary: Pathtracer ISPC - Model: Asian Dragon Obj Frames Per Second > Higher Is Better AVX512 On .. 134.84 |========================================================== AVX512 Off . 115.27 |================================================== Embree 4.1 Binary: Pathtracer ISPC - Model: Asian Dragon Obj Frames Per Second Per Watt > Higher Is Better AVX512 On .. 1.070 |=========================================================== AVX512 Off . 0.842 |============================================== Embree 4.1 CPU Peak Freq (Highest CPU Core Frequency) Monitor Megahertz > Higher Is Better AVX512 On .. MIN: 2250 AVG: 2841 MAX: 3101 AVX512 Off . MIN: 2250 AVG: 2855 MAX: 3098 Embree 4.1 CPU Power Consumption Monitor Watts < Lower Is Better AVX512 On .. MIN: 20 AVG: 126 MAX: 326 AVX512 Off . MIN: 20 AVG: 137 MAX: 331 Embree 4.1 CPU Temperature Monitor Celsius < Lower Is Better AVX512 On .. MIN: 32.5 AVG: 39.3 MAX: 47.0 AVX512 Off . MIN: 32.5 AVG: 36.7 MAX: 47.0 OpenVKL 1.3.1 Benchmark: vklBenchmark ISPC Items / Sec > Higher Is Better AVX512 On .. 1398 |============================================================ AVX512 Off . 1179 |=================================================== OpenVKL 1.3.1 Benchmark: vklBenchmark ISPC Items / Sec Per Watt > Higher Is Better AVX512 On .. 5.858 |=========================================================== AVX512 Off . 4.569 |============================================== OpenVKL 1.3.1 CPU Peak Freq (Highest CPU Core Frequency) Monitor Megahertz > Higher Is Better AVX512 On .. MIN: 2250 AVG: 2984 MAX: 3118 AVX512 Off . MIN: 2250 AVG: 2958 MAX: 3128 OpenVKL 1.3.1 CPU Power Consumption Monitor Watts < Lower Is Better AVX512 On .. MIN: 20 AVG: 239 MAX: 322 AVX512 Off . MIN: 10 AVG: 258 MAX: 348 OpenVKL 1.3.1 CPU Temperature Monitor Celsius < Lower Is Better AVX512 On .. MIN: 30.6 AVG: 53.1 MAX: 62.3 AVX512 Off . MIN: 30.4 AVG: 54.5 MAX: 64.8 OSPRay 2.12 Benchmark: gravity_spheres_volume/dim_512/ao/real_time Items Per Second > Higher Is Better AVX512 On .. 32.76 |=========================================================== AVX512 Off . 19.17 |=================================== OSPRay 2.12 Benchmark: gravity_spheres_volume/dim_512/ao/real_time Items Per Second Per Watt > Higher Is Better AVX512 On .. 0.118 |=========================================================== AVX512 Off . 0.066 |================================= OSPRay 2.12 CPU Peak Freq (Highest CPU Core Frequency) Monitor Megahertz > Higher Is Better AVX512 On .. MIN: 2250 AVG: 2885 MAX: 3099 AVX512 Off . MIN: 2250 AVG: 2926 MAX: 3096 OSPRay 2.12 CPU Power Consumption Monitor Watts < Lower Is Better AVX512 On .. MIN: 20 AVG: 277 MAX: 330 AVX512 Off . MIN: 21 AVG: 291 MAX: 346 OSPRay 2.12 CPU Temperature Monitor Celsius < Lower Is Better AVX512 On .. MIN: 33.5 AVG: 55.1 MAX: 63.3 AVX512 Off . MIN: 32.0 AVG: 57.5 MAX: 65.3 OSPRay 2.12 Benchmark: gravity_spheres_volume/dim_512/scivis/real_time Items Per Second > Higher Is Better AVX512 On .. 31.68 |=========================================================== AVX512 Off . 18.02 |================================== OSPRay 2.12 Benchmark: gravity_spheres_volume/dim_512/scivis/real_time Items Per Second Per Watt > Higher Is Better AVX512 On .. 0.114 |=========================================================== AVX512 Off . 0.062 |================================ OSPRay 2.12 CPU Peak Freq (Highest CPU Core Frequency) Monitor Megahertz > Higher Is Better AVX512 On .. MIN: 2250 AVG: 2875 MAX: 3096 AVX512 Off . MIN: 2250 AVG: 2925 MAX: 3101 OSPRay 2.12 CPU Power Consumption Monitor Watts < Lower Is Better AVX512 On .. MIN: 21 AVG: 279 MAX: 332 AVX512 Off . MIN: 21 AVG: 292 MAX: 347 OSPRay 2.12 CPU Temperature Monitor Celsius < Lower Is Better AVX512 On .. MIN: 39.4 AVG: 57.2 MAX: 64.3 AVX512 Off . MIN: 39.4 AVG: 59.7 MAX: 66.1 OSPRay 2.12 Benchmark: gravity_spheres_volume/dim_512/pathtracer/real_time Items Per Second > Higher Is Better AVX512 On .. 27.97 |=========================================================== AVX512 Off . 19.55 |========================================= OSPRay 2.12 Benchmark: gravity_spheres_volume/dim_512/pathtracer/real_time Items Per Second Per Watt > Higher Is Better AVX512 On .. 0.106 |=========================================================== AVX512 Off . 0.072 |======================================== OSPRay 2.12 CPU Peak Freq (Highest CPU Core Frequency) Monitor Megahertz > Higher Is Better AVX512 On .. MIN: 2250 AVG: 3024 MAX: 3099 AVX512 Off . MIN: 2250 AVG: 3052 MAX: 3098 OSPRay 2.12 CPU Power Consumption Monitor Watts < Lower Is Better AVX512 On .. MIN: 21 AVG: 263 MAX: 314 AVX512 Off . MIN: 21 AVG: 272 MAX: 322 OSPRay 2.12 CPU Temperature Monitor Celsius < Lower Is Better AVX512 On .. MIN: 40.0 AVG: 55.6 MAX: 61.3 AVX512 Off . MIN: 40.0 AVG: 57.0 MAX: 62.8 oneDNN 3.1 Harness: Recurrent Neural Network Training - Data Type: bf16bf16bf16 - Engine: CPU ms < Lower Is Better AVX512 On .. 1174.75 |=================================================== AVX512 Off . 1317.57 |========================================================= oneDNN 3.1 CPU Peak Freq (Highest CPU Core Frequency) Monitor Megahertz > Higher Is Better AVX512 On .. MIN: 2250 AVG: 2998 MAX: 3097 AVX512 Off . MIN: 2250 AVG: 2824 MAX: 3100 oneDNN 3.1 CPU Power Consumption Monitor Watts < Lower Is Better AVX512 On .. MIN: 20 AVG: 177 MAX: 278 AVX512 Off . MIN: 20 AVG: 202 MAX: 273 oneDNN 3.1 CPU Temperature Monitor Celsius < Lower Is Better AVX512 On .. MIN: 30.4 AVG: 39.2 MAX: 45.3 AVX512 Off . MIN: 24.5 AVG: 39.8 MAX: 45.1 Cpuminer-Opt 3.20.3 Algorithm: x25x kH/s > Higher Is Better AVX512 On .. 4977.89 |========================================================= AVX512 Off . 3010.37 |================================== Cpuminer-Opt 3.20.3 Algorithm: x25x kH/s Per Watt > Higher Is Better AVX512 On .. 16.85 |=========================================================== AVX512 Off . 10.81 |====================================== Cpuminer-Opt 3.20.3 CPU Peak Freq (Highest CPU Core Frequency) Monitor Megahertz > Higher Is Better AVX512 On .. MIN: 2250 AVG: 2909 MAX: 3099 AVX512 Off . MIN: 2250 AVG: 3019 MAX: 3099 Cpuminer-Opt 3.20.3 CPU Power Consumption Monitor Watts < Lower Is Better AVX512 On .. MIN: 20 AVG: 295 MAX: 341 AVX512 Off . MIN: 21 AVG: 278 MAX: 322 Cpuminer-Opt 3.20.3 CPU Temperature Monitor Celsius < Lower Is Better AVX512 On .. MIN: 39.4 AVG: 58.7 MAX: 64.3 AVX512 Off . MIN: 37.6 AVG: 55.2 MAX: 59.5 Cpuminer-Opt 3.20.3 Algorithm: scrypt kH/s > Higher Is Better AVX512 On .. 2993.21 |========================================================= AVX512 Off . 2033.15 |======================================= Cpuminer-Opt 3.20.3 Algorithm: scrypt kH/s Per Watt > Higher Is Better AVX512 On .. 8.913 |=========================================================== AVX512 Off . 6.476 |=========================================== Cpuminer-Opt 3.20.3 CPU Peak Freq (Highest CPU Core Frequency) Monitor Megahertz > Higher Is Better AVX512 On .. MIN: 2250 AVG: 2959 MAX: 3095 AVX512 Off . MIN: 2250 AVG: 2952 MAX: 3091 Cpuminer-Opt 3.20.3 CPU Power Consumption Monitor Watts < Lower Is Better AVX512 On .. MIN: 21 AVG: 336 MAX: 385 AVX512 Off . MIN: 21 AVG: 314 MAX: 361 Cpuminer-Opt 3.20.3 CPU Temperature Monitor Celsius < Lower Is Better AVX512 On .. MIN: 39.5 AVG: 66.4 MAX: 73.3 AVX512 Off . MIN: 38.1 AVG: 63.6 MAX: 70.0 Cpuminer-Opt 3.20.3 Algorithm: Blake-2 S kH/s > Higher Is Better AVX512 On .. 7238650 |========================================================= AVX512 Off . 4555580 |==================================== Cpuminer-Opt 3.20.3 Algorithm: Blake-2 S kH/s Per Watt > Higher Is Better AVX512 On .. 22160.82 |======================================================== AVX512 Off . 14551.24 |===================================== Cpuminer-Opt 3.20.3 CPU Peak Freq (Highest CPU Core Frequency) Monitor Megahertz > Higher Is Better AVX512 On .. MIN: 2250 AVG: 2925 MAX: 3002 AVX512 Off . MIN: 2250 AVG: 2779 MAX: 3096 Cpuminer-Opt 3.20.3 CPU Power Consumption Monitor Watts < Lower Is Better AVX512 On .. MIN: 20 AVG: 327 MAX: 376 AVX512 Off . MIN: 21 AVG: 313 MAX: 358 Cpuminer-Opt 3.20.3 CPU Temperature Monitor Celsius < Lower Is Better AVX512 On .. MIN: 33.9 AVG: 64.0 MAX: 72.8 AVX512 Off . MIN: 31.1 AVG: 64.0 MAX: 70.0 Cpuminer-Opt 3.20.3 Algorithm: Garlicoin kH/s > Higher Is Better AVX512 On .. 53090 |=========================================================== AVX512 Off . 39473 |============================================ Cpuminer-Opt 3.20.3 Algorithm: Garlicoin kH/s Per Watt > Higher Is Better AVX512 On .. 272.43 |========================================================== AVX512 Off . 202.32 |=========================================== Cpuminer-Opt 3.20.3 CPU Peak Freq (Highest CPU Core Frequency) Monitor Megahertz > Higher Is Better AVX512 On .. MIN: 2250 AVG: 3058 MAX: 3102 AVX512 Off . MIN: 2250 AVG: 3065 MAX: 3102 Cpuminer-Opt 3.20.3 CPU Power Consumption Monitor Watts < Lower Is Better AVX512 On .. MIN: 21 AVG: 195 MAX: 210 AVX512 Off . MIN: 21 AVG: 195 MAX: 205 Cpuminer-Opt 3.20.3 CPU Temperature Monitor Celsius < Lower Is Better AVX512 On .. MIN: 38.1 AVG: 45.4 MAX: 47.9 AVX512 Off . MIN: 36.8 AVG: 43.7 MAX: 46.6 Cpuminer-Opt 3.20.3 Algorithm: Skeincoin kH/s > Higher Is Better AVX512 On .. 1174953 |========================================================= AVX512 Off . 937977 |============================================== Cpuminer-Opt 3.20.3 Algorithm: Skeincoin kH/s Per Watt > Higher Is Better AVX512 On .. 3691.56 |========================================================= AVX512 Off . 2892.87 |============================================= Cpuminer-Opt 3.20.3 CPU Peak Freq (Highest CPU Core Frequency) Monitor Megahertz > Higher Is Better AVX512 On .. MIN: 2250 AVG: 2804 MAX: 3143 AVX512 Off . MIN: 2250 AVG: 2899 MAX: 3096 Cpuminer-Opt 3.20.3 CPU Power Consumption Monitor Watts < Lower Is Better AVX512 On .. MIN: 20 AVG: 318 MAX: 371 AVX512 Off . MIN: 20 AVG: 324 MAX: 376 Cpuminer-Opt 3.20.3 CPU Temperature Monitor Celsius < Lower Is Better AVX512 On .. MIN: 34.4 AVG: 63.4 MAX: 71.9 AVX512 Off . MIN: 33.0 AVG: 62.9 MAX: 71.9 Cpuminer-Opt 3.20.3 Algorithm: Myriad-Groestl kH/s > Higher Is Better AVX512 On .. 8628.76 |========================================================= AVX512 Off . 7149.95 |=============================================== Cpuminer-Opt 3.20.3 Algorithm: Myriad-Groestl kH/s Per Watt > Higher Is Better AVX512 On .. 51.65 |=========================================================== AVX512 Off . 44.67 |=================================================== Cpuminer-Opt 3.20.3 CPU Peak Freq (Highest CPU Core Frequency) Monitor Megahertz > Higher Is Better AVX512 On .. MIN: 2250 AVG: 3021 MAX: 3097 AVX512 Off . MIN: 2250 AVG: 3046 MAX: 3099 Cpuminer-Opt 3.20.3 CPU Power Consumption Monitor Watts < Lower Is Better AVX512 On .. MIN: 20 AVG: 167 MAX: 200 AVX512 Off . MIN: 20 AVG: 160 MAX: 173 Cpuminer-Opt 3.20.3 CPU Temperature Monitor Celsius < Lower Is Better AVX512 On .. MIN: 34.9 AVG: 42.2 MAX: 47.0 AVX512 Off . MIN: 33.9 AVG: 40.9 MAX: 44.6 Cpuminer-Opt 3.20.3 Algorithm: LBC, LBRY Credits kH/s > Higher Is Better AVX512 On .. 660660 |========================================================== AVX512 Off . 332667 |============================= Cpuminer-Opt 3.20.3 Algorithm: LBC, LBRY Credits kH/s Per Watt > Higher Is Better AVX512 On .. 2003.50 |========================================================= AVX512 Off . 1052.19 |============================== Cpuminer-Opt 3.20.3 CPU Peak Freq (Highest CPU Core Frequency) Monitor Megahertz > Higher Is Better AVX512 On .. MIN: 2250 AVG: 2886 MAX: 3096 AVX512 Off . MIN: 2250 AVG: 2746 MAX: 3096 Cpuminer-Opt 3.20.3 CPU Power Consumption Monitor Watts < Lower Is Better AVX512 On .. MIN: 20 AVG: 330 MAX: 381 AVX512 Off . MIN: 21 AVG: 316 MAX: 362 Cpuminer-Opt 3.20.3 CPU Temperature Monitor Celsius < Lower Is Better AVX512 On .. MIN: 32.0 AVG: 63.2 MAX: 72.8 AVX512 Off . MIN: 30.6 AVG: 59.5 MAX: 71.9 Cpuminer-Opt 3.20.3 Algorithm: Quad SHA-256, Pyrite kH/s > Higher Is Better AVX512 On .. 1498937 |========================================================= AVX512 Off . 876137 |================================= Cpuminer-Opt 3.20.3 Algorithm: Quad SHA-256, Pyrite kH/s Per Watt > Higher Is Better AVX512 On .. 4347.58 |========================================================= AVX512 Off . 2825.31 |===================================== Cpuminer-Opt 3.20.3 CPU Peak Freq (Highest CPU Core Frequency) Monitor Megahertz > Higher Is Better AVX512 On .. MIN: 2250 AVG: 2966 MAX: 3080 AVX512 Off . MIN: 2250 AVG: 2919 MAX: 3027 Cpuminer-Opt 3.20.3 CPU Power Consumption Monitor Watts < Lower Is Better AVX512 On .. MIN: 21 AVG: 345 MAX: 398 AVX512 Off . MIN: 11 AVG: 310 MAX: 353 Cpuminer-Opt 3.20.3 CPU Temperature Monitor Celsius < Lower Is Better AVX512 On .. MIN: 40.5 AVG: 68.7 MAX: 74.3 AVX512 Off . MIN: 38.6 AVG: 62.0 MAX: 68.1 TensorFlow 2.12 Device: CPU - Batch Size: 16 - Model: AlexNet images/sec > Higher Is Better AVX512 On .. 342.88 |========================================================== AVX512 Off . 70.10 |============ TensorFlow 2.12 Device: CPU - Batch Size: 16 - Model: AlexNet images/sec Per Watt > Higher Is Better AVX512 On .. 2.966 |=========================================================== AVX512 Off . 0.576 |=========== TensorFlow 2.12 CPU Peak Freq (Highest CPU Core Frequency) Monitor Megahertz > Higher Is Better AVX512 On .. MIN: 2250 AVG: 2801 MAX: 3254 AVX512 Off . MIN: 2250 AVG: 2992 MAX: 3136 TensorFlow 2.12 CPU Power Consumption Monitor Watts < Lower Is Better AVX512 On .. MIN: 10 AVG: 116 MAX: 200 AVX512 Off . MIN: 21 AVG: 122 MAX: 146 TensorFlow 2.12 CPU Temperature Monitor Celsius < Lower Is Better AVX512 On .. MIN: 34.9 AVG: 41.1 MAX: 49.4 AVX512 Off . MIN: 33.9 AVG: 40.3 MAX: 49.4 TensorFlow 2.12 Device: CPU - Batch Size: 32 - Model: AlexNet images/sec > Higher Is Better AVX512 On .. 562.48 |========================================================== AVX512 Off . 84.96 |========= TensorFlow 2.12 Device: CPU - Batch Size: 32 - Model: AlexNet images/sec Per Watt > Higher Is Better AVX512 On .. 4.376 |=========================================================== AVX512 Off . 0.691 |========= TensorFlow 2.12 CPU Peak Freq (Highest CPU Core Frequency) Monitor Megahertz > Higher Is Better AVX512 On .. MIN: 2250 AVG: 2836 MAX: 3101 AVX512 Off . MIN: 2250 AVG: 3039 MAX: 3146 TensorFlow 2.12 CPU Power Consumption Monitor Watts < Lower Is Better AVX512 On .. MIN: 20 AVG: 129 MAX: 211 AVX512 Off . MIN: 21 AVG: 123 MAX: 139 TensorFlow 2.12 CPU Temperature Monitor Celsius < Lower Is Better AVX512 On .. MIN: 32.0 AVG: 37.8 MAX: 45.3 AVX512 Off . MIN: 30.5 AVG: 37.1 MAX: 45.6 TensorFlow 2.12 Device: CPU - Batch Size: 64 - Model: AlexNet images/sec > Higher Is Better AVX512 On .. 857.55 |========================================================== AVX512 Off . 97.59 |======= TensorFlow 2.12 Device: CPU - Batch Size: 64 - Model: AlexNet images/sec Per Watt > Higher Is Better AVX512 On .. 5.938 |=========================================================== AVX512 Off . 0.778 |======== TensorFlow 2.12 CPU Peak Freq (Highest CPU Core Frequency) Monitor Megahertz > Higher Is Better AVX512 On .. MIN: 2250 AVG: 2751 MAX: 3111 AVX512 Off . MIN: 2250 AVG: 3057 MAX: 3377 TensorFlow 2.12 CPU Power Consumption Monitor Watts < Lower Is Better AVX512 On .. MIN: 20 AVG: 144 MAX: 225 AVX512 Off . MIN: 20 AVG: 125 MAX: 141 TensorFlow 2.12 CPU Temperature Monitor Celsius < Lower Is Better AVX512 On .. MIN: 30.6 AVG: 38.3 MAX: 45.5 AVX512 Off . MIN: 30.4 AVG: 36.5 MAX: 46.4 TensorFlow 2.12 Device: CPU - Batch Size: 256 - Model: AlexNet images/sec > Higher Is Better AVX512 On .. 1422.36 |========================================================= AVX512 Off . 106.28 |==== TensorFlow 2.12 Device: CPU - Batch Size: 256 - Model: AlexNet images/sec Per Watt > Higher Is Better AVX512 On .. 6.984 |=========================================================== AVX512 Off . 0.839 |======= TensorFlow 2.12 CPU Peak Freq (Highest CPU Core Frequency) Monitor Megahertz > Higher Is Better AVX512 On .. MIN: 2250 AVG: 2742 MAX: 3102 AVX512 Off . MIN: 2250 AVG: 3073 MAX: 3166 TensorFlow 2.12 CPU Power Consumption Monitor Watts < Lower Is Better AVX512 On .. MIN: 20 AVG: 204 MAX: 257 AVX512 Off . MIN: 20 AVG: 127 MAX: 155 TensorFlow 2.12 CPU Temperature Monitor Celsius < Lower Is Better AVX512 On .. MIN: 30.9 AVG: 44.8 MAX: 52.3 AVX512 Off . MIN: 28.8 AVG: 36.0 MAX: 47.9 TensorFlow 2.12 Device: CPU - Batch Size: 512 - Model: AlexNet images/sec > Higher Is Better AVX512 On .. 1632.40 |========================================================= AVX512 Off . 109.88 |==== TensorFlow 2.12 Device: CPU - Batch Size: 512 - Model: AlexNet images/sec Per Watt > Higher Is Better AVX512 On .. 7.097 |=========================================================== AVX512 Off . 0.865 |======= TensorFlow 2.12 CPU Peak Freq (Highest CPU Core Frequency) Monitor Megahertz > Higher Is Better AVX512 On .. MIN: 2250 AVG: 2754 MAX: 3095 AVX512 Off . MIN: 2203 AVG: 3079 MAX: 3359 TensorFlow 2.12 CPU Power Consumption Monitor Watts < Lower Is Better AVX512 On .. MIN: 20 AVG: 230 MAX: 283 AVX512 Off . MIN: 20 AVG: 127 MAX: 190 TensorFlow 2.12 CPU Temperature Monitor Celsius < Lower Is Better AVX512 On .. MIN: 33.9 AVG: 49.8 MAX: 55.8 AVX512 Off . MIN: 28.8 AVG: 36.2 MAX: 47.4 TensorFlow 2.12 Device: CPU - Batch Size: 16 - Model: GoogLeNet images/sec > Higher Is Better AVX512 On .. 104.77 |========================================================== AVX512 Off . 39.64 |====================== TensorFlow 2.12 Device: CPU - Batch Size: 16 - Model: GoogLeNet images/sec Per Watt > Higher Is Better AVX512 On .. 0.774 |=========================================================== AVX512 Off . 0.335 |========================== TensorFlow 2.12 CPU Peak Freq (Highest CPU Core Frequency) Monitor Megahertz > Higher Is Better AVX512 On .. MIN: 2250 AVG: 2977 MAX: 3320 AVX512 Off . MIN: 2250 AVG: 3032 MAX: 3208 TensorFlow 2.12 CPU Power Consumption Monitor Watts < Lower Is Better AVX512 On .. MIN: 20 AVG: 135 MAX: 179 AVX512 Off . MIN: 20 AVG: 118 MAX: 140 TensorFlow 2.12 CPU Temperature Monitor Celsius < Lower Is Better AVX512 On .. MIN: 33.0 AVG: 38.5 MAX: 45.8 AVX512 Off . MIN: 29.1 AVG: 35.7 MAX: 47.9 TensorFlow 2.12 Device: CPU - Batch Size: 16 - Model: ResNet-50 images/sec > Higher Is Better AVX512 On .. 43.11 |=========================================================== AVX512 Off . 15.91 |====================== TensorFlow 2.12 Device: CPU - Batch Size: 16 - Model: ResNet-50 images/sec Per Watt > Higher Is Better AVX512 On .. 0.294 |=========================================================== AVX512 Off . 0.113 |======================= TensorFlow 2.12 CPU Peak Freq (Highest CPU Core Frequency) Monitor Megahertz > Higher Is Better AVX512 On .. MIN: 2250 AVG: 3041 MAX: 3348 AVX512 Off . MIN: 2250 AVG: 3075 MAX: 3217 TensorFlow 2.12 CPU Power Consumption Monitor Watts < Lower Is Better AVX512 On .. MIN: 20 AVG: 147 MAX: 171 AVX512 Off . MIN: 20 AVG: 140 MAX: 152 TensorFlow 2.12 CPU Temperature Monitor Celsius < Lower Is Better AVX512 On .. MIN: 30.4 AVG: 38.1 MAX: 44.6 AVX512 Off . MIN: 28.8 AVG: 37.2 MAX: 48.8 TensorFlow 2.12 Device: CPU - Batch Size: 32 - Model: GoogLeNet images/sec > Higher Is Better AVX512 On .. 180.77 |========================================================== AVX512 Off . 44.46 |============== TensorFlow 2.12 Device: CPU - Batch Size: 32 - Model: GoogLeNet images/sec Per Watt > Higher Is Better AVX512 On .. 1.138 |=========================================================== AVX512 Off . 0.360 |=================== TensorFlow 2.12 CPU Peak Freq (Highest CPU Core Frequency) Monitor Megahertz > Higher Is Better AVX512 On .. MIN: 2250 AVG: 2992 MAX: 3472 AVX512 Off . MIN: 2250 AVG: 3064 MAX: 3197 TensorFlow 2.12 CPU Power Consumption Monitor Watts < Lower Is Better AVX512 On .. MIN: 20 AVG: 159 MAX: 208 AVX512 Off . MIN: 20 AVG: 124 MAX: 150 TensorFlow 2.12 CPU Temperature Monitor Celsius < Lower Is Better AVX512 On .. MIN: 30.8 AVG: 40.3 MAX: 49.9 AVX512 Off . MIN: 29.3 AVG: 35.3 MAX: 47.1 TensorFlow 2.12 Device: CPU - Batch Size: 32 - Model: ResNet-50 images/sec > Higher Is Better AVX512 On .. 71.62 |=========================================================== AVX512 Off . 17.48 |============== TensorFlow 2.12 Device: CPU - Batch Size: 32 - Model: ResNet-50 images/sec Per Watt > Higher Is Better AVX512 On .. 0.407 |=========================================================== AVX512 Off . 0.124 |================== TensorFlow 2.12 CPU Peak Freq (Highest CPU Core Frequency) Monitor Megahertz > Higher Is Better AVX512 On .. MIN: 2250 AVG: 3066 MAX: 3438 AVX512 Off . MIN: 2250 AVG: 3084 MAX: 3221 TensorFlow 2.12 CPU Power Consumption Monitor Watts < Lower Is Better AVX512 On .. MIN: 20 AVG: 176 MAX: 205 AVX512 Off . MIN: 20 AVG: 141 MAX: 173 TensorFlow 2.12 CPU Temperature Monitor Celsius < Lower Is Better AVX512 On .. MIN: 31.3 AVG: 41.8 MAX: 48.6 AVX512 Off . MIN: 28.3 AVG: 37.5 MAX: 51.6 TensorFlow 2.12 Device: CPU - Batch Size: 64 - Model: GoogLeNet images/sec > Higher Is Better AVX512 On .. 277.24 |========================================================== AVX512 Off . 46.28 |========== TensorFlow 2.12 Device: CPU - Batch Size: 64 - Model: GoogLeNet images/sec Per Watt > Higher Is Better AVX512 On .. 1.476 |=========================================================== AVX512 Off . 0.369 |=============== TensorFlow 2.12 CPU Peak Freq (Highest CPU Core Frequency) Monitor Megahertz > Higher Is Better AVX512 On .. MIN: 2250 AVG: 2995 MAX: 3532 AVX512 Off . MIN: 2250 AVG: 3075 MAX: 3309 TensorFlow 2.12 CPU Power Consumption Monitor Watts < Lower Is Better AVX512 On .. MIN: 20 AVG: 188 MAX: 237 AVX512 Off . MIN: 20 AVG: 125 MAX: 152 TensorFlow 2.12 CPU Temperature Monitor Celsius < Lower Is Better AVX512 On .. MIN: 32.5 AVG: 44.3 MAX: 52.8 AVX512 Off . MIN: 29.9 AVG: 35.9 MAX: 49.0 TensorFlow 2.12 Device: CPU - Batch Size: 64 - Model: ResNet-50 images/sec > Higher Is Better AVX512 On .. 96.63 |=========================================================== AVX512 Off . 18.45 |=========== TensorFlow 2.12 Device: CPU - Batch Size: 64 - Model: ResNet-50 images/sec Per Watt > Higher Is Better AVX512 On .. 0.483 |=========================================================== AVX512 Off . 0.131 |================ TensorFlow 2.12 CPU Peak Freq (Highest CPU Core Frequency) Monitor Megahertz > Higher Is Better AVX512 On .. MIN: 2250 AVG: 3021 MAX: 3283 AVX512 Off . MIN: 2250 AVG: 3090 MAX: 3249 TensorFlow 2.12 CPU Power Consumption Monitor Watts < Lower Is Better AVX512 On .. MIN: 21 AVG: 200 MAX: 231 AVX512 Off . MIN: 20 AVG: 140 MAX: 180 TensorFlow 2.12 CPU Temperature Monitor Celsius < Lower Is Better AVX512 On .. MIN: 33.5 AVG: 45.3 MAX: 53.3 AVX512 Off . MIN: 28.8 AVG: 38.1 MAX: 51.6 TensorFlow 2.12 Device: CPU - Batch Size: 256 - Model: GoogLeNet images/sec > Higher Is Better AVX512 On .. 501.67 |========================================================== AVX512 Off . 46.17 |===== TensorFlow 2.12 Device: CPU - Batch Size: 256 - Model: GoogLeNet images/sec Per Watt > Higher Is Better AVX512 On .. 2.078 |=========================================================== AVX512 Off . 0.362 |========== TensorFlow 2.12 CPU Peak Freq (Highest CPU Core Frequency) Monitor Megahertz > Higher Is Better AVX512 On .. MIN: 2250 AVG: 2916 MAX: 3157 AVX512 Off . MIN: 2250 AVG: 3086 MAX: 3417 TensorFlow 2.12 CPU Power Consumption Monitor Watts < Lower Is Better AVX512 On .. MIN: 20 AVG: 241 MAX: 278 AVX512 Off . MIN: 20 AVG: 127 MAX: 214 TensorFlow 2.12 CPU Temperature Monitor Celsius < Lower Is Better AVX512 On .. MIN: 34.4 AVG: 50.9 MAX: 58.9 AVX512 Off . MIN: 29.8 AVG: 36.4 MAX: 52.1 TensorFlow 2.12 Device: CPU - Batch Size: 256 - Model: ResNet-50 images/sec > Higher Is Better AVX512 On .. 119.32 |========================================================== AVX512 Off . 19.89 |========== TensorFlow 2.12 Device: CPU - Batch Size: 256 - Model: ResNet-50 images/sec Per Watt > Higher Is Better AVX512 On .. 0.537 |=========================================================== AVX512 Off . 0.143 |================ TensorFlow 2.12 CPU Peak Freq (Highest CPU Core Frequency) Monitor Megahertz > Higher Is Better AVX512 On .. MIN: 2250 AVG: 2956 MAX: 3308 AVX512 Off . MIN: 2250 AVG: 3085 MAX: 3559 TensorFlow 2.12 CPU Power Consumption Monitor Watts < Lower Is Better AVX512 On .. MIN: 21 AVG: 222 MAX: 273 AVX512 Off . MIN: 20 AVG: 139 MAX: 199 TensorFlow 2.12 CPU Temperature Monitor Celsius < Lower Is Better AVX512 On .. MIN: 37.6 AVG: 48.4 MAX: 57.6 AVX512 Off . MIN: 29.0 AVG: 38.3 MAX: 53.1 TensorFlow 2.12 Device: CPU - Batch Size: 512 - Model: GoogLeNet images/sec > Higher Is Better AVX512 On .. 417.25 |========================================================== AVX512 Off . 46.92 |======= TensorFlow 2.12 Device: CPU - Batch Size: 512 - Model: GoogLeNet images/sec Per Watt > Higher Is Better AVX512 On .. 1.766 |=========================================================== AVX512 Off . 0.369 |============ TensorFlow 2.12 CPU Peak Freq (Highest CPU Core Frequency) Monitor Megahertz > Higher Is Better AVX512 On .. MIN: 2250 AVG: 2974 MAX: 3207 AVX512 Off . MIN: 2250 AVG: 3083 MAX: 3336 TensorFlow 2.12 CPU Power Consumption Monitor Watts < Lower Is Better AVX512 On .. MIN: 11 AVG: 236 MAX: 283 AVX512 Off . MIN: 20 AVG: 127 MAX: 218 TensorFlow 2.12 CPU Temperature Monitor Celsius < Lower Is Better AVX512 On .. MIN: 34.6 AVG: 50.9 MAX: 58.4 AVX512 Off . MIN: 30.1 AVG: 36.8 MAX: 51.1 TensorFlow 2.12 Device: CPU - Batch Size: 512 - Model: ResNet-50 images/sec > Higher Is Better AVX512 On .. 122.81 |========================================================== AVX512 Off . 20.78 |========== TensorFlow 2.12 Device: CPU - Batch Size: 512 - Model: ResNet-50 images/sec Per Watt > Higher Is Better AVX512 On .. 0.542 |=========================================================== AVX512 Off . 0.148 |================ TensorFlow 2.12 CPU Peak Freq (Highest CPU Core Frequency) Monitor Megahertz > Higher Is Better AVX512 On .. MIN: 2250 AVG: 2958 MAX: 3370 AVX512 Off . MIN: 2243 AVG: 3086 MAX: 3295 TensorFlow 2.12 CPU Power Consumption Monitor Watts < Lower Is Better AVX512 On .. MIN: 21 AVG: 227 MAX: 289 AVX512 Off . MIN: 20 AVG: 140 MAX: 209 TensorFlow 2.12 CPU Temperature Monitor Celsius < Lower Is Better AVX512 On .. MIN: 35.4 AVG: 48.8 MAX: 57.5 AVX512 Off . MIN: 29.4 AVG: 39.1 MAX: 54.1 Neural Magic DeepSparse 1.5 Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Stream items/sec > Higher Is Better AVX512 On .. 73.54 |=========================================================== AVX512 Off . 61.37 |================================================= Neural Magic DeepSparse 1.5 Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Stream ms/batch < Lower Is Better AVX512 On .. 858.40 |================================================ AVX512 Off . 1023.17 |========================================================= Neural Magic DeepSparse 1.5 CPU Peak Freq (Highest CPU Core Frequency) Monitor Megahertz > Higher Is Better AVX512 On .. MIN: 2250 AVG: 3011 MAX: 3136 AVX512 Off . MIN: 2250 AVG: 2933 MAX: 3136 Neural Magic DeepSparse 1.5 CPU Power Consumption Monitor Watts < Lower Is Better AVX512 On .. MIN: 20 AVG: 253 MAX: 358 AVX512 Off . MIN: 21 AVG: 244 MAX: 344 Neural Magic DeepSparse 1.5 CPU Temperature Monitor Celsius < Lower Is Better AVX512 On .. MIN: 34.6 AVG: 57.5 MAX: 71.4 AVX512 Off . MIN: 30.6 AVG: 54.5 MAX: 70.5 Neural Magic DeepSparse 1.5 Model: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Scenario: Asynchronous Multi-Stream items/sec > Higher Is Better AVX512 On .. 1381.57 |========================================================= AVX512 Off . 718.30 |============================== Neural Magic DeepSparse 1.5 Model: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Scenario: Asynchronous Multi-Stream ms/batch < Lower Is Better AVX512 On .. 46.26 |=============================== AVX512 Off . 88.91 |=========================================================== Neural Magic DeepSparse 1.5 CPU Peak Freq (Highest CPU Core Frequency) Monitor Megahertz > Higher Is Better AVX512 On .. MIN: 2250 AVG: 3026 MAX: 3124 AVX512 Off . MIN: 2250 AVG: 3015 MAX: 3127 Neural Magic DeepSparse 1.5 CPU Power Consumption Monitor Watts < Lower Is Better AVX512 On .. MIN: 21 AVG: 250 MAX: 321 AVX512 Off . MIN: 21 AVG: 235 MAX: 327 Neural Magic DeepSparse 1.5 CPU Temperature Monitor Celsius < Lower Is Better AVX512 On .. MIN: 39.4 AVG: 58.1 MAX: 67.6 AVX512 Off . MIN: 38.1 AVG: 53.8 MAX: 64.3 Neural Magic DeepSparse 1.5 Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-Stream items/sec > Higher Is Better AVX512 On .. 247.97 |========================================================== AVX512 Off . 213.64 |================================================== Neural Magic DeepSparse 1.5 Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-Stream ms/batch < Lower Is Better AVX512 On .. 259.65 |=================================================== AVX512 Off . 298.06 |========================================================== Neural Magic DeepSparse 1.5 CPU Peak Freq (Highest CPU Core Frequency) Monitor Megahertz > Higher Is Better AVX512 On .. MIN: 2250 AVG: 3002 MAX: 3416 AVX512 Off . MIN: 2250 AVG: 3023 MAX: 3152 Neural Magic DeepSparse 1.5 CPU Power Consumption Monitor Watts < Lower Is Better AVX512 On .. MIN: 11 AVG: 234 MAX: 342 AVX512 Off . MIN: 21 AVG: 229 MAX: 329 Neural Magic DeepSparse 1.5 CPU Temperature Monitor Celsius < Lower Is Better AVX512 On .. MIN: 38.6 AVG: 53.1 MAX: 66.5 AVX512 Off . MIN: 38.1 AVG: 52.9 MAX: 65.8 Neural Magic DeepSparse 1.5 Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream items/sec > Higher Is Better AVX512 On .. 970.06 |========================================================== AVX512 Off . 870.95 |==================================================== Neural Magic DeepSparse 1.5 Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream ms/batch < Lower Is Better AVX512 On .. 65.89 |===================================================== AVX512 Off . 73.35 |=========================================================== Neural Magic DeepSparse 1.5 CPU Peak Freq (Highest CPU Core Frequency) Monitor Megahertz > Higher Is Better AVX512 On .. MIN: 2250 AVG: 3012 MAX: 3134 AVX512 Off . MIN: 2250 AVG: 2962 MAX: 3101 Neural Magic DeepSparse 1.5 CPU Power Consumption Monitor Watts < Lower Is Better AVX512 On .. MIN: 21 AVG: 279 MAX: 333 AVX512 Off . MIN: 21 AVG: 285 MAX: 342 Neural Magic DeepSparse 1.5 CPU Temperature Monitor Celsius < Lower Is Better AVX512 On .. MIN: 39.8 AVG: 62.8 MAX: 70.4 AVX512 Off . MIN: 40.0 AVG: 65.2 MAX: 72.9 Neural Magic DeepSparse 1.5 Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream items/sec > Higher Is Better AVX512 On .. 624.74 |========================================================== AVX512 Off . 522.11 |================================================ Neural Magic DeepSparse 1.5 Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream ms/batch < Lower Is Better AVX512 On .. 102.22 |================================================= AVX512 Off . 122.23 |========================================================== Neural Magic DeepSparse 1.5 CPU Peak Freq (Highest CPU Core Frequency) Monitor Megahertz > Higher Is Better AVX512 On .. MIN: 2250 AVG: 3034 MAX: 3099 AVX512 Off . MIN: 2250 AVG: 2931 MAX: 3101 Neural Magic DeepSparse 1.5 CPU Power Consumption Monitor Watts < Lower Is Better AVX512 On .. MIN: 21 AVG: 256 MAX: 321 AVX512 Off . MIN: 21 AVG: 256 MAX: 320 Neural Magic DeepSparse 1.5 CPU Temperature Monitor Celsius < Lower Is Better AVX512 On .. MIN: 39.1 AVG: 60.4 MAX: 67.1 AVX512 Off . MIN: 41.0 AVG: 60.7 MAX: 68.5 Neural Magic DeepSparse 1.5 Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Asynchronous Multi-Stream items/sec > Higher Is Better AVX512 On .. 127.06 |========================================================== AVX512 Off . 69.33 |================================ Neural Magic DeepSparse 1.5 Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Asynchronous Multi-Stream ms/batch < Lower Is Better AVX512 On .. 498.48 |================================ AVX512 Off . 906.94 |========================================================== Neural Magic DeepSparse 1.5 CPU Peak Freq (Highest CPU Core Frequency) Monitor Megahertz > Higher Is Better AVX512 On .. MIN: 2250 AVG: 3006 MAX: 3115 AVX512 Off . MIN: 2250 AVG: 3048 MAX: 3116 Neural Magic DeepSparse 1.5 CPU Power Consumption Monitor Watts < Lower Is Better AVX512 On .. MIN: 21 AVG: 228 MAX: 324 AVX512 Off . MIN: 21 AVG: 235 MAX: 341 Neural Magic DeepSparse 1.5 CPU Temperature Monitor Celsius < Lower Is Better AVX512 On .. MIN: 38.1 AVG: 53.1 MAX: 66.1 AVX512 Off . MIN: 40.0 AVG: 54.0 MAX: 69.1 Neural Magic DeepSparse 1.5 Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-Stream items/sec > Higher Is Better AVX512 On .. 316.17 |========================================================== AVX512 Off . 260.77 |================================================ Neural Magic DeepSparse 1.5 Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-Stream ms/batch < Lower Is Better AVX512 On .. 201.60 |================================================ AVX512 Off . 244.15 |========================================================== Neural Magic DeepSparse 1.5 CPU Peak Freq (Highest CPU Core Frequency) Monitor Megahertz > Higher Is Better AVX512 On .. MIN: 2250 AVG: 3013 MAX: 3127 AVX512 Off . MIN: 2250 AVG: 2940 MAX: 3122 Neural Magic DeepSparse 1.5 CPU Power Consumption Monitor Watts < Lower Is Better AVX512 On .. MIN: 21 AVG: 248 MAX: 359 AVX512 Off . MIN: 21 AVG: 248 MAX: 347 Neural Magic DeepSparse 1.5 CPU Temperature Monitor Celsius < Lower Is Better AVX512 On .. MIN: 36.0 AVG: 57.7 MAX: 70.9 AVX512 Off . MIN: 38.4 AVG: 58.3 MAX: 70.5 Neural Magic DeepSparse 1.5 Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Stream items/sec > Higher Is Better AVX512 On .. 73.15 |=========================================================== AVX512 Off . 61.18 |================================================= Neural Magic DeepSparse 1.5 Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Stream ms/batch < Lower Is Better AVX512 On .. 859.71 |================================================ AVX512 Off . 1025.48 |========================================================= Neural Magic DeepSparse 1.5 CPU Peak Freq (Highest CPU Core Frequency) Monitor Megahertz > Higher Is Better AVX512 On .. MIN: 2250 AVG: 3006 MAX: 3135 AVX512 Off . MIN: 2250 AVG: 2952 MAX: 3146 Neural Magic DeepSparse 1.5 CPU Power Consumption Monitor Watts < Lower Is Better AVX512 On .. MIN: 21 AVG: 244 MAX: 358 AVX512 Off . MIN: 21 AVG: 246 MAX: 345 Neural Magic DeepSparse 1.5 CPU Temperature Monitor Celsius < Lower Is Better AVX512 On .. MIN: 37.3 AVG: 57.6 MAX: 70.9 AVX512 Off . MIN: 38.9 AVG: 58.3 MAX: 70.9 OpenVINO 2022.3 Model: Face Detection FP16 - Device: CPU FPS > Higher Is Better AVX512 On .. 60.73 |=========================================================== AVX512 Off . 26.18 |========================= OpenVINO 2022.3 Model: Face Detection FP16 - Device: CPU ms < Lower Is Better AVX512 On .. 1048.37 |========================= AVX512 Off . 2423.39 |========================================================= OpenVINO 2022.3 CPU Peak Freq (Highest CPU Core Frequency) Monitor Megahertz > Higher Is Better AVX512 On .. MIN: 2250 AVG: 2708 MAX: 3101 AVX512 Off . MIN: 2250 AVG: 2491 MAX: 3096 OpenVINO 2022.3 CPU Power Consumption Monitor Watts < Lower Is Better AVX512 On .. MIN: 21 AVG: 315 MAX: 359 AVX512 Off . MIN: 21 AVG: 287 MAX: 326 OpenVINO 2022.3 CPU Temperature Monitor Celsius < Lower Is Better AVX512 On .. MIN: 38.6 AVG: 63.1 MAX: 70.0 AVX512 Off . MIN: 39.8 AVG: 59.3 MAX: 68.1 OpenVINO 2022.3 Model: Person Detection FP16 - Device: CPU FPS > Higher Is Better AVX512 On .. 27.08 |=========================================================== AVX512 Off . 15.06 |================================= OpenVINO 2022.3 Model: Person Detection FP16 - Device: CPU ms < Lower Is Better AVX512 On .. 2334.29 |================================ AVX512 Off . 4153.59 |========================================================= OpenVINO 2022.3 CPU Peak Freq (Highest CPU Core Frequency) Monitor Megahertz > Higher Is Better AVX512 On .. MIN: 2250 AVG: 2931 MAX: 3185 AVX512 Off . MIN: 2250 AVG: 2649 MAX: 3132 OpenVINO 2022.3 CPU Power Consumption Monitor Watts < Lower Is Better AVX512 On .. MIN: 20 AVG: 306 MAX: 359 AVX512 Off . MIN: 21 AVG: 283 MAX: 329 OpenVINO 2022.3 CPU Temperature Monitor Celsius < Lower Is Better AVX512 On .. MIN: 41.3 AVG: 61.2 MAX: 73.4 AVX512 Off . MIN: 37.6 AVG: 57.4 MAX: 67.6 OpenVINO 2022.3 Model: Person Detection FP32 - Device: CPU FPS > Higher Is Better AVX512 On .. 27.01 |=========================================================== AVX512 Off . 14.99 |================================= OpenVINO 2022.3 Model: Person Detection FP32 - Device: CPU ms < Lower Is Better AVX512 On .. 2339.81 |================================ AVX512 Off . 4170.49 |========================================================= OpenVINO 2022.3 CPU Peak Freq (Highest CPU Core Frequency) Monitor Megahertz > Higher Is Better AVX512 On .. MIN: 2250 AVG: 2936 MAX: 3426 AVX512 Off . MIN: 2250 AVG: 2645 MAX: 3103 OpenVINO 2022.3 CPU Power Consumption Monitor Watts < Lower Is Better AVX512 On .. MIN: 21 AVG: 306 MAX: 358 AVX512 Off . MIN: 21 AVG: 293 MAX: 340 OpenVINO 2022.3 CPU Temperature Monitor Celsius < Lower Is Better AVX512 On .. MIN: 37.6 AVG: 60.6 MAX: 72.9 AVX512 Off . MIN: 36.5 AVG: 58.0 MAX: 72.4 OpenVINO 2022.3 Model: Vehicle Detection FP16 - Device: CPU FPS > Higher Is Better AVX512 On .. 1430.45 |========================================================= AVX512 Off . 1190.91 |=============================================== OpenVINO 2022.3 Model: Vehicle Detection FP16 - Device: CPU ms < Lower Is Better AVX512 On .. 44.84 |================================================= AVX512 Off . 53.79 |=========================================================== OpenVINO 2022.3 CPU Peak Freq (Highest CPU Core Frequency) Monitor Megahertz > Higher Is Better AVX512 On .. MIN: 2250 AVG: 3029 MAX: 3257 AVX512 Off . MIN: 2241 AVG: 2918 MAX: 3105 OpenVINO 2022.3 CPU Power Consumption Monitor Watts < Lower Is Better AVX512 On .. MIN: 21 AVG: 256 MAX: 334 AVX512 Off . MIN: 21 AVG: 267 MAX: 327 OpenVINO 2022.3 CPU Temperature Monitor Celsius < Lower Is Better AVX512 On .. MIN: 36.8 AVG: 51.7 MAX: 57.5 AVX512 Off . MIN: 36.8 AVG: 53.9 MAX: 62.3 OpenVINO 2022.3 Model: Face Detection FP16-INT8 - Device: CPU FPS > Higher Is Better AVX512 On .. 118.00 |========================================================== AVX512 Off . 57.95 |============================ OpenVINO 2022.3 Model: Face Detection FP16-INT8 - Device: CPU ms < Lower Is Better AVX512 On .. 540.35 |============================ AVX512 Off . 1094.52 |========================================================= OpenVINO 2022.3 CPU Peak Freq (Highest CPU Core Frequency) Monitor Megahertz > Higher Is Better AVX512 On .. MIN: 2250 AVG: 2696 MAX: 3116 AVX512 Off . MIN: 2250 AVG: 2688 MAX: 3124 OpenVINO 2022.3 CPU Power Consumption Monitor Watts < Lower Is Better AVX512 On .. MIN: 21 AVG: 295 MAX: 336 AVX512 Off . MIN: 21 AVG: 324 MAX: 369 OpenVINO 2022.3 CPU Temperature Monitor Celsius < Lower Is Better AVX512 On .. MIN: 34.4 AVG: 59.5 MAX: 70.5 AVX512 Off . MIN: 35.8 AVG: 65.5 MAX: 76.1 OpenVINO 2022.3 Model: Vehicle Detection FP16-INT8 - Device: CPU FPS > Higher Is Better AVX512 On .. 5690.34 |========================================================= AVX512 Off . 3954.90 |======================================== OpenVINO 2022.3 Model: Vehicle Detection FP16-INT8 - Device: CPU ms < Lower Is Better AVX512 On .. 11.26 |========================================= AVX512 Off . 16.17 |=========================================================== OpenVINO 2022.3 CPU Peak Freq (Highest CPU Core Frequency) Monitor Megahertz > Higher Is Better AVX512 On .. MIN: 2250 AVG: 2705 MAX: 3121 AVX512 Off . MIN: 2250 AVG: 2659 MAX: 3098 OpenVINO 2022.3 CPU Power Consumption Monitor Watts < Lower Is Better AVX512 On .. MIN: 21 AVG: 306 MAX: 336 AVX512 Off . MIN: 21 AVG: 330 MAX: 358 OpenVINO 2022.3 CPU Temperature Monitor Celsius < Lower Is Better AVX512 On .. MIN: 40.0 AVG: 59.2 MAX: 66.6 AVX512 Off . MIN: 42.1 AVG: 67.7 MAX: 72.8 OpenVINO 2022.3 Model: Weld Porosity Detection FP16 - Device: CPU FPS > Higher Is Better AVX512 On .. 6073.22 |========================================================= AVX512 Off . 2551.70 |======================== OpenVINO 2022.3 Model: Weld Porosity Detection FP16 - Device: CPU ms < Lower Is Better AVX512 On .. 10.52 |========================= AVX512 Off . 25.06 |=========================================================== OpenVINO 2022.3 CPU Peak Freq (Highest CPU Core Frequency) Monitor Megahertz > Higher Is Better AVX512 On .. MIN: 2250 AVG: 2718 MAX: 3095 AVX512 Off . MIN: 2250 AVG: 2373 MAX: 3112 OpenVINO 2022.3 CPU Power Consumption Monitor Watts < Lower Is Better AVX512 On .. MIN: 21 AVG: 328 MAX: 354 AVX512 Off . MIN: 21 AVG: 288 MAX: 311 OpenVINO 2022.3 CPU Temperature Monitor Celsius < Lower Is Better AVX512 On .. MIN: 36.8 AVG: 64.2 MAX: 69.9 AVX512 Off . MIN: 41.9 AVG: 61.1 MAX: 64.3 OpenVINO 2022.3 Model: Machine Translation EN To DE FP16 - Device: CPU FPS > Higher Is Better AVX512 On .. 580.40 |========================================================== AVX512 Off . 251.97 |========================= OpenVINO 2022.3 Model: Machine Translation EN To DE FP16 - Device: CPU ms < Lower Is Better AVX512 On .. 110.35 |========================= AVX512 Off . 254.01 |========================================================== OpenVINO 2022.3 CPU Peak Freq (Highest CPU Core Frequency) Monitor Megahertz > Higher Is Better AVX512 On .. MIN: 2250 AVG: 2661 MAX: 3111 AVX512 Off . MIN: 2214 AVG: 2537 MAX: 3101 OpenVINO 2022.3 CPU Power Consumption Monitor Watts < Lower Is Better AVX512 On .. MIN: 11 AVG: 295 MAX: 346 AVX512 Off . MIN: 21 AVG: 293 MAX: 331 OpenVINO 2022.3 CPU Temperature Monitor Celsius < Lower Is Better AVX512 On .. MIN: 40.5 AVG: 57.3 MAX: 65.8 AVX512 Off . MIN: 41.0 AVG: 56.7 MAX: 64.6 OpenVINO 2022.3 Model: Weld Porosity Detection FP16-INT8 - Device: CPU FPS > Higher Is Better AVX512 On .. 11818.33 |======================================================== AVX512 Off . 5692.99 |=========================== OpenVINO 2022.3 Model: Weld Porosity Detection FP16-INT8 - Device: CPU ms < Lower Is Better AVX512 On .. 10.82 |============================ AVX512 Off . 22.47 |=========================================================== OpenVINO 2022.3 CPU Peak Freq (Highest CPU Core Frequency) Monitor Megahertz > Higher Is Better AVX512 On .. MIN: 2250 AVG: 2619 MAX: 3137 AVX512 Off . MIN: 2250 AVG: 2671 MAX: 3102 OpenVINO 2022.3 CPU Power Consumption Monitor Watts < Lower Is Better AVX512 On .. MIN: 21 AVG: 307 MAX: 334 AVX512 Off . MIN: 21 AVG: 337 MAX: 365 OpenVINO 2022.3 CPU Temperature Monitor Celsius < Lower Is Better AVX512 On .. MIN: 36.8 AVG: 61.3 MAX: 66.1 AVX512 Off . MIN: 36.8 AVG: 67.4 MAX: 73.3 OpenVINO 2022.3 Model: Person Vehicle Bike Detection FP16 - Device: CPU FPS > Higher Is Better AVX512 On .. 6638.71 |========================================================= AVX512 Off . 3317.34 |============================ OpenVINO 2022.3 Model: Person Vehicle Bike Detection FP16 - Device: CPU ms < Lower Is Better AVX512 On .. 9.63 |============================= AVX512 Off . 19.28 |=========================================================== OpenVINO 2022.3 CPU Peak Freq (Highest CPU Core Frequency) Monitor Megahertz > Higher Is Better AVX512 On .. MIN: 2250 AVG: 2679 MAX: 3096 AVX512 Off . MIN: 2250 AVG: 2483 MAX: 3131 OpenVINO 2022.3 CPU Power Consumption Monitor Watts < Lower Is Better AVX512 On .. MIN: 22 AVG: 309 MAX: 347 AVX512 Off . MIN: 21 AVG: 293 MAX: 328 OpenVINO 2022.3 CPU Temperature Monitor Celsius < Lower Is Better AVX512 On .. MIN: 40.5 AVG: 60.6 MAX: 66.6 AVX512 Off . MIN: 41.0 AVG: 57.1 MAX: 64.8 OpenVINO 2022.3 Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU FPS > Higher Is Better AVX512 On .. 110240.89 |======================================================= AVX512 Off . 62564.16 |=============================== OpenVINO 2022.3 Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU ms < Lower Is Better AVX512 On .. 0.99 |=============================== AVX512 Off . 1.91 |============================================================ OpenVINO 2022.3 CPU Peak Freq (Highest CPU Core Frequency) Monitor Megahertz > Higher Is Better AVX512 On .. MIN: 2250 AVG: 2892 MAX: 3097 AVX512 Off . MIN: 2250 AVG: 2590 MAX: 3101 OpenVINO 2022.3 CPU Power Consumption Monitor Watts < Lower Is Better AVX512 On .. MIN: 21 AVG: 316 MAX: 348 AVX512 Off . MIN: 21 AVG: 299 MAX: 333 OpenVINO 2022.3 CPU Temperature Monitor Celsius < Lower Is Better AVX512 On .. MIN: 41.0 AVG: 64.6 MAX: 70.0 AVX512 Off . MIN: 37.3 AVG: 61.8 MAX: 68.0 OpenVINO 2022.3 Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU FPS > Higher Is Better AVX512 On .. 73970.12 |======================================================== AVX512 Off . 66895.49 |=================================================== OpenVINO 2022.3 Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU ms < Lower Is Better AVX512 On .. 1.58 |====================================================== AVX512 Off . 1.76 |============================================================ OpenVINO 2022.3 CPU Peak Freq (Highest CPU Core Frequency) Monitor Megahertz > Higher Is Better AVX512 On .. MIN: 2250 AVG: 2761 MAX: 3119 AVX512 Off . MIN: 2250 AVG: 2626 MAX: 3099 OpenVINO 2022.3 CPU Power Consumption Monitor Watts < Lower Is Better AVX512 On .. MIN: 21 AVG: 311 MAX: 337 AVX512 Off . MIN: 21 AVG: 308 MAX: 334 OpenVINO 2022.3 CPU Temperature Monitor Celsius < Lower Is Better AVX512 On .. MIN: 41.4 AVG: 63.4 MAX: 68.1 AVX512 Off . MIN: 41.0 AVG: 63.9 MAX: 69.0 CPU Peak Freq (Highest CPU Core Frequency) Monitor Phoronix Test Suite System Monitoring Megahertz AVX512 On .. MIN: 2250 AVG: 2918 MAX: 3532 AVX512 Off . MIN: 2203 AVG: 2980 MAX: 3559 CPU Power Consumption Monitor Phoronix Test Suite System Monitoring Watts AVX512 On .. MIN: 10 AVG: 231 MAX: 398 AVX512 Off . MIN: 10 AVG: 179 MAX: 378 CPU Temperature Monitor Phoronix Test Suite System Monitoring Celsius AVX512 On .. MIN: 23.3 AVG: 51.4 MAX: 74.3 AVX512 Off . MIN: 20.8 AVG: 44.2 MAX: 76.1