AMD EPYC 9754 1P benchmarks with AVX-512 benchmarking and then AVX-512 disabled. Tests by Michael Larabel for a future article.
Compare your own system(s) to this result file with the
Phoronix Test Suite by running the command:
phoronix-test-suite benchmark 2307197-NE-AMDBERGAM43
AMD EPYC 9754 Bergamo AVX-512
AMD EPYC 9754 1P benchmarks with AVX-512 benchmarking and then AVX-512 disabled. Tests by Michael Larabel for a future article.
AVX512 On:
Processor: AMD EPYC 9754 128-Core @ 2.25GHz (128 Cores / 256 Threads), Motherboard: AMD Titanite_4G (RTI1007B BIOS), Chipset: AMD Device 14a4, Memory: 768GB, Disk: 2 x 1920GB SAMSUNG MZWLJ1T9HBJR-00007, Graphics: ASPEED, Network: Broadcom NetXtreme BCM5720 PCIe
OS: Ubuntu 22.04, Kernel: 5.19.0-41-generic (x86_64), Desktop: GNOME Shell 42.5, Display Server: X Server 1.21.1.4, Vulkan: 1.3.224, Compiler: GCC 11.3.0, File-System: ext4, Screen Resolution: 1024x768
AVX512 Off:
Processor: AMD EPYC 9754 128-Core @ 2.25GHz (128 Cores / 256 Threads), Motherboard: AMD Titanite_4G (RTI1007B BIOS), Chipset: AMD Device 14a4, Memory: 768GB, Disk: 2 x 1920GB SAMSUNG MZWLJ1T9HBJR-00007, Graphics: ASPEED, Network: Broadcom NetXtreme BCM5720 PCIe
OS: Ubuntu 22.04, Kernel: 5.19.0-41-generic (x86_64), Desktop: GNOME Shell 42.5, Display Server: X Server 1.21.1.4, Vulkan: 1.3.224, Compiler: GCC 11.3.0, File-System: ext4, Screen Resolution: 1024x768
CPU Temperature Monitor
Phoronix Test Suite System Monitoring
Celsius
AVX512 On .. MIN: 23.3 AVG: 51.4 MAX: 74.3
AVX512 Off . MIN: 20.8 AVG: 44.2 MAX: 76.1
CPU Peak Freq (Highest CPU Core Frequency) Monitor
Phoronix Test Suite System Monitoring
Megahertz
AVX512 On .. MIN: 2250 AVG: 2918 MAX: 3532
AVX512 Off . MIN: 2203 AVG: 2980 MAX: 3559
CPU Power Consumption Monitor
Phoronix Test Suite System Monitoring
Watts
AVX512 On .. MIN: 10 AVG: 231 MAX: 398
AVX512 Off . MIN: 10 AVG: 179 MAX: 378
miniBUDE 20210901
Implementation: OpenMP - Input Deck: BM1
Billion Interactions/s > Higher Is Better
AVX512 On .. 237.03 |==========================================================
AVX512 Off . 187.11 |==============================================
miniBUDE 20210901
Implementation: OpenMP - Input Deck: BM2
Billion Interactions/s > Higher Is Better
AVX512 On .. 238.89 |==========================================================
AVX512 Off . 181.13 |============================================
miniBUDE 20210901
Implementation: OpenMP - Input Deck: BM1
Billion Interactions/s Per Watt > Higher Is Better
AVX512 On .. 1.550 |===========================================================
AVX512 Off . 1.026 |=======================================
miniBUDE 20210901
Implementation: OpenMP - Input Deck: BM2
Billion Interactions/s Per Watt > Higher Is Better
AVX512 On .. 0.89 |============================================================
AVX512 Off . 0.62 |==========================================
OpenVINO 2022.3
Model: Face Detection FP16 - Device: CPU
FPS > Higher Is Better
AVX512 On .. 60.73 |===========================================================
AVX512 Off . 26.18 |=========================
OpenVINO 2022.3
Model: Person Detection FP16 - Device: CPU
FPS > Higher Is Better
AVX512 On .. 27.08 |===========================================================
AVX512 Off . 15.06 |=================================
OpenVINO 2022.3
Model: Person Detection FP32 - Device: CPU
FPS > Higher Is Better
AVX512 On .. 27.01 |===========================================================
AVX512 Off . 14.99 |=================================
OpenVINO 2022.3
Model: Vehicle Detection FP16 - Device: CPU
FPS > Higher Is Better
AVX512 On .. 1430.45 |=========================================================
AVX512 Off . 1190.91 |===============================================
OpenVINO 2022.3
Model: Face Detection FP16-INT8 - Device: CPU
FPS > Higher Is Better
AVX512 On .. 118.00 |==========================================================
AVX512 Off . 57.95 |============================
OpenVINO 2022.3
Model: Vehicle Detection FP16-INT8 - Device: CPU
FPS > Higher Is Better
AVX512 On .. 5690.34 |=========================================================
AVX512 Off . 3954.90 |========================================
OpenVINO 2022.3
Model: Weld Porosity Detection FP16 - Device: CPU
FPS > Higher Is Better
AVX512 On .. 6073.22 |=========================================================
AVX512 Off . 2551.70 |========================
OpenVINO 2022.3
Model: Machine Translation EN To DE FP16 - Device: CPU
FPS > Higher Is Better
AVX512 On .. 580.40 |==========================================================
AVX512 Off . 251.97 |=========================
OpenVINO 2022.3
Model: Weld Porosity Detection FP16-INT8 - Device: CPU
FPS > Higher Is Better
AVX512 On .. 11818.33 |========================================================
AVX512 Off . 5692.99 |===========================
OpenVINO 2022.3
Model: Person Vehicle Bike Detection FP16 - Device: CPU
FPS > Higher Is Better
AVX512 On .. 6638.71 |=========================================================
AVX512 Off . 3317.34 |============================
OpenVINO 2022.3
Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU
FPS > Higher Is Better
AVX512 On .. 110240.89 |=======================================================
AVX512 Off . 62564.16 |===============================
OpenVINO 2022.3
Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU
FPS > Higher Is Better
AVX512 On .. 73970.12 |========================================================
AVX512 Off . 66895.49 |===================================================
Embree 4.1
Binary: Pathtracer ISPC - Model: Crown
Frames Per Second Per Watt > Higher Is Better
AVX512 On .. 0.672 |===========================================================
AVX512 Off . 0.560 |=================================================
Embree 4.1
Binary: Pathtracer ISPC - Model: Asian Dragon
Frames Per Second Per Watt > Higher Is Better
AVX512 On .. 0.920 |===========================================================
AVX512 Off . 0.715 |==============================================
Embree 4.1
Binary: Pathtracer ISPC - Model: Crown
Frames Per Second > Higher Is Better
AVX512 On .. 125.54 |==========================================================
AVX512 Off . 112.23 |====================================================
Embree 4.1
Binary: Pathtracer ISPC - Model: Asian Dragon Obj
Frames Per Second Per Watt > Higher Is Better
AVX512 On .. 1.070 |===========================================================
AVX512 Off . 0.842 |==============================================
Embree 4.1
Binary: Pathtracer ISPC - Model: Asian Dragon
Frames Per Second > Higher Is Better
AVX512 On .. 157.65 |==========================================================
AVX512 Off . 132.95 |=================================================
Embree 4.1
Binary: Pathtracer ISPC - Model: Asian Dragon Obj
Frames Per Second > Higher Is Better
AVX512 On .. 134.84 |==========================================================
AVX512 Off . 115.27 |==================================================
miniBUDE 20210901
Implementation: OpenMP - Input Deck: BM1
GFInst/s > Higher Is Better
AVX512 On .. 5925.67 |=========================================================
AVX512 Off . 4677.68 |=============================================
miniBUDE 20210901
Implementation: OpenMP - Input Deck: BM2
GFInst/s > Higher Is Better
AVX512 On .. 5972.19 |=========================================================
AVX512 Off . 4528.31 |===========================================
libxsmm 2-1.17-3645
M N K: 128
GFLOPS/s Per Watt > Higher Is Better
AVX512 On .. 13.07 |===========================================================
AVX512 Off . 12.53 |=========================================================
libxsmm 2-1.17-3645
M N K: 256
GFLOPS/s > Higher Is Better
AVX512 On .. 3342.5 |==========================================================
AVX512 Off . 2415.3 |==========================================
libxsmm 2-1.17-3645
M N K: 256
GFLOPS/s Per Watt > Higher Is Better
AVX512 On .. 15.90 |===========================================================
AVX512 Off . 11.40 |==========================================
libxsmm 2-1.17-3645
M N K: 128
GFLOPS/s > Higher Is Better
AVX512 On .. 2690.7 |==========================================================
AVX512 Off . 2573.3 |=======================================================
TensorFlow 2.12
Device: CPU - Batch Size: 16 - Model: AlexNet
images/sec Per Watt > Higher Is Better
AVX512 On .. 2.966 |===========================================================
AVX512 Off . 0.576 |===========
TensorFlow 2.12
Device: CPU - Batch Size: 32 - Model: AlexNet
images/sec Per Watt > Higher Is Better
AVX512 On .. 4.376 |===========================================================
AVX512 Off . 0.691 |=========
TensorFlow 2.12
Device: CPU - Batch Size: 64 - Model: AlexNet
images/sec Per Watt > Higher Is Better
AVX512 On .. 5.938 |===========================================================
AVX512 Off . 0.778 |========
TensorFlow 2.12
Device: CPU - Batch Size: 256 - Model: AlexNet
images/sec Per Watt > Higher Is Better
AVX512 On .. 6.984 |===========================================================
AVX512 Off . 0.839 |=======
TensorFlow 2.12
Device: CPU - Batch Size: 512 - Model: AlexNet
images/sec Per Watt > Higher Is Better
AVX512 On .. 7.097 |===========================================================
AVX512 Off . 0.865 |=======
TensorFlow 2.12
Device: CPU - Batch Size: 16 - Model: GoogLeNet
images/sec Per Watt > Higher Is Better
AVX512 On .. 0.774 |===========================================================
AVX512 Off . 0.335 |==========================
TensorFlow 2.12
Device: CPU - Batch Size: 16 - Model: ResNet-50
images/sec Per Watt > Higher Is Better
AVX512 On .. 0.294 |===========================================================
AVX512 Off . 0.113 |=======================
TensorFlow 2.12
Device: CPU - Batch Size: 32 - Model: GoogLeNet
images/sec Per Watt > Higher Is Better
AVX512 On .. 1.138 |===========================================================
AVX512 Off . 0.360 |===================
TensorFlow 2.12
Device: CPU - Batch Size: 32 - Model: ResNet-50
images/sec Per Watt > Higher Is Better
AVX512 On .. 0.407 |===========================================================
AVX512 Off . 0.124 |==================
TensorFlow 2.12
Device: CPU - Batch Size: 64 - Model: GoogLeNet
images/sec Per Watt > Higher Is Better
AVX512 On .. 1.476 |===========================================================
AVX512 Off . 0.369 |===============
TensorFlow 2.12
Device: CPU - Batch Size: 64 - Model: ResNet-50
images/sec > Higher Is Better
AVX512 On .. 96.63 |===========================================================
AVX512 Off . 18.45 |===========
TensorFlow 2.12
Device: CPU - Batch Size: 64 - Model: ResNet-50
images/sec Per Watt > Higher Is Better
AVX512 On .. 0.483 |===========================================================
AVX512 Off . 0.131 |================
TensorFlow 2.12
Device: CPU - Batch Size: 256 - Model: GoogLeNet
images/sec Per Watt > Higher Is Better
AVX512 On .. 2.078 |===========================================================
AVX512 Off . 0.362 |==========
TensorFlow 2.12
Device: CPU - Batch Size: 16 - Model: AlexNet
images/sec > Higher Is Better
AVX512 On .. 342.88 |==========================================================
AVX512 Off . 70.10 |============
TensorFlow 2.12
Device: CPU - Batch Size: 32 - Model: AlexNet
images/sec > Higher Is Better
AVX512 On .. 562.48 |==========================================================
AVX512 Off . 84.96 |=========
TensorFlow 2.12
Device: CPU - Batch Size: 64 - Model: AlexNet
images/sec > Higher Is Better
AVX512 On .. 857.55 |==========================================================
AVX512 Off . 97.59 |=======
TensorFlow 2.12
Device: CPU - Batch Size: 256 - Model: ResNet-50
images/sec Per Watt > Higher Is Better
AVX512 On .. 0.537 |===========================================================
AVX512 Off . 0.143 |================
TensorFlow 2.12
Device: CPU - Batch Size: 256 - Model: AlexNet
images/sec > Higher Is Better
AVX512 On .. 1422.36 |=========================================================
AVX512 Off . 106.28 |====
TensorFlow 2.12
Device: CPU - Batch Size: 512 - Model: AlexNet
images/sec > Higher Is Better
AVX512 On .. 1632.40 |=========================================================
AVX512 Off . 109.88 |====
TensorFlow 2.12
Device: CPU - Batch Size: 16 - Model: GoogLeNet
images/sec > Higher Is Better
AVX512 On .. 104.77 |==========================================================
AVX512 Off . 39.64 |======================
TensorFlow 2.12
Device: CPU - Batch Size: 16 - Model: ResNet-50
images/sec > Higher Is Better
AVX512 On .. 43.11 |===========================================================
AVX512 Off . 15.91 |======================
TensorFlow 2.12
Device: CPU - Batch Size: 32 - Model: GoogLeNet
images/sec > Higher Is Better
AVX512 On .. 180.77 |==========================================================
AVX512 Off . 44.46 |==============
TensorFlow 2.12
Device: CPU - Batch Size: 32 - Model: ResNet-50
images/sec > Higher Is Better
AVX512 On .. 71.62 |===========================================================
AVX512 Off . 17.48 |==============
TensorFlow 2.12
Device: CPU - Batch Size: 512 - Model: GoogLeNet
images/sec Per Watt > Higher Is Better
AVX512 On .. 1.766 |===========================================================
AVX512 Off . 0.369 |============
TensorFlow 2.12
Device: CPU - Batch Size: 64 - Model: GoogLeNet
images/sec > Higher Is Better
AVX512 On .. 277.24 |==========================================================
AVX512 Off . 46.28 |==========
TensorFlow 2.12
Device: CPU - Batch Size: 256 - Model: GoogLeNet
images/sec > Higher Is Better
AVX512 On .. 501.67 |==========================================================
AVX512 Off . 46.17 |=====
TensorFlow 2.12
Device: CPU - Batch Size: 512 - Model: ResNet-50
images/sec Per Watt > Higher Is Better
AVX512 On .. 0.542 |===========================================================
AVX512 Off . 0.148 |================
TensorFlow 2.12
Device: CPU - Batch Size: 256 - Model: ResNet-50
images/sec > Higher Is Better
AVX512 On .. 119.32 |==========================================================
AVX512 Off . 19.89 |==========
TensorFlow 2.12
Device: CPU - Batch Size: 512 - Model: GoogLeNet
images/sec > Higher Is Better
AVX512 On .. 417.25 |==========================================================
AVX512 Off . 46.92 |=======
TensorFlow 2.12
Device: CPU - Batch Size: 512 - Model: ResNet-50
images/sec > Higher Is Better
AVX512 On .. 122.81 |==========================================================
AVX512 Off . 20.78 |==========
OpenVKL 1.3.1
Benchmark: vklBenchmark ISPC
Items / Sec > Higher Is Better
AVX512 On .. 1398 |============================================================
AVX512 Off . 1179 |===================================================
OpenVKL 1.3.1
Benchmark: vklBenchmark ISPC
Items / Sec Per Watt > Higher Is Better
AVX512 On .. 5.858 |===========================================================
AVX512 Off . 4.569 |==============================================
OSPRay 2.12
Benchmark: gravity_spheres_volume/dim_512/ao/real_time
Items Per Second > Higher Is Better
AVX512 On .. 32.76 |===========================================================
AVX512 Off . 19.17 |===================================
OSPRay 2.12
Benchmark: gravity_spheres_volume/dim_512/scivis/real_time
Items Per Second > Higher Is Better
AVX512 On .. 31.68 |===========================================================
AVX512 Off . 18.02 |==================================
OSPRay 2.12
Benchmark: gravity_spheres_volume/dim_512/pathtracer/real_time
Items Per Second > Higher Is Better
AVX512 On .. 27.97 |===========================================================
AVX512 Off . 19.55 |=========================================
OSPRay 2.12
Benchmark: gravity_spheres_volume/dim_512/ao/real_time
Items Per Second Per Watt > Higher Is Better
AVX512 On .. 0.118 |===========================================================
AVX512 Off . 0.066 |=================================
OSPRay 2.12
Benchmark: gravity_spheres_volume/dim_512/scivis/real_time
Items Per Second Per Watt > Higher Is Better
AVX512 On .. 0.114 |===========================================================
AVX512 Off . 0.062 |================================
OSPRay 2.12
Benchmark: gravity_spheres_volume/dim_512/pathtracer/real_time
Items Per Second Per Watt > Higher Is Better
AVX512 On .. 0.106 |===========================================================
AVX512 Off . 0.072 |========================================
Neural Magic DeepSparse 1.5
Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Stream
items/sec > Higher Is Better
AVX512 On .. 73.54 |===========================================================
AVX512 Off . 61.37 |=================================================
Neural Magic DeepSparse 1.5
Model: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Scenario: Asynchronous Multi-Stream
items/sec > Higher Is Better
AVX512 On .. 1381.57 |=========================================================
AVX512 Off . 718.30 |==============================
Neural Magic DeepSparse 1.5
Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-Stream
items/sec > Higher Is Better
AVX512 On .. 247.97 |==========================================================
AVX512 Off . 213.64 |==================================================
Neural Magic DeepSparse 1.5
Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream
items/sec > Higher Is Better
AVX512 On .. 970.06 |==========================================================
AVX512 Off . 870.95 |====================================================
Neural Magic DeepSparse 1.5
Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream
items/sec > Higher Is Better
AVX512 On .. 624.74 |==========================================================
AVX512 Off . 522.11 |================================================
Neural Magic DeepSparse 1.5
Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Asynchronous Multi-Stream
items/sec > Higher Is Better
AVX512 On .. 127.06 |==========================================================
AVX512 Off . 69.33 |================================
Neural Magic DeepSparse 1.5
Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-Stream
items/sec > Higher Is Better
AVX512 On .. 316.17 |==========================================================
AVX512 Off . 260.77 |================================================
Neural Magic DeepSparse 1.5
Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Stream
items/sec > Higher Is Better
AVX512 On .. 73.15 |===========================================================
AVX512 Off . 61.18 |=================================================
Cpuminer-Opt 3.20.3
Algorithm: x25x
kH/s Per Watt > Higher Is Better
AVX512 On .. 16.85 |===========================================================
AVX512 Off . 10.81 |======================================
Cpuminer-Opt 3.20.3
Algorithm: scrypt
kH/s Per Watt > Higher Is Better
AVX512 On .. 8.913 |===========================================================
AVX512 Off . 6.476 |===========================================
Cpuminer-Opt 3.20.3
Algorithm: Blake-2 S
kH/s Per Watt > Higher Is Better
AVX512 On .. 22160.82 |========================================================
AVX512 Off . 14551.24 |=====================================
Cpuminer-Opt 3.20.3
Algorithm: Garlicoin
kH/s Per Watt > Higher Is Better
AVX512 On .. 272.43 |==========================================================
AVX512 Off . 202.32 |===========================================
Cpuminer-Opt 3.20.3
Algorithm: Skeincoin
kH/s Per Watt > Higher Is Better
AVX512 On .. 3691.56 |=========================================================
AVX512 Off . 2892.87 |=============================================
Cpuminer-Opt 3.20.3
Algorithm: Myriad-Groestl
kH/s Per Watt > Higher Is Better
AVX512 On .. 51.65 |===========================================================
AVX512 Off . 44.67 |===================================================
Cpuminer-Opt 3.20.3
Algorithm: LBC, LBRY Credits
kH/s Per Watt > Higher Is Better
AVX512 On .. 2003.50 |=========================================================
AVX512 Off . 1052.19 |==============================
Cpuminer-Opt 3.20.3
Algorithm: scrypt
kH/s > Higher Is Better
AVX512 On .. 2993.21 |=========================================================
AVX512 Off . 2033.15 |=======================================
Cpuminer-Opt 3.20.3
Algorithm: Skeincoin
kH/s > Higher Is Better
AVX512 On .. 1174953 |=========================================================
AVX512 Off . 937977 |==============================================
Cpuminer-Opt 3.20.3
Algorithm: Myriad-Groestl
kH/s > Higher Is Better
AVX512 On .. 8628.76 |=========================================================
AVX512 Off . 7149.95 |===============================================
Cpuminer-Opt 3.20.3
Algorithm: Quad SHA-256, Pyrite
kH/s Per Watt > Higher Is Better
AVX512 On .. 4347.58 |=========================================================
AVX512 Off . 2825.31 |=====================================
Cpuminer-Opt 3.20.3
Algorithm: x25x
kH/s > Higher Is Better
AVX512 On .. 4977.89 |=========================================================
AVX512 Off . 3010.37 |==================================
Cpuminer-Opt 3.20.3
Algorithm: Blake-2 S
kH/s > Higher Is Better
AVX512 On .. 7238650 |=========================================================
AVX512 Off . 4555580 |====================================
Cpuminer-Opt 3.20.3
Algorithm: Garlicoin
kH/s > Higher Is Better
AVX512 On .. 53090 |===========================================================
AVX512 Off . 39473 |============================================
Cpuminer-Opt 3.20.3
Algorithm: LBC, LBRY Credits
kH/s > Higher Is Better
AVX512 On .. 660660 |==========================================================
AVX512 Off . 332667 |=============================
Cpuminer-Opt 3.20.3
Algorithm: Quad SHA-256, Pyrite
kH/s > Higher Is Better
AVX512 On .. 1498937 |=========================================================
AVX512 Off . 876137 |=================================
miniBUDE 20210901
CPU Peak Freq (Highest CPU Core Frequency) Monitor
Megahertz > Higher Is Better
AVX512 On .. MIN: 2250 AVG: 2597 MAX: 3098
AVX512 Off . MIN: 2250 AVG: 2529 MAX: 3096
miniBUDE 20210901
CPU Peak Freq (Highest CPU Core Frequency) Monitor
Megahertz > Higher Is Better
AVX512 On .. MIN: 2250 AVG: 2796 MAX: 3014
AVX512 Off . MIN: 2250 AVG: 2696 MAX: 3098
libxsmm 2-1.17-3645
CPU Peak Freq (Highest CPU Core Frequency) Monitor
Megahertz > Higher Is Better
AVX512 On .. MIN: 2250 AVG: 3088 MAX: 3133
AVX512 Off . MIN: 2250 AVG: 3086 MAX: 3117
libxsmm 2-1.17-3645
CPU Peak Freq (Highest CPU Core Frequency) Monitor
Megahertz > Higher Is Better
AVX512 On .. MIN: 2250 AVG: 3054 MAX: 3135
AVX512 Off . MIN: 2239 AVG: 3038 MAX: 3143
Embree 4.1
CPU Peak Freq (Highest CPU Core Frequency) Monitor
Megahertz > Higher Is Better
AVX512 On .. MIN: 2250 AVG: 2511 MAX: 3101
AVX512 Off . MIN: 2250 AVG: 2627 MAX: 3097
Embree 4.1
CPU Peak Freq (Highest CPU Core Frequency) Monitor
Megahertz > Higher Is Better
AVX512 On .. MIN: 2250 AVG: 2565 MAX: 3098
AVX512 Off . MIN: 2250 AVG: 2584 MAX: 3096
Embree 4.1
CPU Peak Freq (Highest CPU Core Frequency) Monitor
Megahertz > Higher Is Better
AVX512 On .. MIN: 2250 AVG: 2841 MAX: 3101
AVX512 Off . MIN: 2250 AVG: 2855 MAX: 3098
OpenVKL 1.3.1
CPU Peak Freq (Highest CPU Core Frequency) Monitor
Megahertz > Higher Is Better
AVX512 On .. MIN: 2250 AVG: 2984 MAX: 3118
AVX512 Off . MIN: 2250 AVG: 2958 MAX: 3128
OSPRay 2.12
CPU Peak Freq (Highest CPU Core Frequency) Monitor
Megahertz > Higher Is Better
AVX512 On .. MIN: 2250 AVG: 2885 MAX: 3099
AVX512 Off . MIN: 2250 AVG: 2926 MAX: 3096
OSPRay 2.12
CPU Peak Freq (Highest CPU Core Frequency) Monitor
Megahertz > Higher Is Better
AVX512 On .. MIN: 2250 AVG: 2875 MAX: 3096
AVX512 Off . MIN: 2250 AVG: 2925 MAX: 3101
OSPRay 2.12
CPU Peak Freq (Highest CPU Core Frequency) Monitor
Megahertz > Higher Is Better
AVX512 On .. MIN: 2250 AVG: 3024 MAX: 3099
AVX512 Off . MIN: 2250 AVG: 3052 MAX: 3098
oneDNN 3.1
CPU Peak Freq (Highest CPU Core Frequency) Monitor
Megahertz > Higher Is Better
AVX512 On .. MIN: 2250 AVG: 2998 MAX: 3097
AVX512 Off . MIN: 2250 AVG: 2824 MAX: 3100
Cpuminer-Opt 3.20.3
CPU Peak Freq (Highest CPU Core Frequency) Monitor
Megahertz > Higher Is Better
AVX512 On .. MIN: 2250 AVG: 2909 MAX: 3099
AVX512 Off . MIN: 2250 AVG: 3019 MAX: 3099
Cpuminer-Opt 3.20.3
CPU Peak Freq (Highest CPU Core Frequency) Monitor
Megahertz > Higher Is Better
AVX512 On .. MIN: 2250 AVG: 2959 MAX: 3095
AVX512 Off . MIN: 2250 AVG: 2952 MAX: 3091
Cpuminer-Opt 3.20.3
CPU Peak Freq (Highest CPU Core Frequency) Monitor
Megahertz > Higher Is Better
AVX512 On .. MIN: 2250 AVG: 2925 MAX: 3002
AVX512 Off . MIN: 2250 AVG: 2779 MAX: 3096
Cpuminer-Opt 3.20.3
CPU Peak Freq (Highest CPU Core Frequency) Monitor
Megahertz > Higher Is Better
AVX512 On .. MIN: 2250 AVG: 3058 MAX: 3102
AVX512 Off . MIN: 2250 AVG: 3065 MAX: 3102
Cpuminer-Opt 3.20.3
CPU Peak Freq (Highest CPU Core Frequency) Monitor
Megahertz > Higher Is Better
AVX512 On .. MIN: 2250 AVG: 2804 MAX: 3143
AVX512 Off . MIN: 2250 AVG: 2899 MAX: 3096
Cpuminer-Opt 3.20.3
CPU Peak Freq (Highest CPU Core Frequency) Monitor
Megahertz > Higher Is Better
AVX512 On .. MIN: 2250 AVG: 3021 MAX: 3097
AVX512 Off . MIN: 2250 AVG: 3046 MAX: 3099
Cpuminer-Opt 3.20.3
CPU Peak Freq (Highest CPU Core Frequency) Monitor
Megahertz > Higher Is Better
AVX512 On .. MIN: 2250 AVG: 2886 MAX: 3096
AVX512 Off . MIN: 2250 AVG: 2746 MAX: 3096
Cpuminer-Opt 3.20.3
CPU Peak Freq (Highest CPU Core Frequency) Monitor
Megahertz > Higher Is Better
AVX512 On .. MIN: 2250 AVG: 2966 MAX: 3080
AVX512 Off . MIN: 2250 AVG: 2919 MAX: 3027
TensorFlow 2.12
CPU Peak Freq (Highest CPU Core Frequency) Monitor
Megahertz > Higher Is Better
AVX512 On .. MIN: 2250 AVG: 2801 MAX: 3254
AVX512 Off . MIN: 2250 AVG: 2992 MAX: 3136
TensorFlow 2.12
CPU Peak Freq (Highest CPU Core Frequency) Monitor
Megahertz > Higher Is Better
AVX512 On .. MIN: 2250 AVG: 2836 MAX: 3101
AVX512 Off . MIN: 2250 AVG: 3039 MAX: 3146
TensorFlow 2.12
CPU Peak Freq (Highest CPU Core Frequency) Monitor
Megahertz > Higher Is Better
AVX512 On .. MIN: 2250 AVG: 2751 MAX: 3111
AVX512 Off . MIN: 2250 AVG: 3057 MAX: 3377
TensorFlow 2.12
CPU Peak Freq (Highest CPU Core Frequency) Monitor
Megahertz > Higher Is Better
AVX512 On .. MIN: 2250 AVG: 2742 MAX: 3102
AVX512 Off . MIN: 2250 AVG: 3073 MAX: 3166
TensorFlow 2.12
CPU Peak Freq (Highest CPU Core Frequency) Monitor
Megahertz > Higher Is Better
AVX512 On .. MIN: 2250 AVG: 2754 MAX: 3095
AVX512 Off . MIN: 2203 AVG: 3079 MAX: 3359
TensorFlow 2.12
CPU Peak Freq (Highest CPU Core Frequency) Monitor
Megahertz > Higher Is Better
AVX512 On .. MIN: 2250 AVG: 2977 MAX: 3320
AVX512 Off . MIN: 2250 AVG: 3032 MAX: 3208
TensorFlow 2.12
CPU Peak Freq (Highest CPU Core Frequency) Monitor
Megahertz > Higher Is Better
AVX512 On .. MIN: 2250 AVG: 3041 MAX: 3348
AVX512 Off . MIN: 2250 AVG: 3075 MAX: 3217
TensorFlow 2.12
CPU Peak Freq (Highest CPU Core Frequency) Monitor
Megahertz > Higher Is Better
AVX512 On .. MIN: 2250 AVG: 2992 MAX: 3472
AVX512 Off . MIN: 2250 AVG: 3064 MAX: 3197
TensorFlow 2.12
CPU Peak Freq (Highest CPU Core Frequency) Monitor
Megahertz > Higher Is Better
AVX512 On .. MIN: 2250 AVG: 3066 MAX: 3438
AVX512 Off . MIN: 2250 AVG: 3084 MAX: 3221
TensorFlow 2.12
CPU Peak Freq (Highest CPU Core Frequency) Monitor
Megahertz > Higher Is Better
AVX512 On .. MIN: 2250 AVG: 2995 MAX: 3532
AVX512 Off . MIN: 2250 AVG: 3075 MAX: 3309
TensorFlow 2.12
CPU Peak Freq (Highest CPU Core Frequency) Monitor
Megahertz > Higher Is Better
AVX512 On .. MIN: 2250 AVG: 3021 MAX: 3283
AVX512 Off . MIN: 2250 AVG: 3090 MAX: 3249
TensorFlow 2.12
CPU Peak Freq (Highest CPU Core Frequency) Monitor
Megahertz > Higher Is Better
AVX512 On .. MIN: 2250 AVG: 2916 MAX: 3157
AVX512 Off . MIN: 2250 AVG: 3086 MAX: 3417
TensorFlow 2.12
CPU Peak Freq (Highest CPU Core Frequency) Monitor
Megahertz > Higher Is Better
AVX512 On .. MIN: 2250 AVG: 2956 MAX: 3308
AVX512 Off . MIN: 2250 AVG: 3085 MAX: 3559
TensorFlow 2.12
CPU Peak Freq (Highest CPU Core Frequency) Monitor
Megahertz > Higher Is Better
AVX512 On .. MIN: 2250 AVG: 2974 MAX: 3207
AVX512 Off . MIN: 2250 AVG: 3083 MAX: 3336
TensorFlow 2.12
CPU Peak Freq (Highest CPU Core Frequency) Monitor
Megahertz > Higher Is Better
AVX512 On .. MIN: 2250 AVG: 2958 MAX: 3370
AVX512 Off . MIN: 2243 AVG: 3086 MAX: 3295
Neural Magic DeepSparse 1.5
CPU Peak Freq (Highest CPU Core Frequency) Monitor
Megahertz > Higher Is Better
AVX512 On .. MIN: 2250 AVG: 3011 MAX: 3136
AVX512 Off . MIN: 2250 AVG: 2933 MAX: 3136
Neural Magic DeepSparse 1.5
CPU Peak Freq (Highest CPU Core Frequency) Monitor
Megahertz > Higher Is Better
AVX512 On .. MIN: 2250 AVG: 3026 MAX: 3124
AVX512 Off . MIN: 2250 AVG: 3015 MAX: 3127
Neural Magic DeepSparse 1.5
CPU Peak Freq (Highest CPU Core Frequency) Monitor
Megahertz > Higher Is Better
AVX512 On .. MIN: 2250 AVG: 3002 MAX: 3416
AVX512 Off . MIN: 2250 AVG: 3023 MAX: 3152
Neural Magic DeepSparse 1.5
CPU Peak Freq (Highest CPU Core Frequency) Monitor
Megahertz > Higher Is Better
AVX512 On .. MIN: 2250 AVG: 3012 MAX: 3134
AVX512 Off . MIN: 2250 AVG: 2962 MAX: 3101
Neural Magic DeepSparse 1.5
CPU Peak Freq (Highest CPU Core Frequency) Monitor
Megahertz > Higher Is Better
AVX512 On .. MIN: 2250 AVG: 3034 MAX: 3099
AVX512 Off . MIN: 2250 AVG: 2931 MAX: 3101
Neural Magic DeepSparse 1.5
CPU Peak Freq (Highest CPU Core Frequency) Monitor
Megahertz > Higher Is Better
AVX512 On .. MIN: 2250 AVG: 3006 MAX: 3115
AVX512 Off . MIN: 2250 AVG: 3048 MAX: 3116
Neural Magic DeepSparse 1.5
CPU Peak Freq (Highest CPU Core Frequency) Monitor
Megahertz > Higher Is Better
AVX512 On .. MIN: 2250 AVG: 3013 MAX: 3127
AVX512 Off . MIN: 2250 AVG: 2940 MAX: 3122
Neural Magic DeepSparse 1.5
CPU Peak Freq (Highest CPU Core Frequency) Monitor
Megahertz > Higher Is Better
AVX512 On .. MIN: 2250 AVG: 3006 MAX: 3135
AVX512 Off . MIN: 2250 AVG: 2952 MAX: 3146
OpenVINO 2022.3
CPU Peak Freq (Highest CPU Core Frequency) Monitor
Megahertz > Higher Is Better
AVX512 On .. MIN: 2250 AVG: 2708 MAX: 3101
AVX512 Off . MIN: 2250 AVG: 2491 MAX: 3096
OpenVINO 2022.3
CPU Peak Freq (Highest CPU Core Frequency) Monitor
Megahertz > Higher Is Better
AVX512 On .. MIN: 2250 AVG: 2931 MAX: 3185
AVX512 Off . MIN: 2250 AVG: 2649 MAX: 3132
OpenVINO 2022.3
CPU Peak Freq (Highest CPU Core Frequency) Monitor
Megahertz > Higher Is Better
AVX512 On .. MIN: 2250 AVG: 2936 MAX: 3426
AVX512 Off . MIN: 2250 AVG: 2645 MAX: 3103
OpenVINO 2022.3
CPU Peak Freq (Highest CPU Core Frequency) Monitor
Megahertz > Higher Is Better
AVX512 On .. MIN: 2250 AVG: 3029 MAX: 3257
AVX512 Off . MIN: 2241 AVG: 2918 MAX: 3105
OpenVINO 2022.3
CPU Peak Freq (Highest CPU Core Frequency) Monitor
Megahertz > Higher Is Better
AVX512 On .. MIN: 2250 AVG: 2696 MAX: 3116
AVX512 Off . MIN: 2250 AVG: 2688 MAX: 3124
OpenVINO 2022.3
CPU Peak Freq (Highest CPU Core Frequency) Monitor
Megahertz > Higher Is Better
AVX512 On .. MIN: 2250 AVG: 2705 MAX: 3121
AVX512 Off . MIN: 2250 AVG: 2659 MAX: 3098
OpenVINO 2022.3
CPU Peak Freq (Highest CPU Core Frequency) Monitor
Megahertz > Higher Is Better
AVX512 On .. MIN: 2250 AVG: 2718 MAX: 3095
AVX512 Off . MIN: 2250 AVG: 2373 MAX: 3112
OpenVINO 2022.3
CPU Peak Freq (Highest CPU Core Frequency) Monitor
Megahertz > Higher Is Better
AVX512 On .. MIN: 2250 AVG: 2661 MAX: 3111
AVX512 Off . MIN: 2214 AVG: 2537 MAX: 3101
OpenVINO 2022.3
CPU Peak Freq (Highest CPU Core Frequency) Monitor
Megahertz > Higher Is Better
AVX512 On .. MIN: 2250 AVG: 2619 MAX: 3137
AVX512 Off . MIN: 2250 AVG: 2671 MAX: 3102
OpenVINO 2022.3
CPU Peak Freq (Highest CPU Core Frequency) Monitor
Megahertz > Higher Is Better
AVX512 On .. MIN: 2250 AVG: 2679 MAX: 3096
AVX512 Off . MIN: 2250 AVG: 2483 MAX: 3131
OpenVINO 2022.3
CPU Peak Freq (Highest CPU Core Frequency) Monitor
Megahertz > Higher Is Better
AVX512 On .. MIN: 2250 AVG: 2892 MAX: 3097
AVX512 Off . MIN: 2250 AVG: 2590 MAX: 3101
OpenVINO 2022.3
CPU Peak Freq (Highest CPU Core Frequency) Monitor
Megahertz > Higher Is Better
AVX512 On .. MIN: 2250 AVG: 2761 MAX: 3119
AVX512 Off . MIN: 2250 AVG: 2626 MAX: 3099
miniBUDE 20210901
CPU Temperature Monitor
Celsius < Lower Is Better
AVX512 On .. MIN: 23.3 AVG: 36.3 MAX: 50.8
AVX512 Off . MIN: 20.8 AVG: 37.0 MAX: 52.8
miniBUDE 20210901
CPU Temperature Monitor
Celsius < Lower Is Better
AVX512 On .. MIN: 29.3 AVG: 53.4 MAX: 62.3
AVX512 Off . MIN: 27.9 AVG: 55.1 MAX: 64.1
libxsmm 2-1.17-3645
CPU Temperature Monitor
Celsius < Lower Is Better
AVX512 On .. MIN: 35.8 AVG: 50.3 MAX: 53.3
AVX512 Off . MIN: 35.5 AVG: 49.1 MAX: 50.9
libxsmm 2-1.17-3645
CPU Temperature Monitor
Celsius < Lower Is Better
AVX512 On .. MIN: 34.4 AVG: 49.7 MAX: 54.3
AVX512 Off . MIN: 33.5 AVG: 49.4 MAX: 53.3
Embree 4.1
CPU Temperature Monitor
Celsius < Lower Is Better
AVX512 On .. MIN: 33.5 AVG: 43.2 MAX: 51.3
AVX512 Off . MIN: 33.3 AVG: 44.2 MAX: 52.8
Embree 4.1
CPU Temperature Monitor
Celsius < Lower Is Better
AVX512 On .. MIN: 33.5 AVG: 41.4 MAX: 48.9
AVX512 Off . MIN: 33.5 AVG: 42.2 MAX: 50.0
Embree 4.1
CPU Temperature Monitor
Celsius < Lower Is Better
AVX512 On .. MIN: 32.5 AVG: 39.3 MAX: 47.0
AVX512 Off . MIN: 32.5 AVG: 36.7 MAX: 47.0
OpenVKL 1.3.1
CPU Temperature Monitor
Celsius < Lower Is Better
AVX512 On .. MIN: 30.6 AVG: 53.1 MAX: 62.3
AVX512 Off . MIN: 30.4 AVG: 54.5 MAX: 64.8
OSPRay 2.12
CPU Temperature Monitor
Celsius < Lower Is Better
AVX512 On .. MIN: 33.5 AVG: 55.1 MAX: 63.3
AVX512 Off . MIN: 32.0 AVG: 57.5 MAX: 65.3
OSPRay 2.12
CPU Temperature Monitor
Celsius < Lower Is Better
AVX512 On .. MIN: 39.4 AVG: 57.2 MAX: 64.3
AVX512 Off . MIN: 39.4 AVG: 59.7 MAX: 66.1
OSPRay 2.12
CPU Temperature Monitor
Celsius < Lower Is Better
AVX512 On .. MIN: 40.0 AVG: 55.6 MAX: 61.3
AVX512 Off . MIN: 40.0 AVG: 57.0 MAX: 62.8
oneDNN 3.1
CPU Temperature Monitor
Celsius < Lower Is Better
AVX512 On .. MIN: 30.4 AVG: 39.2 MAX: 45.3
AVX512 Off . MIN: 24.5 AVG: 39.8 MAX: 45.1
Cpuminer-Opt 3.20.3
CPU Temperature Monitor
Celsius < Lower Is Better
AVX512 On .. MIN: 39.4 AVG: 58.7 MAX: 64.3
AVX512 Off . MIN: 37.6 AVG: 55.2 MAX: 59.5
Cpuminer-Opt 3.20.3
CPU Temperature Monitor
Celsius < Lower Is Better
AVX512 On .. MIN: 39.5 AVG: 66.4 MAX: 73.3
AVX512 Off . MIN: 38.1 AVG: 63.6 MAX: 70.0
Cpuminer-Opt 3.20.3
CPU Temperature Monitor
Celsius < Lower Is Better
AVX512 On .. MIN: 33.9 AVG: 64.0 MAX: 72.8
AVX512 Off . MIN: 31.1 AVG: 64.0 MAX: 70.0
Cpuminer-Opt 3.20.3
CPU Temperature Monitor
Celsius < Lower Is Better
AVX512 On .. MIN: 38.1 AVG: 45.4 MAX: 47.9
AVX512 Off . MIN: 36.8 AVG: 43.7 MAX: 46.6
Cpuminer-Opt 3.20.3
CPU Temperature Monitor
Celsius < Lower Is Better
AVX512 On .. MIN: 34.4 AVG: 63.4 MAX: 71.9
AVX512 Off . MIN: 33.0 AVG: 62.9 MAX: 71.9
Cpuminer-Opt 3.20.3
CPU Temperature Monitor
Celsius < Lower Is Better
AVX512 On .. MIN: 34.9 AVG: 42.2 MAX: 47.0
AVX512 Off . MIN: 33.9 AVG: 40.9 MAX: 44.6
Cpuminer-Opt 3.20.3
CPU Temperature Monitor
Celsius < Lower Is Better
AVX512 On .. MIN: 32.0 AVG: 63.2 MAX: 72.8
AVX512 Off . MIN: 30.6 AVG: 59.5 MAX: 71.9
Cpuminer-Opt 3.20.3
CPU Temperature Monitor
Celsius < Lower Is Better
AVX512 On .. MIN: 40.5 AVG: 68.7 MAX: 74.3
AVX512 Off . MIN: 38.6 AVG: 62.0 MAX: 68.1
TensorFlow 2.12
CPU Temperature Monitor
Celsius < Lower Is Better
AVX512 On .. MIN: 34.9 AVG: 41.1 MAX: 49.4
AVX512 Off . MIN: 33.9 AVG: 40.3 MAX: 49.4
TensorFlow 2.12
CPU Temperature Monitor
Celsius < Lower Is Better
AVX512 On .. MIN: 32.0 AVG: 37.8 MAX: 45.3
AVX512 Off . MIN: 30.5 AVG: 37.1 MAX: 45.6
TensorFlow 2.12
CPU Temperature Monitor
Celsius < Lower Is Better
AVX512 On .. MIN: 30.6 AVG: 38.3 MAX: 45.5
AVX512 Off . MIN: 30.4 AVG: 36.5 MAX: 46.4
TensorFlow 2.12
CPU Temperature Monitor
Celsius < Lower Is Better
AVX512 On .. MIN: 30.9 AVG: 44.8 MAX: 52.3
AVX512 Off . MIN: 28.8 AVG: 36.0 MAX: 47.9
TensorFlow 2.12
CPU Temperature Monitor
Celsius < Lower Is Better
AVX512 On .. MIN: 33.9 AVG: 49.8 MAX: 55.8
AVX512 Off . MIN: 28.8 AVG: 36.2 MAX: 47.4
TensorFlow 2.12
CPU Temperature Monitor
Celsius < Lower Is Better
AVX512 On .. MIN: 33.0 AVG: 38.5 MAX: 45.8
AVX512 Off . MIN: 29.1 AVG: 35.7 MAX: 47.9
TensorFlow 2.12
CPU Temperature Monitor
Celsius < Lower Is Better
AVX512 On .. MIN: 30.4 AVG: 38.1 MAX: 44.6
AVX512 Off . MIN: 28.8 AVG: 37.2 MAX: 48.8
TensorFlow 2.12
CPU Temperature Monitor
Celsius < Lower Is Better
AVX512 On .. MIN: 30.8 AVG: 40.3 MAX: 49.9
AVX512 Off . MIN: 29.3 AVG: 35.3 MAX: 47.1
TensorFlow 2.12
CPU Temperature Monitor
Celsius < Lower Is Better
AVX512 On .. MIN: 31.3 AVG: 41.8 MAX: 48.6
AVX512 Off . MIN: 28.3 AVG: 37.5 MAX: 51.6
TensorFlow 2.12
CPU Temperature Monitor
Celsius < Lower Is Better
AVX512 On .. MIN: 32.5 AVG: 44.3 MAX: 52.8
AVX512 Off . MIN: 29.9 AVG: 35.9 MAX: 49.0
TensorFlow 2.12
CPU Temperature Monitor
Celsius < Lower Is Better
AVX512 On .. MIN: 33.5 AVG: 45.3 MAX: 53.3
AVX512 Off . MIN: 28.8 AVG: 38.1 MAX: 51.6
TensorFlow 2.12
CPU Temperature Monitor
Celsius < Lower Is Better
AVX512 On .. MIN: 34.4 AVG: 50.9 MAX: 58.9
AVX512 Off . MIN: 29.8 AVG: 36.4 MAX: 52.1
TensorFlow 2.12
CPU Temperature Monitor
Celsius < Lower Is Better
AVX512 On .. MIN: 37.6 AVG: 48.4 MAX: 57.6
AVX512 Off . MIN: 29.0 AVG: 38.3 MAX: 53.1
TensorFlow 2.12
CPU Temperature Monitor
Celsius < Lower Is Better
AVX512 On .. MIN: 34.6 AVG: 50.9 MAX: 58.4
AVX512 Off . MIN: 30.1 AVG: 36.8 MAX: 51.1
TensorFlow 2.12
CPU Temperature Monitor
Celsius < Lower Is Better
AVX512 On .. MIN: 35.4 AVG: 48.8 MAX: 57.5
AVX512 Off . MIN: 29.4 AVG: 39.1 MAX: 54.1
Neural Magic DeepSparse 1.5
CPU Temperature Monitor
Celsius < Lower Is Better
AVX512 On .. MIN: 34.6 AVG: 57.5 MAX: 71.4
AVX512 Off . MIN: 30.6 AVG: 54.5 MAX: 70.5
Neural Magic DeepSparse 1.5
CPU Temperature Monitor
Celsius < Lower Is Better
AVX512 On .. MIN: 39.4 AVG: 58.1 MAX: 67.6
AVX512 Off . MIN: 38.1 AVG: 53.8 MAX: 64.3
Neural Magic DeepSparse 1.5
CPU Temperature Monitor
Celsius < Lower Is Better
AVX512 On .. MIN: 38.6 AVG: 53.1 MAX: 66.5
AVX512 Off . MIN: 38.1 AVG: 52.9 MAX: 65.8
Neural Magic DeepSparse 1.5
CPU Temperature Monitor
Celsius < Lower Is Better
AVX512 On .. MIN: 39.8 AVG: 62.8 MAX: 70.4
AVX512 Off . MIN: 40.0 AVG: 65.2 MAX: 72.9
Neural Magic DeepSparse 1.5
CPU Temperature Monitor
Celsius < Lower Is Better
AVX512 On .. MIN: 39.1 AVG: 60.4 MAX: 67.1
AVX512 Off . MIN: 41.0 AVG: 60.7 MAX: 68.5
Neural Magic DeepSparse 1.5
CPU Temperature Monitor
Celsius < Lower Is Better
AVX512 On .. MIN: 38.1 AVG: 53.1 MAX: 66.1
AVX512 Off . MIN: 40.0 AVG: 54.0 MAX: 69.1
Neural Magic DeepSparse 1.5
CPU Temperature Monitor
Celsius < Lower Is Better
AVX512 On .. MIN: 36.0 AVG: 57.7 MAX: 70.9
AVX512 Off . MIN: 38.4 AVG: 58.3 MAX: 70.5
Neural Magic DeepSparse 1.5
CPU Temperature Monitor
Celsius < Lower Is Better
AVX512 On .. MIN: 37.3 AVG: 57.6 MAX: 70.9
AVX512 Off . MIN: 38.9 AVG: 58.3 MAX: 70.9
OpenVINO 2022.3
CPU Temperature Monitor
Celsius < Lower Is Better
AVX512 On .. MIN: 38.6 AVG: 63.1 MAX: 70.0
AVX512 Off . MIN: 39.8 AVG: 59.3 MAX: 68.1
OpenVINO 2022.3
CPU Temperature Monitor
Celsius < Lower Is Better
AVX512 On .. MIN: 41.3 AVG: 61.2 MAX: 73.4
AVX512 Off . MIN: 37.6 AVG: 57.4 MAX: 67.6
OpenVINO 2022.3
CPU Temperature Monitor
Celsius < Lower Is Better
AVX512 On .. MIN: 37.6 AVG: 60.6 MAX: 72.9
AVX512 Off . MIN: 36.5 AVG: 58.0 MAX: 72.4
OpenVINO 2022.3
CPU Temperature Monitor
Celsius < Lower Is Better
AVX512 On .. MIN: 36.8 AVG: 51.7 MAX: 57.5
AVX512 Off . MIN: 36.8 AVG: 53.9 MAX: 62.3
OpenVINO 2022.3
CPU Temperature Monitor
Celsius < Lower Is Better
AVX512 On .. MIN: 34.4 AVG: 59.5 MAX: 70.5
AVX512 Off . MIN: 35.8 AVG: 65.5 MAX: 76.1
OpenVINO 2022.3
CPU Temperature Monitor
Celsius < Lower Is Better
AVX512 On .. MIN: 40.0 AVG: 59.2 MAX: 66.6
AVX512 Off . MIN: 42.1 AVG: 67.7 MAX: 72.8
OpenVINO 2022.3
CPU Temperature Monitor
Celsius < Lower Is Better
AVX512 On .. MIN: 36.8 AVG: 64.2 MAX: 69.9
AVX512 Off . MIN: 41.9 AVG: 61.1 MAX: 64.3
OpenVINO 2022.3
CPU Temperature Monitor
Celsius < Lower Is Better
AVX512 On .. MIN: 40.5 AVG: 57.3 MAX: 65.8
AVX512 Off . MIN: 41.0 AVG: 56.7 MAX: 64.6
OpenVINO 2022.3
CPU Temperature Monitor
Celsius < Lower Is Better
AVX512 On .. MIN: 36.8 AVG: 61.3 MAX: 66.1
AVX512 Off . MIN: 36.8 AVG: 67.4 MAX: 73.3
OpenVINO 2022.3
CPU Temperature Monitor
Celsius < Lower Is Better
AVX512 On .. MIN: 40.5 AVG: 60.6 MAX: 66.6
AVX512 Off . MIN: 41.0 AVG: 57.1 MAX: 64.8
OpenVINO 2022.3
CPU Temperature Monitor
Celsius < Lower Is Better
AVX512 On .. MIN: 41.0 AVG: 64.6 MAX: 70.0
AVX512 Off . MIN: 37.3 AVG: 61.8 MAX: 68.0
OpenVINO 2022.3
CPU Temperature Monitor
Celsius < Lower Is Better
AVX512 On .. MIN: 41.4 AVG: 63.4 MAX: 68.1
AVX512 Off . MIN: 41.0 AVG: 63.9 MAX: 69.0
oneDNN 3.1
Harness: Recurrent Neural Network Training - Data Type: bf16bf16bf16 - Engine: CPU
ms < Lower Is Better
AVX512 On .. 1174.75 |===================================================
AVX512 Off . 1317.57 |=========================================================
OpenVINO 2022.3
Model: Face Detection FP16 - Device: CPU
ms < Lower Is Better
AVX512 On .. 1048.37 |=========================
AVX512 Off . 2423.39 |=========================================================
OpenVINO 2022.3
Model: Person Detection FP16 - Device: CPU
ms < Lower Is Better
AVX512 On .. 2334.29 |================================
AVX512 Off . 4153.59 |=========================================================
OpenVINO 2022.3
Model: Person Detection FP32 - Device: CPU
ms < Lower Is Better
AVX512 On .. 2339.81 |================================
AVX512 Off . 4170.49 |=========================================================
OpenVINO 2022.3
Model: Vehicle Detection FP16 - Device: CPU
ms < Lower Is Better
AVX512 On .. 44.84 |=================================================
AVX512 Off . 53.79 |===========================================================
OpenVINO 2022.3
Model: Face Detection FP16-INT8 - Device: CPU
ms < Lower Is Better
AVX512 On .. 540.35 |============================
AVX512 Off . 1094.52 |=========================================================
OpenVINO 2022.3
Model: Vehicle Detection FP16-INT8 - Device: CPU
ms < Lower Is Better
AVX512 On .. 11.26 |=========================================
AVX512 Off . 16.17 |===========================================================
OpenVINO 2022.3
Model: Weld Porosity Detection FP16 - Device: CPU
ms < Lower Is Better
AVX512 On .. 10.52 |=========================
AVX512 Off . 25.06 |===========================================================
OpenVINO 2022.3
Model: Machine Translation EN To DE FP16 - Device: CPU
ms < Lower Is Better
AVX512 On .. 110.35 |=========================
AVX512 Off . 254.01 |==========================================================
OpenVINO 2022.3
Model: Weld Porosity Detection FP16-INT8 - Device: CPU
ms < Lower Is Better
AVX512 On .. 10.82 |============================
AVX512 Off . 22.47 |===========================================================
OpenVINO 2022.3
Model: Person Vehicle Bike Detection FP16 - Device: CPU
ms < Lower Is Better
AVX512 On .. 9.63 |=============================
AVX512 Off . 19.28 |===========================================================
OpenVINO 2022.3
Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU
ms < Lower Is Better
AVX512 On .. 0.99 |===============================
AVX512 Off . 1.91 |============================================================
OpenVINO 2022.3
Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU
ms < Lower Is Better
AVX512 On .. 1.58 |======================================================
AVX512 Off . 1.76 |============================================================
Neural Magic DeepSparse 1.5
Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Stream
ms/batch < Lower Is Better
AVX512 On .. 858.40 |================================================
AVX512 Off . 1023.17 |=========================================================
Neural Magic DeepSparse 1.5
Model: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Scenario: Asynchronous Multi-Stream
ms/batch < Lower Is Better
AVX512 On .. 46.26 |===============================
AVX512 Off . 88.91 |===========================================================
Neural Magic DeepSparse 1.5
Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-Stream
ms/batch < Lower Is Better
AVX512 On .. 259.65 |===================================================
AVX512 Off . 298.06 |==========================================================
Neural Magic DeepSparse 1.5
Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream
ms/batch < Lower Is Better
AVX512 On .. 65.89 |=====================================================
AVX512 Off . 73.35 |===========================================================
Neural Magic DeepSparse 1.5
Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream
ms/batch < Lower Is Better
AVX512 On .. 102.22 |=================================================
AVX512 Off . 122.23 |==========================================================
Neural Magic DeepSparse 1.5
Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Asynchronous Multi-Stream
ms/batch < Lower Is Better
AVX512 On .. 498.48 |================================
AVX512 Off . 906.94 |==========================================================
Neural Magic DeepSparse 1.5
Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-Stream
ms/batch < Lower Is Better
AVX512 On .. 201.60 |================================================
AVX512 Off . 244.15 |==========================================================
Neural Magic DeepSparse 1.5
Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Stream
ms/batch < Lower Is Better
AVX512 On .. 859.71 |================================================
AVX512 Off . 1025.48 |=========================================================
miniBUDE 20210901
CPU Power Consumption Monitor
Watts < Lower Is Better
AVX512 On .. MIN: 19 AVG: 153 MAX: 317
AVX512 Off . MIN: 20 AVG: 182 MAX: 337
miniBUDE 20210901
CPU Power Consumption Monitor
Watts < Lower Is Better
AVX512 On .. MIN: 20 AVG: 268 MAX: 323
AVX512 Off . MIN: 20 AVG: 292 MAX: 342
libxsmm 2-1.17-3645
CPU Power Consumption Monitor
Watts < Lower Is Better
AVX512 On .. MIN: 20 AVG: 206 MAX: 330
AVX512 Off . MIN: 21 AVG: 205 MAX: 327
libxsmm 2-1.17-3645
CPU Power Consumption Monitor
Watts < Lower Is Better
AVX512 On .. MIN: 20 AVG: 210 MAX: 340
AVX512 Off . MIN: 21 AVG: 212 MAX: 336
Embree 4.1
CPU Power Consumption Monitor
Watts < Lower Is Better
AVX512 On .. MIN: 20 AVG: 187 MAX: 334
AVX512 Off . MIN: 21 AVG: 200 MAX: 340
Embree 4.1
CPU Power Consumption Monitor
Watts < Lower Is Better
AVX512 On .. MIN: 20 AVG: 171 MAX: 327
AVX512 Off . MIN: 20 AVG: 186 MAX: 333
Embree 4.1
CPU Power Consumption Monitor
Watts < Lower Is Better
AVX512 On .. MIN: 20 AVG: 126 MAX: 326
AVX512 Off . MIN: 20 AVG: 137 MAX: 331
OpenVKL 1.3.1
CPU Power Consumption Monitor
Watts < Lower Is Better
AVX512 On .. MIN: 20 AVG: 239 MAX: 322
AVX512 Off . MIN: 10 AVG: 258 MAX: 348
OSPRay 2.12
CPU Power Consumption Monitor
Watts < Lower Is Better
AVX512 On .. MIN: 20 AVG: 277 MAX: 330
AVX512 Off . MIN: 21 AVG: 291 MAX: 346
OSPRay 2.12
CPU Power Consumption Monitor
Watts < Lower Is Better
AVX512 On .. MIN: 21 AVG: 279 MAX: 332
AVX512 Off . MIN: 21 AVG: 292 MAX: 347
OSPRay 2.12
CPU Power Consumption Monitor
Watts < Lower Is Better
AVX512 On .. MIN: 21 AVG: 263 MAX: 314
AVX512 Off . MIN: 21 AVG: 272 MAX: 322
oneDNN 3.1
CPU Power Consumption Monitor
Watts < Lower Is Better
AVX512 On .. MIN: 20 AVG: 177 MAX: 278
AVX512 Off . MIN: 20 AVG: 202 MAX: 273
Cpuminer-Opt 3.20.3
CPU Power Consumption Monitor
Watts < Lower Is Better
AVX512 On .. MIN: 20 AVG: 295 MAX: 341
AVX512 Off . MIN: 21 AVG: 278 MAX: 322
Cpuminer-Opt 3.20.3
CPU Power Consumption Monitor
Watts < Lower Is Better
AVX512 On .. MIN: 21 AVG: 336 MAX: 385
AVX512 Off . MIN: 21 AVG: 314 MAX: 361
Cpuminer-Opt 3.20.3
CPU Power Consumption Monitor
Watts < Lower Is Better
AVX512 On .. MIN: 20 AVG: 327 MAX: 376
AVX512 Off . MIN: 21 AVG: 313 MAX: 358
Cpuminer-Opt 3.20.3
CPU Power Consumption Monitor
Watts < Lower Is Better
AVX512 On .. MIN: 21 AVG: 195 MAX: 210
AVX512 Off . MIN: 21 AVG: 195 MAX: 205
Cpuminer-Opt 3.20.3
CPU Power Consumption Monitor
Watts < Lower Is Better
AVX512 On .. MIN: 20 AVG: 318 MAX: 371
AVX512 Off . MIN: 20 AVG: 324 MAX: 376
Cpuminer-Opt 3.20.3
CPU Power Consumption Monitor
Watts < Lower Is Better
AVX512 On .. MIN: 20 AVG: 167 MAX: 200
AVX512 Off . MIN: 20 AVG: 160 MAX: 173
Cpuminer-Opt 3.20.3
CPU Power Consumption Monitor
Watts < Lower Is Better
AVX512 On .. MIN: 20 AVG: 330 MAX: 381
AVX512 Off . MIN: 21 AVG: 316 MAX: 362
Cpuminer-Opt 3.20.3
CPU Power Consumption Monitor
Watts < Lower Is Better
AVX512 On .. MIN: 21 AVG: 345 MAX: 398
AVX512 Off . MIN: 11 AVG: 310 MAX: 353
TensorFlow 2.12
CPU Power Consumption Monitor
Watts < Lower Is Better
AVX512 On .. MIN: 10 AVG: 116 MAX: 200
AVX512 Off . MIN: 21 AVG: 122 MAX: 146
TensorFlow 2.12
CPU Power Consumption Monitor
Watts < Lower Is Better
AVX512 On .. MIN: 20 AVG: 129 MAX: 211
AVX512 Off . MIN: 21 AVG: 123 MAX: 139
TensorFlow 2.12
CPU Power Consumption Monitor
Watts < Lower Is Better
AVX512 On .. MIN: 20 AVG: 144 MAX: 225
AVX512 Off . MIN: 20 AVG: 125 MAX: 141
TensorFlow 2.12
CPU Power Consumption Monitor
Watts < Lower Is Better
AVX512 On .. MIN: 20 AVG: 204 MAX: 257
AVX512 Off . MIN: 20 AVG: 127 MAX: 155
TensorFlow 2.12
CPU Power Consumption Monitor
Watts < Lower Is Better
AVX512 On .. MIN: 20 AVG: 230 MAX: 283
AVX512 Off . MIN: 20 AVG: 127 MAX: 190
TensorFlow 2.12
CPU Power Consumption Monitor
Watts < Lower Is Better
AVX512 On .. MIN: 20 AVG: 135 MAX: 179
AVX512 Off . MIN: 20 AVG: 118 MAX: 140
TensorFlow 2.12
CPU Power Consumption Monitor
Watts < Lower Is Better
AVX512 On .. MIN: 20 AVG: 147 MAX: 171
AVX512 Off . MIN: 20 AVG: 140 MAX: 152
TensorFlow 2.12
CPU Power Consumption Monitor
Watts < Lower Is Better
AVX512 On .. MIN: 20 AVG: 159 MAX: 208
AVX512 Off . MIN: 20 AVG: 124 MAX: 150
TensorFlow 2.12
CPU Power Consumption Monitor
Watts < Lower Is Better
AVX512 On .. MIN: 20 AVG: 176 MAX: 205
AVX512 Off . MIN: 20 AVG: 141 MAX: 173
TensorFlow 2.12
CPU Power Consumption Monitor
Watts < Lower Is Better
AVX512 On .. MIN: 20 AVG: 188 MAX: 237
AVX512 Off . MIN: 20 AVG: 125 MAX: 152
TensorFlow 2.12
CPU Power Consumption Monitor
Watts < Lower Is Better
AVX512 On .. MIN: 21 AVG: 200 MAX: 231
AVX512 Off . MIN: 20 AVG: 140 MAX: 180
TensorFlow 2.12
CPU Power Consumption Monitor
Watts < Lower Is Better
AVX512 On .. MIN: 20 AVG: 241 MAX: 278
AVX512 Off . MIN: 20 AVG: 127 MAX: 214
TensorFlow 2.12
CPU Power Consumption Monitor
Watts < Lower Is Better
AVX512 On .. MIN: 21 AVG: 222 MAX: 273
AVX512 Off . MIN: 20 AVG: 139 MAX: 199
TensorFlow 2.12
CPU Power Consumption Monitor
Watts < Lower Is Better
AVX512 On .. MIN: 11 AVG: 236 MAX: 283
AVX512 Off . MIN: 20 AVG: 127 MAX: 218
TensorFlow 2.12
CPU Power Consumption Monitor
Watts < Lower Is Better
AVX512 On .. MIN: 21 AVG: 227 MAX: 289
AVX512 Off . MIN: 20 AVG: 140 MAX: 209
Neural Magic DeepSparse 1.5
CPU Power Consumption Monitor
Watts < Lower Is Better
AVX512 On .. MIN: 20 AVG: 253 MAX: 358
AVX512 Off . MIN: 21 AVG: 244 MAX: 344
Neural Magic DeepSparse 1.5
CPU Power Consumption Monitor
Watts < Lower Is Better
AVX512 On .. MIN: 21 AVG: 250 MAX: 321
AVX512 Off . MIN: 21 AVG: 235 MAX: 327
Neural Magic DeepSparse 1.5
CPU Power Consumption Monitor
Watts < Lower Is Better
AVX512 On .. MIN: 11 AVG: 234 MAX: 342
AVX512 Off . MIN: 21 AVG: 229 MAX: 329
Neural Magic DeepSparse 1.5
CPU Power Consumption Monitor
Watts < Lower Is Better
AVX512 On .. MIN: 21 AVG: 279 MAX: 333
AVX512 Off . MIN: 21 AVG: 285 MAX: 342
Neural Magic DeepSparse 1.5
CPU Power Consumption Monitor
Watts < Lower Is Better
AVX512 On .. MIN: 21 AVG: 256 MAX: 321
AVX512 Off . MIN: 21 AVG: 256 MAX: 320
Neural Magic DeepSparse 1.5
CPU Power Consumption Monitor
Watts < Lower Is Better
AVX512 On .. MIN: 21 AVG: 228 MAX: 324
AVX512 Off . MIN: 21 AVG: 235 MAX: 341
Neural Magic DeepSparse 1.5
CPU Power Consumption Monitor
Watts < Lower Is Better
AVX512 On .. MIN: 21 AVG: 248 MAX: 359
AVX512 Off . MIN: 21 AVG: 248 MAX: 347
Neural Magic DeepSparse 1.5
CPU Power Consumption Monitor
Watts < Lower Is Better
AVX512 On .. MIN: 21 AVG: 244 MAX: 358
AVX512 Off . MIN: 21 AVG: 246 MAX: 345
OpenVINO 2022.3
CPU Power Consumption Monitor
Watts < Lower Is Better
AVX512 On .. MIN: 21 AVG: 315 MAX: 359
AVX512 Off . MIN: 21 AVG: 287 MAX: 326
OpenVINO 2022.3
CPU Power Consumption Monitor
Watts < Lower Is Better
AVX512 On .. MIN: 20 AVG: 306 MAX: 359
AVX512 Off . MIN: 21 AVG: 283 MAX: 329
OpenVINO 2022.3
CPU Power Consumption Monitor
Watts < Lower Is Better
AVX512 On .. MIN: 21 AVG: 306 MAX: 358
AVX512 Off . MIN: 21 AVG: 293 MAX: 340
OpenVINO 2022.3
CPU Power Consumption Monitor
Watts < Lower Is Better
AVX512 On .. MIN: 21 AVG: 256 MAX: 334
AVX512 Off . MIN: 21 AVG: 267 MAX: 327
OpenVINO 2022.3
CPU Power Consumption Monitor
Watts < Lower Is Better
AVX512 On .. MIN: 21 AVG: 295 MAX: 336
AVX512 Off . MIN: 21 AVG: 324 MAX: 369
OpenVINO 2022.3
CPU Power Consumption Monitor
Watts < Lower Is Better
AVX512 On .. MIN: 21 AVG: 306 MAX: 336
AVX512 Off . MIN: 21 AVG: 330 MAX: 358
OpenVINO 2022.3
CPU Power Consumption Monitor
Watts < Lower Is Better
AVX512 On .. MIN: 21 AVG: 328 MAX: 354
AVX512 Off . MIN: 21 AVG: 288 MAX: 311
OpenVINO 2022.3
CPU Power Consumption Monitor
Watts < Lower Is Better
AVX512 On .. MIN: 11 AVG: 295 MAX: 346
AVX512 Off . MIN: 21 AVG: 293 MAX: 331
OpenVINO 2022.3
CPU Power Consumption Monitor
Watts < Lower Is Better
AVX512 On .. MIN: 21 AVG: 307 MAX: 334
AVX512 Off . MIN: 21 AVG: 337 MAX: 365
OpenVINO 2022.3
CPU Power Consumption Monitor
Watts < Lower Is Better
AVX512 On .. MIN: 22 AVG: 309 MAX: 347
AVX512 Off . MIN: 21 AVG: 293 MAX: 328
OpenVINO 2022.3
CPU Power Consumption Monitor
Watts < Lower Is Better
AVX512 On .. MIN: 21 AVG: 316 MAX: 348
AVX512 Off . MIN: 21 AVG: 299 MAX: 333
OpenVINO 2022.3
CPU Power Consumption Monitor
Watts < Lower Is Better
AVX512 On .. MIN: 21 AVG: 311 MAX: 337
AVX512 Off . MIN: 21 AVG: 308 MAX: 334