openvino-1.4.0-amx

Intel Xeon w9-3495X testing with a ASUS Pro WS W790E-SAGE SE (0705 BIOS) and llvmpipe on Ubuntu 22.04 via the Phoronix Test Suite.

Compare your own system(s) to this result file with the Phoronix Test Suite by running the command: phoronix-test-suite benchmark 2311114-NE-2311110NE81
Jump To Table - Results

View

Do Not Show Noisy Results
Do Not Show Results With Incomplete Data
Do Not Show Results With Little Change/Spread
List Notable Results

Statistics

Show Overall Harmonic Mean(s)
Show Overall Geometric Mean
Show Wins / Losses Counts (Pie Chart)
Normalize Results
Remove Outliers Before Calculating Averages

Graph Settings

Force Line Graphs Where Applicable
Convert To Scalar Where Applicable
Prefer Vertical Bar Graphs
No Box Plots
On Line Graphs With Missing Data, Connect The Line Gaps

Multi-Way Comparison

Condense Multi-Option Tests Into Single Result Graphs
Condense Test Profiles With Multiple Version Results Into Single Result Graphs

Table

Show Detailed System Result Table

Run Management

Highlight
Result
Hide
Result
Result
Identifier
View Logs
Performance Per
Dollar
Date
Run
  Test
  Duration
AVX512_CORE_AMX
November 11 2023
  1 Hour, 45 Minutes
AVX512_CORE
November 12 2023
  1 Hour, 45 Minutes
Invert Hiding All Results Option
  1 Hour, 45 Minutes
Only show results matching title/arguments (delimit multiple options with a comma):
Do not show results matching title/arguments (delimit multiple options with a comma):


openvino-1.4.0-amx Intel Xeon w9-3495X testing with a ASUS Pro WS W790E-SAGE SE (0705 BIOS) and llvmpipe on Ubuntu 22.04 via the Phoronix Test Suite. AVX512_CORE_AMX: Processor: Intel Xeon w9-3495X @ 4.80GHz (56 Cores / 112 Threads), Motherboard: ASUS Pro WS W790E-SAGE SE (0705 BIOS), Chipset: Intel Device 7aa7, Memory: 8 x 32 GB DDR5-4812MT/s Hynix HMCG88AEBRA115N, Disk: 6401GB Micron_9300_MTFDHAL6T4TDR + 0GB Virtual HDisk0, Graphics: llvmpipe (210/405MHz), Audio: Realtek ALC1220, Network: 2 x Intel X710 for 10GBASE-T OS: Ubuntu 22.04, Kernel: 6.3.0-060300-generic (x86_64), Desktop: GNOME Shell 42.9, Display Server: X Server 1.21.1.4, Display Driver: NVIDIA 535.129.03, OpenGL: 4.5 Mesa 23.0.4-0ubuntu1~22.04.1 (LLVM 15.0.7 256 bits), OpenCL: OpenCL 3.0 CUDA 12.2.147, Vulkan: 1.3.242, Compiler: GCC 11.4.0 + CUDA 12.1, File-System: ext4, Screen Resolution: 1920x1200 AVX512_CORE: Processor: Intel Xeon w9-3495X @ 4.80GHz (56 Cores / 112 Threads), Motherboard: ASUS Pro WS W790E-SAGE SE (0705 BIOS), Chipset: Intel Device 7aa7, Memory: 8 x 32 GB DDR5-4812MT/s Hynix HMCG88AEBRA115N, Disk: 6401GB Micron_9300_MTFDHAL6T4TDR + 4097GB Lexar SSD ARES 4TB + 0GB Virtual HDisk0, Graphics: llvmpipe (210/405MHz), Audio: Realtek ALC1220, Network: 2 x Intel X710 for 10GBASE-T OS: Ubuntu 22.04, Kernel: 6.3.0-060300-generic (x86_64), Desktop: GNOME Shell 42.9, Display Server: X Server 1.21.1.4, Display Driver: NVIDIA 535.129.03, OpenGL: 4.5 Mesa 23.0.4-0ubuntu1~22.04.1 (LLVM 15.0.7 256 bits), OpenCL: OpenCL 3.0 CUDA 12.2.147, Vulkan: 1.3.242, Compiler: GCC 11.4.0 + CUDA 12.1, File-System: ext4, Screen Resolution: 1920x1200 CPU Peak Freq (Highest CPU Core Frequency) Monitor Phoronix Test Suite System Monitoring Megahertz AVX512_CORE_AMX . MIN: 1900 AVG: 2523 MAX: 4355 AVX512_CORE ..... MIN: 1900 AVG: 2565 MAX: 4586 CPU Power Consumption Monitor Phoronix Test Suite System Monitoring Watts AVX512_CORE_AMX . MIN: 54 AVG: 408 MAX: 507 AVX512_CORE ..... MIN: 48 AVG: 428 MAX: 643 CPU Temperature Monitor Phoronix Test Suite System Monitoring Celsius AVX512_CORE_AMX . MIN: 36 AVG: 68 MAX: 78 AVX512_CORE ..... MIN: 36 AVG: 69 MAX: 85 OpenVINO 2023.2.dev Model: Face Detection FP16 - Device: CPU FPS > Higher Is Better AVX512_CORE_AMX . 77.14 |====================================================== AVX512_CORE ..... 12.26 |========= OpenVINO 2023.2.dev Model: Face Detection FP16 - Device: CPU ms < Lower Is Better AVX512_CORE_AMX . 362.17 |======== AVX512_CORE ..... 2269.70 |==================================================== OpenVINO 2023.2.dev CPU Peak Freq (Highest CPU Core Frequency) Monitor Megahertz > Higher Is Better AVX512_CORE_AMX . MIN: 1900 AVG: 2679 MAX: 4330 AVX512_CORE ..... MIN: 1900 AVG: 2661 MAX: 4300 OpenVINO 2023.2.dev CPU Power Consumption Monitor Watts < Lower Is Better AVX512_CORE_AMX . MIN: 96 AVG: 408 MAX: 446 AVX512_CORE ..... MIN: 116 AVG: 408 MAX: 451 OpenVINO 2023.2.dev CPU Temperature Monitor Celsius < Lower Is Better AVX512_CORE_AMX . MIN: 36.0 AVG: 65.9 MAX: 71.0 AVX512_CORE ..... MIN: 37.0 AVG: 65.8 MAX: 73.0 OpenVINO 2023.2.dev Model: Face Detection FP16-INT8 - Device: CPU FPS > Higher Is Better AVX512_CORE_AMX . 165.65 |===================================================== AVX512_CORE ..... 86.16 |============================ OpenVINO 2023.2.dev Model: Face Detection FP16-INT8 - Device: CPU ms < Lower Is Better AVX512_CORE_AMX . 337.49 |===================================================== AVX512_CORE ..... 324.21 |=================================================== OpenVINO 2023.2.dev CPU Peak Freq (Highest CPU Core Frequency) Monitor Megahertz > Higher Is Better AVX512_CORE_AMX . MIN: 1900 AVG: 2668 MAX: 4305 AVX512_CORE ..... MIN: 1900 AVG: 2573 MAX: 4300 OpenVINO 2023.2.dev CPU Power Consumption Monitor Watts < Lower Is Better AVX512_CORE_AMX . MIN: 113 AVG: 419 MAX: 460 AVX512_CORE ..... MIN: 107 AVG: 507 MAX: 613 OpenVINO 2023.2.dev CPU Temperature Monitor Celsius < Lower Is Better AVX512_CORE_AMX . MIN: 42 AVG: 69 MAX: 74 AVX512_CORE ..... MIN: 44 AVG: 79 MAX: 84 OpenVINO 2023.2.dev Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU FPS > Higher Is Better AVX512_CORE_AMX . 91906.18 |=================================================== AVX512_CORE ..... 36370.46 |==================== OpenVINO 2023.2.dev Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU ms < Lower Is Better AVX512_CORE_AMX . 0.54 |===================== AVX512_CORE ..... 1.40 |======================================================= OpenVINO 2023.2.dev CPU Peak Freq (Highest CPU Core Frequency) Monitor Megahertz > Higher Is Better AVX512_CORE_AMX . MIN: 1900 AVG: 2391 MAX: 4326 AVX512_CORE ..... MIN: 1900 AVG: 2537 MAX: 4258 OpenVINO 2023.2.dev CPU Power Consumption Monitor Watts < Lower Is Better AVX512_CORE_AMX . MIN: 105 AVG: 409 MAX: 437 AVX512_CORE ..... MIN: 103 AVG: 432 MAX: 464 OpenVINO 2023.2.dev CPU Temperature Monitor Celsius < Lower Is Better AVX512_CORE_AMX . MIN: 44.0 AVG: 67.5 MAX: 70.0 AVX512_CORE ..... MIN: 45.0 AVG: 69.4 MAX: 74.0 OpenVINO 2023.2.dev Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU FPS > Higher Is Better AVX512_CORE_AMX . 108977.14 |================================================== AVX512_CORE ..... 83670.38 |====================================== OpenVINO 2023.2.dev Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU ms < Lower Is Better AVX512_CORE_AMX . 0.44 |========================================== AVX512_CORE ..... 0.58 |======================================================= OpenVINO 2023.2.dev CPU Peak Freq (Highest CPU Core Frequency) Monitor Megahertz > Higher Is Better AVX512_CORE_AMX . MIN: 1900 AVG: 2375 MAX: 4300 AVX512_CORE ..... MIN: 1900 AVG: 2569 MAX: 4426 OpenVINO 2023.2.dev CPU Power Consumption Monitor Watts < Lower Is Better AVX512_CORE_AMX . MIN: 100 AVG: 391 MAX: 418 AVX512_CORE ..... MIN: 57 AVG: 435 MAX: 466 OpenVINO 2023.2.dev CPU Temperature Monitor Celsius < Lower Is Better AVX512_CORE_AMX . MIN: 41.0 AVG: 65.4 MAX: 70.0 AVX512_CORE ..... MIN: 44.0 AVG: 69.2 MAX: 73.0 OpenVINO 2023.2.dev Model: Person Detection FP16 - Device: CPU FPS > Higher Is Better AVX512_CORE_AMX . 289.57 |===================================================== AVX512_CORE ..... 131.41 |======================== OpenVINO 2023.2.dev Model: Person Detection FP16 - Device: CPU ms < Lower Is Better AVX512_CORE_AMX . 96.62 |======================== AVX512_CORE ..... 212.82 |===================================================== OpenVINO 2023.2.dev CPU Peak Freq (Highest CPU Core Frequency) Monitor Megahertz > Higher Is Better AVX512_CORE_AMX . MIN: 1900 AVG: 2691 MAX: 4355 AVX512_CORE ..... MIN: 1900 AVG: 2664 MAX: 4385 OpenVINO 2023.2.dev CPU Power Consumption Monitor Watts < Lower Is Better AVX512_CORE_AMX . MIN: 100 AVG: 432 MAX: 469 AVX512_CORE ..... MIN: 99 AVG: 424 MAX: 462 OpenVINO 2023.2.dev CPU Temperature Monitor Celsius < Lower Is Better AVX512_CORE_AMX . MIN: 43.0 AVG: 69.0 MAX: 73.0 AVX512_CORE ..... MIN: 42.0 AVG: 67.7 MAX: 73.0 OpenVINO 2023.2.dev Model: Person Detection FP32 - Device: CPU FPS > Higher Is Better AVX512_CORE_AMX . 289.89 |===================================================== AVX512_CORE ..... 133.14 |======================== OpenVINO 2023.2.dev Model: Person Detection FP32 - Device: CPU ms < Lower Is Better AVX512_CORE_AMX . 96.52 |======================== AVX512_CORE ..... 210.10 |===================================================== OpenVINO 2023.2.dev CPU Peak Freq (Highest CPU Core Frequency) Monitor Megahertz > Higher Is Better AVX512_CORE_AMX . MIN: 1900 AVG: 2682 MAX: 4200 AVX512_CORE ..... MIN: 1900 AVG: 2650 MAX: 4586 OpenVINO 2023.2.dev CPU Power Consumption Monitor Watts < Lower Is Better AVX512_CORE_AMX . MIN: 59 AVG: 435 MAX: 475 AVX512_CORE ..... MIN: 103 AVG: 429 MAX: 466 OpenVINO 2023.2.dev CPU Temperature Monitor Celsius < Lower Is Better AVX512_CORE_AMX . MIN: 43.0 AVG: 69.9 MAX: 75.0 AVX512_CORE ..... MIN: 46.0 AVG: 68.8 MAX: 72.0 OpenVINO 2023.2.dev Model: Weld Porosity Detection FP16-INT8 - Device: CPU FPS > Higher Is Better AVX512_CORE_AMX . 17523.90 |=================================================== AVX512_CORE ..... 8530.81 |========================= OpenVINO 2023.2.dev Model: Weld Porosity Detection FP16-INT8 - Device: CPU ms < Lower Is Better AVX512_CORE_AMX . 3.18 |=========================== AVX512_CORE ..... 6.55 |======================================================= OpenVINO 2023.2.dev CPU Peak Freq (Highest CPU Core Frequency) Monitor Megahertz > Higher Is Better AVX512_CORE_AMX . MIN: 1900 AVG: 2301 MAX: 4198 AVX512_CORE ..... MIN: 1900 AVG: 2490 MAX: 3475 OpenVINO 2023.2.dev CPU Power Consumption Monitor Watts < Lower Is Better AVX512_CORE_AMX . MIN: 100 AVG: 410 MAX: 442 AVX512_CORE ..... MIN: 121 AVG: 520 MAX: 643 OpenVINO 2023.2.dev CPU Temperature Monitor Celsius < Lower Is Better AVX512_CORE_AMX . MIN: 44 AVG: 68 MAX: 71 AVX512_CORE ..... MIN: 44 AVG: 80 MAX: 85 OpenVINO 2023.2.dev Model: Weld Porosity Detection FP16 - Device: CPU FPS > Higher Is Better AVX512_CORE_AMX . 9417.38 |==================================================== AVX512_CORE ..... 1273.78 |======= OpenVINO 2023.2.dev Model: Weld Porosity Detection FP16 - Device: CPU ms < Lower Is Better AVX512_CORE_AMX . 5.93 |======= AVX512_CORE ..... 43.93 |====================================================== OpenVINO 2023.2.dev CPU Peak Freq (Highest CPU Core Frequency) Monitor Megahertz > Higher Is Better AVX512_CORE_AMX . MIN: 1900 AVG: 2405 MAX: 4119 AVX512_CORE ..... MIN: 1900 AVG: 2520 MAX: 4200 OpenVINO 2023.2.dev CPU Power Consumption Monitor Watts < Lower Is Better AVX512_CORE_AMX . MIN: 94 AVG: 405 MAX: 437 AVX512_CORE ..... MIN: 111 AVG: 437 MAX: 465 OpenVINO 2023.2.dev CPU Temperature Monitor Celsius < Lower Is Better AVX512_CORE_AMX . MIN: 40.0 AVG: 67.6 MAX: 73.0 AVX512_CORE ..... MIN: 47.0 AVG: 71.0 MAX: 75.0 OpenVINO 2023.2.dev Model: Vehicle Detection FP16-INT8 - Device: CPU FPS > Higher Is Better AVX512_CORE_AMX . 3234.97 |======================================== AVX512_CORE ..... 4193.97 |==================================================== OpenVINO 2023.2.dev Model: Vehicle Detection FP16-INT8 - Device: CPU ms < Lower Is Better AVX512_CORE_AMX . 17.28 |====================================================== AVX512_CORE ..... 6.66 |===================== OpenVINO 2023.2.dev CPU Peak Freq (Highest CPU Core Frequency) Monitor Megahertz > Higher Is Better AVX512_CORE_AMX . MIN: 1900 AVG: 2501 MAX: 4200 AVX512_CORE ..... MIN: 1900 AVG: 2555 MAX: 2909 OpenVINO 2023.2.dev CPU Power Consumption Monitor Watts < Lower Is Better AVX512_CORE_AMX . MIN: 94 AVG: 457 MAX: 500 AVX512_CORE ..... MIN: 114 AVG: 522 MAX: 605 OpenVINO 2023.2.dev CPU Temperature Monitor Celsius < Lower Is Better AVX512_CORE_AMX . MIN: 42 AVG: 72 MAX: 76 AVX512_CORE ..... MIN: 42 AVG: 79 MAX: 84 OpenVINO 2023.2.dev Model: Vehicle Detection FP16 - Device: CPU FPS > Higher Is Better AVX512_CORE_AMX . 1921.78 |==================================================== AVX512_CORE ..... 1077.28 |============================= OpenVINO 2023.2.dev Model: Vehicle Detection FP16 - Device: CPU ms < Lower Is Better AVX512_CORE_AMX . 14.54 |============================== AVX512_CORE ..... 25.97 |====================================================== OpenVINO 2023.2.dev CPU Peak Freq (Highest CPU Core Frequency) Monitor Megahertz > Higher Is Better AVX512_CORE_AMX . MIN: 1900 AVG: 2543 MAX: 3789 AVX512_CORE ..... MIN: 1900 AVG: 2562 MAX: 4171 OpenVINO 2023.2.dev CPU Power Consumption Monitor Watts < Lower Is Better AVX512_CORE_AMX . MIN: 98 AVG: 455 MAX: 490 AVX512_CORE ..... MIN: 104 AVG: 460 MAX: 490 OpenVINO 2023.2.dev CPU Temperature Monitor Celsius < Lower Is Better AVX512_CORE_AMX . MIN: 41 AVG: 72 MAX: 78 AVX512_CORE ..... MIN: 48 AVG: 73 MAX: 77 OpenVINO 2023.2.dev Model: Person Vehicle Bike Detection FP16 - Device: CPU FPS > Higher Is Better AVX512_CORE_AMX . 3661.12 |==================================================== AVX512_CORE ..... 1591.03 |======================= OpenVINO 2023.2.dev Model: Person Vehicle Bike Detection FP16 - Device: CPU ms < Lower Is Better AVX512_CORE_AMX . 15.27 |=============================================== AVX512_CORE ..... 17.58 |====================================================== OpenVINO 2023.2.dev CPU Peak Freq (Highest CPU Core Frequency) Monitor Megahertz > Higher Is Better AVX512_CORE_AMX . MIN: 1900 AVG: 2460 MAX: 4300 AVX512_CORE ..... MIN: 1900 AVG: 2600 MAX: 4363 OpenVINO 2023.2.dev CPU Power Consumption Monitor Watts < Lower Is Better AVX512_CORE_AMX . MIN: 98 AVG: 436 MAX: 476 AVX512_CORE ..... MIN: 103 AVG: 410 MAX: 442 OpenVINO 2023.2.dev CPU Temperature Monitor Celsius < Lower Is Better AVX512_CORE_AMX . MIN: 44.0 AVG: 70.7 MAX: 75.0 AVX512_CORE ..... MIN: 44.0 AVG: 66.5 MAX: 71.0 OpenVINO 2023.2.dev Model: Machine Translation EN To DE FP16 - Device: CPU FPS > Higher Is Better OpenVINO 2023.2.dev Model: Face Detection Retail FP16 - Device: CPU FPS > Higher Is Better AVX512_CORE_AMX . 6610.96 |==================================================== AVX512_CORE ..... 3153.69 |========================= OpenVINO 2023.2.dev Model: Face Detection Retail FP16 - Device: CPU ms < Lower Is Better AVX512_CORE_AMX . 8.45 |==================================================== AVX512_CORE ..... 8.87 |======================================================= OpenVINO 2023.2.dev CPU Peak Freq (Highest CPU Core Frequency) Monitor Megahertz > Higher Is Better AVX512_CORE_AMX . MIN: 1900 AVG: 2397 MAX: 3397 AVX512_CORE ..... MIN: 1900 AVG: 2488 MAX: 2901 OpenVINO 2023.2.dev CPU Power Consumption Monitor Watts < Lower Is Better AVX512_CORE_AMX . MIN: 94 AVG: 452 MAX: 490 AVX512_CORE ..... MIN: 113 AVG: 433 MAX: 463 OpenVINO 2023.2.dev CPU Temperature Monitor Celsius < Lower Is Better AVX512_CORE_AMX . MIN: 39 AVG: 71 MAX: 78 AVX512_CORE ..... MIN: 42 AVG: 69 MAX: 73 OpenVINO 2023.2.dev Model: Face Detection Retail FP16-INT8 - Device: CPU FPS > Higher Is Better AVX512_CORE_AMX . 10083.57 |============================================== AVX512_CORE ..... 11238.54 |=================================================== OpenVINO 2023.2.dev Model: Face Detection Retail FP16-INT8 - Device: CPU ms < Lower Is Better AVX512_CORE_AMX . 5.54 |======================================================= AVX512_CORE ..... 4.96 |================================================= OpenVINO 2023.2.dev CPU Peak Freq (Highest CPU Core Frequency) Monitor Megahertz > Higher Is Better AVX512_CORE_AMX . MIN: 1900 AVG: 2376 MAX: 3703 AVX512_CORE ..... MIN: 1900 AVG: 2754 MAX: 4298 OpenVINO 2023.2.dev CPU Power Consumption Monitor Watts < Lower Is Better AVX512_CORE_AMX . MIN: 95 AVG: 440 MAX: 485 AVX512_CORE ..... MIN: 101 AVG: 494 MAX: 543 OpenVINO 2023.2.dev CPU Temperature Monitor Celsius < Lower Is Better AVX512_CORE_AMX . MIN: 44 AVG: 71 MAX: 75 AVX512_CORE ..... MIN: 42 AVG: 76 MAX: 81 OpenVINO 2023.2.dev Model: Handwritten English Recognition FP16 - Device: CPU FPS > Higher Is Better AVX512_CORE_AMX . 1597.47 |==================================================== AVX512_CORE ..... 844.59 |=========================== OpenVINO 2023.2.dev Model: Handwritten English Recognition FP16 - Device: CPU ms < Lower Is Better AVX512_CORE_AMX . 35.03 |============================= AVX512_CORE ..... 66.26 |====================================================== OpenVINO 2023.2.dev CPU Peak Freq (Highest CPU Core Frequency) Monitor Megahertz > Higher Is Better AVX512_CORE_AMX . MIN: 1900 AVG: 2610 MAX: 4200 AVX512_CORE ..... MIN: 1900 AVG: 2522 MAX: 3189 OpenVINO 2023.2.dev CPU Power Consumption Monitor Watts < Lower Is Better AVX512_CORE_AMX . MIN: 95 AVG: 427 MAX: 461 AVX512_CORE ..... MIN: 48 AVG: 428 MAX: 460 OpenVINO 2023.2.dev CPU Temperature Monitor Celsius < Lower Is Better AVX512_CORE_AMX . MIN: 41.0 AVG: 69.6 MAX: 75.0 AVX512_CORE ..... MIN: 44.0 AVG: 68.1 MAX: 72.0 OpenVINO 2023.2.dev Model: Handwritten English Recognition FP16-INT8 - Device: CPU FPS > Higher Is Better AVX512_CORE_AMX . 1244.36 |==================================================== AVX512_CORE ..... 886.14 |===================================== OpenVINO 2023.2.dev Model: Handwritten English Recognition FP16-INT8 - Device: CPU ms < Lower Is Better AVX512_CORE_AMX . 44.97 |====================================== AVX512_CORE ..... 63.15 |====================================================== OpenVINO 2023.2.dev CPU Peak Freq (Highest CPU Core Frequency) Monitor Megahertz > Higher Is Better AVX512_CORE_AMX . MIN: 1900 AVG: 2743 MAX: 3382 AVX512_CORE ..... MIN: 1900 AVG: 2745 MAX: 2900 OpenVINO 2023.2.dev CPU Power Consumption Monitor Watts < Lower Is Better AVX512_CORE_AMX . MIN: 96 AVG: 419 MAX: 451 AVX512_CORE ..... MIN: 96 AVG: 430 MAX: 466 OpenVINO 2023.2.dev CPU Temperature Monitor Celsius < Lower Is Better AVX512_CORE_AMX . MIN: 44.0 AVG: 69.9 MAX: 74.0 AVX512_CORE ..... MIN: 40.0 AVG: 67.6 MAX: 73.0 OpenVINO 2023.2.dev Model: Road Segmentation ADAS FP16 - Device: CPU FPS > Higher Is Better AVX512_CORE_AMX . 807.46 |===================================================== AVX512_CORE ..... 540.69 |=================================== OpenVINO 2023.2.dev Model: Road Segmentation ADAS FP16 - Device: CPU ms < Lower Is Better AVX512_CORE_AMX . 34.62 |==================================== AVX512_CORE ..... 51.73 |====================================================== OpenVINO 2023.2.dev CPU Peak Freq (Highest CPU Core Frequency) Monitor Megahertz > Higher Is Better AVX512_CORE_AMX . MIN: 1900 AVG: 2694 MAX: 4232 AVX512_CORE ..... MIN: 1900 AVG: 2569 MAX: 4200 OpenVINO 2023.2.dev CPU Power Consumption Monitor Watts < Lower Is Better AVX512_CORE_AMX . MIN: 94 AVG: 466 MAX: 507 AVX512_CORE ..... MIN: 96 AVG: 444 MAX: 478 OpenVINO 2023.2.dev CPU Temperature Monitor Celsius < Lower Is Better AVX512_CORE_AMX . MIN: 41 AVG: 72 MAX: 78 AVX512_CORE ..... MIN: 42 AVG: 69 MAX: 73 OpenVINO 2023.2.dev Model: Road Segmentation ADAS FP16-INT8 - Device: CPU FPS > Higher Is Better AVX512_CORE_AMX . 1129.41 |================================================= AVX512_CORE ..... 1187.75 |==================================================== OpenVINO 2023.2.dev Model: Road Segmentation ADAS FP16-INT8 - Device: CPU ms < Lower Is Better AVX512_CORE_AMX . 49.52 |====================================================== AVX512_CORE ..... 23.47 |========================== OpenVINO 2023.2.dev CPU Peak Freq (Highest CPU Core Frequency) Monitor Megahertz > Higher Is Better AVX512_CORE_AMX . MIN: 1900 AVG: 2670 MAX: 4300 AVX512_CORE ..... MIN: 1900 AVG: 2638 MAX: 4222 OpenVINO 2023.2.dev CPU Power Consumption Monitor Watts < Lower Is Better AVX512_CORE_AMX . MIN: 98 AVG: 443 MAX: 481 AVX512_CORE ..... MIN: 98 AVG: 443 MAX: 480 OpenVINO 2023.2.dev CPU Temperature Monitor Celsius < Lower Is Better AVX512_CORE_AMX . MIN: 45.0 AVG: 71.1 MAX: 75.0 AVX512_CORE ..... MIN: 39.0 AVG: 67.6 MAX: 71.0