Intel Xeon w9-3495X testing with a ASUS Pro WS W790E-SAGE SE (0705 BIOS) and llvmpipe on Ubuntu 22.04 via the Phoronix Test Suite.
Compare your own system(s) to this result file with the
Phoronix Test Suite by running the command:
phoronix-test-suite benchmark 2311114-NE-2311110NE81
openvino-1.4.0-amx
Intel Xeon w9-3495X testing with a ASUS Pro WS W790E-SAGE SE (0705 BIOS) and llvmpipe on Ubuntu 22.04 via the Phoronix Test Suite.
AVX512_CORE_AMX:
Processor: Intel Xeon w9-3495X @ 4.80GHz (56 Cores / 112 Threads), Motherboard: ASUS Pro WS W790E-SAGE SE (0705 BIOS), Chipset: Intel Device 7aa7, Memory: 8 x 32 GB DDR5-4812MT/s Hynix HMCG88AEBRA115N, Disk: 6401GB Micron_9300_MTFDHAL6T4TDR + 0GB Virtual HDisk0, Graphics: llvmpipe (210/405MHz), Audio: Realtek ALC1220, Network: 2 x Intel X710 for 10GBASE-T
OS: Ubuntu 22.04, Kernel: 6.3.0-060300-generic (x86_64), Desktop: GNOME Shell 42.9, Display Server: X Server 1.21.1.4, Display Driver: NVIDIA 535.129.03, OpenGL: 4.5 Mesa 23.0.4-0ubuntu1~22.04.1 (LLVM 15.0.7 256 bits), OpenCL: OpenCL 3.0 CUDA 12.2.147, Vulkan: 1.3.242, Compiler: GCC 11.4.0 + CUDA 12.1, File-System: ext4, Screen Resolution: 1920x1200
AVX512_CORE:
Processor: Intel Xeon w9-3495X @ 4.80GHz (56 Cores / 112 Threads), Motherboard: ASUS Pro WS W790E-SAGE SE (0705 BIOS), Chipset: Intel Device 7aa7, Memory: 8 x 32 GB DDR5-4812MT/s Hynix HMCG88AEBRA115N, Disk: 6401GB Micron_9300_MTFDHAL6T4TDR + 4097GB Lexar SSD ARES 4TB + 0GB Virtual HDisk0, Graphics: llvmpipe (210/405MHz), Audio: Realtek ALC1220, Network: 2 x Intel X710 for 10GBASE-T
OS: Ubuntu 22.04, Kernel: 6.3.0-060300-generic (x86_64), Desktop: GNOME Shell 42.9, Display Server: X Server 1.21.1.4, Display Driver: NVIDIA 535.129.03, OpenGL: 4.5 Mesa 23.0.4-0ubuntu1~22.04.1 (LLVM 15.0.7 256 bits), OpenCL: OpenCL 3.0 CUDA 12.2.147, Vulkan: 1.3.242, Compiler: GCC 11.4.0 + CUDA 12.1, File-System: ext4, Screen Resolution: 1920x1200
CPU Peak Freq (Highest CPU Core Frequency) Monitor
Phoronix Test Suite System Monitoring
Megahertz
AVX512_CORE_AMX . MIN: 1900 AVG: 2523 MAX: 4355
AVX512_CORE ..... MIN: 1900 AVG: 2565 MAX: 4586
CPU Power Consumption Monitor
Phoronix Test Suite System Monitoring
Watts
AVX512_CORE_AMX . MIN: 54 AVG: 408 MAX: 507
AVX512_CORE ..... MIN: 48 AVG: 428 MAX: 643
CPU Temperature Monitor
Phoronix Test Suite System Monitoring
Celsius
AVX512_CORE_AMX . MIN: 36 AVG: 68 MAX: 78
AVX512_CORE ..... MIN: 36 AVG: 69 MAX: 85
OpenVINO 2023.2.dev
Model: Face Detection FP16 - Device: CPU
FPS > Higher Is Better
AVX512_CORE_AMX . 77.14 |======================================================
AVX512_CORE ..... 12.26 |=========
OpenVINO 2023.2.dev
Model: Face Detection FP16 - Device: CPU
ms < Lower Is Better
AVX512_CORE_AMX . 362.17 |========
AVX512_CORE ..... 2269.70 |====================================================
OpenVINO 2023.2.dev
CPU Peak Freq (Highest CPU Core Frequency) Monitor
Megahertz > Higher Is Better
AVX512_CORE_AMX . MIN: 1900 AVG: 2679 MAX: 4330
AVX512_CORE ..... MIN: 1900 AVG: 2661 MAX: 4300
OpenVINO 2023.2.dev
CPU Power Consumption Monitor
Watts < Lower Is Better
AVX512_CORE_AMX . MIN: 96 AVG: 408 MAX: 446
AVX512_CORE ..... MIN: 116 AVG: 408 MAX: 451
OpenVINO 2023.2.dev
CPU Temperature Monitor
Celsius < Lower Is Better
AVX512_CORE_AMX . MIN: 36.0 AVG: 65.9 MAX: 71.0
AVX512_CORE ..... MIN: 37.0 AVG: 65.8 MAX: 73.0
OpenVINO 2023.2.dev
Model: Face Detection FP16-INT8 - Device: CPU
FPS > Higher Is Better
AVX512_CORE_AMX . 165.65 |=====================================================
AVX512_CORE ..... 86.16 |============================
OpenVINO 2023.2.dev
Model: Face Detection FP16-INT8 - Device: CPU
ms < Lower Is Better
AVX512_CORE_AMX . 337.49 |=====================================================
AVX512_CORE ..... 324.21 |===================================================
OpenVINO 2023.2.dev
CPU Peak Freq (Highest CPU Core Frequency) Monitor
Megahertz > Higher Is Better
AVX512_CORE_AMX . MIN: 1900 AVG: 2668 MAX: 4305
AVX512_CORE ..... MIN: 1900 AVG: 2573 MAX: 4300
OpenVINO 2023.2.dev
CPU Power Consumption Monitor
Watts < Lower Is Better
AVX512_CORE_AMX . MIN: 113 AVG: 419 MAX: 460
AVX512_CORE ..... MIN: 107 AVG: 507 MAX: 613
OpenVINO 2023.2.dev
CPU Temperature Monitor
Celsius < Lower Is Better
AVX512_CORE_AMX . MIN: 42 AVG: 69 MAX: 74
AVX512_CORE ..... MIN: 44 AVG: 79 MAX: 84
OpenVINO 2023.2.dev
Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU
FPS > Higher Is Better
AVX512_CORE_AMX . 91906.18 |===================================================
AVX512_CORE ..... 36370.46 |====================
OpenVINO 2023.2.dev
Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU
ms < Lower Is Better
AVX512_CORE_AMX . 0.54 |=====================
AVX512_CORE ..... 1.40 |=======================================================
OpenVINO 2023.2.dev
CPU Peak Freq (Highest CPU Core Frequency) Monitor
Megahertz > Higher Is Better
AVX512_CORE_AMX . MIN: 1900 AVG: 2391 MAX: 4326
AVX512_CORE ..... MIN: 1900 AVG: 2537 MAX: 4258
OpenVINO 2023.2.dev
CPU Power Consumption Monitor
Watts < Lower Is Better
AVX512_CORE_AMX . MIN: 105 AVG: 409 MAX: 437
AVX512_CORE ..... MIN: 103 AVG: 432 MAX: 464
OpenVINO 2023.2.dev
CPU Temperature Monitor
Celsius < Lower Is Better
AVX512_CORE_AMX . MIN: 44.0 AVG: 67.5 MAX: 70.0
AVX512_CORE ..... MIN: 45.0 AVG: 69.4 MAX: 74.0
OpenVINO 2023.2.dev
Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU
FPS > Higher Is Better
AVX512_CORE_AMX . 108977.14 |==================================================
AVX512_CORE ..... 83670.38 |======================================
OpenVINO 2023.2.dev
Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU
ms < Lower Is Better
AVX512_CORE_AMX . 0.44 |==========================================
AVX512_CORE ..... 0.58 |=======================================================
OpenVINO 2023.2.dev
CPU Peak Freq (Highest CPU Core Frequency) Monitor
Megahertz > Higher Is Better
AVX512_CORE_AMX . MIN: 1900 AVG: 2375 MAX: 4300
AVX512_CORE ..... MIN: 1900 AVG: 2569 MAX: 4426
OpenVINO 2023.2.dev
CPU Power Consumption Monitor
Watts < Lower Is Better
AVX512_CORE_AMX . MIN: 100 AVG: 391 MAX: 418
AVX512_CORE ..... MIN: 57 AVG: 435 MAX: 466
OpenVINO 2023.2.dev
CPU Temperature Monitor
Celsius < Lower Is Better
AVX512_CORE_AMX . MIN: 41.0 AVG: 65.4 MAX: 70.0
AVX512_CORE ..... MIN: 44.0 AVG: 69.2 MAX: 73.0
OpenVINO 2023.2.dev
Model: Person Detection FP16 - Device: CPU
FPS > Higher Is Better
AVX512_CORE_AMX . 289.57 |=====================================================
AVX512_CORE ..... 131.41 |========================
OpenVINO 2023.2.dev
Model: Person Detection FP16 - Device: CPU
ms < Lower Is Better
AVX512_CORE_AMX . 96.62 |========================
AVX512_CORE ..... 212.82 |=====================================================
OpenVINO 2023.2.dev
CPU Peak Freq (Highest CPU Core Frequency) Monitor
Megahertz > Higher Is Better
AVX512_CORE_AMX . MIN: 1900 AVG: 2691 MAX: 4355
AVX512_CORE ..... MIN: 1900 AVG: 2664 MAX: 4385
OpenVINO 2023.2.dev
CPU Power Consumption Monitor
Watts < Lower Is Better
AVX512_CORE_AMX . MIN: 100 AVG: 432 MAX: 469
AVX512_CORE ..... MIN: 99 AVG: 424 MAX: 462
OpenVINO 2023.2.dev
CPU Temperature Monitor
Celsius < Lower Is Better
AVX512_CORE_AMX . MIN: 43.0 AVG: 69.0 MAX: 73.0
AVX512_CORE ..... MIN: 42.0 AVG: 67.7 MAX: 73.0
OpenVINO 2023.2.dev
Model: Person Detection FP32 - Device: CPU
FPS > Higher Is Better
AVX512_CORE_AMX . 289.89 |=====================================================
AVX512_CORE ..... 133.14 |========================
OpenVINO 2023.2.dev
Model: Person Detection FP32 - Device: CPU
ms < Lower Is Better
AVX512_CORE_AMX . 96.52 |========================
AVX512_CORE ..... 210.10 |=====================================================
OpenVINO 2023.2.dev
CPU Peak Freq (Highest CPU Core Frequency) Monitor
Megahertz > Higher Is Better
AVX512_CORE_AMX . MIN: 1900 AVG: 2682 MAX: 4200
AVX512_CORE ..... MIN: 1900 AVG: 2650 MAX: 4586
OpenVINO 2023.2.dev
CPU Power Consumption Monitor
Watts < Lower Is Better
AVX512_CORE_AMX . MIN: 59 AVG: 435 MAX: 475
AVX512_CORE ..... MIN: 103 AVG: 429 MAX: 466
OpenVINO 2023.2.dev
CPU Temperature Monitor
Celsius < Lower Is Better
AVX512_CORE_AMX . MIN: 43.0 AVG: 69.9 MAX: 75.0
AVX512_CORE ..... MIN: 46.0 AVG: 68.8 MAX: 72.0
OpenVINO 2023.2.dev
Model: Weld Porosity Detection FP16-INT8 - Device: CPU
FPS > Higher Is Better
AVX512_CORE_AMX . 17523.90 |===================================================
AVX512_CORE ..... 8530.81 |=========================
OpenVINO 2023.2.dev
Model: Weld Porosity Detection FP16-INT8 - Device: CPU
ms < Lower Is Better
AVX512_CORE_AMX . 3.18 |===========================
AVX512_CORE ..... 6.55 |=======================================================
OpenVINO 2023.2.dev
CPU Peak Freq (Highest CPU Core Frequency) Monitor
Megahertz > Higher Is Better
AVX512_CORE_AMX . MIN: 1900 AVG: 2301 MAX: 4198
AVX512_CORE ..... MIN: 1900 AVG: 2490 MAX: 3475
OpenVINO 2023.2.dev
CPU Power Consumption Monitor
Watts < Lower Is Better
AVX512_CORE_AMX . MIN: 100 AVG: 410 MAX: 442
AVX512_CORE ..... MIN: 121 AVG: 520 MAX: 643
OpenVINO 2023.2.dev
CPU Temperature Monitor
Celsius < Lower Is Better
AVX512_CORE_AMX . MIN: 44 AVG: 68 MAX: 71
AVX512_CORE ..... MIN: 44 AVG: 80 MAX: 85
OpenVINO 2023.2.dev
Model: Weld Porosity Detection FP16 - Device: CPU
FPS > Higher Is Better
AVX512_CORE_AMX . 9417.38 |====================================================
AVX512_CORE ..... 1273.78 |=======
OpenVINO 2023.2.dev
Model: Weld Porosity Detection FP16 - Device: CPU
ms < Lower Is Better
AVX512_CORE_AMX . 5.93 |=======
AVX512_CORE ..... 43.93 |======================================================
OpenVINO 2023.2.dev
CPU Peak Freq (Highest CPU Core Frequency) Monitor
Megahertz > Higher Is Better
AVX512_CORE_AMX . MIN: 1900 AVG: 2405 MAX: 4119
AVX512_CORE ..... MIN: 1900 AVG: 2520 MAX: 4200
OpenVINO 2023.2.dev
CPU Power Consumption Monitor
Watts < Lower Is Better
AVX512_CORE_AMX . MIN: 94 AVG: 405 MAX: 437
AVX512_CORE ..... MIN: 111 AVG: 437 MAX: 465
OpenVINO 2023.2.dev
CPU Temperature Monitor
Celsius < Lower Is Better
AVX512_CORE_AMX . MIN: 40.0 AVG: 67.6 MAX: 73.0
AVX512_CORE ..... MIN: 47.0 AVG: 71.0 MAX: 75.0
OpenVINO 2023.2.dev
Model: Vehicle Detection FP16-INT8 - Device: CPU
FPS > Higher Is Better
AVX512_CORE_AMX . 3234.97 |========================================
AVX512_CORE ..... 4193.97 |====================================================
OpenVINO 2023.2.dev
Model: Vehicle Detection FP16-INT8 - Device: CPU
ms < Lower Is Better
AVX512_CORE_AMX . 17.28 |======================================================
AVX512_CORE ..... 6.66 |=====================
OpenVINO 2023.2.dev
CPU Peak Freq (Highest CPU Core Frequency) Monitor
Megahertz > Higher Is Better
AVX512_CORE_AMX . MIN: 1900 AVG: 2501 MAX: 4200
AVX512_CORE ..... MIN: 1900 AVG: 2555 MAX: 2909
OpenVINO 2023.2.dev
CPU Power Consumption Monitor
Watts < Lower Is Better
AVX512_CORE_AMX . MIN: 94 AVG: 457 MAX: 500
AVX512_CORE ..... MIN: 114 AVG: 522 MAX: 605
OpenVINO 2023.2.dev
CPU Temperature Monitor
Celsius < Lower Is Better
AVX512_CORE_AMX . MIN: 42 AVG: 72 MAX: 76
AVX512_CORE ..... MIN: 42 AVG: 79 MAX: 84
OpenVINO 2023.2.dev
Model: Vehicle Detection FP16 - Device: CPU
FPS > Higher Is Better
AVX512_CORE_AMX . 1921.78 |====================================================
AVX512_CORE ..... 1077.28 |=============================
OpenVINO 2023.2.dev
Model: Vehicle Detection FP16 - Device: CPU
ms < Lower Is Better
AVX512_CORE_AMX . 14.54 |==============================
AVX512_CORE ..... 25.97 |======================================================
OpenVINO 2023.2.dev
CPU Peak Freq (Highest CPU Core Frequency) Monitor
Megahertz > Higher Is Better
AVX512_CORE_AMX . MIN: 1900 AVG: 2543 MAX: 3789
AVX512_CORE ..... MIN: 1900 AVG: 2562 MAX: 4171
OpenVINO 2023.2.dev
CPU Power Consumption Monitor
Watts < Lower Is Better
AVX512_CORE_AMX . MIN: 98 AVG: 455 MAX: 490
AVX512_CORE ..... MIN: 104 AVG: 460 MAX: 490
OpenVINO 2023.2.dev
CPU Temperature Monitor
Celsius < Lower Is Better
AVX512_CORE_AMX . MIN: 41 AVG: 72 MAX: 78
AVX512_CORE ..... MIN: 48 AVG: 73 MAX: 77
OpenVINO 2023.2.dev
Model: Person Vehicle Bike Detection FP16 - Device: CPU
FPS > Higher Is Better
AVX512_CORE_AMX . 3661.12 |====================================================
AVX512_CORE ..... 1591.03 |=======================
OpenVINO 2023.2.dev
Model: Person Vehicle Bike Detection FP16 - Device: CPU
ms < Lower Is Better
AVX512_CORE_AMX . 15.27 |===============================================
AVX512_CORE ..... 17.58 |======================================================
OpenVINO 2023.2.dev
CPU Peak Freq (Highest CPU Core Frequency) Monitor
Megahertz > Higher Is Better
AVX512_CORE_AMX . MIN: 1900 AVG: 2460 MAX: 4300
AVX512_CORE ..... MIN: 1900 AVG: 2600 MAX: 4363
OpenVINO 2023.2.dev
CPU Power Consumption Monitor
Watts < Lower Is Better
AVX512_CORE_AMX . MIN: 98 AVG: 436 MAX: 476
AVX512_CORE ..... MIN: 103 AVG: 410 MAX: 442
OpenVINO 2023.2.dev
CPU Temperature Monitor
Celsius < Lower Is Better
AVX512_CORE_AMX . MIN: 44.0 AVG: 70.7 MAX: 75.0
AVX512_CORE ..... MIN: 44.0 AVG: 66.5 MAX: 71.0
OpenVINO 2023.2.dev
Model: Machine Translation EN To DE FP16 - Device: CPU
FPS > Higher Is Better
OpenVINO 2023.2.dev
Model: Face Detection Retail FP16 - Device: CPU
FPS > Higher Is Better
AVX512_CORE_AMX . 6610.96 |====================================================
AVX512_CORE ..... 3153.69 |=========================
OpenVINO 2023.2.dev
Model: Face Detection Retail FP16 - Device: CPU
ms < Lower Is Better
AVX512_CORE_AMX . 8.45 |====================================================
AVX512_CORE ..... 8.87 |=======================================================
OpenVINO 2023.2.dev
CPU Peak Freq (Highest CPU Core Frequency) Monitor
Megahertz > Higher Is Better
AVX512_CORE_AMX . MIN: 1900 AVG: 2397 MAX: 3397
AVX512_CORE ..... MIN: 1900 AVG: 2488 MAX: 2901
OpenVINO 2023.2.dev
CPU Power Consumption Monitor
Watts < Lower Is Better
AVX512_CORE_AMX . MIN: 94 AVG: 452 MAX: 490
AVX512_CORE ..... MIN: 113 AVG: 433 MAX: 463
OpenVINO 2023.2.dev
CPU Temperature Monitor
Celsius < Lower Is Better
AVX512_CORE_AMX . MIN: 39 AVG: 71 MAX: 78
AVX512_CORE ..... MIN: 42 AVG: 69 MAX: 73
OpenVINO 2023.2.dev
Model: Face Detection Retail FP16-INT8 - Device: CPU
FPS > Higher Is Better
AVX512_CORE_AMX . 10083.57 |==============================================
AVX512_CORE ..... 11238.54 |===================================================
OpenVINO 2023.2.dev
Model: Face Detection Retail FP16-INT8 - Device: CPU
ms < Lower Is Better
AVX512_CORE_AMX . 5.54 |=======================================================
AVX512_CORE ..... 4.96 |=================================================
OpenVINO 2023.2.dev
CPU Peak Freq (Highest CPU Core Frequency) Monitor
Megahertz > Higher Is Better
AVX512_CORE_AMX . MIN: 1900 AVG: 2376 MAX: 3703
AVX512_CORE ..... MIN: 1900 AVG: 2754 MAX: 4298
OpenVINO 2023.2.dev
CPU Power Consumption Monitor
Watts < Lower Is Better
AVX512_CORE_AMX . MIN: 95 AVG: 440 MAX: 485
AVX512_CORE ..... MIN: 101 AVG: 494 MAX: 543
OpenVINO 2023.2.dev
CPU Temperature Monitor
Celsius < Lower Is Better
AVX512_CORE_AMX . MIN: 44 AVG: 71 MAX: 75
AVX512_CORE ..... MIN: 42 AVG: 76 MAX: 81
OpenVINO 2023.2.dev
Model: Handwritten English Recognition FP16 - Device: CPU
FPS > Higher Is Better
AVX512_CORE_AMX . 1597.47 |====================================================
AVX512_CORE ..... 844.59 |===========================
OpenVINO 2023.2.dev
Model: Handwritten English Recognition FP16 - Device: CPU
ms < Lower Is Better
AVX512_CORE_AMX . 35.03 |=============================
AVX512_CORE ..... 66.26 |======================================================
OpenVINO 2023.2.dev
CPU Peak Freq (Highest CPU Core Frequency) Monitor
Megahertz > Higher Is Better
AVX512_CORE_AMX . MIN: 1900 AVG: 2610 MAX: 4200
AVX512_CORE ..... MIN: 1900 AVG: 2522 MAX: 3189
OpenVINO 2023.2.dev
CPU Power Consumption Monitor
Watts < Lower Is Better
AVX512_CORE_AMX . MIN: 95 AVG: 427 MAX: 461
AVX512_CORE ..... MIN: 48 AVG: 428 MAX: 460
OpenVINO 2023.2.dev
CPU Temperature Monitor
Celsius < Lower Is Better
AVX512_CORE_AMX . MIN: 41.0 AVG: 69.6 MAX: 75.0
AVX512_CORE ..... MIN: 44.0 AVG: 68.1 MAX: 72.0
OpenVINO 2023.2.dev
Model: Handwritten English Recognition FP16-INT8 - Device: CPU
FPS > Higher Is Better
AVX512_CORE_AMX . 1244.36 |====================================================
AVX512_CORE ..... 886.14 |=====================================
OpenVINO 2023.2.dev
Model: Handwritten English Recognition FP16-INT8 - Device: CPU
ms < Lower Is Better
AVX512_CORE_AMX . 44.97 |======================================
AVX512_CORE ..... 63.15 |======================================================
OpenVINO 2023.2.dev
CPU Peak Freq (Highest CPU Core Frequency) Monitor
Megahertz > Higher Is Better
AVX512_CORE_AMX . MIN: 1900 AVG: 2743 MAX: 3382
AVX512_CORE ..... MIN: 1900 AVG: 2745 MAX: 2900
OpenVINO 2023.2.dev
CPU Power Consumption Monitor
Watts < Lower Is Better
AVX512_CORE_AMX . MIN: 96 AVG: 419 MAX: 451
AVX512_CORE ..... MIN: 96 AVG: 430 MAX: 466
OpenVINO 2023.2.dev
CPU Temperature Monitor
Celsius < Lower Is Better
AVX512_CORE_AMX . MIN: 44.0 AVG: 69.9 MAX: 74.0
AVX512_CORE ..... MIN: 40.0 AVG: 67.6 MAX: 73.0
OpenVINO 2023.2.dev
Model: Road Segmentation ADAS FP16 - Device: CPU
FPS > Higher Is Better
AVX512_CORE_AMX . 807.46 |=====================================================
AVX512_CORE ..... 540.69 |===================================
OpenVINO 2023.2.dev
Model: Road Segmentation ADAS FP16 - Device: CPU
ms < Lower Is Better
AVX512_CORE_AMX . 34.62 |====================================
AVX512_CORE ..... 51.73 |======================================================
OpenVINO 2023.2.dev
CPU Peak Freq (Highest CPU Core Frequency) Monitor
Megahertz > Higher Is Better
AVX512_CORE_AMX . MIN: 1900 AVG: 2694 MAX: 4232
AVX512_CORE ..... MIN: 1900 AVG: 2569 MAX: 4200
OpenVINO 2023.2.dev
CPU Power Consumption Monitor
Watts < Lower Is Better
AVX512_CORE_AMX . MIN: 94 AVG: 466 MAX: 507
AVX512_CORE ..... MIN: 96 AVG: 444 MAX: 478
OpenVINO 2023.2.dev
CPU Temperature Monitor
Celsius < Lower Is Better
AVX512_CORE_AMX . MIN: 41 AVG: 72 MAX: 78
AVX512_CORE ..... MIN: 42 AVG: 69 MAX: 73
OpenVINO 2023.2.dev
Model: Road Segmentation ADAS FP16-INT8 - Device: CPU
FPS > Higher Is Better
AVX512_CORE_AMX . 1129.41 |=================================================
AVX512_CORE ..... 1187.75 |====================================================
OpenVINO 2023.2.dev
Model: Road Segmentation ADAS FP16-INT8 - Device: CPU
ms < Lower Is Better
AVX512_CORE_AMX . 49.52 |======================================================
AVX512_CORE ..... 23.47 |==========================
OpenVINO 2023.2.dev
CPU Peak Freq (Highest CPU Core Frequency) Monitor
Megahertz > Higher Is Better
AVX512_CORE_AMX . MIN: 1900 AVG: 2670 MAX: 4300
AVX512_CORE ..... MIN: 1900 AVG: 2638 MAX: 4222
OpenVINO 2023.2.dev
CPU Power Consumption Monitor
Watts < Lower Is Better
AVX512_CORE_AMX . MIN: 98 AVG: 443 MAX: 481
AVX512_CORE ..... MIN: 98 AVG: 443 MAX: 480
OpenVINO 2023.2.dev
CPU Temperature Monitor
Celsius < Lower Is Better
AVX512_CORE_AMX . MIN: 45.0 AVG: 71.1 MAX: 75.0
AVX512_CORE ..... MIN: 39.0 AVG: 67.6 MAX: 71.0