Core i9-7980XE AVX512 Intel Xeon w9-3495X testing with a ASUS Pro WS W790E-SAGE SE (0705 BIOS) and NVIDIA GeForce RTX 4090 24GB on Ubuntu 23.10 via the Phoronix Test Suite. Core i9-7980XE AVX512: Processor: Intel Core i9-7980XE @ 4.40GHz (18 Cores / 36 Threads), Motherboard: Supermicro C9X299-RPGF v1.01 (2.5 BIOS), Chipset: Intel Sky Lake-E DMI3 Registers, Memory: 8 x 16 GB DDR4-2666MT/s Kingston, Disk: 2 x 1024GB Samsung SSD 970 PRO 1TB + 1600GB INTEL SSDPE2ME016T4, Graphics: llvmpipe (300/405MHz), Audio: NVIDIA TU102 HD Audio, Network: Aquantia AQC108 NBase-T/IEEE + Intel I210 OS: Ubuntu 22.04, Kernel: 6.2.0-36-generic (x86_64), Desktop: GNOME Shell 42.9, Display Server: X Server 1.21.1.3, Display Driver: NVIDIA 535.129.03, OpenGL: 4.5 Mesa 23.0.4-0ubuntu1~22.04.1 (LLVM 15.0.7 256 bits), Vulkan: 1.3.242, Compiler: GCC 11.4.0 + CUDA 12.1, File-System: ext4, Screen Resolution: 1920x1200 Xeon w9-3495X AVX512: Processor: Intel Xeon w9-3495X @ 4.80GHz (56 Cores / 112 Threads), Motherboard: ASUS Pro WS W790E-SAGE SE (0705 BIOS), Chipset: Intel Alder Lake-S PCH, Memory: 8 x 32 GB DDR5-4812MT/s Hynix HMCG88AEBRA115N, Disk: 1024GB SAMSUNG MZVL21T0HCLR-00BL2 + 0GB Virtual HDisk0, Graphics: NVIDIA GeForce RTX 4090 24GB, Audio: Realtek ALC1220, Network: 2 x Intel X710 for 10GBASE-T OS: Ubuntu 23.10, Kernel: 6.5.0-13-generic (x86_64), Desktop: GNOME Shell 45.1, Display Server: X Server 1.21.1.7, Display Driver: NVIDIA 535.129.03, OpenGL: 4.6.0, OpenCL: OpenCL 3.0 CUDA 12.2.147, Compiler: GCC 13.2.0 + CUDA 12.2, File-System: ext4, Screen Resolution: 1920x1200 Xeon w9-3495X AMX: Processor: Intel Xeon w9-3495X @ 4.80GHz (56 Cores / 112 Threads), Motherboard: ASUS Pro WS W790E-SAGE SE (0705 BIOS), Chipset: Intel Alder Lake-S PCH, Memory: 8 x 32 GB DDR5-4812MT/s Hynix HMCG88AEBRA115N, Disk: 1024GB SAMSUNG MZVL21T0HCLR-00BL2 + 0GB Virtual HDisk0, Graphics: NVIDIA GeForce RTX 4090 24GB, Audio: Realtek ALC1220, Network: 2 x Intel X710 for 10GBASE-T OS: Ubuntu 23.10, Kernel: 6.5.0-14-generic (x86_64), Desktop: GNOME Shell 45.1, Display Server: X Server 1.21.1.7, Display Driver: NVIDIA 535.129.03, OpenGL: 4.6.0, OpenCL: OpenCL 3.0 CUDA 12.2.147, Compiler: GCC 13.2.0 + CUDA 12.2, File-System: ext4, Screen Resolution: 1920x1200 CPU Temperature Monitor Phoronix Test Suite System Monitoring Celsius Core i9-7980XE AVX512 . MIN: 25.0 AVG: 37.0 MAX: 43.0 Xeon w9-3495X AVX512 .. MIN: 26.0 AVG: 47.0 MAX: 65.0 Xeon w9-3495X AMX ..... MIN: 19.0 AVG: 37.3 MAX: 44.0 CPU Peak Freq (Highest CPU Core Frequency) Monitor Phoronix Test Suite System Monitoring Megahertz Core i9-7980XE AVX512 . MIN: 1200 AVG: 2654 MAX: 4200 Xeon w9-3495X AVX512 .. MIN: 800 AVG: 2449 MAX: 4800 Xeon w9-3495X AMX ..... MIN: 800 AVG: 2358 MAX: 4800 CPU Power Consumption Monitor Phoronix Test Suite System Monitoring Watts Core i9-7980XE AVX512 . MIN: 13 AVG: 152 MAX: 213 Xeon w9-3495X AVX512 .. MIN: 84 AVG: 413 MAX: 621 Xeon w9-3495X AMX ..... MIN: 55 AVG: 377 MAX: 465 OpenVINO 2023.2.dev Model: Face Detection FP16 - Device: CPU FPS > Higher Is Better Core i9-7980XE AVX512 . 6.89 |==== Xeon w9-3495X AVX512 .. 12.32 |======== Xeon w9-3495X AMX ..... 77.54 |================================================ OpenVINO 2023.2.dev Model: Face Detection FP16-INT8 - Device: CPU FPS > Higher Is Better Core i9-7980XE AVX512 . 10.37 |=== Xeon w9-3495X AVX512 .. 94.98 |=========================== Xeon w9-3495X AMX ..... 166.20 |=============================================== OpenVINO 2023.2.dev Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU FPS > Higher Is Better Core i9-7980XE AVX512 . 16524.06 |======== Xeon w9-3495X AVX512 .. 36085.65 |================== Xeon w9-3495X AMX ..... 90854.42 |============================================= OpenVINO 2023.2.dev Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU FPS > Higher Is Better Core i9-7980XE AVX512 . 23185.57 |========= Xeon w9-3495X AVX512 .. 83679.68 |================================== Xeon w9-3495X AMX ..... 108111.82 |============================================ OpenVINO 2023.2.dev Model: Person Detection FP16 - Device: CPU FPS > Higher Is Better Core i9-7980XE AVX512 . 32.36 |===== Xeon w9-3495X AVX512 .. 131.16 |===================== Xeon w9-3495X AMX ..... 289.92 |=============================================== OpenVINO 2023.2.dev Model: Person Detection FP32 - Device: CPU FPS > Higher Is Better Core i9-7980XE AVX512 . 32.31 |===== Xeon w9-3495X AVX512 .. 131.00 |===================== Xeon w9-3495X AMX ..... 289.72 |=============================================== OpenVINO 2023.2.dev Model: Weld Porosity Detection FP16-INT8 - Device: CPU FPS > Higher Is Better Core i9-7980XE AVX512 . 1064.78 |=== Xeon w9-3495X AVX512 .. 9580.84 |======================== Xeon w9-3495X AMX ..... 17651.48 |============================================= OpenVINO 2023.2.dev Model: Weld Porosity Detection FP16 - Device: CPU FPS > Higher Is Better Core i9-7980XE AVX512 . 702.76 |=== Xeon w9-3495X AVX512 .. 1279.41 |====== Xeon w9-3495X AMX ..... 9514.63 |============================================== OpenVINO 2023.2.dev Model: Vehicle Detection FP16-INT8 - Device: CPU FPS > Higher Is Better Core i9-7980XE AVX512 . 694.27 |======= Xeon w9-3495X AVX512 .. 4441.34 |============================================== Xeon w9-3495X AMX ..... 3208.69 |================================= OpenVINO 2023.2.dev Model: Vehicle Detection FP16 - Device: CPU FPS > Higher Is Better Core i9-7980XE AVX512 . 179.13 |==== Xeon w9-3495X AVX512 .. 1075.48 |========================== Xeon w9-3495X AMX ..... 1913.48 |============================================== OpenVINO 2023.2.dev Model: Person Vehicle Bike Detection FP16 - Device: CPU FPS > Higher Is Better Core i9-7980XE AVX512 . 488.38 |====== Xeon w9-3495X AVX512 .. 1597.98 |==================== Xeon w9-3495X AMX ..... 3642.79 |============================================== OpenVINO 2023.2.dev Model: Machine Translation EN To DE FP16 - Device: CPU FPS > Higher Is Better Core i9-7980XE AVX512 . 76.63 |======== Xeon w9-3495X AVX512 .. 178.67 |================== Xeon w9-3495X AMX ..... 459.96 |=============================================== OpenVINO 2023.2.dev Model: Face Detection Retail FP16 - Device: CPU FPS > Higher Is Better Core i9-7980XE AVX512 . 1009.77 |======= Xeon w9-3495X AVX512 .. 3068.58 |====================== Xeon w9-3495X AMX ..... 6543.61 |============================================== OpenVINO 2023.2.dev Model: Face Detection Retail FP16-INT8 - Device: CPU FPS > Higher Is Better Core i9-7980XE AVX512 . 2062.08 |======== Xeon w9-3495X AVX512 .. 11300.44 |============================================= Xeon w9-3495X AMX ..... 10200.32 |========================================= OpenVINO 2023.2.dev Model: Handwritten English Recognition FP16 - Device: CPU FPS > Higher Is Better Core i9-7980XE AVX512 . 115.31 |=== Xeon w9-3495X AVX512 .. 861.67 |========================= Xeon w9-3495X AMX ..... 1596.75 |============================================== OpenVINO 2023.2.dev Model: Handwritten English Recognition FP16-INT8 - Device: CPU FPS > Higher Is Better Core i9-7980XE AVX512 . 125.54 |===== Xeon w9-3495X AVX512 .. 901.15 |================================= Xeon w9-3495X AMX ..... 1242.44 |============================================== OpenVINO 2023.2.dev Model: Road Segmentation ADAS FP16 - Device: CPU FPS > Higher Is Better Core i9-7980XE AVX512 . 72.01 |==== Xeon w9-3495X AVX512 .. 538.01 |================================ Xeon w9-3495X AMX ..... 779.80 |=============================================== OpenVINO 2023.2.dev Model: Road Segmentation ADAS FP16-INT8 - Device: CPU FPS > Higher Is Better Core i9-7980XE AVX512 . 277.86 |=========== Xeon w9-3495X AVX512 .. 1162.99 |============================================== Xeon w9-3495X AMX ..... 1095.12 |=========================================== OpenVINO 2023.2.dev CPU Peak Freq (Highest CPU Core Frequency) Monitor Megahertz > Higher Is Better Core i9-7980XE AVX512 . MIN: 1201 AVG: 2796 MAX: 3832 Xeon w9-3495X AVX512 .. MIN: 800 AVG: 2542 MAX: 4400 Xeon w9-3495X AMX ..... MIN: 800 AVG: 2575 MAX: 4800 OpenVINO 2023.2.dev CPU Peak Freq (Highest CPU Core Frequency) Monitor Megahertz > Higher Is Better Core i9-7980XE AVX512 . MIN: 1200 AVG: 2771 MAX: 3913 Xeon w9-3495X AVX512 .. MIN: 800 AVG: 2722 MAX: 4611 Xeon w9-3495X AMX ..... MIN: 800 AVG: 2598 MAX: 4800 OpenVINO 2023.2.dev CPU Peak Freq (Highest CPU Core Frequency) Monitor Megahertz > Higher Is Better Core i9-7980XE AVX512 . MIN: 1200 AVG: 2703 MAX: 3475 Xeon w9-3495X AVX512 .. MIN: 800 AVG: 2447 MAX: 3065 Xeon w9-3495X AMX ..... MIN: 800 AVG: 2320 MAX: 4336 OpenVINO 2023.2.dev CPU Peak Freq (Highest CPU Core Frequency) Monitor Megahertz > Higher Is Better Core i9-7980XE AVX512 . MIN: 1200 AVG: 2705 MAX: 3472 Xeon w9-3495X AVX512 .. MIN: 800 AVG: 2501 MAX: 4441 Xeon w9-3495X AMX ..... MIN: 800 AVG: 2326 MAX: 4426 OpenVINO 2023.2.dev CPU Peak Freq (Highest CPU Core Frequency) Monitor Megahertz > Higher Is Better Core i9-7980XE AVX512 . MIN: 1200 AVG: 2785 MAX: 3907 Xeon w9-3495X AVX512 .. MIN: 800 AVG: 2537 MAX: 4400 Xeon w9-3495X AMX ..... MIN: 800 AVG: 2591 MAX: 4400 OpenVINO 2023.2.dev CPU Peak Freq (Highest CPU Core Frequency) Monitor Megahertz > Higher Is Better Core i9-7980XE AVX512 . MIN: 1200 AVG: 2802 MAX: 3764 Xeon w9-3495X AVX512 .. MIN: 800 AVG: 2547 MAX: 4800 Xeon w9-3495X AMX ..... MIN: 800 AVG: 2604 MAX: 4419 OpenVINO 2023.2.dev CPU Peak Freq (Highest CPU Core Frequency) Monitor Megahertz > Higher Is Better Core i9-7980XE AVX512 . MIN: 1200 AVG: 2712 MAX: 3328 Xeon w9-3495X AVX512 .. MIN: 800 AVG: 2694 MAX: 4300 Xeon w9-3495X AMX ..... MIN: 800 AVG: 2198 MAX: 3714 OpenVINO 2023.2.dev CPU Peak Freq (Highest CPU Core Frequency) Monitor Megahertz > Higher Is Better Core i9-7980XE AVX512 . MIN: 1200 AVG: 2722 MAX: 3835 Xeon w9-3495X AVX512 .. MIN: 800 AVG: 2398 MAX: 2564 Xeon w9-3495X AMX ..... MIN: 800 AVG: 2247 MAX: 3326 OpenVINO 2023.2.dev CPU Peak Freq (Highest CPU Core Frequency) Monitor Megahertz > Higher Is Better Core i9-7980XE AVX512 . MIN: 1200 AVG: 2705 MAX: 3319 Xeon w9-3495X AVX512 .. MIN: 800 AVG: 2675 MAX: 3125 Xeon w9-3495X AMX ..... MIN: 800 AVG: 2391 MAX: 4300 OpenVINO 2023.2.dev CPU Peak Freq (Highest CPU Core Frequency) Monitor Megahertz > Higher Is Better Core i9-7980XE AVX512 . MIN: 1200 AVG: 2743 MAX: 3474 Xeon w9-3495X AVX512 .. MIN: 800 AVG: 2457 MAX: 3799 Xeon w9-3495X AMX ..... MIN: 800 AVG: 2464 MAX: 4300 OpenVINO 2023.2.dev CPU Peak Freq (Highest CPU Core Frequency) Monitor Megahertz > Higher Is Better Core i9-7980XE AVX512 . MIN: 1200 AVG: 2760 MAX: 3753 Xeon w9-3495X AVX512 .. MIN: 800 AVG: 2461 MAX: 3800 Xeon w9-3495X AMX ..... MIN: 800 AVG: 2345 MAX: 4400 OpenVINO 2023.2.dev CPU Peak Freq (Highest CPU Core Frequency) Monitor Megahertz > Higher Is Better Core i9-7980XE AVX512 . MIN: 1200 AVG: 2720 MAX: 4200 Xeon w9-3495X AVX512 .. MIN: 800 AVG: 2512 MAX: 4552 Xeon w9-3495X AMX ..... MIN: 800 AVG: 2483 MAX: 4313 OpenVINO 2023.2.dev CPU Peak Freq (Highest CPU Core Frequency) Monitor Megahertz > Higher Is Better Core i9-7980XE AVX512 . MIN: 1200 AVG: 2723 MAX: 3342 Xeon w9-3495X AVX512 .. MIN: 800 AVG: 2424 MAX: 2568 Xeon w9-3495X AMX ..... MIN: 800 AVG: 2332 MAX: 3408 OpenVINO 2023.2.dev CPU Peak Freq (Highest CPU Core Frequency) Monitor Megahertz > Higher Is Better Core i9-7980XE AVX512 . MIN: 1200 AVG: 2703 MAX: 3250 Xeon w9-3495X AVX512 .. MIN: 800 AVG: 2662 MAX: 4381 Xeon w9-3495X AMX ..... MIN: 800 AVG: 2237 MAX: 2559 OpenVINO 2023.2.dev CPU Peak Freq (Highest CPU Core Frequency) Monitor Megahertz > Higher Is Better Core i9-7980XE AVX512 . MIN: 1200 AVG: 2711 MAX: 3404 Xeon w9-3495X AVX512 .. MIN: 800 AVG: 2448 MAX: 4300 Xeon w9-3495X AMX ..... MIN: 800 AVG: 2513 MAX: 4588 OpenVINO 2023.2.dev CPU Peak Freq (Highest CPU Core Frequency) Monitor Megahertz > Higher Is Better Core i9-7980XE AVX512 . MIN: 1200 AVG: 2721 MAX: 3417 Xeon w9-3495X AVX512 .. MIN: 800 AVG: 2684 MAX: 3963 Xeon w9-3495X AMX ..... MIN: 800 AVG: 2669 MAX: 2955 OpenVINO 2023.2.dev CPU Peak Freq (Highest CPU Core Frequency) Monitor Megahertz > Higher Is Better Core i9-7980XE AVX512 . MIN: 1200 AVG: 2805 MAX: 3400 Xeon w9-3495X AVX512 .. MIN: 800 AVG: 2539 MAX: 4394 Xeon w9-3495X AMX ..... MIN: 800 AVG: 2650 MAX: 4300 OpenVINO 2023.2.dev CPU Peak Freq (Highest CPU Core Frequency) Monitor Megahertz > Higher Is Better Core i9-7980XE AVX512 . MIN: 1200 AVG: 2799 MAX: 3792 Xeon w9-3495X AVX512 .. MIN: 800 AVG: 2603 MAX: 4444 Xeon w9-3495X AMX ..... MIN: 800 AVG: 2606 MAX: 4395 OpenVINO 2023.2.dev CPU Temperature Monitor Celsius < Lower Is Better Core i9-7980XE AVX512 . MIN: 25.0 AVG: 39.0 MAX: 43.0 Xeon w9-3495X AVX512 .. MIN: 29.0 AVG: 47.3 MAX: 51.0 Xeon w9-3495X AMX ..... MIN: 20.0 AVG: 36.3 MAX: 40.0 OpenVINO 2023.2.dev CPU Temperature Monitor Celsius < Lower Is Better Core i9-7980XE AVX512 . MIN: 27.0 AVG: 37.6 MAX: 41.0 Xeon w9-3495X AVX512 .. MIN: 34.0 AVG: 60.3 MAX: 65.0 Xeon w9-3495X AMX ..... MIN: 22.0 AVG: 37.4 MAX: 40.0 OpenVINO 2023.2.dev CPU Temperature Monitor Celsius < Lower Is Better Core i9-7980XE AVX512 . MIN: 27.0 AVG: 39.0 MAX: 41.0 Xeon w9-3495X AVX512 .. MIN: 31.0 AVG: 45.7 MAX: 48.0 Xeon w9-3495X AMX ..... MIN: 23.0 AVG: 36.7 MAX: 39.0 OpenVINO 2023.2.dev CPU Temperature Monitor Celsius < Lower Is Better Core i9-7980XE AVX512 . MIN: 27.0 AVG: 38.0 MAX: 39.0 Xeon w9-3495X AVX512 .. MIN: 31.0 AVG: 48.6 MAX: 51.0 Xeon w9-3495X AMX ..... MIN: 23.0 AVG: 35.7 MAX: 38.0 OpenVINO 2023.2.dev CPU Temperature Monitor Celsius < Lower Is Better Core i9-7980XE AVX512 . MIN: 26.0 AVG: 35.5 MAX: 39.0 Xeon w9-3495X AVX512 .. MIN: 34.0 AVG: 49.2 MAX: 52.0 Xeon w9-3495X AMX ..... MIN: 23.0 AVG: 37.1 MAX: 40.0 OpenVINO 2023.2.dev CPU Temperature Monitor Celsius < Lower Is Better Core i9-7980XE AVX512 . MIN: 27.0 AVG: 35.7 MAX: 41.0 Xeon w9-3495X AVX512 .. MIN: 34.0 AVG: 48.5 MAX: 52.0 Xeon w9-3495X AMX ..... MIN: 23.0 AVG: 37.7 MAX: 40.0 OpenVINO 2023.2.dev CPU Temperature Monitor Celsius < Lower Is Better Core i9-7980XE AVX512 . MIN: 26.0 AVG: 38.1 MAX: 39.0 Xeon w9-3495X AVX512 .. MIN: 31.0 AVG: 59.2 MAX: 64.0 Xeon w9-3495X AMX ..... MIN: 24.0 AVG: 37.9 MAX: 40.0 OpenVINO 2023.2.dev CPU Temperature Monitor Celsius < Lower Is Better Core i9-7980XE AVX512 . MIN: 26.0 AVG: 39.8 MAX: 42.0 Xeon w9-3495X AVX512 .. MIN: 34.0 AVG: 50.2 MAX: 52.0 Xeon w9-3495X AMX ..... MIN: 23.0 AVG: 37.2 MAX: 40.0 OpenVINO 2023.2.dev CPU Temperature Monitor Celsius < Lower Is Better Core i9-7980XE AVX512 . MIN: 26.0 AVG: 37.9 MAX: 39.0 Xeon w9-3495X AVX512 .. MIN: 34.0 AVG: 59.0 MAX: 64.0 Xeon w9-3495X AMX ..... MIN: 23.0 AVG: 39.4 MAX: 42.0 OpenVINO 2023.2.dev CPU Temperature Monitor Celsius < Lower Is Better Core i9-7980XE AVX512 . MIN: 26.0 AVG: 34.6 MAX: 36.0 Xeon w9-3495X AVX512 .. MIN: 34.0 AVG: 49.7 MAX: 53.0 Xeon w9-3495X AMX ..... MIN: 24.0 AVG: 39.2 MAX: 42.0 OpenVINO 2023.2.dev CPU Temperature Monitor Celsius < Lower Is Better Core i9-7980XE AVX512 . MIN: 26.0 AVG: 36.6 MAX: 39.0 Xeon w9-3495X AVX512 .. MIN: 30.0 AVG: 42.9 MAX: 45.0 Xeon w9-3495X AMX ..... MIN: 24.0 AVG: 38.8 MAX: 44.0 OpenVINO 2023.2.dev CPU Temperature Monitor Celsius < Lower Is Better Core i9-7980XE AVX512 . MIN: 26.0 AVG: 37.8 MAX: 40.0 Xeon w9-3495X AVX512 .. MIN: 28.0 AVG: 44.1 MAX: 46.0 Xeon w9-3495X AMX ..... MIN: 24.0 AVG: 36.5 MAX: 39.0 OpenVINO 2023.2.dev CPU Temperature Monitor Celsius < Lower Is Better Core i9-7980XE AVX512 . MIN: 26.0 AVG: 36.9 MAX: 39.0 Xeon w9-3495X AVX512 .. MIN: 28.0 AVG: 42.2 MAX: 44.0 Xeon w9-3495X AMX ..... MIN: 24.0 AVG: 39.4 MAX: 42.0 OpenVINO 2023.2.dev CPU Temperature Monitor Celsius < Lower Is Better Core i9-7980XE AVX512 . MIN: 26.0 AVG: 38.8 MAX: 40.0 Xeon w9-3495X AVX512 .. MIN: 27.0 AVG: 46.5 MAX: 51.0 Xeon w9-3495X AMX ..... MIN: 24.0 AVG: 39.4 MAX: 42.0 OpenVINO 2023.2.dev CPU Temperature Monitor Celsius < Lower Is Better Core i9-7980XE AVX512 . MIN: 27.0 AVG: 36.9 MAX: 39.0 Xeon w9-3495X AVX512 .. MIN: 27.0 AVG: 42.0 MAX: 44.0 Xeon w9-3495X AMX ..... MIN: 24.0 AVG: 38.4 MAX: 41.0 OpenVINO 2023.2.dev CPU Temperature Monitor Celsius < Lower Is Better Core i9-7980XE AVX512 . MIN: 28.0 AVG: 37.4 MAX: 40.0 Xeon w9-3495X AVX512 .. MIN: 26.0 AVG: 42.5 MAX: 45.0 Xeon w9-3495X AMX ..... MIN: 24.0 AVG: 38.2 MAX: 40.0 OpenVINO 2023.2.dev CPU Temperature Monitor Celsius < Lower Is Better Core i9-7980XE AVX512 . MIN: 28.0 AVG: 36.4 MAX: 39.0 Xeon w9-3495X AVX512 .. MIN: 26.0 AVG: 42.2 MAX: 45.0 Xeon w9-3495X AMX ..... MIN: 24.0 AVG: 39.9 MAX: 42.0 OpenVINO 2023.2.dev CPU Temperature Monitor Celsius < Lower Is Better Core i9-7980XE AVX512 . MIN: 29.0 AVG: 40.5 MAX: 43.0 Xeon w9-3495X AVX512 .. MIN: 27.0 AVG: 43.1 MAX: 46.0 Xeon w9-3495X AMX ..... MIN: 24.0 AVG: 39.5 MAX: 42.0 OpenVINO 2023.2.dev Model: Face Detection FP16 - Device: CPU ms < Lower Is Better Core i9-7980XE AVX512 . 1728.04 |=================================== Xeon w9-3495X AVX512 .. 2265.71 |============================================== Xeon w9-3495X AMX ..... 360.30 |======= OpenVINO 2023.2.dev Model: Face Detection FP16-INT8 - Device: CPU ms < Lower Is Better Core i9-7980XE AVX512 . 1151.79 |============================================== Xeon w9-3495X AVX512 .. 294.22 |============ Xeon w9-3495X AMX ..... 336.18 |============= OpenVINO 2023.2.dev Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU ms < Lower Is Better Core i9-7980XE AVX512 . 1.07 |===================================== Xeon w9-3495X AVX512 .. 1.41 |================================================= Xeon w9-3495X AMX ..... 0.54 |=================== OpenVINO 2023.2.dev Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU ms < Lower Is Better Core i9-7980XE AVX512 . 0.75 |================================================= Xeon w9-3495X AVX512 .. 0.58 |====================================== Xeon w9-3495X AMX ..... 0.44 |============================= OpenVINO 2023.2.dev Model: Person Detection FP16 - Device: CPU ms < Lower Is Better Core i9-7980XE AVX512 . 370.26 |=============================================== Xeon w9-3495X AVX512 .. 213.32 |=========================== Xeon w9-3495X AMX ..... 96.50 |============ OpenVINO 2023.2.dev Model: Person Detection FP32 - Device: CPU ms < Lower Is Better Core i9-7980XE AVX512 . 370.83 |=============================================== Xeon w9-3495X AVX512 .. 213.61 |=========================== Xeon w9-3495X AMX ..... 96.56 |============ OpenVINO 2023.2.dev Model: Weld Porosity Detection FP16-INT8 - Device: CPU ms < Lower Is Better Core i9-7980XE AVX512 . 16.89 |================================================ Xeon w9-3495X AVX512 .. 5.84 |================= Xeon w9-3495X AMX ..... 3.16 |========= OpenVINO 2023.2.dev Model: Weld Porosity Detection FP16 - Device: CPU ms < Lower Is Better Core i9-7980XE AVX512 . 25.58 |============================ Xeon w9-3495X AVX512 .. 43.75 |================================================ Xeon w9-3495X AMX ..... 5.87 |====== OpenVINO 2023.2.dev Model: Vehicle Detection FP16-INT8 - Device: CPU ms < Lower Is Better Core i9-7980XE AVX512 . 17.26 |================================================ Xeon w9-3495X AVX512 .. 6.29 |================= Xeon w9-3495X AMX ..... 17.43 |================================================ OpenVINO 2023.2.dev Model: Vehicle Detection FP16 - Device: CPU ms < Lower Is Better Core i9-7980XE AVX512 . 66.92 |================================================ Xeon w9-3495X AVX512 .. 26.01 |=================== Xeon w9-3495X AMX ..... 14.59 |========== OpenVINO 2023.2.dev Model: Person Vehicle Bike Detection FP16 - Device: CPU ms < Lower Is Better Core i9-7980XE AVX512 . 24.54 |================================================ Xeon w9-3495X AVX512 .. 17.51 |================================== Xeon w9-3495X AMX ..... 15.34 |============================== OpenVINO 2023.2.dev Model: Machine Translation EN To DE FP16 - Device: CPU ms < Lower Is Better Core i9-7980XE AVX512 . 156.42 |=============================================== Xeon w9-3495X AVX512 .. 156.55 |=============================================== Xeon w9-3495X AMX ..... 60.65 |================== OpenVINO 2023.2.dev Model: Face Detection Retail FP16 - Device: CPU ms < Lower Is Better Core i9-7980XE AVX512 . 11.85 |================================================ Xeon w9-3495X AVX512 .. 9.11 |===================================== Xeon w9-3495X AMX ..... 8.54 |=================================== OpenVINO 2023.2.dev Model: Face Detection Retail FP16-INT8 - Device: CPU ms < Lower Is Better Core i9-7980XE AVX512 . 8.71 |================================================= Xeon w9-3495X AVX512 .. 4.93 |============================ Xeon w9-3495X AMX ..... 5.48 |=============================== OpenVINO 2023.2.dev Model: Handwritten English Recognition FP16 - Device: CPU ms < Lower Is Better Core i9-7980XE AVX512 . 155.97 |=============================================== Xeon w9-3495X AVX512 .. 64.94 |==================== Xeon w9-3495X AMX ..... 35.05 |=========== OpenVINO 2023.2.dev Model: Handwritten English Recognition FP16-INT8 - Device: CPU ms < Lower Is Better Core i9-7980XE AVX512 . 143.25 |=============================================== Xeon w9-3495X AVX512 .. 62.11 |==================== Xeon w9-3495X AMX ..... 45.04 |=============== OpenVINO 2023.2.dev Model: Road Segmentation ADAS FP16 - Device: CPU ms < Lower Is Better Core i9-7980XE AVX512 . 166.50 |=============================================== Xeon w9-3495X AVX512 .. 51.97 |=============== Xeon w9-3495X AMX ..... 35.84 |========== OpenVINO 2023.2.dev Model: Road Segmentation ADAS FP16-INT8 - Device: CPU ms < Lower Is Better Core i9-7980XE AVX512 . 43.15 |========================================= Xeon w9-3495X AVX512 .. 23.97 |======================= Xeon w9-3495X AMX ..... 51.06 |================================================ OpenVINO 2023.2.dev CPU Power Consumption Monitor Watts < Lower Is Better Core i9-7980XE AVX512 . MIN: 25 AVG: 186 MAX: 213 Xeon w9-3495X AVX512 .. MIN: 86 AVG: 388 MAX: 429 Xeon w9-3495X AMX ..... MIN: 85 AVG: 384 MAX: 418 OpenVINO 2023.2.dev CPU Power Consumption Monitor Watts < Lower Is Better Core i9-7980XE AVX512 . MIN: 25 AVG: 157 MAX: 175 Xeon w9-3495X AVX512 .. MIN: 86 AVG: 541 MAX: 596 Xeon w9-3495X AMX ..... MIN: 84 AVG: 389 MAX: 428 OpenVINO 2023.2.dev CPU Power Consumption Monitor Watts < Lower Is Better Core i9-7980XE AVX512 . MIN: 25 AVG: 177 MAX: 191 Xeon w9-3495X AVX512 .. MIN: 85 AVG: 405 MAX: 437 Xeon w9-3495X AMX ..... MIN: 84 AVG: 379 MAX: 408 OpenVINO 2023.2.dev CPU Power Consumption Monitor Watts < Lower Is Better Core i9-7980XE AVX512 . MIN: 25 AVG: 160 MAX: 172 Xeon w9-3495X AVX512 .. MIN: 84 AVG: 411 MAX: 443 Xeon w9-3495X AMX ..... MIN: 85 AVG: 364 MAX: 392 OpenVINO 2023.2.dev CPU Power Consumption Monitor Watts < Lower Is Better Core i9-7980XE AVX512 . MIN: 25 AVG: 139 MAX: 152 Xeon w9-3495X AVX512 .. MIN: 86 AVG: 401 MAX: 433 Xeon w9-3495X AMX ..... MIN: 84 AVG: 395 MAX: 432 OpenVINO 2023.2.dev CPU Power Consumption Monitor Watts < Lower Is Better Core i9-7980XE AVX512 . MIN: 25 AVG: 141 MAX: 155 Xeon w9-3495X AVX512 .. MIN: 86 AVG: 399 MAX: 433 Xeon w9-3495X AMX ..... MIN: 85 AVG: 396 MAX: 434 OpenVINO 2023.2.dev CPU Power Consumption Monitor Watts < Lower Is Better Core i9-7980XE AVX512 . MIN: 25 AVG: 162 MAX: 175 Xeon w9-3495X AVX512 .. MIN: 85 AVG: 572 MAX: 621 Xeon w9-3495X AMX ..... MIN: 82 AVG: 386 MAX: 416 OpenVINO 2023.2.dev CPU Power Consumption Monitor Watts < Lower Is Better Core i9-7980XE AVX512 . MIN: 25 AVG: 195 MAX: 210 Xeon w9-3495X AVX512 .. MIN: 86 AVG: 412 MAX: 442 Xeon w9-3495X AMX ..... MIN: 84 AVG: 373 MAX: 404 OpenVINO 2023.2.dev CPU Power Consumption Monitor Watts < Lower Is Better Core i9-7980XE AVX512 . MIN: 25 AVG: 166 MAX: 180 Xeon w9-3495X AVX512 .. MIN: 85 AVG: 529 MAX: 584 Xeon w9-3495X AMX ..... MIN: 83 AVG: 419 MAX: 459 OpenVINO 2023.2.dev CPU Power Consumption Monitor Watts < Lower Is Better Core i9-7980XE AVX512 . MIN: 25 AVG: 135 MAX: 144 Xeon w9-3495X AVX512 .. MIN: 86 AVG: 429 MAX: 461 Xeon w9-3495X AMX ..... MIN: 84 AVG: 417 MAX: 451 OpenVINO 2023.2.dev CPU Power Consumption Monitor Watts < Lower Is Better Core i9-7980XE AVX512 . MIN: 25 AVG: 154 MAX: 168 Xeon w9-3495X AVX512 .. MIN: 85 AVG: 386 MAX: 421 Xeon w9-3495X AMX ..... MIN: 83 AVG: 405 MAX: 442 OpenVINO 2023.2.dev CPU Power Consumption Monitor Watts < Lower Is Better Core i9-7980XE AVX512 . MIN: 17 AVG: 177 MAX: 195 Xeon w9-3495X AVX512 .. MIN: 86 AVG: 416 MAX: 453 Xeon w9-3495X AMX ..... MIN: 83 AVG: 366 MAX: 405 OpenVINO 2023.2.dev CPU Power Consumption Monitor Watts < Lower Is Better Core i9-7980XE AVX512 . MIN: 25 AVG: 161 MAX: 174 Xeon w9-3495X AVX512 .. MIN: 84 AVG: 400 MAX: 432 Xeon w9-3495X AMX ..... MIN: 84 AVG: 418 MAX: 451 OpenVINO 2023.2.dev CPU Power Consumption Monitor Watts < Lower Is Better Core i9-7980XE AVX512 . MIN: 25 AVG: 163 MAX: 176 Xeon w9-3495X AVX512 .. MIN: 85 AVG: 462 MAX: 504 Xeon w9-3495X AMX ..... MIN: 83 AVG: 411 MAX: 453 OpenVINO 2023.2.dev CPU Power Consumption Monitor Watts < Lower Is Better Core i9-7980XE AVX512 . MIN: 25 AVG: 155 MAX: 168 Xeon w9-3495X AVX512 .. MIN: 84 AVG: 409 MAX: 439 Xeon w9-3495X AMX ..... MIN: 85 AVG: 394 MAX: 422 OpenVINO 2023.2.dev CPU Power Consumption Monitor Watts < Lower Is Better Core i9-7980XE AVX512 . MIN: 25 AVG: 154 MAX: 167 Xeon w9-3495X AVX512 .. MIN: 85 AVG: 411 MAX: 443 Xeon w9-3495X AMX ..... MIN: 83 AVG: 386 MAX: 416 OpenVINO 2023.2.dev CPU Power Consumption Monitor Watts < Lower Is Better Core i9-7980XE AVX512 . MIN: 25 AVG: 128 MAX: 138 Xeon w9-3495X AVX512 .. MIN: 85 AVG: 417 MAX: 452 Xeon w9-3495X AMX ..... MIN: 82 AVG: 426 MAX: 465 OpenVINO 2023.2.dev CPU Power Consumption Monitor Watts < Lower Is Better Core i9-7980XE AVX512 . MIN: 25 AVG: 164 MAX: 178 Xeon w9-3495X AVX512 .. MIN: 86 AVG: 422 MAX: 457 Xeon w9-3495X AMX ..... MIN: 82 AVG: 411 MAX: 445