Intel Xeon w9-3495X testing with a ASUS Pro WS W790E-SAGE SE (0705 BIOS) and llvmpipe on Ubuntu 22.04 via the Phoronix Test Suite.
Compare your own system(s) to this result file with the
Phoronix Test Suite by running the command:
phoronix-test-suite benchmark 2311114-NE-2311110NE81
openvino-1.4.0-amx
Intel Xeon w9-3495X testing with a ASUS Pro WS W790E-SAGE SE (0705 BIOS) and llvmpipe on Ubuntu 22.04 via the Phoronix Test Suite.
,,"AVX512_CORE_AMX","AVX512_CORE"
Processor,,Intel Xeon w9-3495X @ 4.80GHz (56 Cores / 112 Threads),Intel Xeon w9-3495X @ 4.80GHz (56 Cores / 112 Threads)
Motherboard,,ASUS Pro WS W790E-SAGE SE (0705 BIOS),ASUS Pro WS W790E-SAGE SE (0705 BIOS)
Chipset,,Intel Device 7aa7,Intel Device 7aa7
Memory,,8 x 32 GB DDR5-4812MT/s Hynix HMCG88AEBRA115N,8 x 32 GB DDR5-4812MT/s Hynix HMCG88AEBRA115N
Disk,,6401GB Micron_9300_MTFDHAL6T4TDR + 0GB Virtual HDisk0,6401GB Micron_9300_MTFDHAL6T4TDR + 4097GB Lexar SSD ARES 4TB + 0GB Virtual HDisk0
Graphics,,llvmpipe (210/405MHz),llvmpipe (210/405MHz)
Audio,,Realtek ALC1220,Realtek ALC1220
Network,,2 x Intel X710 for 10GBASE-T,2 x Intel X710 for 10GBASE-T
OS,,Ubuntu 22.04,Ubuntu 22.04
Kernel,,6.3.0-060300-generic (x86_64),6.3.0-060300-generic (x86_64)
Desktop,,GNOME Shell 42.9,GNOME Shell 42.9
Display Server,,X Server 1.21.1.4,X Server 1.21.1.4
Display Driver,,NVIDIA 535.129.03,NVIDIA 535.129.03
OpenGL,,4.5 Mesa 23.0.4-0ubuntu1~22.04.1 (LLVM 15.0.7 256 bits),4.5 Mesa 23.0.4-0ubuntu1~22.04.1 (LLVM 15.0.7 256 bits)
OpenCL,,OpenCL 3.0 CUDA 12.2.147,OpenCL 3.0 CUDA 12.2.147
Vulkan,,1.3.242,1.3.242
Compiler,,GCC 11.4.0 + CUDA 12.1,GCC 11.4.0 + CUDA 12.1
File-System,,ext4,ext4
Screen Resolution,,1920x1200,1920x1200
,,"AVX512_CORE_AMX","AVX512_CORE"
"OpenVINO - Model: Weld Porosity Detection FP16 - Device: CPU (ms)",LIB,5.93,43.93
"OpenVINO - Model: Weld Porosity Detection FP16 - Device: CPU (FPS)",HIB,9417.38,1273.78
"OpenVINO - Model: Face Detection FP16 - Device: CPU (FPS)",HIB,77.14,12.26
"OpenVINO - Model: Face Detection FP16 - Device: CPU (ms)",LIB,362.17,2269.70
"OpenVINO - Model: Vehicle Detection FP16-INT8 - Device: CPU (ms)",LIB,17.28,6.66
"OpenVINO - Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU (ms)",LIB,0.54,1.4
"OpenVINO - Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU (FPS)",HIB,91906.18,36370.46
"OpenVINO - Model: Person Vehicle Bike Detection FP16 - Device: CPU (FPS)",HIB,3661.12,1591.03
"OpenVINO - Model: Person Detection FP16 - Device: CPU (FPS)",HIB,289.57,131.41
"OpenVINO - Model: Person Detection FP16 - Device: CPU (ms)",LIB,96.62,212.82
"OpenVINO - Model: Person Detection FP32 - Device: CPU (FPS)",HIB,289.89,133.14
"OpenVINO - Model: Person Detection FP32 - Device: CPU (ms)",LIB,96.52,210.10
"OpenVINO - Model: Road Segmentation ADAS FP16-INT8 - Device: CPU (ms)",LIB,49.52,23.47
"OpenVINO - Model: Face Detection Retail FP16 - Device: CPU (FPS)",HIB,6610.96,3153.69
"OpenVINO - Model: Weld Porosity Detection FP16-INT8 - Device: CPU (ms)",LIB,3.18,6.55
"OpenVINO - Model: Weld Porosity Detection FP16-INT8 - Device: CPU (FPS)",HIB,17523.90,8530.81
"OpenVINO - Model: Face Detection FP16-INT8 - Device: CPU (FPS)",HIB,165.65,86.16
"OpenVINO - Model: Handwritten English Recognition FP16 - Device: CPU (ms)",LIB,35.03,66.26
"OpenVINO - Model: Handwritten English Recognition FP16 - Device: CPU (FPS)",HIB,1597.47,844.59
"OpenVINO - Model: Vehicle Detection FP16 - Device: CPU (ms)",LIB,14.54,25.97
"OpenVINO - Model: Vehicle Detection FP16 - Device: CPU (FPS)",HIB,1921.78,1077.28
"OpenVINO - Model: Road Segmentation ADAS FP16 - Device: CPU (ms)",LIB,34.62,51.73
"OpenVINO - Model: Road Segmentation ADAS FP16 - Device: CPU (FPS)",HIB,807.46,540.69
"OpenVINO - Model: Handwritten English Recognition FP16-INT8 - Device: CPU (ms)",LIB,44.97,63.15
"OpenVINO - Model: Handwritten English Recognition FP16-INT8 - Device: CPU (FPS)",HIB,1244.36,886.14
"OpenVINO - Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU (ms)",LIB,0.44,0.58
"OpenVINO - Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU (FPS)",HIB,108977.14,83670.38
"OpenVINO - Model: Vehicle Detection FP16-INT8 - Device: CPU (FPS)",HIB,3234.97,4193.97
"OpenVINO - Model: Person Vehicle Bike Detection FP16 - Device: CPU (ms)",LIB,15.27,17.58
"OpenVINO - Model: Face Detection Retail FP16-INT8 - Device: CPU (ms)",LIB,5.54,4.96
"OpenVINO - Model: Face Detection Retail FP16-INT8 - Device: CPU (FPS)",HIB,10083.57,11238.54
"OpenVINO - Model: Road Segmentation ADAS FP16-INT8 - Device: CPU (FPS)",HIB,1129.41,1187.75
"OpenVINO - Model: Face Detection Retail FP16 - Device: CPU (ms)",LIB,8.45,8.87
"OpenVINO - Model: Face Detection FP16-INT8 - Device: CPU (ms)",LIB,337.49,324.21
"CPU Temperature Monitor - Phoronix Test Suite System Monitoring (Celsius)",,68.03,69.48
"CPU Power Consumption Monitor - Phoronix Test Suite System Monitoring (Watts)",,407.76,428.13
"CPU Peak Freq (Highest CPU Core Frequency) Monitor - Phoronix Test Suite System Monitoring (Megahertz)",,2523.31,2564.64
"OpenVINO - CPU Temperature Monitor (Celsius)",LIB,71.13,67.59
"OpenVINO - CPU Power Consumption Monitor (Watts)",LIB,443.42,442.96
"OpenVINO - CPU Peak Freq (Highest CPU Core Frequency) Monitor (Megahertz)",HIB,2669.65,2637.69
"OpenVINO - CPU Temperature Monitor (Celsius)",LIB,72.06,68.92
"OpenVINO - CPU Power Consumption Monitor (Watts)",LIB,465.63,444.33
"OpenVINO - CPU Peak Freq (Highest CPU Core Frequency) Monitor (Megahertz)",HIB,2694.06,2569.13
"OpenVINO - CPU Temperature Monitor (Celsius)",LIB,69.9,67.63
"OpenVINO - CPU Power Consumption Monitor (Watts)",LIB,418.72,429.63
"OpenVINO - CPU Peak Freq (Highest CPU Core Frequency) Monitor (Megahertz)",HIB,2743.22,2744.75
"OpenVINO - CPU Temperature Monitor (Celsius)",LIB,69.64,68.11
"OpenVINO - CPU Power Consumption Monitor (Watts)",LIB,426.63,428.05
"OpenVINO - CPU Peak Freq (Highest CPU Core Frequency) Monitor (Megahertz)",HIB,2609.82,2522.47
"OpenVINO - CPU Temperature Monitor (Celsius)",LIB,71.29,75.57
"OpenVINO - CPU Power Consumption Monitor (Watts)",LIB,440.36,494.4
"OpenVINO - CPU Peak Freq (Highest CPU Core Frequency) Monitor (Megahertz)",HIB,2376.14,2753.56
"OpenVINO - CPU Temperature Monitor (Celsius)",LIB,71.37,69.26
"OpenVINO - CPU Power Consumption Monitor (Watts)",LIB,451.69,433.06
"OpenVINO - CPU Peak Freq (Highest CPU Core Frequency) Monitor (Megahertz)",HIB,2397.03,2488.03
"OpenVINO - Model: Machine Translation EN To DE FP16 - Device: CPU (FPS)",HIB,,
"OpenVINO - CPU Temperature Monitor (Celsius)",LIB,70.71,66.47
"OpenVINO - CPU Power Consumption Monitor (Watts)",LIB,435.89,409.74
"OpenVINO - CPU Peak Freq (Highest CPU Core Frequency) Monitor (Megahertz)",HIB,2459.97,2599.94
"OpenVINO - CPU Temperature Monitor (Celsius)",LIB,71.72,73.18
"OpenVINO - CPU Power Consumption Monitor (Watts)",LIB,454.59,460.3
"OpenVINO - CPU Peak Freq (Highest CPU Core Frequency) Monitor (Megahertz)",HIB,2543.49,2562.31
"OpenVINO - CPU Temperature Monitor (Celsius)",LIB,71.7,79.23
"OpenVINO - CPU Power Consumption Monitor (Watts)",LIB,456.56,522.37
"OpenVINO - CPU Peak Freq (Highest CPU Core Frequency) Monitor (Megahertz)",HIB,2500.83,2554.57
"OpenVINO - CPU Temperature Monitor (Celsius)",LIB,67.56,71.05
"OpenVINO - CPU Power Consumption Monitor (Watts)",LIB,405.34,436.88
"OpenVINO - CPU Peak Freq (Highest CPU Core Frequency) Monitor (Megahertz)",HIB,2404.55,2519.58
"OpenVINO - CPU Temperature Monitor (Celsius)",LIB,68.03,79.79
"OpenVINO - CPU Power Consumption Monitor (Watts)",LIB,409.56,519.53
"OpenVINO - CPU Peak Freq (Highest CPU Core Frequency) Monitor (Megahertz)",HIB,2300.52,2490.09
"OpenVINO - CPU Temperature Monitor (Celsius)",LIB,69.87,68.82
"OpenVINO - CPU Power Consumption Monitor (Watts)",LIB,434.69,429.08
"OpenVINO - CPU Peak Freq (Highest CPU Core Frequency) Monitor (Megahertz)",HIB,2682.4,2650.01
"OpenVINO - CPU Temperature Monitor (Celsius)",LIB,69,67.66
"OpenVINO - CPU Power Consumption Monitor (Watts)",LIB,431.92,424.2
"OpenVINO - CPU Peak Freq (Highest CPU Core Frequency) Monitor (Megahertz)",HIB,2691.14,2664.33
"OpenVINO - CPU Temperature Monitor (Celsius)",LIB,65.42,69.25
"OpenVINO - CPU Power Consumption Monitor (Watts)",LIB,390.55,435.49
"OpenVINO - CPU Peak Freq (Highest CPU Core Frequency) Monitor (Megahertz)",HIB,2374.62,2569.26
"OpenVINO - CPU Temperature Monitor (Celsius)",LIB,67.53,69.38
"OpenVINO - CPU Power Consumption Monitor (Watts)",LIB,408.81,432.42
"OpenVINO - CPU Peak Freq (Highest CPU Core Frequency) Monitor (Megahertz)",HIB,2391.24,2536.58
"OpenVINO - CPU Temperature Monitor (Celsius)",LIB,68.78,79.25
"OpenVINO - CPU Power Consumption Monitor (Watts)",LIB,419.09,506.85
"OpenVINO - CPU Peak Freq (Highest CPU Core Frequency) Monitor (Megahertz)",HIB,2667.76,2572.51
"OpenVINO - CPU Temperature Monitor (Celsius)",LIB,65.93,65.77
"OpenVINO - CPU Power Consumption Monitor (Watts)",LIB,407.51,407.85
"OpenVINO - CPU Peak Freq (Highest CPU Core Frequency) Monitor (Megahertz)",HIB,2678.87,2660.63