Intel Xeon w9-3495X testing with a ASUS Pro WS W790E-SAGE SE (0705 BIOS) and llvmpipe on Ubuntu 22.04 via the Phoronix Test Suite.
Compare your own system(s) to this result file with the
Phoronix Test Suite by running the command:
phoronix-test-suite benchmark 2311114-NE-2311110NE81
openvino-1.4.0-amx
Intel Xeon w9-3495X testing with a ASUS Pro WS W790E-SAGE SE (0705 BIOS) and llvmpipe on Ubuntu 22.04 via the Phoronix Test Suite.
,,"AVX512_CORE_AMX","AVX512_CORE"
Processor,,Intel Xeon w9-3495X @ 4.80GHz (56 Cores / 112 Threads),Intel Xeon w9-3495X @ 4.80GHz (56 Cores / 112 Threads)
Motherboard,,ASUS Pro WS W790E-SAGE SE (0705 BIOS),ASUS Pro WS W790E-SAGE SE (0705 BIOS)
Chipset,,Intel Device 7aa7,Intel Device 7aa7
Memory,,8 x 32 GB DDR5-4812MT/s Hynix HMCG88AEBRA115N,8 x 32 GB DDR5-4812MT/s Hynix HMCG88AEBRA115N
Disk,,6401GB Micron_9300_MTFDHAL6T4TDR + 0GB Virtual HDisk0,6401GB Micron_9300_MTFDHAL6T4TDR + 4097GB Lexar SSD ARES 4TB + 0GB Virtual HDisk0
Graphics,,llvmpipe (210/405MHz),llvmpipe (210/405MHz)
Audio,,Realtek ALC1220,Realtek ALC1220
Network,,2 x Intel X710 for 10GBASE-T,2 x Intel X710 for 10GBASE-T
OS,,Ubuntu 22.04,Ubuntu 22.04
Kernel,,6.3.0-060300-generic (x86_64),6.3.0-060300-generic (x86_64)
Desktop,,GNOME Shell 42.9,GNOME Shell 42.9
Display Server,,X Server 1.21.1.4,X Server 1.21.1.4
Display Driver,,NVIDIA 535.129.03,NVIDIA 535.129.03
OpenGL,,4.5 Mesa 23.0.4-0ubuntu1~22.04.1 (LLVM 15.0.7 256 bits),4.5 Mesa 23.0.4-0ubuntu1~22.04.1 (LLVM 15.0.7 256 bits)
OpenCL,,OpenCL 3.0 CUDA 12.2.147,OpenCL 3.0 CUDA 12.2.147
Vulkan,,1.3.242,1.3.242
Compiler,,GCC 11.4.0 + CUDA 12.1,GCC 11.4.0 + CUDA 12.1
File-System,,ext4,ext4
Screen Resolution,,1920x1200,1920x1200
,,"AVX512_CORE_AMX","AVX512_CORE"
"CPU Temperature Monitor - Phoronix Test Suite System Monitoring (Celsius)",,68.03,69.48
"CPU Peak Freq (Highest CPU Core Frequency) Monitor - Phoronix Test Suite System Monitoring (Megahertz)",,2523.31,2564.64
"CPU Power Consumption Monitor - Phoronix Test Suite System Monitoring (Watts)",,407.76,428.13
"OpenVINO - Model: Face Detection FP16 - Device: CPU (FPS)",HIB,77.14,12.26
"OpenVINO - Model: Face Detection FP16-INT8 - Device: CPU (FPS)",HIB,165.65,86.16
"OpenVINO - Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU (FPS)",HIB,91906.18,36370.46
"OpenVINO - Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU (FPS)",HIB,108977.14,83670.38
"OpenVINO - Model: Person Detection FP16 - Device: CPU (FPS)",HIB,289.57,131.41
"OpenVINO - Model: Person Detection FP32 - Device: CPU (FPS)",HIB,289.89,133.14
"OpenVINO - Model: Weld Porosity Detection FP16-INT8 - Device: CPU (FPS)",HIB,17523.90,8530.81
"OpenVINO - Model: Weld Porosity Detection FP16 - Device: CPU (FPS)",HIB,9417.38,1273.78
"OpenVINO - Model: Vehicle Detection FP16-INT8 - Device: CPU (FPS)",HIB,3234.97,4193.97
"OpenVINO - Model: Vehicle Detection FP16 - Device: CPU (FPS)",HIB,1921.78,1077.28
"OpenVINO - Model: Person Vehicle Bike Detection FP16 - Device: CPU (FPS)",HIB,3661.12,1591.03
"OpenVINO - Model: Machine Translation EN To DE FP16 - Device: CPU (FPS)",HIB,,
"OpenVINO - Model: Face Detection Retail FP16 - Device: CPU (FPS)",HIB,6610.96,3153.69
"OpenVINO - Model: Face Detection Retail FP16-INT8 - Device: CPU (FPS)",HIB,10083.57,11238.54
"OpenVINO - Model: Handwritten English Recognition FP16 - Device: CPU (FPS)",HIB,1597.47,844.59
"OpenVINO - Model: Handwritten English Recognition FP16-INT8 - Device: CPU (FPS)",HIB,1244.36,886.14
"OpenVINO - Model: Road Segmentation ADAS FP16 - Device: CPU (FPS)",HIB,807.46,540.69
"OpenVINO - Model: Road Segmentation ADAS FP16-INT8 - Device: CPU (FPS)",HIB,1129.41,1187.75
"OpenVINO - CPU Peak Freq (Highest CPU Core Frequency) Monitor (Megahertz)",HIB,2678.87,2660.63
"OpenVINO - CPU Peak Freq (Highest CPU Core Frequency) Monitor (Megahertz)",HIB,2667.76,2572.51
"OpenVINO - CPU Peak Freq (Highest CPU Core Frequency) Monitor (Megahertz)",HIB,2391.24,2536.58
"OpenVINO - CPU Peak Freq (Highest CPU Core Frequency) Monitor (Megahertz)",HIB,2374.62,2569.26
"OpenVINO - CPU Peak Freq (Highest CPU Core Frequency) Monitor (Megahertz)",HIB,2691.14,2664.33
"OpenVINO - CPU Peak Freq (Highest CPU Core Frequency) Monitor (Megahertz)",HIB,2682.4,2650.01
"OpenVINO - CPU Peak Freq (Highest CPU Core Frequency) Monitor (Megahertz)",HIB,2300.52,2490.09
"OpenVINO - CPU Peak Freq (Highest CPU Core Frequency) Monitor (Megahertz)",HIB,2404.55,2519.58
"OpenVINO - CPU Peak Freq (Highest CPU Core Frequency) Monitor (Megahertz)",HIB,2500.83,2554.57
"OpenVINO - CPU Peak Freq (Highest CPU Core Frequency) Monitor (Megahertz)",HIB,2543.49,2562.31
"OpenVINO - CPU Peak Freq (Highest CPU Core Frequency) Monitor (Megahertz)",HIB,2459.97,2599.94
"OpenVINO - CPU Peak Freq (Highest CPU Core Frequency) Monitor (Megahertz)",HIB,2397.03,2488.03
"OpenVINO - CPU Peak Freq (Highest CPU Core Frequency) Monitor (Megahertz)",HIB,2376.14,2753.56
"OpenVINO - CPU Peak Freq (Highest CPU Core Frequency) Monitor (Megahertz)",HIB,2609.82,2522.47
"OpenVINO - CPU Peak Freq (Highest CPU Core Frequency) Monitor (Megahertz)",HIB,2743.22,2744.75
"OpenVINO - CPU Peak Freq (Highest CPU Core Frequency) Monitor (Megahertz)",HIB,2694.06,2569.13
"OpenVINO - CPU Peak Freq (Highest CPU Core Frequency) Monitor (Megahertz)",HIB,2669.65,2637.69
"OpenVINO - CPU Temperature Monitor (Celsius)",LIB,65.93,65.77
"OpenVINO - CPU Temperature Monitor (Celsius)",LIB,68.78,79.25
"OpenVINO - CPU Temperature Monitor (Celsius)",LIB,67.53,69.38
"OpenVINO - CPU Temperature Monitor (Celsius)",LIB,65.42,69.25
"OpenVINO - CPU Temperature Monitor (Celsius)",LIB,69,67.66
"OpenVINO - CPU Temperature Monitor (Celsius)",LIB,69.87,68.82
"OpenVINO - CPU Temperature Monitor (Celsius)",LIB,68.03,79.79
"OpenVINO - CPU Temperature Monitor (Celsius)",LIB,67.56,71.05
"OpenVINO - CPU Temperature Monitor (Celsius)",LIB,71.7,79.23
"OpenVINO - CPU Temperature Monitor (Celsius)",LIB,71.72,73.18
"OpenVINO - CPU Temperature Monitor (Celsius)",LIB,70.71,66.47
"OpenVINO - CPU Temperature Monitor (Celsius)",LIB,71.37,69.26
"OpenVINO - CPU Temperature Monitor (Celsius)",LIB,71.29,75.57
"OpenVINO - CPU Temperature Monitor (Celsius)",LIB,69.64,68.11
"OpenVINO - CPU Temperature Monitor (Celsius)",LIB,69.9,67.63
"OpenVINO - CPU Temperature Monitor (Celsius)",LIB,72.06,68.92
"OpenVINO - CPU Temperature Monitor (Celsius)",LIB,71.13,67.59
"OpenVINO - Model: Face Detection FP16 - Device: CPU (ms)",LIB,362.17,2269.70
"OpenVINO - Model: Face Detection FP16-INT8 - Device: CPU (ms)",LIB,337.49,324.21
"OpenVINO - Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU (ms)",LIB,0.54,1.4
"OpenVINO - Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU (ms)",LIB,0.44,0.58
"OpenVINO - Model: Person Detection FP16 - Device: CPU (ms)",LIB,96.62,212.82
"OpenVINO - Model: Person Detection FP32 - Device: CPU (ms)",LIB,96.52,210.10
"OpenVINO - Model: Weld Porosity Detection FP16-INT8 - Device: CPU (ms)",LIB,3.18,6.55
"OpenVINO - Model: Weld Porosity Detection FP16 - Device: CPU (ms)",LIB,5.93,43.93
"OpenVINO - Model: Vehicle Detection FP16-INT8 - Device: CPU (ms)",LIB,17.28,6.66
"OpenVINO - Model: Vehicle Detection FP16 - Device: CPU (ms)",LIB,14.54,25.97
"OpenVINO - Model: Person Vehicle Bike Detection FP16 - Device: CPU (ms)",LIB,15.27,17.58
"OpenVINO - Model: Face Detection Retail FP16 - Device: CPU (ms)",LIB,8.45,8.87
"OpenVINO - Model: Face Detection Retail FP16-INT8 - Device: CPU (ms)",LIB,5.54,4.96
"OpenVINO - Model: Handwritten English Recognition FP16 - Device: CPU (ms)",LIB,35.03,66.26
"OpenVINO - Model: Handwritten English Recognition FP16-INT8 - Device: CPU (ms)",LIB,44.97,63.15
"OpenVINO - Model: Road Segmentation ADAS FP16 - Device: CPU (ms)",LIB,34.62,51.73
"OpenVINO - Model: Road Segmentation ADAS FP16-INT8 - Device: CPU (ms)",LIB,49.52,23.47
"OpenVINO - CPU Power Consumption Monitor (Watts)",LIB,407.51,407.85
"OpenVINO - CPU Power Consumption Monitor (Watts)",LIB,419.09,506.85
"OpenVINO - CPU Power Consumption Monitor (Watts)",LIB,408.81,432.42
"OpenVINO - CPU Power Consumption Monitor (Watts)",LIB,390.55,435.49
"OpenVINO - CPU Power Consumption Monitor (Watts)",LIB,431.92,424.2
"OpenVINO - CPU Power Consumption Monitor (Watts)",LIB,434.69,429.08
"OpenVINO - CPU Power Consumption Monitor (Watts)",LIB,409.56,519.53
"OpenVINO - CPU Power Consumption Monitor (Watts)",LIB,405.34,436.88
"OpenVINO - CPU Power Consumption Monitor (Watts)",LIB,456.56,522.37
"OpenVINO - CPU Power Consumption Monitor (Watts)",LIB,454.59,460.3
"OpenVINO - CPU Power Consumption Monitor (Watts)",LIB,435.89,409.74
"OpenVINO - CPU Power Consumption Monitor (Watts)",LIB,451.69,433.06
"OpenVINO - CPU Power Consumption Monitor (Watts)",LIB,440.36,494.4
"OpenVINO - CPU Power Consumption Monitor (Watts)",LIB,426.63,428.05
"OpenVINO - CPU Power Consumption Monitor (Watts)",LIB,418.72,429.63
"OpenVINO - CPU Power Consumption Monitor (Watts)",LIB,465.63,444.33
"OpenVINO - CPU Power Consumption Monitor (Watts)",LIB,443.42,442.96