Benchmarks by Michael Larabel for a future article.
Compare your own system(s) to this result file with the
Phoronix Test Suite by running the command:
phoronix-test-suite benchmark 2301160-NE-OPENVINOA07
OpenVINO AMX Benchmarks
Benchmarks by Michael Larabel for a future article.
,,"AVX512_CORE_AMX","AVX512_CORE_FP16","AVX512_CORE_BF16","AVX512_CORE_VNNI","AVX512_CORE"
Processor,,2 x Intel Xeon Platinum 8490H @ 3.50GHz (120 Cores / 240 Threads),2 x Intel Xeon Platinum 8490H @ 3.50GHz (120 Cores / 240 Threads),2 x Intel Xeon Platinum 8490H @ 3.50GHz (120 Cores / 240 Threads),2 x Intel Xeon Platinum 8490H @ 3.50GHz (120 Cores / 240 Threads),2 x Intel Xeon Platinum 8490H @ 3.50GHz (120 Cores / 240 Threads)
Motherboard,,Quanta Cloud S6Q-MB-MPS (3A10.uh BIOS),Quanta Cloud S6Q-MB-MPS (3A10.uh BIOS),Quanta Cloud S6Q-MB-MPS (3A10.uh BIOS),Quanta Cloud S6Q-MB-MPS (3A10.uh BIOS),Quanta Cloud S6Q-MB-MPS (3A10.uh BIOS)
Chipset,,Intel Device 1bce,Intel Device 1bce,Intel Device 1bce,Intel Device 1bce,Intel Device 1bce
Memory,,16 x 64 GB 4800MT/s Samsung M321R8GA0BB0-CQKEG,16 x 64 GB 4800MT/s Samsung M321R8GA0BB0-CQKEG,16 x 64 GB 4800MT/s Samsung M321R8GA0BB0-CQKEG,16 x 64 GB 4800MT/s Samsung M321R8GA0BB0-CQKEG,16 x 64 GB 4800MT/s Samsung M321R8GA0BB0-CQKEG
Disk,,2 x 1920GB SAMSUNG MZWLJ1T9HBJR-00007 + 960GB INTEL SSDSC2KG96,2 x 1920GB SAMSUNG MZWLJ1T9HBJR-00007 + 960GB INTEL SSDSC2KG96,2 x 1920GB SAMSUNG MZWLJ1T9HBJR-00007 + 960GB INTEL SSDSC2KG96,2 x 1920GB SAMSUNG MZWLJ1T9HBJR-00007 + 960GB INTEL SSDSC2KG96,2 x 1920GB SAMSUNG MZWLJ1T9HBJR-00007 + 960GB INTEL SSDSC2KG96
Graphics,,ASPEED,ASPEED,ASPEED,ASPEED,ASPEED
Monitor,,VGA HDMI,VGA HDMI,VGA HDMI,VGA HDMI,VGA HDMI
Network,,4 x Intel E810-C for QSFP + 2 x Intel X710 for 10GBASE-T,4 x Intel E810-C for QSFP + 2 x Intel X710 for 10GBASE-T,4 x Intel E810-C for QSFP + 2 x Intel X710 for 10GBASE-T,4 x Intel E810-C for QSFP + 2 x Intel X710 for 10GBASE-T,4 x Intel E810-C for QSFP + 2 x Intel X710 for 10GBASE-T
OS,,Ubuntu 22.04,Ubuntu 22.04,Ubuntu 22.04,Ubuntu 22.04,Ubuntu 22.04
Kernel,,6.1.4-060104-generic (x86_64),6.1.4-060104-generic (x86_64),6.1.4-060104-generic (x86_64),6.1.4-060104-generic (x86_64),6.1.4-060104-generic (x86_64)
Desktop,,GNOME Shell 42.2,GNOME Shell 42.2,GNOME Shell 42.2,GNOME Shell 42.2,GNOME Shell 42.2
Display Server,,X Server 1.21.1.3,X Server 1.21.1.3,X Server 1.21.1.3,X Server 1.21.1.3,X Server 1.21.1.3
Vulkan,,1.2.204,1.2.204,1.2.204,1.2.204,1.2.204
Compiler,,GCC 11.3.0 + Clang 14.0.0-1ubuntu1,GCC 11.3.0 + Clang 14.0.0-1ubuntu1,GCC 11.3.0 + Clang 14.0.0-1ubuntu1,GCC 11.3.0 + Clang 14.0.0-1ubuntu1,GCC 11.3.0 + Clang 14.0.0-1ubuntu1
File-System,,ext4,ext4,ext4,ext4,ext4
Screen Resolution,,1920x1080,1920x1080,1920x1080,1920x1080,1920x1080
,,"AVX512_CORE_AMX","AVX512_CORE_FP16","AVX512_CORE_BF16","AVX512_CORE_VNNI","AVX512_CORE"
"OpenVINO - Model: Face Detection FP16-INT8 - Device: CPU (ms)",LIB,424.16,409.81,409.84,409.95,942.79
"OpenVINO - Model: Face Detection FP16-INT8 - Device: CPU (FPS)",HIB,282.25,146.08,146.06,146.02,63.21
"OpenVINO - Model: Person Vehicle Bike Detection FP16 - Device: CPU (ms)",LIB,25.09,21.95,21.66,32.93,32.94
"OpenVINO - Model: Person Vehicle Bike Detection FP16 - Device: CPU (FPS)",HIB,4778.34,2730.07,2767.16,1821.09,1820.27
"OpenVINO - Model: Machine Translation EN To DE FP16 - Device: CPU (ms)",LIB,82.79,186.53,190.49,154.55,158.26
"OpenVINO - Model: Machine Translation EN To DE FP16 - Device: CPU (FPS)",HIB,724.10,321.28,314.61,387.62,378.72
"OpenVINO - Model: Weld Porosity Detection FP16-INT8 - Device: CPU (ms)",LIB,5.18,13.46,13.43,13.44,20.54
"OpenVINO - Model: Weld Porosity Detection FP16-INT8 - Device: CPU (FPS)",HIB,23066.63,8897.10,8918.62,8909.05,5835.39
"OpenVINO - CPU Temperature Monitor (Celsius)",LIB,51.54,52.63,52.6,52.4,52.43
"OpenVINO - CPU Power Consumption Monitor (Watts)",LIB,643.72,651.64,650.15,648.39,647.7
"OpenVINO - CPU Peak Freq (Highest CPU Core Frequency) Monitor (Megahertz)",HIB,2792.04,2655.76,2710.22,2567.8,2589.73
"OpenVINO - CPU Temperature Monitor (Celsius)",LIB,51.93,52.79,52.45,52,52.13
"OpenVINO - CPU Power Consumption Monitor (Watts)",LIB,640.04,652.74,651.7,655.01,654.84
"OpenVINO - CPU Peak Freq (Highest CPU Core Frequency) Monitor (Megahertz)",HIB,2965.43,2738.88,2754.72,2933.9,2909.83
"OpenVINO - CPU Temperature Monitor (Celsius)",LIB,52.24,55.23,54.65,54.82,54.91
"OpenVINO - CPU Power Consumption Monitor (Watts)",LIB,662.66,665.38,666.54,664.81,667.52
"OpenVINO - CPU Peak Freq (Highest CPU Core Frequency) Monitor (Megahertz)",HIB,2859.73,2927.6,2890.92,2903.46,2673.76
"OpenVINO - CPU Temperature Monitor (Celsius)",LIB,48,52.3,51.11,52.59,52.08
"OpenVINO - CPU Power Consumption Monitor (Watts)",LIB,615.59,641.18,640.52,639.72,643.37
"OpenVINO - CPU Peak Freq (Highest CPU Core Frequency) Monitor (Megahertz)",HIB,2561.26,2374.27,2400.97,2393.13,2649.4