Benchmarks by Michael Larabel for a future article.
Compare your own system(s) to this result file with the
Phoronix Test Suite by running the command:
phoronix-test-suite benchmark 2301166-NE-OPENVINOA64
OpenVINO AMX Benchmarks AMD EPYC Genoa
Benchmarks by Michael Larabel for a future article.
,,"Xeon Platinum 8490H 2P","Xeon Platinum 8490H 2P - No AMX","EPYC 9654 2P"
Processor,,2 x Intel Xeon Platinum 8490H @ 3.50GHz (120 Cores / 240 Threads),2 x Intel Xeon Platinum 8490H @ 3.50GHz (120 Cores / 240 Threads),2 x AMD EPYC 9654 96-Core @ 2.40GHz (192 Cores / 384 Threads)
Motherboard,,Quanta Cloud S6Q-MB-MPS (3A10.uh BIOS),Quanta Cloud S6Q-MB-MPS (3A10.uh BIOS),AMD Titanite_4G (RTI1002E BIOS)
Chipset,,Intel Device 1bce,Intel Device 1bce,AMD Device 14a4
Memory,,16 x 64 GB 4800MT/s Samsung M321R8GA0BB0-CQKEG,16 x 64 GB 4800MT/s Samsung M321R8GA0BB0-CQKEG,24 x 64 GB 4800MT/s Samsung M321R8GA0BB0-CQKEG
Disk,,2 x 1920GB SAMSUNG MZWLJ1T9HBJR-00007 + 960GB INTEL SSDSC2KG96,2 x 1920GB SAMSUNG MZWLJ1T9HBJR-00007 + 960GB INTEL SSDSC2KG96,2 x 1920GB SAMSUNG MZWLJ1T9HBJR-00007
Graphics,,ASPEED,ASPEED,ASPEED
Monitor,,VGA HDMI,VGA HDMI,VGA HDMI
Network,,4 x Intel E810-C for QSFP + 2 x Intel X710 for 10GBASE-T,4 x Intel E810-C for QSFP + 2 x Intel X710 for 10GBASE-T,Broadcom NetXtreme BCM5720 PCIe
OS,,Ubuntu 22.04,Ubuntu 22.04,Ubuntu 22.04
Kernel,,6.1.4-060104-generic (x86_64),6.1.4-060104-generic (x86_64),6.1.4-060104-generic (x86_64)
Desktop,,GNOME Shell 42.2,GNOME Shell 42.2,GNOME Shell 42.2
Display Server,,X Server 1.21.1.3,X Server 1.21.1.3,X Server 1.21.1.3
Vulkan,,1.2.204,1.2.204,1.2.204
Compiler,,GCC 11.3.0 + Clang 14.0.0-1ubuntu1,GCC 11.3.0 + Clang 14.0.0-1ubuntu1,GCC 11.3.0 + Clang 14.0.0-1ubuntu1
File-System,,ext4,ext4,ext4
Screen Resolution,,1920x1080,1920x1080,1920x1080
,,"Xeon Platinum 8490H 2P","Xeon Platinum 8490H 2P - No AMX","EPYC 9654 2P"
"OpenVINO - Model: Face Detection FP16-INT8 - Device: CPU (FPS)",HIB,282.25,146.08,188.64
"OpenVINO - Model: Face Detection FP16-INT8 - Device: CPU (ms)",LIB,424.16,409.81,507.25
"OpenVINO - Model: Weld Porosity Detection FP16-INT8 - Device: CPU (FPS)",HIB,23066.63,8897.10,18678.16
"OpenVINO - Model: Weld Porosity Detection FP16-INT8 - Device: CPU (ms)",LIB,5.18,13.46,10.26
"OpenVINO - Model: Person Vehicle Bike Detection FP16 - Device: CPU (FPS)",HIB,4778.34,2730.07,5320.83
"OpenVINO - Model: Person Vehicle Bike Detection FP16 - Device: CPU (ms)",LIB,25.09,21.95,18.03
"OpenVINO - Model: Machine Translation EN To DE FP16 - Device: CPU (FPS)",HIB,724.10,321.28,989.16
"OpenVINO - Model: Machine Translation EN To DE FP16 - Device: CPU (ms)",LIB,82.79,186.53,97.00
"OpenVINO - CPU Peak Freq (Highest CPU Core Frequency) Monitor (Megahertz)",HIB,2561.26,2374.27,2989.63
"OpenVINO - CPU Power Consumption Monitor (Watts)",LIB,615.59,641.18,601.82
"OpenVINO - CPU Peak Freq (Highest CPU Core Frequency) Monitor (Megahertz)",HIB,2859.73,2927.6,2808.9
"OpenVINO - CPU Power Consumption Monitor (Watts)",LIB,662.66,665.38,651.68
"OpenVINO - CPU Peak Freq (Highest CPU Core Frequency) Monitor (Megahertz)",HIB,2965.43,2738.88,3493.3
"OpenVINO - CPU Power Consumption Monitor (Watts)",LIB,640.04,652.74,566.67
"OpenVINO - CPU Peak Freq (Highest CPU Core Frequency) Monitor (Megahertz)",HIB,2792.04,2655.76,2964.78
"OpenVINO - CPU Power Consumption Monitor (Watts)",LIB,643.72,651.64,649.89
"CPU Peak Freq (Highest CPU Core Frequency) Monitor - Phoronix Test Suite System Monitoring (Megahertz)",,2744.33,2603.67,3129.46
"CPU Power Consumption Monitor - Phoronix Test Suite System Monitoring (Watts)",,624.35,646.09,596.25