Benchmarks by Michael Larabel for a future article.
Compare your own system(s) to this result file with the
Phoronix Test Suite by running the command:
phoronix-test-suite benchmark 2301166-NE-OPENVINOA64
OpenVINO AMX Benchmarks AMD EPYC Genoa,
"OpenVINO 2022.3 - Model: Machine Translation EN To DE FP16 - Device: CPU",
Higher Results Are Better
"Xeon Platinum 8490H 2P",726.7,731.53,714.06
"Xeon Platinum 8490H 2P - No AMX",321.21,319.99,322.65
"EPYC 9654 2P",1036.83,985.45,991.32,957.09,976.1,976.9,995.64,993.91
"OpenVINO 2022.3 - Model: Weld Porosity Detection FP16-INT8 - Device: CPU",
Lower Results Are Better
"Xeon Platinum 8490H 2P",5.15,5.17,5.22
"Xeon Platinum 8490H 2P - No AMX",13.39,13.51,13.49
"EPYC 9654 2P",10.27,10.25,10.26
"OpenVINO 2022.3 - Model: Weld Porosity Detection FP16-INT8 - Device: CPU",
Higher Results Are Better
"Xeon Platinum 8490H 2P",23199.14,23111.69,22889.05
"Xeon Platinum 8490H 2P - No AMX",8945.56,8866.78,8878.97
"EPYC 9654 2P",18657.78,18694.73,18681.97
"OpenVINO 2022.3 - Model: Machine Translation EN To DE FP16 - Device: CPU",
Lower Results Are Better
"Xeon Platinum 8490H 2P",82.52,81.91,83.94
"Xeon Platinum 8490H 2P - No AMX",186.56,187.3,185.74
"EPYC 9654 2P",92.5,97.33,96.73,100.2,98.26,98.19,96.32,96.48
"OpenVINO 2022.3 - Model: Person Vehicle Bike Detection FP16 - Device: CPU",
Higher Results Are Better
"Xeon Platinum 8490H 2P",4805.85,4773.35,4755.83
"Xeon Platinum 8490H 2P - No AMX",2750.42,2727.87,2711.92
"EPYC 9654 2P",5349.19,5122.15,5414.96,5189.37,5490.38,5282.64,5436.08,5281.83
"OpenVINO 2022.3 - Model: Face Detection FP16-INT8 - Device: CPU",
Higher Results Are Better
"Xeon Platinum 8490H 2P",279.92,279.46,287.36
"Xeon Platinum 8490H 2P - No AMX",145.5,146.35,146.38
"EPYC 9654 2P",188.33,188.67,188.91
"OpenVINO 2022.3 - Model: Person Vehicle Bike Detection FP16 - Device: CPU",
Lower Results Are Better
"Xeon Platinum 8490H 2P",24.95,25.12,25.21
"Xeon Platinum 8490H 2P - No AMX",21.79,21.97,22.1
"EPYC 9654 2P",17.93,18.73,17.71,18.48,17.47,18.15,17.64,18.16
"OpenVINO 2022.3 - Model: Face Detection FP16-INT8 - Device: CPU",
Lower Results Are Better
"Xeon Platinum 8490H 2P",427.47,428.34,416.68
"Xeon Platinum 8490H 2P - No AMX",411.42,408.97,409.03
"EPYC 9654 2P",507.82,507.17,506.75
"CPU Power Consumption Monitor - Phoronix Test Suite System Monitoring",
"Xeon Platinum 8490H 2P",
"Xeon Platinum 8490H 2P - No AMX",
"EPYC 9654 2P",
"CPU Peak Freq (Highest CPU Core Frequency) Monitor - Phoronix Test Suite System Monitoring",
"Xeon Platinum 8490H 2P",
"Xeon Platinum 8490H 2P - No AMX",
"EPYC 9654 2P",
"OpenVINO 2022.3 - CPU Power Consumption Monitor",
Lower Results Are Better
"Xeon Platinum 8490H 2P",
"Xeon Platinum 8490H 2P - No AMX",
"EPYC 9654 2P",
"OpenVINO 2022.3 - CPU Peak Freq (Highest CPU Core Frequency) Monitor",
Higher Results Are Better
"Xeon Platinum 8490H 2P",
"Xeon Platinum 8490H 2P - No AMX",
"EPYC 9654 2P",
"OpenVINO 2022.3 - CPU Power Consumption Monitor",
Lower Results Are Better
"Xeon Platinum 8490H 2P",
"Xeon Platinum 8490H 2P - No AMX",
"EPYC 9654 2P",
"OpenVINO 2022.3 - CPU Peak Freq (Highest CPU Core Frequency) Monitor",
Higher Results Are Better
"Xeon Platinum 8490H 2P",
"Xeon Platinum 8490H 2P - No AMX",
"EPYC 9654 2P",
"OpenVINO 2022.3 - CPU Power Consumption Monitor",
Lower Results Are Better
"Xeon Platinum 8490H 2P",
"Xeon Platinum 8490H 2P - No AMX",
"EPYC 9654 2P",
"OpenVINO 2022.3 - CPU Peak Freq (Highest CPU Core Frequency) Monitor",
Higher Results Are Better
"Xeon Platinum 8490H 2P",
"Xeon Platinum 8490H 2P - No AMX",
"EPYC 9654 2P",
"OpenVINO 2022.3 - CPU Power Consumption Monitor",
Lower Results Are Better
"Xeon Platinum 8490H 2P",
"Xeon Platinum 8490H 2P - No AMX",
"EPYC 9654 2P",
"OpenVINO 2022.3 - CPU Peak Freq (Highest CPU Core Frequency) Monitor",
Higher Results Are Better
"Xeon Platinum 8490H 2P",
"Xeon Platinum 8490H 2P - No AMX",
"EPYC 9654 2P",