Intel Xeon w9-3495X testing with a ASUS Pro WS W790E-SAGE SE (0705 BIOS) and llvmpipe on Ubuntu 22.04 via the Phoronix Test Suite.
Compare your own system(s) to this result file with the
Phoronix Test Suite by running the command:
phoronix-test-suite benchmark 2311114-NE-2311110NE81
openvino-1.4.0-amx,
"CPU Temperature Monitor - Phoronix Test Suite System Monitoring",
"AVX512_CORE_AMX",
"AVX512_CORE",
"CPU Peak Freq (Highest CPU Core Frequency) Monitor - Phoronix Test Suite System Monitoring",
"AVX512_CORE_AMX",
"AVX512_CORE",
"CPU Power Consumption Monitor - Phoronix Test Suite System Monitoring",
"AVX512_CORE_AMX",
"AVX512_CORE",
"OpenVINO 2023.2.dev - Model: Face Detection FP16 - Device: CPU",
Higher Results Are Better
"AVX512_CORE_AMX",77.27,77.15,76.99
"AVX512_CORE",12.25,12.25,12.28
"OpenVINO 2023.2.dev - Model: Face Detection FP16-INT8 - Device: CPU",
Higher Results Are Better
"AVX512_CORE_AMX",165.54,165.78,165.63
"AVX512_CORE",87.01,85.72,85.75
"OpenVINO 2023.2.dev - Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU",
Higher Results Are Better
"AVX512_CORE_AMX",91824.27,91880.46,92013.81
"AVX512_CORE",36315.23,36424.38,36371.77
"OpenVINO 2023.2.dev - Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU",
Higher Results Are Better
"AVX512_CORE_AMX",108645.2,108886.72,109399.5
"AVX512_CORE",83473.09,83749.57,83788.47
"OpenVINO 2023.2.dev - Model: Person Detection FP16 - Device: CPU",
Higher Results Are Better
"AVX512_CORE_AMX",289.83,289.19,289.68
"AVX512_CORE",131.46,131.4,131.36
"OpenVINO 2023.2.dev - Model: Person Detection FP32 - Device: CPU",
Higher Results Are Better
"AVX512_CORE_AMX",289.72,290.55,289.39
"AVX512_CORE",131.46,131.42,136.55
"OpenVINO 2023.2.dev - Model: Weld Porosity Detection FP16-INT8 - Device: CPU",
Higher Results Are Better
"AVX512_CORE_AMX",17485.88,17549.69,17536.14
"AVX512_CORE",8753.95,8497.42,8341.06
"OpenVINO 2023.2.dev - Model: Weld Porosity Detection FP16 - Device: CPU",
Higher Results Are Better
"AVX512_CORE_AMX",9416.96,9420.48,9414.69
"AVX512_CORE",1274.2,1273.79,1273.34
"OpenVINO 2023.2.dev - Model: Vehicle Detection FP16-INT8 - Device: CPU",
Higher Results Are Better
"AVX512_CORE_AMX",3240.68,3238.07,3226.15
"AVX512_CORE",4290.15,4196.43,4095.33
"OpenVINO 2023.2.dev - Model: Vehicle Detection FP16 - Device: CPU",
Higher Results Are Better
"AVX512_CORE_AMX",1922.55,1922.12,1920.66
"AVX512_CORE",1077.62,1075.65,1078.56
"OpenVINO 2023.2.dev - Model: Person Vehicle Bike Detection FP16 - Device: CPU",
Higher Results Are Better
"AVX512_CORE_AMX",3670.73,3646.68,3665.94
"AVX512_CORE",1592.05,1589.78,1591.25
"OpenVINO 2023.2.dev - Model: Machine Translation EN To DE FP16 - Device: CPU",
Higher Results Are Better
"AVX512_CORE_AMX",
"AVX512_CORE",
"OpenVINO 2023.2.dev - Model: Face Detection Retail FP16 - Device: CPU",
Higher Results Are Better
"AVX512_CORE_AMX",6606.31,6602.02,6624.56
"AVX512_CORE",3161.52,3150.48,3149.08
"OpenVINO 2023.2.dev - Model: Face Detection Retail FP16-INT8 - Device: CPU",
Higher Results Are Better
"AVX512_CORE_AMX",10079.4,10092.09,10079.21
"AVX512_CORE",11266.67,11233.65,11215.29
"OpenVINO 2023.2.dev - Model: Handwritten English Recognition FP16 - Device: CPU",
Higher Results Are Better
"AVX512_CORE_AMX",1597.25,1601.75,1593.42
"AVX512_CORE",844.46,844.81,844.49
"OpenVINO 2023.2.dev - Model: Handwritten English Recognition FP16-INT8 - Device: CPU",
Higher Results Are Better
"AVX512_CORE_AMX",1242.17,1243.94,1246.98
"AVX512_CORE",880,888.42,890.01
"OpenVINO 2023.2.dev - Model: Road Segmentation ADAS FP16 - Device: CPU",
Higher Results Are Better
"AVX512_CORE_AMX",807.27,807.05,808.05
"AVX512_CORE",540.36,540.87,540.85
"OpenVINO 2023.2.dev - Model: Road Segmentation ADAS FP16-INT8 - Device: CPU",
Higher Results Are Better
"AVX512_CORE_AMX",1126.84,1132.53,1128.85
"AVX512_CORE",1188.43,1188.74,1186.08
"OpenVINO 2023.2.dev - CPU Peak Freq (Highest CPU Core Frequency) Monitor",
Higher Results Are Better
"AVX512_CORE_AMX",
"AVX512_CORE",
"OpenVINO 2023.2.dev - CPU Peak Freq (Highest CPU Core Frequency) Monitor",
Higher Results Are Better
"AVX512_CORE_AMX",
"AVX512_CORE",
"OpenVINO 2023.2.dev - CPU Peak Freq (Highest CPU Core Frequency) Monitor",
Higher Results Are Better
"AVX512_CORE_AMX",
"AVX512_CORE",
"OpenVINO 2023.2.dev - CPU Peak Freq (Highest CPU Core Frequency) Monitor",
Higher Results Are Better
"AVX512_CORE_AMX",
"AVX512_CORE",
"OpenVINO 2023.2.dev - CPU Peak Freq (Highest CPU Core Frequency) Monitor",
Higher Results Are Better
"AVX512_CORE_AMX",
"AVX512_CORE",
"OpenVINO 2023.2.dev - CPU Peak Freq (Highest CPU Core Frequency) Monitor",
Higher Results Are Better
"AVX512_CORE_AMX",
"AVX512_CORE",
"OpenVINO 2023.2.dev - CPU Peak Freq (Highest CPU Core Frequency) Monitor",
Higher Results Are Better
"AVX512_CORE_AMX",
"AVX512_CORE",
"OpenVINO 2023.2.dev - CPU Peak Freq (Highest CPU Core Frequency) Monitor",
Higher Results Are Better
"AVX512_CORE_AMX",
"AVX512_CORE",
"OpenVINO 2023.2.dev - CPU Peak Freq (Highest CPU Core Frequency) Monitor",
Higher Results Are Better
"AVX512_CORE_AMX",
"AVX512_CORE",
"OpenVINO 2023.2.dev - CPU Peak Freq (Highest CPU Core Frequency) Monitor",
Higher Results Are Better
"AVX512_CORE_AMX",
"AVX512_CORE",
"OpenVINO 2023.2.dev - CPU Peak Freq (Highest CPU Core Frequency) Monitor",
Higher Results Are Better
"AVX512_CORE_AMX",
"AVX512_CORE",
"OpenVINO 2023.2.dev - CPU Peak Freq (Highest CPU Core Frequency) Monitor",
Higher Results Are Better
"AVX512_CORE_AMX",
"AVX512_CORE",
"OpenVINO 2023.2.dev - CPU Peak Freq (Highest CPU Core Frequency) Monitor",
Higher Results Are Better
"AVX512_CORE_AMX",
"AVX512_CORE",
"OpenVINO 2023.2.dev - CPU Peak Freq (Highest CPU Core Frequency) Monitor",
Higher Results Are Better
"AVX512_CORE_AMX",
"AVX512_CORE",
"OpenVINO 2023.2.dev - CPU Peak Freq (Highest CPU Core Frequency) Monitor",
Higher Results Are Better
"AVX512_CORE_AMX",
"AVX512_CORE",
"OpenVINO 2023.2.dev - CPU Peak Freq (Highest CPU Core Frequency) Monitor",
Higher Results Are Better
"AVX512_CORE_AMX",
"AVX512_CORE",
"OpenVINO 2023.2.dev - CPU Peak Freq (Highest CPU Core Frequency) Monitor",
Higher Results Are Better
"AVX512_CORE_AMX",
"AVX512_CORE",
"OpenVINO 2023.2.dev - CPU Temperature Monitor",
Lower Results Are Better
"AVX512_CORE_AMX",
"AVX512_CORE",
"OpenVINO 2023.2.dev - CPU Temperature Monitor",
Lower Results Are Better
"AVX512_CORE_AMX",
"AVX512_CORE",
"OpenVINO 2023.2.dev - CPU Temperature Monitor",
Lower Results Are Better
"AVX512_CORE_AMX",
"AVX512_CORE",
"OpenVINO 2023.2.dev - CPU Temperature Monitor",
Lower Results Are Better
"AVX512_CORE_AMX",
"AVX512_CORE",
"OpenVINO 2023.2.dev - CPU Temperature Monitor",
Lower Results Are Better
"AVX512_CORE_AMX",
"AVX512_CORE",
"OpenVINO 2023.2.dev - CPU Temperature Monitor",
Lower Results Are Better
"AVX512_CORE_AMX",
"AVX512_CORE",
"OpenVINO 2023.2.dev - CPU Temperature Monitor",
Lower Results Are Better
"AVX512_CORE_AMX",
"AVX512_CORE",
"OpenVINO 2023.2.dev - CPU Temperature Monitor",
Lower Results Are Better
"AVX512_CORE_AMX",
"AVX512_CORE",
"OpenVINO 2023.2.dev - CPU Temperature Monitor",
Lower Results Are Better
"AVX512_CORE_AMX",
"AVX512_CORE",
"OpenVINO 2023.2.dev - CPU Temperature Monitor",
Lower Results Are Better
"AVX512_CORE_AMX",
"AVX512_CORE",
"OpenVINO 2023.2.dev - CPU Temperature Monitor",
Lower Results Are Better
"AVX512_CORE_AMX",
"AVX512_CORE",
"OpenVINO 2023.2.dev - CPU Temperature Monitor",
Lower Results Are Better
"AVX512_CORE_AMX",
"AVX512_CORE",
"OpenVINO 2023.2.dev - CPU Temperature Monitor",
Lower Results Are Better
"AVX512_CORE_AMX",
"AVX512_CORE",
"OpenVINO 2023.2.dev - CPU Temperature Monitor",
Lower Results Are Better
"AVX512_CORE_AMX",
"AVX512_CORE",
"OpenVINO 2023.2.dev - CPU Temperature Monitor",
Lower Results Are Better
"AVX512_CORE_AMX",
"AVX512_CORE",
"OpenVINO 2023.2.dev - CPU Temperature Monitor",
Lower Results Are Better
"AVX512_CORE_AMX",
"AVX512_CORE",
"OpenVINO 2023.2.dev - CPU Temperature Monitor",
Lower Results Are Better
"AVX512_CORE_AMX",
"AVX512_CORE",
"OpenVINO 2023.2.dev - Model: Face Detection FP16 - Device: CPU",
Lower Results Are Better
"AVX512_CORE_AMX",361.6,362.09,362.81
"AVX512_CORE",2269.36,2268.56,2271.19
"OpenVINO 2023.2.dev - Model: Face Detection FP16-INT8 - Device: CPU",
Lower Results Are Better
"AVX512_CORE_AMX",337.73,337.19,337.55
"AVX512_CORE",321.12,325.71,325.81
"OpenVINO 2023.2.dev - Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU",
Lower Results Are Better
"AVX512_CORE_AMX",0.54,0.54,0.54
"AVX512_CORE",1.4,1.4,1.4
"OpenVINO 2023.2.dev - Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU",
Lower Results Are Better
"AVX512_CORE_AMX",0.44,0.44,0.43
"AVX512_CORE",0.58,0.58,0.58
"OpenVINO 2023.2.dev - Model: Person Detection FP16 - Device: CPU",
Lower Results Are Better
"AVX512_CORE_AMX",96.53,96.75,96.57
"AVX512_CORE",212.74,212.8,212.93
"OpenVINO 2023.2.dev - Model: Person Detection FP32 - Device: CPU",
Lower Results Are Better
"AVX512_CORE_AMX",96.59,96.3,96.68
"AVX512_CORE",212.74,212.79,204.77
"OpenVINO 2023.2.dev - Model: Weld Porosity Detection FP16-INT8 - Device: CPU",
Lower Results Are Better
"AVX512_CORE_AMX",3.18,3.17,3.18
"AVX512_CORE",6.38,6.57,6.69
"OpenVINO 2023.2.dev - Model: Weld Porosity Detection FP16 - Device: CPU",
Lower Results Are Better
"AVX512_CORE_AMX",5.93,5.93,5.93
"AVX512_CORE",43.92,43.93,43.95
"OpenVINO 2023.2.dev - Model: Vehicle Detection FP16-INT8 - Device: CPU",
Lower Results Are Better
"AVX512_CORE_AMX",17.25,17.27,17.33
"AVX512_CORE",6.51,6.66,6.82
"OpenVINO 2023.2.dev - Model: Vehicle Detection FP16 - Device: CPU",
Lower Results Are Better
"AVX512_CORE_AMX",14.53,14.53,14.55
"AVX512_CORE",25.97,26.01,25.94
"OpenVINO 2023.2.dev - Model: Person Vehicle Bike Detection FP16 - Device: CPU",
Lower Results Are Better
"AVX512_CORE_AMX",15.23,15.33,15.25
"AVX512_CORE",17.57,17.6,17.58
"OpenVINO 2023.2.dev - Model: Face Detection Retail FP16 - Device: CPU",
Lower Results Are Better
"AVX512_CORE_AMX",8.46,8.46,8.43
"AVX512_CORE",8.85,8.88,8.88
"OpenVINO 2023.2.dev - Model: Face Detection Retail FP16-INT8 - Device: CPU",
Lower Results Are Better
"AVX512_CORE_AMX",5.54,5.54,5.54
"AVX512_CORE",4.95,4.96,4.97
"OpenVINO 2023.2.dev - Model: Handwritten English Recognition FP16 - Device: CPU",
Lower Results Are Better
"AVX512_CORE_AMX",35.04,34.94,35.12
"AVX512_CORE",66.27,66.24,66.27
"OpenVINO 2023.2.dev - Model: Handwritten English Recognition FP16-INT8 - Device: CPU",
Lower Results Are Better
"AVX512_CORE_AMX",45.05,44.98,44.87
"AVX512_CORE",63.59,62.99,62.88
"OpenVINO 2023.2.dev - Model: Road Segmentation ADAS FP16 - Device: CPU",
Lower Results Are Better
"AVX512_CORE_AMX",34.63,34.63,34.59
"AVX512_CORE",51.76,51.71,51.71
"OpenVINO 2023.2.dev - Model: Road Segmentation ADAS FP16-INT8 - Device: CPU",
Lower Results Are Better
"AVX512_CORE_AMX",49.63,49.39,49.55
"AVX512_CORE",23.46,23.46,23.5
"OpenVINO 2023.2.dev - CPU Power Consumption Monitor",
Lower Results Are Better
"AVX512_CORE_AMX",
"AVX512_CORE",
"OpenVINO 2023.2.dev - CPU Power Consumption Monitor",
Lower Results Are Better
"AVX512_CORE_AMX",
"AVX512_CORE",
"OpenVINO 2023.2.dev - CPU Power Consumption Monitor",
Lower Results Are Better
"AVX512_CORE_AMX",
"AVX512_CORE",
"OpenVINO 2023.2.dev - CPU Power Consumption Monitor",
Lower Results Are Better
"AVX512_CORE_AMX",
"AVX512_CORE",
"OpenVINO 2023.2.dev - CPU Power Consumption Monitor",
Lower Results Are Better
"AVX512_CORE_AMX",
"AVX512_CORE",
"OpenVINO 2023.2.dev - CPU Power Consumption Monitor",
Lower Results Are Better
"AVX512_CORE_AMX",
"AVX512_CORE",
"OpenVINO 2023.2.dev - CPU Power Consumption Monitor",
Lower Results Are Better
"AVX512_CORE_AMX",
"AVX512_CORE",
"OpenVINO 2023.2.dev - CPU Power Consumption Monitor",
Lower Results Are Better
"AVX512_CORE_AMX",
"AVX512_CORE",
"OpenVINO 2023.2.dev - CPU Power Consumption Monitor",
Lower Results Are Better
"AVX512_CORE_AMX",
"AVX512_CORE",
"OpenVINO 2023.2.dev - CPU Power Consumption Monitor",
Lower Results Are Better
"AVX512_CORE_AMX",
"AVX512_CORE",
"OpenVINO 2023.2.dev - CPU Power Consumption Monitor",
Lower Results Are Better
"AVX512_CORE_AMX",
"AVX512_CORE",
"OpenVINO 2023.2.dev - CPU Power Consumption Monitor",
Lower Results Are Better
"AVX512_CORE_AMX",
"AVX512_CORE",
"OpenVINO 2023.2.dev - CPU Power Consumption Monitor",
Lower Results Are Better
"AVX512_CORE_AMX",
"AVX512_CORE",
"OpenVINO 2023.2.dev - CPU Power Consumption Monitor",
Lower Results Are Better
"AVX512_CORE_AMX",
"AVX512_CORE",
"OpenVINO 2023.2.dev - CPU Power Consumption Monitor",
Lower Results Are Better
"AVX512_CORE_AMX",
"AVX512_CORE",
"OpenVINO 2023.2.dev - CPU Power Consumption Monitor",
Lower Results Are Better
"AVX512_CORE_AMX",
"AVX512_CORE",
"OpenVINO 2023.2.dev - CPU Power Consumption Monitor",
Lower Results Are Better
"AVX512_CORE_AMX",
"AVX512_CORE",