openvino140-amx-avx

Intel Xeon w9-3495X testing with a ASUS Pro WS W790E-SAGE SE (0705 BIOS) and llvmpipe on Ubuntu 22.04 via the Phoronix Test Suite.

Compare your own system(s) to this result file with the Phoronix Test Suite by running the command: phoronix-test-suite benchmark 2311121-NE-OPENVINO159
Jump To Table - Results

Statistics

Remove Outliers Before Calculating Averages

Graph Settings

Prefer Vertical Bar Graphs
No Box Plots
On Line Graphs With Missing Data, Connect The Line Gaps

Multi-Way Comparison

Condense Multi-Option Tests Into Single Result Graphs
Condense Test Profiles With Multiple Version Results Into Single Result Graphs

Table

Show Detailed System Result Table

Run Management

Result
Identifier
View Logs
Performance Per
Dollar
Date
Run
  Test
  Duration
Xeon w-3495X AVX512
November 13 2023
  1 Hour, 45 Minutes
Only show results matching title/arguments (delimit multiple options with a comma):
Do not show results matching title/arguments (delimit multiple options with a comma):

openvino140-amx-avx, "OpenVINO 2023.2.dev - Model: Face Detection FP16 - Device: CPU", Higher Results Are Better "Xeon w-3495X AVX512",12.18,12.29,12.29 "OpenVINO 2023.2.dev - Model: Face Detection FP16 - Device: CPU", Lower Results Are Better "Xeon w-3495X AVX512",2271.81,2267.71,2266.79 "OpenVINO 2023.2.dev - CPU Peak Freq (Highest CPU Core Frequency) Monitor", Higher Results Are Better "Xeon w-3495X AVX512", "OpenVINO 2023.2.dev - CPU Power Consumption Monitor", Lower Results Are Better "Xeon w-3495X AVX512", "OpenVINO 2023.2.dev - CPU Temperature Monitor", Lower Results Are Better "Xeon w-3495X AVX512", "OpenVINO 2023.2.dev - Model: Face Detection FP16-INT8 - Device: CPU", Higher Results Are Better "Xeon w-3495X AVX512",91.78,89.96,89.48 "OpenVINO 2023.2.dev - Model: Face Detection FP16-INT8 - Device: CPU", Lower Results Are Better "Xeon w-3495X AVX512",304.36,310.56,312.21 "OpenVINO 2023.2.dev - CPU Peak Freq (Highest CPU Core Frequency) Monitor", Higher Results Are Better "Xeon w-3495X AVX512", "OpenVINO 2023.2.dev - CPU Power Consumption Monitor", Lower Results Are Better "Xeon w-3495X AVX512", "OpenVINO 2023.2.dev - CPU Temperature Monitor", Lower Results Are Better "Xeon w-3495X AVX512", "OpenVINO 2023.2.dev - Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU", Higher Results Are Better "Xeon w-3495X AVX512",36506.2,36531.67,36584.88 "OpenVINO 2023.2.dev - Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU", Lower Results Are Better "Xeon w-3495X AVX512",1.39,1.39,1.39 "OpenVINO 2023.2.dev - CPU Peak Freq (Highest CPU Core Frequency) Monitor", Higher Results Are Better "Xeon w-3495X AVX512", "OpenVINO 2023.2.dev - CPU Power Consumption Monitor", Lower Results Are Better "Xeon w-3495X AVX512", "OpenVINO 2023.2.dev - CPU Temperature Monitor", Lower Results Are Better "Xeon w-3495X AVX512", "OpenVINO 2023.2.dev - Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU", Higher Results Are Better "Xeon w-3495X AVX512",83608.58,83379.41,83051.9 "OpenVINO 2023.2.dev - Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU", Lower Results Are Better "Xeon w-3495X AVX512",0.58,0.58,0.58 "OpenVINO 2023.2.dev - CPU Peak Freq (Highest CPU Core Frequency) Monitor", Higher Results Are Better "Xeon w-3495X AVX512", "OpenVINO 2023.2.dev - CPU Power Consumption Monitor", Lower Results Are Better "Xeon w-3495X AVX512", "OpenVINO 2023.2.dev - CPU Temperature Monitor", Lower Results Are Better "Xeon w-3495X AVX512", "OpenVINO 2023.2.dev - Model: Person Detection FP16 - Device: CPU", Higher Results Are Better "Xeon w-3495X AVX512",131.34,131.1,131.38 "OpenVINO 2023.2.dev - Model: Person Detection FP16 - Device: CPU", Lower Results Are Better "Xeon w-3495X AVX512",212.96,213.45,212.91 "OpenVINO 2023.2.dev - CPU Peak Freq (Highest CPU Core Frequency) Monitor", Higher Results Are Better "Xeon w-3495X AVX512", "OpenVINO 2023.2.dev - CPU Power Consumption Monitor", Lower Results Are Better "Xeon w-3495X AVX512", "OpenVINO 2023.2.dev - CPU Temperature Monitor", Lower Results Are Better "Xeon w-3495X AVX512", "OpenVINO 2023.2.dev - Model: Person Detection FP32 - Device: CPU", Higher Results Are Better "Xeon w-3495X AVX512",131.17,131.32,131.25 "OpenVINO 2023.2.dev - Model: Person Detection FP32 - Device: CPU", Lower Results Are Better "Xeon w-3495X AVX512",213.29,213,213.16 "OpenVINO 2023.2.dev - CPU Peak Freq (Highest CPU Core Frequency) Monitor", Higher Results Are Better "Xeon w-3495X AVX512", "OpenVINO 2023.2.dev - CPU Power Consumption Monitor", Lower Results Are Better "Xeon w-3495X AVX512", "OpenVINO 2023.2.dev - CPU Temperature Monitor", Lower Results Are Better "Xeon w-3495X AVX512", "OpenVINO 2023.2.dev - Model: Weld Porosity Detection FP16-INT8 - Device: CPU", Higher Results Are Better "Xeon w-3495X AVX512",9087.3,8857.13,8800.13 "OpenVINO 2023.2.dev - Model: Weld Porosity Detection FP16-INT8 - Device: CPU", Lower Results Are Better "Xeon w-3495X AVX512",6.14,6.3,6.34 "OpenVINO 2023.2.dev - CPU Peak Freq (Highest CPU Core Frequency) Monitor", Higher Results Are Better "Xeon w-3495X AVX512", "OpenVINO 2023.2.dev - CPU Power Consumption Monitor", Lower Results Are Better "Xeon w-3495X AVX512", "OpenVINO 2023.2.dev - CPU Temperature Monitor", Lower Results Are Better "Xeon w-3495X AVX512", "OpenVINO 2023.2.dev - Model: Weld Porosity Detection FP16 - Device: CPU", Higher Results Are Better "Xeon w-3495X AVX512",1275.1,1274.84,1275.27 "OpenVINO 2023.2.dev - Model: Weld Porosity Detection FP16 - Device: CPU", Lower Results Are Better "Xeon w-3495X AVX512",43.89,43.89,43.89 "OpenVINO 2023.2.dev - CPU Peak Freq (Highest CPU Core Frequency) Monitor", Higher Results Are Better "Xeon w-3495X AVX512", "OpenVINO 2023.2.dev - CPU Power Consumption Monitor", Lower Results Are Better "Xeon w-3495X AVX512", "OpenVINO 2023.2.dev - CPU Temperature Monitor", Lower Results Are Better "Xeon w-3495X AVX512", "OpenVINO 2023.2.dev - Model: Vehicle Detection FP16-INT8 - Device: CPU", Higher Results Are Better "Xeon w-3495X AVX512",4419.4,4336.24,4309.72 "OpenVINO 2023.2.dev - Model: Vehicle Detection FP16-INT8 - Device: CPU", Lower Results Are Better "Xeon w-3495X AVX512",6.32,6.45,6.49 "OpenVINO 2023.2.dev - CPU Peak Freq (Highest CPU Core Frequency) Monitor", Higher Results Are Better "Xeon w-3495X AVX512", "OpenVINO 2023.2.dev - CPU Power Consumption Monitor", Lower Results Are Better "Xeon w-3495X AVX512", "OpenVINO 2023.2.dev - CPU Temperature Monitor", Lower Results Are Better "Xeon w-3495X AVX512", "OpenVINO 2023.2.dev - Model: Vehicle Detection FP16 - Device: CPU", Higher Results Are Better "Xeon w-3495X AVX512",1079.52,1079.03,1077.31 "OpenVINO 2023.2.dev - Model: Vehicle Detection FP16 - Device: CPU", Lower Results Are Better "Xeon w-3495X AVX512",25.92,25.93,25.97 "OpenVINO 2023.2.dev - CPU Peak Freq (Highest CPU Core Frequency) Monitor", Higher Results Are Better "Xeon w-3495X AVX512", "OpenVINO 2023.2.dev - CPU Power Consumption Monitor", Lower Results Are Better "Xeon w-3495X AVX512", "OpenVINO 2023.2.dev - CPU Temperature Monitor", Lower Results Are Better "Xeon w-3495X AVX512", "OpenVINO 2023.2.dev - Model: Person Vehicle Bike Detection FP16 - Device: CPU", Higher Results Are Better "Xeon w-3495X AVX512",1587.18,1586.5,1588.19 "OpenVINO 2023.2.dev - Model: Person Vehicle Bike Detection FP16 - Device: CPU", Lower Results Are Better "Xeon w-3495X AVX512",17.62,17.63,17.61 "OpenVINO 2023.2.dev - CPU Peak Freq (Highest CPU Core Frequency) Monitor", Higher Results Are Better "Xeon w-3495X AVX512", "OpenVINO 2023.2.dev - CPU Power Consumption Monitor", Lower Results Are Better "Xeon w-3495X AVX512", "OpenVINO 2023.2.dev - CPU Temperature Monitor", Lower Results Are Better "Xeon w-3495X AVX512", "OpenVINO 2023.2.dev - Model: Machine Translation EN To DE FP16 - Device: CPU", Higher Results Are Better "Xeon w-3495X AVX512", "OpenVINO 2023.2.dev - Model: Face Detection Retail FP16 - Device: CPU", Higher Results Are Better "Xeon w-3495X AVX512",3163.89,3155.65,3156 "OpenVINO 2023.2.dev - Model: Face Detection Retail FP16 - Device: CPU", Lower Results Are Better "Xeon w-3495X AVX512",8.84,8.86,8.86 "OpenVINO 2023.2.dev - CPU Peak Freq (Highest CPU Core Frequency) Monitor", Higher Results Are Better "Xeon w-3495X AVX512", "OpenVINO 2023.2.dev - CPU Power Consumption Monitor", Lower Results Are Better "Xeon w-3495X AVX512", "OpenVINO 2023.2.dev - CPU Temperature Monitor", Lower Results Are Better "Xeon w-3495X AVX512", "OpenVINO 2023.2.dev - Model: Face Detection Retail FP16-INT8 - Device: CPU", Higher Results Are Better "Xeon w-3495X AVX512",11230.05,11225.9,11222.98 "OpenVINO 2023.2.dev - Model: Face Detection Retail FP16-INT8 - Device: CPU", Lower Results Are Better "Xeon w-3495X AVX512",4.96,4.97,4.97 "OpenVINO 2023.2.dev - CPU Peak Freq (Highest CPU Core Frequency) Monitor", Higher Results Are Better "Xeon w-3495X AVX512", "OpenVINO 2023.2.dev - CPU Power Consumption Monitor", Lower Results Are Better "Xeon w-3495X AVX512", "OpenVINO 2023.2.dev - CPU Temperature Monitor", Lower Results Are Better "Xeon w-3495X AVX512", "OpenVINO 2023.2.dev - Model: Handwritten English Recognition FP16 - Device: CPU", Higher Results Are Better "Xeon w-3495X AVX512",843.96,846.56,843.41 "OpenVINO 2023.2.dev - Model: Handwritten English Recognition FP16 - Device: CPU", Lower Results Are Better "Xeon w-3495X AVX512",66.3,66.11,66.34 "OpenVINO 2023.2.dev - CPU Peak Freq (Highest CPU Core Frequency) Monitor", Higher Results Are Better "Xeon w-3495X AVX512", "OpenVINO 2023.2.dev - CPU Power Consumption Monitor", Lower Results Are Better "Xeon w-3495X AVX512", "OpenVINO 2023.2.dev - CPU Temperature Monitor", Lower Results Are Better "Xeon w-3495X AVX512", "OpenVINO 2023.2.dev - Model: Handwritten English Recognition FP16-INT8 - Device: CPU", Higher Results Are Better "Xeon w-3495X AVX512",885.95,886.79,879.48 "OpenVINO 2023.2.dev - Model: Handwritten English Recognition FP16-INT8 - Device: CPU", Lower Results Are Better "Xeon w-3495X AVX512",63.17,63.1,63.64 "OpenVINO 2023.2.dev - CPU Peak Freq (Highest CPU Core Frequency) Monitor", Higher Results Are Better "Xeon w-3495X AVX512", "OpenVINO 2023.2.dev - CPU Power Consumption Monitor", Lower Results Are Better "Xeon w-3495X AVX512", "OpenVINO 2023.2.dev - CPU Temperature Monitor", Lower Results Are Better "Xeon w-3495X AVX512", "OpenVINO 2023.2.dev - Model: Road Segmentation ADAS FP16 - Device: CPU", Higher Results Are Better "Xeon w-3495X AVX512",541.33,542.61,541.63 "OpenVINO 2023.2.dev - Model: Road Segmentation ADAS FP16 - Device: CPU", Lower Results Are Better "Xeon w-3495X AVX512",51.67,51.55,51.64 "OpenVINO 2023.2.dev - CPU Peak Freq (Highest CPU Core Frequency) Monitor", Higher Results Are Better "Xeon w-3495X AVX512", "OpenVINO 2023.2.dev - CPU Power Consumption Monitor", Lower Results Are Better "Xeon w-3495X AVX512", "OpenVINO 2023.2.dev - CPU Temperature Monitor", Lower Results Are Better "Xeon w-3495X AVX512", "OpenVINO 2023.2.dev - Model: Road Segmentation ADAS FP16-INT8 - Device: CPU", Higher Results Are Better "Xeon w-3495X AVX512",1186.74,1188.11,1188.76 "OpenVINO 2023.2.dev - Model: Road Segmentation ADAS FP16-INT8 - Device: CPU", Lower Results Are Better "Xeon w-3495X AVX512",23.5,23.46,23.46 "OpenVINO 2023.2.dev - CPU Peak Freq (Highest CPU Core Frequency) Monitor", Higher Results Are Better "Xeon w-3495X AVX512", "OpenVINO 2023.2.dev - CPU Power Consumption Monitor", Lower Results Are Better "Xeon w-3495X AVX512", "OpenVINO 2023.2.dev - CPU Temperature Monitor", Lower Results Are Better "Xeon w-3495X AVX512", "CPU Peak Freq (Highest CPU Core Frequency) Monitor - Phoronix Test Suite System Monitoring", "Xeon w-3495X AVX512", "CPU Power Consumption Monitor - Phoronix Test Suite System Monitoring", "Xeon w-3495X AVX512", "CPU Temperature Monitor - Phoronix Test Suite System Monitoring", "Xeon w-3495X AVX512",