openvino140-amx-avx

Intel Xeon w9-3495X testing with a ASUS Pro WS W790E-SAGE SE (0705 BIOS) and llvmpipe on Ubuntu 22.04 via the Phoronix Test Suite.

HTML result view exported from: https://openbenchmarking.org/result/2311131-NE-2311121NE59&sro&gru.

openvino140-amx-avxProcessorMotherboardChipsetMemoryDiskGraphicsAudioNetworkOSKernelDesktopDisplay ServerDisplay DriverOpenGLOpenCLVulkanCompilerFile-SystemScreen ResolutionXeon w-3495X AVX512Xeon w-3495X AMXIntel Xeon w9-3495X @ 4.80GHz (56 Cores / 112 Threads)ASUS Pro WS W790E-SAGE SE (0705 BIOS)Intel Device 7aa78 x 32 GB DDR5-4812MT/s Hynix HMCG88AEBRA115N6401GB Micron_9300_MTFDHAL6T4TDR + 4097GB Lexar SSD ARES 4TB + 0GB Virtual HDisk0llvmpipe (210/405MHz)Realtek ALC12202 x Intel X710 for 10GBASE-TUbuntu 22.046.3.0-060300-generic (x86_64)GNOME Shell 42.9X Server 1.21.1.4NVIDIA 535.129.034.5 Mesa 23.0.4-0ubuntu1~22.04.1 (LLVM 15.0.7 256 bits)OpenCL 3.0 CUDA 12.2.1471.3.242GCC 11.4.0 + CUDA 12.1ext41920x12006401GB Micron_9300_MTFDHAL6T4TDR + 0GB Virtual HDisk0OpenBenchmarking.orgKernel Details- Transparent Huge Pages: madviseCompiler Details- --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-bootstrap --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-link-serialization=2 --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none=/build/gcc-11-XeT9lY/gcc-11-11.4.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-11-XeT9lY/gcc-11-11.4.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-build-config=bootstrap-lto-lean --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v Processor Details- Scaling Governor: intel_pstate powersave (EPP: performance) - CPU Microcode: 0x2b0004b1Python Details- Python 3.10.12Security Details- itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Not affected

openvino140-amx-avxopenvino: Face Detection FP16 - CPUopenvino: Face Detection FP16-INT8 - CPUopenvino: Age Gender Recognition Retail 0013 FP16 - CPUopenvino: Age Gender Recognition Retail 0013 FP16-INT8 - CPUopenvino: Person Detection FP16 - CPUopenvino: Person Detection FP32 - CPUopenvino: Weld Porosity Detection FP16-INT8 - CPUopenvino: Weld Porosity Detection FP16 - CPUopenvino: Vehicle Detection FP16-INT8 - CPUopenvino: Vehicle Detection FP16 - CPUopenvino: Person Vehicle Bike Detection FP16 - CPUopenvino: Face Detection Retail FP16 - CPUopenvino: Face Detection Retail FP16-INT8 - CPUopenvino: Handwritten English Recognition FP16 - CPUopenvino: Handwritten English Recognition FP16-INT8 - CPUopenvino: Road Segmentation ADAS FP16 - CPUopenvino: Road Segmentation ADAS FP16-INT8 - CPUopenvino: Face Detection FP16 - CPUopenvino: Face Detection FP16-INT8 - CPUopenvino: Age Gender Recognition Retail 0013 FP16 - CPUopenvino: Age Gender Recognition Retail 0013 FP16-INT8 - CPUopenvino: Person Detection FP16 - CPUopenvino: Person Detection FP32 - CPUopenvino: Weld Porosity Detection FP16-INT8 - CPUopenvino: Weld Porosity Detection FP16 - CPUopenvino: Vehicle Detection FP16-INT8 - CPUopenvino: Vehicle Detection FP16 - CPUopenvino: Person Vehicle Bike Detection FP16 - CPUopenvino: Face Detection Retail FP16 - CPUopenvino: Face Detection Retail FP16-INT8 - CPUopenvino: Handwritten English Recognition FP16 - CPUopenvino: Handwritten English Recognition FP16-INT8 - CPUopenvino: Road Segmentation ADAS FP16 - CPUopenvino: Road Segmentation ADAS FP16-INT8 - CPUXeon w-3495X AVX512Xeon w-3495X AMX12.2590.4136540.9283346.63131.27131.258914.851275.074355.121078.621587.293158.5111226.31844.64884.07541.861187.872268.77309.041.390.58213.11213.156.2643.896.4225.9417.628.854.9766.2563.3051.6223.4777.13165.2692228.81108321.98289.28290.2317538.099400.663217.491775.623503.145990.759263.511401.231095.86545.69585.35362.20338.160.540.4496.7196.403.175.9317.3815.7515.979.336.0339.9951.0752.7996.33OpenBenchmarking.org

CPU Temperature Monitor

Phoronix Test Suite System Monitoring

OpenBenchmarking.orgCelsiusCPU Temperature MonitorPhoronix Test Suite System MonitoringXeon w-3495X AMXXeon w-3495X AVX51220406080100Min: 47 / Avg: 79.63 / Max: 90Min: 31 / Avg: 67.73 / Max: 89

CPU Peak Freq (Highest CPU Core Frequency) Monitor

Phoronix Test Suite System Monitoring

OpenBenchmarking.orgMegahertzCPU Peak Freq (Highest CPU Core Frequency) MonitorPhoronix Test Suite System MonitoringXeon w-3495X AMXXeon w-3495X AVX5128001600240032004000Min: 510 / Avg: 2083.98 / Max: 4517Min: 1900 / Avg: 2590.26 / Max: 4300

CPU Power Consumption Monitor

Phoronix Test Suite System Monitoring

OpenBenchmarking.orgWattsCPU Power Consumption MonitorPhoronix Test Suite System MonitoringXeon w-3495X AMXXeon w-3495X AVX512110220330440550Min: 58.72 / Avg: 395.56 / Max: 516.63Min: 92.98 / Avg: 426.33 / Max: 644.43

OpenVINO

Model: Face Detection FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Face Detection FP16 - Device: CPUXeon w-3495X AMXXeon w-3495X AVX51220406080100SE +/- 0.06, N = 3SE +/- 0.04, N = 377.1312.251. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie

OpenVINO

Model: Face Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Face Detection FP16-INT8 - Device: CPUXeon w-3495X AMXXeon w-3495X AVX5124080120160200SE +/- 0.29, N = 3SE +/- 0.70, N = 3165.2690.411. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie

OpenVINO

Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Age Gender Recognition Retail 0013 FP16 - Device: CPUXeon w-3495X AMXXeon w-3495X AVX51220K40K60K80K100KSE +/- 84.22, N = 3SE +/- 23.18, N = 392228.8136540.921. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie

OpenVINO

Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPUXeon w-3495X AMXXeon w-3495X AVX51220K40K60K80K100KSE +/- 164.95, N = 3SE +/- 161.53, N = 3108321.9883346.631. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie

OpenVINO

Model: Person Detection FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Person Detection FP16 - Device: CPUXeon w-3495X AMXXeon w-3495X AVX51260120180240300SE +/- 0.56, N = 3SE +/- 0.09, N = 3289.28131.271. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie

OpenVINO

Model: Person Detection FP32 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Person Detection FP32 - Device: CPUXeon w-3495X AMXXeon w-3495X AVX51260120180240300SE +/- 0.48, N = 3SE +/- 0.04, N = 3290.23131.251. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie

OpenVINO

Model: Weld Porosity Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Weld Porosity Detection FP16-INT8 - Device: CPUXeon w-3495X AMXXeon w-3495X AVX5124K8K12K16K20KSE +/- 5.37, N = 3SE +/- 87.78, N = 317538.098914.851. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie

OpenVINO

Model: Weld Porosity Detection FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Weld Porosity Detection FP16 - Device: CPUXeon w-3495X AMXXeon w-3495X AVX5122K4K6K8K10KSE +/- 10.11, N = 3SE +/- 0.13, N = 39400.661275.071. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie

OpenVINO

Model: Vehicle Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Vehicle Detection FP16-INT8 - Device: CPUXeon w-3495X AMXXeon w-3495X AVX5129001800270036004500SE +/- 2.70, N = 3SE +/- 33.04, N = 33217.494355.121. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie

OpenVINO

Model: Vehicle Detection FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Vehicle Detection FP16 - Device: CPUXeon w-3495X AMXXeon w-3495X AVX512400800120016002000SE +/- 15.27, N = 15SE +/- 0.67, N = 31775.621078.621. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie

OpenVINO

Model: Person Vehicle Bike Detection FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Person Vehicle Bike Detection FP16 - Device: CPUXeon w-3495X AMXXeon w-3495X AVX5128001600240032004000SE +/- 34.77, N = 6SE +/- 0.49, N = 33503.141587.291. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie

OpenVINO

Model: Face Detection Retail FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Face Detection Retail FP16 - Device: CPUXeon w-3495X AMXXeon w-3495X AVX51213002600390052006500SE +/- 69.64, N = 4SE +/- 2.69, N = 35990.753158.511. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie

OpenVINO

Model: Face Detection Retail FP16-INT8 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Face Detection Retail FP16-INT8 - Device: CPUXeon w-3495X AMXXeon w-3495X AVX5122K4K6K8K10KSE +/- 83.54, N = 3SE +/- 2.05, N = 39263.5111226.311. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie

OpenVINO

Model: Handwritten English Recognition FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Handwritten English Recognition FP16 - Device: CPUXeon w-3495X AMXXeon w-3495X AVX51230060090012001500SE +/- 14.65, N = 15SE +/- 0.97, N = 31401.23844.641. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie

OpenVINO

Model: Handwritten English Recognition FP16-INT8 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Handwritten English Recognition FP16-INT8 - Device: CPUXeon w-3495X AMXXeon w-3495X AVX5122004006008001000SE +/- 10.17, N = 6SE +/- 2.31, N = 31095.86884.071. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie

OpenVINO

Model: Road Segmentation ADAS FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Road Segmentation ADAS FP16 - Device: CPUXeon w-3495X AMXXeon w-3495X AVX512120240360480600SE +/- 28.82, N = 12SE +/- 0.39, N = 3545.69541.861. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie

OpenVINO

Model: Road Segmentation ADAS FP16-INT8 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Road Segmentation ADAS FP16-INT8 - Device: CPUXeon w-3495X AMXXeon w-3495X AVX51230060090012001500SE +/- 13.98, N = 15SE +/- 0.60, N = 3585.351187.871. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie

OpenVINO

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxXeon w-3495X AMX190026604370Xeon w-3495X AVX512190026674200OpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2023.2.devCPU Peak Freq (Highest CPU Core Frequency) Monitor11002200330044005500

OpenVINO

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxXeon w-3495X AMX190026604306Xeon w-3495X AVX512190027244300OpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2023.2.devCPU Peak Freq (Highest CPU Core Frequency) Monitor11002200330044005500

OpenVINO

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxXeon w-3495X AMX190024054300Xeon w-3495X AVX512190025224200OpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2023.2.devCPU Peak Freq (Highest CPU Core Frequency) Monitor11002200330044005500

OpenVINO

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxXeon w-3495X AMX190023634324Xeon w-3495X AVX512190025724253OpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2023.2.devCPU Peak Freq (Highest CPU Core Frequency) Monitor11002200330044005500

OpenVINO

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxXeon w-3495X AMX190026804336Xeon w-3495X AVX512190026804300OpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2023.2.devCPU Peak Freq (Highest CPU Core Frequency) Monitor11002200330044005500

OpenVINO

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxXeon w-3495X AMX190027314315Xeon w-3495X AVX512190026314300OpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2023.2.devCPU Peak Freq (Highest CPU Core Frequency) Monitor11002200330044005500

OpenVINO

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxXeon w-3495X AMX190023444517Xeon w-3495X AVX512190025842901OpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2023.2.devCPU Peak Freq (Highest CPU Core Frequency) Monitor12002400360048006000

OpenVINO

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxXeon w-3495X AMX190023212900Xeon w-3495X AVX512190024984296OpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2023.2.devCPU Peak Freq (Highest CPU Core Frequency) Monitor11002200330044005500

OpenVINO

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxXeon w-3495X AMX190025074300Xeon w-3495X AVX512190026913985OpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2023.2.devCPU Peak Freq (Highest CPU Core Frequency) Monitor11002200330044005500

OpenVINO

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxXeon w-3495X AMX190025574260Xeon w-3495X AVX512190025583747OpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2023.2.devCPU Peak Freq (Highest CPU Core Frequency) Monitor11002200330044005500

OpenVINO

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxXeon w-3495X AMX160021684409Xeon w-3495X AVX512190025664281OpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2023.2.devCPU Peak Freq (Highest CPU Core Frequency) Monitor11002200330044005500

OpenVINO

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxXeon w-3495X AMX150020674300Xeon w-3495X AVX512190025364200OpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2023.2.devCPU Peak Freq (Highest CPU Core Frequency) Monitor11002200330044005500

OpenVINO

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxXeon w-3495X AMX170021444351Xeon w-3495X AVX512190027384200OpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2023.2.devCPU Peak Freq (Highest CPU Core Frequency) Monitor11002200330044005500

OpenVINO

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxXeon w-3495X AMX150020844199Xeon w-3495X AVX512190025083399OpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2023.2.devCPU Peak Freq (Highest CPU Core Frequency) Monitor11002200330044005500

OpenVINO

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxXeon w-3495X AMX180022064300Xeon w-3495X AVX512190027463011OpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2023.2.devCPU Peak Freq (Highest CPU Core Frequency) Monitor11002200330044005500

OpenVINO

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxXeon w-3495X AMX55614514300Xeon w-3495X AVX512190025654158OpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2023.2.devCPU Peak Freq (Highest CPU Core Frequency) Monitor11002200330044005500

OpenVINO

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxXeon w-3495X AMX51012304300Xeon w-3495X AVX512190026254204OpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2023.2.devCPU Peak Freq (Highest CPU Core Frequency) Monitor11002200330044005500

OpenVINO

CPU Temperature Monitor

MinAvgMaxXeon w-3495X AMX48.074.579.0Xeon w-3495X AVX51231.063.370.0OpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2023.2.devCPU Temperature Monitor20406080100

OpenVINO

CPU Temperature Monitor

MinAvgMaxXeon w-3495X AMX50.074.879.0Xeon w-3495X AVX51237.082.289.0OpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2023.2.devCPU Temperature Monitor20406080100

OpenVINO

CPU Temperature Monitor

MinAvgMaxXeon w-3495X AMX48.073.878.0Xeon w-3495X AVX51241.068.172.0OpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2023.2.devCPU Temperature Monitor20406080100

OpenVINO

CPU Temperature Monitor

MinAvgMaxXeon w-3495X AMX47.071.875.0Xeon w-3495X AVX51238.067.672.0OpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2023.2.devCPU Temperature Monitor20406080100

OpenVINO

CPU Temperature Monitor

MinAvgMaxXeon w-3495X AMX48.075.680.0Xeon w-3495X AVX51238.066.370.0OpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2023.2.devCPU Temperature Monitor20406080100

OpenVINO

CPU Temperature Monitor

MinAvgMaxXeon w-3495X AMX49.076.480.0Xeon w-3495X AVX51237.066.170.0OpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2023.2.devCPU Temperature Monitor20406080100

OpenVINO

CPU Temperature Monitor

MinAvgMaxXeon w-3495X AMX51.074.878.0Xeon w-3495X AVX51237.082.189.0OpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2023.2.devCPU Temperature Monitor20406080100

OpenVINO

CPU Temperature Monitor

MinAvgMaxXeon w-3495X AMX48.073.778.0Xeon w-3495X AVX51237.066.272.0OpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2023.2.devCPU Temperature Monitor20406080100

OpenVINO

CPU Temperature Monitor

MinAvgMaxXeon w-3495X AMX48.075.379.0Xeon w-3495X AVX51235.080.786.0OpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2023.2.devCPU Temperature Monitor20406080100

OpenVINO

CPU Temperature Monitor

MinAvgMaxXeon w-3495X AMX48.076.580.0Xeon w-3495X AVX51241.070.875.0OpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2023.2.devCPU Temperature Monitor20406080100

OpenVINO

CPU Temperature Monitor

MinAvgMaxXeon w-3495X AMX50.077.882.0Xeon w-3495X AVX51239.063.667.0OpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2023.2.devCPU Temperature Monitor20406080100

OpenVINO

CPU Temperature Monitor

MinAvgMaxXeon w-3495X AMX49.080.884.0Xeon w-3495X AVX51233.065.270.0OpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2023.2.devCPU Temperature Monitor20406080100

OpenVINO

CPU Temperature Monitor

MinAvgMaxXeon w-3495X AMX54.081.886.0Xeon w-3495X AVX51237.073.179.0OpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2023.2.devCPU Temperature Monitor20406080100

OpenVINO

CPU Temperature Monitor

MinAvgMaxXeon w-3495X AMX55.083.387.0Xeon w-3495X AVX51239.065.269.0OpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2023.2.devCPU Temperature Monitor20406080100

OpenVINO

CPU Temperature Monitor

MinAvgMaxXeon w-3495X AMX59.085.189.0Xeon w-3495X AVX51237.065.970.0OpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2023.2.devCPU Temperature Monitor20406080100

OpenVINO

CPU Temperature Monitor

MinAvgMaxXeon w-3495X AMX57.085.390.0Xeon w-3495X AVX51237.066.570.0OpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2023.2.devCPU Temperature Monitor20406080100

OpenVINO

CPU Temperature Monitor

MinAvgMaxXeon w-3495X AMX65.087.090.0Xeon w-3495X AVX51237.067.271.0OpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2023.2.devCPU Temperature Monitor20406080100

OpenVINO

Model: Face Detection FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Face Detection FP16 - Device: CPUXeon w-3495X AMXXeon w-3495X AVX5125001000150020002500SE +/- 0.25, N = 3SE +/- 1.54, N = 3362.202268.77MIN: 119.43 / MAX: 472.79MIN: 1517.57 / MAX: 2563.681. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie

OpenVINO

Model: Face Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Face Detection FP16-INT8 - Device: CPUXeon w-3495X AMXXeon w-3495X AVX51270140210280350SE +/- 0.57, N = 3SE +/- 2.39, N = 3338.16309.04MIN: 127.79 / MAX: 448.45MIN: 163.58 / MAX: 409.951. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie

OpenVINO

Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Age Gender Recognition Retail 0013 FP16 - Device: CPUXeon w-3495X AMXXeon w-3495X AVX5120.31280.62560.93841.25121.564SE +/- 0.00, N = 3SE +/- 0.00, N = 30.541.39MIN: 0.24 / MAX: 58.79MIN: 0.75 / MAX: 56.291. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie

OpenVINO

Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPUXeon w-3495X AMXXeon w-3495X AVX5120.13050.2610.39150.5220.6525SE +/- 0.00, N = 3SE +/- 0.00, N = 30.440.58MIN: 0.22 / MAX: 56.4MIN: 0.31 / MAX: 53.911. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie

OpenVINO

Model: Person Detection FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Person Detection FP16 - Device: CPUXeon w-3495X AMXXeon w-3495X AVX51250100150200250SE +/- 0.19, N = 3SE +/- 0.17, N = 396.71213.11MIN: 42.98 / MAX: 223.77MIN: 115.03 / MAX: 293.961. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie

OpenVINO

Model: Person Detection FP32 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Person Detection FP32 - Device: CPUXeon w-3495X AMXXeon w-3495X AVX51250100150200250SE +/- 0.15, N = 3SE +/- 0.08, N = 396.40213.15MIN: 49.92 / MAX: 186.22MIN: 117.21 / MAX: 284.141. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie

OpenVINO

Model: Weld Porosity Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Weld Porosity Detection FP16-INT8 - Device: CPUXeon w-3495X AMXXeon w-3495X AVX512246810SE +/- 0.00, N = 3SE +/- 0.06, N = 33.176.26MIN: 1.39 / MAX: 63.13MIN: 3.38 / MAX: 133.591. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie

OpenVINO

Model: Weld Porosity Detection FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Weld Porosity Detection FP16 - Device: CPUXeon w-3495X AMXXeon w-3495X AVX5121020304050SE +/- 0.00, N = 3SE +/- 0.00, N = 35.9343.89MIN: 2.12 / MAX: 285.01MIN: 22.33 / MAX: 445.641. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie

OpenVINO

Model: Vehicle Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Vehicle Detection FP16-INT8 - Device: CPUXeon w-3495X AMXXeon w-3495X AVX51248121620SE +/- 0.02, N = 3SE +/- 0.05, N = 317.386.42MIN: 8.24 / MAX: 103.71MIN: 3.75 / MAX: 71.691. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie

OpenVINO

Model: Vehicle Detection FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Vehicle Detection FP16 - Device: CPUXeon w-3495X AMXXeon w-3495X AVX512612182430SE +/- 0.13, N = 15SE +/- 0.02, N = 315.7525.94MIN: 6.76 / MAX: 103.22MIN: 14.36 / MAX: 99.921. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie

OpenVINO

Model: Person Vehicle Bike Detection FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Person Vehicle Bike Detection FP16 - Device: CPUXeon w-3495X AMXXeon w-3495X AVX51248121620SE +/- 0.15, N = 6SE +/- 0.01, N = 315.9717.62MIN: 8.98 / MAX: 90.98MIN: 11.57 / MAX: 77.451. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie

OpenVINO

Model: Face Detection Retail FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Face Detection Retail FP16 - Device: CPUXeon w-3495X AMXXeon w-3495X AVX5123691215SE +/- 0.11, N = 4SE +/- 0.01, N = 39.338.85MIN: 4.69 / MAX: 283.65MIN: 4.88 / MAX: 68.81. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie

OpenVINO

Model: Face Detection Retail FP16-INT8 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Face Detection Retail FP16-INT8 - Device: CPUXeon w-3495X AMXXeon w-3495X AVX512246810SE +/- 0.06, N = 3SE +/- 0.00, N = 36.034.97MIN: 3.46 / MAX: 82.63MIN: 2.79 / MAX: 62.291. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie

OpenVINO

Model: Handwritten English Recognition FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Handwritten English Recognition FP16 - Device: CPUXeon w-3495X AMXXeon w-3495X AVX5121530456075SE +/- 0.40, N = 15SE +/- 0.07, N = 339.9966.25MIN: 21.33 / MAX: 131.88MIN: 40.54 / MAX: 128.11. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie

OpenVINO

Model: Handwritten English Recognition FP16-INT8 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Handwritten English Recognition FP16-INT8 - Device: CPUXeon w-3495X AMXXeon w-3495X AVX5121428425670SE +/- 0.46, N = 6SE +/- 0.17, N = 351.0763.30MIN: 29.37 / MAX: 134.75MIN: 41.81 / MAX: 120.711. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie

OpenVINO

Model: Road Segmentation ADAS FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Road Segmentation ADAS FP16 - Device: CPUXeon w-3495X AMXXeon w-3495X AVX5121224364860SE +/- 2.69, N = 12SE +/- 0.04, N = 352.7951.62MIN: 22.13 / MAX: 170.68MIN: 28.55 / MAX: 117.461. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie

OpenVINO

Model: Road Segmentation ADAS FP16-INT8 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Road Segmentation ADAS FP16-INT8 - Device: CPUXeon w-3495X AMXXeon w-3495X AVX51220406080100SE +/- 2.35, N = 15SE +/- 0.01, N = 396.3323.47MIN: 33.13 / MAX: 263.56MIN: 12.57 / MAX: 82.581. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie

OpenVINO

CPU Power Consumption Monitor

MinAvgMaxXeon w-3495X AMX109.2420.4457.3Xeon w-3495X AVX51295.5400.9446.6OpenBenchmarking.orgWatts, Fewer Is BetterOpenVINO 2023.2.devCPU Power Consumption Monitor120240360480600

OpenVINO

CPU Power Consumption Monitor

MinAvgMaxXeon w-3495X AMX111.5425.0468.6Xeon w-3495X AVX51293.9539.7621.8OpenBenchmarking.orgWatts, Fewer Is BetterOpenVINO 2023.2.devCPU Power Consumption Monitor160320480640800

OpenVINO

CPU Power Consumption Monitor

MinAvgMaxXeon w-3495X AMX58.7416.5444.3Xeon w-3495X AVX51294.6426.1461.1OpenBenchmarking.orgWatts, Fewer Is BetterOpenVINO 2023.2.devCPU Power Consumption Monitor120240360480600

OpenVINO

CPU Power Consumption Monitor

MinAvgMaxXeon w-3495X AMX99.7395.8422.7Xeon w-3495X AVX51294.0431.1461.2OpenBenchmarking.orgWatts, Fewer Is BetterOpenVINO 2023.2.devCPU Power Consumption Monitor120240360480600

OpenVINO

CPU Power Consumption Monitor

MinAvgMaxXeon w-3495X AMX104.8441.1479.2Xeon w-3495X AVX51294.0418.3454.9OpenBenchmarking.orgWatts, Fewer Is BetterOpenVINO 2023.2.devCPU Power Consumption Monitor120240360480600

OpenVINO

CPU Power Consumption Monitor

MinAvgMaxXeon w-3495X AMX100.8442.3482.3Xeon w-3495X AVX51294.3419.1454.9OpenBenchmarking.orgWatts, Fewer Is BetterOpenVINO 2023.2.devCPU Power Consumption Monitor120240360480600

OpenVINO

CPU Power Consumption Monitor

MinAvgMaxXeon w-3495X AMX101417451Xeon w-3495X AVX51293549644OpenBenchmarking.orgWatts, Fewer Is BetterOpenVINO 2023.2.devCPU Power Consumption Monitor2004006008001000

OpenVINO

CPU Power Consumption Monitor

MinAvgMaxXeon w-3495X AMX107.0411.8442.1Xeon w-3495X AVX51293.3399.8461.3OpenBenchmarking.orgWatts, Fewer Is BetterOpenVINO 2023.2.devCPU Power Consumption Monitor120240360480600

OpenVINO

CPU Power Consumption Monitor

MinAvgMaxXeon w-3495X AMX111.6463.4505.2Xeon w-3495X AVX51293.1551.1615.5OpenBenchmarking.orgWatts, Fewer Is BetterOpenVINO 2023.2.devCPU Power Consumption Monitor160320480640800

OpenVINO

CPU Power Consumption Monitor

MinAvgMaxXeon w-3495X AMX98.1453.8494.4Xeon w-3495X AVX51294.3456.3487.3OpenBenchmarking.orgWatts, Fewer Is BetterOpenVINO 2023.2.devCPU Power Consumption Monitor130260390520650

OpenVINO

CPU Power Consumption Monitor

MinAvgMaxXeon w-3495X AMX108.6426.2484.9Xeon w-3495X AVX51293.6406.4439.0OpenBenchmarking.orgWatts, Fewer Is BetterOpenVINO 2023.2.devCPU Power Consumption Monitor120240360480600

OpenVINO

CPU Power Consumption Monitor

MinAvgMaxXeon w-3495X AMX99.1431.0495.5Xeon w-3495X AVX51293.1430.8460.6OpenBenchmarking.orgWatts, Fewer Is BetterOpenVINO 2023.2.devCPU Power Consumption Monitor130260390520650

OpenVINO

CPU Power Consumption Monitor

MinAvgMaxXeon w-3495X AMX110.6429.5497.9Xeon w-3495X AVX51294.3488.3537.7OpenBenchmarking.orgWatts, Fewer Is BetterOpenVINO 2023.2.devCPU Power Consumption Monitor140280420560700

OpenVINO

CPU Power Consumption Monitor

MinAvgMaxXeon w-3495X AMX111.8400.9478.2Xeon w-3495X AVX51293.5424.8456.3OpenBenchmarking.orgWatts, Fewer Is BetterOpenVINO 2023.2.devCPU Power Consumption Monitor120240360480600

OpenVINO

CPU Power Consumption Monitor

MinAvgMaxXeon w-3495X AMX120.3396.1469.7Xeon w-3495X AVX51294.0429.1461.4OpenBenchmarking.orgWatts, Fewer Is BetterOpenVINO 2023.2.devCPU Power Consumption Monitor120240360480600

OpenVINO

CPU Power Consumption Monitor

MinAvgMaxXeon w-3495X AMX108.8375.1516.6Xeon w-3495X AVX51294.0440.3475.4OpenBenchmarking.orgWatts, Fewer Is BetterOpenVINO 2023.2.devCPU Power Consumption Monitor130260390520650

OpenVINO

CPU Power Consumption Monitor

MinAvgMaxXeon w-3495X AMX79.3332.5497.5Xeon w-3495X AVX51294.2443.0481.6OpenBenchmarking.orgWatts, Fewer Is BetterOpenVINO 2023.2.devCPU Power Consumption Monitor130260390520650

Phoronix Test Suite v10.8.5