openvino140-amx-avx

Intel Xeon w9-3495X testing with a ASUS Pro WS W790E-SAGE SE (0705 BIOS) and llvmpipe on Ubuntu 22.04 via the Phoronix Test Suite.

HTML result view exported from: https://openbenchmarking.org/result/2311131-NE-2311121NE59&grr.

openvino140-amx-avxProcessorMotherboardChipsetMemoryDiskGraphicsAudioNetworkOSKernelDesktopDisplay ServerDisplay DriverOpenGLOpenCLVulkanCompilerFile-SystemScreen ResolutionXeon w-3495X AVX512Xeon w-3495X AMXIntel Xeon w9-3495X @ 4.80GHz (56 Cores / 112 Threads)ASUS Pro WS W790E-SAGE SE (0705 BIOS)Intel Device 7aa78 x 32 GB DDR5-4812MT/s Hynix HMCG88AEBRA115N6401GB Micron_9300_MTFDHAL6T4TDR + 4097GB Lexar SSD ARES 4TB + 0GB Virtual HDisk0llvmpipe (210/405MHz)Realtek ALC12202 x Intel X710 for 10GBASE-TUbuntu 22.046.3.0-060300-generic (x86_64)GNOME Shell 42.9X Server 1.21.1.4NVIDIA 535.129.034.5 Mesa 23.0.4-0ubuntu1~22.04.1 (LLVM 15.0.7 256 bits)OpenCL 3.0 CUDA 12.2.1471.3.242GCC 11.4.0 + CUDA 12.1ext41920x12006401GB Micron_9300_MTFDHAL6T4TDR + 0GB Virtual HDisk0OpenBenchmarking.orgKernel Details- Transparent Huge Pages: madviseCompiler Details- --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-bootstrap --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-link-serialization=2 --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none=/build/gcc-11-XeT9lY/gcc-11-11.4.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-11-XeT9lY/gcc-11-11.4.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-build-config=bootstrap-lto-lean --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v Processor Details- Scaling Governor: intel_pstate powersave (EPP: performance) - CPU Microcode: 0x2b0004b1Python Details- Python 3.10.12Security Details- itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Not affected

openvino140-amx-avxopenvino: Road Segmentation ADAS FP16-INT8 - CPUopenvino: Road Segmentation ADAS FP16-INT8 - CPUopenvino: Handwritten English Recognition FP16 - CPUopenvino: Handwritten English Recognition FP16 - CPUopenvino: Vehicle Detection FP16 - CPUopenvino: Vehicle Detection FP16 - CPUopenvino: Road Segmentation ADAS FP16 - CPUopenvino: Road Segmentation ADAS FP16 - CPUopenvino: Person Vehicle Bike Detection FP16 - CPUopenvino: Person Vehicle Bike Detection FP16 - CPUopenvino: Handwritten English Recognition FP16-INT8 - CPUopenvino: Handwritten English Recognition FP16-INT8 - CPUopenvino: Face Detection Retail FP16 - CPUopenvino: Face Detection Retail FP16 - CPUopenvino: Face Detection FP16 - CPUopenvino: Face Detection FP16 - CPUopenvino: Face Detection FP16-INT8 - CPUopenvino: Face Detection FP16-INT8 - CPUopenvino: Person Detection FP32 - CPUopenvino: Person Detection FP32 - CPUopenvino: Person Detection FP16 - CPUopenvino: Person Detection FP16 - CPUopenvino: Face Detection Retail FP16-INT8 - CPUopenvino: Face Detection Retail FP16-INT8 - CPUopenvino: Vehicle Detection FP16-INT8 - CPUopenvino: Vehicle Detection FP16-INT8 - CPUopenvino: Age Gender Recognition Retail 0013 FP16-INT8 - CPUopenvino: Age Gender Recognition Retail 0013 FP16-INT8 - CPUopenvino: Age Gender Recognition Retail 0013 FP16 - CPUopenvino: Age Gender Recognition Retail 0013 FP16 - CPUopenvino: Weld Porosity Detection FP16 - CPUopenvino: Weld Porosity Detection FP16 - CPUopenvino: Weld Porosity Detection FP16-INT8 - CPUopenvino: Weld Porosity Detection FP16-INT8 - CPUopenvino: Machine Translation EN To DE FP16 - CPUXeon w-3495X AVX512Xeon w-3495X AMX23.471187.8766.25844.6425.941078.6251.62541.8617.621587.2963.30884.078.853158.512268.7712.25309.0490.41213.15131.25213.11131.274.9711226.316.424355.120.5883346.631.3936540.9243.891275.076.268914.8596.33585.3539.991401.2315.751775.6252.79545.6915.973503.1451.071095.869.335990.75362.2077.13338.16165.2696.40290.2396.71289.286.039263.5117.383217.490.44108321.980.5492228.815.939400.663.1717538.09OpenBenchmarking.org

OpenVINO

Model: Road Segmentation ADAS FP16-INT8 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Road Segmentation ADAS FP16-INT8 - Device: CPUXeon w-3495X AVX512Xeon w-3495X AMX20406080100SE +/- 0.01, N = 3SE +/- 2.35, N = 1523.4796.33MIN: 12.57 / MAX: 82.58MIN: 33.13 / MAX: 263.561. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie

OpenVINO

Model: Road Segmentation ADAS FP16-INT8 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Road Segmentation ADAS FP16-INT8 - Device: CPUXeon w-3495X AVX512Xeon w-3495X AMX30060090012001500SE +/- 0.60, N = 3SE +/- 13.98, N = 151187.87585.351. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie

OpenVINO

Model: Handwritten English Recognition FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Handwritten English Recognition FP16 - Device: CPUXeon w-3495X AVX512Xeon w-3495X AMX1530456075SE +/- 0.07, N = 3SE +/- 0.40, N = 1566.2539.99MIN: 40.54 / MAX: 128.1MIN: 21.33 / MAX: 131.881. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie

OpenVINO

Model: Handwritten English Recognition FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Handwritten English Recognition FP16 - Device: CPUXeon w-3495X AVX512Xeon w-3495X AMX30060090012001500SE +/- 0.97, N = 3SE +/- 14.65, N = 15844.641401.231. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie

OpenVINO

Model: Vehicle Detection FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Vehicle Detection FP16 - Device: CPUXeon w-3495X AVX512Xeon w-3495X AMX612182430SE +/- 0.02, N = 3SE +/- 0.13, N = 1525.9415.75MIN: 14.36 / MAX: 99.92MIN: 6.76 / MAX: 103.221. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie

OpenVINO

Model: Vehicle Detection FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Vehicle Detection FP16 - Device: CPUXeon w-3495X AVX512Xeon w-3495X AMX400800120016002000SE +/- 0.67, N = 3SE +/- 15.27, N = 151078.621775.621. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie

OpenVINO

Model: Road Segmentation ADAS FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Road Segmentation ADAS FP16 - Device: CPUXeon w-3495X AVX512Xeon w-3495X AMX1224364860SE +/- 0.04, N = 3SE +/- 2.69, N = 1251.6252.79MIN: 28.55 / MAX: 117.46MIN: 22.13 / MAX: 170.681. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie

OpenVINO

Model: Road Segmentation ADAS FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Road Segmentation ADAS FP16 - Device: CPUXeon w-3495X AVX512Xeon w-3495X AMX120240360480600SE +/- 0.39, N = 3SE +/- 28.82, N = 12541.86545.691. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie

OpenVINO

Model: Person Vehicle Bike Detection FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Person Vehicle Bike Detection FP16 - Device: CPUXeon w-3495X AVX512Xeon w-3495X AMX48121620SE +/- 0.01, N = 3SE +/- 0.15, N = 617.6215.97MIN: 11.57 / MAX: 77.45MIN: 8.98 / MAX: 90.981. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie

OpenVINO

Model: Person Vehicle Bike Detection FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Person Vehicle Bike Detection FP16 - Device: CPUXeon w-3495X AVX512Xeon w-3495X AMX8001600240032004000SE +/- 0.49, N = 3SE +/- 34.77, N = 61587.293503.141. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie

OpenVINO

Model: Handwritten English Recognition FP16-INT8 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Handwritten English Recognition FP16-INT8 - Device: CPUXeon w-3495X AVX512Xeon w-3495X AMX1428425670SE +/- 0.17, N = 3SE +/- 0.46, N = 663.3051.07MIN: 41.81 / MAX: 120.71MIN: 29.37 / MAX: 134.751. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie

OpenVINO

Model: Handwritten English Recognition FP16-INT8 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Handwritten English Recognition FP16-INT8 - Device: CPUXeon w-3495X AVX512Xeon w-3495X AMX2004006008001000SE +/- 2.31, N = 3SE +/- 10.17, N = 6884.071095.861. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie

OpenVINO

Model: Face Detection Retail FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Face Detection Retail FP16 - Device: CPUXeon w-3495X AVX512Xeon w-3495X AMX3691215SE +/- 0.01, N = 3SE +/- 0.11, N = 48.859.33MIN: 4.88 / MAX: 68.8MIN: 4.69 / MAX: 283.651. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie

OpenVINO

Model: Face Detection Retail FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Face Detection Retail FP16 - Device: CPUXeon w-3495X AVX512Xeon w-3495X AMX13002600390052006500SE +/- 2.69, N = 3SE +/- 69.64, N = 43158.515990.751. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie

OpenVINO

Model: Face Detection FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Face Detection FP16 - Device: CPUXeon w-3495X AVX512Xeon w-3495X AMX5001000150020002500SE +/- 1.54, N = 3SE +/- 0.25, N = 32268.77362.20MIN: 1517.57 / MAX: 2563.68MIN: 119.43 / MAX: 472.791. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie

OpenVINO

Model: Face Detection FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Face Detection FP16 - Device: CPUXeon w-3495X AVX512Xeon w-3495X AMX20406080100SE +/- 0.04, N = 3SE +/- 0.06, N = 312.2577.131. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie

OpenVINO

Model: Face Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Face Detection FP16-INT8 - Device: CPUXeon w-3495X AVX512Xeon w-3495X AMX70140210280350SE +/- 2.39, N = 3SE +/- 0.57, N = 3309.04338.16MIN: 163.58 / MAX: 409.95MIN: 127.79 / MAX: 448.451. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie

OpenVINO

Model: Face Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Face Detection FP16-INT8 - Device: CPUXeon w-3495X AVX512Xeon w-3495X AMX4080120160200SE +/- 0.70, N = 3SE +/- 0.29, N = 390.41165.261. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie

OpenVINO

Model: Person Detection FP32 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Person Detection FP32 - Device: CPUXeon w-3495X AVX512Xeon w-3495X AMX50100150200250SE +/- 0.08, N = 3SE +/- 0.15, N = 3213.1596.40MIN: 117.21 / MAX: 284.14MIN: 49.92 / MAX: 186.221. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie

OpenVINO

Model: Person Detection FP32 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Person Detection FP32 - Device: CPUXeon w-3495X AVX512Xeon w-3495X AMX60120180240300SE +/- 0.04, N = 3SE +/- 0.48, N = 3131.25290.231. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie

OpenVINO

Model: Person Detection FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Person Detection FP16 - Device: CPUXeon w-3495X AVX512Xeon w-3495X AMX50100150200250SE +/- 0.17, N = 3SE +/- 0.19, N = 3213.1196.71MIN: 115.03 / MAX: 293.96MIN: 42.98 / MAX: 223.771. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie

OpenVINO

Model: Person Detection FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Person Detection FP16 - Device: CPUXeon w-3495X AVX512Xeon w-3495X AMX60120180240300SE +/- 0.09, N = 3SE +/- 0.56, N = 3131.27289.281. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie

OpenVINO

Model: Face Detection Retail FP16-INT8 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Face Detection Retail FP16-INT8 - Device: CPUXeon w-3495X AVX512Xeon w-3495X AMX246810SE +/- 0.00, N = 3SE +/- 0.06, N = 34.976.03MIN: 2.79 / MAX: 62.29MIN: 3.46 / MAX: 82.631. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie

OpenVINO

Model: Face Detection Retail FP16-INT8 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Face Detection Retail FP16-INT8 - Device: CPUXeon w-3495X AVX512Xeon w-3495X AMX2K4K6K8K10KSE +/- 2.05, N = 3SE +/- 83.54, N = 311226.319263.511. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie

OpenVINO

Model: Vehicle Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Vehicle Detection FP16-INT8 - Device: CPUXeon w-3495X AVX512Xeon w-3495X AMX48121620SE +/- 0.05, N = 3SE +/- 0.02, N = 36.4217.38MIN: 3.75 / MAX: 71.69MIN: 8.24 / MAX: 103.711. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie

OpenVINO

Model: Vehicle Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Vehicle Detection FP16-INT8 - Device: CPUXeon w-3495X AVX512Xeon w-3495X AMX9001800270036004500SE +/- 33.04, N = 3SE +/- 2.70, N = 34355.123217.491. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie

OpenVINO

Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPUXeon w-3495X AVX512Xeon w-3495X AMX0.13050.2610.39150.5220.6525SE +/- 0.00, N = 3SE +/- 0.00, N = 30.580.44MIN: 0.31 / MAX: 53.91MIN: 0.22 / MAX: 56.41. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie

OpenVINO

Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPUXeon w-3495X AVX512Xeon w-3495X AMX20K40K60K80K100KSE +/- 161.53, N = 3SE +/- 164.95, N = 383346.63108321.981. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie

OpenVINO

Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Age Gender Recognition Retail 0013 FP16 - Device: CPUXeon w-3495X AVX512Xeon w-3495X AMX0.31280.62560.93841.25121.564SE +/- 0.00, N = 3SE +/- 0.00, N = 31.390.54MIN: 0.75 / MAX: 56.29MIN: 0.24 / MAX: 58.791. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie

OpenVINO

Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Age Gender Recognition Retail 0013 FP16 - Device: CPUXeon w-3495X AVX512Xeon w-3495X AMX20K40K60K80K100KSE +/- 23.18, N = 3SE +/- 84.22, N = 336540.9292228.811. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie

OpenVINO

Model: Weld Porosity Detection FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Weld Porosity Detection FP16 - Device: CPUXeon w-3495X AVX512Xeon w-3495X AMX1020304050SE +/- 0.00, N = 3SE +/- 0.00, N = 343.895.93MIN: 22.33 / MAX: 445.64MIN: 2.12 / MAX: 285.011. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie

OpenVINO

Model: Weld Porosity Detection FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Weld Porosity Detection FP16 - Device: CPUXeon w-3495X AVX512Xeon w-3495X AMX2K4K6K8K10KSE +/- 0.13, N = 3SE +/- 10.11, N = 31275.079400.661. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie

OpenVINO

Model: Weld Porosity Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Weld Porosity Detection FP16-INT8 - Device: CPUXeon w-3495X AVX512Xeon w-3495X AMX246810SE +/- 0.06, N = 3SE +/- 0.00, N = 36.263.17MIN: 3.38 / MAX: 133.59MIN: 1.39 / MAX: 63.131. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie

OpenVINO

Model: Weld Porosity Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Weld Porosity Detection FP16-INT8 - Device: CPUXeon w-3495X AVX512Xeon w-3495X AMX4K8K12K16K20KSE +/- 87.78, N = 3SE +/- 5.37, N = 38914.8517538.091. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie

CPU Temperature Monitor

Phoronix Test Suite System Monitoring

OpenBenchmarking.orgCelsiusCPU Temperature MonitorPhoronix Test Suite System MonitoringXeon w-3495X AVX512Xeon w-3495X AMX20406080100Min: 31 / Avg: 67.73 / Max: 89Min: 47 / Avg: 79.63 / Max: 90

CPU Power Consumption Monitor

Phoronix Test Suite System Monitoring

OpenBenchmarking.orgWattsCPU Power Consumption MonitorPhoronix Test Suite System MonitoringXeon w-3495X AVX512Xeon w-3495X AMX110220330440550Min: 92.98 / Avg: 426.33 / Max: 644.43Min: 58.72 / Avg: 395.56 / Max: 516.63

CPU Peak Freq (Highest CPU Core Frequency) Monitor

Phoronix Test Suite System Monitoring

OpenBenchmarking.orgMegahertzCPU Peak Freq (Highest CPU Core Frequency) MonitorPhoronix Test Suite System MonitoringXeon w-3495X AVX512Xeon w-3495X AMX8001600240032004000Min: 1900 / Avg: 2590.26 / Max: 4300Min: 510 / Avg: 2083.98 / Max: 4517

OpenVINO

CPU Temperature Monitor

MinAvgMaxXeon w-3495X AVX51237.067.271.0Xeon w-3495X AMX65.087.090.0OpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2023.2.devCPU Temperature Monitor20406080100

OpenVINO

CPU Power Consumption Monitor

MinAvgMaxXeon w-3495X AVX51294.2443.0481.6Xeon w-3495X AMX79.3332.5497.5OpenBenchmarking.orgWatts, Fewer Is BetterOpenVINO 2023.2.devCPU Power Consumption Monitor130260390520650

OpenVINO

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxXeon w-3495X AVX512190026254204Xeon w-3495X AMX51012304300OpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2023.2.devCPU Peak Freq (Highest CPU Core Frequency) Monitor11002200330044005500

OpenVINO

CPU Temperature Monitor

MinAvgMaxXeon w-3495X AVX51237.066.570.0Xeon w-3495X AMX57.085.390.0OpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2023.2.devCPU Temperature Monitor20406080100

OpenVINO

CPU Power Consumption Monitor

MinAvgMaxXeon w-3495X AVX51294.0440.3475.4Xeon w-3495X AMX108.8375.1516.6OpenBenchmarking.orgWatts, Fewer Is BetterOpenVINO 2023.2.devCPU Power Consumption Monitor130260390520650

OpenVINO

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxXeon w-3495X AVX512190025654158Xeon w-3495X AMX55614514300OpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2023.2.devCPU Peak Freq (Highest CPU Core Frequency) Monitor11002200330044005500

OpenVINO

CPU Temperature Monitor

MinAvgMaxXeon w-3495X AVX51237.065.970.0Xeon w-3495X AMX59.085.189.0OpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2023.2.devCPU Temperature Monitor20406080100

OpenVINO

CPU Power Consumption Monitor

MinAvgMaxXeon w-3495X AVX51294.0429.1461.4Xeon w-3495X AMX120.3396.1469.7OpenBenchmarking.orgWatts, Fewer Is BetterOpenVINO 2023.2.devCPU Power Consumption Monitor120240360480600

OpenVINO

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxXeon w-3495X AVX512190027463011Xeon w-3495X AMX180022064300OpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2023.2.devCPU Peak Freq (Highest CPU Core Frequency) Monitor11002200330044005500

OpenVINO

CPU Temperature Monitor

MinAvgMaxXeon w-3495X AVX51239.065.269.0Xeon w-3495X AMX55.083.387.0OpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2023.2.devCPU Temperature Monitor20406080100

OpenVINO

CPU Power Consumption Monitor

MinAvgMaxXeon w-3495X AVX51293.5424.8456.3Xeon w-3495X AMX111.8400.9478.2OpenBenchmarking.orgWatts, Fewer Is BetterOpenVINO 2023.2.devCPU Power Consumption Monitor120240360480600

OpenVINO

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxXeon w-3495X AVX512190025083399Xeon w-3495X AMX150020844199OpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2023.2.devCPU Peak Freq (Highest CPU Core Frequency) Monitor11002200330044005500

OpenVINO

CPU Temperature Monitor

MinAvgMaxXeon w-3495X AVX51237.073.179.0Xeon w-3495X AMX54.081.886.0OpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2023.2.devCPU Temperature Monitor20406080100

OpenVINO

CPU Power Consumption Monitor

MinAvgMaxXeon w-3495X AVX51294.3488.3537.7Xeon w-3495X AMX110.6429.5497.9OpenBenchmarking.orgWatts, Fewer Is BetterOpenVINO 2023.2.devCPU Power Consumption Monitor140280420560700

OpenVINO

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxXeon w-3495X AVX512190027384200Xeon w-3495X AMX170021444351OpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2023.2.devCPU Peak Freq (Highest CPU Core Frequency) Monitor11002200330044005500

OpenVINO

CPU Temperature Monitor

MinAvgMaxXeon w-3495X AVX51233.065.270.0Xeon w-3495X AMX49.080.884.0OpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2023.2.devCPU Temperature Monitor20406080100

OpenVINO

CPU Power Consumption Monitor

MinAvgMaxXeon w-3495X AVX51293.1430.8460.6Xeon w-3495X AMX99.1431.0495.5OpenBenchmarking.orgWatts, Fewer Is BetterOpenVINO 2023.2.devCPU Power Consumption Monitor130260390520650

OpenVINO

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxXeon w-3495X AVX512190025364200Xeon w-3495X AMX150020674300OpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2023.2.devCPU Peak Freq (Highest CPU Core Frequency) Monitor11002200330044005500

OpenVINO

CPU Temperature Monitor

MinAvgMaxXeon w-3495X AVX51239.063.667.0Xeon w-3495X AMX50.077.882.0OpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2023.2.devCPU Temperature Monitor20406080100

OpenVINO

CPU Power Consumption Monitor

MinAvgMaxXeon w-3495X AVX51293.6406.4439.0Xeon w-3495X AMX108.6426.2484.9OpenBenchmarking.orgWatts, Fewer Is BetterOpenVINO 2023.2.devCPU Power Consumption Monitor120240360480600

OpenVINO

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxXeon w-3495X AVX512190025664281Xeon w-3495X AMX160021684409OpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2023.2.devCPU Peak Freq (Highest CPU Core Frequency) Monitor11002200330044005500

OpenVINO

CPU Temperature Monitor

MinAvgMaxXeon w-3495X AVX51241.070.875.0Xeon w-3495X AMX48.076.580.0OpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2023.2.devCPU Temperature Monitor20406080100

OpenVINO

CPU Power Consumption Monitor

MinAvgMaxXeon w-3495X AVX51294.3456.3487.3Xeon w-3495X AMX98.1453.8494.4OpenBenchmarking.orgWatts, Fewer Is BetterOpenVINO 2023.2.devCPU Power Consumption Monitor130260390520650

OpenVINO

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxXeon w-3495X AVX512190025583747Xeon w-3495X AMX190025574260OpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2023.2.devCPU Peak Freq (Highest CPU Core Frequency) Monitor11002200330044005500

OpenVINO

CPU Temperature Monitor

MinAvgMaxXeon w-3495X AVX51235.080.786.0Xeon w-3495X AMX48.075.379.0OpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2023.2.devCPU Temperature Monitor20406080100

OpenVINO

CPU Power Consumption Monitor

MinAvgMaxXeon w-3495X AVX51293.1551.1615.5Xeon w-3495X AMX111.6463.4505.2OpenBenchmarking.orgWatts, Fewer Is BetterOpenVINO 2023.2.devCPU Power Consumption Monitor160320480640800

OpenVINO

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxXeon w-3495X AVX512190026913985Xeon w-3495X AMX190025074300OpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2023.2.devCPU Peak Freq (Highest CPU Core Frequency) Monitor11002200330044005500

OpenVINO

CPU Temperature Monitor

MinAvgMaxXeon w-3495X AVX51237.066.272.0Xeon w-3495X AMX48.073.778.0OpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2023.2.devCPU Temperature Monitor20406080100

OpenVINO

CPU Power Consumption Monitor

MinAvgMaxXeon w-3495X AVX51293.3399.8461.3Xeon w-3495X AMX107.0411.8442.1OpenBenchmarking.orgWatts, Fewer Is BetterOpenVINO 2023.2.devCPU Power Consumption Monitor120240360480600

OpenVINO

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxXeon w-3495X AVX512190024984296Xeon w-3495X AMX190023212900OpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2023.2.devCPU Peak Freq (Highest CPU Core Frequency) Monitor11002200330044005500

OpenVINO

CPU Temperature Monitor

MinAvgMaxXeon w-3495X AVX51237.082.189.0Xeon w-3495X AMX51.074.878.0OpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2023.2.devCPU Temperature Monitor20406080100

OpenVINO

CPU Power Consumption Monitor

MinAvgMaxXeon w-3495X AVX51293549644Xeon w-3495X AMX101417451OpenBenchmarking.orgWatts, Fewer Is BetterOpenVINO 2023.2.devCPU Power Consumption Monitor2004006008001000

OpenVINO

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxXeon w-3495X AVX512190025842901Xeon w-3495X AMX190023444517OpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2023.2.devCPU Peak Freq (Highest CPU Core Frequency) Monitor12002400360048006000

OpenVINO

CPU Temperature Monitor

MinAvgMaxXeon w-3495X AVX51237.066.170.0Xeon w-3495X AMX49.076.480.0OpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2023.2.devCPU Temperature Monitor20406080100

OpenVINO

CPU Power Consumption Monitor

MinAvgMaxXeon w-3495X AVX51294.3419.1454.9Xeon w-3495X AMX100.8442.3482.3OpenBenchmarking.orgWatts, Fewer Is BetterOpenVINO 2023.2.devCPU Power Consumption Monitor120240360480600

OpenVINO

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxXeon w-3495X AVX512190026314300Xeon w-3495X AMX190027314315OpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2023.2.devCPU Peak Freq (Highest CPU Core Frequency) Monitor11002200330044005500

OpenVINO

CPU Temperature Monitor

MinAvgMaxXeon w-3495X AVX51238.066.370.0Xeon w-3495X AMX48.075.680.0OpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2023.2.devCPU Temperature Monitor20406080100

OpenVINO

CPU Power Consumption Monitor

MinAvgMaxXeon w-3495X AVX51294.0418.3454.9Xeon w-3495X AMX104.8441.1479.2OpenBenchmarking.orgWatts, Fewer Is BetterOpenVINO 2023.2.devCPU Power Consumption Monitor120240360480600

OpenVINO

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxXeon w-3495X AVX512190026804300Xeon w-3495X AMX190026804336OpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2023.2.devCPU Peak Freq (Highest CPU Core Frequency) Monitor11002200330044005500

OpenVINO

CPU Temperature Monitor

MinAvgMaxXeon w-3495X AVX51238.067.672.0Xeon w-3495X AMX47.071.875.0OpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2023.2.devCPU Temperature Monitor20406080100

OpenVINO

CPU Power Consumption Monitor

MinAvgMaxXeon w-3495X AVX51294.0431.1461.2Xeon w-3495X AMX99.7395.8422.7OpenBenchmarking.orgWatts, Fewer Is BetterOpenVINO 2023.2.devCPU Power Consumption Monitor120240360480600

OpenVINO

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxXeon w-3495X AVX512190025724253Xeon w-3495X AMX190023634324OpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2023.2.devCPU Peak Freq (Highest CPU Core Frequency) Monitor11002200330044005500

OpenVINO

CPU Temperature Monitor

MinAvgMaxXeon w-3495X AVX51241.068.172.0Xeon w-3495X AMX48.073.878.0OpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2023.2.devCPU Temperature Monitor20406080100

OpenVINO

CPU Power Consumption Monitor

MinAvgMaxXeon w-3495X AVX51294.6426.1461.1Xeon w-3495X AMX58.7416.5444.3OpenBenchmarking.orgWatts, Fewer Is BetterOpenVINO 2023.2.devCPU Power Consumption Monitor120240360480600

OpenVINO

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxXeon w-3495X AVX512190025224200Xeon w-3495X AMX190024054300OpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2023.2.devCPU Peak Freq (Highest CPU Core Frequency) Monitor11002200330044005500

OpenVINO

CPU Temperature Monitor

MinAvgMaxXeon w-3495X AVX51237.082.289.0Xeon w-3495X AMX50.074.879.0OpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2023.2.devCPU Temperature Monitor20406080100

OpenVINO

CPU Power Consumption Monitor

MinAvgMaxXeon w-3495X AVX51293.9539.7621.8Xeon w-3495X AMX111.5425.0468.6OpenBenchmarking.orgWatts, Fewer Is BetterOpenVINO 2023.2.devCPU Power Consumption Monitor160320480640800

OpenVINO

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxXeon w-3495X AVX512190027244300Xeon w-3495X AMX190026604306OpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2023.2.devCPU Peak Freq (Highest CPU Core Frequency) Monitor11002200330044005500

OpenVINO

CPU Temperature Monitor

MinAvgMaxXeon w-3495X AVX51231.063.370.0Xeon w-3495X AMX48.074.579.0OpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2023.2.devCPU Temperature Monitor20406080100

OpenVINO

CPU Power Consumption Monitor

MinAvgMaxXeon w-3495X AVX51295.5400.9446.6Xeon w-3495X AMX109.2420.4457.3OpenBenchmarking.orgWatts, Fewer Is BetterOpenVINO 2023.2.devCPU Power Consumption Monitor120240360480600

OpenVINO

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxXeon w-3495X AVX512190026674200Xeon w-3495X AMX190026604370OpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2023.2.devCPU Peak Freq (Highest CPU Core Frequency) Monitor11002200330044005500

Phoronix Test Suite v10.8.5