Core i9-7980XE AVX512

Intel Xeon w9-3495X testing with a ASUS Pro WS W790E-SAGE SE (0705 BIOS) and NVIDIA GeForce RTX 4090 24GB on Ubuntu 23.10 via the Phoronix Test Suite.

HTML result view exported from: https://openbenchmarking.org/result/2312071-NE-2312068NE72&sor&grt.

Core i9-7980XE AVX512ProcessorMotherboardChipsetMemoryDiskGraphicsAudioNetworkOSKernelDesktopDisplay ServerDisplay DriverOpenGLVulkanCompilerFile-SystemScreen ResolutionOpenCLCore i9-7980XE AVX512Xeon w9-3495X AVX512Xeon w9-3495X AMXIntel Core i9-7980XE @ 4.40GHz (18 Cores / 36 Threads)Supermicro C9X299-RPGF v1.01 (2.5 BIOS)Intel Sky Lake-E DMI3 Registers8 x 16 GB DDR4-2666MT/s Kingston2 x 1024GB Samsung SSD 970 PRO 1TB + 1600GB INTEL SSDPE2ME016T4llvmpipe (300/405MHz)NVIDIA TU102 HD AudioAquantia AQC108 NBase-T/IEEE + Intel I210Ubuntu 22.046.2.0-36-generic (x86_64)GNOME Shell 42.9X Server 1.21.1.3NVIDIA 535.129.034.5 Mesa 23.0.4-0ubuntu1~22.04.1 (LLVM 15.0.7 256 bits)1.3.242GCC 11.4.0 + CUDA 12.1ext41920x1200Intel Xeon w9-3495X @ 4.80GHz (56 Cores / 112 Threads)ASUS Pro WS W790E-SAGE SE (0705 BIOS)Intel Alder Lake-S PCH8 x 32 GB DDR5-4812MT/s Hynix HMCG88AEBRA115N1024GB SAMSUNG MZVL21T0HCLR-00BL2 + 0GB Virtual HDisk0NVIDIA GeForce RTX 4090 24GBRealtek ALC12202 x Intel X710 for 10GBASE-TUbuntu 23.106.5.0-13-generic (x86_64)GNOME Shell 45.1X Server 1.21.1.74.6.0OpenCL 3.0 CUDA 12.2.147GCC 13.2.0 + CUDA 12.26.5.0-14-generic (x86_64)OpenBenchmarking.orgKernel Details- Transparent Huge Pages: madviseCompiler Details- Core i9-7980XE AVX512: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-bootstrap --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-link-serialization=2 --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none=/build/gcc-11-XeT9lY/gcc-11-11.4.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-11-XeT9lY/gcc-11-11.4.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-build-config=bootstrap-lto-lean --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v - Xeon w9-3495X AVX512: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-bootstrap --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-link-serialization=2 --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-defaulted --enable-offload-targets=nvptx-none=/build/gcc-13-XYspKM/gcc-13-13.2.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-13-XYspKM/gcc-13-13.2.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-build-config=bootstrap-lto-lean --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v - Xeon w9-3495X AMX: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-bootstrap --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-link-serialization=2 --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-defaulted --enable-offload-targets=nvptx-none=/build/gcc-13-XYspKM/gcc-13-13.2.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-13-XYspKM/gcc-13-13.2.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-build-config=bootstrap-lto-lean --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v Processor Details- Core i9-7980XE AVX512: Scaling Governor: intel_cpufreq schedutil - CPU Microcode: 0x2007006- Xeon w9-3495X AVX512: Scaling Governor: intel_pstate powersave (EPP: performance) - CPU Microcode: 0x2b0004d0- Xeon w9-3495X AMX: Scaling Governor: intel_pstate powersave (EPP: performance) - CPU Microcode: 0x2b0004d0Python Details- Core i9-7980XE AVX512: Python 3.10.12- Xeon w9-3495X AVX512: Python 3.10.9- Xeon w9-3495X AMX: Python 3.10.9Security Details- Core i9-7980XE AVX512: gather_data_sampling: Mitigation of Microcode + itlb_multihit: KVM: Mitigation of VMX disabled + l1tf: Mitigation of PTE Inversion; VMX: conditional cache flushes SMT vulnerable + mds: Mitigation of Clear buffers; SMT vulnerable + meltdown: Mitigation of PTI + mmio_stale_data: Mitigation of Clear buffers; SMT vulnerable + retbleed: Mitigation of IBRS + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of IBRS IBPB: conditional STIBP: conditional RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Mitigation of Clear buffers; SMT vulnerable - Xeon w9-3495X AVX512: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Not affected - Xeon w9-3495X AMX: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Not affected

Core i9-7980XE AVX512openvino: Face Detection FP16 - CPUopenvino: Face Detection FP16 - CPUopenvino: Face Detection FP16-INT8 - CPUopenvino: Face Detection FP16-INT8 - CPUopenvino: Age Gender Recognition Retail 0013 FP16 - CPUopenvino: Age Gender Recognition Retail 0013 FP16 - CPUopenvino: Age Gender Recognition Retail 0013 FP16-INT8 - CPUopenvino: Age Gender Recognition Retail 0013 FP16-INT8 - CPUopenvino: Person Detection FP16 - CPUopenvino: Person Detection FP16 - CPUopenvino: Person Detection FP32 - CPUopenvino: Person Detection FP32 - CPUopenvino: Weld Porosity Detection FP16-INT8 - CPUopenvino: Weld Porosity Detection FP16-INT8 - CPUopenvino: Weld Porosity Detection FP16 - CPUopenvino: Weld Porosity Detection FP16 - CPUopenvino: Vehicle Detection FP16-INT8 - CPUopenvino: Vehicle Detection FP16-INT8 - CPUopenvino: Vehicle Detection FP16 - CPUopenvino: Vehicle Detection FP16 - CPUopenvino: Person Vehicle Bike Detection FP16 - CPUopenvino: Person Vehicle Bike Detection FP16 - CPUopenvino: Machine Translation EN To DE FP16 - CPUopenvino: Machine Translation EN To DE FP16 - CPUopenvino: Face Detection Retail FP16 - CPUopenvino: Face Detection Retail FP16 - CPUopenvino: Face Detection Retail FP16-INT8 - CPUopenvino: Face Detection Retail FP16-INT8 - CPUopenvino: Handwritten English Recognition FP16 - CPUopenvino: Handwritten English Recognition FP16 - CPUopenvino: Handwritten English Recognition FP16-INT8 - CPUopenvino: Handwritten English Recognition FP16-INT8 - CPUopenvino: Road Segmentation ADAS FP16 - CPUopenvino: Road Segmentation ADAS FP16 - CPUopenvino: Road Segmentation ADAS FP16-INT8 - CPUopenvino: Road Segmentation ADAS FP16-INT8 - CPUCore i9-7980XE AVX512Xeon w9-3495X AVX512Xeon w9-3495X AMX6.891728.0410.371151.7916524.061.0723185.570.7532.36370.2632.31370.831064.7816.89702.7625.58694.2717.26179.1366.92488.3824.5476.63156.421009.7711.852062.088.71115.31155.97125.54143.2572.01166.50277.8643.1512.322265.7194.98294.2236085.651.4183679.680.58131.16213.32131.00213.619580.845.841279.4143.754441.346.291075.4826.011597.9817.51178.67156.553068.589.1111300.444.93861.6764.94901.1562.11538.0151.971162.9923.9777.54360.30166.20336.1890854.420.54108111.820.44289.9296.50289.7296.5617651.483.169514.635.873208.6917.431913.4814.593642.7915.34459.9660.656543.618.5410200.325.481596.7535.051242.4445.04779.8035.841095.1251.06OpenBenchmarking.org

CPU Peak Freq (Highest CPU Core Frequency) Monitor

Phoronix Test Suite System Monitoring

OpenBenchmarking.orgMegahertzCPU Peak Freq (Highest CPU Core Frequency) MonitorPhoronix Test Suite System MonitoringXeon w9-3495X AMXXeon w9-3495X AVX512Core i9-7980XE AVX5128001600240032004000Min: 800 / Avg: 2358.19 / Max: 4800Min: 800 / Avg: 2448.67 / Max: 4800Min: 1200 / Avg: 2654.38 / Max: 4200

CPU Power Consumption Monitor

Phoronix Test Suite System Monitoring

OpenBenchmarking.orgWattsCPU Power Consumption MonitorPhoronix Test Suite System MonitoringCore i9-7980XE AVX512Xeon w9-3495X AMXXeon w9-3495X AVX512110220330440550Min: 12.81 / Avg: 151.76 / Max: 213.09Min: 55.12 / Avg: 377.02 / Max: 464.87Min: 83.79 / Avg: 413.17 / Max: 621.26

CPU Temperature Monitor

Phoronix Test Suite System Monitoring

OpenBenchmarking.orgCelsiusCPU Temperature MonitorPhoronix Test Suite System MonitoringCore i9-7980XE AVX512Xeon w9-3495X AMXXeon w9-3495X AVX5121326395265Min: 25 / Avg: 36.96 / Max: 43Min: 19 / Avg: 37.25 / Max: 44Min: 26 / Avg: 47.01 / Max: 65

OpenVINO

Model: Face Detection FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Face Detection FP16 - Device: CPUXeon w9-3495X AMXXeon w9-3495X AVX512Core i9-7980XE AVX51220406080100SE +/- 0.14, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 377.5412.326.891. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie

OpenVINO

Model: Face Detection FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Face Detection FP16 - Device: CPUXeon w9-3495X AMXCore i9-7980XE AVX512Xeon w9-3495X AVX5125001000150020002500SE +/- 0.64, N = 3SE +/- 1.70, N = 3SE +/- 0.67, N = 3360.301728.042265.71MIN: 113.6 / MAX: 404.23MIN: 924.93 / MAX: 1876.1MIN: 2165.62 / MAX: 2447.31. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie

OpenVINO

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxCore i9-7980XE AVX512120127963832Xeon w9-3495X AMX80025754800Xeon w9-3495X AVX51280025424400OpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2023.2.devCPU Peak Freq (Highest CPU Core Frequency) Monitor12002400360048006000

OpenVINO

CPU Power Consumption Monitor

MinAvgMaxCore i9-7980XE AVX51225.2185.9213.1Xeon w9-3495X AMX85.3384.3418.0Xeon w9-3495X AVX51286.0388.0429.4OpenBenchmarking.orgWatts, Fewer Is BetterOpenVINO 2023.2.devCPU Power Consumption Monitor110220330440550

OpenVINO

CPU Temperature Monitor

MinAvgMaxXeon w9-3495X AMX20.036.340.0Core i9-7980XE AVX51225.039.043.0Xeon w9-3495X AVX51229.047.351.0OpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2023.2.devCPU Temperature Monitor1530456075

OpenVINO

Model: Face Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Face Detection FP16-INT8 - Device: CPUXeon w9-3495X AMXXeon w9-3495X AVX512Core i9-7980XE AVX5124080120160200SE +/- 0.08, N = 3SE +/- 0.02, N = 3SE +/- 0.00, N = 3166.2094.9810.371. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie

OpenVINO

Model: Face Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Face Detection FP16-INT8 - Device: CPUXeon w9-3495X AVX512Xeon w9-3495X AMXCore i9-7980XE AVX5122004006008001000SE +/- 0.15, N = 3SE +/- 0.14, N = 3SE +/- 0.18, N = 3294.22336.181151.79MIN: 134.33 / MAX: 325MIN: 120.23 / MAX: 371.04MIN: 854.11 / MAX: 1231.911. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie

OpenVINO

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxCore i9-7980XE AVX512120027713913Xeon w9-3495X AVX51280027224611Xeon w9-3495X AMX80025984800OpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2023.2.devCPU Peak Freq (Highest CPU Core Frequency) Monitor12002400360048006000

OpenVINO

CPU Power Consumption Monitor

MinAvgMaxCore i9-7980XE AVX51225.3157.3174.6Xeon w9-3495X AMX84.4388.8428.2Xeon w9-3495X AVX51285.9540.9596.3OpenBenchmarking.orgWatts, Fewer Is BetterOpenVINO 2023.2.devCPU Power Consumption Monitor160320480640800

OpenVINO

CPU Temperature Monitor

MinAvgMaxXeon w9-3495X AMX22.037.440.0Core i9-7980XE AVX51227.037.641.0Xeon w9-3495X AVX51234.060.365.0OpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2023.2.devCPU Temperature Monitor20406080100

OpenVINO

Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Age Gender Recognition Retail 0013 FP16 - Device: CPUXeon w9-3495X AMXXeon w9-3495X AVX512Core i9-7980XE AVX51220K40K60K80K100KSE +/- 21.27, N = 3SE +/- 16.00, N = 3SE +/- 16.83, N = 390854.4236085.6516524.061. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie

OpenVINO

Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Age Gender Recognition Retail 0013 FP16 - Device: CPUXeon w9-3495X AMXCore i9-7980XE AVX512Xeon w9-3495X AVX5120.31730.63460.95191.26921.5865SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 30.541.071.41MIN: 0.24 / MAX: 17.71MIN: 0.61 / MAX: 22.1MIN: 0.74 / MAX: 12.831. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie

OpenVINO

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxCore i9-7980XE AVX512120027033475Xeon w9-3495X AVX51280024473065Xeon w9-3495X AMX80023204336OpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2023.2.devCPU Peak Freq (Highest CPU Core Frequency) Monitor11002200330044005500

OpenVINO

CPU Power Consumption Monitor

MinAvgMaxCore i9-7980XE AVX51225.5176.5190.6Xeon w9-3495X AMX83.7379.1408.0Xeon w9-3495X AVX51284.9405.1436.6OpenBenchmarking.orgWatts, Fewer Is BetterOpenVINO 2023.2.devCPU Power Consumption Monitor110220330440550

OpenVINO

CPU Temperature Monitor

MinAvgMaxXeon w9-3495X AMX23.036.739.0Core i9-7980XE AVX51227.039.041.0Xeon w9-3495X AVX51231.045.748.0OpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2023.2.devCPU Temperature Monitor1428425670

OpenVINO

Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPUXeon w9-3495X AMXXeon w9-3495X AVX512Core i9-7980XE AVX51220K40K60K80K100KSE +/- 200.26, N = 3SE +/- 155.97, N = 3SE +/- 15.14, N = 3108111.8283679.6823185.571. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie

OpenVINO

Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPUXeon w9-3495X AMXXeon w9-3495X AVX512Core i9-7980XE AVX5120.16880.33760.50640.67520.844SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 30.440.580.75MIN: 0.23 / MAX: 16.5MIN: 0.31 / MAX: 17.47MIN: 0.45 / MAX: 20.041. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie

OpenVINO

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxCore i9-7980XE AVX512120027053472Xeon w9-3495X AVX51280025014441Xeon w9-3495X AMX80023264426OpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2023.2.devCPU Peak Freq (Highest CPU Core Frequency) Monitor12002400360048006000

OpenVINO

CPU Power Consumption Monitor

MinAvgMaxCore i9-7980XE AVX51225.4160.1171.8Xeon w9-3495X AMX84.6364.1391.8Xeon w9-3495X AVX51284.1410.7443.5OpenBenchmarking.orgWatts, Fewer Is BetterOpenVINO 2023.2.devCPU Power Consumption Monitor120240360480600

OpenVINO

CPU Temperature Monitor

MinAvgMaxXeon w9-3495X AMX23.035.738.0Core i9-7980XE AVX51227.038.039.0Xeon w9-3495X AVX51231.048.651.0OpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2023.2.devCPU Temperature Monitor1530456075

OpenVINO

Model: Person Detection FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Person Detection FP16 - Device: CPUXeon w9-3495X AMXXeon w9-3495X AVX512Core i9-7980XE AVX51260120180240300SE +/- 0.52, N = 3SE +/- 0.05, N = 3SE +/- 0.02, N = 3289.92131.1632.361. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie

OpenVINO

Model: Person Detection FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Person Detection FP16 - Device: CPUXeon w9-3495X AMXXeon w9-3495X AVX512Core i9-7980XE AVX51280160240320400SE +/- 0.16, N = 3SE +/- 0.10, N = 3SE +/- 0.29, N = 396.50213.32370.26MIN: 36.72 / MAX: 138.57MIN: 118.86 / MAX: 242.74MIN: 163.39 / MAX: 489.161. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie

OpenVINO

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxCore i9-7980XE AVX512120027853907Xeon w9-3495X AMX80025914400Xeon w9-3495X AVX51280025374400OpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2023.2.devCPU Peak Freq (Highest CPU Core Frequency) Monitor11002200330044005500

OpenVINO

CPU Power Consumption Monitor

MinAvgMaxCore i9-7980XE AVX51225.4138.9152.4Xeon w9-3495X AMX84.2395.5431.5Xeon w9-3495X AVX51286.3400.5433.3OpenBenchmarking.orgWatts, Fewer Is BetterOpenVINO 2023.2.devCPU Power Consumption Monitor110220330440550

OpenVINO

CPU Temperature Monitor

MinAvgMaxCore i9-7980XE AVX51226.035.539.0Xeon w9-3495X AMX23.037.140.0Xeon w9-3495X AVX51234.049.252.0OpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2023.2.devCPU Temperature Monitor1530456075

OpenVINO

Model: Person Detection FP32 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Person Detection FP32 - Device: CPUXeon w9-3495X AMXXeon w9-3495X AVX512Core i9-7980XE AVX51260120180240300SE +/- 0.27, N = 3SE +/- 0.01, N = 3SE +/- 0.06, N = 3289.72131.0032.311. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie

OpenVINO

Model: Person Detection FP32 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Person Detection FP32 - Device: CPUXeon w9-3495X AMXXeon w9-3495X AVX512Core i9-7980XE AVX51280160240320400SE +/- 0.09, N = 3SE +/- 0.03, N = 3SE +/- 0.72, N = 396.56213.61370.83MIN: 30.66 / MAX: 137.73MIN: 121.31 / MAX: 240.33MIN: 174.7 / MAX: 480.361. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie

OpenVINO

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxCore i9-7980XE AVX512120028023764Xeon w9-3495X AMX80026044419Xeon w9-3495X AVX51280025474800OpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2023.2.devCPU Peak Freq (Highest CPU Core Frequency) Monitor12002400360048006000

OpenVINO

CPU Power Consumption Monitor

MinAvgMaxCore i9-7980XE AVX51225.2141.2155.3Xeon w9-3495X AMX84.8395.5434.0Xeon w9-3495X AVX51285.5399.4433.4OpenBenchmarking.orgWatts, Fewer Is BetterOpenVINO 2023.2.devCPU Power Consumption Monitor110220330440550

OpenVINO

CPU Temperature Monitor

MinAvgMaxCore i9-7980XE AVX51227.035.741.0Xeon w9-3495X AMX23.037.740.0Xeon w9-3495X AVX51234.048.552.0OpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2023.2.devCPU Temperature Monitor1530456075

OpenVINO

Model: Weld Porosity Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Weld Porosity Detection FP16-INT8 - Device: CPUXeon w9-3495X AMXXeon w9-3495X AVX512Core i9-7980XE AVX5124K8K12K16K20KSE +/- 8.07, N = 3SE +/- 3.32, N = 3SE +/- 0.58, N = 317651.489580.841064.781. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie

OpenVINO

Model: Weld Porosity Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Weld Porosity Detection FP16-INT8 - Device: CPUXeon w9-3495X AMXXeon w9-3495X AVX512Core i9-7980XE AVX51248121620SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.01, N = 33.165.8416.89MIN: 1.4 / MAX: 19.31MIN: 3.32 / MAX: 25.54MIN: 10.44 / MAX: 36.991. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie

OpenVINO

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxCore i9-7980XE AVX512120027123328Xeon w9-3495X AVX51280026944300Xeon w9-3495X AMX80021983714OpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2023.2.devCPU Peak Freq (Highest CPU Core Frequency) Monitor11002200330044005500

OpenVINO

CPU Power Consumption Monitor

MinAvgMaxCore i9-7980XE AVX51225.2162.5174.7Xeon w9-3495X AMX82.3385.6416.0Xeon w9-3495X AVX51285.5571.8621.3OpenBenchmarking.orgWatts, Fewer Is BetterOpenVINO 2023.2.devCPU Power Consumption Monitor160320480640800

OpenVINO

CPU Temperature Monitor

MinAvgMaxXeon w9-3495X AMX24.037.940.0Core i9-7980XE AVX51226.038.139.0Xeon w9-3495X AVX51231.059.264.0OpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2023.2.devCPU Temperature Monitor20406080100

OpenVINO

Model: Weld Porosity Detection FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Weld Porosity Detection FP16 - Device: CPUXeon w9-3495X AMXXeon w9-3495X AVX512Core i9-7980XE AVX5122K4K6K8K10KSE +/- 3.81, N = 3SE +/- 0.19, N = 3SE +/- 1.14, N = 39514.631279.41702.761. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie

OpenVINO

Model: Weld Porosity Detection FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Weld Porosity Detection FP16 - Device: CPUXeon w9-3495X AMXCore i9-7980XE AVX512Xeon w9-3495X AVX5121020304050SE +/- 0.00, N = 3SE +/- 0.04, N = 3SE +/- 0.01, N = 35.8725.5843.75MIN: 2.08 / MAX: 20.1MIN: 15.82 / MAX: 319.73MIN: 26.61 / MAX: 61.811. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie

OpenVINO

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxCore i9-7980XE AVX512120027223835Xeon w9-3495X AVX51280023982564Xeon w9-3495X AMX80022473326OpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2023.2.devCPU Peak Freq (Highest CPU Core Frequency) Monitor10002000300040005000

OpenVINO

CPU Power Consumption Monitor

MinAvgMaxCore i9-7980XE AVX51225.4194.6210.3Xeon w9-3495X AMX83.8372.9404.2Xeon w9-3495X AVX51285.9412.3441.6OpenBenchmarking.orgWatts, Fewer Is BetterOpenVINO 2023.2.devCPU Power Consumption Monitor120240360480600

OpenVINO

CPU Temperature Monitor

MinAvgMaxXeon w9-3495X AMX23.037.240.0Core i9-7980XE AVX51226.039.842.0Xeon w9-3495X AVX51234.050.252.0OpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2023.2.devCPU Temperature Monitor1530456075

OpenVINO

Model: Vehicle Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Vehicle Detection FP16-INT8 - Device: CPUXeon w9-3495X AVX512Xeon w9-3495X AMXCore i9-7980XE AVX51210002000300040005000SE +/- 6.41, N = 3SE +/- 2.59, N = 3SE +/- 0.50, N = 34441.343208.69694.271. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie

OpenVINO

Model: Vehicle Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Vehicle Detection FP16-INT8 - Device: CPUXeon w9-3495X AVX512Core i9-7980XE AVX512Xeon w9-3495X AMX48121620SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.02, N = 36.2917.2617.43MIN: 3.98 / MAX: 24.01MIN: 10.16 / MAX: 51.62MIN: 8.16 / MAX: 49.811. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie

OpenVINO

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxCore i9-7980XE AVX512120027053319Xeon w9-3495X AVX51280026753125Xeon w9-3495X AMX80023914300OpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2023.2.devCPU Peak Freq (Highest CPU Core Frequency) Monitor11002200330044005500

OpenVINO

CPU Power Consumption Monitor

MinAvgMaxCore i9-7980XE AVX51225.4166.1180.4Xeon w9-3495X AMX83.2419.3458.8Xeon w9-3495X AVX51285.2529.5584.3OpenBenchmarking.orgWatts, Fewer Is BetterOpenVINO 2023.2.devCPU Power Consumption Monitor160320480640800

OpenVINO

CPU Temperature Monitor

MinAvgMaxCore i9-7980XE AVX51226.037.939.0Xeon w9-3495X AMX23.039.442.0Xeon w9-3495X AVX51234.059.064.0OpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2023.2.devCPU Temperature Monitor20406080100

OpenVINO

Model: Vehicle Detection FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Vehicle Detection FP16 - Device: CPUXeon w9-3495X AMXXeon w9-3495X AVX512Core i9-7980XE AVX512400800120016002000SE +/- 1.07, N = 3SE +/- 0.60, N = 3SE +/- 0.13, N = 31913.481075.48179.131. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie

OpenVINO

Model: Vehicle Detection FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Vehicle Detection FP16 - Device: CPUXeon w9-3495X AMXXeon w9-3495X AVX512Core i9-7980XE AVX5121530456075SE +/- 0.01, N = 3SE +/- 0.02, N = 3SE +/- 0.04, N = 314.5926.0166.92MIN: 6.54 / MAX: 44.91MIN: 13.73 / MAX: 42.09MIN: 31.14 / MAX: 163.431. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie

OpenVINO

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxCore i9-7980XE AVX512120027433474Xeon w9-3495X AMX80024644300Xeon w9-3495X AVX51280024573799OpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2023.2.devCPU Peak Freq (Highest CPU Core Frequency) Monitor11002200330044005500

OpenVINO

CPU Power Consumption Monitor

MinAvgMaxCore i9-7980XE AVX51225.4134.8144.3Xeon w9-3495X AMX83.9416.5450.7Xeon w9-3495X AVX51285.6429.1460.5OpenBenchmarking.orgWatts, Fewer Is BetterOpenVINO 2023.2.devCPU Power Consumption Monitor120240360480600

OpenVINO

CPU Temperature Monitor

MinAvgMaxCore i9-7980XE AVX51226.034.636.0Xeon w9-3495X AMX24.039.242.0Xeon w9-3495X AVX51234.049.753.0OpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2023.2.devCPU Temperature Monitor1530456075

OpenVINO

Model: Person Vehicle Bike Detection FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Person Vehicle Bike Detection FP16 - Device: CPUXeon w9-3495X AMXXeon w9-3495X AVX512Core i9-7980XE AVX5128001600240032004000SE +/- 5.70, N = 3SE +/- 1.46, N = 3SE +/- 0.67, N = 33642.791597.98488.381. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie

OpenVINO

Model: Person Vehicle Bike Detection FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Person Vehicle Bike Detection FP16 - Device: CPUXeon w9-3495X AMXXeon w9-3495X AVX512Core i9-7980XE AVX512612182430SE +/- 0.03, N = 3SE +/- 0.02, N = 3SE +/- 0.03, N = 315.3417.5124.54MIN: 8.18 / MAX: 37.56MIN: 10.49 / MAX: 30.45MIN: 14.19 / MAX: 60.041. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie

OpenVINO

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxCore i9-7980XE AVX512120027603753Xeon w9-3495X AVX51280024613800Xeon w9-3495X AMX80023454400OpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2023.2.devCPU Peak Freq (Highest CPU Core Frequency) Monitor11002200330044005500

OpenVINO

CPU Power Consumption Monitor

MinAvgMaxCore i9-7980XE AVX51225.4154.3168.1Xeon w9-3495X AVX51284.9385.6421.0Xeon w9-3495X AMX82.9405.3441.7OpenBenchmarking.orgWatts, Fewer Is BetterOpenVINO 2023.2.devCPU Power Consumption Monitor120240360480600

OpenVINO

CPU Temperature Monitor

MinAvgMaxCore i9-7980XE AVX51226.036.639.0Xeon w9-3495X AMX24.038.844.0Xeon w9-3495X AVX51230.042.945.0OpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2023.2.devCPU Temperature Monitor1224364860

OpenVINO

Model: Machine Translation EN To DE FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Machine Translation EN To DE FP16 - Device: CPUXeon w9-3495X AMXXeon w9-3495X AVX512Core i9-7980XE AVX512100200300400500SE +/- 1.25, N = 3SE +/- 0.09, N = 3SE +/- 0.05, N = 3459.96178.6776.631. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie

OpenVINO

Model: Machine Translation EN To DE FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Machine Translation EN To DE FP16 - Device: CPUXeon w9-3495X AMXCore i9-7980XE AVX512Xeon w9-3495X AVX512306090120150SE +/- 0.17, N = 3SE +/- 0.10, N = 3SE +/- 0.07, N = 360.65156.42156.55MIN: 20.82 / MAX: 82.28MIN: 81.1 / MAX: 208.16MIN: 106.01 / MAX: 193.651. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie

OpenVINO

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxCore i9-7980XE AVX512120027204200Xeon w9-3495X AVX51280025124552Xeon w9-3495X AMX80024834313OpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2023.2.devCPU Peak Freq (Highest CPU Core Frequency) Monitor12002400360048006000

OpenVINO

CPU Power Consumption Monitor

MinAvgMaxCore i9-7980XE AVX51217.2177.5194.7Xeon w9-3495X AMX82.8365.5404.8Xeon w9-3495X AVX51285.8415.6452.7OpenBenchmarking.orgWatts, Fewer Is BetterOpenVINO 2023.2.devCPU Power Consumption Monitor120240360480600

OpenVINO

CPU Temperature Monitor

MinAvgMaxXeon w9-3495X AMX24.036.539.0Core i9-7980XE AVX51226.037.840.0Xeon w9-3495X AVX51228.044.146.0OpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2023.2.devCPU Temperature Monitor1224364860

OpenVINO

Model: Face Detection Retail FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Face Detection Retail FP16 - Device: CPUXeon w9-3495X AMXXeon w9-3495X AVX512Core i9-7980XE AVX51214002800420056007000SE +/- 1.33, N = 3SE +/- 2.53, N = 3SE +/- 1.56, N = 36543.613068.581009.771. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie

OpenVINO

Model: Face Detection Retail FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Face Detection Retail FP16 - Device: CPUXeon w9-3495X AMXXeon w9-3495X AVX512Core i9-7980XE AVX5123691215SE +/- 0.00, N = 3SE +/- 0.01, N = 3SE +/- 0.02, N = 38.549.1111.85MIN: 4.83 / MAX: 25.87MIN: 4.86 / MAX: 21.78MIN: 5.06 / MAX: 83.341. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie

OpenVINO

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxCore i9-7980XE AVX512120027233342Xeon w9-3495X AVX51280024242568Xeon w9-3495X AMX80023323408OpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2023.2.devCPU Peak Freq (Highest CPU Core Frequency) Monitor8001600240032004000

OpenVINO

CPU Power Consumption Monitor

MinAvgMaxCore i9-7980XE AVX51225.5161.5174.1Xeon w9-3495X AVX51284.3400.4432.5Xeon w9-3495X AMX83.8418.5450.7OpenBenchmarking.orgWatts, Fewer Is BetterOpenVINO 2023.2.devCPU Power Consumption Monitor120240360480600

OpenVINO

CPU Temperature Monitor

MinAvgMaxCore i9-7980XE AVX51226.036.939.0Xeon w9-3495X AMX24.039.442.0Xeon w9-3495X AVX51228.042.244.0OpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2023.2.devCPU Temperature Monitor1224364860

OpenVINO

Model: Face Detection Retail FP16-INT8 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Face Detection Retail FP16-INT8 - Device: CPUXeon w9-3495X AVX512Xeon w9-3495X AMXCore i9-7980XE AVX5122K4K6K8K10KSE +/- 5.47, N = 3SE +/- 2.79, N = 3SE +/- 0.69, N = 311300.4410200.322062.081. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie

OpenVINO

Model: Face Detection Retail FP16-INT8 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Face Detection Retail FP16-INT8 - Device: CPUXeon w9-3495X AVX512Xeon w9-3495X AMXCore i9-7980XE AVX512246810SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 34.935.488.71MIN: 2.77 / MAX: 18.8MIN: 3.74 / MAX: 21.44MIN: 5.72 / MAX: 310.181. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie

OpenVINO

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxCore i9-7980XE AVX512120027033250Xeon w9-3495X AVX51280026624381Xeon w9-3495X AMX80022372559OpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2023.2.devCPU Peak Freq (Highest CPU Core Frequency) Monitor11002200330044005500

OpenVINO

CPU Power Consumption Monitor

MinAvgMaxCore i9-7980XE AVX51225.4163.3175.7Xeon w9-3495X AMX83.2410.6452.7Xeon w9-3495X AVX51285.0462.1504.5OpenBenchmarking.orgWatts, Fewer Is BetterOpenVINO 2023.2.devCPU Power Consumption Monitor130260390520650

OpenVINO

CPU Temperature Monitor

MinAvgMaxCore i9-7980XE AVX51226.038.840.0Xeon w9-3495X AMX24.039.442.0Xeon w9-3495X AVX51227.046.551.0OpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2023.2.devCPU Temperature Monitor1530456075

OpenVINO

Model: Handwritten English Recognition FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Handwritten English Recognition FP16 - Device: CPUXeon w9-3495X AMXXeon w9-3495X AVX512Core i9-7980XE AVX51230060090012001500SE +/- 1.69, N = 3SE +/- 0.81, N = 3SE +/- 0.85, N = 31596.75861.67115.311. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie

OpenVINO

Model: Handwritten English Recognition FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Handwritten English Recognition FP16 - Device: CPUXeon w9-3495X AMXXeon w9-3495X AVX512Core i9-7980XE AVX512306090120150SE +/- 0.04, N = 3SE +/- 0.06, N = 3SE +/- 1.16, N = 335.0564.94155.97MIN: 19.64 / MAX: 60.54MIN: 41.14 / MAX: 87.25MIN: 75.82 / MAX: 384.521. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie

OpenVINO

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxCore i9-7980XE AVX512120027113404Xeon w9-3495X AMX80025134588Xeon w9-3495X AVX51280024484300OpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2023.2.devCPU Peak Freq (Highest CPU Core Frequency) Monitor12002400360048006000

OpenVINO

CPU Power Consumption Monitor

MinAvgMaxCore i9-7980XE AVX51225.3155.4167.7Xeon w9-3495X AMX84.6393.8422.2Xeon w9-3495X AVX51283.9408.7438.6OpenBenchmarking.orgWatts, Fewer Is BetterOpenVINO 2023.2.devCPU Power Consumption Monitor120240360480600

OpenVINO

CPU Temperature Monitor

MinAvgMaxCore i9-7980XE AVX51227.036.939.0Xeon w9-3495X AMX24.038.441.0Xeon w9-3495X AVX51227.042.044.0OpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2023.2.devCPU Temperature Monitor1224364860

OpenVINO

Model: Handwritten English Recognition FP16-INT8 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Handwritten English Recognition FP16-INT8 - Device: CPUXeon w9-3495X AMXXeon w9-3495X AVX512Core i9-7980XE AVX51230060090012001500SE +/- 7.51, N = 3SE +/- 3.76, N = 3SE +/- 0.37, N = 31242.44901.15125.541. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie

OpenVINO

Model: Handwritten English Recognition FP16-INT8 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Handwritten English Recognition FP16-INT8 - Device: CPUXeon w9-3495X AMXXeon w9-3495X AVX512Core i9-7980XE AVX512306090120150SE +/- 0.27, N = 3SE +/- 0.26, N = 3SE +/- 0.43, N = 345.0462.11143.25MIN: 30.14 / MAX: 61.29MIN: 40.72 / MAX: 75.47MIN: 89.87 / MAX: 340.081. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie

OpenVINO

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxCore i9-7980XE AVX512120027213417Xeon w9-3495X AVX51280026843963Xeon w9-3495X AMX80026692955OpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2023.2.devCPU Peak Freq (Highest CPU Core Frequency) Monitor10002000300040005000

OpenVINO

CPU Power Consumption Monitor

MinAvgMaxCore i9-7980XE AVX51225.5154.2166.6Xeon w9-3495X AMX82.6385.6416.4Xeon w9-3495X AVX51284.9411.1443.1OpenBenchmarking.orgWatts, Fewer Is BetterOpenVINO 2023.2.devCPU Power Consumption Monitor120240360480600

OpenVINO

CPU Temperature Monitor

MinAvgMaxCore i9-7980XE AVX51228.037.440.0Xeon w9-3495X AMX24.038.240.0Xeon w9-3495X AVX51226.042.545.0OpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2023.2.devCPU Temperature Monitor1224364860

OpenVINO

Model: Road Segmentation ADAS FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Road Segmentation ADAS FP16 - Device: CPUXeon w9-3495X AMXXeon w9-3495X AVX512Core i9-7980XE AVX5122004006008001000SE +/- 1.25, N = 3SE +/- 0.28, N = 3SE +/- 0.03, N = 3779.80538.0172.011. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie

OpenVINO

Model: Road Segmentation ADAS FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Road Segmentation ADAS FP16 - Device: CPUXeon w9-3495X AMXXeon w9-3495X AVX512Core i9-7980XE AVX5124080120160200SE +/- 0.06, N = 3SE +/- 0.03, N = 3SE +/- 0.07, N = 335.8451.97166.50MIN: 22.87 / MAX: 62.61MIN: 34.95 / MAX: 72.11MIN: 73.66 / MAX: 506.121. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie

OpenVINO

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxCore i9-7980XE AVX512120028053400Xeon w9-3495X AMX80026504300Xeon w9-3495X AVX51280025394394OpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2023.2.devCPU Peak Freq (Highest CPU Core Frequency) Monitor11002200330044005500

OpenVINO

CPU Power Consumption Monitor

MinAvgMaxCore i9-7980XE AVX51225.4127.8137.5Xeon w9-3495X AVX51284.6417.3451.8Xeon w9-3495X AMX82.3425.5464.9OpenBenchmarking.orgWatts, Fewer Is BetterOpenVINO 2023.2.devCPU Power Consumption Monitor120240360480600

OpenVINO

CPU Temperature Monitor

MinAvgMaxCore i9-7980XE AVX51228.036.439.0Xeon w9-3495X AMX24.039.942.0Xeon w9-3495X AVX51226.042.245.0OpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2023.2.devCPU Temperature Monitor1224364860

OpenVINO

Model: Road Segmentation ADAS FP16-INT8 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Road Segmentation ADAS FP16-INT8 - Device: CPUXeon w9-3495X AVX512Xeon w9-3495X AMXCore i9-7980XE AVX51230060090012001500SE +/- 0.91, N = 3SE +/- 1.38, N = 3SE +/- 0.10, N = 31162.991095.12277.861. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie

OpenVINO

Model: Road Segmentation ADAS FP16-INT8 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Road Segmentation ADAS FP16-INT8 - Device: CPUXeon w9-3495X AVX512Core i9-7980XE AVX512Xeon w9-3495X AMX1224364860SE +/- 0.02, N = 3SE +/- 0.01, N = 3SE +/- 0.07, N = 323.9743.1551.06MIN: 12.92 / MAX: 39.72MIN: 29.71 / MAX: 163.53MIN: 26.67 / MAX: 170.371. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie

OpenVINO

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxCore i9-7980XE AVX512120027993792Xeon w9-3495X AMX80026064395Xeon w9-3495X AVX51280026034444OpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2023.2.devCPU Peak Freq (Highest CPU Core Frequency) Monitor12002400360048006000

OpenVINO

CPU Power Consumption Monitor

MinAvgMaxCore i9-7980XE AVX51225.2163.9178.1Xeon w9-3495X AMX82.2411.3445.5Xeon w9-3495X AVX51285.6421.7456.8OpenBenchmarking.orgWatts, Fewer Is BetterOpenVINO 2023.2.devCPU Power Consumption Monitor120240360480600

OpenVINO

CPU Temperature Monitor

MinAvgMaxXeon w9-3495X AMX24.039.542.0Core i9-7980XE AVX51229.040.543.0Xeon w9-3495X AVX51227.043.146.0OpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2023.2.devCPU Temperature Monitor1224364860

Phoronix Test Suite v10.8.5