Core i9-7980XE AVX512

Intel Xeon w9-3495X testing with a ASUS Pro WS W790E-SAGE SE (0705 BIOS) and NVIDIA GeForce RTX 4090 24GB on Ubuntu 23.10 via the Phoronix Test Suite.

Compare your own system(s) to this result file with the Phoronix Test Suite by running the command: phoronix-test-suite benchmark 2312071-NE-2312068NE72
Jump To Table - Results

View

Do Not Show Noisy Results
Do Not Show Results With Incomplete Data
Do Not Show Results With Little Change/Spread
List Notable Results

Statistics

Show Overall Harmonic Mean(s)
Show Overall Geometric Mean
Show Wins / Losses Counts (Pie Chart)
Normalize Results
Remove Outliers Before Calculating Averages

Graph Settings

Force Line Graphs Where Applicable
Convert To Scalar Where Applicable
Disable Color Branding
Prefer Vertical Bar Graphs
No Box Plots
On Line Graphs With Missing Data, Connect The Line Gaps

Additional Graphs

Show Perf Per Core/Thread Calculation Graphs Where Applicable
Show Perf Per Clock Calculation Graphs Where Applicable

Multi-Way Comparison

Condense Multi-Option Tests Into Single Result Graphs
Condense Test Profiles With Multiple Version Results Into Single Result Graphs

Table

Show Detailed System Result Table

Run Management

Highlight
Result
Hide
Result
Result
Identifier
View Logs
Performance Per
Dollar
Date
Run
  Test
  Duration
Core i9-7980XE AVX512
December 05 2023
  1 Hour, 51 Minutes
Xeon w9-3495X AVX512
December 06 2023
  1 Hour, 51 Minutes
Xeon w9-3495X AMX
December 06 2023
  1 Hour, 50 Minutes
Invert Hiding All Results Option
  1 Hour, 51 Minutes

Only show results where is faster than
Only show results matching title/arguments (delimit multiple options with a comma):
Do not show results matching title/arguments (delimit multiple options with a comma):

Core i9-7980XE AVX512

Processor: Intel Core i9-7980XE @ 4.40GHz (18 Cores / 36 Threads), Motherboard: Supermicro C9X299-RPGF v1.01 (2.5 BIOS), Chipset: Intel Sky Lake-E DMI3 Registers, Memory: 8 x 16 GB DDR4-2666MT/s Kingston, Disk: 2 x 1024GB Samsung SSD 970 PRO 1TB + 1600GB INTEL SSDPE2ME016T4, Graphics: llvmpipe (300/405MHz), Audio: NVIDIA TU102 HD Audio, Network: Aquantia AQC108 NBase-T/IEEE + Intel I210

OS: Ubuntu 22.04, Kernel: 6.2.0-36-generic (x86_64), Desktop: GNOME Shell 42.9, Display Server: X Server 1.21.1.3, Display Driver: NVIDIA 535.129.03, OpenGL: 4.5 Mesa 23.0.4-0ubuntu1~22.04.1 (LLVM 15.0.7 256 bits), Vulkan: 1.3.242, Compiler: GCC 11.4.0 + CUDA 12.1, File-System: ext4, Screen Resolution: 1920x1200

Kernel Notes: Transparent Huge Pages: madvise
Compiler Notes: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-bootstrap --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-link-serialization=2 --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none=/build/gcc-11-XeT9lY/gcc-11-11.4.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-11-XeT9lY/gcc-11-11.4.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-build-config=bootstrap-lto-lean --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v
Processor Notes: Scaling Governor: intel_cpufreq schedutil - CPU Microcode: 0x2007006
Python Notes: Python 3.10.12
Security Notes: gather_data_sampling: Mitigation of Microcode + itlb_multihit: KVM: Mitigation of VMX disabled + l1tf: Mitigation of PTE Inversion; VMX: conditional cache flushes SMT vulnerable + mds: Mitigation of Clear buffers; SMT vulnerable + meltdown: Mitigation of PTI + mmio_stale_data: Mitigation of Clear buffers; SMT vulnerable + retbleed: Mitigation of IBRS + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of IBRS IBPB: conditional STIBP: conditional RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Mitigation of Clear buffers; SMT vulnerable

Xeon w9-3495X AVX512

Processor: Intel Xeon w9-3495X @ 4.80GHz (56 Cores / 112 Threads), Motherboard: ASUS Pro WS W790E-SAGE SE (0705 BIOS), Chipset: Intel Alder Lake-S PCH, Memory: 8 x 32 GB DDR5-4812MT/s Hynix HMCG88AEBRA115N, Disk: 1024GB SAMSUNG MZVL21T0HCLR-00BL2 + 0GB Virtual HDisk0, Graphics: NVIDIA GeForce RTX 4090 24GB, Audio: Realtek ALC1220, Network: 2 x Intel X710 for 10GBASE-T

OS: Ubuntu 23.10, Kernel: 6.5.0-13-generic (x86_64), Desktop: GNOME Shell 45.1, Display Server: X Server 1.21.1.7, Display Driver: NVIDIA 535.129.03, OpenGL: 4.6.0, OpenCL: OpenCL 3.0 CUDA 12.2.147, Compiler: GCC 13.2.0 + CUDA 12.2, File-System: ext4, Screen Resolution: 1920x1200

Kernel Notes: Transparent Huge Pages: madvise
Compiler Notes: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-bootstrap --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-link-serialization=2 --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-defaulted --enable-offload-targets=nvptx-none=/build/gcc-13-XYspKM/gcc-13-13.2.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-13-XYspKM/gcc-13-13.2.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-build-config=bootstrap-lto-lean --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v
Processor Notes: Scaling Governor: intel_pstate powersave (EPP: performance) - CPU Microcode: 0x2b0004d0
Python Notes: Python 3.10.9
Security Notes: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Not affected

Xeon w9-3495X AMX

OS: Ubuntu 23.10, Kernel: 6.5.0-14-generic (x86_64), Desktop: GNOME Shell 45.1, Display Server: X Server 1.21.1.7, Display Driver: NVIDIA 535.129.03, OpenGL: 4.6.0, OpenCL: OpenCL 3.0 CUDA 12.2.147, Compiler: GCC 13.2.0 + CUDA 12.2, File-System: ext4, Screen Resolution: 1920x1200

Core i9-7980XE AVX512ProcessorMotherboardChipsetMemoryDiskGraphicsAudioNetworkOSKernelDesktopDisplay ServerDisplay DriverOpenGLVulkanCompilerFile-SystemScreen ResolutionOpenCLCore i9-7980XE AVX512Xeon w9-3495X AVX512Xeon w9-3495X AMXIntel Core i9-7980XE @ 4.40GHz (18 Cores / 36 Threads)Supermicro C9X299-RPGF v1.01 (2.5 BIOS)Intel Sky Lake-E DMI3 Registers8 x 16 GB DDR4-2666MT/s Kingston2 x 1024GB Samsung SSD 970 PRO 1TB + 1600GB INTEL SSDPE2ME016T4llvmpipe (300/405MHz)NVIDIA TU102 HD AudioAquantia AQC108 NBase-T/IEEE + Intel I210Ubuntu 22.046.2.0-36-generic (x86_64)GNOME Shell 42.9X Server 1.21.1.3NVIDIA 535.129.034.5 Mesa 23.0.4-0ubuntu1~22.04.1 (LLVM 15.0.7 256 bits)1.3.242GCC 11.4.0 + CUDA 12.1ext41920x1200Intel Xeon w9-3495X @ 4.80GHz (56 Cores / 112 Threads)ASUS Pro WS W790E-SAGE SE (0705 BIOS)Intel Alder Lake-S PCH8 x 32 GB DDR5-4812MT/s Hynix HMCG88AEBRA115N1024GB SAMSUNG MZVL21T0HCLR-00BL2 + 0GB Virtual HDisk0NVIDIA GeForce RTX 4090 24GBRealtek ALC12202 x Intel X710 for 10GBASE-TUbuntu 23.106.5.0-13-generic (x86_64)GNOME Shell 45.1X Server 1.21.1.74.6.0OpenCL 3.0 CUDA 12.2.147GCC 13.2.0 + CUDA 12.26.5.0-14-generic (x86_64)OpenBenchmarking.orgKernel Details- Transparent Huge Pages: madviseCompiler Details- Core i9-7980XE AVX512: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-bootstrap --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-link-serialization=2 --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none=/build/gcc-11-XeT9lY/gcc-11-11.4.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-11-XeT9lY/gcc-11-11.4.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-build-config=bootstrap-lto-lean --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v - Xeon w9-3495X AVX512: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-bootstrap --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-link-serialization=2 --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-defaulted --enable-offload-targets=nvptx-none=/build/gcc-13-XYspKM/gcc-13-13.2.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-13-XYspKM/gcc-13-13.2.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-build-config=bootstrap-lto-lean --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v - Xeon w9-3495X AMX: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-bootstrap --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-link-serialization=2 --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-defaulted --enable-offload-targets=nvptx-none=/build/gcc-13-XYspKM/gcc-13-13.2.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-13-XYspKM/gcc-13-13.2.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-build-config=bootstrap-lto-lean --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v Processor Details- Core i9-7980XE AVX512: Scaling Governor: intel_cpufreq schedutil - CPU Microcode: 0x2007006- Xeon w9-3495X AVX512: Scaling Governor: intel_pstate powersave (EPP: performance) - CPU Microcode: 0x2b0004d0- Xeon w9-3495X AMX: Scaling Governor: intel_pstate powersave (EPP: performance) - CPU Microcode: 0x2b0004d0Python Details- Core i9-7980XE AVX512: Python 3.10.12- Xeon w9-3495X AVX512: Python 3.10.9- Xeon w9-3495X AMX: Python 3.10.9Security Details- Core i9-7980XE AVX512: gather_data_sampling: Mitigation of Microcode + itlb_multihit: KVM: Mitigation of VMX disabled + l1tf: Mitigation of PTE Inversion; VMX: conditional cache flushes SMT vulnerable + mds: Mitigation of Clear buffers; SMT vulnerable + meltdown: Mitigation of PTI + mmio_stale_data: Mitigation of Clear buffers; SMT vulnerable + retbleed: Mitigation of IBRS + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of IBRS IBPB: conditional STIBP: conditional RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Mitigation of Clear buffers; SMT vulnerable - Xeon w9-3495X AVX512: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Not affected - Xeon w9-3495X AMX: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Not affected

Core i9-7980XE AVX512Xeon w9-3495X AVX512Xeon w9-3495X AMXLogarithmic Result OverviewPhoronix Test SuiteOpenVINOOpenVINOOpenVINOOpenVINOOpenVINOOpenVINOOpenVINOOpenVINOOpenVINOOpenVINOOpenVINOOpenVINOOpenVINOOpenVINOOpenVINOOpenVINOOpenVINOOpenVINOOpenVINOOpenVINOOpenVINOOpenVINOOpenVINOOpenVINOOpenVINOOpenVINOOpenVINOOpenVINOOpenVINOOpenVINOOpenVINOOpenVINOOpenVINOOpenVINOOpenVINOOpenVINOH.E.R.F.I - CPUP.D.F - CPUP.D.F - CPUP.V.B.D.F - CPUW.P.D.F - CPUF.D.R.F - CPUV.D.F.I - CPUF.D.F - CPUM.T.E.T.D.F - CPUA.G.R.R.0.F - CPUF.D.R.F.I - CPUW.P.D.F.I - CPUA.G.R.R.0.F.I - CPUR.S.A.F - CPUV.D.F - CPUH.E.R.F - CPUR.S.A.F.I - CPUF.D.F.I - CPUP.D.F - CPUP.D.F - CPUH.E.R.F.I - CPUV.D.F.I - CPUA.G.R.R.0.F - CPUM.T.E.T.D.F - CPUR.S.A.F.I - CPUW.P.D.F.I - CPUF.D.F.I - CPUH.E.R.F - CPUW.P.D.F - CPUF.D.F - CPUR.S.A.F - CPUV.D.F - CPUF.D.R.F.I - CPUA.G.R.R.0.F.I - CPUP.V.B.D.F - CPUF.D.R.F - CPU

Core i9-7980XE AVX512openvino: Face Detection FP16 - CPUopenvino: Face Detection FP16 - CPUopenvino: Face Detection FP16-INT8 - CPUopenvino: Face Detection FP16-INT8 - CPUopenvino: Age Gender Recognition Retail 0013 FP16 - CPUopenvino: Age Gender Recognition Retail 0013 FP16 - CPUopenvino: Age Gender Recognition Retail 0013 FP16-INT8 - CPUopenvino: Age Gender Recognition Retail 0013 FP16-INT8 - CPUopenvino: Person Detection FP16 - CPUopenvino: Person Detection FP16 - CPUopenvino: Person Detection FP32 - CPUopenvino: Person Detection FP32 - CPUopenvino: Weld Porosity Detection FP16-INT8 - CPUopenvino: Weld Porosity Detection FP16-INT8 - CPUopenvino: Weld Porosity Detection FP16 - CPUopenvino: Weld Porosity Detection FP16 - CPUopenvino: Vehicle Detection FP16-INT8 - CPUopenvino: Vehicle Detection FP16-INT8 - CPUopenvino: Vehicle Detection FP16 - CPUopenvino: Vehicle Detection FP16 - CPUopenvino: Person Vehicle Bike Detection FP16 - CPUopenvino: Person Vehicle Bike Detection FP16 - CPUopenvino: Machine Translation EN To DE FP16 - CPUopenvino: Machine Translation EN To DE FP16 - CPUopenvino: Face Detection Retail FP16 - CPUopenvino: Face Detection Retail FP16 - CPUopenvino: Face Detection Retail FP16-INT8 - CPUopenvino: Face Detection Retail FP16-INT8 - CPUopenvino: Handwritten English Recognition FP16 - CPUopenvino: Handwritten English Recognition FP16 - CPUopenvino: Handwritten English Recognition FP16-INT8 - CPUopenvino: Handwritten English Recognition FP16-INT8 - CPUopenvino: Road Segmentation ADAS FP16 - CPUopenvino: Road Segmentation ADAS FP16 - CPUopenvino: Road Segmentation ADAS FP16-INT8 - CPUopenvino: Road Segmentation ADAS FP16-INT8 - CPUCore i9-7980XE AVX512Xeon w9-3495X AVX512Xeon w9-3495X AMX6.891728.0410.371151.7916524.061.0723185.570.7532.36370.2632.31370.831064.7816.89702.7625.58694.2717.26179.1366.92488.3824.5476.63156.421009.7711.852062.088.71115.31155.97125.54143.2572.01166.50277.8643.1512.322265.7194.98294.2236085.651.4183679.680.58131.16213.32131.00213.619580.845.841279.4143.754441.346.291075.4826.011597.9817.51178.67156.553068.589.1111300.444.93861.6764.94901.1562.11538.0151.971162.9923.9777.54360.30166.20336.1890854.420.54108111.820.44289.9296.50289.7296.5617651.483.169514.635.873208.6917.431913.4814.593642.7915.34459.9660.656543.618.5410200.325.481596.7535.051242.4445.04779.8035.841095.1251.06OpenBenchmarking.org

CPU Peak Freq (Highest CPU Core Frequency) Monitor

OpenBenchmarking.orgMegahertzCPU Peak Freq (Highest CPU Core Frequency) MonitorPhoronix Test Suite System MonitoringXeon w9-3495X AMXXeon w9-3495X AVX512Core i9-7980XE AVX5128001600240032004000Min: 800 / Avg: 2358.19 / Max: 4800Min: 800 / Avg: 2448.67 / Max: 4800Min: 1200 / Avg: 2654.38 / Max: 4200

CPU Power Consumption Monitor

OpenBenchmarking.orgWattsCPU Power Consumption MonitorPhoronix Test Suite System MonitoringXeon w9-3495X AMXXeon w9-3495X AVX512Core i9-7980XE AVX512110220330440550Min: 55.12 / Avg: 377.02 / Max: 464.87Min: 83.79 / Avg: 413.17 / Max: 621.26Min: 12.81 / Avg: 151.76 / Max: 213.09

CPU Temperature Monitor

OpenBenchmarking.orgCelsiusCPU Temperature MonitorPhoronix Test Suite System MonitoringXeon w9-3495X AMXXeon w9-3495X AVX512Core i9-7980XE AVX5121326395265Min: 19 / Avg: 37.25 / Max: 44Min: 26 / Avg: 47.01 / Max: 65Min: 25 / Avg: 36.96 / Max: 43

OpenVINO

This is a test of the Intel OpenVINO, a toolkit around neural networks, using its built-in benchmarking support and analyzing the throughput and latency for various models. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Face Detection FP16 - Device: CPUXeon w9-3495X AMXXeon w9-3495X AVX512Core i9-7980XE AVX51220406080100SE +/- 0.14, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 377.5412.326.891. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie
OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Face Detection FP16 - Device: CPUXeon w9-3495X AMXXeon w9-3495X AVX512Core i9-7980XE AVX5121530456075Min: 77.26 / Avg: 77.54 / Max: 77.72Min: 12.31 / Avg: 12.32 / Max: 12.34Min: 6.87 / Avg: 6.89 / Max: 6.911. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Face Detection FP16 - Device: CPUXeon w9-3495X AMXXeon w9-3495X AVX512Core i9-7980XE AVX5125001000150020002500SE +/- 0.64, N = 3SE +/- 0.67, N = 3SE +/- 1.70, N = 3360.302265.711728.04MIN: 113.6 / MAX: 404.23MIN: 2165.62 / MAX: 2447.3MIN: 924.93 / MAX: 1876.11. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie
MinAvgMaxXeon w9-3495X AMX80025754800Xeon w9-3495X AVX51280025424400Core i9-7980XE AVX512120127963832OpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2023.2.devCPU Peak Freq (Highest CPU Core Frequency) Monitor12002400360048006000
MinAvgMaxXeon w9-3495X AMX85.3384.3418.0Xeon w9-3495X AVX51286.0388.0429.4Core i9-7980XE AVX51225.2185.9213.1OpenBenchmarking.orgWatts, Fewer Is BetterOpenVINO 2023.2.devCPU Power Consumption Monitor1102203304405501. Xeon w9-3495X AMX: Approximate power consumption of 25492 Joules per run.2. Xeon w9-3495X AVX512: Approximate power consumption of 27163 Joules per run.3. Core i9-7980XE AVX512: Approximate power consumption of 13140 Joules per run.
MinAvgMaxXeon w9-3495X AMX20.036.340.0Xeon w9-3495X AVX51229.047.351.0Core i9-7980XE AVX51225.039.043.0OpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2023.2.devCPU Temperature Monitor1530456075
OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Face Detection FP16 - Device: CPUXeon w9-3495X AMXXeon w9-3495X AVX512Core i9-7980XE AVX512400800120016002000Min: 359.44 / Avg: 360.3 / Max: 361.54Min: 2264.63 / Avg: 2265.71 / Max: 2266.94Min: 1724.65 / Avg: 1728.04 / Max: 1729.851. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Face Detection FP16-INT8 - Device: CPUXeon w9-3495X AMXXeon w9-3495X AVX512Core i9-7980XE AVX5124080120160200SE +/- 0.08, N = 3SE +/- 0.02, N = 3SE +/- 0.00, N = 3166.2094.9810.371. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie
OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Face Detection FP16-INT8 - Device: CPUXeon w9-3495X AMXXeon w9-3495X AVX512Core i9-7980XE AVX512306090120150Min: 166.06 / Avg: 166.2 / Max: 166.34Min: 94.93 / Avg: 94.98 / Max: 95.01Min: 10.36 / Avg: 10.37 / Max: 10.371. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Face Detection FP16-INT8 - Device: CPUXeon w9-3495X AMXXeon w9-3495X AVX512Core i9-7980XE AVX5122004006008001000SE +/- 0.14, N = 3SE +/- 0.15, N = 3SE +/- 0.18, N = 3336.18294.221151.79MIN: 120.23 / MAX: 371.04MIN: 134.33 / MAX: 325MIN: 854.11 / MAX: 1231.911. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie
MinAvgMaxXeon w9-3495X AMX80025984800Xeon w9-3495X AVX51280027224611Core i9-7980XE AVX512120027713913OpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2023.2.devCPU Peak Freq (Highest CPU Core Frequency) Monitor12002400360048006000
MinAvgMaxXeon w9-3495X AMX84.4388.8428.2Xeon w9-3495X AVX51285.9540.9596.3Core i9-7980XE AVX51225.3157.3174.6OpenBenchmarking.orgWatts, Fewer Is BetterOpenVINO 2023.2.devCPU Power Consumption Monitor1603204806408001. Xeon w9-3495X AMX: Approximate power consumption of 26180 Joules per run.2. Xeon w9-3495X AVX512: Approximate power consumption of 35882 Joules per run.3. Core i9-7980XE AVX512: Approximate power consumption of 10903 Joules per run.
MinAvgMaxXeon w9-3495X AMX22.037.440.0Xeon w9-3495X AVX51234.060.365.0Core i9-7980XE AVX51227.037.641.0OpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2023.2.devCPU Temperature Monitor20406080100
OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Face Detection FP16-INT8 - Device: CPUXeon w9-3495X AMXXeon w9-3495X AVX512Core i9-7980XE AVX5122004006008001000Min: 336.03 / Avg: 336.18 / Max: 336.46Min: 293.93 / Avg: 294.22 / Max: 294.44Min: 1151.59 / Avg: 1151.79 / Max: 1152.151. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Age Gender Recognition Retail 0013 FP16 - Device: CPUXeon w9-3495X AMXXeon w9-3495X AVX512Core i9-7980XE AVX51220K40K60K80K100KSE +/- 21.27, N = 3SE +/- 16.00, N = 3SE +/- 16.83, N = 390854.4236085.6516524.061. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie
OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Age Gender Recognition Retail 0013 FP16 - Device: CPUXeon w9-3495X AMXXeon w9-3495X AVX512Core i9-7980XE AVX51216K32K48K64K80KMin: 90814.31 / Avg: 90854.42 / Max: 90886.77Min: 36059.76 / Avg: 36085.65 / Max: 36114.88Min: 16501.08 / Avg: 16524.06 / Max: 16556.861. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Age Gender Recognition Retail 0013 FP16 - Device: CPUXeon w9-3495X AMXXeon w9-3495X AVX512Core i9-7980XE AVX5120.31730.63460.95191.26921.5865SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 30.541.411.07MIN: 0.24 / MAX: 17.71MIN: 0.74 / MAX: 12.83MIN: 0.61 / MAX: 22.11. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie
MinAvgMaxXeon w9-3495X AMX80023204336Xeon w9-3495X AVX51280024473065Core i9-7980XE AVX512120027033475OpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2023.2.devCPU Peak Freq (Highest CPU Core Frequency) Monitor11002200330044005500
MinAvgMaxXeon w9-3495X AMX83.7379.1408.0Xeon w9-3495X AVX51284.9405.1436.6Core i9-7980XE AVX51225.5176.5190.6OpenBenchmarking.orgWatts, Fewer Is BetterOpenVINO 2023.2.devCPU Power Consumption Monitor1102203304405501. Xeon w9-3495X AMX: Approximate power consumption of 24517 Joules per run.2. Xeon w9-3495X AVX512: Approximate power consumption of 26059 Joules per run.3. Core i9-7980XE AVX512: Approximate power consumption of 11416 Joules per run.
MinAvgMaxXeon w9-3495X AMX23.036.739.0Xeon w9-3495X AVX51231.045.748.0Core i9-7980XE AVX51227.039.041.0OpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2023.2.devCPU Temperature Monitor1428425670
OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Age Gender Recognition Retail 0013 FP16 - Device: CPUXeon w9-3495X AMXXeon w9-3495X AVX512Core i9-7980XE AVX512246810Min: 0.54 / Avg: 0.54 / Max: 0.54Min: 1.4 / Avg: 1.41 / Max: 1.41Min: 1.06 / Avg: 1.07 / Max: 1.071. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPUXeon w9-3495X AMXXeon w9-3495X AVX512Core i9-7980XE AVX51220K40K60K80K100KSE +/- 200.26, N = 3SE +/- 155.97, N = 3SE +/- 15.14, N = 3108111.8283679.6823185.571. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie
OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPUXeon w9-3495X AMXXeon w9-3495X AVX512Core i9-7980XE AVX51220K40K60K80K100KMin: 107740.42 / Avg: 108111.82 / Max: 108427.35Min: 83468.2 / Avg: 83679.68 / Max: 83984Min: 23155.4 / Avg: 23185.57 / Max: 23202.921. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPUXeon w9-3495X AMXXeon w9-3495X AVX512Core i9-7980XE AVX5120.16880.33760.50640.67520.844SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 30.440.580.75MIN: 0.23 / MAX: 16.5MIN: 0.31 / MAX: 17.47MIN: 0.45 / MAX: 20.041. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie
MinAvgMaxXeon w9-3495X AMX80023264426Xeon w9-3495X AVX51280025014441Core i9-7980XE AVX512120027053472OpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2023.2.devCPU Peak Freq (Highest CPU Core Frequency) Monitor12002400360048006000
MinAvgMaxXeon w9-3495X AMX84.6364.1391.8Xeon w9-3495X AVX51284.1410.7443.5Core i9-7980XE AVX51225.4160.1171.8OpenBenchmarking.orgWatts, Fewer Is BetterOpenVINO 2023.2.devCPU Power Consumption Monitor1202403604806001. Xeon w9-3495X AMX: Approximate power consumption of 23545 Joules per run.2. Xeon w9-3495X AVX512: Approximate power consumption of 26421 Joules per run.3. Core i9-7980XE AVX512: Approximate power consumption of 10351 Joules per run.
MinAvgMaxXeon w9-3495X AMX23.035.738.0Xeon w9-3495X AVX51231.048.651.0Core i9-7980XE AVX51227.038.039.0OpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2023.2.devCPU Temperature Monitor1530456075
OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPUXeon w9-3495X AMXXeon w9-3495X AVX512Core i9-7980XE AVX512246810Min: 0.43 / Avg: 0.44 / Max: 0.44Min: 0.58 / Avg: 0.58 / Max: 0.58Min: 0.75 / Avg: 0.75 / Max: 0.761. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Person Detection FP16 - Device: CPUXeon w9-3495X AMXXeon w9-3495X AVX512Core i9-7980XE AVX51260120180240300SE +/- 0.52, N = 3SE +/- 0.05, N = 3SE +/- 0.02, N = 3289.92131.1632.361. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie
OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Person Detection FP16 - Device: CPUXeon w9-3495X AMXXeon w9-3495X AVX512Core i9-7980XE AVX51250100150200250Min: 289.06 / Avg: 289.92 / Max: 290.86Min: 131.06 / Avg: 131.16 / Max: 131.25Min: 32.33 / Avg: 32.36 / Max: 32.391. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Person Detection FP16 - Device: CPUXeon w9-3495X AMXXeon w9-3495X AVX512Core i9-7980XE AVX51280160240320400SE +/- 0.16, N = 3SE +/- 0.10, N = 3SE +/- 0.29, N = 396.50213.32370.26MIN: 36.72 / MAX: 138.57MIN: 118.86 / MAX: 242.74MIN: 163.39 / MAX: 489.161. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie
MinAvgMaxXeon w9-3495X AMX80025914400Xeon w9-3495X AVX51280025374400Core i9-7980XE AVX512120027853907OpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2023.2.devCPU Peak Freq (Highest CPU Core Frequency) Monitor11002200330044005500
MinAvgMaxXeon w9-3495X AMX84.2395.5431.5Xeon w9-3495X AVX51286.3400.5433.3Core i9-7980XE AVX51225.4138.9152.4OpenBenchmarking.orgWatts, Fewer Is BetterOpenVINO 2023.2.devCPU Power Consumption Monitor1102203304405501. Xeon w9-3495X AMX: Approximate power consumption of 25836 Joules per run.2. Xeon w9-3495X AVX512: Approximate power consumption of 26301 Joules per run.3. Core i9-7980XE AVX512: Approximate power consumption of 9214 Joules per run.
MinAvgMaxXeon w9-3495X AMX23.037.140.0Xeon w9-3495X AVX51234.049.252.0Core i9-7980XE AVX51226.035.539.0OpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2023.2.devCPU Temperature Monitor1530456075
OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Person Detection FP16 - Device: CPUXeon w9-3495X AMXXeon w9-3495X AVX512Core i9-7980XE AVX51270140210280350Min: 96.22 / Avg: 96.5 / Max: 96.77Min: 213.15 / Avg: 213.32 / Max: 213.48Min: 369.94 / Avg: 370.26 / Max: 370.841. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Person Detection FP32 - Device: CPUXeon w9-3495X AMXXeon w9-3495X AVX512Core i9-7980XE AVX51260120180240300SE +/- 0.27, N = 3SE +/- 0.01, N = 3SE +/- 0.06, N = 3289.72131.0032.311. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie
OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Person Detection FP32 - Device: CPUXeon w9-3495X AMXXeon w9-3495X AVX512Core i9-7980XE AVX51250100150200250Min: 289.22 / Avg: 289.72 / Max: 290.14Min: 130.98 / Avg: 131 / Max: 131.01Min: 32.19 / Avg: 32.31 / Max: 32.371. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Person Detection FP32 - Device: CPUXeon w9-3495X AMXXeon w9-3495X AVX512Core i9-7980XE AVX51280160240320400SE +/- 0.09, N = 3SE +/- 0.03, N = 3SE +/- 0.72, N = 396.56213.61370.83MIN: 30.66 / MAX: 137.73MIN: 121.31 / MAX: 240.33MIN: 174.7 / MAX: 480.361. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie
MinAvgMaxXeon w9-3495X AMX80026044419Xeon w9-3495X AVX51280025474800Core i9-7980XE AVX512120028023764OpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2023.2.devCPU Peak Freq (Highest CPU Core Frequency) Monitor12002400360048006000
MinAvgMaxXeon w9-3495X AMX84.8395.5434.0Xeon w9-3495X AVX51285.5399.4433.4Core i9-7980XE AVX51225.2141.2155.3OpenBenchmarking.orgWatts, Fewer Is BetterOpenVINO 2023.2.devCPU Power Consumption Monitor1102203304405501. Xeon w9-3495X AMX: Approximate power consumption of 25841 Joules per run.2. Xeon w9-3495X AVX512: Approximate power consumption of 26230 Joules per run.3. Core i9-7980XE AVX512: Approximate power consumption of 9369 Joules per run.
MinAvgMaxXeon w9-3495X AMX23.037.740.0Xeon w9-3495X AVX51234.048.552.0Core i9-7980XE AVX51227.035.741.0OpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2023.2.devCPU Temperature Monitor1530456075
OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Person Detection FP32 - Device: CPUXeon w9-3495X AMXXeon w9-3495X AVX512Core i9-7980XE AVX51270140210280350Min: 96.42 / Avg: 96.56 / Max: 96.72Min: 213.56 / Avg: 213.61 / Max: 213.66Min: 370.07 / Avg: 370.83 / Max: 372.281. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Weld Porosity Detection FP16-INT8 - Device: CPUXeon w9-3495X AMXXeon w9-3495X AVX512Core i9-7980XE AVX5124K8K12K16K20KSE +/- 8.07, N = 3SE +/- 3.32, N = 3SE +/- 0.58, N = 317651.489580.841064.781. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie
OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Weld Porosity Detection FP16-INT8 - Device: CPUXeon w9-3495X AMXXeon w9-3495X AVX512Core i9-7980XE AVX5123K6K9K12K15KMin: 17638.46 / Avg: 17651.48 / Max: 17666.24Min: 9575.98 / Avg: 9580.84 / Max: 9587.18Min: 1064.19 / Avg: 1064.78 / Max: 1065.941. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Weld Porosity Detection FP16-INT8 - Device: CPUXeon w9-3495X AMXXeon w9-3495X AVX512Core i9-7980XE AVX51248121620SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.01, N = 33.165.8416.89MIN: 1.4 / MAX: 19.31MIN: 3.32 / MAX: 25.54MIN: 10.44 / MAX: 36.991. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie
MinAvgMaxXeon w9-3495X AMX80021983714Xeon w9-3495X AVX51280026944300Core i9-7980XE AVX512120027123328OpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2023.2.devCPU Peak Freq (Highest CPU Core Frequency) Monitor11002200330044005500
MinAvgMaxXeon w9-3495X AMX82.3385.6416.0Xeon w9-3495X AVX51285.5571.8621.3Core i9-7980XE AVX51225.2162.5174.7OpenBenchmarking.orgWatts, Fewer Is BetterOpenVINO 2023.2.devCPU Power Consumption Monitor1603204806408001. Xeon w9-3495X AMX: Approximate power consumption of 24676 Joules per run.2. Xeon w9-3495X AVX512: Approximate power consumption of 36787 Joules per run.3. Core i9-7980XE AVX512: Approximate power consumption of 10507 Joules per run.
MinAvgMaxXeon w9-3495X AMX24.037.940.0Xeon w9-3495X AVX51231.059.264.0Core i9-7980XE AVX51226.038.139.0OpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2023.2.devCPU Temperature Monitor20406080100
OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Weld Porosity Detection FP16-INT8 - Device: CPUXeon w9-3495X AMXXeon w9-3495X AVX512Core i9-7980XE AVX51248121620Min: 3.16 / Avg: 3.16 / Max: 3.16Min: 5.83 / Avg: 5.84 / Max: 5.84Min: 16.87 / Avg: 16.89 / Max: 16.91. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Weld Porosity Detection FP16 - Device: CPUXeon w9-3495X AMXXeon w9-3495X AVX512Core i9-7980XE AVX5122K4K6K8K10KSE +/- 3.81, N = 3SE +/- 0.19, N = 3SE +/- 1.14, N = 39514.631279.41702.761. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie
OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Weld Porosity Detection FP16 - Device: CPUXeon w9-3495X AMXXeon w9-3495X AVX512Core i9-7980XE AVX51217003400510068008500Min: 9507.63 / Avg: 9514.63 / Max: 9520.74Min: 1279.15 / Avg: 1279.41 / Max: 1279.78Min: 700.48 / Avg: 702.76 / Max: 704.051. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Weld Porosity Detection FP16 - Device: CPUXeon w9-3495X AMXXeon w9-3495X AVX512Core i9-7980XE AVX5121020304050SE +/- 0.00, N = 3SE +/- 0.01, N = 3SE +/- 0.04, N = 35.8743.7525.58MIN: 2.08 / MAX: 20.1MIN: 26.61 / MAX: 61.81MIN: 15.82 / MAX: 319.731. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie
MinAvgMaxXeon w9-3495X AMX80022473326Xeon w9-3495X AVX51280023982564Core i9-7980XE AVX512120027223835OpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2023.2.devCPU Peak Freq (Highest CPU Core Frequency) Monitor10002000300040005000
MinAvgMaxXeon w9-3495X AMX83.8372.9404.2Xeon w9-3495X AVX51285.9412.3441.6Core i9-7980XE AVX51225.4194.6210.3OpenBenchmarking.orgWatts, Fewer Is BetterOpenVINO 2023.2.devCPU Power Consumption Monitor1202403604806001. Xeon w9-3495X AMX: Approximate power consumption of 24114 Joules per run.2. Xeon w9-3495X AVX512: Approximate power consumption of 26527 Joules per run.3. Core i9-7980XE AVX512: Approximate power consumption of 12586 Joules per run.
MinAvgMaxXeon w9-3495X AMX23.037.240.0Xeon w9-3495X AVX51234.050.252.0Core i9-7980XE AVX51226.039.842.0OpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2023.2.devCPU Temperature Monitor1530456075
OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Weld Porosity Detection FP16 - Device: CPUXeon w9-3495X AMXXeon w9-3495X AVX512Core i9-7980XE AVX512918273645Min: 5.87 / Avg: 5.87 / Max: 5.88Min: 43.74 / Avg: 43.75 / Max: 43.76Min: 25.53 / Avg: 25.58 / Max: 25.661. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Vehicle Detection FP16-INT8 - Device: CPUXeon w9-3495X AMXXeon w9-3495X AVX512Core i9-7980XE AVX51210002000300040005000SE +/- 2.59, N = 3SE +/- 6.41, N = 3SE +/- 0.50, N = 33208.694441.34694.271. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie
OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Vehicle Detection FP16-INT8 - Device: CPUXeon w9-3495X AMXXeon w9-3495X AVX512Core i9-7980XE AVX5128001600240032004000Min: 3205.07 / Avg: 3208.69 / Max: 3213.71Min: 4429.65 / Avg: 4441.34 / Max: 4451.75Min: 693.44 / Avg: 694.27 / Max: 695.161. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Vehicle Detection FP16-INT8 - Device: CPUXeon w9-3495X AMXXeon w9-3495X AVX512Core i9-7980XE AVX51248121620SE +/- 0.02, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 317.436.2917.26MIN: 8.16 / MAX: 49.81MIN: 3.98 / MAX: 24.01MIN: 10.16 / MAX: 51.621. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie
MinAvgMaxXeon w9-3495X AMX80023914300Xeon w9-3495X AVX51280026753125Core i9-7980XE AVX512120027053319OpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2023.2.devCPU Peak Freq (Highest CPU Core Frequency) Monitor11002200330044005500
MinAvgMaxXeon w9-3495X AMX83.2419.3458.8Xeon w9-3495X AVX51285.2529.5584.3Core i9-7980XE AVX51225.4166.1180.4OpenBenchmarking.orgWatts, Fewer Is BetterOpenVINO 2023.2.devCPU Power Consumption Monitor1603204806408001. Xeon w9-3495X AMX: Approximate power consumption of 27256 Joules per run.2. Xeon w9-3495X AVX512: Approximate power consumption of 34241 Joules per run.3. Core i9-7980XE AVX512: Approximate power consumption of 10744 Joules per run.
MinAvgMaxXeon w9-3495X AMX23.039.442.0Xeon w9-3495X AVX51234.059.064.0Core i9-7980XE AVX51226.037.939.0OpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2023.2.devCPU Temperature Monitor20406080100
OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Vehicle Detection FP16-INT8 - Device: CPUXeon w9-3495X AMXXeon w9-3495X AVX512Core i9-7980XE AVX51248121620Min: 17.4 / Avg: 17.43 / Max: 17.45Min: 6.28 / Avg: 6.29 / Max: 6.31Min: 17.24 / Avg: 17.26 / Max: 17.281. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Vehicle Detection FP16 - Device: CPUXeon w9-3495X AMXXeon w9-3495X AVX512Core i9-7980XE AVX512400800120016002000SE +/- 1.07, N = 3SE +/- 0.60, N = 3SE +/- 0.13, N = 31913.481075.48179.131. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie
OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Vehicle Detection FP16 - Device: CPUXeon w9-3495X AMXXeon w9-3495X AVX512Core i9-7980XE AVX51230060090012001500Min: 1911.85 / Avg: 1913.48 / Max: 1915.51Min: 1074.71 / Avg: 1075.48 / Max: 1076.66Min: 178.93 / Avg: 179.13 / Max: 179.361. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Vehicle Detection FP16 - Device: CPUXeon w9-3495X AMXXeon w9-3495X AVX512Core i9-7980XE AVX5121530456075SE +/- 0.01, N = 3SE +/- 0.02, N = 3SE +/- 0.04, N = 314.5926.0166.92MIN: 6.54 / MAX: 44.91MIN: 13.73 / MAX: 42.09MIN: 31.14 / MAX: 163.431. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie
MinAvgMaxXeon w9-3495X AMX80024644300Xeon w9-3495X AVX51280024573799Core i9-7980XE AVX512120027433474OpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2023.2.devCPU Peak Freq (Highest CPU Core Frequency) Monitor11002200330044005500
MinAvgMaxXeon w9-3495X AMX83.9416.5450.7Xeon w9-3495X AVX51285.6429.1460.5Core i9-7980XE AVX51225.4134.8144.3OpenBenchmarking.orgWatts, Fewer Is BetterOpenVINO 2023.2.devCPU Power Consumption Monitor1202403604806001. Xeon w9-3495X AMX: Approximate power consumption of 26658 Joules per run.2. Xeon w9-3495X AVX512: Approximate power consumption of 27462 Joules per run.3. Core i9-7980XE AVX512: Approximate power consumption of 8715 Joules per run.
MinAvgMaxXeon w9-3495X AMX24.039.242.0Xeon w9-3495X AVX51234.049.753.0Core i9-7980XE AVX51226.034.636.0OpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2023.2.devCPU Temperature Monitor1530456075
OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Vehicle Detection FP16 - Device: CPUXeon w9-3495X AMXXeon w9-3495X AVX512Core i9-7980XE AVX5121326395265Min: 14.57 / Avg: 14.59 / Max: 14.6Min: 25.98 / Avg: 26.01 / Max: 26.03Min: 66.84 / Avg: 66.92 / Max: 66.991. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Person Vehicle Bike Detection FP16 - Device: CPUXeon w9-3495X AMXXeon w9-3495X AVX512Core i9-7980XE AVX5128001600240032004000SE +/- 5.70, N = 3SE +/- 1.46, N = 3SE +/- 0.67, N = 33642.791597.98488.381. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie
OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Person Vehicle Bike Detection FP16 - Device: CPUXeon w9-3495X AMXXeon w9-3495X AVX512Core i9-7980XE AVX5126001200180024003000Min: 3631.41 / Avg: 3642.79 / Max: 3649.16Min: 1595.08 / Avg: 1597.98 / Max: 1599.66Min: 487.12 / Avg: 488.38 / Max: 489.381. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Person Vehicle Bike Detection FP16 - Device: CPUXeon w9-3495X AMXXeon w9-3495X AVX512Core i9-7980XE AVX512612182430SE +/- 0.03, N = 3SE +/- 0.02, N = 3SE +/- 0.03, N = 315.3417.5124.54MIN: 8.18 / MAX: 37.56MIN: 10.49 / MAX: 30.45MIN: 14.19 / MAX: 60.041. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie
MinAvgMaxXeon w9-3495X AMX80023454400Xeon w9-3495X AVX51280024613800Core i9-7980XE AVX512120027603753OpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2023.2.devCPU Peak Freq (Highest CPU Core Frequency) Monitor11002200330044005500
MinAvgMaxXeon w9-3495X AMX82.9405.3441.7Xeon w9-3495X AVX51284.9385.6421.0Core i9-7980XE AVX51225.4154.3168.1OpenBenchmarking.orgWatts, Fewer Is BetterOpenVINO 2023.2.devCPU Power Consumption Monitor1202403604806001. Xeon w9-3495X AMX: Approximate power consumption of 26482 Joules per run.2. Xeon w9-3495X AVX512: Approximate power consumption of 25192 Joules per run.3. Core i9-7980XE AVX512: Approximate power consumption of 10130 Joules per run.
MinAvgMaxXeon w9-3495X AMX24.038.844.0Xeon w9-3495X AVX51230.042.945.0Core i9-7980XE AVX51226.036.639.0OpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2023.2.devCPU Temperature Monitor1224364860
OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Person Vehicle Bike Detection FP16 - Device: CPUXeon w9-3495X AMXXeon w9-3495X AVX512Core i9-7980XE AVX512612182430Min: 15.31 / Avg: 15.34 / Max: 15.39Min: 17.49 / Avg: 17.51 / Max: 17.54Min: 24.49 / Avg: 24.54 / Max: 24.61. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Machine Translation EN To DE FP16 - Device: CPUXeon w9-3495X AMXXeon w9-3495X AVX512Core i9-7980XE AVX512100200300400500SE +/- 1.25, N = 3SE +/- 0.09, N = 3SE +/- 0.05, N = 3459.96178.6776.631. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie
OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Machine Translation EN To DE FP16 - Device: CPUXeon w9-3495X AMXXeon w9-3495X AVX512Core i9-7980XE AVX51280160240320400Min: 457.61 / Avg: 459.96 / Max: 461.9Min: 178.49 / Avg: 178.67 / Max: 178.79Min: 76.56 / Avg: 76.63 / Max: 76.731. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Machine Translation EN To DE FP16 - Device: CPUXeon w9-3495X AMXXeon w9-3495X AVX512Core i9-7980XE AVX512306090120150SE +/- 0.17, N = 3SE +/- 0.07, N = 3SE +/- 0.10, N = 360.65156.55156.42MIN: 20.82 / MAX: 82.28MIN: 106.01 / MAX: 193.65MIN: 81.1 / MAX: 208.161. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie
MinAvgMaxXeon w9-3495X AMX80024834313Xeon w9-3495X AVX51280025124552Core i9-7980XE AVX512120027204200OpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2023.2.devCPU Peak Freq (Highest CPU Core Frequency) Monitor12002400360048006000
MinAvgMaxXeon w9-3495X AMX82.8365.5404.8Xeon w9-3495X AVX51285.8415.6452.7Core i9-7980XE AVX51217.2177.5194.7OpenBenchmarking.orgWatts, Fewer Is BetterOpenVINO 2023.2.devCPU Power Consumption Monitor1202403604806001. Xeon w9-3495X AMX: Approximate power consumption of 23881 Joules per run.2. Xeon w9-3495X AVX512: Approximate power consumption of 27293 Joules per run.3. Core i9-7980XE AVX512: Approximate power consumption of 11771 Joules per run.
MinAvgMaxXeon w9-3495X AMX24.036.539.0Xeon w9-3495X AVX51228.044.146.0Core i9-7980XE AVX51226.037.840.0OpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2023.2.devCPU Temperature Monitor1224364860
OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Machine Translation EN To DE FP16 - Device: CPUXeon w9-3495X AMXXeon w9-3495X AVX512Core i9-7980XE AVX512306090120150Min: 60.4 / Avg: 60.65 / Max: 60.97Min: 156.47 / Avg: 156.55 / Max: 156.69Min: 156.22 / Avg: 156.42 / Max: 156.541. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Face Detection Retail FP16 - Device: CPUXeon w9-3495X AMXXeon w9-3495X AVX512Core i9-7980XE AVX51214002800420056007000SE +/- 1.33, N = 3SE +/- 2.53, N = 3SE +/- 1.56, N = 36543.613068.581009.771. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie
OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Face Detection Retail FP16 - Device: CPUXeon w9-3495X AMXXeon w9-3495X AVX512Core i9-7980XE AVX51211002200330044005500Min: 6541.63 / Avg: 6543.61 / Max: 6546.13Min: 3065.97 / Avg: 3068.58 / Max: 3073.63Min: 1006.69 / Avg: 1009.77 / Max: 1011.721. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Face Detection Retail FP16 - Device: CPUXeon w9-3495X AMXXeon w9-3495X AVX512Core i9-7980XE AVX5123691215SE +/- 0.00, N = 3SE +/- 0.01, N = 3SE +/- 0.02, N = 38.549.1111.85MIN: 4.83 / MAX: 25.87MIN: 4.86 / MAX: 21.78MIN: 5.06 / MAX: 83.341. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie
MinAvgMaxXeon w9-3495X AMX80023323408Xeon w9-3495X AVX51280024242568Core i9-7980XE AVX512120027233342OpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2023.2.devCPU Peak Freq (Highest CPU Core Frequency) Monitor8001600240032004000
MinAvgMaxXeon w9-3495X AMX83.8418.5450.7Xeon w9-3495X AVX51284.3400.4432.5Core i9-7980XE AVX51225.5161.5174.1OpenBenchmarking.orgWatts, Fewer Is BetterOpenVINO 2023.2.devCPU Power Consumption Monitor1202403604806001. Xeon w9-3495X AMX: Approximate power consumption of 26921 Joules per run.2. Xeon w9-3495X AVX512: Approximate power consumption of 25759 Joules per run.3. Core i9-7980XE AVX512: Approximate power consumption of 10441 Joules per run.
MinAvgMaxXeon w9-3495X AMX24.039.442.0Xeon w9-3495X AVX51228.042.244.0Core i9-7980XE AVX51226.036.939.0OpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2023.2.devCPU Temperature Monitor1224364860
OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Face Detection Retail FP16 - Device: CPUXeon w9-3495X AMXXeon w9-3495X AVX512Core i9-7980XE AVX5123691215Min: 8.54 / Avg: 8.54 / Max: 8.54Min: 9.09 / Avg: 9.11 / Max: 9.12Min: 11.83 / Avg: 11.85 / Max: 11.891. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Face Detection Retail FP16-INT8 - Device: CPUXeon w9-3495X AMXXeon w9-3495X AVX512Core i9-7980XE AVX5122K4K6K8K10KSE +/- 2.79, N = 3SE +/- 5.47, N = 3SE +/- 0.69, N = 310200.3211300.442062.081. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie
OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Face Detection Retail FP16-INT8 - Device: CPUXeon w9-3495X AMXXeon w9-3495X AVX512Core i9-7980XE AVX5122K4K6K8K10KMin: 10194.76 / Avg: 10200.32 / Max: 10203.44Min: 11289.54 / Avg: 11300.44 / Max: 11306.76Min: 2060.71 / Avg: 2062.08 / Max: 2062.851. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Face Detection Retail FP16-INT8 - Device: CPUXeon w9-3495X AMXXeon w9-3495X AVX512Core i9-7980XE AVX512246810SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 35.484.938.71MIN: 3.74 / MAX: 21.44MIN: 2.77 / MAX: 18.8MIN: 5.72 / MAX: 310.181. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie
MinAvgMaxXeon w9-3495X AMX80022372559Xeon w9-3495X AVX51280026624381Core i9-7980XE AVX512120027033250OpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2023.2.devCPU Peak Freq (Highest CPU Core Frequency) Monitor11002200330044005500
MinAvgMaxXeon w9-3495X AMX83.2410.6452.7Xeon w9-3495X AVX51285.0462.1504.5Core i9-7980XE AVX51225.4163.3175.7OpenBenchmarking.orgWatts, Fewer Is BetterOpenVINO 2023.2.devCPU Power Consumption Monitor1302603905206501. Xeon w9-3495X AMX: Approximate power consumption of 26551 Joules per run.2. Xeon w9-3495X AVX512: Approximate power consumption of 29882 Joules per run.3. Core i9-7980XE AVX512: Approximate power consumption of 10563 Joules per run.
MinAvgMaxXeon w9-3495X AMX24.039.442.0Xeon w9-3495X AVX51227.046.551.0Core i9-7980XE AVX51226.038.840.0OpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2023.2.devCPU Temperature Monitor1530456075
OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Face Detection Retail FP16-INT8 - Device: CPUXeon w9-3495X AMXXeon w9-3495X AVX512Core i9-7980XE AVX5123691215Min: 5.47 / Avg: 5.48 / Max: 5.48Min: 4.93 / Avg: 4.93 / Max: 4.93Min: 8.71 / Avg: 8.71 / Max: 8.721. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Handwritten English Recognition FP16 - Device: CPUXeon w9-3495X AMXXeon w9-3495X AVX512Core i9-7980XE AVX51230060090012001500SE +/- 1.69, N = 3SE +/- 0.81, N = 3SE +/- 0.85, N = 31596.75861.67115.311. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie
OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Handwritten English Recognition FP16 - Device: CPUXeon w9-3495X AMXXeon w9-3495X AVX512Core i9-7980XE AVX51230060090012001500Min: 1593.36 / Avg: 1596.75 / Max: 1598.49Min: 860.49 / Avg: 861.67 / Max: 863.22Min: 113.61 / Avg: 115.31 / Max: 116.291. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Handwritten English Recognition FP16 - Device: CPUXeon w9-3495X AMXXeon w9-3495X AVX512Core i9-7980XE AVX512306090120150SE +/- 0.04, N = 3SE +/- 0.06, N = 3SE +/- 1.16, N = 335.0564.94155.97MIN: 19.64 / MAX: 60.54MIN: 41.14 / MAX: 87.25MIN: 75.82 / MAX: 384.521. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie
MinAvgMaxXeon w9-3495X AMX80025134588Xeon w9-3495X AVX51280024484300Core i9-7980XE AVX512120027113404OpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2023.2.devCPU Peak Freq (Highest CPU Core Frequency) Monitor12002400360048006000
MinAvgMaxXeon w9-3495X AMX84.6393.8422.2Xeon w9-3495X AVX51283.9408.7438.6Core i9-7980XE AVX51225.3155.4167.7OpenBenchmarking.orgWatts, Fewer Is BetterOpenVINO 2023.2.devCPU Power Consumption Monitor1202403604806001. Xeon w9-3495X AMX: Approximate power consumption of 25334 Joules per run.2. Xeon w9-3495X AVX512: Approximate power consumption of 26430 Joules per run.3. Core i9-7980XE AVX512: Approximate power consumption of 10155 Joules per run.
MinAvgMaxXeon w9-3495X AMX24.038.441.0Xeon w9-3495X AVX51227.042.044.0Core i9-7980XE AVX51227.036.939.0OpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2023.2.devCPU Temperature Monitor1224364860
OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Handwritten English Recognition FP16 - Device: CPUXeon w9-3495X AMXXeon w9-3495X AVX512Core i9-7980XE AVX512306090120150Min: 35.01 / Avg: 35.05 / Max: 35.12Min: 64.83 / Avg: 64.94 / Max: 65.03Min: 154.63 / Avg: 155.97 / Max: 158.281. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Handwritten English Recognition FP16-INT8 - Device: CPUXeon w9-3495X AMXXeon w9-3495X AVX512Core i9-7980XE AVX51230060090012001500SE +/- 7.51, N = 3SE +/- 3.76, N = 3SE +/- 0.37, N = 31242.44901.15125.541. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie
OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Handwritten English Recognition FP16-INT8 - Device: CPUXeon w9-3495X AMXXeon w9-3495X AVX512Core i9-7980XE AVX5122004006008001000Min: 1228.44 / Avg: 1242.44 / Max: 1254.16Min: 893.86 / Avg: 901.15 / Max: 906.38Min: 124.81 / Avg: 125.54 / Max: 126.041. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Handwritten English Recognition FP16-INT8 - Device: CPUXeon w9-3495X AMXXeon w9-3495X AVX512Core i9-7980XE AVX512306090120150SE +/- 0.27, N = 3SE +/- 0.26, N = 3SE +/- 0.43, N = 345.0462.11143.25MIN: 30.14 / MAX: 61.29MIN: 40.72 / MAX: 75.47MIN: 89.87 / MAX: 340.081. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie
MinAvgMaxXeon w9-3495X AMX80026692955Xeon w9-3495X AVX51280026843963Core i9-7980XE AVX512120027213417OpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2023.2.devCPU Peak Freq (Highest CPU Core Frequency) Monitor10002000300040005000
MinAvgMaxXeon w9-3495X AMX82.6385.6416.4Xeon w9-3495X AVX51284.9411.1443.1Core i9-7980XE AVX51225.5154.2166.6OpenBenchmarking.orgWatts, Fewer Is BetterOpenVINO 2023.2.devCPU Power Consumption Monitor1202403604806001. Xeon w9-3495X AMX: Approximate power consumption of 24936 Joules per run.2. Xeon w9-3495X AVX512: Approximate power consumption of 26584 Joules per run.3. Core i9-7980XE AVX512: Approximate power consumption of 10023 Joules per run.
MinAvgMaxXeon w9-3495X AMX24.038.240.0Xeon w9-3495X AVX51226.042.545.0Core i9-7980XE AVX51228.037.440.0OpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2023.2.devCPU Temperature Monitor1224364860
OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Handwritten English Recognition FP16-INT8 - Device: CPUXeon w9-3495X AMXXeon w9-3495X AVX512Core i9-7980XE AVX512306090120150Min: 44.62 / Avg: 45.04 / Max: 45.55Min: 61.75 / Avg: 62.11 / Max: 62.61Min: 142.67 / Avg: 143.25 / Max: 144.091. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Road Segmentation ADAS FP16 - Device: CPUXeon w9-3495X AMXXeon w9-3495X AVX512Core i9-7980XE AVX5122004006008001000SE +/- 1.25, N = 3SE +/- 0.28, N = 3SE +/- 0.03, N = 3779.80538.0172.011. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie
OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Road Segmentation ADAS FP16 - Device: CPUXeon w9-3495X AMXXeon w9-3495X AVX512Core i9-7980XE AVX512140280420560700Min: 778.46 / Avg: 779.8 / Max: 782.29Min: 537.47 / Avg: 538.01 / Max: 538.44Min: 71.97 / Avg: 72.01 / Max: 72.061. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Road Segmentation ADAS FP16 - Device: CPUXeon w9-3495X AMXXeon w9-3495X AVX512Core i9-7980XE AVX5124080120160200SE +/- 0.06, N = 3SE +/- 0.03, N = 3SE +/- 0.07, N = 335.8451.97166.50MIN: 22.87 / MAX: 62.61MIN: 34.95 / MAX: 72.11MIN: 73.66 / MAX: 506.121. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie
MinAvgMaxXeon w9-3495X AMX80026504300Xeon w9-3495X AVX51280025394394Core i9-7980XE AVX512120028053400OpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2023.2.devCPU Peak Freq (Highest CPU Core Frequency) Monitor11002200330044005500
MinAvgMaxXeon w9-3495X AMX82.3425.5464.9Xeon w9-3495X AVX51284.6417.3451.8Core i9-7980XE AVX51225.4127.8137.5OpenBenchmarking.orgWatts, Fewer Is BetterOpenVINO 2023.2.devCPU Power Consumption Monitor1202403604806001. Xeon w9-3495X AMX: Approximate power consumption of 27517 Joules per run.2. Xeon w9-3495X AVX512: Approximate power consumption of 26986 Joules per run.3. Core i9-7980XE AVX512: Approximate power consumption of 8349 Joules per run.
MinAvgMaxXeon w9-3495X AMX24.039.942.0Xeon w9-3495X AVX51226.042.245.0Core i9-7980XE AVX51228.036.439.0OpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2023.2.devCPU Temperature Monitor1224364860
OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Road Segmentation ADAS FP16 - Device: CPUXeon w9-3495X AMXXeon w9-3495X AVX512Core i9-7980XE AVX512306090120150Min: 35.72 / Avg: 35.84 / Max: 35.9Min: 51.93 / Avg: 51.97 / Max: 52.02Min: 166.37 / Avg: 166.5 / Max: 166.591. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Road Segmentation ADAS FP16-INT8 - Device: CPUXeon w9-3495X AMXXeon w9-3495X AVX512Core i9-7980XE AVX51230060090012001500SE +/- 1.38, N = 3SE +/- 0.91, N = 3SE +/- 0.10, N = 31095.121162.99277.861. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie
OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Road Segmentation ADAS FP16-INT8 - Device: CPUXeon w9-3495X AMXXeon w9-3495X AVX512Core i9-7980XE AVX5122004006008001000Min: 1092.57 / Avg: 1095.12 / Max: 1097.32Min: 1161.22 / Avg: 1162.99 / Max: 1164.25Min: 277.69 / Avg: 277.86 / Max: 278.041. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Road Segmentation ADAS FP16-INT8 - Device: CPUXeon w9-3495X AMXXeon w9-3495X AVX512Core i9-7980XE AVX5121224364860SE +/- 0.07, N = 3SE +/- 0.02, N = 3SE +/- 0.01, N = 351.0623.9743.15MIN: 26.67 / MAX: 170.37MIN: 12.92 / MAX: 39.72MIN: 29.71 / MAX: 163.531. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie
MinAvgMaxXeon w9-3495X AMX80026064395Xeon w9-3495X AVX51280026034444Core i9-7980XE AVX512120027993792OpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2023.2.devCPU Peak Freq (Highest CPU Core Frequency) Monitor12002400360048006000
MinAvgMaxXeon w9-3495X AMX82.2411.3445.5Xeon w9-3495X AVX51285.6421.7456.8Core i9-7980XE AVX51225.2163.9178.1OpenBenchmarking.orgWatts, Fewer Is BetterOpenVINO 2023.2.devCPU Power Consumption Monitor1202403604806001. Xeon w9-3495X AMX: Approximate power consumption of 26733 Joules per run.2. Xeon w9-3495X AVX512: Approximate power consumption of 27412 Joules per run.3. Core i9-7980XE AVX512: Approximate power consumption of 10711 Joules per run.
MinAvgMaxXeon w9-3495X AMX24.039.542.0Xeon w9-3495X AVX51227.043.146.0Core i9-7980XE AVX51229.040.543.0OpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2023.2.devCPU Temperature Monitor1224364860
OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Road Segmentation ADAS FP16-INT8 - Device: CPUXeon w9-3495X AMXXeon w9-3495X AVX512Core i9-7980XE AVX5121020304050Min: 50.95 / Avg: 51.06 / Max: 51.18Min: 23.95 / Avg: 23.97 / Max: 24.01Min: 43.12 / Avg: 43.15 / Max: 43.171. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie

39 Results Shown

CPU Peak Freq (Highest CPU Core Frequency) Monitor:
  Phoronix Test Suite System Monitoring:
    Megahertz
    Watts
    Celsius
OpenVINO:
  Face Detection FP16 - CPU:
    FPS
    ms
  Face Detection FP16-INT8 - CPU:
    FPS
    ms
  Age Gender Recognition Retail 0013 FP16 - CPU:
    FPS
    ms
  Age Gender Recognition Retail 0013 FP16-INT8 - CPU:
    FPS
    ms
  Person Detection FP16 - CPU:
    FPS
    ms
  Person Detection FP32 - CPU:
    FPS
    ms
  Weld Porosity Detection FP16-INT8 - CPU:
    FPS
    ms
  Weld Porosity Detection FP16 - CPU:
    FPS
    ms
  Vehicle Detection FP16-INT8 - CPU:
    FPS
    ms
  Vehicle Detection FP16 - CPU:
    FPS
    ms
  Person Vehicle Bike Detection FP16 - CPU:
    FPS
    ms
  Machine Translation EN To DE FP16 - CPU:
    FPS
    ms
  Face Detection Retail FP16 - CPU:
    FPS
    ms
  Face Detection Retail FP16-INT8 - CPU:
    FPS
    ms
  Handwritten English Recognition FP16 - CPU:
    FPS
    ms
  Handwritten English Recognition FP16-INT8 - CPU:
    FPS
    ms
  Road Segmentation ADAS FP16 - CPU:
    FPS
    ms
  Road Segmentation ADAS FP16-INT8 - CPU:
    FPS
    ms

Core i9-7980XE AVX512

Processor: Intel Core i9-7980XE @ 4.40GHz (18 Cores / 36 Threads), Motherboard: Supermicro C9X299-RPGF v1.01 (2.5 BIOS), Chipset: Intel Sky Lake-E DMI3 Registers, Memory: 8 x 16 GB DDR4-2666MT/s Kingston, Disk: 2 x 1024GB Samsung SSD 970 PRO 1TB + 1600GB INTEL SSDPE2ME016T4, Graphics: llvmpipe (300/405MHz), Audio: NVIDIA TU102 HD Audio, Network: Aquantia AQC108 NBase-T/IEEE + Intel I210

OS: Ubuntu 22.04, Kernel: 6.2.0-36-generic (x86_64), Desktop: GNOME Shell 42.9, Display Server: X Server 1.21.1.3, Display Driver: NVIDIA 535.129.03, OpenGL: 4.5 Mesa 23.0.4-0ubuntu1~22.04.1 (LLVM 15.0.7 256 bits), Vulkan: 1.3.242, Compiler: GCC 11.4.0 + CUDA 12.1, File-System: ext4, Screen Resolution: 1920x1200

Kernel Notes: Transparent Huge Pages: madvise
Compiler Notes: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-bootstrap --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-link-serialization=2 --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none=/build/gcc-11-XeT9lY/gcc-11-11.4.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-11-XeT9lY/gcc-11-11.4.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-build-config=bootstrap-lto-lean --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v
Processor Notes: Scaling Governor: intel_cpufreq schedutil - CPU Microcode: 0x2007006
Python Notes: Python 3.10.12
Security Notes: gather_data_sampling: Mitigation of Microcode + itlb_multihit: KVM: Mitigation of VMX disabled + l1tf: Mitigation of PTE Inversion; VMX: conditional cache flushes SMT vulnerable + mds: Mitigation of Clear buffers; SMT vulnerable + meltdown: Mitigation of PTI + mmio_stale_data: Mitigation of Clear buffers; SMT vulnerable + retbleed: Mitigation of IBRS + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of IBRS IBPB: conditional STIBP: conditional RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Mitigation of Clear buffers; SMT vulnerable

Testing initiated at 5 December 2023 18:23 by user root.

Xeon w9-3495X AVX512

Processor: Intel Xeon w9-3495X @ 4.80GHz (56 Cores / 112 Threads), Motherboard: ASUS Pro WS W790E-SAGE SE (0705 BIOS), Chipset: Intel Alder Lake-S PCH, Memory: 8 x 32 GB DDR5-4812MT/s Hynix HMCG88AEBRA115N, Disk: 1024GB SAMSUNG MZVL21T0HCLR-00BL2 + 0GB Virtual HDisk0, Graphics: NVIDIA GeForce RTX 4090 24GB, Audio: Realtek ALC1220, Network: 2 x Intel X710 for 10GBASE-T

OS: Ubuntu 23.10, Kernel: 6.5.0-13-generic (x86_64), Desktop: GNOME Shell 45.1, Display Server: X Server 1.21.1.7, Display Driver: NVIDIA 535.129.03, OpenGL: 4.6.0, OpenCL: OpenCL 3.0 CUDA 12.2.147, Compiler: GCC 13.2.0 + CUDA 12.2, File-System: ext4, Screen Resolution: 1920x1200

Kernel Notes: Transparent Huge Pages: madvise
Compiler Notes: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-bootstrap --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-link-serialization=2 --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-defaulted --enable-offload-targets=nvptx-none=/build/gcc-13-XYspKM/gcc-13-13.2.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-13-XYspKM/gcc-13-13.2.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-build-config=bootstrap-lto-lean --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v
Processor Notes: Scaling Governor: intel_pstate powersave (EPP: performance) - CPU Microcode: 0x2b0004d0
Python Notes: Python 3.10.9
Security Notes: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Not affected

Testing initiated at 6 December 2023 17:37 by user root.

Xeon w9-3495X AMX

Processor: Intel Xeon w9-3495X @ 4.80GHz (56 Cores / 112 Threads), Motherboard: ASUS Pro WS W790E-SAGE SE (0705 BIOS), Chipset: Intel Alder Lake-S PCH, Memory: 8 x 32 GB DDR5-4812MT/s Hynix HMCG88AEBRA115N, Disk: 1024GB SAMSUNG MZVL21T0HCLR-00BL2 + 0GB Virtual HDisk0, Graphics: NVIDIA GeForce RTX 4090 24GB, Audio: Realtek ALC1220, Network: 2 x Intel X710 for 10GBASE-T

OS: Ubuntu 23.10, Kernel: 6.5.0-14-generic (x86_64), Desktop: GNOME Shell 45.1, Display Server: X Server 1.21.1.7, Display Driver: NVIDIA 535.129.03, OpenGL: 4.6.0, OpenCL: OpenCL 3.0 CUDA 12.2.147, Compiler: GCC 13.2.0 + CUDA 12.2, File-System: ext4, Screen Resolution: 1920x1200

Kernel Notes: Transparent Huge Pages: madvise
Compiler Notes: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-bootstrap --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-link-serialization=2 --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-defaulted --enable-offload-targets=nvptx-none=/build/gcc-13-XYspKM/gcc-13-13.2.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-13-XYspKM/gcc-13-13.2.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-build-config=bootstrap-lto-lean --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v
Processor Notes: Scaling Governor: intel_pstate powersave (EPP: performance) - CPU Microcode: 0x2b0004d0
Python Notes: Python 3.10.9
Security Notes: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Not affected

Testing initiated at 6 December 2023 23:29 by user root.