AMD Ryzen 9 7950X AVX-512

AMD Ryzen 9 7950X AVX-512 benchmark comparison by Michael Larabel launch day embargo lift review. Stock/out-of-the-box build with AVX-512. For lack of any AVX-512 toggle from the ASUS BIOS, the AVX2 / non-AVX-512 run was carried out by booting kernel with "clearcpuid=304" to clear AVX-512 support from the kernel and for the binary programs that scan /proc/cpuinfo for avx512* extensions. Plus for the open-source benchmarks specifying CFLAGS/CXXFLAGS without AVX-512 extensions. See full launch day review @ https://www.phoronix.com/review/amd-zen4-avx512

Compare your own system(s) to this result file with the Phoronix Test Suite by running the command: phoronix-test-suite benchmark 2209253-NE-RYZEN795065
Jump To Table - Results

View

Do Not Show Noisy Results
Do Not Show Results With Incomplete Data
Do Not Show Results With Little Change/Spread
List Notable Results
Show Result Confidence Charts
Allow Limiting Results To Certain Suite(s)

Statistics

Show Overall Harmonic Mean(s)
Show Overall Geometric Mean
Show Wins / Losses Counts (Pie Chart)
Normalize Results
Remove Outliers Before Calculating Averages

Graph Settings

Force Line Graphs Where Applicable
Convert To Scalar Where Applicable
Prefer Vertical Bar Graphs
No Box Plots
On Line Graphs With Missing Data, Connect The Line Gaps

Multi-Way Comparison

Condense Multi-Option Tests Into Single Result Graphs
Condense Test Profiles With Multiple Version Results Into Single Result Graphs

Table

Show Detailed System Result Table

Run Management

Highlight
Result
Toggle/Hide
Result
Result
Identifier
Performance Per
Dollar
Date
Run
  Test
  Duration
Default, AVX-512 Enabled
September 17 2022
  4 Hours, 11 Minutes
Without AVX-512
September 17 2022
  3 Hours, 57 Minutes
Invert Behavior (Only Show Selected Data)
  4 Hours, 4 Minutes
Only show results matching title/arguments (delimit multiple options with a comma):
Do not show results matching title/arguments (delimit multiple options with a comma):

Without AVX-512

Kernel Notes: Transparent Huge Pages: madvise
Environment Notes: CXXFLAGS="-O3 -march=native -mno-avx512f" CFLAGS="-O3 -march=native -mno-avx512f"
Compiler Notes: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-defaulted --enable-offload-targets=nvptx-none=/build/gcc-12-OcsLtf/gcc-12-12-20220319/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-12-OcsLtf/gcc-12-12-20220319/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v
Processor Notes: Scaling Governor: amd-pstate performance (Boost: Enabled) - CPU Microcode: 0xa601203
Python Notes: Python 3.10.4
Security Notes: itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional IBRS_FW STIBP: always-on RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected

Default, AVX-512 Enabled

Processor: AMD Ryzen 9 7950X 16-Core @ 5.88GHz (16 Cores / 32 Threads), Motherboard: ASUS ROG CROSSHAIR X670E HERO (0604 BIOS), Chipset: AMD Device 14d8, Memory: 32GB, Disk: 2000GB Samsung SSD 980 PRO 2TB + 2000GB, Graphics: AMD Radeon RX 6800 XT 16GB (2575/1000MHz), Audio: AMD Navi 21 HDMI Audio, Monitor: ASUS VP28U, Network: Intel I225-V + Intel Wi-Fi 6 AX210/AX211/AX411

OS: Ubuntu 22.04, Kernel: 6.0.0-060000rc1daily20220820-generic (x86_64), Desktop: GNOME Shell 42.2, Display Server: X Server + Wayland, OpenGL: 4.6 Mesa 22.3.0-devel (git-4685385 2022-08-23 jammy-oibaf-ppa) (LLVM 14.0.6 DRM 3.48), Vulkan: 1.3.224, Compiler: GCC 12.0.1 20220319, File-System: ext4, Screen Resolution: 3840x2160

Kernel Notes: Transparent Huge Pages: madvise
Environment Notes: CXXFLAGS="-O3 -march=native -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi -mprefer-vector-width=512" CFLAGS="-O3 -march=native -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi -mprefer-vector-width=512"
Compiler Notes: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-defaulted --enable-offload-targets=nvptx-none=/build/gcc-12-OcsLtf/gcc-12-12-20220319/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-12-OcsLtf/gcc-12-12-20220319/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v
Processor Notes: Scaling Governor: amd-pstate performance (Boost: Enabled) - CPU Microcode: 0xa601203
Python Notes: Python 3.10.4
Security Notes: itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional IBRS_FW STIBP: always-on RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected

AMD Ryzen 9 7950X AVX-512OpenBenchmarking.orgPhoronix Test SuiteAMD Ryzen 9 7950X 16-Core @ 5.88GHz (16 Cores / 32 Threads)ASUS ROG CROSSHAIR X670E HERO (0604 BIOS)AMD Device 14d832GB2000GB Samsung SSD 980 PRO 2TB + 2000GBAMD Radeon RX 6800 XT 16GB (2575/1000MHz)AMD Navi 21 HDMI AudioASUS VP28UIntel I225-V + Intel Wi-Fi 6 AX210/AX211/AX411Ubuntu 22.046.0.0-060000rc1daily20220820-generic (x86_64)GNOME Shell 42.2X Server + Wayland4.6 Mesa 22.3.0-devel (git-4685385 2022-08-23 jammy-oibaf-ppa) (LLVM 14.0.6 DRM 3.48)1.3.224GCC 12.0.1 20220319ext43840x2160ProcessorMotherboardChipsetMemoryDiskGraphicsAudioMonitorNetworkOSKernelDesktopDisplay ServerOpenGLVulkanCompilerFile-SystemScreen ResolutionAMD Ryzen 9 7950X AVX-512 BenchmarksSystem Logs- Transparent Huge Pages: madvise- Without AVX-512: CXXFLAGS="-O3 -march=native -mno-avx512f" CFLAGS="-O3 -march=native -mno-avx512f"- Default, AVX-512 Enabled: CXXFLAGS="-O3 -march=native -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi -mprefer-vector-width=512" CFLAGS="-O3 -march=native -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi -mprefer-vector-width=512" - --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-defaulted --enable-offload-targets=nvptx-none=/build/gcc-12-OcsLtf/gcc-12-12-20220319/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-12-OcsLtf/gcc-12-12-20220319/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v - Scaling Governor: amd-pstate performance (Boost: Enabled) - CPU Microcode: 0xa601203- Python 3.10.4- itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional IBRS_FW STIBP: always-on RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected

Without AVX-512 vs. Default, AVX-512 Enabled ComparisonPhoronix Test SuiteBaseline+66.4%+66.4%+132.8%+132.8%+199.2%+199.2%+265.6%+265.6%265.7%117.1%117%115.1%114.4%113.7%113.6%109.1%108.6%104.5%103.8%103.8%100%100%98.2%98.1%97.1%92.4%88%87%86.8%83.1%80.2%79.9%79.8%78.9%77.6%70.8%68.2%66.9%58.6%56.1%54.8%53.1%50%48%47.9%40%39.3%37.7%37.4%35.7%32.6%30.1%26.1%25.4%23%22.4%21.4%21.1%21%20.7%20.1%20%15.6%14%12.8%9.9%8.3%3.4%2.8%Myriad-GroestlW.P.D.F.I - CPUW.P.D.F.I - CPUF.D.F - CPUF.D.F - CPUW.P.D.F - CPUW.P.D.F - CPUF.D.F.I - CPUF.D.F.I - CPUBlake-2 SM.T.E.T.D.F - CPUM.T.E.T.D.F - CPUA.G.R.R.0.F - CPUA.G.R.R.0.F - CPUV.D.F.I - CPUV.D.F.I - CPULBC, LBRY CreditsD.B.s - u8s8f32 - CPUD.B.s - u8s8f32 - CPUP.V.B.D.F - CPUP.V.B.D.F - CPUgravity_spheres_volume/dim_512/scivis/real_timeP.D.F - CPUP.D.F - CPUP.D.F - CPUP.D.F - CPUgravity_spheres_volume/dim_512/ao/real_timeA.G.R.R.0.F.I - CPUA.G.R.R.0.F.I - CPUQ.S.2.PCPU - vision_transformerR.N.N.I - u8s8f32 - CPUR.N.N.I - bf16bf16bf16 - CPUGarlicoinIP Shapes 1D - u8s8f32 - CPUV.D.F - CPUV.D.F - CPUC.B.S.A - u8s8f32 - CPUSkeincoinR.N.N.T - u8s8f32 - CPUgravity_spheres_volume/dim_512/pathtracer/real_timeR.N.N.T - bf16bf16bf16 - CPUDistinctUserIDvklBenchmark ISPCTopTweetPartialTweets1 - 4K - 1 - Path Tracer3 - 4K - 1 - Path TracerKostya1 - 4K - 32 - Path TracerPathtracer ISPC - Crown1 - 4K - 16 - Path Tracer3 - 4K - 32 - Path Tracer3 - 4K - 16 - Path TracerPathtracer ISPC - Asian DragonLargeRandSqueezeNetV1.0Eigenparticle_volume/pathtracer/real_timeSummer Nature 4KS.N.1Cpuminer-OptOpenVINOOpenVINOOpenVINOOpenVINOOpenVINOOpenVINOOpenVINOOpenVINOCpuminer-OptOpenVINOOpenVINOOpenVINOOpenVINOOpenVINOOpenVINOCpuminer-OptoneDNNoneDNNOpenVINOOpenVINOOSPRayOpenVINOOpenVINOOpenVINOOpenVINOOSPRayOpenVINOOpenVINOCpuminer-OptNCNNoneDNNoneDNNCpuminer-OptoneDNNOpenVINOOpenVINOoneDNNCpuminer-OptoneDNNOSPRayoneDNNsimdjsonOpenVKLsimdjsonsimdjsonOSPRay StudioOSPRay StudiosimdjsonOSPRay StudioEmbreeOSPRay StudioOSPRay StudioOSPRay StudioEmbreesimdjsonMobile Neural NetworkLeelaChessZeroOSPRaydav1ddav1dWithout AVX-512Default, AVX-512 Enabled

AMD Ryzen 9 7950X AVX-512lczero: Eigensimdjson: Kostyasimdjson: TopTweetsimdjson: LargeRandsimdjson: PartialTweetssimdjson: DistinctUserIDdav1d: Summer Nature 4Kdav1d: Summer Nature 1080pembree: Pathtracer ISPC - Crownembree: Pathtracer ISPC - Asian Dragonopenvkl: vklBenchmark ISPCospray: particle_volume/pathtracer/real_timeospray: gravity_spheres_volume/dim_512/ao/real_timeospray: gravity_spheres_volume/dim_512/scivis/real_timeospray: gravity_spheres_volume/dim_512/pathtracer/real_timeonednn: IP Shapes 1D - u8s8f32 - CPUonednn: Convolution Batch Shapes Auto - u8s8f32 - CPUonednn: Deconvolution Batch shapes_1d - u8s8f32 - CPUonednn: Deconvolution Batch shapes_3d - u8s8f32 - CPUonednn: Recurrent Neural Network Training - u8s8f32 - CPUonednn: Recurrent Neural Network Inference - u8s8f32 - CPUonednn: Recurrent Neural Network Training - bf16bf16bf16 - CPUonednn: Recurrent Neural Network Inference - bf16bf16bf16 - CPUospray-studio: 1 - 4K - 1 - Path Tracerospray-studio: 3 - 4K - 1 - Path Tracerospray-studio: 1 - 4K - 16 - Path Tracerospray-studio: 1 - 4K - 32 - Path Tracerospray-studio: 3 - 4K - 16 - Path Tracerospray-studio: 3 - 4K - 32 - Path Tracercpuminer-opt: Blake-2 Scpuminer-opt: Garlicoincpuminer-opt: Skeincoincpuminer-opt: Myriad-Groestlcpuminer-opt: LBC, LBRY Creditscpuminer-opt: Quad SHA-256, Pyritemnn: SqueezeNetV1.0ncnn: CPU - vision_transformeropenvino: Face Detection FP16 - CPUopenvino: Face Detection FP16 - CPUopenvino: Person Detection FP16 - CPUopenvino: Person Detection FP16 - CPUopenvino: Person Detection FP32 - CPUopenvino: Person Detection FP32 - CPUopenvino: Vehicle Detection FP16 - CPUopenvino: Vehicle Detection FP16 - CPUopenvino: Face Detection FP16-INT8 - CPUopenvino: Face Detection FP16-INT8 - CPUopenvino: Vehicle Detection FP16-INT8 - CPUopenvino: Vehicle Detection FP16-INT8 - CPUopenvino: Weld Porosity Detection FP16 - CPUopenvino: Weld Porosity Detection FP16 - CPUopenvino: Machine Translation EN To DE FP16 - CPUopenvino: Machine Translation EN To DE FP16 - CPUopenvino: Weld Porosity Detection FP16-INT8 - CPUopenvino: Weld Porosity Detection FP16-INT8 - CPUopenvino: Person Vehicle Bike Detection FP16 - CPUopenvino: Person Vehicle Bike Detection FP16 - CPUopenvino: Age Gender Recognition Retail 0013 FP16 - CPUopenvino: Age Gender Recognition Retail 0013 FP16 - CPUopenvino: Age Gender Recognition Retail 0013 FP16-INT8 - CPUopenvino: Age Gender Recognition Retail 0013 FP16-INT8 - CPUWithout AVX-512Default, AVX-512 Enabled15784.957.901.577.697.74380.321412.2729.117030.3870153231.3784.535294.333986.922270.6259427.449360.8001161.083961566.09910.4601544.39902.10245025348748441461568834417287210337002597.6520432016393769601926673.99762.746.741178.814.201889.404.201887.13502.2815.9213.60585.81953.798.38681.3711.7366.03121.061353.8411.81907.368.8022781.700.738316.870.4117356.019.961.799.6410.26393.401451.9435.229335.1217199250.6558.053977.934329.509060.4171965.321270.4159400.5764321137.29583.3161137.96582.90136594368620291207277361714398121134343977.80284667599571517203215033.54339.5714.50549.947.571050.377.551054.92742.9010.7628.44280.861890.254.231455.455.49134.5959.392938.135.441696.824.7145555.670.3564463.940.24OpenBenchmarking.org

LeelaChessZero

LeelaChessZero (lc0 / lczero) is a chess engine automated vian neural networks. This test profile can be used for OpenCL, CUDA + cuDNN, and BLAS (CPU-based) benchmarking. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgNodes Per Second, More Is BetterLeelaChessZero 0.28Backend: EigenWithout AVX-512Default, AVX-512 Enabled400800120016002000SE +/- 16.33, N = 3SE +/- 7.31, N = 315781735-mno-avx512f-mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi1. (CXX) g++ options: -flto -O3 -march=native -pthread
OpenBenchmarking.orgNodes Per Second Per Watt, More Is BetterLeelaChessZero 0.28Backend: EigenWithout AVX-512Default, AVX-512 Enabled36912159.10710.156
MinAvgMaxWithout AVX-512515253075881Default, AVX-512 Enabled519153215881OpenBenchmarking.orgMegahertz, More Is BetterLeelaChessZero 0.28CPU Peak Freq (Highest CPU Core Frequency) Monitor16003200480064008000
MinAvgMaxWithout AVX-51223.3173.3195.1Default, AVX-512 Enabled22.5170.8192.1OpenBenchmarking.orgWatts, Fewer Is BetterLeelaChessZero 0.28CPU Power Consumption Monitor50100150200250
MinAvgMaxWithout AVX-51236.188.391.0Default, AVX-512 Enabled33.684.487.4OpenBenchmarking.orgCelsius, Fewer Is BetterLeelaChessZero 0.28CPU Temperature Monitor20406080100

simdjson

This is a benchmark of SIMDJSON, a high performance JSON parser. SIMDJSON aims to be the fastest JSON parser and is used by projects like Microsoft FishStore, Yandex ClickHouse, Shopify, and others. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgGB/s, More Is Bettersimdjson 2.0Throughput Test: KostyaWithout AVX-512Default, AVX-512 Enabled246810SE +/- 0.00, N = 3SE +/- 0.04, N = 34.956.01-mno-avx512f-mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi1. (CXX) g++ options: -O3 -march=native
OpenBenchmarking.orgGB/s Per Watt, More Is Bettersimdjson 2.0Throughput Test: KostyaWithout AVX-512Default, AVX-512 Enabled0.02120.04240.06360.08480.1060.0760.094
OpenBenchmarking.orgMegahertz, More Is Bettersimdjson 2.0CPU Peak Freq (Highest CPU Core Frequency) MonitorDefault, AVX-512 Enabled130026003900520065005881
MinAvgMaxWithout AVX-51216.765.668.6Default, AVX-512 Enabled21.963.766.4OpenBenchmarking.orgWatts, Fewer Is Bettersimdjson 2.0CPU Power Consumption Monitor20406080100
MinAvgMaxWithout AVX-51239.467.768.8Default, AVX-512 Enabled39.067.168.8OpenBenchmarking.orgCelsius, Fewer Is Bettersimdjson 2.0CPU Temperature Monitor20406080100

OpenBenchmarking.orgGB/s, More Is Bettersimdjson 2.0Throughput Test: TopTweetWithout AVX-512Default, AVX-512 Enabled3691215SE +/- 0.02, N = 3SE +/- 0.09, N = 37.909.96-mno-avx512f-mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi1. (CXX) g++ options: -O3 -march=native
OpenBenchmarking.orgGB/s Per Watt, More Is Bettersimdjson 2.0Throughput Test: TopTweetWithout AVX-512Default, AVX-512 Enabled0.03560.07120.10680.14240.1780.1250.158
OpenBenchmarking.orgMegahertz, More Is Bettersimdjson 2.0CPU Peak Freq (Highest CPU Core Frequency) MonitorDefault, AVX-512 Enabled130026003900520065005881
MinAvgMaxWithout AVX-51223.263.467.0Default, AVX-512 Enabled22.062.966.5OpenBenchmarking.orgWatts, Fewer Is Bettersimdjson 2.0CPU Power Consumption Monitor20406080100
MinAvgMaxWithout AVX-51239.566.767.9Default, AVX-512 Enabled39.065.466.6OpenBenchmarking.orgCelsius, Fewer Is Bettersimdjson 2.0CPU Temperature Monitor20406080100

OpenBenchmarking.orgGB/s, More Is Bettersimdjson 2.0Throughput Test: LargeRandomWithout AVX-512Default, AVX-512 Enabled0.40280.80561.20841.61122.014SE +/- 0.00, N = 3SE +/- 0.00, N = 31.571.79-mno-avx512f-mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi1. (CXX) g++ options: -O3 -march=native
OpenBenchmarking.orgGB/s Per Watt, More Is Bettersimdjson 2.0Throughput Test: LargeRandomWithout AVX-512Default, AVX-512 Enabled0.00650.0130.01950.0260.03250.0250.029
OpenBenchmarking.orgMegahertz, More Is Bettersimdjson 2.0CPU Peak Freq (Highest CPU Core Frequency) MonitorDefault, AVX-512 Enabled130026003900520065005881
MinAvgMaxWithout AVX-51222.962.665.3Default, AVX-512 Enabled22.262.765.8OpenBenchmarking.orgWatts, Fewer Is Bettersimdjson 2.0CPU Power Consumption Monitor20406080100
MinAvgMaxWithout AVX-51238.968.869.9Default, AVX-512 Enabled38.566.668.0OpenBenchmarking.orgCelsius, Fewer Is Bettersimdjson 2.0CPU Temperature Monitor20406080100

OpenBenchmarking.orgGB/s, More Is Bettersimdjson 2.0Throughput Test: PartialTweetsWithout AVX-512Default, AVX-512 Enabled3691215SE +/- 0.01, N = 3SE +/- 0.08, N = 37.699.64-mno-avx512f-mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi1. (CXX) g++ options: -O3 -march=native
OpenBenchmarking.orgGB/s Per Watt, More Is Bettersimdjson 2.0Throughput Test: PartialTweetsWithout AVX-512Default, AVX-512 Enabled0.03490.06980.10470.13960.17450.1210.155
OpenBenchmarking.orgMegahertz, More Is Bettersimdjson 2.0CPU Peak Freq (Highest CPU Core Frequency) MonitorDefault, AVX-512 Enabled130026003900520065005881
MinAvgMaxWithout AVX-51223.563.867.3Default, AVX-512 Enabled22.462.366.2OpenBenchmarking.orgWatts, Fewer Is Bettersimdjson 2.0CPU Power Consumption Monitor20406080100
MinAvgMaxWithout AVX-51239.366.367.6Default, AVX-512 Enabled39.065.368.4OpenBenchmarking.orgCelsius, Fewer Is Bettersimdjson 2.0CPU Temperature Monitor20406080100

OpenBenchmarking.orgGB/s, More Is Bettersimdjson 2.0Throughput Test: DistinctUserIDWithout AVX-512Default, AVX-512 Enabled3691215SE +/- 0.07, N = 3SE +/- 0.06, N = 37.7410.26-mno-avx512f-mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi1. (CXX) g++ options: -O3 -march=native
OpenBenchmarking.orgGB/s Per Watt, More Is Bettersimdjson 2.0Throughput Test: DistinctUserIDWithout AVX-512Default, AVX-512 Enabled0.03710.07420.11130.14840.18550.1220.165
OpenBenchmarking.orgMegahertz, More Is Bettersimdjson 2.0CPU Peak Freq (Highest CPU Core Frequency) MonitorDefault, AVX-512 Enabled130026003900520065005881
MinAvgMaxWithout AVX-51223.163.467.0Default, AVX-512 Enabled22.362.166.4OpenBenchmarking.orgWatts, Fewer Is Bettersimdjson 2.0CPU Power Consumption Monitor20406080100
MinAvgMaxWithout AVX-51238.967.269.5Default, AVX-512 Enabled38.966.768.6OpenBenchmarking.orgCelsius, Fewer Is Bettersimdjson 2.0CPU Temperature Monitor20406080100

dav1d

Dav1d is an open-source, speedy AV1 video decoder. This test profile times how long it takes to decode sample AV1 video content. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgFPS, More Is Betterdav1d 1.0Video Input: Summer Nature 4KWithout AVX-512Default, AVX-512 Enabled90180270360450SE +/- 3.22, N = 5SE +/- 1.37, N = 5380.32393.40-mno-avx512f-mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi -lm1. (CC) gcc options: -O3 -march=native -pthread
OpenBenchmarking.orgFPS Per Watt, More Is Betterdav1d 1.0Video Input: Summer Nature 4KWithout AVX-512Default, AVX-512 Enabled0.70181.40362.10542.80723.5092.9373.119
MinAvgMaxWithout AVX-512525854925881Default, AVX-512 Enabled523954935881OpenBenchmarking.orgMegahertz, More Is Betterdav1d 1.0CPU Peak Freq (Highest CPU Core Frequency) Monitor16003200480064008000
MinAvgMaxWithout AVX-51223.9129.5187.9Default, AVX-512 Enabled23.2126.1185.4OpenBenchmarking.orgWatts, Fewer Is Betterdav1d 1.0CPU Power Consumption Monitor50100150200250
MinAvgMaxWithout AVX-51238.870.980.3Default, AVX-512 Enabled38.670.079.0OpenBenchmarking.orgCelsius, Fewer Is Betterdav1d 1.0CPU Temperature Monitor20406080100

OpenBenchmarking.orgFPS, More Is Betterdav1d 1.0Video Input: Summer Nature 1080pWithout AVX-512Default, AVX-512 Enabled30060090012001500SE +/- 2.53, N = 10SE +/- 1.72, N = 101412.271451.94-mno-avx512f-mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi -lm1. (CC) gcc options: -O3 -march=native -pthread
OpenBenchmarking.orgFPS Per Watt, More Is Betterdav1d 1.0Video Input: Summer Nature 1080pWithout AVX-512Default, AVX-512 Enabled4812162017.2118.11
MinAvgMaxWithout AVX-512526356865881Default, AVX-512 Enabled528256745881OpenBenchmarking.orgMegahertz, More Is Betterdav1d 1.0CPU Peak Freq (Highest CPU Core Frequency) Monitor16003200480064008000
MinAvgMaxWithout AVX-51223.682.1180.6Default, AVX-512 Enabled23.280.2178.7OpenBenchmarking.orgWatts, Fewer Is Betterdav1d 1.0CPU Power Consumption Monitor50100150200250
MinAvgMaxWithout AVX-51241.365.174.4Default, AVX-512 Enabled41.364.573.3OpenBenchmarking.orgCelsius, Fewer Is Betterdav1d 1.0CPU Temperature Monitor20406080100

Embree

Intel Embree is a collection of high-performance ray-tracing kernels for execution on CPUs and supporting instruction sets such as SSE, AVX, AVX2, and AVX-512. Embree also supports making use of the Intel SPMD Program Compiler (ISPC). Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgFrames Per Second, More Is BetterEmbree 3.13Binary: Pathtracer ISPC - Model: CrownWithout AVX-512Default, AVX-512 Enabled816243240SE +/- 0.11, N = 3SE +/- 0.08, N = 329.1235.23MIN: 28.7 / MAX: 29.86MIN: 34.75 / MAX: 36.08
OpenBenchmarking.orgFrames Per Second Per Watt, More Is BetterEmbree 3.13Binary: Pathtracer ISPC - Model: CrownWithout AVX-512Default, AVX-512 Enabled0.04230.08460.12690.16920.21150.1530.188
MinAvgMaxWithout AVX-512515253005881Default, AVX-512 Enabled514653245881OpenBenchmarking.orgMegahertz, More Is BetterEmbree 3.13CPU Peak Freq (Highest CPU Core Frequency) Monitor16003200480064008000
MinAvgMaxWithout AVX-51223.3190.5227.8Default, AVX-512 Enabled22.6187.3235.9OpenBenchmarking.orgWatts, Fewer Is BetterEmbree 3.13CPU Power Consumption Monitor60120180240300
MinAvgMaxWithout AVX-51240.084.991.0Default, AVX-512 Enabled40.383.290.9OpenBenchmarking.orgCelsius, Fewer Is BetterEmbree 3.13CPU Temperature Monitor20406080100

OpenBenchmarking.orgFrames Per Second, More Is BetterEmbree 3.13Binary: Pathtracer ISPC - Model: Asian DragonWithout AVX-512Default, AVX-512 Enabled816243240SE +/- 0.16, N = 3SE +/- 0.08, N = 330.3935.12MIN: 29.85 / MAX: 30.94MIN: 34.64 / MAX: 36.13
OpenBenchmarking.orgFrames Per Second Per Watt, More Is BetterEmbree 3.13Binary: Pathtracer ISPC - Model: Asian DragonWithout AVX-512Default, AVX-512 Enabled0.04770.09540.14310.19080.23850.1710.212
MinAvgMaxWithout AVX-512519753545881Default, AVX-512 Enabled522253755881OpenBenchmarking.orgMegahertz, More Is BetterEmbree 3.13CPU Peak Freq (Highest CPU Core Frequency) Monitor16003200480064008000
MinAvgMaxWithout AVX-51224.3177.3210.0Default, AVX-512 Enabled22.6166.0203.7OpenBenchmarking.orgWatts, Fewer Is BetterEmbree 3.13CPU Power Consumption Monitor60120180240300
MinAvgMaxWithout AVX-51244.681.085.9Default, AVX-512 Enabled44.175.180.8OpenBenchmarking.orgCelsius, Fewer Is BetterEmbree 3.13CPU Temperature Monitor20406080100

OpenVKL

OpenVKL is the Intel Open Volume Kernel Library that offers high-performance volume computation kernels and part of the Intel oneAPI rendering toolkit. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgItems / Sec, More Is BetterOpenVKL 1.0Benchmark: vklBenchmark ISPCWithout AVX-512Default, AVX-512 Enabled4080120160200SE +/- 0.00, N = 3SE +/- 0.33, N = 3153199MIN: 14 / MAX: 1843MIN: 17 / MAX: 2254
OpenBenchmarking.orgItems / Sec Per Watt, More Is BetterOpenVKL 1.0Benchmark: vklBenchmark ISPCWithout AVX-512Default, AVX-512 Enabled0.28730.57460.86191.14921.43650.9121.277
MinAvgMaxWithout AVX-512507253465881Default, AVX-512 Enabled516854035881OpenBenchmarking.orgMegahertz, More Is BetterOpenVKL 1.0CPU Peak Freq (Highest CPU Core Frequency) Monitor16003200480064008000
MinAvgMaxWithout AVX-51223.6167.7228.1Default, AVX-512 Enabled22.4155.8211.8OpenBenchmarking.orgWatts, Fewer Is BetterOpenVKL 1.0CPU Power Consumption Monitor60120180240300
MinAvgMaxWithout AVX-51243.984.995.4Default, AVX-512 Enabled43.879.189.5OpenBenchmarking.orgCelsius, Fewer Is BetterOpenVKL 1.0CPU Temperature Monitor20406080100

OSPRay

Intel OSPRay is a portable ray-tracing engine for high-performance, high-fidelity scientific visualizations. OSPRay builds off Intel's Embree and Intel SPMD Program Compiler (ISPC) components as part of the oneAPI rendering toolkit. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgItems Per Second, More Is BetterOSPRay 2.10Benchmark: particle_volume/pathtracer/real_timeWithout AVX-512Default, AVX-512 Enabled50100150200250SE +/- 0.59, N = 3SE +/- 0.91, N = 3231.38250.66
OpenBenchmarking.orgItems Per Second Per Watt, More Is BetterOSPRay 2.10Benchmark: particle_volume/pathtracer/real_timeWithout AVX-512Default, AVX-512 Enabled0.31370.62740.94111.25481.56851.2371.394
MinAvgMaxWithout AVX-512507051855881Default, AVX-512 Enabled512752705881OpenBenchmarking.orgMegahertz, More Is BetterOSPRay 2.10CPU Peak Freq (Highest CPU Core Frequency) Monitor16003200480064008000
MinAvgMaxWithout AVX-51222.9187.0222.6Default, AVX-512 Enabled22.4179.8215.5OpenBenchmarking.orgWatts, Fewer Is BetterOSPRay 2.10CPU Power Consumption Monitor60120180240300
MinAvgMaxWithout AVX-51245.090.895.8Default, AVX-512 Enabled43.186.393.0OpenBenchmarking.orgCelsius, Fewer Is BetterOSPRay 2.10CPU Temperature Monitor20406080100

OpenBenchmarking.orgItems Per Second, More Is BetterOSPRay 2.10Benchmark: gravity_spheres_volume/dim_512/ao/real_timeWithout AVX-512Default, AVX-512 Enabled246810SE +/- 0.00574, N = 3SE +/- 0.00437, N = 34.535298.05397
OpenBenchmarking.orgItems Per Second Per Watt, More Is BetterOSPRay 2.10Benchmark: gravity_spheres_volume/dim_512/ao/real_timeWithout AVX-512Default, AVX-512 Enabled0.00970.01940.02910.03880.04850.0230.043
MinAvgMaxWithout AVX-512513152015881Default, AVX-512 Enabled516552435881OpenBenchmarking.orgMegahertz, More Is BetterOSPRay 2.10CPU Peak Freq (Highest CPU Core Frequency) Monitor16003200480064008000
MinAvgMaxWithout AVX-51223.1193.5209.6Default, AVX-512 Enabled22.5189.2205.4OpenBenchmarking.orgWatts, Fewer Is BetterOSPRay 2.10CPU Power Consumption Monitor60120180240300
MinAvgMaxWithout AVX-51244.891.493.5Default, AVX-512 Enabled42.587.089.1OpenBenchmarking.orgCelsius, Fewer Is BetterOSPRay 2.10CPU Temperature Monitor20406080100

OpenBenchmarking.orgItems Per Second, More Is BetterOSPRay 2.10Benchmark: gravity_spheres_volume/dim_512/scivis/real_timeWithout AVX-512Default, AVX-512 Enabled246810SE +/- 0.00159, N = 3SE +/- 0.03212, N = 34.333987.93432
OpenBenchmarking.orgItems Per Second Per Watt, More Is BetterOSPRay 2.10Benchmark: gravity_spheres_volume/dim_512/scivis/real_timeWithout AVX-512Default, AVX-512 Enabled0.00950.0190.02850.0380.04750.0220.042
MinAvgMaxWithout AVX-512512152015881Default, AVX-512 Enabled516652355881OpenBenchmarking.orgMegahertz, More Is BetterOSPRay 2.10CPU Peak Freq (Highest CPU Core Frequency) Monitor16003200480064008000
MinAvgMaxWithout AVX-51223.1193.1207.2Default, AVX-512 Enabled22.4188.0204.2OpenBenchmarking.orgWatts, Fewer Is BetterOSPRay 2.10CPU Power Consumption Monitor60120180240300
MinAvgMaxWithout AVX-51247.492.093.9Default, AVX-512 Enabled46.487.389.4OpenBenchmarking.orgCelsius, Fewer Is BetterOSPRay 2.10CPU Temperature Monitor20406080100

OpenBenchmarking.orgItems Per Second, More Is BetterOSPRay 2.10Benchmark: gravity_spheres_volume/dim_512/pathtracer/real_timeWithout AVX-512Default, AVX-512 Enabled3691215SE +/- 0.00119, N = 3SE +/- 0.00541, N = 36.922279.50906
OpenBenchmarking.orgItems Per Second Per Watt, More Is BetterOSPRay 2.10Benchmark: gravity_spheres_volume/dim_512/pathtracer/real_timeWithout AVX-512Default, AVX-512 Enabled0.01130.02260.03390.04520.05650.0350.050
MinAvgMaxWithout AVX-512510751875881Default, AVX-512 Enabled515552255881OpenBenchmarking.orgMegahertz, More Is BetterOSPRay 2.10CPU Peak Freq (Highest CPU Core Frequency) Monitor16003200480064008000
MinAvgMaxWithout AVX-51223.4197.7214.7Default, AVX-512 Enabled22.8191.7209.5OpenBenchmarking.orgWatts, Fewer Is BetterOSPRay 2.10CPU Power Consumption Monitor60120180240300
MinAvgMaxWithout AVX-51248.093.395.1Default, AVX-512 Enabled46.388.991.0OpenBenchmarking.orgCelsius, Fewer Is BetterOSPRay 2.10CPU Temperature Monitor20406080100

oneDNN

This is a test of the Intel oneDNN as an Intel-optimized library for Deep Neural Networks and making use of its built-in benchdnn functionality. The result is the total perf time reported. Intel oneDNN was formerly known as DNNL (Deep Neural Network Library) and MKL-DNN before being rebranded as part of Intel oneAPI. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.6Harness: IP Shapes 1D - Data Type: u8s8f32 - Engine: CPUWithout AVX-512Default, AVX-512 Enabled0.14080.28160.42240.56320.704SE +/- 0.006181, N = 5SE +/- 0.007969, N = 150.6259420.417196-mno-avx512f - MIN: 0.58-mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi - MIN: 0.341. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -std=c++11 -pie -ldl -lpthread
MinAvgMaxWithout AVX-512512553675881Default, AVX-512 Enabled512754195881OpenBenchmarking.orgMegahertz, More Is BetteroneDNN 2.6CPU Peak Freq (Highest CPU Core Frequency) Monitor16003200480064008000
MinAvgMaxWithout AVX-51223.9140.4221.2Default, AVX-512 Enabled20.1124.9214.3OpenBenchmarking.orgWatts, Fewer Is BetteroneDNN 2.6CPU Power Consumption Monitor60120180240300
MinAvgMaxWithout AVX-51248.180.293.6Default, AVX-512 Enabled48.470.887.5OpenBenchmarking.orgCelsius, Fewer Is BetteroneDNN 2.6CPU Temperature Monitor20406080100

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.6Harness: Convolution Batch Shapes Auto - Data Type: u8s8f32 - Engine: CPUWithout AVX-512Default, AVX-512 Enabled246810SE +/- 0.00637, N = 7SE +/- 0.00255, N = 77.449365.32127-mno-avx512f - MIN: 7.29-mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi - MIN: 5.261. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -std=c++11 -pie -ldl -lpthread
MinAvgMaxWithout AVX-512531855855881Default, AVX-512 Enabled491054755881OpenBenchmarking.orgMegahertz, More Is BetteroneDNN 2.6CPU Peak Freq (Highest CPU Core Frequency) Monitor16003200480064008000
MinAvgMaxWithout AVX-51223.593.1166.1Default, AVX-512 Enabled11.5107.7218.9OpenBenchmarking.orgWatts, Fewer Is BetteroneDNN 2.6CPU Power Consumption Monitor60120180240300
MinAvgMaxWithout AVX-51245.158.865.6Default, AVX-512 Enabled42.069.782.9OpenBenchmarking.orgCelsius, Fewer Is BetteroneDNN 2.6CPU Temperature Monitor20406080100

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.6Harness: Deconvolution Batch shapes_1d - Data Type: u8s8f32 - Engine: CPUWithout AVX-512Default, AVX-512 Enabled0.180.360.540.720.9SE +/- 0.010456, N = 3SE +/- 0.000107, N = 30.8001160.415940-mno-avx512f - MIN: 0.76-mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi - MIN: 0.41. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -std=c++11 -pie -ldl -lpthread
MinAvgMaxWithout AVX-512499253485881Default, AVX-512 Enabled518053815881OpenBenchmarking.orgMegahertz, More Is BetteroneDNN 2.6CPU Peak Freq (Highest CPU Core Frequency) Monitor16003200480064008000
MinAvgMaxWithout AVX-51217.5152.3233.2Default, AVX-512 Enabled23.0149.1219.8OpenBenchmarking.orgWatts, Fewer Is BetteroneDNN 2.6CPU Power Consumption Monitor60120180240300
MinAvgMaxWithout AVX-51240.981.994.9Default, AVX-512 Enabled41.375.886.6OpenBenchmarking.orgCelsius, Fewer Is BetteroneDNN 2.6CPU Temperature Monitor20406080100

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.6Harness: Deconvolution Batch shapes_3d - Data Type: u8s8f32 - Engine: CPUWithout AVX-512Default, AVX-512 Enabled0.24390.48780.73170.97561.2195SE +/- 0.006665, N = 9SE +/- 0.001581, N = 91.0839600.576432-mno-avx512f - MIN: 1.03-mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi - MIN: 0.561. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -std=c++11 -pie -ldl -lpthread
MinAvgMaxWithout AVX-512515755855881Default, AVX-512 Enabled520856135881OpenBenchmarking.orgMegahertz, More Is BetteroneDNN 2.6CPU Peak Freq (Highest CPU Core Frequency) Monitor16003200480064008000
MinAvgMaxWithout AVX-51222.8108.1230.7Default, AVX-512 Enabled23.1102.3213.6OpenBenchmarking.orgWatts, Fewer Is BetteroneDNN 2.6CPU Power Consumption Monitor60120180240300
MinAvgMaxWithout AVX-51244.877.991.6Default, AVX-512 Enabled43.572.482.6OpenBenchmarking.orgCelsius, Fewer Is BetteroneDNN 2.6CPU Temperature Monitor20406080100

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.6Harness: Recurrent Neural Network Training - Data Type: u8s8f32 - Engine: CPUWithout AVX-512Default, AVX-512 Enabled30060090012001500SE +/- 8.37, N = 3SE +/- 1.54, N = 31566.091137.29-mno-avx512f - MIN: 1541.57-mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi - MIN: 1130.881. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -std=c++11 -pie -ldl -lpthread
MinAvgMaxWithout AVX-512477250075881Default, AVX-512 Enabled482251665881OpenBenchmarking.orgMegahertz, More Is BetteroneDNN 2.6CPU Peak Freq (Highest CPU Core Frequency) Monitor16003200480064008000
MinAvgMaxWithout AVX-51223.2187.5219.5Default, AVX-512 Enabled22.8200.9226.3OpenBenchmarking.orgWatts, Fewer Is BetteroneDNN 2.6CPU Power Consumption Monitor60120180240300
MinAvgMaxWithout AVX-51243.588.195.9Default, AVX-512 Enabled42.587.892.0OpenBenchmarking.orgCelsius, Fewer Is BetteroneDNN 2.6CPU Temperature Monitor20406080100

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.6Harness: Recurrent Neural Network Inference - Data Type: u8s8f32 - Engine: CPUWithout AVX-512Default, AVX-512 Enabled2004006008001000SE +/- 3.36, N = 3SE +/- 0.21, N = 3910.46583.32-mno-avx512f - MIN: 898.05-mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi - MIN: 579.291. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -std=c++11 -pie -ldl -lpthread
MinAvgMaxWithout AVX-512480450515881Default, AVX-512 Enabled480250915881OpenBenchmarking.orgMegahertz, More Is BetteroneDNN 2.6CPU Peak Freq (Highest CPU Core Frequency) Monitor16003200480064008000
MinAvgMaxWithout AVX-51223.3181.1224.4Default, AVX-512 Enabled23.8200.3227.2OpenBenchmarking.orgWatts, Fewer Is BetteroneDNN 2.6CPU Power Consumption Monitor60120180240300
MinAvgMaxWithout AVX-51247.586.495.8Default, AVX-512 Enabled47.089.292.6OpenBenchmarking.orgCelsius, Fewer Is BetteroneDNN 2.6CPU Temperature Monitor20406080100

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.6Harness: Recurrent Neural Network Training - Data Type: bf16bf16bf16 - Engine: CPUWithout AVX-512Default, AVX-512 Enabled30060090012001500SE +/- 19.60, N = 3SE +/- 1.66, N = 31544.391137.96-mno-avx512f - MIN: 1494.51-mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi - MIN: 1131.231. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -std=c++11 -pie -ldl -lpthread
MinAvgMaxWithout AVX-512474549855881Default, AVX-512 Enabled456051635881OpenBenchmarking.orgMegahertz, More Is BetteroneDNN 2.6CPU Peak Freq (Highest CPU Core Frequency) Monitor16003200480064008000
MinAvgMaxWithout AVX-51223.4189.5220.2Default, AVX-512 Enabled20.3200.1223.4OpenBenchmarking.orgWatts, Fewer Is BetteroneDNN 2.6CPU Power Consumption Monitor60120180240300
MinAvgMaxWithout AVX-51247.389.896.1Default, AVX-512 Enabled47.588.892.0OpenBenchmarking.orgCelsius, Fewer Is BetteroneDNN 2.6CPU Temperature Monitor20406080100

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.6Harness: Recurrent Neural Network Inference - Data Type: bf16bf16bf16 - Engine: CPUWithout AVX-512Default, AVX-512 Enabled2004006008001000SE +/- 5.88, N = 3SE +/- 1.02, N = 3902.10582.90-mno-avx512f - MIN: 885.67-mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi - MIN: 578.181. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -std=c++11 -pie -ldl -lpthread
MinAvgMaxWithout AVX-512449550585881Default, AVX-512 Enabled442150885881OpenBenchmarking.orgMegahertz, More Is BetteroneDNN 2.6CPU Peak Freq (Highest CPU Core Frequency) Monitor16003200480064008000
MinAvgMaxWithout AVX-51223.1180.3220.1Default, AVX-512 Enabled22.4200.3226.4OpenBenchmarking.orgWatts, Fewer Is BetteroneDNN 2.6CPU Power Consumption Monitor60120180240300
MinAvgMaxWithout AVX-51247.686.896.0Default, AVX-512 Enabled47.588.992.8OpenBenchmarking.orgCelsius, Fewer Is BetteroneDNN 2.6CPU Temperature Monitor20406080100

OSPRay Studio

Intel OSPRay Studio is an open-source, interactive visualization and ray-tracing software package. OSPRay Studio makes use of Intel OSPRay, a portable ray-tracing engine for high-performance, high-fidelity visualizations. OSPRay builds off Intel's Embree and Intel SPMD Program Compiler (ISPC) components as part of the oneAPI rendering toolkit. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.11Camera: 1 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path TracerWithout AVX-512Default, AVX-512 Enabled10002000300040005000SE +/- 6.51, N = 3SE +/- 5.21, N = 345023659-mno-avx512f-mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi1. (CXX) g++ options: -O3 -march=native -ldl
MinAvgMaxWithout AVX-512512352125881Default, AVX-512 Enabled513652305881OpenBenchmarking.orgMegahertz, More Is BetterOSPRay Studio 0.11CPU Peak Freq (Highest CPU Core Frequency) Monitor16003200480064008000
MinAvgMaxWithout AVX-51217.7198.8223.6Default, AVX-512 Enabled17.2198.2221.8OpenBenchmarking.orgWatts, Fewer Is BetterOSPRay Studio 0.11CPU Power Consumption Monitor60120180240300
MinAvgMaxWithout AVX-51241.991.094.1Default, AVX-512 Enabled44.989.592.5OpenBenchmarking.orgCelsius, Fewer Is BetterOSPRay Studio 0.11CPU Temperature Monitor20406080100

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.11Camera: 3 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path TracerWithout AVX-512Default, AVX-512 Enabled11002200330044005500SE +/- 3.28, N = 3SE +/- 5.55, N = 353484368-mno-avx512f-mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi1. (CXX) g++ options: -O3 -march=native -ldl
MinAvgMaxWithout AVX-512511752075881Default, AVX-512 Enabled513452275881OpenBenchmarking.orgMegahertz, More Is BetterOSPRay Studio 0.11CPU Peak Freq (Highest CPU Core Frequency) Monitor16003200480064008000
MinAvgMaxWithout AVX-51222.8197.3224.0Default, AVX-512 Enabled22.9198.4217.9OpenBenchmarking.orgWatts, Fewer Is BetterOSPRay Studio 0.11CPU Power Consumption Monitor60120180240300
MinAvgMaxWithout AVX-51247.691.894.5Default, AVX-512 Enabled47.089.792.5OpenBenchmarking.orgCelsius, Fewer Is BetterOSPRay Studio 0.11CPU Temperature Monitor20406080100

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.11Camera: 1 - Resolution: 4K - Samples Per Pixel: 16 - Renderer: Path TracerWithout AVX-512Default, AVX-512 Enabled16K32K48K64K80KSE +/- 91.34, N = 3SE +/- 138.54, N = 37484462029-mno-avx512f-mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi1. (CXX) g++ options: -O3 -march=native -ldl
MinAvgMaxWithout AVX-512511852545881Default, AVX-512 Enabled514252955881OpenBenchmarking.orgMegahertz, More Is BetterOSPRay Studio 0.11CPU Peak Freq (Highest CPU Core Frequency) Monitor16003200480064008000
MinAvgMaxWithout AVX-51212.7189.2223.7Default, AVX-512 Enabled19.2185.5223.2OpenBenchmarking.orgWatts, Fewer Is BetterOSPRay Studio 0.11CPU Power Consumption Monitor60120180240300
MinAvgMaxWithout AVX-51248.090.295.0Default, AVX-512 Enabled46.987.892.4OpenBenchmarking.orgCelsius, Fewer Is BetterOSPRay Studio 0.11CPU Temperature Monitor20406080100

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.11Camera: 1 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path TracerWithout AVX-512Default, AVX-512 Enabled30K60K90K120K150KSE +/- 168.25, N = 3SE +/- 140.99, N = 3146156120727-mno-avx512f-mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi1. (CXX) g++ options: -O3 -march=native -ldl
MinAvgMaxWithout AVX-512510652025881Default, AVX-512 Enabled511852295881OpenBenchmarking.orgMegahertz, More Is BetterOSPRay Studio 0.11CPU Peak Freq (Highest CPU Core Frequency) Monitor16003200480064008000
MinAvgMaxWithout AVX-51216.1199.9221.5Default, AVX-512 Enabled14.7198.1226.1OpenBenchmarking.orgWatts, Fewer Is BetterOSPRay Studio 0.11CPU Power Consumption Monitor60120180240300
MinAvgMaxWithout AVX-51248.192.395.3Default, AVX-512 Enabled46.690.093.5OpenBenchmarking.orgCelsius, Fewer Is BetterOSPRay Studio 0.11CPU Temperature Monitor20406080100

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.11Camera: 3 - Resolution: 4K - Samples Per Pixel: 16 - Renderer: Path TracerWithout AVX-512Default, AVX-512 Enabled20K40K60K80K100KSE +/- 7.57, N = 3SE +/- 149.41, N = 38834473617-mno-avx512f-mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi1. (CXX) g++ options: -O3 -march=native -ldl
MinAvgMaxWithout AVX-512512252405881Default, AVX-512 Enabled512852645881OpenBenchmarking.orgMegahertz, More Is BetterOSPRay Studio 0.11CPU Peak Freq (Highest CPU Core Frequency) Monitor16003200480064008000
MinAvgMaxWithout AVX-51223.0192.2220.6Default, AVX-512 Enabled22.9188.7219.2OpenBenchmarking.orgWatts, Fewer Is BetterOSPRay Studio 0.11CPU Power Consumption Monitor60120180240300
MinAvgMaxWithout AVX-51248.390.494.5Default, AVX-512 Enabled47.588.393.0OpenBenchmarking.orgCelsius, Fewer Is BetterOSPRay Studio 0.11CPU Temperature Monitor20406080100

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.11Camera: 3 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path TracerWithout AVX-512Default, AVX-512 Enabled40K80K120K160K200KSE +/- 155.59, N = 3SE +/- 116.66, N = 3172872143981-mno-avx512f-mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi1. (CXX) g++ options: -O3 -march=native -ldl
MinAvgMaxWithout AVX-512511851945881Default, AVX-512 Enabled513152205881OpenBenchmarking.orgMegahertz, More Is BetterOSPRay Studio 0.11CPU Peak Freq (Highest CPU Core Frequency) Monitor16003200480064008000
MinAvgMaxWithout AVX-51223.1201.2218.3Default, AVX-512 Enabled22.9199.7222.9OpenBenchmarking.orgWatts, Fewer Is BetterOSPRay Studio 0.11CPU Power Consumption Monitor60120180240300
MinAvgMaxWithout AVX-51248.092.395.1Default, AVX-512 Enabled47.490.093.4OpenBenchmarking.orgCelsius, Fewer Is BetterOSPRay Studio 0.11CPU Temperature Monitor20406080100

Cpuminer-Opt

Cpuminer-Opt is a fork of cpuminer-multi that carries a wide range of CPU performance optimizations for measuring the potential cryptocurrency mining performance of the CPU/processor with a wide variety of cryptocurrencies. The benchmark reports the hash speed for the CPU mining performance for the selected cryptocurrency. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgkH/s, More Is BetterCpuminer-Opt 3.18Algorithm: Blake-2 SWithout AVX-512Default, AVX-512 Enabled500K1000K1500K2000K2500KSE +/- 4192.40, N = 3SE +/- 38034.65, N = 1210337002113434-mno-avx512f-mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi1. (CXX) g++ options: -O3 -march=native -lcurl -lz -lpthread -lssl -lcrypto -lgmp
OpenBenchmarking.orgkH/s Per Watt, More Is BetterCpuminer-Opt 3.18Algorithm: Blake-2 SWithout AVX-512Default, AVX-512 Enabled4K8K12K16K20K9800.3719614.14
MinAvgMaxWithout AVX-512520455215881Default, AVX-512 Enabled526055425881OpenBenchmarking.orgMegahertz, More Is BetterCpuminer-Opt 3.18CPU Peak Freq (Highest CPU Core Frequency) Monitor16003200480064008000
MinAvgMaxWithout AVX-51221.0105.5175.6Default, AVX-512 Enabled19.2107.8200.8OpenBenchmarking.orgWatts, Fewer Is BetterCpuminer-Opt 3.18CPU Power Consumption Monitor50100150200250
MinAvgMaxWithout AVX-51248.669.285.9Default, AVX-512 Enabled47.166.479.6OpenBenchmarking.orgCelsius, Fewer Is BetterCpuminer-Opt 3.18CPU Temperature Monitor20406080100

OpenBenchmarking.orgkH/s, More Is BetterCpuminer-Opt 3.18Algorithm: GarlicoinWithout AVX-512Default, AVX-512 Enabled9001800270036004500SE +/- 25.96, N = 3SE +/- 75.31, N = 122597.653977.80-mno-avx512f-mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi1. (CXX) g++ options: -O3 -march=native -lcurl -lz -lpthread -lssl -lcrypto -lgmp
OpenBenchmarking.orgkH/s Per Watt, More Is BetterCpuminer-Opt 3.18Algorithm: GarlicoinWithout AVX-512Default, AVX-512 Enabled61218243015.4524.63
MinAvgMaxWithout AVX-512524453395881Default, AVX-512 Enabled528353745881OpenBenchmarking.orgMegahertz, More Is BetterCpuminer-Opt 3.18CPU Peak Freq (Highest CPU Core Frequency) Monitor16003200480064008000
MinAvgMaxWithout AVX-51223.1168.2190.7Default, AVX-512 Enabled22.9161.5185.7OpenBenchmarking.orgWatts, Fewer Is BetterCpuminer-Opt 3.18CPU Power Consumption Monitor50100150200250
MinAvgMaxWithout AVX-51244.375.979.9Default, AVX-512 Enabled40.872.976.3OpenBenchmarking.orgCelsius, Fewer Is BetterCpuminer-Opt 3.18CPU Temperature Monitor20406080100

OpenBenchmarking.orgkH/s, More Is BetterCpuminer-Opt 3.18Algorithm: SkeincoinWithout AVX-512Default, AVX-512 Enabled60K120K180K240K300KSE +/- 1803.62, N = 3SE +/- 424.91, N = 3204320284667-mno-avx512f-mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi1. (CXX) g++ options: -O3 -march=native -lcurl -lz -lpthread -lssl -lcrypto -lgmp
OpenBenchmarking.orgkH/s Per Watt, More Is BetterCpuminer-Opt 3.18Algorithm: SkeincoinWithout AVX-512Default, AVX-512 Enabled60012001800240030001926.962696.44
MinAvgMaxWithout AVX-512518955175881Default, AVX-512 Enabled515755355881OpenBenchmarking.orgMegahertz, More Is BetterCpuminer-Opt 3.18CPU Peak Freq (Highest CPU Core Frequency) Monitor16003200480064008000
MinAvgMaxWithout AVX-51222.9106.0219.4Default, AVX-512 Enabled22.7105.6218.2OpenBenchmarking.orgWatts, Fewer Is BetterCpuminer-Opt 3.18CPU Power Consumption Monitor60120180240300
MinAvgMaxWithout AVX-51244.868.584.1Default, AVX-512 Enabled43.366.685.6OpenBenchmarking.orgCelsius, Fewer Is BetterCpuminer-Opt 3.18CPU Temperature Monitor20406080100

OpenBenchmarking.orgkH/s, More Is BetterCpuminer-Opt 3.18Algorithm: Myriad-GroestlWithout AVX-512Default, AVX-512 Enabled13K26K39K52K65KSE +/- 105.88, N = 3SE +/- 669.95, N = 151639359957-mno-avx512f-mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi1. (CXX) g++ options: -O3 -march=native -lcurl -lz -lpthread -lssl -lcrypto -lgmp
OpenBenchmarking.orgkH/s Per Watt, More Is BetterCpuminer-Opt 3.18Algorithm: Myriad-GroestlWithout AVX-512Default, AVX-512 Enabled110220330440550128.78496.89
MinAvgMaxWithout AVX-512534454495881Default, AVX-512 Enabled529855035881OpenBenchmarking.orgMegahertz, More Is BetterCpuminer-Opt 3.18CPU Peak Freq (Highest CPU Core Frequency) Monitor16003200480064008000
MinAvgMaxWithout AVX-51223.6127.3150.7Default, AVX-512 Enabled21.7120.7179.8OpenBenchmarking.orgWatts, Fewer Is BetterCpuminer-Opt 3.18CPU Power Consumption Monitor50100150200250
MinAvgMaxWithout AVX-51243.367.773.0Default, AVX-512 Enabled42.167.671.3OpenBenchmarking.orgCelsius, Fewer Is BetterCpuminer-Opt 3.18CPU Temperature Monitor20406080100

OpenBenchmarking.orgkH/s, More Is BetterCpuminer-Opt 3.18Algorithm: LBC, LBRY CreditsWithout AVX-512Default, AVX-512 Enabled30K60K90K120K150KSE +/- 40.41, N = 3SE +/- 177.76, N = 376960151720-mno-avx512f-mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi1. (CXX) g++ options: -O3 -march=native -lcurl -lz -lpthread -lssl -lcrypto -lgmp
OpenBenchmarking.orgkH/s Per Watt, More Is BetterCpuminer-Opt 3.18Algorithm: LBC, LBRY CreditsWithout AVX-512Default, AVX-512 Enabled30060090012001500579.301370.92
MinAvgMaxWithout AVX-512516454595881Default, AVX-512 Enabled520855205881OpenBenchmarking.orgMegahertz, More Is BetterCpuminer-Opt 3.18CPU Peak Freq (Highest CPU Core Frequency) Monitor16003200480064008000
MinAvgMaxWithout AVX-51223.5132.8181.2Default, AVX-512 Enabled23.3110.7206.7OpenBenchmarking.orgWatts, Fewer Is BetterCpuminer-Opt 3.18CPU Power Consumption Monitor60120180240300
MinAvgMaxWithout AVX-51241.973.086.5Default, AVX-512 Enabled40.566.683.9OpenBenchmarking.orgCelsius, Fewer Is BetterCpuminer-Opt 3.18CPU Temperature Monitor20406080100

OpenBenchmarking.orgkH/s, More Is BetterCpuminer-Opt 3.18Algorithm: Quad SHA-256, PyriteWithout AVX-512Default, AVX-512 Enabled70K140K210K280K350KSE +/- 177.04, N = 3SE +/- 1040.42, N = 3192667321503-mno-avx512f-mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi1. (CXX) g++ options: -O3 -march=native -lcurl -lz -lpthread -lssl -lcrypto -lgmp
OpenBenchmarking.orgkH/s Per Watt, More Is BetterCpuminer-Opt 3.18Algorithm: Quad SHA-256, PyriteWithout AVX-512Default, AVX-512 Enabled60012001800240030001788.773025.64
MinAvgMaxWithout AVX-512520755225881Default, AVX-512 Enabled522455405881OpenBenchmarking.orgMegahertz, More Is BetterCpuminer-Opt 3.18CPU Peak Freq (Highest CPU Core Frequency) Monitor16003200480064008000
MinAvgMaxWithout AVX-51223.2107.7185.5Default, AVX-512 Enabled23.3106.3178.0OpenBenchmarking.orgWatts, Fewer Is BetterCpuminer-Opt 3.18CPU Power Consumption Monitor50100150200250
MinAvgMaxWithout AVX-51244.067.780.0Default, AVX-512 Enabled41.464.781.5OpenBenchmarking.orgCelsius, Fewer Is BetterCpuminer-Opt 3.18CPU Temperature Monitor20406080100

Mobile Neural Network

MNN is the Mobile Neural Network as a highly efficient, lightweight deep learning framework developed by Alibaba. This MNN test profile is building the OpenMP / CPU threaded version for processor benchmarking and not any GPU-accelerated test. MNN does allow making use of AVX-512 extensions. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgms, Fewer Is BetterMobile Neural Network 2.1Model: SqueezeNetV1.0Without AVX-512Default, AVX-512 Enabled0.89931.79862.69793.59724.4965SE +/- 0.121, N = 3SE +/- 0.015, N = 63.9973.543-mno-avx512f - MIN: 3.72 / MAX: 5.69-mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi - MIN: 3.43 / MAX: 10.231. (CXX) g++ options: -O3 -march=native -std=c++11 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl

NCNN

NCNN is a high performance neural network inference framework optimized for mobile and other platforms developed by Tencent. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20220729Target: CPU - Model: vision_transformerWithout AVX-512Default, AVX-512 Enabled1428425670SE +/- 0.91, N = 3SE +/- 0.03, N = 362.7439.57-mno-avx512f - MIN: 61.57 / MAX: 65.21-mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi - MIN: 39.32 / MAX: 41.991. (CXX) g++ options: -O3 -march=native -rdynamic -lgomp -lpthread

OpenVINO

This is a test of the Intel OpenVINO, a toolkit around neural networks, using its built-in benchmarking support and analyzing the throughput and latency for various models. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.2.devModel: Face Detection FP16 - Device: CPUWithout AVX-512Default, AVX-512 Enabled48121620SE +/- 0.01, N = 3SE +/- 0.01, N = 36.7414.50-mno-avx512f-mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi1. (CXX) g++ options: -fPIC -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -flto -shared

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.2.devModel: Face Detection FP16 - Device: CPUWithout AVX-512Default, AVX-512 Enabled30060090012001500SE +/- 0.92, N = 3SE +/- 0.48, N = 31178.81549.94-mno-avx512f - MIN: 596.16 / MAX: 1250.72-mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi - MIN: 282.71 / MAX: 577.011. (CXX) g++ options: -fPIC -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -flto -shared
MinAvgMaxWithout AVX-512498851515881Default, AVX-512 Enabled503851805881OpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2022.2.devCPU Peak Freq (Highest CPU Core Frequency) Monitor16003200480064008000
MinAvgMaxWithout AVX-51220.6212.4235.9Default, AVX-512 Enabled23.3209.6235.1OpenBenchmarking.orgWatts, Fewer Is BetterOpenVINO 2022.2.devCPU Power Consumption Monitor60120180240300
MinAvgMaxWithout AVX-51241.893.096.3Default, AVX-512 Enabled40.993.195.9OpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2022.2.devCPU Temperature Monitor20406080100

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.2.devModel: Person Detection FP16 - Device: CPUWithout AVX-512Default, AVX-512 Enabled246810SE +/- 0.00, N = 3SE +/- 0.02, N = 34.207.57-mno-avx512f-mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi1. (CXX) g++ options: -fPIC -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -flto -shared

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.2.devModel: Person Detection FP16 - Device: CPUWithout AVX-512Default, AVX-512 Enabled400800120016002000SE +/- 0.47, N = 3SE +/- 2.40, N = 31889.401050.37-mno-avx512f - MIN: 1032.21 / MAX: 2215.28-mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi - MIN: 604.91 / MAX: 1254.321. (CXX) g++ options: -fPIC -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -flto -shared
MinAvgMaxWithout AVX-512494751895881Default, AVX-512 Enabled503552295881OpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2022.2.devCPU Peak Freq (Highest CPU Core Frequency) Monitor16003200480064008000
MinAvgMaxWithout AVX-51210.2206.7232.4Default, AVX-512 Enabled23.2199.4219.9OpenBenchmarking.orgWatts, Fewer Is BetterOpenVINO 2022.2.devCPU Power Consumption Monitor60120180240300
MinAvgMaxWithout AVX-51247.694.096.6Default, AVX-512 Enabled47.193.296.1OpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2022.2.devCPU Temperature Monitor20406080100

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.2.devModel: Person Detection FP32 - Device: CPUWithout AVX-512Default, AVX-512 Enabled246810SE +/- 0.02, N = 3SE +/- 0.02, N = 34.207.55-mno-avx512f-mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi1. (CXX) g++ options: -fPIC -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -flto -shared

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.2.devModel: Person Detection FP32 - Device: CPUWithout AVX-512Default, AVX-512 Enabled400800120016002000SE +/- 5.93, N = 3SE +/- 3.05, N = 31887.131054.92-mno-avx512f - MIN: 1054.92 / MAX: 2161.5-mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi - MIN: 641.2 / MAX: 1276.511. (CXX) g++ options: -fPIC -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -flto -shared
MinAvgMaxWithout AVX-512491751575881Default, AVX-512 Enabled505952195881OpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2022.2.devCPU Peak Freq (Highest CPU Core Frequency) Monitor16003200480064008000
MinAvgMaxWithout AVX-51223.4205.1233.4Default, AVX-512 Enabled23.0199.5219.7OpenBenchmarking.orgWatts, Fewer Is BetterOpenVINO 2022.2.devCPU Power Consumption Monitor60120180240300
MinAvgMaxWithout AVX-51248.494.196.8Default, AVX-512 Enabled47.393.396.3OpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2022.2.devCPU Temperature Monitor20406080100

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.2.devModel: Vehicle Detection FP16 - Device: CPUWithout AVX-512Default, AVX-512 Enabled160320480640800SE +/- 5.20, N = 3SE +/- 8.04, N = 3502.28742.90-mno-avx512f-mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi1. (CXX) g++ options: -fPIC -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -flto -shared

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.2.devModel: Vehicle Detection FP16 - Device: CPUWithout AVX-512Default, AVX-512 Enabled48121620SE +/- 0.16, N = 3SE +/- 0.12, N = 315.9210.76-mno-avx512f - MIN: 6.75 / MAX: 34.35-mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi - MIN: 4.25 / MAX: 23.391. (CXX) g++ options: -fPIC -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -flto -shared
MinAvgMaxWithout AVX-512506251735881Default, AVX-512 Enabled514452655881OpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2022.2.devCPU Peak Freq (Highest CPU Core Frequency) Monitor16003200480064008000
MinAvgMaxWithout AVX-51220.6207.2225.3Default, AVX-512 Enabled21.9188.8207.3OpenBenchmarking.orgWatts, Fewer Is BetterOpenVINO 2022.2.devCPU Power Consumption Monitor60120180240300
MinAvgMaxWithout AVX-51247.991.294.1Default, AVX-512 Enabled47.583.486.0OpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2022.2.devCPU Temperature Monitor20406080100

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.2.devModel: Face Detection FP16-INT8 - Device: CPUWithout AVX-512Default, AVX-512 Enabled714212835SE +/- 0.02, N = 3SE +/- 0.01, N = 313.6028.44-mno-avx512f-mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi1. (CXX) g++ options: -fPIC -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -flto -shared

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.2.devModel: Face Detection FP16-INT8 - Device: CPUWithout AVX-512Default, AVX-512 Enabled130260390520650SE +/- 0.73, N = 3SE +/- 0.17, N = 3585.81280.86-mno-avx512f - MIN: 556.1 / MAX: 596-mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi - MIN: 263.49 / MAX: 294.781. (CXX) g++ options: -fPIC -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -flto -shared
MinAvgMaxWithout AVX-512496351015881Default, AVX-512 Enabled506951885881OpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2022.2.devCPU Peak Freq (Highest CPU Core Frequency) Monitor16003200480064008000
MinAvgMaxWithout AVX-51222.9206.6233.0Default, AVX-512 Enabled22.2207.0227.9OpenBenchmarking.orgWatts, Fewer Is BetterOpenVINO 2022.2.devCPU Power Consumption Monitor60120180240300
MinAvgMaxWithout AVX-51248.393.395.6Default, AVX-512 Enabled45.893.296.0OpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2022.2.devCPU Temperature Monitor20406080100

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.2.devModel: Vehicle Detection FP16-INT8 - Device: CPUWithout AVX-512Default, AVX-512 Enabled400800120016002000SE +/- 0.65, N = 3SE +/- 2.10, N = 3953.791890.25-mno-avx512f-mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi1. (CXX) g++ options: -fPIC -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -flto -shared

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.2.devModel: Vehicle Detection FP16-INT8 - Device: CPUWithout AVX-512Default, AVX-512 Enabled246810SE +/- 0.01, N = 3SE +/- 0.01, N = 38.384.23-mno-avx512f - MIN: 4.65 / MAX: 17.13-mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi - MIN: 2.63 / MAX: 12.451. (CXX) g++ options: -fPIC -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -flto -shared
MinAvgMaxWithout AVX-512502751255881Default, AVX-512 Enabled506651475881OpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2022.2.devCPU Peak Freq (Highest CPU Core Frequency) Monitor16003200480064008000
MinAvgMaxWithout AVX-51223.5209.4234.1Default, AVX-512 Enabled22.8212.9234.8OpenBenchmarking.orgWatts, Fewer Is BetterOpenVINO 2022.2.devCPU Power Consumption Monitor60120180240300
MinAvgMaxWithout AVX-51248.393.595.4Default, AVX-512 Enabled47.393.395.4OpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2022.2.devCPU Temperature Monitor20406080100

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.2.devModel: Weld Porosity Detection FP16 - Device: CPUWithout AVX-512Default, AVX-512 Enabled30060090012001500SE +/- 0.52, N = 3SE +/- 1.06, N = 3681.371455.45-mno-avx512f-mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi1. (CXX) g++ options: -fPIC -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -flto -shared

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.2.devModel: Weld Porosity Detection FP16 - Device: CPUWithout AVX-512Default, AVX-512 Enabled3691215SE +/- 0.01, N = 3SE +/- 0.00, N = 311.735.49-mno-avx512f - MIN: 6.24 / MAX: 20.45-mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi - MIN: 2.89 / MAX: 13.221. (CXX) g++ options: -fPIC -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -flto -shared
MinAvgMaxWithout AVX-512500851035881Default, AVX-512 Enabled507551595881OpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2022.2.devCPU Peak Freq (Highest CPU Core Frequency) Monitor16003200480064008000
MinAvgMaxWithout AVX-51223.1212.2232.9Default, AVX-512 Enabled22.8208.9234.0OpenBenchmarking.orgWatts, Fewer Is BetterOpenVINO 2022.2.devCPU Power Consumption Monitor60120180240300
MinAvgMaxWithout AVX-51248.093.995.8Default, AVX-512 Enabled47.893.395.4OpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2022.2.devCPU Temperature Monitor20406080100

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.2.devModel: Machine Translation EN To DE FP16 - Device: CPUWithout AVX-512Default, AVX-512 Enabled306090120150SE +/- 0.12, N = 3SE +/- 0.42, N = 366.03134.59-mno-avx512f-mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi1. (CXX) g++ options: -fPIC -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -flto -shared

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.2.devModel: Machine Translation EN To DE FP16 - Device: CPUWithout AVX-512Default, AVX-512 Enabled306090120150SE +/- 0.21, N = 3SE +/- 0.18, N = 3121.0659.39-mno-avx512f - MIN: 57.76 / MAX: 141.8-mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi - MIN: 26.85 / MAX: 70.781. (CXX) g++ options: -fPIC -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -flto -shared
MinAvgMaxWithout AVX-512488851405881Default, AVX-512 Enabled513952435881OpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2022.2.devCPU Peak Freq (Highest CPU Core Frequency) Monitor16003200480064008000
MinAvgMaxWithout AVX-51223.2205.1225.9Default, AVX-512 Enabled23.6191.8217.6OpenBenchmarking.orgWatts, Fewer Is BetterOpenVINO 2022.2.devCPU Power Consumption Monitor60120180240300
MinAvgMaxWithout AVX-51248.693.796.8Default, AVX-512 Enabled47.387.290.1OpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2022.2.devCPU Temperature Monitor20406080100

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.2.devModel: Weld Porosity Detection FP16-INT8 - Device: CPUWithout AVX-512Default, AVX-512 Enabled6001200180024003000SE +/- 2.11, N = 3SE +/- 4.82, N = 31353.842938.13-mno-avx512f-mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi1. (CXX) g++ options: -fPIC -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -flto -shared

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.2.devModel: Weld Porosity Detection FP16-INT8 - Device: CPUWithout AVX-512Default, AVX-512 Enabled3691215SE +/- 0.02, N = 3SE +/- 0.01, N = 311.815.44-mno-avx512f - MIN: 6.9 / MAX: 19.2-mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi - MIN: 2.88 / MAX: 13.321. (CXX) g++ options: -fPIC -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -flto -shared
MinAvgMaxWithout AVX-512498250935881Default, AVX-512 Enabled458251635881OpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2022.2.devCPU Peak Freq (Highest CPU Core Frequency) Monitor16003200480064008000
MinAvgMaxWithout AVX-51223.1211.2232.0Default, AVX-512 Enabled23.3212.3236.0OpenBenchmarking.orgWatts, Fewer Is BetterOpenVINO 2022.2.devCPU Power Consumption Monitor60120180240300
MinAvgMaxWithout AVX-51247.993.595.4Default, AVX-512 Enabled45.993.195.3OpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2022.2.devCPU Temperature Monitor20406080100

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.2.devModel: Person Vehicle Bike Detection FP16 - Device: CPUWithout AVX-512Default, AVX-512 Enabled400800120016002000SE +/- 1.39, N = 3SE +/- 3.05, N = 3907.361696.82-mno-avx512f-mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi1. (CXX) g++ options: -fPIC -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -flto -shared

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.2.devModel: Person Vehicle Bike Detection FP16 - Device: CPUWithout AVX-512Default, AVX-512 Enabled246810SE +/- 0.01, N = 3SE +/- 0.01, N = 38.804.71-mno-avx512f - MIN: 5.34 / MAX: 19.18-mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi - MIN: 3.46 / MAX: 12.81. (CXX) g++ options: -fPIC -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -flto -shared
MinAvgMaxWithout AVX-512489951145881Default, AVX-512 Enabled510051885881OpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2022.2.devCPU Peak Freq (Highest CPU Core Frequency) Monitor16003200480064008000
MinAvgMaxWithout AVX-51223.7209.7228.7Default, AVX-512 Enabled19.8209.2227.6OpenBenchmarking.orgWatts, Fewer Is BetterOpenVINO 2022.2.devCPU Power Consumption Monitor60120180240300
MinAvgMaxWithout AVX-51248.393.496.0Default, AVX-512 Enabled47.591.194.1OpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2022.2.devCPU Temperature Monitor20406080100

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.2.devModel: Age Gender Recognition Retail 0013 FP16 - Device: CPUWithout AVX-512Default, AVX-512 Enabled10K20K30K40K50KSE +/- 51.81, N = 3SE +/- 43.30, N = 322781.7045555.67-mno-avx512f-mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi1. (CXX) g++ options: -fPIC -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -flto -shared

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.2.devModel: Age Gender Recognition Retail 0013 FP16 - Device: CPUWithout AVX-512Default, AVX-512 Enabled0.15750.3150.47250.630.7875SE +/- 0.00, N = 3SE +/- 0.00, N = 30.700.35-mno-avx512f - MIN: 0.39 / MAX: 8.82-mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi - MIN: 0.21 / MAX: 7.781. (CXX) g++ options: -fPIC -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -flto -shared
MinAvgMaxWithout AVX-512494550535881Default, AVX-512 Enabled500651075881OpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2022.2.devCPU Peak Freq (Highest CPU Core Frequency) Monitor16003200480064008000
MinAvgMaxWithout AVX-51223.3209.3228.7Default, AVX-512 Enabled23.2214.9234.4OpenBenchmarking.orgWatts, Fewer Is BetterOpenVINO 2022.2.devCPU Power Consumption Monitor60120180240300
MinAvgMaxWithout AVX-51248.693.295.5Default, AVX-512 Enabled47.093.295.5OpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2022.2.devCPU Temperature Monitor20406080100

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.2.devModel: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPUWithout AVX-512Default, AVX-512 Enabled14K28K42K56K70KSE +/- 43.53, N = 3SE +/- 24.16, N = 338316.8764463.94-mno-avx512f-mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi1. (CXX) g++ options: -fPIC -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -flto -shared

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.2.devModel: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPUWithout AVX-512Default, AVX-512 Enabled0.09230.18460.27690.36920.4615SE +/- 0.00, N = 3SE +/- 0.00, N = 30.410.24-mno-avx512f - MIN: 0.22 / MAX: 7.87-mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi - MIN: 0.15 / MAX: 7.551. (CXX) g++ options: -fPIC -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -flto -shared
MinAvgMaxWithout AVX-512499951145881Default, AVX-512 Enabled506251425881OpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2022.2.devCPU Peak Freq (Highest CPU Core Frequency) Monitor16003200480064008000
MinAvgMaxWithout AVX-51223.1208.4234.1Default, AVX-512 Enabled20.0217.4237.8OpenBenchmarking.orgWatts, Fewer Is BetterOpenVINO 2022.2.devCPU Power Consumption Monitor60120180240300
MinAvgMaxWithout AVX-51248.593.795.6Default, AVX-512 Enabled48.093.295.5OpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2022.2.devCPU Temperature Monitor20406080100

CPU Peak Freq (Highest CPU Core Frequency) Monitor

OpenBenchmarking.orgMegahertzCPU Peak Freq (Highest CPU Core Frequency) MonitorPhoronix Test Suite System MonitoringWithout AVX-512Default, AVX-512 Enabled10002000300040005000Min: 4495 / Avg: 5334.93 / Max: 5881Min: 4421 / Avg: 5372.19 / Max: 5881

CPU Power Consumption Monitor

OpenBenchmarking.orgWattsCPU Power Consumption MonitorPhoronix Test Suite System MonitoringWithout AVX-512Default, AVX-512 Enabled4080120160200Min: 10.2 / Avg: 161.11 / Max: 235.88Min: 11.53 / Avg: 158.06 / Max: 237.76

CPU Temperature Monitor

OpenBenchmarking.orgCelsiusCPU Temperature MonitorPhoronix Test Suite System MonitoringWithout AVX-512Default, AVX-512 Enabled20406080100Min: 36.13 / Avg: 84.12 / Max: 96.75Min: 33.63 / Avg: 81.24 / Max: 96.25

64 Results Shown

LeelaChessZero
simdjson:
  Kostya
  TopTweet
  LargeRand
  PartialTweets
  DistinctUserID
dav1d:
  Summer Nature 4K
  Summer Nature 1080p
Embree:
  Pathtracer ISPC - Crown
  Pathtracer ISPC - Asian Dragon
OpenVKL
OSPRay:
  particle_volume/pathtracer/real_time
  gravity_spheres_volume/dim_512/ao/real_time
  gravity_spheres_volume/dim_512/scivis/real_time
  gravity_spheres_volume/dim_512/pathtracer/real_time
oneDNN:
  IP Shapes 1D - u8s8f32 - CPU
  Convolution Batch Shapes Auto - u8s8f32 - CPU
  Deconvolution Batch shapes_1d - u8s8f32 - CPU
  Deconvolution Batch shapes_3d - u8s8f32 - CPU
  Recurrent Neural Network Training - u8s8f32 - CPU
  Recurrent Neural Network Inference - u8s8f32 - CPU
  Recurrent Neural Network Training - bf16bf16bf16 - CPU
  Recurrent Neural Network Inference - bf16bf16bf16 - CPU
OSPRay Studio:
  1 - 4K - 1 - Path Tracer
  3 - 4K - 1 - Path Tracer
  1 - 4K - 16 - Path Tracer
  1 - 4K - 32 - Path Tracer
  3 - 4K - 16 - Path Tracer
  3 - 4K - 32 - Path Tracer
Cpuminer-Opt:
  Blake-2 S
  Garlicoin
  Skeincoin
  Myriad-Groestl
  LBC, LBRY Credits
  Quad SHA-256, Pyrite
Mobile Neural Network
NCNN
OpenVINO:
  Face Detection FP16 - CPU:
    FPS
    ms
  Person Detection FP16 - CPU:
    FPS
    ms
  Person Detection FP32 - CPU:
    FPS
    ms
  Vehicle Detection FP16 - CPU:
    FPS
    ms
  Face Detection FP16-INT8 - CPU:
    FPS
    ms
  Vehicle Detection FP16-INT8 - CPU:
    FPS
    ms
  Weld Porosity Detection FP16 - CPU:
    FPS
    ms
  Machine Translation EN To DE FP16 - CPU:
    FPS
    ms
  Weld Porosity Detection FP16-INT8 - CPU:
    FPS
    ms
  Person Vehicle Bike Detection FP16 - CPU:
    FPS
    ms
  Age Gender Recognition Retail 0013 FP16 - CPU:
    FPS
    ms
  Age Gender Recognition Retail 0013 FP16-INT8 - CPU:
    FPS
    ms
CPU Peak Freq (Highest CPU Core Frequency) Monitor:
  Phoronix Test Suite System Monitoring:
    Megahertz
    Watts
    Celsius

Without AVX-512

Kernel Notes: Transparent Huge Pages: madvise
Environment Notes: CXXFLAGS="-O3 -march=native -mno-avx512f" CFLAGS="-O3 -march=native -mno-avx512f"
Compiler Notes: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-defaulted --enable-offload-targets=nvptx-none=/build/gcc-12-OcsLtf/gcc-12-12-20220319/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-12-OcsLtf/gcc-12-12-20220319/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v
Processor Notes: Scaling Governor: amd-pstate performance (Boost: Enabled) - CPU Microcode: 0xa601203
Python Notes: Python 3.10.4
Security Notes: itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional IBRS_FW STIBP: always-on RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected

Testing initiated at 17 September 2022 15:47 by user phoronix.

Default, AVX-512 Enabled

Processor: AMD Ryzen 9 7950X 16-Core @ 5.88GHz (16 Cores / 32 Threads), Motherboard: ASUS ROG CROSSHAIR X670E HERO (0604 BIOS), Chipset: AMD Device 14d8, Memory: 32GB, Disk: 2000GB Samsung SSD 980 PRO 2TB + 2000GB, Graphics: AMD Radeon RX 6800 XT 16GB (2575/1000MHz), Audio: AMD Navi 21 HDMI Audio, Monitor: ASUS VP28U, Network: Intel I225-V + Intel Wi-Fi 6 AX210/AX211/AX411

OS: Ubuntu 22.04, Kernel: 6.0.0-060000rc1daily20220820-generic (x86_64), Desktop: GNOME Shell 42.2, Display Server: X Server + Wayland, OpenGL: 4.6 Mesa 22.3.0-devel (git-4685385 2022-08-23 jammy-oibaf-ppa) (LLVM 14.0.6 DRM 3.48), Vulkan: 1.3.224, Compiler: GCC 12.0.1 20220319, File-System: ext4, Screen Resolution: 3840x2160

Kernel Notes: Transparent Huge Pages: madvise
Environment Notes: CXXFLAGS="-O3 -march=native -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi -mprefer-vector-width=512" CFLAGS="-O3 -march=native -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi -mprefer-vector-width=512"
Compiler Notes: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-defaulted --enable-offload-targets=nvptx-none=/build/gcc-12-OcsLtf/gcc-12-12-20220319/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-12-OcsLtf/gcc-12-12-20220319/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v
Processor Notes: Scaling Governor: amd-pstate performance (Boost: Enabled) - CPU Microcode: 0xa601203
Python Notes: Python 3.10.4
Security Notes: itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional IBRS_FW STIBP: always-on RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected

Testing initiated at 17 September 2022 20:32 by user phoronix.