AVX-512 Analysis

bENCHMARKS for a future article. Intel Core i7-1165G7 testing with a Dell 0GG9PT (3.15.0 BIOS) and Intel Xe TGL GT2 15GB on Ubuntu 23.04 via the Phoronix Test Suite.

Compare your own system(s) to this result file with the Phoronix Test Suite by running the command: phoronix-test-suite benchmark 2307108-NE-2307083NE10
Jump To Table - Results

View

Do Not Show Noisy Results
Do Not Show Results With Incomplete Data
Do Not Show Results With Little Change/Spread
List Notable Results

Limit displaying results to tests within:

CPU Massive 4 Tests
Creator Workloads 6 Tests
Cryptography 2 Tests
HPC - High Performance Computing 5 Tests
Machine Learning 4 Tests
Multi-Core 7 Tests
Intel oneAPI 6 Tests
Python Tests 2 Tests
Raytracing 2 Tests
Renderers 2 Tests
Server CPU Tests 2 Tests

Statistics

Show Overall Harmonic Mean(s)
Show Overall Geometric Mean
Show Geometric Means Per-Suite/Category
Show Wins / Losses Counts (Pie Chart)
Normalize Results
Remove Outliers Before Calculating Averages

Graph Settings

Force Line Graphs Where Applicable
Convert To Scalar Where Applicable
Disable Color Branding
Prefer Vertical Bar Graphs
No Box Plots
On Line Graphs With Missing Data, Connect The Line Gaps

Multi-Way Comparison

Condense Comparison
Transpose Comparison

Table

Show Detailed System Result Table

Run Management

Highlight
Result
Hide
Result
Result
Identifier
Performance Per
Dollar
Date
Run
  Test
  Duration
Ryzen 7 7840U: AVX512 Off
July 08 2023
  9 Hours, 49 Minutes
Ryzen 7 7840U: AVX512 On
July 08 2023
  8 Hours, 19 Minutes
Core i7 1165G7: AVX512 On
July 08 2023
  13 Hours, 34 Minutes
Core i7 1165G7: AVX512 Off
July 09 2023
  14 Hours, 44 Minutes
Invert Hiding All Results Option
  11 Hours, 37 Minutes

Only show results where is faster than
Only show results matching title/arguments (delimit multiple options with a comma):
Do not show results matching title/arguments (delimit multiple options with a comma):


ProcessorMotherboardChipsetMemoryDiskGraphicsAudioNetworkOSKernelDesktopDisplay ServerOpenGLCompilerFile-SystemScreen ResolutionRyzen 7 7840UCore i7 1165G7 AVX512 Off AVX512 On AVX512 On AVX512 OffAMD Ryzen 7 7840U @ 3.30GHz (8 Cores / 16 Threads)PHX Ray_PEU (V1.04 BIOS)AMD Device 14e816GB1024GB Micron_3400_MTFDKBA1T0TFHAMD Phoenix1 512MB (2700/400MHz)AMD Rembrandt Radeon HD AudioMEDIATEK MT7922 802.11ax PCIUbuntu 23.046.2.0-24-generic (x86_64)KDE Plasma 5.27.4X Server 1.21.1.74.6 Mesa 23.0.2 (LLVM 15.0.7 DRM 3.49)GCC 12.2.0ext43200x2000Intel Core i7-1165G7 @ 4.70GHz (4 Cores / 8 Threads)Dell 0GG9PT (3.15.0 BIOS)Intel Tiger Lake-LPKioxia KBG40ZNS256G NVMe 256GBIntel Xe TGL GT2 15GB (1300MHz)Realtek ALC289Intel Wi-Fi 6 AX2016.2.0-20-generic (x86_64)GNOME Shell 44.0X Server + Wayland4.6 Mesa 23.0.21920x12006.2.0-24-generic (x86_64)OpenBenchmarking.orgKernel Details- Transparent Huge Pages: madviseCompiler Details- --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-defaulted --enable-offload-targets=nvptx-none=/build/gcc-12-Pa930Z/gcc-12-12.2.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-12-Pa930Z/gcc-12-12.2.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v Processor Details- Ryzen 7 7840U: AVX512 Off: Scaling Governor: acpi-cpufreq schedutil (Boost: Enabled) - CPU Microcode: 0xa704101- Ryzen 7 7840U: AVX512 On: Scaling Governor: acpi-cpufreq schedutil (Boost: Enabled) - CPU Microcode: 0xa704101- Core i7 1165G7: AVX512 On: Scaling Governor: intel_pstate powersave (EPP: balance_performance) - CPU Microcode: 0xa6 - Thermald 2.5.2 - Core i7 1165G7: AVX512 Off: Scaling Governor: intel_pstate powersave (EPP: balance_performance) - CPU Microcode: 0xa6 - Thermald 2.5.2 Python Details- Python 3.11.2Security Details- Ryzen 7 7840U: AVX512 Off: itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional IBRS_FW STIBP: always-on RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected - Ryzen 7 7840U: AVX512 On: itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional IBRS_FW STIBP: always-on RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected - Core i7 1165G7: AVX512 On: itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Not affected - Core i7 1165G7: AVX512 Off: itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Not affected

lczero: Eigenembree: Pathtracer ISPC - Asian Dragonembree: Pathtracer ISPC - Asian Dragon Objembree: Pathtracer ISPC - Crownopenvkl: vklBenchmark ISPCospray: gravity_spheres_volume/dim_512/ao/real_timeospray: gravity_spheres_volume/dim_512/scivis/real_timeospray: gravity_spheres_volume/dim_512/pathtracer/real_timeospray: particle_volume/pathtracer/real_timeospray-studio: 1 - 1080p - 1 - Path Tracerospray-studio: 1 - 1080p - 32 - Path Tracerospray-studio: 1 - 4K - 1 - Path Tracerospray-studio: 1 - 4K - 32 - Path Tracerospray-studio: 3 - 1080p - 1 - Path Tracerospray-studio: 3 - 1080p - 32 - Path Tracerospray-studio: 3 - 4K - 1 - Path Tracerospray-studio: 3 - 4K - 32 - Path Traceronednn: Deconvolution Batch shapes_1d - u8s8f32 - CPUonednn: Deconvolution Batch shapes_3d - u8s8f32 - CPUonednn: IP Shapes 1D - u8s8f32 - CPUonednn: Recurrent Neural Network Training - u8s8f32 - CPUonednn: Recurrent Neural Network Inference - u8s8f32 - CPUcpuminer-opt: scryptcpuminer-opt: Quad SHA-256, Pyritecpuminer-opt: Myriad-Groestlcpuminer-opt: Magicpuminer-opt: Blake-2 Scpuminer-opt: x25xcpuminer-opt: Garlicoincpuminer-opt: Skeincoincpuminer-opt: LBC, LBRY Creditsopenvino: Face Detection FP16 - CPUopenvino: Face Detection FP16 - CPUopenvino: Face Detection FP16-INT8 - CPUopenvino: Face Detection FP16-INT8 - CPUopenvino: Age Gender Recognition Retail 0013 FP16 - CPUopenvino: Age Gender Recognition Retail 0013 FP16 - CPUopenvino: Age Gender Recognition Retail 0013 FP16-INT8 - CPUopenvino: Age Gender Recognition Retail 0013 FP16-INT8 - CPUopenvino: Person Detection FP16 - CPUopenvino: Person Detection FP16 - CPUopenvino: Person Detection FP32 - CPUopenvino: Person Detection FP32 - CPUopenvino: Weld Porosity Detection FP16-INT8 - CPUopenvino: Weld Porosity Detection FP16-INT8 - CPUopenvino: Weld Porosity Detection FP16 - CPUopenvino: Weld Porosity Detection FP16 - CPUopenvino: Vehicle Detection FP16-INT8 - CPUopenvino: Vehicle Detection FP16-INT8 - CPUopenvino: Vehicle Detection FP16 - CPUopenvino: Vehicle Detection FP16 - CPUopenvino: Person Vehicle Bike Detection FP16 - CPUopenvino: Person Vehicle Bike Detection FP16 - CPUopenvino: Machine Translation EN To DE FP16 - CPUopenvino: Machine Translation EN To DE FP16 - CPUminibude: OpenMP - BM1minibude: OpenMP - BM1smhasher: FarmHash32 x86_64 AVXsmhasher: FarmHash32 x86_64 AVXlibxsmm: 64tensorflow: CPU - 16 - ResNet-50tensorflow: CPU - 16 - AlexNettensorflow: CPU - 16 - GoogLeNettensorflow: CPU - 64 - ResNet-50tensorflow: CPU - 64 - AlexNettensorflow: CPU - 64 - GoogLeNetRyzen 7 7840UCore i7 1165G7 AVX512 Off AVX512 On AVX512 On AVX512 Off4638.09177.23296.8556921.194871.137241.9576493.51824456147764180885979235707187853224797395752.869453.369981.680585003.232748.20128.055853313910365.61315925348.692009.3863907220301.562570.313.181252.114781.191.655336.561.490.914390.070.914387.55344.8223.20170.2023.48237.4516.84131.1330.53212.1518.8317.13233.17290.69711.62836442.7626.438155.38.8446.2125.788.5464.7924.876559.95848.55957.91861141.988701.978142.46956101.8084192138553165675489035060161258190646287671.527071.616330.9444324354.172371.62166.578762726160351.21531477374.952752.2778300439033.501143.206.91578.3510275.450.776240.041.271.782242.451.772252.82639.0512.49331.3112.05359.9711.10185.7221.53336.1311.8836.46109.68372.10014.88440077.5926.390168.016.4477.6551.1916.74113.5848.058716.29755.51624.9448821.426821.397241.6762188.340469062195872668087044785072689823218910762022.481262.523681.895787357.333754.66132.795260312609143.68282211175.051822.7734161245021.013968.313.911021.782780.431.423141.621.260.636290.160.636318.67375.4610.65100.6039.77224.2917.8281.4349.10149.6726.7013.22302.21161.7056.46839090.0927.028137.19.7452.9728.6210.5164.5629.968045.63035.01784.3653630.8780800.8333341.2579676.036277002436822947096785491012966753574511666124.879155.740303.593429315.504765.1062.57215655364.37145.65150523156.601057.36229718840.501.013943.841.812198.132495.371.592804.431.410.656142.870.646247.58179.8122.2694.3642.40119.1633.5793.8142.63148.1326.9912.05331.58131.1875.24734821.2027.261139.06.8736.8718.386.7744.9117.97OpenBenchmarking.org

LeelaChessZero

LeelaChessZero (lc0 / lczero) is a chess engine automated vian neural networks. This test profile can be used for OpenCL, CUDA + cuDNN, and BLAS (CPU-based) benchmarking. Learn more via the OpenBenchmarking.org test page.

Ryzen 7 7840UCore i7 1165G7OpenBenchmarking.orgNodes Per Second, More Is BetterLeelaChessZero 0.28Backend: EigenAVX512 OffAVX512 On2004006008001000SE +/- 11.93, N = 9SE +/- 12.23, N = 9SE +/- 9.33, N = 3SE +/- 11.55, N = 94636558718041. (CXX) g++ options: -flto -pthread
Ryzen 7 7840UCore i7 1165G7OpenBenchmarking.orgNodes Per Second, More Is BetterLeelaChessZero 0.28Backend: EigenAVX512 OffAVX512 On150300450600750Min: 436 / Avg: 463.44 / Max: 549Min: 611 / Avg: 654.67 / Max: 710Min: 856 / Avg: 870.67 / Max: 888Min: 758 / Avg: 803.67 / Max: 8811. (CXX) g++ options: -flto -pthread

Embree

Intel Embree is a collection of high-performance ray-tracing kernels for execution on CPUs (and GPUs via SYCL) and supporting instruction sets such as SSE, AVX, AVX2, and AVX-512. Embree also supports making use of the Intel SPMD Program Compiler (ISPC). Learn more via the OpenBenchmarking.org test page.

Ryzen 7 7840UCore i7 1165G7OpenBenchmarking.orgFrames Per Second, More Is BetterEmbree 4.1Binary: Pathtracer ISPC - Model: Asian DragonAVX512 OffAVX512 On3691215SE +/- 0.0474, N = 3SE +/- 0.0930, N = 3SE +/- 0.0513, N = 15SE +/- 0.0607, N = 38.09179.95846.29755.6303
Ryzen 7 7840UCore i7 1165G7OpenBenchmarking.orgFrames Per Second, More Is BetterEmbree 4.1Binary: Pathtracer ISPC - Model: Asian DragonAVX512 OffAVX512 On3691215Min: 8.02 / Avg: 8.09 / Max: 8.18Min: 9.81 / Avg: 9.96 / Max: 10.13Min: 6.08 / Avg: 6.3 / Max: 6.6Min: 5.56 / Avg: 5.63 / Max: 5.75

Ryzen 7 7840UCore i7 1165G7OpenBenchmarking.orgFrames Per Second, More Is BetterEmbree 4.1Binary: Pathtracer ISPC - Model: Asian Dragon ObjAVX512 OffAVX512 On246810SE +/- 0.0412, N = 3SE +/- 0.1142, N = 3SE +/- 0.0350, N = 3SE +/- 0.0334, N = 37.23298.55955.51625.0178
Ryzen 7 7840UCore i7 1165G7OpenBenchmarking.orgFrames Per Second, More Is BetterEmbree 4.1Binary: Pathtracer ISPC - Model: Asian Dragon ObjAVX512 OffAVX512 On3691215Min: 7.15 / Avg: 7.23 / Max: 7.28Min: 8.4 / Avg: 8.56 / Max: 8.78Min: 5.46 / Avg: 5.52 / Max: 5.58Min: 4.96 / Avg: 5.02 / Max: 5.08

Ryzen 7 7840UCore i7 1165G7OpenBenchmarking.orgFrames Per Second, More Is BetterEmbree 4.1Binary: Pathtracer ISPC - Model: CrownAVX512 OffAVX512 On246810SE +/- 0.0389, N = 3SE +/- 0.0891, N = 3SE +/- 0.0702, N = 3SE +/- 0.0485, N = 56.85567.91864.94484.3653
Ryzen 7 7840UCore i7 1165G7OpenBenchmarking.orgFrames Per Second, More Is BetterEmbree 4.1Binary: Pathtracer ISPC - Model: CrownAVX512 OffAVX512 On3691215Min: 6.78 / Avg: 6.86 / Max: 6.91Min: 7.75 / Avg: 7.92 / Max: 8.05Min: 4.81 / Avg: 4.94 / Max: 5.05Min: 4.28 / Avg: 4.37 / Max: 4.55

OpenVKL

OpenVKL is the Intel Open Volume Kernel Library that offers high-performance volume computation kernels and part of the Intel oneAPI rendering toolkit. Learn more via the OpenBenchmarking.org test page.

Ryzen 7 7840UCore i7 1165G7OpenBenchmarking.orgItems / Sec, More Is BetterOpenVKL 1.3.1Benchmark: vklBenchmark ISPCAVX512 OffAVX512 On306090120150SE +/- 1.30, N = 9SE +/- 1.61, N = 9SE +/- 0.33, N = 3SE +/- 0.00, N = 3921148263
Ryzen 7 7840UCore i7 1165G7OpenBenchmarking.orgItems / Sec, More Is BetterOpenVKL 1.3.1Benchmark: vklBenchmark ISPCAVX512 OffAVX512 On20406080100Min: 89 / Avg: 92.11 / Max: 102Min: 110 / Avg: 113.78 / Max: 124Min: 82 / Avg: 82.33 / Max: 83Min: 63 / Avg: 63 / Max: 63

OSPRay

Intel OSPRay is a portable ray-tracing engine for high-performance, high-fidelity scientific visualizations. OSPRay builds off Intel's Embree and Intel SPMD Program Compiler (ISPC) components as part of the oneAPI rendering toolkit. Learn more via the OpenBenchmarking.org test page.

Ryzen 7 7840UCore i7 1165G7OpenBenchmarking.orgItems Per Second, More Is BetterOSPRay 2.12Benchmark: gravity_spheres_volume/dim_512/ao/real_timeAVX512 OffAVX512 On0.44750.8951.34251.792.2375SE +/- 0.001291, N = 3SE +/- 0.013221, N = 3SE +/- 0.021513, N = 15SE +/- 0.012598, N = 151.1948701.9887001.4268200.878080
Ryzen 7 7840UCore i7 1165G7OpenBenchmarking.orgItems Per Second, More Is BetterOSPRay 2.12Benchmark: gravity_spheres_volume/dim_512/ao/real_timeAVX512 OffAVX512 On246810Min: 1.19 / Avg: 1.19 / Max: 1.2Min: 1.97 / Avg: 1.99 / Max: 2.01Min: 1.36 / Avg: 1.43 / Max: 1.57Min: 0.84 / Avg: 0.88 / Max: 0.97

Ryzen 7 7840UCore i7 1165G7OpenBenchmarking.orgItems Per Second, More Is BetterOSPRay 2.12Benchmark: gravity_spheres_volume/dim_512/scivis/real_timeAVX512 OffAVX512 On0.44510.89021.33531.78042.2255SE +/- 0.003982, N = 3SE +/- 0.013755, N = 3SE +/- 0.020565, N = 15SE +/- 0.012585, N = 151.1372401.9781401.3972400.833334
Ryzen 7 7840UCore i7 1165G7OpenBenchmarking.orgItems Per Second, More Is BetterOSPRay 2.12Benchmark: gravity_spheres_volume/dim_512/scivis/real_timeAVX512 OffAVX512 On246810Min: 1.13 / Avg: 1.14 / Max: 1.14Min: 1.95 / Avg: 1.98 / Max: 2Min: 1.33 / Avg: 1.4 / Max: 1.52Min: 0.78 / Avg: 0.83 / Max: 0.93

Ryzen 7 7840UCore i7 1165G7OpenBenchmarking.orgItems Per Second, More Is BetterOSPRay 2.12Benchmark: gravity_spheres_volume/dim_512/pathtracer/real_timeAVX512 OffAVX512 On0.55571.11141.66712.22282.7785SE +/- 0.00675, N = 3SE +/- 0.01551, N = 3SE +/- 0.02317, N = 15SE +/- 0.01820, N = 151.957642.469561.676211.25796
Ryzen 7 7840UCore i7 1165G7OpenBenchmarking.orgItems Per Second, More Is BetterOSPRay 2.12Benchmark: gravity_spheres_volume/dim_512/pathtracer/real_timeAVX512 OffAVX512 On246810Min: 1.94 / Avg: 1.96 / Max: 1.97Min: 2.45 / Avg: 2.47 / Max: 2.5Min: 1.59 / Avg: 1.68 / Max: 1.85Min: 1.17 / Avg: 1.26 / Max: 1.38

Ryzen 7 7840UCore i7 1165G7OpenBenchmarking.orgItems Per Second, More Is BetterOSPRay 2.12Benchmark: particle_volume/pathtracer/real_timeAVX512 OffAVX512 On20406080100SE +/- 0.14, N = 3SE +/- 0.25, N = 3SE +/- 0.88, N = 3SE +/- 1.06, N = 1293.52101.8188.3476.04
Ryzen 7 7840UCore i7 1165G7OpenBenchmarking.orgItems Per Second, More Is BetterOSPRay 2.12Benchmark: particle_volume/pathtracer/real_timeAVX512 OffAVX512 On20406080100Min: 93.34 / Avg: 93.52 / Max: 93.79Min: 101.36 / Avg: 101.81 / Max: 102.21Min: 87.06 / Avg: 88.34 / Max: 90.01Min: 70.11 / Avg: 76.04 / Max: 82.38

OSPRay Studio

Intel OSPRay Studio is an open-source, interactive visualization and ray-tracing software package. OSPRay Studio makes use of Intel OSPRay, a portable ray-tracing engine for high-performance, high-fidelity visualizations. OSPRay builds off Intel's Embree and Intel SPMD Program Compiler (ISPC) components as part of the oneAPI rendering toolkit. Learn more via the OpenBenchmarking.org test page.

Ryzen 7 7840UCore i7 1165G7OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.11Camera: 1 - Resolution: 1080p - Samples Per Pixel: 1 - Renderer: Path TracerAVX512 OffAVX512 On17003400510068008500SE +/- 46.49, N = 3SE +/- 36.74, N = 12SE +/- 4.48, N = 3SE +/- 2.73, N = 344564192690677001. (CXX) g++ options: -O3 -lm -ldl
Ryzen 7 7840UCore i7 1165G7OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.11Camera: 1 - Resolution: 1080p - Samples Per Pixel: 1 - Renderer: Path TracerAVX512 OffAVX512 On13002600390052006500Min: 4394 / Avg: 4456 / Max: 4547Min: 3849 / Avg: 4192.17 / Max: 4288Min: 6900 / Avg: 6906.33 / Max: 6915Min: 7695 / Avg: 7700.33 / Max: 77041. (CXX) g++ options: -O3 -lm -ldl

Ryzen 7 7840UCore i7 1165G7OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.11Camera: 1 - Resolution: 1080p - Samples Per Pixel: 32 - Renderer: Path TracerAVX512 OffAVX512 On50K100K150K200K250KSE +/- 922.16, N = 3SE +/- 1719.79, N = 4SE +/- 815.80, N = 3SE +/- 192.36, N = 31477641385532195872436821. (CXX) g++ options: -O3 -lm -ldl
Ryzen 7 7840UCore i7 1165G7OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.11Camera: 1 - Resolution: 1080p - Samples Per Pixel: 32 - Renderer: Path TracerAVX512 OffAVX512 On40K80K120K160K200KMin: 146036 / Avg: 147764.33 / Max: 149186Min: 133843 / Avg: 138553 / Max: 141452Min: 217956 / Avg: 219587 / Max: 220441Min: 243431 / Avg: 243682 / Max: 2440601. (CXX) g++ options: -O3 -lm -ldl

Ryzen 7 7840UCore i7 1165G7OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.11Camera: 1 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path TracerAVX512 OffAVX512 On6K12K18K24K30KSE +/- 66.23, N = 3SE +/- 185.50, N = 4SE +/- 354.53, N = 3SE +/- 75.26, N = 3180881656726680294701. (CXX) g++ options: -O3 -lm -ldl
Ryzen 7 7840UCore i7 1165G7OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.11Camera: 1 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path TracerAVX512 OffAVX512 On5K10K15K20K25KMin: 17981 / Avg: 18087.67 / Max: 18209Min: 16013 / Avg: 16566.5 / Max: 16800Min: 26208 / Avg: 26679.67 / Max: 27374Min: 29325 / Avg: 29469.67 / Max: 295781. (CXX) g++ options: -O3 -lm -ldl

Ryzen 7 7840UCore i7 1165G7OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.11Camera: 1 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path TracerAVX512 OffAVX512 On200K400K600K800K1000KSE +/- 5872.37, N = 3SE +/- 3927.76, N = 3SE +/- 954.05, N = 3SE +/- 1928.99, N = 35979235489038704479678541. (CXX) g++ options: -O3 -lm -ldl
Ryzen 7 7840UCore i7 1165G7OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.11Camera: 1 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path TracerAVX512 OffAVX512 On200K400K600K800K1000KMin: 591078 / Avg: 597923.33 / Max: 609611Min: 541062 / Avg: 548903 / Max: 553237Min: 868616 / Avg: 870446.67 / Max: 871828Min: 964252 / Avg: 967853.67 / Max: 9708521. (CXX) g++ options: -O3 -lm -ldl

Ryzen 7 7840UCore i7 1165G7OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.11Camera: 3 - Resolution: 1080p - Samples Per Pixel: 1 - Renderer: Path TracerAVX512 OffAVX512 On2K4K6K8K10KSE +/- 29.78, N = 3SE +/- 57.01, N = 3SE +/- 20.19, N = 3SE +/- 110.89, N = 1257075060850791011. (CXX) g++ options: -O3 -lm -ldl
Ryzen 7 7840UCore i7 1165G7OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.11Camera: 3 - Resolution: 1080p - Samples Per Pixel: 1 - Renderer: Path TracerAVX512 OffAVX512 On16003200480064008000Min: 5664 / Avg: 5706.67 / Max: 5764Min: 4955 / Avg: 5060 / Max: 5151Min: 8485 / Avg: 8506.67 / Max: 8547Min: 8433 / Avg: 9100.5 / Max: 93781. (CXX) g++ options: -O3 -lm -ldl

Ryzen 7 7840UCore i7 1165G7OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.11Camera: 3 - Resolution: 1080p - Samples Per Pixel: 32 - Renderer: Path TracerAVX512 OffAVX512 On60K120K180K240K300KSE +/- 2250.38, N = 3SE +/- 466.38, N = 3SE +/- 322.06, N = 3SE +/- 2472.90, N = 31878531612582689822966751. (CXX) g++ options: -O3 -lm -ldl
Ryzen 7 7840UCore i7 1165G7OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.11Camera: 3 - Resolution: 1080p - Samples Per Pixel: 32 - Renderer: Path TracerAVX512 OffAVX512 On50K100K150K200K250KMin: 183725 / Avg: 187853.33 / Max: 191470Min: 160336 / Avg: 161258.33 / Max: 161840Min: 268368 / Avg: 268981.67 / Max: 269458Min: 292812 / Avg: 296674.67 / Max: 3012811. (CXX) g++ options: -O3 -lm -ldl

Ryzen 7 7840UCore i7 1165G7OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.11Camera: 3 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path TracerAVX512 OffAVX512 On8K16K24K32K40KSE +/- 44.38, N = 3SE +/- 180.02, N = 3SE +/- 288.86, N = 3SE +/- 25.42, N = 3224791906432189357451. (CXX) g++ options: -O3 -lm -ldl
Ryzen 7 7840UCore i7 1165G7OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.11Camera: 3 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path TracerAVX512 OffAVX512 On6K12K18K24K30KMin: 22391 / Avg: 22479 / Max: 22533Min: 18776 / Avg: 19063.67 / Max: 19395Min: 31611 / Avg: 32188.67 / Max: 32484Min: 35702 / Avg: 35745 / Max: 357901. (CXX) g++ options: -O3 -lm -ldl

Ryzen 7 7840UCore i7 1165G7OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.11Camera: 3 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path TracerAVX512 OffAVX512 On200K400K600K800K1000KSE +/- 6114.98, N = 3SE +/- 4373.49, N = 3SE +/- 1190.01, N = 3SE +/- 1916.25, N = 3739575628767107620211666121. (CXX) g++ options: -O3 -lm -ldl
Ryzen 7 7840UCore i7 1165G7OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.11Camera: 3 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path TracerAVX512 OffAVX512 On200K400K600K800K1000KMin: 727821 / Avg: 739575 / Max: 748378Min: 622415 / Avg: 628767.33 / Max: 637151Min: 1073900 / Avg: 1076201.67 / Max: 1077877Min: 1162782 / Avg: 1166611.67 / Max: 11686541. (CXX) g++ options: -O3 -lm -ldl

oneDNN

This is a test of the Intel oneDNN as an Intel-optimized library for Deep Neural Networks and making use of its built-in benchdnn functionality. The result is the total perf time reported. Intel oneDNN was formerly known as DNNL (Deep Neural Network Library) and MKL-DNN before being rebranded as part of the Intel oneAPI toolkit. Learn more via the OpenBenchmarking.org test page.

Ryzen 7 7840UCore i7 1165G7OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.1Harness: Deconvolution Batch shapes_1d - Data Type: u8s8f32 - Engine: CPUAVX512 OffAVX512 On1.09782.19563.29344.39125.489SE +/- 0.03232, N = 3SE +/- 0.01623, N = 3SE +/- 0.06304, N = 12SE +/- 0.06289, N = 32.869451.527072.481264.879151. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl
Ryzen 7 7840UCore i7 1165G7OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.1Harness: Deconvolution Batch shapes_1d - Data Type: u8s8f32 - Engine: CPUAVX512 OffAVX512 On246810Min: 2.83 / Avg: 2.87 / Max: 2.93Min: 1.51 / Avg: 1.53 / Max: 1.56Min: 2.22 / Avg: 2.48 / Max: 2.76Min: 4.77 / Avg: 4.88 / Max: 4.991. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl

Ryzen 7 7840UCore i7 1165G7OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.1Harness: Deconvolution Batch shapes_3d - Data Type: u8s8f32 - Engine: CPUAVX512 OffAVX512 On1.29162.58323.87485.16646.458SE +/- 0.03292, N = 15SE +/- 0.01465, N = 15SE +/- 0.00396, N = 9SE +/- 0.01583, N = 93.369981.616332.523685.740301. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl
Ryzen 7 7840UCore i7 1165G7OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.1Harness: Deconvolution Batch shapes_3d - Data Type: u8s8f32 - Engine: CPUAVX512 OffAVX512 On246810Min: 3.23 / Avg: 3.37 / Max: 3.67Min: 1.54 / Avg: 1.62 / Max: 1.74Min: 2.5 / Avg: 2.52 / Max: 2.54Min: 5.63 / Avg: 5.74 / Max: 5.781. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl

Ryzen 7 7840UCore i7 1165G7OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.1Harness: IP Shapes 1D - Data Type: u8s8f32 - Engine: CPUAVX512 OffAVX512 On0.80851.6172.42553.2344.0425SE +/- 0.015865, N = 4SE +/- 0.005008, N = 4SE +/- 0.060765, N = 12SE +/- 0.129867, N = 121.6805800.9444321.8957803.5934201. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl
Ryzen 7 7840UCore i7 1165G7OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.1Harness: IP Shapes 1D - Data Type: u8s8f32 - Engine: CPUAVX512 OffAVX512 On246810Min: 1.64 / Avg: 1.68 / Max: 1.71Min: 0.93 / Avg: 0.94 / Max: 0.96Min: 1.58 / Avg: 1.9 / Max: 2.09Min: 2.96 / Avg: 3.59 / Max: 4.051. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl

Ryzen 7 7840UCore i7 1165G7OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.1Harness: Recurrent Neural Network Training - Data Type: u8s8f32 - Engine: CPUAVX512 OffAVX512 On2K4K6K8K10KSE +/- 91.64, N = 15SE +/- 84.98, N = 12SE +/- 64.19, N = 15SE +/- 71.00, N = 35003.234354.177357.339315.501. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl
Ryzen 7 7840UCore i7 1165G7OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.1Harness: Recurrent Neural Network Training - Data Type: u8s8f32 - Engine: CPUAVX512 OffAVX512 On16003200480064008000Min: 4134.6 / Avg: 5003.23 / Max: 5296.23Min: 3765.03 / Avg: 4354.17 / Max: 4756.16Min: 6933.25 / Avg: 7357.33 / Max: 7635.91Min: 9179.62 / Avg: 9315.5 / Max: 9419.121. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl

Ryzen 7 7840UCore i7 1165G7OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.1Harness: Recurrent Neural Network Inference - Data Type: u8s8f32 - Engine: CPUAVX512 OffAVX512 On10002000300040005000SE +/- 10.85, N = 3SE +/- 20.46, N = 3SE +/- 45.38, N = 15SE +/- 39.98, N = 82748.202371.623754.664765.101. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl
Ryzen 7 7840UCore i7 1165G7OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.1Harness: Recurrent Neural Network Inference - Data Type: u8s8f32 - Engine: CPUAVX512 OffAVX512 On8001600240032004000Min: 2731.97 / Avg: 2748.2 / Max: 2768.79Min: 2334.89 / Avg: 2371.62 / Max: 2405.62Min: 3420.06 / Avg: 3754.66 / Max: 3911.36Min: 4501.38 / Avg: 4765.1 / Max: 4845.161. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl

Cpuminer-Opt

Cpuminer-Opt is a fork of cpuminer-multi that carries a wide range of CPU performance optimizations for measuring the potential cryptocurrency mining performance of the CPU/processor with a wide variety of cryptocurrencies. The benchmark reports the hash speed for the CPU mining performance for the selected cryptocurrency. Learn more via the OpenBenchmarking.org test page.

Ryzen 7 7840UCore i7 1165G7OpenBenchmarking.orgkH/s, More Is BetterCpuminer-Opt 3.20.3Algorithm: scryptAVX512 OffAVX512 On4080120160200SE +/- 0.43, N = 3SE +/- 0.83, N = 3SE +/- 2.62, N = 15SE +/- 1.99, N = 15128.05166.57132.7962.571. (CXX) g++ options: -O2 -lcurl -lz -lpthread -lssl -lcrypto -lgmp
Ryzen 7 7840UCore i7 1165G7OpenBenchmarking.orgkH/s, More Is BetterCpuminer-Opt 3.20.3Algorithm: scryptAVX512 OffAVX512 On306090120150Min: 127.36 / Avg: 128.05 / Max: 128.83Min: 165.23 / Avg: 166.57 / Max: 168.1Min: 123.13 / Avg: 132.79 / Max: 148.92Min: 52.35 / Avg: 62.57 / Max: 70.231. (CXX) g++ options: -O2 -lcurl -lz -lpthread -lssl -lcrypto -lgmp

Ryzen 7 7840UCore i7 1165G7OpenBenchmarking.orgkH/s, More Is BetterCpuminer-Opt 3.20.3Algorithm: Quad SHA-256, PyriteAVX512 OffAVX512 On20K40K60K80K100KSE +/- 69.60, N = 3SE +/- 217.36, N = 3SE +/- 1028.89, N = 15SE +/- 620.71, N = 15585338762752603215651. (CXX) g++ options: -O2 -lcurl -lz -lpthread -lssl -lcrypto -lgmp
Ryzen 7 7840UCore i7 1165G7OpenBenchmarking.orgkH/s, More Is BetterCpuminer-Opt 3.20.3Algorithm: Quad SHA-256, PyriteAVX512 OffAVX512 On15K30K45K60K75KMin: 58420 / Avg: 58533.33 / Max: 58660Min: 87380 / Avg: 87626.67 / Max: 88060Min: 49720 / Avg: 52603.33 / Max: 59660Min: 19080 / Avg: 21565.33 / Max: 243601. (CXX) g++ options: -O2 -lcurl -lz -lpthread -lssl -lcrypto -lgmp

Ryzen 7 7840UCore i7 1165G7OpenBenchmarking.orgkH/s, More Is BetterCpuminer-Opt 3.20.3Algorithm: Myriad-GroestlAVX512 OffAVX512 On6K12K18K24K30KSE +/- 62.45, N = 3SE +/- 73.71, N = 3SE +/- 290.93, N = 15SE +/- 152.81, N = 1513910.0026160.0012609.005364.371. (CXX) g++ options: -O2 -lcurl -lz -lpthread -lssl -lcrypto -lgmp
Ryzen 7 7840UCore i7 1165G7OpenBenchmarking.orgkH/s, More Is BetterCpuminer-Opt 3.20.3Algorithm: Myriad-GroestlAVX512 OffAVX512 On5K10K15K20K25KMin: 13820 / Avg: 13910 / Max: 14030Min: 26050 / Avg: 26160 / Max: 26300Min: 11810 / Avg: 12609.33 / Max: 14580Min: 4661.72 / Avg: 5364.37 / Max: 5985.471. (CXX) g++ options: -O2 -lcurl -lz -lpthread -lssl -lcrypto -lgmp

Ryzen 7 7840UCore i7 1165G7OpenBenchmarking.orgkH/s, More Is BetterCpuminer-Opt 3.20.3Algorithm: MagiAVX512 OffAVX512 On80160240320400SE +/- 1.15, N = 3SE +/- 1.18, N = 3SE +/- 4.24, N = 15SE +/- 4.18, N = 15365.61351.21143.68145.651. (CXX) g++ options: -O2 -lcurl -lz -lpthread -lssl -lcrypto -lgmp
Ryzen 7 7840UCore i7 1165G7OpenBenchmarking.orgkH/s, More Is BetterCpuminer-Opt 3.20.3Algorithm: MagiAVX512 OffAVX512 On70140210280350Min: 363.48 / Avg: 365.61 / Max: 367.43Min: 349.05 / Avg: 351.21 / Max: 353.1Min: 129.38 / Avg: 143.68 / Max: 165.5Min: 129.35 / Avg: 145.65 / Max: 165.341. (CXX) g++ options: -O2 -lcurl -lz -lpthread -lssl -lcrypto -lgmp

Ryzen 7 7840UCore i7 1165G7OpenBenchmarking.orgkH/s, More Is BetterCpuminer-Opt 3.20.3Algorithm: Blake-2 SAVX512 OffAVX512 On110K220K330K440K550KSE +/- 2454.54, N = 15SE +/- 4566.14, N = 3SE +/- 7085.48, N = 15SE +/- 3240.30, N = 153159255314772822111505231. (CXX) g++ options: -O2 -lcurl -lz -lpthread -lssl -lcrypto -lgmp
Ryzen 7 7840UCore i7 1165G7OpenBenchmarking.orgkH/s, More Is BetterCpuminer-Opt 3.20.3Algorithm: Blake-2 SAVX512 OffAVX512 On90K180K270K360K450KMin: 299430 / Avg: 315924.67 / Max: 331560Min: 523180 / Avg: 531476.67 / Max: 538930Min: 245900 / Avg: 282211.33 / Max: 330720Min: 138010 / Avg: 150522.67 / Max: 1671901. (CXX) g++ options: -O2 -lcurl -lz -lpthread -lssl -lcrypto -lgmp

Ryzen 7 7840UCore i7 1165G7OpenBenchmarking.orgkH/s, More Is BetterCpuminer-Opt 3.20.3Algorithm: x25xAVX512 OffAVX512 On80160240320400SE +/- 0.87, N = 3SE +/- 2.44, N = 3SE +/- 4.73, N = 15SE +/- 4.42, N = 15348.69374.95175.05156.601. (CXX) g++ options: -O2 -lcurl -lz -lpthread -lssl -lcrypto -lgmp
Ryzen 7 7840UCore i7 1165G7OpenBenchmarking.orgkH/s, More Is BetterCpuminer-Opt 3.20.3Algorithm: x25xAVX512 OffAVX512 On70140210280350Min: 347.64 / Avg: 348.69 / Max: 350.41Min: 371.85 / Avg: 374.95 / Max: 379.76Min: 156.38 / Avg: 175.05 / Max: 195.85Min: 138.37 / Avg: 156.6 / Max: 174.241. (CXX) g++ options: -O2 -lcurl -lz -lpthread -lssl -lcrypto -lgmp

Ryzen 7 7840UCore i7 1165G7OpenBenchmarking.orgkH/s, More Is BetterCpuminer-Opt 3.20.3Algorithm: GarlicoinAVX512 OffAVX512 On6001200180024003000SE +/- 17.03, N = 3SE +/- 15.25, N = 3SE +/- 36.88, N = 15SE +/- 29.55, N = 152009.382752.271822.771057.361. (CXX) g++ options: -O2 -lcurl -lz -lpthread -lssl -lcrypto -lgmp
Ryzen 7 7840UCore i7 1165G7OpenBenchmarking.orgkH/s, More Is BetterCpuminer-Opt 3.20.3Algorithm: GarlicoinAVX512 OffAVX512 On5001000150020002500Min: 1982.19 / Avg: 2009.38 / Max: 2040.75Min: 2724.09 / Avg: 2752.27 / Max: 2776.47Min: 1718.29 / Avg: 1822.77 / Max: 2068.37Min: 940.92 / Avg: 1057.36 / Max: 1227.941. (CXX) g++ options: -O2 -lcurl -lz -lpthread -lssl -lcrypto -lgmp

Ryzen 7 7840UCore i7 1165G7OpenBenchmarking.orgkH/s, More Is BetterCpuminer-Opt 3.20.3Algorithm: SkeincoinAVX512 OffAVX512 On20K40K60K80K100KSE +/- 336.52, N = 3SE +/- 587.57, N = 3SE +/- 719.45, N = 15SE +/- 658.33, N = 15639077830034161229711. (CXX) g++ options: -O2 -lcurl -lz -lpthread -lssl -lcrypto -lgmp
Ryzen 7 7840UCore i7 1165G7OpenBenchmarking.orgkH/s, More Is BetterCpuminer-Opt 3.20.3Algorithm: SkeincoinAVX512 OffAVX512 On14K28K42K56K70KMin: 63240 / Avg: 63906.67 / Max: 64320Min: 77130 / Avg: 78300 / Max: 78980Min: 31890 / Avg: 34160.67 / Max: 38850Min: 20660 / Avg: 22970.67 / Max: 265801. (CXX) g++ options: -O2 -lcurl -lz -lpthread -lssl -lcrypto -lgmp

Ryzen 7 7840UCore i7 1165G7OpenBenchmarking.orgkH/s, More Is BetterCpuminer-Opt 3.20.3Algorithm: LBC, LBRY CreditsAVX512 OffAVX512 On9K18K27K36K45KSE +/- 83.27, N = 3SE +/- 327.43, N = 3SE +/- 524.03, N = 15SE +/- 230.96, N = 1522030.0043903.0024502.008840.501. (CXX) g++ options: -O2 -lcurl -lz -lpthread -lssl -lcrypto -lgmp
Ryzen 7 7840UCore i7 1165G7OpenBenchmarking.orgkH/s, More Is BetterCpuminer-Opt 3.20.3Algorithm: LBC, LBRY CreditsAVX512 OffAVX512 On8K16K24K32K40KMin: 21910 / Avg: 22030 / Max: 22190Min: 43310 / Avg: 43903.33 / Max: 44440Min: 22890 / Avg: 24502 / Max: 27330Min: 8039.34 / Avg: 8840.5 / Max: 100101. (CXX) g++ options: -O2 -lcurl -lz -lpthread -lssl -lcrypto -lgmp

OpenVINO

This is a test of the Intel OpenVINO, a toolkit around neural networks, using its built-in benchmarking support and analyzing the throughput and latency for various models. Learn more via the OpenBenchmarking.org test page.

Ryzen 7 7840UCore i7 1165G7OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.3Model: Face Detection FP16 - Device: CPUAVX512 OffAVX512 On0.78751.5752.36253.153.9375SE +/- 0.03, N = 15SE +/- 0.05, N = 12SE +/- 0.01, N = 3SE +/- 0.01, N = 141.563.501.011.011. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared
Ryzen 7 7840UCore i7 1165G7OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.3Model: Face Detection FP16 - Device: CPUAVX512 OffAVX512 On246810Min: 1.46 / Avg: 1.56 / Max: 1.84Min: 3.35 / Avg: 3.5 / Max: 3.9Min: 1 / Avg: 1.01 / Max: 1.03Min: 1 / Avg: 1.01 / Max: 1.111. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared

Ryzen 7 7840UCore i7 1165G7OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.3Model: Face Detection FP16 - Device: CPUAVX512 OffAVX512 On9001800270036004500SE +/- 44.91, N = 15SE +/- 15.69, N = 12SE +/- 38.46, N = 3SE +/- 28.27, N = 142570.311143.203968.313943.841. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared
Ryzen 7 7840UCore i7 1165G7OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.3Model: Face Detection FP16 - Device: CPUAVX512 OffAVX512 On7001400210028003500Min: 2161.2 / Avg: 2570.31 / Max: 2734.63Min: 1024.85 / Avg: 1143.2 / Max: 1194.14Min: 3891.53 / Avg: 3968.31 / Max: 4010.53Min: 3577.28 / Avg: 3943.84 / Max: 3987.881. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared

Ryzen 7 7840UCore i7 1165G7OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.3Model: Face Detection FP16-INT8 - Device: CPUAVX512 OffAVX512 On246810SE +/- 0.02, N = 3SE +/- 0.01, N = 3SE +/- 0.04, N = 15SE +/- 0.01, N = 153.186.913.911.811. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared
Ryzen 7 7840UCore i7 1165G7OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.3Model: Face Detection FP16-INT8 - Device: CPUAVX512 OffAVX512 On3691215Min: 3.14 / Avg: 3.18 / Max: 3.22Min: 6.89 / Avg: 6.91 / Max: 6.93Min: 3.8 / Avg: 3.91 / Max: 4.29Min: 1.78 / Avg: 1.81 / Max: 1.981. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared

Ryzen 7 7840UCore i7 1165G7OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.3Model: Face Detection FP16-INT8 - Device: CPUAVX512 OffAVX512 On5001000150020002500SE +/- 9.28, N = 3SE +/- 0.78, N = 3SE +/- 10.52, N = 15SE +/- 17.25, N = 151252.11578.351021.782198.131. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared
Ryzen 7 7840UCore i7 1165G7OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.3Model: Face Detection FP16-INT8 - Device: CPUAVX512 OffAVX512 On400800120016002000Min: 1237.65 / Avg: 1252.11 / Max: 1269.41Min: 576.85 / Avg: 578.35 / Max: 579.46Min: 929.87 / Avg: 1021.78 / Max: 1048.71Min: 2009.41 / Avg: 2198.13 / Max: 2246.131. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared

Ryzen 7 7840UCore i7 1165G7OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.3Model: Age Gender Recognition Retail 0013 FP16 - Device: CPUAVX512 OffAVX512 On2K4K6K8K10KSE +/- 49.53, N = 5SE +/- 23.21, N = 3SE +/- 24.76, N = 15SE +/- 22.56, N = 154781.1910275.452780.432495.371. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared
Ryzen 7 7840UCore i7 1165G7OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.3Model: Age Gender Recognition Retail 0013 FP16 - Device: CPUAVX512 OffAVX512 On2K4K6K8K10KMin: 4684.8 / Avg: 4781.19 / Max: 4967.08Min: 10245.86 / Avg: 10275.45 / Max: 10321.22Min: 2716.35 / Avg: 2780.43 / Max: 3121.08Min: 2439.78 / Avg: 2495.37 / Max: 2756.941. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared

Ryzen 7 7840UCore i7 1165G7OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.3Model: Age Gender Recognition Retail 0013 FP16 - Device: CPUAVX512 OffAVX512 On0.37130.74261.11391.48521.8565SE +/- 0.02, N = 5SE +/- 0.00, N = 3SE +/- 0.01, N = 15SE +/- 0.01, N = 151.650.771.421.591. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared
Ryzen 7 7840UCore i7 1165G7OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.3Model: Age Gender Recognition Retail 0013 FP16 - Device: CPUAVX512 OffAVX512 On246810Min: 1.58 / Avg: 1.65 / Max: 1.68Min: 0.77 / Avg: 0.77 / Max: 0.77Min: 1.27 / Avg: 1.42 / Max: 1.45Min: 1.43 / Avg: 1.59 / Max: 1.621. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared

Ryzen 7 7840UCore i7 1165G7OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.3Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPUAVX512 OffAVX512 On13002600390052006500SE +/- 61.26, N = 3SE +/- 89.90, N = 3SE +/- 25.48, N = 15SE +/- 33.60, N = 155336.566240.043141.622804.431. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared
Ryzen 7 7840UCore i7 1165G7OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.3Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPUAVX512 OffAVX512 On11002200330044005500Min: 5215.02 / Avg: 5336.56 / Max: 5410.67Min: 6066.06 / Avg: 6240.04 / Max: 6366.32Min: 3062.01 / Avg: 3141.62 / Max: 3427.4Min: 2689.21 / Avg: 2804.43 / Max: 3100.691. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared

Ryzen 7 7840UCore i7 1165G7OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.3Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPUAVX512 OffAVX512 On0.33530.67061.00591.34121.6765SE +/- 0.02, N = 3SE +/- 0.02, N = 3SE +/- 0.01, N = 15SE +/- 0.02, N = 151.491.271.261.411. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared
Ryzen 7 7840UCore i7 1165G7OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.3Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPUAVX512 OffAVX512 On246810Min: 1.47 / Avg: 1.49 / Max: 1.52Min: 1.25 / Avg: 1.27 / Max: 1.3Min: 1.15 / Avg: 1.26 / Max: 1.29Min: 1.28 / Avg: 1.41 / Max: 1.471. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared

Ryzen 7 7840UCore i7 1165G7OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.3Model: Person Detection FP16 - Device: CPUAVX512 OffAVX512 On0.40050.8011.20151.6022.0025SE +/- 0.01, N = 15SE +/- 0.03, N = 12SE +/- 0.01, N = 12SE +/- 0.01, N = 30.911.780.630.651. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared
Ryzen 7 7840UCore i7 1165G7OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.3Model: Person Detection FP16 - Device: CPUAVX512 OffAVX512 On246810Min: 0.88 / Avg: 0.91 / Max: 1Min: 1.69 / Avg: 1.78 / Max: 1.99Min: 0.62 / Avg: 0.63 / Max: 0.7Min: 0.64 / Avg: 0.65 / Max: 0.661. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared

Ryzen 7 7840UCore i7 1165G7OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.3Model: Person Detection FP16 - Device: CPUAVX512 OffAVX512 On13002600390052006500SE +/- 43.35, N = 15SE +/- 36.55, N = 12SE +/- 58.12, N = 12SE +/- 101.01, N = 34390.072242.456290.166142.871. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared
Ryzen 7 7840UCore i7 1165G7OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.3Model: Person Detection FP16 - Device: CPUAVX512 OffAVX512 On11002200330044005500Min: 3992.51 / Avg: 4390.07 / Max: 4539.49Min: 2000.36 / Avg: 2242.45 / Max: 2353.13Min: 5655.59 / Avg: 6290.16 / Max: 6382.17Min: 5940.94 / Avg: 6142.87 / Max: 6249.071. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared

Ryzen 7 7840UCore i7 1165G7OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.3Model: Person Detection FP32 - Device: CPUAVX512 OffAVX512 On0.39830.79661.19491.59321.9915SE +/- 0.00, N = 3SE +/- 0.02, N = 3SE +/- 0.01, N = 12SE +/- 0.00, N = 110.911.770.630.641. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared
Ryzen 7 7840UCore i7 1165G7OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.3Model: Person Detection FP32 - Device: CPUAVX512 OffAVX512 On246810Min: 0.91 / Avg: 0.91 / Max: 0.92Min: 1.75 / Avg: 1.77 / Max: 1.8Min: 0.62 / Avg: 0.63 / Max: 0.69Min: 0.62 / Avg: 0.64 / Max: 0.681. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared

Ryzen 7 7840UCore i7 1165G7OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.3Model: Person Detection FP32 - Device: CPUAVX512 OffAVX512 On14002800420056007000SE +/- 16.00, N = 3SE +/- 21.58, N = 3SE +/- 47.81, N = 12SE +/- 45.70, N = 114387.552252.826318.676247.581. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared
Ryzen 7 7840UCore i7 1165G7OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.3Model: Person Detection FP32 - Device: CPUAVX512 OffAVX512 On11002200330044005500Min: 4355.58 / Avg: 4387.55 / Max: 4404.76Min: 2210.26 / Avg: 2252.82 / Max: 2280.28Min: 5801.98 / Avg: 6318.67 / Max: 6410.83Min: 5808.87 / Avg: 6247.58 / Max: 6371.561. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared

Ryzen 7 7840UCore i7 1165G7OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.3Model: Weld Porosity Detection FP16-INT8 - Device: CPUAVX512 OffAVX512 On140280420560700SE +/- 2.55, N = 15SE +/- 3.92, N = 3SE +/- 3.72, N = 15SE +/- 1.96, N = 15344.82639.05375.46179.811. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared
Ryzen 7 7840UCore i7 1165G7OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.3Model: Weld Porosity Detection FP16-INT8 - Device: CPUAVX512 OffAVX512 On110220330440550Min: 318.22 / Avg: 344.82 / Max: 353.91Min: 631.38 / Avg: 639.05 / Max: 644.27Min: 365.73 / Avg: 375.46 / Max: 408.26Min: 173.5 / Avg: 179.81 / Max: 197.311. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared

Ryzen 7 7840UCore i7 1165G7OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.3Model: Weld Porosity Detection FP16-INT8 - Device: CPUAVX512 OffAVX512 On612182430SE +/- 0.18, N = 15SE +/- 0.08, N = 3SE +/- 0.10, N = 15SE +/- 0.23, N = 1523.2012.4910.6522.261. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared
Ryzen 7 7840UCore i7 1165G7OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.3Model: Weld Porosity Detection FP16-INT8 - Device: CPUAVX512 OffAVX512 On510152025Min: 22.59 / Avg: 23.2 / Max: 25.12Min: 12.39 / Avg: 12.49 / Max: 12.64Min: 9.78 / Avg: 10.65 / Max: 10.92Min: 20.26 / Avg: 22.26 / Max: 23.041. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared

Ryzen 7 7840UCore i7 1165G7OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.3Model: Weld Porosity Detection FP16 - Device: CPUAVX512 OffAVX512 On70140210280350SE +/- 1.57, N = 3SE +/- 3.20, N = 3SE +/- 0.90, N = 13SE +/- 0.83, N = 13170.20331.31100.6094.361. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared
Ryzen 7 7840UCore i7 1165G7OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.3Model: Weld Porosity Detection FP16 - Device: CPUAVX512 OffAVX512 On60120180240300Min: 168.16 / Avg: 170.2 / Max: 173.28Min: 325.01 / Avg: 331.31 / Max: 335.44Min: 99.43 / Avg: 100.6 / Max: 111.44Min: 93.07 / Avg: 94.36 / Max: 104.241. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared

Ryzen 7 7840UCore i7 1165G7OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.3Model: Weld Porosity Detection FP16 - Device: CPUAVX512 OffAVX512 On1020304050SE +/- 0.22, N = 3SE +/- 0.12, N = 3SE +/- 0.33, N = 13SE +/- 0.34, N = 1323.4812.0539.7742.401. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared
Ryzen 7 7840UCore i7 1165G7OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.3Model: Weld Porosity Detection FP16 - Device: CPUAVX512 OffAVX512 On918273645Min: 23.05 / Avg: 23.48 / Max: 23.76Min: 11.9 / Avg: 12.05 / Max: 12.28Min: 35.87 / Avg: 39.77 / Max: 40.21Min: 38.35 / Avg: 42.4 / Max: 42.951. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared

Ryzen 7 7840UCore i7 1165G7OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.3Model: Vehicle Detection FP16-INT8 - Device: CPUAVX512 OffAVX512 On80160240320400SE +/- 2.68, N = 3SE +/- 3.22, N = 15SE +/- 1.42, N = 14SE +/- 0.88, N = 14237.45359.97224.29119.161. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared
Ryzen 7 7840UCore i7 1165G7OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.3Model: Vehicle Detection FP16-INT8 - Device: CPUAVX512 OffAVX512 On60120180240300Min: 232.65 / Avg: 237.45 / Max: 241.93Min: 352.02 / Avg: 359.97 / Max: 394.05Min: 222.16 / Avg: 224.29 / Max: 242.62Min: 117.87 / Avg: 119.16 / Max: 130.531. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared

Ryzen 7 7840UCore i7 1165G7OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.3Model: Vehicle Detection FP16-INT8 - Device: CPUAVX512 OffAVX512 On816243240SE +/- 0.19, N = 3SE +/- 0.09, N = 15SE +/- 0.10, N = 14SE +/- 0.23, N = 1416.8411.1017.8233.571. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared
Ryzen 7 7840UCore i7 1165G7OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.3Model: Vehicle Detection FP16-INT8 - Device: CPUAVX512 OffAVX512 On714212835Min: 16.52 / Avg: 16.84 / Max: 17.18Min: 10.13 / Avg: 11.1 / Max: 11.34Min: 16.47 / Avg: 17.82 / Max: 17.98Min: 30.62 / Avg: 33.57 / Max: 33.911. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared

Ryzen 7 7840UCore i7 1165G7OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.3Model: Vehicle Detection FP16 - Device: CPUAVX512 OffAVX512 On4080120160200SE +/- 1.48, N = 15SE +/- 2.58, N = 3SE +/- 0.67, N = 3SE +/- 0.98, N = 5131.13185.7281.4393.811. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared
Ryzen 7 7840UCore i7 1165G7OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.3Model: Vehicle Detection FP16 - Device: CPUAVX512 OffAVX512 On306090120150Min: 124.82 / Avg: 131.13 / Max: 145.72Min: 182.7 / Avg: 185.72 / Max: 190.86Min: 80.42 / Avg: 81.43 / Max: 82.69Min: 92.4 / Avg: 93.81 / Max: 97.721. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared

Ryzen 7 7840UCore i7 1165G7OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.3Model: Vehicle Detection FP16 - Device: CPUAVX512 OffAVX512 On1122334455SE +/- 0.33, N = 15SE +/- 0.29, N = 3SE +/- 0.40, N = 3SE +/- 0.44, N = 530.5321.5349.1042.631. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared
Ryzen 7 7840UCore i7 1165G7OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.3Model: Vehicle Detection FP16 - Device: CPUAVX512 OffAVX512 On1020304050Min: 27.42 / Avg: 30.53 / Max: 32.02Min: 20.94 / Avg: 21.53 / Max: 21.87Min: 48.35 / Avg: 49.1 / Max: 49.71Min: 40.9 / Avg: 42.63 / Max: 43.271. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared

Ryzen 7 7840UCore i7 1165G7OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.3Model: Person Vehicle Bike Detection FP16 - Device: CPUAVX512 OffAVX512 On70140210280350SE +/- 0.75, N = 3SE +/- 3.29, N = 3SE +/- 0.41, N = 3SE +/- 1.50, N = 5212.15336.13149.67148.131. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared
Ryzen 7 7840UCore i7 1165G7OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.3Model: Person Vehicle Bike Detection FP16 - Device: CPUAVX512 OffAVX512 On60120180240300Min: 210.65 / Avg: 212.15 / Max: 212.98Min: 332.55 / Avg: 336.13 / Max: 342.7Min: 149.11 / Avg: 149.67 / Max: 150.46Min: 145.99 / Avg: 148.13 / Max: 153.981. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared

Ryzen 7 7840UCore i7 1165G7OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.3Model: Person Vehicle Bike Detection FP16 - Device: CPUAVX512 OffAVX512 On612182430SE +/- 0.07, N = 3SE +/- 0.11, N = 3SE +/- 0.07, N = 3SE +/- 0.27, N = 518.8311.8826.7026.991. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared
Ryzen 7 7840UCore i7 1165G7OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.3Model: Person Vehicle Bike Detection FP16 - Device: CPUAVX512 OffAVX512 On612182430Min: 18.75 / Avg: 18.83 / Max: 18.96Min: 11.65 / Avg: 11.88 / Max: 12Min: 26.56 / Avg: 26.7 / Max: 26.8Min: 25.95 / Avg: 26.99 / Max: 27.381. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared

Ryzen 7 7840UCore i7 1165G7OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.3Model: Machine Translation EN To DE FP16 - Device: CPUAVX512 OffAVX512 On816243240SE +/- 0.10, N = 3SE +/- 0.33, N = 3SE +/- 0.10, N = 3SE +/- 0.11, N = 717.1336.4613.2212.051. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared
Ryzen 7 7840UCore i7 1165G7OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.3Model: Machine Translation EN To DE FP16 - Device: CPUAVX512 OffAVX512 On816243240Min: 16.94 / Avg: 17.13 / Max: 17.26Min: 35.81 / Avg: 36.46 / Max: 36.91Min: 13.07 / Avg: 13.22 / Max: 13.42Min: 11.89 / Avg: 12.05 / Max: 12.731. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared

Ryzen 7 7840UCore i7 1165G7OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.3Model: Machine Translation EN To DE FP16 - Device: CPUAVX512 OffAVX512 On70140210280350SE +/- 1.31, N = 3SE +/- 0.99, N = 3SE +/- 2.39, N = 3SE +/- 3.01, N = 7233.17109.68302.21331.581. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared
Ryzen 7 7840UCore i7 1165G7OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.3Model: Machine Translation EN To DE FP16 - Device: CPUAVX512 OffAVX512 On60120180240300Min: 231.55 / Avg: 233.17 / Max: 235.76Min: 108.35 / Avg: 109.68 / Max: 111.62Min: 297.71 / Avg: 302.21 / Max: 305.84Min: 313.64 / Avg: 331.58 / Max: 336.071. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared

miniBUDE

MiniBUDE is a mini application for the the core computation of the Bristol University Docking Engine (BUDE). This test profile currently makes use of the OpenMP implementation of miniBUDE for CPU benchmarking. Learn more via the OpenBenchmarking.org test page.

Ryzen 7 7840UCore i7 1165G7OpenBenchmarking.orgGFInst/s, More Is BetterminiBUDE 20210901Implementation: OpenMP - Input Deck: BM1AVX512 OffAVX512 On80160240320400SE +/- 3.42, N = 3SE +/- 3.72, N = 3SE +/- 1.94, N = 4SE +/- 1.80, N = 3290.70372.10161.71131.191. (CC) gcc options: -std=c99 -Ofast -ffast-math -fopenmp -march=native -lm
Ryzen 7 7840UCore i7 1165G7OpenBenchmarking.orgGFInst/s, More Is BetterminiBUDE 20210901Implementation: OpenMP - Input Deck: BM1AVX512 OffAVX512 On70140210280350Min: 284.1 / Avg: 290.7 / Max: 295.55Min: 365.06 / Avg: 372.1 / Max: 377.7Min: 157.24 / Avg: 161.71 / Max: 166.69Min: 127.63 / Avg: 131.19 / Max: 133.481. (CC) gcc options: -std=c99 -Ofast -ffast-math -fopenmp -march=native -lm

Ryzen 7 7840UCore i7 1165G7OpenBenchmarking.orgBillion Interactions/s, More Is BetterminiBUDE 20210901Implementation: OpenMP - Input Deck: BM1AVX512 OffAVX512 On48121620SE +/- 0.137, N = 3SE +/- 0.149, N = 3SE +/- 0.078, N = 4SE +/- 0.072, N = 311.62814.8846.4685.2471. (CC) gcc options: -std=c99 -Ofast -ffast-math -fopenmp -march=native -lm
Ryzen 7 7840UCore i7 1165G7OpenBenchmarking.orgBillion Interactions/s, More Is BetterminiBUDE 20210901Implementation: OpenMP - Input Deck: BM1AVX512 OffAVX512 On48121620Min: 11.36 / Avg: 11.63 / Max: 11.82Min: 14.6 / Avg: 14.88 / Max: 15.11Min: 6.29 / Avg: 6.47 / Max: 6.67Min: 5.11 / Avg: 5.25 / Max: 5.341. (CC) gcc options: -std=c99 -Ofast -ffast-math -fopenmp -march=native -lm

SMHasher

SMHasher is a hash function tester supporting various algorithms and able to make use of AVX and other modern CPU instruction set extensions. Learn more via the OpenBenchmarking.org test page.

Ryzen 7 7840UCore i7 1165G7OpenBenchmarking.orgMiB/sec, More Is BetterSMHasher 2022-08-22Hash: FarmHash32 x86_64 AVXAVX512 OffAVX512 On9K18K27K36K45KSE +/- 89.33, N = 6SE +/- 5.74, N = 6SE +/- 2.05, N = 5SE +/- 28.52, N = 536442.7640077.5939090.0934821.201. (CXX) g++ options: -march=native -O3 -flto=auto -fno-fat-lto-objects
Ryzen 7 7840UCore i7 1165G7OpenBenchmarking.orgMiB/sec, More Is BetterSMHasher 2022-08-22Hash: FarmHash32 x86_64 AVXAVX512 OffAVX512 On7K14K21K28K35KMin: 36190.75 / Avg: 36442.76 / Max: 36681.47Min: 40049.01 / Avg: 40077.59 / Max: 40085.28Min: 39084.49 / Avg: 39090.09 / Max: 39094.78Min: 34708.79 / Avg: 34821.2 / Max: 34860.921. (CXX) g++ options: -march=native -O3 -flto=auto -fno-fat-lto-objects

libxsmm

Libxsmm is an open-source library for specialized dense and sparse matrix operations and deep learning primitives. Libxsmm supports making use of Intel AMX, AVX-512, and other modern CPU instruction set capabilities. Learn more via the OpenBenchmarking.org test page.

Ryzen 7 7840UCore i7 1165G7OpenBenchmarking.orgGFLOPS/s, More Is Betterlibxsmm 2-1.17-3645M N K: 64AVX512 OffAVX512 On4080120160200SE +/- 1.56, N = 3SE +/- 1.19, N = 3SE +/- 1.64, N = 14SE +/- 1.72, N = 13155.3168.0137.1139.01. (CXX) g++ options: -dynamic -Bstatic -static-libgcc -lgomp -lm -lrt -ldl -lquadmath -lstdc++ -pthread -fPIC -std=c++14 -O2 -fopenmp -fopenmp-simd -funroll-loops -ftree-vectorize -fdata-sections -ffunction-sections -fvisibility=hidden -march=core-avx2
Ryzen 7 7840UCore i7 1165G7OpenBenchmarking.orgGFLOPS/s, More Is Betterlibxsmm 2-1.17-3645M N K: 64AVX512 OffAVX512 On306090120150Min: 152.6 / Avg: 155.33 / Max: 158Min: 165.7 / Avg: 167.97 / Max: 169.7Min: 134.5 / Avg: 137.06 / Max: 158.4Min: 137.1 / Avg: 138.95 / Max: 159.61. (CXX) g++ options: -dynamic -Bstatic -static-libgcc -lgomp -lm -lrt -ldl -lquadmath -lstdc++ -pthread -fPIC -std=c++14 -O2 -fopenmp -fopenmp-simd -funroll-loops -ftree-vectorize -fdata-sections -ffunction-sections -fvisibility=hidden -march=core-avx2

TensorFlow

This is a benchmark of the TensorFlow deep learning framework using the TensorFlow reference benchmarks (tensorflow/benchmarks with tf_cnn_benchmarks.py). Note with the Phoronix Test Suite there is also pts/tensorflow-lite for benchmarking the TensorFlow Lite binaries if desired for complementary metrics. Learn more via the OpenBenchmarking.org test page.

Ryzen 7 7840UCore i7 1165G7OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.12Device: CPU - Batch Size: 16 - Model: ResNet-50AVX512 OffAVX512 On48121620SE +/- 0.00, N = 3SE +/- 0.08, N = 3SE +/- 0.09, N = 3SE +/- 0.02, N = 38.8416.449.746.87
Ryzen 7 7840UCore i7 1165G7OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.12Device: CPU - Batch Size: 16 - Model: ResNet-50AVX512 OffAVX512 On48121620Min: 8.83 / Avg: 8.84 / Max: 8.84Min: 16.34 / Avg: 16.44 / Max: 16.59Min: 9.58 / Avg: 9.74 / Max: 9.87Min: 6.84 / Avg: 6.87 / Max: 6.91

Ryzen 7 7840UCore i7 1165G7OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.12Device: CPU - Batch Size: 16 - Model: AlexNetAVX512 OffAVX512 On20406080100SE +/- 0.03, N = 3SE +/- 0.18, N = 3SE +/- 1.39, N = 15SE +/- 0.57, N = 1546.2177.6552.9736.87
Ryzen 7 7840UCore i7 1165G7OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.12Device: CPU - Batch Size: 16 - Model: AlexNetAVX512 OffAVX512 On1530456075Min: 46.15 / Avg: 46.21 / Max: 46.26Min: 77.31 / Avg: 77.65 / Max: 77.9Min: 47.14 / Avg: 52.97 / Max: 59.6Min: 35 / Avg: 36.87 / Max: 40.61

Ryzen 7 7840UCore i7 1165G7OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.12Device: CPU - Batch Size: 16 - Model: GoogLeNetAVX512 OffAVX512 On1224364860SE +/- 0.19, N = 11SE +/- 0.32, N = 3SE +/- 0.52, N = 15SE +/- 0.26, N = 325.7851.1928.6218.38
Ryzen 7 7840UCore i7 1165G7OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.12Device: CPU - Batch Size: 16 - Model: GoogLeNetAVX512 OffAVX512 On1020304050Min: 25.41 / Avg: 25.78 / Max: 27.56Min: 50.55 / Avg: 51.19 / Max: 51.53Min: 26.5 / Avg: 28.62 / Max: 31.19Min: 17.88 / Avg: 18.38 / Max: 18.77

Ryzen 7 7840UCore i7 1165G7OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.12Device: CPU - Batch Size: 64 - Model: ResNet-50AVX512 OffAVX512 On48121620SE +/- 0.01, N = 3SE +/- 0.20, N = 3SE +/- 0.04, N = 3SE +/- 0.01, N = 38.5416.7410.516.77
Ryzen 7 7840UCore i7 1165G7OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.12Device: CPU - Batch Size: 64 - Model: ResNet-50AVX512 OffAVX512 On48121620Min: 8.53 / Avg: 8.54 / Max: 8.55Min: 16.42 / Avg: 16.74 / Max: 17.11Min: 10.45 / Avg: 10.51 / Max: 10.59Min: 6.76 / Avg: 6.77 / Max: 6.78

Ryzen 7 7840UCore i7 1165G7OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.12Device: CPU - Batch Size: 64 - Model: AlexNetAVX512 OffAVX512 On306090120150SE +/- 0.71, N = 5SE +/- 0.62, N = 3SE +/- 0.75, N = 15SE +/- 0.28, N = 364.79113.5864.5644.91
Ryzen 7 7840UCore i7 1165G7OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.12Device: CPU - Batch Size: 64 - Model: AlexNetAVX512 OffAVX512 On20406080100Min: 63.46 / Avg: 64.79 / Max: 67.38Min: 112.94 / Avg: 113.58 / Max: 114.82Min: 57.41 / Avg: 64.56 / Max: 66.42Min: 44.39 / Avg: 44.91 / Max: 45.36

Ryzen 7 7840UCore i7 1165G7OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.12Device: CPU - Batch Size: 64 - Model: GoogLeNetAVX512 OffAVX512 On1122334455SE +/- 0.08, N = 3SE +/- 0.53, N = 4SE +/- 0.09, N = 3SE +/- 0.03, N = 324.8748.0529.9617.97
Ryzen 7 7840UCore i7 1165G7OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.12Device: CPU - Batch Size: 64 - Model: GoogLeNetAVX512 OffAVX512 On1020304050Min: 24.78 / Avg: 24.87 / Max: 25.02Min: 47.33 / Avg: 48.05 / Max: 49.61Min: 29.82 / Avg: 29.96 / Max: 30.13Min: 17.92 / Avg: 17.97 / Max: 18

CPU Peak Freq (Highest CPU Core Frequency) Monitor

Ryzen 7 7840UCore i7 1165G7OpenBenchmarking.orgMegahertzCPU Peak Freq (Highest CPU Core Frequency) MonitorPhoronix Test Suite System MonitoringAVX512 OffAVX512 On9001800270036004500Min: 1114 / Avg: 2621.67 / Max: 5115Min: 1397 / Avg: 2761.55 / Max: 5115Min: 683 / Avg: 2950.53 / Max: 4707Min: 640 / Avg: 2932.06 / Max: 4745

CPU Power Consumption Monitor

Ryzen 7 7840UCore i7 1165G7OpenBenchmarking.orgWattsCPU Power Consumption MonitorPhoronix Test Suite System MonitoringAVX512 OffAVX512 On1530456075Min: 1.3 / Avg: 16.39 / Max: 30.21Min: 1.27 / Avg: 15.88 / Max: 30.82Min: 0.54 / Avg: 28.73 / Max: 63.65Min: 0.59 / Avg: 29.93 / Max: 75.77

CPU Temperature Monitor

Ryzen 7 7840UCore i7 1165G7OpenBenchmarking.orgCelsiusCPU Temperature MonitorPhoronix Test Suite System MonitoringAVX512 OffAVX512 On20406080100Min: 38.88 / Avg: 67.66 / Max: 92Min: 31.25 / Avg: 67.05 / Max: 92.13Min: 33 / Avg: 80.26 / Max: 100Min: 32 / Avg: 80.83 / Max: 100

System Temperature Monitor

OpenBenchmarking.orgCelsiusSystem Temperature MonitorPhoronix Test Suite System MonitoringAVX512 OffAVX512 On20406080100Min: 38 / Avg: 67.22 / Max: 92Min: 31 / Avg: 66.6 / Max: 92

69 Results Shown

LeelaChessZero
Embree:
  Pathtracer ISPC - Asian Dragon
  Pathtracer ISPC - Asian Dragon Obj
  Pathtracer ISPC - Crown
OpenVKL
OSPRay:
  gravity_spheres_volume/dim_512/ao/real_time
  gravity_spheres_volume/dim_512/scivis/real_time
  gravity_spheres_volume/dim_512/pathtracer/real_time
  particle_volume/pathtracer/real_time
OSPRay Studio:
  1 - 1080p - 1 - Path Tracer
  1 - 1080p - 32 - Path Tracer
  1 - 4K - 1 - Path Tracer
  1 - 4K - 32 - Path Tracer
  3 - 1080p - 1 - Path Tracer
  3 - 1080p - 32 - Path Tracer
  3 - 4K - 1 - Path Tracer
  3 - 4K - 32 - Path Tracer
oneDNN:
  Deconvolution Batch shapes_1d - u8s8f32 - CPU
  Deconvolution Batch shapes_3d - u8s8f32 - CPU
  IP Shapes 1D - u8s8f32 - CPU
  Recurrent Neural Network Training - u8s8f32 - CPU
  Recurrent Neural Network Inference - u8s8f32 - CPU
Cpuminer-Opt:
  scrypt
  Quad SHA-256, Pyrite
  Myriad-Groestl
  Magi
  Blake-2 S
  x25x
  Garlicoin
  Skeincoin
  LBC, LBRY Credits
OpenVINO:
  Face Detection FP16 - CPU:
    FPS
    ms
  Face Detection FP16-INT8 - CPU:
    FPS
    ms
  Age Gender Recognition Retail 0013 FP16 - CPU:
    FPS
    ms
  Age Gender Recognition Retail 0013 FP16-INT8 - CPU:
    FPS
    ms
  Person Detection FP16 - CPU:
    FPS
    ms
  Person Detection FP32 - CPU:
    FPS
    ms
  Weld Porosity Detection FP16-INT8 - CPU:
    FPS
    ms
  Weld Porosity Detection FP16 - CPU:
    FPS
    ms
  Vehicle Detection FP16-INT8 - CPU:
    FPS
    ms
  Vehicle Detection FP16 - CPU:
    FPS
    ms
  Person Vehicle Bike Detection FP16 - CPU:
    FPS
    ms
  Machine Translation EN To DE FP16 - CPU:
    FPS
    ms
miniBUDE:
  OpenMP - BM1:
    GFInst/s
    Billion Interactions/s
SMHasher
libxsmm
TensorFlow:
  CPU - 16 - ResNet-50
  CPU - 16 - AlexNet
  CPU - 16 - GoogLeNet
  CPU - 64 - ResNet-50
  CPU - 64 - AlexNet
  CPU - 64 - GoogLeNet
CPU Peak Freq (Highest CPU Core Frequency) Monitor:
  Phoronix Test Suite System Monitoring:
    Megahertz
    Watts
    Celsius
    Celsius