Ryzen 7 7840U AMD Zen 4 AVX-512 Analysis

Benchmarks by Michael Larabel for a future article. Intel Core i7-1065G7 testing with a Dell 06CDVY (1.0.9 BIOS) and Intel Iris Plus ICL GT2 16GB on Ubuntu 23.04 via the Phoronix Test Suite.

Compare your own system(s) to this result file with the Phoronix Test Suite by running the command: phoronix-test-suite benchmark 2307119-NE-2307108NE50
Jump To Table - Results

View

Do Not Show Noisy Results
Do Not Show Results With Incomplete Data
Do Not Show Results With Little Change/Spread
List Notable Results
Show Result Confidence Charts

Limit displaying results to tests within:

CPU Massive 3 Tests
Creator Workloads 6 Tests
HPC - High Performance Computing 4 Tests
Machine Learning 3 Tests
Multi-Core 7 Tests
Intel oneAPI 6 Tests
Python Tests 2 Tests
Raytracing 2 Tests
Renderers 2 Tests
Server CPU Tests 2 Tests

Statistics

Show Overall Harmonic Mean(s)
Show Overall Geometric Mean
Show Geometric Means Per-Suite/Category
Show Wins / Losses Counts (Pie Chart)
Normalize Results
Remove Outliers Before Calculating Averages

Graph Settings

Force Line Graphs Where Applicable
Convert To Scalar Where Applicable
Disable Color Branding
Prefer Vertical Bar Graphs
No Box Plots
On Line Graphs With Missing Data, Connect The Line Gaps

Multi-Way Comparison

Condense Comparison
Transpose Comparison

Table

Show Detailed System Result Table

Run Management

Highlight
Result
Hide
Result
Result
Identifier
Performance Per
Dollar
Date
Run
  Test
  Duration
Core i7 1065G7: AVX512 Off
July 11 2023
  10 Hours, 47 Minutes
Core i7 1065G7: AVX512 On
July 10 2023
  12 Hours, 43 Minutes
Core i7 1165G7: AVX512 Off
July 09 2023
  13 Hours, 41 Minutes
Core i7 1165G7: AVX512 On
July 08 2023
  13 Hours, 7 Minutes
Ryzen 7 7840U: AVX512 Off
July 08 2023
  8 Hours, 48 Minutes
Ryzen 7 7840U: AVX512 On
July 08 2023
  7 Hours, 18 Minutes
Invert Hiding All Results Option
  11 Hours, 4 Minutes

Only show results where is faster than
Only show results matching title/arguments (delimit multiple options with a comma):
Do not show results matching title/arguments (delimit multiple options with a comma):


ProcessorMotherboardChipsetMemoryDiskGraphicsAudioNetworkOSKernelDesktopDisplay ServerOpenGLCompilerFile-SystemScreen ResolutionRyzen 7 7840UCore i7 1165G7Core i7 1065G7 AVX512 Off AVX512 On AVX512 On AVX512 Off AVX512 On AVX512 OffAMD Ryzen 7 7840U @ 3.30GHz (8 Cores / 16 Threads)PHX Ray_PEU (V1.04 BIOS)AMD Device 14e816GB1024GB Micron_3400_MTFDKBA1T0TFHAMD Phoenix1 512MB (2700/400MHz)AMD Rembrandt Radeon HD AudioMEDIATEK MT7922 802.11ax PCIUbuntu 23.046.2.0-24-generic (x86_64)KDE Plasma 5.27.4X Server 1.21.1.74.6 Mesa 23.0.2 (LLVM 15.0.7 DRM 3.49)GCC 12.2.0ext43200x2000Intel Core i7-1165G7 @ 4.70GHz (4 Cores / 8 Threads)Dell 0GG9PT (3.15.0 BIOS)Intel Tiger Lake-LPKioxia KBG40ZNS256G NVMe 256GBIntel Xe TGL GT2 15GB (1300MHz)Realtek ALC289Intel Wi-Fi 6 AX201GNOME Shell 44.0X Server + Wayland4.6 Mesa 23.0.21920x1200Intel Core i7-1065G7 @ 3.90GHz (4 Cores / 8 Threads)Dell 06CDVY (1.0.9 BIOS)Intel Ice Lake-LP DRAMToshiba KBG40ZPZ512G NVMe 512GBIntel Iris Plus ICL GT2 16GB (1100MHz)Intel Ice Lake-LP PCH CNVi WiFi4.6 Mesa 23.0.4-0ubuntu1~23.04.1OpenBenchmarking.orgKernel Details- Transparent Huge Pages: madviseCompiler Details- --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-defaulted --enable-offload-targets=nvptx-none=/build/gcc-12-Pa930Z/gcc-12-12.2.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-12-Pa930Z/gcc-12-12.2.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v Processor Details- Ryzen 7 7840U: AVX512 Off: Scaling Governor: acpi-cpufreq schedutil (Boost: Enabled) - CPU Microcode: 0xa704101- Ryzen 7 7840U: AVX512 On: Scaling Governor: acpi-cpufreq schedutil (Boost: Enabled) - CPU Microcode: 0xa704101- Core i7 1165G7: AVX512 On: Scaling Governor: intel_pstate powersave (EPP: balance_performance) - CPU Microcode: 0xa6 - Thermald 2.5.2- Core i7 1165G7: AVX512 Off: Scaling Governor: intel_pstate powersave (EPP: balance_performance) - CPU Microcode: 0xa6 - Thermald 2.5.2- Core i7 1065G7: AVX512 On: Scaling Governor: intel_pstate powersave (EPP: balance_performance) - CPU Microcode: 0xb8 - Thermald 2.5.2- Core i7 1065G7: AVX512 Off: Scaling Governor: intel_pstate powersave (EPP: balance_performance) - CPU Microcode: 0xb8 - Thermald 2.5.2Python Details- Python 3.11.2Security Details- Ryzen 7 7840U: AVX512 Off: itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional IBRS_FW STIBP: always-on RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected - Ryzen 7 7840U: AVX512 On: itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional IBRS_FW STIBP: always-on RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected - Core i7 1165G7: AVX512 On: itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Not affected - Core i7 1165G7: AVX512 Off: itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Not affected - Core i7 1065G7: AVX512 On: itlb_multihit: KVM: Mitigation of VMX disabled + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Mitigation of Clear buffers; SMT vulnerable + retbleed: Mitigation of Enhanced IBRS + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Mitigation of Microcode + tsx_async_abort: Not affected - Core i7 1065G7: AVX512 Off: itlb_multihit: KVM: Mitigation of VMX disabled + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Mitigation of Clear buffers; SMT vulnerable + retbleed: Mitigation of Enhanced IBRS + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Mitigation of Microcode + tsx_async_abort: Not affected

ospray-studio: 3 - 4K - 32 - Path Tracerospray-studio: 1 - 4K - 32 - Path Tracertensorflow: CPU - 64 - ResNet-50openvkl: vklBenchmark ISPCtensorflow: CPU - 64 - GoogLeNetlibxsmm: 64ospray-studio: 3 - 1080p - 32 - Path Traceronednn: Recurrent Neural Network Training - u8s8f32 - CPUospray: particle_volume/pathtracer/real_timeospray-studio: 1 - 1080p - 32 - Path Traceropenvino: Face Detection FP16 - CPUopenvino: Face Detection FP16 - CPUopenvino: Person Detection FP16 - CPUopenvino: Person Detection FP16 - CPUtensorflow: CPU - 16 - ResNet-50tensorflow: CPU - 64 - AlexNetopenvino: Weld Porosity Detection FP16-INT8 - CPUopenvino: Weld Porosity Detection FP16-INT8 - CPUospray-studio: 1 - 1080p - 1 - Path Tracerospray-studio: 3 - 1080p - 1 - Path Traceropenvino: Age Gender Recognition Retail 0013 FP16 - CPUopenvino: Age Gender Recognition Retail 0013 FP16 - CPUopenvino: Face Detection FP16-INT8 - CPUopenvino: Face Detection FP16-INT8 - CPUopenvino: Person Detection FP32 - CPUopenvino: Person Detection FP32 - CPUopenvino: Vehicle Detection FP16-INT8 - CPUopenvino: Vehicle Detection FP16-INT8 - CPUtensorflow: CPU - 16 - GoogLeNetembree: Pathtracer ISPC - Asian Dragonopenvino: Age Gender Recognition Retail 0013 FP16-INT8 - CPUopenvino: Age Gender Recognition Retail 0013 FP16-INT8 - CPUonednn: Recurrent Neural Network Inference - u8s8f32 - CPUembree: Pathtracer ISPC - Crownospray: gravity_spheres_volume/dim_512/scivis/real_timeminibude: OpenMP - BM1minibude: OpenMP - BM1embree: Pathtracer ISPC - Asian Dragon Objospray: gravity_spheres_volume/dim_512/ao/real_timeopenvino: Weld Porosity Detection FP16 - CPUopenvino: Weld Porosity Detection FP16 - CPUospray: gravity_spheres_volume/dim_512/pathtracer/real_timetensorflow: CPU - 16 - AlexNetospray-studio: 3 - 4K - 1 - Path Tracerospray-studio: 1 - 4K - 1 - Path Traceropenvino: Vehicle Detection FP16 - CPUopenvino: Vehicle Detection FP16 - CPUcpuminer-opt: Blake-2 Scpuminer-opt: x25xcpuminer-opt: Myriad-Groestlcpuminer-opt: Garlicoincpuminer-opt: Skeincoincpuminer-opt: LBC, LBRY Creditsopenvino: Machine Translation EN To DE FP16 - CPUopenvino: Machine Translation EN To DE FP16 - CPUopenvino: Person Vehicle Bike Detection FP16 - CPUopenvino: Person Vehicle Bike Detection FP16 - CPUcpuminer-opt: scryptcpuminer-opt: Quad SHA-256, Pyriteonednn: Deconvolution Batch shapes_1d - u8s8f32 - CPUonednn: IP Shapes 1D - u8s8f32 - CPUonednn: Deconvolution Batch shapes_3d - u8s8f32 - CPURyzen 7 7840UCore i7 1165G7Core i7 1065G7 AVX512 Off AVX512 On AVX512 On AVX512 Off AVX512 On AVX512 Off7395755979238.549224.87155.31878535003.2393.51821477642570.311.564390.070.918.8464.7923.20344.82445657071.654781.191252.113.184387.550.9116.84237.4525.788.09171.495336.562748.206.85561.1372411.628290.6977.23291.1948723.48170.201.9576446.21224791808830.53131.13315925348.69139102009.386390722030233.1717.1318.83212.15128.05585332.869451.680583.3699862876754890316.7411448.05168.01612584354.17101.8081385531143.203.502242.451.7816.44113.5812.49639.05419250600.7710275.45578.356.912252.821.7711.10359.9751.199.95841.276240.042371.627.91861.9781414.884372.1008.55951.9887012.05331.312.4695677.65190641656721.53185.72531477374.95261602752.277830043903109.6836.4611.88336.13166.57876271.527070.9444321.61633107620287044710.518229.96137.12689827357.3388.34042195873968.311.016290.160.639.7464.5610.65375.46690685071.422780.431021.783.916318.670.6317.82224.2928.626.29751.263141.623754.664.94481.397246.468161.7055.51621.4268239.77100.601.6762152.97321892668049.1081.43282211175.05126091822.773416124502302.2113.2226.70149.67132.79526032.481261.895782.5236811666129678546.776317.97139.02966759315.5076.03622436823943.841.016142.870.656.8744.9122.26179.81770091011.592495.372198.131.816247.580.6433.57119.1618.385.63031.412804.434765.104.36530.8333345.247131.1875.01780.87808042.4094.361.2579636.87357452947042.6393.81150523156.605364.371057.36229718840.50331.5812.0526.99148.1362.57215654.879153.593425.74030157184813170477.515320.7792.039971611513.956.01393353475677.940.709526.090.427.1846.6515.24262.3810304123422.011972.411478.992.709645.110.4126.98148.1819.924.13481.862126.635863.573.20560.8283654.546113.6473.61060.84888858.9767.831.0343638.47488204080769.8557.25192807118.908664.821277.892446216205438.379.1239.19102.0375.83334034.120713.211083.15547161104613703174.674111.9786.441223112996.549.10503552406046.150.669570.620.424.7932.1331.94125.2211072128432.251756.763229.191.239721.500.4149.1581.3812.273.91242.091896.016705.372.91810.4889893.53088.2493.42150.51313563.8462.660.75521127.32504864216566.3060.3399990102.373733.13717.47155406023.36510.127.8339.69100.7343.01150278.533145.797049.11295OpenBenchmarking.org

OSPRay Studio

Intel OSPRay Studio is an open-source, interactive visualization and ray-tracing software package. OSPRay Studio makes use of Intel OSPRay, a portable ray-tracing engine for high-performance, high-fidelity visualizations. OSPRay builds off Intel's Embree and Intel SPMD Program Compiler (ISPC) components as part of the oneAPI rendering toolkit. Learn more via the OpenBenchmarking.org test page.

AVX512 OffAVX512 OnOpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.11Camera: 3 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path TracerCore i7 1065G7Core i7 1165G7Ryzen 7 7840U300K600K900K1200K1500KSE +/- 17616.28, N = 4SE +/- 1916.25, N = 3SE +/- 6114.98, N = 3SE +/- 4397.04, N = 3SE +/- 1190.01, N = 3SE +/- 4373.49, N = 316110461166612739575157184810762026287671. (CXX) g++ options: -O3 -lm -ldl

AVX512 OffAVX512 OnOpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.11Camera: 1 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path TracerCore i7 1065G7Core i7 1165G7Ryzen 7 7840U300K600K900K1200K1500KSE +/- 10697.42, N = 3SE +/- 1928.99, N = 3SE +/- 5872.37, N = 3SE +/- 1706.45, N = 3SE +/- 954.05, N = 3SE +/- 3927.76, N = 3137031796785459792313170478704475489031. (CXX) g++ options: -O3 -lm -ldl

TensorFlow

This is a benchmark of the TensorFlow deep learning framework using the TensorFlow reference benchmarks (tensorflow/benchmarks with tf_cnn_benchmarks.py). Note with the Phoronix Test Suite there is also pts/tensorflow-lite for benchmarking the TensorFlow Lite binaries if desired for complementary metrics. Learn more via the OpenBenchmarking.org test page.

AVX512 OffAVX512 OnOpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.12Device: CPU - Batch Size: 64 - Model: ResNet-50Core i7 1065G7Core i7 1165G7Ryzen 7 7840U48121620SE +/- 0.05, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.00, N = 3SE +/- 0.04, N = 3SE +/- 0.20, N = 34.676.778.547.5110.5116.74

OpenVKL

OpenVKL is the Intel Open Volume Kernel Library that offers high-performance volume computation kernels and part of the Intel oneAPI rendering toolkit. Learn more via the OpenBenchmarking.org test page.

AVX512 OffAVX512 OnOpenBenchmarking.orgItems / Sec, More Is BetterOpenVKL 1.3.1Benchmark: vklBenchmark ISPCCore i7 1065G7Core i7 1165G7Ryzen 7 7840U306090120150SE +/- 0.33, N = 3SE +/- 0.00, N = 3SE +/- 1.30, N = 9SE +/- 0.67, N = 3SE +/- 0.33, N = 3SE +/- 1.61, N = 94163925382114

TensorFlow

This is a benchmark of the TensorFlow deep learning framework using the TensorFlow reference benchmarks (tensorflow/benchmarks with tf_cnn_benchmarks.py). Note with the Phoronix Test Suite there is also pts/tensorflow-lite for benchmarking the TensorFlow Lite binaries if desired for complementary metrics. Learn more via the OpenBenchmarking.org test page.

AVX512 OffAVX512 OnOpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.12Device: CPU - Batch Size: 64 - Model: GoogLeNetCore i7 1065G7Core i7 1165G7Ryzen 7 7840U1122334455SE +/- 0.13, N = 3SE +/- 0.03, N = 3SE +/- 0.08, N = 3SE +/- 0.02, N = 3SE +/- 0.09, N = 3SE +/- 0.53, N = 411.9717.9724.8720.7729.9648.05

libxsmm

Libxsmm is an open-source library for specialized dense and sparse matrix operations and deep learning primitives. Libxsmm supports making use of Intel AMX, AVX-512, and other modern CPU instruction set capabilities. Learn more via the OpenBenchmarking.org test page.

AVX512 OffAVX512 OnOpenBenchmarking.orgGFLOPS/s, More Is Betterlibxsmm 2-1.17-3645M N K: 64Core i7 1065G7Core i7 1165G7Ryzen 7 7840U4080120160200SE +/- 2.79, N = 12SE +/- 1.72, N = 13SE +/- 1.56, N = 3SE +/- 3.03, N = 12SE +/- 1.64, N = 14SE +/- 1.19, N = 386.4139.0155.392.0137.1168.01. (CXX) g++ options: -dynamic -Bstatic -lgomp -lm -lrt -ldl -lquadmath -lstdc++ -pthread -fPIC -std=c++14 -O2 -fopenmp -fopenmp-simd -funroll-loops -ftree-vectorize -fdata-sections -ffunction-sections -fvisibility=hidden -march=core-avx2

OSPRay Studio

Intel OSPRay Studio is an open-source, interactive visualization and ray-tracing software package. OSPRay Studio makes use of Intel OSPRay, a portable ray-tracing engine for high-performance, high-fidelity visualizations. OSPRay builds off Intel's Embree and Intel SPMD Program Compiler (ISPC) components as part of the oneAPI rendering toolkit. Learn more via the OpenBenchmarking.org test page.

AVX512 OffAVX512 OnOpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.11Camera: 3 - Resolution: 1080p - Samples Per Pixel: 32 - Renderer: Path TracerCore i7 1065G7Core i7 1165G7Ryzen 7 7840U90K180K270K360K450KSE +/- 449.20, N = 3SE +/- 2472.90, N = 3SE +/- 2250.38, N = 3SE +/- 557.19, N = 3SE +/- 322.06, N = 3SE +/- 466.38, N = 34122312966751878533997162689821612581. (CXX) g++ options: -O3 -lm -ldl

oneDNN

This is a test of the Intel oneDNN as an Intel-optimized library for Deep Neural Networks and making use of its built-in benchdnn functionality. The result is the total perf time reported. Intel oneDNN was formerly known as DNNL (Deep Neural Network Library) and MKL-DNN before being rebranded as part of the Intel oneAPI toolkit. Learn more via the OpenBenchmarking.org test page.

AVX512 OffAVX512 OnOpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.1Harness: Recurrent Neural Network Training - Data Type: u8s8f32 - Engine: CPUCore i7 1065G7Core i7 1165G7Ryzen 7 7840U3K6K9K12K15KSE +/- 20.04, N = 3SE +/- 71.00, N = 3SE +/- 91.64, N = 15SE +/- 37.92, N = 3SE +/- 64.19, N = 15SE +/- 84.98, N = 1212996.509315.505003.2311513.907357.334354.171. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl

OSPRay

Intel OSPRay is a portable ray-tracing engine for high-performance, high-fidelity scientific visualizations. OSPRay builds off Intel's Embree and Intel SPMD Program Compiler (ISPC) components as part of the oneAPI rendering toolkit. Learn more via the OpenBenchmarking.org test page.

AVX512 OffAVX512 OnOpenBenchmarking.orgItems Per Second, More Is BetterOSPRay 2.12Benchmark: particle_volume/pathtracer/real_timeCore i7 1065G7Core i7 1165G7Ryzen 7 7840U20406080100SE +/- 0.43, N = 3SE +/- 1.06, N = 12SE +/- 0.14, N = 3SE +/- 0.13, N = 3SE +/- 0.88, N = 3SE +/- 0.25, N = 349.1176.0493.5256.0188.34101.81

OSPRay Studio

Intel OSPRay Studio is an open-source, interactive visualization and ray-tracing software package. OSPRay Studio makes use of Intel OSPRay, a portable ray-tracing engine for high-performance, high-fidelity visualizations. OSPRay builds off Intel's Embree and Intel SPMD Program Compiler (ISPC) components as part of the oneAPI rendering toolkit. Learn more via the OpenBenchmarking.org test page.

AVX512 OffAVX512 OnOpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.11Camera: 1 - Resolution: 1080p - Samples Per Pixel: 32 - Renderer: Path TracerCore i7 1065G7Core i7 1165G7Ryzen 7 7840U80K160K240K320K400KSE +/- 3658.24, N = 3SE +/- 192.36, N = 3SE +/- 922.16, N = 3SE +/- 1847.71, N = 3SE +/- 815.80, N = 3SE +/- 1719.79, N = 43552402436821477643353472195871385531. (CXX) g++ options: -O3 -lm -ldl

OpenVINO

This is a test of the Intel OpenVINO, a toolkit around neural networks, using its built-in benchmarking support and analyzing the throughput and latency for various models. Learn more via the OpenBenchmarking.org test page.

AVX512 OffAVX512 OnOpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.3Model: Face Detection FP16 - Device: CPUCore i7 1065G7Core i7 1165G7Ryzen 7 7840U13002600390052006500SE +/- 41.88, N = 9SE +/- 28.27, N = 14SE +/- 44.91, N = 15SE +/- 53.93, N = 15SE +/- 38.46, N = 3SE +/- 15.69, N = 126046.153943.842570.315677.943968.311143.201. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

AVX512 OffAVX512 OnOpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.3Model: Face Detection FP16 - Device: CPUCore i7 1065G7Core i7 1165G7Ryzen 7 7840U0.78751.5752.36253.153.9375SE +/- 0.01, N = 9SE +/- 0.01, N = 14SE +/- 0.03, N = 15SE +/- 0.01, N = 15SE +/- 0.01, N = 3SE +/- 0.05, N = 120.661.011.560.701.013.501. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

AVX512 OffAVX512 OnOpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.3Model: Person Detection FP16 - Device: CPUCore i7 1065G7Core i7 1165G7Ryzen 7 7840U2K4K6K8K10KSE +/- 88.24, N = 4SE +/- 101.01, N = 3SE +/- 43.35, N = 15SE +/- 65.76, N = 15SE +/- 58.12, N = 12SE +/- 36.55, N = 129570.626142.874390.079526.096290.162242.451. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

AVX512 OffAVX512 OnOpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.3Model: Person Detection FP16 - Device: CPUCore i7 1065G7Core i7 1165G7Ryzen 7 7840U0.40050.8011.20151.6022.0025SE +/- 0.01, N = 4SE +/- 0.01, N = 3SE +/- 0.01, N = 15SE +/- 0.00, N = 15SE +/- 0.01, N = 12SE +/- 0.03, N = 120.420.650.910.420.631.781. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

TensorFlow

This is a benchmark of the TensorFlow deep learning framework using the TensorFlow reference benchmarks (tensorflow/benchmarks with tf_cnn_benchmarks.py). Note with the Phoronix Test Suite there is also pts/tensorflow-lite for benchmarking the TensorFlow Lite binaries if desired for complementary metrics. Learn more via the OpenBenchmarking.org test page.

AVX512 OffAVX512 OnOpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.12Device: CPU - Batch Size: 16 - Model: ResNet-50Core i7 1065G7Core i7 1165G7Ryzen 7 7840U48121620SE +/- 0.02, N = 3SE +/- 0.02, N = 3SE +/- 0.00, N = 3SE +/- 0.03, N = 3SE +/- 0.09, N = 3SE +/- 0.08, N = 34.796.878.847.189.7416.44

AVX512 OffAVX512 OnOpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.12Device: CPU - Batch Size: 64 - Model: AlexNetCore i7 1065G7Core i7 1165G7Ryzen 7 7840U306090120150SE +/- 0.20, N = 3SE +/- 0.28, N = 3SE +/- 0.71, N = 5SE +/- 0.01, N = 3SE +/- 0.75, N = 15SE +/- 0.62, N = 332.1344.9164.7946.6564.56113.58

OpenVINO

This is a test of the Intel OpenVINO, a toolkit around neural networks, using its built-in benchmarking support and analyzing the throughput and latency for various models. Learn more via the OpenBenchmarking.org test page.

AVX512 OffAVX512 OnOpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.3Model: Weld Porosity Detection FP16-INT8 - Device: CPUCore i7 1065G7Core i7 1165G7Ryzen 7 7840U714212835SE +/- 0.44, N = 3SE +/- 0.23, N = 15SE +/- 0.18, N = 15SE +/- 0.14, N = 15SE +/- 0.10, N = 15SE +/- 0.08, N = 331.9422.2623.2015.2410.6512.491. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

AVX512 OffAVX512 OnOpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.3Model: Weld Porosity Detection FP16-INT8 - Device: CPUCore i7 1065G7Core i7 1165G7Ryzen 7 7840U140280420560700SE +/- 1.74, N = 3SE +/- 1.96, N = 15SE +/- 2.55, N = 15SE +/- 2.42, N = 15SE +/- 3.72, N = 15SE +/- 3.92, N = 3125.22179.81344.82262.38375.46639.051. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

OSPRay Studio

Intel OSPRay Studio is an open-source, interactive visualization and ray-tracing software package. OSPRay Studio makes use of Intel OSPRay, a portable ray-tracing engine for high-performance, high-fidelity visualizations. OSPRay builds off Intel's Embree and Intel SPMD Program Compiler (ISPC) components as part of the oneAPI rendering toolkit. Learn more via the OpenBenchmarking.org test page.

AVX512 OffAVX512 OnOpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.11Camera: 1 - Resolution: 1080p - Samples Per Pixel: 1 - Renderer: Path TracerCore i7 1065G7Core i7 1165G7Ryzen 7 7840U2K4K6K8K10KSE +/- 136.38, N = 3SE +/- 2.73, N = 3SE +/- 46.49, N = 3SE +/- 2.60, N = 3SE +/- 4.48, N = 3SE +/- 36.74, N = 12110727700445610304690641921. (CXX) g++ options: -O3 -lm -ldl

AVX512 OffAVX512 OnOpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.11Camera: 3 - Resolution: 1080p - Samples Per Pixel: 1 - Renderer: Path TracerCore i7 1065G7Core i7 1165G7Ryzen 7 7840U3K6K9K12K15KSE +/- 66.39, N = 3SE +/- 110.89, N = 12SE +/- 29.78, N = 3SE +/- 18.89, N = 3SE +/- 20.19, N = 3SE +/- 57.01, N = 3128439101570712342850750601. (CXX) g++ options: -O3 -lm -ldl

OpenVINO

This is a test of the Intel OpenVINO, a toolkit around neural networks, using its built-in benchmarking support and analyzing the throughput and latency for various models. Learn more via the OpenBenchmarking.org test page.

AVX512 OffAVX512 OnOpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.3Model: Age Gender Recognition Retail 0013 FP16 - Device: CPUCore i7 1065G7Core i7 1165G7Ryzen 7 7840U0.50631.01261.51892.02522.5315SE +/- 0.02, N = 4SE +/- 0.01, N = 15SE +/- 0.02, N = 5SE +/- 0.01, N = 15SE +/- 0.01, N = 15SE +/- 0.00, N = 32.251.591.652.011.420.771. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

AVX512 OffAVX512 OnOpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.3Model: Age Gender Recognition Retail 0013 FP16 - Device: CPUCore i7 1065G7Core i7 1165G7Ryzen 7 7840U2K4K6K8K10KSE +/- 18.92, N = 4SE +/- 22.56, N = 15SE +/- 49.53, N = 5SE +/- 14.06, N = 15SE +/- 24.76, N = 15SE +/- 23.21, N = 31756.762495.374781.191972.412780.4310275.451. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

AVX512 OffAVX512 OnOpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.3Model: Face Detection FP16-INT8 - Device: CPUCore i7 1065G7Core i7 1165G7Ryzen 7 7840U7001400210028003500SE +/- 39.71, N = 3SE +/- 17.25, N = 15SE +/- 9.28, N = 3SE +/- 20.45, N = 13SE +/- 10.52, N = 15SE +/- 0.78, N = 33229.192198.131252.111478.991021.78578.351. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

AVX512 OffAVX512 OnOpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.3Model: Face Detection FP16-INT8 - Device: CPUCore i7 1065G7Core i7 1165G7Ryzen 7 7840U246810SE +/- 0.01, N = 3SE +/- 0.01, N = 15SE +/- 0.02, N = 3SE +/- 0.04, N = 13SE +/- 0.04, N = 15SE +/- 0.01, N = 31.231.813.182.703.916.911. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

AVX512 OffAVX512 OnOpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.3Model: Person Detection FP32 - Device: CPUCore i7 1065G7Core i7 1165G7Ryzen 7 7840U2K4K6K8K10KSE +/- 114.44, N = 3SE +/- 45.70, N = 11SE +/- 16.00, N = 3SE +/- 79.32, N = 12SE +/- 47.81, N = 12SE +/- 21.58, N = 39721.506247.584387.559645.116318.672252.821. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

AVX512 OffAVX512 OnOpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.3Model: Person Detection FP32 - Device: CPUCore i7 1065G7Core i7 1165G7Ryzen 7 7840U0.39830.79661.19491.59321.9915SE +/- 0.01, N = 3SE +/- 0.00, N = 11SE +/- 0.00, N = 3SE +/- 0.00, N = 12SE +/- 0.01, N = 12SE +/- 0.02, N = 30.410.640.910.410.631.771. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

AVX512 OffAVX512 OnOpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.3Model: Vehicle Detection FP16-INT8 - Device: CPUCore i7 1065G7Core i7 1165G7Ryzen 7 7840U1122334455SE +/- 0.54, N = 4SE +/- 0.23, N = 14SE +/- 0.19, N = 3SE +/- 0.28, N = 5SE +/- 0.10, N = 14SE +/- 0.09, N = 1549.1533.5716.8426.9817.8211.101. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

AVX512 OffAVX512 OnOpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.3Model: Vehicle Detection FP16-INT8 - Device: CPUCore i7 1065G7Core i7 1165G7Ryzen 7 7840U80160240320400SE +/- 0.91, N = 4SE +/- 0.88, N = 14SE +/- 2.68, N = 3SE +/- 1.56, N = 5SE +/- 1.42, N = 14SE +/- 3.22, N = 1581.38119.16237.45148.18224.29359.971. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

TensorFlow

This is a benchmark of the TensorFlow deep learning framework using the TensorFlow reference benchmarks (tensorflow/benchmarks with tf_cnn_benchmarks.py). Note with the Phoronix Test Suite there is also pts/tensorflow-lite for benchmarking the TensorFlow Lite binaries if desired for complementary metrics. Learn more via the OpenBenchmarking.org test page.

AVX512 OffAVX512 OnOpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.12Device: CPU - Batch Size: 16 - Model: GoogLeNetCore i7 1065G7Core i7 1165G7Ryzen 7 7840U1224364860SE +/- 0.10, N = 3SE +/- 0.26, N = 3SE +/- 0.19, N = 11SE +/- 0.17, N = 8SE +/- 0.52, N = 15SE +/- 0.32, N = 312.2718.3825.7819.9228.6251.19

Embree

Intel Embree is a collection of high-performance ray-tracing kernels for execution on CPUs (and GPUs via SYCL) and supporting instruction sets such as SSE, AVX, AVX2, and AVX-512. Embree also supports making use of the Intel SPMD Program Compiler (ISPC). Learn more via the OpenBenchmarking.org test page.

AVX512 OffAVX512 OnOpenBenchmarking.orgFrames Per Second, More Is BetterEmbree 4.1Binary: Pathtracer ISPC - Model: Asian DragonCore i7 1065G7Core i7 1165G7Ryzen 7 7840U3691215SE +/- 0.0463, N = 3SE +/- 0.0607, N = 3SE +/- 0.0474, N = 3SE +/- 0.0069, N = 3SE +/- 0.0513, N = 15SE +/- 0.0930, N = 33.91245.63038.09174.13486.29759.9584

OpenVINO

This is a test of the Intel OpenVINO, a toolkit around neural networks, using its built-in benchmarking support and analyzing the throughput and latency for various models. Learn more via the OpenBenchmarking.org test page.

AVX512 OffAVX512 OnOpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.3Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPUCore i7 1065G7Core i7 1165G7Ryzen 7 7840U0.47030.94061.41091.88122.3515SE +/- 0.02, N = 4SE +/- 0.02, N = 15SE +/- 0.02, N = 3SE +/- 0.01, N = 15SE +/- 0.01, N = 15SE +/- 0.02, N = 32.091.411.491.861.261.271. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

AVX512 OffAVX512 OnOpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.3Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPUCore i7 1065G7Core i7 1165G7Ryzen 7 7840U13002600390052006500SE +/- 20.61, N = 4SE +/- 33.60, N = 15SE +/- 61.26, N = 3SE +/- 16.58, N = 15SE +/- 25.48, N = 15SE +/- 89.90, N = 31896.012804.435336.562126.633141.626240.041. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

oneDNN

This is a test of the Intel oneDNN as an Intel-optimized library for Deep Neural Networks and making use of its built-in benchdnn functionality. The result is the total perf time reported. Intel oneDNN was formerly known as DNNL (Deep Neural Network Library) and MKL-DNN before being rebranded as part of the Intel oneAPI toolkit. Learn more via the OpenBenchmarking.org test page.

AVX512 OffAVX512 OnOpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.1Harness: Recurrent Neural Network Inference - Data Type: u8s8f32 - Engine: CPUCore i7 1065G7Core i7 1165G7Ryzen 7 7840U14002800420056007000SE +/- 4.80, N = 3SE +/- 39.98, N = 8SE +/- 10.85, N = 3SE +/- 35.60, N = 3SE +/- 45.38, N = 15SE +/- 20.46, N = 36705.374765.102748.205863.573754.662371.621. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl

Embree

Intel Embree is a collection of high-performance ray-tracing kernels for execution on CPUs (and GPUs via SYCL) and supporting instruction sets such as SSE, AVX, AVX2, and AVX-512. Embree also supports making use of the Intel SPMD Program Compiler (ISPC). Learn more via the OpenBenchmarking.org test page.

AVX512 OffAVX512 OnOpenBenchmarking.orgFrames Per Second, More Is BetterEmbree 4.1Binary: Pathtracer ISPC - Model: CrownCore i7 1065G7Core i7 1165G7Ryzen 7 7840U246810SE +/- 0.0178, N = 3SE +/- 0.0485, N = 5SE +/- 0.0389, N = 3SE +/- 0.0015, N = 3SE +/- 0.0702, N = 3SE +/- 0.0891, N = 32.91814.36536.85563.20564.94487.9186

OSPRay

Intel OSPRay is a portable ray-tracing engine for high-performance, high-fidelity scientific visualizations. OSPRay builds off Intel's Embree and Intel SPMD Program Compiler (ISPC) components as part of the oneAPI rendering toolkit. Learn more via the OpenBenchmarking.org test page.

AVX512 OffAVX512 OnOpenBenchmarking.orgItems Per Second, More Is BetterOSPRay 2.12Benchmark: gravity_spheres_volume/dim_512/scivis/real_timeCore i7 1065G7Core i7 1165G7Ryzen 7 7840U0.44510.89021.33531.78042.2255SE +/- 0.000911, N = 3SE +/- 0.012585, N = 15SE +/- 0.003982, N = 3SE +/- 0.002072, N = 3SE +/- 0.020565, N = 15SE +/- 0.013755, N = 30.4889890.8333341.1372400.8283651.3972401.978140

miniBUDE

MiniBUDE is a mini application for the the core computation of the Bristol University Docking Engine (BUDE). This test profile currently makes use of the OpenMP implementation of miniBUDE for CPU benchmarking. Learn more via the OpenBenchmarking.org test page.

AVX512 OffAVX512 OnOpenBenchmarking.orgBillion Interactions/s, More Is BetterminiBUDE 20210901Implementation: OpenMP - Input Deck: BM1Core i7 1065G7Core i7 1165G7Ryzen 7 7840U48121620SE +/- 0.014, N = 3SE +/- 0.072, N = 3SE +/- 0.137, N = 3SE +/- 0.027, N = 3SE +/- 0.078, N = 4SE +/- 0.149, N = 33.5305.24711.6284.5466.46814.8841. (CC) gcc options: -std=c99 -Ofast -ffast-math -fopenmp -march=native -lm

AVX512 OffAVX512 OnOpenBenchmarking.orgGFInst/s, More Is BetterminiBUDE 20210901Implementation: OpenMP - Input Deck: BM1Core i7 1065G7Core i7 1165G7Ryzen 7 7840U80160240320400SE +/- 0.34, N = 3SE +/- 1.80, N = 3SE +/- 3.42, N = 3SE +/- 0.67, N = 3SE +/- 1.94, N = 4SE +/- 3.72, N = 388.25131.19290.70113.65161.71372.101. (CC) gcc options: -std=c99 -Ofast -ffast-math -fopenmp -march=native -lm

Embree

Intel Embree is a collection of high-performance ray-tracing kernels for execution on CPUs (and GPUs via SYCL) and supporting instruction sets such as SSE, AVX, AVX2, and AVX-512. Embree also supports making use of the Intel SPMD Program Compiler (ISPC). Learn more via the OpenBenchmarking.org test page.

AVX512 OffAVX512 OnOpenBenchmarking.orgFrames Per Second, More Is BetterEmbree 4.1Binary: Pathtracer ISPC - Model: Asian Dragon ObjCore i7 1065G7Core i7 1165G7Ryzen 7 7840U246810SE +/- 0.0383, N = 3SE +/- 0.0334, N = 3SE +/- 0.0412, N = 3SE +/- 0.0178, N = 3SE +/- 0.0350, N = 3SE +/- 0.1142, N = 33.42155.01787.23293.61065.51628.5595

OSPRay

Intel OSPRay is a portable ray-tracing engine for high-performance, high-fidelity scientific visualizations. OSPRay builds off Intel's Embree and Intel SPMD Program Compiler (ISPC) components as part of the oneAPI rendering toolkit. Learn more via the OpenBenchmarking.org test page.

AVX512 OffAVX512 OnOpenBenchmarking.orgItems Per Second, More Is BetterOSPRay 2.12Benchmark: gravity_spheres_volume/dim_512/ao/real_timeCore i7 1065G7Core i7 1165G7Ryzen 7 7840U0.44750.8951.34251.792.2375SE +/- 0.001192, N = 3SE +/- 0.012598, N = 15SE +/- 0.001291, N = 3SE +/- 0.001976, N = 3SE +/- 0.021513, N = 15SE +/- 0.013221, N = 30.5131350.8780801.1948700.8488881.4268201.988700

OpenVINO

This is a test of the Intel OpenVINO, a toolkit around neural networks, using its built-in benchmarking support and analyzing the throughput and latency for various models. Learn more via the OpenBenchmarking.org test page.

AVX512 OffAVX512 OnOpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.3Model: Weld Porosity Detection FP16 - Device: CPUCore i7 1065G7Core i7 1165G7Ryzen 7 7840U1428425670SE +/- 0.75, N = 4SE +/- 0.34, N = 13SE +/- 0.22, N = 3SE +/- 0.60, N = 5SE +/- 0.33, N = 13SE +/- 0.12, N = 363.8442.4023.4858.9739.7712.051. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

AVX512 OffAVX512 OnOpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.3Model: Weld Porosity Detection FP16 - Device: CPUCore i7 1065G7Core i7 1165G7Ryzen 7 7840U70140210280350SE +/- 0.76, N = 4SE +/- 0.83, N = 13SE +/- 1.57, N = 3SE +/- 0.72, N = 5SE +/- 0.90, N = 13SE +/- 3.20, N = 362.6694.36170.2067.83100.60331.311. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

OSPRay

Intel OSPRay is a portable ray-tracing engine for high-performance, high-fidelity scientific visualizations. OSPRay builds off Intel's Embree and Intel SPMD Program Compiler (ISPC) components as part of the oneAPI rendering toolkit. Learn more via the OpenBenchmarking.org test page.

AVX512 OffAVX512 OnOpenBenchmarking.orgItems Per Second, More Is BetterOSPRay 2.12Benchmark: gravity_spheres_volume/dim_512/pathtracer/real_timeCore i7 1065G7Core i7 1165G7Ryzen 7 7840U0.55571.11141.66712.22282.7785SE +/- 0.001991, N = 3SE +/- 0.018195, N = 15SE +/- 0.006749, N = 3SE +/- 0.005484, N = 3SE +/- 0.023168, N = 15SE +/- 0.015506, N = 30.7552111.2579601.9576401.0343601.6762102.469560

TensorFlow

This is a benchmark of the TensorFlow deep learning framework using the TensorFlow reference benchmarks (tensorflow/benchmarks with tf_cnn_benchmarks.py). Note with the Phoronix Test Suite there is also pts/tensorflow-lite for benchmarking the TensorFlow Lite binaries if desired for complementary metrics. Learn more via the OpenBenchmarking.org test page.

AVX512 OffAVX512 OnOpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.12Device: CPU - Batch Size: 16 - Model: AlexNetCore i7 1065G7Core i7 1165G7Ryzen 7 7840U20406080100SE +/- 0.24, N = 3SE +/- 0.57, N = 15SE +/- 0.03, N = 3SE +/- 0.38, N = 15SE +/- 1.39, N = 15SE +/- 0.18, N = 327.3236.8746.2138.4752.9777.65

OSPRay Studio

Intel OSPRay Studio is an open-source, interactive visualization and ray-tracing software package. OSPRay Studio makes use of Intel OSPRay, a portable ray-tracing engine for high-performance, high-fidelity visualizations. OSPRay builds off Intel's Embree and Intel SPMD Program Compiler (ISPC) components as part of the oneAPI rendering toolkit. Learn more via the OpenBenchmarking.org test page.

AVX512 OffAVX512 OnOpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.11Camera: 3 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path TracerCore i7 1065G7Core i7 1165G7Ryzen 7 7840U11K22K33K44K55KSE +/- 213.05, N = 3SE +/- 25.42, N = 3SE +/- 44.38, N = 3SE +/- 64.71, N = 3SE +/- 288.86, N = 3SE +/- 180.02, N = 35048635745224794882032189190641. (CXX) g++ options: -O3 -lm -ldl

AVX512 OffAVX512 OnOpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.11Camera: 1 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path TracerCore i7 1065G7Core i7 1165G7Ryzen 7 7840U9K18K27K36K45KSE +/- 189.84, N = 3SE +/- 75.26, N = 3SE +/- 66.23, N = 3SE +/- 121.29, N = 3SE +/- 354.53, N = 3SE +/- 185.50, N = 44216529470180884080726680165671. (CXX) g++ options: -O3 -lm -ldl

OpenVINO

This is a test of the Intel OpenVINO, a toolkit around neural networks, using its built-in benchmarking support and analyzing the throughput and latency for various models. Learn more via the OpenBenchmarking.org test page.

AVX512 OffAVX512 OnOpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.3Model: Vehicle Detection FP16 - Device: CPUCore i7 1065G7Core i7 1165G7Ryzen 7 7840U1632486480SE +/- 0.74, N = 4SE +/- 0.44, N = 5SE +/- 0.33, N = 15SE +/- 0.88, N = 3SE +/- 0.40, N = 3SE +/- 0.29, N = 366.3042.6330.5369.8549.1021.531. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

AVX512 OffAVX512 OnOpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.3Model: Vehicle Detection FP16 - Device: CPUCore i7 1065G7Core i7 1165G7Ryzen 7 7840U4080120160200SE +/- 0.69, N = 4SE +/- 0.98, N = 5SE +/- 1.48, N = 15SE +/- 0.73, N = 3SE +/- 0.67, N = 3SE +/- 2.58, N = 360.3393.81131.1357.2581.43185.721. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

Cpuminer-Opt

Cpuminer-Opt is a fork of cpuminer-multi that carries a wide range of CPU performance optimizations for measuring the potential cryptocurrency mining performance of the CPU/processor with a wide variety of cryptocurrencies. The benchmark reports the hash speed for the CPU mining performance for the selected cryptocurrency. Learn more via the OpenBenchmarking.org test page.

AVX512 OffAVX512 OnOpenBenchmarking.orgkH/s, More Is BetterCpuminer-Opt 3.20.3Algorithm: Blake-2 SCore i7 1065G7Core i7 1165G7Ryzen 7 7840U110K220K330K440K550KSE +/- 128.97, N = 3SE +/- 3240.30, N = 15SE +/- 2454.54, N = 15SE +/- 4676.57, N = 15SE +/- 7085.48, N = 15SE +/- 4566.14, N = 3999901505233159251928072822115314771. (CXX) g++ options: -O2 -lcurl -lz -lpthread -lssl -lcrypto -lgmp

AVX512 OffAVX512 OnOpenBenchmarking.orgkH/s, More Is BetterCpuminer-Opt 3.20.3Algorithm: x25xCore i7 1065G7Core i7 1165G7Ryzen 7 7840U80160240320400SE +/- 0.33, N = 3SE +/- 4.42, N = 15SE +/- 0.87, N = 3SE +/- 3.24, N = 15SE +/- 4.73, N = 15SE +/- 2.44, N = 3102.37156.60348.69118.90175.05374.951. (CXX) g++ options: -O2 -lcurl -lz -lpthread -lssl -lcrypto -lgmp

AVX512 OffAVX512 OnOpenBenchmarking.orgkH/s, More Is BetterCpuminer-Opt 3.20.3Algorithm: Myriad-GroestlCore i7 1065G7Core i7 1165G7Ryzen 7 7840U6K12K18K24K30KSE +/- 11.01, N = 3SE +/- 152.81, N = 15SE +/- 62.45, N = 3SE +/- 236.00, N = 15SE +/- 290.93, N = 15SE +/- 73.71, N = 33733.135364.3713910.008664.8212609.0026160.001. (CXX) g++ options: -O2 -lcurl -lz -lpthread -lssl -lcrypto -lgmp

AVX512 OffAVX512 OnOpenBenchmarking.orgkH/s, More Is BetterCpuminer-Opt 3.20.3Algorithm: GarlicoinCore i7 1065G7Core i7 1165G7Ryzen 7 7840U6001200180024003000SE +/- 1.36, N = 3SE +/- 29.55, N = 15SE +/- 17.03, N = 3SE +/- 35.57, N = 15SE +/- 36.88, N = 15SE +/- 15.25, N = 3717.471057.362009.381277.891822.772752.271. (CXX) g++ options: -O2 -lcurl -lz -lpthread -lssl -lcrypto -lgmp

AVX512 OffAVX512 OnOpenBenchmarking.orgkH/s, More Is BetterCpuminer-Opt 3.20.3Algorithm: SkeincoinCore i7 1065G7Core i7 1165G7Ryzen 7 7840U20K40K60K80K100KSE +/- 20.82, N = 3SE +/- 658.33, N = 15SE +/- 336.52, N = 3SE +/- 784.96, N = 15SE +/- 719.45, N = 15SE +/- 587.57, N = 31554022971639072446234161783001. (CXX) g++ options: -O2 -lcurl -lz -lpthread -lssl -lcrypto -lgmp

AVX512 OffAVX512 OnOpenBenchmarking.orgkH/s, More Is BetterCpuminer-Opt 3.20.3Algorithm: LBC, LBRY CreditsCore i7 1065G7Core i7 1165G7Ryzen 7 7840U9K18K27K36K45KSE +/- 27.56, N = 3SE +/- 230.96, N = 15SE +/- 83.27, N = 3SE +/- 314.90, N = 15SE +/- 524.03, N = 15SE +/- 327.43, N = 36023.368840.5022030.0016205.0024502.0043903.001. (CXX) g++ options: -O2 -lcurl -lz -lpthread -lssl -lcrypto -lgmp

OpenVINO

This is a test of the Intel OpenVINO, a toolkit around neural networks, using its built-in benchmarking support and analyzing the throughput and latency for various models. Learn more via the OpenBenchmarking.org test page.

AVX512 OffAVX512 OnOpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.3Model: Machine Translation EN To DE FP16 - Device: CPUCore i7 1065G7Core i7 1165G7Ryzen 7 7840U110220330440550SE +/- 7.04, N = 3SE +/- 3.01, N = 7SE +/- 1.31, N = 3SE +/- 4.31, N = 5SE +/- 2.39, N = 3SE +/- 0.99, N = 3510.12331.58233.17438.37302.21109.681. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

AVX512 OffAVX512 OnOpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.3Model: Machine Translation EN To DE FP16 - Device: CPUCore i7 1065G7Core i7 1165G7Ryzen 7 7840U816243240SE +/- 0.11, N = 3SE +/- 0.11, N = 7SE +/- 0.10, N = 3SE +/- 0.09, N = 5SE +/- 0.10, N = 3SE +/- 0.33, N = 37.8312.0517.139.1213.2236.461. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

AVX512 OffAVX512 OnOpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.3Model: Person Vehicle Bike Detection FP16 - Device: CPUCore i7 1065G7Core i7 1165G7Ryzen 7 7840U918273645SE +/- 0.44, N = 4SE +/- 0.27, N = 5SE +/- 0.07, N = 3SE +/- 0.53, N = 3SE +/- 0.07, N = 3SE +/- 0.11, N = 339.6926.9918.8339.1926.7011.881. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

AVX512 OffAVX512 OnOpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.3Model: Person Vehicle Bike Detection FP16 - Device: CPUCore i7 1065G7Core i7 1165G7Ryzen 7 7840U70140210280350SE +/- 1.15, N = 4SE +/- 1.50, N = 5SE +/- 0.75, N = 3SE +/- 1.41, N = 3SE +/- 0.41, N = 3SE +/- 3.29, N = 3100.73148.13212.15102.03149.67336.131. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

Cpuminer-Opt

Cpuminer-Opt is a fork of cpuminer-multi that carries a wide range of CPU performance optimizations for measuring the potential cryptocurrency mining performance of the CPU/processor with a wide variety of cryptocurrencies. The benchmark reports the hash speed for the CPU mining performance for the selected cryptocurrency. Learn more via the OpenBenchmarking.org test page.

AVX512 OffAVX512 OnOpenBenchmarking.orgkH/s, More Is BetterCpuminer-Opt 3.20.3Algorithm: scryptCore i7 1065G7Core i7 1165G7Ryzen 7 7840U4080120160200SE +/- 0.08, N = 3SE +/- 1.99, N = 15SE +/- 0.43, N = 3SE +/- 0.36, N = 3SE +/- 2.62, N = 15SE +/- 0.83, N = 343.0162.57128.0575.83132.79166.571. (CXX) g++ options: -O2 -lcurl -lz -lpthread -lssl -lcrypto -lgmp

AVX512 OffAVX512 OnOpenBenchmarking.orgkH/s, More Is BetterCpuminer-Opt 3.20.3Algorithm: Quad SHA-256, PyriteCore i7 1065G7Core i7 1165G7Ryzen 7 7840U20K40K60K80K100KSE +/- 82.12, N = 3SE +/- 620.71, N = 15SE +/- 69.60, N = 3SE +/- 78.60, N = 3SE +/- 1028.89, N = 15SE +/- 217.36, N = 31502721565585333340352603876271. (CXX) g++ options: -O2 -lcurl -lz -lpthread -lssl -lcrypto -lgmp

oneDNN

This is a test of the Intel oneDNN as an Intel-optimized library for Deep Neural Networks and making use of its built-in benchdnn functionality. The result is the total perf time reported. Intel oneDNN was formerly known as DNNL (Deep Neural Network Library) and MKL-DNN before being rebranded as part of the Intel oneAPI toolkit. Learn more via the OpenBenchmarking.org test page.

AVX512 OffAVX512 OnOpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.1Harness: Deconvolution Batch shapes_1d - Data Type: u8s8f32 - Engine: CPUCore i7 1065G7Core i7 1165G7Ryzen 7 7840U246810SE +/- 0.14867, N = 12SE +/- 0.06289, N = 3SE +/- 0.03232, N = 3SE +/- 0.03695, N = 15SE +/- 0.06304, N = 12SE +/- 0.01623, N = 38.533144.879152.869454.120712.481261.527071. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl

AVX512 OffAVX512 OnOpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.1Harness: IP Shapes 1D - Data Type: u8s8f32 - Engine: CPUCore i7 1065G7Core i7 1165G7Ryzen 7 7840U1.30432.60863.91295.21726.5215SE +/- 0.151107, N = 14SE +/- 0.129867, N = 12SE +/- 0.015865, N = 4SE +/- 0.106785, N = 15SE +/- 0.060765, N = 12SE +/- 0.005008, N = 45.7970403.5934201.6805803.2110801.8957800.9444321. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl

AVX512 OffAVX512 OnOpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.1Harness: Deconvolution Batch shapes_3d - Data Type: u8s8f32 - Engine: CPUCore i7 1065G7Core i7 1165G7Ryzen 7 7840U3691215SE +/- 0.20975, N = 15SE +/- 0.01583, N = 9SE +/- 0.03292, N = 15SE +/- 0.00826, N = 9SE +/- 0.00396, N = 9SE +/- 0.01465, N = 159.112955.740303.369983.155472.523681.616331. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl

CPU Temperature Monitor

AVX512 OffAVX512 OnOpenBenchmarking.orgCelsiusCPU Temperature MonitorPhoronix Test Suite System MonitoringCore i7 1065G7Core i7 1165G7Ryzen 7 7840U20406080100Min: 33 / Avg: 67.31 / Max: 100Min: 32 / Avg: 80.83 / Max: 100Min: 38.88 / Avg: 67.66 / Max: 92Min: 42 / Avg: 68.49 / Max: 100Min: 33 / Avg: 80.26 / Max: 100Min: 31.25 / Avg: 67.05 / Max: 92.13

CPU Power Consumption Monitor

AVX512 OffAVX512 OnOpenBenchmarking.orgWattsCPU Power Consumption MonitorPhoronix Test Suite System MonitoringCore i7 1065G7Core i7 1165G7Ryzen 7 7840U1530456075Min: 0.3 / Avg: 14.57 / Max: 46.78Min: 0.59 / Avg: 29.93 / Max: 75.77Min: 1.3 / Avg: 16.39 / Max: 30.21Min: 0.35 / Avg: 15.11 / Max: 46.04Min: 0.54 / Avg: 28.73 / Max: 63.65Min: 1.27 / Avg: 15.88 / Max: 30.82

CPU Peak Freq (Highest CPU Core Frequency) Monitor

AVX512 OffAVX512 OnOpenBenchmarking.orgMegahertzCPU Peak Freq (Highest CPU Core Frequency) MonitorPhoronix Test Suite System MonitoringCore i7 1065G7Core i7 1165G7Ryzen 7 7840U9001800270036004500Min: 1220 / Avg: 1946.81 / Max: 3908Min: 640 / Avg: 2932.06 / Max: 4745Min: 1114 / Avg: 2621.67 / Max: 5115Min: 1322 / Avg: 1935.69 / Max: 3910Min: 683 / Avg: 2950.53 / Max: 4707Min: 1397 / Avg: 2761.55 / Max: 5115

Geometric Mean Of All Test Results

AVX512 OffAVX512 OnOpenBenchmarking.orgGeometric Mean, More Is BetterGeometric Mean Of All Test ResultsResult Composite - Ryzen 7 7840U AMD Zen 4 AVX-512 AnalysisCore i7 1065G7Core i7 1165G7Ryzen 7 7840U36912153.0234.5107.2864.0656.04611.233

66 Results Shown

OSPRay Studio:
  3 - 4K - 32 - Path Tracer
  1 - 4K - 32 - Path Tracer
TensorFlow
OpenVKL
TensorFlow
libxsmm
OSPRay Studio
oneDNN
OSPRay
OSPRay Studio
OpenVINO:
  Face Detection FP16 - CPU:
    ms
    FPS
  Person Detection FP16 - CPU:
    ms
    FPS
TensorFlow:
  CPU - 16 - ResNet-50
  CPU - 64 - AlexNet
OpenVINO:
  Weld Porosity Detection FP16-INT8 - CPU:
    ms
    FPS
OSPRay Studio:
  1 - 1080p - 1 - Path Tracer
  3 - 1080p - 1 - Path Tracer
OpenVINO:
  Age Gender Recognition Retail 0013 FP16 - CPU:
    ms
    FPS
  Face Detection FP16-INT8 - CPU:
    ms
    FPS
  Person Detection FP32 - CPU:
    ms
    FPS
  Vehicle Detection FP16-INT8 - CPU:
    ms
    FPS
TensorFlow
Embree
OpenVINO:
  Age Gender Recognition Retail 0013 FP16-INT8 - CPU:
    ms
    FPS
oneDNN
Embree
OSPRay
miniBUDE:
  OpenMP - BM1:
    Billion Interactions/s
    GFInst/s
Embree
OSPRay
OpenVINO:
  Weld Porosity Detection FP16 - CPU:
    ms
    FPS
OSPRay
TensorFlow
OSPRay Studio:
  3 - 4K - 1 - Path Tracer
  1 - 4K - 1 - Path Tracer
OpenVINO:
  Vehicle Detection FP16 - CPU:
    ms
    FPS
Cpuminer-Opt:
  Blake-2 S
  x25x
  Myriad-Groestl
  Garlicoin
  Skeincoin
  LBC, LBRY Credits
OpenVINO:
  Machine Translation EN To DE FP16 - CPU:
    ms
    FPS
  Person Vehicle Bike Detection FP16 - CPU:
    ms
    FPS
Cpuminer-Opt:
  scrypt
  Quad SHA-256, Pyrite
oneDNN:
  Deconvolution Batch shapes_1d - u8s8f32 - CPU
  IP Shapes 1D - u8s8f32 - CPU
  Deconvolution Batch shapes_3d - u8s8f32 - CPU
CPU Temperature Monitor:
  Phoronix Test Suite System Monitoring:
    Celsius
    Watts
    Megahertz
  Result Composite - Ryzen 7 7840U AMD Zen 4 AVX-512 Analysis:
    Geometric Mean