AMD Ryzen 9 7950X / Ryzen 9 9950X AVX-512 Comparison

AMD Ryzen 9 7950X and Ryzen 9 9950X AVX-512 on/off comparison benchmarks by Michael Larabel for a future article.

Compare your own system(s) to this result file with the Phoronix Test Suite by running the command: phoronix-test-suite benchmark 2408145-NE-RYZEN999549
Jump To Table - Results

View

Do Not Show Noisy Results
Do Not Show Results With Incomplete Data
Do Not Show Results With Little Change/Spread
List Notable Results
Show Result Confidence Charts

Limit displaying results to tests within:

CPU Massive 5 Tests
Creator Workloads 6 Tests
HPC - High Performance Computing 12 Tests
Machine Learning 9 Tests
Molecular Dynamics 2 Tests
Multi-Core 8 Tests
NVIDIA GPU Compute 2 Tests
Intel oneAPI 6 Tests
Python Tests 5 Tests
Raytracing 2 Tests
Renderers 2 Tests
Scientific Computing 2 Tests
Server CPU Tests 3 Tests

Statistics

Show Overall Harmonic Mean(s)
Show Overall Geometric Mean
Show Geometric Means Per-Suite/Category
Show Wins / Losses Counts (Pie Chart)
Normalize Results
Remove Outliers Before Calculating Averages

Graph Settings

Force Line Graphs Where Applicable
Convert To Scalar Where Applicable
Disable Color Branding
Prefer Vertical Bar Graphs
No Box Plots
On Line Graphs With Missing Data, Connect The Line Gaps

Multi-Way Comparison

Condense Comparison
Transpose Comparison

Table

Show Detailed System Result Table

Run Management

Highlight
Result
Hide
Result
Result
Identifier
Performance Per
Dollar
Date
Run
  Test
  Duration
Ryzen 9 9950X: AVX-512 On
August 11
  5 Hours, 44 Minutes
Ryzen 9 9950X: AVX-512 Off
August 12
  5 Hours, 22 Minutes
Ryzen 9 7950X: AVX-512 On
August 12
  5 Hours, 35 Minutes
Ryzen 9 7950X: AVX-512 Off
August 12
  5 Hours, 39 Minutes
Invert Hiding All Results Option
  5 Hours, 35 Minutes

Only show results where is faster than
Only show results matching title/arguments (delimit multiple options with a comma):
Do not show results matching title/arguments (delimit multiple options with a comma):

Ryzen 9 9950X: AVX-512 On

Kernel Notes: Transparent Huge Pages: madvise
Compiler Notes: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-backtrace --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-defaulted --enable-offload-targets=nvptx-none=/build/gcc-13-uJ7kn6/gcc-13-13.2.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-13-uJ7kn6/gcc-13-13.2.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v
Processor Notes: Scaling Governor: amd-pstate-epp powersave (EPP: balance_performance) - CPU Microcode: 0xb40401a
Python Notes: Python 3.12.3
Security Notes: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + reg_file_data_sampling: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS; IBPB: conditional; STIBP: always-on; RSB filling; PBRSB-eIBRS: Not affected; BHI: Not affected + srbds: Not affected + tsx_async_abort: Not affected

Ryzen 9 9950X: AVX-512 Off

Processor: AMD Ryzen 9 9950X 16-Core @ 5.75GHz (16 Cores / 32 Threads), Motherboard: ASUS ROG STRIX X670E-E GAMING WIFI (2124 BIOS), Chipset: AMD Device 14d8, Memory: 2 x 16GB DDR5-6000MT/s G Skill F5-6000J3038F16G, Disk: 2000GB Corsair MP700 PRO, Graphics: AMD Radeon RX 7900 GRE 16GB, Audio: AMD Navi 31 HDMI/DP, Monitor: DELL U2723QE, Network: Intel I225-V + Intel Wi-Fi 6E

OS: Ubuntu 24.04, Kernel: 6.10.0-phx (x86_64), Desktop: GNOME Shell 46.0, Display Server: X Server + Wayland, OpenGL: 4.6 Mesa 24.2~git2406040600.8112d4~oibaf~n (git-8112d44 2024-06-04 noble-oibaf-ppa) (LLVM 17.0.6 DRM 3.57), Compiler: GCC 13.2.0, File-System: ext4, Screen Resolution: 3840x2160

Ryzen 9 7950X: AVX-512 On

Kernel Notes: Transparent Huge Pages: madvise
Compiler Notes: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-backtrace --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-defaulted --enable-offload-targets=nvptx-none=/build/gcc-13-uJ7kn6/gcc-13-13.2.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-13-uJ7kn6/gcc-13-13.2.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v
Processor Notes: Scaling Governor: amd-pstate-epp powersave (EPP: balance_performance) - CPU Microcode: 0xa601206
Python Notes: Python 3.12.3
Security Notes: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + reg_file_data_sampling: Not affected + retbleed: Not affected + spec_rstack_overflow: Mitigation of Safe RET + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS; IBPB: conditional; STIBP: always-on; RSB filling; PBRSB-eIBRS: Not affected; BHI: Not affected + srbds: Not affected + tsx_async_abort: Not affected

Ryzen 9 7950X: AVX-512 Off

Changed Processor to AMD Ryzen 9 7950X 16-Core @ 5.88GHz (16 Cores / 32 Threads).

AMD Ryzen 9 7950X / Ryzen 9 9950X AVX-512 ComparisonOpenBenchmarking.orgPhoronix Test SuiteAMD Ryzen 9 9950X 16-Core @ 5.75GHz (16 Cores / 32 Threads)AMD Ryzen 9 7950X 16-Core @ 5.88GHz (16 Cores / 32 Threads)ASUS ROG STRIX X670E-E GAMING WIFI (2124 BIOS)AMD Device 14d82 x 16GB DDR5-6000MT/s G Skill F5-6000J3038F16G2000GB Corsair MP700 PROAMD Radeon RX 7900 GRE 16GBAMD Navi 31 HDMI/DPDELL U2723QEIntel I225-V + Intel Wi-Fi 6EUbuntu 24.046.10.0-phx (x86_64)GNOME Shell 46.0X Server + Wayland4.6 Mesa 24.2~git2406040600.8112d4~oibaf~n (git-8112d44 2024-06-04 noble-oibaf-ppa) (LLVM 17.0.6 DRM 3.57)GCC 13.2.0ext43840x2160ProcessorsMotherboardChipsetMemoryDiskGraphicsAudioMonitorNetworkOSKernelDesktopDisplay ServerOpenGLCompilerFile-SystemScreen ResolutionAMD Ryzen 9 7950X / Ryzen 9 9950X AVX-512 Comparison BenchmarksSystem Logs- Transparent Huge Pages: madvise- --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-backtrace --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-defaulted --enable-offload-targets=nvptx-none=/build/gcc-13-uJ7kn6/gcc-13-13.2.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-13-uJ7kn6/gcc-13-13.2.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v - Ryzen 9 9950X: AVX-512 On: Scaling Governor: amd-pstate-epp powersave (EPP: balance_performance) - CPU Microcode: 0xb40401a- Ryzen 9 9950X: AVX-512 Off: Scaling Governor: amd-pstate-epp powersave (EPP: balance_performance) - CPU Microcode: 0xb40401a- Ryzen 9 7950X: AVX-512 On: Scaling Governor: amd-pstate-epp powersave (EPP: balance_performance) - CPU Microcode: 0xa601206- Ryzen 9 7950X: AVX-512 Off: Scaling Governor: amd-pstate-epp powersave (EPP: balance_performance) - CPU Microcode: 0xa601206- Python 3.12.3- Ryzen 9 9950X: AVX-512 On: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + reg_file_data_sampling: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS; IBPB: conditional; STIBP: always-on; RSB filling; PBRSB-eIBRS: Not affected; BHI: Not affected + srbds: Not affected + tsx_async_abort: Not affected - Ryzen 9 9950X: AVX-512 Off: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + reg_file_data_sampling: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS; IBPB: conditional; STIBP: always-on; RSB filling; PBRSB-eIBRS: Not affected; BHI: Not affected + srbds: Not affected + tsx_async_abort: Not affected - Ryzen 9 7950X: AVX-512 On: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + reg_file_data_sampling: Not affected + retbleed: Not affected + spec_rstack_overflow: Mitigation of Safe RET + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS; IBPB: conditional; STIBP: always-on; RSB filling; PBRSB-eIBRS: Not affected; BHI: Not affected + srbds: Not affected + tsx_async_abort: Not affected - Ryzen 9 7950X: AVX-512 Off: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + reg_file_data_sampling: Not affected + retbleed: Not affected + spec_rstack_overflow: Mitigation of Safe RET + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS; IBPB: conditional; STIBP: always-on; RSB filling; PBRSB-eIBRS: Not affected; BHI: Not affected + srbds: Not affected + tsx_async_abort: Not affected

openvino: Weld Porosity Detection FP16 - CPUopenvino: Weld Porosity Detection FP16 - CPUopenvino: Face Detection FP16 - CPUopenvino: Face Detection FP16 - CPUopenvino: Age Gender Recognition Retail 0013 FP16 - CPUopenvino: Age Gender Recognition Retail 0013 FP16 - CPUopenvino: Person Re-Identification Retail FP16 - CPUopenvino: Handwritten English Recognition FP16 - CPUopenvino: Handwritten English Recognition FP16 - CPUopenvino: Person Re-Identification Retail FP16 - CPUopenvino: Person Vehicle Bike Detection FP16 - CPUopenvino: Person Vehicle Bike Detection FP16 - CPUtensorflow: CPU - 64 - ResNet-50openvino: Face Detection Retail FP16 - CPUopenvino: Face Detection Retail FP16 - CPUnamd: ATPase with 327,506 Atomsnamd: STMV with 1,066,628 Atomsopenvino: Machine Translation EN To DE FP16 - CPUopenvino: Machine Translation EN To DE FP16 - CPUospray: gravity_spheres_volume/dim_512/scivis/real_timeospray: gravity_spheres_volume/dim_512/ao/real_timeonednn: IP Shapes 3D - CPUminibude: OpenMP - BM1minibude: OpenMP - BM1onednn: Deconvolution Batch shapes_3d - CPUonnx: ResNet50 v1-12-int8 - CPU - Standardopenvino: Vehicle Detection FP16 - CPUopenvino: Vehicle Detection FP16 - CPUonednn: IP Shapes 1D - CPUopenvino: Person Detection FP16 - CPUopenvino: Person Detection FP16 - CPUopenvino: Road Segmentation ADAS FP16-INT8 - CPUopenvino: Road Segmentation ADAS FP16-INT8 - CPUospray: gravity_spheres_volume/dim_512/pathtracer/real_timesimdjson: PartialTweetssimdjson: DistinctUserIDonednn: Recurrent Neural Network Training - CPUsimdjson: TopTweetonnx: super-resolution-10 - CPU - Standardonednn: Recurrent Neural Network Inference - CPUopenvino: Noise Suppression Poconet-Like FP16 - CPUopenvino: Noise Suppression Poconet-Like FP16 - CPUospray-studio: 1 - 4K - 1 - Path Tracer - CPUospray-studio: 1 - 4K - 16 - Path Tracer - CPUospray-studio: 1 - 4K - 32 - Path Tracer - CPUospray-studio: 3 - 4K - 1 - Path Tracer - CPUospray-studio: 3 - 4K - 32 - Path Tracer - CPUospray-studio: 3 - 4K - 16 - Path Tracer - CPUonednn: Deconvolution Batch shapes_1d - CPUsimdjson: Kostyalczero: Eigenopenvkl: vklBenchmarkCPU ISPCnumpy: onnx: CaffeNet 12-int8 - CPU - Standardonnx: fcn-resnet101-11 - CPU - Standardtensorflow: CPU - 1 - ResNet-50pytorch: CPU - 1 - ResNet-50embree: Pathtracer ISPC - Asian Dragonembree: Pathtracer ISPC - Asian Dragon Objpytorch: CPU - 64 - ResNet-50ospray: particle_volume/pathtracer/real_timesimdjson: LargeRandlczero: BLASembree: Pathtracer ISPC - Crowny-cruncher: 1Bmnn: resnet-v2-50gromacs: MPI CPU - water_GMX50_barey-cruncher: 500Monnx: ArcFace ResNet-100 - CPU - Standardxnnpack: QU8MobileNetV2xnnpack: QU8MobileNetV3Largeonnx: super-resolution-10 - CPU - Standardonnx: ResNet50 v1-12-int8 - CPU - Standardonnx: ArcFace ResNet-100 - CPU - Standardonnx: fcn-resnet101-11 - CPU - Standardonnx: CaffeNet 12-int8 - CPU - StandardRyzen 9 9950XRyzen 9 7950X AVX-512 On AVX-512 Off AVX-512 On AVX-512 Off6.822327.1823.29342.810.2555883.542.5916.56962.923027.683.722133.7651.741.534938.983.483380.9870745.10177.119.532779.727003.0753077.1901929.7531.36386571.4688.77908.960.664875109.2973.12638.6712.5011.030012.3813.05759.93412.95227.646404.6978.431867.603225540221057983829124596634761.788467.472207651054.92872.9404.8548816.8285.1441.351535.507157.89277.2802.0722036.651516.49010.0483.1357.57055.507878511544.392531.7494218.0181205.9801.1459523.57675.856.801168.940.7519062.587.6746.11346.431034.5410.06792.0338.993.922015.671.697570.48492102.8677.696.469206.706626.1672138.469961.7272.59761447.23815.29521.701.0585560.69131.60476.8816.749.083769.9910.441258.8010.33151.023635.73213.181201.733594599581177124235138397703642.411926.431626561010.59803.4423.6003212.9870.1439.532734.081447.05261.1561.9020534.627220.23011.3172.6699.07349.806585611776.621282.2354020.0769277.7511.2440010.971454.5214.33556.000.436493.603.8720.61775.122059.524.771667.9244.082.283357.783.058770.8258157.56138.797.937308.076463.1150853.1221328.0502.38830419.18610.02795.701.00661101.5178.75481.0416.589.179629.4710.281245.2810.48144.777629.5989.361680.424004676111316054735154740792712.753466.01177647794.79695.7313.5477516.2374.4634.711129.546950.23239.2971.8117133.766516.02910.8752.7407.69647.852580710946.906902.3849820.8958281.8671.4368223.67674.776.871158.010.8017640.847.6148.98326.301048.4910.08791.2619.733.942015.991.493540.42614104.1176.774.208254.442336.6029338.401960.0372.72463299.66916.50483.591.2119562.80127.26359.2622.226.357557.207.591303.167.64137.126664.15413.571166.245131852771668056020195460994752.802514.80142507731.83605.7713.4163612.2263.2331.037826.716943.87210.8501.5816828.782818.05712.6552.5928.39547.847387011307.292543.3363920.8995292.7071.65024OpenBenchmarking.org

OpenVINO

This is a test of the Intel OpenVINO, a toolkit around neural networks, using its built-in benchmarking support and analyzing the throughput and latency for various models. Learn more via the OpenBenchmarking.org test page.

Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Weld Porosity Detection FP16 - Device: CPUAVX-512 OnAVX-512 Off612182430SE +/- 0.00, N = 3SE +/- 0.02, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 36.8223.5710.9723.671. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2024.0CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OnAVX-512 Off10002000300040005000Min: 3619 / Avg: 4222.63 / Max: 5720Min: 600 / Avg: 4670.17 / Max: 5589Min: 545 / Avg: 4892.56 / Max: 5546Min: 545 / Avg: 4758.4 / Max: 5549
Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgWatts, Fewer Is BetterOpenVINO 2024.0CPU Power Consumption MonitorAVX-512 OnAVX-512 Off4080120160200Min: 29.11 / Avg: 177.79 / Max: 190.01Min: 18.98 / Avg: 187.87 / Max: 201.1Min: 21.13 / Avg: 214.35 / Max: 230.02Min: 21.26 / Avg: 208.13 / Max: 223.31
Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2024.0CPU Temperature MonitorAVX-512 OnAVX-512 Off20406080100Min: 49.25 / Avg: 76.56 / Max: 78.63Min: 47.5 / Avg: 80.7 / Max: 83Min: 48.5 / Avg: 89.3 / Max: 92Min: 49 / Avg: 88 / Max: 90.75

Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Weld Porosity Detection FP16 - Device: CPUAVX-512 OnAVX-512 Off5001000150020002500SE +/- 1.07, N = 3SE +/- 0.69, N = 3SE +/- 0.51, N = 3SE +/- 0.19, N = 32327.18675.851454.52674.771. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Face Detection FP16 - Device: CPUAVX-512 OnAVX-512 Off612182430SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 323.296.8014.336.871. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Face Detection FP16 - Device: CPUAVX-512 OnAVX-512 Off30060090012001500SE +/- 0.13, N = 3SE +/- 3.79, N = 3SE +/- 0.04, N = 3SE +/- 0.43, N = 3342.811168.94556.001158.011. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2024.0CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OnAVX-512 Off10002000300040005000Min: 3648 / Avg: 4276.15 / Max: 5255Min: 600 / Avg: 4685.27 / Max: 5524Min: 545 / Avg: 4961.4 / Max: 5501Min: 545 / Avg: 4818.54 / Max: 5346
Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgWatts, Fewer Is BetterOpenVINO 2024.0CPU Power Consumption MonitorAVX-512 OnAVX-512 Off4080120160200Min: 28.69 / Avg: 180.05 / Max: 196.04Min: 17.98 / Avg: 185.38 / Max: 201.59Min: 21.06 / Avg: 213.87 / Max: 233.38Min: 21.07 / Avg: 208.81 / Max: 228.13
Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2024.0CPU Temperature MonitorAVX-512 OnAVX-512 Off20406080100Min: 48.38 / Avg: 78.65 / Max: 83.5Min: 46.88 / Avg: 82.44 / Max: 92.5Min: 45.13 / Avg: 92.42 / Max: 96.13Min: 46.13 / Avg: 88.81 / Max: 92.88

Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Age Gender Recognition Retail 0013 FP16 - Device: CPUAVX-512 OnAVX-512 Off0.180.360.540.720.9SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 30.250.750.400.801. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2024.0CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OnAVX-512 Off10002000300040005000Min: 3662 / Avg: 4532.44 / Max: 5709Min: 600 / Avg: 4822.76 / Max: 5679Min: 545 / Avg: 5033.06 / Max: 5550Min: 545 / Avg: 4904.19 / Max: 5523
Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgWatts, Fewer Is BetterOpenVINO 2024.0CPU Power Consumption MonitorAVX-512 OnAVX-512 Off4080120160200Min: 26.84 / Avg: 186.88 / Max: 199.12Min: 19.02 / Avg: 188.25 / Max: 200.62Min: 21.34 / Avg: 217.98 / Max: 235.89Min: 21.27 / Avg: 214.52 / Max: 232.6
Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2024.0CPU Temperature MonitorAVX-512 OnAVX-512 Off20406080100Min: 48.5 / Avg: 78.1 / Max: 80Min: 47.5 / Avg: 81.3 / Max: 83.5Min: 48.38 / Avg: 88.97 / Max: 91.5Min: 48.75 / Avg: 91.54 / Max: 94.13

Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Age Gender Recognition Retail 0013 FP16 - Device: CPUAVX-512 OnAVX-512 Off12K24K36K48K60KSE +/- 40.07, N = 3SE +/- 18.06, N = 3SE +/- 34.76, N = 3SE +/- 30.09, N = 355883.5419062.5836493.6017640.841. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Person Re-Identification Retail FP16 - Device: CPUAVX-512 OnAVX-512 Off246810SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.01, N = 32.597.673.877.611. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2024.0CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OnAVX-512 Off10002000300040005000Min: 3624 / Avg: 4457.57 / Max: 5659Min: 600 / Avg: 4591.12 / Max: 5645Min: 545 / Avg: 4897.53 / Max: 5109Min: 545 / Avg: 4807.9 / Max: 5518
Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgWatts, Fewer Is BetterOpenVINO 2024.0CPU Power Consumption MonitorAVX-512 OnAVX-512 Off4080120160200Min: 28.73 / Avg: 183.35 / Max: 196.52Min: 18.23 / Avg: 187.35 / Max: 201.53Min: 20.92 / Avg: 214.29 / Max: 230.54Min: 21.45 / Avg: 205.35 / Max: 223.29
Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2024.0CPU Temperature MonitorAVX-512 OnAVX-512 Off20406080100Min: 49.38 / Avg: 79.38 / Max: 81.5Min: 48.13 / Avg: 80.05 / Max: 82.25Min: 48 / Avg: 89.9 / Max: 92.88Min: 49.63 / Avg: 86.84 / Max: 89.75

Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Handwritten English Recognition FP16 - Device: CPUAVX-512 OnAVX-512 Off1122334455SE +/- 0.02, N = 3SE +/- 0.04, N = 3SE +/- 0.13, N = 3SE +/- 0.09, N = 316.5646.1120.6148.981. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2024.0CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OnAVX-512 Off10002000300040005000Min: 3658 / Avg: 4575.96 / Max: 5722Min: 600 / Avg: 4522.72 / Max: 5049Min: 545 / Avg: 4957.66 / Max: 5275Min: 545 / Avg: 4837.77 / Max: 5172
Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgWatts, Fewer Is BetterOpenVINO 2024.0CPU Power Consumption MonitorAVX-512 OnAVX-512 Off4080120160200Min: 29.1 / Avg: 188.3 / Max: 201.46Min: 19 / Avg: 188.22 / Max: 200.96Min: 21.31 / Avg: 215.55 / Max: 236.59Min: 21.51 / Avg: 213.73 / Max: 232.37
Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2024.0CPU Temperature MonitorAVX-512 OnAVX-512 Off20406080100Min: 49.63 / Avg: 78.64 / Max: 80.5Min: 48.13 / Avg: 79.46 / Max: 81.5Min: 47.63 / Avg: 88.83 / Max: 93.13Min: 50 / Avg: 92.25 / Max: 95.88

Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Handwritten English Recognition FP16 - Device: CPUAVX-512 OnAVX-512 Off2004006008001000SE +/- 1.39, N = 3SE +/- 0.29, N = 3SE +/- 4.65, N = 3SE +/- 0.62, N = 3962.92346.43775.12326.301. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Person Re-Identification Retail FP16 - Device: CPUAVX-512 OnAVX-512 Off6001200180024003000SE +/- 2.87, N = 3SE +/- 0.29, N = 3SE +/- 1.23, N = 3SE +/- 1.51, N = 33027.681034.542059.521048.491. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Person Vehicle Bike Detection FP16 - Device: CPUAVX-512 OnAVX-512 Off3691215SE +/- 0.01, N = 3SE +/- 0.04, N = 3SE +/- 0.03, N = 3SE +/- 0.11, N = 33.7210.064.7710.081. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2024.0CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OnAVX-512 Off10002000300040005000Min: 3629 / Avg: 4679.02 / Max: 4858Min: 600 / Avg: 4855.6 / Max: 5651Min: 545 / Avg: 4927.98 / Max: 5499Min: 545 / Avg: 4870.81 / Max: 5552
Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgWatts, Fewer Is BetterOpenVINO 2024.0CPU Power Consumption MonitorAVX-512 OnAVX-512 Off4080120160200Min: 29.11 / Avg: 185.92 / Max: 200.72Min: 19 / Avg: 186.44 / Max: 200.8Min: 21.06 / Avg: 216.76 / Max: 236.74Min: 21.24 / Avg: 212.59 / Max: 236.49
Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2024.0CPU Temperature MonitorAVX-512 OnAVX-512 Off20406080100Min: 49.5 / Avg: 78.3 / Max: 80.13Min: 47.5 / Avg: 79.55 / Max: 82.13Min: 47.13 / Avg: 90.12 / Max: 93.25Min: 49 / Avg: 90.09 / Max: 93.75

Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Person Vehicle Bike Detection FP16 - Device: CPUAVX-512 OnAVX-512 Off5001000150020002500SE +/- 5.99, N = 3SE +/- 3.56, N = 3SE +/- 10.71, N = 3SE +/- 8.20, N = 32133.76792.031667.92791.261. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

TensorFlow

This is a benchmark of the TensorFlow deep learning framework using the TensorFlow reference benchmarks (tensorflow/benchmarks with tf_cnn_benchmarks.py). Note with the Phoronix Test Suite there is also pts/tensorflow-lite for benchmarking the TensorFlow Lite binaries if desired for complementary metrics. Learn more via the OpenBenchmarking.org test page.

Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.16.1Device: CPU - Batch Size: 64 - Model: ResNet-50AVX-512 OnAVX-512 Off1224364860SE +/- 0.04, N = 3SE +/- 0.02, N = 3SE +/- 0.02, N = 3SE +/- 0.02, N = 351.7438.9944.0819.73
Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgimages/sec Per Watt, More Is BetterTensorFlow 2.16.1Device: CPU - Batch Size: 64 - Model: ResNet-50AVX-512 OnAVX-512 Off0.07720.15440.23160.30880.3860.3430.2450.2620.125
Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgMegahertz, More Is BetterTensorFlow 2.16.1CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OnAVX-512 Off10002000300040005000Min: 3639 / Avg: 5195.43 / Max: 5730Min: 600 / Avg: 5150.31 / Max: 5668Min: 545 / Avg: 5191.38 / Max: 5475Min: 545 / Avg: 5230.72 / Max: 5502
Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgWatts, Fewer Is BetterTensorFlow 2.16.1CPU Power Consumption MonitorAVX-512 OnAVX-512 Off4080120160200Min: 29.46 / Avg: 151.01 / Max: 161.12Min: 19.23 / Avg: 159.46 / Max: 173.07Min: 20.93 / Avg: 167.98 / Max: 188.32Min: 21.55 / Avg: 157.54 / Max: 194.89
Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgCelsius, Fewer Is BetterTensorFlow 2.16.1CPU Temperature MonitorAVX-512 OnAVX-512 Off1530456075Min: 44.75 / Avg: 69.67 / Max: 72.38Min: 45 / Avg: 74.05 / Max: 76Min: 44.13 / Avg: 76.75 / Max: 78.88Min: 45.75 / Avg: 76.6 / Max: 78.75

OpenVINO

This is a test of the Intel OpenVINO, a toolkit around neural networks, using its built-in benchmarking support and analyzing the throughput and latency for various models. Learn more via the OpenBenchmarking.org test page.

Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Face Detection Retail FP16 - Device: CPUAVX-512 OnAVX-512 Off0.88651.7732.65953.5464.4325SE +/- 0.00, N = 3SE +/- 0.01, N = 3SE +/- 0.00, N = 3SE +/- 0.01, N = 31.533.922.283.941. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2024.0CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OnAVX-512 Off9001800270036004500Min: 3626 / Avg: 4501.67 / Max: 5467Min: 600 / Avg: 4615.93 / Max: 4941Min: 545 / Avg: 4939.13 / Max: 5140Min: 545 / Avg: 4764.59 / Max: 5011
Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgWatts, Fewer Is BetterOpenVINO 2024.0CPU Power Consumption MonitorAVX-512 OnAVX-512 Off4080120160200Min: 29.72 / Avg: 186.17 / Max: 199.95Min: 19.31 / Avg: 187.48 / Max: 201.01Min: 21.02 / Avg: 216.11 / Max: 232.91Min: 21.37 / Avg: 206.72 / Max: 223.05
Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2024.0CPU Temperature MonitorAVX-512 OnAVX-512 Off20406080100Min: 49.5 / Avg: 80.26 / Max: 82.5Min: 47.38 / Avg: 79.61 / Max: 81.75Min: 47.38 / Avg: 89.94 / Max: 93.13Min: 49.38 / Avg: 86.2 / Max: 88.5

Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Face Detection Retail FP16 - Device: CPUAVX-512 OnAVX-512 Off11002200330044005500SE +/- 7.46, N = 3SE +/- 7.10, N = 3SE +/- 2.51, N = 3SE +/- 4.63, N = 34938.982015.673357.782015.991. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

NAMD

Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgns/day, More Is BetterNAMD 3.0b6Input: ATPase with 327,506 AtomsAVX-512 OnAVX-512 Off0.78381.56762.35143.13523.919SE +/- 0.02808, N = 3SE +/- 0.01059, N = 3SE +/- 0.02678, N = 3SE +/- 0.00219, N = 33.483381.697573.058771.49354
Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgns/day Per Watt, More Is BetterNAMD 3.0b6Input: ATPase with 327,506 AtomsAVX-512 OnAVX-512 Off0.00740.01480.02220.02960.0370.0330.0130.0260.010
Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgMegahertz, More Is BetterNAMD 3.0b6CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OnAVX-512 Off10002000300040005000Min: 3655 / Avg: 5241.34 / Max: 5678Min: 600 / Avg: 4886.4 / Max: 5693Min: 545 / Avg: 5062.91 / Max: 5425Min: 545 / Avg: 4961.94 / Max: 5545
Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgWatts, Fewer Is BetterNAMD 3.0b6CPU Power Consumption MonitorAVX-512 OnAVX-512 Off4080120160200Min: 29.37 / Avg: 104.06 / Max: 200.84Min: 19.32 / Avg: 128.97 / Max: 201.35Min: 20.82 / Avg: 117.86 / Max: 227.29Min: 21.4 / Avg: 151.13 / Max: 232.97
Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgCelsius, Fewer Is BetterNAMD 3.0b6CPU Temperature MonitorAVX-512 OnAVX-512 Off20406080100Min: 48.5 / Avg: 77.84 / Max: 84.5Min: 45.25 / Avg: 76.08 / Max: 80.75Min: 47.5 / Avg: 78.51 / Max: 88.75Min: 48.38 / Avg: 85.29 / Max: 95.38

Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgns/day, More Is BetterNAMD 3.0b6Input: STMV with 1,066,628 AtomsAVX-512 OnAVX-512 Off0.22210.44420.66630.88841.1105SE +/- 0.00150, N = 3SE +/- 0.00040, N = 3SE +/- 0.00092, N = 3SE +/- 0.00052, N = 30.987070.484920.825810.42614
Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgns/day Per Watt, More Is BetterNAMD 3.0b6Input: STMV with 1,066,628 AtomsAVX-512 OnAVX-512 Off0.00160.00320.00480.00640.0080.0070.0030.0050.002
Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgMegahertz, More Is BetterNAMD 3.0b6CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OnAVX-512 Off10002000300040005000Min: 3619 / Avg: 5139.71 / Max: 5690Min: 600 / Avg: 4834.28 / Max: 5700Min: 545 / Avg: 5148.07 / Max: 5472Min: 545 / Avg: 5072.84 / Max: 5518
Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgWatts, Fewer Is BetterNAMD 3.0b6CPU Power Consumption MonitorAVX-512 OnAVX-512 Off4080120160200Min: 28.75 / Avg: 136.45 / Max: 191.04Min: 18.38 / Avg: 161.74 / Max: 198.27Min: 21.16 / Avg: 151.2 / Max: 213.58Min: 21.21 / Avg: 184.64 / Max: 225.35
Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgCelsius, Fewer Is BetterNAMD 3.0b6CPU Temperature MonitorAVX-512 OnAVX-512 Off20406080100Min: 47.5 / Avg: 79.22 / Max: 84.13Min: 45 / Avg: 77.56 / Max: 80.63Min: 46.25 / Avg: 82.12 / Max: 89.5Min: 47.88 / Avg: 89.47 / Max: 94.63

OpenVINO

This is a test of the Intel OpenVINO, a toolkit around neural networks, using its built-in benchmarking support and analyzing the throughput and latency for various models. Learn more via the OpenBenchmarking.org test page.

Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Machine Translation EN To DE FP16 - Device: CPUAVX-512 OnAVX-512 Off20406080100SE +/- 0.15, N = 3SE +/- 0.49, N = 3SE +/- 0.30, N = 3SE +/- 0.55, N = 345.10102.8657.56104.111. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2024.0CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OnAVX-512 Off10002000300040005000Min: 3615 / Avg: 4798.72 / Max: 5719Min: 600 / Avg: 4657.78 / Max: 5557Min: 545 / Avg: 5067.47 / Max: 5538Min: 545 / Avg: 4806.14 / Max: 5192
Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgWatts, Fewer Is BetterOpenVINO 2024.0CPU Power Consumption MonitorAVX-512 OnAVX-512 Off4080120160200Min: 29.34 / Avg: 170.11 / Max: 184.95Min: 19.1 / Avg: 186.38 / Max: 201.17Min: 21.01 / Avg: 201.12 / Max: 226.14Min: 21.23 / Avg: 205.67 / Max: 228.1
Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2024.0CPU Temperature MonitorAVX-512 OnAVX-512 Off20406080100Min: 49.25 / Avg: 75.84 / Max: 78.25Min: 47.63 / Avg: 80.61 / Max: 84.13Min: 47.13 / Avg: 84.61 / Max: 88.25Min: 48.88 / Avg: 89.75 / Max: 92.88

Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Machine Translation EN To DE FP16 - Device: CPUAVX-512 OnAVX-512 Off4080120160200SE +/- 0.57, N = 3SE +/- 0.38, N = 3SE +/- 0.72, N = 3SE +/- 0.41, N = 3177.1177.69138.7976.771. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OSPRay

Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgItems Per Second, More Is BetterOSPRay 3.2Benchmark: gravity_spheres_volume/dim_512/scivis/real_timeAVX-512 OnAVX-512 Off3691215SE +/- 0.01315, N = 3SE +/- 0.01723, N = 3SE +/- 0.00679, N = 3SE +/- 0.00671, N = 39.532776.469207.937304.20825
Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgItems Per Second Per Watt, More Is BetterOSPRay 3.2Benchmark: gravity_spheres_volume/dim_512/scivis/real_timeAVX-512 OnAVX-512 Off0.01170.02340.03510.04680.05850.0520.0360.0420.021
Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgMegahertz, More Is BetterOSPRay 3.2CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OnAVX-512 Off10002000300040005000Min: 3622 / Avg: 5022.93 / Max: 5718Min: 600 / Avg: 4824.55 / Max: 5609Min: 545 / Avg: 4999.96 / Max: 5543Min: 545 / Avg: 5049.67 / Max: 5450
Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgWatts, Fewer Is BetterOSPRay 3.2CPU Power Consumption MonitorAVX-512 OnAVX-512 Off4080120160200Min: 29.89 / Avg: 182.83 / Max: 201.18Min: 18.87 / Avg: 179.15 / Max: 203.39Min: 21.48 / Avg: 189.77 / Max: 222.64Min: 21.18 / Avg: 196.78 / Max: 221.85
Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgCelsius, Fewer Is BetterOSPRay 3.2CPU Temperature MonitorAVX-512 OnAVX-512 Off20406080100Min: 48.75 / Avg: 80 / Max: 83.25Min: 47 / Avg: 79.36 / Max: 83.25Min: 47.75 / Avg: 85.39 / Max: 88.38Min: 48.75 / Avg: 89.5 / Max: 92

Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgItems Per Second, More Is BetterOSPRay 3.2Benchmark: gravity_spheres_volume/dim_512/ao/real_timeAVX-512 OnAVX-512 Off3691215SE +/- 0.00263, N = 3SE +/- 0.00321, N = 3SE +/- 0.01996, N = 3SE +/- 0.00077, N = 39.727006.706628.076464.44233
Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgItems Per Second Per Watt, More Is BetterOSPRay 3.2Benchmark: gravity_spheres_volume/dim_512/ao/real_timeAVX-512 OnAVX-512 Off0.01190.02380.03570.04760.05950.0530.0370.0430.023
Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgMegahertz, More Is BetterOSPRay 3.2CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OnAVX-512 Off10002000300040005000Min: 3617 / Avg: 5033.79 / Max: 5719Min: 600 / Avg: 4956.77 / Max: 5701Min: 545 / Avg: 5020.2 / Max: 5404Min: 545 / Avg: 5009.68 / Max: 5461
Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgWatts, Fewer Is BetterOSPRay 3.2CPU Power Consumption MonitorAVX-512 OnAVX-512 Off4080120160200Min: 29.13 / Avg: 182.22 / Max: 204.79Min: 19.1 / Avg: 183.09 / Max: 201Min: 21.47 / Avg: 188.23 / Max: 216.92Min: 11.53 / Avg: 195.62 / Max: 221.08
Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgCelsius, Fewer Is BetterOSPRay 3.2CPU Temperature MonitorAVX-512 OnAVX-512 Off20406080100Min: 49.5 / Avg: 80.42 / Max: 85Min: 47.88 / Avg: 80.13 / Max: 86.63Min: 47.38 / Avg: 85.22 / Max: 88.25Min: 48.38 / Avg: 89.3 / Max: 91.88

oneDNN

This is a test of the Intel oneDNN as an Intel-optimized library for Deep Neural Networks and making use of its built-in benchdnn functionality. The result is the total perf time reported. Intel oneDNN was formerly known as DNNL (Deep Neural Network Library) and MKL-DNN before being rebranded as part of the Intel oneAPI toolkit. Learn more via the OpenBenchmarking.org test page.

Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.4Harness: IP Shapes 3D - Engine: CPUAVX-512 OnAVX-512 Off246810SE +/- 0.00113, N = 5SE +/- 0.00900, N = 5SE +/- 0.00401, N = 5SE +/- 0.00179, N = 53.075306.167213.115086.602931. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl
Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgMegahertz, More Is BetteroneDNN 3.4CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OnAVX-512 Off10002000300040005000Min: 2614 / Avg: 4961.5 / Max: 5697Min: 3620 / Avg: 5058.03 / Max: 5725Min: 545 / Avg: 4438.91 / Max: 5549Min: 545 / Avg: 4561.92 / Max: 5425
Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgWatts, Fewer Is BetteroneDNN 3.4CPU Power Consumption MonitorAVX-512 OnAVX-512 Off306090120150Min: 28.94 / Avg: 98.43 / Max: 137.57Min: 29.27 / Avg: 84.39 / Max: 136.23Min: 17.78 / Avg: 93.39 / Max: 137.81Min: 20.52 / Avg: 79.91 / Max: 150.55
Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgCelsius, Fewer Is BetteroneDNN 3.4CPU Temperature MonitorAVX-512 OnAVX-512 Off1428425670Min: 47.63 / Avg: 60.41 / Max: 69.75Min: 48.25 / Avg: 60.81 / Max: 67.88Min: 45.63 / Avg: 61.1 / Max: 71.63Min: 47.63 / Avg: 63.73 / Max: 70

miniBUDE

MiniBUDE is a mini application for the the core computation of the Bristol University Docking Engine (BUDE). This test profile currently makes use of the OpenMP implementation of miniBUDE for CPU benchmarking. Learn more via the OpenBenchmarking.org test page.

Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgBillion Interactions/s, More Is BetterminiBUDE 20210901Implementation: OpenMP - Input Deck: BM1AVX-512 OnAVX-512 Off20406080100SE +/- 0.06, N = 5SE +/- 0.02, N = 3SE +/- 0.00, N = 4SE +/- 0.33, N = 377.1938.4753.1238.401. (CC) gcc options: -std=c99 -Ofast -ffast-math -fopenmp -march=native -lm
Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgBillion Interactions/s Per Watt, More Is BetterminiBUDE 20210901Implementation: OpenMP - Input Deck: BM1AVX-512 OnAVX-512 Off0.11570.23140.34710.46280.57850.5140.2270.3160.199
Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgMegahertz, More Is BetterminiBUDE 20210901CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OnAVX-512 Off10002000300040005000Min: 3617 / Avg: 4629.52 / Max: 5709Min: 600 / Avg: 4520.91 / Max: 5559Min: 545 / Avg: 4648.16 / Max: 5304Min: 545 / Avg: 4524.89 / Max: 5125
Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgWatts, Fewer Is BetterminiBUDE 20210901CPU Power Consumption MonitorAVX-512 OnAVX-512 Off4080120160200Min: 28.89 / Avg: 150.07 / Max: 200.78Min: 18.77 / Avg: 169.1 / Max: 200.59Min: 21.09 / Avg: 168.06 / Max: 215.33Min: 20.85 / Avg: 192.49 / Max: 230.83
Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgCelsius, Fewer Is BetterminiBUDE 20210901CPU Temperature MonitorAVX-512 OnAVX-512 Off20406080100Min: 49.63 / Avg: 80.61 / Max: 86.75Min: 46.25 / Avg: 79.27 / Max: 83.75Min: 48.25 / Avg: 84.63 / Max: 90.63Min: 48.25 / Avg: 88.69 / Max: 94.5

Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgGFInst/s, More Is BetterminiBUDE 20210901Implementation: OpenMP - Input Deck: BM1AVX-512 OnAVX-512 Off400800120016002000SE +/- 1.54, N = 5SE +/- 0.52, N = 3SE +/- 0.05, N = 4SE +/- 8.36, N = 31929.75961.731328.05960.041. (CC) gcc options: -std=c99 -Ofast -ffast-math -fopenmp -march=native -lm

oneDNN

This is a test of the Intel oneDNN as an Intel-optimized library for Deep Neural Networks and making use of its built-in benchdnn functionality. The result is the total perf time reported. Intel oneDNN was formerly known as DNNL (Deep Neural Network Library) and MKL-DNN before being rebranded as part of the Intel oneAPI toolkit. Learn more via the OpenBenchmarking.org test page.

Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.4Harness: Deconvolution Batch shapes_3d - Engine: CPUAVX-512 OnAVX-512 Off0.6131.2261.8392.4523.065SE +/- 0.00309, N = 9SE +/- 0.01154, N = 9SE +/- 0.00055, N = 9SE +/- 0.00474, N = 91.363862.597612.388302.724631. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl
Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgMegahertz, More Is BetteroneDNN 3.4CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OnAVX-512 Off10002000300040005000Min: 3621 / Avg: 4383.27 / Max: 5514Min: 600 / Avg: 3343.02 / Max: 5158Min: 545 / Avg: 4318.22 / Max: 5548Min: 545 / Avg: 3837.94 / Max: 5352
Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgWatts, Fewer Is BetteroneDNN 3.4CPU Power Consumption MonitorAVX-512 OnAVX-512 Off4080120160200Min: 27.61 / Avg: 93.68 / Max: 183.48Min: 18.13 / Avg: 93.29 / Max: 197.76Min: 20.45 / Avg: 96.65 / Max: 217.27Min: 21.35 / Avg: 101.36 / Max: 226.09
Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgCelsius, Fewer Is BetteroneDNN 3.4CPU Temperature MonitorAVX-512 OnAVX-512 Off20406080100Min: 48.25 / Avg: 66.47 / Max: 74Min: 47.25 / Avg: 71.74 / Max: 81.13Min: 46.25 / Avg: 71.46 / Max: 81.88Min: 47.38 / Avg: 77.34 / Max: 89.25

ONNX Runtime

ONNX Runtime is developed by Microsoft and partners as a open-source, cross-platform, high performance machine learning inferencing and training accelerator. This test profile runs the ONNX Runtime with various models available from the ONNX Model Zoo. Learn more via the OpenBenchmarking.org test page.

Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.17Model: ResNet50 v1-12-int8 - Device: CPU - Executor: StandardAVX-512 OnAVX-512 Off120240360480600SE +/- 0.98, N = 3SE +/- 1.07, N = 3SE +/- 1.03, N = 3SE +/- 0.27, N = 3571.47447.24419.19299.671. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt
Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgInference Time Cost (ms), Fewer Is BetterONNX Runtime 1.17Model: ResNet50 v1-12-int8 - Device: CPU - Executor: StandardAVX-512 OnAVX-512 Off0.75071.50142.25213.00283.7535SE +/- 0.00302, N = 3SE +/- 0.00529, N = 3SE +/- 0.00598, N = 3SE +/- 0.00299, N = 31.749422.235402.384983.336391. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt
Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgMegahertz, More Is BetterONNX Runtime 1.17CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OnAVX-512 Off9001800270036004500Min: 3607 / Avg: 5024.13 / Max: 5179Min: 600 / Avg: 5016.9 / Max: 5363Min: 545 / Avg: 5000.84 / Max: 5247Min: 545 / Avg: 4981.61 / Max: 5173
Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgWatts, Fewer Is BetterONNX Runtime 1.17CPU Power Consumption MonitorAVX-512 OnAVX-512 Off4080120160200Min: 28.95 / Avg: 163.95 / Max: 178.76Min: 17.79 / Avg: 175.89 / Max: 188.7Min: 10.86 / Avg: 174.4 / Max: 187.51Min: 20.66 / Avg: 191.33 / Max: 207.44
Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgCelsius, Fewer Is BetterONNX Runtime 1.17CPU Temperature MonitorAVX-512 OnAVX-512 Off20406080100Min: 49.25 / Avg: 75.08 / Max: 77.38Min: 47.75 / Avg: 79.15 / Max: 81.13Min: 46.25 / Avg: 76.39 / Max: 78.5Min: 47.88 / Avg: 86.26 / Max: 88.75

OpenVINO

This is a test of the Intel OpenVINO, a toolkit around neural networks, using its built-in benchmarking support and analyzing the throughput and latency for various models. Learn more via the OpenBenchmarking.org test page.

Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Vehicle Detection FP16 - Device: CPUAVX-512 OnAVX-512 Off48121620SE +/- 0.01, N = 3SE +/- 0.07, N = 3SE +/- 0.08, N = 3SE +/- 0.05, N = 38.7715.2910.0216.501. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2024.0CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OnAVX-512 Off10002000300040005000Min: 3620 / Avg: 4943.47 / Max: 5429Min: 600 / Avg: 4809.34 / Max: 5681Min: 545 / Avg: 5007.83 / Max: 5500Min: 545 / Avg: 4994.54 / Max: 5520
Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgWatts, Fewer Is BetterOpenVINO 2024.0CPU Power Consumption MonitorAVX-512 OnAVX-512 Off4080120160200Min: 28.14 / Avg: 169.58 / Max: 195.86Min: 18.15 / Avg: 188.06 / Max: 200.9Min: 21.29 / Avg: 205.98 / Max: 230.48Min: 21.08 / Avg: 215.91 / Max: 235.64
Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2024.0CPU Temperature MonitorAVX-512 OnAVX-512 Off20406080100Min: 47.75 / Avg: 74.44 / Max: 78.5Min: 48 / Avg: 80.27 / Max: 82.5Min: 46.5 / Avg: 83.55 / Max: 86.75Min: 48.63 / Avg: 89.17 / Max: 92

Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Vehicle Detection FP16 - Device: CPUAVX-512 OnAVX-512 Off2004006008001000SE +/- 0.91, N = 3SE +/- 2.33, N = 3SE +/- 6.59, N = 3SE +/- 1.66, N = 3908.96521.70795.70483.591. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

oneDNN

This is a test of the Intel oneDNN as an Intel-optimized library for Deep Neural Networks and making use of its built-in benchdnn functionality. The result is the total perf time reported. Intel oneDNN was formerly known as DNNL (Deep Neural Network Library) and MKL-DNN before being rebranded as part of the Intel oneAPI toolkit. Learn more via the OpenBenchmarking.org test page.

Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.4Harness: IP Shapes 1D - Engine: CPUAVX-512 OnAVX-512 Off0.27270.54540.81811.09081.3635SE +/- 0.006767, N = 6SE +/- 0.002635, N = 4SE +/- 0.000816, N = 4SE +/- 0.000909, N = 40.6648751.0585501.0066101.2119501. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl
Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgMegahertz, More Is BetteroneDNN 3.4CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OnAVX-512 Off10002000300040005000Min: 3621 / Avg: 4728.01 / Max: 5723Min: 600 / Avg: 4385.57 / Max: 5439Min: 545 / Avg: 4550.45 / Max: 5225Min: 545 / Avg: 4505.34 / Max: 5114
Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgWatts, Fewer Is BetteroneDNN 3.4CPU Power Consumption MonitorAVX-512 OnAVX-512 Off4080120160200Min: 27.64 / Avg: 142.28 / Max: 200.23Min: 18.23 / Avg: 156.72 / Max: 200.79Min: 20.94 / Avg: 162.23 / Max: 230.81Min: 20.8 / Avg: 170.06 / Max: 226.44
Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgCelsius, Fewer Is BetteroneDNN 3.4CPU Temperature MonitorAVX-512 OnAVX-512 Off20406080100Min: 47.13 / Avg: 70.53 / Max: 78Min: 45.5 / Avg: 74.6 / Max: 80.38Min: 45.88 / Avg: 77.41 / Max: 86.88Min: 46.88 / Avg: 83.93 / Max: 91

OpenVINO

This is a test of the Intel OpenVINO, a toolkit around neural networks, using its built-in benchmarking support and analyzing the throughput and latency for various models. Learn more via the OpenBenchmarking.org test page.

Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Person Detection FP16 - Device: CPUAVX-512 OnAVX-512 Off20406080100SE +/- 0.34, N = 3SE +/- 0.20, N = 3SE +/- 1.04, N = 3SE +/- 0.10, N = 3109.2960.69101.5162.801. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Person Detection FP16 - Device: CPUAVX-512 OnAVX-512 Off306090120150SE +/- 0.22, N = 3SE +/- 0.43, N = 3SE +/- 0.82, N = 3SE +/- 0.21, N = 373.12131.6078.75127.261. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2024.0CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OnAVX-512 Off10002000300040005000Min: 3628 / Avg: 5070.15 / Max: 5643Min: 600 / Avg: 5067.69 / Max: 5631Min: 545 / Avg: 5040.57 / Max: 5300Min: 545 / Avg: 4936.56 / Max: 5536
Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgWatts, Fewer Is BetterOpenVINO 2024.0CPU Power Consumption MonitorAVX-512 OnAVX-512 Off4080120160200Min: 22.78 / Avg: 164.38 / Max: 188.55Min: 18.66 / Avg: 186.84 / Max: 201.2Min: 21.3 / Avg: 188.25 / Max: 207.15Min: 21.19 / Avg: 200.91 / Max: 219.71
Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2024.0CPU Temperature MonitorAVX-512 OnAVX-512 Off20406080100Min: 49.38 / Avg: 79.87 / Max: 84.75Min: 48.13 / Avg: 85.48 / Max: 88Min: 48.5 / Avg: 84.47 / Max: 87.38Min: 49.5 / Avg: 88.98 / Max: 91.5

Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Road Segmentation ADAS FP16-INT8 - Device: CPUAVX-512 OnAVX-512 Off140280420560700SE +/- 3.09, N = 3SE +/- 3.66, N = 3SE +/- 1.08, N = 3SE +/- 0.48, N = 3638.67476.88481.04359.261. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Road Segmentation ADAS FP16-INT8 - Device: CPUAVX-512 OnAVX-512 Off510152025SE +/- 0.06, N = 3SE +/- 0.13, N = 3SE +/- 0.04, N = 3SE +/- 0.03, N = 312.5016.7416.5822.221. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2024.0CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OnAVX-512 Off10002000300040005000Min: 3618 / Avg: 4859.56 / Max: 5647Min: 600 / Avg: 4858.7 / Max: 5447Min: 545 / Avg: 4964.93 / Max: 5217Min: 545 / Avg: 4937.24 / Max: 5181
Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgWatts, Fewer Is BetterOpenVINO 2024.0CPU Power Consumption MonitorAVX-512 OnAVX-512 Off4080120160200Min: 28.92 / Avg: 173.93 / Max: 193.75Min: 19.18 / Avg: 187.6 / Max: 201.03Min: 21.4 / Avg: 191.94 / Max: 211.11Min: 21.5 / Avg: 199.32 / Max: 219.67
Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2024.0CPU Temperature MonitorAVX-512 OnAVX-512 Off20406080100Min: 49.38 / Avg: 77.06 / Max: 79.38Min: 47.38 / Avg: 82.21 / Max: 84.63Min: 48.63 / Avg: 86.49 / Max: 89.13Min: 49.25 / Avg: 90.1 / Max: 93.13

OSPRay

Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgItems Per Second, More Is BetterOSPRay 3.2Benchmark: gravity_spheres_volume/dim_512/pathtracer/real_timeAVX-512 OnAVX-512 Off3691215SE +/- 0.00324, N = 3SE +/- 0.00447, N = 3SE +/- 0.01877, N = 3SE +/- 0.00125, N = 311.030009.083769.179626.35755
Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgItems Per Second Per Watt, More Is BetterOSPRay 3.2Benchmark: gravity_spheres_volume/dim_512/pathtracer/real_timeAVX-512 OnAVX-512 Off0.01370.02740.04110.05480.06850.0610.0500.0470.032
Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgMegahertz, More Is BetterOSPRay 3.2CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OnAVX-512 Off10002000300040005000Min: 3619 / Avg: 4902.23 / Max: 5635Min: 600 / Avg: 4748.25 / Max: 5727Min: 3600 / Avg: 5067.26 / Max: 5490Min: 545 / Avg: 4965.4 / Max: 5450
Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgWatts, Fewer Is BetterOSPRay 3.2CPU Power Consumption MonitorAVX-512 OnAVX-512 Off4080120160200Min: 29.65 / Avg: 180.79 / Max: 200.8Min: 18.95 / Avg: 181.7 / Max: 202.79Min: 21.1 / Avg: 194.63 / Max: 224.62Min: 21.16 / Avg: 198.83 / Max: 229.38
Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgCelsius, Fewer Is BetterOSPRay 3.2CPU Temperature MonitorAVX-512 OnAVX-512 Off20406080100Min: 48.25 / Avg: 79.03 / Max: 84.88Min: 45.25 / Avg: 78.75 / Max: 85Min: 47.5 / Avg: 86.77 / Max: 89.75Min: 49 / Avg: 90.47 / Max: 93.5

simdjson

Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgGB/s, More Is Bettersimdjson 3.10Throughput Test: PartialTweetsAVX-512 OnAVX-512 Off3691215SE +/- 0.12, N = 15SE +/- 0.08, N = 9SE +/- 0.02, N = 3SE +/- 0.07, N = 312.389.999.477.201. (CXX) g++ options: -O3 -lrt
Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgGB/s Per Watt, More Is Bettersimdjson 3.10Throughput Test: PartialTweetsAVX-512 OnAVX-512 Off0.05130.10260.15390.20520.25650.2280.1840.1600.124
Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgMegahertz, More Is Bettersimdjson 3.10CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OnAVX-512 Off10002000300040005000Min: 2477 / Avg: 5552.06 / Max: 5749Min: 600 / Avg: 5458.44 / Max: 5722Min: 545 / Avg: 5280.33 / Max: 5557Min: 545 / Avg: 5267.71 / Max: 5555
Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgWatts, Fewer Is Bettersimdjson 3.10CPU Power Consumption MonitorAVX-512 OnAVX-512 Off1224364860Min: 26.15 / Avg: 54.31 / Max: 61.05Min: 17.29 / Avg: 54.29 / Max: 58.14Min: 20.82 / Avg: 59.23 / Max: 62.08Min: 20.61 / Avg: 58.04 / Max: 61.36
Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgCelsius, Fewer Is Bettersimdjson 3.10CPU Temperature MonitorAVX-512 OnAVX-512 Off1326395265Min: 42 / Avg: 59.46 / Max: 65.38Min: 39.88 / Avg: 62.95 / Max: 65.25Min: 40.13 / Avg: 64.23 / Max: 67.5Min: 40.25 / Avg: 63.54 / Max: 68.38

Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgGB/s, More Is Bettersimdjson 3.10Throughput Test: DistinctUserIDAVX-512 OnAVX-512 Off3691215SE +/- 0.07, N = 3SE +/- 0.08, N = 3SE +/- 0.02, N = 3SE +/- 0.05, N = 313.0510.4410.287.591. (CXX) g++ options: -O3 -lrt
Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgGB/s Per Watt, More Is Bettersimdjson 3.10Throughput Test: DistinctUserIDAVX-512 OnAVX-512 Off0.05650.1130.16950.2260.28250.2510.1900.1740.130
Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgMegahertz, More Is Bettersimdjson 3.10CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OnAVX-512 Off10002000300040005000Min: 3634 / Avg: 5479.51 / Max: 5752Min: 600 / Avg: 5477.86 / Max: 5721Min: 545 / Avg: 5390.86 / Max: 5599Min: 545 / Avg: 5310.51 / Max: 5549
Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgWatts, Fewer Is Bettersimdjson 3.10CPU Power Consumption MonitorAVX-512 OnAVX-512 Off1224364860Min: 26.96 / Avg: 51.89 / Max: 55.93Min: 18.51 / Avg: 55.04 / Max: 57.72Min: 21.08 / Avg: 59.24 / Max: 62.18Min: 20.75 / Avg: 58.27 / Max: 61.59
Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgCelsius, Fewer Is Bettersimdjson 3.10CPU Temperature MonitorAVX-512 OnAVX-512 Off1326395265Min: 42.13 / Avg: 56.31 / Max: 58.88Min: 39.5 / Avg: 63.74 / Max: 65.13Min: 40.25 / Avg: 64.57 / Max: 66.25Min: 40.25 / Avg: 64.88 / Max: 69

oneDNN

This is a test of the Intel oneDNN as an Intel-optimized library for Deep Neural Networks and making use of its built-in benchdnn functionality. The result is the total perf time reported. Intel oneDNN was formerly known as DNNL (Deep Neural Network Library) and MKL-DNN before being rebranded as part of the Intel oneAPI toolkit. Learn more via the OpenBenchmarking.org test page.

Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.4Harness: Recurrent Neural Network Training - Engine: CPUAVX-512 OnAVX-512 Off30060090012001500SE +/- 1.13, N = 3SE +/- 0.50, N = 3SE +/- 0.97, N = 3SE +/- 0.80, N = 3759.931258.801245.281303.161. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl
Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgMegahertz, More Is BetteroneDNN 3.4CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OnAVX-512 Off10002000300040005000Min: 3620 / Avg: 4539.43 / Max: 5097Min: 600 / Avg: 4628.18 / Max: 5635Min: 545 / Avg: 4963.28 / Max: 5425Min: 545 / Avg: 4841.65 / Max: 5350
Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgWatts, Fewer Is BetteroneDNN 3.4CPU Power Consumption MonitorAVX-512 OnAVX-512 Off4080120160200Min: 28.27 / Avg: 178.02 / Max: 200.61Min: 19.21 / Avg: 189.56 / Max: 200.98Min: 20.62 / Avg: 212.31 / Max: 236.6Min: 21.31 / Avg: 212.56 / Max: 233.78
Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgCelsius, Fewer Is BetteroneDNN 3.4CPU Temperature MonitorAVX-512 OnAVX-512 Off20406080100Min: 46.25 / Avg: 75.44 / Max: 80.88Min: 44.75 / Avg: 78.58 / Max: 82.5Min: 44.63 / Avg: 85.98 / Max: 90.13Min: 46 / Avg: 89.79 / Max: 94.13

simdjson

Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgGB/s, More Is Bettersimdjson 3.10Throughput Test: TopTweetAVX-512 OnAVX-512 Off3691215SE +/- 0.14, N = 3SE +/- 0.02, N = 3SE +/- 0.09, N = 3SE +/- 0.01, N = 312.9510.3310.487.641. (CXX) g++ options: -O3 -lrt
Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgGB/s Per Watt, More Is Bettersimdjson 3.10Throughput Test: TopTweetAVX-512 OnAVX-512 Off0.05470.10940.16410.21880.27350.2430.1870.1760.130
Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgMegahertz, More Is Bettersimdjson 3.10CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OnAVX-512 Off10002000300040005000Min: 3633 / Avg: 5525.79 / Max: 5742Min: 600 / Avg: 5466.56 / Max: 5707Min: 545 / Avg: 5312.84 / Max: 5556Min: 545 / Avg: 5284.79 / Max: 5425
Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgWatts, Fewer Is Bettersimdjson 3.10CPU Power Consumption MonitorAVX-512 OnAVX-512 Off1326395265Min: 29.54 / Avg: 53.21 / Max: 65.86Min: 19.22 / Avg: 55.19 / Max: 58.35Min: 20.7 / Avg: 59.45 / Max: 63.58Min: 21.23 / Avg: 58.89 / Max: 61.76
Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgCelsius, Fewer Is Bettersimdjson 3.10CPU Temperature MonitorAVX-512 OnAVX-512 Off1326395265Min: 43.13 / Avg: 58.91 / Max: 62.75Min: 41.5 / Avg: 65.51 / Max: 66.75Min: 41 / Avg: 65.56 / Max: 67.38Min: 41.25 / Avg: 65.6 / Max: 66.63

ONNX Runtime

ONNX Runtime is developed by Microsoft and partners as a open-source, cross-platform, high performance machine learning inferencing and training accelerator. This test profile runs the ONNX Runtime with various models available from the ONNX Model Zoo. Learn more via the OpenBenchmarking.org test page.

Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.17Model: super-resolution-10 - Device: CPU - Executor: StandardAVX-512 OnAVX-512 Off50100150200250SE +/- 0.18, N = 3SE +/- 0.04, N = 3SE +/- 0.09, N = 3SE +/- 0.52, N = 3227.65151.02144.78137.131. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt
Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgInference Time Cost (ms), Fewer Is BetterONNX Runtime 1.17Model: super-resolution-10 - Device: CPU - Executor: StandardAVX-512 OnAVX-512 Off246810SE +/- 0.00355, N = 3SE +/- 0.00170, N = 3SE +/- 0.00447, N = 3SE +/- 0.02791, N = 34.392536.621286.906907.292541. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt
Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgMegahertz, More Is BetterONNX Runtime 1.17CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OnAVX-512 Off9001800270036004500Min: 3610 / Avg: 5029.56 / Max: 5141Min: 600 / Avg: 5073.02 / Max: 5287Min: 545 / Avg: 5134.93 / Max: 5300Min: 545 / Avg: 5077.08 / Max: 5250
Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgWatts, Fewer Is BetterONNX Runtime 1.17CPU Power Consumption MonitorAVX-512 OnAVX-512 Off306090120150Min: 27.98 / Avg: 148.17 / Max: 157.13Min: 18.59 / Avg: 152.68 / Max: 163.63Min: 20.96 / Avg: 143.14 / Max: 153.68Min: 19.82 / Avg: 145.08 / Max: 156.27
Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgCelsius, Fewer Is BetterONNX Runtime 1.17CPU Temperature MonitorAVX-512 OnAVX-512 Off20406080100Min: 49 / Avg: 86.06 / Max: 89Min: 47.25 / Avg: 91.67 / Max: 94.38Min: 46.5 / Avg: 84.82 / Max: 87.5Min: 47.88 / Avg: 89.65 / Max: 92.13

oneDNN

This is a test of the Intel oneDNN as an Intel-optimized library for Deep Neural Networks and making use of its built-in benchdnn functionality. The result is the total perf time reported. Intel oneDNN was formerly known as DNNL (Deep Neural Network Library) and MKL-DNN before being rebranded as part of the Intel oneAPI toolkit. Learn more via the OpenBenchmarking.org test page.

Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.4Harness: Recurrent Neural Network Inference - Engine: CPUAVX-512 OnAVX-512 Off140280420560700SE +/- 0.61, N = 3SE +/- 0.28, N = 3SE +/- 0.67, N = 3SE +/- 0.46, N = 3404.70635.73629.60664.151. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl
Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgMegahertz, More Is BetteroneDNN 3.4CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OnAVX-512 Off10002000300040005000Min: 3619 / Avg: 4486.43 / Max: 5076Min: 600 / Avg: 4697.52 / Max: 5620Min: 545 / Avg: 4915.41 / Max: 5250Min: 545 / Avg: 4798.17 / Max: 5325
Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgWatts, Fewer Is BetteroneDNN 3.4CPU Power Consumption MonitorAVX-512 OnAVX-512 Off4080120160200Min: 28.96 / Avg: 177.84 / Max: 200.21Min: 18.46 / Avg: 189.87 / Max: 200.99Min: 21.2 / Avg: 212.15 / Max: 235.91Min: 20.59 / Avg: 212.77 / Max: 230.06
Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgCelsius, Fewer Is BetteroneDNN 3.4CPU Temperature MonitorAVX-512 OnAVX-512 Off20406080100Min: 49.38 / Avg: 75.9 / Max: 81.13Min: 47.5 / Avg: 79.19 / Max: 82.5Min: 48.25 / Avg: 87.04 / Max: 90.38Min: 49.75 / Avg: 91.17 / Max: 94.38

OpenVINO

This is a test of the Intel OpenVINO, a toolkit around neural networks, using its built-in benchmarking support and analyzing the throughput and latency for various models. Learn more via the OpenBenchmarking.org test page.

Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Noise Suppression Poconet-Like FP16 - Device: CPUAVX-512 OnAVX-512 Off3691215SE +/- 0.02, N = 3SE +/- 0.03, N = 3SE +/- 0.02, N = 3SE +/- 0.03, N = 38.4313.189.3613.571. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2024.0CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OnAVX-512 Off10002000300040005000Min: 3619 / Avg: 4935.35 / Max: 5671Min: 600 / Avg: 4611.73 / Max: 5009Min: 545 / Avg: 4923.65 / Max: 5187Min: 545 / Avg: 4948.23 / Max: 5417
Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgWatts, Fewer Is BetterOpenVINO 2024.0CPU Power Consumption MonitorAVX-512 OnAVX-512 Off4080120160200Min: 28.92 / Avg: 170.83 / Max: 184.18Min: 19.27 / Avg: 180.53 / Max: 196.82Min: 20.76 / Avg: 207.81 / Max: 224.79Min: 21.38 / Avg: 219.56 / Max: 236.17
Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2024.0CPU Temperature MonitorAVX-512 OnAVX-512 Off20406080100Min: 49 / Avg: 71.65 / Max: 74Min: 47.38 / Avg: 76.32 / Max: 78.63Min: 48.25 / Avg: 85.15 / Max: 87.5Min: 49.38 / Avg: 92.91 / Max: 95.75

Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Noise Suppression Poconet-Like FP16 - Device: CPUAVX-512 OnAVX-512 Off400800120016002000SE +/- 3.92, N = 3SE +/- 2.28, N = 3SE +/- 2.92, N = 3SE +/- 2.29, N = 31867.601201.731680.421166.241. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OSPRay Studio

Intel OSPRay Studio is an open-source, interactive visualization and ray-tracing software package. OSPRay Studio makes use of Intel OSPRay, a portable ray-tracing engine for high-performance, high-fidelity visualizations. OSPRay builds off Intel's Embree and Intel SPMD Program Compiler (ISPC) components as part of the oneAPI rendering toolkit. Learn more via the OpenBenchmarking.org test page.

Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 1.0Camera: 1 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path Tracer - Acceleration: CPUAVX-512 OnAVX-512 Off11002200330044005500SE +/- 1.00, N = 3SE +/- 2.03, N = 3SE +/- 2.85, N = 3SE +/- 5.00, N = 33225359440045131
Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgMegahertz, More Is BetterOSPRay Studio 1.0CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OnAVX-512 Off10002000300040005000Min: 3632 / Avg: 4931.07 / Max: 5741Min: 600 / Avg: 4859.88 / Max: 5720Min: 545 / Avg: 5006.21 / Max: 5646Min: 545 / Avg: 5033.73 / Max: 5509
Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgWatts, Fewer Is BetterOSPRay Studio 1.0CPU Power Consumption MonitorAVX-512 OnAVX-512 Off4080120160200Min: 29.74 / Avg: 176.55 / Max: 201Min: 18.83 / Avg: 177.31 / Max: 201.19Min: 21.21 / Avg: 192.85 / Max: 231.42Min: 21.3 / Avg: 193.33 / Max: 233.46
Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgCelsius, Fewer Is BetterOSPRay Studio 1.0CPU Temperature MonitorAVX-512 OnAVX-512 Off20406080100Min: 49.38 / Avg: 77.7 / Max: 80.63Min: 47.5 / Avg: 77.14 / Max: 82.25Min: 48.13 / Avg: 85.97 / Max: 90.75Min: 49.75 / Avg: 88.22 / Max: 93.13

Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 1.0Camera: 1 - Resolution: 4K - Samples Per Pixel: 16 - Renderer: Path Tracer - Acceleration: CPUAVX-512 OnAVX-512 Off20K40K60K80K100KSE +/- 42.15, N = 3SE +/- 25.03, N = 3SE +/- 142.41, N = 3SE +/- 106.67, N = 354022599586761185277
Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgMegahertz, More Is BetterOSPRay Studio 1.0CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OnAVX-512 Off10002000300040005000Min: 3615 / Avg: 4941.53 / Max: 5717Min: 600 / Avg: 4858.36 / Max: 5683Min: 545 / Avg: 5007.43 / Max: 5700Min: 545 / Avg: 5000.76 / Max: 5514
Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgWatts, Fewer Is BetterOSPRay Studio 1.0CPU Power Consumption MonitorAVX-512 OnAVX-512 Off4080120160200Min: 29.36 / Avg: 171.05 / Max: 201.19Min: 19.03 / Avg: 173.62 / Max: 200.99Min: 21.34 / Avg: 192.87 / Max: 235.9Min: 21.38 / Avg: 197.76 / Max: 232.88
Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgCelsius, Fewer Is BetterOSPRay Studio 1.0CPU Temperature MonitorAVX-512 OnAVX-512 Off20406080100Min: 49.38 / Avg: 77.36 / Max: 83.75Min: 48 / Avg: 77.04 / Max: 83.13Min: 47.88 / Avg: 85.99 / Max: 91.13Min: 49 / Avg: 88.72 / Max: 93.5

Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 1.0Camera: 1 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path Tracer - Acceleration: CPUAVX-512 OnAVX-512 Off40K80K120K160K200KSE +/- 68.30, N = 3SE +/- 147.11, N = 3SE +/- 209.54, N = 3SE +/- 116.94, N = 3105798117712131605166805
Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgMegahertz, More Is BetterOSPRay Studio 1.0CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OnAVX-512 Off10002000300040005000Min: 3622 / Avg: 4927.48 / Max: 5735Min: 600 / Avg: 4850.5 / Max: 5720Min: 545 / Avg: 5080 / Max: 5675Min: 545 / Avg: 5075.26 / Max: 5477
Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgWatts, Fewer Is BetterOSPRay Studio 1.0CPU Power Consumption MonitorAVX-512 OnAVX-512 Off4080120160200Min: 28.98 / Avg: 184.04 / Max: 201.19Min: 17.96 / Avg: 185.11 / Max: 201.19Min: 21.45 / Avg: 207.59 / Max: 235.75Min: 21.11 / Avg: 209.25 / Max: 233.54
Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgCelsius, Fewer Is BetterOSPRay Studio 1.0CPU Temperature MonitorAVX-512 OnAVX-512 Off20406080100Min: 48.63 / Avg: 78.33 / Max: 80.63Min: 47.63 / Avg: 77.78 / Max: 82.25Min: 47.88 / Avg: 88.21 / Max: 91.5Min: 49 / Avg: 90.93 / Max: 93.88

Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 1.0Camera: 3 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path Tracer - Acceleration: CPUAVX-512 OnAVX-512 Off13002600390052006500SE +/- 1.53, N = 3SE +/- 4.33, N = 3SE +/- 10.17, N = 3SE +/- 9.87, N = 33829423547356020
Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgMegahertz, More Is BetterOSPRay Studio 1.0CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OnAVX-512 Off10002000300040005000Min: 3640 / Avg: 4952.48 / Max: 5730Min: 600 / Avg: 4870.49 / Max: 5718Min: 545 / Avg: 5051.96 / Max: 5700Min: 545 / Avg: 5066.47 / Max: 5548
Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgWatts, Fewer Is BetterOSPRay Studio 1.0CPU Power Consumption MonitorAVX-512 OnAVX-512 Off4080120160200Min: 30.13 / Avg: 177.71 / Max: 201.19Min: 18.31 / Avg: 177.49 / Max: 203.79Min: 21.33 / Avg: 194.3 / Max: 234.61Min: 21.43 / Avg: 192.96 / Max: 234.25
Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgCelsius, Fewer Is BetterOSPRay Studio 1.0CPU Temperature MonitorAVX-512 OnAVX-512 Off20406080100Min: 49.13 / Avg: 77.46 / Max: 80.5Min: 47.5 / Avg: 77.24 / Max: 82Min: 48 / Avg: 86.17 / Max: 91.38Min: 48.63 / Avg: 87.75 / Max: 92.75

Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 1.0Camera: 3 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path Tracer - Acceleration: CPUAVX-512 OnAVX-512 Off40K80K120K160K200KSE +/- 55.03, N = 3SE +/- 188.82, N = 3SE +/- 26.96, N = 3SE +/- 475.57, N = 3124596138397154740195460
Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgMegahertz, More Is BetterOSPRay Studio 1.0CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OnAVX-512 Off10002000300040005000Min: 3646 / Avg: 4922.13 / Max: 5722Min: 600 / Avg: 4875.24 / Max: 5692Min: 545 / Avg: 5081.87 / Max: 5700Min: 545 / Avg: 5052 / Max: 5548
Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgWatts, Fewer Is BetterOSPRay Studio 1.0CPU Power Consumption MonitorAVX-512 OnAVX-512 Off4080120160200Min: 29.54 / Avg: 186.24 / Max: 201.19Min: 18.85 / Avg: 186.98 / Max: 201Min: 21.2 / Avg: 209.83 / Max: 234.95Min: 21.2 / Avg: 210.75 / Max: 233.13
Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgCelsius, Fewer Is BetterOSPRay Studio 1.0CPU Temperature MonitorAVX-512 OnAVX-512 Off20406080100Min: 49.25 / Avg: 78.65 / Max: 81Min: 48.38 / Avg: 78.25 / Max: 83.63Min: 48 / Avg: 88.3 / Max: 91.38Min: 48.88 / Avg: 91.05 / Max: 93.75

Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 1.0Camera: 3 - Resolution: 4K - Samples Per Pixel: 16 - Renderer: Path Tracer - Acceleration: CPUAVX-512 OnAVX-512 Off20K40K60K80K100KSE +/- 49.41, N = 3SE +/- 36.23, N = 3SE +/- 199.04, N = 3SE +/- 91.66, N = 363476703647927199475
Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgMegahertz, More Is BetterOSPRay Studio 1.0CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OnAVX-512 Off10002000300040005000Min: 3634 / Avg: 4957.56 / Max: 5706Min: 600 / Avg: 4856.09 / Max: 5680Min: 545 / Avg: 5062.85 / Max: 5700Min: 545 / Avg: 5024.7 / Max: 5475
Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgWatts, Fewer Is BetterOSPRay Studio 1.0CPU Power Consumption MonitorAVX-512 OnAVX-512 Off4080120160200Min: 29.35 / Avg: 175.27 / Max: 201.2Min: 18.96 / Avg: 176.49 / Max: 200.99Min: 21.39 / Avg: 197.03 / Max: 234.02Min: 21.1 / Avg: 200.25 / Max: 232.96
Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgCelsius, Fewer Is BetterOSPRay Studio 1.0CPU Temperature MonitorAVX-512 OnAVX-512 Off20406080100Min: 49 / Avg: 77.75 / Max: 83.63Min: 48.38 / Avg: 77.28 / Max: 82.63Min: 48 / Avg: 86.28 / Max: 91.13Min: 49.13 / Avg: 89.21 / Max: 93.25

oneDNN

This is a test of the Intel oneDNN as an Intel-optimized library for Deep Neural Networks and making use of its built-in benchdnn functionality. The result is the total perf time reported. Intel oneDNN was formerly known as DNNL (Deep Neural Network Library) and MKL-DNN before being rebranded as part of the Intel oneAPI toolkit. Learn more via the OpenBenchmarking.org test page.

Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.4Harness: Deconvolution Batch shapes_1d - Engine: CPUAVX-512 OnAVX-512 Off0.63061.26121.89182.52243.153SE +/- 0.00399, N = 3SE +/- 0.00490, N = 3SE +/- 0.00663, N = 3SE +/- 0.00224, N = 31.788462.411922.753462.802511. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl
Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgMegahertz, More Is BetteroneDNN 3.4CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OnAVX-512 Off10002000300040005000Min: 3622 / Avg: 4719.61 / Max: 5619Min: 600 / Avg: 4536.93 / Max: 5617Min: 545 / Avg: 4783.54 / Max: 5499Min: 545 / Avg: 4789.28 / Max: 5474
Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgWatts, Fewer Is BetteroneDNN 3.4CPU Power Consumption MonitorAVX-512 OnAVX-512 Off4080120160200Min: 28.65 / Avg: 148.35 / Max: 200.8Min: 20.37 / Avg: 154.75 / Max: 200.8Min: 21.22 / Avg: 167.02 / Max: 233.85Min: 20.62 / Avg: 166.22 / Max: 233.55
Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgCelsius, Fewer Is BetteroneDNN 3.4CPU Temperature MonitorAVX-512 OnAVX-512 Off20406080100Min: 46 / Avg: 71.16 / Max: 78.63Min: 45.5 / Avg: 71.85 / Max: 79Min: 44.25 / Avg: 78.78 / Max: 87.88Min: 44.63 / Avg: 82.29 / Max: 94.5

simdjson

Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgGB/s, More Is Bettersimdjson 3.10Throughput Test: KostyaAVX-512 OnAVX-512 Off246810SE +/- 0.04, N = 3SE +/- 0.01, N = 3SE +/- 0.05, N = 3SE +/- 0.01, N = 37.476.436.014.801. (CXX) g++ options: -O3 -lrt
Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgGB/s Per Watt, More Is Bettersimdjson 3.10Throughput Test: KostyaAVX-512 OnAVX-512 Off0.03040.06080.09120.12160.1520.1350.1170.1020.082
Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgMegahertz, More Is Bettersimdjson 3.10CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OnAVX-512 Off10002000300040005000Min: 3584 / Avg: 5478.54 / Max: 5754Min: 600 / Avg: 5471.7 / Max: 5724Min: 545 / Avg: 5358.7 / Max: 5625Min: 545 / Avg: 5310.37 / Max: 5561
Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgWatts, Fewer Is Bettersimdjson 3.10CPU Power Consumption MonitorAVX-512 OnAVX-512 Off1224364860Min: 28.92 / Avg: 55.23 / Max: 60.68Min: 18.68 / Avg: 54.99 / Max: 59.23Min: 20.87 / Avg: 58.92 / Max: 61.56Min: 21.43 / Avg: 58.67 / Max: 61.26
Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgCelsius, Fewer Is Bettersimdjson 3.10CPU Temperature MonitorAVX-512 OnAVX-512 Off1428425670Min: 49.38 / Avg: 63.04 / Max: 72.63Min: 47.13 / Avg: 66.4 / Max: 72.25Min: 46.63 / Avg: 68.73 / Max: 70.63Min: 48.5 / Avg: 68.43 / Max: 71.75

LeelaChessZero

Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgNodes Per Second, More Is BetterLeelaChessZero 0.31.1Backend: EigenAVX-512 OnAVX-512 Off50100150200250SE +/- 1.76, N = 3SE +/- 1.53, N = 3SE +/- 2.03, N = 3SE +/- 1.67, N = 32201621771421. (CXX) g++ options: -flto -pthread
Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgNodes Per Second Per Watt, More Is BetterLeelaChessZero 0.31.1Backend: EigenAVX-512 OnAVX-512 Off0.26060.52120.78181.04241.3031.1580.8810.8700.695
Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgMegahertz, More Is BetterLeelaChessZero 0.31.1CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OnAVX-512 Off10002000300040005000Min: 3635 / Avg: 5194.42 / Max: 5596Min: 600 / Avg: 5097.43 / Max: 5689Min: 545 / Avg: 5144.02 / Max: 5450Min: 545 / Avg: 5098.97 / Max: 5467
Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgWatts, Fewer Is BetterLeelaChessZero 0.31.1CPU Power Consumption MonitorAVX-512 OnAVX-512 Off4080120160200Min: 28.09 / Avg: 189.91 / Max: 202.57Min: 18.56 / Avg: 183.79 / Max: 201.6Min: 21.05 / Avg: 203.56 / Max: 232.81Min: 21.25 / Avg: 204.24 / Max: 236.38
Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgCelsius, Fewer Is BetterLeelaChessZero 0.31.1CPU Temperature MonitorAVX-512 OnAVX-512 Off20406080100Min: 49.38 / Avg: 82.17 / Max: 89.13Min: 46.5 / Avg: 81.99 / Max: 88.5Min: 47.5 / Avg: 87.92 / Max: 89.75Min: 48.88 / Avg: 92.38 / Max: 94.75

OpenVKL

OpenVKL is the Intel Open Volume Kernel Library that offers high-performance volume computation kernels and part of the Intel oneAPI rendering toolkit. Learn more via the OpenBenchmarking.org test page.

Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgItems / Sec, More Is BetterOpenVKL 2.0.0Benchmark: vklBenchmarkCPU ISPCAVX-512 OnAVX-512 Off160320480640800SE +/- 0.33, N = 3SE +/- 0.33, N = 3SE +/- 0.33, N = 3SE +/- 0.33, N = 3765656647507
Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgItems / Sec Per Watt, More Is BetterOpenVKL 2.0.0Benchmark: vklBenchmarkCPU ISPCAVX-512 OnAVX-512 Off0.94431.88862.83293.77724.72154.1973.5853.5272.643
Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgMegahertz, More Is BetterOpenVKL 2.0.0CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OnAVX-512 Off10002000300040005000Min: 3574 / Avg: 5192.18 / Max: 5731Min: 600 / Avg: 5140.88 / Max: 5728Min: 545 / Avg: 5188.14 / Max: 5725Min: 545 / Avg: 5145.86 / Max: 5725
Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgWatts, Fewer Is BetterOpenVKL 2.0.0CPU Power Consumption MonitorAVX-512 OnAVX-512 Off4080120160200Min: 25.9 / Avg: 182.28 / Max: 201.39Min: 18.17 / Avg: 183 / Max: 203.18Min: 21 / Avg: 183.42 / Max: 236.07Min: 21.69 / Avg: 191.85 / Max: 232.58
Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgCelsius, Fewer Is BetterOpenVKL 2.0.0CPU Temperature MonitorAVX-512 OnAVX-512 Off20406080100Min: 41.5 / Avg: 78.25 / Max: 84.25Min: 40.13 / Avg: 77.61 / Max: 82.25Min: 47.38 / Avg: 83.05 / Max: 93.13Min: 47.38 / Avg: 86.97 / Max: 95.38

Numpy Benchmark

This is a test to obtain the general Numpy performance. Learn more via the OpenBenchmarking.org test page.

Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgScore, More Is BetterNumpy BenchmarkAVX-512 OnAVX-512 Off2004006008001000SE +/- 6.93, N = 3SE +/- 2.31, N = 3SE +/- 6.26, N = 3SE +/- 2.88, N = 31054.921010.59794.79731.83
Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgScore Per Watt, More Is BetterNumpy BenchmarkAVX-512 OnAVX-512 Off51015202519.6218.8513.6812.62
Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgMegahertz, More Is BetterNumpy BenchmarkCPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OnAVX-512 Off10002000300040005000Min: 2590 / Avg: 5507.31 / Max: 5753Min: 600 / Avg: 5459.26 / Max: 5728Min: 545 / Avg: 5348.24 / Max: 5700Min: 545 / Avg: 5274.11 / Max: 5548
Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgWatts, Fewer Is BetterNumpy BenchmarkCPU Power Consumption MonitorAVX-512 OnAVX-512 Off1326395265Min: 29.26 / Avg: 53.77 / Max: 61.61Min: 18.24 / Avg: 53.62 / Max: 59.46Min: 21.17 / Avg: 58.11 / Max: 65.09Min: 21.31 / Avg: 57.99 / Max: 64.98
Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgCelsius, Fewer Is BetterNumpy BenchmarkCPU Temperature MonitorAVX-512 OnAVX-512 Off1530456075Min: 49.38 / Avg: 65.66 / Max: 77.13Min: 48.5 / Avg: 70.04 / Max: 76.13Min: 48.25 / Avg: 69.49 / Max: 77.5Min: 49.38 / Avg: 69.14 / Max: 73.13

ONNX Runtime

ONNX Runtime is developed by Microsoft and partners as a open-source, cross-platform, high performance machine learning inferencing and training accelerator. This test profile runs the ONNX Runtime with various models available from the ONNX Model Zoo. Learn more via the OpenBenchmarking.org test page.

Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.17Model: CaffeNet 12-int8 - Device: CPU - Executor: StandardAVX-512 OnAVX-512 Off2004006008001000SE +/- 7.80, N = 15SE +/- 0.45, N = 3SE +/- 3.29, N = 3SE +/- 0.54, N = 3872.94803.44695.73605.771. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt
Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgInference Time Cost (ms), Fewer Is BetterONNX Runtime 1.17Model: CaffeNet 12-int8 - Device: CPU - Executor: StandardAVX-512 OnAVX-512 Off0.37130.74261.11391.48521.8565SE +/- 0.01010, N = 15SE +/- 0.00071, N = 3SE +/- 0.00680, N = 3SE +/- 0.00147, N = 31.145951.244001.436821.650241. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt
Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgMegahertz, More Is BetterONNX Runtime 1.17CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OnAVX-512 Off10002000300040005000Min: 2506 / Avg: 5329.13 / Max: 5514Min: 600 / Avg: 5195.91 / Max: 5469Min: 545 / Avg: 5015.46 / Max: 5551Min: 545 / Avg: 5048.44 / Max: 5268
Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgWatts, Fewer Is BetterONNX Runtime 1.17CPU Power Consumption MonitorAVX-512 OnAVX-512 Off306090120150Min: 28.12 / Avg: 170.82 / Max: 187.78Min: 19.21 / Avg: 171.96 / Max: 185.49Min: 20.97 / Avg: 141.69 / Max: 152.37Min: 21.22 / Avg: 156.32 / Max: 167.86
Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgCelsius, Fewer Is BetterONNX Runtime 1.17CPU Temperature MonitorAVX-512 OnAVX-512 Off1530456075Min: 47.5 / Avg: 72.56 / Max: 75.75Min: 48.25 / Avg: 72.67 / Max: 75.25Min: 48.25 / Avg: 66.48 / Max: 68Min: 49.25 / Avg: 72.2 / Max: 74

Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.17Model: fcn-resnet101-11 - Device: CPU - Executor: StandardAVX-512 OnAVX-512 Off1.09232.18463.27694.36925.4615SE +/- 0.01446, N = 3SE +/- 0.00187, N = 3SE +/- 0.00354, N = 3SE +/- 0.00295, N = 34.854883.600323.547753.416361. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt
Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgInference Time Cost (ms), Fewer Is BetterONNX Runtime 1.17Model: fcn-resnet101-11 - Device: CPU - Executor: StandardAVX-512 OnAVX-512 Off60120180240300SE +/- 0.61, N = 3SE +/- 0.14, N = 3SE +/- 0.28, N = 3SE +/- 0.25, N = 3205.98277.75281.87292.711. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt
Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgMegahertz, More Is BetterONNX Runtime 1.17CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OnAVX-512 Off10002000300040005000Min: 3615 / Avg: 4701.21 / Max: 5705Min: 600 / Avg: 4723.63 / Max: 5485Min: 545 / Avg: 5056.11 / Max: 5290Min: 545 / Avg: 4728.96 / Max: 5172
Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgWatts, Fewer Is BetterONNX Runtime 1.17CPU Power Consumption MonitorAVX-512 OnAVX-512 Off4080120160200Min: 28.88 / Avg: 162.69 / Max: 174.94Min: 18.46 / Avg: 188.17 / Max: 201.12Min: 20.95 / Avg: 201.58 / Max: 222.02Min: 21.56 / Avg: 209.92 / Max: 228.59
Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgCelsius, Fewer Is BetterONNX Runtime 1.17CPU Temperature MonitorAVX-512 OnAVX-512 Off20406080100Min: 49.75 / Avg: 74.3 / Max: 76.13Min: 48.38 / Avg: 82.11 / Max: 84Min: 46.25 / Avg: 86.52 / Max: 89Min: 47.63 / Avg: 88.67 / Max: 91.38

TensorFlow

This is a benchmark of the TensorFlow deep learning framework using the TensorFlow reference benchmarks (tensorflow/benchmarks with tf_cnn_benchmarks.py). Note with the Phoronix Test Suite there is also pts/tensorflow-lite for benchmarking the TensorFlow Lite binaries if desired for complementary metrics. Learn more via the OpenBenchmarking.org test page.

Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.16.1Device: CPU - Batch Size: 1 - Model: ResNet-50AVX-512 OnAVX-512 Off48121620SE +/- 0.04, N = 5SE +/- 0.01, N = 5SE +/- 0.03, N = 5SE +/- 0.02, N = 416.8212.9816.2312.22
Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgimages/sec Per Watt, More Is BetterTensorFlow 2.16.1Device: CPU - Batch Size: 1 - Model: ResNet-50AVX-512 OnAVX-512 Off0.05330.10660.15990.21320.26650.2370.1330.1750.118
Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgMegahertz, More Is BetterTensorFlow 2.16.1CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OnAVX-512 Off10002000300040005000Min: 3625 / Avg: 4609.22 / Max: 5717Min: 600 / Avg: 4507.81 / Max: 5719Min: 545 / Avg: 4675.91 / Max: 5425Min: 545 / Avg: 4592.95 / Max: 5547
Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgWatts, Fewer Is BetterTensorFlow 2.16.1CPU Power Consumption MonitorAVX-512 OnAVX-512 Off306090120150Min: 28.31 / Avg: 70.9 / Max: 159.43Min: 19.03 / Avg: 97.93 / Max: 147.97Min: 20.57 / Avg: 92.6 / Max: 150.83Min: 18.1 / Avg: 103.76 / Max: 155.98
Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgCelsius, Fewer Is BetterTensorFlow 2.16.1CPU Temperature MonitorAVX-512 OnAVX-512 Off1428425670Min: 46.63 / Avg: 57.17 / Max: 65Min: 47.38 / Avg: 62.7 / Max: 70.5Min: 45.63 / Avg: 60.43 / Max: 67.5Min: 47.13 / Avg: 64.33 / Max: 68.75

PyTorch

This is a benchmark of PyTorch making use of pytorch-benchmark [https://github.com/LukasHedegaard/pytorch-benchmark]. Learn more via the OpenBenchmarking.org test page.

Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgbatches/sec, More Is BetterPyTorch 2.2.1Device: CPU - Batch Size: 1 - Model: ResNet-50AVX-512 OnAVX-512 Off20406080100SE +/- 0.88, N = 4SE +/- 0.81, N = 4SE +/- 0.54, N = 3SE +/- 0.33, N = 385.1470.1474.4663.23
Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgbatches/sec Per Watt, More Is BetterPyTorch 2.2.1Device: CPU - Batch Size: 1 - Model: ResNet-50AVX-512 OnAVX-512 Off0.18020.36040.54060.72080.9010.8010.5530.6840.535
Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgMegahertz, More Is BetterPyTorch 2.2.1CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OnAVX-512 Off10002000300040005000Min: 3617 / Avg: 5126.44 / Max: 5724Min: 600 / Avg: 5082.69 / Max: 5674Min: 545 / Avg: 4812.05 / Max: 5500Min: 545 / Avg: 5098.84 / Max: 5525
Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgWatts, Fewer Is BetterPyTorch 2.2.1CPU Power Consumption MonitorAVX-512 OnAVX-512 Off306090120150Min: 28.31 / Avg: 106.25 / Max: 140.63Min: 19.07 / Avg: 126.9 / Max: 167.61Min: 20.71 / Avg: 108.88 / Max: 143.73Min: 20.24 / Avg: 118.1 / Max: 152.49
Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgCelsius, Fewer Is BetterPyTorch 2.2.1CPU Temperature MonitorAVX-512 OnAVX-512 Off1428425670Min: 48.13 / Avg: 61.59 / Max: 70.88Min: 43.38 / Avg: 64.37 / Max: 70.5Min: 45.75 / Avg: 60.87 / Max: 68.88Min: 46.5 / Avg: 62.49 / Max: 67.75

Embree

Intel Embree is a collection of high-performance ray-tracing kernels for execution on CPUs (and GPUs via SYCL) and supporting instruction sets such as SSE, AVX, AVX2, and AVX-512. Embree also supports making use of the Intel SPMD Program Compiler (ISPC). Learn more via the OpenBenchmarking.org test page.

Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgFrames Per Second, More Is BetterEmbree 4.3Binary: Pathtracer ISPC - Model: Asian DragonAVX-512 OnAVX-512 Off918273645SE +/- 0.01, N = 3SE +/- 0.05, N = 3SE +/- 0.03, N = 3SE +/- 0.01, N = 341.3539.5334.7131.04
Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgFrames Per Second Per Watt, More Is BetterEmbree 4.3Binary: Pathtracer ISPC - Model: Asian DragonAVX-512 OnAVX-512 Off0.05560.11120.16680.22240.2780.2470.2390.1960.164
Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgMegahertz, More Is BetterEmbree 4.3CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OnAVX-512 Off10002000300040005000Min: 3635 / Avg: 5020.42 / Max: 5374Min: 600 / Avg: 4830.59 / Max: 5346Min: 545 / Avg: 4954.57 / Max: 5550Min: 545 / Avg: 4840.28 / Max: 5223
Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgWatts, Fewer Is BetterEmbree 4.3CPU Power Consumption MonitorAVX-512 OnAVX-512 Off4080120160200Min: 27.44 / Avg: 167.16 / Max: 201.21Min: 19.19 / Avg: 165.38 / Max: 200.81Min: 21.18 / Avg: 177.43 / Max: 214.2Min: 21.79 / Avg: 189.63 / Max: 225.09
Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgCelsius, Fewer Is BetterEmbree 4.3CPU Temperature MonitorAVX-512 OnAVX-512 Off1632486480Min: 46.25 / Avg: 70.75 / Max: 75.13Min: 44.5 / Avg: 69.79 / Max: 74.38Min: 45.13 / Avg: 74.76 / Max: 79.75Min: 45.5 / Avg: 80.07 / Max: 85.13

Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgFrames Per Second, More Is BetterEmbree 4.3Binary: Pathtracer ISPC - Model: Asian Dragon ObjAVX-512 OnAVX-512 Off816243240SE +/- 0.01, N = 3SE +/- 0.04, N = 3SE +/- 0.00, N = 3SE +/- 0.01, N = 335.5134.0829.5526.72
Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgFrames Per Second Per Watt, More Is BetterEmbree 4.3Binary: Pathtracer ISPC - Model: Asian Dragon ObjAVX-512 OnAVX-512 Off0.05290.10580.15870.21160.26450.2350.2240.1830.156
Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgMegahertz, More Is BetterEmbree 4.3CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OnAVX-512 Off10002000300040005000Min: 3613 / Avg: 5192.2 / Max: 5739Min: 600 / Avg: 4884.48 / Max: 5720Min: 545 / Avg: 5052.51 / Max: 5700Min: 545 / Avg: 4929.02 / Max: 5545
Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgWatts, Fewer Is BetterEmbree 4.3CPU Power Consumption MonitorAVX-512 OnAVX-512 Off4080120160200Min: 30.21 / Avg: 151.22 / Max: 200.98Min: 19.21 / Avg: 152.33 / Max: 200.99Min: 21.37 / Avg: 161.67 / Max: 211.86Min: 11.34 / Avg: 171.18 / Max: 229.51
Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgCelsius, Fewer Is BetterEmbree 4.3CPU Temperature MonitorAVX-512 OnAVX-512 Off1632486480Min: 48 / Avg: 71.18 / Max: 75.38Min: 45.63 / Avg: 71.42 / Max: 76.63Min: 45.75 / Avg: 74.57 / Max: 79.38Min: 46.38 / Avg: 78.4 / Max: 84.25

PyTorch

This is a benchmark of PyTorch making use of pytorch-benchmark [https://github.com/LukasHedegaard/pytorch-benchmark]. Learn more via the OpenBenchmarking.org test page.

Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgbatches/sec, More Is BetterPyTorch 2.2.1Device: CPU - Batch Size: 64 - Model: ResNet-50AVX-512 OnAVX-512 Off1326395265SE +/- 0.41, N = 3SE +/- 0.36, N = 3SE +/- 0.30, N = 3SE +/- 0.11, N = 357.8947.0550.2343.87
Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgbatches/sec Per Watt, More Is BetterPyTorch 2.2.1Device: CPU - Batch Size: 64 - Model: ResNet-50AVX-512 OnAVX-512 Off0.10440.20880.31320.41760.5220.4640.3080.3760.309
Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgMegahertz, More Is BetterPyTorch 2.2.1CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OnAVX-512 Off10002000300040005000Min: 3635 / Avg: 5250.28 / Max: 5650Min: 600 / Avg: 5271.25 / Max: 5644Min: 545 / Avg: 5139.14 / Max: 5550Min: 545 / Avg: 5102.27 / Max: 5544
Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgWatts, Fewer Is BetterPyTorch 2.2.1CPU Power Consumption MonitorAVX-512 OnAVX-512 Off306090120150Min: 29.64 / Avg: 124.8 / Max: 149.27Min: 18.92 / Avg: 152.56 / Max: 180.02Min: 20.49 / Avg: 133.67 / Max: 158.26Min: 20.92 / Avg: 141.87 / Max: 165.5
Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgCelsius, Fewer Is BetterPyTorch 2.2.1CPU Temperature MonitorAVX-512 OnAVX-512 Off1428425670Min: 46.38 / Avg: 61.66 / Max: 72.63Min: 45.63 / Avg: 69.35 / Max: 73.25Min: 44.13 / Avg: 63.58 / Max: 67.88Min: 45.5 / Avg: 66.81 / Max: 70.5

OSPRay

Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgItems Per Second, More Is BetterOSPRay 3.2Benchmark: particle_volume/pathtracer/real_timeAVX-512 OnAVX-512 Off60120180240300SE +/- 0.40, N = 3SE +/- 0.58, N = 3SE +/- 0.60, N = 3SE +/- 0.33, N = 3277.28261.16239.30210.85
Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgItems Per Second Per Watt, More Is BetterOSPRay 3.2Benchmark: particle_volume/pathtracer/real_timeAVX-512 OnAVX-512 Off0.31860.63720.95581.27441.5931.4161.3371.1701.022
Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgMegahertz, More Is BetterOSPRay 3.2CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OnAVX-512 Off10002000300040005000Min: 3630 / Avg: 4931.4 / Max: 5535Min: 600 / Avg: 4825.38 / Max: 5444Min: 545 / Avg: 5091.95 / Max: 5555Min: 545 / Avg: 5038.7 / Max: 5197
Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgWatts, Fewer Is BetterOSPRay 3.2CPU Power Consumption MonitorAVX-512 OnAVX-512 Off4080120160200Min: 29.24 / Avg: 195.84 / Max: 205.19Min: 19.06 / Avg: 195.32 / Max: 203.81Min: 21.13 / Avg: 204.51 / Max: 233.27Min: 21.3 / Avg: 206.26 / Max: 231.22
Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgCelsius, Fewer Is BetterOSPRay 3.2CPU Temperature MonitorAVX-512 OnAVX-512 Off20406080100Min: 49.13 / Avg: 81.85 / Max: 86.5Min: 47.38 / Avg: 81.19 / Max: 87.38Min: 47.63 / Avg: 89.75 / Max: 93.5Min: 47.63 / Avg: 91.85 / Max: 95.38

simdjson

Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgGB/s, More Is Bettersimdjson 3.10Throughput Test: LargeRandomAVX-512 OnAVX-512 Off0.46580.93161.39741.86322.329SE +/- 0.00, N = 3SE +/- 0.03, N = 3SE +/- 0.00, N = 3SE +/- 0.01, N = 32.071.901.811.581. (CXX) g++ options: -O3 -lrt
Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgGB/s Per Watt, More Is Bettersimdjson 3.10Throughput Test: LargeRandomAVX-512 OnAVX-512 Off0.0090.0180.0270.0360.0450.0400.0350.0310.027
Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgMegahertz, More Is Bettersimdjson 3.10CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OnAVX-512 Off10002000300040005000Min: 3640 / Avg: 5485.05 / Max: 5748Min: 600 / Avg: 5495.4 / Max: 5727Min: 545 / Avg: 5253.66 / Max: 5551Min: 545 / Avg: 5279.35 / Max: 5558
Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgWatts, Fewer Is Bettersimdjson 3.10CPU Power Consumption MonitorAVX-512 OnAVX-512 Off1224364860Min: 27.07 / Avg: 52.23 / Max: 56.4Min: 18.29 / Avg: 53.68 / Max: 57.75Min: 21.12 / Avg: 57.98 / Max: 60.63Min: 20.84 / Avg: 58.47 / Max: 61.3
Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgCelsius, Fewer Is Bettersimdjson 3.10CPU Temperature MonitorAVX-512 OnAVX-512 Off1326395265Min: 42.13 / Avg: 57.43 / Max: 60.13Min: 40.38 / Avg: 61.95 / Max: 65.25Min: 40.5 / Avg: 67.14 / Max: 68.38Min: 40.75 / Avg: 67.26 / Max: 68.38

LeelaChessZero

Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgNodes Per Second, More Is BetterLeelaChessZero 0.31.1Backend: BLASAVX-512 OnAVX-512 Off50100150200250SE +/- 1.76, N = 3SE +/- 2.40, N = 3SE +/- 1.65, N = 6SE +/- 0.33, N = 32202051711681. (CXX) g++ options: -flto -pthread
Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgNodes Per Second Per Watt, More Is BetterLeelaChessZero 0.31.1Backend: BLASAVX-512 OnAVX-512 Off0.28010.56020.84031.12041.40051.2451.0970.8660.822
Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgMegahertz, More Is BetterLeelaChessZero 0.31.1CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OnAVX-512 Off10002000300040005000Min: 3282 / Avg: 5187.86 / Max: 5568Min: 600 / Avg: 5129.22 / Max: 5699Min: 545 / Avg: 5176.37 / Max: 5552Min: 545 / Avg: 5110.71 / Max: 5400
Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgWatts, Fewer Is BetterLeelaChessZero 0.31.1CPU Power Consumption MonitorAVX-512 OnAVX-512 Off4080120160200Min: 29.28 / Avg: 176.71 / Max: 192.4Min: 19.07 / Avg: 186.92 / Max: 201.72Min: 21 / Avg: 197.55 / Max: 228.21Min: 20.49 / Avg: 204.47 / Max: 236.13
Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgCelsius, Fewer Is BetterLeelaChessZero 0.31.1CPU Temperature MonitorAVX-512 OnAVX-512 Off20406080100Min: 40.5 / Avg: 79.55 / Max: 87.75Min: 40.13 / Avg: 83.68 / Max: 92.75Min: 37.63 / Avg: 84.36 / Max: 86.63Min: 37.25 / Avg: 89.69 / Max: 92.25

Embree

Intel Embree is a collection of high-performance ray-tracing kernels for execution on CPUs (and GPUs via SYCL) and supporting instruction sets such as SSE, AVX, AVX2, and AVX-512. Embree also supports making use of the Intel SPMD Program Compiler (ISPC). Learn more via the OpenBenchmarking.org test page.

Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgFrames Per Second, More Is BetterEmbree 4.3Binary: Pathtracer ISPC - Model: CrownAVX-512 OnAVX-512 Off816243240SE +/- 0.04, N = 3SE +/- 0.02, N = 3SE +/- 0.08, N = 3SE +/- 0.07, N = 336.6534.6333.7728.78
Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgFrames Per Second Per Watt, More Is BetterEmbree 4.3Binary: Pathtracer ISPC - Model: CrownAVX-512 OnAVX-512 Off0.04880.09760.14640.19520.2440.2170.2060.1700.141
Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgMegahertz, More Is BetterEmbree 4.3CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OnAVX-512 Off10002000300040005000Min: 3623 / Avg: 4942 / Max: 5589Min: 600 / Avg: 4536.91 / Max: 5597Min: 545 / Avg: 4649.18 / Max: 5453Min: 545 / Avg: 4818.4 / Max: 5191
Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgWatts, Fewer Is BetterEmbree 4.3CPU Power Consumption MonitorAVX-512 OnAVX-512 Off4080120160200Min: 29.04 / Avg: 168.67 / Max: 201.01Min: 18.59 / Avg: 167.96 / Max: 200.8Min: 21.08 / Avg: 198.56 / Max: 237.09Min: 21.36 / Avg: 203.84 / Max: 237.26
Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgCelsius, Fewer Is BetterEmbree 4.3CPU Temperature MonitorAVX-512 OnAVX-512 Off20406080100Min: 41.63 / Avg: 69.37 / Max: 74.88Min: 40.13 / Avg: 68.47 / Max: 74Min: 40.38 / Avg: 80.36 / Max: 87.25Min: 40 / Avg: 82.96 / Max: 89.5

Y-Cruncher

Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgSeconds, Fewer Is BetterY-Cruncher 0.8.5Pi Digits To Calculate: 1BAVX-512 OnAVX-512 Off510152025SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.02, N = 3SE +/- 0.01, N = 316.4920.2316.0318.06
Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgMegahertz, More Is BetterY-Cruncher 0.8.5CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OnAVX-512 Off10002000300040005000Min: 3629 / Avg: 5077.78 / Max: 5642Min: 600 / Avg: 4804.56 / Max: 5726Min: 545 / Avg: 4699.94 / Max: 5502Min: 545 / Avg: 4705.9 / Max: 5500
Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgWatts, Fewer Is BetterY-Cruncher 0.8.5CPU Power Consumption MonitorAVX-512 OnAVX-512 Off4080120160200Min: 28.27 / Avg: 144.36 / Max: 197.74Min: 18.65 / Avg: 157.4 / Max: 201.53Min: 21.25 / Avg: 155.2 / Max: 231.62Min: 21.2 / Avg: 168.48 / Max: 232.13
Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgCelsius, Fewer Is BetterY-Cruncher 0.8.5CPU Temperature MonitorAVX-512 OnAVX-512 Off20406080100Min: 48.63 / Avg: 72.08 / Max: 80.38Min: 47.13 / Avg: 76.17 / Max: 81.5Min: 47.38 / Avg: 75.75 / Max: 86Min: 49 / Avg: 81.67 / Max: 90.63

Mobile Neural Network

Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgms, Fewer Is BetterMobile Neural Network 2.9.b11b7037dModel: resnet-v2-50AVX-512 OnAVX-512 Off3691215SE +/- 0.04, N = 3SE +/- 0.06, N = 3SE +/- 0.11, N = 3SE +/- 0.10, N = 310.0511.3210.8812.661. (CXX) g++ options: -std=c++11 -O3 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -pthread -ldl

GROMACS

The GROMACS (GROningen MAchine for Chemical Simulations) molecular dynamics package testing with the water_GMX50 data. This test profile allows selecting between CPU and GPU-based GROMACS builds. Learn more via the OpenBenchmarking.org test page.

Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgNs Per Day, More Is BetterGROMACS 2024Implementation: MPI CPU - Input: water_GMX50_bareAVX-512 OnAVX-512 Off0.70541.41082.11622.82163.527SE +/- 0.004, N = 3SE +/- 0.004, N = 3SE +/- 0.001, N = 3SE +/- 0.006, N = 33.1352.6692.7402.5921. (CXX) g++ options: -O3 -lm
Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgNs Per Day Per Watt, More Is BetterGROMACS 2024Implementation: MPI CPU - Input: water_GMX50_bareAVX-512 OnAVX-512 Off0.00410.00820.01230.01640.02050.0180.0150.0160.014
Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgMegahertz, More Is BetterGROMACS 2024CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OnAVX-512 Off10002000300040005000Min: 3623 / Avg: 5305.7 / Max: 5715Min: 600 / Avg: 5102.25 / Max: 5714Min: 545 / Avg: 5061.84 / Max: 5550Min: 545 / Avg: 5096.29 / Max: 5423
Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgWatts, Fewer Is BetterGROMACS 2024CPU Power Consumption MonitorAVX-512 OnAVX-512 Off4080120160200Min: 28.65 / Avg: 175.5 / Max: 192.97Min: 18.86 / Avg: 177.28 / Max: 200.24Min: 21.18 / Avg: 173.84 / Max: 209.67Min: 21.01 / Avg: 179.94 / Max: 212.47
Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgCelsius, Fewer Is BetterGROMACS 2024CPU Temperature MonitorAVX-512 OnAVX-512 Off20406080100Min: 48.63 / Avg: 79.02 / Max: 81.75Min: 41.25 / Avg: 78.18 / Max: 85.13Min: 41 / Avg: 78.22 / Max: 88.5Min: 41.88 / Avg: 80.23 / Max: 89.38

Y-Cruncher

Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgSeconds, Fewer Is BetterY-Cruncher 0.8.5Pi Digits To Calculate: 500MAVX-512 OnAVX-512 Off3691215SE +/- 0.002, N = 5SE +/- 0.008, N = 5SE +/- 0.007, N = 5SE +/- 0.009, N = 57.5709.0737.6968.395
Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgMegahertz, More Is BetterY-Cruncher 0.8.5CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OnAVX-512 Off10002000300040005000Min: 3620 / Avg: 4855.47 / Max: 5666Min: 600 / Avg: 4448.63 / Max: 5712Min: 545 / Avg: 4674.45 / Max: 5551Min: 545 / Avg: 4219.63 / Max: 5501
Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgWatts, Fewer Is BetterY-Cruncher 0.8.5CPU Power Consumption MonitorAVX-512 OnAVX-512 Off4080120160200Min: 28.12 / Avg: 118.5 / Max: 188.81Min: 18.49 / Avg: 133.31 / Max: 200.89Min: 21.1 / Avg: 125.14 / Max: 212.55Min: 20.15 / Avg: 138.5 / Max: 225.83
Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgCelsius, Fewer Is BetterY-Cruncher 0.8.5CPU Temperature MonitorAVX-512 OnAVX-512 Off20406080100Min: 47.75 / Avg: 67.55 / Max: 76.13Min: 46.38 / Avg: 73.04 / Max: 80.25Min: 46 / Avg: 70.65 / Max: 81.25Min: 47.63 / Avg: 76.89 / Max: 87.13

ONNX Runtime

ONNX Runtime is developed by Microsoft and partners as a open-source, cross-platform, high performance machine learning inferencing and training accelerator. This test profile runs the ONNX Runtime with various models available from the ONNX Model Zoo. Learn more via the OpenBenchmarking.org test page.

Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.17Model: ArcFace ResNet-100 - Device: CPU - Executor: StandardAVX-512 OnAVX-512 Off1224364860SE +/- 0.61, N = 3SE +/- 0.22, N = 3SE +/- 0.15, N = 3SE +/- 0.28, N = 355.5149.8147.8547.851. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt
Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgInference Time Cost (ms), Fewer Is BetterONNX Runtime 1.17Model: ArcFace ResNet-100 - Device: CPU - Executor: StandardAVX-512 OnAVX-512 Off510152025SE +/- 0.20, N = 3SE +/- 0.09, N = 3SE +/- 0.07, N = 3SE +/- 0.12, N = 318.0220.0820.9020.901. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt
Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgMegahertz, More Is BetterONNX Runtime 1.17CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OnAVX-512 Off9001800270036004500Min: 3620 / Avg: 5028.13 / Max: 5281Min: 600 / Avg: 5065.23 / Max: 5393Min: 545 / Avg: 5055.37 / Max: 5296Min: 545 / Avg: 4926.11 / Max: 5325
Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgWatts, Fewer Is BetterONNX Runtime 1.17CPU Power Consumption MonitorAVX-512 OnAVX-512 Off4080120160200Min: 28.12 / Avg: 160.78 / Max: 172.91Min: 19.42 / Avg: 186.74 / Max: 201.09Min: 21.4 / Avg: 191.64 / Max: 207.58Min: 20.26 / Avg: 195.05 / Max: 210.64
Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgCelsius, Fewer Is BetterONNX Runtime 1.17CPU Temperature MonitorAVX-512 OnAVX-512 Off1632486480Min: 49.5 / Avg: 71.42 / Max: 73.13Min: 47.63 / Avg: 80.2 / Max: 82.75Min: 47 / Avg: 79.71 / Max: 81.75Min: 48.75 / Avg: 84.1 / Max: 86.13

XNNPACK

Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgus, Fewer Is BetterXNNPACK 2cd86bModel: QU8MobileNetV2AVX-512 OnAVX-512 Off2004006008001000SE +/- 3.93, N = 3SE +/- 0.58, N = 3SE +/- 0.67, N = 3SE +/- 1.45, N = 37858568078701. (CXX) g++ options: -O3 -lrt -lm

Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgus, Fewer Is BetterXNNPACK 2cd86bModel: QU8MobileNetV3LargeAVX-512 OnAVX-512 Off30060090012001500SE +/- 1.15, N = 3SE +/- 2.03, N = 3SE +/- 3.38, N = 3SE +/- 3.84, N = 311541177109411301. (CXX) g++ options: -O3 -lrt -lm

CPU Temperature Monitor

Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgCelsiusCPU Temperature MonitorPhoronix Test Suite System MonitoringAVX-512 OnAVX-512 Off20406080100Min: 40.5 / Avg: 73.15 / Max: 89.13Min: 39.5 / Avg: 75.07 / Max: 94.5Min: 37.63 / Avg: 80.57 / Max: 96.13Min: 37.25 / Avg: 83.51 / Max: 95.88

CPU Power Consumption Monitor

Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgWattsCPU Power Consumption MonitorPhoronix Test Suite System MonitoringAVX-512 OnAVX-512 Off4080120160200Min: 22.78 / Avg: 148.64 / Max: 205.19Min: 13.82 / Avg: 152.26 / Max: 203.94Min: 10.68 / Avg: 169.29 / Max: 237.09Min: 11.34 / Avg: 172.33 / Max: 237.26

CPU Peak Freq (Highest CPU Core Frequency) Monitor

Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgMegahertzCPU Peak Freq (Highest CPU Core Frequency) MonitorPhoronix Test Suite System MonitoringAVX-512 OnAVX-512 Off10002000300040005000Min: 2477 / Avg: 5097.18 / Max: 5799Min: 600 / Avg: 4986.91 / Max: 5728Min: 545 / Avg: 5001.33 / Max: 5725Min: 545 / Avg: 4954.31 / Max: 5725

74 Results Shown

OpenVINO:
  Weld Porosity Detection FP16 - CPU:
    ms
    FPS
  Face Detection FP16 - CPU:
    FPS
    ms
  Age Gender Recognition Retail 0013 FP16 - CPU:
    ms
    FPS
  Person Re-Identification Retail FP16 - CPU:
    ms
  Handwritten English Recognition FP16 - CPU:
    ms
    FPS
  Person Re-Identification Retail FP16 - CPU:
    FPS
  Person Vehicle Bike Detection FP16 - CPU:
    ms
    FPS
TensorFlow
OpenVINO:
  Face Detection Retail FP16 - CPU:
    ms
    FPS
NAMD:
  ATPase with 327,506 Atoms
  STMV with 1,066,628 Atoms
OpenVINO:
  Machine Translation EN To DE FP16 - CPU:
    ms
    FPS
OSPRay:
  gravity_spheres_volume/dim_512/scivis/real_time
  gravity_spheres_volume/dim_512/ao/real_time
oneDNN
miniBUDE:
  OpenMP - BM1:
    Billion Interactions/s
    GFInst/s
oneDNN
ONNX Runtime
OpenVINO:
  Vehicle Detection FP16 - CPU:
    ms
    FPS
oneDNN
OpenVINO:
  Person Detection FP16 - CPU:
    FPS
    ms
  Road Segmentation ADAS FP16-INT8 - CPU:
    FPS
    ms
OSPRay
simdjson:
  PartialTweets
  DistinctUserID
oneDNN
simdjson
ONNX Runtime
oneDNN
OpenVINO:
  Noise Suppression Poconet-Like FP16 - CPU:
    ms
    FPS
OSPRay Studio:
  1 - 4K - 1 - Path Tracer - CPU
  1 - 4K - 16 - Path Tracer - CPU
  1 - 4K - 32 - Path Tracer - CPU
  3 - 4K - 1 - Path Tracer - CPU
  3 - 4K - 32 - Path Tracer - CPU
  3 - 4K - 16 - Path Tracer - CPU
oneDNN
simdjson
LeelaChessZero
OpenVKL
Numpy Benchmark
ONNX Runtime:
  CaffeNet 12-int8 - CPU - Standard
  fcn-resnet101-11 - CPU - Standard
TensorFlow
PyTorch
Embree:
  Pathtracer ISPC - Asian Dragon
  Pathtracer ISPC - Asian Dragon Obj
PyTorch
OSPRay
simdjson
LeelaChessZero
Embree
Y-Cruncher
Mobile Neural Network
GROMACS
Y-Cruncher
ONNX Runtime
XNNPACK:
  QU8MobileNetV2
  QU8MobileNetV3Large
CPU Temperature Monitor:
  Phoronix Test Suite System Monitoring:
    Celsius
    Watts
    Megahertz

Ryzen 9 9950X: AVX-512 On

Kernel Notes: Transparent Huge Pages: madvise
Compiler Notes: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-backtrace --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-defaulted --enable-offload-targets=nvptx-none=/build/gcc-13-uJ7kn6/gcc-13-13.2.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-13-uJ7kn6/gcc-13-13.2.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v
Processor Notes: Scaling Governor: amd-pstate-epp powersave (EPP: balance_performance) - CPU Microcode: 0xb40401a
Python Notes: Python 3.12.3
Security Notes: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + reg_file_data_sampling: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS; IBPB: conditional; STIBP: always-on; RSB filling; PBRSB-eIBRS: Not affected; BHI: Not affected + srbds: Not affected + tsx_async_abort: Not affected

Testing initiated at 11 August 2024 14:56 by user pts.

Ryzen 9 9950X: AVX-512 Off

Processor: AMD Ryzen 9 9950X 16-Core @ 5.75GHz (16 Cores / 32 Threads), Motherboard: ASUS ROG STRIX X670E-E GAMING WIFI (2124 BIOS), Chipset: AMD Device 14d8, Memory: 2 x 16GB DDR5-6000MT/s G Skill F5-6000J3038F16G, Disk: 2000GB Corsair MP700 PRO, Graphics: AMD Radeon RX 7900 GRE 16GB, Audio: AMD Navi 31 HDMI/DP, Monitor: DELL U2723QE, Network: Intel I225-V + Intel Wi-Fi 6E

OS: Ubuntu 24.04, Kernel: 6.10.0-phx (x86_64), Desktop: GNOME Shell 46.0, Display Server: X Server + Wayland, OpenGL: 4.6 Mesa 24.2~git2406040600.8112d4~oibaf~n (git-8112d44 2024-06-04 noble-oibaf-ppa) (LLVM 17.0.6 DRM 3.57), Compiler: GCC 13.2.0, File-System: ext4, Screen Resolution: 3840x2160

Kernel Notes: Transparent Huge Pages: madvise
Compiler Notes: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-backtrace --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-defaulted --enable-offload-targets=nvptx-none=/build/gcc-13-uJ7kn6/gcc-13-13.2.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-13-uJ7kn6/gcc-13-13.2.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v
Processor Notes: Scaling Governor: amd-pstate-epp powersave (EPP: balance_performance) - CPU Microcode: 0xb40401a
Python Notes: Python 3.12.3
Security Notes: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + reg_file_data_sampling: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS; IBPB: conditional; STIBP: always-on; RSB filling; PBRSB-eIBRS: Not affected; BHI: Not affected + srbds: Not affected + tsx_async_abort: Not affected

Testing initiated at 12 August 2024 01:11 by user phoronix.

Ryzen 9 7950X: AVX-512 On

Kernel Notes: Transparent Huge Pages: madvise
Compiler Notes: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-backtrace --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-defaulted --enable-offload-targets=nvptx-none=/build/gcc-13-uJ7kn6/gcc-13-13.2.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-13-uJ7kn6/gcc-13-13.2.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v
Processor Notes: Scaling Governor: amd-pstate-epp powersave (EPP: balance_performance) - CPU Microcode: 0xa601206
Python Notes: Python 3.12.3
Security Notes: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + reg_file_data_sampling: Not affected + retbleed: Not affected + spec_rstack_overflow: Mitigation of Safe RET + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS; IBPB: conditional; STIBP: always-on; RSB filling; PBRSB-eIBRS: Not affected; BHI: Not affected + srbds: Not affected + tsx_async_abort: Not affected

Testing initiated at 12 August 2024 18:40 by user phoronix.

Ryzen 9 7950X: AVX-512 Off

Processor: AMD Ryzen 9 7950X 16-Core @ 5.88GHz (16 Cores / 32 Threads), Motherboard: ASUS ROG STRIX X670E-E GAMING WIFI (2124 BIOS), Chipset: AMD Device 14d8, Memory: 2 x 16GB DDR5-6000MT/s G Skill F5-6000J3038F16G, Disk: 2000GB Corsair MP700 PRO, Graphics: AMD Radeon RX 7900 GRE 16GB, Audio: AMD Navi 31 HDMI/DP, Monitor: DELL U2723QE, Network: Intel I225-V + Intel Wi-Fi 6E

OS: Ubuntu 24.04, Kernel: 6.10.0-phx (x86_64), Desktop: GNOME Shell 46.0, Display Server: X Server + Wayland, OpenGL: 4.6 Mesa 24.2~git2406040600.8112d4~oibaf~n (git-8112d44 2024-06-04 noble-oibaf-ppa) (LLVM 17.0.6 DRM 3.57), Compiler: GCC 13.2.0, File-System: ext4, Screen Resolution: 3840x2160

Kernel Notes: Transparent Huge Pages: madvise
Compiler Notes: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-backtrace --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-defaulted --enable-offload-targets=nvptx-none=/build/gcc-13-uJ7kn6/gcc-13-13.2.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-13-uJ7kn6/gcc-13-13.2.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v
Processor Notes: Scaling Governor: amd-pstate-epp powersave (EPP: balance_performance) - CPU Microcode: 0xa601206
Python Notes: Python 3.12.3
Security Notes: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + reg_file_data_sampling: Not affected + retbleed: Not affected + spec_rstack_overflow: Mitigation of Safe RET + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS; IBPB: conditional; STIBP: always-on; RSB filling; PBRSB-eIBRS: Not affected; BHI: Not affected + srbds: Not affected + tsx_async_abort: Not affected

Testing initiated at 12 August 2024 11:50 by user phoronix.