Linux 6.9 + Ubuntu 22.04 Intel AMD Server CPU Benchmarks

Benchmarks by Michael Larabel for a future article.

Compare your own system(s) to this result file with the Phoronix Test Suite by running the command: phoronix-test-suite benchmark 2405207-NE-LINUX69SE55
Jump To Table - Results

View

Do Not Show Noisy Results
Do Not Show Results With Incomplete Data
Do Not Show Results With Little Change/Spread
List Notable Results
Show Result Confidence Charts

Limit displaying results to tests within:

AV1 2 Tests
BLAS (Basic Linear Algebra Sub-Routine) Tests 4 Tests
C++ Boost Tests 5 Tests
Chess Test Suite 2 Tests
Timed Code Compilation 8 Tests
C/C++ Compiler Tests 16 Tests
Compression Tests 3 Tests
CPU Massive 25 Tests
Creator Workloads 23 Tests
Cryptography 5 Tests
Database Test Suite 5 Tests
Encoding 7 Tests
Fortran Tests 7 Tests
Game Development 5 Tests
HPC - High Performance Computing 29 Tests
Imaging 3 Tests
Common Kernel Benchmarks 3 Tests
LAPACK (Linear Algebra Pack) Tests 3 Tests
Linear Algebra 2 Tests
Machine Learning 7 Tests
Molecular Dynamics 10 Tests
MPI Benchmarks 10 Tests
Multi-Core 44 Tests
NVIDIA GPU Compute 3 Tests
Intel oneAPI 7 Tests
OpenMPI Tests 18 Tests
Programmer / Developer System Benchmarks 12 Tests
Python 2 Tests
Raytracing 2 Tests
Renderers 5 Tests
Scientific Computing 15 Tests
Software Defined Radio 2 Tests
Server 7 Tests
Server CPU Tests 17 Tests
Single-Threaded 2 Tests
Video Encoding 7 Tests
Common Workstation Benchmarks 3 Tests

Statistics

Show Overall Harmonic Mean(s)
Show Overall Geometric Mean
Show Geometric Means Per-Suite/Category
Show Wins / Losses Counts (Pie Chart)
Normalize Results
Remove Outliers Before Calculating Averages

Graph Settings

Force Line Graphs Where Applicable
Convert To Scalar Where Applicable
Disable Color Branding
Prefer Vertical Bar Graphs
No Box Plots
On Line Graphs With Missing Data, Connect The Line Gaps

Additional Graphs

Show Perf Per Core/Thread Calculation Graphs Where Applicable
Show Perf Per Clock Calculation Graphs Where Applicable
Show Perf Per RAM Channel Calculation Graphs Where Applicable

Multi-Way Comparison

Condense Multi-Option Tests Into Single Result Graphs
Condense Test Profiles With Multiple Version Results Into Single Result Graphs

Table

Show Detailed System Result Table

Run Management

Highlight
Result
Hide
Result
Result
Identifier
Performance Per
Dollar
Date
Run
  Test
  Duration
EPYC 8534P
May 18
  1 Day, 2 Hours, 46 Minutes
EPYC 8534PN
May 19
  1 Day, 3 Hours, 27 Minutes
EPYC 9654
May 13
  1 Day, 1 Hour, 28 Minutes
EPYC 9654 2P
May 14
  1 Day, 5 Hours, 21 Minutes
EPYC 9684X
May 12
  23 Hours, 34 Minutes
EPYC 9684X 2P
May 11
  1 Day, 3 Hours, 52 Minutes
EPYC 9754
May 15
  1 Day, 5 Hours, 27 Minutes
EPYC 9754 2P
May 17
  1 Day, 8 Hours, 26 Minutes
Xeon Max 9468
April 21
  1 Day, 3 Hours, 35 Minutes
Xeon Max 9468 2P
April 22
  1 Day, 22 Minutes
Xeon Max 9480
April 26
  1 Day, 1 Hour, 29 Minutes
Xeon Max 9480 2P
April 27
  1 Day, 6 Hours, 2 Minutes
Xeon Platinum 8490H
April 16
  22 Hours, 13 Minutes
Xeon Platinum 8490H 2P
April 17
  22 Hours, 41 Minutes
Xeon Platinum 8592+
April 11
  22 Hours, 1 Minute
Xeon Platinum 8592+ 2P
April 08
  23 Hours, 31 Minutes
Invert Hiding All Results Option
  1 Day, 2 Hours, 16 Minutes

Only show results where is faster than
Only show results matching title/arguments (delimit multiple options with a comma):
Do not show results matching title/arguments (delimit multiple options with a comma):


Linux 6.9 + Ubuntu 22.04 Intel AMD Server CPU BenchmarksProcessorMotherboardChipsetMemoryDiskGraphicsNetworkOSKernelCompilerFile-SystemScreen ResolutionXeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN2 x INTEL XEON PLATINUM 8592+ @ 3.90GHz (128 Cores / 256 Threads)Quanta Cloud QuantaGrid D54Q-2U S6Q-MB-MPS (3B05.TEL4P1 BIOS)Intel Device 1bce1008GB2 x 1920GB KIOXIA KCD8XPUG1T92ASPEED2 x Intel X710 for 10GBASE-TUbuntu 24.046.9.0-060900rc3-generic (x86_64)GCC 13.2.0ext41920x1200INTEL XEON PLATINUM 8592+ @ 3.90GHz (64 Cores / 128 Threads)512GBIntel Xeon Platinum 8490H @ 3.50GHz (60 Cores / 120 Threads)2 x Intel Xeon Platinum 8490H @ 3.50GHz (120 Cores / 240 Threads)1008GB2 x Intel X710 for 10GBASE-TIntel Xeon Max 9468 @ 3.50GHz (48 Cores / 96 Threads)576GB2 x Intel Xeon Max 9468 @ 3.50GHz (96 Cores / 192 Threads)1136GB2 x Intel X710 for 10GBASE-TIntel Xeon Max 9480 @ 3.50GHz (56 Cores / 112 Threads)576GB2 x Intel Xeon Max 9480 @ 3.50GHz (112 Cores / 224 Threads)1136GB2 x Intel X710 for 10GBASE-T2 x AMD EPYC 9684X 96-Core @ 2.55GHz (192 Cores / 384 Threads)AMD Titanite_4G (RTI1007B BIOS)AMD Device 14a41520GBBroadcom NetXtreme BCM5720 PCIeAMD EPYC 9684X 96-Core @ 2.55GHz (96 Cores / 192 Threads)12 x 64GB DDR5-4800MT/s Samsung M321R8GA0BB0-CQKEGAMD EPYC 9654 96-Core @ 2.40GHz (96 Cores / 192 Threads)2 x AMD EPYC 9654 96-Core @ 2.40GHz (192 Cores / 384 Threads)1520GBAMD EPYC 9754 128-Core @ 2.25GHz (128 Cores / 256 Threads)12 x 64GB DDR5-4800MT/s Samsung M321R8GA0BB0-CQKEG2 x AMD EPYC 9754 128-Core @ 2.25GHz (256 Cores / 512 Threads)1520GBAMD EPYC 8534P 64-Core @ 2.30GHz (64 Cores / 128 Threads)AMD Cinnabar (RCB1009C BIOS)6 x 32GB DDR5-4800MT/s Samsung M321R4GA0BB0-CQKMG2 x 1920GB KIOXIA KCD8XPUG1T92 + 2000GB Corsair MP700 PRO2 x Broadcom NetXtreme BCM5720 PCIeAMD EPYC 8534PN 64-Core @ 2.00GHz (64 Cores / 128 Threads)2 x 1920GB KIOXIA KCD8XPUG1T92OpenBenchmarking.orgKernel Details- Transparent Huge Pages: madviseCompiler Details- --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-backtrace --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-defaulted --enable-offload-targets=nvptx-none=/build/gcc-13-OiuXZC/gcc-13-13.2.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-13-OiuXZC/gcc-13-13.2.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -vProcessor Details- Xeon Platinum 8592+ 2P: Scaling Governor: intel_pstate performance (EPP: performance) - CPU Microcode: 0x21000200- Xeon Platinum 8592+: Scaling Governor: intel_pstate performance (EPP: performance) - CPU Microcode: 0x21000200- Xeon Platinum 8490H: Scaling Governor: intel_pstate performance (EPP: performance) - CPU Microcode: 0x2b000590- Xeon Platinum 8490H 2P: Scaling Governor: intel_pstate performance (EPP: performance) - CPU Microcode: 0x2b000590- Xeon Max 9468: Scaling Governor: intel_pstate performance (EPP: performance) - CPU Microcode: 0x2c000290- Xeon Max 9468 2P: Scaling Governor: intel_pstate performance (EPP: performance) - CPU Microcode: 0x2c000290- Xeon Max 9480: Scaling Governor: intel_pstate performance (EPP: performance) - CPU Microcode: 0x2c000290- Xeon Max 9480 2P: Scaling Governor: intel_pstate performance (EPP: performance) - CPU Microcode: 0x2c000290- EPYC 9684X 2P: Scaling Governor: acpi-cpufreq performance (Boost: Enabled) - CPU Microcode: 0xa101144- EPYC 9684X: Scaling Governor: acpi-cpufreq performance (Boost: Enabled) - CPU Microcode: 0xa101144- EPYC 9654: Scaling Governor: acpi-cpufreq performance (Boost: Enabled) - CPU Microcode: 0xa101144- EPYC 9654 2P: Scaling Governor: acpi-cpufreq performance (Boost: Enabled) - CPU Microcode: 0xa101144- EPYC 9754: Scaling Governor: acpi-cpufreq performance (Boost: Enabled) - CPU Microcode: 0xaa00116- EPYC 9754 2P: Scaling Governor: acpi-cpufreq performance (Boost: Enabled) - CPU Microcode: 0xaa00116- EPYC 8534P: Scaling Governor: acpi-cpufreq performance (Boost: Enabled) - CPU Microcode: 0xaa00213- EPYC 8534PN: Scaling Governor: acpi-cpufreq performance (Boost: Enabled) - CPU Microcode: 0xaa00213Java Details- OpenJDK Runtime Environment (build 21.0.3-ea+7-Ubuntu-1build1)Python Details- Python 3.12.2Security Details- Xeon Platinum 8592+ 2P: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + reg_file_data_sampling: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Not affected- Xeon Platinum 8592+: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + reg_file_data_sampling: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Not affected- Xeon Platinum 8490H: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + reg_file_data_sampling: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Not affected- Xeon Platinum 8490H 2P: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + reg_file_data_sampling: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Not affected- Xeon Max 9468: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + reg_file_data_sampling: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Not affected- Xeon Max 9468 2P: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + reg_file_data_sampling: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Not affected- Xeon Max 9480: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + reg_file_data_sampling: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Not affected- Xeon Max 9480 2P: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + reg_file_data_sampling: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Not affected- EPYC 9684X 2P: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + reg_file_data_sampling: Not affected + retbleed: Not affected + spec_rstack_overflow: Mitigation of Safe RET + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional STIBP: always-on RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected- EPYC 9684X: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + reg_file_data_sampling: Not affected + retbleed: Not affected + spec_rstack_overflow: Mitigation of Safe RET + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional STIBP: always-on RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected- EPYC 9654: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + reg_file_data_sampling: Not affected + retbleed: Not affected + spec_rstack_overflow: Mitigation of Safe RET + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional STIBP: always-on RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected- EPYC 9654 2P: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + reg_file_data_sampling: Not affected + retbleed: Not affected + spec_rstack_overflow: Mitigation of Safe RET + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional STIBP: always-on RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected- EPYC 9754: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + reg_file_data_sampling: Not affected + retbleed: Not affected + spec_rstack_overflow: Mitigation of Safe RET + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional STIBP: always-on RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected- EPYC 9754 2P: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + reg_file_data_sampling: Not affected + retbleed: Not affected + spec_rstack_overflow: Mitigation of Safe RET + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional STIBP: always-on RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected- EPYC 8534P: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + reg_file_data_sampling: Not affected + retbleed: Not affected + spec_rstack_overflow: Mitigation of Safe RET + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional STIBP: always-on RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected- EPYC 8534PN: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + reg_file_data_sampling: Not affected + retbleed: Not affected + spec_rstack_overflow: Mitigation of Safe RET + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional STIBP: always-on RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected

Xeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PNLogarithmic Result OverviewPhoronix Test SuiteBRL-CADNAMDXmrigStockfishJohn The RipperASKAPPrimesieveRELIONm-queensCoremarkOpenSSLSpeedbHelsingBlenderNAS Parallel BenchmarksPennantOSPRay StudioLlamafileXcompact3d Incompact3dPyTorchACES DGEMMLULESHRocksDBminiBUDE7-Zip CompressionAlgebraic Multi-Grid BenchmarkWRFGROMACSOSPRayOpenVKLEmbreePostgreSQLASTC EncoderminiFEHigh Performance Conjugate GradientIntel Open Image DenoiseoneDNNKvazaarOpenRadiossOpenVINOGPAWMemcachedONNX RuntimeTimed Node.js CompilationOpenFOAMParallel BZIP2 CompressionLAMMPS Molecular Dynamics SimulatorLuxCoreRenderTimed LLVM Compilationuvg266CloverLeafQuantLibY-CruncherGraphicsMagickTimed Linux Kernel CompilationGNU Octave BenchmarkTensorFlowClickHouseNWChemLiquid-DSPApache IoTDBTimed Godot Game Engine CompilationQMCPACKTimed FFmpeg CompilationTimed Gem5 CompilationTimed ImageMagick CompilationsrsRAN ProjectSVT-AV1x265PyBenchTimed Mesa CompilationNumpy Benchmarklibavif avifencZstd CompressionSecureMarkFFmpegGoogle SynthMarkWebP Image Encode

Xeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PNLogarithmic Per Watt Result OverviewPhoronix Test SuiteminiFEMemcachedWebP Image EncodePyTorchZstd CompressionSVT-AV1FFmpegsrsRAN ProjectNumpy Benchmarkx265Google SynthMarkminiBUDE7-Zip CompressionKvazaarSecureMarkuvg266LuxCoreRenderClickHouseACES DGEMMLiquid-DSPRocksDBSpeedbGraphicsMagickASKAPEmbreeOpenVKLQuantLibASTC EncoderTensorFlowJohn The RipperLAMMPS Molecular Dynamics SimulatorStockfishCoremarkNAS Parallel BenchmarksOSPRayXmrigHigh Performance Conjugate GradientOpenSSLGROMACSIntel Open Image DenoiseAlgebraic Multi-Grid BenchmarkLlamafileBRL-CADNAMDLULESHP.W.G.MP.W.G.MP.W.G.MP.W.G.MP.W.G.MP.W.G.MP.W.G.MP.W.G.MP.W.G.MP.W.G.MP.W.G.MP.W.G.MP.W.G.MP.W.G.MP.W.G.MP.W.G.MP.W.G.MP.W.G.MP.W.G.MP.W.G.MP.W.G.MP.W.G.MP.W.G.MP.W.G.MP.W.G.MP.W.G.MP.W.G.MP.W.G.MP.W.G.MP.W.G.MP.W.G.MP.W.G.MP.W.G.MP.W.G.MP.W.G.MP.W.G.MP.W.G.MP.W.G.MP.W.G.MP.W.G.MP.W.G.MP.W.G.MP.W.G.MP.W.G.MP.W.G.M

Linux 6.9 + Ubuntu 22.04 Intel AMD Server CPU Benchmarkspytorch: CPU - 64 - ResNet-50pytorch: CPU - 64 - ResNet-152pytorch: CPU - 256 - ResNet-50pytorch: CPU - 512 - ResNet-50pytorch: CPU - 512 - ResNet-152pytorch: CPU - 256 - ResNet-152minibude: OpenMP - BM1minibude: OpenMP - BM2openssl: SHA256openssl: SHA512openssl: AES-128-GCMopenssl: AES-256-GCMopenssl: ChaCha20openssl: ChaCha20-Poly1305minife: Smallamg: ffmpeg: libx265 - Uploadffmpeg: libx265 - Platformffmpeg: libx265 - Video On Demandopenvino: Face Detection FP16-INT8 - CPUopenvino: Age Gender Recognition Retail 0013 FP16-INT8 - CPUopenvino: Person Detection FP16 - CPUopenvino: Weld Porosity Detection FP16-INT8 - CPUopenvino: Vehicle Detection FP16-INT8 - CPUopenvino: Person Vehicle Bike Detection FP16 - CPUopenvino: Machine Translation EN To DE FP16 - CPUopenvino: Face Detection Retail FP16-INT8 - CPUopenvino: Handwritten English Recognition FP16-INT8 - CPUopenvino: Road Segmentation ADAS FP16-INT8 - CPUopenvino: Person Re-Identification Retail FP16 - CPUopenvino: Noise Suppression Poconet-Like FP16 - CPUkvazaar: Bosphorus 4K - Slowkvazaar: Bosphorus 4K - Mediumkvazaar: Bosphorus 4K - Very Fastuvg266: Bosphorus 4K - Slowuvg266: Bosphorus 4K - Mediumuvg266: Bosphorus 4K - Very Fastvvenc: Bosphorus 4K - Fastvvenc: Bosphorus 4K - Fasterembree: Pathtracer ISPC - Asian Dragonsvt-av1: Preset 13 - Bosphorus 4Ksvt-av1: Preset 12 - Bosphorus 4Ksvt-av1: Preset 8 - Bosphorus 4Ksvt-av1: Preset 4 - Bosphorus 4Kx265: Bosphorus 4Kembree: Pathtracer ISPC - Asian Dragon Objembree: Pathtracer ISPC - Crownminibude: OpenMP - BM1minibude: OpenMP - BM2mt-dgemm: Sustained Floating-Point Ratehpcg: 144 144 144 - 60xmrig: GhostRider - 1Moidn: RT.hdr_alb_nrm.3840x2160 - CPU-Onlyoidn: RT.ldr_alb_nrm.3840x2160 - CPU-Onlyoidn: RTLightmap.hdr.4096x4096 - CPU-Onlytensorflow: CPU - 512 - GoogLeNettensorflow: CPU - 64 - ResNet-50tensorflow: CPU - 64 - AlexNettensorflow: CPU - 64 - GoogLeNettensorflow: CPU - 256 - ResNet-50tensorflow: CPU - 256 - AlexNettensorflow: CPU - 256 - GoogLeNettensorflow: CPU - 512 - ResNet-50tensorflow: CPU - 512 - AlexNetonnx: yolov4 - CPU - Standardonnx: yolov4 - CPU - Parallelonnx: fcn-resnet101-11 - CPU - Standardonnx: fcn-resnet101-11 - CPU - Parallelonnx: super-resolution-10 - CPU - Standardonnx: super-resolution-10 - CPU - Parallelonnx: bertsquad-12 - CPU - Standardonnx: bertsquad-12 - CPU - Parallelonnx: GPT-2 - CPU - Standardonnx: GPT-2 - CPU - Parallelonnx: ArcFace ResNet-100 - CPU - Standardonnx: ArcFace ResNet-100 - CPU - Parallelonnx: ResNet50 v1-12-int8 - CPU - Standardonnx: ResNet50 v1-12-int8 - CPU - Parallelonnx: CaffeNet 12-int8 - CPU - Standardonnx: CaffeNet 12-int8 - CPU - Parallelonnx: Faster R-CNN R-50-FPN-int8 - CPU - Standardonnx: Faster R-CNN R-50-FPN-int8 - CPU - Parallelonnx: T5 Encoder - CPU - Standardonnx: T5 Encoder - CPU - Parallelopenvkl: vklBenchmarkCPU ISPCospray: gravity_spheres_volume/dim_512/pathtracer/real_timeospray: particle_volume/ao/real_timeospray: particle_volume/scivis/real_timegraphics-magick: Noise-Gaussiangraphics-magick: Enhancedgraphics-magick: Sharpengraphics-magick: Swirlcoremark: CoreMark Size 666 - Iterations Per Secondaircrack-ng: luxcorerender: LuxCore Benchmark - CPUluxcorerender: Orange Juice - CPUluxcorerender: DLSC - CPUsecuremark: SecureMark-TLScompress-zstd: 19 - Compression Speedcompress-zstd: 19 - Decompression Speedcompress-zstd: 19, Long Mode - Decompression Speedcompress-zstd: 19, Long Mode - Compression Speedsrsran: PUSCH Processor Benchmark, Throughput Totalsrsran: PUSCH Processor Benchmark, Throughput Threadsrsran: PDSCH Processor Benchmark, Throughput Totalsrsran: PDSCH Processor Benchmark, Throughput Threadquantlib: Single-Threadedquantlib: Multi-Threadedaskap: tConvolve MT - Griddingcompress-7zip: Compression Ratingcompress-7zip: Decompression Ratingwebp: Quality 100, Highest Compressionwebp: Quality 100, Lossless, Highest Compressionaskap: tConvolve MPI - Degriddingaskap: tConvolve MPI - Griddingastcenc: Mediumastcenc: Very Thoroughastcenc: Thoroughastcenc: Exhaustivestockfish: Chess Benchmarkgromacs: MPI CPU - water_GMX50_barelammps: Rhodopsin Proteinlammps: 20k Atomsnamd: ATPase with 327,506 Atomsnamd: STMV with 1,066,628 Atomsrocksdb: Rand Readrocksdb: Read While Writingspeedb: Rand Readspeedb: Read While Writingmemcached: 1:100apache-iotdb: 500 - 100 - 800 - 400apache-iotdb: 800 - 100 - 800 - 100clickhouse: 100M Rows Hits Dataset, First Run / Cold Cacheclickhouse: 100M Rows Hits Dataset, Second Runclickhouse: 100M Rows Hits Dataset, Third Runjohn-the-ripper: Blowfishjohn-the-ripper: bcryptjohn-the-ripper: WPA PSKliquid-dsp: 1 - 256 - 32liquid-dsp: 1 - 256 - 57liquid-dsp: 1 - 256 - 512liquid-dsp: 64 - 256 - 32liquid-dsp: 64 - 256 - 57liquid-dsp: 64 - 256 - 512liquid-dsp: 128 - 256 - 32liquid-dsp: 128 - 256 - 57liquid-dsp: 128 - 256 - 512liquid-dsp: 256 - 256 - 32liquid-dsp: 256 - 256 - 512liquid-dsp: 256 - 256 - 57numpy: openssl: RSA4096llamafile: llava-v1.5-7b-q4 - CPUllamafile: wizardcoder-python-34b-v1.0.Q6_K - CPUnpb: EP.Dnpb: LU.Cnpb: SP.Cnpb: IS.Dnpb: MG.Cnpb: CG.Cpgbench: 100 - 1000 - Read Writepgbench: 100 - 1000 - Read Onlyopenssl: RSA4096brl-cad: VGR Performance Metricsynthmark: VoiceMark_100lulesh: apache-iotdb: 500 - 100 - 800 - 400apache-iotdb: 800 - 100 - 800 - 100pennant: leblancbigpennant: sedovbigonnx: yolov4 - CPU - Standardonnx: yolov4 - CPU - Parallelonnx: fcn-resnet101-11 - CPU - Standardonnx: fcn-resnet101-11 - CPU - Parallelonnx: super-resolution-10 - CPU - Standardonnx: super-resolution-10 - CPU - Parallelonnx: bertsquad-12 - CPU - Standardonnx: bertsquad-12 - CPU - Parallelonnx: GPT-2 - CPU - Standardonnx: GPT-2 - CPU - Parallelonnx: ArcFace ResNet-100 - CPU - Standardonnx: ArcFace ResNet-100 - CPU - Parallelonnx: ResNet50 v1-12-int8 - CPU - Standardonnx: ResNet50 v1-12-int8 - CPU - Parallelonnx: CaffeNet 12-int8 - CPU - Standardonnx: CaffeNet 12-int8 - CPU - Parallelonnx: Faster R-CNN R-50-FPN-int8 - CPU - Standardonnx: Faster R-CNN R-50-FPN-int8 - CPU - Parallelonnx: T5 Encoder - CPU - Standardonnx: T5 Encoder - CPU - Parallelpybench: Total For Average Test Timespgbench: 100 - 1000 - Read Write - Average Latencypgbench: 100 - 1000 - Read Only - Average Latencyospray-studio: 1 - 4K - 1 - Path Tracer - CPUospray-studio: 1 - 4K - 16 - Path Tracer - CPUospray-studio: 1 - 4K - 32 - Path Tracer - CPUospray-studio: 3 - 4K - 1 - Path Tracer - CPUospray-studio: 3 - 4K - 16 - Path Tracer - CPUospray-studio: 3 - 4K - 32 - Path Tracer - CPUopenvino: Face Detection FP16-INT8 - CPUopenvino: Age Gender Recognition Retail 0013 FP16-INT8 - CPUopenvino: Person Detection FP16 - CPUopenvino: Weld Porosity Detection FP16-INT8 - CPUopenvino: Vehicle Detection FP16-INT8 - CPUopenvino: Person Vehicle Bike Detection FP16 - CPUopenvino: Machine Translation EN To DE FP16 - CPUopenvino: Face Detection Retail FP16-INT8 - CPUopenvino: Handwritten English Recognition FP16-INT8 - CPUopenvino: Road Segmentation ADAS FP16-INT8 - CPUopenvino: Person Re-Identification Retail FP16 - CPUopenvino: Noise Suppression Poconet-Like FP16 - CPUonednn: Deconvolution Batch shapes_3d - CPUbuild-linux-kernel: defconfigbuild-linux-kernel: allmodconfigbuild-ffmpeg: Time To Compilebuild-godot: Time To Compilebuild-nodejs: Time To Compilebuild-gem5: Time To Compilebuild-llvm: Ninjabuild-mesa: Time To Compilebuild-imagemagick: Time To Compilewrf: conus 2.5kmrelion: Basic - CPUm-queens: Time To Solvecloverleaf: clover_bm64_shortcloverleaf: clover_bm16gpaw: Carbon Nanotubenwchem: C240 Buckyballincompact3d: input.i3d 193 Cells Per Directionincompact3d: X3D-benchmarking input.i3dopenfoam: drivaerFastback, Small Mesh Size - Mesh Timeopenfoam: drivaerFastback, Small Mesh Size - Execution Timeopenfoam: drivaerFastback, Medium Mesh Size - Mesh Timeopenfoam: drivaerFastback, Medium Mesh Size - Execution Timeopenradioss: Cell Phone Drop Testopenradioss: INIVOL and Fluid Structure Interaction Drop Containeropenradioss: Chrysler Neon 1Mblender: BMW27 - CPU-Onlyblender: Classroom - CPU-Onlyblender: Fishy Cat - CPU-Onlyblender: Pabellon Barcelona - CPU-Onlyblender: Barbershop - CPU-Onlyblender: Junkshop - CPU-Onlyappleseed: Disney Materialcompress-pbzip2: FreeBSD-13.0-RELEASE-amd64-memstick.img Compressionavifenc: 0avifenc: 2avifenc: 6avifenc: 6, Losslessavifenc: 10, Losslessoctave-benchmark: helsing: 14 digitprimesieve: 1e12primesieve: 1e13y-cruncher: 500My-cruncher: 1Bqmcpack: Li2_STO_aeXeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN40.7716.2541.4540.8316.1716.00199.734191.818131976050120465207607071769313146013149752993937768428438276044409914427042114.6360964633326.8053.2253.29545.21128566.81736.2348122.168719.3710934.171128.7824676.865570.632237.6918375.639360.8940.9241.5865.3827.1130.3753.666.96013.256199.6089162.979165.49570.4267.36039.31173.2208153.16224993.3434795.46258.25334069.297616324.75.035.092.40577.7694.66858.84291.37150.331681.44501.39169.752039.6316.967214.19809.926843.05085251.305214.81222.425115.4341236.648195.45338.424031.4589171.231153.922754.805605.58934.662831.7109356.764354.754322248.757654.119553.93481943742846894966250.77798364181.2938.8819.9112.7430843417.81165.81189.79.675493.4129.530547.6755.53586.3380867.56038.926742395734103.460.5959139.272004.0550.016814.633497.93838.909122261037818.54055.49656.4005.852672.2542257839280012425519586147871175857373780240.568923185092771639423.30443.58438.6020549920677879709338950600704990001820053321546333332620066667883701250352076666744505250001493833333607730000020270000006284300000519.8961499.67.493.0516004.07455312.09228184.687437.81220893.7898764.93331108818812057021.65186677799.49170826.734286.7882.732.1594599.96452658.939470.4377100.738327.8753.980134.6543144.599664.78914.295315.1094826.086631.79075.839546.496931.324541.6491928.848131.53242.802632.8173969230.2031.14975912124242498981435833391234.240.4643.412.4814.6711.6928.175.1822.9657.136.9513.150.62425025.872189.73917.389103.376145.413157.363106.81516.18311.4935601.101155.7417.40231.90378.0538.0491809.75.39125967171.37577829.32512523.558932139.61713137.0380226.88100.0086.9312.7633.6117.2941.85125.8718.3143.6953991.43236260.52633.6502.8055.6134.5796.85648.0912.18725.0212.6595.11097.91163.0623.4963.6063.3023.4123.33106.395108.124665739579202388605477088956750654074438768367034415091693722362573801331830.2181476000026.9353.9253.99284.6481279.79403.2026943.424656.925725.03592.2012317.942924.661159.669515.866757.2624.2324.8038.0216.0616.6435.107.39215.966112.6611174.832177.86179.4377.87638.9397.186182.96632659.8832703.08829.14107835.13618378.33.313.321.58462.7891.51819.89319.76129.021277.46423.59140.531486.1222.968920.87959.118853.30836259.186234.54025.159119.6773270.329248.68266.516260.4094314.057308.801908.187830.72534.459533.3797460.775462.855200427.101030.840430.67991712281675292369998.356940153584.2038.0614.749.3830989618.01221.81242.69.803088.7129.526378.1742.93600.5195648.85062.074416363381463.470.6031177.237265.9327.78297.624054.45474.630310976634510.47734.30137.4604.648141.437872975179468926893315178381121684134752673.799270975194616807437.20455.79458.2310583110578142811640244000731406671877433319277666672475500000783770000314823333335032000001152933333316720000011787666673806833333520.2231594.416.614.088089.14232012.77109416.424059.70107321.8963760.457539616990461036735.6916904799.71738433.973280.2681.734.18270716.9691043.535547.8953109.670302.2663.857744.2635239.745150.83073.696494.0168715.037616.55343.183923.237801.100421.2029829.018529.95662.169662.1598069113.2640.5891441231255079817093199359522224.640.4939.622.3613.7311.1726.855.1921.8755.076.729.400.90716134.591316.90221.357122.718214.431187.507165.04817.25812.59510602.408290.44814.25739.38410.5943.0481878.310.1967066323.24569731.70490533.065393148.40248302.064127.90128.74157.5623.7263.6131.9180.29236.7332.0848.4250511.84753764.47534.7912.9715.7844.4566.45889.0704.25048.4063.3916.701105.9856.0120.1354.8456.4420.4620.2582.84886.967618069945232221992772376880469369770023935271731612642117322503885073035230.1160509700024.9749.7949.84167.83115106.30298.5615943.173325.903606.12477.779004.231643.431068.435943.664209.1020.2320.9750.0315.7117.8549.426.71915.06091.9925162.474164.25070.9087.06137.8679.380570.05402071.1892174.19223.54370531.07385808.82.712.711.29461.23120.93969.62380.14143.671205.30448.46148.451278.4519.859318.14138.597193.03922227.423205.52520.145316.0956222.029191.56252.816746.8491315.410313.100852.326784.30434.002132.3433357.355326.143173424.644521.932421.89321582161575022194630.600449147469.3287.1013.468.7227720514.61032.01069.17.942616.9129.724688.5680.23209.6179647.58088.113881902878623.080.5217891.621314.2333.99027.088551.29714.2689968874798.76228.71634.8922.970211.052742653661707841738276179617106953604481667.958779720690871770465.50486.05481.6694513945514012783650600067074667168823331890566667253920000074441000032006000003181266667918566667324380000010208333333500833333455.5727431.120.955.857562.80135125.1571245.262865.7283448.7033811.63712271748146974189.9833892711.37823072.302294.3385.164.95586516.0308050.352255.1204116.315329.0364.396494.8660449.637662.12764.499765.2152018.931921.34363.170023.192981.172921.2736829.408030.91652.796943.0650076514.0400.5721657313805802619773664968006356.380.43100.393.5817.8416.5062.466.4336.2055.999.7913.951.0774339.450362.45424.056140.233254.003210.934187.01719.22614.72411980.806373.18215.21139.48328.4747.7762070.312.9293413357.00971231.38458542.219419160.72685420.646731.49140.43207.2025.8968.6134.8387.92261.9735.9653.4902762.14485769.93137.7523.1696.2784.9237.53293.3484.57651.8203.2677.047109.3037.0814.0337.4437.5514.5914.08133.628140.828119106802107428462544771533026300727136953432847062440297294744220253297746877.5312440266724.5648.7648.77423.18189893.31654.8447654.955483.817862.58793.6420937.584744.051843.6115519.927356.6331.2432.0467.6424.7127.6554.886.48012.536152.7472154.502156.51665.2246.69837.04132.2806124.70843340.6943520.70545.96595560.851511263.24.414.482.18576.08115.47996.47331.76161.061730.25528.93174.951899.6415.555512.754610.836232.83498212.924188.89016.570514.5280180.032144.64036.249329.1487177.763156.461696.980566.37733.608230.0368288.471246.335271642.818838.223538.22691823422656173902076.24361253914.9338.8218.7011.1227547215.2963.6992.18.164853.6129.730108.7675.53210.1350187.57630.065927295570543.070.5134614.141773.0484.549913.751886.98458.370118776176915.45042.28150.5212.219481.1090052504999812321300551286958172970273245908.408016962083651785485.63507.56501.6318358318360379325336461000669913331684333320250000002655500000799496667355860000037236666671126466667611656666716169666675361266667456.1854601.110.443.8214946.76261127.09147311.143960.28163333.2158128.24673157781411916162.94136969712.69743724.062317.3692.232.52980711.2843864.285878.398992.3473352.7384.725305.2928760.358968.82995.551016.9061927.594434.30545.625176.390311.435731.7635329.753633.28993.465714.0588176714.8561.293894141383341110631683738813283.110.2945.782.5021.7315.0437.585.7225.1265.027.7215.960.73617029.981218.57019.506118.572172.990178.282122.31418.29313.2626674.12203.4077.88126.58214.8041.5631960.96.39169817196.80811635.60409728.556037162.02669196.4964428.22107.36115.8913.7435.9119.1346.38141.5421.1548.564181.46921067.37537.3113.0446.1725.0748.03650.8312.32527.1072.3645.008101.62951.5519.0152.9751.0519.4719.2063.62070.213444391851871619926127764120084817050745672808722659735415316132105821320091.1158849666723.3347.3247.34202.59135075.07285.9519183.832935.473802.61415.969087.122074.30860.646717.654208.4917.5218.1340.2313.3615.1739.566.32414.10175.4690144.698146.09762.7506.49029.0564.959758.42301590.5011755.33319.76893025.24235446.82.262.271.08383.57104.23841.68333.73119.73986.04375.73117.531047.9618.217916.17427.241872.62544217.880195.70521.170216.3251176.333191.11147.270340.7289330.104319.043728.469687.67129.997328.5164219.532337.004124319.910216.050216.08691501601143941614763.703237117588.9926.3011.867.4627764714.41126.41131.17.762170.7129.721286.6702.63225.7143755.33375.323147162077383.100.551852221766.5247.29795.134237.00513.1204680190887.54527.62928.2785.971301.45223205346154743966321145704887954084384040.528245566485744542446.40465.06470.026789367875286552365376676713033316906333164026666721387666676323966672351900000267003333380018666723818000008385300002848933333461.6122861.07.671.475366.69126171.5258815.363050.1685910.9535116.55699691792636697707.2713937711.10123848.540314.4490.025.93095721.0211254.959961.8256139.096380.9024.589125.1091447.241761.25475.677005.2278121.217924.55353.028973.133661.378311.4528033.334135.06654.575812.9709476314.2920.5591988370556897323574283780742236.520.3341.932.5016.3312.5428.735.2723.1255.747.1311.371.2640743.421428.38726.458149.378270.380220.569212.48220.17516.07513273.694412.37121.03041.43351.2954.3762530.513.9692376407.58940631.78187445.947435153.12467440.8311333.75160.56228.7431.6686.6742.78106.96320.1142.8558.3791162.63207776.91541.1253.7306.8364.9167.622123.8326.16067.3243.7818.300121.1942.3515.8441.6841.6516.6816.30108.397127.84588635753413323042229931277583382757101189899332344990849492732039672044719876.5315626166722.3445.9545.29373.50174862.56568.8137710.605576.867127.28795.6317252.273998.021691.7913102.285565.2326.0026.6951.9119.7522.2544.756.02311.897125.7494122.617122.08954.8235.99127.26104.8425107.62992709.9303196.12339.34573254.405410975.83.513.491.72467.91111.71932.59341.51141.951479.53447.50145.291604.1114.483113.08698.399622.17463205.885173.90916.639413.7366141.954135.97640.567132.8141174.677166.485604.755492.88527.607424.7274199.079246.680177635.932429.501829.34961502691995092993136.60183283665.7586.8116.9110.1727758913.81040.21041.87.623787.0129.730236.0651.93207.0288129.13347.934917294017073.090.5436900.542939.2441.651810.205172.32976.212613797720313.39247.51246.7057.300651.886794055331739624417419943570138592543373323.927750124880770465491.89499.18501.0713456213386656287536497667670640001690466719632333332494050000732560000325403333335964000001091460000467096666714440666674825133333435.2145531.07.771.7710970.45246822.52135939.253816.70172614.1065396.22589529760351395446.43658790710.91652102.668328.4194.842.88109913.2112569.450176.4227121.670460.6734.858185.7492160.112072.80187.041117.3484824.651030.47335.744916.005251.652702.0265936.228340.45345.022674.0527076316.9631.0271049166453892612371970145211256.630.2842.162.5317.1913.3429.985.5524.0056.717.3217.150.94507532.143246.93620.788123.882175.625184.298134.41918.47414.4027157.961214.41610.84032.25263.3342.87317857.29349117189.68611632.48199328.993119134.78213201.1095627.51114.29125.1516.5544.7123.1755.26169.4424.9951.2458981.98293269.64738.6533.7767.1215.31712.61765.0263.12133.9213.1106.334102.1251.3519.2451.5651.8619.2919.5870.84378.105518404367631889398078374771070266059201411545326374069006718779617444018621.2159799333323.7748.3548.14217.11140144.01301.3020910.532877.324093.73467.089686.392243.84894.877207.744386.4818.2418.8441.3413.8915.6840.826.50114.36283.4921149.996151.71865.3596.57231.4071.825365.33181771.0651952.60622.53999030.58726122.32.382.391.14398.40103.56852.36335.58123.691058.99386.00125.141108.9516.916616.38986.549652.61721213.985190.06320.010315.7394168.859188.93042.274742.2711296.799301.136705.606678.48329.425028.4798215.127346.213135622.362518.553318.48511581811304321855135.326098134048.9646.8212.508.0027726014.51127.51133.37.722514.0129.715081.0705.53229.1162727.43406.963423632433473.100.5520561.423250.2284.33365.970242.98343.6276735922308.28230.84332.1575.925011.50214234469939736650024407067499881764315467.178347564586354518461.62474.68476.917915279144334076365390006712766716885333167970000023089666676890033332739633333297240000088220000027690666679445500003222533333464.7225441.58.131.546445.09131606.8669776.413076.6686407.4635234.06722251607424813667.6767812712.01325831.838309.0389.535.11416119.8824659.179561.0107155.788382.1094.672695.2607549.974063.53535.919615.2902723.662523.65653.370343.320301.416621.4724933.987735.11104.647572.8873476213.8450.6221792337906254021233923873366257.500.3759.692.6719.4413.5938.505.7724.9462.537.7612.721.1964340.501384.06324.840143.808252.648215.496197.84419.65015.37612410.29384.38418.10242.22357.5748.4872245.212.7997582351.64416531.99824841.746192150.66848410.2900531.92146.03212.9928.4976.8738.4897.80290.5639.1756.4016982.28776673.06039.8763.5506.6054.8677.748107.2375.33258.1593.7047.959117.8138.3014.9637.9137.8414.7414.92114.902133.990103382860113375645220531484669627050118114895735352291240334737273521529721583.2320516100023.3046.5946.79401.45176900.32569.6040032.815525.567689.32889.1818561.914351.591801.8914033.945933.6528.9629.6252.2322.1424.6546.256.07711.967129.7482124.263127.54655.9796.05227.90112.7231116.60532872.5623349.75644.66830262.635712115.03.653.661.74477.33107.30940.40308.95135.281528.41449.91138.391677.6214.458312.59748.260162.10480199.896169.85017.987313.5190132.712136.68933.962129.1955161.886153.407581.769478.46727.777224.6818185.46252.671185239.338933.112533.12751643012275583279262.53034965663.8237.4116.6410.4427729813.31039.21046.07.464386.6129.711866.7663.83222.8316359.24382.975255144691313.090.5440368.645195.1483.104911.887583.33957.207514940908214.12752.24451.8162.563191.7677847375594611223329497907490153544003392842.387805772880139566460.66467.96471.7915665815595965788936521333662660001688400020904666672491340000757176667333706666738965000001206066667536703333315189333335036000000439.8448534.87.261.5412793.01257384.55141954.153819.83171436.4766492.44600469207251627941.44075342712.08553269.469325.9795.392.52736312.1069069.201479.3770121.780475.2545.002225.8862855.901973.96847.532597.3082229.444834.25076.177966.517441.718752.0878036.003940.51785.391233.9581976316.6551.098961153573617911431811141971278.520.3064.912.7920.2414.4241.576.0225.7262.117.9718.720.86435830.530231.03320.008122.704171.174181.629128.06618.13814.0946840.057201.3829.28532.44269.2043.9111873.16.66387510187.22400428.84015727.577291159.31171186.3253927.63110.56117.9115.2940.3821.4551.29156.7023.4549.1361751.71129668.43738.1363.7387.0385.31112.57858.2482.69130.1962.9616.266106.2717.287.0816.9716.827.077.02236.610309.2192762677664039145597120019903520599671714061761087108661819195076765271954759466.6446728133327.4355.1155.01205.03178488.031095.7920550.9311735.429752.891110.4935809.595766.624013.9612665.628231.7262.8263.4874.0343.3945.2655.05231.4272161.339163.79587.8248.51331.95210.4367214.01785915.2537730.47178.49615844.950231157.83.453.471.64464.7886.08738.31248.03120.111560.56391.40137.501897.647.248696.318285.497110.857685119.558587.257911.27078.75971161.947110.16823.496015.0516141.830100.4600446.805310.59144.063524.0540263.524276.207390660.374855.338255.25761794082975838448083.72998010.6133.0822.5830174016.81392.51321.48.426999.7112.225977.4664.73125.4644091.014185.174136611164653.620.56123480121976.9508.092619.4052116.122611.910739912422322.52553.77162.00020.752596.383431031209151198516641059546533333075748683410.79106778379124947288513.92528.21526.36374589376268129400036040000554156671308313322793000002772800000849340000440790000047593666671394733333793526666723943333338012700000540.9698237.014.295.2422166.60551955.55390520.9312296.27244738.8188487.915527234809093214376.36193921783.20054678.485246.0861.462.0768353.081108137.989158.265182.2681165.938.3996911.458090.0621114.1586.171909.0660742.887966.43557.096829.952452.246453.2178122.788641.56963.807923.6179281818.1590.2895618916178556601051420893233.630.3543.779.254.084.9143.175.3433.1811.953.7822.201.00191425.872181.99517.83996.161114.912161.93689.27516.40111.7204431.34493.1684.13322.83223.5424.1341429.93.75319901167.12816426.82362722.707989135.516393.56811522.5279.4249.557.7518.6710.1623.8467.5211.471.10944663.40435.3162.8905.9504.9436.95530.6941.19912.1304.5108.99291.96634.7113.8934.9034.6913.9514.08151.948187.6841384095889834586513191399600710926785972059996354490408477338392565207753167.8237614900027.6155.3855.56101.51138605.52433.069997.896017.195608.07576.9817230.352986.332212.416846.796963.3140.0040.5078.1529.1832.7462.707.54717.016155.1208162.475165.75386.2988.59532.12133.4769130.78743798.6954692.10645.24579427.582415786.62.642.661.28425.25104.52868.54330.26123.371301.26406.58121.961392.919.736859.800085.665081.25179122.948108.86813.974512.2807162.092161.49741.474529.8493243.340178.698672.916590.70746.876428.7250279.641446.303239634.644732.518832.52321653002015464152864.875380206619.29212.4324.6916.2130083317.21385.31324.98.455656.9112.229384.9680.73114.2319827.214955.65791127160653.610.5764260.274389.0500.767310.322473.37966.302721452465915.22239.99846.8919.335343.4108552331009114158419537633034195957778634258.39126161028144760448566.31597.73595.1919257419289867132236066000554553331338733322874666672862000000850586667435353333347553333331368733333586246666715704000005811900000542.1548996.825.388.4811424.05362511.43225311.826346.15134994.1462071.107949239893581613828.73122574783.42227287.261209.6852.933.3604535.460660102.734102.035178.032801.9618.133269.1852471.556481.43196.166686.1847824.109733.49944.109145.594911.485961.6930721.578434.81263.575432.2392281812.5800.2511037166033864512251953544349471.980.45110.919.427.858.4883.115.4132.0021.636.9313.521.1192332.889290.34119.991103.352147.837176.876124.45516.66812.1997885.16176.4226.95042.17245.8230.0011450.56.88121279309.84765325.93164628.325594118.54229178.2538220.4594.7677.3214.2935.6618.3644.87123.9018.6540.9189611.36906361.62934.0442.7235.7574.7706.85756.9121.98423.2654.3127.47197.00435.0113.8434.9034.6514.0513.95136.945171.7711264751376903962757549789728843612376769655366750331102112335096099835750909.6228280200027.6655.6155.5993.99133779.62306.279356.715528.155024.32525.8816038.902739.011743.496554.125697.5138.9039.5876.8328.0131.4462.027.43116.730132.4918172.875178.51687.9938.42231.72113.2783110.52533423.6344294.28339.08626228.318514207.72.732.731.31470.95114.63942.19354.59138.111278.58447.61140.011363.339.860189.785165.550181.25135122.683109.99813.864712.2549126.816156.61039.258629.2690225.308190.382604.045586.17842.069229.8381187.012374.745207730.607328.095628.06891602641735113926265.277120186675.43211.3421.3214.2929834117.21388.91328.58.385239.6112.227695.2684.73105.9294183.212394.65495006426263.620.5742172.446233.7449.11419.184465.30255.630119770835012.51436.15142.5078.182752.8787740927294914608544428557054180249938220895.45125562060142102254536.82562.50559.5516654116654164347536068333554253331339466722827666672859833333811373333403273333342563000001158166667527193333313621666675266466667529.8035964.925.758.3510652.03269047.28125191.115229.41116725.0453182.777998736032611436324.93161216783.77826082.711211.8553.773.7548355.916458101.4686102.191182.017800.2318.150929.0895572.123281.60417.885846.3778025.478934.16364.461355.253211.660461.7057923.919833.52095.346562.6671181812.5020.2781180188964329013912230550019510.100.48157.4510.098.589.4791.165.8534.9227.467.2316.321.1548734.567311.82520.494111.688164.021185.300135.66616.96313.47110176.864238.8817.73846.50334.3034.8661575.58.25383511466.54801428.03102232.591783136.39912325.4233122.53100.24176.1415.9640.2620.1548.88139.2521.0243.4540511.42295461.99234.1482.7565.7994.7927.52862.1732.05824.2373.8506.743108.0217.077.0417.4116.247.207.14217.846291.2782516456298877882225738317850068790671526505465813100150263486069892582222343531.0432493033326.4152.7952.81188.74172688.50750.1118666.1610708.919203.19990.1631974.885178.293353.7312024.187810.6561.0761.1172.6840.9642.0353.44185.7110167.223171.21886.3418.34928.81175.5971176.20615446.1617281.95868.86850542.515826702.73.483.491.67525.8482.94727.77227.22133.871524.74401.84161.901862.796.412296.348914.538170.91704395.837286.923010.66158.80930102.572109.46423.578615.0082133.485100.3586444.847315.35539.803525.6265167.107271.620333552.674147.614347.52671783682625537975907.45064910.5629.6117.8929961017.01382.11324.68.306835.7112.222931.8673.43098.5593246.912708.576173410332773.620.5781025.886757.7491.534417.0098105.405210.601837075153020.23450.12157.09917.811055.2783981514511020108289857687179303245968498306.78108821580125595607504.84529.80525.23316492320527125333336033000549546671339066722820666672730233333824583333406333333342809333331199966667751333333321295333337411866667529.0371942.014.475.2419414.94472931.04256584.6710139.69194942.3284477.725550534227312861959.86162228782.32248760.815240.4361.072.3129773.408337155.960157.505220.3511094.25610.434411.502493.8340113.5179.746149.1245242.513766.62857.555589.962452.250203.1706425.317139.01765.984363.6800182218.0590.29366110428207507801242727943253.630.3563.9810.174.465.2048.435.9836.9014.303.9823.121.00947327.678197.63018.089102.583118.902164.89994.81016.40912.7496918.021145.6474.60930.05266.1025.8441558.44.26078596248.86731527.73771225.005632140.48261124.2994623.5385.8977.648.6121.1211.2526.3579.0512.871.12632962.88735.4022.8105.8464.8297.64533.6751.24212.6314.3298.196102.9827.6810.8827.7827.5310.9111.01229.913232.74916126916228052746634113116722114187099753900787365639632938745703974887050139.9227535266723.3647.3147.33115.78132973.43283.1811508.195778.515594.81621.4219917.543280.251671.237862.655310.0738.4739.0868.5629.0032.4454.466.46514.785156.3909163.413169.23078.7397.28328.16133.9297126.14565747.8235818.73644.97082623.62669320.53.123.161.50450.61106.14924.80314.67125.761454.71462.79135.171620.538.295338.635946.011643.13156106.13094.736511.41829.6529689.7350137.19330.857224.6095160.904153.246382.103452.32337.958527.4471131.004319.452250837.738135.246135.14641513042075354525288.003014177989.89112.4123.7616.7925069513.81139.91102.26.685973.8112.125194.6596.22596.1374413.512731.85754407808713.040.4828476.628854.3527.799712.318786.01397.557318976379913.24240.38647.9867.997562.8886957323545215776186589951070228294267736018.74116685326131781309433.79450.12458.9622018822018880318729907333462700001117450018987666672444933333709650000379156666747145000001369800000658820000017447000006401366667425.4653966.920.647.4712575.30279397.45127519.375702.13125567.0743799.787224434224921872096.13484477655.79524218.831227.4058.113.6543035.147658120.556115.790166.793319.3489.4217710.553787.6552103.59711.13927.2808732.474440.63306.227916.523672.616532.2102026.445836.44607.633373.1290497413.8430.292954152863738311301812942945551.070.73230.2410.9210.9711.35102.846.2538.8538.218.0322.670.94362138.526337.68523.217128.279186.103212.546146.76119.90616.38811895.407360.2076.35048.36400.5233.12017008.87225914534.05942830.38137233.814223167.40625449.4659723.69106.54231.9612.8631.6516.5839.83114.7617.7045.0780871.35573773.27140.3513.2516.8535.6628.80148.8491.92121.7623.9686.928110.8013.685.7913.1113.765.755.71214.617288.53732025868623710477663304723166119452831983103026700130692850757390602860899042113.5278303908323.2847.1347.14231.83166151.42750.9622499.0312750.5910182.161127.0538546.666400.944032.6614601.526513.3654.8854.5759.0137.1338.1246.00208.3131159.746168.77977.5967.15328.11200.1612190.08395365.4217213.43384.68859441.872717873.13.593.571.71588.4367.08658.97176.00131.381403.46397.44174.931876.666.749775.557674.914202.5170998.637478.067610.751887.9840286.686499.218218.013311.9382117.61788.3741316.113270.63135.871226.3257127.537250.634401263.845956.693656.44851644033105678171241.7085129.6532.2622.0025107513.71139.01104.26.648396.7112.129877.1576.82590.8759922.111208.777696813402263.030.4852639.554066.0462.238222.0023121.301714.103830120223221.30551.62958.83918.974545.836061135206564229001521169947385365932047645325.70103630483115317834411.26420.35427.95415412412723155100029893333462296671127366718949666672374766667709393333379413333346265666671349800000643900000017348000006316266667422.76107830.610.944.6322017.75588329.32214017.189771.41245447.7263265.015922830446203729470.85861750655.04646126.080253.1366.542.0843842.940456148.208179.989203.571397.42910.2310612.809393.6360125.24411.577410.066655.915883.76608.5180811.31483.164413.6960227.897538.00007.840653.9873597216.8840.3295318413169606301001520071275.530.4185.8611.2056.2756.736.639.8615.844.3728.100.82965330.680210.19721.224126.112147.735192.977101.56119.55815.8107365.863201.2653.98127.74349.6727.1451712.64.51061893253.31855329.47448424.570122192.41705137.1138527.8690.8593.997.1716.829.7121.6665.5811.211.06839874.68941.9163.3416.9865.7408.84826.7761.35911.5574.1007.915111.1533.4913.1933.6833.7613.2813.26107.353107.715745847210072437846082053978493137346230975053030706893837721118566172724526.0115005266723.2546.8746.8853.8987511.11197.915366.792943.082830.12317.389256.111542.61998.093692.673636.3323.7124.3154.6017.0419.2550.046.11813.96875.2149160.785165.08968.1886.93928.1364.325362.18662683.8312692.87321.81757722.19724660.01.791.800.86313.5087.31673.42276.9398.70843.63308.46101.17875.238.874468.758144.664912.57278106.52697.050812.38849.800989.2081128.98230.374327.3128219.058207.336443.058547.52436.077227.9362127.085255.671126618.470517.966817.94481231721123792274636.131544153818.0317.3813.819.3925002413.91118.81101.46.763193.0112.119375.9557.92593.3172566.85826.443313573679893.030.4816704.416573.2294.62095.742041.02253.5146991981446.49924.24627.5325.706721.519012661865379333645274091778120539016198256.72105432862116879799323.59337.32338.84102198102222386212298996674621066711290000187133333321868333336338600003047066667298280000080991666730622000008210133333116933333421.9925894.621.005.166416.34133284.4652745.642746.2063930.6422229.94612722606500881480.8851997655.23916949.591251.4765.666.54176811.36964112.728114.174216.703388.7439.3868110.302680.7232102.050311.20477.7452132.920136.61194.570294.825062.257161.8244327.928135.79437.873253.9100697616.3210.3842043388117205124214537784261592.220.53161.4811.7810.7811.22100.676.7741.3831.998.5917.301.4983544.276406.41427.536154.010277.525242.931205.01421.03517.91716146.997468.68813.25057.38495.2563.7962024.720.9379139567.28694733.67316258.169235163.69864691.6422433.23176.87297.2527.1267.6734.3585.12240.1335.8256.4175182.20049775.86441.6573.4847.1825.7358.929105.6763.80145.9535.07710.205137.2333.2313.1533.3033.1813.2813.1898.20797.978678067303872219447097348896539085741589396320728205332707719330509364324548.8114710800023.2746.8646.9348.7378334.92204.054830.012763.482506.10293.078279.631396.78918.533355.733405.9422.4623.0251.5115.7717.8044.926.00013.61473.9073153.417157.36264.7876.72727.7463.343358.27762455.1632449.45420.99773222.13414564.31.691.690.80295.2980.86617.03256.7992.82771.47287.4295.63796.828.752338.472834.465332.25453102.96696.167911.54478.8714488.5688129.64631.064426.2475211.187203.055446.689553.47137.530227.8703127.208254.727117716.920016.450416.45051201631053632069432.528093141831.7766.9313.008.4825016213.81144.81096.56.742818.5112.119485.8563.62593.0153920.85821.463190943383553.030.4815903.416399.7273.67035.240637.95973.1993906581566.24621.93525.3345.449711.461632349926368934176242940110118821035820618.18105138551117884977322.69337.44335.469347393472339998298993334548633311236333177686666720263333335772633332767933333268706666773175666727896000007417400002793700000418.8921047.520.655.115745.04130839.1252684.932718.9462449.5521684.80553952416375810291.8771352656.25016855.891251.0564.936.85271212.15132114.311118.023226.626443.9619.7113110.397786.6515112.76011.28647.7051132.229438.10274.742214.926532.238681.8057326.829035.88317.860153.9245597418.0530.4142240425137809326494884491643654.830.6156.5913.1111.4812.67109.007.6045.7134.769.4618.491.7974946.352438.16828.420159.624288.118251.606215.92521.53018.17516609.781496.24114.49357.54498.2266.7052224.621.1780307568.25404936.82344159.266377188.37105690.7350335.95187.03300.6930.0775.2638.0494.41263.7638.8661.3624632.32119578.24142.6053.6237.3015.7348.948120.5604.54554.3895.16510.427151.27OpenBenchmarking.org

CPU Power Consumption Monitor

OpenBenchmarking.orgWattsCPU Power Consumption MonitorPhoronix Test Suite System MonitoringXeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN170340510680850Min: 39.72 / Avg: 455.07 / Max: 946.96Min: 17.77 / Avg: 260.08 / Max: 405.42Min: 30.38 / Avg: 278.1 / Max: 383.24Min: 87.48 / Avg: 517.33 / Max: 758.17Min: 38.11 / Avg: 291.53 / Max: 379.76Min: 102.49 / Avg: 566.6 / Max: 756.48Min: 38.16 / Avg: 295.53 / Max: 384.53Min: 95.52 / Avg: 569.8 / Max: 760.61Min: 33.66 / Avg: 525.49 / Max: 837.69Min: 17.06 / Avg: 290.08 / Max: 413.51Min: 14.69 / Avg: 244.69 / Max: 373.1Min: 35.7 / Avg: 464.49 / Max: 751.79Min: 10.09 / Avg: 225.05 / Max: 397.44Min: 20.22 / Avg: 375.51 / Max: 735.74Min: 8.43 / Avg: 128.7 / Max: 184.62Min: 9.26 / Avg: 114.13 / Max: 155.71

PyTorch

OpenBenchmarking.orgbatches/sec Per Watt, More Is BetterPyTorch 2.2.1Device: CPU - Batch Size: 64 - Model: ResNet-50Xeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN0.07610.15220.22830.30440.38050.0800.2580.2230.0760.1930.0740.1860.0660.0420.1500.1790.0460.1750.0460.3080.338

OpenBenchmarking.orgbatches/sec Per Watt, More Is BetterPyTorch 2.2.1Device: CPU - Batch Size: 64 - Model: ResNet-152Xeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN0.02840.05680.08520.11360.1420.0300.0890.0760.0270.0670.0270.0660.0250.0160.0570.0680.0180.0660.0180.1140.126

OpenBenchmarking.orgbatches/sec Per Watt, More Is BetterPyTorch 2.2.1Device: CPU - Batch Size: 256 - Model: ResNet-50Xeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN0.07520.15040.22560.30080.3760.0820.2930.2180.0770.1970.0730.1890.0660.0400.1500.1790.0480.1760.0440.3050.334

OpenBenchmarking.orgbatches/sec Per Watt, More Is BetterPyTorch 2.2.1Device: CPU - Batch Size: 256 - Model: ResNet-152Xeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN0.02840.05680.08520.11360.1420.0300.0880.0760.0270.0680.0270.0680.0250.0150.0570.0680.0180.0670.0180.1140.126

OpenBenchmarking.orgbatches/sec Per Watt, More Is BetterPyTorch 2.2.1Device: CPU - Batch Size: 512 - Model: ResNet-50Xeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN0.07470.14940.22410.29880.37350.0800.2580.2250.0770.1920.0730.1880.0660.0400.1490.1780.0440.1750.0460.3050.332

OpenBenchmarking.orgbatches/sec, More Is BetterPyTorch 2.2.1Device: CPU - Batch Size: 64 - Model: ResNet-50Xeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN1428425670SE +/- 0.12, N = 3SE +/- 0.12, N = 3SE +/- 0.24, N = 3SE +/- 0.50, N = 3SE +/- 0.71, N = 3SE +/- 0.51, N = 3SE +/- 0.62, N = 3SE +/- 0.46, N = 4SE +/- 0.37, N = 12SE +/- 0.10, N = 3SE +/- 0.26, N = 3SE +/- 0.35, N = 12SE +/- 0.10, N = 3SE +/- 0.23, N = 9SE +/- 0.06, N = 3SE +/- 0.18, N = 340.7763.0656.0137.0851.5542.3551.3538.3017.2834.7135.0117.0727.6813.6833.4933.23MIN: 16.88 / MAX: 42.06MIN: 33.2 / MAX: 65.54MIN: 51.84 / MAX: 59.12MIN: 26.46 / MAX: 40.15MIN: 37.49 / MAX: 54.33MIN: 36.76 / MAX: 44.4MIN: 41.6 / MAX: 53.81MIN: 27.11 / MAX: 40.39MIN: 13.59 / MAX: 19.8MIN: 33.58 / MAX: 35.7MIN: 33.84 / MAX: 36.39MIN: 11.04 / MAX: 19.93MIN: 26.61 / MAX: 28.44MIN: 10.81 / MAX: 14.92MIN: 32.03 / MAX: 34.13MIN: 31.97 / MAX: 33.93

OpenBenchmarking.orgbatches/sec, More Is BetterPyTorch 2.2.1Device: CPU - Batch Size: 64 - Model: ResNet-152Xeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN612182430SE +/- 0.15, N = 12SE +/- 0.34, N = 3SE +/- 0.18, N = 3SE +/- 0.17, N = 3SE +/- 0.19, N = 5SE +/- 0.21, N = 3SE +/- 0.17, N = 12SE +/- 0.05, N = 3SE +/- 0.15, N = 9SE +/- 0.10, N = 3SE +/- 0.17, N = 3SE +/- 0.13, N = 9SE +/- 0.02, N = 3SE +/- 0.03, N = 3SE +/- 0.16, N = 3SE +/- 0.03, N = 316.2523.4920.1314.0319.0115.8419.2414.967.0813.8913.847.0410.885.7913.1913.15MIN: 6.19 / MAX: 17.5MIN: 19.73 / MAX: 24.56MIN: 17.06 / MAX: 21.01MIN: 8.98 / MAX: 15.41MIN: 11.15 / MAX: 20.08MIN: 6.82 / MAX: 16.51MIN: 10.95 / MAX: 20.39MIN: 10.89 / MAX: 15.42MIN: 3.61 / MAX: 8.09MIN: 13.54 / MAX: 14.15MIN: 13.51 / MAX: 14.34MIN: 3.58 / MAX: 7.91MIN: 10.75 / MAX: 11.02MIN: 3.25 / MAX: 6.39MIN: 12.44 / MAX: 13.62MIN: 12.52 / MAX: 13.35

OpenBenchmarking.orgbatches/sec, More Is BetterPyTorch 2.2.1Device: CPU - Batch Size: 256 - Model: ResNet-50Xeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN1428425670SE +/- 0.29, N = 3SE +/- 0.64, N = 3SE +/- 0.52, N = 3SE +/- 0.49, N = 3SE +/- 0.76, N = 3SE +/- 0.52, N = 3SE +/- 0.62, N = 3SE +/- 0.45, N = 3SE +/- 0.32, N = 12SE +/- 0.09, N = 3SE +/- 0.21, N = 3SE +/- 0.37, N = 12SE +/- 0.08, N = 3SE +/- 0.28, N = 12SE +/- 0.18, N = 3SE +/- 0.13, N = 341.4563.6054.8437.4452.9741.6851.5637.9116.9734.9034.9017.4127.7813.1133.6833.30MIN: 38.42 / MAX: 42.93MIN: 37.79 / MAX: 65.67MIN: 46.5 / MAX: 58.5MIN: 26.88 / MAX: 41.26MIN: 33.28 / MAX: 55.78MIN: 37.38 / MAX: 44.02MIN: 30.49 / MAX: 54.7MIN: 16.15 / MAX: 40.53MIN: 14.73 / MAX: 19.36MIN: 34.15 / MAX: 35.71MIN: 33.85 / MAX: 35.99MIN: 11.49 / MAX: 19.87MIN: 26.81 / MAX: 28.37MIN: 8.01 / MAX: 14.98MIN: 31.27 / MAX: 34.43MIN: 32.26 / MAX: 33.94

OpenBenchmarking.orgbatches/sec, More Is BetterPyTorch 2.2.1Device: CPU - Batch Size: 512 - Model: ResNet-50Xeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN1428425670SE +/- 0.30, N = 15SE +/- 0.19, N = 3SE +/- 0.12, N = 3SE +/- 0.21, N = 3SE +/- 0.72, N = 3SE +/- 0.26, N = 3SE +/- 0.43, N = 15SE +/- 0.34, N = 15SE +/- 0.29, N = 12SE +/- 0.19, N = 3SE +/- 0.10, N = 3SE +/- 0.23, N = 3SE +/- 0.04, N = 3SE +/- 0.22, N = 12SE +/- 0.08, N = 3SE +/- 0.11, N = 340.8363.3056.4437.5551.0541.6551.8637.8416.8234.6934.6516.2427.5313.7633.7633.18MIN: 15.4 / MAX: 43.41MIN: 48.94 / MAX: 65.25MIN: 48.09 / MAX: 58.6MIN: 24.5 / MAX: 40.69MIN: 40.71 / MAX: 53.89MIN: 31.6 / MAX: 43.65MIN: 30.55 / MAX: 55.87MIN: 19.63 / MAX: 40.77MIN: 11.96 / MAX: 19.26MIN: 33.34 / MAX: 35.97MIN: 33.72 / MAX: 35.48MIN: 11.41 / MAX: 17.76MIN: 26.63 / MAX: 28.06MIN: 9.99 / MAX: 14.97MIN: 31.39 / MAX: 34.3MIN: 32.26 / MAX: 33.81

OpenBenchmarking.orgbatches/sec, More Is BetterPyTorch 2.2.1Device: CPU - Batch Size: 512 - Model: ResNet-152Xeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN612182430SE +/- 0.18, N = 3SE +/- 0.16, N = 3SE +/- 0.04, N = 3SE +/- 0.09, N = 3SE +/- 0.18, N = 7SE +/- 0.09, N = 3SE +/- 0.18, N = 7SE +/- 0.16, N = 3SE +/- 0.13, N = 9SE +/- 0.12, N = 3SE +/- 0.18, N = 3SE +/- 0.14, N = 9SE +/- 0.02, N = 3SE +/- 0.11, N = 9SE +/- 0.11, N = 3SE +/- 0.09, N = 316.1723.4120.4614.5919.4716.6819.2914.747.0713.9514.057.2010.915.7513.2813.28MIN: 11.54 / MAX: 16.69MIN: 22.41 / MAX: 24.3MIN: 17.25 / MAX: 21.16MIN: 10.11 / MAX: 16.06MIN: 11.79 / MAX: 20.53MIN: 7.02 / MAX: 17.07MIN: 10.66 / MAX: 20.07MIN: 10.63 / MAX: 15.36MIN: 3.53 / MAX: 7.83MIN: 13.65 / MAX: 14.33MIN: 13.72 / MAX: 14.61MIN: 3.59 / MAX: 8.29MIN: 10.79 / MAX: 11.05MIN: 2.81 / MAX: 6.42MIN: 12.91 / MAX: 13.58MIN: 12.1 / MAX: 13.57

OpenBenchmarking.orgbatches/sec, More Is BetterPyTorch 2.2.1Device: CPU - Batch Size: 256 - Model: ResNet-152Xeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN612182430SE +/- 0.16, N = 3SE +/- 0.29, N = 3SE +/- 0.08, N = 3SE +/- 0.13, N = 7SE +/- 0.15, N = 3SE +/- 0.09, N = 3SE +/- 0.15, N = 3SE +/- 0.18, N = 4SE +/- 0.13, N = 9SE +/- 0.20, N = 3SE +/- 0.11, N = 3SE +/- 0.13, N = 9SE +/- 0.15, N = 3SE +/- 0.12, N = 9SE +/- 0.06, N = 3SE +/- 0.04, N = 316.0023.3320.2514.0819.2016.3019.5814.927.0214.0813.957.1411.015.7113.2613.18MIN: 11.43 / MAX: 16.66MIN: 19.78 / MAX: 24.54MIN: 17.03 / MAX: 21.21MIN: 6.98 / MAX: 15.46MIN: 10.93 / MAX: 20MIN: 11.86 / MAX: 16.95MIN: 13.13 / MAX: 20.27MIN: 8.28 / MAX: 15.85MIN: 3.92 / MAX: 8.02MIN: 13.43 / MAX: 14.62MIN: 13.45 / MAX: 14.29MIN: 3.67 / MAX: 7.91MIN: 10.7 / MAX: 11.43MIN: 3.18 / MAX: 6.47MIN: 12.98 / MAX: 13.46MIN: 12.94 / MAX: 13.34

miniBUDE

OpenBenchmarking.orgBillion Interactions/s Per Watt, More Is BetterminiBUDE 20210901Implementation: OpenMP - Input Deck: BM1Xeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN0.31790.63580.95371.27161.58950.5030.4450.3240.2910.2620.2280.2800.2310.6110.6400.7060.6551.4130.7321.0081.043

OpenBenchmarking.orgBillion Interactions/s Per Watt, More Is BetterminiBUDE 20210901Implementation: OpenMP - Input Deck: BM2Xeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN0.19060.38120.57180.76240.9530.3190.3340.2750.2440.2450.2110.2480.2150.5320.5510.6050.5880.8470.6690.7460.789

OpenBenchmarking.orgBillion Interactions/s, More Is BetterminiBUDE 20210901Implementation: OpenMP - Input Deck: BM1Xeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN50100150200250SE +/- 1.02, N = 8SE +/- 0.20, N = 6SE +/- 0.61, N = 5SE +/- 0.81, N = 7SE +/- 0.12, N = 4SE +/- 1.28, N = 12SE +/- 0.84, N = 15SE +/- 1.85, N = 12SE +/- 6.15, N = 12SE +/- 3.27, N = 13SE +/- 1.18, N = 7SE +/- 2.97, N = 13SE +/- 0.70, N = 9SE +/- 3.98, N = 15SE +/- 0.04, N = 6SE +/- 0.03, N = 6199.73106.4082.85133.6363.62108.4070.84114.90236.61151.95136.95217.85229.91214.62107.3598.211. (CC) gcc options: -std=c99 -Ofast -ffast-math -fopenmp -march=native -lm

OpenBenchmarking.orgBillion Interactions/s, More Is BetterminiBUDE 20210901Implementation: OpenMP - Input Deck: BM2Xeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN70140210280350SE +/- 1.93, N = 15SE +/- 0.03, N = 3SE +/- 0.31, N = 3SE +/- 0.99, N = 3SE +/- 0.31, N = 3SE +/- 1.48, N = 3SE +/- 0.96, N = 4SE +/- 0.93, N = 3SE +/- 2.28, N = 3SE +/- 1.71, N = 3SE +/- 0.93, N = 3SE +/- 0.08, N = 3SE +/- 0.01, N = 3SE +/- 3.85, N = 3SE +/- 0.01, N = 3SE +/- 0.00, N = 3191.82108.1286.97140.8370.21127.8578.11133.99309.22187.68171.77291.28232.75288.54107.7297.981. (CC) gcc options: -std=c99 -Ofast -ffast-math -fopenmp -march=native -lm

OpenSSL

OpenSSL is an open-source toolkit that implements SSL (Secure Sockets Layer) and TLS (Transport Layer Security) protocols. This test profile makes use of the built-in "openssl speed" benchmarking capabilities. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgbyte/s, More Is BetterOpenSSL 3.3Algorithm: SHA256Xeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN70000M140000M210000M280000M350000MSE +/- 29142783.86, N = 3SE +/- 23323764.84, N = 3SE +/- 159515825.53, N = 3SE +/- 66583540.43, N = 3SE +/- 27466135.54, N = 3SE +/- 126029257.64, N = 3SE +/- 33334799.97, N = 3SE +/- 70647143.49, N = 3SE +/- 160246527.97, N = 3SE +/- 146384349.91, N = 3SE +/- 38601729.93, N = 3SE +/- 210407867.05, N = 3SE +/- 34182873.86, N = 3SE +/- 80639802.67, N = 3SE +/- 10642001.84, N = 3SE +/- 64797308.82, N = 3131976050120665739579206180699452311910680210744439185187886357534135184043676310338286011327626776640313840958898312647513769025164562988716126916228032025868623774584721007678067303871. (CC) gcc options: -pthread -m64 -O3 -lssl -lcrypto -ldl

OpenBenchmarking.orgbyte/s, More Is BetterOpenSSL 3.3Algorithm: SHA512Xeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN20000M40000M60000M80000M100000MSE +/- 14734422.48, N = 3SE +/- 37654528.63, N = 3SE +/- 203213936.42, N = 3SE +/- 481040738.21, N = 3SE +/- 500176.69, N = 3SE +/- 3500318.33, N = 3SE +/- 1250834.62, N = 3SE +/- 14339684.98, N = 3SE +/- 44023374.36, N = 3SE +/- 55712209.05, N = 3SE +/- 6285194.15, N = 3SE +/- 37307640.51, N = 3SE +/- 5822493.86, N = 3SE +/- 17716195.81, N = 3SE +/- 15082903.45, N = 3SE +/- 9990938.84, N = 34652076070723886054770222199277234284625447716199261277323042229931889398078337564522053914559712004586513191339627575497788222573835274663411310477663304724378460820221944709731. (CC) gcc options: -pthread -m64 -O3 -lssl -lcrypto -ldl

OpenBenchmarking.orgbyte/s Per Watt, More Is BetterOpenSSL 3.3Algorithm: AES-128-GCMXeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN700M1400M2100M2800M3500M2589909503.872600338214.732333237948.272275619248.612035473064.321967868118.182214398499.062168460340.432480518885.862482510440.032686039538.132638396952.003351926704.373291374680.153225126995.223483917754.10

OpenBenchmarking.orgbyte/s Per Watt, More Is BetterOpenSSL 3.3Algorithm: AES-256-GCMXeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN600M1200M1800M2400M3000M2193171119.612177657519.612048623453.071998240264.781651813451.151587520126.441789501537.541745319585.662139406659.572144285710.422331206946.712286984508.792889219779.922844279712.452800094011.982991193842.10

OpenBenchmarking.orgbyte/s Per Watt, More Is BetterOpenSSL 3.3Algorithm: ChaCha20Xeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN400M800M1200M1600M2000M1003586866.341008751851.93977212174.27936302176.04811931853.54774438543.71852735838.29846331621.991353849347.711361592598.331510491450.861480134319.021795036060.881778324265.621824186596.162009755510.33

OpenBenchmarking.orgbyte/s, More Is BetterOpenSSL 3.3Algorithm: AES-128-GCMXeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN500000M1000000M1500000M2000000M2500000MSE +/- 1622921637.03, N = 3SE +/- 1253503549.61, N = 3SE +/- 28627701.54, N = 3SE +/- 159598753.20, N = 3SE +/- 43545680.66, N = 3SE +/- 268465891.11, N = 3SE +/- 56355870.99, N = 3SE +/- 697208281.49, N = 3SE +/- 1428966819.54, N = 3SE +/- 570058274.06, N = 3SE +/- 164763342.54, N = 3SE +/- 337702856.52, N = 3SE +/- 49279694.68, N = 3SE +/- 1841260363.24, N = 3SE +/- 530918594.60, N = 3SE +/- 409615403.40, N = 3176931314601388956750654076880469369715330263007276412008481701277583382757747710702660148466962705019903520599679960071092678972884361231785006879067116722114187023166119452835397849313734889653908571. (CC) gcc options: -pthread -m64 -O3 -lssl -lcrypto -ldl

OpenBenchmarking.orgbyte/s Per Watt, More Is BetterOpenSSL 3.3Algorithm: ChaCha20-Poly1305Xeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN300M600M900M1200M1500M648595124.99658820863.84666607882.23644676877.17568545794.25542055990.77603664493.39574875604.57957228032.13957073830.821061980440.861039886433.311269363721.241244610923.331287300050.021388893901.10

OpenBenchmarking.orgbyte/s, More Is BetterOpenSSL 3.3Algorithm: AES-256-GCMXeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN400000M800000M1200000M1600000M2000000MSE +/- 1320809584.03, N = 3SE +/- 3966858436.56, N = 3SE +/- 2848140790.67, N = 3SE +/- 1397764228.85, N = 3SE +/- 119857064.56, N = 3SE +/- 108288170.03, N = 3SE +/- 63026881.96, N = 3SE +/- 112278705.55, N = 3SE +/- 1859275059.09, N = 3SE +/- 671752057.50, N = 3SE +/- 818689705.82, N = 3SE +/- 2225250504.62, N = 3SE +/- 290015345.25, N = 3SE +/- 1791964708.17, N = 3SE +/- 148092414.72, N = 3SE +/- 3442274884.66, N = 314975299393777443876836707002393527171369534328470507456728087101189899332359201411545311811489573531714061761087859720599963767696553667152650546581399753900787319831030267004623097505304158939632071. (CC) gcc options: -pthread -m64 -O3 -lssl -lcrypto -ldl

OpenBenchmarking.orgbyte/s, More Is BetterOpenSSL 3.3Algorithm: ChaCha20Xeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN300000M600000M900000M1200000M1500000MSE +/- 303075210.03, N = 3SE +/- 3335467.26, N = 3SE +/- 232288636.76, N = 3SE +/- 271318554.29, N = 3SE +/- 415487944.57, N = 3SE +/- 329510485.23, N = 3SE +/- 312824840.64, N = 3SE +/- 863978337.15, N = 3SE +/- 874940734.18, N = 3SE +/- 94935214.36, N = 3SE +/- 151272595.84, N = 3SE +/- 80233613.02, N = 3SE +/- 170968063.89, N = 3SE +/- 63368290.15, N = 3SE +/- 9570566.28, N = 3SE +/- 71110585.03, N = 36842843827603441509169373161264211736244029729472265973541534499084949272637406900675229124033471086618191950544904084773503311021123100150263486065639632938713069285075733070689383772820533270771. (CC) gcc options: -pthread -m64 -O3 -lssl -lcrypto -ldl

OpenBenchmarking.orgbyte/s, More Is BetterOpenSSL 3.3Algorithm: ChaCha20-Poly1305Xeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN200000M400000M600000M800000M1000000MSE +/- 82161991.11, N = 3SE +/- 120899798.30, N = 3SE +/- 766713911.50, N = 3SE +/- 132227134.30, N = 3SE +/- 6370607.14, N = 3SE +/- 4148679.28, N = 3SE +/- 37795783.50, N = 3SE +/- 36941390.18, N = 3SE +/- 558033954.71, N = 3SE +/- 4478378.70, N = 3SE +/- 29295317.86, N = 3SE +/- 6119305.11, N = 3SE +/- 151303743.70, N = 3SE +/- 19082587.00, N = 3SE +/- 24234601.89, N = 3SE +/- 65233629.47, N = 34440991442702236257380132250388507304422025329771613210582133203967204471877961744403727352152977676527195473839256520773509609983576989258222234570397488709060286089902111856617271933050936431. (CC) gcc options: -pthread -m64 -O3 -lssl -lcrypto -ldl

miniFE

OpenBenchmarking.orgCG Mflops Per Watt, More Is BetterminiFE 2.2Problem Size: SmallXeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN90180270360450114.81160.18156.59110.4879.2439.8571.5243.11179.90298.90334.41140.84392.87162.67254.52282.72

OpenBenchmarking.orgCG Mflops, More Is BetterminiFE 2.2Problem Size: SmallXeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN13K26K39K52K65KSE +/- 1633.92, N = 15SE +/- 135.77, N = 4SE +/- 11.14, N = 4SE +/- 467.78, N = 4SE +/- 601.03, N = 12SE +/- 1097.75, N = 15SE +/- 572.00, N = 12SE +/- 283.44, N = 3SE +/- 2182.93, N = 15SE +/- 92.04, N = 5SE +/- 42.89, N = 5SE +/- 1510.37, N = 15SE +/- 53.07, N = 5SE +/- 2087.13, N = 15SE +/- 49.20, N = 4SE +/- 42.17, N = 442114.631830.235230.146877.520091.119876.518621.221583.259466.653167.850909.643531.050139.942113.524526.024548.81. (CXX) g++ options: -O3 -fopenmp -lmpi_cxx -lmpi

Algebraic Multi-Grid Benchmark

OpenBenchmarking.orgFigure Of Merit Per Watt, More Is BetterAlgebraic Multi-Grid Benchmark 1.2Xeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN2M4M6M8M10M6520382.606349445.215415151.065278683.305380716.035320019.085363427.415337195.717422966.058293777.789442032.078578578.7010610537.825533330.989344903.3810387087.22

OpenBenchmarking.orgFigure Of Merit, More Is BetterAlgebraic Multi-Grid Benchmark 1.2Xeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN1000M2000M3000M4000M5000MSE +/- 9014927.20, N = 3SE +/- 4000850.45, N = 3SE +/- 468935.32, N = 3SE +/- 2438223.49, N = 3SE +/- 3359086.30, N = 3SE +/- 7233468.75, N = 3SE +/- 1778769.08, N = 3SE +/- 9164253.67, N = 3SE +/- 6340323.98, N = 3SE +/- 4963892.66, N = 3SE +/- 1066998.75, N = 3SE +/- 8808919.44, N = 3SE +/- 433397.56, N = 3SE +/- 235140242.43, N = 12SE +/- 2902028.33, N = 3SE +/- 291866.98, N = 336096463331814760000160509700031244026671588496667315626166715979933333205161000446728133323761490002282802000432493033322753526672783039083115005266711471080001. (CC) gcc options: -lparcsr_ls -lparcsr_mv -lseq_mv -lIJ_mv -lkrylov -lHYPRE_utilities -lm -fopenmp -lmpi

FFmpeg

OpenBenchmarking.orgFPS Per Watt, More Is BetterFFmpeg 7.0Encoder: libx265 - Scenario: PlatformXeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN0.15750.3150.47250.630.78750.1680.3290.2670.1330.2100.1040.2120.1060.1920.3990.4520.2030.4980.2240.6750.700

OpenBenchmarking.orgFPS Per Watt, More Is BetterFFmpeg 7.0Encoder: libx265 - Scenario: Video On DemandXeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN0.15770.31540.47310.63080.78850.1680.3290.2670.1330.2100.1020.2110.1070.1910.4000.4520.2030.4990.2240.6750.701

OpenBenchmarking.orgFPS, More Is BetterFFmpeg 7.0Encoder: libx265 - Scenario: UploadXeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN714212835SE +/- 0.04, N = 3SE +/- 0.05, N = 3SE +/- 0.04, N = 3SE +/- 0.10, N = 3SE +/- 0.00, N = 3SE +/- 0.12, N = 3SE +/- 0.07, N = 3SE +/- 0.07, N = 3SE +/- 0.03, N = 3SE +/- 0.03, N = 3SE +/- 0.01, N = 3SE +/- 0.04, N = 3SE +/- 0.03, N = 3SE +/- 0.04, N = 3SE +/- 0.04, N = 3SE +/- 0.02, N = 326.8026.9324.9724.5623.3322.3423.7723.3027.4327.6127.6626.4123.3623.2823.2523.271. (CXX) g++ options: -O3 -rdynamic -lpthread -lrt -ldl -lnuma

OpenBenchmarking.orgFPS, More Is BetterFFmpeg 7.0Encoder: libx265 - Scenario: PlatformXeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN1224364860SE +/- 0.15, N = 3SE +/- 0.14, N = 3SE +/- 0.16, N = 3SE +/- 0.12, N = 3SE +/- 0.03, N = 3SE +/- 0.09, N = 3SE +/- 0.08, N = 3SE +/- 0.27, N = 3SE +/- 0.04, N = 3SE +/- 0.01, N = 3SE +/- 0.02, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.02, N = 3SE +/- 0.02, N = 3SE +/- 0.03, N = 353.2253.9249.7948.7647.3245.9548.3546.5955.1155.3855.6152.7947.3147.1346.8746.861. (CXX) g++ options: -O3 -rdynamic -lpthread -lrt -ldl -lnuma

OpenBenchmarking.orgFPS, More Is BetterFFmpeg 7.0Encoder: libx265 - Scenario: Video On DemandXeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN1224364860SE +/- 0.14, N = 3SE +/- 0.03, N = 3SE +/- 0.02, N = 3SE +/- 0.03, N = 3SE +/- 0.10, N = 3SE +/- 0.43, N = 3SE +/- 0.07, N = 3SE +/- 0.13, N = 3SE +/- 0.07, N = 3SE +/- 0.03, N = 3SE +/- 0.03, N = 3SE +/- 0.03, N = 3SE +/- 0.03, N = 3SE +/- 0.00, N = 3SE +/- 0.02, N = 3SE +/- 0.05, N = 353.2953.9949.8448.7747.3445.2948.1446.7955.0155.5655.5952.8147.3347.1446.8846.931. (CXX) g++ options: -O3 -rdynamic -lpthread -lrt -ldl -lnuma

OpenVINO

This is a test of the Intel OpenVINO, a toolkit around neural networks, using its built-in benchmarking support and analyzing the throughput and latency for various models. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Face Detection FP16-INT8 - Device: CPUXeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN120240360480600SE +/- 0.77, N = 3SE +/- 0.69, N = 3SE +/- 0.12, N = 3SE +/- 0.01, N = 3SE +/- 0.14, N = 3SE +/- 0.58, N = 3SE +/- 0.41, N = 3SE +/- 0.54, N = 3SE +/- 0.41, N = 3SE +/- 0.12, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.03, N = 3SE +/- 0.04, N = 3SE +/- 0.01, N = 3SE +/- 0.06, N = 3545.21284.64167.83423.18202.59373.50217.11401.45205.03101.5193.99188.74115.78231.8353.8948.731. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPUXeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN40K80K120K160K200KSE +/- 1158.60, N = 3SE +/- 988.12, N = 3SE +/- 75.30, N = 3SE +/- 2494.14, N = 3SE +/- 383.22, N = 3SE +/- 18.38, N = 3SE +/- 1761.33, N = 3SE +/- 1422.88, N = 15SE +/- 1640.61, N = 7SE +/- 162.47, N = 3SE +/- 205.87, N = 3SE +/- 1922.38, N = 15SE +/- 89.35, N = 3SE +/- 1374.23, N = 9SE +/- 86.99, N = 3SE +/- 55.52, N = 3128566.8181279.79115106.30189893.31135075.07174862.56140144.01176900.32178488.03138605.52133779.62172688.50132973.43166151.4287511.1178334.921. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Person Detection FP16 - Device: CPUXeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN2004006008001000SE +/- 1.42, N = 3SE +/- 0.95, N = 3SE +/- 0.04, N = 3SE +/- 0.69, N = 3SE +/- 1.23, N = 3SE +/- 1.28, N = 3SE +/- 0.52, N = 3SE +/- 0.55, N = 3SE +/- 2.17, N = 3SE +/- 5.20, N = 15SE +/- 7.13, N = 15SE +/- 5.47, N = 15SE +/- 13.40, N = 15SE +/- 20.94, N = 15SE +/- 0.25, N = 3SE +/- 0.56, N = 3736.23403.20298.56654.84285.95568.81301.30569.601095.79433.06306.27750.11283.18750.96197.91204.051. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Weld Porosity Detection FP16-INT8 - Device: CPUXeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN10K20K30K40K50KSE +/- 39.08, N = 3SE +/- 47.41, N = 3SE +/- 2.71, N = 3SE +/- 53.98, N = 3SE +/- 234.43, N = 4SE +/- 80.58, N = 3SE +/- 21.27, N = 3SE +/- 233.95, N = 3SE +/- 110.20, N = 3SE +/- 11.71, N = 3SE +/- 4.46, N = 3SE +/- 147.69, N = 3SE +/- 5.50, N = 3SE +/- 11.27, N = 3SE +/- 0.41, N = 3SE +/- 1.69, N = 348122.1626943.4215943.1747654.9519183.8337710.6020910.5340032.8120550.939997.899356.7118666.1611508.1922499.035366.794830.011. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Vehicle Detection FP16-INT8 - Device: CPUXeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN3K6K9K12K15KSE +/- 6.25, N = 3SE +/- 0.73, N = 3SE +/- 0.81, N = 3SE +/- 11.51, N = 3SE +/- 8.09, N = 3SE +/- 4.11, N = 3SE +/- 5.68, N = 3SE +/- 8.70, N = 3SE +/- 4.04, N = 3SE +/- 3.54, N = 3SE +/- 8.39, N = 3SE +/- 4.21, N = 3SE +/- 66.33, N = 15SE +/- 1.24, N = 3SE +/- 2.22, N = 3SE +/- 2.89, N = 38719.374656.923325.905483.812935.475576.862877.325525.5611735.426017.195528.1510708.915778.5112750.592943.082763.481. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Person Vehicle Bike Detection FP16 - Device: CPUXeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN2K4K6K8K10KSE +/- 3.37, N = 3SE +/- 4.97, N = 3SE +/- 4.52, N = 3SE +/- 8.98, N = 3SE +/- 7.17, N = 3SE +/- 4.05, N = 3SE +/- 9.37, N = 3SE +/- 3.66, N = 3SE +/- 10.88, N = 3SE +/- 18.02, N = 3SE +/- 25.68, N = 3SE +/- 6.56, N = 3SE +/- 54.09, N = 3SE +/- 4.91, N = 3SE +/- 2.97, N = 3SE +/- 3.87, N = 310934.175725.033606.127862.583802.617127.284093.737689.329752.895608.075024.329203.195594.8110182.162830.122506.101. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Machine Translation EN To DE FP16 - Device: CPUXeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN2004006008001000SE +/- 0.85, N = 3SE +/- 0.54, N = 3SE +/- 0.17, N = 3SE +/- 3.48, N = 3SE +/- 1.21, N = 3SE +/- 1.99, N = 3SE +/- 4.09, N = 3SE +/- 1.13, N = 3SE +/- 0.37, N = 3SE +/- 4.29, N = 11SE +/- 4.59, N = 7SE +/- 8.96, N = 3SE +/- 6.34, N = 5SE +/- 11.78, N = 3SE +/- 0.39, N = 3SE +/- 0.13, N = 31128.78592.20477.77793.64415.96795.63467.08889.181110.49576.98525.88990.16621.421127.05317.38293.071. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Face Detection Retail FP16-INT8 - Device: CPUXeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN8K16K24K32K40KSE +/- 17.69, N = 3SE +/- 4.30, N = 3SE +/- 5.45, N = 3SE +/- 12.64, N = 3SE +/- 18.13, N = 3SE +/- 12.64, N = 3SE +/- 7.39, N = 3SE +/- 3.89, N = 3SE +/- 15.46, N = 3SE +/- 7.70, N = 3SE +/- 2.59, N = 3SE +/- 46.87, N = 3SE +/- 8.57, N = 3SE +/- 10.72, N = 3SE +/- 2.45, N = 3SE +/- 7.49, N = 324676.8612317.949004.2320937.589087.1217252.279686.3918561.9135809.5917230.3516038.9031974.8819917.5438546.669256.118279.631. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Handwritten English Recognition FP16-INT8 - Device: CPUXeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN14002800420056007000SE +/- 3.43, N = 3SE +/- 0.73, N = 3SE +/- 1.46, N = 3SE +/- 2.46, N = 3SE +/- 3.41, N = 3SE +/- 1.09, N = 3SE +/- 4.55, N = 3SE +/- 2.81, N = 3SE +/- 13.59, N = 3SE +/- 4.06, N = 3SE +/- 4.84, N = 3SE +/- 9.83, N = 3SE +/- 7.27, N = 3SE +/- 14.68, N = 3SE +/- 3.51, N = 3SE +/- 0.47, N = 35570.632924.661643.434744.052074.303998.022243.844351.595766.622986.332739.015178.293280.256400.941542.611396.781. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Road Segmentation ADAS FP16-INT8 - Device: CPUXeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN9001800270036004500SE +/- 11.53, N = 3SE +/- 0.47, N = 3SE +/- 2.65, N = 3SE +/- 0.66, N = 3SE +/- 2.29, N = 3SE +/- 1.56, N = 3SE +/- 2.94, N = 3SE +/- 1.74, N = 3SE +/- 5.33, N = 3SE +/- 1.09, N = 3SE +/- 6.85, N = 3SE +/- 3.90, N = 3SE +/- 11.41, N = 15SE +/- 5.40, N = 3SE +/- 0.65, N = 3SE +/- 0.81, N = 32237.691159.661068.431843.61860.641691.79894.871801.894013.962212.411743.493353.731671.234032.66998.09918.531. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Person Re-Identification Retail FP16 - Device: CPUXeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN4K8K12K16K20KSE +/- 7.74, N = 3SE +/- 5.57, N = 3SE +/- 3.97, N = 3SE +/- 4.14, N = 3SE +/- 3.72, N = 3SE +/- 3.67, N = 3SE +/- 0.46, N = 3SE +/- 7.22, N = 3SE +/- 7.99, N = 3SE +/- 4.58, N = 3SE +/- 4.14, N = 3SE +/- 7.03, N = 3SE +/- 4.98, N = 3SE +/- 10.13, N = 3SE +/- 3.18, N = 3SE +/- 1.89, N = 318375.639515.865943.6615519.926717.6513102.287207.7414033.9412665.626846.796554.1212024.187862.6514601.523692.673355.731. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Noise Suppression Poconet-Like FP16 - Device: CPUXeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN2K4K6K8K10KSE +/- 24.76, N = 3SE +/- 10.14, N = 3SE +/- 1.87, N = 3SE +/- 13.31, N = 3SE +/- 15.13, N = 3SE +/- 37.79, N = 3SE +/- 7.60, N = 3SE +/- 28.98, N = 3SE +/- 59.51, N = 3SE +/- 1.84, N = 3SE +/- 67.22, N = 14SE +/- 77.59, N = 3SE +/- 139.41, N = 12SE +/- 27.90, N = 3SE +/- 0.64, N = 3SE +/- 3.67, N = 39360.896757.264209.107356.634208.495565.234386.485933.658231.726963.315697.517810.655310.076513.363636.333405.941. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

Kvazaar

This is a test of Kvazaar as a CPU-based H.265/HEVC video encoder written in the C programming language and optimized in Assembly. Kvazaar is the winner of the 2016 ACM Open-Source Software Competition and developed at the Ultra Video Group, Tampere University, Finland. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgFrames Per Second, More Is BetterKvazaar 2.2Video Input: Bosphorus 4K - Video Preset: SlowXeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN1428425670SE +/- 0.04, N = 4SE +/- 0.07, N = 3SE +/- 0.03, N = 3SE +/- 0.08, N = 3SE +/- 0.03, N = 3SE +/- 0.03, N = 3SE +/- 0.02, N = 3SE +/- 0.02, N = 3SE +/- 0.26, N = 5SE +/- 0.07, N = 4SE +/- 0.01, N = 4SE +/- 0.50, N = 5SE +/- 0.05, N = 4SE +/- 0.47, N = 8SE +/- 0.04, N = 3SE +/- 0.05, N = 340.9224.2320.2331.2417.5226.0018.2428.9662.8240.0038.9061.0738.4754.8823.7122.461. (CC) gcc options: -pthread -ftree-vectorize -fvisibility=hidden -O2 -lpthread -lm -lrt

OpenBenchmarking.orgFrames Per Second, More Is BetterKvazaar 2.2Video Input: Bosphorus 4K - Video Preset: MediumXeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN1428425670SE +/- 0.27, N = 4SE +/- 0.03, N = 3SE +/- 0.02, N = 3SE +/- 0.06, N = 3SE +/- 0.04, N = 3SE +/- 0.08, N = 3SE +/- 0.02, N = 3SE +/- 0.07, N = 3SE +/- 0.40, N = 5SE +/- 0.01, N = 4SE +/- 0.07, N = 4SE +/- 0.56, N = 5SE +/- 0.04, N = 4SE +/- 0.52, N = 15SE +/- 0.05, N = 3SE +/- 0.03, N = 341.5824.8020.9732.0418.1326.6918.8429.6263.4840.5039.5861.1139.0854.5724.3123.021. (CC) gcc options: -pthread -ftree-vectorize -fvisibility=hidden -O2 -lpthread -lm -lrt

OpenBenchmarking.orgFrames Per Second, More Is BetterKvazaar 2.2Video Input: Bosphorus 4K - Video Preset: Very FastXeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN20406080100SE +/- 0.36, N = 5SE +/- 0.04, N = 4SE +/- 0.08, N = 4SE +/- 0.45, N = 5SE +/- 0.06, N = 4SE +/- 0.33, N = 4SE +/- 0.08, N = 4SE +/- 0.29, N = 4SE +/- 0.28, N = 6SE +/- 0.32, N = 6SE +/- 0.62, N = 6SE +/- 0.71, N = 6SE +/- 0.21, N = 5SE +/- 0.63, N = 15SE +/- 0.07, N = 5SE +/- 0.07, N = 465.3838.0250.0367.6440.2351.9141.3452.2374.0378.1576.8372.6868.5659.0154.6051.511. (CC) gcc options: -pthread -ftree-vectorize -fvisibility=hidden -O2 -lpthread -lm -lrt

uvg266

uvg266 is an open-source VVC/H.266 (Versatile Video Coding) encoder based on Kvazaar as part of the Ultra Video Group, Tampere University, Finland. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgFrames Per Second, More Is Betteruvg266 0.4.1Video Input: Bosphorus 4K - Video Preset: SlowXeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN1020304050SE +/- 0.02, N = 3SE +/- 0.01, N = 3SE +/- 0.03, N = 3SE +/- 0.04, N = 3SE +/- 0.02, N = 3SE +/- 0.04, N = 3SE +/- 0.01, N = 3SE +/- 0.04, N = 3SE +/- 0.12, N = 4SE +/- 0.04, N = 3SE +/- 0.04, N = 3SE +/- 0.21, N = 4SE +/- 0.04, N = 3SE +/- 0.23, N = 4SE +/- 0.04, N = 3SE +/- 0.02, N = 327.1116.0615.7124.7113.3619.7513.8922.1443.3929.1828.0140.9629.0037.1317.0415.77

OpenBenchmarking.orgFrames Per Second, More Is Betteruvg266 0.4.1Video Input: Bosphorus 4K - Video Preset: MediumXeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN1020304050SE +/- 0.05, N = 3SE +/- 0.16, N = 3SE +/- 0.02, N = 3SE +/- 0.04, N = 3SE +/- 0.02, N = 3SE +/- 0.03, N = 3SE +/- 0.02, N = 3SE +/- 0.03, N = 3SE +/- 0.46, N = 4SE +/- 0.03, N = 3SE +/- 0.01, N = 3SE +/- 0.23, N = 4SE +/- 0.05, N = 3SE +/- 0.28, N = 11SE +/- 0.01, N = 3SE +/- 0.01, N = 330.3716.6417.8527.6515.1722.2515.6824.6545.2632.7431.4442.0332.4438.1219.2517.80

OpenBenchmarking.orgFrames Per Second, More Is Betteruvg266 0.4.1Video Input: Bosphorus 4K - Video Preset: Very FastXeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN1428425670SE +/- 0.16, N = 5SE +/- 0.08, N = 3SE +/- 0.01, N = 4SE +/- 0.50, N = 5SE +/- 0.12, N = 4SE +/- 0.39, N = 4SE +/- 0.02, N = 4SE +/- 0.38, N = 9SE +/- 0.12, N = 5SE +/- 0.13, N = 5SE +/- 0.13, N = 5SE +/- 0.55, N = 5SE +/- 0.18, N = 5SE +/- 0.43, N = 15SE +/- 0.08, N = 4SE +/- 0.06, N = 453.6635.1049.4254.8839.5644.7540.8246.2555.0562.7062.0253.4454.4646.0050.0444.92

VVenC

VVenC is the Fraunhofer Versatile Video Encoder as a fast/efficient H.266/VVC encoder. The vvenc encoder makes use of SIMD Everywhere (SIMDe). The vvenc software is published under the Clear BSD License. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgFrames Per Second, More Is BetterVVenC 1.11Video Input: Bosphorus 4K - Video Preset: FastXeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684XEPYC 9654EPYC 9754EPYC 8534PEPYC 8534PN246810SE +/- 0.038, N = 3SE +/- 0.023, N = 3SE +/- 0.022, N = 3SE +/- 0.047, N = 3SE +/- 0.010, N = 3SE +/- 0.081, N = 3SE +/- 0.033, N = 3SE +/- 0.043, N = 15SE +/- 0.057, N = 3SE +/- 0.048, N = 3SE +/- 0.045, N = 3SE +/- 0.038, N = 3SE +/- 0.041, N = 36.9607.3926.7196.4806.3246.0236.5016.0777.5477.4316.4656.1186.0001. (CXX) g++ options: -O3 -flto=auto -fno-fat-lto-objects

Video Input: Bosphorus 4K - Video Preset: Fast

EPYC 9684X 2P: The test quit with a non-zero exit status. E: Parameter Check Error: Number of threads out of range (-1

EPYC 9654 2P: The test quit with a non-zero exit status. E: Parameter Check Error: Number of threads out of range (-1

EPYC 9754 2P: The test quit with a non-zero exit status. E: Parameter Check Error: Number of threads out of range (-1

OpenBenchmarking.orgFrames Per Second, More Is BetterVVenC 1.11Video Input: Bosphorus 4K - Video Preset: FasterXeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684XEPYC 9654EPYC 9754EPYC 8534PEPYC 8534PN48121620SE +/- 0.12, N = 3SE +/- 0.08, N = 3SE +/- 0.02, N = 3SE +/- 0.16, N = 3SE +/- 0.05, N = 3SE +/- 0.11, N = 3SE +/- 0.13, N = 3SE +/- 0.13, N = 3SE +/- 0.03, N = 3SE +/- 0.02, N = 3SE +/- 0.05, N = 3SE +/- 0.06, N = 3SE +/- 0.01, N = 313.2615.9715.0612.5414.1011.9014.3611.9717.0216.7314.7913.9713.611. (CXX) g++ options: -O3 -flto=auto -fno-fat-lto-objects

Video Input: Bosphorus 4K - Video Preset: Faster

EPYC 9684X 2P: The test quit with a non-zero exit status. E: Parameter Check Error: Number of threads out of range (-1

EPYC 9654 2P: The test quit with a non-zero exit status. E: Parameter Check Error: Number of threads out of range (-1

EPYC 9754 2P: The test quit with a non-zero exit status. E: Parameter Check Error: Number of threads out of range (-1

Embree

OpenBenchmarking.orgFrames Per Second Per Watt, More Is BetterEmbree 4.3Binary: Pathtracer ISPC - Model: Asian DragonXeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN0.1940.3880.5820.7760.970.5080.4940.4280.3230.2760.2460.3120.2530.5640.6620.7350.5180.8620.6200.6130.706

OpenBenchmarking.orgFrames Per Second, More Is BetterEmbree 4.3Binary: Pathtracer ISPC - Model: Asian DragonXeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN50100150200250SE +/- 0.26, N = 8SE +/- 0.13, N = 6SE +/- 0.05, N = 5SE +/- 0.13, N = 7SE +/- 0.04, N = 5SE +/- 0.63, N = 6SE +/- 0.11, N = 5SE +/- 1.20, N = 15SE +/- 2.04, N = 8SE +/- 0.07, N = 7SE +/- 0.03, N = 6SE +/- 1.54, N = 8SE +/- 0.12, N = 7SE +/- 1.88, N = 7SE +/- 0.03, N = 5SE +/- 0.05, N = 5199.61112.6691.99152.7575.47125.7583.49129.75231.43155.12132.49185.71156.39208.3175.2173.91MIN: 185.98 / MAX: 216.64MIN: 107.88 / MAX: 117.19MIN: 88.57 / MAX: 98.54MIN: 143.8 / MAX: 168.98MIN: 72.93 / MAX: 78.77MIN: 120.06 / MAX: 135.13MIN: 80.58 / MAX: 88.97MIN: 110.67 / MAX: 151.91MIN: 187.58 / MAX: 274.64MIN: 152.39 / MAX: 161.68MIN: 130.77 / MAX: 135.13MIN: 154.13 / MAX: 227.12MIN: 153.92 / MAX: 160MIN: 162.41 / MAX: 258.13MIN: 74.55 / MAX: 76.96MIN: 73.25 / MAX: 75

SVT-AV1

This is a benchmark of the SVT-AV1 open-source video encoder/decoder. SVT-AV1 was originally developed by Intel as part of their Open Visual Cloud / Scalable Video Technology (SVT). Development of SVT-AV1 has since moved to the Alliance for Open Media as part of upstream AV1 development. SVT-AV1 is a CPU-based multi-threaded video encoder for the AV1 video format with a sample YUV video file. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 2.0Encoder Mode: Preset 13 - Input: Bosphorus 4KXeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN4080120160200SE +/- 2.84, N = 15SE +/- 2.83, N = 15SE +/- 2.31, N = 15SE +/- 2.18, N = 15SE +/- 1.44, N = 15SE +/- 1.63, N = 15SE +/- 1.62, N = 15SE +/- 1.67, N = 15SE +/- 1.54, N = 15SE +/- 3.81, N = 15SE +/- 4.38, N = 15SE +/- 4.23, N = 15SE +/- 4.48, N = 15SE +/- 4.46, N = 15SE +/- 4.25, N = 15SE +/- 3.84, N = 15162.98174.83162.47154.50144.70122.62150.00124.26161.34162.48172.88167.22163.41159.75160.79153.421. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 2.0Encoder Mode: Preset 12 - Input: Bosphorus 4KXeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN4080120160200SE +/- 0.42, N = 7SE +/- 0.20, N = 7SE +/- 0.41, N = 7SE +/- 0.25, N = 7SE +/- 0.61, N = 7SE +/- 0.83, N = 5SE +/- 0.40, N = 7SE +/- 0.97, N = 6SE +/- 0.88, N = 6SE +/- 0.43, N = 7SE +/- 0.80, N = 7SE +/- 1.88, N = 15SE +/- 1.32, N = 6SE +/- 1.41, N = 6SE +/- 0.71, N = 6SE +/- 0.78, N = 6165.50177.86164.25156.52146.10122.09151.72127.55163.80165.75178.52171.22169.23168.78165.09157.361. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

Embree

OpenBenchmarking.orgFrames Per Second Per Watt, More Is BetterEmbree 4.3Binary: Pathtracer ISPC - Model: Asian Dragon ObjXeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN0.22010.44020.66030.88041.10050.5790.5230.3680.3200.2630.2220.2910.2400.6020.7160.6930.5750.9780.7590.6420.713

OpenBenchmarking.orgFrames Per Second Per Watt, More Is BetterEmbree 4.3Binary: Pathtracer ISPC - Model: CrownXeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN0.14150.2830.42450.5660.70750.3630.3310.2580.2520.2060.2050.2320.2260.4990.5220.4990.4680.6290.5320.4820.517

SVT-AV1

This is a benchmark of the SVT-AV1 open-source video encoder/decoder. SVT-AV1 was originally developed by Intel as part of their Open Visual Cloud / Scalable Video Technology (SVT). Development of SVT-AV1 has since moved to the Alliance for Open Media as part of upstream AV1 development. SVT-AV1 is a CPU-based multi-threaded video encoder for the AV1 video format with a sample YUV video file. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 2.0Encoder Mode: Preset 8 - Input: Bosphorus 4KXeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN20406080100SE +/- 0.79, N = 5SE +/- 0.22, N = 5SE +/- 0.20, N = 5SE +/- 0.46, N = 4SE +/- 0.26, N = 4SE +/- 0.58, N = 5SE +/- 0.29, N = 4SE +/- 0.44, N = 15SE +/- 0.63, N = 5SE +/- 0.42, N = 5SE +/- 0.56, N = 5SE +/- 0.40, N = 5SE +/- 0.38, N = 5SE +/- 0.31, N = 4SE +/- 0.11, N = 4SE +/- 0.67, N = 470.4379.4470.9165.2262.7554.8265.3655.9887.8286.3087.9986.3478.7477.6068.1964.791. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 2.0Encoder Mode: Preset 4 - Input: Bosphorus 4KXeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN246810SE +/- 0.044, N = 3SE +/- 0.005, N = 3SE +/- 0.030, N = 3SE +/- 0.049, N = 3SE +/- 0.027, N = 3SE +/- 0.015, N = 3SE +/- 0.047, N = 3SE +/- 0.042, N = 3SE +/- 0.040, N = 3SE +/- 0.021, N = 3SE +/- 0.019, N = 3SE +/- 0.046, N = 3SE +/- 0.024, N = 3SE +/- 0.004, N = 3SE +/- 0.007, N = 3SE +/- 0.015, N = 37.3607.8767.0616.6986.4905.9916.5726.0528.5138.5958.4228.3497.2837.1536.9396.7271. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

x265

This is a simple test of the x265 encoder run on the CPU with 1080p and 4K options for H.265 video encode performance with x265. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgFrames Per Second, More Is Betterx265 3.6Video Input: Bosphorus 4KXeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN918273645SE +/- 0.09, N = 4SE +/- 0.06, N = 4SE +/- 0.11, N = 4SE +/- 0.20, N = 4SE +/- 0.08, N = 3SE +/- 0.12, N = 3SE +/- 0.39, N = 3SE +/- 0.10, N = 3SE +/- 0.10, N = 3SE +/- 0.11, N = 3SE +/- 0.08, N = 3SE +/- 0.09, N = 3SE +/- 0.02, N = 3SE +/- 0.06, N = 3SE +/- 0.06, N = 3SE +/- 0.06, N = 339.3138.9337.8637.0429.0527.2631.4027.9031.9532.1231.7228.8128.1628.1128.1327.741. (CXX) g++ options: -O3 -rdynamic -lpthread -lrt -ldl -lnuma

Embree

Intel Embree is a collection of high-performance ray-tracing kernels for execution on CPUs (and GPUs via SYCL) and supporting instruction sets such as SSE, AVX, AVX2, and AVX-512. Embree also supports making use of the Intel SPMD Program Compiler (ISPC). Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgFrames Per Second, More Is BetterEmbree 4.3Binary: Pathtracer ISPC - Model: Asian Dragon ObjXeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN50100150200250SE +/- 0.29, N = 4SE +/- 0.35, N = 3SE +/- 0.09, N = 3SE +/- 0.22, N = 4SE +/- 0.08, N = 3SE +/- 0.76, N = 3SE +/- 0.09, N = 3SE +/- 0.89, N = 15SE +/- 1.72, N = 15SE +/- 0.11, N = 4SE +/- 0.02, N = 4SE +/- 1.58, N = 15SE +/- 0.07, N = 4SE +/- 3.26, N = 12SE +/- 0.04, N = 3SE +/- 0.04, N = 3173.2297.1979.38132.2864.96104.8471.83112.72210.44133.48113.28175.60133.93200.1664.3363.34MIN: 164.07 / MAX: 187.8MIN: 92.96 / MAX: 102.04MIN: 76.07 / MAX: 85.98MIN: 125 / MAX: 146.52MIN: 63.12 / MAX: 67.81MIN: 101.05 / MAX: 112.02MIN: 69.55 / MAX: 76.73MIN: 102 / MAX: 125.96MIN: 168.12 / MAX: 235.13MIN: 130.86 / MAX: 138.79MIN: 111.7 / MAX: 116.19MIN: 154.41 / MAX: 194.22MIN: 131.91 / MAX: 136.58MIN: 148.48 / MAX: 223.22MIN: 63.73 / MAX: 65.21MIN: 62.81 / MAX: 64.1

OpenBenchmarking.orgFrames Per Second, More Is BetterEmbree 4.3Binary: Pathtracer ISPC - Model: CrownXeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN50100150200250SE +/- 0.07, N = 7SE +/- 0.05, N = 5SE +/- 0.07, N = 5SE +/- 0.12, N = 6SE +/- 0.05, N = 4SE +/- 0.14, N = 6SE +/- 0.02, N = 4SE +/- 0.48, N = 6SE +/- 1.23, N = 8SE +/- 0.20, N = 7SE +/- 0.08, N = 6SE +/- 0.43, N = 7SE +/- 0.64, N = 6SE +/- 1.04, N = 7SE +/- 0.04, N = 4SE +/- 0.07, N = 4153.1682.9770.05124.7158.42107.6365.33116.61214.02130.79110.53176.21126.15190.0862.1958.28MIN: 143.78 / MAX: 166.08MIN: 79.09 / MAX: 87.11MIN: 63.26 / MAX: 79.13MIN: 115.3 / MAX: 143.82MIN: 55.81 / MAX: 61.43MIN: 102.22 / MAX: 114.8MIN: 60.89 / MAX: 69.91MIN: 107.47 / MAX: 129.72MIN: 181.82 / MAX: 248.2MIN: 126.46 / MAX: 138.83MIN: 107.72 / MAX: 115.26MIN: 163.69 / MAX: 195.97MIN: 122.27 / MAX: 133.25MIN: 164.86 / MAX: 219.06MIN: 61.2 / MAX: 63.88MIN: 57.28 / MAX: 60.13

miniBUDE

MiniBUDE is a mini application for the the core computation of the Bristol University Docking Engine (BUDE). This test profile currently makes use of the OpenMP implementation of miniBUDE for CPU benchmarking. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgGFInst/s, More Is BetterminiBUDE 20210901Implementation: OpenMP - Input Deck: BM1Xeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN13002600390052006500SE +/- 25.44, N = 8SE +/- 5.07, N = 6SE +/- 15.23, N = 5SE +/- 20.15, N = 7SE +/- 2.91, N = 4SE +/- 32.01, N = 12SE +/- 21.10, N = 15SE +/- 46.19, N = 12SE +/- 153.85, N = 12SE +/- 81.83, N = 13SE +/- 29.52, N = 7SE +/- 74.36, N = 13SE +/- 17.54, N = 9SE +/- 99.42, N = 15SE +/- 0.97, N = 6SE +/- 0.82, N = 64993.342659.882071.193340.691590.502709.931771.072872.565915.253798.703423.635446.165747.825365.422683.832455.161. (CC) gcc options: -std=c99 -Ofast -ffast-math -fopenmp -march=native -lm

OpenBenchmarking.orgGFInst/s, More Is BetterminiBUDE 20210901Implementation: OpenMP - Input Deck: BM2Xeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN17003400510068008500SE +/- 48.20, N = 15SE +/- 0.70, N = 3SE +/- 7.77, N = 3SE +/- 24.63, N = 3SE +/- 7.81, N = 3SE +/- 36.96, N = 3SE +/- 23.93, N = 4SE +/- 23.14, N = 3SE +/- 57.10, N = 3SE +/- 42.85, N = 3SE +/- 23.15, N = 3SE +/- 2.03, N = 3SE +/- 0.20, N = 3SE +/- 96.25, N = 3SE +/- 0.13, N = 3SE +/- 0.10, N = 34795.462703.092174.193520.711755.333196.121952.613349.767730.474692.114294.287281.965818.747213.432692.872449.451. (CC) gcc options: -std=c99 -Ofast -ffast-math -fopenmp -march=native -lm

ACES DGEMM

OpenBenchmarking.orgGFLOP/s Per Watt, More Is BetterACES DGEMM 1.0Sustained Floating-Point RateXeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN0.06570.13140.19710.26280.32850.1490.1210.0930.1010.0710.0780.0810.0900.2150.1960.2140.2280.2520.2920.1980.220

OpenBenchmarking.orgGFLOP/s, More Is BetterACES DGEMM 1.0Sustained Floating-Point RateXeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN20406080100SE +/- 0.11, N = 8SE +/- 0.08, N = 6SE +/- 0.09, N = 5SE +/- 0.28, N = 7SE +/- 0.04, N = 4SE +/- 0.06, N = 7SE +/- 0.09, N = 5SE +/- 0.04, N = 7SE +/- 0.39, N = 9SE +/- 0.40, N = 7SE +/- 0.22, N = 7SE +/- 0.10, N = 9SE +/- 0.17, N = 7SE +/- 0.19, N = 10SE +/- 0.16, N = 5SE +/- 0.10, N = 558.2529.1423.5445.9719.7739.3522.5444.6778.5045.2539.0968.8744.9784.6921.8221.001. (CC) gcc options: -O3 -march=native -fopenmp

High Performance Conjugate Gradient

OpenBenchmarking.orgGFLOP/s Per Watt, More Is BetterHigh Performance Conjugate Gradient 3.1X Y Z: 144 144 144 - RT: 60Xeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN0.0380.0760.1140.1520.190.1010.1030.0900.0880.0730.0790.0890.0920.0620.0840.1040.0690.0990.0740.1560.169

OpenBenchmarking.orgGFLOP/s, More Is BetterHigh Performance Conjugate Gradient 3.1X Y Z: 144 144 144 - RT: 60Xeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN1530456075SE +/- 0.94, N = 3SE +/- 0.08, N = 3SE +/- 0.02, N = 3SE +/- 0.03, N = 3SE +/- 0.08, N = 3SE +/- 0.29, N = 3SE +/- 0.37, N = 3SE +/- 0.07, N = 3SE +/- 0.51, N = 3SE +/- 0.28, N = 5SE +/- 0.05, N = 3SE +/- 0.05, N = 3SE +/- 0.04, N = 3SE +/- 0.02, N = 3SE +/- 0.03, N = 3SE +/- 0.02, N = 369.3035.1431.0760.8525.2454.4130.5962.6444.9527.5828.3242.5223.6341.8722.2022.131. (CXX) g++ options: -O3 -ffast-math -ftree-vectorize -lmpi_cxx -lmpi

Xmrig

OpenBenchmarking.orgH/s Per Watt, More Is BetterXmrig 6.21Variant: GhostRider - Hash Count: 1MXeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN112233445525.2925.0217.1116.8316.6416.2917.9318.0044.0842.0046.6945.0540.1736.1733.4736.24

OpenBenchmarking.orgH/s, More Is BetterXmrig 6.21Variant: GhostRider - Hash Count: 1MXeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN7K14K21K28K35KSE +/- 64.69, N = 3SE +/- 44.68, N = 3SE +/- 23.16, N = 3SE +/- 4.03, N = 3SE +/- 12.93, N = 3SE +/- 14.02, N = 3SE +/- 14.78, N = 3SE +/- 7.44, N = 3SE +/- 95.10, N = 3SE +/- 10.36, N = 3SE +/- 117.32, N = 3SE +/- 290.50, N = 3SE +/- 61.27, N = 3SE +/- 46.94, N = 3SE +/- 30.53, N = 3SE +/- 41.94, N = 316324.78378.35808.811263.25446.810975.86122.312115.031157.815786.614207.726702.79320.517873.14660.04564.31. (CXX) g++ options: -fexceptions -fno-rtti -maes -O3 -Ofast -static-libgcc -static-libstdc++ -rdynamic -lssl -lcrypto -luv -lpthread -lrt -ldl -lhwloc

Intel Open Image Denoise

OpenBenchmarking.orgImages / Sec Per Watt, More Is BetterIntel Open Image Denoise 2.2Run: RT.hdr_alb_nrm.3840x2160 - Device: CPU-OnlyXeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN0.00360.00720.01080.01440.0180.0110.0130.0100.0090.0080.0060.0080.0070.0070.0090.0120.0080.0150.0100.0140.016

OpenBenchmarking.orgImages / Sec Per Watt, More Is BetterIntel Open Image Denoise 2.2Run: RT.ldr_alb_nrm.3840x2160 - Device: CPU-OnlyXeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN0.00360.00720.01080.01440.0180.0120.0130.0100.0090.0080.0060.0080.0070.0070.0090.0120.0080.0150.0100.0150.016

OpenBenchmarking.orgImages / Sec Per Watt, More Is BetterIntel Open Image Denoise 2.2Run: RTLightmap.hdr.4096x4096 - Device: CPU-OnlyXeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN0.00160.00320.00480.00640.0080.0040.0050.0040.0040.0030.0030.0040.0030.0030.0040.0050.0030.0060.0040.0060.007

OpenBenchmarking.orgImages / Sec, More Is BetterIntel Open Image Denoise 2.2Run: RT.hdr_alb_nrm.3840x2160 - Device: CPU-OnlyXeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN1.13182.26363.39544.52725.659SE +/- 0.03, N = 6SE +/- 0.00, N = 5SE +/- 0.00, N = 4SE +/- 0.03, N = 6SE +/- 0.00, N = 4SE +/- 0.01, N = 5SE +/- 0.00, N = 4SE +/- 0.04, N = 5SE +/- 0.00, N = 5SE +/- 0.00, N = 4SE +/- 0.01, N = 4SE +/- 0.01, N = 5SE +/- 0.02, N = 5SE +/- 0.01, N = 5SE +/- 0.00, N = 3SE +/- 0.00, N = 35.033.312.714.412.263.512.383.653.452.642.733.483.123.591.791.69

OpenBenchmarking.orgImages / Sec, More Is BetterIntel Open Image Denoise 2.2Run: RT.ldr_alb_nrm.3840x2160 - Device: CPU-OnlyXeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN1.14532.29063.43594.58125.7265SE +/- 0.03, N = 6SE +/- 0.00, N = 5SE +/- 0.00, N = 4SE +/- 0.01, N = 6SE +/- 0.00, N = 4SE +/- 0.02, N = 5SE +/- 0.00, N = 4SE +/- 0.02, N = 5SE +/- 0.00, N = 5SE +/- 0.02, N = 4SE +/- 0.01, N = 4SE +/- 0.01, N = 5SE +/- 0.03, N = 6SE +/- 0.01, N = 5SE +/- 0.00, N = 3SE +/- 0.00, N = 35.093.322.714.482.273.492.393.663.472.662.733.493.163.571.801.69

OpenBenchmarking.orgImages / Sec, More Is BetterIntel Open Image Denoise 2.2Run: RTLightmap.hdr.4096x4096 - Device: CPU-OnlyXeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN0.541.081.622.162.7SE +/- 0.01, N = 4SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.01, N = 4SE +/- 0.00, N = 3SE +/- 0.02, N = 3SE +/- 0.00, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 32.401.581.292.181.081.721.141.741.641.281.311.671.501.710.860.80

TensorFlow

This is a benchmark of the TensorFlow deep learning framework using the TensorFlow reference benchmarks (tensorflow/benchmarks with tf_cnn_benchmarks.py). Note with the Phoronix Test Suite there is also pts/tensorflow-lite for benchmarking the TensorFlow Lite binaries if desired for complementary metrics. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.16.1Device: CPU - Batch Size: 512 - Model: GoogLeNetXeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN130260390520650SE +/- 1.52, N = 3SE +/- 3.68, N = 3SE +/- 0.34, N = 3SE +/- 2.62, N = 3SE +/- 0.41, N = 3SE +/- 1.14, N = 3SE +/- 0.37, N = 3SE +/- 2.46, N = 3SE +/- 1.60, N = 3SE +/- 3.05, N = 12SE +/- 4.02, N = 10SE +/- 5.11, N = 3SE +/- 12.03, N = 12SE +/- 5.63, N = 6SE +/- 0.06, N = 3SE +/- 0.03, N = 3577.76462.78461.23576.08383.57467.91398.40477.33464.78425.25470.95525.84450.61588.43313.50295.29

OpenBenchmarking.orgimages/sec Per Watt, More Is BetterTensorFlow 2.16.1Device: CPU - Batch Size: 64 - Model: ResNet-50Xeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN0.14720.29440.44160.58880.7360.2020.3820.3980.2020.3300.1860.3260.1780.1590.3540.4480.1700.4770.1790.6100.654

OpenBenchmarking.orgimages/sec Per Watt, More Is BetterTensorFlow 2.16.1Device: CPU - Batch Size: 64 - Model: AlexNetXeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN2468102.4044.1454.3752.2693.3411.8983.3741.9191.8574.3325.4392.0656.2382.2366.5086.664

OpenBenchmarking.orgimages/sec Per Watt, More Is BetterTensorFlow 2.16.1Device: CPU - Batch Size: 64 - Model: GoogLeNetXeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN0.51641.03281.54922.06562.5820.6831.4111.3780.6331.1420.6061.1530.5530.5031.2741.5680.5131.6030.5022.1692.295

OpenBenchmarking.orgimages/sec Per Watt, More Is BetterTensorFlow 2.16.1Device: CPU - Batch Size: 256 - Model: ResNet-50Xeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN0.15550.3110.46650.6220.77750.2780.4630.4250.2430.3540.2100.3630.2000.2030.3850.4850.2520.5250.2910.6460.691

OpenBenchmarking.orgimages/sec Per Watt, More Is BetterTensorFlow 2.16.1Device: CPU - Batch Size: 256 - Model: AlexNetXeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN2468103.6354.7494.1463.1223.2052.5153.4442.5933.2484.8085.4193.5356.9763.8296.6847.144

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.16.1Device: CPU - Batch Size: 64 - Model: ResNet-50Xeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN306090120150SE +/- 0.70, N = 3SE +/- 0.50, N = 3SE +/- 0.04, N = 3SE +/- 1.12, N = 3SE +/- 0.13, N = 3SE +/- 0.39, N = 3SE +/- 0.93, N = 3SE +/- 1.28, N = 3SE +/- 1.04, N = 4SE +/- 0.08, N = 3SE +/- 0.64, N = 3SE +/- 0.91, N = 5SE +/- 0.60, N = 3SE +/- 0.88, N = 3SE +/- 0.05, N = 3SE +/- 0.11, N = 394.6691.51120.93115.47104.23111.71103.56107.3086.08104.52114.6382.94106.1467.0887.3180.86

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.16.1Device: CPU - Batch Size: 64 - Model: AlexNetXeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN2004006008001000SE +/- 2.22, N = 5SE +/- 6.22, N = 5SE +/- 0.51, N = 5SE +/- 7.98, N = 5SE +/- 1.95, N = 5SE +/- 6.39, N = 13SE +/- 2.31, N = 5SE +/- 7.35, N = 5SE +/- 7.66, N = 5SE +/- 1.37, N = 5SE +/- 1.31, N = 5SE +/- 8.87, N = 4SE +/- 2.99, N = 5SE +/- 7.43, N = 15SE +/- 0.45, N = 4SE +/- 0.16, N = 4858.84819.89969.62996.47841.68932.59852.36940.40738.31868.54942.19727.77924.80658.97673.42617.03

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.16.1Device: CPU - Batch Size: 64 - Model: GoogLeNetXeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN80160240320400SE +/- 0.21, N = 3SE +/- 1.12, N = 3SE +/- 1.62, N = 3SE +/- 2.37, N = 3SE +/- 1.94, N = 3SE +/- 3.52, N = 5SE +/- 0.83, N = 3SE +/- 2.38, N = 3SE +/- 2.47, N = 3SE +/- 1.66, N = 3SE +/- 4.22, N = 3SE +/- 2.41, N = 3SE +/- 3.84, N = 4SE +/- 1.18, N = 3SE +/- 0.30, N = 3SE +/- 0.44, N = 3291.37319.76380.14331.76333.73341.51335.58308.95248.03330.26354.59227.22314.67176.00276.93256.79

OpenBenchmarking.orgimages/sec Per Watt, More Is BetterTensorFlow 2.16.1Device: CPU - Batch Size: 256 - Model: GoogLeNetXeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN0.51081.02161.53242.04322.5540.9361.5031.3850.8331.1410.6841.1700.6900.6661.3051.6200.7751.8960.9322.1152.270

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.16.1Device: CPU - Batch Size: 256 - Model: ResNet-50Xeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN4080120160200SE +/- 0.21, N = 3SE +/- 0.58, N = 3SE +/- 0.03, N = 3SE +/- 1.57, N = 3SE +/- 0.14, N = 3SE +/- 1.40, N = 3SE +/- 0.63, N = 3SE +/- 1.04, N = 12SE +/- 0.50, N = 3SE +/- 1.39, N = 4SE +/- 0.66, N = 3SE +/- 0.57, N = 3SE +/- 2.00, N = 12SE +/- 0.18, N = 3SE +/- 0.05, N = 3SE +/- 0.06, N = 3150.33129.02143.67161.06119.73141.95123.69135.28120.11123.37138.11133.87125.76131.3898.7092.82

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.16.1Device: CPU - Batch Size: 256 - Model: AlexNetXeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN400800120016002000SE +/- 1.86, N = 3SE +/- 4.27, N = 3SE +/- 0.54, N = 3SE +/- 5.06, N = 3SE +/- 1.21, N = 3SE +/- 1.15, N = 3SE +/- 6.82, N = 3SE +/- 5.81, N = 3SE +/- 15.82, N = 3SE +/- 1.54, N = 3SE +/- 2.58, N = 3SE +/- 6.01, N = 3SE +/- 4.01, N = 3SE +/- 10.23, N = 15SE +/- 0.99, N = 3SE +/- 0.41, N = 31681.441277.461205.301730.25986.041479.531058.991528.411560.561301.261278.581524.741454.711403.46843.63771.47

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.16.1Device: CPU - Batch Size: 256 - Model: GoogLeNetXeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN110220330440550SE +/- 2.68, N = 3SE +/- 2.30, N = 3SE +/- 0.24, N = 3SE +/- 4.87, N = 3SE +/- 1.67, N = 3SE +/- 2.29, N = 3SE +/- 1.91, N = 3SE +/- 4.80, N = 3SE +/- 0.51, N = 3SE +/- 2.76, N = 15SE +/- 3.87, N = 15SE +/- 1.02, N = 3SE +/- 10.93, N = 12SE +/- 1.11, N = 3SE +/- 0.04, N = 3SE +/- 0.07, N = 3501.39423.59448.46528.93375.73447.50386.00449.91391.40406.58447.61401.84462.79397.44308.46287.42

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.16.1Device: CPU - Batch Size: 512 - Model: ResNet-50Xeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN4080120160200SE +/- 0.61, N = 3SE +/- 0.48, N = 3SE +/- 0.01, N = 3SE +/- 1.39, N = 3SE +/- 1.17, N = 3SE +/- 0.79, N = 3SE +/- 0.61, N = 3SE +/- 1.80, N = 3SE +/- 0.31, N = 3SE +/- 1.42, N = 4SE +/- 0.34, N = 3SE +/- 1.83, N = 3SE +/- 1.62, N = 4SE +/- 0.81, N = 3SE +/- 0.01, N = 3SE +/- 0.02, N = 3169.75140.53148.45174.95117.53145.29125.14138.39137.50121.96140.01161.90135.17174.93101.1795.63

OpenBenchmarking.orgimages/sec Per Watt, More Is BetterTensorFlow 2.16.1Device: CPU - Batch Size: 512 - Model: AlexNetXeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN2468103.9034.8614.4263.1473.2202.5373.4092.6743.5264.6755.2943.8536.8994.5696.4946.990

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.16.1Device: CPU - Batch Size: 512 - Model: AlexNetXeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN400800120016002000SE +/- 19.23, N = 3SE +/- 1.84, N = 3SE +/- 0.51, N = 3SE +/- 18.52, N = 3SE +/- 3.89, N = 3SE +/- 17.88, N = 4SE +/- 5.13, N = 3SE +/- 8.55, N = 3SE +/- 23.15, N = 4SE +/- 0.49, N = 3SE +/- 0.67, N = 3SE +/- 12.71, N = 3SE +/- 4.07, N = 3SE +/- 7.97, N = 3SE +/- 0.35, N = 3SE +/- 0.57, N = 32039.631486.121278.451899.641047.961604.111108.951677.621897.641392.911363.331862.791620.531876.66875.23796.82

ONNX Runtime

ONNX Runtime is developed by Microsoft and partners as a open-source, cross-platform, high performance machine learning inferencing and training accelerator. This test profile runs the ONNX Runtime with various models available from the ONNX Model Zoo. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.17Model: yolov4 - Device: CPU - Executor: StandardXeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN612182430SE +/- 0.09991, N = 3SE +/- 0.05084, N = 3SE +/- 0.04802, N = 3SE +/- 0.06825, N = 3SE +/- 0.16821, N = 15SE +/- 0.29451, N = 15SE +/- 0.15263, N = 15SE +/- 0.09595, N = 14SE +/- 0.08454, N = 3SE +/- 0.12519, N = 3SE +/- 0.08554, N = 8SE +/- 0.04207, N = 3SE +/- 0.05314, N = 3SE +/- 0.09575, N = 3SE +/- 0.10588, N = 4SE +/- 0.09781, N = 516.9672022.9689019.8593015.5555018.2179014.4831016.9166014.458307.248699.736859.860186.412298.295336.749778.874468.752331. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.17Model: yolov4 - Device: CPU - Executor: ParallelXeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN510152025SE +/- 0.11392, N = 3SE +/- 0.13074, N = 3SE +/- 0.01672, N = 3SE +/- 0.01439, N = 3SE +/- 0.05802, N = 3SE +/- 0.12795, N = 3SE +/- 0.00279, N = 3SE +/- 0.02010, N = 3SE +/- 0.00606, N = 3SE +/- 0.00491, N = 3SE +/- 0.01934, N = 3SE +/- 0.02467, N = 3SE +/- 0.01474, N = 3SE +/- 0.07368, N = 3SE +/- 0.00112, N = 3SE +/- 0.03807, N = 314.1980020.8795018.1413012.7546016.1742013.0869016.3898012.597406.318289.800089.785166.348918.635945.557678.758148.472831. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.17Model: fcn-resnet101-11 - Device: CPU - Executor: StandardXeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN3691215SE +/- 0.04271, N = 3SE +/- 0.05824, N = 3SE +/- 0.00664, N = 3SE +/- 0.07619, N = 15SE +/- 0.15651, N = 15SE +/- 0.34632, N = 12SE +/- 0.22869, N = 15SE +/- 0.16487, N = 15SE +/- 0.06453, N = 15SE +/- 0.16422, N = 12SE +/- 0.15150, N = 15SE +/- 0.00718, N = 3SE +/- 0.08489, N = 15SE +/- 0.07023, N = 3SE +/- 0.14467, N = 12SE +/- 0.11914, N = 159.926849.118858.5971910.836237.241878.399626.549658.260165.497115.665085.550184.538176.011644.914204.664914.465331. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.17Model: fcn-resnet101-11 - Device: CPU - Executor: ParallelXeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN0.74441.48882.23322.97763.722SE +/- 0.038257, N = 3SE +/- 0.008053, N = 3SE +/- 0.008707, N = 3SE +/- 0.007683, N = 3SE +/- 0.011894, N = 3SE +/- 0.027020, N = 13SE +/- 0.015170, N = 3SE +/- 0.026516, N = 3SE +/- 0.001170, N = 3SE +/- 0.020352, N = 15SE +/- 0.013875, N = 12SE +/- 0.016597, N = 12SE +/- 0.018814, N = 3SE +/- 0.034519, N = 3SE +/- 0.023203, N = 3SE +/- 0.018603, N = 153.0508503.3083603.0392202.8349802.6254402.1746302.6172102.1048000.8576851.2517901.2513500.9170433.1315602.5170902.5727802.2545301. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.17Model: super-resolution-10 - Device: CPU - Executor: StandardXeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN60120180240300SE +/- 3.39, N = 3SE +/- 0.03, N = 3SE +/- 0.16, N = 3SE +/- 4.15, N = 15SE +/- 0.09, N = 3SE +/- 2.30, N = 4SE +/- 0.25, N = 3SE +/- 1.02, N = 3SE +/- 2.15, N = 12SE +/- 0.58, N = 3SE +/- 0.67, N = 3SE +/- 0.61, N = 3SE +/- 0.26, N = 3SE +/- 2.46, N = 15SE +/- 0.30, N = 3SE +/- 0.30, N = 3251.31259.19227.42212.92217.88205.89213.99199.90119.56122.95122.6895.84106.1398.64106.53102.971. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.17Model: super-resolution-10 - Device: CPU - Executor: ParallelXeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN50100150200250SE +/- 1.38, N = 3SE +/- 1.98, N = 3SE +/- 2.34, N = 3SE +/- 0.74, N = 3SE +/- 0.98, N = 3SE +/- 1.17, N = 3SE +/- 0.61, N = 3SE +/- 0.62, N = 3SE +/- 0.41, N = 3SE +/- 0.99, N = 3SE +/- 0.36, N = 3SE +/- 0.53, N = 3SE +/- 0.26, N = 3SE +/- 0.83, N = 3SE +/- 0.54, N = 3SE +/- 0.72, N = 3214.81234.54205.53188.89195.71173.91190.06169.8587.26108.87110.0086.9294.7478.0797.0596.171. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.17Model: bertsquad-12 - Device: CPU - Executor: StandardXeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN612182430SE +/- 0.22, N = 3SE +/- 0.02, N = 3SE +/- 0.07, N = 3SE +/- 0.17, N = 3SE +/- 0.20, N = 3SE +/- 0.19, N = 3SE +/- 0.09, N = 3SE +/- 0.35, N = 15SE +/- 0.39, N = 15SE +/- 0.04, N = 3SE +/- 0.03, N = 3SE +/- 0.10, N = 6SE +/- 0.09, N = 15SE +/- 0.27, N = 12SE +/- 0.08, N = 3SE +/- 0.17, N = 322.4325.1620.1516.5721.1716.6420.0117.9911.2713.9713.8610.6611.4210.7512.3911.541. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.17Model: bertsquad-12 - Device: CPU - Executor: ParallelXeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN510152025SE +/- 0.02832, N = 3SE +/- 0.21736, N = 3SE +/- 0.04566, N = 3SE +/- 0.02421, N = 3SE +/- 0.06023, N = 3SE +/- 0.09371, N = 3SE +/- 0.07567, N = 3SE +/- 0.04124, N = 3SE +/- 0.04604, N = 3SE +/- 0.08493, N = 3SE +/- 0.09004, N = 3SE +/- 0.05052, N = 3SE +/- 0.05587, N = 3SE +/- 0.01907, N = 3SE +/- 0.10485, N = 3SE +/- 0.10146, N = 415.4341019.6773016.0956014.5280016.3251013.7366015.7394013.519008.7597112.2807012.254908.809309.652967.984029.800908.871441. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.17Model: GPT-2 - Device: CPU - Executor: StandardXeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN60120180240300SE +/- 8.14, N = 15SE +/- 1.19, N = 3SE +/- 1.50, N = 3SE +/- 1.05, N = 3SE +/- 2.01, N = 15SE +/- 0.58, N = 3SE +/- 1.88, N = 3SE +/- 1.08, N = 3SE +/- 0.46, N = 3SE +/- 0.70, N = 3SE +/- 1.37, N = 5SE +/- 0.13, N = 3SE +/- 0.15, N = 3SE +/- 1.43, N = 15SE +/- 0.28, N = 3SE +/- 0.63, N = 3236.65270.33222.03180.03176.33141.95168.86132.71161.95162.09126.82102.5789.7486.6989.2188.571. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.17Model: GPT-2 - Device: CPU - Executor: ParallelXeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN50100150200250SE +/- 0.81, N = 3SE +/- 0.27, N = 3SE +/- 0.53, N = 3SE +/- 0.78, N = 3SE +/- 1.04, N = 3SE +/- 1.53, N = 3SE +/- 2.63, N = 3SE +/- 0.26, N = 3SE +/- 0.48, N = 3SE +/- 0.64, N = 3SE +/- 0.08, N = 3SE +/- 0.35, N = 3SE +/- 0.17, N = 3SE +/- 0.19, N = 3SE +/- 0.64, N = 3SE +/- 0.43, N = 3195.45248.68191.56144.64191.11135.98188.93136.69110.17161.50156.61109.46137.1999.22128.98129.651. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.17Model: ArcFace ResNet-100 - Device: CPU - Executor: StandardXeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN1530456075SE +/- 0.51, N = 13SE +/- 0.82, N = 3SE +/- 0.16, N = 3SE +/- 0.48, N = 3SE +/- 0.69, N = 15SE +/- 0.34, N = 3SE +/- 0.59, N = 3SE +/- 0.21, N = 3SE +/- 0.57, N = 15SE +/- 0.06, N = 3SE +/- 0.42, N = 4SE +/- 0.32, N = 15SE +/- 0.38, N = 15SE +/- 0.41, N = 15SE +/- 0.07, N = 3SE +/- 0.29, N = 1538.4266.5252.8236.2547.2740.5742.2733.9623.5041.4739.2623.5830.8618.0130.3731.061. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.17Model: ArcFace ResNet-100 - Device: CPU - Executor: ParallelXeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN1428425670SE +/- 0.27, N = 3SE +/- 0.27, N = 3SE +/- 0.10, N = 3SE +/- 0.09, N = 3SE +/- 0.28, N = 3SE +/- 0.12, N = 3SE +/- 0.21, N = 3SE +/- 0.11, N = 3SE +/- 0.05, N = 3SE +/- 0.04, N = 3SE +/- 0.03, N = 3SE +/- 0.06, N = 3SE +/- 0.08, N = 3SE +/- 0.06, N = 3SE +/- 0.12, N = 3SE +/- 0.24, N = 331.4660.4146.8529.1540.7332.8142.2729.2015.0529.8529.2715.0124.6111.9427.3126.251. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.17Model: ResNet50 v1-12-int8 - Device: CPU - Executor: StandardXeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN70140210280350SE +/- 0.40, N = 3SE +/- 2.52, N = 3SE +/- 1.80, N = 3SE +/- 1.01, N = 3SE +/- 2.40, N = 3SE +/- 2.72, N = 15SE +/- 3.31, N = 5SE +/- 1.78, N = 3SE +/- 3.21, N = 15SE +/- 0.95, N = 3SE +/- 4.35, N = 15SE +/- 3.84, N = 12SE +/- 2.12, N = 15SE +/- 1.44, N = 15SE +/- 2.24, N = 15SE +/- 2.40, N = 15171.23314.06315.41177.76330.10174.68296.80161.89141.83243.34225.31133.49160.90117.62219.06211.191. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.17Model: ResNet50 v1-12-int8 - Device: CPU - Executor: ParallelXeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN70140210280350SE +/- 1.63, N = 3SE +/- 2.50, N = 3SE +/- 0.53, N = 3SE +/- 0.73, N = 3SE +/- 1.74, N = 3SE +/- 0.47, N = 3SE +/- 2.72, N = 3SE +/- 0.73, N = 3SE +/- 0.54, N = 3SE +/- 1.50, N = 3SE +/- 2.31, N = 4SE +/- 0.54, N = 3SE +/- 0.53, N = 3SE +/- 0.66, N = 3SE +/- 1.54, N = 15SE +/- 1.50, N = 15153.92308.80313.10156.46319.04166.49301.14153.41100.46178.70190.38100.36153.2588.37207.34203.061. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.17Model: CaffeNet 12-int8 - Device: CPU - Executor: StandardXeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN2004006008001000SE +/- 8.88, N = 3SE +/- 2.43, N = 3SE +/- 11.46, N = 3SE +/- 6.50, N = 15SE +/- 12.91, N = 15SE +/- 1.83, N = 3SE +/- 7.34, N = 3SE +/- 6.21, N = 5SE +/- 7.76, N = 15SE +/- 6.60, N = 3SE +/- 9.50, N = 15SE +/- 4.37, N = 15SE +/- 2.19, N = 3SE +/- 2.36, N = 11SE +/- 4.84, N = 4SE +/- 6.13, N = 3754.81908.19852.33696.98728.47604.76705.61581.77446.81672.92604.05444.85382.10316.11443.06446.691. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.17Model: CaffeNet 12-int8 - Device: CPU - Executor: ParallelXeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN2004006008001000SE +/- 2.57, N = 3SE +/- 10.06, N = 4SE +/- 5.72, N = 3SE +/- 4.81, N = 3SE +/- 4.16, N = 3SE +/- 1.77, N = 3SE +/- 4.87, N = 3SE +/- 1.98, N = 3SE +/- 4.10, N = 3SE +/- 5.53, N = 15SE +/- 4.99, N = 15SE +/- 2.35, N = 15SE +/- 3.02, N = 15SE +/- 2.41, N = 15SE +/- 0.91, N = 3SE +/- 5.34, N = 6605.59830.73784.30566.38687.67492.89678.48478.47310.59590.71586.18315.36452.32270.63547.52553.471. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.17Model: Faster R-CNN R-50-FPN-int8 - Device: CPU - Executor: StandardXeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN1122334455SE +/- 0.11, N = 3SE +/- 0.10, N = 3SE +/- 0.05, N = 3SE +/- 0.13, N = 3SE +/- 0.09, N = 3SE +/- 0.31, N = 3SE +/- 0.27, N = 3SE +/- 0.26, N = 3SE +/- 0.76, N = 15SE +/- 1.36, N = 15SE +/- 0.91, N = 15SE +/- 0.92, N = 15SE +/- 0.63, N = 15SE +/- 0.27, N = 15SE +/- 0.87, N = 15SE +/- 0.82, N = 1534.6634.4634.0033.6130.0027.6129.4327.7844.0646.8842.0739.8037.9635.8736.0837.531. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.17Model: Faster R-CNN R-50-FPN-int8 - Device: CPU - Executor: ParallelXeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN816243240SE +/- 0.00, N = 3SE +/- 0.01, N = 3SE +/- 0.07, N = 3SE +/- 0.06, N = 3SE +/- 0.10, N = 3SE +/- 0.34, N = 3SE +/- 0.07, N = 3SE +/- 0.19, N = 3SE +/- 0.08, N = 3SE +/- 0.19, N = 3SE +/- 0.36, N = 3SE +/- 0.05, N = 3SE +/- 0.33, N = 4SE +/- 0.24, N = 7SE +/- 0.14, N = 3SE +/- 0.25, N = 331.7133.3832.3430.0428.5224.7328.4824.6824.0528.7329.8425.6327.4526.3327.9427.871. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.17Model: T5 Encoder - Device: CPU - Executor: StandardXeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN100200300400500SE +/- 3.01, N = 3SE +/- 1.00, N = 3SE +/- 0.84, N = 3SE +/- 0.26, N = 3SE +/- 3.95, N = 15SE +/- 1.31, N = 3SE +/- 0.51, N = 3SE +/- 0.89, N = 3SE +/- 4.17, N = 15SE +/- 1.35, N = 3SE +/- 1.08, N = 3SE +/- 1.86, N = 3SE +/- 1.16, N = 3SE +/- 1.15, N = 3SE +/- 0.98, N = 13SE +/- 0.54, N = 3356.76460.78357.36288.47219.53199.08215.13185.46263.52279.64187.01167.11131.00127.54127.09127.211. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.17Model: T5 Encoder - Device: CPU - Executor: ParallelXeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN100200300400500SE +/- 1.73, N = 3SE +/- 3.84, N = 3SE +/- 0.86, N = 3SE +/- 2.94, N = 3SE +/- 3.48, N = 15SE +/- 2.44, N = 3SE +/- 1.74, N = 3SE +/- 1.67, N = 15SE +/- 0.65, N = 3SE +/- 3.58, N = 3SE +/- 0.55, N = 3SE +/- 2.43, N = 3SE +/- 3.02, N = 3SE +/- 0.64, N = 3SE +/- 2.24, N = 3SE +/- 1.96, N = 3354.75462.86326.14246.34337.00246.68346.21252.67276.21446.30374.75271.62319.45250.63255.67254.731. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

OpenVKL

OpenBenchmarking.orgItems / Sec Per Watt, More Is BetterOpenVKL 2.0.0Benchmark: vklBenchmarkCPU ISPCXeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN36912155.1066.2615.3914.2873.7982.7454.1292.8535.7636.8617.6016.1029.4577.6739.1639.780

OpenBenchmarking.orgItems / Sec, More Is BetterOpenVKL 2.0.0Benchmark: vklBenchmarkCPU ISPCXeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN9001800270036004500SE +/- 13.62, N = 3SE +/- 2.08, N = 3SE +/- 1.53, N = 3SE +/- 6.74, N = 3SE +/- 6.66, N = 3SE +/- 8.62, N = 3SE +/- 13.96, N = 3SE +/- 4.36, N = 3SE +/- 5.36, N = 3SE +/- 1.00, N = 3SE +/- 1.20, N = 3SE +/- 8.67, N = 3SE +/- 0.88, N = 3SE +/- 26.33, N = 3SE +/- 1.20, N = 3SE +/- 8.17, N = 33222200417342716124317761356185239062396207733352508401212661177MIN: 248 / MAX: 36519MIN: 134 / MAX: 29750MIN: 104 / MAX: 26188MIN: 188 / MAX: 30888MIN: 95 / MAX: 19286MIN: 177 / MAX: 27371MIN: 107 / MAX: 20909MIN: 191 / MAX: 28947MIN: 350 / MAX: 44654MIN: 187 / MAX: 29055MIN: 160 / MAX: 26161MIN: 299 / MAX: 40960MIN: 207 / MAX: 30640MIN: 382 / MAX: 47557MIN: 98 / MAX: 15312MIN: 91 / MAX: 14403

OSPRay

OpenBenchmarking.orgItems Per Second Per Watt, More Is BetterOSPRay 3.1Benchmark: gravity_spheres_volume/dim_512/pathtracer/real_timeXeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN0.0320.0640.0960.1280.160.0770.0880.0790.0680.0630.0550.0700.0600.0840.0940.1120.0910.1300.1110.1350.142

OpenBenchmarking.orgItems Per Second Per Watt, More Is BetterOSPRay 3.1Benchmark: particle_volume/ao/real_timeXeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN0.0290.0580.0870.1160.1450.0800.0910.0650.0560.0600.0430.0560.0490.0720.0850.0960.0790.1140.0950.1210.129

OpenBenchmarking.orgItems Per Second Per Watt, More Is BetterOSPRay 3.1Benchmark: particle_volume/scivis/real_timeXeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN0.03260.06520.09780.13040.1630.0910.1060.0740.0610.0630.0470.0610.0530.0810.0980.1070.0860.1330.1070.1390.145

OpenBenchmarking.orgItems Per Second, More Is BetterOSPRay 3.1Benchmark: gravity_spheres_volume/dim_512/pathtracer/real_timeXeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN1428425670SE +/- 0.04, N = 3SE +/- 0.03, N = 3SE +/- 0.02, N = 3SE +/- 0.02, N = 3SE +/- 0.01, N = 3SE +/- 0.09, N = 3SE +/- 0.03, N = 3SE +/- 0.16, N = 3SE +/- 0.14, N = 3SE +/- 0.04, N = 3SE +/- 0.01, N = 3SE +/- 0.07, N = 3SE +/- 0.02, N = 3SE +/- 0.05, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 348.7627.1024.6442.8219.9135.9322.3639.3460.3734.6430.6152.6737.7463.8518.4716.92

OpenBenchmarking.orgItems Per Second, More Is BetterOSPRay 3.1Benchmark: particle_volume/ao/real_timeXeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN1326395265SE +/- 0.07, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.02, N = 3SE +/- 0.04, N = 3SE +/- 0.02, N = 3SE +/- 0.01, N = 3SE +/- 0.00, N = 3SE +/- 0.03, N = 3SE +/- 0.02, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.03, N = 3SE +/- 0.02, N = 3SE +/- 0.02, N = 3SE +/- 0.04, N = 354.1230.8421.9338.2216.0529.5018.5533.1155.3432.5228.1047.6135.2556.6917.9716.45

OpenBenchmarking.orgItems Per Second, More Is BetterOSPRay 3.1Benchmark: particle_volume/scivis/real_timeXeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN1326395265SE +/- 0.05, N = 3SE +/- 0.04, N = 3SE +/- 0.01, N = 3SE +/- 0.02, N = 3SE +/- 0.01, N = 3SE +/- 0.06, N = 3SE +/- 0.04, N = 3SE +/- 0.04, N = 3SE +/- 0.02, N = 3SE +/- 0.02, N = 3SE +/- 0.01, N = 3SE +/- 0.05, N = 3SE +/- 0.02, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 353.9330.6821.8938.2316.0929.3518.4933.1355.2632.5228.0747.5335.1556.4517.9416.45

GraphicsMagick

OpenBenchmarking.orgIterations Per Minute Per Watt, More Is BetterGraphicsMagick 1.3.43Operation: SwirlXeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN0.73981.47962.21942.95923.6991.3071.7241.6171.1371.1930.8511.3410.9641.2982.0362.2901.4452.7791.7103.0933.288

OpenBenchmarking.orgIterations Per Minute, More Is BetterGraphicsMagick 1.3.43Operation: Noise-GaussianXeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN4080120160200SE +/- 0.88, N = 3SE +/- 0.00, N = 3SE +/- 0.33, N = 3SE +/- 1.15, N = 3SE +/- 0.33, N = 3SE +/- 0.58, N = 3SE +/- 0.33, N = 3SE +/- 0.33, N = 3SE +/- 0.67, N = 3SE +/- 0.00, N = 3SE +/- 0.58, N = 3SE +/- 0.67, N = 3SE +/- 0.58, N = 3SE +/- 0.58, N = 3SE +/- 0.33, N = 3SE +/- 0.00, N = 31941711581821501501581641791651601781511641231201. (CC) gcc options: -fopenmp -O2 -ltiff -ljbig -lsharpyuv -lwebp -lwebpmux -lfreetype -ljpeg -lXext -lSM -lICE -lX11 -lxml2 -lzstd -llzma -lbz2 -lz -lm -lpthread -lgomp

OpenBenchmarking.orgIterations Per Minute, More Is BetterGraphicsMagick 1.3.43Operation: EnhancedXeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN90180270360450SE +/- 1.15, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.33, N = 3SE +/- 0.00, N = 3SE +/- 2.60, N = 3SE +/- 0.00, N = 3SE +/- 1.00, N = 3SE +/- 0.33, N = 3SE +/- 0.67, N = 3SE +/- 0.33, N = 3SE +/- 1.20, N = 3SE +/- 0.33, N = 3SE +/- 0.33, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 33742282163421602691813014083002643683044031721631. (CC) gcc options: -fopenmp -O2 -ltiff -ljbig -lsharpyuv -lwebp -lwebpmux -lfreetype -ljpeg -lXext -lSM -lICE -lX11 -lxml2 -lzstd -llzma -lbz2 -lz -lm -lpthread -lgomp

OpenBenchmarking.orgIterations Per Minute, More Is BetterGraphicsMagick 1.3.43Operation: SharpenXeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN70140210280350SE +/- 1.67, N = 3SE +/- 0.00, N = 3SE +/- 0.33, N = 3SE +/- 1.67, N = 3SE +/- 0.00, N = 3SE +/- 1.20, N = 3SE +/- 0.00, N = 3SE +/- 0.33, N = 3SE +/- 0.88, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 1.20, N = 3SE +/- 0.33, N = 3SE +/- 3.00, N = 3SE +/- 0.00, N = 3SE +/- 0.33, N = 32841671572651141991302272972011732622073101121051. (CC) gcc options: -fopenmp -O2 -ltiff -ljbig -lsharpyuv -lwebp -lwebpmux -lfreetype -ljpeg -lXext -lSM -lICE -lX11 -lxml2 -lzstd -llzma -lbz2 -lz -lm -lpthread -lgomp

OpenBenchmarking.orgIterations Per Minute, More Is BetterGraphicsMagick 1.3.43Operation: SwirlXeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN150300450600750SE +/- 0.58, N = 3SE +/- 0.88, N = 3SE +/- 1.15, N = 3SE +/- 1.76, N = 3SE +/- 0.58, N = 3SE +/- 1.33, N = 3SE +/- 0.67, N = 3SE +/- 0.67, N = 3SE +/- 0.67, N = 3SE +/- 0.00, N = 3SE +/- 0.33, N = 3SE +/- 0.33, N = 3SE +/- 0.33, N = 3SE +/- 0.33, N = 3SE +/- 0.33, N = 3SE +/- 0.88, N = 36895295026173945094325585835465115535355673793631. (CC) gcc options: -fopenmp -O2 -ltiff -ljbig -lsharpyuv -lwebp -lwebpmux -lfreetype -ljpeg -lXext -lSM -lICE -lX11 -lxml2 -lzstd -llzma -lbz2 -lz -lm -lpthread -lgomp

Coremark

This is a test of EEMBC CoreMark processor benchmark. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgIterations/Sec, More Is BetterCoremark 1.0CoreMark Size 666 - Iterations Per SecondXeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN2M4M6M8M10MSE +/- 9700.21, N = 3SE +/- 4635.95, N = 3SE +/- 9256.47, N = 3SE +/- 12743.41, N = 3SE +/- 1747.99, N = 3SE +/- 7219.73, N = 3SE +/- 5202.86, N = 3SE +/- 20649.43, N = 3SE +/- 76743.24, N = 3SE +/- 54326.71, N = 3SE +/- 10132.66, N = 3SE +/- 2306.54, N = 3SE +/- 4775.53, N = 3SE +/- 54771.53, N = 3SE +/- 1374.66, N = 3SE +/- 11678.22, N = 34966250.782369998.362194630.603902076.241614763.702993136.601855135.333279262.538448083.734152864.883926265.287975907.454525288.008171241.712274636.132069432.531. (CC) gcc options: -O2 -lrt" -lrt

Aircrack-ng

OpenBenchmarking.orgk/s Per Watt, More Is BetterAircrack-ng 1.7Xeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684XEPYC 9654EPYC 9754EPYC 8534PEPYC 8534PN30060090012001500128.68507.73479.3697.52377.96142.86433.27112.13585.84702.97763.991057.151173.57

OpenBenchmarking.orgk/s, More Is BetterAircrack-ng 1.7Xeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684XEPYC 9654EPYC 9754EPYC 8534PEPYC 8534PN40K80K120K160K200KSE +/- 773.70, N = 3SE +/- 840.59, N = 3SE +/- 1953.08, N = 3SE +/- 1197.41, N = 15SE +/- 36.42, N = 3SE +/- 1027.07, N = 15SE +/- 122.31, N = 3SE +/- 1131.21, N = 15SE +/- 1622.56, N = 3SE +/- 207.11, N = 3SE +/- 714.86, N = 3SE +/- 338.71, N = 3SE +/- 319.60, N = 364181.29153584.20147469.3353914.93117588.9983665.76134048.9665663.82206619.29186675.43177989.89153818.03141831.781. (CXX) g++ options: -std=gnu++17 -O3 -fvisibility=hidden -fcommon -rdynamic -lnl-3 -lnl-genl-3 -lpcre -lsqlite3 -lpthread -lz -lssl -lcrypto -lhwloc -ldl -lm -pthread

EPYC 9684X 2P: The test run did not produce a result.

EPYC 9654 2P: The test run did not produce a result.

EPYC 9754 2P: The test run did not produce a result.

LuxCoreRender

OpenBenchmarking.orgM samples/sec Per Watt, More Is BetterLuxCoreRender 2.6Scene: DLSC - Acceleration: CPUXeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN0.01490.02980.04470.05960.07450.0190.0290.0260.0170.0230.0150.0240.0160.0310.0420.0480.0310.0540.0390.0600.066

OpenBenchmarking.orgM samples/sec, More Is BetterLuxCoreRender 2.6Scene: LuxCore Benchmark - Acceleration: CPUXeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN3691215SE +/- 0.17, N = 12SE +/- 0.11, N = 3SE +/- 0.04, N = 3SE +/- 0.12, N = 3SE +/- 0.03, N = 3SE +/- 0.22, N = 12SE +/- 0.05, N = 3SE +/- 0.16, N = 15SE +/- 0.12, N = 15SE +/- 0.04, N = 3SE +/- 0.10, N = 7SE +/- 0.11, N = 15SE +/- 0.16, N = 3SE +/- 0.08, N = 15SE +/- 0.02, N = 3SE +/- 0.02, N = 38.888.067.108.826.306.816.827.4110.6112.4311.3410.5612.419.657.386.93MIN: 3.73 / MAX: 11.48MIN: 3.62 / MAX: 9.37MIN: 3.06 / MAX: 8.2MIN: 3.72 / MAX: 10.41MIN: 2.53 / MAX: 7.3MIN: 2.55 / MAX: 9.19MIN: 2.81 / MAX: 7.94MIN: 2.67 / MAX: 9.42MIN: 3.78 / MAX: 13.37MIN: 5.47 / MAX: 14.43MIN: 4.84 / MAX: 13.61MIN: 3.72 / MAX: 13.3MIN: 5.2 / MAX: 14.7MIN: 3.42 / MAX: 12.1MIN: 2.8 / MAX: 8.68MIN: 2.6 / MAX: 8.15

OpenBenchmarking.orgM samples/sec, More Is BetterLuxCoreRender 2.6Scene: Orange Juice - Acceleration: CPUXeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN816243240SE +/- 0.30, N = 15SE +/- 0.05, N = 3SE +/- 0.07, N = 3SE +/- 0.12, N = 3SE +/- 0.10, N = 3SE +/- 0.16, N = 15SE +/- 0.04, N = 3SE +/- 0.28, N = 15SE +/- 1.06, N = 15SE +/- 0.28, N = 5SE +/- 0.18, N = 15SE +/- 0.84, N = 15SE +/- 0.07, N = 3SE +/- 1.12, N = 15SE +/- 0.05, N = 3SE +/- 0.05, N = 319.9114.7413.4618.7011.8616.9112.5016.6433.0824.6921.3229.6123.7632.2613.8113.00MIN: 15 / MAX: 30.59MIN: 12.17 / MAX: 18.21MIN: 11.09 / MAX: 16.56MIN: 16.22 / MAX: 25.05MIN: 9.93 / MAX: 13.28MIN: 12.9 / MAX: 23.07MIN: 10.38 / MAX: 14.93MIN: 12.39 / MAX: 24.93MIN: 24.95 / MAX: 50.9MIN: 20.63 / MAX: 30.25MIN: 18.08 / MAX: 26.9MIN: 22.93 / MAX: 46.21MIN: 20.86 / MAX: 33.07MIN: 23.52 / MAX: 56.17MIN: 11.85 / MAX: 16.24MIN: 11.12 / MAX: 14.81

OpenBenchmarking.orgM samples/sec, More Is BetterLuxCoreRender 2.6Scene: DLSC - Acceleration: CPUXeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN510152025SE +/- 0.24, N = 15SE +/- 0.02, N = 3SE +/- 0.06, N = 15SE +/- 0.23, N = 15SE +/- 0.08, N = 3SE +/- 0.12, N = 3SE +/- 0.10, N = 3SE +/- 0.20, N = 15SE +/- 0.91, N = 15SE +/- 0.18, N = 15SE +/- 0.13, N = 3SE +/- 0.12, N = 3SE +/- 0.28, N = 15SE +/- 1.02, N = 15SE +/- 0.06, N = 15SE +/- 0.03, N = 312.749.388.7211.127.4610.178.0010.4422.5816.2114.2917.8916.7922.009.398.48MIN: 10.69 / MAX: 19.19MIN: 8.94 / MAX: 11.49MIN: 8.12 / MAX: 10.6MIN: 9.18 / MAX: 17.51MIN: 7.17 / MAX: 8.21MIN: 9.34 / MAX: 14.75MIN: 7.65 / MAX: 9.12MIN: 8.86 / MAX: 16.08MIN: 17.46 / MAX: 32.78MIN: 15.2 / MAX: 19.13MIN: 13.78 / MAX: 17.04MIN: 16.29 / MAX: 28.22MIN: 15.23 / MAX: 21.36MIN: 16.32 / MAX: 35.07MIN: 8.9 / MAX: 10.42MIN: 8.26 / MAX: 9.41

SecureMark

OpenBenchmarking.orgmarks Per Watt, More Is BetterSecureMark 1.0.4Benchmark: SecureMark-TLSXeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN100020003000400050001242.563643.383029.201185.322308.76986.372198.71973.551152.382686.163034.031272.883204.231278.594697.254781.86

OpenBenchmarking.orgmarks, More Is BetterSecureMark 1.0.4Benchmark: SecureMark-TLSXeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN70K140K210K280K350KSE +/- 411.11, N = 3SE +/- 209.97, N = 3SE +/- 625.56, N = 3SE +/- 330.95, N = 3SE +/- 256.85, N = 3SE +/- 384.08, N = 3SE +/- 670.43, N = 3SE +/- 196.24, N = 3SE +/- 809.90, N = 3SE +/- 415.71, N = 3SE +/- 361.20, N = 3SE +/- 389.81, N = 3SE +/- 457.42, N = 3SE +/- 553.62, N = 3SE +/- 372.96, N = 3SE +/- 542.88, N = 33084343098962772052754722776472775892772602772983017403008332983412996102506952510752500242501621. (CC) gcc options: -pedantic -O3

Zstd Compression

This test measures the time needed to compress/decompress a sample file (silesia.tar) using Zstd (Zstandard) compression with options for different compression levels / settings. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgMB/s, More Is BetterZstd Compression 1.5.4Compression Level: 19 - Compression SpeedXeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN48121620SE +/- 0.03, N = 3SE +/- 0.21, N = 4SE +/- 0.06, N = 3SE +/- 0.12, N = 3SE +/- 0.15, N = 3SE +/- 0.09, N = 15SE +/- 0.11, N = 15SE +/- 0.13, N = 15SE +/- 0.22, N = 3SE +/- 0.03, N = 3SE +/- 0.00, N = 3SE +/- 0.09, N = 3SE +/- 0.06, N = 3SE +/- 0.03, N = 3SE +/- 0.00, N = 3SE +/- 0.03, N = 317.818.014.615.214.413.814.513.316.817.217.217.013.813.713.913.81. (CC) gcc options: -O3 -pthread -lz -llzma

OpenBenchmarking.orgMB/s Per Watt, More Is BetterZstd Compression 1.5.4Compression Level: 19 - Decompression SpeedXeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN5101520254.0088.7056.4652.8285.6162.5065.5482.5205.29211.71113.3085.81814.0655.87519.69820.546

OpenBenchmarking.orgMB/s, More Is BetterZstd Compression 1.5.4Compression Level: 19 - Decompression SpeedXeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN30060090012001500SE +/- 1.88, N = 3SE +/- 3.01, N = 4SE +/- 4.45, N = 3SE +/- 4.96, N = 3SE +/- 2.12, N = 3SE +/- 0.66, N = 15SE +/- 1.08, N = 15SE +/- 0.65, N = 15SE +/- 1.73, N = 3SE +/- 7.31, N = 3SE +/- 0.46, N = 3SE +/- 2.20, N = 3SE +/- 0.83, N = 3SE +/- 1.83, N = 3SE +/- 21.23, N = 3SE +/- 1.58, N = 31165.81221.81032.0963.61126.41040.21127.51039.21392.51385.31388.91382.11139.91139.01118.81144.81. (CC) gcc options: -O3 -pthread -lz -llzma

OpenBenchmarking.orgMB/s, More Is BetterZstd Compression 1.5.4Compression Level: 19, Long Mode - Decompression SpeedXeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN30060090012001500SE +/- 1.60, N = 3SE +/- 0.84, N = 3SE +/- 0.43, N = 3SE +/- 3.69, N = 3SE +/- 0.56, N = 3SE +/- 1.00, N = 3SE +/- 1.45, N = 3SE +/- 1.78, N = 15SE +/- 2.93, N = 3SE +/- 1.99, N = 3SE +/- 1.17, N = 3SE +/- 1.87, N = 3SE +/- 1.95, N = 3SE +/- 0.19, N = 3SE +/- 2.09, N = 3SE +/- 0.92, N = 31189.71242.61069.1992.11131.11041.81133.31046.01321.41324.91328.51324.61102.21104.21101.41096.51. (CC) gcc options: -O3 -pthread -lz -llzma

OpenBenchmarking.orgMB/s, More Is BetterZstd Compression 1.5.4Compression Level: 19, Long Mode - Compression SpeedXeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN3691215SE +/- 0.04, N = 3SE +/- 0.05, N = 3SE +/- 0.03, N = 3SE +/- 0.05, N = 3SE +/- 0.04, N = 3SE +/- 0.03, N = 3SE +/- 0.03, N = 3SE +/- 0.06, N = 15SE +/- 0.03, N = 3SE +/- 0.02, N = 3SE +/- 0.02, N = 3SE +/- 0.03, N = 3SE +/- 0.02, N = 3SE +/- 0.05, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 39.679.807.948.167.767.627.727.468.428.458.388.306.686.646.766.741. (CC) gcc options: -O3 -pthread -lz -llzma

srsRAN Project

srsRAN Project is a complete ORAN-native 5G RAN solution created by Software Radio Systems (SRS). The srsRAN Project radio suite was formerly known as srsLTE and can be used for building your own software-defined radio (SDR) 4G/5G mobile network. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgMbps, More Is BettersrsRAN Project 23.10.1-20240325Test: PUSCH Processor Benchmark, Throughput TotalXeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN2K4K6K8K10KSE +/- 0.12, N = 3SE +/- 18.09, N = 3SE +/- 18.43, N = 3SE +/- 47.68, N = 6SE +/- 0.09, N = 3SE +/- 26.47, N = 3SE +/- 18.30, N = 3SE +/- 0.15, N = 3SE +/- 2.29, N = 3SE +/- 55.17, N = 3SE +/- 0.20, N = 3SE +/- 74.95, N = 4SE +/- 63.64, N = 5SE +/- 76.45, N = 3SE +/- 25.25, N = 3SE +/- 19.02, N = 135493.43088.72616.94853.62170.73787.02514.04386.66999.75656.95239.66835.75973.88396.73193.02818.5MIN: 3703.4 / MAX: 5493.6MIN: 1852.6 / MAX: 3124.9MIN: 1591.7 / MAX: 2653.8MIN: 3181.8 / MAX: 4929.4MIN: 1388.2 / MAX: 2170.8MIN: 2545.7 / MAX: 3839.9MIN: 1550.4 / MAX: 2532.5MIN: 2970.2 / MAX: 4386.9MIN: 6424.8 / MAX: 7003.9MIN: 3595.4 / MAX: 5767.2MIN: 3593.7 / MAX: 5240MIN: 6107.2 / MAX: 6950.8MIN: 4286.9 / MAX: 6228.4MIN: 8064.1 / MAX: 8549.4MIN: 1941.2 / MAX: 3219MIN: 1696.8 / MAX: 2893.21. (CXX) g++ options: -O3 -march=native -mavx2 -mavx -msse4.1 -mfma -mavx512f -mavx512cd -mavx512bw -mavx512dq -fno-trapping-math -fno-math-errno -ldl

OpenBenchmarking.orgMbps Per Watt, More Is BettersrsRAN Project 23.10.1-20240325Test: PUSCH Processor Benchmark, Throughput ThreadXeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN0.5111.0221.5332.0442.5550.5641.1960.9650.4260.7500.3450.7360.3470.4761.0951.2570.5241.5510.6372.2342.271

OpenBenchmarking.orgMbps Per Watt, More Is BettersrsRAN Project 23.10.1-20240325Test: PDSCH Processor Benchmark, Throughput TotalXeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN408012016020056.8898.8387.2151.1275.6849.9852.1619.2141.0791.42100.2640.9896.5258.04141.87165.23

OpenBenchmarking.orgMbps Per Watt, More Is BettersrsRAN Project 23.10.1-20240325Test: PDSCH Processor Benchmark, Throughput ThreadXeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN481216204.0748.9296.1162.5985.0852.0354.7882.0653.6398.6289.7954.16210.6754.20013.54814.524

OpenBenchmarking.orgMbps, More Is BettersrsRAN Project 23.10.1-20240325Test: PUSCH Processor Benchmark, Throughput ThreadXeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN306090120150SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3129.5129.5129.7129.7129.7129.7129.7129.7112.2112.2112.2112.2112.1112.1112.1112.1MIN: 105.7MIN: 105.7MIN: 105.9MIN: 105.9MIN: 105.9MIN: 105.9MIN: 105.9MIN: 105.9MIN: 79.3MIN: 79.3MIN: 79.3MIN: 79.3MIN: 79.3MIN: 79.3MIN: 79.3MIN: 79.31. (CXX) g++ options: -O3 -march=native -mavx2 -mavx -msse4.1 -mfma -mavx512f -mavx512cd -mavx512bw -mavx512dq -fno-trapping-math -fno-math-errno -ldl

OpenBenchmarking.orgMbps, More Is BettersrsRAN Project 23.10.1-20240325Test: PDSCH Processor Benchmark, Throughput TotalXeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN7K14K21K28K35KSE +/- 356.81, N = 15SE +/- 298.34, N = 15SE +/- 236.27, N = 4SE +/- 312.17, N = 3SE +/- 938.95, N = 15SE +/- 175.78, N = 4SE +/- 281.72, N = 15SE +/- 490.54, N = 15SE +/- 343.97, N = 3SE +/- 348.28, N = 4SE +/- 357.13, N = 12SE +/- 526.01, N = 15SE +/- 237.63, N = 3SE +/- 2115.57, N = 15SE +/- 207.19, N = 5SE +/- 58.21, N = 330547.626378.124688.530108.721286.630236.015081.011866.725977.429384.927695.222931.825194.629877.119375.919485.81. (CXX) g++ options: -O3 -march=native -mavx2 -mavx -msse4.1 -mfma -mavx512f -mavx512cd -mavx512bw -mavx512dq -fno-trapping-math -fno-math-errno -ldl

OpenBenchmarking.orgMbps, More Is BettersrsRAN Project 23.10.1-20240325Test: PDSCH Processor Benchmark, Throughput ThreadXeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN160320480640800SE +/- 1.89, N = 8SE +/- 1.34, N = 8SE +/- 1.17, N = 8SE +/- 2.57, N = 8SE +/- 1.64, N = 8SE +/- 3.86, N = 8SE +/- 1.27, N = 8SE +/- 5.02, N = 8SE +/- 5.52, N = 8SE +/- 3.13, N = 8SE +/- 1.71, N = 8SE +/- 3.72, N = 8SE +/- 0.80, N = 7SE +/- 4.48, N = 7SE +/- 3.14, N = 7SE +/- 1.24, N = 7755.5742.9680.2675.5702.6651.9705.5663.8664.7680.7684.7673.4596.2576.8557.9563.61. (CXX) g++ options: -O3 -march=native -mavx2 -mavx -msse4.1 -mfma -mavx512f -mavx512cd -mavx512bw -mavx512dq -fno-trapping-math -fno-math-errno -ldl

QuantLib

OpenBenchmarking.orgMFLOPS Per Watt, More Is BetterQuantLib 1.32Configuration: Single-ThreadedXeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN112233445515.0145.3531.9413.2926.6811.1524.9211.0112.8029.6033.7414.2334.8114.0749.1250.14

OpenBenchmarking.orgMFLOPS, More Is BetterQuantLib 1.32Configuration: Single-ThreadedXeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN8001600240032004000SE +/- 30.36, N = 12SE +/- 33.58, N = 3SE +/- 28.42, N = 3SE +/- 25.40, N = 3SE +/- 22.17, N = 3SE +/- 28.11, N = 3SE +/- 25.35, N = 3SE +/- 28.57, N = 3SE +/- 1.14, N = 3SE +/- 22.39, N = 3SE +/- 24.27, N = 3SE +/- 19.83, N = 3SE +/- 14.83, N = 3SE +/- 19.30, N = 3SE +/- 18.64, N = 3SE +/- 14.40, N = 33586.33600.53209.63210.13225.73207.03229.13222.83125.43114.23105.93098.52596.12590.82593.32593.01. (CXX) g++ options: -O3 -march=native -fPIE -pie

OpenBenchmarking.orgMFLOPS, More Is BetterQuantLib 1.32Configuration: Multi-ThreadedXeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN160K320K480K640K800KSE +/- 248.00, N = 3SE +/- 63.14, N = 3SE +/- 105.60, N = 3SE +/- 362.38, N = 3SE +/- 155.19, N = 3SE +/- 286.86, N = 3SE +/- 40.48, N = 3SE +/- 160.59, N = 3SE +/- 1065.76, N = 3SE +/- 412.72, N = 3SE +/- 86.78, N = 3SE +/- 713.18, N = 3SE +/- 156.35, N = 3SE +/- 804.57, N = 3SE +/- 82.80, N = 3SE +/- 86.28, N = 3380867.5195648.8179647.5350187.5143755.3288129.1162727.4316359.2644091.0319827.2294183.2593246.9374413.5759922.1172566.8153920.81. (CXX) g++ options: -O3 -march=native -fPIE -pie

ASKAP

ASKAP is a set of benchmarks from the Australian SKA Pathfinder. The principal ASKAP benchmarks are the Hogbom Clean Benchmark (tHogbomClean) and Convolutional Resamping Benchmark (tConvolve) as well as some previous ASKAP benchmarks being included as well for OpenCL and CUDA execution of tConvolve. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgMillion Grid Points Per Second, More Is BetterASKAP 1.0Test: tConvolve MT - GriddingXeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN3K6K9K12K15KSE +/- 60.72, N = 3SE +/- 54.27, N = 5SE +/- 4.15, N = 3SE +/- 75.19, N = 5SE +/- 87.89, N = 12SE +/- 23.56, N = 3SE +/- 32.87, N = 12SE +/- 195.28, N = 8SE +/- 204.28, N = 3SE +/- 262.30, N = 12SE +/- 59.24, N = 3SE +/- 141.43, N = 5SE +/- 2.09, N = 3SE +/- 21.01, N = 3SE +/- 0.88, N = 3SE +/- 0.88, N = 36038.925062.078088.117630.063375.323347.933406.964382.9714185.1014955.6012394.6012708.5012731.8011208.705826.445821.461. (CXX) g++ options: -O3 -fstrict-aliasing -fopenmp

7-Zip Compression

OpenBenchmarking.orgMIPS Per Watt, More Is Better7-Zip Compression 22.01Test: Decompression RatingXeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN7001400210028003500986.761119.86934.34908.47663.36637.01773.01746.101928.992281.232434.842011.143140.682852.082768.542828.90

OpenBenchmarking.orgMIPS, More Is Better7-Zip Compression 22.01Test: Compression RatingXeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN170K340K510K680K850KSE +/- 709.87, N = 3SE +/- 1982.97, N = 3SE +/- 1535.53, N = 3SE +/- 4200.62, N = 3SE +/- 1836.55, N = 3SE +/- 5127.15, N = 3SE +/- 2258.81, N = 3SE +/- 3924.87, N = 3SE +/- 3075.95, N = 3SE +/- 1520.59, N = 3SE +/- 719.89, N = 3SE +/- 6869.20, N = 3SE +/- 1188.96, N = 3SE +/- 2500.52, N = 3SE +/- 268.94, N = 3SE +/- 206.69, N = 36742394416363881905927293147164917293423635255147413665791125495007617345754407769683313573190941. (CXX) g++ options: -lpthread -ldl -O2 -fPIC

OpenBenchmarking.orgMIPS, More Is Better7-Zip Compression 22.01Test: Decompression RatingXeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN300K600K900K1200K1500KSE +/- 28320.74, N = 3SE +/- 119.21, N = 3SE +/- 61.74, N = 3SE +/- 185.14, N = 3SE +/- 916.22, N = 3SE +/- 2598.93, N = 3SE +/- 374.59, N = 3SE +/- 6276.88, N = 3SE +/- 38431.24, N = 3SE +/- 1085.99, N = 3SE +/- 111.53, N = 3SE +/- 15794.26, N = 3SE +/- 291.68, N = 3SE +/- 14188.09, N = 3SE +/- 120.28, N = 3SE +/- 81.21, N = 35734103381462878625570542077384017072433474691311116465716065642626103327778087113402263679893383551. (CXX) g++ options: -lpthread -ldl -O2 -fPIC

WebP Image Encode

OpenBenchmarking.orgMP/s Per Watt, More Is BetterWebP Image Encode 1.2.4Encode Settings: Quality 100, Highest CompressionXeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN0.01620.03240.04860.06480.0810.0190.0510.0350.0140.0280.0110.0260.0110.0190.0440.0480.0210.0490.0200.0690.072

OpenBenchmarking.orgMP/s Per Watt, More Is BetterWebP Image Encode 1.2.4Encode Settings: Quality 100, Lossless, Highest CompressionXeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN0.0020.0040.0060.0080.010.0020.0050.0040.0020.0030.0010.0030.0010.0020.0050.0060.0030.0060.0030.0090.009

OpenBenchmarking.orgMP/s, More Is BetterWebP Image Encode 1.2.4Encode Settings: Quality 100, Highest CompressionXeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN0.81451.6292.44353.2584.0725SE +/- 0.00, N = 6SE +/- 0.00, N = 6SE +/- 0.00, N = 6SE +/- 0.00, N = 6SE +/- 0.00, N = 6SE +/- 0.00, N = 6SE +/- 0.00, N = 6SE +/- 0.00, N = 6SE +/- 0.00, N = 6SE +/- 0.00, N = 6SE +/- 0.00, N = 6SE +/- 0.00, N = 6SE +/- 0.00, N = 6SE +/- 0.00, N = 6SE +/- 0.00, N = 6SE +/- 0.00, N = 63.463.473.083.073.103.093.103.093.623.613.623.623.043.033.033.031. (CC) gcc options: -fvisibility=hidden -O2 -lm

OpenBenchmarking.orgMP/s, More Is BetterWebP Image Encode 1.2.4Encode Settings: Quality 100, Lossless, Highest CompressionXeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN0.1350.270.4050.540.675SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 30.590.600.520.510.550.540.550.540.560.570.570.570.480.480.480.481. (CC) gcc options: -fvisibility=hidden -O2 -lm

ASKAP

ASKAP is a set of benchmarks from the Australian SKA Pathfinder. The principal ASKAP benchmarks are the Hogbom Clean Benchmark (tHogbomClean) and Convolutional Resamping Benchmark (tConvolve) as well as some previous ASKAP benchmarks being included as well for OpenCL and CUDA execution of tConvolve. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgMpix/sec, More Is BetterASKAP 1.0Test: tConvolve MPI - DegriddingXeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN30K60K90K120K150KSE +/- 480.95, N = 3SE +/- 153.57, N = 3SE +/- 93.91, N = 3SE +/- 378.22, N = 4SE +/- 0.00, N = 3SE +/- 143.60, N = 3SE +/- 76.47, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 189.10, N = 3SE +/- 882.91, N = 4SE +/- 598.81, N = 12SE +/- 1077.92, N = 14SE +/- 44.43, N = 3SE +/- 69.57, N = 359139.231177.217891.634614.118522.036900.520561.440368.6123480.064260.242172.481025.828476.652639.516704.415903.41. (CXX) g++ options: -O3 -fstrict-aliasing -fopenmp

OpenBenchmarking.orgMpix/sec Per Watt, More Is BetterASKAP 1.0Test: tConvolve MPI - GriddingXeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN50100150200250128.04125.1467.8566.7269.9667.7775.1470.87199.37247.30188.14167.00134.70109.74130.96142.12

OpenBenchmarking.orgMpix/sec, More Is BetterASKAP 1.0Test: tConvolve MPI - GriddingXeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN30K60K90K120K150KSE +/- 1080.03, N = 3SE +/- 219.20, N = 3SE +/- 76.67, N = 3SE +/- 412.68, N = 4SE +/- 99.83, N = 3SE +/- 194.30, N = 3SE +/- 0.00, N = 3SE +/- 802.88, N = 3SE +/- 19579.11, N = 3SE +/- 581.17, N = 3SE +/- 1853.72, N = 3SE +/- 2386.93, N = 4SE +/- 685.49, N = 12SE +/- 1180.69, N = 14SE +/- 86.77, N = 3SE +/- 0.00, N = 372004.037265.921314.241773.021766.542939.223250.245195.1121976.974389.046233.786757.728854.354066.016573.216399.71. (CXX) g++ options: -O3 -fstrict-aliasing -fopenmp

ASTC Encoder

ASTC Encoder (astcenc) is for the Adaptive Scalable Texture Compression (ASTC) format commonly used with OpenGL, OpenGL ES, and Vulkan graphics APIs. This test profile does a coding test of both compression/decompression. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgMT/s, More Is BetterASTC Encoder 4.7Preset: MediumXeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN120240360480600SE +/- 1.56, N = 7SE +/- 1.17, N = 6SE +/- 0.16, N = 6SE +/- 2.79, N = 6SE +/- 0.03, N = 6SE +/- 0.52, N = 6SE +/- 0.08, N = 6SE +/- 0.77, N = 6SE +/- 3.11, N = 7SE +/- 0.63, N = 7SE +/- 0.20, N = 7SE +/- 3.54, N = 6SE +/- 0.39, N = 7SE +/- 0.52, N = 6SE +/- 0.07, N = 6SE +/- 0.07, N = 6550.02327.78333.99484.55247.30441.65284.33483.10508.09500.77449.11491.53527.80462.24294.62273.671. (CXX) g++ options: -O3 -flto -pthread

OpenBenchmarking.orgMT/s Per Watt, More Is BetterASTC Encoder 4.7Preset: Very ThoroughXeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN0.01170.02340.03510.04680.05850.0280.0260.0230.0250.0160.0170.0190.0200.0360.0320.0340.0360.0470.0520.0380.041

OpenBenchmarking.orgMT/s, More Is BetterASTC Encoder 4.7Preset: Very ThoroughXeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN510152025SE +/- 0.0007, N = 3SE +/- 0.0294, N = 3SE +/- 0.0054, N = 3SE +/- 0.0379, N = 3SE +/- 0.0016, N = 3SE +/- 0.0055, N = 3SE +/- 0.0016, N = 3SE +/- 0.0022, N = 3SE +/- 0.1284, N = 3SE +/- 0.0254, N = 3SE +/- 0.0006, N = 3SE +/- 0.1965, N = 3SE +/- 0.0006, N = 3SE +/- 0.1961, N = 15SE +/- 0.0007, N = 3SE +/- 0.0012, N = 314.63347.62407.088513.75185.134210.20515.970211.887519.405210.32249.184417.009812.318722.00235.74205.24061. (CXX) g++ options: -O3 -flto -pthread

OpenBenchmarking.orgMT/s Per Watt, More Is BetterASTC Encoder 4.7Preset: ExhaustiveXeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN0.00740.01480.02220.02960.0370.0170.0160.0140.0150.0100.0110.0120.0120.0210.0200.0210.0230.0290.0330.0230.025

OpenBenchmarking.orgMT/s, More Is BetterASTC Encoder 4.7Preset: ThoroughXeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN306090120150SE +/- 0.55, N = 5SE +/- 0.05, N = 4SE +/- 0.01, N = 4SE +/- 0.19, N = 5SE +/- 0.01, N = 3SE +/- 0.05, N = 4SE +/- 0.03, N = 4SE +/- 0.03, N = 5SE +/- 1.46, N = 12SE +/- 0.06, N = 5SE +/- 0.01, N = 4SE +/- 0.73, N = 15SE +/- 0.01, N = 5SE +/- 1.20, N = 5SE +/- 0.02, N = 4SE +/- 0.02, N = 397.9454.4551.3086.9837.0172.3342.9883.34116.1273.3865.30105.4186.01121.3041.0237.961. (CXX) g++ options: -O3 -flto -pthread

OpenBenchmarking.orgMT/s, More Is BetterASTC Encoder 4.7Preset: ExhaustiveXeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN48121620SE +/- 0.0157, N = 3SE +/- 0.0072, N = 3SE +/- 0.0024, N = 3SE +/- 0.0164, N = 3SE +/- 0.0003, N = 3SE +/- 0.0033, N = 3SE +/- 0.0011, N = 3SE +/- 0.0016, N = 3SE +/- 0.0170, N = 3SE +/- 0.0086, N = 3SE +/- 0.0002, N = 3SE +/- 0.0218, N = 3SE +/- 0.0025, N = 3SE +/- 0.1160, N = 3SE +/- 0.0010, N = 3SE +/- 0.0006, N = 38.90914.63034.26898.37013.12046.21263.62767.207511.91076.30275.630110.60187.557314.10383.51463.19931. (CXX) g++ options: -O3 -flto -pthread

Stockfish

This is a test of Stockfish, an advanced open-source C++11 chess benchmark that can scale up to 1024 CPU threads. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgNodes Per Second, More Is BetterStockfish 16.1Chess BenchmarkXeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN90M180M270M360M450MSE +/- 2482737.87, N = 3SE +/- 2966712.90, N = 9SE +/- 1304590.97, N = 3SE +/- 2148606.38, N = 4SE +/- 1751369.24, N = 12SE +/- 4344961.90, N = 10SE +/- 629927.17, N = 3SE +/- 2925715.37, N = 11SE +/- 919073.22, N = 3SE +/- 2268830.04, N = 3SE +/- 3170744.86, N = 15SE +/- 2356843.91, N = 3SE +/- 4652276.19, N = 12SE +/- 7961094.38, N = 12SE +/- 2397455.91, N = 12SE +/- 2147688.02, N = 1222261037810976634596887479187761769680190881379772037359223014940908239912422321452465919770835037075153018976379930120223299198144906581561. (CXX) g++ options: -lgcov -m64 -lpthread -fno-exceptions -std=c++17 -fno-peel-loops -fno-tracer -pedantic -O3 -funroll-loops -msse -msse3 -mpopcnt -mavx2 -mbmi -mavx512f -mavx512bw -mavx512vnni -mavx512dq -mavx512vl -msse4.1 -mssse3 -msse2 -mbmi2 -flto -flto-partition=one -flto=jobserver

GROMACS

The GROMACS (GROningen MAchine for Chemical Simulations) molecular dynamics package testing with the water_GMX50 data. This test profile allows selecting between CPU and GPU-based GROMACS builds. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgNs Per Day, More Is BetterGROMACS 2024Implementation: MPI CPU - Input: water_GMX50_bareXeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN510152025SE +/- 0.046, N = 3SE +/- 0.009, N = 3SE +/- 0.010, N = 3SE +/- 0.019, N = 3SE +/- 0.019, N = 3SE +/- 0.025, N = 3SE +/- 0.007, N = 3SE +/- 0.032, N = 3SE +/- 0.224, N = 14SE +/- 0.052, N = 3SE +/- 0.034, N = 3SE +/- 0.189, N = 6SE +/- 0.032, N = 3SE +/- 0.067, N = 3SE +/- 0.004, N = 3SE +/- 0.004, N = 318.54010.4778.76215.4507.54513.3928.28214.12722.52515.22212.51420.23413.24221.3056.4996.2461. (CXX) g++ options: -O3 -lm

LAMMPS Molecular Dynamics Simulator

LAMMPS is a classical molecular dynamics code, and an acronym for Large-scale Atomic/Molecular Massively Parallel Simulator. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgns/day, More Is BetterLAMMPS Molecular Dynamics Simulator 23Jun2022Model: Rhodopsin ProteinXeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN1224364860SE +/- 0.97, N = 15SE +/- 0.29, N = 15SE +/- 0.36, N = 15SE +/- 0.33, N = 8SE +/- 0.05, N = 11SE +/- 0.11, N = 9SE +/- 0.04, N = 11SE +/- 0.09, N = 8SE +/- 0.43, N = 7SE +/- 0.35, N = 15SE +/- 0.14, N = 11SE +/- 0.39, N = 7SE +/- 0.29, N = 10SE +/- 0.24, N = 5SE +/- 0.29, N = 15SE +/- 0.30, N = 1555.5034.3028.7242.2827.6347.5130.8452.2453.7740.0036.1550.1240.3951.6324.2521.941. (CXX) g++ options: -O3 -lm -ldl

OpenBenchmarking.orgns/day, More Is BetterLAMMPS Molecular Dynamics Simulator 23Jun2022Model: 20k AtomsXeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN1428425670SE +/- 0.04, N = 3SE +/- 0.02, N = 3SE +/- 0.04, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.07, N = 3SE +/- 0.01, N = 3SE +/- 0.05, N = 3SE +/- 0.12, N = 3SE +/- 0.30, N = 3SE +/- 0.12, N = 3SE +/- 0.13, N = 3SE +/- 0.19, N = 3SE +/- 0.13, N = 3SE +/- 0.02, N = 3SE +/- 0.02, N = 356.4037.4634.8950.5228.2846.7132.1651.8262.0046.8942.5157.1047.9958.8427.5325.331. (CXX) g++ options: -O3 -lm -ldl

NAMD

OpenBenchmarking.orgns/day Per Watt, More Is BetterNAMD 3.0b6Input: ATPase with 327,506 AtomsXeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN0.01890.03780.05670.07560.09450.0120.0200.0110.0040.0240.0140.0220.0050.0640.0520.0440.0680.0480.0840.0520.056

OpenBenchmarking.orgns/day Per Watt, More Is BetterNAMD 3.0b6Input: STMV with 1,066,628 AtomsXeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN0.00520.01040.01560.02080.0260.0040.0060.0040.0020.0050.0030.0050.0030.0190.0120.0120.0180.0140.0230.0120.013

OpenBenchmarking.orgns/day, More Is BetterNAMD 3.0b6Input: ATPase with 327,506 AtomsXeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN510152025SE +/- 0.34017, N = 12SE +/- 0.54361, N = 15SE +/- 0.21567, N = 12SE +/- 0.17435, N = 15SE +/- 0.16058, N = 15SE +/- 0.26203, N = 15SE +/- 0.14537, N = 15SE +/- 0.44989, N = 15SE +/- 0.08771, N = 3SE +/- 0.02148, N = 6SE +/- 0.01368, N = 5SE +/- 0.04751, N = 3SE +/- 0.04917, N = 5SE +/- 0.02125, N = 3SE +/- 0.04338, N = 5SE +/- 0.00431, N = 45.852674.648142.970212.219485.971307.300655.925012.5631920.752599.335348.1827517.811057.9975618.974545.706725.44971

OpenBenchmarking.orgns/day, More Is BetterNAMD 3.0b6Input: STMV with 1,066,628 AtomsXeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN246810SE +/- 0.08185, N = 13SE +/- 0.02648, N = 15SE +/- 0.01396, N = 15SE +/- 0.04403, N = 15SE +/- 0.05087, N = 15SE +/- 0.05644, N = 12SE +/- 0.05862, N = 15SE +/- 0.05463, N = 15SE +/- 0.01739, N = 3SE +/- 0.00206, N = 3SE +/- 0.00537, N = 3SE +/- 0.02927, N = 3SE +/- 0.00847, N = 3SE +/- 0.00332, N = 3SE +/- 0.00440, N = 3SE +/- 0.00540, N = 32.254221.437871.052741.109001.452231.886791.502141.767786.383433.410852.878775.278392.888695.836061.519011.46163

RocksDB

This is a benchmark of Meta/Facebook's RocksDB as an embeddable persistent key-value store for fast storage based on Google's LevelDB. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgOp/s, More Is BetterRocksDB 9.0Test: Random ReadXeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN200M400M600M800M1000MSE +/- 82996.27, N = 3SE +/- 1119855.47, N = 3SE +/- 3338569.32, N = 3SE +/- 1411218.60, N = 3SE +/- 81327.78, N = 3SE +/- 1120857.00, N = 3SE +/- 86315.43, N = 3SE +/- 785893.13, N = 3SE +/- 2927744.32, N = 3SE +/- 326038.01, N = 3SE +/- 610621.13, N = 3SE +/- 599126.55, N = 3SE +/- 153963.59, N = 3SE +/- 1154820.73, N = 3SE +/- 206014.27, N = 3SE +/- 211259.57, N = 3578392800297517946265366170525049998205346154405533173234469939473755946103120915152331009140927294981514511057323545211352065642661865372349926361. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti -lpthread

Speedb

OpenBenchmarking.orgOp/s Per Watt, More Is BetterSpeedb 2.7Test: Read While WritingXeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN20K40K60K80K100K30648.4237383.4132356.0426260.0526509.9121183.2029984.5823023.2357884.5657032.7763472.8761034.9793506.8485339.0379851.0597163.65

RocksDB

This is a benchmark of Meta/Facebook's RocksDB as an embeddable persistent key-value store for fast storage based on Google's LevelDB. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgOp/s, More Is BetterRocksDB 9.0Test: Read While WritingXeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN5M10M15M20M25MSE +/- 215352.04, N = 15SE +/- 28201.44, N = 3SE +/- 61518.27, N = 10SE +/- 343737.14, N = 15SE +/- 83772.27, N = 13SE +/- 218479.19, N = 15SE +/- 26369.56, N = 3SE +/- 254193.37, N = 15SE +/- 236709.61, N = 3SE +/- 93669.97, N = 15SE +/- 36524.26, N = 3SE +/- 506458.47, N = 15SE +/- 109424.14, N = 3SE +/- 273109.47, N = 3SE +/- 28098.62, N = 3SE +/- 81998.56, N = 312425519892689378417381232130074396639624417736650011223329198516641415841914608544201082891577618622900152933364589341761. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti -lpthread

Speedb

Speedb is a next-generation key value storage engine that is RocksDB compatible and aiming for stability, efficiency, and performance. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgOp/s, More Is BetterSpeedb 2.7Test: Random ReadXeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN300M600M900M1200M1500MSE +/- 5399265.88, N = 15SE +/- 242146.75, N = 3SE +/- 168680.90, N = 3SE +/- 5393159.45, N = 3SE +/- 3698537.65, N = 15SE +/- 8491098.40, N = 15SE +/- 2763560.64, N = 13SE +/- 2955608.21, N = 3SE +/- 5954964.38, N = 3SE +/- 205170.43, N = 3SE +/- 66268.38, N = 3SE +/- 955915.20, N = 3SE +/- 1606748.01, N = 3SE +/- 2399164.12, N = 3SE +/- 109015.29, N = 3SE +/- 70537.88, N = 3586147871315178381276179617551286958211457048419943570244070674497907490105954653353763303442855705485768717958995107011699473852740917782429401101. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti -lpthread

OpenBenchmarking.orgOp/s, More Is BetterSpeedb 2.7Test: Read While WritingXeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN8M16M24M32M40MSE +/- 195912.00, N = 15SE +/- 143570.67, N = 4SE +/- 62510.72, N = 3SE +/- 239363.92, N = 3SE +/- 88257.34, N = 3SE +/- 171807.74, N = 3SE +/- 93731.24, N = 7SE +/- 197596.27, N = 3SE +/- 651901.79, N = 15SE +/- 118870.12, N = 3SE +/- 170909.18, N = 3SE +/- 746932.76, N = 15SE +/- 172052.60, N = 3SE +/- 803844.71, N = 15SE +/- 88013.69, N = 15SE +/- 86788.79, N = 31758573712168413106953601729702787954081385925499881761535440033307574195957771802499330324596228294263659320412053901118821031. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti -lpthread

Memcached

OpenBenchmarking.orgOps/sec Per Watt, More Is BetterMemcached 1.6.19Set To Get Ratio: 1:100Xeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN11K22K33K44K55K7668.8118089.3015564.535947.3315062.136127.3314272.395975.5515985.0125824.7331074.2617990.1432910.9319415.8844935.7451146.06

OpenBenchmarking.orgOps/sec, More Is BetterMemcached 1.6.19Set To Get Ratio: 1:100Xeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN2M4M6M8M10MSE +/- 35300.21, N = 3SE +/- 35182.67, N = 3SE +/- 25335.31, N = 3SE +/- 50660.01, N = 15SE +/- 21428.06, N = 3SE +/- 26891.33, N = 3SE +/- 52575.97, N = 3SE +/- 24083.78, N = 3SE +/- 27143.58, N = 3SE +/- 58081.25, N = 3SE +/- 29027.89, N = 3SE +/- 83562.82, N = 3SE +/- 38372.96, N = 3SE +/- 14591.70, N = 3SE +/- 36366.89, N = 3SE +/- 41123.40, N = 33780240.564752673.794481667.953245908.404384040.523373323.924315467.173392842.388683410.798634258.398220895.458498306.787736018.747645325.706198256.725820618.181. (CXX) g++ options: -O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre

Apache IoTDB

Apache IotDB is a time series database and this benchmark is facilitated using the IoT Benchmaark [https://github.com/thulab/iot-benchmark/]. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgpoint/sec, More Is BetterApache IoTDB 1.2Device Count: 500 - Batch Size Per Write: 100 - Sensor Count: 800 - Client Number: 400Xeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN30M60M90M120M150MSE +/- 761276.42, N = 12SE +/- 746822.47, N = 3SE +/- 308756.34, N = 3SE +/- 692701.79, N = 8SE +/- 662950.65, N = 3SE +/- 565297.90, N = 12SE +/- 1037167.36, N = 3SE +/- 574699.97, N = 12SE +/- 353097.82, N = 3SE +/- 371659.60, N = 3SE +/- 255887.16, N = 3SE +/- 1152766.29, N = 3SE +/- 68559.13, N = 3SE +/- 666882.79, N = 15SE +/- 13050.78, N = 3SE +/- 412757.79, N = 38923185092709751877972068016962082455664775012488347564578057728106778379126161028125562060108821580116685326103630483105432862105138551

OpenBenchmarking.orgpoint/sec, More Is BetterApache IoTDB 1.2Device Count: 800 - Batch Size Per Write: 100 - Sensor Count: 800 - Client Number: 100Xeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN30M60M90M120M150MSE +/- 862582.24, N = 7SE +/- 739343.51, N = 3SE +/- 276414.35, N = 3SE +/- 928557.10, N = 3SE +/- 435900.66, N = 3SE +/- 594234.55, N = 3SE +/- 782176.98, N = 3SE +/- 872659.60, N = 4SE +/- 1058559.19, N = 12SE +/- 538692.55, N = 3SE +/- 665173.47, N = 3SE +/- 1249999.63, N = 12SE +/- 263772.09, N = 3SE +/- 1225528.40, N = 12SE +/- 576868.09, N = 3SE +/- 41021.96, N = 39277163994616807908717708365178585744542807704658635451880139566124947288144760448142102254125595607131781309115317834116879799117884977

ClickHouse

OpenBenchmarking.orgQueries Per Minute, Geo Mean Per Watt, More Is BetterClickHouse 22.12.3.5100M Rows Hits Dataset, Third RunXeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN0.98241.96482.94723.92964.9121.2892.5992.3411.2651.9671.0681.9741.0121.6763.7094.0531.8704.1821.8574.0854.366

OpenBenchmarking.orgQueries Per Minute, Geo Mean, More Is BetterClickHouse 22.12.3.5100M Rows Hits Dataset, First Run / Cold CacheXeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN120240360480600SE +/- 4.12, N = 5SE +/- 4.18, N = 6SE +/- 3.41, N = 3SE +/- 4.37, N = 3SE +/- 2.85, N = 3SE +/- 1.35, N = 3SE +/- 5.88, N = 3SE +/- 3.85, N = 12SE +/- 4.34, N = 3SE +/- 7.88, N = 3SE +/- 5.33, N = 3SE +/- 6.05, N = 3SE +/- 2.78, N = 3SE +/- 4.49, N = 5SE +/- 1.57, N = 3SE +/- 1.88, N = 3423.30437.20465.50485.63446.40491.89461.62460.66513.92566.31536.82504.84433.79411.26323.59322.69MIN: 61.54 / MAX: 6000MIN: 41.7 / MAX: 5454.55MIN: 40.93 / MAX: 5454.55MIN: 63.63 / MAX: 5000MIN: 32.64 / MAX: 4615.38MIN: 51.86 / MAX: 5454.55MIN: 35.59 / MAX: 5454.55MIN: 53.62 / MAX: 5454.55MIN: 84.87 / MAX: 5000MIN: 59.64 / MAX: 5454.55MIN: 56.6 / MAX: 6666.67MIN: 81.97 / MAX: 4615.38MIN: 54.1 / MAX: 4285.71MIN: 77.12 / MAX: 5000MIN: 35.69 / MAX: 3750MIN: 32.99 / MAX: 4000

OpenBenchmarking.orgQueries Per Minute, Geo Mean, More Is BetterClickHouse 22.12.3.5100M Rows Hits Dataset, Second RunXeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN130260390520650SE +/- 3.10, N = 5SE +/- 2.86, N = 6SE +/- 2.93, N = 3SE +/- 3.26, N = 3SE +/- 1.94, N = 3SE +/- 0.19, N = 3SE +/- 4.95, N = 3SE +/- 3.17, N = 12SE +/- 6.78, N = 3SE +/- 0.42, N = 3SE +/- 3.14, N = 3SE +/- 8.37, N = 3SE +/- 9.26, N = 3SE +/- 4.85, N = 5SE +/- 2.99, N = 3SE +/- 5.72, N = 3443.58455.79486.05507.56465.06499.18474.68467.96528.21597.73562.50529.80450.12420.35337.32337.44MIN: 62.43 / MAX: 6666.67MIN: 42.19 / MAX: 6666.67MIN: 40.43 / MAX: 6666.67MIN: 66.45 / MAX: 5454.55MIN: 32.59 / MAX: 5000MIN: 54.2 / MAX: 4615.38MIN: 36.43 / MAX: 6000MIN: 52.36 / MAX: 6000MIN: 92.17 / MAX: 6000MIN: 61.41 / MAX: 5454.55MIN: 57.47 / MAX: 6666.67MIN: 86.08 / MAX: 5454.55MIN: 66.15 / MAX: 5454.55MIN: 78.33 / MAX: 4285.71MIN: 35.76 / MAX: 4000MIN: 33.44 / MAX: 4615.38

OpenBenchmarking.orgQueries Per Minute, Geo Mean, More Is BetterClickHouse 22.12.3.5100M Rows Hits Dataset, Third RunXeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN130260390520650SE +/- 5.39, N = 5SE +/- 3.62, N = 6SE +/- 3.45, N = 3SE +/- 2.55, N = 3SE +/- 6.03, N = 3SE +/- 3.08, N = 3SE +/- 3.60, N = 3SE +/- 3.54, N = 12SE +/- 2.03, N = 3SE +/- 4.34, N = 3SE +/- 4.03, N = 3SE +/- 10.00, N = 3SE +/- 3.32, N = 3SE +/- 6.21, N = 5SE +/- 1.77, N = 3SE +/- 5.23, N = 3438.60458.23481.66501.63470.02501.07476.91471.79526.36595.19559.55525.23458.96427.95338.84335.46MIN: 58.2 / MAX: 6000MIN: 42.16 / MAX: 6000MIN: 40.16 / MAX: 5454.55MIN: 64.45 / MAX: 6666.67MIN: 32.59 / MAX: 5454.55MIN: 54.25 / MAX: 5000MIN: 36.01 / MAX: 5000MIN: 53.43 / MAX: 6000MIN: 91.05 / MAX: 6000MIN: 62.05 / MAX: 5000MIN: 57.03 / MAX: 5000MIN: 81.86 / MAX: 5000MIN: 68.65 / MAX: 4000MIN: 80.54 / MAX: 5454.55MIN: 35.76 / MAX: 4000MIN: 32.86 / MAX: 5454.55

John The Ripper

This is a benchmark of John The Ripper, which is a password cracker. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgReal C/S, More Is BetterJohn The Ripper 2023.03.14Test: BlowfishXeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN90K180K270K360K450KSE +/- 649.08, N = 3SE +/- 79.75, N = 3SE +/- 11.39, N = 3SE +/- 348.45, N = 3SE +/- 17.33, N = 3SE +/- 116.69, N = 3SE +/- 8.67, N = 3SE +/- 169.28, N = 3SE +/- 454.86, N = 3SE +/- 98.33, N = 3SE +/- 38.33, N = 3SE +/- 3455.48, N = 3SE +/- 1.33, N = 3SE +/- 2397.15, N = 3SE +/- 13.72, N = 3SE +/- 20.54, N = 3205499105831945131835836789313456279152156658374589192574166541316492220188415412102198934731. (CC) gcc options: -m64 -lssl -lcrypto -fopenmp -lgmp -lm -lrt -lz -ldl -lcrypt -lbz2

OpenBenchmarking.orgReal C/S, More Is BetterJohn The Ripper 2023.03.14Test: bcryptXeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN90K180K270K360K450KSE +/- 288.38, N = 3SE +/- 46.28, N = 3SE +/- 10.67, N = 3SE +/- 292.24, N = 3SE +/- 8.84, N = 3SE +/- 866.68, N = 3SE +/- 8.67, N = 3SE +/- 576.80, N = 3SE +/- 1315.55, N = 3SE +/- 154.46, N = 3SE +/- 20.00, N = 3SE +/- 710.46, N = 3SE +/- 1.33, N = 3SE +/- 4958.68, N = 4SE +/- 22.28, N = 3SE +/- 0.00, N = 3206778105781945511836036787513386679144155959376268192898166541320527220188412723102222934721. (CC) gcc options: -m64 -lssl -lcrypto -fopenmp -lgmp -lm -lrt -lz -ldl -lcrypt -lbz2

OpenBenchmarking.orgReal C/S Per Watt, More Is BetterJohn The Ripper 2023.03.14Test: WPA PSKXeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN60012001800240030001285.881374.721347.411261.481133.971057.221204.611100.831799.501853.752017.721941.482304.832253.102414.272563.93

OpenBenchmarking.orgReal C/S, More Is BetterJohn The Ripper 2023.03.14Test: WPA PSKXeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN300K600K900K1200K1500KSE +/- 15579.94, N = 15SE +/- 864.17, N = 3SE +/- 1599.31, N = 3SE +/- 2519.00, N = 3SE +/- 987.33, N = 3SE +/- 5122.51, N = 3SE +/- 1274.00, N = 3SE +/- 788.50, N = 3SE +/- 5291.50, N = 3SE +/- 2683.36, N = 3SE +/- 921.74, N = 3SE +/- 1333.33, N = 3SE +/- 478.70, N = 3SE +/- 4358.90, N = 3SE +/- 321.00, N = 3SE +/- 79.20, N = 37970934281164012787932532865525628753340766578891294000671322643475125333380318715510003862123399981. (CC) gcc options: -m64 -lssl -lcrypto -fopenmp -lgmp -lm -lrt -lz -ldl -lcrypt -lbz2

Liquid-DSP

OpenBenchmarking.orgsamples/s Per Watt, More Is BetterLiquid-DSP 1.6Threads: 128 - Buffer Length: 256 - Filter Length: 512Xeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN1.4M2.8M4.2M5.6M7M2443783.023740373.112929507.991966021.922528910.041702250.872800439.161899608.972805690.783778092.654367851.072957086.755183635.113727692.535867538.626364836.35

OpenBenchmarking.orgsamples/s, More Is BetterLiquid-DSP 1.6Threads: 1 - Buffer Length: 256 - Filter Length: 32Xeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN9M18M27M36M45MSE +/- 419600.12, N = 5SE +/- 417042.80, N = 5SE +/- 1527.53, N = 3SE +/- 1154.70, N = 3SE +/- 1666.67, N = 3SE +/- 1201.85, N = 3SE +/- 3000.00, N = 3SE +/- 1452.97, N = 3SE +/- 19139.84, N = 3SE +/- 7023.77, N = 3SE +/- 7753.14, N = 3SE +/- 13503.09, N = 3SE +/- 6984.11, N = 3SE +/- 2185.81, N = 3SE +/- 2333.33, N = 3SE +/- 881.92, N = 3389506004024400036506000364610003653766736497667365390003652133336040000360660003606833336033000299073332989333329899667298993331. (CC) gcc options: -O3 -pthread -lm -lc -lliquid

OpenBenchmarking.orgsamples/s, More Is BetterLiquid-DSP 1.6Threads: 1 - Buffer Length: 256 - Filter Length: 57Xeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN16M32M48M64M80MSE +/- 68119.99, N = 3SE +/- 599433.09, N = 9SE +/- 666.67, N = 3SE +/- 3844.19, N = 3SE +/- 4910.31, N = 3SE +/- 4163.33, N = 3SE +/- 5364.49, N = 3SE +/- 822374.71, N = 4SE +/- 34724.31, N = 3SE +/- 7423.69, N = 3SE +/- 12719.19, N = 3SE +/- 486361.09, N = 3SE +/- 7937.25, N = 3SE +/- 8089.77, N = 3SE +/- 4807.40, N = 3SE +/- 393224.42, N = 3704990007314066767074667669913336713033367064000671276676626600055415667554553335542533354954667462700004622966746210667454863331. (CC) gcc options: -O3 -pthread -lm -lc -lliquid

OpenBenchmarking.orgsamples/s, More Is BetterLiquid-DSP 1.6Threads: 1 - Buffer Length: 256 - Filter Length: 512Xeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN4M8M12M16M20MSE +/- 162096.41, N = 15SE +/- 9492.69, N = 3SE +/- 8685.88, N = 3SE +/- 38670.98, N = 3SE +/- 5238.74, N = 3SE +/- 17457.89, N = 3SE +/- 30179.10, N = 3SE +/- 7571.88, N = 3SE +/- 234395.65, N = 15SE +/- 134727.30, N = 3SE +/- 121304.48, N = 3SE +/- 124115.99, N = 3SE +/- 120841.84, N = 4SE +/- 11050.39, N = 3SE +/- 3464.10, N = 3SE +/- 31571.79, N = 3182005331877433316882333168433331690633316904667168853331688400013083133133873331339466713390667111745001127366711290000112363331. (CC) gcc options: -O3 -pthread -lm -lc -lliquid

OpenBenchmarking.orgsamples/s, More Is BetterLiquid-DSP 1.6Threads: 64 - Buffer Length: 256 - Filter Length: 32Xeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN500M1000M1500M2000M2500MSE +/- 17236814.61, N = 3SE +/- 27191440.65, N = 3SE +/- 3167192.94, N = 3SE +/- 3300505.01, N = 3SE +/- 688799.28, N = 3SE +/- 2206304.10, N = 3SE +/- 692820.32, N = 3SE +/- 3017909.50, N = 3SE +/- 2510644.01, N = 3SE +/- 3000185.18, N = 3SE +/- 2810891.52, N = 3SE +/- 1567730.14, N = 3SE +/- 1550627.11, N = 3SE +/- 1462114.15, N = 3SE +/- 3090487.20, N = 3SE +/- 3256958.36, N = 321546333331927766667189056666720250000001640266667196323333316797000002090466667227930000022874666672282766667228206666718987666671894966667187133333317768666671. (CC) gcc options: -O3 -pthread -lm -lc -lliquid

OpenBenchmarking.orgsamples/s, More Is BetterLiquid-DSP 1.6Threads: 64 - Buffer Length: 256 - Filter Length: 57Xeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN600M1200M1800M2400M3000MSE +/- 32405829.38, N = 3SE +/- 11426868.92, N = 3SE +/- 7076957.92, N = 3SE +/- 28500058.48, N = 3SE +/- 2629533.12, N = 3SE +/- 28812627.44, N = 4SE +/- 5493127.02, N = 3SE +/- 27382304.50, N = 5SE +/- 8732315.46, N = 3SE +/- 8476044.68, N = 3SE +/- 3786085.64, N = 3SE +/- 10590929.03, N = 3SE +/- 8567444.84, N = 3SE +/- 17457503.96, N = 3SE +/- 4914717.13, N = 3SE +/- 7776531.65, N = 326200666672475500000253920000026555000002138766667249405000023089666672491340000277280000028620000002859833333273023333324449333332374766667218683333320263333331. (CC) gcc options: -O3 -pthread -lm -lc -lliquid

OpenBenchmarking.orgsamples/s Per Watt, More Is BetterLiquid-DSP 1.6Threads: 256 - Buffer Length: 256 - Filter Length: 32Xeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN5M10M15M20M25M9752693.4110180344.3110249944.709661394.058576477.667263532.049061082.038335236.3212478169.6716171511.9117844515.2113431732.6922727990.0916713460.6721992105.6023304528.15

OpenBenchmarking.orgsamples/s Per Watt, More Is BetterLiquid-DSP 1.6Threads: 256 - Buffer Length: 256 - Filter Length: 57Xeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN5M10M15M20M25M10144378.3912268330.0811085612.938419315.638954185.907597124.4310156047.287871904.9711934150.9216030850.5617475938.7712864302.7022424548.8216347865.8721345877.0223457026.73

OpenBenchmarking.orgsamples/s Per Watt, More Is BetterLiquid-DSP 1.6Threads: 256 - Buffer Length: 256 - Filter Length: 512Xeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN1.4M2.8M4.2M5.6M7M3272343.493805850.463267678.462571656.772666847.492269719.802982249.172388645.743603186.164387111.544853033.944001237.146413920.524657018.095998206.246532499.05

OpenBenchmarking.orgsamples/s, More Is BetterLiquid-DSP 1.6Threads: 64 - Buffer Length: 256 - Filter Length: 512Xeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN200M400M600M800M1000MSE +/- 7562646.32, N = 8SE +/- 1515552.70, N = 3SE +/- 940265.92, N = 3SE +/- 3717554.45, N = 3SE +/- 1611276.24, N = 3SE +/- 4432294.36, N = 3SE +/- 1289603.73, N = 3SE +/- 6141471.96, N = 3SE +/- 3039034.93, N = 3SE +/- 752558.60, N = 3SE +/- 1678355.68, N = 3SE +/- 2261241.06, N = 3SE +/- 673003.22, N = 3SE +/- 958772.36, N = 3SE +/- 822739.33, N = 3SE +/- 2292977.20, N = 38837012507837700007444100007994966676323966677325600006890033337571766678493400008505866678113733338245833337096500007093933336338600005772633331. (CC) gcc options: -O3 -pthread -lm -lc -lliquid

OpenBenchmarking.orgsamples/s, More Is BetterLiquid-DSP 1.6Threads: 128 - Buffer Length: 256 - Filter Length: 32Xeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN900M1800M2700M3600M4500MSE +/- 13813198.20, N = 3SE +/- 2236316.42, N = 3SE +/- 1858314.65, N = 3SE +/- 26633124.74, N = 3SE +/- 400000.00, N = 3SE +/- 4598671.31, N = 3SE +/- 1342054.81, N = 3SE +/- 2403700.85, N = 3SE +/- 4250882.26, N = 3SE +/- 841295.30, N = 3SE +/- 2714365.08, N = 3SE +/- 3186603.90, N = 3SE +/- 4056818.68, N = 3SE +/- 384418.75, N = 3SE +/- 3138116.92, N = 3SE +/- 2003607.86, N = 335207666673148233333320060000035586000002351900000325403333327396333333337066667440790000043535333334032733333406333333337915666673794133333304706666727679333331. (CC) gcc options: -O3 -pthread -lm -lc -lliquid

OpenBenchmarking.orgsamples/s, More Is BetterLiquid-DSP 1.6Threads: 128 - Buffer Length: 256 - Filter Length: 57Xeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN1000M2000M3000M4000M5000MSE +/- 51282832.98, N = 4SE +/- 5260228.13, N = 3SE +/- 3116800.35, N = 3SE +/- 13655808.69, N = 3SE +/- 2030052.00, N = 3SE +/- 25888414.40, N = 3SE +/- 3119294.79, N = 3SE +/- 14772609.79, N = 3SE +/- 11892621.43, N = 3SE +/- 6778479.02, N = 3SE +/- 20120967.50, N = 3SE +/- 4098915.85, N = 3SE +/- 18691531.06, N = 3SE +/- 14606429.33, N = 3SE +/- 3527510.93, N = 3SE +/- 6398003.16, N = 344505250003503200000318126666737236666672670033333359640000029724000003896500000475936666747553333334256300000428093333347145000004626566667298280000026870666671. (CC) gcc options: -O3 -pthread -lm -lc -lliquid

OpenBenchmarking.orgsamples/s, More Is BetterLiquid-DSP 1.6Threads: 128 - Buffer Length: 256 - Filter Length: 512Xeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN300M600M900M1200M1500MSE +/- 4790383.89, N = 3SE +/- 2313246.88, N = 3SE +/- 1740596.96, N = 3SE +/- 6842108.19, N = 3SE +/- 681281.47, N = 3SE +/- 11560043.25, N = 5SE +/- 1345523.44, N = 3SE +/- 2123152.79, N = 3SE +/- 3901424.24, N = 3SE +/- 2412697.89, N = 3SE +/- 1047748.91, N = 3SE +/- 2338327.99, N = 3SE +/- 814452.78, N = 3SE +/- 503322.30, N = 3SE +/- 390953.25, N = 3SE +/- 431058.13, N = 3149383333311529333339185666671126466667800186667109146000088220000012060666671394733333136873333311581666671199966667136980000013498000008099166677317566671. (CC) gcc options: -O3 -pthread -lm -lc -lliquid

OpenBenchmarking.orgsamples/s, More Is BetterLiquid-DSP 1.6Threads: 256 - Buffer Length: 256 - Filter Length: 32Xeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN2000M4000M6000M8000M10000MSE +/- 6711433.03, N = 3SE +/- 2516611.48, N = 3SE +/- 4021608.30, N = 3SE +/- 10496401.50, N = 3SE +/- 1320353.49, N = 3SE +/- 2447674.63, N = 3SE +/- 1338323.99, N = 3SE +/- 895048.11, N = 3SE +/- 34610274.65, N = 3SE +/- 11426625.83, N = 3SE +/- 1419311.26, N = 3SE +/- 46730658.51, N = 3SE +/- 3768731.00, N = 3SE +/- 2936551.27, N = 3SE +/- 1501110.70, N = 3SE +/- 1928730.15, N = 360773000003167200000324380000061165666672381800000467096666727690666675367033333793526666758624666675271933333751333333365882000006439000000306220000027896000001. (CC) gcc options: -O3 -pthread -lm -lc -lliquid

OpenBenchmarking.orgsamples/s, More Is BetterLiquid-DSP 1.6Threads: 256 - Buffer Length: 256 - Filter Length: 512Xeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN500M1000M1500M2000M2500MSE +/- 14465476.14, N = 3SE +/- 240370.09, N = 3SE +/- 1722723.94, N = 3SE +/- 5630373.98, N = 3SE +/- 569766.03, N = 3SE +/- 4238841.56, N = 3SE +/- 740202.67, N = 3SE +/- 6728628.72, N = 3SE +/- 14870701.99, N = 3SE +/- 2676440.42, N = 3SE +/- 520683.31, N = 3SE +/- 11753202.87, N = 3SE +/- 1300000.00, N = 3SE +/- 1650252.51, N = 3SE +/- 776881.23, N = 3SE +/- 170391.71, N = 32027000000117876666710208333331616966667838530000144406666794455000015189333332394333333157040000013621666672129533333174470000017348000008210133337417400001. (CC) gcc options: -O3 -pthread -lm -lc -lliquid

OpenBenchmarking.orgsamples/s, More Is BetterLiquid-DSP 1.6Threads: 256 - Buffer Length: 256 - Filter Length: 57Xeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN2000M4000M6000M8000M10000MSE +/- 61971606.40, N = 3SE +/- 3555434.03, N = 3SE +/- 5292237.50, N = 3SE +/- 2331189.49, N = 3SE +/- 4088330.28, N = 3SE +/- 17558125.69, N = 3SE +/- 1976810.00, N = 3SE +/- 28453880.81, N = 3SE +/- 50144890.07, N = 3SE +/- 8144527.82, N = 3SE +/- 2618735.91, N = 3SE +/- 60380193.59, N = 3SE +/- 12739745.33, N = 3SE +/- 8069352.17, N = 3SE +/- 1959875.28, N = 3SE +/- 4481443.22, N = 362843000003806833333350083333353612666672848933333482513333332225333335036000000801270000058119000005266466667741186666764013666676316266667311693333327937000001. (CC) gcc options: -O3 -pthread -lm -lc -lliquid

Numpy Benchmark

OpenBenchmarking.orgScore Per Watt, More Is BetterNumpy BenchmarkXeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN2468102.3605.2554.1831.7163.2901.3433.1641.3752.0794.8545.3592.2495.4052.1707.9187.962

OpenBenchmarking.orgScore, More Is BetterNumpy BenchmarkXeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN120240360480600SE +/- 1.42, N = 3SE +/- 1.84, N = 3SE +/- 0.33, N = 3SE +/- 0.26, N = 3SE +/- 0.60, N = 3SE +/- 1.13, N = 3SE +/- 0.79, N = 3SE +/- 1.30, N = 3SE +/- 0.60, N = 3SE +/- 1.85, N = 3SE +/- 2.28, N = 3SE +/- 0.38, N = 3SE +/- 0.96, N = 3SE +/- 0.25, N = 3SE +/- 0.72, N = 3SE +/- 1.34, N = 3519.89520.22455.57456.18461.61435.21464.72439.84540.96542.15529.80529.03425.46422.76421.99418.89

OpenSSL

OpenSSL is an open-source toolkit that implements SSL (Secure Sockets Layer) and TLS (Transport Layer Security) protocols. This test profile makes use of the built-in "openssl speed" benchmarking capabilities. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgsign/s, More Is BetterOpenSSL 3.3Algorithm: RSA4096Xeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN20K40K60K80K100KSE +/- 56.68, N = 3SE +/- 15.15, N = 3SE +/- 9.84, N = 3SE +/- 14.34, N = 3SE +/- 19.45, N = 3SE +/- 6.92, N = 3SE +/- 20.13, N = 3SE +/- 83.09, N = 3SE +/- 247.60, N = 3SE +/- 98.71, N = 3SE +/- 29.11, N = 3SE +/- 81.38, N = 3SE +/- 27.42, N = 3SE +/- 80.37, N = 3SE +/- 22.17, N = 3SE +/- 12.56, N = 361499.631594.427431.154601.122861.045531.025441.548534.898237.048996.835964.971942.053966.9107830.625894.621047.51. (CC) gcc options: -pthread -m64 -O3 -lssl -lcrypto -ldl

Llamafile

OpenBenchmarking.orgTokens Per Second Per Watt, More Is BetterLlamafile 0.7Test: wizardcoder-python-34b-v1.0.Q6_K - Acceleration: CPUXeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN0.00990.01980.02970.03960.04950.0050.0130.0180.0060.0050.0030.0050.0020.0090.0290.0340.0110.0370.0110.0380.044

OpenBenchmarking.orgTokens Per Second, More Is BetterLlamafile 0.7Test: llava-v1.5-7b-q4 - Acceleration: CPUXeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN612182430SE +/- 1.08, N = 12SE +/- 0.17, N = 4SE +/- 0.15, N = 4SE +/- 0.09, N = 15SE +/- 0.10, N = 3SE +/- 0.05, N = 3SE +/- 0.02, N = 3SE +/- 0.04, N = 3SE +/- 0.02, N = 4SE +/- 0.10, N = 5SE +/- 0.02, N = 5SE +/- 0.07, N = 4SE +/- 0.05, N = 4SE +/- 0.08, N = 4SE +/- 0.11, N = 4SE +/- 0.07, N = 47.4916.6120.9510.447.677.778.137.2614.2925.3825.7514.4720.6410.9421.0020.65

OpenBenchmarking.orgTokens Per Second, More Is BetterLlamafile 0.7Test: wizardcoder-python-34b-v1.0.Q6_K - Acceleration: CPUXeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN246810SE +/- 0.01, N = 3SE +/- 0.02, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.00, N = 3SE +/- 0.01, N = 3SE +/- 0.00, N = 3SE +/- 0.12, N = 6SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.03, N = 3SE +/- 0.01, N = 3SE +/- 0.03, N = 3SE +/- 0.01, N = 3SE +/- 0.02, N = 3SE +/- 0.03, N = 33.054.085.853.821.471.771.541.545.248.488.355.247.474.635.165.11

NAS Parallel Benchmarks

NPB, NAS Parallel Benchmarks, is a benchmark developed by NASA for high-end computer systems. This test profile currently uses the MPI version of NPB. This test profile offers selecting the different NPB tests/problems and varying problem sizes. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgTotal Mop/s, More Is BetterNAS Parallel Benchmarks 3.4Test / Class: EP.DXeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN5K10K15K20K25KSE +/- 30.19, N = 4SE +/- 22.33, N = 3SE +/- 6.77, N = 3SE +/- 100.23, N = 4SE +/- 155.10, N = 12SE +/- 4.83, N = 4SE +/- 6.53, N = 3SE +/- 10.93, N = 4SE +/- 602.37, N = 15SE +/- 309.03, N = 15SE +/- 122.47, N = 15SE +/- 530.31, N = 15SE +/- 367.88, N = 12SE +/- 1274.85, N = 12SE +/- 14.68, N = 3SE +/- 50.01, N = 816004.078089.147562.8014946.765366.6910970.456445.0912793.0122166.6011424.0510652.0319414.9412575.3022017.756416.345745.041. (F9X) gfortran options: -O3 -march=native -lmpi_usempif08 -lmpi_mpifh -lmpi -lopen-rte -lopen-pal -lhwloc -levent_core -levent_pthreads -lm -lz 2. Open MPI 4.1.6

OpenBenchmarking.orgTotal Mop/s, More Is BetterNAS Parallel Benchmarks 3.4Test / Class: LU.CXeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN130K260K390K520K650KSE +/- 726.00, N = 5SE +/- 213.44, N = 5SE +/- 130.20, N = 4SE +/- 398.40, N = 5SE +/- 71.37, N = 3SE +/- 441.66, N = 5SE +/- 37.04, N = 4SE +/- 411.20, N = 5SE +/- 1879.23, N = 6SE +/- 1849.65, N = 6SE +/- 789.76, N = 5SE +/- 4162.49, N = 6SE +/- 2566.89, N = 15SE +/- 5800.63, N = 15SE +/- 314.42, N = 4SE +/- 274.93, N = 3455312.09232012.77135125.15261127.09126171.52246822.52131606.86257384.55551955.55362511.43269047.28472931.04279397.45588329.32133284.46130839.121. (F9X) gfortran options: -O3 -march=native -lmpi_usempif08 -lmpi_mpifh -lmpi -lopen-rte -lopen-pal -lhwloc -levent_core -levent_pthreads -lm -lz 2. Open MPI 4.1.6

OpenBenchmarking.orgTotal Mop/s, More Is BetterNAS Parallel Benchmarks 3.4Test / Class: SP.CXeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN80K160K240K320K400KSE +/- 1528.09, N = 5SE +/- 31.76, N = 4SE +/- 150.79, N = 3SE +/- 560.20, N = 4SE +/- 67.02, N = 3SE +/- 679.14, N = 4SE +/- 9.58, N = 3SE +/- 420.81, N = 4SE +/- 1666.53, N = 6SE +/- 1178.78, N = 6SE +/- 72.03, N = 4SE +/- 1929.89, N = 5SE +/- 126.50, N = 4SE +/- 2064.71, N = 6SE +/- 23.20, N = 3SE +/- 14.31, N = 3228184.68109416.4271245.26147311.1458815.36135939.2569776.41141954.15390520.93225311.82125191.11256584.67127519.37214017.1852745.6452684.931. (F9X) gfortran options: -O3 -march=native -lmpi_usempif08 -lmpi_mpifh -lmpi -lopen-rte -lopen-pal -lhwloc -levent_core -levent_pthreads -lm -lz 2. Open MPI 4.1.6

OpenBenchmarking.orgTotal Mop/s, More Is BetterNAS Parallel Benchmarks 3.4Test / Class: IS.DXeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN3K6K9K12K15KSE +/- 155.00, N = 15SE +/- 8.92, N = 4SE +/- 6.56, N = 3SE +/- 23.92, N = 4SE +/- 15.55, N = 4SE +/- 12.99, N = 4SE +/- 18.08, N = 4SE +/- 4.96, N = 4SE +/- 119.22, N = 6SE +/- 29.95, N = 5SE +/- 17.53, N = 5SE +/- 76.70, N = 10SE +/- 35.67, N = 5SE +/- 85.04, N = 8SE +/- 9.85, N = 4SE +/- 14.39, N = 47437.814059.702865.723960.283050.163816.703076.663819.8312296.276346.155229.4110139.695702.139771.412746.202718.941. (F9X) gfortran options: -O3 -march=native -lmpi_usempif08 -lmpi_mpifh -lmpi -lopen-rte -lopen-pal -lhwloc -levent_core -levent_pthreads -lm -lz 2. Open MPI 4.1.6

OpenBenchmarking.orgTotal Mop/s, More Is BetterNAS Parallel Benchmarks 3.4Test / Class: MG.CXeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN50K100K150K200K250KSE +/- 1422.07, N = 7SE +/- 406.29, N = 9SE +/- 152.92, N = 9SE +/- 1262.04, N = 9SE +/- 436.97, N = 10SE +/- 1415.96, N = 9SE +/- 382.59, N = 10SE +/- 1298.67, N = 9SE +/- 7207.31, N = 15SE +/- 1372.89, N = 15SE +/- 1153.71, N = 15SE +/- 2707.72, N = 14SE +/- 884.47, N = 9SE +/- 1776.37, N = 11SE +/- 167.65, N = 8SE +/- 301.54, N = 8220893.78107321.8983448.70163333.2185910.95172614.1086407.46171436.47244738.81134994.14116725.04194942.32125567.07245447.7263930.6462449.551. (F9X) gfortran options: -O3 -march=native -lmpi_usempif08 -lmpi_mpifh -lmpi -lopen-rte -lopen-pal -lhwloc -levent_core -levent_pthreads -lm -lz 2. Open MPI 4.1.6

OpenBenchmarking.orgTotal Mop/s, More Is BetterNAS Parallel Benchmarks 3.4Test / Class: CG.CXeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN20K40K60K80K100KSE +/- 271.54, N = 6SE +/- 328.18, N = 8SE +/- 243.41, N = 12SE +/- 178.23, N = 8SE +/- 313.88, N = 7SE +/- 545.92, N = 15SE +/- 260.16, N = 15SE +/- 560.41, N = 15SE +/- 661.05, N = 7SE +/- 386.70, N = 9SE +/- 393.67, N = 15SE +/- 779.47, N = 7SE +/- 480.71, N = 15SE +/- 545.82, N = 5SE +/- 126.79, N = 6SE +/- 207.19, N = 698764.9363760.4533811.6358128.2435116.5565396.2235234.0666492.4488487.9162071.1053182.7784477.7243799.7863265.0122229.9421684.801. (F9X) gfortran options: -O3 -march=native -lmpi_usempif08 -lmpi_mpifh -lmpi -lopen-rte -lopen-pal -lhwloc -levent_core -levent_pthreads -lm -lz 2. Open MPI 4.1.6

PostgreSQL

This is a benchmark of PostgreSQL using the integrated pgbench for facilitating the database benchmarks. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgTPS, More Is BetterPostgreSQL 16Scaling Factor: 100 - Clients: 1000 - Mode: Read WriteXeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN20K40K60K80K100KSE +/- 106.16, N = 3SE +/- 198.41, N = 3SE +/- 78.02, N = 3SE +/- 137.82, N = 3SE +/- 95.84, N = 3SE +/- 195.77, N = 3SE +/- 143.25, N = 3SE +/- 440.63, N = 3SE +/- 1059.49, N = 12SE +/- 87.23, N = 3SE +/- 232.97, N = 3SE +/- 865.71, N = 12SE +/- 242.45, N = 3SE +/- 58.85, N = 3SE +/- 175.33, N = 3SE +/- 299.71, N = 3331107539671227673156996958952722256004655272794927998755505722445922861272553951. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm

OpenBenchmarking.orgTPS, More Is BetterPostgreSQL 16Scaling Factor: 100 - Clients: 1000 - Mode: Read OnlyXeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN900K1800K2700K3600K4500KSE +/- 30933.90, N = 12SE +/- 13863.97, N = 12SE +/- 20350.34, N = 3SE +/- 18635.21, N = 12SE +/- 24978.23, N = 12SE +/- 16726.04, N = 9SE +/- 17697.00, N = 3SE +/- 36627.33, N = 9SE +/- 71870.42, N = 12SE +/- 27594.68, N = 3SE +/- 39970.22, N = 3SE +/- 41074.86, N = 12SE +/- 15503.17, N = 3SE +/- 13473.87, N = 3SE +/- 11512.67, N = 3SE +/- 4774.62, N = 38818811699046174814677814117926369760351607424920725348090939893583603261342273134224923044620260650024163751. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm

OpenSSL

OpenSSL is an open-source toolkit that implements SSL (Secure Sockets Layer) and TLS (Transport Layer Security) protocols. This test profile makes use of the built-in "openssl speed" benchmarking capabilities. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgverify/s, More Is BetterOpenSSL 3.3Algorithm: RSA4096Xeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN800K1600K2400K3200K4000KSE +/- 6745.42, N = 3SE +/- 92.62, N = 3SE +/- 92.46, N = 3SE +/- 862.96, N = 3SE +/- 165.80, N = 3SE +/- 355.69, N = 3SE +/- 200.66, N = 3SE +/- 277.84, N = 3SE +/- 6125.37, N = 3SE +/- 1576.96, N = 3SE +/- 149.48, N = 3SE +/- 5.26, N = 3SE +/- 444.74, N = 3SE +/- 2222.55, N = 3SE +/- 126.84, N = 3SE +/- 136.07, N = 32057021.61036735.6974189.91916162.9697707.21395446.4813667.61627941.43214376.31613828.71436324.92861959.81872096.13729470.8881480.8810291.81. (CC) gcc options: -pthread -m64 -O3 -lssl -lcrypto -ldl

BRL-CAD

BRL-CAD is a cross-platform, open-source solid modeling system with built-in benchmark mode. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgVGR Performance Metric, More Is BetterBRL-CAD 7.38.2VGR Performance MetricXeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN1.3M2.6M3.9M5.2M6.5M51866779169048338924136969713937365879076781240753426193921312257431612166162228348447758617508519977713521. (CXX) g++ options: -std=c++17 -pipe -fvisibility=hidden -fno-strict-aliasing -fno-common -fexceptions -ftemplate-depth-128 -m64 -ggdb3 -O3 -fipa-pta -fstrength-reduce -finline-functions -flto -ltcl8.6 -lnetpbm -lregex_brl -lz_brl -lassimp -ldl -lm -ltk8.6

Google SynthMark

SynthMark is a cross platform tool for benchmarking CPU performance under a variety of real-time audio workloads. It uses a polyphonic synthesizer model to provide standardized tests for latency, jitter and computational throughput. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgVoices, More Is BetterGoogle SynthMark 20201109Test: VoiceMark_100Xeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN2004006008001000SE +/- 0.38, N = 3SE +/- 0.13, N = 3SE +/- 0.22, N = 3SE +/- 1.51, N = 3SE +/- 0.26, N = 3SE +/- 0.30, N = 3SE +/- 0.24, N = 3SE +/- 0.48, N = 3SE +/- 0.72, N = 3SE +/- 0.69, N = 3SE +/- 0.55, N = 3SE +/- 0.56, N = 3SE +/- 0.45, N = 3SE +/- 0.88, N = 3SE +/- 0.14, N = 3SE +/- 0.60, N = 3799.49799.72711.38712.70711.10710.92712.01712.09783.20783.42783.78782.32655.80655.05655.24656.251. (CXX) g++ options: -lm -lpthread -std=c++11 -Ofast

LULESH

OpenBenchmarking.orgz/s Per Watt, More Is BetterLULESH 2.0.3Xeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN4080120160200143.95155.84105.6088.38100.4197.72103.89100.20122.54130.21143.77123.49134.50122.60149.38162.52

OpenBenchmarking.orgz/s, More Is BetterLULESH 2.0.3Xeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN15K30K45K60K75KSE +/- 359.29, N = 3SE +/- 437.51, N = 4SE +/- 182.38, N = 15SE +/- 272.44, N = 4SE +/- 211.12, N = 6SE +/- 206.20, N = 5SE +/- 217.67, N = 6SE +/- 207.54, N = 5SE +/- 675.87, N = 3SE +/- 194.65, N = 15SE +/- 372.12, N = 3SE +/- 349.39, N = 15SE +/- 244.17, N = 3SE +/- 427.75, N = 3SE +/- 372.63, N = 12SE +/- 373.78, N = 1270826.7338433.9723072.3043724.0623848.5452102.6725831.8453269.4754678.4927287.2626082.7148760.8224218.8346126.0816949.5916855.891. (CXX) g++ options: -O3 -fopenmp -lm -lmpi_cxx -lmpi

Apache IoTDB

Apache IotDB is a time series database and this benchmark is facilitated using the IoT Benchmaark [https://github.com/thulab/iot-benchmark/]. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgAverage Latency, Fewer Is BetterApache IoTDB 1.2Device Count: 500 - Batch Size Per Write: 100 - Sensor Count: 800 - Client Number: 400Xeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN70140210280350SE +/- 3.40, N = 12SE +/- 3.41, N = 3SE +/- 2.20, N = 3SE +/- 3.79, N = 8SE +/- 5.15, N = 3SE +/- 2.59, N = 12SE +/- 5.07, N = 3SE +/- 3.74, N = 12SE +/- 1.87, N = 3SE +/- 1.71, N = 3SE +/- 1.96, N = 3SE +/- 3.49, N = 3SE +/- 1.41, N = 3SE +/- 2.16, N = 15SE +/- 0.38, N = 3SE +/- 0.82, N = 3286.78280.26294.33317.36314.44328.41309.03325.97246.08209.68211.85240.43227.40253.13251.47251.05MAX: 28496.67MAX: 27450.82MAX: 27740.38MAX: 32341.07MAX: 27244.84MAX: 29309.84MAX: 26720.06MAX: 30042.47MAX: 27665.32MAX: 26606.61MAX: 26989.76MAX: 27651.54MAX: 26860.34MAX: 27854.54MAX: 26615.75MAX: 26590.2

OpenBenchmarking.orgAverage Latency, Fewer Is BetterApache IoTDB 1.2Device Count: 800 - Batch Size Per Write: 100 - Sensor Count: 800 - Client Number: 100Xeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN20406080100SE +/- 0.80, N = 7SE +/- 0.68, N = 3SE +/- 0.15, N = 3SE +/- 1.18, N = 3SE +/- 0.48, N = 3SE +/- 1.01, N = 3SE +/- 0.87, N = 3SE +/- 1.11, N = 4SE +/- 0.59, N = 12SE +/- 0.23, N = 3SE +/- 0.31, N = 3SE +/- 0.65, N = 12SE +/- 0.10, N = 3SE +/- 0.79, N = 12SE +/- 0.31, N = 3SE +/- 0.03, N = 382.7381.7385.1692.2390.0294.8489.5395.3961.4652.9353.7761.0758.1166.5465.6664.93MAX: 24148.34MAX: 24081.78MAX: 23810.86MAX: 23842.9MAX: 23857.34MAX: 23842.98MAX: 23819.37MAX: 23846.38MAX: 23888.07MAX: 23851.86MAX: 22579.45MAX: 23881.58MAX: 23856.7MAX: 24915.81MAX: 23840.27MAX: 22583.73

Pennant

Pennant is an application focused on hydrodynamics on general unstructured meshes in 2D. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgHydro Cycle Time - Seconds, Fewer Is BetterPennant 1.0.1Test: leblancbigXeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN246810SE +/- 0.013568, N = 6SE +/- 0.022698, N = 7SE +/- 0.022393, N = 7SE +/- 0.019069, N = 15SE +/- 0.025580, N = 6SE +/- 0.010204, N = 7SE +/- 0.023904, N = 7SE +/- 0.008354, N = 7SE +/- 0.055800, N = 15SE +/- 0.115724, N = 15SE +/- 0.115723, N = 15SE +/- 0.063684, N = 15SE +/- 0.115702, N = 15SE +/- 0.022246, N = 15SE +/- 0.057580, N = 6SE +/- 0.045713, N = 132.1594594.1827074.9558652.5298075.9309572.8810995.1141612.5273632.0768353.3604533.7548352.3129773.6543032.0843846.5417686.8527121. (CXX) g++ options: -fopenmp -lmpi_cxx -lmpi

OpenBenchmarking.orgHydro Cycle Time - Seconds, Fewer Is BetterPennant 1.0.1Test: sedovbigXeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN510152025SE +/- 0.018471, N = 4SE +/- 0.002400, N = 3SE +/- 0.002987, N = 3SE +/- 0.016400, N = 4SE +/- 0.001847, N = 3SE +/- 0.003237, N = 4SE +/- 0.013353, N = 3SE +/- 0.003253, N = 4SE +/- 0.041359, N = 15SE +/- 0.080453, N = 15SE +/- 0.052975, N = 7SE +/- 0.040626, N = 15SE +/- 0.074320, N = 15SE +/- 0.037087, N = 15SE +/- 0.024479, N = 4SE +/- 0.029749, N = 49.96452616.96910016.03080011.28438021.02112013.21125019.88246012.1069003.0811085.4606605.9164583.4083375.1476582.94045611.36964012.1513201. (CXX) g++ options: -fopenmp -lmpi_cxx -lmpi

PyBench

This test profile reports the total time of the different average timed test results from PyBench. PyBench reports average test times for different functions such as BuiltinFunctionCalls and NestedForLoops, with this total result providing a rough estimate as to Python's average performance on a given system. This test profile runs PyBench each time for 20 rounds. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgMilliseconds, Fewer Is BetterPyBench 2018-02-16Total For Average Test TimesXeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN2004006008001000SE +/- 0.48, N = 4SE +/- 0.41, N = 4SE +/- 0.33, N = 3SE +/- 1.15, N = 3SE +/- 0.33, N = 3SE +/- 0.67, N = 3SE +/- 0.58, N = 3SE +/- 0.67, N = 3SE +/- 1.20, N = 3SE +/- 2.08, N = 3SE +/- 2.19, N = 3SE +/- 1.86, N = 3SE +/- 0.58, N = 3SE +/- 1.33, N = 3SE +/- 1.45, N = 3SE +/- 2.40, N = 3692691765767763763762763818818818822974972976974

PostgreSQL

This is a benchmark of PostgreSQL using the integrated pgbench for facilitating the database benchmarks. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgms, Fewer Is BetterPostgreSQL 16Scaling Factor: 100 - Clients: 1000 - Mode: Read Write - Average LatencyXeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN714212835SE +/- 0.10, N = 3SE +/- 0.04, N = 3SE +/- 0.02, N = 3SE +/- 0.03, N = 3SE +/- 0.02, N = 3SE +/- 0.06, N = 3SE +/- 0.03, N = 3SE +/- 0.12, N = 3SE +/- 0.32, N = 12SE +/- 0.01, N = 3SE +/- 0.04, N = 3SE +/- 0.25, N = 12SE +/- 0.05, N = 3SE +/- 0.02, N = 3SE +/- 0.05, N = 3SE +/- 0.10, N = 330.2013.2614.0414.8614.2916.9613.8516.6618.1612.5812.5018.0613.8416.8816.3218.051. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm

OpenBenchmarking.orgms, Fewer Is BetterPostgreSQL 16Scaling Factor: 100 - Clients: 1000 - Mode: Read Only - Average LatencyXeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN0.29090.58180.87271.16361.4545SE +/- 0.040, N = 12SE +/- 0.005, N = 12SE +/- 0.007, N = 3SE +/- 0.030, N = 12SE +/- 0.008, N = 12SE +/- 0.017, N = 9SE +/- 0.007, N = 3SE +/- 0.038, N = 9SE +/- 0.006, N = 12SE +/- 0.002, N = 3SE +/- 0.003, N = 3SE +/- 0.004, N = 12SE +/- 0.001, N = 3SE +/- 0.001, N = 3SE +/- 0.002, N = 3SE +/- 0.001, N = 31.1490.5890.5721.2930.5591.0270.6221.0980.2890.2510.2780.2930.2920.3290.3840.4141. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm

OSPRay Studio

Intel OSPRay Studio is an open-source, interactive visualization and ray-tracing software package. OSPRay Studio makes use of Intel OSPRay, a portable ray-tracing engine for high-performance, high-fidelity visualizations. OSPRay builds off Intel's Embree and Intel SPMD Program Compiler (ISPC) components as part of the oneAPI rendering toolkit. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 1.0Camera: 1 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path Tracer - Acceleration: CPUXeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN5001000150020002500SE +/- 0.88, N = 3SE +/- 0.88, N = 3SE +/- 0.58, N = 3SE +/- 0.58, N = 3SE +/- 0.33, N = 3SE +/- 1.76, N = 3SE +/- 0.58, N = 3SE +/- 0.58, N = 3SE +/- 1.20, N = 3SE +/- 1.15, N = 3SE +/- 0.58, N = 3SE +/- 0.58, N = 3SE +/- 1.20, N = 3SE +/- 0.88, N = 3SE +/- 0.58, N = 3SE +/- 1.20, N = 3759144116578941988104917929615611037118066195453120432240

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 1.0Camera: 1 - Resolution: 4K - Samples Per Pixel: 16 - Renderer: Path Tracer - Acceleration: CPUXeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN9K18K27K36K45KSE +/- 7.13, N = 3SE +/- 37.49, N = 3SE +/- 62.46, N = 3SE +/- 34.10, N = 3SE +/- 28.06, N = 3SE +/- 72.42, N = 3SE +/- 83.47, N = 3SE +/- 51.39, N = 3SE +/- 17.16, N = 3SE +/- 39.30, N = 3SE +/- 44.33, N = 3SE +/- 32.74, N = 3SE +/- 33.33, N = 3SE +/- 12.34, N = 3SE +/- 250.73, N = 3SE +/- 31.02, N = 3121242312531380141383705516645337901535789161660318896104281528684133881142513

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 1.0Camera: 1 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path Tracer - Acceleration: CPUXeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN20K40K60K80K100KSE +/- 16.05, N = 3SE +/- 90.37, N = 3SE +/- 102.40, N = 3SE +/- 64.24, N = 3SE +/- 134.33, N = 3SE +/- 37.55, N = 3SE +/- 64.91, N = 3SE +/- 13.86, N = 3SE +/- 14.62, N = 3SE +/- 193.23, N = 3SE +/- 42.05, N = 3SE +/- 109.43, N = 3SE +/- 312.83, N = 12SE +/- 47.34, N = 3SE +/- 172.59, N = 3SE +/- 346.19, N = 324249507985802633411689733892662540361791785538645432902075037383169607205178093

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 1.0Camera: 3 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path Tracer - Acceleration: CPUXeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN6001200180024003000SE +/- 0.00, N = 3SE +/- 1.45, N = 3SE +/- 0.88, N = 3SE +/- 0.88, N = 3SE +/- 1.20, N = 3SE +/- 2.65, N = 3SE +/- 1.20, N = 3SE +/- 0.33, N = 3SE +/- 1.45, N = 3SE +/- 1.53, N = 3SE +/- 1.00, N = 3SE +/- 0.58, N = 3SE +/- 0.88, N = 3SE +/- 0.67, N = 3SE +/- 1.00, N = 3SE +/- 3.06, N = 3898170919771063235712372123114366012251391780113063024212649

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 1.0Camera: 3 - Resolution: 4K - Samples Per Pixel: 16 - Renderer: Path Tracer - Acceleration: CPUXeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN10K20K30K40K50KSE +/- 8.00, N = 3SE +/- 26.00, N = 3SE +/- 61.20, N = 3SE +/- 29.96, N = 3SE +/- 36.47, N = 3SE +/- 25.12, N = 3SE +/- 74.33, N = 3SE +/- 10.97, N = 3SE +/- 32.79, N = 3SE +/- 24.66, N = 3SE +/- 5.55, N = 3SE +/- 27.79, N = 3SE +/- 21.05, N = 3SE +/- 16.90, N = 3SE +/- 111.72, N = 3SE +/- 197.99, N = 314358319933664916837428371970139238181111051419535223051242718129100154537748844

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 1.0Camera: 3 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path Tracer - Acceleration: CPUXeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN20K40K60K80K100KSE +/- 47.16, N = 3SE +/- 162.52, N = 3SE +/- 58.68, N = 3SE +/- 125.33, N = 3SE +/- 41.33, N = 3SE +/- 155.80, N = 3SE +/- 65.97, N = 3SE +/- 141.04, N = 3SE +/- 27.74, N = 3SE +/- 89.57, N = 3SE +/- 231.95, N = 3SE +/- 756.08, N = 15SE +/- 50.97, N = 3SE +/- 28.11, N = 3SE +/- 29.36, N = 3SE +/- 13.58, N = 333391595226800638813807424521173366419712089344349500192794342945200718426191643

OpenVINO

This is a test of the Intel OpenVINO, a toolkit around neural networks, using its built-in benchmarking support and analyzing the throughput and latency for various models. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Face Detection FP16-INT8 - Device: CPUXeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN140280420560700SE +/- 0.33, N = 3SE +/- 0.69, N = 3SE +/- 0.28, N = 3SE +/- 0.00, N = 3SE +/- 0.15, N = 3SE +/- 0.40, N = 3SE +/- 0.47, N = 3SE +/- 0.35, N = 3SE +/- 0.43, N = 3SE +/- 0.43, N = 3SE +/- 0.07, N = 3SE +/- 0.02, N = 3SE +/- 0.18, N = 3SE +/- 0.03, N = 3SE +/- 0.18, N = 3SE +/- 0.12, N = 3234.24224.64356.38283.11236.52256.63257.50278.52233.63471.98510.10253.63551.07275.53592.22654.83MIN: 148.68 / MAX: 448.54MIN: 153.29 / MAX: 553.64MIN: 109.11 / MAX: 395.69MIN: 203.37 / MAX: 332.08MIN: 172.47 / MAX: 265.77MIN: 191.95 / MAX: 301.21MIN: 187.62 / MAX: 295.06MIN: 196.58 / MAX: 401.59MIN: 208.22 / MAX: 306.45MIN: 439.42 / MAX: 492.74MIN: 263.11 / MAX: 527.97MIN: 208.02 / MAX: 272.56MIN: 513.17 / MAX: 582.25MIN: 260.9 / MAX: 318.85MIN: 486.17 / MAX: 612.41MIN: 592.1 / MAX: 665.731. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPUXeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN0.16430.32860.49290.65720.8215SE +/- 0.01, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.01, N = 3SE +/- 0.00, N = 15SE +/- 0.00, N = 7SE +/- 0.00, N = 3SE +/- 0.01, N = 3SE +/- 0.00, N = 15SE +/- 0.00, N = 3SE +/- 0.00, N = 9SE +/- 0.00, N = 3SE +/- 0.00, N = 30.460.490.430.290.330.280.370.300.350.450.480.350.730.410.530.60MIN: 0.18 / MAX: 22.29MIN: 0.18 / MAX: 16.07MIN: 0.23 / MAX: 17.03MIN: 0.24 / MAX: 39.69MIN: 0.26 / MAX: 19.2MIN: 0.25 / MAX: 41.4MIN: 0.28 / MAX: 40.85MIN: 0.26 / MAX: 42.1MIN: 0.32 / MAX: 82.66MIN: 0.22 / MAX: 19.11MIN: 0.22 / MAX: 18.92MIN: 0.32 / MAX: 81.66MIN: 0.26 / MAX: 23.1MIN: 0.39 / MAX: 91.48MIN: 0.26 / MAX: 22.12MIN: 0.26 / MAX: 24.71. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Person Detection FP16 - Device: CPUXeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN50100150200250SE +/- 0.09, N = 3SE +/- 0.09, N = 3SE +/- 0.01, N = 3SE +/- 0.05, N = 3SE +/- 0.18, N = 3SE +/- 0.10, N = 3SE +/- 0.10, N = 3SE +/- 0.06, N = 3SE +/- 0.09, N = 3SE +/- 1.22, N = 15SE +/- 2.90, N = 15SE +/- 0.44, N = 15SE +/- 6.97, N = 15SE +/- 1.90, N = 15SE +/- 0.19, N = 3SE +/- 0.41, N = 343.4139.62100.3945.7841.9342.1659.6964.9143.77110.91157.4563.98230.2485.86161.48156.59MIN: 27.3 / MAX: 82.85MIN: 26.71 / MAX: 62.24MIN: 41.76 / MAX: 139.86MIN: 33.94 / MAX: 85.21MIN: 27.14 / MAX: 54.05MIN: 32.47 / MAX: 70.84MIN: 42.86 / MAX: 84.25MIN: 49.88 / MAX: 107.03MIN: 37.7 / MAX: 90.56MIN: 43.17 / MAX: 198.04MIN: 52.3 / MAX: 282.08MIN: 39.78 / MAX: 114.18MIN: 65.18 / MAX: 718.24MIN: 47.19 / MAX: 207.44MIN: 55.89 / MAX: 223.7MIN: 61.92 / MAX: 224.561. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Weld Porosity Detection FP16-INT8 - Device: CPUXeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN3691215SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.03, N = 4SE +/- 0.01, N = 3SE +/- 0.00, N = 3SE +/- 0.01, N = 3SE +/- 0.04, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.08, N = 3SE +/- 0.01, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 32.482.363.582.502.502.532.672.799.259.4210.0910.1710.9211.2011.7813.11MIN: 1.98 / MAX: 34.01MIN: 2.02 / MAX: 21.33MIN: 1.4 / MAX: 12.71MIN: 2.28 / MAX: 40.8MIN: 2.22 / MAX: 27.89MIN: 2.23 / MAX: 31.44MIN: 2.39 / MAX: 34.22MIN: 2.44 / MAX: 34.21MIN: 8.35 / MAX: 44.99MIN: 4.22 / MAX: 26.07MIN: 4.29 / MAX: 26.52MIN: 8.74 / MAX: 41.95MIN: 4.98 / MAX: 37.58MIN: 9.95 / MAX: 64.26MIN: 6.2 / MAX: 24.38MIN: 6.01 / MAX: 25.621. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Vehicle Detection FP16-INT8 - Device: CPUXeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN510152025SE +/- 0.01, N = 3SE +/- 0.00, N = 3SE +/- 0.01, N = 3SE +/- 0.04, N = 3SE +/- 0.05, N = 3SE +/- 0.01, N = 3SE +/- 0.04, N = 3SE +/- 0.03, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.01, N = 3SE +/- 0.00, N = 3SE +/- 0.12, N = 15SE +/- 0.00, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 314.6713.7317.8421.7316.3317.1919.4420.244.087.858.584.4610.975.0010.7811.48MIN: 12.73 / MAX: 41.28MIN: 12.23 / MAX: 23.01MIN: 9.08 / MAX: 37.11MIN: 15.08 / MAX: 39.82MIN: 13.49 / MAX: 26.98MIN: 13.16 / MAX: 42.02MIN: 15.1 / MAX: 32.19MIN: 13.69 / MAX: 36.9MIN: 3.61 / MAX: 25.59MIN: 3.77 / MAX: 30.51MIN: 3.84 / MAX: 27.82MIN: 3.61 / MAX: 26.57MIN: 4.5 / MAX: 46.56MIN: 4.38 / MAX: 33.93MIN: 5.12 / MAX: 22.93MIN: 5.61 / MAX: 26.21. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Person Vehicle Bike Detection FP16 - Device: CPUXeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN48121620SE +/- 0.00, N = 3SE +/- 0.01, N = 3SE +/- 0.02, N = 3SE +/- 0.02, N = 3SE +/- 0.02, N = 3SE +/- 0.00, N = 3SE +/- 0.03, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.03, N = 3SE +/- 0.05, N = 3SE +/- 0.00, N = 3SE +/- 0.11, N = 3SE +/- 0.00, N = 3SE +/- 0.01, N = 3SE +/- 0.02, N = 311.6911.1716.5015.0412.5413.3413.5914.424.918.489.475.2011.356.2711.2212.67MIN: 10.28 / MAX: 42.12MIN: 10.18 / MAX: 19.36MIN: 11.95 / MAX: 28.87MIN: 12.32 / MAX: 32.87MIN: 9.17 / MAX: 21.01MIN: 9.67 / MAX: 39.84MIN: 9.53 / MAX: 21.61MIN: 9.74 / MAX: 43.95MIN: 4.44 / MAX: 21.92MIN: 5 / MAX: 22.91MIN: 5.96 / MAX: 23.01MIN: 4.52 / MAX: 23.03MIN: 6.34 / MAX: 32.69MIN: 5.66 / MAX: 25.66MIN: 6.69 / MAX: 20.05MIN: 7.38 / MAX: 24.531. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Machine Translation EN To DE FP16 - Device: CPUXeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN20406080100SE +/- 0.02, N = 3SE +/- 0.02, N = 3SE +/- 0.03, N = 3SE +/- 0.16, N = 3SE +/- 0.12, N = 3SE +/- 0.07, N = 3SE +/- 0.34, N = 3SE +/- 0.05, N = 3SE +/- 0.01, N = 3SE +/- 0.60, N = 11SE +/- 0.77, N = 7SE +/- 0.44, N = 3SE +/- 1.05, N = 5SE +/- 0.59, N = 3SE +/- 0.13, N = 3SE +/- 0.05, N = 328.1726.8562.4637.5828.7329.9838.5041.5743.1783.1191.1648.43102.8456.73100.67109.00MIN: 20.12 / MAX: 261.31MIN: 20.18 / MAX: 307.38MIN: 46.12 / MAX: 79.06MIN: 20.58 / MAX: 347.67MIN: 19.52 / MAX: 209.26MIN: 20.48 / MAX: 222.7MIN: 25.18 / MAX: 161.13MIN: 28.11 / MAX: 155.06MIN: 34.03 / MAX: 226.77MIN: 36.66 / MAX: 131.44MIN: 43.59 / MAX: 136.45MIN: 36.56 / MAX: 119.12MIN: 47.17 / MAX: 172.5MIN: 45.46 / MAX: 220.87MIN: 47.39 / MAX: 138.74MIN: 53.63 / MAX: 148.461. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Face Detection Retail FP16-INT8 - Device: CPUXeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN246810SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.01, N = 3SE +/- 0.00, N = 3SE +/- 0.01, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.01, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.01, N = 35.185.196.435.725.275.555.776.025.345.415.855.986.256.606.777.60MIN: 4.74 / MAX: 26.35MIN: 4.72 / MAX: 11.02MIN: 3.84 / MAX: 15.83MIN: 5.1 / MAX: 17.93MIN: 4.98 / MAX: 13.16MIN: 5.12 / MAX: 24.99MIN: 5.26 / MAX: 13.86MIN: 5.37 / MAX: 27.77MIN: 4.88 / MAX: 26.62MIN: 2.65 / MAX: 24.3MIN: 2.67 / MAX: 22.66MIN: 4.9 / MAX: 26.69MIN: 3.07 / MAX: 31.02MIN: 5.84 / MAX: 35.85MIN: 3.54 / MAX: 18.38MIN: 3.84 / MAX: 21.811. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Handwritten English Recognition FP16-INT8 - Device: CPUXeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN1020304050SE +/- 0.02, N = 3SE +/- 0.01, N = 3SE +/- 0.04, N = 3SE +/- 0.00, N = 3SE +/- 0.04, N = 3SE +/- 0.01, N = 3SE +/- 0.05, N = 3SE +/- 0.02, N = 3SE +/- 0.07, N = 3SE +/- 0.05, N = 3SE +/- 0.06, N = 3SE +/- 0.07, N = 3SE +/- 0.09, N = 3SE +/- 0.08, N = 3SE +/- 0.09, N = 3SE +/- 0.02, N = 322.9621.8736.2025.1223.1224.0024.9425.7233.1832.0034.9236.9038.8539.8641.3845.71MIN: 20.8 / MAX: 34.86MIN: 20.16 / MAX: 32.36MIN: 20.73 / MAX: 45.28MIN: 19.86 / MAX: 59.96MIN: 18.74 / MAX: 31.08MIN: 19.19 / MAX: 45.88MIN: 19.75 / MAX: 33.18MIN: 20.7 / MAX: 44.98MIN: 29.34 / MAX: 51.4MIN: 21.72 / MAX: 52.65MIN: 22.04 / MAX: 54.74MIN: 29.34 / MAX: 49.06MIN: 23.02 / MAX: 69.97MIN: 35.87 / MAX: 58.79MIN: 25.29 / MAX: 59.37MIN: 31.06 / MAX: 64.631. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Road Segmentation ADAS FP16-INT8 - Device: CPUXeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN1530456075SE +/- 0.28, N = 3SE +/- 0.02, N = 3SE +/- 0.14, N = 3SE +/- 0.03, N = 3SE +/- 0.15, N = 3SE +/- 0.05, N = 3SE +/- 0.21, N = 3SE +/- 0.06, N = 3SE +/- 0.02, N = 3SE +/- 0.01, N = 3SE +/- 0.11, N = 3SE +/- 0.02, N = 3SE +/- 0.26, N = 15SE +/- 0.02, N = 3SE +/- 0.02, N = 3SE +/- 0.03, N = 357.1355.0755.9965.0255.7456.7162.5362.1111.9521.6327.4614.3038.2115.8431.9934.76MIN: 39.58 / MAX: 104.91MIN: 46.78 / MAX: 80.73MIN: 27.63 / MAX: 76.45MIN: 55.15 / MAX: 104.43MIN: 44.83 / MAX: 69.99MIN: 45.43 / MAX: 89.46MIN: 48.23 / MAX: 78.43MIN: 47.82 / MAX: 101.26MIN: 11.25 / MAX: 37.16MIN: 14.35 / MAX: 50.29MIN: 14.03 / MAX: 53.11MIN: 11.91 / MAX: 38.94MIN: 15.81 / MAX: 88.01MIN: 13.68 / MAX: 55.05MIN: 16.09 / MAX: 51.04MIN: 17.72 / MAX: 54.791. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Person Re-Identification Retail FP16 - Device: CPUXeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN3691215SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.01, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 36.956.729.797.727.137.327.767.973.786.937.233.988.034.378.599.46MIN: 6.28 / MAX: 20.42MIN: 6.22 / MAX: 11.15MIN: 4.37 / MAX: 18.18MIN: 7.16 / MAX: 18.31MIN: 6.64 / MAX: 12.22MIN: 6.78 / MAX: 18.72MIN: 6.86 / MAX: 12.92MIN: 7.04 / MAX: 21.51MIN: 3.43 / MAX: 19.66MIN: 3.55 / MAX: 50.69MIN: 3.57 / MAX: 20.82MIN: 3.41 / MAX: 18.88MIN: 4.21 / MAX: 29.66MIN: 4.13 / MAX: 27.79MIN: 5.08 / MAX: 17.25MIN: 5.55 / MAX: 22.411. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Noise Suppression Poconet-Like FP16 - Device: CPUXeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN714212835SE +/- 0.04, N = 3SE +/- 0.01, N = 3SE +/- 0.00, N = 3SE +/- 0.05, N = 3SE +/- 0.04, N = 3SE +/- 0.12, N = 3SE +/- 0.02, N = 3SE +/- 0.09, N = 3SE +/- 0.04, N = 3SE +/- 0.00, N = 3SE +/- 0.16, N = 14SE +/- 0.08, N = 3SE +/- 0.45, N = 12SE +/- 0.10, N = 3SE +/- 0.00, N = 3SE +/- 0.02, N = 313.159.4013.9515.9611.3717.1512.7218.7222.2013.5216.3223.1222.6728.1017.3018.49MIN: 7.28 / MAX: 47.97MIN: 7.66 / MAX: 25.07MIN: 8.67 / MAX: 65.92MIN: 10.38 / MAX: 43.64MIN: 9.17 / MAX: 32.12MIN: 10.81 / MAX: 59.34MIN: 9.56 / MAX: 30.66MIN: 12.15 / MAX: 64.81MIN: 9.55 / MAX: 75.9MIN: 6.46 / MAX: 38.94MIN: 8.11 / MAX: 42.33MIN: 10.62 / MAX: 67.83MIN: 8.31 / MAX: 66.6MIN: 12.27 / MAX: 100.22MIN: 10.72 / MAX: 37.75MIN: 11.59 / MAX: 39.131. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

oneDNN

This is a test of the Intel oneDNN as an Intel-optimized library for Deep Neural Networks and making use of its built-in benchdnn functionality. The result is the total perf time reported. Intel oneDNN was formerly known as DNNL (Deep Neural Network Library) and MKL-DNN before being rebranded as part of the Intel oneAPI toolkit. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.4Harness: Deconvolution Batch shapes_3d - Engine: CPUXeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN0.40440.80881.21321.61762.022SE +/- 0.000902, N = 9SE +/- 0.000392, N = 9SE +/- 0.000805, N = 9SE +/- 0.001274, N = 9SE +/- 0.000508, N = 9SE +/- 0.000806, N = 9SE +/- 0.000927, N = 9SE +/- 0.001240, N = 9SE +/- 0.002070, N = 9SE +/- 0.001272, N = 9SE +/- 0.001484, N = 9SE +/- 0.001921, N = 9SE +/- 0.001089, N = 9SE +/- 0.003127, N = 9SE +/- 0.000791, N = 9SE +/- 0.001685, N = 90.6242500.9071611.0774300.7361701.2640700.9450751.1964300.8643581.0019141.1192301.1548701.0094730.9436210.8296531.4983501.797490MIN: 0.58MIN: 0.87MIN: 1.06MIN: 0.66MIN: 1.21MIN: 0.9MIN: 1.16MIN: 0.81MIN: 0.92MIN: 1.02MIN: 1.04MIN: 0.94MIN: 0.92MIN: 0.65MIN: 1.37MIN: 1.651. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread

Timed Linux Kernel Compilation

This test times how long it takes to build the Linux kernel in a default configuration (defconfig) for the architecture being tested or alternatively an allmodconfig for building all possible kernel modules for the build. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed Linux Kernel Compilation 6.8Build: defconfigXeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN1122334455SE +/- 0.23, N = 7SE +/- 0.39, N = 4SE +/- 0.55, N = 3SE +/- 0.43, N = 3SE +/- 0.59, N = 3SE +/- 0.40, N = 4SE +/- 0.57, N = 3SE +/- 0.31, N = 5SE +/- 0.17, N = 13SE +/- 0.46, N = 3SE +/- 0.43, N = 3SE +/- 0.33, N = 3SE +/- 0.44, N = 3SE +/- 0.28, N = 7SE +/- 0.50, N = 4SE +/- 0.54, N = 425.8734.5939.4529.9843.4232.1440.5030.5325.8732.8934.5727.6838.5330.6844.2846.35

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed Linux Kernel Compilation 6.8Build: allmodconfigXeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN90180270360450SE +/- 0.56, N = 3SE +/- 0.72, N = 3SE +/- 0.80, N = 3SE +/- 0.86, N = 3SE +/- 0.61, N = 3SE +/- 0.56, N = 3SE +/- 0.67, N = 3SE +/- 0.73, N = 3SE +/- 0.98, N = 3SE +/- 0.37, N = 3SE +/- 0.49, N = 3SE +/- 0.49, N = 3SE +/- 1.05, N = 3SE +/- 1.31, N = 3SE +/- 0.91, N = 3SE +/- 0.78, N = 3189.74316.90362.45218.57428.39246.94384.06231.03182.00290.34311.83197.63337.69210.20406.41438.17

Timed FFmpeg Compilation

This test times how long it takes to build the FFmpeg multimedia library. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed FFmpeg Compilation 7.0Time To CompileXeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN714212835SE +/- 0.05, N = 3SE +/- 0.07, N = 3SE +/- 0.04, N = 3SE +/- 0.01, N = 3SE +/- 0.03, N = 3SE +/- 0.09, N = 3SE +/- 0.09, N = 3SE +/- 0.03, N = 3SE +/- 0.03, N = 3SE +/- 0.02, N = 3SE +/- 0.03, N = 3SE +/- 0.05, N = 3SE +/- 0.11, N = 3SE +/- 0.30, N = 3SE +/- 0.05, N = 3SE +/- 0.04, N = 317.3921.3624.0619.5126.4620.7924.8420.0117.8419.9920.4918.0923.2221.2227.5428.42

Timed Godot Game Engine Compilation

This test times how long it takes to compile the Godot Game Engine. Godot is a popular, open-source, cross-platform 2D/3D game engine and is built using the SCons build system and targeting the X11 platform. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed Godot Game Engine Compilation 4.0Time To CompileXeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN4080120160200SE +/- 0.29, N = 3SE +/- 0.91, N = 3SE +/- 0.76, N = 3SE +/- 0.56, N = 3SE +/- 0.18, N = 3SE +/- 0.56, N = 3SE +/- 0.32, N = 3SE +/- 1.69, N = 3SE +/- 0.62, N = 3SE +/- 0.12, N = 3SE +/- 0.16, N = 3SE +/- 0.06, N = 3SE +/- 0.20, N = 3SE +/- 0.55, N = 3SE +/- 0.32, N = 3SE +/- 0.16, N = 3103.38122.72140.23118.57149.38123.88143.81122.7096.16103.35111.69102.58128.28126.11154.01159.62

Timed Node.js Compilation

This test profile times how long it takes to build/compile Node.js itself from source. Node.js is a JavaScript run-time built from the Chrome V8 JavaScript engine while itself is written in C/C++. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed Node.js Compilation 21.7.2Time To CompileXeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN60120180240300SE +/- 0.12, N = 3SE +/- 0.52, N = 3SE +/- 0.71, N = 3SE +/- 0.48, N = 3SE +/- 0.53, N = 3SE +/- 0.84, N = 3SE +/- 0.74, N = 3SE +/- 0.52, N = 3SE +/- 1.19, N = 3SE +/- 0.50, N = 3SE +/- 0.59, N = 3SE +/- 0.18, N = 3SE +/- 0.72, N = 3SE +/- 1.51, N = 3SE +/- 0.17, N = 3SE +/- 0.19, N = 3145.41214.43254.00172.99270.38175.63252.65171.17114.91147.84164.02118.90186.10147.74277.53288.12

Timed Gem5 Compilation

This test times how long it takes to compile Gem5. Gem5 is a simulator for computer system architecture research. Gem5 is widely used for computer architecture research within the industry, academia, and more. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed Gem5 Compilation 23.0.1Time To CompileXeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN50100150200250SE +/- 0.89, N = 3SE +/- 2.17, N = 3SE +/- 0.92, N = 3SE +/- 0.58, N = 3SE +/- 2.59, N = 4SE +/- 1.72, N = 3SE +/- 2.11, N = 6SE +/- 1.01, N = 3SE +/- 1.16, N = 3SE +/- 2.15, N = 3SE +/- 2.24, N = 4SE +/- 0.72, N = 3SE +/- 1.88, N = 3SE +/- 1.73, N = 3SE +/- 1.99, N = 9SE +/- 0.97, N = 3157.36187.51210.93178.28220.57184.30215.50181.63161.94176.88185.30164.90212.55192.98242.93251.61

Timed LLVM Compilation

This test times how long it takes to compile/build the LLVM compiler stack. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed LLVM Compilation 16.0Build System: NinjaXeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN50100150200250SE +/- 0.27, N = 3SE +/- 0.12, N = 3SE +/- 0.07, N = 3SE +/- 0.15, N = 3SE +/- 0.19, N = 3SE +/- 0.17, N = 3SE +/- 0.36, N = 3SE +/- 0.79, N = 3SE +/- 0.09, N = 3SE +/- 0.27, N = 3SE +/- 0.31, N = 3SE +/- 0.08, N = 3SE +/- 0.74, N = 3SE +/- 0.45, N = 3SE +/- 0.20, N = 3SE +/- 0.10, N = 3106.82165.05187.02122.31212.48134.42197.84128.0789.28124.46135.6794.81146.76101.56205.01215.93

Timed Mesa Compilation

This test profile times how long it takes to compile Mesa with Meson/Ninja. For minimizing build dependencies and avoid versioning conflicts, test this is just the core Mesa build without LLVM or the extra Gallium3D/Mesa drivers enabled. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed Mesa Compilation 24.0Time To CompileXeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN510152025SE +/- 0.05, N = 4SE +/- 0.07, N = 3SE +/- 0.07, N = 3SE +/- 0.12, N = 3SE +/- 0.03, N = 3SE +/- 0.07, N = 3SE +/- 0.08, N = 3SE +/- 0.17, N = 3SE +/- 0.08, N = 4SE +/- 0.02, N = 3SE +/- 0.03, N = 3SE +/- 0.02, N = 4SE +/- 0.03, N = 3SE +/- 0.12, N = 3SE +/- 0.04, N = 3SE +/- 0.02, N = 316.1817.2619.2318.2920.1818.4719.6518.1416.4016.6716.9616.4119.9119.5621.0421.53

Timed ImageMagick Compilation

This test times how long it takes to build ImageMagick. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed ImageMagick Compilation 6.9.0Time To CompileXeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN48121620SE +/- 0.03, N = 4SE +/- 0.10, N = 4SE +/- 0.10, N = 4SE +/- 0.13, N = 4SE +/- 0.15, N = 4SE +/- 0.11, N = 4SE +/- 0.06, N = 4SE +/- 0.07, N = 4SE +/- 0.04, N = 4SE +/- 0.06, N = 4SE +/- 0.09, N = 4SE +/- 0.04, N = 4SE +/- 0.08, N = 4SE +/- 0.02, N = 4SE +/- 0.04, N = 3SE +/- 0.04, N = 311.4912.6014.7213.2616.0814.4015.3814.0911.7212.2013.4712.7516.3915.8117.9218.18

WRF

WRF, the Weather Research and Forecasting Model, is a "next-generation mesoscale numerical weather prediction system designed for both atmospheric research and operational forecasting applications. It features two dynamical cores, a data assimilation system, and a software architecture supporting parallel computation and system extensibility." Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterWRF 4.2.2Input: conus 2.5kmXeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN4K8K12K16K20K5601.1010602.4111980.816674.1213273.697157.9612410.296840.064431.347885.1610176.866918.0211895.417365.8616147.0016609.781. (F9X) gfortran options: -O2 -ftree-vectorize -funroll-loops -ffree-form -fconvert=big-endian -frecord-marker=4 -fallow-invalid-boz -lesmf_time -lwrfio_nf -lnetcdff -lnetcdf -lmpi_usempif08 -lmpi_mpifh -lmpi -lopen-rte -lopen-pal -lhwloc -levent_core -levent_pthreads -lm -lz

RELION

RELION - REgularised LIkelihood OptimisatioN - is a stand-alone computer program for Maximum A Posteriori refinement of (multiple) 3D reconstructions or 2D class averages in cryo-electron microscopy (cryo-EM). It is developed in the research group of Sjors Scheres at the MRC Laboratory of Molecular Biology. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterRELION 4.0.1Test: Basic - Device: CPUXeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN110220330440550SE +/- 1.41, N = 3SE +/- 2.68, N = 7SE +/- 7.14, N = 9SE +/- 2.65, N = 3SE +/- 2.98, N = 3SE +/- 3.24, N = 12SE +/- 4.65, N = 9SE +/- 2.66, N = 12SE +/- 1.27, N = 15SE +/- 2.17, N = 3SE +/- 2.95, N = 3SE +/- 2.11, N = 12SE +/- 7.69, N = 9SE +/- 4.04, N = 12SE +/- 4.63, N = 3SE +/- 6.20, N = 3155.74290.45373.18203.41412.37214.42384.38201.3893.17176.42238.88145.65360.21201.27468.69496.241. (CXX) g++ options: -fopenmp -std=c++11 -O3 -rdynamic -ldl -ltiff -lfftw3f -lfftw3 -lpng -ljpeg -lmpi_cxx -lmpi

m-queens

A solver for the N-queens problem with multi-threading support via the OpenMP library. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is Betterm-queens 1.2Time To SolveXeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN510152025SE +/- 0.028, N = 6SE +/- 0.030, N = 4SE +/- 0.025, N = 4SE +/- 0.021, N = 6SE +/- 0.031, N = 3SE +/- 0.021, N = 5SE +/- 0.035, N = 3SE +/- 0.028, N = 5SE +/- 0.064, N = 15SE +/- 0.025, N = 6SE +/- 0.019, N = 6SE +/- 0.093, N = 15SE +/- 0.021, N = 6SE +/- 0.031, N = 8SE +/- 0.019, N = 4SE +/- 0.029, N = 47.40214.25715.2117.88121.03010.84018.1029.2854.1336.9507.7384.6096.3503.98113.25014.4931. (CXX) g++ options: -fopenmp -O2 -march=native

CloverLeaf

CloverLeaf is a Lagrangian-Eulerian hydrodynamics benchmark. This test profile currently makes use of CloverLeaf's OpenMP version. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterCloverLeaf 1.3Input: clover_bm64_shortXeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN1326395265SE +/- 0.45, N = 3SE +/- 0.03, N = 3SE +/- 0.02, N = 3SE +/- 0.24, N = 3SE +/- 0.15, N = 3SE +/- 0.31, N = 15SE +/- 0.17, N = 3SE +/- 0.40, N = 4SE +/- 0.23, N = 3SE +/- 1.81, N = 15SE +/- 2.15, N = 15SE +/- 1.11, N = 12SE +/- 2.07, N = 12SE +/- 0.30, N = 3SE +/- 0.04, N = 3SE +/- 0.04, N = 331.9039.3839.4826.5841.4332.2542.2232.4422.8342.1746.5030.0548.3627.7457.3857.541. (F9X) gfortran options: -O3 -march=native -funroll-loops -fopenmp

OpenBenchmarking.orgSeconds, Fewer Is BetterCloverLeaf 1.3Input: clover_bm16Xeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN110220330440550SE +/- 2.02, N = 3SE +/- 0.54, N = 3SE +/- 0.13, N = 3SE +/- 0.74, N = 3SE +/- 1.43, N = 3SE +/- 1.56, N = 3SE +/- 2.03, N = 3SE +/- 2.11, N = 9SE +/- 0.59, N = 3SE +/- 2.24, N = 3SE +/- 3.79, N = 9SE +/- 0.12, N = 3SE +/- 4.99, N = 9SE +/- 1.02, N = 3SE +/- 0.79, N = 3SE +/- 1.08, N = 3378.05410.59328.47214.80351.29263.33357.57269.20223.54245.82334.30266.10400.52349.67495.25498.221. (F9X) gfortran options: -O3 -march=native -funroll-loops -fopenmp

GPAW

GPAW is a density-functional theory (DFT) Python code based on the projector-augmented wave (PAW) method and the atomic simulation environment (ASE). Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterGPAW 23.6Input: Carbon NanotubeXeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN1530456075SE +/- 0.10, N = 3SE +/- 0.12, N = 3SE +/- 0.24, N = 3SE +/- 0.55, N = 3SE +/- 0.03, N = 3SE +/- 0.08, N = 3SE +/- 0.08, N = 3SE +/- 0.27, N = 3SE +/- 0.30, N = 15SE +/- 0.11, N = 3SE +/- 0.21, N = 3SE +/- 0.29, N = 15SE +/- 0.14, N = 3SE +/- 0.18, N = 3SE +/- 0.07, N = 3SE +/- 0.01, N = 338.0543.0547.7841.5654.3842.8748.4943.9124.1330.0034.8725.8433.1227.1563.8066.711. (CC) gcc options: -shared -lxc -lblas -lmpi

NWChem

NWChem is an open-source high performance computational chemistry package. Per NWChem's documentation, "NWChem aims to provide its users with computational chemistry tools that are scalable both in their ability to treat large scientific computational chemistry problems efficiently, and in their use of available parallel computing resources from high-performance parallel supercomputers to conventional workstation clusters." Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterNWChem 7.0.2Input: C240 BuckyballXeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN50010001500200025001809.71878.32070.31960.92530.51785.02245.21873.11429.91450.51575.51558.41700.01712.62024.72224.61. (F9X) gfortran options: -lnwctask -lccsd -lmcscf -lselci -lmp2 -lmoints -lstepper -ldriver -loptim -lnwdft -lgradients -lcphf -lesp -lddscf -ldangchang -lguess -lhessian -lvib -lnwcutil -lrimp2 -lproperty -lsolvation -lnwints -lprepar -lnwmd -lnwpw -lofpw -lpaw -lpspw -lband -lnwpwlib -lcafe -lspace -lanalyze -lqhop -lpfft -ldplot -ldrdy -lvscf -lqmmm -lqmd -letrans -ltce -lbq -lmm -lcons -lperfm -ldntmc -lccca -ldimqm -lga -larmci -lpeigs -l64to32 -lopenblas -lpthread -lrt -llapack -lnwcblas -lmpi_usempif08 -lmpi_mpifh -lmpi -lopen-rte -lopen-pal -lhwloc -levent_core -levent_pthreads -lm -lz -lcomex -m64 -ffast-math -std=legacy -fdefault-integer-8 -finline-functions -O2

Xcompact3d Incompact3d

Xcompact3d Incompact3d is a Fortran-MPI based, finite difference high-performance code for solving the incompressible Navier-Stokes equation and as many as you need scalar transport equations. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterXcompact3d Incompact3d 2021-03-11Input: input.i3d 193 Cells Per DirectionXeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN510152025SE +/- 0.03329814, N = 5SE +/- 0.02923582, N = 4SE +/- 0.01004100, N = 4SE +/- 0.04312801, N = 5SE +/- 0.04445674, N = 4SE +/- 0.01741826, N = 5SE +/- 0.01708632, N = 4SE +/- 0.05695382, N = 15SE +/- 0.00891960, N = 5SE +/- 0.05847189, N = 6SE +/- 0.06577912, N = 5SE +/- 0.04312156, N = 5SE +/- 0.03951909, N = 5SE +/- 0.01633300, N = 4SE +/- 0.01040414, N = 3SE +/- 0.10237421, N = 35.3912596710.1967066012.929341306.3916981713.969237607.2934911712.799758206.663875103.753199016.881212798.253835114.260785968.872259144.5106189320.9379139021.178030701. (F9X) gfortran options: -cpp -O2 -funroll-loops -floop-optimize -fcray-pointer -fbacktrace -lmpi_usempif08 -lmpi_mpifh -lmpi -lopen-rte -lopen-pal -lhwloc -levent_core -levent_pthreads -lm -lz

OpenBenchmarking.orgSeconds, Fewer Is BetterXcompact3d Incompact3d 2021-03-11Input: X3D-benchmarking input.i3dXeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN120240360480600SE +/- 0.37, N = 3SE +/- 2.51, N = 3SE +/- 3.88, N = 4SE +/- 0.05, N = 3SE +/- 1.25, N = 3SE +/- 0.04, N = 3SE +/- 0.14, N = 3SE +/- 0.01, N = 3SE +/- 2.20, N = 12SE +/- 3.06, N = 9SE +/- 4.73, N = 3SE +/- 3.26, N = 9SE +/- 5.39, N = 3SE +/- 9.13, N = 9SE +/- 0.92, N = 3SE +/- 0.22, N = 3171.38323.25357.01196.81407.59189.69351.64187.22167.13309.85466.55248.87534.06253.32567.29568.251. (F9X) gfortran options: -cpp -O2 -funroll-loops -floop-optimize -fcray-pointer -fbacktrace -lmpi_usempif08 -lmpi_mpifh -lmpi -lopen-rte -lopen-pal -lhwloc -levent_core -levent_pthreads -lm -lz

OpenFOAM

OpenFOAM is the leading free, open-source software for computational fluid dynamics (CFD). This test profile currently uses the drivaerFastback test case for analyzing automotive aerodynamics or alternatively the older motorBike input. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterOpenFOAM 10Input: drivaerFastback, Small Mesh Size - Mesh TimeXeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN81624324029.3331.7031.3835.6031.7832.4832.0028.8426.8225.9328.0327.7430.3829.4733.6736.821. (CXX) g++ options: -std=c++14 -m64 -O3 -ftemplate-depth-100 -fPIC -fuse-ld=bfd -Xlinker --add-needed --no-as-needed -lfiniteVolume -lmeshTools -lparallel -llagrangian -lregionModels -lgenericPatchFields -lOpenFOAM -ldl -lm

OpenBenchmarking.orgSeconds, Fewer Is BetterOpenFOAM 10Input: drivaerFastback, Small Mesh Size - Execution TimeXeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN132639526523.5633.0742.2228.5645.9528.9941.7527.5822.7128.3332.5925.0133.8124.5758.1759.271. (CXX) g++ options: -std=c++14 -m64 -O3 -ftemplate-depth-100 -fPIC -fuse-ld=bfd -Xlinker --add-needed --no-as-needed -lfiniteVolume -lmeshTools -lparallel -llagrangian -lregionModels -lgenericPatchFields -lOpenFOAM -ldl -lm

OpenBenchmarking.orgSeconds, Fewer Is BetterOpenFOAM 10Input: drivaerFastback, Medium Mesh Size - Mesh TimeXeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN4080120160200139.62148.40160.73162.03153.12134.78150.67159.31135.52118.54136.40140.48167.41192.42163.70188.371. (CXX) g++ options: -std=c++14 -m64 -O3 -ftemplate-depth-100 -fPIC -fuse-ld=bfd -Xlinker --add-needed --no-as-needed -lfiniteVolume -lmeshTools -lparallel -llagrangian -lregionModels -lgenericPatchFields -lOpenFOAM -ldl -lm

OpenBenchmarking.orgSeconds, Fewer Is BetterOpenFOAM 10Input: drivaerFastback, Medium Mesh Size - Execution TimeXeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN150300450600750137.04302.06420.65196.50440.83201.11410.29186.3393.57178.25325.42124.30449.47137.11691.64690.741. (CXX) g++ options: -std=c++14 -m64 -O3 -ftemplate-depth-100 -fPIC -fuse-ld=bfd -Xlinker --add-needed --no-as-needed -lfiniteVolume -lmeshTools -lparallel -llagrangian -lregionModels -lgenericPatchFields -lOpenFOAM -ldl -lm

OpenRadioss

OpenRadioss is an open-source AGPL-licensed finite element solver for dynamic event analysis OpenRadioss is based on Altair Radioss and open-sourced in 2022. This open-source finite element solver is benchmarked with various example models available from https://www.openradioss.org/models/ and https://github.com/OpenRadioss/ModelExchange/tree/main/Examples. This test is currently using a reference OpenRadioss binary build offered via GitHub. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterOpenRadioss 2023.09.15Model: Cell Phone Drop TestXeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN816243240SE +/- 0.32, N = 3SE +/- 0.18, N = 3SE +/- 0.08, N = 3SE +/- 0.10, N = 3SE +/- 0.08, N = 3SE +/- 0.01, N = 3SE +/- 0.02, N = 3SE +/- 0.05, N = 3SE +/- 0.05, N = 3SE +/- 0.19, N = 3SE +/- 0.26, N = 3SE +/- 0.05, N = 3SE +/- 0.26, N = 3SE +/- 0.05, N = 3SE +/- 0.18, N = 3SE +/- 0.35, N = 326.8827.9031.4928.2233.7527.5131.9227.6322.5220.4522.5323.5323.6927.8633.2335.95

OpenBenchmarking.orgSeconds, Fewer Is BetterOpenRadioss 2023.09.15Model: INIVOL and Fluid Structure Interaction Drop ContainerXeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN4080120160200SE +/- 0.30, N = 3SE +/- 0.12, N = 3SE +/- 0.19, N = 3SE +/- 0.17, N = 3SE +/- 0.08, N = 3SE +/- 0.07, N = 3SE +/- 0.06, N = 3SE +/- 0.09, N = 3SE +/- 0.43, N = 3SE +/- 0.93, N = 3SE +/- 0.57, N = 3SE +/- 0.14, N = 3SE +/- 0.46, N = 3SE +/- 0.12, N = 3SE +/- 0.37, N = 3SE +/- 0.63, N = 3100.00128.74140.43107.36160.56114.29146.03110.5679.4294.76100.2485.89106.5490.85176.87187.03

OpenBenchmarking.orgSeconds, Fewer Is BetterOpenRadioss 2023.09.15Model: Chrysler Neon 1MXeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN70140210280350SE +/- 0.14, N = 3SE +/- 0.20, N = 3SE +/- 0.15, N = 3SE +/- 0.11, N = 3SE +/- 0.08, N = 3SE +/- 0.13, N = 3SE +/- 0.18, N = 3SE +/- 0.14, N = 3SE +/- 0.46, N = 3SE +/- 0.49, N = 3SE +/- 1.51, N = 8SE +/- 0.71, N = 12SE +/- 1.11, N = 3SE +/- 1.00, N = 10SE +/- 0.47, N = 3SE +/- 0.50, N = 386.93157.56207.20115.89228.74125.15212.99117.9149.5577.32176.1477.64231.9693.99297.25300.69

Blender

Blender is an open-source 3D creation and modeling software project. This test is of Blender's Cycles performance with various sample files. GPU computing via NVIDIA OptiX and NVIDIA CUDA is currently supported as well as HIP for AMD Radeon GPUs and Intel oneAPI for Intel Graphics. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 4.1Blend File: BMW27 - Compute: CPU-OnlyXeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN714212835SE +/- 0.03, N = 4SE +/- 0.04, N = 3SE +/- 0.15, N = 3SE +/- 0.08, N = 4SE +/- 0.11, N = 3SE +/- 0.03, N = 3SE +/- 0.24, N = 3SE +/- 0.08, N = 4SE +/- 0.03, N = 6SE +/- 0.04, N = 4SE +/- 0.07, N = 4SE +/- 0.02, N = 5SE +/- 0.01, N = 4SE +/- 0.02, N = 6SE +/- 0.04, N = 3SE +/- 0.05, N = 312.7623.7225.8913.7431.6616.5528.4915.297.7514.2915.968.6112.867.1727.1230.07

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 4.1Blend File: Classroom - Compute: CPU-OnlyXeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN20406080100SE +/- 0.22, N = 3SE +/- 0.11, N = 3SE +/- 0.04, N = 3SE +/- 0.05, N = 3SE +/- 0.20, N = 3SE +/- 0.38, N = 3SE +/- 0.40, N = 3SE +/- 0.25, N = 3SE +/- 0.03, N = 3SE +/- 0.14, N = 3SE +/- 0.11, N = 3SE +/- 0.05, N = 3SE +/- 0.04, N = 3SE +/- 0.05, N = 3SE +/- 0.04, N = 3SE +/- 0.18, N = 333.6163.6168.6135.9186.6744.7176.8740.3818.6735.6640.2621.1231.6516.8267.6775.26

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 4.1Blend File: Fishy Cat - Compute: CPU-OnlyXeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN1020304050SE +/- 0.04, N = 3SE +/- 0.06, N = 3SE +/- 0.11, N = 3SE +/- 0.08, N = 3SE +/- 0.17, N = 3SE +/- 0.13, N = 3SE +/- 0.04, N = 3SE +/- 0.18, N = 3SE +/- 0.02, N = 5SE +/- 0.07, N = 3SE +/- 0.11, N = 3SE +/- 0.05, N = 4SE +/- 0.13, N = 3SE +/- 0.04, N = 5SE +/- 0.23, N = 3SE +/- 0.07, N = 317.2931.9134.8319.1342.7823.1738.4821.4510.1618.3620.1511.2516.589.7134.3538.04

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 4.1Blend File: Pabellon Barcelona - Compute: CPU-OnlyXeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN20406080100SE +/- 0.06, N = 3SE +/- 0.09, N = 3SE +/- 0.15, N = 3SE +/- 0.26, N = 3SE +/- 0.31, N = 3SE +/- 0.08, N = 3SE +/- 0.44, N = 3SE +/- 0.20, N = 3SE +/- 0.11, N = 3SE +/- 0.16, N = 3SE +/- 0.04, N = 3SE +/- 0.10, N = 3SE +/- 0.13, N = 3SE +/- 0.13, N = 3SE +/- 0.16, N = 3SE +/- 0.05, N = 341.8580.2987.9246.38106.9655.2697.8051.2923.8444.8748.8826.3539.8321.6685.1294.41

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 4.1Blend File: Barbershop - Compute: CPU-OnlyXeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN70140210280350SE +/- 0.21, N = 3SE +/- 0.69, N = 3SE +/- 0.18, N = 3SE +/- 0.42, N = 3SE +/- 0.12, N = 3SE +/- 0.23, N = 3SE +/- 1.09, N = 3SE +/- 0.06, N = 3SE +/- 0.11, N = 3SE +/- 0.12, N = 3SE +/- 0.25, N = 3SE +/- 0.02, N = 3SE +/- 0.03, N = 3SE +/- 0.07, N = 3SE +/- 0.06, N = 3SE +/- 0.07, N = 3125.87236.73261.97141.54320.11169.44290.56156.7067.52123.90139.2579.05114.7665.58240.13263.76

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 4.1Blend File: Junkshop - Compute: CPU-OnlyXeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN1020304050SE +/- 0.09, N = 3SE +/- 0.10, N = 3SE +/- 0.24, N = 3SE +/- 0.04, N = 3SE +/- 0.04, N = 3SE +/- 0.06, N = 3SE +/- 0.10, N = 3SE +/- 0.19, N = 3SE +/- 0.08, N = 4SE +/- 0.13, N = 3SE +/- 0.06, N = 3SE +/- 0.02, N = 4SE +/- 0.08, N = 3SE +/- 0.02, N = 4SE +/- 0.06, N = 3SE +/- 0.03, N = 318.3132.0835.9621.1542.8524.9939.1723.4511.4718.6521.0212.8717.7011.2135.8238.86

Appleseed

Appleseed is an open-source production renderer focused on physically-based global illumination rendering engine primarily designed for animation and visual effects. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterAppleseed 2.0 BetaScene: Disney MaterialXeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684XEPYC 9654EPYC 9754EPYC 8534PEPYC 8534PN142842567043.7048.4353.4948.5658.3851.2556.4049.1440.9243.4545.0856.4261.36

Scene: Disney Material

EPYC 9684X 2P: The test run did not produce a result.

EPYC 9654 2P: The test run did not produce a result.

EPYC 9754 2P: The test run did not produce a result.

Parallel BZIP2 Compression

This test measures the time needed to compress a file (FreeBSD-13.0-RELEASE-amd64-memstick.img) using Parallel BZIP2 compression. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterParallel BZIP2 Compression 1.1.13FreeBSD-13.0-RELEASE-amd64-memstick.img CompressionXeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN0.59221.18441.77662.36882.961SE +/- 0.024402, N = 15SE +/- 0.023842, N = 15SE +/- 0.007749, N = 10SE +/- 0.017240, N = 15SE +/- 0.023295, N = 15SE +/- 0.030907, N = 15SE +/- 0.020941, N = 15SE +/- 0.028863, N = 15SE +/- 0.015217, N = 15SE +/- 0.015384, N = 15SE +/- 0.014512, N = 15SE +/- 0.019468, N = 15SE +/- 0.010826, N = 15SE +/- 0.012053, N = 15SE +/- 0.023387, N = 15SE +/- 0.016947, N = 151.4323621.8475372.1448571.4692102.6320771.9829322.2877661.7112961.1094461.3690631.4229541.1263291.3557371.0683982.2004972.3211951. (CXX) g++ options: -O2 -pthread -lbz2 -lpthread

libavif avifenc

This is a test of the AOMedia libavif library testing the encoding of a JPEG image to AV1 Image Format (AVIF). Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is Betterlibavif avifenc 1.0Encoder Speed: 0Xeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN20406080100SE +/- 0.03, N = 3SE +/- 0.08, N = 3SE +/- 0.32, N = 3SE +/- 0.05, N = 3SE +/- 0.15, N = 3SE +/- 0.29, N = 3SE +/- 0.22, N = 3SE +/- 0.32, N = 3SE +/- 0.01, N = 3SE +/- 0.12, N = 3SE +/- 0.01, N = 3SE +/- 0.11, N = 3SE +/- 0.13, N = 3SE +/- 0.06, N = 3SE +/- 0.19, N = 3SE +/- 0.18, N = 360.5364.4869.9367.3876.9269.6573.0668.4463.4061.6361.9962.8973.2774.6975.8678.241. (CXX) g++ options: -O3 -fPIC -lm

OpenBenchmarking.orgSeconds, Fewer Is Betterlibavif avifenc 1.0Encoder Speed: 2Xeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN1020304050SE +/- 0.09, N = 3SE +/- 0.05, N = 3SE +/- 0.04, N = 3SE +/- 0.16, N = 3SE +/- 0.21, N = 3SE +/- 0.22, N = 3SE +/- 0.31, N = 3SE +/- 0.06, N = 3SE +/- 0.03, N = 3SE +/- 0.02, N = 3SE +/- 0.02, N = 3SE +/- 0.43, N = 3SE +/- 0.06, N = 3SE +/- 0.13, N = 3SE +/- 0.03, N = 3SE +/- 0.10, N = 333.6534.7937.7537.3141.1338.6539.8838.1435.3234.0434.1535.4040.3541.9241.6642.611. (CXX) g++ options: -O3 -fPIC -lm

OpenBenchmarking.orgSeconds, Fewer Is Betterlibavif avifenc 1.0Encoder Speed: 6Xeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN0.84961.69922.54883.39844.248SE +/- 0.009, N = 10SE +/- 0.016, N = 9SE +/- 0.022, N = 9SE +/- 0.008, N = 9SE +/- 0.017, N = 9SE +/- 0.029, N = 8SE +/- 0.011, N = 9SE +/- 0.022, N = 9SE +/- 0.005, N = 9SE +/- 0.005, N = 10SE +/- 0.011, N = 10SE +/- 0.008, N = 10SE +/- 0.002, N = 9SE +/- 0.026, N = 9SE +/- 0.016, N = 9SE +/- 0.011, N = 92.8052.9713.1693.0443.7303.7763.5503.7382.8902.7232.7562.8103.2513.3413.4843.6231. (CXX) g++ options: -O3 -fPIC -lm

OpenBenchmarking.orgSeconds, Fewer Is Betterlibavif avifenc 1.0Encoder Speed: 6, LosslessXeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN246810SE +/- 0.031, N = 7SE +/- 0.025, N = 7SE +/- 0.013, N = 7SE +/- 0.022, N = 7SE +/- 0.045, N = 6SE +/- 0.027, N = 6SE +/- 0.033, N = 6SE +/- 0.035, N = 6SE +/- 0.015, N = 7SE +/- 0.014, N = 7SE +/- 0.010, N = 7SE +/- 0.020, N = 7SE +/- 0.007, N = 6SE +/- 0.025, N = 6SE +/- 0.009, N = 6SE +/- 0.011, N = 65.6135.7846.2786.1726.8367.1216.6057.0385.9505.7575.7995.8466.8536.9867.1827.3011. (CXX) g++ options: -O3 -fPIC -lm

OpenBenchmarking.orgSeconds, Fewer Is Betterlibavif avifenc 1.0Encoder Speed: 10, LosslessXeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN1.29152.5833.87455.1666.4575SE +/- 0.015, N = 8SE +/- 0.008, N = 8SE +/- 0.006, N = 7SE +/- 0.014, N = 7SE +/- 0.005, N = 7SE +/- 0.019, N = 7SE +/- 0.015, N = 7SE +/- 0.028, N = 7SE +/- 0.003, N = 7SE +/- 0.002, N = 8SE +/- 0.006, N = 8SE +/- 0.006, N = 8SE +/- 0.004, N = 7SE +/- 0.006, N = 7SE +/- 0.006, N = 7SE +/- 0.010, N = 74.5794.4564.9235.0744.9165.3174.8675.3114.9434.7704.7924.8295.6625.7405.7355.7341. (CXX) g++ options: -O3 -fPIC -lm

GNU Octave Benchmark

This test profile measures how long it takes to complete several reference GNU Octave files via octave-benchmark. GNU Octave is used for numerical computations and is an open-source alternative to MATLAB. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterGNU Octave Benchmark 8.4.0Xeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN3691215SE +/- 0.019, N = 6SE +/- 0.020, N = 6SE +/- 0.015, N = 6SE +/- 0.019, N = 6SE +/- 0.015, N = 6SE +/- 0.096, N = 5SE +/- 0.024, N = 6SE +/- 0.082, N = 5SE +/- 0.007, N = 6SE +/- 0.018, N = 6SE +/- 0.009, N = 6SE +/- 0.004, N = 6SE +/- 0.014, N = 5SE +/- 0.025, N = 5SE +/- 0.011, N = 5SE +/- 0.007, N = 56.8566.4587.5328.0367.62212.6177.74812.5786.9556.8577.5287.6458.8018.8488.9298.948

Helsing

Helsing is an open-source POSIX vampire number generator. This test profile measures the time it takes to generate vampire numbers between varying numbers of digits. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterHelsing 1.0-betaDigit Range: 14 digitXeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN306090120150SE +/- 0.07, N = 3SE +/- 0.08, N = 3SE +/- 0.26, N = 3SE +/- 0.06, N = 3SE +/- 0.53, N = 3SE +/- 0.11, N = 3SE +/- 0.12, N = 3SE +/- 0.42, N = 3SE +/- 0.42, N = 3SE +/- 0.14, N = 3SE +/- 0.10, N = 3SE +/- 0.38, N = 5SE +/- 0.02, N = 3SE +/- 0.32, N = 3SE +/- 0.27, N = 3SE +/- 0.06, N = 348.0989.0793.3550.83123.8365.03107.2458.2530.6956.9162.1733.6848.8526.78105.68120.561. (CC) gcc options: -O2 -pthread

Primesieve

Primesieve generates prime numbers using a highly optimized sieve of Eratosthenes implementation. Primesieve primarily benchmarks the CPU's L1/L2 cache performance. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterPrimesieve 12.1Length: 1e12Xeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN246810SE +/- 0.008, N = 11SE +/- 0.007, N = 8SE +/- 0.019, N = 8SE +/- 0.006, N = 10SE +/- 0.006, N = 7SE +/- 0.004, N = 9SE +/- 0.010, N = 7SE +/- 0.005, N = 10SE +/- 0.003, N = 12SE +/- 0.004, N = 11SE +/- 0.003, N = 11SE +/- 0.005, N = 12SE +/- 0.002, N = 11SE +/- 0.010, N = 15SE +/- 0.006, N = 8SE +/- 0.003, N = 82.1874.2504.5762.3256.1603.1215.3322.6911.1991.9842.0581.2421.9211.3593.8014.5451. (CXX) g++ options: -O3

OpenBenchmarking.orgSeconds, Fewer Is BetterPrimesieve 12.1Length: 1e13Xeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN1530456075SE +/- 0.04, N = 3SE +/- 0.04, N = 3SE +/- 0.04, N = 3SE +/- 0.01, N = 3SE +/- 0.07, N = 3SE +/- 0.04, N = 3SE +/- 0.04, N = 3SE +/- 0.07, N = 3SE +/- 0.02, N = 4SE +/- 0.02, N = 3SE +/- 0.02, N = 3SE +/- 0.01, N = 4SE +/- 0.02, N = 3SE +/- 0.01, N = 4SE +/- 0.02, N = 3SE +/- 0.01, N = 325.0248.4151.8227.1167.3233.9258.1630.2012.1323.2724.2412.6321.7611.5645.9554.391. (CXX) g++ options: -O3

Y-Cruncher

Y-Cruncher is a multi-threaded Pi benchmark capable of computing Pi to trillions of digits. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterY-Cruncher 0.8.3Pi Digits To Calculate: 500MXeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN1.16212.32423.48634.64845.8105SE +/- 0.004, N = 7SE +/- 0.008, N = 7SE +/- 0.003, N = 7SE +/- 0.002, N = 8SE +/- 0.010, N = 7SE +/- 0.064, N = 15SE +/- 0.023, N = 15SE +/- 0.074, N = 15SE +/- 0.007, N = 5SE +/- 0.003, N = 6SE +/- 0.003, N = 6SE +/- 0.003, N = 5SE +/- 0.005, N = 6SE +/- 0.015, N = 5SE +/- 0.006, N = 6SE +/- 0.008, N = 62.6593.3913.2672.3643.7813.1103.7042.9614.5104.3123.8504.3293.9684.1005.0775.165

OpenBenchmarking.orgSeconds, Fewer Is BetterY-Cruncher 0.8.3Pi Digits To Calculate: 1BXeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN3691215SE +/- 0.010, N = 6SE +/- 0.030, N = 5SE +/- 0.005, N = 5SE +/- 0.007, N = 6SE +/- 0.045, N = 5SE +/- 0.122, N = 15SE +/- 0.026, N = 5SE +/- 0.142, N = 12SE +/- 0.012, N = 4SE +/- 0.008, N = 4SE +/- 0.008, N = 5SE +/- 0.012, N = 4SE +/- 0.007, N = 4SE +/- 0.049, N = 4SE +/- 0.005, N = 4SE +/- 0.001, N = 45.1106.7017.0475.0088.3006.3347.9596.2668.9927.4716.7438.1966.9287.91510.20510.427

QMCPACK

QMCPACK is a modern high-performance open-source Quantum Monte Carlo (QMC) simulation code making use of MPI for this benchmark of the H20 example code. QMCPACK is an open-source production level many-body ab initio Quantum Monte Carlo code for computing the electronic structure of atoms, molecules, and solids. QMCPACK is supported by the U.S. Department of Energy. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgTotal Execution Time - Seconds, Fewer Is BetterQMCPACK 3.17.1Input: Li2_STO_aeXeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN306090120150SE +/- 0.93, N = 3SE +/- 1.03, N = 3SE +/- 0.89, N = 3SE +/- 1.11, N = 3SE +/- 1.20, N = 3SE +/- 0.88, N = 3SE +/- 1.04, N = 3SE +/- 1.11, N = 5SE +/- 0.06, N = 3SE +/- 1.06, N = 3SE +/- 0.54, N = 3SE +/- 0.23, N = 3SE +/- 0.63, N = 3SE +/- 0.42, N = 3SE +/- 1.13, N = 3SE +/- 0.40, N = 397.91105.98109.30101.63121.19102.12117.81106.2791.9797.00108.02102.98110.80111.15137.23151.271. (CXX) g++ options: -fopenmp -foffload=disable -finline-limit=1000 -fstrict-aliasing -funroll-all-loops -ffast-math -march=native -O3 -lm -ldl

301 Results Shown

CPU Power Consumption Monitor:
  Phoronix Test Suite System Monitoring
  CPU - 64 - ResNet-50
  CPU - 64 - ResNet-152
  CPU - 256 - ResNet-50
  CPU - 256 - ResNet-152
  CPU - 512 - ResNet-50
PyTorch:
  CPU - 64 - ResNet-50
  CPU - 64 - ResNet-152
  CPU - 256 - ResNet-50
  CPU - 512 - ResNet-50
  CPU - 512 - ResNet-152
  CPU - 256 - ResNet-152
miniBUDE:
  OpenMP - BM1
  OpenMP - BM2
miniBUDE:
  OpenMP - BM1
  OpenMP - BM2
OpenSSL:
  SHA256
  SHA512
OpenSSL:
  AES-128-GCM
  AES-256-GCM
  ChaCha20
OpenSSL
OpenSSL
OpenSSL:
  AES-256-GCM
  ChaCha20
  ChaCha20-Poly1305
miniFE
miniFE
Algebraic Multi-Grid Benchmark
Algebraic Multi-Grid Benchmark
FFmpeg:
  libx265 - Platform
  libx265 - Video On Demand
FFmpeg:
  libx265 - Upload
  libx265 - Platform
  libx265 - Video On Demand
OpenVINO:
  Face Detection FP16-INT8 - CPU
  Age Gender Recognition Retail 0013 FP16-INT8 - CPU
  Person Detection FP16 - CPU
  Weld Porosity Detection FP16-INT8 - CPU
  Vehicle Detection FP16-INT8 - CPU
  Person Vehicle Bike Detection FP16 - CPU
  Machine Translation EN To DE FP16 - CPU
  Face Detection Retail FP16-INT8 - CPU
  Handwritten English Recognition FP16-INT8 - CPU
  Road Segmentation ADAS FP16-INT8 - CPU
  Person Re-Identification Retail FP16 - CPU
  Noise Suppression Poconet-Like FP16 - CPU
Kvazaar:
  Bosphorus 4K - Slow
  Bosphorus 4K - Medium
  Bosphorus 4K - Very Fast
uvg266:
  Bosphorus 4K - Slow
  Bosphorus 4K - Medium
  Bosphorus 4K - Very Fast
VVenC:
  Bosphorus 4K - Fast
  Bosphorus 4K - Faster
Embree
Embree
SVT-AV1:
  Preset 13 - Bosphorus 4K
  Preset 12 - Bosphorus 4K
Embree:
  Pathtracer ISPC - Asian Dragon Obj
  Pathtracer ISPC - Crown
SVT-AV1:
  Preset 8 - Bosphorus 4K
  Preset 4 - Bosphorus 4K
x265
Embree:
  Pathtracer ISPC - Asian Dragon Obj
  Pathtracer ISPC - Crown
miniBUDE:
  OpenMP - BM1
  OpenMP - BM2
ACES DGEMM
ACES DGEMM
High Performance Conjugate Gradient
High Performance Conjugate Gradient
Xmrig
Xmrig
Intel Open Image Denoise:
  RT.hdr_alb_nrm.3840x2160 - CPU-Only
  RT.ldr_alb_nrm.3840x2160 - CPU-Only
  RTLightmap.hdr.4096x4096 - CPU-Only
Intel Open Image Denoise:
  RT.hdr_alb_nrm.3840x2160 - CPU-Only
  RT.ldr_alb_nrm.3840x2160 - CPU-Only
  RTLightmap.hdr.4096x4096 - CPU-Only
TensorFlow
TensorFlow:
  CPU - 64 - ResNet-50
  CPU - 64 - AlexNet
  CPU - 64 - GoogLeNet
  CPU - 256 - ResNet-50
  CPU - 256 - AlexNet
TensorFlow:
  CPU - 64 - ResNet-50
  CPU - 64 - AlexNet
  CPU - 64 - GoogLeNet
TensorFlow
TensorFlow:
  CPU - 256 - ResNet-50
  CPU - 256 - AlexNet
  CPU - 256 - GoogLeNet
  CPU - 512 - ResNet-50
TensorFlow
TensorFlow
ONNX Runtime:
  yolov4 - CPU - Standard
  yolov4 - CPU - Parallel
  fcn-resnet101-11 - CPU - Standard
  fcn-resnet101-11 - CPU - Parallel
  super-resolution-10 - CPU - Standard
  super-resolution-10 - CPU - Parallel
  bertsquad-12 - CPU - Standard
  bertsquad-12 - CPU - Parallel
  GPT-2 - CPU - Standard
  GPT-2 - CPU - Parallel
  ArcFace ResNet-100 - CPU - Standard
  ArcFace ResNet-100 - CPU - Parallel
  ResNet50 v1-12-int8 - CPU - Standard
  ResNet50 v1-12-int8 - CPU - Parallel
  CaffeNet 12-int8 - CPU - Standard
  CaffeNet 12-int8 - CPU - Parallel
  Faster R-CNN R-50-FPN-int8 - CPU - Standard
  Faster R-CNN R-50-FPN-int8 - CPU - Parallel
  T5 Encoder - CPU - Standard
  T5 Encoder - CPU - Parallel
OpenVKL
OpenVKL
OSPRay:
  gravity_spheres_volume/dim_512/pathtracer/real_time
  particle_volume/ao/real_time
  particle_volume/scivis/real_time
OSPRay:
  gravity_spheres_volume/dim_512/pathtracer/real_time
  particle_volume/ao/real_time
  particle_volume/scivis/real_time
GraphicsMagick
GraphicsMagick:
  Noise-Gaussian
  Enhanced
  Sharpen
  Swirl
Coremark
Aircrack-ng
Aircrack-ng
LuxCoreRender
LuxCoreRender:
  LuxCore Benchmark - CPU
  Orange Juice - CPU
  DLSC - CPU
SecureMark
SecureMark
Zstd Compression
Zstd Compression
Zstd Compression:
  19 - Decompression Speed
  19, Long Mode - Decompression Speed
  19, Long Mode - Compression Speed
srsRAN Project
srsRAN Project:
  PUSCH Processor Benchmark, Throughput Thread
  PDSCH Processor Benchmark, Throughput Total
  PDSCH Processor Benchmark, Throughput Thread
srsRAN Project:
  PUSCH Processor Benchmark, Throughput Thread
  PDSCH Processor Benchmark, Throughput Total
  PDSCH Processor Benchmark, Throughput Thread
QuantLib
QuantLib:
  Single-Threaded
  Multi-Threaded
ASKAP
7-Zip Compression
7-Zip Compression:
  Compression Rating
  Decompression Rating
WebP Image Encode:
  Quality 100, Highest Compression
  Quality 100, Lossless, Highest Compression
WebP Image Encode:
  Quality 100, Highest Compression
  Quality 100, Lossless, Highest Compression
ASKAP
ASKAP
ASKAP
ASTC Encoder
ASTC Encoder
ASTC Encoder
ASTC Encoder
ASTC Encoder:
  Thorough
  Exhaustive
Stockfish
GROMACS
LAMMPS Molecular Dynamics Simulator:
  Rhodopsin Protein
  20k Atoms
NAMD:
  ATPase with 327,506 Atoms
  STMV with 1,066,628 Atoms
NAMD:
  ATPase with 327,506 Atoms
  STMV with 1,066,628 Atoms
RocksDB
Speedb
RocksDB
Speedb:
  Rand Read
  Read While Writing
Memcached
Memcached
Apache IoTDB:
  500 - 100 - 800 - 400
  800 - 100 - 800 - 100
ClickHouse
ClickHouse:
  100M Rows Hits Dataset, First Run / Cold Cache
  100M Rows Hits Dataset, Second Run
  100M Rows Hits Dataset, Third Run
John The Ripper:
  Blowfish
  bcrypt
John The Ripper
John The Ripper
Liquid-DSP
Liquid-DSP:
  1 - 256 - 32
  1 - 256 - 57
  1 - 256 - 512
  64 - 256 - 32
  64 - 256 - 57
Liquid-DSP:
  256 - 256 - 32
  256 - 256 - 57
  256 - 256 - 512
Liquid-DSP:
  64 - 256 - 512
  128 - 256 - 32
  128 - 256 - 57
  128 - 256 - 512
  256 - 256 - 32
  256 - 256 - 512
  256 - 256 - 57
Numpy Benchmark
Numpy Benchmark
OpenSSL
Llamafile
Llamafile:
  llava-v1.5-7b-q4 - CPU
  wizardcoder-python-34b-v1.0.Q6_K - CPU
NAS Parallel Benchmarks:
  EP.D
  LU.C
  SP.C
  IS.D
  MG.C
  CG.C
PostgreSQL:
  100 - 1000 - Read Write
  100 - 1000 - Read Only
OpenSSL
BRL-CAD
Google SynthMark
LULESH
LULESH
Apache IoTDB:
  500 - 100 - 800 - 400
  800 - 100 - 800 - 100
Pennant:
  leblancbig
  sedovbig
PyBench
PostgreSQL:
  100 - 1000 - Read Write - Average Latency
  100 - 1000 - Read Only - Average Latency
OSPRay Studio:
  1 - 4K - 1 - Path Tracer - CPU
  1 - 4K - 16 - Path Tracer - CPU
  1 - 4K - 32 - Path Tracer - CPU
  3 - 4K - 1 - Path Tracer - CPU
  3 - 4K - 16 - Path Tracer - CPU
  3 - 4K - 32 - Path Tracer - CPU
OpenVINO:
  Face Detection FP16-INT8 - CPU
  Age Gender Recognition Retail 0013 FP16-INT8 - CPU
  Person Detection FP16 - CPU
  Weld Porosity Detection FP16-INT8 - CPU
  Vehicle Detection FP16-INT8 - CPU
  Person Vehicle Bike Detection FP16 - CPU
  Machine Translation EN To DE FP16 - CPU
  Face Detection Retail FP16-INT8 - CPU
  Handwritten English Recognition FP16-INT8 - CPU
  Road Segmentation ADAS FP16-INT8 - CPU
  Person Re-Identification Retail FP16 - CPU
  Noise Suppression Poconet-Like FP16 - CPU
oneDNN
Timed Linux Kernel Compilation:
  defconfig
  allmodconfig
Timed FFmpeg Compilation
Timed Godot Game Engine Compilation
Timed Node.js Compilation
Timed Gem5 Compilation
Timed LLVM Compilation
Timed Mesa Compilation
Timed ImageMagick Compilation
WRF
RELION
m-queens
CloverLeaf:
  clover_bm64_short
  clover_bm16
GPAW
NWChem
Xcompact3d Incompact3d:
  input.i3d 193 Cells Per Direction
  X3D-benchmarking input.i3d
OpenFOAM:
  drivaerFastback, Small Mesh Size - Mesh Time
  drivaerFastback, Small Mesh Size - Execution Time
  drivaerFastback, Medium Mesh Size - Mesh Time
  drivaerFastback, Medium Mesh Size - Execution Time
OpenRadioss:
  Cell Phone Drop Test
  INIVOL and Fluid Structure Interaction Drop Container
  Chrysler Neon 1M
Blender:
  BMW27 - CPU-Only
  Classroom - CPU-Only
  Fishy Cat - CPU-Only
  Pabellon Barcelona - CPU-Only
  Barbershop - CPU-Only
  Junkshop - CPU-Only
Appleseed
Parallel BZIP2 Compression
libavif avifenc:
  0
  2
  6
  6, Lossless
  10, Lossless
GNU Octave Benchmark
Helsing
Primesieve:
  1e12
  1e13
Y-Cruncher:
  500M
  1B
QMCPACK