Linux 6.9 + Ubuntu 22.04 Intel AMD Server CPU Benchmarks

Benchmarks by Michael Larabel for a future article.

Compare your own system(s) to this result file with the Phoronix Test Suite by running the command: phoronix-test-suite benchmark 2405207-NE-LINUX69SE55
Jump To Table - Results

View

Do Not Show Noisy Results
Do Not Show Results With Incomplete Data
Do Not Show Results With Little Change/Spread
List Notable Results

Limit displaying results to tests within:

AV1 2 Tests
BLAS (Basic Linear Algebra Sub-Routine) Tests 4 Tests
C++ Boost Tests 5 Tests
Chess Test Suite 2 Tests
Timed Code Compilation 8 Tests
C/C++ Compiler Tests 16 Tests
Compression Tests 3 Tests
CPU Massive 25 Tests
Creator Workloads 23 Tests
Cryptography 5 Tests
Database Test Suite 5 Tests
Encoding 7 Tests
Fortran Tests 7 Tests
Game Development 5 Tests
HPC - High Performance Computing 29 Tests
Imaging 3 Tests
Common Kernel Benchmarks 3 Tests
LAPACK (Linear Algebra Pack) Tests 3 Tests
Linear Algebra 2 Tests
Machine Learning 7 Tests
Molecular Dynamics 10 Tests
MPI Benchmarks 10 Tests
Multi-Core 44 Tests
NVIDIA GPU Compute 3 Tests
Intel oneAPI 7 Tests
OpenMPI Tests 18 Tests
Programmer / Developer System Benchmarks 12 Tests
Python 2 Tests
Raytracing 2 Tests
Renderers 5 Tests
Scientific Computing 15 Tests
Software Defined Radio 2 Tests
Server 7 Tests
Server CPU Tests 17 Tests
Single-Threaded 2 Tests
Video Encoding 7 Tests
Common Workstation Benchmarks 3 Tests

Statistics

Show Overall Harmonic Mean(s)
Show Overall Geometric Mean
Show Geometric Means Per-Suite/Category
Show Wins / Losses Counts (Pie Chart)
Normalize Results
Remove Outliers Before Calculating Averages

Graph Settings

Force Line Graphs Where Applicable
Convert To Scalar Where Applicable
Disable Color Branding
Prefer Vertical Bar Graphs
No Box Plots
On Line Graphs With Missing Data, Connect The Line Gaps

Additional Graphs

Show Perf Per Core/Thread Calculation Graphs Where Applicable
Show Perf Per Clock Calculation Graphs Where Applicable
Show Perf Per RAM Channel Calculation Graphs Where Applicable

Multi-Way Comparison

Condense Multi-Option Tests Into Single Result Graphs
Condense Test Profiles With Multiple Version Results Into Single Result Graphs

Table

Show Detailed System Result Table

Run Management

Highlight
Result
Hide
Result
Result
Identifier
Performance Per
Dollar
Date
Run
  Test
  Duration
EPYC 8534P
May 18
  1 Day, 2 Hours, 46 Minutes
EPYC 8534PN
May 19
  1 Day, 3 Hours, 27 Minutes
EPYC 9654
May 13
  1 Day, 1 Hour, 28 Minutes
EPYC 9654 2P
May 14
  1 Day, 5 Hours, 21 Minutes
EPYC 9684X
May 12
  23 Hours, 34 Minutes
EPYC 9684X 2P
May 11
  1 Day, 3 Hours, 52 Minutes
EPYC 9754
May 15
  1 Day, 5 Hours, 27 Minutes
EPYC 9754 2P
May 17
  1 Day, 8 Hours, 26 Minutes
Xeon Max 9468
April 21
  1 Day, 3 Hours, 35 Minutes
Xeon Max 9468 2P
April 22
  1 Day, 22 Minutes
Xeon Max 9480
April 26
  1 Day, 1 Hour, 29 Minutes
Xeon Max 9480 2P
April 27
  1 Day, 6 Hours, 2 Minutes
Xeon Platinum 8490H
April 16
  22 Hours, 13 Minutes
Xeon Platinum 8490H 2P
April 17
  22 Hours, 41 Minutes
Xeon Platinum 8592+
April 11
  22 Hours, 1 Minute
Xeon Platinum 8592+ 2P
April 08
  23 Hours, 31 Minutes
Invert Hiding All Results Option
  1 Day, 2 Hours, 16 Minutes

Only show results where is faster than
Only show results matching title/arguments (delimit multiple options with a comma):
Do not show results matching title/arguments (delimit multiple options with a comma):


Linux 6.9 + Ubuntu 22.04 Intel AMD Server CPU BenchmarksProcessorMotherboardChipsetMemoryDiskGraphicsNetworkOSKernelCompilerFile-SystemScreen ResolutionEPYC 8534PEPYC 8534PNEPYC 9654EPYC 9654 2PEPYC 9684XEPYC 9684X 2PEPYC 9754EPYC 9754 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PXeon Platinum 8490HXeon Platinum 8490H 2PXeon Platinum 8592+Xeon Platinum 8592+ 2PAMD EPYC 8534P 64-Core @ 2.30GHz (64 Cores / 128 Threads)AMD Cinnabar (RCB1009C BIOS)AMD Device 14a46 x 32GB DDR5-4800MT/s Samsung M321R4GA0BB0-CQKMG2 x 1920GB KIOXIA KCD8XPUG1T92 + 2000GB Corsair MP700 PROASPEED2 x Broadcom NetXtreme BCM5720 PCIeUbuntu 24.046.9.0-060900rc3-generic (x86_64)GCC 13.2.0ext41920x1200AMD EPYC 8534PN 64-Core @ 2.00GHz (64 Cores / 128 Threads)2 x 1920GB KIOXIA KCD8XPUG1T92AMD EPYC 9654 96-Core @ 2.40GHz (96 Cores / 192 Threads)AMD Titanite_4G (RTI1007B BIOS)12 x 64GB DDR5-4800MT/s Samsung M321R8GA0BB0-CQKEGBroadcom NetXtreme BCM5720 PCIe2 x AMD EPYC 9654 96-Core @ 2.40GHz (192 Cores / 384 Threads)1520GBAMD EPYC 9684X 96-Core @ 2.55GHz (96 Cores / 192 Threads)12 x 64GB DDR5-4800MT/s Samsung M321R8GA0BB0-CQKEG2 x AMD EPYC 9684X 96-Core @ 2.55GHz (192 Cores / 384 Threads)1520GBAMD EPYC 9754 128-Core @ 2.25GHz (128 Cores / 256 Threads)12 x 64GB DDR5-4800MT/s Samsung M321R8GA0BB0-CQKEG2 x AMD EPYC 9754 128-Core @ 2.25GHz (256 Cores / 512 Threads)1520GBIntel Xeon Max 9468 @ 3.50GHz (48 Cores / 96 Threads)Quanta Cloud QuantaGrid D54Q-2U S6Q-MB-MPS (3B05.TEL4P1 BIOS)Intel Device 1bce576GB2 x Intel Xeon Max 9468 @ 3.50GHz (96 Cores / 192 Threads)1136GB2 x Intel X710 for 10GBASE-TIntel Xeon Max 9480 @ 3.50GHz (56 Cores / 112 Threads)576GB2 x Intel Xeon Max 9480 @ 3.50GHz (112 Cores / 224 Threads)1136GB2 x Intel X710 for 10GBASE-TIntel Xeon Platinum 8490H @ 3.50GHz (60 Cores / 120 Threads)512GB2 x Intel Xeon Platinum 8490H @ 3.50GHz (120 Cores / 240 Threads)1008GB2 x Intel X710 for 10GBASE-TINTEL XEON PLATINUM 8592+ @ 3.90GHz (64 Cores / 128 Threads)512GB2 x INTEL XEON PLATINUM 8592+ @ 3.90GHz (128 Cores / 256 Threads)1008GB2 x Intel X710 for 10GBASE-TOpenBenchmarking.orgKernel Details- Transparent Huge Pages: madviseCompiler Details- --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-backtrace --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-defaulted --enable-offload-targets=nvptx-none=/build/gcc-13-OiuXZC/gcc-13-13.2.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-13-OiuXZC/gcc-13-13.2.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -vProcessor Details- EPYC 8534P: Scaling Governor: acpi-cpufreq performance (Boost: Enabled) - CPU Microcode: 0xaa00213- EPYC 8534PN: Scaling Governor: acpi-cpufreq performance (Boost: Enabled) - CPU Microcode: 0xaa00213- EPYC 9654: Scaling Governor: acpi-cpufreq performance (Boost: Enabled) - CPU Microcode: 0xa101144- EPYC 9654 2P: Scaling Governor: acpi-cpufreq performance (Boost: Enabled) - CPU Microcode: 0xa101144- EPYC 9684X: Scaling Governor: acpi-cpufreq performance (Boost: Enabled) - CPU Microcode: 0xa101144- EPYC 9684X 2P: Scaling Governor: acpi-cpufreq performance (Boost: Enabled) - CPU Microcode: 0xa101144- EPYC 9754: Scaling Governor: acpi-cpufreq performance (Boost: Enabled) - CPU Microcode: 0xaa00116- EPYC 9754 2P: Scaling Governor: acpi-cpufreq performance (Boost: Enabled) - CPU Microcode: 0xaa00116- Xeon Max 9468: Scaling Governor: intel_pstate performance (EPP: performance) - CPU Microcode: 0x2c000290- Xeon Max 9468 2P: Scaling Governor: intel_pstate performance (EPP: performance) - CPU Microcode: 0x2c000290- Xeon Max 9480: Scaling Governor: intel_pstate performance (EPP: performance) - CPU Microcode: 0x2c000290- Xeon Max 9480 2P: Scaling Governor: intel_pstate performance (EPP: performance) - CPU Microcode: 0x2c000290- Xeon Platinum 8490H: Scaling Governor: intel_pstate performance (EPP: performance) - CPU Microcode: 0x2b000590- Xeon Platinum 8490H 2P: Scaling Governor: intel_pstate performance (EPP: performance) - CPU Microcode: 0x2b000590- Xeon Platinum 8592+: Scaling Governor: intel_pstate performance (EPP: performance) - CPU Microcode: 0x21000200- Xeon Platinum 8592+ 2P: Scaling Governor: intel_pstate performance (EPP: performance) - CPU Microcode: 0x21000200Java Details- OpenJDK Runtime Environment (build 21.0.3-ea+7-Ubuntu-1build1)Python Details- Python 3.12.2Security Details- EPYC 8534P: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + reg_file_data_sampling: Not affected + retbleed: Not affected + spec_rstack_overflow: Mitigation of Safe RET + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional STIBP: always-on RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected- EPYC 8534PN: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + reg_file_data_sampling: Not affected + retbleed: Not affected + spec_rstack_overflow: Mitigation of Safe RET + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional STIBP: always-on RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected- EPYC 9654: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + reg_file_data_sampling: Not affected + retbleed: Not affected + spec_rstack_overflow: Mitigation of Safe RET + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional STIBP: always-on RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected- EPYC 9654 2P: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + reg_file_data_sampling: Not affected + retbleed: Not affected + spec_rstack_overflow: Mitigation of Safe RET + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional STIBP: always-on RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected- EPYC 9684X: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + reg_file_data_sampling: Not affected + retbleed: Not affected + spec_rstack_overflow: Mitigation of Safe RET + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional STIBP: always-on RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected- EPYC 9684X 2P: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + reg_file_data_sampling: Not affected + retbleed: Not affected + spec_rstack_overflow: Mitigation of Safe RET + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional STIBP: always-on RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected- EPYC 9754: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + reg_file_data_sampling: Not affected + retbleed: Not affected + spec_rstack_overflow: Mitigation of Safe RET + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional STIBP: always-on RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected- EPYC 9754 2P: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + reg_file_data_sampling: Not affected + retbleed: Not affected + spec_rstack_overflow: Mitigation of Safe RET + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional STIBP: always-on RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected- Xeon Max 9468: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + reg_file_data_sampling: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Not affected- Xeon Max 9468 2P: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + reg_file_data_sampling: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Not affected- Xeon Max 9480: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + reg_file_data_sampling: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Not affected- Xeon Max 9480 2P: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + reg_file_data_sampling: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Not affected- Xeon Platinum 8490H: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + reg_file_data_sampling: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Not affected- Xeon Platinum 8490H 2P: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + reg_file_data_sampling: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Not affected- Xeon Platinum 8592+: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + reg_file_data_sampling: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Not affected- Xeon Platinum 8592+ 2P: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + reg_file_data_sampling: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Not affected

EPYC 8534PEPYC 8534PNEPYC 9654EPYC 9654 2PEPYC 9684XEPYC 9684X 2PEPYC 9754EPYC 9754 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PXeon Platinum 8490HXeon Platinum 8490H 2PXeon Platinum 8592+Xeon Platinum 8592+ 2PLogarithmic Result OverviewPhoronix Test SuiteBRL-CADNAMDXmrigStockfishJohn The RipperASKAPPrimesieveRELIONm-queensCoremarkOpenSSLSpeedbHelsingBlenderNAS Parallel BenchmarksPennantOSPRay StudioLlamafileXcompact3d Incompact3dPyTorchACES DGEMMLULESHRocksDBminiBUDE7-Zip CompressionAlgebraic Multi-Grid BenchmarkWRFGROMACSOSPRayOpenVKLEmbreePostgreSQLASTC EncoderminiFEHigh Performance Conjugate GradientIntel Open Image DenoiseoneDNNKvazaarOpenRadiossOpenVINOGPAWMemcachedONNX RuntimeTimed Node.js CompilationOpenFOAMParallel BZIP2 CompressionLAMMPS Molecular Dynamics SimulatorLuxCoreRenderTimed LLVM Compilationuvg266CloverLeafQuantLibY-CruncherGraphicsMagickTimed Linux Kernel CompilationGNU Octave BenchmarkTensorFlowClickHouseNWChemLiquid-DSPApache IoTDBTimed Godot Game Engine CompilationQMCPACKTimed FFmpeg CompilationTimed Gem5 CompilationTimed ImageMagick CompilationsrsRAN ProjectSVT-AV1x265PyBenchTimed Mesa CompilationNumpy Benchmarklibavif avifencZstd CompressionSecureMarkFFmpegGoogle SynthMarkWebP Image Encode

EPYC 8534PEPYC 8534PNEPYC 9654EPYC 9654 2PEPYC 9684XEPYC 9684X 2PEPYC 9754EPYC 9754 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PXeon Platinum 8490HXeon Platinum 8490H 2PXeon Platinum 8592+Xeon Platinum 8592+ 2PLogarithmic Per Watt Result OverviewPhoronix Test SuiteminiFEMemcachedWebP Image EncodePyTorchZstd CompressionSVT-AV1FFmpegsrsRAN ProjectNumpy Benchmarkx265Google SynthMarkminiBUDE7-Zip CompressionKvazaarSecureMarkuvg266LuxCoreRenderClickHouseACES DGEMMLiquid-DSPRocksDBSpeedbGraphicsMagickASKAPEmbreeOpenVKLQuantLibASTC EncoderTensorFlowJohn The RipperLAMMPS Molecular Dynamics SimulatorStockfishCoremarkNAS Parallel BenchmarksOSPRayXmrigHigh Performance Conjugate GradientOpenSSLGROMACSIntel Open Image DenoiseAlgebraic Multi-Grid BenchmarkLlamafileBRL-CADNAMDLULESHP.W.G.MP.W.G.MP.W.G.MP.W.G.MP.W.G.MP.W.G.MP.W.G.MP.W.G.MP.W.G.MP.W.G.MP.W.G.MP.W.G.MP.W.G.MP.W.G.MP.W.G.MP.W.G.MP.W.G.MP.W.G.MP.W.G.MP.W.G.MP.W.G.MP.W.G.MP.W.G.MP.W.G.MP.W.G.MP.W.G.MP.W.G.MP.W.G.MP.W.G.MP.W.G.MP.W.G.MP.W.G.MP.W.G.MP.W.G.MP.W.G.MP.W.G.MP.W.G.MP.W.G.MP.W.G.MP.W.G.MP.W.G.MP.W.G.MP.W.G.MP.W.G.MP.W.G.M

Linux 6.9 + Ubuntu 22.04 Intel AMD Server CPU Benchmarkswrf: conus 2.5kmopenvkl: vklBenchmarkCPU ISPCnwchem: C240 Buckyballhpcg: 144 144 144 - 60relion: Basic - CPUbrl-cad: VGR Performance Metricincompact3d: X3D-benchmarking input.i3daskap: tConvolve MT - Griddingcloverleaf: clover_bm16tensorflow: CPU - 512 - ResNet-50pgbench: 100 - 1000 - Read Only - Average Latencypgbench: 100 - 1000 - Read Onlytensorflow: CPU - 256 - ResNet-50pytorch: CPU - 512 - ResNet-152pytorch: CPU - 256 - ResNet-152stockfish: Chess Benchmarkopenssl: RSA4096openssl: RSA4096pytorch: CPU - 64 - ResNet-152apache-iotdb: 800 - 100 - 800 - 100apache-iotdb: 800 - 100 - 800 - 100build-linux-kernel: allmodconfigsecuremark: SecureMark-TLSclickhouse: 100M Rows Hits Dataset, Third Runclickhouse: 100M Rows Hits Dataset, Second Runclickhouse: 100M Rows Hits Dataset, First Run / Cold Cacheapache-iotdb: 500 - 100 - 800 - 400apache-iotdb: 500 - 100 - 800 - 400openradioss: Chrysler Neon 1Mbuild-gem5: Time To Compilenamd: STMV with 1,066,628 Atomsonnx: fcn-resnet101-11 - CPU - Standardonnx: fcn-resnet101-11 - CPU - Standardlammps: 20k Atomstensorflow: CPU - 512 - GoogLeNetluxcorerender: DLSC - CPUbuild-nodejs: Time To Compilepgbench: 100 - 1000 - Read Write - Average Latencypgbench: 100 - 1000 - Read Writeonnx: Faster R-CNN R-50-FPN-int8 - CPU - Standardonnx: Faster R-CNN R-50-FPN-int8 - CPU - Standardopenssl: AES-128-GCMopenssl: AES-256-GCMopenssl: SHA512openssl: ChaCha20openssl: SHA256openssl: ChaCha20-Poly1305luxcorerender: Orange Juice - CPUonnx: ResNet50 v1-12-int8 - CPU - Standardonnx: ResNet50 v1-12-int8 - CPU - Standardffmpeg: libx265 - Uploadblender: Barbershop - CPU-Onlyffmpeg: libx265 - Video On Demandffmpeg: libx265 - Platformrocksdb: Read While Writingpytorch: CPU - 512 - ResNet-50onnx: ArcFace ResNet-100 - CPU - Standardonnx: ArcFace ResNet-100 - CPU - Standardospray: particle_volume/scivis/real_timenumpy: luxcorerender: LuxCore Benchmark - CPUpytorch: CPU - 256 - ResNet-50onnx: CaffeNet 12-int8 - CPU - Standardonnx: CaffeNet 12-int8 - CPU - Standardopenfoam: drivaerFastback, Medium Mesh Size - Execution Timeopenfoam: drivaerFastback, Medium Mesh Size - Mesh Timebuild-llvm: Ninjaspeedb: Read While Writingllamafile: wizardcoder-python-34b-v1.0.Q6_K - CPUopenvino: Person Detection FP16 - CPUopenvino: Person Detection FP16 - CPUonnx: CaffeNet 12-int8 - CPU - Parallelonnx: CaffeNet 12-int8 - CPU - Parallelpytorch: CPU - 64 - ResNet-50onnx: yolov4 - CPU - Standardonnx: yolov4 - CPU - Standardopenradioss: INIVOL and Fluid Structure Interaction Drop Containeronnx: fcn-resnet101-11 - CPU - Parallelonnx: fcn-resnet101-11 - CPU - Parallelbuild-godot: Time To Compileonnx: bertsquad-12 - CPU - Standardonnx: bertsquad-12 - CPU - Standardtensorflow: CPU - 256 - GoogLeNetcompress-zstd: 19 - Decompression Speedcompress-zstd: 19 - Compression Speedqmcpack: Li2_STO_aespeedb: Rand Readospray: particle_volume/ao/real_timexmrig: GhostRider - 1Monnx: GPT-2 - CPU - Standardonnx: GPT-2 - CPU - Standardopenvino: Age Gender Recognition Retail 0013 FP16-INT8 - CPUopenvino: Age Gender Recognition Retail 0013 FP16-INT8 - CPUonnx: T5 Encoder - CPU - Standardonnx: T5 Encoder - CPU - Standardvvenc: Bosphorus 4K - Fastonnx: super-resolution-10 - CPU - Standardonnx: super-resolution-10 - CPU - Standardcompress-zstd: 19, Long Mode - Decompression Speedcompress-zstd: 19, Long Mode - Compression Speednamd: ATPase with 327,506 Atomsonnx: ResNet50 v1-12-int8 - CPU - Parallelonnx: ResNet50 v1-12-int8 - CPU - Parallelonnx: T5 Encoder - CPU - Parallelonnx: T5 Encoder - CPU - Parallelopenvino: Noise Suppression Poconet-Like FP16 - CPUopenvino: Noise Suppression Poconet-Like FP16 - CPUcloverleaf: clover_bm64_shortospray-studio: 3 - 4K - 32 - Path Tracer - CPUtensorflow: CPU - 64 - ResNet-50memcached: 1:100askap: tConvolve MPI - Griddingaskap: tConvolve MPI - Degriddingopenvino: Machine Translation EN To DE FP16 - CPUopenvino: Machine Translation EN To DE FP16 - CPUopenvino: Road Segmentation ADAS FP16-INT8 - CPUopenvino: Road Segmentation ADAS FP16-INT8 - CPUopenvino: Vehicle Detection FP16-INT8 - CPUopenvino: Vehicle Detection FP16-INT8 - CPUospray-studio: 1 - 4K - 32 - Path Tracer - CPUhelsing: 14 digitavifenc: 0ospray-studio: 3 - 4K - 1 - Path Tracer - CPUonnx: Faster R-CNN R-50-FPN-int8 - CPU - Parallelonnx: Faster R-CNN R-50-FPN-int8 - CPU - Parallelospray-studio: 3 - 4K - 16 - Path Tracer - CPUospray-studio: 1 - 4K - 16 - Path Tracer - CPUospray-studio: 1 - 4K - 1 - Path Tracer - CPUquantlib: Multi-Threadedospray: gravity_spheres_volume/dim_512/pathtracer/real_timeopenvino: Face Detection FP16-INT8 - CPUopenvino: Face Detection FP16-INT8 - CPUonnx: bertsquad-12 - CPU - Parallelonnx: bertsquad-12 - CPU - Parallelopenvino: Person Vehicle Bike Detection FP16 - CPUopenvino: Person Vehicle Bike Detection FP16 - CPUopenvino: Person Re-Identification Retail FP16 - CPUopenvino: Person Re-Identification Retail FP16 - CPUopenvino: Weld Porosity Detection FP16-INT8 - CPUopenvino: Weld Porosity Detection FP16-INT8 - CPUonnx: GPT-2 - CPU - Parallelonnx: GPT-2 - CPU - Parallelopenvino: Face Detection Retail FP16-INT8 - CPUopenvino: Face Detection Retail FP16-INT8 - CPUonnx: yolov4 - CPU - Parallelonnx: yolov4 - CPU - Parallelopenvino: Handwritten English Recognition FP16-INT8 - CPUopenvino: Handwritten English Recognition FP16-INT8 - CPUsrsran: PDSCH Processor Benchmark, Throughput Totalonnx: ArcFace ResNet-100 - CPU - Parallelonnx: ArcFace ResNet-100 - CPU - Parallelgpaw: Carbon Nanotubeblender: Pabellon Barcelona - CPU-Onlygraphics-magick: Noise-Gaussiangraphics-magick: Sharpengraphics-magick: Enhancedonnx: super-resolution-10 - CPU - Parallelonnx: super-resolution-10 - CPU - Parallelgraphics-magick: Swirlrocksdb: Rand Readaircrack-ng: build-linux-kernel: defconfigblender: Classroom - CPU-Onlyminibude: OpenMP - BM2minibude: OpenMP - BM2liquid-dsp: 1 - 256 - 512webp: Quality 100, Lossless, Highest Compressiontensorflow: CPU - 512 - AlexNetcoremark: CoreMark Size 666 - Iterations Per Secondcompress-7zip: Decompression Ratingcompress-7zip: Compression Ratinglulesh: srsran: PUSCH Processor Benchmark, Throughput Totalnpb: EP.Damg: minife: Smallopenradioss: Cell Phone Drop Testjohn-the-ripper: WPA PSKavifenc: 2vvenc: Bosphorus 4K - Fastergromacs: MPI CPU - water_GMX50_bareastcenc: Very Thoroughllamafile: llava-v1.5-7b-q4 - CPUprimesieve: 1e13liquid-dsp: 1 - 256 - 57liquid-dsp: 64 - 256 - 512embree: Pathtracer ISPC - Asian Dragon Objsvt-av1: Preset 13 - Bosphorus 4Kliquid-dsp: 1 - 256 - 32liquid-dsp: 64 - 256 - 57liquid-dsp: 128 - 256 - 512quantlib: Single-Threadedtensorflow: CPU - 256 - AlexNetastcenc: Exhaustivejohn-the-ripper: bcryptliquid-dsp: 256 - 256 - 512liquid-dsp: 128 - 256 - 57john-the-ripper: Blowfishliquid-dsp: 256 - 256 - 57liquid-dsp: 256 - 256 - 32liquid-dsp: 128 - 256 - 32liquid-dsp: 64 - 256 - 32synthmark: VoiceMark_100tensorflow: CPU - 64 - GoogLeNetuvg266: Bosphorus 4K - Slowuvg266: Bosphorus 4K - Mediumappleseed: Disney Materialblender: Junkshop - CPU-Onlysvt-av1: Preset 4 - Bosphorus 4Kblender: Fishy Cat - CPU-Onlypennant: sedovbigkvazaar: Bosphorus 4K - Mediumkvazaar: Bosphorus 4K - Slowopenfoam: drivaerFastback, Small Mesh Size - Execution Timeopenfoam: drivaerFastback, Small Mesh Size - Mesh Timepennant: leblancbigoidn: RTLightmap.hdr.4096x4096 - CPU-Onlyuvg266: Bosphorus 4K - Very Fasttensorflow: CPU - 64 - AlexNetblender: BMW27 - CPU-Onlybuild-ffmpeg: Time To Compilenpb: LU.Castcenc: Thoroughnpb: IS.Dsvt-av1: Preset 8 - Bosphorus 4Kx265: Bosphorus 4Knpb: SP.Cy-cruncher: 1Bpybench: Total For Average Test Timesincompact3d: input.i3d 193 Cells Per Directionminibude: OpenMP - BM1minibude: OpenMP - BM1build-mesa: Time To Compilesrsran: PUSCH Processor Benchmark, Throughput Threadkvazaar: Bosphorus 4K - Very Fastbuild-imagemagick: Time To Compilem-queens: Time To Solvenpb: CG.Cy-cruncher: 500Moidn: RT.ldr_alb_nrm.3840x2160 - CPU-Onlyoidn: RT.hdr_alb_nrm.3840x2160 - CPU-Onlyembree: Pathtracer ISPC - Asian Dragonoctave-benchmark: webp: Quality 100, Highest Compressionembree: Pathtracer ISPC - Crownsvt-av1: Preset 12 - Bosphorus 4Kastcenc: Mediumavifenc: 6, Losslessmt-dgemm: Sustained Floating-Point Ratenpb: MG.Cavifenc: 10, Losslesssrsran: PDSCH Processor Benchmark, Throughput Threadlammps: Rhodopsin Proteinavifenc: 6onednn: Deconvolution Batch shapes_3d - CPUprimesieve: 1e12compress-pbzip2: FreeBSD-13.0-RELEASE-amd64-memstick.img CompressionEPYC 8534PEPYC 8534PNEPYC 9654EPYC 9654 2PEPYC 9684XEPYC 9684X 2PEPYC 9754EPYC 9754 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PXeon Platinum 8490HXeon Platinum 8490H 2PXeon Platinum 8592+Xeon Platinum 8592+ 2P16146.99712662024.722.1972468.688851997567.2869475826.44495.25101.170.384260650098.7013.2813.2699198144881480.825894.613.1965.66116879799406.414250024338.84337.32323.59251.47105432862297.25242.9311.51901216.7034.6649127.532313.509.39277.52516.3216127227.928136.0772539784931373462309750530243784608203070689383777458472100721118566172713.814.57029219.05823.25240.1346.8846.87933364533.7632.920130.374317.9448421.997.3833.682.25716443.058691.64224163.69864205.014120539015.16161.48197.911.82443547.52433.49112.7288.87446176.87388.7432.57278154.01080.723212.3884308.461118.813.9137.2327409177817.96684660.011.204789.20810.5387511.117.87325127.0856.1189.38681106.5261101.46.765.706724.82506207.3363.91006255.67117.303636.3357.388426187.316198256.7216573.216704.4100.67317.3831.99998.0910.782943.0872051105.67675.864242135.794327.936245377388112043172566.818.4705592.2253.89102.05039.800911.222830.128.593692.6711.785366.797.74521128.9826.779256.11114.1748.7581441.381542.6119375.936.611927.312863.79685.1212311217210.302697.0508379266186537153818.03144.27667.67107.7152692.873112900000.48875.232274636.13154436798933135716949.5913193.06416.34115005266724526.033.2338621241.65713.9686.4995.742021.0045.9534621066763386000064.3253160.7852989966721868333338099166672593.3843.633.514610222282101333329828000001021983116933333306220000030470666671871333333655.239276.9317.0419.2556.41751835.826.93934.3511.3696424.3123.7158.16923533.6731626.5417680.8650.04673.4227.1227.536133284.4641.02252746.2068.18828.1352745.6410.20597620.9379139107.3532683.83121.035112.154.6017.91713.25022229.945.0771.801.7975.21498.9293.0362.1866165.089294.62097.18221.81757763930.645.735557.924.2463.4841.498353.8012.20049716609.78111772224.622.1341496.241771352568.2540495821.46498.2295.630.414241637592.8213.2813.1890658156810291.821047.513.1564.93117884977438.168250162335.46337.44322.69251.05105138551300.69251.6061.46163226.6264.4653325.334295.298.48288.11818.0535539526.829037.5302488965390857415893963207221944709732820533270776780673038719330509364313.004.74221211.18723.27263.7646.9346.86893417633.1832.229431.064416.4505418.896.9333.302.23868446.689690.73503188.37105215.925118821035.11156.59204.051.80573553.47133.23114.3118.75233187.03443.9612.25453159.62486.651511.5447287.421144.813.8151.2724294011016.45044564.311.286488.56880.678334.927.86015127.2086.0009.71131102.9661096.56.745.449714.92653203.0553.92455254.72718.493405.9457.549164380.865820618.1816399.715903.4109.00293.0734.76918.5311.482763.4878093120.56078.241264935.883127.870348844425132240153920.816.9200654.8348.73112.7608.8714412.672506.109.463355.7313.114830.017.70511129.6467.608279.63118.0238.4728345.711396.7819485.838.102726.247566.70594.4112010516310.397796.1679363234992636141831.77646.35275.2697.9782449.454112363330.48796.822069432.52809333835531909416855.8912818.55745.04114710800024548.835.9533999842.60513.6146.2465.240620.6554.3894548633357726333363.3433153.4172989933320263333337317566672593.0771.473.1993934727417400002687066667934732793700000278960000027679333331776866667656.250256.7915.7717.8061.36246338.866.72738.0412.1513223.0222.4659.26637736.8234416.8527120.8044.92617.0330.0728.420130839.1237.95972718.9464.78727.7452684.9310.42797421.178030798.2072455.16321.530112.151.5118.17514.49321684.805.1651.691.6973.90738.9483.0358.2776157.362273.67037.30120.99773262449.555.734563.621.9353.6231.797494.5452.32119510176.86420771575.528.3185238.8813161216466.54801412394.6334.30140.010.2783603261138.1114.0513.951977083501436324.935964.913.8453.77142102254311.825298341559.55562.50536.82211.85125562060176.14185.3002.87877182.0175.5501842.507470.9514.29164.02112.5027998723.919842.06928972884361237676965536673962757549750331102112312647513769035096099835721.324.46135225.30827.66139.2555.5955.611460854434.6525.478939.258628.0689529.8011.3434.901.66046604.045325.42331136.39912135.666180249938.35157.45306.271.70579586.17835.01101.46869.86018100.24800.2311.25135111.68872.123213.8647447.611388.917.2108.0242855705428.095614207.77.88584126.8160.48133779.625.34656187.0127.4318.15092122.6831328.58.388.182755.25321190.3822.66711374.74516.325697.5146.5050019114.638220895.4546233.742172.491.16525.8827.461743.498.585528.154329062.17361.992139133.520929.838122305188961180294183.230.6073510.1093.9981.604112.25499.475024.327.236554.1210.099356.716.37780156.6105.8516038.90102.1919.7851634.922739.0127695.234.163629.269034.86648.881601732649.08955109.998511409272949186675.43234.56740.26171.7714294.283133946670.571363.333926265.27712064262654950026082.7115239.610652.03228280200050909.622.5364347534.14816.73012.5149.184425.7524.23755425333811373333113.2783172.87536068333285983333311581666673105.91278.585.6301166541136216666742563000001665415266466667527193333340327333332282766667783.778354.5928.0131.4443.45405121.028.42220.155.91645839.5838.9032.59178328.0310223.7548351.3162.02942.1915.9620.494269047.2865.30255229.4187.99331.72125191.116.7438188.25383511136.9453423.63416.963112.276.8313.4717.73853182.773.8502.732.73132.49187.5283.62110.5253178.516449.11415.79939.086262116725.044.792684.736.1512.7561.154872.0581.4229546918.02133351558.442.5158145.6476162228248.86731512708.5266.10161.900.2933422731133.877.207.143707515302861959.871942.07.0461.07125595607197.630299610525.23529.80504.84240.4310882158077.64164.8995.27839220.3514.5381757.099525.8417.89118.90218.0595550525.317139.80351785006879067152650546581378822257383100150263486025164562988769892582222329.617.55558133.48526.4179.0552.8152.792010828916.2442.513723.578647.5267529.0310.5617.412.25020444.847124.29946140.4826194.810303245965.2463.98750.113.17064315.35517.07155.9606.4122985.891094.2560.917043102.58393.834010.6615401.841382.117.0102.9885768717947.614326702.79.74614102.5720.35172688.505.98436167.10710.434495.83721324.68.3017.811059.96245100.35863.68001271.62023.127810.6530.052794382.948498306.7886757.781025.848.43990.1614.303353.734.4610708.912075033.67562.88778039.017625.62651242710428661593246.952.6741253.63188.74113.5178.809305.209203.193.9812024.1810.1718666.169.12452109.4645.9831974.88157.5056.3489136.905178.2922931.866.628515.008225.84426.3517826236811.502486.923055381514511027.67821.12291.2787281.958133906670.571862.797975907.450649103327776173448760.8156835.719414.94432493033343531.023.53125333335.40220.23417.009814.4712.63154954667824583333175.5971167.22336033000273023333311999666673098.51524.7410.6018320527212953333342809333333164927411866667751333333340633333332282066667782.322227.2240.9642.0312.878.34911.253.40833761.1161.0725.00563227.7377122.3129771.6753.44727.778.6118.089472931.04105.405210139.6986.34128.81256584.678.1968224.26078596217.8465446.16116.409112.272.6812.7494.60984477.724.3293.493.48185.71107.6453.62176.2061171.218491.53445.84668.868505194942.324.829673.450.1212.8101.0094731.2421.1263297885.1623961450.527.5824176.4223122574309.84765314955.6245.82121.960.2513989358123.3713.9514.082145246591613828.748996.813.8952.93144760448290.341300833595.19597.73566.31209.6812616102877.32176.8763.41085178.0325.6650846.891425.2516.21147.83712.5807949221.578446.87649960071092678597205999634586513191354490408477313840958898338392565207724.694.10914243.34027.61123.9055.5655.381415841934.6924.109741.474532.5232542.1512.4334.901.48596672.916178.25382118.54229124.455195957778.48110.91433.061.69307590.70734.71102.7349.7368594.76801.9611.25179103.35271.556413.9745406.581385.317.297.00453763303432.518815786.66.16668162.0920.45138605.523.57543279.6417.5478.13326122.9481324.98.459.335345.59491178.6982.23922446.30313.526963.3142.1744349104.528634258.3974389.064260.283.11576.9821.632212.417.856017.193864556.91261.629122534.812628.725019535166031037319827.234.6447471.98101.5181.431912.28078.485608.076.936846.799.429997.896.18478161.4975.4117230.35102.0359.8000832.002986.3329384.933.499429.849330.00144.871652013009.18524108.868546523310091206619.29232.88935.66187.6844692.106133873330.571392.914152864.87538071606557911227287.2615656.911424.05237614900053167.820.4567132234.04417.01615.22210.322425.3823.26555455333850586667133.4769162.47536066000286200000013687333333114.21301.266.3027192898157040000047553333331925745811900000586246666743535333332287466667783.422330.2629.1832.7440.91896118.658.59518.365.46066040.5040.0028.32559425.9316463.3604531.2862.70868.5414.2919.991362511.4373.37966346.1586.29832.12225311.827.4718186.88121279151.9483798.69516.668112.278.1512.1996.95062071.104.3122.662.64155.12086.8573.61130.7874165.753500.76735.75745.245794134994.144.770680.739.9982.7231.119231.9841.3690634431.34439061429.944.950293.1686193921167.12816414185.1223.54137.500.2893480909120.117.077.023991242233214376.398237.07.0861.46124947288181.995301740526.36528.21513.92246.0810677837949.55161.9366.38343182.2685.4971162.000464.7822.58114.91218.1595527222.788644.06351990352059967171406176108791455971200108661819195027626776640376765271954733.087.09682141.83027.4367.5255.0155.111985166416.8242.887923.496055.2576540.9610.6116.972.24645446.80593.568115135.516389.275333075745.2443.771095.793.21781310.59117.28137.9897.2486979.421165.930.85768596.16190.062111.2707391.401392.516.891.966105954653355.338231157.86.17190161.9470.35178488.033.80792263.5248.39969119.55851321.48.4220.752599.95245100.46003.61792276.20722.208231.7222.832089386.088683410.79121976.912348043.171110.4911.954013.964.0811735.421785530.69463.40466041.569624.0540105148916561644091.060.3748233.63205.03114.1588.759714.919752.893.7812665.629.2520550.939.06607110.1685.3435809.59158.2656.3182833.185766.6225977.466.435515.051624.13423.8417929740811.458087.2579583103120915125.87218.67309.2197730.471130831330.561897.648448083.729980111646574136654678.4856999.722166.60446728133359466.622.52129400035.31622.52519.405214.2912.13055415667849340000210.4367161.33936040000277280000013947333333125.41560.5611.9107376268239433333347593666673745898012700000793526666744079000002279300000783.200248.0343.3945.2611.478.51310.163.08110863.4862.8222.70798926.8236272.0768351.6455.05738.317.7517.839551955.55116.122612296.2787.82431.95390520.938.9928183.75319901236.6105915.25316.401112.274.0311.7204.13388487.914.5103.473.45231.42726.9553.62214.0178163.795508.09265.95078.496158244738.814.943664.753.7712.8901.0019141.1991.10944611895.4072508170023.6266360.2073484477534.05942812731.8400.52135.170.2923422492125.7610.9111.011897637991872096.153966.910.8858.11131781309337.685250695458.96450.12433.79227.40116685326231.96212.5462.88869166.7936.0116447.986450.6116.79186.10313.8437224426.445837.958511672211418709975390078735274663411365639632938716126916228045703974887023.766.22791160.90423.36114.7647.3347.311577618627.5332.474430.857235.1464425.4612.4127.782.61653382.103449.46597167.40625146.761228294267.47230.24283.182.21020452.32327.68120.5568.29533106.54319.3483.13156128.27987.655211.4182462.791139.913.8110.8058995107035.24619320.511.139289.73500.73132973.437.63337131.0046.4659.42177106.1301102.26.687.997566.52367153.2463.12904319.45222.675310.0748.3642945106.147736018.7428854.328476.6102.84621.4238.211671.2310.975778.513738348.84973.271113036.446027.44711812915286954374413.537.7381551.07115.78103.5979.6529611.355594.818.037862.6510.9211508.197.28087137.1936.2519917.54115.7908.6359438.853280.2525194.640.633024.609533.12039.8315120730410.553794.7365535573235452177989.89138.52631.65232.7495818.736111745000.481620.534525288.00301478087157544024218.8315973.812575.30227535266750139.923.6980318740.35114.78513.24212.318720.6421.76246270000709650000133.9297163.41329907333244493333313698000002596.11454.717.5573220188174470000047145000002201886401366667658820000037915666671898766667655.795314.6729.0032.4445.07808717.707.28316.585.14765839.0838.4733.81422330.3813723.6543031.5054.46924.8012.8623.217279397.4586.01395702.1378.73928.16127519.376.9289748.87225914229.9135747.82319.906112.168.5616.3886.35043799.783.9683.163.12156.39098.8013.04126.1456169.230527.79976.85344.970826125567.075.662596.240.3863.2510.9436211.9211.3557377365.86340121712.641.8727201.2655861750253.31855311208.7349.67174.930.3293044620131.385.755.713012022323729470.8107830.65.7966.54115317834210.197251075427.95420.35411.26253.1310363048393.99192.9775.83606203.5714.9142058.839588.4322.00147.73516.8845922827.897535.871223166119452831983103026700104776633047130692850757332025868623790602860899032.268.51808117.61723.2865.5847.1447.132290015213.7655.915818.013356.4485422.769.6513.113.16441316.113137.11385192.41705101.561365932044.6385.86750.963.69602270.63113.68148.2086.7497790.85397.4292.51709126.11293.636010.75188397.441139.013.7111.15116994738556.693617873.111.577486.68640.41166151.427.84065127.53710.2310698.63741104.26.6418.9745411.314888.37413.98735250.63428.106513.3627.742007167.087645325.7054066.052639.556.731127.0515.844032.66512750.591696026.77674.68963038.000026.3257100158413531759922.163.8459275.53231.83125.2447.984026.2710182.164.3714601.5211.2022499.0310.066699.21826.638546.66179.9895.5576739.866400.9429877.183.766011.938227.14521.6616431040312.809378.0676567113520656430.68016.82288.5377213.433112736670.481876.668171241.708512134022677696846126.0808396.722017.75278303908342113.527.86155100041.91621.30522.002310.9411.55746229667709393333200.1612159.74629893333237476666713498000002590.81403.4614.1038412723173480000046265666674154126316266667643900000037941333331894966667655.046176.0037.1338.1211.217.1539.712.94045654.5754.8824.57012229.4744842.0843841.7146.00658.977.1721.224588329.32121.30179771.4177.59628.11214017.187.9159724.51061893214.6175365.42119.558112.159.0115.8103.98163265.014.1003.573.59208.31318.8483.03190.0839168.779462.23826.98684.688594245447.725.740576.851.6293.3410.8296531.3591.06839813273.69412432530.525.2423412.371713937407.5894063375.32351.29117.530.5591792636119.7319.4719.2068019088697707.222861.019.0190.0285744542428.387277647470.02465.06446.40314.4482455664228.74220.5691.45223139.0967.2418728.278383.577.46270.38014.2926996933.334129.9973641200848170507456728087161992612772265973541534443918518716132105821311.863.02897330.10423.33320.1147.3447.32743966351.0521.217947.270316.0869461.616.3052.971.37831728.469440.83113153.12467212.48287954081.4741.93285.951.45280687.67151.5554.959918.2179160.56380.9022.62544149.37847.241721.1702375.731126.414.4121.1921145704816.05025446.85.67700176.3330.33135075.074.57581219.5326.3244.58912217.8801131.17.765.971303.13366319.0432.97094337.00411.374208.4941.4380742104.234384040.5221766.51852228.73415.9655.74860.6416.332935.4768973123.83276.915235735.066528.516442837370551988143755.319.9102236.52202.5961.254716.325112.543802.617.136717.652.5019183.835.22781191.1115.279087.1261.825616.174223.122074.3021286.624.553540.728954.376106.961501141605.10914195.705394205346154117588.99243.42186.6770.2131755.333169063330.551047.961614763.70323720773831471623848.5402170.75366.69158849666720091.133.7528655241.12514.1017.5455.13427.6767.3246713033363239666764.9597144.6983653766721387666678001866673225.7986.043.1204678758385300002670033333678932848933333238180000023519000001640266667711.101333.7313.3615.1758.37911642.856.49042.7821.0211218.1317.5245.94743531.7818745.9309571.0839.56841.6831.6626.458126171.5237.00513050.1662.75029.0558815.368.30076313.969237663.6201590.50120.175129.740.2316.07521.03035116.553.7812.272.2675.46907.6223.1058.4230146.097247.29796.83619.76893085910.954.916702.627.6293.7301.264076.1602.6320777157.9611776178554.4054214.4163658790189.6861163347.93263.33145.291.027976035141.9516.6816.301379772031395446.445531.015.8494.8480770465246.936277589501.07499.18491.89328.4177501248125.15184.2981.88679121.6708.3996246.705467.9110.17175.62516.9635895236.228327.607412775833827571011898993323323042229934499084949278863575341332039672044716.915.74491174.67722.34169.4445.2945.95962441741.6524.651040.567129.3496435.216.8141.681.65270604.755201.10956134.78213134.419138592541.7742.16568.812.02659492.88542.3569.450114.4831114.29460.6732.17463123.88260.112016.6394447.501040.213.8102.1241994357029.501810975.87.04111141.9540.28174862.565.02267199.0796.0234.85818205.8851041.87.627.300656.00525166.4854.05270246.68017.155565.2332.2545211111.713373323.9242939.236900.529.98795.6356.711691.7917.195576.863892665.02669.647123740.453424.727419701166451049288129.135.9324256.63373.5072.801813.736613.347127.287.3213102.282.5337710.607.34848135.9765.5517252.2776.422713.086924.003998.0230236.030.473332.814142.87355.261501992695.74921173.90950940553317383665.75832.14344.71127.8453196.123169046670.541604.112993136.60183240170749172952102.6683787.010970.45315626166719876.527.5156287538.65311.89713.39210.20517.7733.92167064000732560000104.8425122.61736497667249405000010914600003207.01479.536.2126133866144406666735964000001345624825133333467096666732540333331963233333710.916341.5119.7522.2551.24589824.995.99123.1713.2112526.6926.0028.99311932.4819932.8810991.7244.75932.5916.5520.788246822.5272.32973816.7054.82327.26135939.256.3347637.29349117108.3972709.93018.474129.751.9114.40210.84065396.223.1103.493.51125.749412.6173.09107.6299122.089441.65187.12139.345732172614.105.317651.947.5123.7760.9450753.1211.98293212410.2913562245.230.5872384.384767812351.6441653406.96357.57125.140.6221607424123.6919.2919.5873592230813667.625441.519.2489.5386354518384.063277260476.91474.68461.62309.0383475645212.99215.4961.50214155.7886.5496532.157398.408.00252.64813.8457222533.987729.4250747710702660592014115453188939807832637406900675184043676318779617444012.503.37034296.79923.77290.5648.1448.35736650051.8623.662542.274718.4851464.726.8251.561.41662705.606410.29005150.66848197.84499881761.5459.69301.301.47249678.48351.3559.179516.9166146.03382.1092.61721143.80849.974020.0103386.001127.514.5117.8124407067418.55336122.35.91961168.8590.37140144.014.64757215.1276.5014.67269213.9851133.37.725.925013.32030301.1362.88734346.21312.724386.4842.2273366103.564315467.1723250.220561.438.50467.0862.53894.8719.442877.3262540107.23773.060212335.111028.479839238337901792162727.422.3625257.50217.1163.535315.739413.594093.737.767207.742.6720910.535.29027188.9305.779686.3961.010716.389824.942243.8415081.023.656542.271148.48797.801581301815.26075190.063432234469939134048.96440.50176.8778.1051952.606168853330.551108.951855135.32609824334734236325831.8382514.06445.09159799333318621.231.9233407639.87614.3628.2825.97028.1358.1596712766768900333371.8253149.9963653900023089666678822000003229.11058.993.6276791449445500002972400000791523222533333276906666727396333331679700000712.013335.5813.8915.6856.40169839.176.57238.4819.8824618.8418.2441.74619231.9982485.1141611.1440.82852.3628.4924.840131606.8642.98343076.6665.35931.4069776.417.95976212.799758270.8431771.06519.650129.741.3415.37618.10235234.063.7042.392.3883.49217.7483.1065.3318151.718284.33366.60522.53999086407.464.867705.530.8433.5501.196435.3322.2877666840.05718521873.162.6357201.3824075342187.2240044382.97269.20138.391.098920725135.2814.7414.921494090821627941.448534.814.9695.3980139566231.033277298471.79467.96460.66325.9778057728117.91181.6291.76778121.7808.2601651.816477.3310.44171.17416.6556004636.003927.7772148466962705011811489573533756452205352291240334710338286011337273521529716.646.17796161.88623.30156.7046.7946.591122332937.8429.444833.962133.1275439.847.4137.911.71875581.769186.32539159.31171128.066153544001.5464.91569.602.08780478.46738.3069.201414.4583110.56475.2542.10480122.70455.901917.9873449.911039.213.3106.2749790749033.112512115.07.53259132.7120.30176900.325.39123185.466.0775.00222199.8961046.07.462.563196.51744153.4073.95819252.67118.725933.6532.4441971107.303392842.3845195.140368.641.57889.1862.111801.8920.245525.563617958.24868.437114340.517824.68181811115357961316359.239.3389278.52401.4573.968413.519014.427689.327.9714033.942.7940032.817.30822136.6896.0218561.9179.377012.597425.724351.5911866.734.250729.195543.91151.291642273015.88628169.85055847375594665663.82330.53040.38133.9903349.756168840000.541677.623279262.53034946913152551453269.4694386.612793.01320516100021583.227.6365788938.13611.96714.12711.88757.2630.19666266000757176667112.7231124.26336521333249134000012060666673222.81528.417.2075155959151893333338965000001566585036000000536703333333370666672090466667712.085308.9522.1424.6549.13617523.456.05221.4512.1069029.6228.9627.57729128.8401572.5273631.7446.25940.4015.2920.008257384.5583.33953819.8355.97927.90141954.156.2667636.66387510114.9022872.56218.138129.752.2314.0949.28566492.442.9613.663.65129.748212.5783.09116.6053127.546483.10497.03844.668302171436.475.311663.852.2443.7380.8643582.6911.71129611980.80617342070.331.0738373.182833892357.0097128088.11328.47148.450.5721748146143.6720.4620.2596887479974189.927431.120.1385.1690871770362.454277205481.66486.05465.50294.3387797206207.20210.9341.05274116.3158.5971934.892461.238.72254.00314.0407122729.408034.0021768804693697700239352717222199277233161264211736180699452322503885073013.463.17002315.41024.97261.9749.8449.79784173856.4418.931952.816721.8932455.577.1054.841.17292852.326420.6467160.72685187.017106953605.85100.39298.561.27368784.30456.0150.352219.8593140.43329.0363.03922140.23349.637620.1453448.461032.014.6109.3027617961721.93245808.84.49976222.0290.43115106.302.79694357.3556.7194.39649227.4231069.17.942.970213.19298313.1003.06500326.14313.954209.1039.4868006120.934481667.9521314.217891.662.46477.7755.991068.4317.843325.905802693.34869.931197730.916532.343336649313801657179647.524.6445356.38167.8362.127616.095616.503606.129.795943.663.5815943.175.21520191.5626.439004.2355.120418.141336.201643.4324688.521.343646.849147.77687.921581572164.86604205.525502265366170147469.32839.45068.6186.9672174.192168823330.521278.452194630.60044928786238819023072.3022616.97562.80160509700035230.131.4940127837.75215.0608.7627.088520.9551.8206707466774441000079.3805162.4743650600025392000009185666673209.61205.304.26899455110208333333181266667945133500833333324380000032006000001890566667711.378380.1415.7117.8553.49027635.967.06134.8316.0308020.9720.2342.21941931.3845854.9558651.2949.42969.6225.8924.056135125.1551.29712865.7270.90837.8671245.267.04776512.929341382.8482071.18919.226129.750.0314.72415.21133811.633.2672.712.7191.99257.5323.0870.0540164.250333.99026.27823.54370583448.704.923680.228.7163.1691.077434.5762.1448576674.1227161960.960.8515203.4074136969196.8081167630.06214.80174.951.293778141161.0614.5914.081877617691916162.954601.114.0392.2383651785218.570275472501.63507.56485.63317.3680169620115.89178.2821.1090092.347310.8362350.521576.0811.12172.99014.8566731529.753633.6082153302630072713695343284704284625447762440297294711910680210744220253297718.705.62517177.76324.56141.5448.7748.761232130037.5527.594436.249338.2269456.188.8237.441.43573696.980196.49644162.02669122.314172970273.8245.78654.841.76353566.37737.0864.285815.5555107.36352.7382.83498118.57260.358916.5705528.93963.615.2101.62955128695838.223511263.25.55101180.0320.29189893.313.46571288.4716.4804.72530212.924992.18.162.219486.39031156.4614.05881246.33515.967356.6326.5838813115.473245908.4041773.034614.137.58793.6465.021843.6121.735483.813341150.83167.375106333.289930.03681683714138894350187.542.8188283.11423.1868.829914.528015.047862.587.7215519.922.5047654.956.90619144.6405.7220937.5878.398912.754625.124744.0530108.734.305429.148741.56346.381822653425.29287188.89061752504999853914.93329.98135.91140.8283520.705168433330.511899.643902076.24361255705459272943724.0624853.614946.76312440266746877.528.2279325337.31112.53615.45013.751810.4427.10766991333799496667132.2806154.50236461000265550000011264666673210.11730.258.3701183603161696666737236666671835835361266667611656666735586000002025000000712.697331.7624.7127.6548.5641821.156.69819.1311.2843832.0431.2428.55603735.6040972.5298072.1854.88996.4713.7419.506261127.0986.98453960.2865.22437.04147311.145.0087676.39169817133.6283340.69418.293129.767.6413.2627.88158128.242.3644.484.41152.74728.0363.07124.7084156.516484.54996.17245.965955163333.215.074675.542.2813.0440.7361702.3251.46921010602.40820041878.335.1361290.448916904323.2456975062.07410.59140.530.5891699046129.0223.4123.331097663451036735.631594.423.4981.7394616807316.902309896458.23455.79437.20280.2692709751157.56187.5071.43787109.6709.1188537.460462.789.38214.43113.2647539629.018534.4595889567506540744387683670238860547703441509169376657395792022362573801314.743.18392314.05726.93236.7353.9953.92892689363.3015.037666.516230.6799520.228.0663.601.10042908.187302.0641148.40248165.048121684134.0839.62403.201.20298830.72563.0643.535522.9689128.74302.2663.30836122.71839.745125.1591423.591221.818.0105.9831517838130.84048378.33.69649270.3290.4981279.792.16966460.7757.3923.85774259.1861242.69.804.648143.23780308.8012.15980462.8559.406757.2639.385952291.514752673.7937265.931177.226.85592.2055.071159.6613.734656.925079889.07064.475170929.956633.379731993231251441195648.827.1010224.64284.6450.830719.677311.175725.036.729515.862.3626943.424.01687248.6825.1912317.9447.895320.879521.872924.6626378.116.553460.409443.04880.291711672284.26352234.540529297517946153584.20334.59163.61108.1242703.088187743330.601486.122369998.35694033814644163638433.9733088.78089.14181476000031830.227.9042811634.79115.96610.4777.624016.6148.4067314066778377000097.1861174.83240244000247550000011529333333600.51277.464.6303105781117876666735032000001058313806833333316720000031482333331927766667799.717319.7616.0616.6448.42505132.087.87631.9116.9691024.8024.2333.06539331.7049054.1827071.5835.10819.8923.7221.357232012.7754.45474059.7079.43738.93109416.426.70169110.1967066106.3952659.88317.258129.538.0212.59514.25763760.453.3913.323.31112.66116.4583.4782.9663177.861327.78295.78429.141078107321.894.456742.934.3012.9710.9071614.2501.8475375601.10132221809.769.2976155.7415186677171.3757786038.92378.05169.751.149881881150.3316.1716.002226103782057021.661499.616.2582.7392771639189.739308434438.60443.58423.30286.788923185086.93157.3632.25422100.7389.9268456.400577.7612.74145.41330.2033311028.848134.6628176931314601314975299393774652076070768428438276013197605012044409914427019.915.83954171.23126.80125.8753.2953.221242551940.8326.086638.424053.9348519.898.8841.451.32454754.805137.03802139.61713106.815175857373.0543.41736.231.64919605.58940.7758.939416.9672100.00327.8753.05085103.37644.599622.4251501.391165.817.897.91158614787154.119516324.74.29531236.6480.46128566.812.80263356.7646.9603.98013251.3051189.79.675.852676.49693153.9222.81739354.75413.159360.8931.903339194.663780240.5672004.059139.228.171128.7857.132237.6914.678719.372424948.09160.52689831.532431.71091435812124759380867.548.7576234.24545.2164.789115.434111.6910934.176.9518375.632.4848122.165.10948195.4535.1824676.8670.437714.198022.965570.6330547.631.790731.458938.04941.851942843744.65431214.81268957839280064181.29325.87233.61191.8184795.462182005330.592039.634966250.77798357341067423970826.7345493.416004.07360964633342114.626.8879709333.65013.25618.54014.63347.4925.02170499000883701250173.2208162.97938950600262006666714938333333586.31681.448.9091206778202700000044505250002054996284300000607730000035207666672154633333799.491291.3727.1130.3743.69539918.317.36017.299.96452641.5840.9223.55893229.3251252.1594592.4053.66858.8412.7617.389455312.0997.93837437.8170.42639.31228184.685.1106925.39125967199.7344993.34316.183129.565.3811.4937.40298764.932.6595.095.03199.60896.8563.46153.1622165.495550.01685.61358.253340220893.784.579755.555.4962.8050.6242502.1871.432362OpenBenchmarking.org

WRF

WRF, the Weather Research and Forecasting Model, is a "next-generation mesoscale numerical weather prediction system designed for both atmospheric research and operational forecasting applications. It features two dynamical cores, a data assimilation system, and a software architecture supporting parallel computation and system extensibility." Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterWRF 4.2.2Input: conus 2.5kmEPYC 9684X 2PXeon Platinum 8592+ 2PXeon Platinum 8490H 2PXeon Max 9480 2PEPYC 9654 2PXeon Max 9468 2PEPYC 9754 2PEPYC 9684XEPYC 9654Xeon Platinum 8592+EPYC 9754Xeon Platinum 8490HXeon Max 9480Xeon Max 9468EPYC 8534PEPYC 8534PN4K8K12K16K20K4431.345601.106674.126840.066918.027157.967365.867885.1610176.8610602.4111895.4111980.8112410.2913273.6916147.0016609.781. (F9X) gfortran options: -O2 -ftree-vectorize -funroll-loops -ffree-form -fconvert=big-endian -frecord-marker=4 -fallow-invalid-boz -lesmf_time -lwrfio_nf -lnetcdff -lnetcdf -lmpi_usempif08 -lmpi_mpifh -lmpi -lopen-rte -lopen-pal -lhwloc -levent_core -levent_pthreads -lm -lz

OpenVKL

OpenVKL is the Intel Open Volume Kernel Library that offers high-performance volume computation kernels and part of the Intel oneAPI rendering toolkit. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgItems / Sec, More Is BetterOpenVKL 2.0.0Benchmark: vklBenchmarkCPU ISPCEPYC 9754 2PEPYC 9684X 2PEPYC 9654 2PXeon Platinum 8592+ 2PXeon Platinum 8490H 2PEPYC 9754EPYC 9684XEPYC 9654Xeon Platinum 8592+Xeon Max 9480 2PXeon Max 9468 2PXeon Platinum 8490HXeon Max 9480EPYC 8534PXeon Max 9468EPYC 8534PN9001800270036004500SE +/- 26.33, N = 3SE +/- 5.36, N = 3SE +/- 8.67, N = 3SE +/- 13.62, N = 3SE +/- 6.74, N = 3SE +/- 0.88, N = 3SE +/- 1.00, N = 3SE +/- 1.20, N = 3SE +/- 2.08, N = 3SE +/- 4.36, N = 3SE +/- 8.62, N = 3SE +/- 1.53, N = 3SE +/- 13.96, N = 3SE +/- 1.20, N = 3SE +/- 6.66, N = 3SE +/- 8.17, N = 34012390633353222271625082396207720041852177617341356126612431177MIN: 382 / MAX: 47557MIN: 350 / MAX: 44654MIN: 299 / MAX: 40960MIN: 248 / MAX: 36519MIN: 188 / MAX: 30888MIN: 207 / MAX: 30640MIN: 187 / MAX: 29055MIN: 160 / MAX: 26161MIN: 134 / MAX: 29750MIN: 191 / MAX: 28947MIN: 177 / MAX: 27371MIN: 104 / MAX: 26188MIN: 107 / MAX: 20909MIN: 98 / MAX: 15312MIN: 95 / MAX: 19286MIN: 91 / MAX: 14403
OpenBenchmarking.orgItems / Sec, More Is BetterOpenVKL 2.0.0Benchmark: vklBenchmarkCPU ISPCEPYC 9754 2PEPYC 9684X 2PEPYC 9654 2PXeon Platinum 8592+ 2PXeon Platinum 8490H 2PEPYC 9754EPYC 9684XEPYC 9654Xeon Platinum 8592+Xeon Max 9480 2PXeon Max 9468 2PXeon Platinum 8490HXeon Max 9480EPYC 8534PXeon Max 9468EPYC 8534PN7001400210028003500Min: 3986 / Avg: 4012.33 / Max: 4065Min: 3896 / Avg: 3906.33 / Max: 3914Min: 3326 / Avg: 3334.67 / Max: 3352Min: 3200 / Avg: 3222.33 / Max: 3247Min: 2706 / Avg: 2716.33 / Max: 2729Min: 2506 / Avg: 2507.67 / Max: 2509Min: 2395 / Avg: 2396 / Max: 2398Min: 2075 / Avg: 2077.33 / Max: 2079Min: 2001 / Avg: 2004 / Max: 2008Min: 1844 / Avg: 1852 / Max: 1859Min: 1759 / Avg: 1776 / Max: 1787Min: 1731 / Avg: 1734 / Max: 1736Min: 1334 / Avg: 1356.33 / Max: 1382Min: 1264 / Avg: 1266.33 / Max: 1268Min: 1231 / Avg: 1243 / Max: 1254Min: 1161 / Avg: 1177.33 / Max: 1186

NWChem

NWChem is an open-source high performance computational chemistry package. Per NWChem's documentation, "NWChem aims to provide its users with computational chemistry tools that are scalable both in their ability to treat large scientific computational chemistry problems efficiently, and in their use of available parallel computing resources from high-performance parallel supercomputers to conventional workstation clusters." Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterNWChem 7.0.2Input: C240 BuckyballEPYC 9684X 2PEPYC 9684XEPYC 9654 2PEPYC 9654EPYC 9754EPYC 9754 2PXeon Max 9468 2PXeon Platinum 8592+ 2PXeon Max 9480 2PXeon Platinum 8592+Xeon Platinum 8490H 2PEPYC 8534PXeon Platinum 8490HEPYC 8534PNXeon Max 9480Xeon Max 946850010001500200025001429.91450.51558.41575.51700.01712.61785.01809.71873.11878.31960.92024.72070.32224.62245.22530.51. (F9X) gfortran options: -lnwctask -lccsd -lmcscf -lselci -lmp2 -lmoints -lstepper -ldriver -loptim -lnwdft -lgradients -lcphf -lesp -lddscf -ldangchang -lguess -lhessian -lvib -lnwcutil -lrimp2 -lproperty -lsolvation -lnwints -lprepar -lnwmd -lnwpw -lofpw -lpaw -lpspw -lband -lnwpwlib -lcafe -lspace -lanalyze -lqhop -lpfft -ldplot -ldrdy -lvscf -lqmmm -lqmd -letrans -ltce -lbq -lmm -lcons -lperfm -ldntmc -lccca -ldimqm -lga -larmci -lpeigs -l64to32 -lopenblas -lpthread -lrt -llapack -lnwcblas -lmpi_usempif08 -lmpi_mpifh -lmpi -lopen-rte -lopen-pal -lhwloc -levent_core -levent_pthreads -lm -lz -lcomex -m64 -ffast-math -std=legacy -fdefault-integer-8 -finline-functions -O2

High Performance Conjugate Gradient

HPCG is the High Performance Conjugate Gradient and is a new scientific benchmark from Sandia National Lans focused for super-computer testing with modern real-world workloads compared to HPCC. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgGFLOP/s, More Is BetterHigh Performance Conjugate Gradient 3.1X Y Z: 144 144 144 - RT: 60Xeon Platinum 8592+ 2PXeon Max 9480 2PXeon Platinum 8490H 2PXeon Max 9468 2PEPYC 9684X 2PEPYC 9654 2PEPYC 9754 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Max 9480EPYC 9654EPYC 9684XXeon Max 9468EPYC 9754EPYC 8534PEPYC 8534PN1530456075SE +/- 0.94, N = 3SE +/- 0.07, N = 3SE +/- 0.03, N = 3SE +/- 0.29, N = 3SE +/- 0.51, N = 3SE +/- 0.05, N = 3SE +/- 0.02, N = 3SE +/- 0.08, N = 3SE +/- 0.02, N = 3SE +/- 0.37, N = 3SE +/- 0.05, N = 3SE +/- 0.28, N = 5SE +/- 0.08, N = 3SE +/- 0.04, N = 3SE +/- 0.03, N = 3SE +/- 0.02, N = 369.3062.6460.8554.4144.9542.5241.8735.1431.0730.5928.3227.5825.2423.6322.2022.131. (CXX) g++ options: -O3 -ffast-math -ftree-vectorize -lmpi_cxx -lmpi
OpenBenchmarking.orgGFLOP/s, More Is BetterHigh Performance Conjugate Gradient 3.1X Y Z: 144 144 144 - RT: 60Xeon Platinum 8592+ 2PXeon Max 9480 2PXeon Platinum 8490H 2PXeon Max 9468 2PEPYC 9684X 2PEPYC 9654 2PEPYC 9754 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Max 9480EPYC 9654EPYC 9684XXeon Max 9468EPYC 9754EPYC 8534PEPYC 8534PN1326395265Min: 67.54 / Avg: 69.3 / Max: 70.74Min: 62.56 / Avg: 62.64 / Max: 62.77Min: 60.81 / Avg: 60.85 / Max: 60.92Min: 54.03 / Avg: 54.41 / Max: 54.99Min: 44.11 / Avg: 44.95 / Max: 45.87Min: 42.42 / Avg: 42.52 / Max: 42.58Min: 41.84 / Avg: 41.87 / Max: 41.91Min: 34.98 / Avg: 35.14 / Max: 35.22Min: 31.05 / Avg: 31.07 / Max: 31.11Min: 29.88 / Avg: 30.59 / Max: 31.14Min: 28.27 / Avg: 28.32 / Max: 28.41Min: 26.56 / Avg: 27.58 / Max: 28.1Min: 25.1 / Avg: 25.24 / Max: 25.39Min: 23.55 / Avg: 23.63 / Max: 23.69Min: 22.16 / Avg: 22.2 / Max: 22.25Min: 22.1 / Avg: 22.13 / Max: 22.171. (CXX) g++ options: -O3 -ffast-math -ftree-vectorize -lmpi_cxx -lmpi

RELION

RELION - REgularised LIkelihood OptimisatioN - is a stand-alone computer program for Maximum A Posteriori refinement of (multiple) 3D reconstructions or 2D class averages in cryo-electron microscopy (cryo-EM). It is developed in the research group of Sjors Scheres at the MRC Laboratory of Molecular Biology. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterRELION 4.0.1Test: Basic - Device: CPUEPYC 9684X 2PEPYC 9654 2PXeon Platinum 8592+ 2PEPYC 9684XEPYC 9754 2PXeon Max 9480 2PXeon Platinum 8490H 2PXeon Max 9468 2PEPYC 9654Xeon Platinum 8592+EPYC 9754Xeon Platinum 8490HXeon Max 9480Xeon Max 9468EPYC 8534PEPYC 8534PN110220330440550SE +/- 1.27, N = 15SE +/- 2.11, N = 12SE +/- 1.41, N = 3SE +/- 2.17, N = 3SE +/- 4.04, N = 12SE +/- 2.66, N = 12SE +/- 2.65, N = 3SE +/- 3.24, N = 12SE +/- 2.95, N = 3SE +/- 2.68, N = 7SE +/- 7.69, N = 9SE +/- 7.14, N = 9SE +/- 4.65, N = 9SE +/- 2.98, N = 3SE +/- 4.63, N = 3SE +/- 6.20, N = 393.17145.65155.74176.42201.27201.38203.41214.42238.88290.45360.21373.18384.38412.37468.69496.241. (CXX) g++ options: -fopenmp -std=c++11 -O3 -rdynamic -ldl -ltiff -lfftw3f -lfftw3 -lpng -ljpeg -lmpi_cxx -lmpi
OpenBenchmarking.orgSeconds, Fewer Is BetterRELION 4.0.1Test: Basic - Device: CPUEPYC 9684X 2PEPYC 9654 2PXeon Platinum 8592+ 2PEPYC 9684XEPYC 9754 2PXeon Max 9480 2PXeon Platinum 8490H 2PXeon Max 9468 2PEPYC 9654Xeon Platinum 8592+EPYC 9754Xeon Platinum 8490HXeon Max 9480Xeon Max 9468EPYC 8534PEPYC 8534PN90180270360450Min: 81.41 / Avg: 93.17 / Max: 98.24Min: 127.74 / Avg: 145.65 / Max: 155.47Min: 153.09 / Avg: 155.74 / Max: 157.87Min: 173.24 / Avg: 176.42 / Max: 180.58Min: 176.29 / Avg: 201.26 / Max: 216.52Min: 177.35 / Avg: 201.38 / Max: 211.97Min: 200.25 / Avg: 203.41 / Max: 208.67Min: 190.69 / Avg: 214.42 / Max: 226.92Min: 234.22 / Avg: 238.88 / Max: 244.33Min: 281.55 / Avg: 290.45 / Max: 301.47Min: 327.68 / Avg: 360.21 / Max: 384.89Min: 321.77 / Avg: 373.18 / Max: 391.54Min: 361.02 / Avg: 384.38 / Max: 399.13Min: 406.42 / Avg: 412.37 / Max: 415.48Min: 463.06 / Avg: 468.69 / Max: 477.88Min: 489.16 / Avg: 496.24 / Max: 508.61. (CXX) g++ options: -fopenmp -std=c++11 -O3 -rdynamic -ldl -ltiff -lfftw3f -lfftw3 -lpng -ljpeg -lmpi_cxx -lmpi

BRL-CAD

OpenBenchmarking.orgVGR Performance Metric, More Is BetterBRL-CAD 7.38.2VGR Performance MetricEPYC 9684X 2PEPYC 9654 2PEPYC 9754 2PXeon Platinum 8592+ 2PXeon Platinum 8490H 2PXeon Max 9480 2PXeon Max 9468 2PEPYC 9754EPYC 9654EPYC 9684XXeon Platinum 8592+EPYC 8534PXeon Platinum 8490HEPYC 8534PNXeon Max 9480Xeon Max 94681.3M2.6M3.9M5.2M6.5M61939216162228586175051866774136969407534236587903484477316121631225749169048519978338927713527678127139371. (CXX) g++ options: -std=c++17 -pipe -fvisibility=hidden -fno-strict-aliasing -fno-common -fexceptions -ftemplate-depth-128 -m64 -ggdb3 -O3 -fipa-pta -fstrength-reduce -finline-functions -flto -ltcl8.6 -lnetpbm -lregex_brl -lz_brl -lassimp -ldl -lm -ltk8.6

Xcompact3d Incompact3d

Xcompact3d Incompact3d is a Fortran-MPI based, finite difference high-performance code for solving the incompressible Navier-Stokes equation and as many as you need scalar transport equations. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterXcompact3d Incompact3d 2021-03-11Input: X3D-benchmarking input.i3dEPYC 9684X 2PXeon Platinum 8592+ 2PXeon Max 9480 2PXeon Max 9468 2PXeon Platinum 8490H 2PEPYC 9654 2PEPYC 9754 2PEPYC 9684XXeon Platinum 8592+Xeon Max 9480Xeon Platinum 8490HXeon Max 9468EPYC 9654EPYC 9754EPYC 8534PEPYC 8534PN120240360480600SE +/- 2.20, N = 12SE +/- 0.37, N = 3SE +/- 0.01, N = 3SE +/- 0.04, N = 3SE +/- 0.05, N = 3SE +/- 3.26, N = 9SE +/- 9.13, N = 9SE +/- 3.06, N = 9SE +/- 2.51, N = 3SE +/- 0.14, N = 3SE +/- 3.88, N = 4SE +/- 1.25, N = 3SE +/- 4.73, N = 3SE +/- 5.39, N = 3SE +/- 0.92, N = 3SE +/- 0.22, N = 3167.13171.38187.22189.69196.81248.87253.32309.85323.25351.64357.01407.59466.55534.06567.29568.251. (F9X) gfortran options: -cpp -O2 -funroll-loops -floop-optimize -fcray-pointer -fbacktrace -lmpi_usempif08 -lmpi_mpifh -lmpi -lopen-rte -lopen-pal -lhwloc -levent_core -levent_pthreads -lm -lz
OpenBenchmarking.orgSeconds, Fewer Is BetterXcompact3d Incompact3d 2021-03-11Input: X3D-benchmarking input.i3dEPYC 9684X 2PXeon Platinum 8592+ 2PXeon Max 9480 2PXeon Max 9468 2PXeon Platinum 8490H 2PEPYC 9654 2PEPYC 9754 2PEPYC 9684XXeon Platinum 8592+Xeon Max 9480Xeon Platinum 8490HXeon Max 9468EPYC 9654EPYC 9754EPYC 8534PEPYC 8534PN100200300400500Min: 147.46 / Avg: 167.13 / Max: 176.24Min: 170.71 / Avg: 171.38 / Max: 171.97Min: 187.21 / Avg: 187.22 / Max: 187.23Min: 189.62 / Avg: 189.69 / Max: 189.76Min: 196.75 / Avg: 196.81 / Max: 196.91Min: 223.02 / Avg: 248.87 / Max: 254.3Min: 180.49 / Avg: 253.32 / Max: 264.89Min: 288.64 / Avg: 309.85 / Max: 322.97Min: 318.23 / Avg: 323.25 / Max: 325.77Min: 351.39 / Avg: 351.64 / Max: 351.84Min: 352.67 / Avg: 357.01 / Max: 368.65Min: 406.25 / Avg: 407.59 / Max: 410.08Min: 457.26 / Avg: 466.55 / Max: 472.76Min: 523.29 / Avg: 534.06 / Max: 539.85Min: 565.55 / Avg: 567.29 / Max: 568.67Min: 567.93 / Avg: 568.25 / Max: 568.681. (F9X) gfortran options: -cpp -O2 -funroll-loops -floop-optimize -fcray-pointer -fbacktrace -lmpi_usempif08 -lmpi_mpifh -lmpi -lopen-rte -lopen-pal -lhwloc -levent_core -levent_pthreads -lm -lz

ASKAP

ASKAP is a set of benchmarks from the Australian SKA Pathfinder. The principal ASKAP benchmarks are the Hogbom Clean Benchmark (tHogbomClean) and Convolutional Resamping Benchmark (tConvolve) as well as some previous ASKAP benchmarks being included as well for OpenCL and CUDA execution of tConvolve. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgMillion Grid Points Per Second, More Is BetterASKAP 1.0Test: tConvolve MT - GriddingEPYC 9684XEPYC 9684X 2PEPYC 9754EPYC 9654 2PEPYC 9654EPYC 9754 2PXeon Platinum 8490HXeon Platinum 8490H 2PXeon Platinum 8592+ 2PEPYC 8534PEPYC 8534PNXeon Platinum 8592+Xeon Max 9480 2PXeon Max 9480Xeon Max 9468Xeon Max 9468 2P3K6K9K12K15KSE +/- 262.30, N = 12SE +/- 204.28, N = 3SE +/- 2.09, N = 3SE +/- 141.43, N = 5SE +/- 59.24, N = 3SE +/- 21.01, N = 3SE +/- 4.15, N = 3SE +/- 75.19, N = 5SE +/- 60.72, N = 3SE +/- 0.88, N = 3SE +/- 0.88, N = 3SE +/- 54.27, N = 5SE +/- 195.28, N = 8SE +/- 32.87, N = 12SE +/- 87.89, N = 12SE +/- 23.56, N = 314955.6014185.1012731.8012708.5012394.6011208.708088.117630.066038.925826.445821.465062.074382.973406.963375.323347.931. (CXX) g++ options: -O3 -fstrict-aliasing -fopenmp
OpenBenchmarking.orgMillion Grid Points Per Second, More Is BetterASKAP 1.0Test: tConvolve MT - GriddingEPYC 9684XEPYC 9684X 2PEPYC 9754EPYC 9654 2PEPYC 9654EPYC 9754 2PXeon Platinum 8490HXeon Platinum 8490H 2PXeon Platinum 8592+ 2PEPYC 8534PEPYC 8534PNXeon Platinum 8592+Xeon Max 9480 2PXeon Max 9480Xeon Max 9468Xeon Max 9468 2P3K6K9K12K15KMin: 13077.8 / Avg: 14955.56 / Max: 16322.2Min: 13971.3 / Avg: 14185.1 / Max: 14593.5Min: 12728.6 / Avg: 12731.77 / Max: 12735.7Min: 12310.9 / Avg: 12708.48 / Max: 13074.5Min: 12279.9 / Avg: 12394.57 / Max: 12477.7Min: 11167.6 / Avg: 11208.73 / Max: 11236.7Min: 8080.61 / Avg: 8088.11 / Max: 8094.94Min: 7461.63 / Avg: 7630.06 / Max: 7858.99Min: 5928.12 / Avg: 6038.92 / Max: 6137.36Min: 5824.78 / Avg: 5826.44 / Max: 5827.76Min: 5819.8 / Avg: 5821.46 / Max: 5822.79Min: 4957.92 / Avg: 5062.07 / Max: 5265.07Min: 3160.98 / Avg: 4382.97 / Max: 4764.45Min: 3251.98 / Avg: 3406.96 / Max: 3632.24Min: 2777.12 / Avg: 3375.32 / Max: 3849.48Min: 3301.97 / Avg: 3347.93 / Max: 3379.911. (CXX) g++ options: -O3 -fstrict-aliasing -fopenmp

CloverLeaf

CloverLeaf is a Lagrangian-Eulerian hydrodynamics benchmark. This test profile currently makes use of CloverLeaf's OpenMP version. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterCloverLeaf 1.3Input: clover_bm16Xeon Platinum 8490H 2PEPYC 9684X 2PEPYC 9684XXeon Max 9468 2PEPYC 9654 2PXeon Max 9480 2PXeon Platinum 8490HEPYC 9654EPYC 9754 2PXeon Max 9468Xeon Max 9480Xeon Platinum 8592+ 2PEPYC 9754Xeon Platinum 8592+EPYC 8534PEPYC 8534PN110220330440550SE +/- 0.74, N = 3SE +/- 0.59, N = 3SE +/- 2.24, N = 3SE +/- 1.56, N = 3SE +/- 0.12, N = 3SE +/- 2.11, N = 9SE +/- 0.13, N = 3SE +/- 3.79, N = 9SE +/- 1.02, N = 3SE +/- 1.43, N = 3SE +/- 2.03, N = 3SE +/- 2.02, N = 3SE +/- 4.99, N = 9SE +/- 0.54, N = 3SE +/- 0.79, N = 3SE +/- 1.08, N = 3214.80223.54245.82263.33266.10269.20328.47334.30349.67351.29357.57378.05400.52410.59495.25498.221. (F9X) gfortran options: -O3 -march=native -funroll-loops -fopenmp
OpenBenchmarking.orgSeconds, Fewer Is BetterCloverLeaf 1.3Input: clover_bm16Xeon Platinum 8490H 2PEPYC 9684X 2PEPYC 9684XXeon Max 9468 2PEPYC 9654 2PXeon Max 9480 2PXeon Platinum 8490HEPYC 9654EPYC 9754 2PXeon Max 9468Xeon Max 9480Xeon Platinum 8592+ 2PEPYC 9754Xeon Platinum 8592+EPYC 8534PEPYC 8534PN90180270360450Min: 213.33 / Avg: 214.8 / Max: 215.62Min: 222.37 / Avg: 223.54 / Max: 224.23Min: 241.35 / Avg: 245.82 / Max: 248.31Min: 261.16 / Avg: 263.33 / Max: 266.36Min: 265.86 / Avg: 266.1 / Max: 266.27Min: 261.99 / Avg: 269.2 / Max: 280.35Min: 328.23 / Avg: 328.47 / Max: 328.69Min: 325.78 / Avg: 334.3 / Max: 360.63Min: 347.76 / Avg: 349.67 / Max: 351.23Min: 349.41 / Avg: 351.29 / Max: 354.11Min: 354.4 / Avg: 357.57 / Max: 361.34Min: 374.35 / Avg: 378.05 / Max: 381.3Min: 392.55 / Avg: 400.52 / Max: 440.01Min: 409.58 / Avg: 410.59 / Max: 411.42Min: 494.18 / Avg: 495.25 / Max: 496.8Min: 496.77 / Avg: 498.22 / Max: 500.321. (F9X) gfortran options: -O3 -march=native -funroll-loops -fopenmp

TensorFlow

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.16.1Device: CPU - Batch Size: 512 - Model: ResNet-50Xeon Platinum 8490H 2PEPYC 9754 2PXeon Platinum 8592+ 2PEPYC 9654 2PXeon Platinum 8490HXeon Max 9468 2PXeon Platinum 8592+EPYC 9654Xeon Max 9480 2PEPYC 9684X 2PEPYC 9754Xeon Max 9480EPYC 9684XXeon Max 9468EPYC 8534PEPYC 8534PN4080120160200SE +/- 1.39, N = 3SE +/- 0.81, N = 3SE +/- 0.61, N = 3SE +/- 1.83, N = 3SE +/- 0.01, N = 3SE +/- 0.79, N = 3SE +/- 0.48, N = 3SE +/- 0.34, N = 3SE +/- 1.80, N = 3SE +/- 0.31, N = 3SE +/- 1.62, N = 4SE +/- 0.61, N = 3SE +/- 1.42, N = 4SE +/- 1.17, N = 3SE +/- 0.01, N = 3SE +/- 0.02, N = 3174.95174.93169.75161.90148.45145.29140.53140.01138.39137.50135.17125.14121.96117.53101.1795.63
OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.16.1Device: CPU - Batch Size: 512 - Model: ResNet-50Xeon Platinum 8490H 2PEPYC 9754 2PXeon Platinum 8592+ 2PEPYC 9654 2PXeon Platinum 8490HXeon Max 9468 2PXeon Platinum 8592+EPYC 9654Xeon Max 9480 2PEPYC 9684X 2PEPYC 9754Xeon Max 9480EPYC 9684XXeon Max 9468EPYC 8534PEPYC 8534PN306090120150Min: 172.43 / Avg: 174.95 / Max: 177.22Min: 173.86 / Avg: 174.93 / Max: 176.53Min: 168.56 / Avg: 169.75 / Max: 170.55Min: 158.53 / Avg: 161.9 / Max: 164.83Min: 148.44 / Avg: 148.45 / Max: 148.46Min: 144.06 / Avg: 145.29 / Max: 146.77Min: 139.68 / Avg: 140.53 / Max: 141.35Min: 139.61 / Avg: 140.01 / Max: 140.69Min: 134.79 / Avg: 138.39 / Max: 140.44Min: 136.92 / Avg: 137.5 / Max: 137.98Min: 130.61 / Avg: 135.17 / Max: 137.97Min: 123.92 / Avg: 125.14 / Max: 125.82Min: 119.14 / Avg: 121.96 / Max: 124.79Min: 115.29 / Avg: 117.53 / Max: 119.21Min: 101.15 / Avg: 101.17 / Max: 101.2Min: 95.61 / Avg: 95.63 / Max: 95.67

PostgreSQL

This is a benchmark of PostgreSQL using the integrated pgbench for facilitating the database benchmarks. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgms, Fewer Is BetterPostgreSQL 16Scaling Factor: 100 - Clients: 1000 - Mode: Read Only - Average LatencyEPYC 9684XEPYC 9654EPYC 9684X 2PEPYC 9754EPYC 9654 2PEPYC 9754 2PEPYC 8534PEPYC 8534PNXeon Max 9468Xeon Platinum 8490HXeon Platinum 8592+Xeon Max 9480Xeon Max 9468 2PXeon Max 9480 2PXeon Platinum 8592+ 2PXeon Platinum 8490H 2P0.29090.58180.87271.16361.4545SE +/- 0.002, N = 3SE +/- 0.003, N = 3SE +/- 0.006, N = 12SE +/- 0.001, N = 3SE +/- 0.004, N = 12SE +/- 0.001, N = 3SE +/- 0.002, N = 3SE +/- 0.001, N = 3SE +/- 0.008, N = 12SE +/- 0.007, N = 3SE +/- 0.005, N = 12SE +/- 0.007, N = 3SE +/- 0.017, N = 9SE +/- 0.038, N = 9SE +/- 0.040, N = 12SE +/- 0.030, N = 120.2510.2780.2890.2920.2930.3290.3840.4140.5590.5720.5890.6221.0271.0981.1491.2931. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm
OpenBenchmarking.orgms, Fewer Is BetterPostgreSQL 16Scaling Factor: 100 - Clients: 1000 - Mode: Read Only - Average LatencyEPYC 9684XEPYC 9654EPYC 9684X 2PEPYC 9754EPYC 9654 2PEPYC 9754 2PEPYC 8534PEPYC 8534PNXeon Max 9468Xeon Platinum 8490HXeon Platinum 8592+Xeon Max 9480Xeon Max 9468 2PXeon Max 9480 2PXeon Platinum 8592+ 2PXeon Platinum 8490H 2P246810Min: 0.25 / Avg: 0.25 / Max: 0.25Min: 0.27 / Avg: 0.28 / Max: 0.28Min: 0.27 / Avg: 0.29 / Max: 0.33Min: 0.29 / Avg: 0.29 / Max: 0.3Min: 0.28 / Avg: 0.29 / Max: 0.32Min: 0.33 / Avg: 0.33 / Max: 0.33Min: 0.38 / Avg: 0.38 / Max: 0.39Min: 0.41 / Avg: 0.41 / Max: 0.42Min: 0.54 / Avg: 0.56 / Max: 0.63Min: 0.56 / Avg: 0.57 / Max: 0.58Min: 0.57 / Avg: 0.59 / Max: 0.62Min: 0.61 / Avg: 0.62 / Max: 0.64Min: 0.93 / Avg: 1.03 / Max: 1.11Min: 0.84 / Avg: 1.1 / Max: 1.24Min: 0.92 / Avg: 1.15 / Max: 1.37Min: 1.09 / Avg: 1.29 / Max: 1.481. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm

OpenBenchmarking.orgTPS, More Is BetterPostgreSQL 16Scaling Factor: 100 - Clients: 1000 - Mode: Read OnlyEPYC 9684XEPYC 9654EPYC 9684X 2PEPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PNXeon Max 9468Xeon Platinum 8490HXeon Platinum 8592+Xeon Max 9480Xeon Max 9468 2PXeon Max 9480 2PXeon Platinum 8592+ 2PXeon Platinum 8490H 2P900K1800K2700K3600K4500KSE +/- 27594.68, N = 3SE +/- 39970.22, N = 3SE +/- 71870.42, N = 12SE +/- 41074.86, N = 12SE +/- 15503.17, N = 3SE +/- 13473.87, N = 3SE +/- 11512.67, N = 3SE +/- 4774.62, N = 3SE +/- 24978.23, N = 12SE +/- 20350.34, N = 3SE +/- 13863.97, N = 12SE +/- 17697.00, N = 3SE +/- 16726.04, N = 9SE +/- 36627.33, N = 9SE +/- 30933.90, N = 12SE +/- 18635.21, N = 123989358360326134809093422731342249230446202606500241637517926361748146169904616074249760359207258818817781411. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm
OpenBenchmarking.orgTPS, More Is BetterPostgreSQL 16Scaling Factor: 100 - Clients: 1000 - Mode: Read OnlyEPYC 9684XEPYC 9654EPYC 9684X 2PEPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PNXeon Max 9468Xeon Platinum 8490HXeon Platinum 8592+Xeon Max 9480Xeon Max 9468 2PXeon Max 9480 2PXeon Platinum 8592+ 2PXeon Platinum 8490H 2P700K1400K2100K2800K3500KMin: 3936068.09 / Avg: 3989357.67 / Max: 4028434.85Min: 3536441.99 / Avg: 3603260.59 / Max: 3674673.98Min: 3042220.94 / Avg: 3480909.16 / Max: 3754154.43Min: 3096387.1 / Avg: 3422731.25 / Max: 3566653.83Min: 3391671.01 / Avg: 3422492 / Max: 3440834.3Min: 3021935.84 / Avg: 3044619.98 / Max: 3068559.96Min: 2585025.03 / Avg: 2606500.12 / Max: 2624430.7Min: 2407809.58 / Avg: 2416375.18 / Max: 2424313.64Min: 1592416.34 / Avg: 1792635.72 / Max: 1862528.55Min: 1714551.7 / Avg: 1748146.26 / Max: 1784842.35Min: 1614190.59 / Avg: 1699045.74 / Max: 1759981.07Min: 1575272.28 / Avg: 1607424.15 / Max: 1636315.87Min: 898628.97 / Avg: 976034.51 / Max: 1074194.42Min: 805818.73 / Avg: 920724.73 / Max: 1185417.76Min: 730756.21 / Avg: 881881.35 / Max: 1084339.69Min: 675010 / Avg: 778140.99 / Max: 917513.61. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm

TensorFlow

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.16.1Device: CPU - Batch Size: 256 - Model: ResNet-50Xeon Platinum 8490H 2PXeon Platinum 8592+ 2PXeon Platinum 8490HXeon Max 9468 2PEPYC 9654Xeon Max 9480 2PEPYC 9654 2PEPYC 9754 2PXeon Platinum 8592+EPYC 9754Xeon Max 9480EPYC 9684XEPYC 9684X 2PXeon Max 9468EPYC 8534PEPYC 8534PN4080120160200SE +/- 1.57, N = 3SE +/- 0.21, N = 3SE +/- 0.03, N = 3SE +/- 1.40, N = 3SE +/- 0.66, N = 3SE +/- 1.04, N = 12SE +/- 0.57, N = 3SE +/- 0.18, N = 3SE +/- 0.58, N = 3SE +/- 2.00, N = 12SE +/- 0.63, N = 3SE +/- 1.39, N = 4SE +/- 0.50, N = 3SE +/- 0.14, N = 3SE +/- 0.05, N = 3SE +/- 0.06, N = 3161.06150.33143.67141.95138.11135.28133.87131.38129.02125.76123.69123.37120.11119.7398.7092.82
OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.16.1Device: CPU - Batch Size: 256 - Model: ResNet-50Xeon Platinum 8490H 2PXeon Platinum 8592+ 2PXeon Platinum 8490HXeon Max 9468 2PEPYC 9654Xeon Max 9480 2PEPYC 9654 2PEPYC 9754 2PXeon Platinum 8592+EPYC 9754Xeon Max 9480EPYC 9684XEPYC 9684X 2PXeon Max 9468EPYC 8534PEPYC 8534PN306090120150Min: 158.11 / Avg: 161.06 / Max: 163.44Min: 149.91 / Avg: 150.33 / Max: 150.6Min: 143.62 / Avg: 143.67 / Max: 143.71Min: 139.16 / Avg: 141.95 / Max: 143.51Min: 137.07 / Avg: 138.11 / Max: 139.34Min: 128.65 / Avg: 135.28 / Max: 139.7Min: 132.82 / Avg: 133.87 / Max: 134.8Min: 131.09 / Avg: 131.38 / Max: 131.7Min: 127.87 / Avg: 129.02 / Max: 129.6Min: 120.59 / Avg: 125.76 / Max: 146.17Min: 122.52 / Avg: 123.69 / Max: 124.7Min: 120.83 / Avg: 123.37 / Max: 126.84Min: 119.16 / Avg: 120.11 / Max: 120.85Min: 119.49 / Avg: 119.73 / Max: 119.99Min: 98.6 / Avg: 98.7 / Max: 98.75Min: 92.76 / Avg: 92.82 / Max: 92.94

PyTorch

OpenBenchmarking.orgbatches/sec, More Is BetterPyTorch 2.2.1Device: CPU - Batch Size: 512 - Model: ResNet-152Xeon Platinum 8592+Xeon Platinum 8490HXeon Max 9468Xeon Max 9480Xeon Max 9468 2PXeon Platinum 8592+ 2PXeon Max 9480 2PXeon Platinum 8490H 2PEPYC 9654EPYC 9684XEPYC 8534PNEPYC 8534PEPYC 9754EPYC 9654 2PEPYC 9684X 2PEPYC 9754 2P612182430SE +/- 0.16, N = 3SE +/- 0.04, N = 3SE +/- 0.18, N = 7SE +/- 0.18, N = 7SE +/- 0.09, N = 3SE +/- 0.18, N = 3SE +/- 0.16, N = 3SE +/- 0.09, N = 3SE +/- 0.18, N = 3SE +/- 0.12, N = 3SE +/- 0.09, N = 3SE +/- 0.11, N = 3SE +/- 0.02, N = 3SE +/- 0.14, N = 9SE +/- 0.13, N = 9SE +/- 0.11, N = 923.4120.4619.4719.2916.6816.1714.7414.5914.0513.9513.2813.2810.917.207.075.75MIN: 22.41 / MAX: 24.3MIN: 17.25 / MAX: 21.16MIN: 11.79 / MAX: 20.53MIN: 10.66 / MAX: 20.07MIN: 7.02 / MAX: 17.07MIN: 11.54 / MAX: 16.69MIN: 10.63 / MAX: 15.36MIN: 10.11 / MAX: 16.06MIN: 13.72 / MAX: 14.61MIN: 13.65 / MAX: 14.33MIN: 12.1 / MAX: 13.57MIN: 12.91 / MAX: 13.58MIN: 10.79 / MAX: 11.05MIN: 3.59 / MAX: 8.29MIN: 3.53 / MAX: 7.83MIN: 2.81 / MAX: 6.42
OpenBenchmarking.orgbatches/sec, More Is BetterPyTorch 2.2.1Device: CPU - Batch Size: 512 - Model: ResNet-152Xeon Platinum 8592+Xeon Platinum 8490HXeon Max 9468Xeon Max 9480Xeon Max 9468 2PXeon Platinum 8592+ 2PXeon Max 9480 2PXeon Platinum 8490H 2PEPYC 9654EPYC 9684XEPYC 8534PNEPYC 8534PEPYC 9754EPYC 9654 2PEPYC 9684X 2PEPYC 9754 2P510152025Min: 23.13 / Avg: 23.41 / Max: 23.67Min: 20.39 / Avg: 20.46 / Max: 20.54Min: 18.55 / Avg: 19.47 / Max: 20.1Min: 18.48 / Avg: 19.29 / Max: 19.78Min: 16.56 / Avg: 16.68 / Max: 16.86Min: 15.82 / Avg: 16.17 / Max: 16.41Min: 14.42 / Avg: 14.74 / Max: 14.92Min: 14.43 / Avg: 14.59 / Max: 14.74Min: 13.84 / Avg: 14.05 / Max: 14.4Min: 13.76 / Avg: 13.95 / Max: 14.16Min: 13.14 / Avg: 13.28 / Max: 13.44Min: 13.1 / Avg: 13.28 / Max: 13.47Min: 10.89 / Avg: 10.91 / Max: 10.95Min: 6.54 / Avg: 7.2 / Max: 7.86Min: 6.48 / Avg: 7.07 / Max: 7.58Min: 5.24 / Avg: 5.75 / Max: 6.2

OpenBenchmarking.orgbatches/sec, More Is BetterPyTorch 2.2.1Device: CPU - Batch Size: 256 - Model: ResNet-152Xeon Platinum 8592+Xeon Platinum 8490HXeon Max 9480Xeon Max 9468Xeon Max 9468 2PXeon Platinum 8592+ 2PXeon Max 9480 2PXeon Platinum 8490H 2PEPYC 9684XEPYC 9654EPYC 8534PEPYC 8534PNEPYC 9754EPYC 9654 2PEPYC 9684X 2PEPYC 9754 2P612182430SE +/- 0.29, N = 3SE +/- 0.08, N = 3SE +/- 0.15, N = 3SE +/- 0.15, N = 3SE +/- 0.09, N = 3SE +/- 0.16, N = 3SE +/- 0.18, N = 4SE +/- 0.13, N = 7SE +/- 0.20, N = 3SE +/- 0.11, N = 3SE +/- 0.06, N = 3SE +/- 0.04, N = 3SE +/- 0.15, N = 3SE +/- 0.13, N = 9SE +/- 0.13, N = 9SE +/- 0.12, N = 923.3320.2519.5819.2016.3016.0014.9214.0814.0813.9513.2613.1811.017.147.025.71MIN: 19.78 / MAX: 24.54MIN: 17.03 / MAX: 21.21MIN: 13.13 / MAX: 20.27MIN: 10.93 / MAX: 20MIN: 11.86 / MAX: 16.95MIN: 11.43 / MAX: 16.66MIN: 8.28 / MAX: 15.85MIN: 6.98 / MAX: 15.46MIN: 13.43 / MAX: 14.62MIN: 13.45 / MAX: 14.29MIN: 12.98 / MAX: 13.46MIN: 12.94 / MAX: 13.34MIN: 10.7 / MAX: 11.43MIN: 3.67 / MAX: 7.91MIN: 3.92 / MAX: 8.02MIN: 3.18 / MAX: 6.47
OpenBenchmarking.orgbatches/sec, More Is BetterPyTorch 2.2.1Device: CPU - Batch Size: 256 - Model: ResNet-152Xeon Platinum 8592+Xeon Platinum 8490HXeon Max 9480Xeon Max 9468Xeon Max 9468 2PXeon Platinum 8592+ 2PXeon Max 9480 2PXeon Platinum 8490H 2PEPYC 9684XEPYC 9654EPYC 8534PEPYC 8534PNEPYC 9754EPYC 9654 2PEPYC 9684X 2PEPYC 9754 2P510152025Min: 22.87 / Avg: 23.33 / Max: 23.86Min: 20.08 / Avg: 20.25 / Max: 20.35Min: 19.41 / Avg: 19.58 / Max: 19.87Min: 18.9 / Avg: 19.2 / Max: 19.38Min: 16.14 / Avg: 16.3 / Max: 16.46Min: 15.77 / Avg: 16 / Max: 16.32Min: 14.45 / Avg: 14.92 / Max: 15.35Min: 13.69 / Avg: 14.08 / Max: 14.61Min: 13.81 / Avg: 14.08 / Max: 14.47Min: 13.72 / Avg: 13.95 / Max: 14.08Min: 13.15 / Avg: 13.26 / Max: 13.36Min: 13.09 / Avg: 13.18 / Max: 13.23Min: 10.8 / Avg: 11.01 / Max: 11.3Min: 6.45 / Avg: 7.14 / Max: 7.59Min: 6.5 / Avg: 7.02 / Max: 7.6Min: 5.09 / Avg: 5.71 / Max: 6.15

Stockfish

OpenBenchmarking.orgNodes Per Second, More Is BetterStockfish 16.1Chess BenchmarkEPYC 9684X 2PEPYC 9654 2PEPYC 9754 2PXeon Platinum 8592+ 2PEPYC 9684XEPYC 9654EPYC 9754Xeon Platinum 8490H 2PXeon Max 9480 2PXeon Max 9468 2PXeon Platinum 8592+EPYC 8534PXeon Platinum 8490HEPYC 8534PNXeon Max 9480Xeon Max 946890M180M270M360M450MSE +/- 919073.22, N = 3SE +/- 2356843.91, N = 3SE +/- 7961094.38, N = 12SE +/- 2482737.87, N = 3SE +/- 2268830.04, N = 3SE +/- 3170744.86, N = 15SE +/- 4652276.19, N = 12SE +/- 2148606.38, N = 4SE +/- 2925715.37, N = 11SE +/- 4344961.90, N = 10SE +/- 2966712.90, N = 9SE +/- 2397455.91, N = 12SE +/- 1304590.97, N = 3SE +/- 2147688.02, N = 12SE +/- 629927.17, N = 3SE +/- 1751369.24, N = 1239912422337075153030120223222261037821452465919770835018976379918776176914940908213797720310976634599198144968874799065815673592230680190881. (CXX) g++ options: -lgcov -m64 -lpthread -fno-exceptions -std=c++17 -fno-peel-loops -fno-tracer -pedantic -O3 -funroll-loops -msse -msse3 -mpopcnt -mavx2 -mbmi -mavx512f -mavx512bw -mavx512vnni -mavx512dq -mavx512vl -msse4.1 -mssse3 -msse2 -mbmi2 -flto -flto-partition=one -flto=jobserver
OpenBenchmarking.orgNodes Per Second, More Is BetterStockfish 16.1Chess BenchmarkEPYC 9684X 2PEPYC 9654 2PEPYC 9754 2PXeon Platinum 8592+ 2PEPYC 9684XEPYC 9654EPYC 9754Xeon Platinum 8490H 2PXeon Max 9480 2PXeon Max 9468 2PXeon Platinum 8592+EPYC 8534PXeon Platinum 8490HEPYC 8534PNXeon Max 9480Xeon Max 946870M140M210M280M350MMin: 397383832 / Avg: 399124223.33 / Max: 400506635Min: 367819084 / Avg: 370751530 / Max: 375413799Min: 249790326 / Avg: 301202231.83 / Max: 347346604Min: 218003860 / Avg: 222610378 / Max: 226518927Min: 210554411 / Avg: 214524658.67 / Max: 218412575Min: 173574520 / Avg: 197708349.67 / Max: 214024385Min: 169071949 / Avg: 189763799 / Max: 234765459Min: 182910465 / Avg: 187761768.75 / Max: 192568158Min: 129404582 / Avg: 149409082.45 / Max: 160455993Min: 114663193 / Avg: 137977202.6 / Max: 157872926Min: 95815903 / Avg: 109766344.67 / Max: 124123359Min: 88934946 / Avg: 99198144.33 / Max: 112868492Min: 94884961 / Avg: 96887479.33 / Max: 99337294Min: 77008870 / Avg: 90658155.75 / Max: 105582612Min: 72332406 / Avg: 73592230 / Max: 74229713Min: 59888483 / Avg: 68019087.75 / Max: 777309081. (CXX) g++ options: -lgcov -m64 -lpthread -fno-exceptions -std=c++17 -fno-peel-loops -fno-tracer -pedantic -O3 -funroll-loops -msse -msse3 -mpopcnt -mavx2 -mbmi -mavx512f -mavx512bw -mavx512vnni -mavx512dq -mavx512vl -msse4.1 -mssse3 -msse2 -mbmi2 -flto -flto-partition=one -flto=jobserver

OpenSSL

OpenBenchmarking.orgverify/s, More Is BetterOpenSSL 3.3Algorithm: RSA4096EPYC 9754 2PEPYC 9684X 2PEPYC 9654 2PXeon Platinum 8592+ 2PXeon Platinum 8490H 2PEPYC 9754Xeon Max 9480 2PEPYC 9684XEPYC 9654Xeon Max 9468 2PXeon Platinum 8592+Xeon Platinum 8490HEPYC 8534PXeon Max 9480EPYC 8534PNXeon Max 9468800K1600K2400K3200K4000KSE +/- 2222.55, N = 3SE +/- 6125.37, N = 3SE +/- 5.26, N = 3SE +/- 6745.42, N = 3SE +/- 862.96, N = 3SE +/- 444.74, N = 3SE +/- 277.84, N = 3SE +/- 1576.96, N = 3SE +/- 149.48, N = 3SE +/- 355.69, N = 3SE +/- 92.62, N = 3SE +/- 92.46, N = 3SE +/- 126.84, N = 3SE +/- 200.66, N = 3SE +/- 136.07, N = 3SE +/- 165.80, N = 33729470.83214376.32861959.82057021.61916162.91872096.11627941.41613828.71436324.91395446.41036735.6974189.9881480.8813667.6810291.8697707.21. (CC) gcc options: -pthread -m64 -O3 -lssl -lcrypto -ldl
OpenBenchmarking.orgverify/s, More Is BetterOpenSSL 3.3Algorithm: RSA4096EPYC 9754 2PEPYC 9684X 2PEPYC 9654 2PXeon Platinum 8592+ 2PXeon Platinum 8490H 2PEPYC 9754Xeon Max 9480 2PEPYC 9684XEPYC 9654Xeon Max 9468 2PXeon Platinum 8592+Xeon Platinum 8490HEPYC 8534PXeon Max 9480EPYC 8534PNXeon Max 9468600K1200K1800K2400K3000KMin: 3727222.4 / Avg: 3729470.8 / Max: 3733915.8Min: 3207836.3 / Avg: 3214376.33 / Max: 3226617.5Min: 2861949.8 / Avg: 2861959.83 / Max: 2861967.6Min: 2043628.9 / Avg: 2057021.63 / Max: 2065124.5Min: 1914634.4 / Avg: 1916162.9 / Max: 1917621.3Min: 1871280.9 / Avg: 1872096.07 / Max: 1872811.9Min: 1627415 / Avg: 1627941.37 / Max: 1628358.8Min: 1612210.9 / Avg: 1613828.73 / Max: 1616982.3Min: 1436117.5 / Avg: 1436324.93 / Max: 1436615.1Min: 1394736 / Avg: 1395446.43 / Max: 1395833.4Min: 1036563.4 / Avg: 1036735.63 / Max: 1036880.8Min: 974005 / Avg: 974189.87 / Max: 974286.4Min: 881287.6 / Avg: 881480.83 / Max: 881719.8Min: 813395.8 / Avg: 813667.6 / Max: 814059.2Min: 810123.6 / Avg: 810291.83 / Max: 810561.2Min: 697529.8 / Avg: 697707.17 / Max: 698038.51. (CC) gcc options: -pthread -m64 -O3 -lssl -lcrypto -ldl

OpenBenchmarking.orgsign/s, More Is BetterOpenSSL 3.3Algorithm: RSA4096EPYC 9754 2PEPYC 9684X 2PEPYC 9654 2PXeon Platinum 8592+ 2PXeon Platinum 8490H 2PEPYC 9754EPYC 9684XXeon Max 9480 2PXeon Max 9468 2PEPYC 9654Xeon Platinum 8592+Xeon Platinum 8490HEPYC 8534PXeon Max 9480Xeon Max 9468EPYC 8534PN20K40K60K80K100KSE +/- 80.37, N = 3SE +/- 247.60, N = 3SE +/- 81.38, N = 3SE +/- 56.68, N = 3SE +/- 14.34, N = 3SE +/- 27.42, N = 3SE +/- 98.71, N = 3SE +/- 83.09, N = 3SE +/- 6.92, N = 3SE +/- 29.11, N = 3SE +/- 15.15, N = 3SE +/- 9.84, N = 3SE +/- 22.17, N = 3SE +/- 20.13, N = 3SE +/- 19.45, N = 3SE +/- 12.56, N = 3107830.698237.071942.061499.654601.153966.948996.848534.845531.035964.931594.427431.125894.625441.522861.021047.51. (CC) gcc options: -pthread -m64 -O3 -lssl -lcrypto -ldl
OpenBenchmarking.orgsign/s, More Is BetterOpenSSL 3.3Algorithm: RSA4096EPYC 9754 2PEPYC 9684X 2PEPYC 9654 2PXeon Platinum 8592+ 2PXeon Platinum 8490H 2PEPYC 9754EPYC 9684XXeon Max 9480 2PXeon Max 9468 2PEPYC 9654Xeon Platinum 8592+Xeon Platinum 8490HEPYC 8534PXeon Max 9480Xeon Max 9468EPYC 8534PN20K40K60K80K100KMin: 107718.7 / Avg: 107830.63 / Max: 107986.5Min: 97966.5 / Avg: 98237.03 / Max: 98731.5Min: 71850.6 / Avg: 71941.97 / Max: 72104.3Min: 61388.1 / Avg: 61499.57 / Max: 61573.2Min: 54572.8 / Avg: 54601.13 / Max: 54619.2Min: 53938.3 / Avg: 53966.87 / Max: 54021.7Min: 48884.5 / Avg: 48996.83 / Max: 49193.6Min: 48448.6 / Avg: 48534.77 / Max: 48700.9Min: 45522.9 / Avg: 45531.03 / Max: 45544.8Min: 35934.4 / Avg: 35964.9 / Max: 36023.1Min: 31564.8 / Avg: 31594.43 / Max: 31614.7Min: 27412.5 / Avg: 27431.07 / Max: 27446Min: 25872.2 / Avg: 25894.57 / Max: 25938.9Min: 25410.6 / Avg: 25441.5 / Max: 25479.3Min: 22837.3 / Avg: 22861.03 / Max: 22899.6Min: 21033.9 / Avg: 21047.5 / Max: 21072.61. (CC) gcc options: -pthread -m64 -O3 -lssl -lcrypto -ldl

PyTorch

OpenBenchmarking.orgbatches/sec, More Is BetterPyTorch 2.2.1Device: CPU - Batch Size: 64 - Model: ResNet-152Xeon Platinum 8592+Xeon Platinum 8490HXeon Max 9480Xeon Max 9468Xeon Platinum 8592+ 2PXeon Max 9468 2PXeon Max 9480 2PXeon Platinum 8490H 2PEPYC 9684XEPYC 9654EPYC 8534PEPYC 8534PNEPYC 9754EPYC 9684X 2PEPYC 9654 2PEPYC 9754 2P612182430SE +/- 0.34, N = 3SE +/- 0.18, N = 3SE +/- 0.17, N = 12SE +/- 0.19, N = 5SE +/- 0.15, N = 12SE +/- 0.21, N = 3SE +/- 0.05, N = 3SE +/- 0.17, N = 3SE +/- 0.10, N = 3SE +/- 0.17, N = 3SE +/- 0.16, N = 3SE +/- 0.03, N = 3SE +/- 0.02, N = 3SE +/- 0.15, N = 9SE +/- 0.13, N = 9SE +/- 0.03, N = 323.4920.1319.2419.0116.2515.8414.9614.0313.8913.8413.1913.1510.887.087.045.79MIN: 19.73 / MAX: 24.56MIN: 17.06 / MAX: 21.01MIN: 10.95 / MAX: 20.39MIN: 11.15 / MAX: 20.08MIN: 6.19 / MAX: 17.5MIN: 6.82 / MAX: 16.51MIN: 10.89 / MAX: 15.42MIN: 8.98 / MAX: 15.41MIN: 13.54 / MAX: 14.15MIN: 13.51 / MAX: 14.34MIN: 12.44 / MAX: 13.62MIN: 12.52 / MAX: 13.35MIN: 10.75 / MAX: 11.02MIN: 3.61 / MAX: 8.09MIN: 3.58 / MAX: 7.91MIN: 3.25 / MAX: 6.39
OpenBenchmarking.orgbatches/sec, More Is BetterPyTorch 2.2.1Device: CPU - Batch Size: 64 - Model: ResNet-152Xeon Platinum 8592+Xeon Platinum 8490HXeon Max 9480Xeon Max 9468Xeon Platinum 8592+ 2PXeon Max 9468 2PXeon Max 9480 2PXeon Platinum 8490H 2PEPYC 9684XEPYC 9654EPYC 8534PEPYC 8534PNEPYC 9754EPYC 9684X 2PEPYC 9654 2PEPYC 9754 2P510152025Min: 22.82 / Avg: 23.49 / Max: 23.88Min: 19.76 / Avg: 20.13 / Max: 20.37Min: 18.21 / Avg: 19.24 / Max: 20.15Min: 18.55 / Avg: 19.01 / Max: 19.68Min: 15.08 / Avg: 16.25 / Max: 17.16Min: 15.57 / Avg: 15.84 / Max: 16.25Min: 14.87 / Avg: 14.96 / Max: 15.01Min: 13.7 / Avg: 14.03 / Max: 14.29Min: 13.69 / Avg: 13.89 / Max: 14.03Min: 13.64 / Avg: 13.84 / Max: 14.17Min: 13.02 / Avg: 13.19 / Max: 13.52Min: 13.1 / Avg: 13.15 / Max: 13.21Min: 10.86 / Avg: 10.88 / Max: 10.92Min: 6.54 / Avg: 7.08 / Max: 7.82Min: 6.42 / Avg: 7.04 / Max: 7.57Min: 5.74 / Avg: 5.79 / Max: 5.83

Apache IoTDB

Apache IotDB is a time series database and this benchmark is facilitated using the IoT Benchmaark [https://github.com/thulab/iot-benchmark/]. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgAverage Latency, Fewer Is BetterApache IoTDB 1.2Device Count: 800 - Batch Size Per Write: 100 - Sensor Count: 800 - Client Number: 100EPYC 9684XEPYC 9654EPYC 9754EPYC 9654 2PEPYC 9684X 2PEPYC 8534PNEPYC 8534PEPYC 9754 2PXeon Platinum 8592+Xeon Platinum 8592+ 2PXeon Platinum 8490HXeon Max 9480Xeon Max 9468Xeon Platinum 8490H 2PXeon Max 9468 2PXeon Max 9480 2P20406080100SE +/- 0.23, N = 3SE +/- 0.31, N = 3SE +/- 0.10, N = 3SE +/- 0.65, N = 12SE +/- 0.59, N = 12SE +/- 0.03, N = 3SE +/- 0.31, N = 3SE +/- 0.79, N = 12SE +/- 0.68, N = 3SE +/- 0.80, N = 7SE +/- 0.15, N = 3SE +/- 0.87, N = 3SE +/- 0.48, N = 3SE +/- 1.18, N = 3SE +/- 1.01, N = 3SE +/- 1.11, N = 452.9353.7758.1161.0761.4664.9365.6666.5481.7382.7385.1689.5390.0292.2394.8495.39MAX: 23851.86MAX: 22579.45MAX: 23856.7MAX: 23881.58MAX: 23888.07MAX: 22583.73MAX: 23840.27MAX: 24915.81MAX: 24081.78MAX: 24148.34MAX: 23810.86MAX: 23819.37MAX: 23857.34MAX: 23842.9MAX: 23842.98MAX: 23846.38
OpenBenchmarking.orgAverage Latency, Fewer Is BetterApache IoTDB 1.2Device Count: 800 - Batch Size Per Write: 100 - Sensor Count: 800 - Client Number: 100EPYC 9684XEPYC 9654EPYC 9754EPYC 9654 2PEPYC 9684X 2PEPYC 8534PNEPYC 8534PEPYC 9754 2PXeon Platinum 8592+Xeon Platinum 8592+ 2PXeon Platinum 8490HXeon Max 9480Xeon Max 9468Xeon Platinum 8490H 2PXeon Max 9468 2PXeon Max 9480 2P20406080100Min: 52.58 / Avg: 52.93 / Max: 53.36Min: 53.41 / Avg: 53.77 / Max: 54.38Min: 57.9 / Avg: 58.11 / Max: 58.22Min: 59.04 / Avg: 61.07 / Max: 66.93Min: 60.06 / Avg: 61.46 / Max: 67.79Min: 64.89 / Avg: 64.93 / Max: 65Min: 65.33 / Avg: 65.66 / Max: 66.28Min: 63.73 / Avg: 66.54 / Max: 74.56Min: 80.98 / Avg: 81.73 / Max: 83.09Min: 81.11 / Avg: 82.73 / Max: 87.36Min: 84.91 / Avg: 85.16 / Max: 85.42Min: 88.61 / Avg: 89.53 / Max: 91.26Min: 89.39 / Avg: 90.02 / Max: 90.97Min: 90.17 / Avg: 92.23 / Max: 94.25Min: 93.52 / Avg: 94.84 / Max: 96.82Min: 93.94 / Avg: 95.39 / Max: 98.68

OpenBenchmarking.orgpoint/sec, More Is BetterApache IoTDB 1.2Device Count: 800 - Batch Size Per Write: 100 - Sensor Count: 800 - Client Number: 100EPYC 9684XEPYC 9654EPYC 9754EPYC 9654 2PEPYC 9684X 2PEPYC 8534PNEPYC 8534PEPYC 9754 2PXeon Platinum 8592+Xeon Platinum 8592+ 2PXeon Platinum 8490HXeon Max 9480Xeon Max 9468Xeon Platinum 8490H 2PXeon Max 9468 2PXeon Max 9480 2P30M60M90M120M150MSE +/- 538692.55, N = 3SE +/- 665173.47, N = 3SE +/- 263772.09, N = 3SE +/- 1249999.63, N = 12SE +/- 1058559.19, N = 12SE +/- 41021.96, N = 3SE +/- 576868.09, N = 3SE +/- 1225528.40, N = 12SE +/- 739343.51, N = 3SE +/- 862582.24, N = 7SE +/- 276414.35, N = 3SE +/- 782176.98, N = 3SE +/- 435900.66, N = 3SE +/- 928557.10, N = 3SE +/- 594234.55, N = 3SE +/- 872659.60, N = 41447604481421022541317813091255956071249472881178849771168797991153178349461680792771639908717708635451885744542836517858077046580139566
OpenBenchmarking.orgpoint/sec, More Is BetterApache IoTDB 1.2Device Count: 800 - Batch Size Per Write: 100 - Sensor Count: 800 - Client Number: 100EPYC 9684XEPYC 9654EPYC 9754EPYC 9654 2PEPYC 9684X 2PEPYC 8534PNEPYC 8534PEPYC 9754 2PXeon Platinum 8592+Xeon Platinum 8592+ 2PXeon Platinum 8490HXeon Max 9480Xeon Max 9468Xeon Platinum 8490H 2PXeon Max 9468 2PXeon Max 9480 2P30M60M90M120M150MMin: 143706640.39 / Avg: 144760447.53 / Max: 145481482.17Min: 140773486.6 / Avg: 142102254 / Max: 142822763.62Min: 131336080.34 / Avg: 131781309.4 / Max: 132248986.1Min: 114727224.61 / Avg: 125595606.97 / Max: 129945596.97Min: 113723801.33 / Avg: 124947287.85 / Max: 128081350.59Min: 117840008.82 / Avg: 117884976.56 / Max: 117966889.63Min: 115726293.47 / Avg: 116879798.99 / Max: 117476529.93Min: 103181555.75 / Avg: 115317833.87 / Max: 119933113.35Min: 93141563.61 / Avg: 94616807.11 / Max: 95441772.58Min: 87833481.05 / Avg: 92771638.71 / Max: 94723672.41Min: 90321310.22 / Avg: 90871770.37 / Max: 91191271.14Min: 84804662.47 / Avg: 86354518.4 / Max: 87313463.81Min: 84895320.77 / Avg: 85744542.22 / Max: 86339873.09Min: 82086029.92 / Avg: 83651785.32 / Max: 85299511.22Min: 79582539.09 / Avg: 80770464.9 / Max: 81395545.65Min: 77579252.22 / Avg: 80139565.75 / Max: 81426556.35

Timed Linux Kernel Compilation

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed Linux Kernel Compilation 6.8Build: allmodconfigEPYC 9684X 2PXeon Platinum 8592+ 2PEPYC 9654 2PEPYC 9754 2PXeon Platinum 8490H 2PXeon Max 9480 2PXeon Max 9468 2PEPYC 9684XEPYC 9654Xeon Platinum 8592+EPYC 9754Xeon Platinum 8490HXeon Max 9480EPYC 8534PXeon Max 9468EPYC 8534PN90180270360450SE +/- 0.98, N = 3SE +/- 0.56, N = 3SE +/- 0.49, N = 3SE +/- 1.31, N = 3SE +/- 0.86, N = 3SE +/- 0.73, N = 3SE +/- 0.56, N = 3SE +/- 0.37, N = 3SE +/- 0.49, N = 3SE +/- 0.72, N = 3SE +/- 1.05, N = 3SE +/- 0.80, N = 3SE +/- 0.67, N = 3SE +/- 0.91, N = 3SE +/- 0.61, N = 3SE +/- 0.78, N = 3182.00189.74197.63210.20218.57231.03246.94290.34311.83316.90337.69362.45384.06406.41428.39438.17
OpenBenchmarking.orgSeconds, Fewer Is BetterTimed Linux Kernel Compilation 6.8Build: allmodconfigEPYC 9684X 2PXeon Platinum 8592+ 2PEPYC 9654 2PEPYC 9754 2PXeon Platinum 8490H 2PXeon Max 9480 2PXeon Max 9468 2PEPYC 9684XEPYC 9654Xeon Platinum 8592+EPYC 9754Xeon Platinum 8490HXeon Max 9480EPYC 8534PXeon Max 9468EPYC 8534PN80160240320400Min: 180.32 / Avg: 182 / Max: 183.71Min: 189.09 / Avg: 189.74 / Max: 190.86Min: 196.97 / Avg: 197.63 / Max: 198.59Min: 208.35 / Avg: 210.2 / Max: 212.72Min: 217.6 / Avg: 218.57 / Max: 220.29Min: 230.21 / Avg: 231.03 / Max: 232.48Min: 246.34 / Avg: 246.94 / Max: 248.06Min: 289.85 / Avg: 290.34 / Max: 291.08Min: 310.91 / Avg: 311.83 / Max: 312.59Min: 316.04 / Avg: 316.9 / Max: 318.34Min: 335.59 / Avg: 337.68 / Max: 338.81Min: 361.57 / Avg: 362.45 / Max: 364.05Min: 383.35 / Avg: 384.06 / Max: 385.39Min: 405.29 / Avg: 406.41 / Max: 408.21Min: 427.77 / Avg: 428.39 / Max: 429.6Min: 437.25 / Avg: 438.17 / Max: 439.71

SecureMark

SecureMark is an objective, standardized benchmarking framework for measuring the efficiency of cryptographic processing solutions developed by EEMBC. SecureMark-TLS is benchmarking Transport Layer Security performance with a focus on IoT/edge computing. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgmarks, More Is BetterSecureMark 1.0.4Benchmark: SecureMark-TLSXeon Platinum 8592+Xeon Platinum 8592+ 2PEPYC 9684X 2PEPYC 9684XEPYC 9654 2PEPYC 9654Xeon Max 9468Xeon Max 9468 2PXeon Max 9480 2PXeon Max 9480Xeon Platinum 8490HXeon Platinum 8490H 2PEPYC 9754 2PEPYC 9754EPYC 8534PNEPYC 8534P70K140K210K280K350KSE +/- 209.97, N = 3SE +/- 411.11, N = 3SE +/- 809.90, N = 3SE +/- 415.71, N = 3SE +/- 389.81, N = 3SE +/- 361.20, N = 3SE +/- 256.85, N = 3SE +/- 384.08, N = 3SE +/- 196.24, N = 3SE +/- 670.43, N = 3SE +/- 625.56, N = 3SE +/- 330.95, N = 3SE +/- 553.62, N = 3SE +/- 457.42, N = 3SE +/- 542.88, N = 3SE +/- 372.96, N = 33098963084343017403008332996102983412776472775892772982772602772052754722510752506952501622500241. (CC) gcc options: -pedantic -O3
OpenBenchmarking.orgmarks, More Is BetterSecureMark 1.0.4Benchmark: SecureMark-TLSXeon Platinum 8592+Xeon Platinum 8592+ 2PEPYC 9684X 2PEPYC 9684XEPYC 9654 2PEPYC 9654Xeon Max 9468Xeon Max 9468 2PXeon Max 9480 2PXeon Max 9480Xeon Platinum 8490HXeon Platinum 8490H 2PEPYC 9754 2PEPYC 9754EPYC 8534PNEPYC 8534P50K100K150K200K250KMin: 309477.53 / Avg: 309896.25 / Max: 310133.28Min: 308006.75 / Avg: 308434.25 / Max: 309256.25Min: 300123.44 / Avg: 301739.95 / Max: 302637.53Min: 300002.16 / Avg: 300833.13 / Max: 301272.09Min: 299136.5 / Avg: 299610.25 / Max: 300383.34Min: 297791.66 / Avg: 298340.77 / Max: 299021.84Min: 277154.09 / Avg: 277646.99 / Max: 278018.78Min: 277153.66 / Avg: 277589.29 / Max: 278355.03Min: 276929.5 / Avg: 277298.43 / Max: 277598.84Min: 276120.94 / Avg: 277260.22 / Max: 278442.19Min: 276369.16 / Avg: 277204.97 / Max: 278429.13Min: 274903.75 / Avg: 275472.07 / Max: 276050.06Min: 249970.92 / Avg: 251075.08 / Max: 251698.72Min: 249780.47 / Avg: 250695.32 / Max: 251153.11Min: 249192.2 / Avg: 250161.8 / Max: 251069.78Min: 249308.77 / Avg: 250023.76 / Max: 250565.361. (CC) gcc options: -pedantic -O3

ClickHouse

ClickHouse is an open-source, high performance OLAP data management system. This test profile uses ClickHouse's standard benchmark recommendations per https://clickhouse.com/docs/en/operations/performance-test/ / https://github.com/ClickHouse/ClickBench/tree/main/clickhouse with the 100 million rows web analytics dataset. The reported value is the query processing time using the geometric mean of all separate queries performed as an aggregate. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgQueries Per Minute, Geo Mean, More Is BetterClickHouse 22.12.3.5100M Rows Hits Dataset, Third RunEPYC 9684XEPYC 9654EPYC 9684X 2PEPYC 9654 2PXeon Platinum 8490H 2PXeon Max 9468 2PXeon Platinum 8490HXeon Max 9480Xeon Max 9480 2PXeon Max 9468EPYC 9754Xeon Platinum 8592+Xeon Platinum 8592+ 2PEPYC 9754 2PEPYC 8534PEPYC 8534PN130260390520650SE +/- 4.34, N = 3SE +/- 4.03, N = 3SE +/- 2.03, N = 3SE +/- 10.00, N = 3SE +/- 2.55, N = 3SE +/- 3.08, N = 3SE +/- 3.45, N = 3SE +/- 3.60, N = 3SE +/- 3.54, N = 12SE +/- 6.03, N = 3SE +/- 3.32, N = 3SE +/- 3.62, N = 6SE +/- 5.39, N = 5SE +/- 6.21, N = 5SE +/- 1.77, N = 3SE +/- 5.23, N = 3595.19559.55526.36525.23501.63501.07481.66476.91471.79470.02458.96458.23438.60427.95338.84335.46MIN: 62.05 / MAX: 5000MIN: 57.03 / MAX: 5000MIN: 91.05 / MAX: 6000MIN: 81.86 / MAX: 5000MIN: 64.45 / MAX: 6666.67MIN: 54.25 / MAX: 5000MIN: 40.16 / MAX: 5454.55MIN: 36.01 / MAX: 5000MIN: 53.43 / MAX: 6000MIN: 32.59 / MAX: 5454.55MIN: 68.65 / MAX: 4000MIN: 42.16 / MAX: 6000MIN: 58.2 / MAX: 6000MIN: 80.54 / MAX: 5454.55MIN: 35.76 / MAX: 4000MIN: 32.86 / MAX: 5454.55
OpenBenchmarking.orgQueries Per Minute, Geo Mean, More Is BetterClickHouse 22.12.3.5100M Rows Hits Dataset, Third RunEPYC 9684XEPYC 9654EPYC 9684X 2PEPYC 9654 2PXeon Platinum 8490H 2PXeon Max 9468 2PXeon Platinum 8490HXeon Max 9480Xeon Max 9480 2PXeon Max 9468EPYC 9754Xeon Platinum 8592+Xeon Platinum 8592+ 2PEPYC 9754 2PEPYC 8534PEPYC 8534PN110220330440550Min: 589.34 / Avg: 595.19 / Max: 603.68Min: 552.28 / Avg: 559.55 / Max: 566.2Min: 522.34 / Avg: 526.36 / Max: 528.82Min: 510.63 / Avg: 525.23 / Max: 544.36Min: 496.6 / Avg: 501.63 / Max: 504.9Min: 496.61 / Avg: 501.07 / Max: 506.98Min: 475.41 / Avg: 481.66 / Max: 487.3Min: 471.3 / Avg: 476.91 / Max: 483.63Min: 446.09 / Avg: 471.79 / Max: 491.73Min: 463.25 / Avg: 470.02 / Max: 482.06Min: 452.55 / Avg: 458.96 / Max: 463.63Min: 448.17 / Avg: 458.23 / Max: 470.76Min: 421.32 / Avg: 438.6 / Max: 447.62Min: 408.27 / Avg: 427.95 / Max: 444.06Min: 337.06 / Avg: 338.84 / Max: 342.38Min: 325.01 / Avg: 335.46 / Max: 341.15

OpenBenchmarking.orgQueries Per Minute, Geo Mean, More Is BetterClickHouse 22.12.3.5100M Rows Hits Dataset, Second RunEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9684X 2PXeon Platinum 8490H 2PXeon Max 9468 2PXeon Platinum 8490HXeon Max 9480Xeon Max 9480 2PXeon Max 9468Xeon Platinum 8592+EPYC 9754Xeon Platinum 8592+ 2PEPYC 9754 2PEPYC 8534PNEPYC 8534P130260390520650SE +/- 0.42, N = 3SE +/- 3.14, N = 3SE +/- 8.37, N = 3SE +/- 6.78, N = 3SE +/- 3.26, N = 3SE +/- 0.19, N = 3SE +/- 2.93, N = 3SE +/- 4.95, N = 3SE +/- 3.17, N = 12SE +/- 1.94, N = 3SE +/- 2.86, N = 6SE +/- 9.26, N = 3SE +/- 3.10, N = 5SE +/- 4.85, N = 5SE +/- 5.72, N = 3SE +/- 2.99, N = 3597.73562.50529.80528.21507.56499.18486.05474.68467.96465.06455.79450.12443.58420.35337.44337.32MIN: 61.41 / MAX: 5454.55MIN: 57.47 / MAX: 6666.67MIN: 86.08 / MAX: 5454.55MIN: 92.17 / MAX: 6000MIN: 66.45 / MAX: 5454.55MIN: 54.2 / MAX: 4615.38MIN: 40.43 / MAX: 6666.67MIN: 36.43 / MAX: 6000MIN: 52.36 / MAX: 6000MIN: 32.59 / MAX: 5000MIN: 42.19 / MAX: 6666.67MIN: 66.15 / MAX: 5454.55MIN: 62.43 / MAX: 6666.67MIN: 78.33 / MAX: 4285.71MIN: 33.44 / MAX: 4615.38MIN: 35.76 / MAX: 4000
OpenBenchmarking.orgQueries Per Minute, Geo Mean, More Is BetterClickHouse 22.12.3.5100M Rows Hits Dataset, Second RunEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9684X 2PXeon Platinum 8490H 2PXeon Max 9468 2PXeon Platinum 8490HXeon Max 9480Xeon Max 9480 2PXeon Max 9468Xeon Platinum 8592+EPYC 9754Xeon Platinum 8592+ 2PEPYC 9754 2PEPYC 8534PNEPYC 8534P110220330440550Min: 596.95 / Avg: 597.73 / Max: 598.4Min: 556.37 / Avg: 562.5 / Max: 566.71Min: 514.57 / Avg: 529.8 / Max: 543.43Min: 521.36 / Avg: 528.21 / Max: 541.76Min: 503.94 / Avg: 507.56 / Max: 514.07Min: 498.98 / Avg: 499.18 / Max: 499.57Min: 481.53 / Avg: 486.05 / Max: 491.55Min: 465.01 / Avg: 474.68 / Max: 481.39Min: 454.49 / Avg: 467.96 / Max: 490.02Min: 461.49 / Avg: 465.06 / Max: 468.18Min: 447.71 / Avg: 455.79 / Max: 463.66Min: 440.11 / Avg: 450.12 / Max: 468.63Min: 433.51 / Avg: 443.58 / Max: 451.39Min: 406.2 / Avg: 420.35 / Max: 435.49Min: 327.9 / Avg: 337.44 / Max: 347.68Min: 332.75 / Avg: 337.32 / Max: 342.95

OpenBenchmarking.orgQueries Per Minute, Geo Mean, More Is BetterClickHouse 22.12.3.5100M Rows Hits Dataset, First Run / Cold CacheEPYC 9684XEPYC 9654EPYC 9684X 2PEPYC 9654 2PXeon Max 9468 2PXeon Platinum 8490H 2PXeon Platinum 8490HXeon Max 9480Xeon Max 9480 2PXeon Max 9468Xeon Platinum 8592+EPYC 9754Xeon Platinum 8592+ 2PEPYC 9754 2PEPYC 8534PEPYC 8534PN120240360480600SE +/- 7.88, N = 3SE +/- 5.33, N = 3SE +/- 4.34, N = 3SE +/- 6.05, N = 3SE +/- 1.35, N = 3SE +/- 4.37, N = 3SE +/- 3.41, N = 3SE +/- 5.88, N = 3SE +/- 3.85, N = 12SE +/- 2.85, N = 3SE +/- 4.18, N = 6SE +/- 2.78, N = 3SE +/- 4.12, N = 5SE +/- 4.49, N = 5SE +/- 1.57, N = 3SE +/- 1.88, N = 3566.31536.82513.92504.84491.89485.63465.50461.62460.66446.40437.20433.79423.30411.26323.59322.69MIN: 59.64 / MAX: 5454.55MIN: 56.6 / MAX: 6666.67MIN: 84.87 / MAX: 5000MIN: 81.97 / MAX: 4615.38MIN: 51.86 / MAX: 5454.55MIN: 63.63 / MAX: 5000MIN: 40.93 / MAX: 5454.55MIN: 35.59 / MAX: 5454.55MIN: 53.62 / MAX: 5454.55MIN: 32.64 / MAX: 4615.38MIN: 41.7 / MAX: 5454.55MIN: 54.1 / MAX: 4285.71MIN: 61.54 / MAX: 6000MIN: 77.12 / MAX: 5000MIN: 35.69 / MAX: 3750MIN: 32.99 / MAX: 4000
OpenBenchmarking.orgQueries Per Minute, Geo Mean, More Is BetterClickHouse 22.12.3.5100M Rows Hits Dataset, First Run / Cold CacheEPYC 9684XEPYC 9654EPYC 9684X 2PEPYC 9654 2PXeon Max 9468 2PXeon Platinum 8490H 2PXeon Platinum 8490HXeon Max 9480Xeon Max 9480 2PXeon Max 9468Xeon Platinum 8592+EPYC 9754Xeon Platinum 8592+ 2PEPYC 9754 2PEPYC 8534PEPYC 8534PN100200300400500Min: 553.2 / Avg: 566.31 / Max: 580.42Min: 529.9 / Avg: 536.82 / Max: 547.31Min: 505.69 / Avg: 513.92 / Max: 520.39Min: 493.09 / Avg: 504.84 / Max: 513.2Min: 489.2 / Avg: 491.89 / Max: 493.37Min: 476.93 / Avg: 485.63 / Max: 490.74Min: 460.18 / Avg: 465.5 / Max: 471.85Min: 452.26 / Avg: 461.62 / Max: 472.47Min: 437.57 / Avg: 460.66 / Max: 481.51Min: 441.14 / Avg: 446.4 / Max: 450.91Min: 426.53 / Avg: 437.2 / Max: 455.19Min: 429.82 / Avg: 433.79 / Max: 439.16Min: 412.49 / Avg: 423.3 / Max: 437.55Min: 395.43 / Avg: 411.26 / Max: 420.76Min: 320.66 / Avg: 323.59 / Max: 326.03Min: 320.77 / Avg: 322.69 / Max: 326.45

Apache IoTDB

Apache IotDB is a time series database and this benchmark is facilitated using the IoT Benchmaark [https://github.com/thulab/iot-benchmark/]. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgAverage Latency, Fewer Is BetterApache IoTDB 1.2Device Count: 500 - Batch Size Per Write: 100 - Sensor Count: 800 - Client Number: 400EPYC 9684XEPYC 9654EPYC 9754EPYC 9654 2PEPYC 9684X 2PEPYC 8534PNEPYC 8534PEPYC 9754 2PXeon Platinum 8592+Xeon Platinum 8592+ 2PXeon Platinum 8490HXeon Max 9480Xeon Max 9468Xeon Platinum 8490H 2PXeon Max 9480 2PXeon Max 9468 2P70140210280350SE +/- 1.71, N = 3SE +/- 1.96, N = 3SE +/- 1.41, N = 3SE +/- 3.49, N = 3SE +/- 1.87, N = 3SE +/- 0.82, N = 3SE +/- 0.38, N = 3SE +/- 2.16, N = 15SE +/- 3.41, N = 3SE +/- 3.40, N = 12SE +/- 2.20, N = 3SE +/- 5.07, N = 3SE +/- 5.15, N = 3SE +/- 3.79, N = 8SE +/- 3.74, N = 12SE +/- 2.59, N = 12209.68211.85227.40240.43246.08251.05251.47253.13280.26286.78294.33309.03314.44317.36325.97328.41MAX: 26606.61MAX: 26989.76MAX: 26860.34MAX: 27651.54MAX: 27665.32MAX: 26590.2MAX: 26615.75MAX: 27854.54MAX: 27450.82MAX: 28496.67MAX: 27740.38MAX: 26720.06MAX: 27244.84MAX: 32341.07MAX: 30042.47MAX: 29309.84
OpenBenchmarking.orgAverage Latency, Fewer Is BetterApache IoTDB 1.2Device Count: 500 - Batch Size Per Write: 100 - Sensor Count: 800 - Client Number: 400EPYC 9684XEPYC 9654EPYC 9754EPYC 9654 2PEPYC 9684X 2PEPYC 8534PNEPYC 8534PEPYC 9754 2PXeon Platinum 8592+Xeon Platinum 8592+ 2PXeon Platinum 8490HXeon Max 9480Xeon Max 9468Xeon Platinum 8490H 2PXeon Max 9480 2PXeon Max 9468 2P60120180240300Min: 206.79 / Avg: 209.68 / Max: 212.72Min: 209.09 / Avg: 211.85 / Max: 215.64Min: 224.63 / Avg: 227.4 / Max: 229.19Min: 235.73 / Avg: 240.43 / Max: 247.25Min: 243.68 / Avg: 246.08 / Max: 249.77Min: 249.93 / Avg: 251.05 / Max: 252.65Min: 250.71 / Avg: 251.47 / Max: 251.88Min: 234.43 / Avg: 253.13 / Max: 276.08Min: 275.8 / Avg: 280.26 / Max: 286.97Min: 273.05 / Avg: 286.78 / Max: 316.89Min: 291.11 / Avg: 294.33 / Max: 298.54Min: 299.22 / Avg: 309.03 / Max: 316.14Min: 304.72 / Avg: 314.44 / Max: 322.26Min: 303.36 / Avg: 317.36 / Max: 331.83Min: 307.82 / Avg: 325.97 / Max: 354.99Min: 319.07 / Avg: 328.41 / Max: 347.44

OpenBenchmarking.orgpoint/sec, More Is BetterApache IoTDB 1.2Device Count: 500 - Batch Size Per Write: 100 - Sensor Count: 800 - Client Number: 400EPYC 9684XEPYC 9654EPYC 9754EPYC 9654 2PEPYC 9684X 2PEPYC 8534PEPYC 8534PNEPYC 9754 2PXeon Platinum 8592+Xeon Platinum 8592+ 2PXeon Platinum 8490HXeon Max 9480Xeon Max 9468Xeon Platinum 8490H 2PXeon Max 9480 2PXeon Max 9468 2P30M60M90M120M150MSE +/- 371659.60, N = 3SE +/- 255887.16, N = 3SE +/- 68559.13, N = 3SE +/- 1152766.29, N = 3SE +/- 353097.82, N = 3SE +/- 13050.78, N = 3SE +/- 412757.79, N = 3SE +/- 666882.79, N = 15SE +/- 746822.47, N = 3SE +/- 761276.42, N = 12SE +/- 308756.34, N = 3SE +/- 1037167.36, N = 3SE +/- 662950.65, N = 3SE +/- 692701.79, N = 8SE +/- 574699.97, N = 12SE +/- 565297.90, N = 121261610281255620601166853261088215801067783791054328621051385511036304839270975189231850877972068347564582455664801696207805772877501248
OpenBenchmarking.orgpoint/sec, More Is BetterApache IoTDB 1.2Device Count: 500 - Batch Size Per Write: 100 - Sensor Count: 800 - Client Number: 400EPYC 9684XEPYC 9654EPYC 9754EPYC 9654 2PEPYC 9684X 2PEPYC 8534PEPYC 8534PNEPYC 9754 2PXeon Platinum 8592+Xeon Platinum 8592+ 2PXeon Platinum 8490HXeon Max 9480Xeon Max 9468Xeon Platinum 8490H 2PXeon Max 9480 2PXeon Max 9468 2P20M40M60M80M100MMin: 125442601.6 / Avg: 126161028.23 / Max: 126685438.25Min: 125098980.22 / Avg: 125562059.83 / Max: 125982286.33Min: 116554610.8 / Avg: 116685326.23 / Max: 116786547.15Min: 107579184.73 / Avg: 108821579.72 / Max: 111124725.91Min: 106100515.69 / Avg: 106778378.88 / Max: 107288804.88Min: 105406900.51 / Avg: 105432861.63 / Max: 105448183.99Min: 104451785.05 / Avg: 105138551.23 / Max: 105878634.65Min: 96231160.7 / Avg: 103630482.84 / Max: 107455633.39Min: 91216839.59 / Avg: 92709751.24 / Max: 93496734.87Min: 81747205.1 / Avg: 89231850.46 / Max: 91854673.51Min: 87266472.46 / Avg: 87797206.07 / Max: 88335945.89Min: 81771445.11 / Avg: 83475644.71 / Max: 85351915.5Min: 81296689.33 / Avg: 82455664.42 / Max: 83592909.29Min: 76187205.81 / Avg: 80169620.06 / Max: 82023058.74Min: 73090909.99 / Avg: 78057727.65 / Max: 80034510.45Min: 73145472.62 / Avg: 77501248.16 / Max: 79015213.11

OpenRadioss

OpenRadioss is an open-source AGPL-licensed finite element solver for dynamic event analysis OpenRadioss is based on Altair Radioss and open-sourced in 2022. This open-source finite element solver is benchmarked with various example models available from https://www.openradioss.org/models/ and https://github.com/OpenRadioss/ModelExchange/tree/main/Examples. This test is currently using a reference OpenRadioss binary build offered via GitHub. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterOpenRadioss 2023.09.15Model: Chrysler Neon 1MEPYC 9684X 2PEPYC 9684XEPYC 9654 2PXeon Platinum 8592+ 2PEPYC 9754 2PXeon Platinum 8490H 2PXeon Max 9480 2PXeon Max 9468 2PXeon Platinum 8592+EPYC 9654Xeon Platinum 8490HXeon Max 9480Xeon Max 9468EPYC 9754EPYC 8534PEPYC 8534PN70140210280350SE +/- 0.46, N = 3SE +/- 0.49, N = 3SE +/- 0.71, N = 12SE +/- 0.14, N = 3SE +/- 1.00, N = 10SE +/- 0.11, N = 3SE +/- 0.14, N = 3SE +/- 0.13, N = 3SE +/- 0.20, N = 3SE +/- 1.51, N = 8SE +/- 0.15, N = 3SE +/- 0.18, N = 3SE +/- 0.08, N = 3SE +/- 1.11, N = 3SE +/- 0.47, N = 3SE +/- 0.50, N = 349.5577.3277.6486.9393.99115.89117.91125.15157.56176.14207.20212.99228.74231.96297.25300.69
OpenBenchmarking.orgSeconds, Fewer Is BetterOpenRadioss 2023.09.15Model: Chrysler Neon 1MEPYC 9684X 2PEPYC 9684XEPYC 9654 2PXeon Platinum 8592+ 2PEPYC 9754 2PXeon Platinum 8490H 2PXeon Max 9480 2PXeon Max 9468 2PXeon Platinum 8592+EPYC 9654Xeon Platinum 8490HXeon Max 9480Xeon Max 9468EPYC 9754EPYC 8534PEPYC 8534PN50100150200250Min: 48.8 / Avg: 49.55 / Max: 50.39Min: 76.77 / Avg: 77.32 / Max: 78.3Min: 69.97 / Avg: 77.64 / Max: 79.2Min: 86.78 / Avg: 86.93 / Max: 87.22Min: 85.32 / Avg: 93.99 / Max: 96.35Min: 115.68 / Avg: 115.89 / Max: 116.03Min: 117.77 / Avg: 117.91 / Max: 118.18Min: 124.93 / Avg: 125.15 / Max: 125.39Min: 157.21 / Avg: 157.56 / Max: 157.92Min: 166.67 / Avg: 176.14 / Max: 180.48Min: 207.03 / Avg: 207.2 / Max: 207.49Min: 212.71 / Avg: 212.99 / Max: 213.33Min: 228.6 / Avg: 228.74 / Max: 228.86Min: 229.74 / Avg: 231.96 / Max: 233.14Min: 296.35 / Avg: 297.25 / Max: 297.96Min: 300.16 / Avg: 300.69 / Max: 301.69

Timed Gem5 Compilation

This test times how long it takes to compile Gem5. Gem5 is a simulator for computer system architecture research. Gem5 is widely used for computer architecture research within the industry, academia, and more. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed Gem5 Compilation 23.0.1Time To CompileXeon Platinum 8592+ 2PEPYC 9684X 2PEPYC 9654 2PEPYC 9684XXeon Platinum 8490H 2PXeon Max 9480 2PXeon Max 9468 2PEPYC 9654Xeon Platinum 8592+EPYC 9754 2PXeon Platinum 8490HEPYC 9754Xeon Max 9480Xeon Max 9468EPYC 8534PEPYC 8534PN50100150200250SE +/- 0.89, N = 3SE +/- 1.16, N = 3SE +/- 0.72, N = 3SE +/- 2.15, N = 3SE +/- 0.58, N = 3SE +/- 1.01, N = 3SE +/- 1.72, N = 3SE +/- 2.24, N = 4SE +/- 2.17, N = 3SE +/- 1.73, N = 3SE +/- 0.92, N = 3SE +/- 1.88, N = 3SE +/- 2.11, N = 6SE +/- 2.59, N = 4SE +/- 1.99, N = 9SE +/- 0.97, N = 3157.36161.94164.90176.88178.28181.63184.30185.30187.51192.98210.93212.55215.50220.57242.93251.61
OpenBenchmarking.orgSeconds, Fewer Is BetterTimed Gem5 Compilation 23.0.1Time To CompileXeon Platinum 8592+ 2PEPYC 9684X 2PEPYC 9654 2PEPYC 9684XXeon Platinum 8490H 2PXeon Max 9480 2PXeon Max 9468 2PEPYC 9654Xeon Platinum 8592+EPYC 9754 2PXeon Platinum 8490HEPYC 9754Xeon Max 9480Xeon Max 9468EPYC 8534PEPYC 8534PN50100150200250Min: 155.58 / Avg: 157.36 / Max: 158.28Min: 159.72 / Avg: 161.94 / Max: 163.63Min: 163.64 / Avg: 164.9 / Max: 166.13Min: 172.74 / Avg: 176.88 / Max: 179.95Min: 177.28 / Avg: 178.28 / Max: 179.29Min: 180.13 / Avg: 181.63 / Max: 183.54Min: 180.87 / Avg: 184.3 / Max: 186.22Min: 178.6 / Avg: 185.3 / Max: 188.11Min: 183.17 / Avg: 187.51 / Max: 189.86Min: 189.51 / Avg: 192.98 / Max: 194.8Min: 209.09 / Avg: 210.93 / Max: 211.86Min: 209.34 / Avg: 212.55 / Max: 215.87Min: 207.83 / Avg: 215.5 / Max: 219.52Min: 215.31 / Avg: 220.57 / Max: 225.44Min: 233.72 / Avg: 242.93 / Max: 249.42Min: 249.77 / Avg: 251.61 / Max: 253.04

NAMD

NAMD is a parallel molecular dynamics code designed for high-performance simulation of large biomolecular systems. NAMD was developed by the Theoretical and Computational Biophysics Group in the Beckman Institute for Advanced Science and Technology at the University of Illinois at Urbana-Champaign. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgns/day, More Is BetterNAMD 3.0b6Input: STMV with 1,066,628 AtomsEPYC 9684X 2PEPYC 9754 2PEPYC 9654 2PEPYC 9684XEPYC 9754EPYC 9654Xeon Platinum 8592+ 2PXeon Max 9468 2PXeon Max 9480 2PEPYC 8534PXeon Max 9480EPYC 8534PNXeon Max 9468Xeon Platinum 8592+Xeon Platinum 8490H 2PXeon Platinum 8490H246810SE +/- 0.01739, N = 3SE +/- 0.00332, N = 3SE +/- 0.02927, N = 3SE +/- 0.00206, N = 3SE +/- 0.00847, N = 3SE +/- 0.00537, N = 3SE +/- 0.08185, N = 13SE +/- 0.05644, N = 12SE +/- 0.05463, N = 15SE +/- 0.00440, N = 3SE +/- 0.05862, N = 15SE +/- 0.00540, N = 3SE +/- 0.05087, N = 15SE +/- 0.02648, N = 15SE +/- 0.04403, N = 15SE +/- 0.01396, N = 156.383435.836065.278393.410852.888692.878772.254221.886791.767781.519011.502141.461631.452231.437871.109001.05274
OpenBenchmarking.orgns/day, More Is BetterNAMD 3.0b6Input: STMV with 1,066,628 AtomsEPYC 9684X 2PEPYC 9754 2PEPYC 9654 2PEPYC 9684XEPYC 9754EPYC 9654Xeon Platinum 8592+ 2PXeon Max 9468 2PXeon Max 9480 2PEPYC 8534PXeon Max 9480EPYC 8534PNXeon Max 9468Xeon Platinum 8592+Xeon Platinum 8490H 2PXeon Platinum 8490H3691215Min: 6.36 / Avg: 6.38 / Max: 6.42Min: 5.83 / Avg: 5.84 / Max: 5.84Min: 5.22 / Avg: 5.28 / Max: 5.31Min: 3.41 / Avg: 3.41 / Max: 3.41Min: 2.88 / Avg: 2.89 / Max: 2.91Min: 2.87 / Avg: 2.88 / Max: 2.89Min: 1.76 / Avg: 2.25 / Max: 2.78Min: 1.63 / Avg: 1.89 / Max: 2.23Min: 1.49 / Avg: 1.77 / Max: 2.29Min: 1.51 / Avg: 1.52 / Max: 1.53Min: 1.09 / Avg: 1.5 / Max: 1.84Min: 1.45 / Avg: 1.46 / Max: 1.47Min: 1.15 / Avg: 1.45 / Max: 1.75Min: 1.23 / Avg: 1.44 / Max: 1.61Min: 0.9 / Avg: 1.11 / Max: 1.44Min: 0.97 / Avg: 1.05 / Max: 1.14

ONNX Runtime

ONNX Runtime is developed by Microsoft and partners as a open-source, cross-platform, high performance machine learning inferencing and training accelerator. This test profile runs the ONNX Runtime with various models available from the ONNX Model Zoo. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgInference Time Cost (ms), Fewer Is BetterONNX Runtime 1.17Model: fcn-resnet101-11 - Device: CPU - Executor: StandardXeon Platinum 8490H 2PXeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Max 9468 2PXeon Max 9480 2PXeon Max 9468Xeon Max 9480EPYC 9754EPYC 9684XEPYC 9654EPYC 9684X 2PEPYC 9754 2PEPYC 8534PEPYC 9654 2PEPYC 8534PN50100150200250SE +/- 0.69, N = 15SE +/- 0.44, N = 3SE +/- 0.71, N = 3SE +/- 0.09, N = 3SE +/- 5.82, N = 12SE +/- 2.59, N = 15SE +/- 3.36, N = 15SE +/- 6.41, N = 15SE +/- 2.29, N = 15SE +/- 4.76, N = 12SE +/- 4.84, N = 15SE +/- 2.18, N = 15SE +/- 2.91, N = 3SE +/- 6.87, N = 12SE +/- 0.35, N = 3SE +/- 7.19, N = 1592.35100.74109.67116.32121.67121.78139.10155.79166.79178.03182.02182.27203.57216.70220.35226.631. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt
OpenBenchmarking.orgInference Time Cost (ms), Fewer Is BetterONNX Runtime 1.17Model: fcn-resnet101-11 - Device: CPU - Executor: StandardXeon Platinum 8490H 2PXeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Max 9468 2PXeon Max 9480 2PXeon Max 9468Xeon Max 9480EPYC 9754EPYC 9684XEPYC 9654EPYC 9684X 2PEPYC 9754 2PEPYC 8534PEPYC 9654 2PEPYC 8534PN4080120160200Min: 90.31 / Avg: 92.35 / Max: 100.18Min: 100.26 / Avg: 100.74 / Max: 101.61Min: 108.91 / Avg: 109.67 / Max: 111.08Min: 116.18 / Avg: 116.31 / Max: 116.48Min: 104.92 / Avg: 121.67 / Max: 167.8Min: 111.99 / Avg: 121.78 / Max: 145.67Min: 126.21 / Avg: 139.1 / Max: 173.52Min: 134.46 / Avg: 155.79 / Max: 211.84Min: 151.61 / Avg: 166.79 / Max: 175.8Min: 151.51 / Avg: 178.03 / Max: 194.09Min: 159.17 / Avg: 182.02 / Max: 203.06Min: 172.07 / Avg: 182.27 / Max: 200.42Min: 198.53 / Avg: 203.57 / Max: 208.6Min: 190.46 / Avg: 216.7 / Max: 246.51Min: 219.86 / Avg: 220.35 / Max: 221.03Min: 210.35 / Avg: 226.63 / Max: 296.481. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.17Model: fcn-resnet101-11 - Device: CPU - Executor: StandardXeon Platinum 8490H 2PXeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Max 9468 2PXeon Max 9480 2PXeon Max 9468Xeon Max 9480EPYC 9754EPYC 9684XEPYC 9654EPYC 9684X 2PEPYC 9754 2PEPYC 8534PEPYC 9654 2PEPYC 8534PN3691215SE +/- 0.07619, N = 15SE +/- 0.04271, N = 3SE +/- 0.05824, N = 3SE +/- 0.00664, N = 3SE +/- 0.34632, N = 12SE +/- 0.16487, N = 15SE +/- 0.15651, N = 15SE +/- 0.22869, N = 15SE +/- 0.08489, N = 15SE +/- 0.16422, N = 12SE +/- 0.15150, N = 15SE +/- 0.06453, N = 15SE +/- 0.07023, N = 3SE +/- 0.14467, N = 12SE +/- 0.00718, N = 3SE +/- 0.11914, N = 1510.836239.926849.118858.597198.399628.260167.241876.549656.011645.665085.550185.497114.914204.664914.538174.465331. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt
OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.17Model: fcn-resnet101-11 - Device: CPU - Executor: StandardXeon Platinum 8490H 2PXeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Max 9468 2PXeon Max 9480 2PXeon Max 9468Xeon Max 9480EPYC 9754EPYC 9684XEPYC 9654EPYC 9684X 2PEPYC 9754 2PEPYC 8534PEPYC 9654 2PEPYC 8534PN3691215Min: 9.98 / Avg: 10.84 / Max: 11.07Min: 9.84 / Avg: 9.93 / Max: 9.97Min: 9 / Avg: 9.12 / Max: 9.18Min: 8.58 / Avg: 8.6 / Max: 8.61Min: 5.96 / Avg: 8.4 / Max: 9.53Min: 6.86 / Avg: 8.26 / Max: 8.93Min: 5.76 / Avg: 7.24 / Max: 7.92Min: 4.72 / Avg: 6.55 / Max: 7.44Min: 5.69 / Avg: 6.01 / Max: 6.6Min: 5.15 / Avg: 5.67 / Max: 6.6Min: 4.92 / Avg: 5.55 / Max: 6.28Min: 4.99 / Avg: 5.5 / Max: 5.81Min: 4.79 / Avg: 4.91 / Max: 5.04Min: 4.06 / Avg: 4.66 / Max: 5.25Min: 4.52 / Avg: 4.54 / Max: 4.55Min: 3.37 / Avg: 4.47 / Max: 4.751. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

LAMMPS Molecular Dynamics Simulator

LAMMPS is a classical molecular dynamics code, and an acronym for Large-scale Atomic/Molecular Massively Parallel Simulator. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgns/day, More Is BetterLAMMPS Molecular Dynamics Simulator 23Jun2022Model: 20k AtomsEPYC 9684X 2PEPYC 9754 2PEPYC 9654 2PXeon Platinum 8592+ 2PXeon Max 9480 2PXeon Platinum 8490H 2PEPYC 9754EPYC 9684XXeon Max 9468 2PEPYC 9654Xeon Platinum 8592+Xeon Platinum 8490HXeon Max 9480Xeon Max 9468EPYC 8534PEPYC 8534PN1428425670SE +/- 0.12, N = 3SE +/- 0.13, N = 3SE +/- 0.13, N = 3SE +/- 0.04, N = 3SE +/- 0.05, N = 3SE +/- 0.01, N = 3SE +/- 0.19, N = 3SE +/- 0.30, N = 3SE +/- 0.07, N = 3SE +/- 0.12, N = 3SE +/- 0.02, N = 3SE +/- 0.04, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.02, N = 3SE +/- 0.02, N = 362.0058.8457.1056.4051.8250.5247.9946.8946.7142.5137.4634.8932.1628.2827.5325.331. (CXX) g++ options: -O3 -lm -ldl
OpenBenchmarking.orgns/day, More Is BetterLAMMPS Molecular Dynamics Simulator 23Jun2022Model: 20k AtomsEPYC 9684X 2PEPYC 9754 2PEPYC 9654 2PXeon Platinum 8592+ 2PXeon Max 9480 2PXeon Platinum 8490H 2PEPYC 9754EPYC 9684XXeon Max 9468 2PEPYC 9654Xeon Platinum 8592+Xeon Platinum 8490HXeon Max 9480Xeon Max 9468EPYC 8534PEPYC 8534PN1224364860Min: 61.77 / Avg: 62 / Max: 62.17Min: 58.61 / Avg: 58.84 / Max: 59.04Min: 56.91 / Avg: 57.1 / Max: 57.36Min: 56.35 / Avg: 56.4 / Max: 56.48Min: 51.72 / Avg: 51.82 / Max: 51.89Min: 50.5 / Avg: 50.52 / Max: 50.54Min: 47.71 / Avg: 47.99 / Max: 48.35Min: 46.3 / Avg: 46.89 / Max: 47.27Min: 46.61 / Avg: 46.71 / Max: 46.84Min: 42.26 / Avg: 42.51 / Max: 42.63Min: 37.42 / Avg: 37.46 / Max: 37.49Min: 34.81 / Avg: 34.89 / Max: 34.94Min: 32.15 / Avg: 32.16 / Max: 32.17Min: 28.26 / Avg: 28.28 / Max: 28.29Min: 27.5 / Avg: 27.53 / Max: 27.57Min: 25.29 / Avg: 25.33 / Max: 25.361. (CXX) g++ options: -O3 -lm -ldl

TensorFlow

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.16.1Device: CPU - Batch Size: 512 - Model: GoogLeNetEPYC 9754 2PXeon Platinum 8592+ 2PXeon Platinum 8490H 2PEPYC 9654 2PXeon Max 9480 2PEPYC 9654Xeon Max 9468 2PEPYC 9684X 2PXeon Platinum 8592+Xeon Platinum 8490HEPYC 9754EPYC 9684XXeon Max 9480Xeon Max 9468EPYC 8534PEPYC 8534PN130260390520650SE +/- 5.63, N = 6SE +/- 1.52, N = 3SE +/- 2.62, N = 3SE +/- 5.11, N = 3SE +/- 2.46, N = 3SE +/- 4.02, N = 10SE +/- 1.14, N = 3SE +/- 1.60, N = 3SE +/- 3.68, N = 3SE +/- 0.34, N = 3SE +/- 12.03, N = 12SE +/- 3.05, N = 12SE +/- 0.37, N = 3SE +/- 0.41, N = 3SE +/- 0.06, N = 3SE +/- 0.03, N = 3588.43577.76576.08525.84477.33470.95467.91464.78462.78461.23450.61425.25398.40383.57313.50295.29
OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.16.1Device: CPU - Batch Size: 512 - Model: GoogLeNetEPYC 9754 2PXeon Platinum 8592+ 2PXeon Platinum 8490H 2PEPYC 9654 2PXeon Max 9480 2PEPYC 9654Xeon Max 9468 2PEPYC 9684X 2PXeon Platinum 8592+Xeon Platinum 8490HEPYC 9754EPYC 9684XXeon Max 9480Xeon Max 9468EPYC 8534PEPYC 8534PN100200300400500Min: 573.12 / Avg: 588.43 / Max: 606.36Min: 575.91 / Avg: 577.76 / Max: 580.78Min: 572.84 / Avg: 576.08 / Max: 581.26Min: 517.73 / Avg: 525.84 / Max: 535.28Min: 473.08 / Avg: 477.33 / Max: 481.61Min: 449.01 / Avg: 470.95 / Max: 501.08Min: 465.67 / Avg: 467.91 / Max: 469.37Min: 462.49 / Avg: 464.78 / Max: 467.85Min: 455.42 / Avg: 462.78 / Max: 466.49Min: 460.79 / Avg: 461.23 / Max: 461.9Min: 432.94 / Avg: 450.61 / Max: 582.08Min: 417.27 / Avg: 425.25 / Max: 457.11Min: 397.73 / Avg: 398.4 / Max: 398.99Min: 382.75 / Avg: 383.57 / Max: 384.07Min: 313.38 / Avg: 313.5 / Max: 313.6Min: 295.24 / Avg: 295.29 / Max: 295.35

LuxCoreRender

LuxCoreRender is an open-source 3D physically based renderer formerly known as LuxRender. LuxCoreRender supports CPU-based rendering as well as GPU acceleration via OpenCL, NVIDIA CUDA, and NVIDIA OptiX interfaces. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgM samples/sec, More Is BetterLuxCoreRender 2.6Scene: DLSC - Acceleration: CPUEPYC 9684X 2PEPYC 9754 2PEPYC 9654 2PEPYC 9754EPYC 9684XEPYC 9654Xeon Platinum 8592+ 2PXeon Platinum 8490H 2PXeon Max 9480 2PXeon Max 9468 2PEPYC 8534PXeon Platinum 8592+Xeon Platinum 8490HEPYC 8534PNXeon Max 9480Xeon Max 9468510152025SE +/- 0.91, N = 15SE +/- 1.02, N = 15SE +/- 0.12, N = 3SE +/- 0.28, N = 15SE +/- 0.18, N = 15SE +/- 0.13, N = 3SE +/- 0.24, N = 15SE +/- 0.23, N = 15SE +/- 0.20, N = 15SE +/- 0.12, N = 3SE +/- 0.06, N = 15SE +/- 0.02, N = 3SE +/- 0.06, N = 15SE +/- 0.03, N = 3SE +/- 0.10, N = 3SE +/- 0.08, N = 322.5822.0017.8916.7916.2114.2912.7411.1210.4410.179.399.388.728.488.007.46MIN: 17.46 / MAX: 32.78MIN: 16.32 / MAX: 35.07MIN: 16.29 / MAX: 28.22MIN: 15.23 / MAX: 21.36MIN: 15.2 / MAX: 19.13MIN: 13.78 / MAX: 17.04MIN: 10.69 / MAX: 19.19MIN: 9.18 / MAX: 17.51MIN: 8.86 / MAX: 16.08MIN: 9.34 / MAX: 14.75MIN: 8.9 / MAX: 10.42MIN: 8.94 / MAX: 11.49MIN: 8.12 / MAX: 10.6MIN: 8.26 / MAX: 9.41MIN: 7.65 / MAX: 9.12MIN: 7.17 / MAX: 8.21
OpenBenchmarking.orgM samples/sec, More Is BetterLuxCoreRender 2.6Scene: DLSC - Acceleration: CPUEPYC 9684X 2PEPYC 9754 2PEPYC 9654 2PEPYC 9754EPYC 9684XEPYC 9654Xeon Platinum 8592+ 2PXeon Platinum 8490H 2PXeon Max 9480 2PXeon Max 9468 2PEPYC 8534PXeon Platinum 8592+Xeon Platinum 8490HEPYC 8534PNXeon Max 9480Xeon Max 9468510152025Min: 18.97 / Avg: 22.58 / Max: 26.51Min: 18.37 / Avg: 22 / Max: 26.92Min: 17.67 / Avg: 17.89 / Max: 18.1Min: 15.95 / Avg: 16.79 / Max: 18.93Min: 15.68 / Avg: 16.21 / Max: 17.34Min: 14.16 / Avg: 14.29 / Max: 14.55Min: 11.63 / Avg: 12.74 / Max: 14.1Min: 10.06 / Avg: 11.12 / Max: 12.79Min: 9.65 / Avg: 10.44 / Max: 12.26Min: 9.93 / Avg: 10.17 / Max: 10.3Min: 9.12 / Avg: 9.39 / Max: 9.66Min: 9.35 / Avg: 9.38 / Max: 9.4Min: 8.48 / Avg: 8.72 / Max: 9.03Min: 8.43 / Avg: 8.48 / Max: 8.51Min: 7.87 / Avg: 8 / Max: 8.2Min: 7.31 / Avg: 7.46 / Max: 7.54

Timed Node.js Compilation

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed Node.js Compilation 21.7.2Time To CompileEPYC 9684X 2PEPYC 9654 2PXeon Platinum 8592+ 2PEPYC 9754 2PEPYC 9684XEPYC 9654Xeon Max 9480 2PXeon Platinum 8490H 2PXeon Max 9468 2PEPYC 9754Xeon Platinum 8592+Xeon Max 9480Xeon Platinum 8490HXeon Max 9468EPYC 8534PEPYC 8534PN60120180240300SE +/- 1.19, N = 3SE +/- 0.18, N = 3SE +/- 0.12, N = 3SE +/- 1.51, N = 3SE +/- 0.50, N = 3SE +/- 0.59, N = 3SE +/- 0.52, N = 3SE +/- 0.48, N = 3SE +/- 0.84, N = 3SE +/- 0.72, N = 3SE +/- 0.52, N = 3SE +/- 0.74, N = 3SE +/- 0.71, N = 3SE +/- 0.53, N = 3SE +/- 0.17, N = 3SE +/- 0.19, N = 3114.91118.90145.41147.74147.84164.02171.17172.99175.63186.10214.43252.65254.00270.38277.53288.12
OpenBenchmarking.orgSeconds, Fewer Is BetterTimed Node.js Compilation 21.7.2Time To CompileEPYC 9684X 2PEPYC 9654 2PXeon Platinum 8592+ 2PEPYC 9754 2PEPYC 9684XEPYC 9654Xeon Max 9480 2PXeon Platinum 8490H 2PXeon Max 9468 2PEPYC 9754Xeon Platinum 8592+Xeon Max 9480Xeon Platinum 8490HXeon Max 9468EPYC 8534PEPYC 8534PN50100150200250Min: 112.53 / Avg: 114.91 / Max: 116.19Min: 118.61 / Avg: 118.9 / Max: 119.22Min: 145.21 / Avg: 145.41 / Max: 145.61Min: 145.49 / Avg: 147.74 / Max: 150.62Min: 146.87 / Avg: 147.84 / Max: 148.55Min: 162.92 / Avg: 164.02 / Max: 164.95Min: 170.52 / Avg: 171.17 / Max: 172.21Min: 172.43 / Avg: 172.99 / Max: 173.95Min: 174.7 / Avg: 175.63 / Max: 177.31Min: 185.05 / Avg: 186.1 / Max: 187.47Min: 213.49 / Avg: 214.43 / Max: 215.29Min: 251.27 / Avg: 252.65 / Max: 253.82Min: 253.22 / Avg: 254 / Max: 255.43Min: 269.34 / Avg: 270.38 / Max: 271.1Min: 277.32 / Avg: 277.52 / Max: 277.86Min: 287.75 / Avg: 288.12 / Max: 288.35

PostgreSQL

This is a benchmark of PostgreSQL using the integrated pgbench for facilitating the database benchmarks. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgms, Fewer Is BetterPostgreSQL 16Scaling Factor: 100 - Clients: 1000 - Mode: Read Write - Average LatencyEPYC 9654EPYC 9684XXeon Platinum 8592+EPYC 9754Xeon Max 9480Xeon Platinum 8490HXeon Max 9468Xeon Platinum 8490H 2PEPYC 8534PXeon Max 9480 2PEPYC 9754 2PXeon Max 9468 2PEPYC 8534PNEPYC 9654 2PEPYC 9684X 2PXeon Platinum 8592+ 2P714212835SE +/- 0.04, N = 3SE +/- 0.01, N = 3SE +/- 0.04, N = 3SE +/- 0.05, N = 3SE +/- 0.03, N = 3SE +/- 0.02, N = 3SE +/- 0.02, N = 3SE +/- 0.03, N = 3SE +/- 0.05, N = 3SE +/- 0.12, N = 3SE +/- 0.02, N = 3SE +/- 0.06, N = 3SE +/- 0.10, N = 3SE +/- 0.25, N = 12SE +/- 0.32, N = 12SE +/- 0.10, N = 312.5012.5813.2613.8413.8514.0414.2914.8616.3216.6616.8816.9618.0518.0618.1630.201. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm
OpenBenchmarking.orgms, Fewer Is BetterPostgreSQL 16Scaling Factor: 100 - Clients: 1000 - Mode: Read Write - Average LatencyEPYC 9654EPYC 9684XXeon Platinum 8592+EPYC 9754Xeon Max 9480Xeon Platinum 8490HXeon Max 9468Xeon Platinum 8490H 2PEPYC 8534PXeon Max 9480 2PEPYC 9754 2PXeon Max 9468 2PEPYC 8534PNEPYC 9654 2PEPYC 9684X 2PXeon Platinum 8592+ 2P714212835Min: 12.45 / Avg: 12.5 / Max: 12.57Min: 12.56 / Avg: 12.58 / Max: 12.61Min: 13.22 / Avg: 13.26 / Max: 13.33Min: 13.76 / Avg: 13.84 / Max: 13.92Min: 13.81 / Avg: 13.85 / Max: 13.9Min: 14.01 / Avg: 14.04 / Max: 14.06Min: 14.27 / Avg: 14.29 / Max: 14.33Min: 14.8 / Avg: 14.86 / Max: 14.89Min: 16.27 / Avg: 16.32 / Max: 16.41Min: 16.43 / Avg: 16.66 / Max: 16.85Min: 16.86 / Avg: 16.88 / Max: 16.92Min: 16.87 / Avg: 16.96 / Max: 17.07Min: 17.86 / Avg: 18.05 / Max: 18.18Min: 15.49 / Avg: 18.06 / Max: 18.58Min: 15.56 / Avg: 18.16 / Max: 18.93Min: 30.02 / Avg: 30.2 / Max: 30.351. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm

OpenBenchmarking.orgTPS, More Is BetterPostgreSQL 16Scaling Factor: 100 - Clients: 1000 - Mode: Read WriteEPYC 9654EPYC 9684XXeon Platinum 8592+EPYC 9754Xeon Max 9480Xeon Platinum 8490HXeon Max 9468Xeon Platinum 8490H 2PEPYC 8534PXeon Max 9480 2PEPYC 9754 2PXeon Max 9468 2PEPYC 9654 2PEPYC 8534PNEPYC 9684X 2PXeon Platinum 8592+ 2P20K40K60K80K100KSE +/- 232.97, N = 3SE +/- 87.23, N = 3SE +/- 198.41, N = 3SE +/- 242.45, N = 3SE +/- 143.25, N = 3SE +/- 78.02, N = 3SE +/- 95.84, N = 3SE +/- 137.82, N = 3SE +/- 175.33, N = 3SE +/- 440.63, N = 3SE +/- 58.85, N = 3SE +/- 195.77, N = 3SE +/- 865.71, N = 12SE +/- 299.71, N = 3SE +/- 1059.49, N = 12SE +/- 106.16, N = 3799877949275396722447222571227699696731561272600465922858952555055539555272331101. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm
OpenBenchmarking.orgTPS, More Is BetterPostgreSQL 16Scaling Factor: 100 - Clients: 1000 - Mode: Read WriteEPYC 9654EPYC 9684XXeon Platinum 8592+EPYC 9754Xeon Max 9480Xeon Platinum 8490HXeon Max 9468Xeon Platinum 8490H 2PEPYC 8534PXeon Max 9480 2PEPYC 9754 2PXeon Max 9468 2PEPYC 9654 2PEPYC 8534PNEPYC 9684X 2PXeon Platinum 8592+ 2P14K28K42K56K70KMin: 79552.17 / Avg: 79987.17 / Max: 80349.25Min: 79318.11 / Avg: 79491.85 / Max: 79592.38Min: 75004.67 / Avg: 75396.07 / Max: 75648.36Min: 71830.32 / Avg: 72243.51 / Max: 72669.9Min: 71942.13 / Avg: 72225.43 / Max: 72404.01Min: 71104.9 / Avg: 71227.06 / Max: 71372.21Min: 69776.9 / Avg: 69968.58 / Max: 70064.85Min: 67177.04 / Avg: 67315.11 / Max: 67590.75Min: 60921.84 / Avg: 61271.68 / Max: 61467.49Min: 59344.37 / Avg: 60046.43 / Max: 60858.76Min: 59119.84 / Avg: 59227.63 / Max: 59322.48Min: 58590 / Avg: 58952.17 / Max: 59262.11Min: 53832.46 / Avg: 55505.05 / Max: 64541.8Min: 55003.55 / Avg: 55394.65 / Max: 55983.59Min: 52840.38 / Avg: 55272 / Max: 64270.3Min: 32945.41 / Avg: 33110.04 / Max: 33308.471. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm

ONNX Runtime

ONNX Runtime is developed by Microsoft and partners as a open-source, cross-platform, high performance machine learning inferencing and training accelerator. This test profile runs the ONNX Runtime with various models available from the ONNX Model Zoo. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgInference Time Cost (ms), Fewer Is BetterONNX Runtime 1.17Model: Faster R-CNN R-50-FPN-int8 - Device: CPU - Executor: StandardEPYC 9684XEPYC 9684X 2PEPYC 9654EPYC 9654 2PEPYC 9754EPYC 8534PNEPYC 9754 2PEPYC 8534PXeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9480Xeon Max 9480 2PXeon Max 9468 2P816243240SE +/- 0.61, N = 15SE +/- 0.40, N = 15SE +/- 0.50, N = 15SE +/- 0.61, N = 15SE +/- 0.45, N = 15SE +/- 0.61, N = 15SE +/- 0.23, N = 15SE +/- 0.63, N = 15SE +/- 0.09, N = 3SE +/- 0.09, N = 3SE +/- 0.04, N = 3SE +/- 0.12, N = 3SE +/- 0.11, N = 3SE +/- 0.31, N = 3SE +/- 0.33, N = 3SE +/- 0.40, N = 321.5822.7923.9225.3226.4526.8327.9027.9328.8529.0229.4129.7533.3333.9936.0036.231. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt
OpenBenchmarking.orgInference Time Cost (ms), Fewer Is BetterONNX Runtime 1.17Model: Faster R-CNN R-50-FPN-int8 - Device: CPU - Executor: StandardEPYC 9684XEPYC 9684X 2PEPYC 9654EPYC 9654 2PEPYC 9754EPYC 8534PNEPYC 9754 2PEPYC 8534PXeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9480Xeon Max 9480 2PXeon Max 9468 2P816243240Min: 18.79 / Avg: 21.58 / Max: 23.88Min: 20.9 / Avg: 22.79 / Max: 24.76Min: 20.98 / Avg: 23.92 / Max: 25.93Min: 23.13 / Avg: 25.32 / Max: 28.47Min: 24.64 / Avg: 26.45 / Max: 29.86Min: 24.43 / Avg: 26.83 / Max: 30.1Min: 26.96 / Avg: 27.9 / Max: 30.68Min: 24.1 / Avg: 27.93 / Max: 29.83Min: 28.67 / Avg: 28.85 / Max: 28.95Min: 28.87 / Avg: 29.02 / Max: 29.17Min: 29.33 / Avg: 29.41 / Max: 29.45Min: 29.52 / Avg: 29.75 / Max: 29.9Min: 33.13 / Avg: 33.33 / Max: 33.49Min: 33.37 / Avg: 33.99 / Max: 34.35Min: 35.37 / Avg: 36 / Max: 36.49Min: 35.77 / Avg: 36.23 / Max: 37.041. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.17Model: Faster R-CNN R-50-FPN-int8 - Device: CPU - Executor: StandardEPYC 9684XEPYC 9684X 2PEPYC 9654EPYC 9654 2PEPYC 9754EPYC 8534PNEPYC 8534PEPYC 9754 2PXeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9480Xeon Max 9480 2PXeon Max 9468 2P1122334455SE +/- 1.36, N = 15SE +/- 0.76, N = 15SE +/- 0.91, N = 15SE +/- 0.92, N = 15SE +/- 0.63, N = 15SE +/- 0.82, N = 15SE +/- 0.87, N = 15SE +/- 0.27, N = 15SE +/- 0.11, N = 3SE +/- 0.10, N = 3SE +/- 0.05, N = 3SE +/- 0.13, N = 3SE +/- 0.09, N = 3SE +/- 0.27, N = 3SE +/- 0.26, N = 3SE +/- 0.31, N = 346.8844.0642.0739.8037.9637.5336.0835.8734.6634.4634.0033.6130.0029.4327.7827.611. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt
OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.17Model: Faster R-CNN R-50-FPN-int8 - Device: CPU - Executor: StandardEPYC 9684XEPYC 9684X 2PEPYC 9654EPYC 9654 2PEPYC 9754EPYC 8534PNEPYC 8534PEPYC 9754 2PXeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9480Xeon Max 9480 2PXeon Max 9468 2P1020304050Min: 41.88 / Avg: 46.88 / Max: 53.22Min: 40.38 / Avg: 44.06 / Max: 47.85Min: 38.57 / Avg: 42.07 / Max: 47.67Min: 35.13 / Avg: 39.8 / Max: 43.23Min: 33.49 / Avg: 37.96 / Max: 40.59Min: 33.22 / Avg: 37.53 / Max: 40.92Min: 33.51 / Avg: 36.08 / Max: 41.49Min: 32.59 / Avg: 35.87 / Max: 37.09Min: 34.55 / Avg: 34.66 / Max: 34.88Min: 34.28 / Avg: 34.46 / Max: 34.63Min: 33.95 / Avg: 34 / Max: 34.09Min: 33.44 / Avg: 33.61 / Max: 33.87Min: 29.86 / Avg: 30 / Max: 30.18Min: 29.11 / Avg: 29.42 / Max: 29.97Min: 27.4 / Avg: 27.78 / Max: 28.27Min: 27 / Avg: 27.61 / Max: 27.951. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

OpenSSL

OpenBenchmarking.orgbyte/s, More Is BetterOpenSSL 3.3Algorithm: AES-128-GCMEPYC 9754 2PEPYC 9684X 2PEPYC 9654 2PXeon Platinum 8592+ 2PXeon Platinum 8490H 2PXeon Max 9480 2PXeon Max 9468 2PEPYC 9754EPYC 9684XEPYC 9654Xeon Platinum 8592+Xeon Platinum 8490HXeon Max 9480Xeon Max 9468EPYC 8534PEPYC 8534PN500000M1000000M1500000M2000000M2500000MSE +/- 1841260363.24, N = 3SE +/- 1428966819.54, N = 3SE +/- 337702856.52, N = 3SE +/- 1622921637.03, N = 3SE +/- 159598753.20, N = 3SE +/- 697208281.49, N = 3SE +/- 268465891.11, N = 3SE +/- 49279694.68, N = 3SE +/- 570058274.06, N = 3SE +/- 164763342.54, N = 3SE +/- 1253503549.61, N = 3SE +/- 28627701.54, N = 3SE +/- 56355870.99, N = 3SE +/- 43545680.66, N = 3SE +/- 530918594.60, N = 3SE +/- 409615403.40, N = 3231661194528319903520599671785006879067176931314601315330263007271484669627050127758338275711672211418709960071092678972884361238895675065407688046936977477107026606412008481705397849313734889653908571. (CC) gcc options: -pthread -m64 -O3 -lssl -lcrypto -ldl
OpenBenchmarking.orgbyte/s, More Is BetterOpenSSL 3.3Algorithm: AES-128-GCMEPYC 9754 2PEPYC 9684X 2PEPYC 9654 2PXeon Platinum 8592+ 2PXeon Platinum 8490H 2PXeon Max 9480 2PXeon Max 9468 2PEPYC 9754EPYC 9684XEPYC 9654Xeon Platinum 8592+Xeon Platinum 8490HXeon Max 9480Xeon Max 9468EPYC 8534PEPYC 8534PN400000M800000M1200000M1600000M2000000MMin: 2314727732020 / Avg: 2316611945283.3 / Max: 2320294129370Min: 1987535076580 / Avg: 1990352059966.7 / Max: 1992178034550Min: 1784615558840 / Avg: 1785006879066.7 / Max: 1785679279170Min: 1767482912490 / Avg: 1769313146013.3 / Max: 1772549751060Min: 1532769000930 / Avg: 1533026300726.7 / Max: 1533318544320Min: 1483608758680 / Avg: 1484669627050 / Max: 1485983781140Min: 1277092543690 / Avg: 1277583382756.7 / Max: 1278017295160Min: 1167149951390 / Avg: 1167221141870 / Max: 1167315765930Min: 995087500630 / Avg: 996007109266.67 / Max: 997050556690Min: 896972292920 / Avg: 897288436123.33 / Max: 897527012280Min: 888030335850 / Avg: 889567506540 / Max: 892051213790Min: 768752002660 / Avg: 768804693696.67 / Max: 768850439650Min: 747630093380 / Avg: 747710702660 / Max: 747819231640Min: 641113915120 / Avg: 641200848170 / Max: 641248860300Min: 538795554950 / Avg: 539784931373.33 / Max: 540613497380Min: 488191196090 / Avg: 488965390856.67 / Max: 4895844821701. (CC) gcc options: -pthread -m64 -O3 -lssl -lcrypto -ldl

OpenBenchmarking.orgbyte/s, More Is BetterOpenSSL 3.3Algorithm: AES-256-GCMEPYC 9754 2PEPYC 9684X 2PEPYC 9654 2PXeon Platinum 8592+ 2PXeon Platinum 8490H 2PXeon Max 9480 2PXeon Max 9468 2PEPYC 9754EPYC 9684XEPYC 9654Xeon Platinum 8592+Xeon Platinum 8490HXeon Max 9480Xeon Max 9468EPYC 8534PEPYC 8534PN400000M800000M1200000M1600000M2000000MSE +/- 1791964708.17, N = 3SE +/- 1859275059.09, N = 3SE +/- 2225250504.62, N = 3SE +/- 1320809584.03, N = 3SE +/- 1397764228.85, N = 3SE +/- 112278705.55, N = 3SE +/- 108288170.03, N = 3SE +/- 290015345.25, N = 3SE +/- 671752057.50, N = 3SE +/- 818689705.82, N = 3SE +/- 3966858436.56, N = 3SE +/- 2848140790.67, N = 3SE +/- 63026881.96, N = 3SE +/- 119857064.56, N = 3SE +/- 148092414.72, N = 3SE +/- 3442274884.66, N = 319831030267001714061761087152650546581314975299393771369534328470118114895735310118989933239975390078738597205999637676965536677443876836707002393527175920141154535074567280874623097505304158939632071. (CC) gcc options: -pthread -m64 -O3 -lssl -lcrypto -ldl
OpenBenchmarking.orgbyte/s, More Is BetterOpenSSL 3.3Algorithm: AES-256-GCMEPYC 9754 2PEPYC 9684X 2PEPYC 9654 2PXeon Platinum 8592+ 2PXeon Platinum 8490H 2PXeon Max 9480 2PXeon Max 9468 2PEPYC 9754EPYC 9684XEPYC 9654Xeon Platinum 8592+Xeon Platinum 8490HXeon Max 9480Xeon Max 9468EPYC 8534PEPYC 8534PN300000M600000M900000M1200000M1500000MMin: 1979633105030 / Avg: 1983103026700 / Max: 1985614611800Min: 1710857643840 / Avg: 1714061761086.7 / Max: 1717298119480Min: 1522495208110 / Avg: 1526505465813.3 / Max: 1530181999550Min: 1494955760300 / Avg: 1497529939376.7 / Max: 1499330658580Min: 1367768906960 / Avg: 1369534328470 / Max: 1372294191240Min: 1180954994550 / Avg: 1181148957353.3 / Max: 1181343935420Min: 1011763512390 / Avg: 1011898993323.3 / Max: 1012113064480Min: 997169946620 / Avg: 997539007873.33 / Max: 998111058880Min: 858821939750 / Avg: 859720599963.33 / Max: 861034834600Min: 766399544800 / Avg: 767696553666.67 / Max: 769210554780Min: 740373466320 / Avg: 744387683670 / Max: 752321211320Min: 694545018060 / Avg: 700239352716.67 / Max: 703215487110Min: 591917684600 / Avg: 592014115453.33 / Max: 592132637220Min: 507221000470 / Avg: 507456728086.67 / Max: 507612294890Min: 462159458030 / Avg: 462309750530 / Max: 462605924410Min: 409016534080 / Avg: 415893963206.67 / Max: 4196037784901. (CC) gcc options: -pthread -m64 -O3 -lssl -lcrypto -ldl

OpenBenchmarking.orgbyte/s, More Is BetterOpenSSL 3.3Algorithm: SHA512EPYC 9754 2PEPYC 9684X 2PEPYC 9654 2PEPYC 9754Xeon Platinum 8592+ 2PEPYC 9684XXeon Platinum 8490H 2PEPYC 9654Xeon Max 9480 2PXeon Max 9468 2PEPYC 8534PXeon Platinum 8592+Xeon Platinum 8490HEPYC 8534PNXeon Max 9480Xeon Max 946820000M40000M60000M80000M100000MSE +/- 17716195.81, N = 3SE +/- 44023374.36, N = 3SE +/- 37307640.51, N = 3SE +/- 5822493.86, N = 3SE +/- 14734422.48, N = 3SE +/- 55712209.05, N = 3SE +/- 481040738.21, N = 3SE +/- 6285194.15, N = 3SE +/- 14339684.98, N = 3SE +/- 3500318.33, N = 3SE +/- 15082903.45, N = 3SE +/- 37654528.63, N = 3SE +/- 203213936.42, N = 3SE +/- 9990938.84, N = 3SE +/- 1250834.62, N = 3SE +/- 500176.69, N = 31047766330479145597120078822257383527466341134652076070745865131913428462544773962757549737564522053323042229932437846082023886054770222199277232219447097318893980783161992612771. (CC) gcc options: -pthread -m64 -O3 -lssl -lcrypto -ldl
OpenBenchmarking.orgbyte/s, More Is BetterOpenSSL 3.3Algorithm: SHA512EPYC 9754 2PEPYC 9684X 2PEPYC 9654 2PEPYC 9754Xeon Platinum 8592+ 2PEPYC 9684XXeon Platinum 8490H 2PEPYC 9654Xeon Max 9480 2PXeon Max 9468 2PEPYC 8534PXeon Platinum 8592+Xeon Platinum 8490HEPYC 8534PNXeon Max 9480Xeon Max 946820000M40000M60000M80000M100000MMin: 104742342430 / Avg: 104776633046.67 / Max: 104801505320Min: 91376626160 / Avg: 91455971200 / Max: 91528695890Min: 78749035330 / Avg: 78822257383.33 / Max: 78871297340Min: 52735029190 / Avg: 52746634113.33 / Max: 52753272410Min: 46497952550 / Avg: 46520760706.67 / Max: 46548324940Min: 45754704480 / Avg: 45865131913.33 / Max: 45933225350Min: 41884310320 / Avg: 42846254476.67 / Max: 43341303310Min: 39615986680 / Avg: 39627575496.67 / Max: 39637587190Min: 37536606990 / Avg: 37564522053.33 / Max: 37584175340Min: 32297389590 / Avg: 32304222993.33 / Max: 32308956940Min: 24348691850 / Avg: 24378460820 / Max: 24397568840Min: 23845431080 / Avg: 23886054770 / Max: 23961283620Min: 21813753380 / Avg: 22219927723.33 / Max: 22435445260Min: 22180744680 / Avg: 22194470973.33 / Max: 22213909820Min: 18891629010 / Avg: 18893980783.33 / Max: 18895895340Min: 16198336550 / Avg: 16199261276.67 / Max: 162000540801. (CC) gcc options: -pthread -m64 -O3 -lssl -lcrypto -ldl

OpenBenchmarking.orgbyte/s, More Is BetterOpenSSL 3.3Algorithm: ChaCha20EPYC 9754 2PEPYC 9684X 2PEPYC 9654 2PXeon Platinum 8592+ 2PEPYC 9754Xeon Platinum 8490H 2PEPYC 9684XXeon Max 9480 2PEPYC 9654Xeon Max 9468 2PXeon Platinum 8592+Xeon Platinum 8490HEPYC 8534PEPYC 8534PNXeon Max 9480Xeon Max 9468300000M600000M900000M1200000M1500000MSE +/- 63368290.15, N = 3SE +/- 874940734.18, N = 3SE +/- 80233613.02, N = 3SE +/- 303075210.03, N = 3SE +/- 170968063.89, N = 3SE +/- 271318554.29, N = 3SE +/- 94935214.36, N = 3SE +/- 863978337.15, N = 3SE +/- 151272595.84, N = 3SE +/- 329510485.23, N = 3SE +/- 3335467.26, N = 3SE +/- 232288636.76, N = 3SE +/- 9570566.28, N = 3SE +/- 71110585.03, N = 3SE +/- 312824840.64, N = 3SE +/- 415487944.57, N = 31306928507573108661819195010015026348606842843827606563963293876244029729475449040847735229124033475033110211234499084949273441509169373161264211733070689383772820533270772637406900672265973541531. (CC) gcc options: -pthread -m64 -O3 -lssl -lcrypto -ldl
OpenBenchmarking.orgbyte/s, More Is BetterOpenSSL 3.3Algorithm: ChaCha20EPYC 9754 2PEPYC 9684X 2PEPYC 9654 2PXeon Platinum 8592+ 2PEPYC 9754Xeon Platinum 8490H 2PEPYC 9684XXeon Max 9480 2PEPYC 9654Xeon Max 9468 2PXeon Platinum 8592+Xeon Platinum 8490HEPYC 8534PEPYC 8534PNXeon Max 9480Xeon Max 9468200000M400000M600000M800000M1000000MMin: 1306801844220 / Avg: 1306928507573.3 / Max: 1306995569770Min: 1084888202990 / Avg: 1086618191950 / Max: 1087711040580Min: 1001353429810 / Avg: 1001502634860 / Max: 1001628381180Min: 683775698530 / Avg: 684284382760 / Max: 684824196440Min: 656158189620 / Avg: 656396329386.67 / Max: 656727901800Min: 623925663880 / Avg: 624402972946.67 / Max: 624865174600Min: 544715543890 / Avg: 544904084773.33 / Max: 545017780360Min: 521204638730 / Avg: 522912403346.67 / Max: 523994388070Min: 503012756140 / Avg: 503311021123.33 / Max: 503504070520Min: 449342850940 / Avg: 449908494926.67 / Max: 450484176340Min: 344145814050 / Avg: 344150916936.67 / Max: 344157189460Min: 315723909260 / Avg: 316126421173.33 / Max: 316528580470Min: 307050204910 / Avg: 307068938376.67 / Max: 307081708070Min: 281950999890 / Avg: 282053327076.67 / Max: 282190030170Min: 263115681790 / Avg: 263740690066.67 / Max: 264077722420Min: 225829051050 / Avg: 226597354153.33 / Max: 2272556834801. (CC) gcc options: -pthread -m64 -O3 -lssl -lcrypto -ldl

OpenBenchmarking.orgbyte/s, More Is BetterOpenSSL 3.3Algorithm: SHA256EPYC 9754 2PEPYC 9684X 2PEPYC 9654 2PEPYC 9754EPYC 9684XXeon Platinum 8592+ 2PEPYC 9654Xeon Platinum 8490H 2PXeon Max 9480 2PXeon Max 9468 2PEPYC 8534PEPYC 8534PNXeon Platinum 8592+Xeon Platinum 8490HXeon Max 9480Xeon Max 946870000M140000M210000M280000M350000MSE +/- 80639802.67, N = 3SE +/- 160246527.97, N = 3SE +/- 210407867.05, N = 3SE +/- 34182873.86, N = 3SE +/- 146384349.91, N = 3SE +/- 29142783.86, N = 3SE +/- 38601729.93, N = 3SE +/- 66583540.43, N = 3SE +/- 70647143.49, N = 3SE +/- 126029257.64, N = 3SE +/- 10642001.84, N = 3SE +/- 64797308.82, N = 3SE +/- 23323764.84, N = 3SE +/- 159515825.53, N = 3SE +/- 33334799.97, N = 3SE +/- 27466135.54, N = 3320258686237276267766403251645629887161269162280138409588983131976050120126475137690119106802107103382860113886357534137458472100767806730387665739579206180699452351840436763444391851871. (CC) gcc options: -pthread -m64 -O3 -lssl -lcrypto -ldl
OpenBenchmarking.orgbyte/s, More Is BetterOpenSSL 3.3Algorithm: SHA256EPYC 9754 2PEPYC 9684X 2PEPYC 9654 2PEPYC 9754EPYC 9684XXeon Platinum 8592+ 2PEPYC 9654Xeon Platinum 8490H 2PXeon Max 9480 2PXeon Max 9468 2PEPYC 8534PEPYC 8534PNXeon Platinum 8592+Xeon Platinum 8490HXeon Max 9480Xeon Max 946860000M120000M180000M240000M300000MMin: 320109812680 / Avg: 320258686236.67 / Max: 320386842950Min: 276100310730 / Avg: 276267766403.33 / Max: 276588149680Min: 251234414660 / Avg: 251645629886.67 / Max: 251928638660Min: 161202050780 / Avg: 161269162280 / Max: 161314007030Min: 138117781740 / Avg: 138409588983.33 / Max: 138576023880Min: 131941867810 / Avg: 131976050120 / Max: 132034026270Min: 126408084590 / Avg: 126475137690 / Max: 126541803220Min: 118985504260 / Avg: 119106802106.67 / Max: 119215045440Min: 103284149010 / Avg: 103382860113.33 / Max: 103519766480Min: 88435026300 / Avg: 88635753413.33 / Max: 88868145720Min: 74563443970 / Avg: 74584721006.67 / Max: 74595831110Min: 67679364230 / Avg: 67806730386.67 / Max: 67891137130Min: 66530973870 / Avg: 66573957920 / Max: 66611143020Min: 61618891490 / Avg: 61806994523.33 / Max: 62124202560Min: 51778993930 / Avg: 51840436763.33 / Max: 51893568230Min: 44395980250 / Avg: 44439185186.67 / Max: 444901673401. (CC) gcc options: -pthread -m64 -O3 -lssl -lcrypto -ldl

OpenBenchmarking.orgbyte/s, More Is BetterOpenSSL 3.3Algorithm: ChaCha20-Poly1305EPYC 9754 2PEPYC 9684X 2PEPYC 9654 2PEPYC 9754Xeon Platinum 8592+ 2PXeon Platinum 8490H 2PEPYC 9684XXeon Max 9480 2PEPYC 9654Xeon Max 9468 2PXeon Platinum 8490HXeon Platinum 8592+EPYC 8534PEPYC 8534PNXeon Max 9480Xeon Max 9468200000M400000M600000M800000M1000000MSE +/- 19082587.00, N = 3SE +/- 558033954.71, N = 3SE +/- 6119305.11, N = 3SE +/- 151303743.70, N = 3SE +/- 82161991.11, N = 3SE +/- 132227134.30, N = 3SE +/- 4478378.70, N = 3SE +/- 36941390.18, N = 3SE +/- 29295317.86, N = 3SE +/- 4148679.28, N = 3SE +/- 766713911.50, N = 3SE +/- 120899798.30, N = 3SE +/- 24234601.89, N = 3SE +/- 65233629.47, N = 3SE +/- 37795783.50, N = 3SE +/- 6370607.14, N = 39060286089907676527195476989258222234570397488704440991442704422025329773839256520773727352152973509609983573203967204472250388507302236257380132111856617271933050936431877961744401613210582131. (CC) gcc options: -pthread -m64 -O3 -lssl -lcrypto -ldl
OpenBenchmarking.orgbyte/s, More Is BetterOpenSSL 3.3Algorithm: ChaCha20-Poly1305EPYC 9754 2PEPYC 9684X 2PEPYC 9654 2PEPYC 9754Xeon Platinum 8592+ 2PXeon Platinum 8490H 2PEPYC 9684XXeon Max 9480 2PEPYC 9654Xeon Max 9468 2PXeon Platinum 8490HXeon Platinum 8592+EPYC 8534PEPYC 8534PNXeon Max 9480Xeon Max 9468160000M320000M480000M640000M800000MMin: 905991562580 / Avg: 906028608990 / Max: 906055076250Min: 766609263000 / Avg: 767652719546.67 / Max: 768517382960Min: 698914381820 / Avg: 698925822223.33 / Max: 698935307470Min: 456863553950 / Avg: 457039748870 / Max: 457340907310Min: 443969338300 / Avg: 444099144270 / Max: 444251308850Min: 441973884520 / Avg: 442202532976.67 / Max: 442431930910Min: 383920347550 / Avg: 383925652076.67 / Max: 383934554470Min: 372685934870 / Avg: 372735215296.67 / Max: 372807527080Min: 350907523350 / Avg: 350960998356.67 / Max: 351008471450Min: 320390195610 / Avg: 320396720446.67 / Max: 320404421840Min: 223505534430 / Avg: 225038850730 / Max: 225821524790Min: 223384491620 / Avg: 223625738013.33 / Max: 223760518080Min: 211147541710 / Avg: 211185661726.67 / Max: 211230646550Min: 193174668900 / Avg: 193305093643.33 / Max: 193373190280Min: 187728433970 / Avg: 187796174440 / Max: 187859096100Min: 161308707500 / Avg: 161321058213.33 / Max: 1613299444401. (CC) gcc options: -pthread -m64 -O3 -lssl -lcrypto -ldl

LuxCoreRender

LuxCoreRender is an open-source 3D physically based renderer formerly known as LuxRender. LuxCoreRender supports CPU-based rendering as well as GPU acceleration via OpenCL, NVIDIA CUDA, and NVIDIA OptiX interfaces. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgM samples/sec, More Is BetterLuxCoreRender 2.6Scene: Orange Juice - Acceleration: CPUEPYC 9684X 2PEPYC 9754 2PEPYC 9654 2PEPYC 9684XEPYC 9754EPYC 9654Xeon Platinum 8592+ 2PXeon Platinum 8490H 2PXeon Max 9468 2PXeon Max 9480 2PXeon Platinum 8592+EPYC 8534PXeon Platinum 8490HEPYC 8534PNXeon Max 9480Xeon Max 9468816243240SE +/- 1.06, N = 15SE +/- 1.12, N = 15SE +/- 0.84, N = 15SE +/- 0.28, N = 5SE +/- 0.07, N = 3SE +/- 0.18, N = 15SE +/- 0.30, N = 15SE +/- 0.12, N = 3SE +/- 0.16, N = 15SE +/- 0.28, N = 15SE +/- 0.05, N = 3SE +/- 0.05, N = 3SE +/- 0.07, N = 3SE +/- 0.05, N = 3SE +/- 0.04, N = 3SE +/- 0.10, N = 333.0832.2629.6124.6923.7621.3219.9118.7016.9116.6414.7413.8113.4613.0012.5011.86MIN: 24.95 / MAX: 50.9MIN: 23.52 / MAX: 56.17MIN: 22.93 / MAX: 46.21MIN: 20.63 / MAX: 30.25MIN: 20.86 / MAX: 33.07MIN: 18.08 / MAX: 26.9MIN: 15 / MAX: 30.59MIN: 16.22 / MAX: 25.05MIN: 12.9 / MAX: 23.07MIN: 12.39 / MAX: 24.93MIN: 12.17 / MAX: 18.21MIN: 11.85 / MAX: 16.24MIN: 11.09 / MAX: 16.56MIN: 11.12 / MAX: 14.81MIN: 10.38 / MAX: 14.93MIN: 9.93 / MAX: 13.28
OpenBenchmarking.orgM samples/sec, More Is BetterLuxCoreRender 2.6Scene: Orange Juice - Acceleration: CPUEPYC 9684X 2PEPYC 9754 2PEPYC 9654 2PEPYC 9684XEPYC 9754EPYC 9654Xeon Platinum 8592+ 2PXeon Platinum 8490H 2PXeon Max 9468 2PXeon Max 9480 2PXeon Platinum 8592+EPYC 8534PXeon Platinum 8490HEPYC 8534PNXeon Max 9480Xeon Max 9468714212835Min: 29.21 / Avg: 33.08 / Max: 38.43Min: 29.18 / Avg: 32.26 / Max: 40.92Min: 26.8 / Avg: 29.61 / Max: 34.89Min: 23.59 / Avg: 24.69 / Max: 24.99Min: 23.62 / Avg: 23.76 / Max: 23.86Min: 20.75 / Avg: 21.32 / Max: 22.36Min: 18.33 / Avg: 19.91 / Max: 22.1Min: 18.51 / Avg: 18.7 / Max: 18.91Min: 15.85 / Avg: 16.91 / Max: 17.99Min: 15.54 / Avg: 16.64 / Max: 18.7Min: 14.65 / Avg: 14.74 / Max: 14.8Min: 13.72 / Avg: 13.81 / Max: 13.86Min: 13.33 / Avg: 13.46 / Max: 13.55Min: 12.93 / Avg: 13 / Max: 13.1Min: 12.42 / Avg: 12.5 / Max: 12.54Min: 11.67 / Avg: 11.86 / Max: 11.97

ONNX Runtime

ONNX Runtime is developed by Microsoft and partners as a open-source, cross-platform, high performance machine learning inferencing and training accelerator. This test profile runs the ONNX Runtime with various models available from the ONNX Model Zoo. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgInference Time Cost (ms), Fewer Is BetterONNX Runtime 1.17Model: ResNet50 v1-12-int8 - Device: CPU - Executor: StandardXeon Max 9468Xeon Platinum 8490HXeon Platinum 8592+Xeon Max 9480EPYC 9684XEPYC 9654EPYC 8534PEPYC 8534PNXeon Platinum 8490H 2PXeon Max 9468 2PXeon Platinum 8592+ 2PXeon Max 9480 2PEPYC 9754EPYC 9684X 2PEPYC 9654 2PEPYC 9754 2P246810SE +/- 0.02187, N = 3SE +/- 0.01810, N = 3SE +/- 0.02572, N = 3SE +/- 0.03815, N = 5SE +/- 0.01598, N = 3SE +/- 0.08822, N = 15SE +/- 0.04633, N = 15SE +/- 0.05392, N = 15SE +/- 0.03225, N = 3SE +/- 0.09530, N = 15SE +/- 0.01358, N = 3SE +/- 0.06816, N = 3SE +/- 0.07891, N = 15SE +/- 0.14799, N = 15SE +/- 0.20624, N = 12SE +/- 0.10131, N = 153.028973.170023.183923.370344.109144.461354.570294.742215.625175.744915.839546.177966.227917.096827.555588.518081. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt
OpenBenchmarking.orgInference Time Cost (ms), Fewer Is BetterONNX Runtime 1.17Model: ResNet50 v1-12-int8 - Device: CPU - Executor: StandardXeon Max 9468Xeon Platinum 8490HXeon Platinum 8592+Xeon Max 9480EPYC 9684XEPYC 9654EPYC 8534PEPYC 8534PNXeon Platinum 8490H 2PXeon Max 9468 2PXeon Platinum 8592+ 2PXeon Max 9480 2PEPYC 9754EPYC 9684X 2PEPYC 9654 2PEPYC 9754 2P3691215Min: 2.99 / Avg: 3.03 / Max: 3.06Min: 3.14 / Avg: 3.17 / Max: 3.2Min: 3.15 / Avg: 3.18 / Max: 3.23Min: 3.28 / Avg: 3.37 / Max: 3.51Min: 4.08 / Avg: 4.11 / Max: 4.13Min: 4.12 / Avg: 4.46 / Max: 4.88Min: 4.32 / Avg: 4.57 / Max: 4.78Min: 4.49 / Avg: 4.74 / Max: 4.98Min: 5.58 / Avg: 5.63 / Max: 5.69Min: 5.38 / Avg: 5.74 / Max: 6.53Min: 5.81 / Avg: 5.84 / Max: 5.85Min: 6.07 / Avg: 6.18 / Max: 6.31Min: 5.73 / Avg: 6.23 / Max: 6.52Min: 6.15 / Avg: 7.1 / Max: 7.57Min: 6.33 / Avg: 7.56 / Max: 8.39Min: 7.72 / Avg: 8.52 / Max: 9.181. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.17Model: ResNet50 v1-12-int8 - Device: CPU - Executor: StandardXeon Max 9468Xeon Platinum 8490HXeon Platinum 8592+Xeon Max 9480EPYC 9684XEPYC 9654EPYC 8534PEPYC 8534PNXeon Platinum 8490H 2PXeon Max 9468 2PXeon Platinum 8592+ 2PXeon Max 9480 2PEPYC 9754EPYC 9684X 2PEPYC 9654 2PEPYC 9754 2P70140210280350SE +/- 2.40, N = 3SE +/- 1.80, N = 3SE +/- 2.52, N = 3SE +/- 3.31, N = 5SE +/- 0.95, N = 3SE +/- 4.35, N = 15SE +/- 2.24, N = 15SE +/- 2.40, N = 15SE +/- 1.01, N = 3SE +/- 2.72, N = 15SE +/- 0.40, N = 3SE +/- 1.78, N = 3SE +/- 2.12, N = 15SE +/- 3.21, N = 15SE +/- 3.84, N = 12SE +/- 1.44, N = 15330.10315.41314.06296.80243.34225.31219.06211.19177.76174.68171.23161.89160.90141.83133.49117.621. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt
OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.17Model: ResNet50 v1-12-int8 - Device: CPU - Executor: StandardXeon Max 9468Xeon Platinum 8490HXeon Platinum 8592+Xeon Max 9480EPYC 9684XEPYC 9654EPYC 8534PEPYC 8534PNXeon Platinum 8490H 2PXeon Max 9468 2PXeon Platinum 8592+ 2PXeon Max 9480 2PEPYC 9754EPYC 9684X 2PEPYC 9654 2PEPYC 9754 2P60120180240300Min: 327.17 / Avg: 330.1 / Max: 334.85Min: 312.56 / Avg: 315.41 / Max: 318.75Min: 309.09 / Avg: 314.06 / Max: 317.25Min: 285.12 / Avg: 296.8 / Max: 305.13Min: 242.03 / Avg: 243.34 / Max: 245.18Min: 205.08 / Avg: 225.31 / Max: 242.82Min: 208.96 / Avg: 219.06 / Max: 231.17Min: 200.89 / Avg: 211.19 / Max: 222.47Min: 175.79 / Avg: 177.76 / Max: 179.16Min: 153.07 / Avg: 174.68 / Max: 185.97Min: 170.81 / Avg: 171.23 / Max: 172.03Min: 158.56 / Avg: 161.89 / Max: 164.63Min: 153.36 / Avg: 160.9 / Max: 174.42Min: 132.01 / Avg: 141.83 / Max: 162.51Min: 119.11 / Avg: 133.48 / Max: 157.92Min: 108.96 / Avg: 117.62 / Max: 129.521. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

FFmpeg

OpenBenchmarking.orgFPS, More Is BetterFFmpeg 7.0Encoder: libx265 - Scenario: UploadEPYC 9654EPYC 9684XEPYC 9684X 2PXeon Platinum 8592+Xeon Platinum 8592+ 2PEPYC 9654 2PXeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9480EPYC 9754Xeon Max 9468Xeon Max 9480 2PEPYC 9754 2PEPYC 8534PNEPYC 8534PXeon Max 9468 2P714212835SE +/- 0.01, N = 3SE +/- 0.03, N = 3SE +/- 0.03, N = 3SE +/- 0.05, N = 3SE +/- 0.04, N = 3SE +/- 0.04, N = 3SE +/- 0.04, N = 3SE +/- 0.10, N = 3SE +/- 0.07, N = 3SE +/- 0.03, N = 3SE +/- 0.00, N = 3SE +/- 0.07, N = 3SE +/- 0.04, N = 3SE +/- 0.02, N = 3SE +/- 0.04, N = 3SE +/- 0.12, N = 327.6627.6127.4326.9326.8026.4124.9724.5623.7723.3623.3323.3023.2823.2723.2522.341. (CXX) g++ options: -O3 -rdynamic -lpthread -lrt -ldl -lnuma
OpenBenchmarking.orgFPS, More Is BetterFFmpeg 7.0Encoder: libx265 - Scenario: UploadEPYC 9654EPYC 9684XEPYC 9684X 2PXeon Platinum 8592+Xeon Platinum 8592+ 2PEPYC 9654 2PXeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9480EPYC 9754Xeon Max 9468Xeon Max 9480 2PEPYC 9754 2PEPYC 8534PNEPYC 8534PXeon Max 9468 2P612182430Min: 27.64 / Avg: 27.66 / Max: 27.68Min: 27.55 / Avg: 27.61 / Max: 27.64Min: 27.38 / Avg: 27.43 / Max: 27.47Min: 26.83 / Avg: 26.93 / Max: 26.98Min: 26.73 / Avg: 26.8 / Max: 26.85Min: 26.36 / Avg: 26.41 / Max: 26.48Min: 24.9 / Avg: 24.97 / Max: 25.05Min: 24.42 / Avg: 24.56 / Max: 24.75Min: 23.66 / Avg: 23.77 / Max: 23.89Min: 23.3 / Avg: 23.36 / Max: 23.39Min: 23.33 / Avg: 23.33 / Max: 23.33Min: 23.18 / Avg: 23.3 / Max: 23.4Min: 23.21 / Avg: 23.28 / Max: 23.34Min: 23.25 / Avg: 23.27 / Max: 23.3Min: 23.21 / Avg: 23.25 / Max: 23.32Min: 22.12 / Avg: 22.34 / Max: 22.551. (CXX) g++ options: -O3 -rdynamic -lpthread -lrt -ldl -lnuma

Blender

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 4.1Blend File: Barbershop - Compute: CPU-OnlyEPYC 9754 2PEPYC 9684X 2PEPYC 9654 2PEPYC 9754EPYC 9684XXeon Platinum 8592+ 2PEPYC 9654Xeon Platinum 8490H 2PXeon Max 9480 2PXeon Max 9468 2PXeon Platinum 8592+EPYC 8534PXeon Platinum 8490HEPYC 8534PNXeon Max 9480Xeon Max 946870140210280350SE +/- 0.07, N = 3SE +/- 0.11, N = 3SE +/- 0.02, N = 3SE +/- 0.03, N = 3SE +/- 0.12, N = 3SE +/- 0.21, N = 3SE +/- 0.25, N = 3SE +/- 0.42, N = 3SE +/- 0.06, N = 3SE +/- 0.23, N = 3SE +/- 0.69, N = 3SE +/- 0.06, N = 3SE +/- 0.18, N = 3SE +/- 0.07, N = 3SE +/- 1.09, N = 3SE +/- 0.12, N = 365.5867.5279.05114.76123.90125.87139.25141.54156.70169.44236.73240.13261.97263.76290.56320.11
OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 4.1Blend File: Barbershop - Compute: CPU-OnlyEPYC 9754 2PEPYC 9684X 2PEPYC 9654 2PEPYC 9754EPYC 9684XXeon Platinum 8592+ 2PEPYC 9654Xeon Platinum 8490H 2PXeon Max 9480 2PXeon Max 9468 2PXeon Platinum 8592+EPYC 8534PXeon Platinum 8490HEPYC 8534PNXeon Max 9480Xeon Max 946860120180240300Min: 65.48 / Avg: 65.58 / Max: 65.71Min: 67.32 / Avg: 67.52 / Max: 67.69Min: 79.01 / Avg: 79.05 / Max: 79.08Min: 114.7 / Avg: 114.76 / Max: 114.81Min: 123.68 / Avg: 123.9 / Max: 124.11Min: 125.6 / Avg: 125.87 / Max: 126.29Min: 138.74 / Avg: 139.25 / Max: 139.55Min: 140.92 / Avg: 141.54 / Max: 142.33Min: 156.59 / Avg: 156.7 / Max: 156.77Min: 168.99 / Avg: 169.44 / Max: 169.77Min: 235.47 / Avg: 236.73 / Max: 237.85Min: 240.04 / Avg: 240.13 / Max: 240.23Min: 261.68 / Avg: 261.97 / Max: 262.29Min: 263.63 / Avg: 263.76 / Max: 263.86Min: 288.45 / Avg: 290.56 / Max: 292.08Min: 319.91 / Avg: 320.11 / Max: 320.34

FFmpeg

OpenBenchmarking.orgFPS, More Is BetterFFmpeg 7.0Encoder: libx265 - Scenario: Video On DemandEPYC 9654EPYC 9684XEPYC 9684X 2PXeon Platinum 8592+Xeon Platinum 8592+ 2PEPYC 9654 2PXeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9480Xeon Max 9468EPYC 9754EPYC 9754 2PEPYC 8534PNEPYC 8534PXeon Max 9480 2PXeon Max 9468 2P1224364860SE +/- 0.03, N = 3SE +/- 0.03, N = 3SE +/- 0.07, N = 3SE +/- 0.03, N = 3SE +/- 0.14, N = 3SE +/- 0.03, N = 3SE +/- 0.02, N = 3SE +/- 0.03, N = 3SE +/- 0.07, N = 3SE +/- 0.10, N = 3SE +/- 0.03, N = 3SE +/- 0.00, N = 3SE +/- 0.05, N = 3SE +/- 0.02, N = 3SE +/- 0.13, N = 3SE +/- 0.43, N = 355.5955.5655.0153.9953.2952.8149.8448.7748.1447.3447.3347.1446.9346.8846.7945.291. (CXX) g++ options: -O3 -rdynamic -lpthread -lrt -ldl -lnuma
OpenBenchmarking.orgFPS, More Is BetterFFmpeg 7.0Encoder: libx265 - Scenario: Video On DemandEPYC 9654EPYC 9684XEPYC 9684X 2PXeon Platinum 8592+Xeon Platinum 8592+ 2PEPYC 9654 2PXeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9480Xeon Max 9468EPYC 9754EPYC 9754 2PEPYC 8534PNEPYC 8534PXeon Max 9480 2PXeon Max 9468 2P1122334455Min: 55.54 / Avg: 55.59 / Max: 55.65Min: 55.5 / Avg: 55.56 / Max: 55.6Min: 54.93 / Avg: 55.01 / Max: 55.14Min: 53.93 / Avg: 53.99 / Max: 54.05Min: 53.03 / Avg: 53.29 / Max: 53.49Min: 52.75 / Avg: 52.81 / Max: 52.87Min: 49.82 / Avg: 49.84 / Max: 49.88Min: 48.7 / Avg: 48.77 / Max: 48.81Min: 48 / Avg: 48.14 / Max: 48.22Min: 47.24 / Avg: 47.34 / Max: 47.53Min: 47.29 / Avg: 47.33 / Max: 47.38Min: 47.13 / Avg: 47.14 / Max: 47.14Min: 46.88 / Avg: 46.93 / Max: 47.03Min: 46.83 / Avg: 46.88 / Max: 46.92Min: 46.53 / Avg: 46.79 / Max: 46.92Min: 44.84 / Avg: 45.29 / Max: 46.151. (CXX) g++ options: -O3 -rdynamic -lpthread -lrt -ldl -lnuma

OpenBenchmarking.orgFPS, More Is BetterFFmpeg 7.0Encoder: libx265 - Scenario: PlatformEPYC 9654EPYC 9684XEPYC 9684X 2PXeon Platinum 8592+Xeon Platinum 8592+ 2PEPYC 9654 2PXeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9480Xeon Max 9468EPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PNXeon Max 9480 2PXeon Max 9468 2P1224364860SE +/- 0.02, N = 3SE +/- 0.01, N = 3SE +/- 0.04, N = 3SE +/- 0.14, N = 3SE +/- 0.15, N = 3SE +/- 0.01, N = 3SE +/- 0.16, N = 3SE +/- 0.12, N = 3SE +/- 0.08, N = 3SE +/- 0.03, N = 3SE +/- 0.01, N = 3SE +/- 0.02, N = 3SE +/- 0.02, N = 3SE +/- 0.03, N = 3SE +/- 0.27, N = 3SE +/- 0.09, N = 355.6155.3855.1153.9253.2252.7949.7948.7648.3547.3247.3147.1346.8746.8646.5945.951. (CXX) g++ options: -O3 -rdynamic -lpthread -lrt -ldl -lnuma
OpenBenchmarking.orgFPS, More Is BetterFFmpeg 7.0Encoder: libx265 - Scenario: PlatformEPYC 9654EPYC 9684XEPYC 9684X 2PXeon Platinum 8592+Xeon Platinum 8592+ 2PEPYC 9654 2PXeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9480Xeon Max 9468EPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PNXeon Max 9480 2PXeon Max 9468 2P1122334455Min: 55.58 / Avg: 55.61 / Max: 55.65Min: 55.36 / Avg: 55.38 / Max: 55.4Min: 55.05 / Avg: 55.11 / Max: 55.18Min: 53.65 / Avg: 53.92 / Max: 54.09Min: 52.97 / Avg: 53.22 / Max: 53.47Min: 52.77 / Avg: 52.79 / Max: 52.81Min: 49.5 / Avg: 49.79 / Max: 50.05Min: 48.53 / Avg: 48.76 / Max: 48.93Min: 48.2 / Avg: 48.35 / Max: 48.48Min: 47.27 / Avg: 47.32 / Max: 47.37Min: 47.3 / Avg: 47.31 / Max: 47.32Min: 47.11 / Avg: 47.13 / Max: 47.16Min: 46.84 / Avg: 46.87 / Max: 46.89Min: 46.83 / Avg: 46.86 / Max: 46.92Min: 46.08 / Avg: 46.59 / Max: 47.01Min: 45.76 / Avg: 45.95 / Max: 46.051. (CXX) g++ options: -O3 -rdynamic -lpthread -lrt -ldl -lnuma

RocksDB

OpenBenchmarking.orgOp/s, More Is BetterRocksDB 9.0Test: Read While WritingEPYC 9754 2PEPYC 9654 2PEPYC 9684X 2PEPYC 9754EPYC 9654EPYC 9684XXeon Platinum 8592+ 2PXeon Platinum 8490H 2PXeon Max 9480 2PXeon Max 9468 2PEPYC 8534PEPYC 8534PNXeon Platinum 8592+Xeon Platinum 8490HXeon Max 9468Xeon Max 94805M10M15M20M25MSE +/- 273109.47, N = 3SE +/- 506458.47, N = 15SE +/- 236709.61, N = 3SE +/- 109424.14, N = 3SE +/- 36524.26, N = 3SE +/- 93669.97, N = 15SE +/- 215352.04, N = 15SE +/- 343737.14, N = 15SE +/- 254193.37, N = 15SE +/- 218479.19, N = 15SE +/- 28098.62, N = 3SE +/- 81998.56, N = 3SE +/- 28201.44, N = 3SE +/- 61518.27, N = 10SE +/- 83772.27, N = 13SE +/- 26369.56, N = 322900152201082891985166415776186146085441415841912425519123213001122332996244179333645893417689268937841738743966373665001. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti -lpthread
OpenBenchmarking.orgOp/s, More Is BetterRocksDB 9.0Test: Read While WritingEPYC 9754 2PEPYC 9654 2PEPYC 9684X 2PEPYC 9754EPYC 9654EPYC 9684XXeon Platinum 8592+ 2PXeon Platinum 8490H 2PXeon Max 9480 2PXeon Max 9468 2PEPYC 8534PEPYC 8534PNXeon Platinum 8592+Xeon Platinum 8490HXeon Max 9468Xeon Max 94804M8M12M16M20MMin: 22361145 / Avg: 22900152 / Max: 23246271Min: 16264288 / Avg: 20108288.67 / Max: 23918351Min: 19522509 / Avg: 19851664.33 / Max: 20310923Min: 15661690 / Avg: 15776186.33 / Max: 15994955Min: 14540147 / Avg: 14608544.33 / Max: 14664956Min: 13691669 / Avg: 14158419.4 / Max: 14830006Min: 11093004 / Avg: 12425519.07 / Max: 14001329Min: 10700779 / Avg: 12321300.13 / Max: 15657422Min: 9871431 / Avg: 11223328.93 / Max: 13362337Min: 8744273 / Avg: 9624416.6 / Max: 11852266Min: 9302459 / Avg: 9333645.33 / Max: 9389725Min: 8799620 / Avg: 8934176 / Max: 9082647Min: 8871422 / Avg: 8926893 / Max: 8963471Min: 7607121 / Avg: 7841737.7 / Max: 8193969Min: 7227203 / Avg: 7439663.23 / Max: 8347963Min: 7328644 / Avg: 7366499.67 / Max: 74172281. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti -lpthread

PyTorch

OpenBenchmarking.orgbatches/sec, More Is BetterPyTorch 2.2.1Device: CPU - Batch Size: 512 - Model: ResNet-50Xeon Platinum 8592+Xeon Platinum 8490HXeon Max 9480Xeon Max 9468Xeon Max 9468 2PXeon Platinum 8592+ 2PXeon Max 9480 2PXeon Platinum 8490H 2PEPYC 9684XEPYC 9654EPYC 8534PEPYC 8534PNEPYC 9754EPYC 9684X 2PEPYC 9654 2PEPYC 9754 2P1428425670SE +/- 0.19, N = 3SE +/- 0.12, N = 3SE +/- 0.43, N = 15SE +/- 0.72, N = 3SE +/- 0.26, N = 3SE +/- 0.30, N = 15SE +/- 0.34, N = 15SE +/- 0.21, N = 3SE +/- 0.19, N = 3SE +/- 0.10, N = 3SE +/- 0.08, N = 3SE +/- 0.11, N = 3SE +/- 0.04, N = 3SE +/- 0.29, N = 12SE +/- 0.23, N = 3SE +/- 0.22, N = 1263.3056.4451.8651.0541.6540.8337.8437.5534.6934.6533.7633.1827.5316.8216.2413.76MIN: 48.94 / MAX: 65.25MIN: 48.09 / MAX: 58.6MIN: 30.55 / MAX: 55.87MIN: 40.71 / MAX: 53.89MIN: 31.6 / MAX: 43.65MIN: 15.4 / MAX: 43.41MIN: 19.63 / MAX: 40.77MIN: 24.5 / MAX: 40.69MIN: 33.34 / MAX: 35.97MIN: 33.72 / MAX: 35.48MIN: 31.39 / MAX: 34.3MIN: 32.26 / MAX: 33.81MIN: 26.63 / MAX: 28.06MIN: 11.96 / MAX: 19.26MIN: 11.41 / MAX: 17.76MIN: 9.99 / MAX: 14.97
OpenBenchmarking.orgbatches/sec, More Is BetterPyTorch 2.2.1Device: CPU - Batch Size: 512 - Model: ResNet-50Xeon Platinum 8592+Xeon Platinum 8490HXeon Max 9480Xeon Max 9468Xeon Max 9468 2PXeon Platinum 8592+ 2PXeon Max 9480 2PXeon Platinum 8490H 2PEPYC 9684XEPYC 9654EPYC 8534PEPYC 8534PNEPYC 9754EPYC 9684X 2PEPYC 9654 2PEPYC 9754 2P1224364860Min: 62.94 / Avg: 63.3 / Max: 63.6Min: 56.2 / Avg: 56.44 / Max: 56.58Min: 48.81 / Avg: 51.86 / Max: 54.88Min: 49.89 / Avg: 51.05 / Max: 52.38Min: 41.16 / Avg: 41.65 / Max: 42.05Min: 38.66 / Avg: 40.83 / Max: 41.99Min: 35.44 / Avg: 37.84 / Max: 39.47Min: 37.32 / Avg: 37.55 / Max: 37.96Min: 34.41 / Avg: 34.69 / Max: 35.06Min: 34.53 / Avg: 34.65 / Max: 34.85Min: 33.61 / Avg: 33.76 / Max: 33.88Min: 32.96 / Avg: 33.18 / Max: 33.3Min: 27.44 / Avg: 27.53 / Max: 27.59Min: 15.34 / Avg: 16.82 / Max: 18.37Min: 15.95 / Avg: 16.24 / Max: 16.71Min: 11.74 / Avg: 13.76 / Max: 14.57

ONNX Runtime

ONNX Runtime is developed by Microsoft and partners as a open-source, cross-platform, high performance machine learning inferencing and training accelerator. This test profile runs the ONNX Runtime with various models available from the ONNX Model Zoo. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgInference Time Cost (ms), Fewer Is BetterONNX Runtime 1.17Model: ArcFace ResNet-100 - Device: CPU - Executor: StandardXeon Platinum 8592+Xeon Platinum 8490HXeon Max 9468Xeon Max 9480EPYC 9684XXeon Max 9468 2PEPYC 9654Xeon Platinum 8592+ 2PXeon Platinum 8490H 2PXeon Max 9480 2PEPYC 8534PNEPYC 9754EPYC 8534PEPYC 9654 2PEPYC 9684X 2PEPYC 9754 2P1326395265SE +/- 0.19, N = 3SE +/- 0.06, N = 3SE +/- 0.32, N = 15SE +/- 0.33, N = 3SE +/- 0.03, N = 3SE +/- 0.21, N = 3SE +/- 0.28, N = 4SE +/- 0.39, N = 13SE +/- 0.36, N = 3SE +/- 0.18, N = 3SE +/- 0.31, N = 15SE +/- 0.40, N = 15SE +/- 0.07, N = 3SE +/- 0.56, N = 15SE +/- 0.98, N = 15SE +/- 1.27, N = 1515.0418.9321.2223.6624.1124.6525.4826.0927.5929.4432.2332.4732.9242.5142.8955.921. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt
OpenBenchmarking.orgInference Time Cost (ms), Fewer Is BetterONNX Runtime 1.17Model: ArcFace ResNet-100 - Device: CPU - Executor: StandardXeon Platinum 8592+Xeon Platinum 8490HXeon Max 9468Xeon Max 9480EPYC 9684XXeon Max 9468 2PEPYC 9654Xeon Platinum 8592+ 2PXeon Platinum 8490H 2PXeon Max 9480 2PEPYC 8534PNEPYC 9754EPYC 8534PEPYC 9654 2PEPYC 9684X 2PEPYC 9754 2P1122334455Min: 14.84 / Avg: 15.04 / Max: 15.42Min: 18.82 / Avg: 18.93 / Max: 19.03Min: 19.95 / Avg: 21.22 / Max: 23.38Min: 23.2 / Avg: 23.66 / Max: 24.31Min: 24.04 / Avg: 24.11 / Max: 24.15Min: 24.3 / Avg: 24.65 / Max: 25.02Min: 24.94 / Avg: 25.48 / Max: 26.25Min: 25.2 / Avg: 26.09 / Max: 30.7Min: 27.04 / Avg: 27.59 / Max: 28.28Min: 29.12 / Avg: 29.44 / Max: 29.73Min: 31.1 / Avg: 32.23 / Max: 34.25Min: 30.61 / Avg: 32.47 / Max: 34Min: 32.79 / Avg: 32.92 / Max: 33.04Min: 38.41 / Avg: 42.51 / Max: 46.17Min: 37.45 / Avg: 42.89 / Max: 47.13Min: 50.27 / Avg: 55.92 / Max: 62.451. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.17Model: ArcFace ResNet-100 - Device: CPU - Executor: StandardXeon Platinum 8592+Xeon Platinum 8490HXeon Max 9468Xeon Max 9480EPYC 9684XXeon Max 9468 2PEPYC 9654Xeon Platinum 8592+ 2PXeon Platinum 8490H 2PXeon Max 9480 2PEPYC 8534PNEPYC 9754EPYC 8534PEPYC 9654 2PEPYC 9684X 2PEPYC 9754 2P1530456075SE +/- 0.82, N = 3SE +/- 0.16, N = 3SE +/- 0.69, N = 15SE +/- 0.59, N = 3SE +/- 0.06, N = 3SE +/- 0.34, N = 3SE +/- 0.42, N = 4SE +/- 0.51, N = 13SE +/- 0.48, N = 3SE +/- 0.21, N = 3SE +/- 0.29, N = 15SE +/- 0.38, N = 15SE +/- 0.07, N = 3SE +/- 0.32, N = 15SE +/- 0.57, N = 15SE +/- 0.41, N = 1566.5252.8247.2742.2741.4740.5739.2638.4236.2533.9631.0630.8630.3723.5823.5018.011. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt
OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.17Model: ArcFace ResNet-100 - Device: CPU - Executor: StandardXeon Platinum 8592+Xeon Platinum 8490HXeon Max 9468Xeon Max 9480EPYC 9684XXeon Max 9468 2PEPYC 9654Xeon Platinum 8592+ 2PXeon Platinum 8490H 2PXeon Max 9480 2PEPYC 8534PNEPYC 9754EPYC 8534PEPYC 9654 2PEPYC 9684X 2PEPYC 9754 2P1326395265Min: 64.87 / Avg: 66.52 / Max: 67.36Min: 52.55 / Avg: 52.82 / Max: 53.12Min: 42.77 / Avg: 47.27 / Max: 50.13Min: 41.14 / Avg: 42.27 / Max: 43.1Min: 41.41 / Avg: 41.47 / Max: 41.59Min: 39.96 / Avg: 40.57 / Max: 41.14Min: 38.09 / Avg: 39.26 / Max: 40.1Min: 32.57 / Avg: 38.42 / Max: 39.68Min: 35.36 / Avg: 36.25 / Max: 36.98Min: 33.63 / Avg: 33.96 / Max: 34.34Min: 29.19 / Avg: 31.06 / Max: 32.15Min: 29.41 / Avg: 30.86 / Max: 32.67Min: 30.27 / Avg: 30.37 / Max: 30.49Min: 21.66 / Avg: 23.58 / Max: 26.04Min: 21.22 / Avg: 23.5 / Max: 26.7Min: 16.01 / Avg: 18.01 / Max: 19.891. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

OSPRay

OpenBenchmarking.orgItems Per Second, More Is BetterOSPRay 3.1Benchmark: particle_volume/scivis/real_timeEPYC 9754 2PEPYC 9684X 2PXeon Platinum 8592+ 2PEPYC 9654 2PXeon Platinum 8490H 2PEPYC 9754Xeon Max 9480 2PEPYC 9684XXeon Platinum 8592+Xeon Max 9468 2PEPYC 9654Xeon Platinum 8490HXeon Max 9480EPYC 8534PEPYC 8534PNXeon Max 94681326395265SE +/- 0.01, N = 3SE +/- 0.02, N = 3SE +/- 0.05, N = 3SE +/- 0.05, N = 3SE +/- 0.02, N = 3SE +/- 0.02, N = 3SE +/- 0.04, N = 3SE +/- 0.02, N = 3SE +/- 0.04, N = 3SE +/- 0.06, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.04, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 356.4555.2653.9347.5338.2335.1533.1332.5230.6829.3528.0721.8918.4917.9416.4516.09
OpenBenchmarking.orgItems Per Second, More Is BetterOSPRay 3.1Benchmark: particle_volume/scivis/real_timeEPYC 9754 2PEPYC 9684X 2PXeon Platinum 8592+ 2PEPYC 9654 2PXeon Platinum 8490H 2PEPYC 9754Xeon Max 9480 2PEPYC 9684XXeon Platinum 8592+Xeon Max 9468 2PEPYC 9654Xeon Platinum 8490HXeon Max 9480EPYC 8534PEPYC 8534PNXeon Max 94681122334455Min: 56.43 / Avg: 56.45 / Max: 56.46Min: 55.22 / Avg: 55.26 / Max: 55.28Min: 53.85 / Avg: 53.93 / Max: 54Min: 47.44 / Avg: 47.53 / Max: 47.61Min: 38.18 / Avg: 38.23 / Max: 38.26Min: 35.12 / Avg: 35.15 / Max: 35.19Min: 33.05 / Avg: 33.13 / Max: 33.19Min: 32.49 / Avg: 32.52 / Max: 32.55Min: 30.6 / Avg: 30.68 / Max: 30.73Min: 29.25 / Avg: 29.35 / Max: 29.45Min: 28.05 / Avg: 28.07 / Max: 28.09Min: 21.88 / Avg: 21.89 / Max: 21.9Min: 18.41 / Avg: 18.49 / Max: 18.52Min: 17.92 / Avg: 17.94 / Max: 17.96Min: 16.44 / Avg: 16.45 / Max: 16.46Min: 16.07 / Avg: 16.09 / Max: 16.1

Numpy Benchmark

This is a test to obtain the general Numpy performance. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgScore, More Is BetterNumpy BenchmarkEPYC 9684XEPYC 9684X 2PEPYC 9654EPYC 9654 2PXeon Platinum 8592+Xeon Platinum 8592+ 2PXeon Max 9480Xeon Max 9468Xeon Platinum 8490H 2PXeon Platinum 8490HXeon Max 9480 2PXeon Max 9468 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN120240360480600SE +/- 1.85, N = 3SE +/- 0.60, N = 3SE +/- 2.28, N = 3SE +/- 0.38, N = 3SE +/- 1.84, N = 3SE +/- 1.42, N = 3SE +/- 0.79, N = 3SE +/- 0.60, N = 3SE +/- 0.26, N = 3SE +/- 0.33, N = 3SE +/- 1.30, N = 3SE +/- 1.13, N = 3SE +/- 0.96, N = 3SE +/- 0.25, N = 3SE +/- 0.72, N = 3SE +/- 1.34, N = 3542.15540.96529.80529.03520.22519.89464.72461.61456.18455.57439.84435.21425.46422.76421.99418.89
OpenBenchmarking.orgScore, More Is BetterNumpy BenchmarkEPYC 9684XEPYC 9684X 2PEPYC 9654EPYC 9654 2PXeon Platinum 8592+Xeon Platinum 8592+ 2PXeon Max 9480Xeon Max 9468Xeon Platinum 8490H 2PXeon Platinum 8490HXeon Max 9480 2PXeon Max 9468 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN100200300400500Min: 539.94 / Avg: 542.15 / Max: 545.82Min: 540.23 / Avg: 540.96 / Max: 542.15Min: 525.41 / Avg: 529.8 / Max: 533.05Min: 528.29 / Avg: 529.03 / Max: 529.54Min: 518.27 / Avg: 520.22 / Max: 523.89Min: 517.06 / Avg: 519.89 / Max: 521.5Min: 463.6 / Avg: 464.72 / Max: 466.25Min: 460.51 / Avg: 461.61 / Max: 462.58Min: 455.67 / Avg: 456.18 / Max: 456.52Min: 454.98 / Avg: 455.57 / Max: 456.12Min: 437.94 / Avg: 439.84 / Max: 442.32Min: 433.47 / Avg: 435.21 / Max: 437.33Min: 423.54 / Avg: 425.46 / Max: 426.47Min: 422.26 / Avg: 422.76 / Max: 423.07Min: 420.54 / Avg: 421.99 / Max: 422.78Min: 416.21 / Avg: 418.89 / Max: 420.32

LuxCoreRender

LuxCoreRender is an open-source 3D physically based renderer formerly known as LuxRender. LuxCoreRender supports CPU-based rendering as well as GPU acceleration via OpenCL, NVIDIA CUDA, and NVIDIA OptiX interfaces. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgM samples/sec, More Is BetterLuxCoreRender 2.6Scene: LuxCore Benchmark - Acceleration: CPUEPYC 9684XEPYC 9754EPYC 9654EPYC 9684X 2PEPYC 9654 2PEPYC 9754 2PXeon Platinum 8592+ 2PXeon Platinum 8490H 2PXeon Platinum 8592+Xeon Max 9480 2PEPYC 8534PXeon Platinum 8490HEPYC 8534PNXeon Max 9480Xeon Max 9468 2PXeon Max 94683691215SE +/- 0.04, N = 3SE +/- 0.16, N = 3SE +/- 0.10, N = 7SE +/- 0.12, N = 15SE +/- 0.11, N = 15SE +/- 0.08, N = 15SE +/- 0.17, N = 12SE +/- 0.12, N = 3SE +/- 0.11, N = 3SE +/- 0.16, N = 15SE +/- 0.02, N = 3SE +/- 0.04, N = 3SE +/- 0.02, N = 3SE +/- 0.05, N = 3SE +/- 0.22, N = 12SE +/- 0.03, N = 312.4312.4111.3410.6110.569.658.888.828.067.417.387.106.936.826.816.30MIN: 5.47 / MAX: 14.43MIN: 5.2 / MAX: 14.7MIN: 4.84 / MAX: 13.61MIN: 3.78 / MAX: 13.37MIN: 3.72 / MAX: 13.3MIN: 3.42 / MAX: 12.1MIN: 3.73 / MAX: 11.48MIN: 3.72 / MAX: 10.41MIN: 3.62 / MAX: 9.37MIN: 2.67 / MAX: 9.42MIN: 2.8 / MAX: 8.68MIN: 3.06 / MAX: 8.2MIN: 2.6 / MAX: 8.15MIN: 2.81 / MAX: 7.94MIN: 2.55 / MAX: 9.19MIN: 2.53 / MAX: 7.3
OpenBenchmarking.orgM samples/sec, More Is BetterLuxCoreRender 2.6Scene: LuxCore Benchmark - Acceleration: CPUEPYC 9684XEPYC 9754EPYC 9654EPYC 9684X 2PEPYC 9654 2PEPYC 9754 2PXeon Platinum 8592+ 2PXeon Platinum 8490H 2PXeon Platinum 8592+Xeon Max 9480 2PEPYC 8534PXeon Platinum 8490HEPYC 8534PNXeon Max 9480Xeon Max 9468 2PXeon Max 946848121620Min: 12.38 / Avg: 12.43 / Max: 12.5Min: 12.09 / Avg: 12.41 / Max: 12.57Min: 11.04 / Avg: 11.34 / Max: 11.83Min: 9.81 / Avg: 10.61 / Max: 11.25Min: 9.78 / Avg: 10.56 / Max: 11.32Min: 9.11 / Avg: 9.65 / Max: 10.25Min: 8.28 / Avg: 8.88 / Max: 10.13Min: 8.61 / Avg: 8.82 / Max: 9.04Min: 7.95 / Avg: 8.06 / Max: 8.28Min: 6.33 / Avg: 7.41 / Max: 8.21Min: 7.34 / Avg: 7.38 / Max: 7.42Min: 7.04 / Avg: 7.1 / Max: 7.17Min: 6.89 / Avg: 6.93 / Max: 6.96Min: 6.74 / Avg: 6.82 / Max: 6.91Min: 6.05 / Avg: 6.81 / Max: 7.91Min: 6.25 / Avg: 6.3 / Max: 6.34

PyTorch

OpenBenchmarking.orgbatches/sec, More Is BetterPyTorch 2.2.1Device: CPU - Batch Size: 256 - Model: ResNet-50Xeon Platinum 8592+Xeon Platinum 8490HXeon Max 9468Xeon Max 9480Xeon Max 9468 2PXeon Platinum 8592+ 2PXeon Max 9480 2PXeon Platinum 8490H 2PEPYC 9684XEPYC 9654EPYC 8534PEPYC 8534PNEPYC 9754EPYC 9654 2PEPYC 9684X 2PEPYC 9754 2P1428425670SE +/- 0.64, N = 3SE +/- 0.52, N = 3SE +/- 0.76, N = 3SE +/- 0.62, N = 3SE +/- 0.52, N = 3SE +/- 0.29, N = 3SE +/- 0.45, N = 3SE +/- 0.49, N = 3SE +/- 0.09, N = 3SE +/- 0.21, N = 3SE +/- 0.18, N = 3SE +/- 0.13, N = 3SE +/- 0.08, N = 3SE +/- 0.37, N = 12SE +/- 0.32, N = 12SE +/- 0.28, N = 1263.6054.8452.9751.5641.6841.4537.9137.4434.9034.9033.6833.3027.7817.4116.9713.11MIN: 37.79 / MAX: 65.67MIN: 46.5 / MAX: 58.5MIN: 33.28 / MAX: 55.78MIN: 30.49 / MAX: 54.7MIN: 37.38 / MAX: 44.02MIN: 38.42 / MAX: 42.93MIN: 16.15 / MAX: 40.53MIN: 26.88 / MAX: 41.26MIN: 34.15 / MAX: 35.71MIN: 33.85 / MAX: 35.99MIN: 31.27 / MAX: 34.43MIN: 32.26 / MAX: 33.94MIN: 26.81 / MAX: 28.37MIN: 11.49 / MAX: 19.87MIN: 14.73 / MAX: 19.36MIN: 8.01 / MAX: 14.98
OpenBenchmarking.orgbatches/sec, More Is BetterPyTorch 2.2.1Device: CPU - Batch Size: 256 - Model: ResNet-50Xeon Platinum 8592+Xeon Platinum 8490HXeon Max 9468Xeon Max 9480Xeon Max 9468 2PXeon Platinum 8592+ 2PXeon Max 9480 2PXeon Platinum 8490H 2PEPYC 9684XEPYC 9654EPYC 8534PEPYC 8534PNEPYC 9754EPYC 9654 2PEPYC 9684X 2PEPYC 9754 2P1224364860Min: 62.37 / Avg: 63.6 / Max: 64.51Min: 53.9 / Avg: 54.84 / Max: 55.68Min: 51.73 / Avg: 52.97 / Max: 54.35Min: 50.46 / Avg: 51.56 / Max: 52.61Min: 40.84 / Avg: 41.68 / Max: 42.62Min: 40.97 / Avg: 41.45 / Max: 41.96Min: 37.02 / Avg: 37.91 / Max: 38.38Min: 36.73 / Avg: 37.44 / Max: 38.39Min: 34.77 / Avg: 34.9 / Max: 35.07Min: 34.66 / Avg: 34.9 / Max: 35.31Min: 33.35 / Avg: 33.68 / Max: 33.95Min: 33.06 / Avg: 33.3 / Max: 33.49Min: 27.63 / Avg: 27.78 / Max: 27.91Min: 15.76 / Avg: 17.41 / Max: 19.14Min: 15.12 / Avg: 16.97 / Max: 18.62Min: 11.78 / Avg: 13.11 / Max: 14.36

ONNX Runtime

ONNX Runtime is developed by Microsoft and partners as a open-source, cross-platform, high performance machine learning inferencing and training accelerator. This test profile runs the ONNX Runtime with various models available from the ONNX Model Zoo. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgInference Time Cost (ms), Fewer Is BetterONNX Runtime 1.17Model: CaffeNet 12-int8 - Device: CPU - Executor: StandardXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8592+ 2PXeon Max 9468Xeon Max 9480Xeon Platinum 8490H 2PEPYC 9684XXeon Max 9468 2PEPYC 9654Xeon Max 9480 2PEPYC 8534PNEPYC 9684X 2PEPYC 9654 2PEPYC 8534PEPYC 9754EPYC 9754 2P0.7121.4242.1362.8483.56SE +/- 0.00291, N = 3SE +/- 0.01594, N = 3SE +/- 0.01541, N = 3SE +/- 0.02719, N = 15SE +/- 0.01456, N = 3SE +/- 0.01405, N = 15SE +/- 0.01470, N = 3SE +/- 0.00498, N = 3SE +/- 0.02493, N = 15SE +/- 0.01853, N = 5SE +/- 0.03117, N = 3SE +/- 0.03659, N = 15SE +/- 0.02209, N = 15SE +/- 0.02450, N = 4SE +/- 0.01501, N = 3SE +/- 0.02347, N = 111.100421.172921.324541.378311.416621.435731.485961.652701.660461.718752.238682.246452.250202.257162.616533.164411. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt
OpenBenchmarking.orgInference Time Cost (ms), Fewer Is BetterONNX Runtime 1.17Model: CaffeNet 12-int8 - Device: CPU - Executor: StandardXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8592+ 2PXeon Max 9468Xeon Max 9480Xeon Platinum 8490H 2PEPYC 9684XXeon Max 9468 2PEPYC 9654Xeon Max 9480 2PEPYC 8534PNEPYC 9684X 2PEPYC 9654 2PEPYC 8534PEPYC 9754EPYC 9754 2P246810Min: 1.09 / Avg: 1.1 / Max: 1.1Min: 1.15 / Avg: 1.17 / Max: 1.2Min: 1.29 / Avg: 1.32 / Max: 1.34Min: 1.31 / Avg: 1.38 / Max: 1.63Min: 1.39 / Avg: 1.42 / Max: 1.43Min: 1.39 / Avg: 1.44 / Max: 1.58Min: 1.47 / Avg: 1.49 / Max: 1.52Min: 1.64 / Avg: 1.65 / Max: 1.66Min: 1.5 / Avg: 1.66 / Max: 1.76Min: 1.67 / Avg: 1.72 / Max: 1.78Min: 2.2 / Avg: 2.24 / Max: 2.3Min: 1.99 / Avg: 2.25 / Max: 2.38Min: 2.09 / Avg: 2.25 / Max: 2.43Min: 2.19 / Avg: 2.26 / Max: 2.31Min: 2.59 / Avg: 2.62 / Max: 2.63Min: 3.04 / Avg: 3.16 / Max: 3.281. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.17Model: CaffeNet 12-int8 - Device: CPU - Executor: StandardXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8592+ 2PXeon Max 9468Xeon Max 9480Xeon Platinum 8490H 2PEPYC 9684XXeon Max 9468 2PEPYC 9654Xeon Max 9480 2PEPYC 9684X 2PEPYC 8534PNEPYC 9654 2PEPYC 8534PEPYC 9754EPYC 9754 2P2004006008001000SE +/- 2.43, N = 3SE +/- 11.46, N = 3SE +/- 8.88, N = 3SE +/- 12.91, N = 15SE +/- 7.34, N = 3SE +/- 6.50, N = 15SE +/- 6.60, N = 3SE +/- 1.83, N = 3SE +/- 9.50, N = 15SE +/- 6.21, N = 5SE +/- 7.76, N = 15SE +/- 6.13, N = 3SE +/- 4.37, N = 15SE +/- 4.84, N = 4SE +/- 2.19, N = 3SE +/- 2.36, N = 11908.19852.33754.81728.47705.61696.98672.92604.76604.05581.77446.81446.69444.85443.06382.10316.111. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt
OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.17Model: CaffeNet 12-int8 - Device: CPU - Executor: StandardXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8592+ 2PXeon Max 9468Xeon Max 9480Xeon Platinum 8490H 2PEPYC 9684XXeon Max 9468 2PEPYC 9654Xeon Max 9480 2PEPYC 9684X 2PEPYC 8534PNEPYC 9654 2PEPYC 8534PEPYC 9754EPYC 9754 2P160320480640800Min: 904.5 / Avg: 908.19 / Max: 912.79Min: 830.17 / Avg: 852.33 / Max: 868.51Min: 744.33 / Avg: 754.81 / Max: 772.47Min: 611.13 / Avg: 728.47 / Max: 762.65Min: 696.95 / Avg: 705.61 / Max: 720.19Min: 631.49 / Avg: 696.98 / Max: 720.32Min: 659.75 / Avg: 672.92 / Max: 680.24Min: 602.3 / Avg: 604.76 / Max: 608.34Min: 568.55 / Avg: 604.04 / Max: 666.46Min: 561.07 / Avg: 581.77 / Max: 598.93Min: 420.18 / Avg: 446.81 / Max: 503.5Min: 434.71 / Avg: 446.69 / Max: 454.94Min: 411.89 / Avg: 444.85 / Max: 478.32Min: 432.89 / Avg: 443.06 / Max: 456.21Min: 379.47 / Avg: 382.1 / Max: 386.46Min: 304.77 / Avg: 316.11 / Max: 329.041. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

OpenFOAM

OpenFOAM is the leading free, open-source software for computational fluid dynamics (CFD). This test profile currently uses the drivaerFastback test case for analyzing automotive aerodynamics or alternatively the older motorBike input. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterOpenFOAM 10Input: drivaerFastback, Medium Mesh Size - Execution TimeEPYC 9684X 2PEPYC 9654 2PXeon Platinum 8592+ 2PEPYC 9754 2PEPYC 9684XXeon Max 9480 2PXeon Platinum 8490H 2PXeon Max 9468 2PXeon Platinum 8592+EPYC 9654Xeon Max 9480Xeon Platinum 8490HXeon Max 9468EPYC 9754EPYC 8534PNEPYC 8534P15030045060075093.57124.30137.04137.11178.25186.33196.50201.11302.06325.42410.29420.65440.83449.47690.74691.641. (CXX) g++ options: -std=c++14 -m64 -O3 -ftemplate-depth-100 -fPIC -fuse-ld=bfd -Xlinker --add-needed --no-as-needed -lfiniteVolume -lmeshTools -lparallel -llagrangian -lregionModels -lgenericPatchFields -lOpenFOAM -ldl -lm

OpenBenchmarking.orgSeconds, Fewer Is BetterOpenFOAM 10Input: drivaerFastback, Medium Mesh Size - Mesh TimeEPYC 9684XXeon Max 9468 2PEPYC 9684X 2PEPYC 9654Xeon Platinum 8592+ 2PEPYC 9654 2PXeon Platinum 8592+Xeon Max 9480Xeon Max 9468Xeon Max 9480 2PXeon Platinum 8490HXeon Platinum 8490H 2PEPYC 8534PEPYC 9754EPYC 8534PNEPYC 9754 2P4080120160200118.54134.78135.52136.40139.62140.48148.40150.67153.12159.31160.73162.03163.70167.41188.37192.421. (CXX) g++ options: -std=c++14 -m64 -O3 -ftemplate-depth-100 -fPIC -fuse-ld=bfd -Xlinker --add-needed --no-as-needed -lfiniteVolume -lmeshTools -lparallel -llagrangian -lregionModels -lgenericPatchFields -lOpenFOAM -ldl -lm

Timed LLVM Compilation

This test times how long it takes to compile/build the LLVM compiler stack. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed LLVM Compilation 16.0Build System: NinjaEPYC 9684X 2PEPYC 9654 2PEPYC 9754 2PXeon Platinum 8592+ 2PXeon Platinum 8490H 2PEPYC 9684XXeon Max 9480 2PXeon Max 9468 2PEPYC 9654EPYC 9754Xeon Platinum 8592+Xeon Platinum 8490HXeon Max 9480EPYC 8534PXeon Max 9468EPYC 8534PN50100150200250SE +/- 0.09, N = 3SE +/- 0.08, N = 3SE +/- 0.45, N = 3SE +/- 0.27, N = 3SE +/- 0.15, N = 3SE +/- 0.27, N = 3SE +/- 0.79, N = 3SE +/- 0.17, N = 3SE +/- 0.31, N = 3SE +/- 0.74, N = 3SE +/- 0.12, N = 3SE +/- 0.07, N = 3SE +/- 0.36, N = 3SE +/- 0.20, N = 3SE +/- 0.19, N = 3SE +/- 0.10, N = 389.2894.81101.56106.82122.31124.46128.07134.42135.67146.76165.05187.02197.84205.01212.48215.93
OpenBenchmarking.orgSeconds, Fewer Is BetterTimed LLVM Compilation 16.0Build System: NinjaEPYC 9684X 2PEPYC 9654 2PEPYC 9754 2PXeon Platinum 8592+ 2PXeon Platinum 8490H 2PEPYC 9684XXeon Max 9480 2PXeon Max 9468 2PEPYC 9654EPYC 9754Xeon Platinum 8592+Xeon Platinum 8490HXeon Max 9480EPYC 8534PXeon Max 9468EPYC 8534PN4080120160200Min: 89.12 / Avg: 89.28 / Max: 89.44Min: 94.66 / Avg: 94.81 / Max: 94.91Min: 100.66 / Avg: 101.56 / Max: 102.09Min: 106.41 / Avg: 106.81 / Max: 107.32Min: 122.06 / Avg: 122.31 / Max: 122.58Min: 123.96 / Avg: 124.46 / Max: 124.89Min: 126.57 / Avg: 128.07 / Max: 129.25Min: 134.13 / Avg: 134.42 / Max: 134.71Min: 135.09 / Avg: 135.67 / Max: 136.15Min: 145.31 / Avg: 146.76 / Max: 147.75Min: 164.82 / Avg: 165.05 / Max: 165.22Min: 186.89 / Avg: 187.02 / Max: 187.11Min: 197.13 / Avg: 197.84 / Max: 198.28Min: 204.72 / Avg: 205.01 / Max: 205.39Min: 212.28 / Avg: 212.48 / Max: 212.86Min: 215.75 / Avg: 215.93 / Max: 216.08

Speedb

Speedb is a next-generation key value storage engine that is RocksDB compatible and aiming for stability, efficiency, and performance. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgOp/s, More Is BetterSpeedb 2.7Test: Read While WritingEPYC 9754 2PEPYC 9684X 2PEPYC 9654 2PEPYC 9754EPYC 9684XEPYC 9654Xeon Platinum 8592+ 2PXeon Platinum 8490H 2PXeon Max 9480 2PXeon Max 9468 2PXeon Platinum 8592+EPYC 8534PEPYC 8534PNXeon Platinum 8490HXeon Max 9480Xeon Max 94688M16M24M32M40MSE +/- 803844.71, N = 15SE +/- 651901.79, N = 15SE +/- 746932.76, N = 15SE +/- 172052.60, N = 3SE +/- 118870.12, N = 3SE +/- 170909.18, N = 3SE +/- 195912.00, N = 15SE +/- 239363.92, N = 3SE +/- 197596.27, N = 3SE +/- 171807.74, N = 3SE +/- 143570.67, N = 4SE +/- 88013.69, N = 15SE +/- 86788.79, N = 3SE +/- 62510.72, N = 3SE +/- 93731.24, N = 7SE +/- 88257.34, N = 33659320433307574303245962282942619595777180249931758573717297027153544001385925412168413120539011188210310695360998817687954081. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti -lpthread
OpenBenchmarking.orgOp/s, More Is BetterSpeedb 2.7Test: Read While WritingEPYC 9754 2PEPYC 9684X 2PEPYC 9654 2PEPYC 9754EPYC 9684XEPYC 9654Xeon Platinum 8592+ 2PXeon Platinum 8490H 2PXeon Max 9480 2PXeon Max 9468 2PXeon Platinum 8592+EPYC 8534PEPYC 8534PNXeon Platinum 8490HXeon Max 9480Xeon Max 94686M12M18M24M30MMin: 31536610 / Avg: 36593204.4 / Max: 41749433Min: 28304403 / Avg: 33307573.87 / Max: 37493854Min: 25392982 / Avg: 30324595.8 / Max: 37197421Min: 22504452 / Avg: 22829425.67 / Max: 23089894Min: 19379424 / Avg: 19595777 / Max: 19789299Min: 17739848 / Avg: 18024993 / Max: 18330811Min: 16371972 / Avg: 17585736.6 / Max: 19279365Min: 16836096 / Avg: 17297027.33 / Max: 17639484Min: 15030824 / Avg: 15354399.67 / Max: 15712674Min: 13643803 / Avg: 13859254 / Max: 14198797Min: 11766394 / Avg: 12168412.75 / Max: 12413695Min: 11617188 / Avg: 12053900.93 / Max: 12740574Min: 11725465 / Avg: 11882103 / Max: 12025193Min: 10620683 / Avg: 10695359.67 / Max: 10819533Min: 9687263 / Avg: 9988176.43 / Max: 10411581Min: 8642809 / Avg: 8795407.67 / Max: 89485401. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti -lpthread

Llamafile

OpenBenchmarking.orgTokens Per Second, More Is BetterLlamafile 0.7Test: wizardcoder-python-34b-v1.0.Q6_K - Acceleration: CPUEPYC 9684XEPYC 9654EPYC 9754Xeon Platinum 8490HEPYC 9684X 2PEPYC 9654 2PEPYC 8534PEPYC 8534PNEPYC 9754 2PXeon Platinum 8592+Xeon Platinum 8490H 2PXeon Platinum 8592+ 2PXeon Max 9468 2PXeon Max 9480 2PXeon Max 9480Xeon Max 9468246810SE +/- 0.01, N = 3SE +/- 0.03, N = 3SE +/- 0.03, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.02, N = 3SE +/- 0.03, N = 3SE +/- 0.01, N = 3SE +/- 0.02, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.12, N = 6SE +/- 0.00, N = 3SE +/- 0.00, N = 38.488.357.475.855.245.245.165.114.634.083.823.051.771.541.541.47
OpenBenchmarking.orgTokens Per Second, More Is BetterLlamafile 0.7Test: wizardcoder-python-34b-v1.0.Q6_K - Acceleration: CPUEPYC 9684XEPYC 9654EPYC 9754Xeon Platinum 8490HEPYC 9684X 2PEPYC 9654 2PEPYC 8534PEPYC 8534PNEPYC 9754 2PXeon Platinum 8592+Xeon Platinum 8490H 2PXeon Platinum 8592+ 2PXeon Max 9468 2PXeon Max 9480 2PXeon Max 9480Xeon Max 94683691215Min: 8.46 / Avg: 8.48 / Max: 8.49Min: 8.28 / Avg: 8.35 / Max: 8.39Min: 7.42 / Avg: 7.47 / Max: 7.5Min: 5.83 / Avg: 5.85 / Max: 5.86Min: 5.23 / Avg: 5.24 / Max: 5.26Min: 5.23 / Avg: 5.24 / Max: 5.25Min: 5.13 / Avg: 5.16 / Max: 5.2Min: 5.06 / Avg: 5.11 / Max: 5.14Min: 4.61 / Avg: 4.63 / Max: 4.64Min: 4.05 / Avg: 4.08 / Max: 4.1Min: 3.8 / Avg: 3.82 / Max: 3.84Min: 3.03 / Avg: 3.05 / Max: 3.06Min: 1.76 / Avg: 1.77 / Max: 1.78Min: 1.07 / Avg: 1.54 / Max: 1.78Min: 1.53 / Avg: 1.54 / Max: 1.54Min: 1.47 / Avg: 1.47 / Max: 1.48

OpenVINO

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Person Detection FP16 - Device: CPUXeon Platinum 8592+Xeon Max 9468Xeon Max 9468 2PXeon Platinum 8592+ 2PEPYC 9684X 2PXeon Platinum 8490H 2PXeon Max 9480EPYC 9654 2PXeon Max 9480 2PEPYC 9754 2PXeon Platinum 8490HEPYC 9684XEPYC 8534PNEPYC 9654EPYC 8534PEPYC 975450100150200250SE +/- 0.09, N = 3SE +/- 0.18, N = 3SE +/- 0.10, N = 3SE +/- 0.09, N = 3SE +/- 0.09, N = 3SE +/- 0.05, N = 3SE +/- 0.10, N = 3SE +/- 0.44, N = 15SE +/- 0.06, N = 3SE +/- 1.90, N = 15SE +/- 0.01, N = 3SE +/- 1.22, N = 15SE +/- 0.41, N = 3SE +/- 2.90, N = 15SE +/- 0.19, N = 3SE +/- 6.97, N = 1539.6241.9342.1643.4143.7745.7859.6963.9864.9185.86100.39110.91156.59157.45161.48230.24MIN: 26.71 / MAX: 62.24MIN: 27.14 / MAX: 54.05MIN: 32.47 / MAX: 70.84MIN: 27.3 / MAX: 82.85MIN: 37.7 / MAX: 90.56MIN: 33.94 / MAX: 85.21MIN: 42.86 / MAX: 84.25MIN: 39.78 / MAX: 114.18MIN: 49.88 / MAX: 107.03MIN: 47.19 / MAX: 207.44MIN: 41.76 / MAX: 139.86MIN: 43.17 / MAX: 198.04MIN: 61.92 / MAX: 224.56MIN: 52.3 / MAX: 282.08MIN: 55.89 / MAX: 223.7MIN: 65.18 / MAX: 718.241. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Person Detection FP16 - Device: CPUXeon Platinum 8592+Xeon Max 9468Xeon Max 9468 2PXeon Platinum 8592+ 2PEPYC 9684X 2PXeon Platinum 8490H 2PXeon Max 9480EPYC 9654 2PXeon Max 9480 2PEPYC 9754 2PXeon Platinum 8490HEPYC 9684XEPYC 8534PNEPYC 9654EPYC 8534PEPYC 97544080120160200Min: 39.45 / Avg: 39.62 / Max: 39.73Min: 41.75 / Avg: 41.93 / Max: 42.29Min: 42.01 / Avg: 42.16 / Max: 42.34Min: 43.24 / Avg: 43.41 / Max: 43.52Min: 43.6 / Avg: 43.77 / Max: 43.87Min: 45.68 / Avg: 45.78 / Max: 45.84Min: 59.52 / Avg: 59.69 / Max: 59.87Min: 58.73 / Avg: 63.98 / Max: 65.33Min: 64.82 / Avg: 64.91 / Max: 65.03Min: 63.36 / Avg: 85.86 / Max: 89.82Min: 100.37 / Avg: 100.39 / Max: 100.4Min: 98.01 / Avg: 110.91 / Max: 113.45Min: 156.09 / Avg: 156.59 / Max: 157.4Min: 118.89 / Avg: 157.45 / Max: 163.99Min: 161.11 / Avg: 161.48 / Max: 161.74Min: 136.44 / Avg: 230.24 / Max: 253.061. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Person Detection FP16 - Device: CPUEPYC 9684X 2PEPYC 9754 2PEPYC 9654 2PXeon Platinum 8592+ 2PXeon Platinum 8490H 2PXeon Max 9480 2PXeon Max 9468 2PEPYC 9684XXeon Platinum 8592+EPYC 9654Xeon Max 9480Xeon Platinum 8490HXeon Max 9468EPYC 9754EPYC 8534PNEPYC 8534P2004006008001000SE +/- 2.17, N = 3SE +/- 20.94, N = 15SE +/- 5.47, N = 15SE +/- 1.42, N = 3SE +/- 0.69, N = 3SE +/- 0.55, N = 3SE +/- 1.28, N = 3SE +/- 5.20, N = 15SE +/- 0.95, N = 3SE +/- 7.13, N = 15SE +/- 0.52, N = 3SE +/- 0.04, N = 3SE +/- 1.23, N = 3SE +/- 13.40, N = 15SE +/- 0.56, N = 3SE +/- 0.25, N = 31095.79750.96750.11736.23654.84569.60568.81433.06403.20306.27301.30298.56285.95283.18204.05197.911. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Person Detection FP16 - Device: CPUEPYC 9684X 2PEPYC 9754 2PEPYC 9654 2PXeon Platinum 8592+ 2PXeon Platinum 8490H 2PXeon Max 9480 2PXeon Max 9468 2PEPYC 9684XXeon Platinum 8592+EPYC 9654Xeon Max 9480Xeon Platinum 8490HXeon Max 9468EPYC 9754EPYC 8534PNEPYC 8534P2004006008001000Min: 1093.36 / Avg: 1095.79 / Max: 1100.11Min: 711.63 / Avg: 750.96 / Max: 1009.2Min: 734.04 / Avg: 750.11 / Max: 816.72Min: 734.28 / Avg: 736.23 / Max: 739Min: 653.98 / Avg: 654.84 / Max: 656.21Min: 568.56 / Avg: 569.6 / Max: 570.41Min: 566.4 / Avg: 568.81 / Max: 570.75Min: 422.63 / Avg: 433.06 / Max: 489.22Min: 402.04 / Avg: 403.2 / Max: 405.07Min: 292.32 / Avg: 306.27 / Max: 402.98Min: 300.38 / Avg: 301.3 / Max: 302.17Min: 298.49 / Avg: 298.56 / Max: 298.61Min: 283.49 / Avg: 285.95 / Max: 287.22Min: 252.5 / Avg: 283.18 / Max: 468.39Min: 202.94 / Avg: 204.05 / Max: 204.77Min: 197.54 / Avg: 197.91 / Max: 198.381. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

ONNX Runtime

ONNX Runtime is developed by Microsoft and partners as a open-source, cross-platform, high performance machine learning inferencing and training accelerator. This test profile runs the ONNX Runtime with various models available from the ONNX Model Zoo. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgInference Time Cost (ms), Fewer Is BetterONNX Runtime 1.17Model: CaffeNet 12-int8 - Device: CPU - Executor: ParallelXeon Platinum 8592+Xeon Platinum 8490HXeon Max 9468Xeon Max 9480Xeon Platinum 8592+ 2PEPYC 9684XEPYC 9654Xeon Platinum 8490H 2PEPYC 8534PNEPYC 8534PXeon Max 9468 2PXeon Max 9480 2PEPYC 9754EPYC 9654 2PEPYC 9684X 2PEPYC 9754 2P0.83161.66322.49483.32644.158SE +/- 0.01491, N = 4SE +/- 0.00936, N = 3SE +/- 0.00884, N = 3SE +/- 0.01053, N = 3SE +/- 0.00701, N = 3SE +/- 0.01586, N = 15SE +/- 0.01428, N = 15SE +/- 0.01492, N = 3SE +/- 0.01684, N = 6SE +/- 0.00301, N = 3SE +/- 0.00720, N = 3SE +/- 0.00871, N = 3SE +/- 0.01454, N = 15SE +/- 0.02296, N = 15SE +/- 0.04200, N = 3SE +/- 0.03210, N = 151.202981.273681.452801.472491.649191.693071.705791.763531.805731.824432.026592.087802.210203.170643.217813.696021. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt
OpenBenchmarking.orgInference Time Cost (ms), Fewer Is BetterONNX Runtime 1.17Model: CaffeNet 12-int8 - Device: CPU - Executor: ParallelXeon Platinum 8592+Xeon Platinum 8490HXeon Max 9468Xeon Max 9480Xeon Platinum 8592+ 2PEPYC 9684XEPYC 9654Xeon Platinum 8490H 2PEPYC 8534PNEPYC 8534PXeon Max 9468 2PXeon Max 9480 2PEPYC 9754EPYC 9654 2PEPYC 9684X 2PEPYC 9754 2P246810Min: 1.18 / Avg: 1.2 / Max: 1.25Min: 1.26 / Avg: 1.27 / Max: 1.29Min: 1.44 / Avg: 1.45 / Max: 1.47Min: 1.45 / Avg: 1.47 / Max: 1.49Min: 1.64 / Avg: 1.65 / Max: 1.66Min: 1.62 / Avg: 1.69 / Max: 1.77Min: 1.6 / Avg: 1.71 / Max: 1.76Min: 1.74 / Avg: 1.76 / Max: 1.79Min: 1.72 / Avg: 1.81 / Max: 1.83Min: 1.82 / Avg: 1.82 / Max: 1.83Min: 2.01 / Avg: 2.03 / Max: 2.04Min: 2.08 / Avg: 2.09 / Max: 2.11Min: 2.1 / Avg: 2.21 / Max: 2.27Min: 2.98 / Avg: 3.17 / Max: 3.26Min: 3.14 / Avg: 3.22 / Max: 3.28Min: 3.45 / Avg: 3.7 / Max: 3.831. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.17Model: CaffeNet 12-int8 - Device: CPU - Executor: ParallelXeon Platinum 8592+Xeon Platinum 8490HXeon Max 9468Xeon Max 9480Xeon Platinum 8592+ 2PEPYC 9684XEPYC 9654Xeon Platinum 8490H 2PEPYC 8534PNEPYC 8534PXeon Max 9468 2PXeon Max 9480 2PEPYC 9754EPYC 9654 2PEPYC 9684X 2PEPYC 9754 2P2004006008001000SE +/- 10.06, N = 4SE +/- 5.72, N = 3SE +/- 4.16, N = 3SE +/- 4.87, N = 3SE +/- 2.57, N = 3SE +/- 5.53, N = 15SE +/- 4.99, N = 15SE +/- 4.81, N = 3SE +/- 5.34, N = 6SE +/- 0.91, N = 3SE +/- 1.77, N = 3SE +/- 1.98, N = 3SE +/- 3.02, N = 15SE +/- 2.35, N = 15SE +/- 4.10, N = 3SE +/- 2.41, N = 15830.73784.30687.67678.48605.59590.71586.18566.38553.47547.52492.89478.47452.32315.36310.59270.631. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt
OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.17Model: CaffeNet 12-int8 - Device: CPU - Executor: ParallelXeon Platinum 8592+Xeon Platinum 8490HXeon Max 9468Xeon Max 9480Xeon Platinum 8592+ 2PEPYC 9684XEPYC 9654Xeon Platinum 8490H 2PEPYC 8534PNEPYC 8534PXeon Max 9468 2PXeon Max 9480 2PEPYC 9754EPYC 9654 2PEPYC 9684X 2PEPYC 9754 2P150300450600750Min: 800.82 / Avg: 830.72 / Max: 843.8Min: 773 / Avg: 784.3 / Max: 791.5Min: 680.54 / Avg: 687.67 / Max: 694.95Min: 672.26 / Avg: 678.48 / Max: 688.08Min: 600.49 / Avg: 605.59 / Max: 608.66Min: 563.2 / Avg: 590.71 / Max: 616.1Min: 566.09 / Avg: 586.18 / Max: 624.18Min: 559.3 / Avg: 566.38 / Max: 575.57Min: 546.36 / Avg: 553.47 / Max: 579.95Min: 545.72 / Avg: 547.52 / Max: 548.63Min: 490.15 / Avg: 492.89 / Max: 496.19Min: 474.56 / Avg: 478.47 / Max: 480.94Min: 439.25 / Avg: 452.32 / Max: 474.7Min: 306.87 / Avg: 315.35 / Max: 335.69Min: 304.95 / Avg: 310.59 / Max: 318.56Min: 261.16 / Avg: 270.63 / Max: 289.91. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

PyTorch

OpenBenchmarking.orgbatches/sec, More Is BetterPyTorch 2.2.1Device: CPU - Batch Size: 64 - Model: ResNet-50Xeon Platinum 8592+Xeon Platinum 8490HXeon Max 9468Xeon Max 9480Xeon Max 9468 2PXeon Platinum 8592+ 2PXeon Max 9480 2PXeon Platinum 8490H 2PEPYC 9654EPYC 9684XEPYC 8534PEPYC 8534PNEPYC 9754EPYC 9684X 2PEPYC 9654 2PEPYC 9754 2P1428425670SE +/- 0.12, N = 3SE +/- 0.24, N = 3SE +/- 0.71, N = 3SE +/- 0.62, N = 3SE +/- 0.51, N = 3SE +/- 0.12, N = 3SE +/- 0.46, N = 4SE +/- 0.50, N = 3SE +/- 0.26, N = 3SE +/- 0.10, N = 3SE +/- 0.06, N = 3SE +/- 0.18, N = 3SE +/- 0.10, N = 3SE +/- 0.37, N = 12SE +/- 0.35, N = 12SE +/- 0.23, N = 963.0656.0151.5551.3542.3540.7738.3037.0835.0134.7133.4933.2327.6817.2817.0713.68MIN: 33.2 / MAX: 65.54MIN: 51.84 / MAX: 59.12MIN: 37.49 / MAX: 54.33MIN: 41.6 / MAX: 53.81MIN: 36.76 / MAX: 44.4MIN: 16.88 / MAX: 42.06MIN: 27.11 / MAX: 40.39MIN: 26.46 / MAX: 40.15MIN: 33.84 / MAX: 36.39MIN: 33.58 / MAX: 35.7MIN: 32.03 / MAX: 34.13MIN: 31.97 / MAX: 33.93MIN: 26.61 / MAX: 28.44MIN: 13.59 / MAX: 19.8MIN: 11.04 / MAX: 19.93MIN: 10.81 / MAX: 14.92
OpenBenchmarking.orgbatches/sec, More Is BetterPyTorch 2.2.1Device: CPU - Batch Size: 64 - Model: ResNet-50Xeon Platinum 8592+Xeon Platinum 8490HXeon Max 9468Xeon Max 9480Xeon Max 9468 2PXeon Platinum 8592+ 2PXeon Max 9480 2PXeon Platinum 8490H 2PEPYC 9654EPYC 9684XEPYC 8534PEPYC 8534PNEPYC 9754EPYC 9684X 2PEPYC 9654 2PEPYC 9754 2P1224364860Min: 62.84 / Avg: 63.06 / Max: 63.24Min: 55.54 / Avg: 56.01 / Max: 56.33Min: 50.78 / Avg: 51.55 / Max: 52.97Min: 50.48 / Avg: 51.35 / Max: 52.55Min: 41.36 / Avg: 42.35 / Max: 43.03Min: 40.55 / Avg: 40.77 / Max: 40.96Min: 36.95 / Avg: 38.3 / Max: 38.97Min: 36.19 / Avg: 37.08 / Max: 37.92Min: 34.66 / Avg: 35.01 / Max: 35.52Min: 34.56 / Avg: 34.71 / Max: 34.9Min: 33.37 / Avg: 33.49 / Max: 33.57Min: 32.87 / Avg: 33.23 / Max: 33.45Min: 27.51 / Avg: 27.68 / Max: 27.86Min: 15.34 / Avg: 17.28 / Max: 18.84Min: 15.52 / Avg: 17.07 / Max: 19.21Min: 12.52 / Avg: 13.68 / Max: 14.43

ONNX Runtime

ONNX Runtime is developed by Microsoft and partners as a open-source, cross-platform, high performance machine learning inferencing and training accelerator. This test profile runs the ONNX Runtime with various models available from the ONNX Model Zoo. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgInference Time Cost (ms), Fewer Is BetterONNX Runtime 1.17Model: yolov4 - Device: CPU - Executor: StandardXeon Platinum 8592+Xeon Platinum 8490HXeon Max 9468Xeon Platinum 8592+ 2PXeon Max 9480Xeon Platinum 8490H 2PXeon Max 9480 2PXeon Max 9468 2PEPYC 9654EPYC 9684XEPYC 8534PEPYC 8534PNEPYC 9754EPYC 9684X 2PEPYC 9754 2PEPYC 9654 2P306090120150SE +/- 0.10, N = 3SE +/- 0.12, N = 3SE +/- 0.55, N = 15SE +/- 0.35, N = 3SE +/- 0.55, N = 15SE +/- 0.28, N = 3SE +/- 0.47, N = 14SE +/- 1.43, N = 15SE +/- 0.88, N = 8SE +/- 1.34, N = 3SE +/- 1.36, N = 4SE +/- 1.32, N = 5SE +/- 0.77, N = 3SE +/- 1.60, N = 3SE +/- 2.08, N = 3SE +/- 1.03, N = 343.5450.3554.9658.9459.1864.2969.2069.45101.47102.73112.73114.31120.56137.99148.21155.961. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt
OpenBenchmarking.orgInference Time Cost (ms), Fewer Is BetterONNX Runtime 1.17Model: yolov4 - Device: CPU - Executor: StandardXeon Platinum 8592+Xeon Platinum 8490HXeon Max 9468Xeon Platinum 8592+ 2PXeon Max 9480Xeon Platinum 8490H 2PXeon Max 9480 2PXeon Max 9468 2PEPYC 9654EPYC 9684XEPYC 8534PEPYC 8534PNEPYC 9754EPYC 9684X 2PEPYC 9754 2PEPYC 9654 2P306090120150Min: 43.36 / Avg: 43.54 / Max: 43.69Min: 50.11 / Avg: 50.35 / Max: 50.48Min: 53.22 / Avg: 54.96 / Max: 61.86Min: 58.25 / Avg: 58.94 / Max: 59.32Min: 56.75 / Avg: 59.18 / Max: 63.11Min: 63.94 / Avg: 64.29 / Max: 64.85Min: 66.91 / Avg: 69.2 / Max: 72.94Min: 63.2 / Avg: 69.45 / Max: 76.56Min: 98.94 / Avg: 101.47 / Max: 104.89Min: 101.28 / Avg: 102.73 / Max: 105.41Min: 110.65 / Avg: 112.73 / Max: 116.47Min: 112.75 / Avg: 114.31 / Max: 119.59Min: 119.06 / Avg: 120.56 / Max: 121.6Min: 135.11 / Avg: 137.99 / Max: 140.66Min: 144.15 / Avg: 148.21 / Max: 151.01Min: 154.46 / Avg: 155.96 / Max: 157.931. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.17Model: yolov4 - Device: CPU - Executor: StandardXeon Platinum 8592+Xeon Platinum 8490HXeon Max 9468Xeon Platinum 8592+ 2PXeon Max 9480Xeon Platinum 8490H 2PXeon Max 9468 2PXeon Max 9480 2PEPYC 9654EPYC 9684XEPYC 8534PEPYC 8534PNEPYC 9754EPYC 9684X 2PEPYC 9754 2PEPYC 9654 2P612182430SE +/- 0.05084, N = 3SE +/- 0.04802, N = 3SE +/- 0.16821, N = 15SE +/- 0.09991, N = 3SE +/- 0.15263, N = 15SE +/- 0.06825, N = 3SE +/- 0.29451, N = 15SE +/- 0.09595, N = 14SE +/- 0.08554, N = 8SE +/- 0.12519, N = 3SE +/- 0.10588, N = 4SE +/- 0.09781, N = 5SE +/- 0.05314, N = 3SE +/- 0.08454, N = 3SE +/- 0.09575, N = 3SE +/- 0.04207, N = 322.9689019.8593018.2179016.9672016.9166015.5555014.4831014.458309.860189.736858.874468.752338.295337.248696.749776.412291. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt
OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.17Model: yolov4 - Device: CPU - Executor: StandardXeon Platinum 8592+Xeon Platinum 8490HXeon Max 9468Xeon Platinum 8592+ 2PXeon Max 9480Xeon Platinum 8490H 2PXeon Max 9468 2PXeon Max 9480 2PEPYC 9654EPYC 9684XEPYC 8534PEPYC 8534PNEPYC 9754EPYC 9684X 2PEPYC 9754 2PEPYC 9654 2P510152025Min: 22.89 / Avg: 22.97 / Max: 23.06Min: 19.81 / Avg: 19.86 / Max: 19.96Min: 16.16 / Avg: 18.22 / Max: 18.79Min: 16.86 / Avg: 16.97 / Max: 17.17Min: 15.84 / Avg: 16.92 / Max: 17.62Min: 15.42 / Avg: 15.56 / Max: 15.64Min: 13.06 / Avg: 14.48 / Max: 15.82Min: 13.71 / Avg: 14.46 / Max: 14.95Min: 9.53 / Avg: 9.86 / Max: 10.11Min: 9.49 / Avg: 9.74 / Max: 9.87Min: 8.59 / Avg: 8.87 / Max: 9.04Min: 8.36 / Avg: 8.75 / Max: 8.87Min: 8.22 / Avg: 8.3 / Max: 8.4Min: 7.11 / Avg: 7.25 / Max: 7.4Min: 6.62 / Avg: 6.75 / Max: 6.94Min: 6.33 / Avg: 6.41 / Max: 6.471. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

OpenRadioss

OpenRadioss is an open-source AGPL-licensed finite element solver for dynamic event analysis OpenRadioss is based on Altair Radioss and open-sourced in 2022. This open-source finite element solver is benchmarked with various example models available from https://www.openradioss.org/models/ and https://github.com/OpenRadioss/ModelExchange/tree/main/Examples. This test is currently using a reference OpenRadioss binary build offered via GitHub. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterOpenRadioss 2023.09.15Model: INIVOL and Fluid Structure Interaction Drop ContainerEPYC 9684X 2PEPYC 9654 2PEPYC 9754 2PEPYC 9684XXeon Platinum 8592+ 2PEPYC 9654EPYC 9754Xeon Platinum 8490H 2PXeon Max 9480 2PXeon Max 9468 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Max 9480Xeon Max 9468EPYC 8534PEPYC 8534PN4080120160200SE +/- 0.43, N = 3SE +/- 0.14, N = 3SE +/- 0.12, N = 3SE +/- 0.93, N = 3SE +/- 0.30, N = 3SE +/- 0.57, N = 3SE +/- 0.46, N = 3SE +/- 0.17, N = 3SE +/- 0.09, N = 3SE +/- 0.07, N = 3SE +/- 0.12, N = 3SE +/- 0.19, N = 3SE +/- 0.06, N = 3SE +/- 0.08, N = 3SE +/- 0.37, N = 3SE +/- 0.63, N = 379.4285.8990.8594.76100.00100.24106.54107.36110.56114.29128.74140.43146.03160.56176.87187.03
OpenBenchmarking.orgSeconds, Fewer Is BetterOpenRadioss 2023.09.15Model: INIVOL and Fluid Structure Interaction Drop ContainerEPYC 9684X 2PEPYC 9654 2PEPYC 9754 2PEPYC 9684XXeon Platinum 8592+ 2PEPYC 9654EPYC 9754Xeon Platinum 8490H 2PXeon Max 9480 2PXeon Max 9468 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Max 9480Xeon Max 9468EPYC 8534PEPYC 8534PN306090120150Min: 78.79 / Avg: 79.42 / Max: 80.25Min: 85.63 / Avg: 85.89 / Max: 86.08Min: 90.66 / Avg: 90.85 / Max: 91.07Min: 93.16 / Avg: 94.76 / Max: 96.37Min: 99.46 / Avg: 100 / Max: 100.48Min: 99.14 / Avg: 100.24 / Max: 101.02Min: 105.81 / Avg: 106.54 / Max: 107.38Min: 107.19 / Avg: 107.36 / Max: 107.69Min: 110.44 / Avg: 110.56 / Max: 110.74Min: 114.19 / Avg: 114.29 / Max: 114.42Min: 128.51 / Avg: 128.74 / Max: 128.94Min: 140.15 / Avg: 140.43 / Max: 140.8Min: 145.92 / Avg: 146.03 / Max: 146.11Min: 160.43 / Avg: 160.56 / Max: 160.7Min: 176.2 / Avg: 176.87 / Max: 177.48Min: 185.77 / Avg: 187.03 / Max: 187.77

ONNX Runtime

ONNX Runtime is developed by Microsoft and partners as a open-source, cross-platform, high performance machine learning inferencing and training accelerator. This test profile runs the ONNX Runtime with various models available from the ONNX Model Zoo. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgInference Time Cost (ms), Fewer Is BetterONNX Runtime 1.17Model: fcn-resnet101-11 - Device: CPU - Executor: ParallelXeon Platinum 8592+EPYC 9754Xeon Platinum 8592+ 2PXeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9480EPYC 8534PEPYC 9754 2PEPYC 8534PNXeon Max 9468 2PXeon Max 9480 2PEPYC 9654EPYC 9684XEPYC 9654 2PEPYC 9684X 2P30060090012001500SE +/- 0.74, N = 3SE +/- 1.91, N = 3SE +/- 4.07, N = 3SE +/- 0.94, N = 3SE +/- 0.96, N = 3SE +/- 1.73, N = 3SE +/- 2.21, N = 3SE +/- 3.54, N = 3SE +/- 5.48, N = 3SE +/- 3.59, N = 15SE +/- 5.57, N = 13SE +/- 6.06, N = 3SE +/- 9.04, N = 12SE +/- 13.72, N = 15SE +/- 19.12, N = 12SE +/- 1.59, N = 3302.27319.35327.88329.04352.74380.90382.11388.74397.43443.96460.67475.25800.23801.961094.261165.931. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt
OpenBenchmarking.orgInference Time Cost (ms), Fewer Is BetterONNX Runtime 1.17Model: fcn-resnet101-11 - Device: CPU - Executor: ParallelXeon Platinum 8592+EPYC 9754Xeon Platinum 8592+ 2PXeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9480EPYC 8534PEPYC 9754 2PEPYC 8534PNXeon Max 9468 2PXeon Max 9480 2PEPYC 9654EPYC 9684XEPYC 9654 2PEPYC 9684X 2P2004006008001000Min: 301.2 / Avg: 302.27 / Max: 303.68Min: 315.58 / Avg: 319.35 / Max: 321.75Min: 319.98 / Avg: 327.88 / Max: 333.56Min: 327.16 / Avg: 329.04 / Max: 330.05Min: 351.7 / Avg: 352.74 / Max: 354.65Min: 378.8 / Avg: 380.9 / Max: 384.34Min: 377.89 / Avg: 382.11 / Max: 385.33Min: 384.93 / Avg: 388.74 / Max: 395.81Min: 388.75 / Avg: 397.43 / Max: 407.56Min: 418.26 / Avg: 443.96 / Max: 461.63Min: 415.8 / Avg: 460.67 / Max: 496.58Min: 468.29 / Avg: 475.25 / Max: 487.33Min: 750.13 / Avg: 800.23 / Max: 860.18Min: 714.25 / Avg: 801.96 / Max: 917.85Min: 982.56 / Avg: 1094.26 / Max: 1165.91Min: 1163.84 / Avg: 1165.93 / Max: 1169.051. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.17Model: fcn-resnet101-11 - Device: CPU - Executor: ParallelXeon Platinum 8592+EPYC 9754Xeon Platinum 8592+ 2PXeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9480EPYC 8534PEPYC 9754 2PEPYC 8534PNXeon Max 9468 2PXeon Max 9480 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9684X 2P0.74441.48882.23322.97763.722SE +/- 0.008053, N = 3SE +/- 0.018814, N = 3SE +/- 0.038257, N = 3SE +/- 0.008707, N = 3SE +/- 0.007683, N = 3SE +/- 0.011894, N = 3SE +/- 0.015170, N = 3SE +/- 0.023203, N = 3SE +/- 0.034519, N = 3SE +/- 0.018603, N = 15SE +/- 0.027020, N = 13SE +/- 0.026516, N = 3SE +/- 0.020352, N = 15SE +/- 0.013875, N = 12SE +/- 0.016597, N = 12SE +/- 0.001170, N = 33.3083603.1315603.0508503.0392202.8349802.6254402.6172102.5727802.5170902.2545302.1746302.1048001.2517901.2513500.9170430.8576851. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt
OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.17Model: fcn-resnet101-11 - Device: CPU - Executor: ParallelXeon Platinum 8592+EPYC 9754Xeon Platinum 8592+ 2PXeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9480EPYC 8534PEPYC 9754 2PEPYC 8534PNXeon Max 9468 2PXeon Max 9480 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9684X 2P246810Min: 3.29 / Avg: 3.31 / Max: 3.32Min: 3.11 / Avg: 3.13 / Max: 3.17Min: 3 / Avg: 3.05 / Max: 3.13Min: 3.03 / Avg: 3.04 / Max: 3.06Min: 2.82 / Avg: 2.83 / Max: 2.84Min: 2.6 / Avg: 2.63 / Max: 2.64Min: 2.6 / Avg: 2.62 / Max: 2.65Min: 2.53 / Avg: 2.57 / Max: 2.6Min: 2.45 / Avg: 2.52 / Max: 2.57Min: 2.17 / Avg: 2.25 / Max: 2.39Min: 2.01 / Avg: 2.17 / Max: 2.4Min: 2.05 / Avg: 2.1 / Max: 2.14Min: 1.09 / Avg: 1.25 / Max: 1.4Min: 1.16 / Avg: 1.25 / Max: 1.33Min: 0.86 / Avg: 0.92 / Max: 1.02Min: 0.86 / Avg: 0.86 / Max: 0.861. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

Timed Godot Game Engine Compilation

This test times how long it takes to compile the Godot Game Engine. Godot is a popular, open-source, cross-platform 2D/3D game engine and is built using the SCons build system and targeting the X11 platform. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed Godot Game Engine Compilation 4.0Time To CompileEPYC 9684X 2PEPYC 9654 2PEPYC 9684XXeon Platinum 8592+ 2PEPYC 9654Xeon Platinum 8490H 2PXeon Max 9480 2PXeon Platinum 8592+Xeon Max 9468 2PEPYC 9754 2PEPYC 9754Xeon Platinum 8490HXeon Max 9480Xeon Max 9468EPYC 8534PEPYC 8534PN4080120160200SE +/- 0.62, N = 3SE +/- 0.06, N = 3SE +/- 0.12, N = 3SE +/- 0.29, N = 3SE +/- 0.16, N = 3SE +/- 0.56, N = 3SE +/- 1.69, N = 3SE +/- 0.91, N = 3SE +/- 0.56, N = 3SE +/- 0.55, N = 3SE +/- 0.20, N = 3SE +/- 0.76, N = 3SE +/- 0.32, N = 3SE +/- 0.18, N = 3SE +/- 0.32, N = 3SE +/- 0.16, N = 396.16102.58103.35103.38111.69118.57122.70122.72123.88126.11128.28140.23143.81149.38154.01159.62
OpenBenchmarking.orgSeconds, Fewer Is BetterTimed Godot Game Engine Compilation 4.0Time To CompileEPYC 9684X 2PEPYC 9654 2PEPYC 9684XXeon Platinum 8592+ 2PEPYC 9654Xeon Platinum 8490H 2PXeon Max 9480 2PXeon Platinum 8592+Xeon Max 9468 2PEPYC 9754 2PEPYC 9754Xeon Platinum 8490HXeon Max 9480Xeon Max 9468EPYC 8534PEPYC 8534PN306090120150Min: 95.32 / Avg: 96.16 / Max: 97.38Min: 102.49 / Avg: 102.58 / Max: 102.7Min: 103.15 / Avg: 103.35 / Max: 103.58Min: 102.83 / Avg: 103.38 / Max: 103.79Min: 111.37 / Avg: 111.69 / Max: 111.85Min: 117.47 / Avg: 118.57 / Max: 119.27Min: 120.06 / Avg: 122.7 / Max: 125.86Min: 121.35 / Avg: 122.72 / Max: 124.45Min: 123.06 / Avg: 123.88 / Max: 124.94Min: 125.01 / Avg: 126.11 / Max: 126.72Min: 128.02 / Avg: 128.28 / Max: 128.66Min: 138.79 / Avg: 140.23 / Max: 141.34Min: 143.2 / Avg: 143.81 / Max: 144.31Min: 149.02 / Avg: 149.38 / Max: 149.59Min: 153.59 / Avg: 154.01 / Max: 154.64Min: 159.44 / Avg: 159.62 / Max: 159.94

ONNX Runtime

ONNX Runtime is developed by Microsoft and partners as a open-source, cross-platform, high performance machine learning inferencing and training accelerator. This test profile runs the ONNX Runtime with various models available from the ONNX Model Zoo. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgInference Time Cost (ms), Fewer Is BetterONNX Runtime 1.17Model: bertsquad-12 - Device: CPU - Executor: StandardXeon Platinum 8592+Xeon Platinum 8592+ 2PXeon Max 9468Xeon Platinum 8490HXeon Max 9480Xeon Max 9480 2PXeon Max 9468 2PXeon Platinum 8490H 2PEPYC 9684XEPYC 9654EPYC 8534PEPYC 8534PNEPYC 9754EPYC 9684X 2PEPYC 9754 2PEPYC 9654 2P20406080100SE +/- 0.04, N = 3SE +/- 0.44, N = 3SE +/- 0.44, N = 3SE +/- 0.17, N = 3SE +/- 0.23, N = 3SE +/- 1.12, N = 15SE +/- 0.68, N = 3SE +/- 0.62, N = 3SE +/- 0.18, N = 3SE +/- 0.17, N = 3SE +/- 0.51, N = 3SE +/- 1.26, N = 3SE +/- 0.70, N = 15SE +/- 2.80, N = 15SE +/- 2.33, N = 12SE +/- 0.90, N = 639.7544.6047.2449.6449.9755.9060.1160.3671.5672.1280.7286.6587.6690.0693.6493.831. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt
OpenBenchmarking.orgInference Time Cost (ms), Fewer Is BetterONNX Runtime 1.17Model: bertsquad-12 - Device: CPU - Executor: StandardXeon Platinum 8592+Xeon Platinum 8592+ 2PXeon Max 9468Xeon Platinum 8490HXeon Max 9480Xeon Max 9480 2PXeon Max 9468 2PXeon Platinum 8490H 2PEPYC 9684XEPYC 9654EPYC 8534PEPYC 8534PNEPYC 9754EPYC 9684X 2PEPYC 9754 2PEPYC 9654 2P20406080100Min: 39.7 / Avg: 39.75 / Max: 39.82Min: 43.99 / Avg: 44.6 / Max: 45.45Min: 46.39 / Avg: 47.24 / Max: 47.85Min: 49.44 / Avg: 49.64 / Max: 49.98Min: 49.68 / Avg: 49.97 / Max: 50.43Min: 51.18 / Avg: 55.9 / Max: 62.25Min: 59.24 / Avg: 60.11 / Max: 61.46Min: 59.65 / Avg: 60.36 / Max: 61.59Min: 71.24 / Avg: 71.56 / Max: 71.87Min: 71.8 / Avg: 72.12 / Max: 72.4Min: 80.14 / Avg: 80.72 / Max: 81.75Min: 84.77 / Avg: 86.65 / Max: 89.04Min: 83.4 / Avg: 87.66 / Max: 90.28Min: 72.63 / Avg: 90.06 / Max: 98.58Min: 83.32 / Avg: 93.64 / Max: 103.73Min: 91.93 / Avg: 93.83 / Max: 97.841. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.17Model: bertsquad-12 - Device: CPU - Executor: StandardXeon Platinum 8592+Xeon Platinum 8592+ 2PXeon Max 9468Xeon Platinum 8490HXeon Max 9480Xeon Max 9480 2PXeon Max 9468 2PXeon Platinum 8490H 2PEPYC 9684XEPYC 9654EPYC 8534PEPYC 8534PNEPYC 9754EPYC 9684X 2PEPYC 9754 2PEPYC 9654 2P612182430SE +/- 0.02, N = 3SE +/- 0.22, N = 3SE +/- 0.20, N = 3SE +/- 0.07, N = 3SE +/- 0.09, N = 3SE +/- 0.35, N = 15SE +/- 0.19, N = 3SE +/- 0.17, N = 3SE +/- 0.04, N = 3SE +/- 0.03, N = 3SE +/- 0.08, N = 3SE +/- 0.17, N = 3SE +/- 0.09, N = 15SE +/- 0.39, N = 15SE +/- 0.27, N = 12SE +/- 0.10, N = 625.1622.4321.1720.1520.0117.9916.6416.5713.9713.8612.3911.5411.4211.2710.7510.661. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt
OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.17Model: bertsquad-12 - Device: CPU - Executor: StandardXeon Platinum 8592+Xeon Platinum 8592+ 2PXeon Max 9468Xeon Platinum 8490HXeon Max 9480Xeon Max 9480 2PXeon Max 9468 2PXeon Platinum 8490H 2PEPYC 9684XEPYC 9654EPYC 8534PEPYC 8534PNEPYC 9754EPYC 9684X 2PEPYC 9754 2PEPYC 9654 2P612182430Min: 25.11 / Avg: 25.16 / Max: 25.19Min: 22 / Avg: 22.43 / Max: 22.73Min: 20.9 / Avg: 21.17 / Max: 21.55Min: 20.01 / Avg: 20.15 / Max: 20.23Min: 19.83 / Avg: 20.01 / Max: 20.13Min: 16.06 / Avg: 17.99 / Max: 19.54Min: 16.27 / Avg: 16.64 / Max: 16.88Min: 16.24 / Avg: 16.57 / Max: 16.76Min: 13.91 / Avg: 13.97 / Max: 14.04Min: 13.81 / Avg: 13.86 / Max: 13.93Min: 12.23 / Avg: 12.39 / Max: 12.48Min: 11.23 / Avg: 11.54 / Max: 11.8Min: 11.08 / Avg: 11.42 / Max: 11.99Min: 10.14 / Avg: 11.27 / Max: 13.77Min: 9.64 / Avg: 10.75 / Max: 12Min: 10.22 / Avg: 10.66 / Max: 10.881. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

TensorFlow

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.16.1Device: CPU - Batch Size: 256 - Model: GoogLeNetXeon Platinum 8490H 2PXeon Platinum 8592+ 2PEPYC 9754Xeon Max 9480 2PXeon Platinum 8490HEPYC 9654Xeon Max 9468 2PXeon Platinum 8592+EPYC 9684XEPYC 9654 2PEPYC 9754 2PEPYC 9684X 2PXeon Max 9480Xeon Max 9468EPYC 8534PEPYC 8534PN110220330440550SE +/- 4.87, N = 3SE +/- 2.68, N = 3SE +/- 10.93, N = 12SE +/- 4.80, N = 3SE +/- 0.24, N = 3SE +/- 3.87, N = 15SE +/- 2.29, N = 3SE +/- 2.30, N = 3SE +/- 2.76, N = 15SE +/- 1.02, N = 3SE +/- 1.11, N = 3SE +/- 0.51, N = 3SE +/- 1.91, N = 3SE +/- 1.67, N = 3SE +/- 0.04, N = 3SE +/- 0.07, N = 3528.93501.39462.79449.91448.46447.61447.50423.59406.58401.84397.44391.40386.00375.73308.46287.42
OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.16.1Device: CPU - Batch Size: 256 - Model: GoogLeNetXeon Platinum 8490H 2PXeon Platinum 8592+ 2PEPYC 9754Xeon Max 9480 2PXeon Platinum 8490HEPYC 9654Xeon Max 9468 2PXeon Platinum 8592+EPYC 9684XEPYC 9654 2PEPYC 9754 2PEPYC 9684X 2PXeon Max 9480Xeon Max 9468EPYC 8534PEPYC 8534PN90180270360450Min: 519.66 / Avg: 528.93 / Max: 536.16Min: 496.29 / Avg: 501.39 / Max: 505.37Min: 429.85 / Avg: 462.79 / Max: 538.85Min: 440.94 / Avg: 449.91 / Max: 457.38Min: 448.09 / Avg: 448.46 / Max: 448.91Min: 429.54 / Avg: 447.61 / Max: 484.44Min: 443.1 / Avg: 447.5 / Max: 450.82Min: 419.06 / Avg: 423.59 / Max: 426.5Min: 393.15 / Avg: 406.58 / Max: 426.62Min: 399.84 / Avg: 401.84 / Max: 403.19Min: 395.26 / Avg: 397.44 / Max: 398.87Min: 390.4 / Avg: 391.4 / Max: 392.06Min: 382.18 / Avg: 386 / Max: 388.1Min: 372.9 / Avg: 375.73 / Max: 378.68Min: 308.4 / Avg: 308.46 / Max: 308.54Min: 287.28 / Avg: 287.42 / Max: 287.52

Zstd Compression

This test measures the time needed to compress/decompress a sample file (silesia.tar) using Zstd (Zstandard) compression with options for different compression levels / settings. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgMB/s, More Is BetterZstd Compression 1.5.4Compression Level: 19 - Decompression SpeedEPYC 9684X 2PEPYC 9654EPYC 9684XEPYC 9654 2PXeon Platinum 8592+Xeon Platinum 8592+ 2PEPYC 8534PNEPYC 9754EPYC 9754 2PXeon Max 9480Xeon Max 9468EPYC 8534PXeon Max 9468 2PXeon Max 9480 2PXeon Platinum 8490HXeon Platinum 8490H 2P30060090012001500SE +/- 1.73, N = 3SE +/- 0.46, N = 3SE +/- 7.31, N = 3SE +/- 2.20, N = 3SE +/- 3.01, N = 4SE +/- 1.88, N = 3SE +/- 1.58, N = 3SE +/- 0.83, N = 3SE +/- 1.83, N = 3SE +/- 1.08, N = 15SE +/- 2.12, N = 3SE +/- 21.23, N = 3SE +/- 0.66, N = 15SE +/- 0.65, N = 15SE +/- 4.45, N = 3SE +/- 4.96, N = 31392.51388.91385.31382.11221.81165.81144.81139.91139.01127.51126.41118.81040.21039.21032.0963.61. (CC) gcc options: -O3 -pthread -lz -llzma
OpenBenchmarking.orgMB/s, More Is BetterZstd Compression 1.5.4Compression Level: 19 - Decompression SpeedEPYC 9684X 2PEPYC 9654EPYC 9684XEPYC 9654 2PXeon Platinum 8592+Xeon Platinum 8592+ 2PEPYC 8534PNEPYC 9754EPYC 9754 2PXeon Max 9480Xeon Max 9468EPYC 8534PXeon Max 9468 2PXeon Max 9480 2PXeon Platinum 8490HXeon Platinum 8490H 2P2004006008001000Min: 1389.3 / Avg: 1392.53 / Max: 1395.2Min: 1388 / Avg: 1388.9 / Max: 1389.5Min: 1370.9 / Avg: 1385.27 / Max: 1394.8Min: 1378.9 / Avg: 1382.07 / Max: 1386.3Min: 1217.4 / Avg: 1221.83 / Max: 1230.5Min: 1162.1 / Avg: 1165.8 / Max: 1168.2Min: 1141.8 / Avg: 1144.77 / Max: 1147.2Min: 1138.7 / Avg: 1139.93 / Max: 1141.5Min: 1135.5 / Avg: 1138.97 / Max: 1141.7Min: 1119 / Avg: 1127.51 / Max: 1131.8Min: 1122.6 / Avg: 1126.43 / Max: 1129.9Min: 1076.6 / Avg: 1118.83 / Max: 1143.8Min: 1036.2 / Avg: 1040.2 / Max: 1044.9Min: 1035.2 / Avg: 1039.18 / Max: 1043.3Min: 1024.3 / Avg: 1032 / Max: 1039.7Min: 954.2 / Avg: 963.57 / Max: 971.11. (CC) gcc options: -O3 -pthread -lz -llzma

OpenBenchmarking.orgMB/s, More Is BetterZstd Compression 1.5.4Compression Level: 19 - Compression SpeedXeon Platinum 8592+Xeon Platinum 8592+ 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9684X 2PXeon Platinum 8490H 2PXeon Platinum 8490HXeon Max 9480Xeon Max 9468EPYC 8534PXeon Max 9468 2PEPYC 9754EPYC 8534PNEPYC 9754 2PXeon Max 9480 2P48121620SE +/- 0.21, N = 4SE +/- 0.03, N = 3SE +/- 0.03, N = 3SE +/- 0.00, N = 3SE +/- 0.09, N = 3SE +/- 0.22, N = 3SE +/- 0.12, N = 3SE +/- 0.06, N = 3SE +/- 0.11, N = 15SE +/- 0.15, N = 3SE +/- 0.00, N = 3SE +/- 0.09, N = 15SE +/- 0.06, N = 3SE +/- 0.03, N = 3SE +/- 0.03, N = 3SE +/- 0.13, N = 1518.017.817.217.217.016.815.214.614.514.413.913.813.813.813.713.31. (CC) gcc options: -O3 -pthread -lz -llzma
OpenBenchmarking.orgMB/s, More Is BetterZstd Compression 1.5.4Compression Level: 19 - Compression SpeedXeon Platinum 8592+Xeon Platinum 8592+ 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9684X 2PXeon Platinum 8490H 2PXeon Platinum 8490HXeon Max 9480Xeon Max 9468EPYC 8534PXeon Max 9468 2PEPYC 9754EPYC 8534PNEPYC 9754 2PXeon Max 9480 2P510152025Min: 17.7 / Avg: 18 / Max: 18.6Min: 17.7 / Avg: 17.77 / Max: 17.8Min: 17.1 / Avg: 17.17 / Max: 17.2Min: 17.2 / Avg: 17.2 / Max: 17.2Min: 16.8 / Avg: 16.97 / Max: 17.1Min: 16.4 / Avg: 16.83 / Max: 17.1Min: 15 / Avg: 15.17 / Max: 15.4Min: 14.5 / Avg: 14.6 / Max: 14.7Min: 13.7 / Avg: 14.49 / Max: 15.2Min: 14.1 / Avg: 14.37 / Max: 14.6Min: 13.9 / Avg: 13.9 / Max: 13.9Min: 13.1 / Avg: 13.76 / Max: 14.4Min: 13.7 / Avg: 13.8 / Max: 13.9Min: 13.7 / Avg: 13.77 / Max: 13.8Min: 13.6 / Avg: 13.67 / Max: 13.7Min: 12.2 / Avg: 13.29 / Max: 13.91. (CC) gcc options: -O3 -pthread -lz -llzma

QMCPACK

QMCPACK is a modern high-performance open-source Quantum Monte Carlo (QMC) simulation code making use of MPI for this benchmark of the H20 example code. QMCPACK is an open-source production level many-body ab initio Quantum Monte Carlo code for computing the electronic structure of atoms, molecules, and solids. QMCPACK is supported by the U.S. Department of Energy. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgTotal Execution Time - Seconds, Fewer Is BetterQMCPACK 3.17.1Input: Li2_STO_aeEPYC 9684X 2PEPYC 9684XXeon Platinum 8592+ 2PXeon Platinum 8490H 2PXeon Max 9468 2PEPYC 9654 2PXeon Platinum 8592+Xeon Max 9480 2PEPYC 9654Xeon Platinum 8490HEPYC 9754EPYC 9754 2PXeon Max 9480Xeon Max 9468EPYC 8534PEPYC 8534PN306090120150SE +/- 0.06, N = 3SE +/- 1.06, N = 3SE +/- 0.93, N = 3SE +/- 1.11, N = 3SE +/- 0.88, N = 3SE +/- 0.23, N = 3SE +/- 1.03, N = 3SE +/- 1.11, N = 5SE +/- 0.54, N = 3SE +/- 0.89, N = 3SE +/- 0.63, N = 3SE +/- 0.42, N = 3SE +/- 1.04, N = 3SE +/- 1.20, N = 3SE +/- 1.13, N = 3SE +/- 0.40, N = 391.9797.0097.91101.63102.12102.98105.98106.27108.02109.30110.80111.15117.81121.19137.23151.271. (CXX) g++ options: -fopenmp -foffload=disable -finline-limit=1000 -fstrict-aliasing -funroll-all-loops -ffast-math -march=native -O3 -lm -ldl
OpenBenchmarking.orgTotal Execution Time - Seconds, Fewer Is BetterQMCPACK 3.17.1Input: Li2_STO_aeEPYC 9684X 2PEPYC 9684XXeon Platinum 8592+ 2PXeon Platinum 8490H 2PXeon Max 9468 2PEPYC 9654 2PXeon Platinum 8592+Xeon Max 9480 2PEPYC 9654Xeon Platinum 8490HEPYC 9754EPYC 9754 2PXeon Max 9480Xeon Max 9468EPYC 8534PEPYC 8534PN306090120150Min: 91.87 / Avg: 91.97 / Max: 92.09Min: 95.36 / Avg: 97 / Max: 98.97Min: 96.04 / Avg: 97.91 / Max: 98.88Min: 99.85 / Avg: 101.63 / Max: 103.68Min: 101.06 / Avg: 102.12 / Max: 103.88Min: 102.52 / Avg: 102.98 / Max: 103.22Min: 104.67 / Avg: 105.98 / Max: 108.02Min: 103.79 / Avg: 106.27 / Max: 109.86Min: 107.14 / Avg: 108.02 / Max: 109Min: 107.57 / Avg: 109.3 / Max: 110.52Min: 109.62 / Avg: 110.8 / Max: 111.78Min: 110.42 / Avg: 111.15 / Max: 111.89Min: 116.12 / Avg: 117.81 / Max: 119.69Min: 119.44 / Avg: 121.19 / Max: 123.49Min: 135.02 / Avg: 137.23 / Max: 138.75Min: 150.56 / Avg: 151.27 / Max: 151.931. (CXX) g++ options: -fopenmp -foffload=disable -finline-limit=1000 -fstrict-aliasing -funroll-all-loops -ffast-math -march=native -O3 -lm -ldl

Speedb

Speedb is a next-generation key value storage engine that is RocksDB compatible and aiming for stability, efficiency, and performance. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgOp/s, More Is BetterSpeedb 2.7Test: Random ReadEPYC 9754 2PEPYC 9684X 2PEPYC 9654 2PEPYC 9754Xeon Platinum 8592+ 2PXeon Platinum 8490H 2PEPYC 9684XXeon Max 9480 2PEPYC 9654Xeon Max 9468 2PXeon Platinum 8592+Xeon Platinum 8490HEPYC 8534PXeon Max 9480EPYC 8534PNXeon Max 9468300M600M900M1200M1500MSE +/- 2399164.12, N = 3SE +/- 5954964.38, N = 3SE +/- 955915.20, N = 3SE +/- 1606748.01, N = 3SE +/- 5399265.88, N = 15SE +/- 5393159.45, N = 3SE +/- 205170.43, N = 3SE +/- 2955608.21, N = 3SE +/- 66268.38, N = 3SE +/- 8491098.40, N = 15SE +/- 242146.75, N = 3SE +/- 168680.90, N = 3SE +/- 109015.29, N = 3SE +/- 2763560.64, N = 13SE +/- 70537.88, N = 3SE +/- 3698537.65, N = 15116994738510595465338576871795899510705861478715512869585376330344979074904285570544199435703151783812761796172740917782440706742429401102114570481. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti -lpthread
OpenBenchmarking.orgOp/s, More Is BetterSpeedb 2.7Test: Random ReadEPYC 9754 2PEPYC 9684X 2PEPYC 9654 2PEPYC 9754Xeon Platinum 8592+ 2PXeon Platinum 8490H 2PEPYC 9684XXeon Max 9480 2PEPYC 9654Xeon Max 9468 2PXeon Platinum 8592+Xeon Platinum 8490HEPYC 8534PXeon Max 9480EPYC 8534PNXeon Max 9468200M400M600M800M1000MMin: 1166288728 / Avg: 1169947385 / Max: 1174465326Min: 1048590952 / Avg: 1059546533 / Max: 1069069844Min: 855890268 / Avg: 857687178.67 / Max: 859151015Min: 586849882 / Avg: 589951069.67 / Max: 592230974Min: 537891393 / Avg: 586147871.33 / Max: 608835550Min: 540533097 / Avg: 551286957.67 / Max: 557388020Min: 537317761 / Avg: 537633034 / Max: 538018128Min: 493247765 / Avg: 497907489.67 / Max: 503387286Min: 428426945 / Avg: 428557054.33 / Max: 428643976Min: 365172792 / Avg: 419943569.73 / Max: 440904796Min: 314847036 / Avg: 315178380.67 / Max: 315649934Min: 275854286 / Avg: 276179617 / Max: 276419610Min: 273882563 / Avg: 274091778.33 / Max: 274249534Min: 211153701 / Avg: 244070673.77 / Max: 247613116Min: 242827547 / Avg: 242940110 / Max: 243070039Min: 183773999 / Avg: 211457047.53 / Max: 2188014191. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti -lpthread

OSPRay

OpenBenchmarking.orgItems Per Second, More Is BetterOSPRay 3.1Benchmark: particle_volume/ao/real_timeEPYC 9754 2PEPYC 9684X 2PXeon Platinum 8592+ 2PEPYC 9654 2PXeon Platinum 8490H 2PEPYC 9754Xeon Max 9480 2PEPYC 9684XXeon Platinum 8592+Xeon Max 9468 2PEPYC 9654Xeon Platinum 8490HXeon Max 9480EPYC 8534PEPYC 8534PNXeon Max 94681326395265SE +/- 0.02, N = 3SE +/- 0.03, N = 3SE +/- 0.07, N = 3SE +/- 0.01, N = 3SE +/- 0.02, N = 3SE +/- 0.03, N = 3SE +/- 0.00, N = 3SE +/- 0.02, N = 3SE +/- 0.01, N = 3SE +/- 0.02, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.02, N = 3SE +/- 0.04, N = 3SE +/- 0.04, N = 356.6955.3454.1247.6138.2235.2533.1132.5230.8429.5028.1021.9318.5517.9716.4516.05
OpenBenchmarking.orgItems Per Second, More Is BetterOSPRay 3.1Benchmark: particle_volume/ao/real_timeEPYC 9754 2PEPYC 9684X 2PXeon Platinum 8592+ 2PEPYC 9654 2PXeon Platinum 8490H 2PEPYC 9754Xeon Max 9480 2PEPYC 9684XXeon Platinum 8592+Xeon Max 9468 2PEPYC 9654Xeon Platinum 8490HXeon Max 9480EPYC 8534PEPYC 8534PNXeon Max 94681122334455Min: 56.66 / Avg: 56.69 / Max: 56.72Min: 55.28 / Avg: 55.34 / Max: 55.38Min: 53.98 / Avg: 54.12 / Max: 54.23Min: 47.59 / Avg: 47.61 / Max: 47.64Min: 38.18 / Avg: 38.22 / Max: 38.25Min: 35.21 / Avg: 35.25 / Max: 35.31Min: 33.11 / Avg: 33.11 / Max: 33.12Min: 32.5 / Avg: 32.52 / Max: 32.55Min: 30.82 / Avg: 30.84 / Max: 30.85Min: 29.46 / Avg: 29.5 / Max: 29.53Min: 28.07 / Avg: 28.1 / Max: 28.12Min: 21.91 / Avg: 21.93 / Max: 21.95Min: 18.53 / Avg: 18.55 / Max: 18.57Min: 17.94 / Avg: 17.97 / Max: 18.01Min: 16.37 / Avg: 16.45 / Max: 16.51Min: 15.99 / Avg: 16.05 / Max: 16.11

Xmrig

Xmrig is an open-source cross-platform CPU/GPU miner for RandomX, KawPow, CryptoNight and AstroBWT. This test profile is setup to measure the Xmrig CPU mining performance. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgH/s, More Is BetterXmrig 6.21Variant: GhostRider - Hash Count: 1MEPYC 9684X 2PEPYC 9654 2PEPYC 9754 2PXeon Platinum 8592+ 2PEPYC 9684XEPYC 9654Xeon Max 9480 2PXeon Platinum 8490H 2PXeon Max 9468 2PEPYC 9754Xeon Platinum 8592+Xeon Max 9480Xeon Platinum 8490HXeon Max 9468EPYC 8534PEPYC 8534PN7K14K21K28K35KSE +/- 95.10, N = 3SE +/- 290.50, N = 3SE +/- 46.94, N = 3SE +/- 64.69, N = 3SE +/- 10.36, N = 3SE +/- 117.32, N = 3SE +/- 7.44, N = 3SE +/- 4.03, N = 3SE +/- 14.02, N = 3SE +/- 61.27, N = 3SE +/- 44.68, N = 3SE +/- 14.78, N = 3SE +/- 23.16, N = 3SE +/- 12.93, N = 3SE +/- 30.53, N = 3SE +/- 41.94, N = 331157.826702.717873.116324.715786.614207.712115.011263.210975.89320.58378.36122.35808.85446.84660.04564.31. (CXX) g++ options: -fexceptions -fno-rtti -maes -O3 -Ofast -static-libgcc -static-libstdc++ -rdynamic -lssl -lcrypto -luv -lpthread -lrt -ldl -lhwloc
OpenBenchmarking.orgH/s, More Is BetterXmrig 6.21Variant: GhostRider - Hash Count: 1MEPYC 9684X 2PEPYC 9654 2PEPYC 9754 2PXeon Platinum 8592+ 2PEPYC 9684XEPYC 9654Xeon Max 9480 2PXeon Platinum 8490H 2PXeon Max 9468 2PEPYC 9754Xeon Platinum 8592+Xeon Max 9480Xeon Platinum 8490HXeon Max 9468EPYC 8534PEPYC 8534PN5K10K15K20K25KMin: 30975.1 / Avg: 31157.77 / Max: 31295Min: 26163.6 / Avg: 26702.67 / Max: 27159.9Min: 17783.2 / Avg: 17873.13 / Max: 17941.4Min: 16244.8 / Avg: 16324.73 / Max: 16452.8Min: 15775.4 / Avg: 15786.6 / Max: 15807.3Min: 14003.4 / Avg: 14207.67 / Max: 14409.8Min: 12100.2 / Avg: 12115 / Max: 12123.7Min: 11256.6 / Avg: 11263.17 / Max: 11270.5Min: 10950.9 / Avg: 10975.83 / Max: 10999.4Min: 9198 / Avg: 9320.53 / Max: 9383.4Min: 8302.5 / Avg: 8378.33 / Max: 8457.2Min: 6093.4 / Avg: 6122.3 / Max: 6142.1Min: 5783.9 / Avg: 5808.83 / Max: 5855.1Min: 5428.9 / Avg: 5446.77 / Max: 5471.9Min: 4615.6 / Avg: 4660 / Max: 4718.5Min: 4483.5 / Avg: 4564.3 / Max: 4624.21. (CXX) g++ options: -fexceptions -fno-rtti -maes -O3 -Ofast -static-libgcc -static-libstdc++ -rdynamic -lssl -lcrypto -luv -lpthread -lrt -ldl -lhwloc

ONNX Runtime

ONNX Runtime is developed by Microsoft and partners as a open-source, cross-platform, high performance machine learning inferencing and training accelerator. This test profile runs the ONNX Runtime with various models available from the ONNX Model Zoo. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgInference Time Cost (ms), Fewer Is BetterONNX Runtime 1.17Model: GPT-2 - Device: CPU - Executor: StandardXeon Platinum 8592+Xeon Platinum 8592+ 2PXeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9480EPYC 9684XEPYC 9684X 2PXeon Max 9468 2PXeon Max 9480 2PEPYC 9654EPYC 9654 2PEPYC 9754EPYC 8534PEPYC 8534PNEPYC 9754 2P3691215SE +/- 0.01631, N = 3SE +/- 0.15083, N = 15SE +/- 0.03075, N = 3SE +/- 0.03218, N = 3SE +/- 0.06596, N = 15SE +/- 0.06620, N = 3SE +/- 0.02661, N = 3SE +/- 0.01742, N = 3SE +/- 0.02902, N = 3SE +/- 0.06105, N = 3SE +/- 0.08751, N = 5SE +/- 0.01221, N = 3SE +/- 0.01807, N = 3SE +/- 0.03478, N = 3SE +/- 0.07964, N = 3SE +/- 0.20120, N = 153.696494.295314.499765.551015.677005.919616.166686.171907.041117.532597.885849.7461411.1392011.2047011.2864011.577401. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt
OpenBenchmarking.orgInference Time Cost (ms), Fewer Is BetterONNX Runtime 1.17Model: GPT-2 - Device: CPU - Executor: StandardXeon Platinum 8592+Xeon Platinum 8592+ 2PXeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9480EPYC 9684XEPYC 9684X 2PXeon Max 9468 2PXeon Max 9480 2PEPYC 9654EPYC 9654 2PEPYC 9754EPYC 8534PEPYC 8534PNEPYC 9754 2P3691215Min: 3.68 / Avg: 3.7 / Max: 3.73Min: 3.71 / Avg: 4.3 / Max: 5.01Min: 4.45 / Avg: 4.5 / Max: 4.56Min: 5.49 / Avg: 5.55 / Max: 5.6Min: 5.34 / Avg: 5.68 / Max: 6.16Min: 5.84 / Avg: 5.92 / Max: 6.05Min: 6.11 / Avg: 6.17 / Max: 6.2Min: 6.15 / Avg: 6.17 / Max: 6.21Min: 6.98 / Avg: 7.04 / Max: 7.08Min: 7.41 / Avg: 7.53 / Max: 7.6Min: 7.75 / Avg: 7.89 / Max: 8.23Min: 9.73 / Avg: 9.75 / Max: 9.77Min: 11.11 / Avg: 11.14 / Max: 11.17Min: 11.16 / Avg: 11.2 / Max: 11.27Min: 11.13 / Avg: 11.29 / Max: 11.4Min: 10.85 / Avg: 11.58 / Max: 12.961. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.17Model: GPT-2 - Device: CPU - Executor: StandardXeon Platinum 8592+Xeon Platinum 8592+ 2PXeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9480EPYC 9684XEPYC 9684X 2PXeon Max 9468 2PXeon Max 9480 2PEPYC 9654EPYC 9654 2PEPYC 9754EPYC 8534PEPYC 8534PNEPYC 9754 2P60120180240300SE +/- 1.19, N = 3SE +/- 8.14, N = 15SE +/- 1.50, N = 3SE +/- 1.05, N = 3SE +/- 2.01, N = 15SE +/- 1.88, N = 3SE +/- 0.70, N = 3SE +/- 0.46, N = 3SE +/- 0.58, N = 3SE +/- 1.08, N = 3SE +/- 1.37, N = 5SE +/- 0.13, N = 3SE +/- 0.15, N = 3SE +/- 0.28, N = 3SE +/- 0.63, N = 3SE +/- 1.43, N = 15270.33236.65222.03180.03176.33168.86162.09161.95141.95132.71126.82102.5789.7489.2188.5786.691. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt
OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.17Model: GPT-2 - Device: CPU - Executor: StandardXeon Platinum 8592+Xeon Platinum 8592+ 2PXeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9480EPYC 9684XEPYC 9684X 2PXeon Max 9468 2PXeon Max 9480 2PEPYC 9654EPYC 9654 2PEPYC 9754EPYC 8534PEPYC 8534PNEPYC 9754 2P50100150200250Min: 267.97 / Avg: 270.33 / Max: 271.72Min: 199.33 / Avg: 236.65 / Max: 269.01Min: 219.24 / Avg: 222.03 / Max: 224.4Min: 178.44 / Avg: 180.03 / Max: 182Min: 162.19 / Avg: 176.33 / Max: 187.26Min: 165.14 / Avg: 168.86 / Max: 171.13Min: 161.32 / Avg: 162.09 / Max: 163.5Min: 161.04 / Avg: 161.95 / Max: 162.43Min: 141.15 / Avg: 141.95 / Max: 143.09Min: 131.45 / Avg: 132.71 / Max: 134.87Min: 121.43 / Avg: 126.82 / Max: 129.02Min: 102.33 / Avg: 102.57 / Max: 102.75Min: 89.47 / Avg: 89.74 / Max: 89.98Min: 88.65 / Avg: 89.21 / Max: 89.56Min: 87.67 / Avg: 88.57 / Max: 89.78Min: 77.11 / Avg: 86.69 / Max: 92.151. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

OpenVINO

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPUXeon Max 9468 2PXeon Platinum 8490H 2PXeon Max 9480 2PXeon Max 9468EPYC 9654 2PEPYC 9684X 2PXeon Max 9480EPYC 9754 2PXeon Platinum 8490HEPYC 9684XXeon Platinum 8592+ 2PEPYC 9654Xeon Platinum 8592+EPYC 8534PEPYC 8534PNEPYC 97540.16430.32860.49290.65720.8215SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 15SE +/- 0.00, N = 3SE +/- 0.00, N = 15SE +/- 0.00, N = 7SE +/- 0.01, N = 3SE +/- 0.00, N = 9SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 30.280.290.300.330.350.350.370.410.430.450.460.480.490.530.600.73MIN: 0.25 / MAX: 41.4MIN: 0.24 / MAX: 39.69MIN: 0.26 / MAX: 42.1MIN: 0.26 / MAX: 19.2MIN: 0.32 / MAX: 81.66MIN: 0.32 / MAX: 82.66MIN: 0.28 / MAX: 40.85MIN: 0.39 / MAX: 91.48MIN: 0.23 / MAX: 17.03MIN: 0.22 / MAX: 19.11MIN: 0.18 / MAX: 22.29MIN: 0.22 / MAX: 18.92MIN: 0.18 / MAX: 16.07MIN: 0.26 / MAX: 22.12MIN: 0.26 / MAX: 24.7MIN: 0.26 / MAX: 23.11. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPUXeon Max 9468 2PXeon Platinum 8490H 2PXeon Max 9480 2PXeon Max 9468EPYC 9654 2PEPYC 9684X 2PXeon Max 9480EPYC 9754 2PXeon Platinum 8490HEPYC 9684XXeon Platinum 8592+ 2PEPYC 9654Xeon Platinum 8592+EPYC 8534PEPYC 8534PNEPYC 9754246810Min: 0.28 / Avg: 0.28 / Max: 0.29Min: 0.29 / Avg: 0.29 / Max: 0.29Min: 0.3 / Avg: 0.3 / Max: 0.31Min: 0.33 / Avg: 0.33 / Max: 0.34Min: 0.35 / Avg: 0.35 / Max: 0.35Min: 0.35 / Avg: 0.35 / Max: 0.35Min: 0.36 / Avg: 0.37 / Max: 0.38Min: 0.41 / Avg: 0.41 / Max: 0.41Min: 0.43 / Avg: 0.43 / Max: 0.43Min: 0.45 / Avg: 0.45 / Max: 0.46Min: 0.45 / Avg: 0.46 / Max: 0.47Min: 0.47 / Avg: 0.48 / Max: 0.49Min: 0.49 / Avg: 0.49 / Max: 0.5Min: 0.53 / Avg: 0.53 / Max: 0.53Min: 0.6 / Avg: 0.6 / Max: 0.6Min: 0.72 / Avg: 0.73 / Max: 0.731. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPUXeon Platinum 8490H 2PEPYC 9684X 2PXeon Max 9480 2PXeon Max 9468 2PEPYC 9654 2PEPYC 9754 2PXeon Max 9480EPYC 9684XXeon Max 9468EPYC 9654EPYC 9754Xeon Platinum 8592+ 2PXeon Platinum 8490HEPYC 8534PXeon Platinum 8592+EPYC 8534PN40K80K120K160K200KSE +/- 2494.14, N = 3SE +/- 1640.61, N = 7SE +/- 1422.88, N = 15SE +/- 18.38, N = 3SE +/- 1922.38, N = 15SE +/- 1374.23, N = 9SE +/- 1761.33, N = 3SE +/- 162.47, N = 3SE +/- 383.22, N = 3SE +/- 205.87, N = 3SE +/- 89.35, N = 3SE +/- 1158.60, N = 3SE +/- 75.30, N = 3SE +/- 86.99, N = 3SE +/- 988.12, N = 3SE +/- 55.52, N = 3189893.31178488.03176900.32174862.56172688.50166151.42140144.01138605.52135075.07133779.62132973.43128566.81115106.3087511.1181279.7978334.921. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPUXeon Platinum 8490H 2PEPYC 9684X 2PXeon Max 9480 2PXeon Max 9468 2PEPYC 9654 2PEPYC 9754 2PXeon Max 9480EPYC 9684XXeon Max 9468EPYC 9654EPYC 9754Xeon Platinum 8592+ 2PXeon Platinum 8490HEPYC 8534PXeon Platinum 8592+EPYC 8534PN30K60K90K120K150KMin: 186685.76 / Avg: 189893.31 / Max: 194805.55Min: 173708.48 / Avg: 178488.03 / Max: 186134.02Min: 168872.14 / Avg: 176900.32 / Max: 183917.68Min: 174838.3 / Avg: 174862.56 / Max: 174898.6Min: 162383.84 / Avg: 172688.5 / Max: 188618.87Min: 162530.5 / Avg: 166151.42 / Max: 175835.15Min: 136639.43 / Avg: 140144.01 / Max: 142204.97Min: 138401.16 / Avg: 138605.52 / Max: 138926.49Min: 134312.2 / Avg: 135075.07 / Max: 135520.49Min: 133368.55 / Avg: 133779.62 / Max: 134005.43Min: 132824.34 / Avg: 132973.43 / Max: 133133.3Min: 126358.92 / Avg: 128566.81 / Max: 130279.86Min: 115010.38 / Avg: 115106.3 / Max: 115254.8Min: 87337.82 / Avg: 87511.11 / Max: 87611.1Min: 79424.55 / Avg: 81279.79 / Max: 82797.06Min: 78265.68 / Avg: 78334.92 / Max: 78444.721. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

ONNX Runtime

ONNX Runtime is developed by Microsoft and partners as a open-source, cross-platform, high performance machine learning inferencing and training accelerator. This test profile runs the ONNX Runtime with various models available from the ONNX Model Zoo. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgInference Time Cost (ms), Fewer Is BetterONNX Runtime 1.17Model: T5 Encoder - Device: CPU - Executor: StandardXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8592+ 2PXeon Platinum 8490H 2PEPYC 9684XEPYC 9684X 2PXeon Max 9468Xeon Max 9480Xeon Max 9468 2PEPYC 9654Xeon Max 9480 2PEPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PNEPYC 8534P246810SE +/- 0.00472, N = 3SE +/- 0.00659, N = 3SE +/- 0.02371, N = 3SE +/- 0.00316, N = 3SE +/- 0.01718, N = 3SE +/- 0.06302, N = 15SE +/- 0.08827, N = 15SE +/- 0.01103, N = 3SE +/- 0.03283, N = 3SE +/- 0.03084, N = 3SE +/- 0.02608, N = 3SE +/- 0.06624, N = 3SE +/- 0.06745, N = 3SE +/- 0.07124, N = 3SE +/- 0.03354, N = 3SE +/- 0.06404, N = 132.169662.796942.802633.465713.575433.807924.575814.647575.022675.346565.391235.984367.633377.840657.860157.873251. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt
OpenBenchmarking.orgInference Time Cost (ms), Fewer Is BetterONNX Runtime 1.17Model: T5 Encoder - Device: CPU - Executor: StandardXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8592+ 2PXeon Platinum 8490H 2PEPYC 9684XEPYC 9684X 2PXeon Max 9468Xeon Max 9480Xeon Max 9468 2PEPYC 9654Xeon Max 9480 2PEPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PNEPYC 8534P3691215Min: 2.16 / Avg: 2.17 / Max: 2.18Min: 2.78 / Avg: 2.8 / Max: 2.8Min: 2.76 / Avg: 2.8 / Max: 2.85Min: 3.46 / Avg: 3.47 / Max: 3.47Min: 3.54 / Avg: 3.58 / Max: 3.6Min: 3.58 / Avg: 3.81 / Max: 4.21Min: 4.3 / Avg: 4.58 / Max: 5.28Min: 4.63 / Avg: 4.65 / Max: 4.67Min: 4.96 / Avg: 5.02 / Max: 5.06Min: 5.3 / Avg: 5.35 / Max: 5.41Min: 5.36 / Avg: 5.39 / Max: 5.44Min: 5.86 / Avg: 5.98 / Max: 6.08Min: 7.51 / Avg: 7.63 / Max: 7.75Min: 7.76 / Avg: 7.84 / Max: 7.98Min: 7.79 / Avg: 7.86 / Max: 7.9Min: 7.59 / Avg: 7.87 / Max: 8.561. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.17Model: T5 Encoder - Device: CPU - Executor: StandardXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8592+ 2PXeon Platinum 8490H 2PEPYC 9684XEPYC 9684X 2PXeon Max 9468Xeon Max 9480Xeon Max 9468 2PEPYC 9654Xeon Max 9480 2PEPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PNEPYC 8534P100200300400500SE +/- 1.00, N = 3SE +/- 0.84, N = 3SE +/- 3.01, N = 3SE +/- 0.26, N = 3SE +/- 1.35, N = 3SE +/- 4.17, N = 15SE +/- 3.95, N = 15SE +/- 0.51, N = 3SE +/- 1.31, N = 3SE +/- 1.08, N = 3SE +/- 0.89, N = 3SE +/- 1.86, N = 3SE +/- 1.16, N = 3SE +/- 1.15, N = 3SE +/- 0.54, N = 3SE +/- 0.98, N = 13460.78357.36356.76288.47279.64263.52219.53215.13199.08187.01185.46167.11131.00127.54127.21127.091. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt
OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.17Model: T5 Encoder - Device: CPU - Executor: StandardXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8592+ 2PXeon Platinum 8490H 2PEPYC 9684XEPYC 9684X 2PXeon Max 9468Xeon Max 9480Xeon Max 9468 2PEPYC 9654Xeon Max 9480 2PEPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PNEPYC 8534P80160240320400Min: 459 / Avg: 460.78 / Max: 462.47Min: 356.49 / Avg: 357.35 / Max: 359.04Min: 351.26 / Avg: 356.76 / Max: 361.65Min: 287.98 / Avg: 288.47 / Max: 288.88Min: 277.47 / Avg: 279.64 / Max: 282.11Min: 237.75 / Avg: 263.52 / Max: 279.12Min: 189.44 / Avg: 219.53 / Max: 232.62Min: 214.14 / Avg: 215.13 / Max: 215.81Min: 197.61 / Avg: 199.08 / Max: 201.68Min: 184.94 / Avg: 187.01 / Max: 188.53Min: 183.72 / Avg: 185.46 / Max: 186.68Min: 164.4 / Avg: 167.11 / Max: 170.67Min: 129.09 / Avg: 131 / Max: 133.1Min: 125.24 / Avg: 127.54 / Max: 128.77Min: 126.49 / Avg: 127.21 / Max: 128.27Min: 116.79 / Avg: 127.08 / Max: 131.651. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

VVenC

OpenBenchmarking.orgFrames Per Second, More Is BetterVVenC 1.11Video Input: Bosphorus 4K - Video Preset: FastEPYC 9684XEPYC 9654Xeon Platinum 8592+Xeon Platinum 8592+ 2PXeon Platinum 8490HXeon Max 9480Xeon Platinum 8490H 2PEPYC 9754Xeon Max 9468EPYC 8534PXeon Max 9480 2PXeon Max 9468 2PEPYC 8534PN246810SE +/- 0.057, N = 3SE +/- 0.048, N = 3SE +/- 0.023, N = 3SE +/- 0.038, N = 3SE +/- 0.022, N = 3SE +/- 0.033, N = 3SE +/- 0.047, N = 3SE +/- 0.045, N = 3SE +/- 0.010, N = 3SE +/- 0.038, N = 3SE +/- 0.043, N = 15SE +/- 0.081, N = 3SE +/- 0.041, N = 37.5477.4317.3926.9606.7196.5016.4806.4656.3246.1186.0776.0236.0001. (CXX) g++ options: -O3 -flto=auto -fno-fat-lto-objects
OpenBenchmarking.orgFrames Per Second, More Is BetterVVenC 1.11Video Input: Bosphorus 4K - Video Preset: FastEPYC 9684XEPYC 9654Xeon Platinum 8592+Xeon Platinum 8592+ 2PXeon Platinum 8490HXeon Max 9480Xeon Platinum 8490H 2PEPYC 9754Xeon Max 9468EPYC 8534PXeon Max 9480 2PXeon Max 9468 2PEPYC 8534PN3691215Min: 7.43 / Avg: 7.55 / Max: 7.61Min: 7.34 / Avg: 7.43 / Max: 7.49Min: 7.35 / Avg: 7.39 / Max: 7.43Min: 6.89 / Avg: 6.96 / Max: 7.02Min: 6.68 / Avg: 6.72 / Max: 6.76Min: 6.44 / Avg: 6.5 / Max: 6.56Min: 6.42 / Avg: 6.48 / Max: 6.57Min: 6.38 / Avg: 6.47 / Max: 6.52Min: 6.31 / Avg: 6.32 / Max: 6.34Min: 6.04 / Avg: 6.12 / Max: 6.16Min: 5.78 / Avg: 6.08 / Max: 6.31Min: 5.88 / Avg: 6.02 / Max: 6.16Min: 5.92 / Avg: 6 / Max: 6.051. (CXX) g++ options: -O3 -flto=auto -fno-fat-lto-objects

Video Input: Bosphorus 4K - Video Preset: Fast

EPYC 9654 2P: The test quit with a non-zero exit status. E: Parameter Check Error: Number of threads out of range (-1

EPYC 9684X 2P: The test quit with a non-zero exit status. E: Parameter Check Error: Number of threads out of range (-1

EPYC 9754 2P: The test quit with a non-zero exit status. E: Parameter Check Error: Number of threads out of range (-1

ONNX Runtime

ONNX Runtime is developed by Microsoft and partners as a open-source, cross-platform, high performance machine learning inferencing and training accelerator. This test profile runs the ONNX Runtime with various models available from the ONNX Model Zoo. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgInference Time Cost (ms), Fewer Is BetterONNX Runtime 1.17Model: super-resolution-10 - Device: CPU - Executor: StandardXeon Platinum 8592+Xeon Platinum 8592+ 2PXeon Platinum 8490HXeon Max 9468Xeon Max 9480Xeon Platinum 8490H 2PXeon Max 9468 2PXeon Max 9480 2PEPYC 9684XEPYC 9654EPYC 9684X 2PEPYC 8534PEPYC 9754EPYC 8534PNEPYC 9754 2PEPYC 9654 2P3691215SE +/- 0.00044, N = 3SE +/- 0.05342, N = 3SE +/- 0.00313, N = 3SE +/- 0.00187, N = 3SE +/- 0.00532, N = 3SE +/- 0.10855, N = 15SE +/- 0.05347, N = 4SE +/- 0.02558, N = 3SE +/- 0.03798, N = 3SE +/- 0.04482, N = 3SE +/- 0.18371, N = 12SE +/- 0.02616, N = 3SE +/- 0.02331, N = 3SE +/- 0.02847, N = 3SE +/- 0.26893, N = 15SE +/- 0.06617, N = 33.857743.980134.396494.589124.672694.725304.858185.002228.133268.150928.399699.386819.421779.7113110.2310610.434401. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt
OpenBenchmarking.orgInference Time Cost (ms), Fewer Is BetterONNX Runtime 1.17Model: super-resolution-10 - Device: CPU - Executor: StandardXeon Platinum 8592+Xeon Platinum 8592+ 2PXeon Platinum 8490HXeon Max 9468Xeon Max 9480Xeon Platinum 8490H 2PXeon Max 9468 2PXeon Max 9480 2PEPYC 9684XEPYC 9654EPYC 9684X 2PEPYC 8534PEPYC 9754EPYC 8534PNEPYC 9754 2PEPYC 9654 2P3691215Min: 3.86 / Avg: 3.86 / Max: 3.86Min: 3.88 / Avg: 3.98 / Max: 4.07Min: 4.39 / Avg: 4.4 / Max: 4.4Min: 4.59 / Avg: 4.59 / Max: 4.59Min: 4.66 / Avg: 4.67 / Max: 4.68Min: 4.41 / Avg: 4.73 / Max: 6.01Min: 4.71 / Avg: 4.86 / Max: 4.95Min: 4.98 / Avg: 5 / Max: 5.05Min: 8.06 / Avg: 8.13 / Max: 8.17Min: 8.07 / Avg: 8.15 / Max: 8.23Min: 8.14 / Avg: 8.4 / Max: 10.41Min: 9.34 / Avg: 9.39 / Max: 9.42Min: 9.38 / Avg: 9.42 / Max: 9.46Min: 9.66 / Avg: 9.71 / Max: 9.75Min: 9.28 / Avg: 10.23 / Max: 11.89Min: 10.34 / Avg: 10.43 / Max: 10.561. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.17Model: super-resolution-10 - Device: CPU - Executor: StandardXeon Platinum 8592+Xeon Platinum 8592+ 2PXeon Platinum 8490HXeon Max 9468Xeon Max 9480Xeon Platinum 8490H 2PXeon Max 9468 2PXeon Max 9480 2PEPYC 9684XEPYC 9654EPYC 9684X 2PEPYC 8534PEPYC 9754EPYC 8534PNEPYC 9754 2PEPYC 9654 2P60120180240300SE +/- 0.03, N = 3SE +/- 3.39, N = 3SE +/- 0.16, N = 3SE +/- 0.09, N = 3SE +/- 0.25, N = 3SE +/- 4.15, N = 15SE +/- 2.30, N = 4SE +/- 1.02, N = 3SE +/- 0.58, N = 3SE +/- 0.67, N = 3SE +/- 2.15, N = 12SE +/- 0.30, N = 3SE +/- 0.26, N = 3SE +/- 0.30, N = 3SE +/- 2.46, N = 15SE +/- 0.61, N = 3259.19251.31227.42217.88213.99212.92205.89199.90122.95122.68119.56106.53106.13102.9798.6495.841. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt
OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.17Model: super-resolution-10 - Device: CPU - Executor: StandardXeon Platinum 8592+Xeon Platinum 8592+ 2PXeon Platinum 8490HXeon Max 9468Xeon Max 9480Xeon Platinum 8490H 2PXeon Max 9468 2PXeon Max 9480 2PEPYC 9684XEPYC 9654EPYC 9684X 2PEPYC 8534PEPYC 9754EPYC 8534PNEPYC 9754 2PEPYC 9654 2P50100150200250Min: 259.13 / Avg: 259.19 / Max: 259.22Min: 245.94 / Avg: 251.3 / Max: 257.58Min: 227.12 / Avg: 227.42 / Max: 227.66Min: 217.72 / Avg: 217.88 / Max: 218.03Min: 213.65 / Avg: 213.99 / Max: 214.46Min: 166.26 / Avg: 212.92 / Max: 226.64Min: 201.86 / Avg: 205.88 / Max: 212.41Min: 197.86 / Avg: 199.9 / Max: 200.92Min: 122.34 / Avg: 122.95 / Max: 124.1Min: 121.53 / Avg: 122.68 / Max: 123.86Min: 96.02 / Avg: 119.56 / Max: 122.78Min: 106.15 / Avg: 106.53 / Max: 107.11Min: 105.73 / Avg: 106.13 / Max: 106.63Min: 102.52 / Avg: 102.97 / Max: 103.54Min: 84.1 / Avg: 98.64 / Max: 107.78Min: 94.69 / Avg: 95.84 / Max: 96.741. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

Zstd Compression

This test measures the time needed to compress/decompress a sample file (silesia.tar) using Zstd (Zstandard) compression with options for different compression levels / settings. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgMB/s, More Is BetterZstd Compression 1.5.4Compression Level: 19, Long Mode - Decompression SpeedEPYC 9654EPYC 9684XEPYC 9654 2PEPYC 9684X 2PXeon Platinum 8592+Xeon Platinum 8592+ 2PXeon Max 9480Xeon Max 9468EPYC 9754 2PEPYC 9754EPYC 8534PEPYC 8534PNXeon Platinum 8490HXeon Max 9480 2PXeon Max 9468 2PXeon Platinum 8490H 2P30060090012001500SE +/- 1.17, N = 3SE +/- 1.99, N = 3SE +/- 1.87, N = 3SE +/- 2.93, N = 3SE +/- 0.84, N = 3SE +/- 1.60, N = 3SE +/- 1.45, N = 3SE +/- 0.56, N = 3SE +/- 0.19, N = 3SE +/- 1.95, N = 3SE +/- 2.09, N = 3SE +/- 0.92, N = 3SE +/- 0.43, N = 3SE +/- 1.78, N = 15SE +/- 1.00, N = 3SE +/- 3.69, N = 31328.51324.91324.61321.41242.61189.71133.31131.11104.21102.21101.41096.51069.11046.01041.8992.11. (CC) gcc options: -O3 -pthread -lz -llzma
OpenBenchmarking.orgMB/s, More Is BetterZstd Compression 1.5.4Compression Level: 19, Long Mode - Decompression SpeedEPYC 9654EPYC 9684XEPYC 9654 2PEPYC 9684X 2PXeon Platinum 8592+Xeon Platinum 8592+ 2PXeon Max 9480Xeon Max 9468EPYC 9754 2PEPYC 9754EPYC 8534PEPYC 8534PNXeon Platinum 8490HXeon Max 9480 2PXeon Max 9468 2PXeon Platinum 8490H 2P2004006008001000Min: 1326.2 / Avg: 1328.53 / Max: 1329.9Min: 1322.3 / Avg: 1324.9 / Max: 1328.8Min: 1321.1 / Avg: 1324.6 / Max: 1327.5Min: 1315.7 / Avg: 1321.37 / Max: 1325.5Min: 1241.7 / Avg: 1242.63 / Max: 1244.3Min: 1186.5 / Avg: 1189.67 / Max: 1191.6Min: 1131.3 / Avg: 1133.27 / Max: 1136.1Min: 1130.3 / Avg: 1131.13 / Max: 1132.2Min: 1103.8 / Avg: 1104.17 / Max: 1104.4Min: 1098.4 / Avg: 1102.23 / Max: 1104.8Min: 1097.6 / Avg: 1101.37 / Max: 1104.8Min: 1094.7 / Avg: 1096.5 / Max: 1097.7Min: 1068.2 / Avg: 1069.07 / Max: 1069.5Min: 1022.2 / Avg: 1046.02 / Max: 1050.8Min: 1040.5 / Avg: 1041.83 / Max: 1043.8Min: 988 / Avg: 992.13 / Max: 999.51. (CC) gcc options: -O3 -pthread -lz -llzma

OpenBenchmarking.orgMB/s, More Is BetterZstd Compression 1.5.4Compression Level: 19, Long Mode - Compression SpeedXeon Platinum 8592+Xeon Platinum 8592+ 2PEPYC 9684XEPYC 9684X 2PEPYC 9654EPYC 9654 2PXeon Platinum 8490H 2PXeon Platinum 8490HXeon Max 9468Xeon Max 9480Xeon Max 9468 2PXeon Max 9480 2PEPYC 8534PEPYC 8534PNEPYC 9754EPYC 9754 2P3691215SE +/- 0.05, N = 3SE +/- 0.04, N = 3SE +/- 0.02, N = 3SE +/- 0.03, N = 3SE +/- 0.02, N = 3SE +/- 0.03, N = 3SE +/- 0.05, N = 3SE +/- 0.03, N = 3SE +/- 0.04, N = 3SE +/- 0.03, N = 3SE +/- 0.03, N = 3SE +/- 0.06, N = 15SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.02, N = 3SE +/- 0.05, N = 39.809.678.458.428.388.308.167.947.767.727.627.466.766.746.686.641. (CC) gcc options: -O3 -pthread -lz -llzma
OpenBenchmarking.orgMB/s, More Is BetterZstd Compression 1.5.4Compression Level: 19, Long Mode - Compression SpeedXeon Platinum 8592+Xeon Platinum 8592+ 2PEPYC 9684XEPYC 9684X 2PEPYC 9654EPYC 9654 2PXeon Platinum 8490H 2PXeon Platinum 8490HXeon Max 9468Xeon Max 9480Xeon Max 9468 2PXeon Max 9480 2PEPYC 8534PEPYC 8534PNEPYC 9754EPYC 9754 2P3691215Min: 9.73 / Avg: 9.8 / Max: 9.89Min: 9.59 / Avg: 9.67 / Max: 9.72Min: 8.42 / Avg: 8.45 / Max: 8.47Min: 8.36 / Avg: 8.42 / Max: 8.46Min: 8.34 / Avg: 8.38 / Max: 8.41Min: 8.24 / Avg: 8.3 / Max: 8.33Min: 8.06 / Avg: 8.16 / Max: 8.23Min: 7.91 / Avg: 7.94 / Max: 7.99Min: 7.69 / Avg: 7.76 / Max: 7.81Min: 7.69 / Avg: 7.72 / Max: 7.78Min: 7.58 / Avg: 7.62 / Max: 7.67Min: 6.93 / Avg: 7.46 / Max: 7.82Min: 6.75 / Avg: 6.76 / Max: 6.77Min: 6.72 / Avg: 6.74 / Max: 6.75Min: 6.65 / Avg: 6.68 / Max: 6.7Min: 6.55 / Avg: 6.64 / Max: 6.711. (CC) gcc options: -O3 -pthread -lz -llzma

NAMD

NAMD is a parallel molecular dynamics code designed for high-performance simulation of large biomolecular systems. NAMD was developed by the Theoretical and Computational Biophysics Group in the Beckman Institute for Advanced Science and Technology at the University of Illinois at Urbana-Champaign. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgns/day, More Is BetterNAMD 3.0b6Input: ATPase with 327,506 AtomsEPYC 9684X 2PEPYC 9754 2PEPYC 9654 2PEPYC 9684XEPYC 9654EPYC 9754Xeon Max 9468 2PXeon Max 9468Xeon Max 9480Xeon Platinum 8592+ 2PEPYC 8534PEPYC 8534PNXeon Platinum 8592+Xeon Platinum 8490HXeon Max 9480 2PXeon Platinum 8490H 2P510152025SE +/- 0.08771, N = 3SE +/- 0.02125, N = 3SE +/- 0.04751, N = 3SE +/- 0.02148, N = 6SE +/- 0.01368, N = 5SE +/- 0.04917, N = 5SE +/- 0.26203, N = 15SE +/- 0.16058, N = 15SE +/- 0.14537, N = 15SE +/- 0.34017, N = 12SE +/- 0.04338, N = 5SE +/- 0.00431, N = 4SE +/- 0.54361, N = 15SE +/- 0.21567, N = 12SE +/- 0.44989, N = 15SE +/- 0.17435, N = 1520.7525918.9745417.811059.335348.182757.997567.300655.971305.925015.852675.706725.449714.648142.970212.563192.21948
OpenBenchmarking.orgns/day, More Is BetterNAMD 3.0b6Input: ATPase with 327,506 AtomsEPYC 9684X 2PEPYC 9754 2PEPYC 9654 2PEPYC 9684XEPYC 9654EPYC 9754Xeon Max 9468 2PXeon Max 9468Xeon Max 9480Xeon Platinum 8592+ 2PEPYC 8534PEPYC 8534PNXeon Platinum 8592+Xeon Platinum 8490HXeon Max 9480 2PXeon Platinum 8490H 2P510152025Min: 20.61 / Avg: 20.75 / Max: 20.91Min: 18.93 / Avg: 18.97 / Max: 19.01Min: 17.72 / Avg: 17.81 / Max: 17.87Min: 9.29 / Avg: 9.34 / Max: 9.42Min: 8.14 / Avg: 8.18 / Max: 8.21Min: 7.87 / Avg: 8 / Max: 8.16Min: 5.44 / Avg: 7.3 / Max: 8.57Min: 4.66 / Avg: 5.97 / Max: 6.77Min: 5.29 / Avg: 5.93 / Max: 6.78Min: 3.15 / Avg: 5.85 / Max: 7.05Min: 5.53 / Avg: 5.71 / Max: 5.76Min: 5.44 / Avg: 5.45 / Max: 5.46Min: 1.28 / Avg: 4.65 / Max: 7.54Min: 1.8 / Avg: 2.97 / Max: 4.16Min: 0.77 / Avg: 2.56 / Max: 5.7Min: 1.23 / Avg: 2.22 / Max: 3.92

ONNX Runtime

ONNX Runtime is developed by Microsoft and partners as a open-source, cross-platform, high performance machine learning inferencing and training accelerator. This test profile runs the ONNX Runtime with various models available from the ONNX Model Zoo. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgInference Time Cost (ms), Fewer Is BetterONNX Runtime 1.17Model: ResNet50 v1-12-int8 - Device: CPU - Executor: ParallelXeon Max 9468Xeon Platinum 8490HXeon Platinum 8592+Xeon Max 9480EPYC 8534PEPYC 8534PNEPYC 9654EPYC 9684XXeon Max 9468 2PXeon Platinum 8490H 2PXeon Platinum 8592+ 2PXeon Max 9480 2PEPYC 9754EPYC 9684X 2PEPYC 9654 2PEPYC 9754 2P3691215SE +/- 0.01698, N = 3SE +/- 0.00544, N = 3SE +/- 0.02630, N = 3SE +/- 0.03023, N = 3SE +/- 0.03641, N = 15SE +/- 0.03633, N = 15SE +/- 0.06505, N = 4SE +/- 0.04669, N = 3SE +/- 0.01680, N = 3SE +/- 0.02968, N = 3SE +/- 0.06875, N = 3SE +/- 0.03080, N = 3SE +/- 0.02258, N = 3SE +/- 0.05309, N = 3SE +/- 0.05293, N = 3SE +/- 0.08457, N = 33.133663.192983.237803.320304.825064.926535.253215.594916.005256.390316.496936.517446.523679.952459.9624511.314801. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt
OpenBenchmarking.orgInference Time Cost (ms), Fewer Is BetterONNX Runtime 1.17Model: ResNet50 v1-12-int8 - Device: CPU - Executor: ParallelXeon Max 9468Xeon Platinum 8490HXeon Platinum 8592+Xeon Max 9480EPYC 8534PEPYC 8534PNEPYC 9654EPYC 9684XXeon Max 9468 2PXeon Platinum 8490H 2PXeon Platinum 8592+ 2PXeon Max 9480 2PEPYC 9754EPYC 9684X 2PEPYC 9654 2PEPYC 9754 2P3691215Min: 3.1 / Avg: 3.13 / Max: 3.15Min: 3.18 / Avg: 3.19 / Max: 3.2Min: 3.19 / Avg: 3.24 / Max: 3.28Min: 3.27 / Avg: 3.32 / Max: 3.38Min: 4.67 / Avg: 4.83 / Max: 5.09Min: 4.68 / Avg: 4.93 / Max: 5.16Min: 5.16 / Avg: 5.25 / Max: 5.44Min: 5.51 / Avg: 5.59 / Max: 5.67Min: 5.97 / Avg: 6.01 / Max: 6.02Min: 6.35 / Avg: 6.39 / Max: 6.45Min: 6.37 / Avg: 6.5 / Max: 6.61Min: 6.46 / Avg: 6.52 / Max: 6.57Min: 6.48 / Avg: 6.52 / Max: 6.56Min: 9.85 / Avg: 9.95 / Max: 10.01Min: 9.86 / Avg: 9.96 / Max: 10.03Min: 11.21 / Avg: 11.31 / Max: 11.481. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.17Model: ResNet50 v1-12-int8 - Device: CPU - Executor: ParallelXeon Max 9468Xeon Platinum 8490HXeon Platinum 8592+Xeon Max 9480EPYC 8534PEPYC 8534PNEPYC 9654EPYC 9684XXeon Max 9468 2PXeon Platinum 8490H 2PXeon Platinum 8592+ 2PXeon Max 9480 2PEPYC 9754EPYC 9684X 2PEPYC 9654 2PEPYC 9754 2P70140210280350SE +/- 1.74, N = 3SE +/- 0.53, N = 3SE +/- 2.50, N = 3SE +/- 2.72, N = 3SE +/- 1.54, N = 15SE +/- 1.50, N = 15SE +/- 2.31, N = 4SE +/- 1.50, N = 3SE +/- 0.47, N = 3SE +/- 0.73, N = 3SE +/- 1.63, N = 3SE +/- 0.73, N = 3SE +/- 0.53, N = 3SE +/- 0.54, N = 3SE +/- 0.54, N = 3SE +/- 0.66, N = 3319.04313.10308.80301.14207.34203.06190.38178.70166.49156.46153.92153.41153.25100.46100.3688.371. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt
OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.17Model: ResNet50 v1-12-int8 - Device: CPU - Executor: ParallelXeon Max 9468Xeon Platinum 8490HXeon Platinum 8592+Xeon Max 9480EPYC 8534PEPYC 8534PNEPYC 9654EPYC 9684XXeon Max 9468 2PXeon Platinum 8490H 2PXeon Platinum 8592+ 2PXeon Max 9480 2PEPYC 9754EPYC 9684X 2PEPYC 9654 2PEPYC 9754 2P60120180240300Min: 316.97 / Avg: 319.04 / Max: 322.5Min: 312.35 / Avg: 313.1 / Max: 314.13Min: 304.4 / Avg: 308.8 / Max: 313.06Min: 296.09 / Avg: 301.14 / Max: 305.44Min: 196.3 / Avg: 207.34 / Max: 214.28Min: 193.75 / Avg: 203.06 / Max: 213.6Min: 183.63 / Avg: 190.38 / Max: 193.87Min: 176.25 / Avg: 178.7 / Max: 181.41Min: 166.02 / Avg: 166.49 / Max: 167.42Min: 155.06 / Avg: 156.46 / Max: 157.5Min: 151.21 / Avg: 153.92 / Max: 156.84Min: 152.27 / Avg: 153.41 / Max: 154.76Min: 152.46 / Avg: 153.25 / Max: 154.25Min: 99.83 / Avg: 100.46 / Max: 101.53Min: 99.68 / Avg: 100.36 / Max: 101.42Min: 87.07 / Avg: 88.37 / Max: 89.171. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

OpenBenchmarking.orgInference Time Cost (ms), Fewer Is BetterONNX Runtime 1.17Model: T5 Encoder - Device: CPU - Executor: ParallelXeon Platinum 8592+EPYC 9684XEPYC 9654Xeon Platinum 8592+ 2PXeon Max 9480Xeon Max 9468Xeon Platinum 8490HEPYC 9754EPYC 9684X 2PEPYC 9654 2PEPYC 8534PEPYC 8534PNXeon Max 9480 2PEPYC 9754 2PXeon Max 9468 2PXeon Platinum 8490H 2P0.91321.82642.73963.65284.566SE +/- 0.01801, N = 3SE +/- 0.01812, N = 3SE +/- 0.00389, N = 3SE +/- 0.01381, N = 3SE +/- 0.01443, N = 3SE +/- 0.03338, N = 15SE +/- 0.00807, N = 3SE +/- 0.02990, N = 3SE +/- 0.00852, N = 3SE +/- 0.03309, N = 3SE +/- 0.03399, N = 3SE +/- 0.02993, N = 3SE +/- 0.02633, N = 15SE +/- 0.01019, N = 3SE +/- 0.04072, N = 3SE +/- 0.04801, N = 32.159802.239222.667112.817392.887342.970943.065003.129043.617923.680013.910063.924553.958193.987354.052704.058811. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt
OpenBenchmarking.orgInference Time Cost (ms), Fewer Is BetterONNX Runtime 1.17Model: T5 Encoder - Device: CPU - Executor: ParallelXeon Platinum 8592+EPYC 9684XEPYC 9654Xeon Platinum 8592+ 2PXeon Max 9480Xeon Max 9468Xeon Platinum 8490HEPYC 9754EPYC 9684X 2PEPYC 9654 2PEPYC 8534PEPYC 8534PNXeon Max 9480 2PEPYC 9754 2PXeon Max 9468 2PXeon Platinum 8490H 2P246810Min: 2.14 / Avg: 2.16 / Max: 2.19Min: 2.22 / Avg: 2.24 / Max: 2.28Min: 2.66 / Avg: 2.67 / Max: 2.67Min: 2.79 / Avg: 2.82 / Max: 2.84Min: 2.86 / Avg: 2.89 / Max: 2.91Min: 2.87 / Avg: 2.97 / Max: 3.37Min: 3.05 / Avg: 3.07 / Max: 3.08Min: 3.1 / Avg: 3.13 / Max: 3.19Min: 3.61 / Avg: 3.62 / Max: 3.63Min: 3.63 / Avg: 3.68 / Max: 3.74Min: 3.84 / Avg: 3.91 / Max: 3.96Min: 3.87 / Avg: 3.92 / Max: 3.97Min: 3.8 / Avg: 3.96 / Max: 4.17Min: 3.97 / Avg: 3.99 / Max: 4Min: 4.01 / Avg: 4.05 / Max: 4.13Min: 3.96 / Avg: 4.06 / Max: 4.121. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.17Model: T5 Encoder - Device: CPU - Executor: ParallelXeon Platinum 8592+EPYC 9684XEPYC 9654Xeon Platinum 8592+ 2PXeon Max 9480Xeon Max 9468Xeon Platinum 8490HEPYC 9754EPYC 9684X 2PEPYC 9654 2PEPYC 8534PEPYC 8534PNXeon Max 9480 2PEPYC 9754 2PXeon Max 9468 2PXeon Platinum 8490H 2P100200300400500SE +/- 3.84, N = 3SE +/- 3.58, N = 3SE +/- 0.55, N = 3SE +/- 1.73, N = 3SE +/- 1.74, N = 3SE +/- 3.48, N = 15SE +/- 0.86, N = 3SE +/- 3.02, N = 3SE +/- 0.65, N = 3SE +/- 2.43, N = 3SE +/- 2.24, N = 3SE +/- 1.96, N = 3SE +/- 1.67, N = 15SE +/- 0.64, N = 3SE +/- 2.44, N = 3SE +/- 2.94, N = 3462.86446.30374.75354.75346.21337.00326.14319.45276.21271.62255.67254.73252.67250.63246.68246.341. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt
OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.17Model: T5 Encoder - Device: CPU - Executor: ParallelXeon Platinum 8592+EPYC 9684XEPYC 9654Xeon Platinum 8592+ 2PXeon Max 9480Xeon Max 9468Xeon Platinum 8490HEPYC 9754EPYC 9684X 2PEPYC 9654 2PEPYC 8534PEPYC 8534PNXeon Max 9480 2PEPYC 9754 2PXeon Max 9468 2PXeon Platinum 8490H 2P80160240320400Min: 455.4 / Avg: 462.85 / Max: 468.18Min: 439.15 / Avg: 446.3 / Max: 450.09Min: 373.68 / Avg: 374.74 / Max: 375.52Min: 351.82 / Avg: 354.75 / Max: 357.8Min: 343.93 / Avg: 346.21 / Max: 349.63Min: 296.9 / Avg: 337 / Max: 348.81Min: 324.75 / Avg: 326.14 / Max: 327.7Min: 313.42 / Avg: 319.45 / Max: 322.65Min: 274.9 / Avg: 276.21 / Max: 276.9Min: 267.11 / Avg: 271.62 / Max: 275.45Min: 252.52 / Avg: 255.67 / Max: 260.01Min: 251.8 / Avg: 254.73 / Max: 258.44Min: 239.84 / Avg: 252.67 / Max: 263.27Min: 249.63 / Avg: 250.63 / Max: 251.82Min: 241.81 / Avg: 246.68 / Max: 249.47Min: 242.46 / Avg: 246.33 / Max: 252.11. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

OpenVINO

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Noise Suppression Poconet-Like FP16 - Device: CPUXeon Platinum 8592+Xeon Max 9468Xeon Max 9480Xeon Platinum 8592+ 2PEPYC 9684XXeon Platinum 8490HXeon Platinum 8490H 2PEPYC 9654Xeon Max 9468 2PEPYC 8534PEPYC 8534PNXeon Max 9480 2PEPYC 9684X 2PEPYC 9754EPYC 9654 2PEPYC 9754 2P714212835SE +/- 0.01, N = 3SE +/- 0.04, N = 3SE +/- 0.02, N = 3SE +/- 0.04, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.05, N = 3SE +/- 0.16, N = 14SE +/- 0.12, N = 3SE +/- 0.00, N = 3SE +/- 0.02, N = 3SE +/- 0.09, N = 3SE +/- 0.04, N = 3SE +/- 0.45, N = 12SE +/- 0.08, N = 3SE +/- 0.10, N = 39.4011.3712.7213.1513.5213.9515.9616.3217.1517.3018.4918.7222.2022.6723.1228.10MIN: 7.66 / MAX: 25.07MIN: 9.17 / MAX: 32.12MIN: 9.56 / MAX: 30.66MIN: 7.28 / MAX: 47.97MIN: 6.46 / MAX: 38.94MIN: 8.67 / MAX: 65.92MIN: 10.38 / MAX: 43.64MIN: 8.11 / MAX: 42.33MIN: 10.81 / MAX: 59.34MIN: 10.72 / MAX: 37.75MIN: 11.59 / MAX: 39.13MIN: 12.15 / MAX: 64.81MIN: 9.55 / MAX: 75.9MIN: 8.31 / MAX: 66.6MIN: 10.62 / MAX: 67.83MIN: 12.27 / MAX: 100.221. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Noise Suppression Poconet-Like FP16 - Device: CPUXeon Platinum 8592+Xeon Max 9468Xeon Max 9480Xeon Platinum 8592+ 2PEPYC 9684XXeon Platinum 8490HXeon Platinum 8490H 2PEPYC 9654Xeon Max 9468 2PEPYC 8534PEPYC 8534PNXeon Max 9480 2PEPYC 9684X 2PEPYC 9754EPYC 9654 2PEPYC 9754 2P612182430Min: 9.38 / Avg: 9.4 / Max: 9.43Min: 11.33 / Avg: 11.37 / Max: 11.45Min: 12.67 / Avg: 12.72 / Max: 12.74Min: 13.1 / Avg: 13.15 / Max: 13.23Min: 13.52 / Avg: 13.52 / Max: 13.52Min: 13.94 / Avg: 13.95 / Max: 13.95Min: 15.86 / Avg: 15.96 / Max: 16.02Min: 14.29 / Avg: 16.32 / Max: 16.64Min: 16.93 / Avg: 17.15 / Max: 17.33Min: 17.29 / Avg: 17.3 / Max: 17.3Min: 18.46 / Avg: 18.49 / Max: 18.52Min: 18.58 / Avg: 18.72 / Max: 18.9Min: 22.15 / Avg: 22.2 / Max: 22.27Min: 18.1 / Avg: 22.67 / Max: 24.62Min: 22.99 / Avg: 23.12 / Max: 23.27Min: 27.97 / Avg: 28.1 / Max: 28.291. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Noise Suppression Poconet-Like FP16 - Device: CPUXeon Platinum 8592+ 2PEPYC 9684X 2PEPYC 9654 2PXeon Platinum 8490H 2PEPYC 9684XXeon Platinum 8592+EPYC 9754 2PXeon Max 9480 2PEPYC 9654Xeon Max 9468 2PEPYC 9754Xeon Max 9480Xeon Platinum 8490HXeon Max 9468EPYC 8534PEPYC 8534PN2K4K6K8K10KSE +/- 24.76, N = 3SE +/- 59.51, N = 3SE +/- 77.59, N = 3SE +/- 13.31, N = 3SE +/- 1.84, N = 3SE +/- 10.14, N = 3SE +/- 27.90, N = 3SE +/- 28.98, N = 3SE +/- 67.22, N = 14SE +/- 37.79, N = 3SE +/- 139.41, N = 12SE +/- 7.60, N = 3SE +/- 1.87, N = 3SE +/- 15.13, N = 3SE +/- 0.64, N = 3SE +/- 3.67, N = 39360.898231.727810.657356.636963.316757.266513.365933.655697.515565.235310.074386.484209.104208.493636.333405.941. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Noise Suppression Poconet-Like FP16 - Device: CPUXeon Platinum 8592+ 2PEPYC 9684X 2PEPYC 9654 2PXeon Platinum 8490H 2PEPYC 9684XXeon Platinum 8592+EPYC 9754 2PXeon Max 9480 2PEPYC 9654Xeon Max 9468 2PEPYC 9754Xeon Max 9480Xeon Platinum 8490HXeon Max 9468EPYC 8534PEPYC 8534PN16003200480064008000Min: 9311.42 / Avg: 9360.89 / Max: 9387.66Min: 8164.66 / Avg: 8231.72 / Max: 8350.41Min: 7691.85 / Avg: 7810.65 / Max: 7956.5Min: 7337.71 / Avg: 7356.63 / Max: 7382.31Min: 6959.64 / Avg: 6963.31 / Max: 6965.39Min: 6738.08 / Avg: 6757.26 / Max: 6772.53Min: 6458.56 / Avg: 6513.36 / Max: 6549.86Min: 5878.07 / Avg: 5933.65 / Max: 5975.66Min: 5574.69 / Avg: 5697.51 / Max: 6560.89Min: 5510.56 / Avg: 5565.23 / Max: 5637.75Min: 4847.28 / Avg: 5310.07 / Max: 6771.47Min: 4378.2 / Avg: 4386.48 / Max: 4401.66Min: 4205.72 / Avg: 4209.1 / Max: 4212.18Min: 4178.31 / Avg: 4208.49 / Max: 4225.58Min: 3635.61 / Avg: 3636.33 / Max: 3637.62Min: 3398.8 / Avg: 3405.94 / Max: 3410.991. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

CloverLeaf

CloverLeaf is a Lagrangian-Eulerian hydrodynamics benchmark. This test profile currently makes use of CloverLeaf's OpenMP version. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterCloverLeaf 1.3Input: clover_bm64_shortEPYC 9684X 2PXeon Platinum 8490H 2PEPYC 9754 2PEPYC 9654 2PXeon Platinum 8592+ 2PXeon Max 9468 2PXeon Max 9480 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Max 9468EPYC 9684XXeon Max 9480EPYC 9654EPYC 9754EPYC 8534PEPYC 8534PN1326395265SE +/- 0.23, N = 3SE +/- 0.24, N = 3SE +/- 0.30, N = 3SE +/- 1.11, N = 12SE +/- 0.45, N = 3SE +/- 0.31, N = 15SE +/- 0.40, N = 4SE +/- 0.03, N = 3SE +/- 0.02, N = 3SE +/- 0.15, N = 3SE +/- 1.81, N = 15SE +/- 0.17, N = 3SE +/- 2.15, N = 15SE +/- 2.07, N = 12SE +/- 0.04, N = 3SE +/- 0.04, N = 322.8326.5827.7430.0531.9032.2532.4439.3839.4841.4342.1742.2246.5048.3657.3857.541. (F9X) gfortran options: -O3 -march=native -funroll-loops -fopenmp
OpenBenchmarking.orgSeconds, Fewer Is BetterCloverLeaf 1.3Input: clover_bm64_shortEPYC 9684X 2PXeon Platinum 8490H 2PEPYC 9754 2PEPYC 9654 2PXeon Platinum 8592+ 2PXeon Max 9468 2PXeon Max 9480 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Max 9468EPYC 9684XXeon Max 9480EPYC 9654EPYC 9754EPYC 8534PEPYC 8534PN1122334455Min: 22.41 / Avg: 22.83 / Max: 23.22Min: 26.11 / Avg: 26.58 / Max: 26.87Min: 27.4 / Avg: 27.74 / Max: 28.34Min: 24.13 / Avg: 30.05 / Max: 34.31Min: 31.03 / Avg: 31.9 / Max: 32.55Min: 30.55 / Avg: 32.25 / Max: 34.35Min: 31.41 / Avg: 32.44 / Max: 33.19Min: 39.35 / Avg: 39.38 / Max: 39.44Min: 39.45 / Avg: 39.48 / Max: 39.52Min: 41.15 / Avg: 41.43 / Max: 41.66Min: 26.4 / Avg: 42.17 / Max: 50.13Min: 41.95 / Avg: 42.22 / Max: 42.54Min: 27.6 / Avg: 46.5 / Max: 53.92Min: 28.75 / Avg: 48.36 / Max: 54.21Min: 57.33 / Avg: 57.38 / Max: 57.45Min: 57.46 / Avg: 57.54 / Max: 57.621. (F9X) gfortran options: -O3 -march=native -funroll-loops -fopenmp

OSPRay Studio

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 1.0Camera: 3 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path Tracer - Acceleration: CPUEPYC 9754 2PEPYC 9684X 2PEPYC 9654 2PXeon Platinum 8592+ 2PXeon Platinum 8490H 2PXeon Max 9480 2PEPYC 9754EPYC 9684XXeon Max 9468 2PEPYC 9654Xeon Platinum 8592+Xeon Platinum 8490HXeon Max 9480Xeon Max 9468EPYC 8534PEPYC 8534PN20K40K60K80K100KSE +/- 28.11, N = 3SE +/- 27.74, N = 3SE +/- 756.08, N = 15SE +/- 47.16, N = 3SE +/- 125.33, N = 3SE +/- 141.04, N = 3SE +/- 50.97, N = 3SE +/- 89.57, N = 3SE +/- 155.80, N = 3SE +/- 231.95, N = 3SE +/- 162.52, N = 3SE +/- 58.68, N = 3SE +/- 65.97, N = 3SE +/- 41.33, N = 3SE +/- 29.36, N = 3SE +/- 13.58, N = 320071208932794333391388134197142945443494521150019595226800673366807428426191643
OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 1.0Camera: 3 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path Tracer - Acceleration: CPUEPYC 9754 2PEPYC 9684X 2PEPYC 9654 2PXeon Platinum 8592+ 2PXeon Platinum 8490H 2PXeon Max 9480 2PEPYC 9754EPYC 9684XXeon Max 9468 2PEPYC 9654Xeon Platinum 8592+Xeon Platinum 8490HXeon Max 9480Xeon Max 9468EPYC 8534PEPYC 8534PN16K32K48K64K80KMin: 20031 / Avg: 20070.67 / Max: 20125Min: 20846 / Avg: 20892.67 / Max: 20942Min: 24809 / Avg: 27943.07 / Max: 30937Min: 33306 / Avg: 33390.67 / Max: 33469Min: 38562 / Avg: 38812.67 / Max: 38938Min: 41773 / Avg: 41971 / Max: 42244Min: 42869 / Avg: 42945.33 / Max: 43042Min: 44186 / Avg: 44348.67 / Max: 44495Min: 44930 / Avg: 45211.33 / Max: 45468Min: 49626 / Avg: 50019.33 / Max: 50429Min: 59240 / Avg: 59521.67 / Max: 59803Min: 67889 / Avg: 68005.67 / Max: 68075Min: 73275 / Avg: 73365.67 / Max: 73494Min: 80692 / Avg: 80742 / Max: 80824Min: 84202 / Avg: 84260.67 / Max: 84292Min: 91627 / Avg: 91643 / Max: 91670

TensorFlow

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.16.1Device: CPU - Batch Size: 64 - Model: ResNet-50Xeon Platinum 8490HXeon Platinum 8490H 2PEPYC 9654Xeon Max 9468 2PXeon Max 9480 2PEPYC 9754EPYC 9684XXeon Max 9468Xeon Max 9480Xeon Platinum 8592+ 2PXeon Platinum 8592+EPYC 8534PEPYC 9684X 2PEPYC 9654 2PEPYC 8534PNEPYC 9754 2P306090120150SE +/- 0.04, N = 3SE +/- 1.12, N = 3SE +/- 0.64, N = 3SE +/- 0.39, N = 3SE +/- 1.28, N = 3SE +/- 0.60, N = 3SE +/- 0.08, N = 3SE +/- 0.13, N = 3SE +/- 0.93, N = 3SE +/- 0.70, N = 3SE +/- 0.50, N = 3SE +/- 0.05, N = 3SE +/- 1.04, N = 4SE +/- 0.91, N = 5SE +/- 0.11, N = 3SE +/- 0.88, N = 3120.93115.47114.63111.71107.30106.14104.52104.23103.5694.6691.5187.3186.0882.9480.8667.08
OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.16.1Device: CPU - Batch Size: 64 - Model: ResNet-50Xeon Platinum 8490HXeon Platinum 8490H 2PEPYC 9654Xeon Max 9468 2PXeon Max 9480 2PEPYC 9754EPYC 9684XXeon Max 9468Xeon Max 9480Xeon Platinum 8592+ 2PXeon Platinum 8592+EPYC 8534PEPYC 9684X 2PEPYC 9654 2PEPYC 8534PNEPYC 9754 2P20406080100Min: 120.89 / Avg: 120.93 / Max: 121.01Min: 113.57 / Avg: 115.47 / Max: 117.44Min: 113.52 / Avg: 114.63 / Max: 115.72Min: 111.29 / Avg: 111.71 / Max: 112.49Min: 105.37 / Avg: 107.3 / Max: 109.71Min: 104.94 / Avg: 106.14 / Max: 106.84Min: 104.44 / Avg: 104.52 / Max: 104.67Min: 104.01 / Avg: 104.23 / Max: 104.47Min: 101.7 / Avg: 103.56 / Max: 104.56Min: 93.32 / Avg: 94.66 / Max: 95.7Min: 90.88 / Avg: 91.51 / Max: 92.5Min: 87.23 / Avg: 87.31 / Max: 87.41Min: 83.06 / Avg: 86.08 / Max: 87.8Min: 79.32 / Avg: 82.94 / Max: 84.03Min: 80.63 / Avg: 80.86 / Max: 80.98Min: 65.45 / Avg: 67.08 / Max: 68.46

Memcached

Memcached is a high performance, distributed memory object caching system. This Memcached test profiles makes use of memtier_benchmark for excuting this CPU/memory-focused server benchmark. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgOps/sec, More Is BetterMemcached 1.6.19Set To Get Ratio: 1:100EPYC 9684X 2PEPYC 9684XEPYC 9654 2PEPYC 9654EPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PNXeon Platinum 8592+Xeon Platinum 8490HXeon Max 9468Xeon Max 9480Xeon Platinum 8592+ 2PXeon Max 9480 2PXeon Max 9468 2PXeon Platinum 8490H 2P2M4M6M8M10MSE +/- 27143.58, N = 3SE +/- 58081.25, N = 3SE +/- 83562.82, N = 3SE +/- 29027.89, N = 3SE +/- 38372.96, N = 3SE +/- 14591.70, N = 3SE +/- 36366.89, N = 3SE +/- 41123.40, N = 3SE +/- 35182.67, N = 3SE +/- 25335.31, N = 3SE +/- 21428.06, N = 3SE +/- 52575.97, N = 3SE +/- 35300.21, N = 3SE +/- 24083.78, N = 3SE +/- 26891.33, N = 3SE +/- 50660.01, N = 158683410.798634258.398498306.788220895.457736018.747645325.706198256.725820618.184752673.794481667.954384040.524315467.173780240.563392842.383373323.923245908.401. (CXX) g++ options: -O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre
OpenBenchmarking.orgOps/sec, More Is BetterMemcached 1.6.19Set To Get Ratio: 1:100EPYC 9684X 2PEPYC 9684XEPYC 9654 2PEPYC 9654EPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PNXeon Platinum 8592+Xeon Platinum 8490HXeon Max 9468Xeon Max 9480Xeon Platinum 8592+ 2PXeon Max 9480 2PXeon Max 9468 2PXeon Platinum 8490H 2P1.5M3M4.5M6M7.5MMin: 8629407.21 / Avg: 8683410.79 / Max: 8715211.67Min: 8541184.65 / Avg: 8634258.39 / Max: 8740988.73Min: 8331995.61 / Avg: 8498306.78 / Max: 8595733.93Min: 8165237.18 / Avg: 8220895.45 / Max: 8263023.98Min: 7661698.1 / Avg: 7736018.74 / Max: 7789755.67Min: 7629002.82 / Avg: 7645325.7 / Max: 7674437.7Min: 6125781.47 / Avg: 6198256.72 / Max: 6239800.48Min: 5748289.42 / Avg: 5820618.18 / Max: 5890691.47Min: 4682633.04 / Avg: 4752673.79 / Max: 4793540.69Min: 4432195.38 / Avg: 4481667.95 / Max: 4515890.16Min: 4341203.5 / Avg: 4384040.52 / Max: 4406567.27Min: 4241023.34 / Avg: 4315467.17 / Max: 4417003.03Min: 3727174.59 / Avg: 3780240.56 / Max: 3847101.16Min: 3344835.19 / Avg: 3392842.38 / Max: 3420247.08Min: 3327832.66 / Avg: 3373323.92 / Max: 3420915.87Min: 2978749.57 / Avg: 3245908.4 / Max: 3602162.861. (CXX) g++ options: -O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre

ASKAP

ASKAP is a set of benchmarks from the Australian SKA Pathfinder. The principal ASKAP benchmarks are the Hogbom Clean Benchmark (tHogbomClean) and Convolutional Resamping Benchmark (tConvolve) as well as some previous ASKAP benchmarks being included as well for OpenCL and CUDA execution of tConvolve. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgMpix/sec, More Is BetterASKAP 1.0Test: tConvolve MPI - GriddingEPYC 9684X 2PEPYC 9654 2PEPYC 9684XXeon Platinum 8592+ 2PEPYC 9754 2PEPYC 9654Xeon Max 9480 2PXeon Max 9468 2PXeon Platinum 8490H 2PXeon Platinum 8592+EPYC 9754Xeon Max 9480Xeon Max 9468Xeon Platinum 8490HEPYC 8534PEPYC 8534PN30K60K90K120K150KSE +/- 19579.11, N = 3SE +/- 2386.93, N = 4SE +/- 581.17, N = 3SE +/- 1080.03, N = 3SE +/- 1180.69, N = 14SE +/- 1853.72, N = 3SE +/- 802.88, N = 3SE +/- 194.30, N = 3SE +/- 412.68, N = 4SE +/- 219.20, N = 3SE +/- 685.49, N = 12SE +/- 0.00, N = 3SE +/- 99.83, N = 3SE +/- 76.67, N = 3SE +/- 86.77, N = 3SE +/- 0.00, N = 3121976.986757.774389.072004.054066.046233.745195.142939.241773.037265.928854.323250.221766.521314.216573.216399.71. (CXX) g++ options: -O3 -fstrict-aliasing -fopenmp
OpenBenchmarking.orgMpix/sec, More Is BetterASKAP 1.0Test: tConvolve MPI - GriddingEPYC 9684X 2PEPYC 9654 2PEPYC 9684XXeon Platinum 8592+ 2PEPYC 9754 2PEPYC 9654Xeon Max 9480 2PXeon Max 9468 2PXeon Platinum 8490H 2PXeon Platinum 8592+EPYC 9754Xeon Max 9480Xeon Max 9468Xeon Platinum 8490HEPYC 8534PEPYC 8534PN20K40K60K80K100KMin: 82861.8 / Avg: 121976.93 / Max: 143125Min: 82861.8 / Avg: 86757.73 / Max: 92610.2Min: 73226.7 / Avg: 74389.03 / Max: 74970.2Min: 69972.2 / Avg: 72004.03 / Max: 73654.9Min: 52479.1 / Avg: 54066.02 / Max: 69393.9Min: 42550.6 / Avg: 46233.73 / Max: 48442.3Min: 43732.6 / Avg: 45195.13 / Max: 46500.5Min: 42550.6 / Avg: 42939.2 / Max: 43133.5Min: 40576.6 / Avg: 41773 / Max: 42321.9Min: 36827.5 / Avg: 37265.9 / Max: 37485.1Min: 24842.2 / Avg: 28854.32 / Max: 35280.1Min: 23250.2 / Avg: 23250.2 / Max: 23250.2Min: 21566.8 / Avg: 21766.47 / Max: 21866.3Min: 21160.9 / Avg: 21314.23 / Max: 21390.9Min: 16399.7 / Avg: 16573.23 / Max: 16660Min: 16399.7 / Avg: 16399.7 / Max: 16399.71. (CXX) g++ options: -O3 -fstrict-aliasing -fopenmp

OpenBenchmarking.orgMpix/sec, More Is BetterASKAP 1.0Test: tConvolve MPI - DegriddingEPYC 9684X 2PEPYC 9654 2PEPYC 9684XXeon Platinum 8592+ 2PEPYC 9754 2PEPYC 9654Xeon Max 9480 2PXeon Max 9468 2PXeon Platinum 8490H 2PXeon Platinum 8592+EPYC 9754Xeon Max 9480Xeon Max 9468Xeon Platinum 8490HEPYC 8534PEPYC 8534PN30K60K90K120K150KSE +/- 0.00, N = 3SE +/- 882.91, N = 4SE +/- 0.00, N = 3SE +/- 480.95, N = 3SE +/- 1077.92, N = 14SE +/- 189.10, N = 3SE +/- 0.00, N = 3SE +/- 143.60, N = 3SE +/- 378.22, N = 4SE +/- 153.57, N = 3SE +/- 598.81, N = 12SE +/- 76.47, N = 3SE +/- 0.00, N = 3SE +/- 93.91, N = 3SE +/- 44.43, N = 3SE +/- 69.57, N = 3123480.081025.864260.259139.252639.542172.440368.636900.534614.131177.228476.620561.418522.017891.616704.415903.41. (CXX) g++ options: -O3 -fstrict-aliasing -fopenmp
OpenBenchmarking.orgMpix/sec, More Is BetterASKAP 1.0Test: tConvolve MPI - DegriddingEPYC 9684X 2PEPYC 9654 2PEPYC 9684XXeon Platinum 8592+ 2PEPYC 9754 2PEPYC 9654Xeon Max 9480 2PXeon Max 9468 2PXeon Platinum 8490H 2PXeon Platinum 8592+EPYC 9754Xeon Max 9480Xeon Max 9468Xeon Platinum 8490HEPYC 8534PEPYC 8534PN20K40K60K80K100KMin: 123480 / Avg: 123480 / Max: 123480Min: 78718.7 / Avg: 81025.83 / Max: 82861.8Min: 64260.2 / Avg: 64260.2 / Max: 64260.2Min: 58310.1 / Avg: 59139.2 / Max: 59976.1Min: 51199.1 / Avg: 52639.47 / Max: 66640.2Min: 41983.3 / Avg: 42172.4 / Max: 42550.6Min: 40368.6 / Avg: 40368.6 / Max: 40368.6Min: 36613.3 / Avg: 36900.5 / Max: 37044.1Min: 33640.5 / Avg: 34614.1 / Max: 35458.9Min: 30870.1 / Avg: 31177.23 / Max: 31330.8Min: 25915.6 / Avg: 28476.62 / Max: 34132.8Min: 20408.5 / Avg: 20561.43 / Max: 20637.9Min: 18522 / Avg: 18522 / Max: 18522Min: 17729.4 / Avg: 17891.57 / Max: 18054.7Min: 16660 / Avg: 16704.43 / Max: 16793.3Min: 15783.2 / Avg: 15903.4 / Max: 16024.21. (CXX) g++ options: -O3 -fstrict-aliasing -fopenmp

OpenVINO

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Machine Translation EN To DE FP16 - Device: CPUXeon Platinum 8592+Xeon Platinum 8592+ 2PXeon Max 9468Xeon Max 9468 2PXeon Platinum 8490H 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9654 2PEPYC 9754 2PXeon Platinum 8490HEPYC 9684XEPYC 9654EPYC 8534PEPYC 9754EPYC 8534PN20406080100SE +/- 0.02, N = 3SE +/- 0.02, N = 3SE +/- 0.12, N = 3SE +/- 0.07, N = 3SE +/- 0.16, N = 3SE +/- 0.34, N = 3SE +/- 0.05, N = 3SE +/- 0.01, N = 3SE +/- 0.44, N = 3SE +/- 0.59, N = 3SE +/- 0.03, N = 3SE +/- 0.60, N = 11SE +/- 0.77, N = 7SE +/- 0.13, N = 3SE +/- 1.05, N = 5SE +/- 0.05, N = 326.8528.1728.7329.9837.5838.5041.5743.1748.4356.7362.4683.1191.16100.67102.84109.00MIN: 20.18 / MAX: 307.38MIN: 20.12 / MAX: 261.31MIN: 19.52 / MAX: 209.26MIN: 20.48 / MAX: 222.7MIN: 20.58 / MAX: 347.67MIN: 25.18 / MAX: 161.13MIN: 28.11 / MAX: 155.06MIN: 34.03 / MAX: 226.77MIN: 36.56 / MAX: 119.12MIN: 45.46 / MAX: 220.87MIN: 46.12 / MAX: 79.06MIN: 36.66 / MAX: 131.44MIN: 43.59 / MAX: 136.45MIN: 47.39 / MAX: 138.74MIN: 47.17 / MAX: 172.5MIN: 53.63 / MAX: 148.461. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Machine Translation EN To DE FP16 - Device: CPUXeon Platinum 8592+Xeon Platinum 8592+ 2PXeon Max 9468Xeon Max 9468 2PXeon Platinum 8490H 2PXeon Max 9480Xeon Max 9480 2PEPYC 9684X 2PEPYC 9654 2PEPYC 9754 2PXeon Platinum 8490HEPYC 9684XEPYC 9654EPYC 8534PEPYC 9754EPYC 8534PN20406080100Min: 26.82 / Avg: 26.85 / Max: 26.89Min: 28.15 / Avg: 28.17 / Max: 28.21Min: 28.54 / Avg: 28.73 / Max: 28.94Min: 29.85 / Avg: 29.98 / Max: 30.09Min: 37.25 / Avg: 37.58 / Max: 37.76Min: 37.89 / Avg: 38.5 / Max: 39.08Min: 41.5 / Avg: 41.57 / Max: 41.67Min: 43.14 / Avg: 43.17 / Max: 43.18Min: 47.56 / Avg: 48.43 / Max: 49Min: 55.57 / Avg: 56.73 / Max: 57.52Min: 62.41 / Avg: 62.46 / Max: 62.51Min: 78.87 / Avg: 83.11 / Max: 84.85Min: 86.66 / Avg: 91.16 / Max: 92.55Min: 100.43 / Avg: 100.67 / Max: 100.85Min: 99.69 / Avg: 102.84 / Max: 106.19Min: 108.91 / Avg: 109 / Max: 109.061. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Machine Translation EN To DE FP16 - Device: CPUXeon Platinum 8592+ 2PEPYC 9754 2PEPYC 9684X 2PEPYC 9654 2PXeon Max 9480 2PXeon Max 9468 2PXeon Platinum 8490H 2PEPYC 9754Xeon Platinum 8592+EPYC 9684XEPYC 9654Xeon Platinum 8490HXeon Max 9480Xeon Max 9468EPYC 8534PEPYC 8534PN2004006008001000SE +/- 0.85, N = 3SE +/- 11.78, N = 3SE +/- 0.37, N = 3SE +/- 8.96, N = 3SE +/- 1.13, N = 3SE +/- 1.99, N = 3SE +/- 3.48, N = 3SE +/- 6.34, N = 5SE +/- 0.54, N = 3SE +/- 4.29, N = 11SE +/- 4.59, N = 7SE +/- 0.17, N = 3SE +/- 4.09, N = 3SE +/- 1.21, N = 3SE +/- 0.39, N = 3SE +/- 0.13, N = 31128.781127.051110.49990.16889.18795.63793.64621.42592.20576.98525.88477.77467.08415.96317.38293.071. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Machine Translation EN To DE FP16 - Device: CPUXeon Platinum 8592+ 2PEPYC 9754 2PEPYC 9684X 2PEPYC 9654 2PXeon Max 9480 2PXeon Max 9468 2PXeon Platinum 8490H 2PEPYC 9754Xeon Platinum 8592+EPYC 9684XEPYC 9654Xeon Platinum 8490HXeon Max 9480Xeon Max 9468EPYC 8534PEPYC 8534PN2004006008001000Min: 1127.09 / Avg: 1128.78 / Max: 1129.73Min: 1111.4 / Avg: 1127.05 / Max: 1150.12Min: 1109.98 / Avg: 1110.49 / Max: 1111.2Min: 978.52 / Avg: 990.16 / Max: 1007.78Min: 886.92 / Avg: 889.18 / Max: 890.47Min: 791.97 / Avg: 795.63 / Max: 798.81Min: 789.51 / Avg: 793.64 / Max: 800.56Min: 601.54 / Avg: 621.42 / Max: 640.68Min: 591.13 / Avg: 592.2 / Max: 592.87Min: 564.85 / Avg: 576.98 / Max: 607.66Min: 517.77 / Avg: 525.88 / Max: 552.88Min: 477.45 / Avg: 477.77 / Max: 478.03Min: 460.09 / Avg: 467.08 / Max: 474.24Min: 413.7 / Avg: 415.96 / Max: 417.83Min: 316.82 / Avg: 317.38 / Max: 318.14Min: 292.87 / Avg: 293.07 / Max: 293.311. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Road Segmentation ADAS FP16-INT8 - Device: CPUEPYC 9684X 2PEPYC 9654 2PEPYC 9754 2PEPYC 9684XEPYC 9654EPYC 8534PEPYC 8534PNEPYC 9754Xeon Platinum 8592+Xeon Max 9468Xeon Platinum 8490HXeon Max 9468 2PXeon Platinum 8592+ 2PXeon Max 9480 2PXeon Max 9480Xeon Platinum 8490H 2P1530456075SE +/- 0.02, N = 3SE +/- 0.02, N = 3SE +/- 0.02, N = 3SE +/- 0.01, N = 3SE +/- 0.11, N = 3SE +/- 0.02, N = 3SE +/- 0.03, N = 3SE +/- 0.26, N = 15SE +/- 0.02, N = 3SE +/- 0.15, N = 3SE +/- 0.14, N = 3SE +/- 0.05, N = 3SE +/- 0.28, N = 3SE +/- 0.06, N = 3SE +/- 0.21, N = 3SE +/- 0.03, N = 311.9514.3015.8421.6327.4631.9934.7638.2155.0755.7455.9956.7157.1362.1162.5365.02MIN: 11.25 / MAX: 37.16MIN: 11.91 / MAX: 38.94MIN: 13.68 / MAX: 55.05MIN: 14.35 / MAX: 50.29MIN: 14.03 / MAX: 53.11MIN: 16.09 / MAX: 51.04MIN: 17.72 / MAX: 54.79MIN: 15.81 / MAX: 88.01MIN: 46.78 / MAX: 80.73MIN: 44.83 / MAX: 69.99MIN: 27.63 / MAX: 76.45MIN: 45.43 / MAX: 89.46MIN: 39.58 / MAX: 104.91MIN: 47.82 / MAX: 101.26MIN: 48.23 / MAX: 78.43MIN: 55.15 / MAX: 104.431. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Road Segmentation ADAS FP16-INT8 - Device: CPUEPYC 9684X 2PEPYC 9654 2PEPYC 9754 2PEPYC 9684XEPYC 9654EPYC 8534PEPYC 8534PNEPYC 9754Xeon Platinum 8592+Xeon Max 9468Xeon Platinum 8490HXeon Max 9468 2PXeon Platinum 8592+ 2PXeon Max 9480 2PXeon Max 9480Xeon Platinum 8490H 2P1326395265Min: 11.92 / Avg: 11.95 / Max: 11.97Min: 14.28 / Avg: 14.3 / Max: 14.33Min: 15.8 / Avg: 15.84 / Max: 15.87Min: 21.61 / Avg: 21.63 / Max: 21.64Min: 27.26 / Avg: 27.46 / Max: 27.62Min: 31.95 / Avg: 31.99 / Max: 32.01Min: 34.72 / Avg: 34.76 / Max: 34.82Min: 36.04 / Avg: 38.21 / Max: 39.69Min: 55.03 / Avg: 55.07 / Max: 55.1Min: 55.44 / Avg: 55.74 / Max: 55.92Min: 55.71 / Avg: 55.99 / Max: 56.15Min: 56.63 / Avg: 56.71 / Max: 56.8Min: 56.8 / Avg: 57.13 / Max: 57.69Min: 61.99 / Avg: 62.11 / Max: 62.18Min: 62.27 / Avg: 62.53 / Max: 62.94Min: 64.98 / Avg: 65.02 / Max: 65.081. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Road Segmentation ADAS FP16-INT8 - Device: CPUEPYC 9754 2PEPYC 9684X 2PEPYC 9654 2PXeon Platinum 8592+ 2PEPYC 9684XXeon Platinum 8490H 2PXeon Max 9480 2PEPYC 9654Xeon Max 9468 2PEPYC 9754Xeon Platinum 8592+Xeon Platinum 8490HEPYC 8534PEPYC 8534PNXeon Max 9480Xeon Max 94689001800270036004500SE +/- 5.40, N = 3SE +/- 5.33, N = 3SE +/- 3.90, N = 3SE +/- 11.53, N = 3SE +/- 1.09, N = 3SE +/- 0.66, N = 3SE +/- 1.74, N = 3SE +/- 6.85, N = 3SE +/- 1.56, N = 3SE +/- 11.41, N = 15SE +/- 0.47, N = 3SE +/- 2.65, N = 3SE +/- 0.65, N = 3SE +/- 0.81, N = 3SE +/- 2.94, N = 3SE +/- 2.29, N = 34032.664013.963353.732237.692212.411843.611801.891743.491691.791671.231159.661068.43998.09918.53894.87860.641. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Road Segmentation ADAS FP16-INT8 - Device: CPUEPYC 9754 2PEPYC 9684X 2PEPYC 9654 2PXeon Platinum 8592+ 2PEPYC 9684XXeon Platinum 8490H 2PXeon Max 9480 2PEPYC 9654Xeon Max 9468 2PEPYC 9754Xeon Platinum 8592+Xeon Platinum 8490HEPYC 8534PEPYC 8534PNXeon Max 9480Xeon Max 94687001400210028003500Min: 4026.19 / Avg: 4032.66 / Max: 4043.38Min: 4007.3 / Avg: 4013.96 / Max: 4024.51Min: 3345.97 / Avg: 3353.73 / Max: 3358.21Min: 2214.76 / Avg: 2237.69 / Max: 2251.29Min: 2210.7 / Avg: 2212.41 / Max: 2214.44Min: 1842.38 / Avg: 1843.61 / Max: 1844.65Min: 1799.84 / Avg: 1801.89 / Max: 1805.36Min: 1733.4 / Avg: 1743.49 / Max: 1756.55Min: 1688.93 / Avg: 1691.79 / Max: 1694.3Min: 1607.92 / Avg: 1671.23 / Max: 1770.86Min: 1159 / Avg: 1159.66 / Max: 1160.57Min: 1065.34 / Avg: 1068.43 / Max: 1073.71Min: 997.22 / Avg: 998.09 / Max: 999.35Min: 916.96 / Avg: 918.53 / Max: 919.63Min: 889.09 / Avg: 894.87 / Max: 898.73Min: 857.92 / Avg: 860.64 / Max: 865.191. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Vehicle Detection FP16-INT8 - Device: CPUEPYC 9684X 2PEPYC 9654 2PEPYC 9754 2PEPYC 9684XEPYC 9654EPYC 8534PEPYC 9754EPYC 8534PNXeon Platinum 8592+Xeon Platinum 8592+ 2PXeon Max 9468Xeon Max 9468 2PXeon Platinum 8490HXeon Max 9480Xeon Max 9480 2PXeon Platinum 8490H 2P510152025SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.12, N = 15SE +/- 0.01, N = 3SE +/- 0.00, N = 3SE +/- 0.01, N = 3SE +/- 0.05, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.04, N = 3SE +/- 0.03, N = 3SE +/- 0.04, N = 34.084.465.007.858.5810.7810.9711.4813.7314.6716.3317.1917.8419.4420.2421.73MIN: 3.61 / MAX: 25.59MIN: 3.61 / MAX: 26.57MIN: 4.38 / MAX: 33.93MIN: 3.77 / MAX: 30.51MIN: 3.84 / MAX: 27.82MIN: 5.12 / MAX: 22.93MIN: 4.5 / MAX: 46.56MIN: 5.61 / MAX: 26.2MIN: 12.23 / MAX: 23.01MIN: 12.73 / MAX: 41.28MIN: 13.49 / MAX: 26.98MIN: 13.16 / MAX: 42.02MIN: 9.08 / MAX: 37.11MIN: 15.1 / MAX: 32.19MIN: 13.69 / MAX: 36.9MIN: 15.08 / MAX: 39.821. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Vehicle Detection FP16-INT8 - Device: CPUEPYC 9684X 2PEPYC 9654 2PEPYC 9754 2PEPYC 9684XEPYC 9654EPYC 8534PEPYC 9754EPYC 8534PNXeon Platinum 8592+Xeon Platinum 8592+ 2PXeon Max 9468Xeon Max 9468 2PXeon Platinum 8490HXeon Max 9480Xeon Max 9480 2PXeon Platinum 8490H 2P510152025Min: 4.08 / Avg: 4.08 / Max: 4.08Min: 4.46 / Avg: 4.46 / Max: 4.47Min: 5 / Avg: 5 / Max: 5Min: 7.84 / Avg: 7.85 / Max: 7.85Min: 8.56 / Avg: 8.58 / Max: 8.6Min: 10.77 / Avg: 10.78 / Max: 10.79Min: 9.93 / Avg: 10.97 / Max: 11.7Min: 11.46 / Avg: 11.48 / Max: 11.5Min: 13.72 / Avg: 13.73 / Max: 13.73Min: 14.65 / Avg: 14.67 / Max: 14.68Min: 16.25 / Avg: 16.33 / Max: 16.41Min: 17.17 / Avg: 17.19 / Max: 17.21Min: 17.83 / Avg: 17.84 / Max: 17.86Min: 19.38 / Avg: 19.44 / Max: 19.51Min: 20.18 / Avg: 20.24 / Max: 20.28Min: 21.69 / Avg: 21.73 / Max: 21.811. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Vehicle Detection FP16-INT8 - Device: CPUEPYC 9754 2PEPYC 9684X 2PEPYC 9654 2PXeon Platinum 8592+ 2PEPYC 9684XEPYC 9754Xeon Max 9468 2PEPYC 9654Xeon Max 9480 2PXeon Platinum 8490H 2PXeon Platinum 8592+Xeon Platinum 8490HEPYC 8534PXeon Max 9468Xeon Max 9480EPYC 8534PN3K6K9K12K15KSE +/- 1.24, N = 3SE +/- 4.04, N = 3SE +/- 4.21, N = 3SE +/- 6.25, N = 3SE +/- 3.54, N = 3SE +/- 66.33, N = 15SE +/- 4.11, N = 3SE +/- 8.39, N = 3SE +/- 8.70, N = 3SE +/- 11.51, N = 3SE +/- 0.73, N = 3SE +/- 0.81, N = 3SE +/- 2.22, N = 3SE +/- 8.09, N = 3SE +/- 5.68, N = 3SE +/- 2.89, N = 312750.5911735.4210708.918719.376017.195778.515576.865528.155525.565483.814656.923325.902943.082935.472877.322763.481. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Vehicle Detection FP16-INT8 - Device: CPUEPYC 9754 2PEPYC 9684X 2PEPYC 9654 2PXeon Platinum 8592+ 2PEPYC 9684XEPYC 9754Xeon Max 9468 2PEPYC 9654Xeon Max 9480 2PXeon Platinum 8490H 2PXeon Platinum 8592+Xeon Platinum 8490HEPYC 8534PXeon Max 9468Xeon Max 9480EPYC 8534PN2K4K6K8K10KMin: 12748.78 / Avg: 12750.59 / Max: 12752.97Min: 11728.63 / Avg: 11735.42 / Max: 11742.62Min: 10701.2 / Avg: 10708.91 / Max: 10715.71Min: 8712.89 / Avg: 8719.37 / Max: 8731.87Min: 6010.21 / Avg: 6017.19 / Max: 6021.67Min: 5415.22 / Avg: 5778.51 / Max: 6357.39Min: 5570.53 / Avg: 5576.86 / Max: 5584.57Min: 5514.17 / Avg: 5528.15 / Max: 5543.17Min: 5513.58 / Avg: 5525.56 / Max: 5542.48Min: 5460.82 / Avg: 5483.81 / Max: 5496.2Min: 4656.19 / Avg: 4656.92 / Max: 4658.37Min: 3324.4 / Avg: 3325.9 / Max: 3327.18Min: 2939.36 / Avg: 2943.08 / Max: 2947.04Min: 2921.65 / Avg: 2935.47 / Max: 2949.68Min: 2867.21 / Avg: 2877.32 / Max: 2886.87Min: 2759.81 / Avg: 2763.48 / Max: 2769.181. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OSPRay Studio

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 1.0Camera: 1 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path Tracer - Acceleration: CPUEPYC 9754 2PEPYC 9684X 2PEPYC 9654 2PXeon Platinum 8592+ 2PXeon Platinum 8490H 2PXeon Max 9480 2PEPYC 9754EPYC 9684XXeon Max 9468 2PEPYC 9654Xeon Platinum 8592+Xeon Platinum 8490HXeon Max 9480Xeon Max 9468EPYC 8534PEPYC 8534PN20K40K60K80K100KSE +/- 47.34, N = 3SE +/- 14.62, N = 3SE +/- 109.43, N = 3SE +/- 16.05, N = 3SE +/- 64.24, N = 3SE +/- 13.86, N = 3SE +/- 312.83, N = 12SE +/- 193.23, N = 3SE +/- 37.55, N = 3SE +/- 42.05, N = 3SE +/- 90.37, N = 3SE +/- 102.40, N = 3SE +/- 64.91, N = 3SE +/- 134.33, N = 3SE +/- 172.59, N = 3SE +/- 346.19, N = 316960178552075024249334113617937383386453892643290507985802662540689737205178093
OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 1.0Camera: 1 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path Tracer - Acceleration: CPUEPYC 9754 2PEPYC 9684X 2PEPYC 9654 2PXeon Platinum 8592+ 2PXeon Platinum 8490H 2PXeon Max 9480 2PEPYC 9754EPYC 9684XXeon Max 9468 2PEPYC 9654Xeon Platinum 8592+Xeon Platinum 8490HXeon Max 9480Xeon Max 9468EPYC 8534PEPYC 8534PN14K28K42K56K70KMin: 16873 / Avg: 16959.67 / Max: 17036Min: 17828 / Avg: 17855.33 / Max: 17878Min: 20563 / Avg: 20750.33 / Max: 20942Min: 24217 / Avg: 24248.67 / Max: 24269Min: 33291 / Avg: 33410.67 / Max: 33511Min: 36158 / Avg: 36178.67 / Max: 36205Min: 36477 / Avg: 37383.08 / Max: 40725Min: 38278 / Avg: 38645.33 / Max: 38933Min: 38866 / Avg: 38925.67 / Max: 38995Min: 43212 / Avg: 43290.33 / Max: 43356Min: 50683 / Avg: 50797.67 / Max: 50976Min: 57887 / Avg: 58026.33 / Max: 58226Min: 62411 / Avg: 62539.67 / Max: 62619Min: 68712 / Avg: 68973.33 / Max: 69158Min: 71706 / Avg: 72051 / Max: 72233Min: 77422 / Avg: 78092.67 / Max: 78577

Helsing

Helsing is an open-source POSIX vampire number generator. This test profile measures the time it takes to generate vampire numbers between varying numbers of digits. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterHelsing 1.0-betaDigit Range: 14 digitEPYC 9754 2PEPYC 9684X 2PEPYC 9654 2PXeon Platinum 8592+ 2PEPYC 9754Xeon Platinum 8490H 2PEPYC 9684XXeon Max 9480 2PEPYC 9654Xeon Max 9468 2PXeon Platinum 8592+Xeon Platinum 8490HEPYC 8534PXeon Max 9480EPYC 8534PNXeon Max 9468306090120150SE +/- 0.32, N = 3SE +/- 0.42, N = 3SE +/- 0.38, N = 5SE +/- 0.07, N = 3SE +/- 0.02, N = 3SE +/- 0.06, N = 3SE +/- 0.14, N = 3SE +/- 0.42, N = 3SE +/- 0.10, N = 3SE +/- 0.11, N = 3SE +/- 0.08, N = 3SE +/- 0.26, N = 3SE +/- 0.27, N = 3SE +/- 0.12, N = 3SE +/- 0.06, N = 3SE +/- 0.53, N = 326.7830.6933.6848.0948.8550.8356.9158.2562.1765.0389.0793.35105.68107.24120.56123.831. (CC) gcc options: -O2 -pthread
OpenBenchmarking.orgSeconds, Fewer Is BetterHelsing 1.0-betaDigit Range: 14 digitEPYC 9754 2PEPYC 9684X 2PEPYC 9654 2PXeon Platinum 8592+ 2PEPYC 9754Xeon Platinum 8490H 2PEPYC 9684XXeon Max 9480 2PEPYC 9654Xeon Max 9468 2PXeon Platinum 8592+Xeon Platinum 8490HEPYC 8534PXeon Max 9480EPYC 8534PNXeon Max 946820406080100Min: 26.27 / Avg: 26.78 / Max: 27.35Min: 29.91 / Avg: 30.69 / Max: 31.35Min: 32.89 / Avg: 33.68 / Max: 35.05Min: 47.96 / Avg: 48.09 / Max: 48.21Min: 48.82 / Avg: 48.85 / Max: 48.88Min: 50.71 / Avg: 50.83 / Max: 50.93Min: 56.73 / Avg: 56.91 / Max: 57.19Min: 57.64 / Avg: 58.25 / Max: 59.05Min: 61.99 / Avg: 62.17 / Max: 62.32Min: 64.83 / Avg: 65.03 / Max: 65.19Min: 88.98 / Avg: 89.07 / Max: 89.23Min: 92.89 / Avg: 93.35 / Max: 93.78Min: 105.32 / Avg: 105.68 / Max: 106.2Min: 107.01 / Avg: 107.24 / Max: 107.36Min: 120.45 / Avg: 120.56 / Max: 120.67Min: 122.82 / Avg: 123.83 / Max: 124.631. (CC) gcc options: -O2 -pthread

libavif avifenc

OpenBenchmarking.orgSeconds, Fewer Is Betterlibavif avifenc 1.0Encoder Speed: 0Xeon Platinum 8592+ 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9684X 2PXeon Platinum 8592+Xeon Platinum 8490H 2PXeon Max 9480 2PXeon Max 9468 2PXeon Platinum 8490HXeon Max 9480EPYC 9754EPYC 9754 2PEPYC 8534PXeon Max 9468EPYC 8534PN20406080100SE +/- 0.03, N = 3SE +/- 0.12, N = 3SE +/- 0.01, N = 3SE +/- 0.11, N = 3SE +/- 0.01, N = 3SE +/- 0.08, N = 3SE +/- 0.05, N = 3SE +/- 0.32, N = 3SE +/- 0.29, N = 3SE +/- 0.32, N = 3SE +/- 0.22, N = 3SE +/- 0.13, N = 3SE +/- 0.06, N = 3SE +/- 0.19, N = 3SE +/- 0.15, N = 3SE +/- 0.18, N = 360.5361.6361.9962.8963.4064.4867.3868.4469.6569.9373.0673.2774.6975.8676.9278.241. (CXX) g++ options: -O3 -fPIC -lm
OpenBenchmarking.orgSeconds, Fewer Is Betterlibavif avifenc 1.0Encoder Speed: 0Xeon Platinum 8592+ 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9684X 2PXeon Platinum 8592+Xeon Platinum 8490H 2PXeon Max 9480 2PXeon Max 9468 2PXeon Platinum 8490HXeon Max 9480EPYC 9754EPYC 9754 2PEPYC 8534PXeon Max 9468EPYC 8534PN1530456075Min: 60.47 / Avg: 60.53 / Max: 60.57Min: 61.38 / Avg: 61.63 / Max: 61.76Min: 61.98 / Avg: 61.99 / Max: 62.02Min: 62.69 / Avg: 62.89 / Max: 63.07Min: 63.39 / Avg: 63.4 / Max: 63.42Min: 64.38 / Avg: 64.48 / Max: 64.63Min: 67.32 / Avg: 67.37 / Max: 67.47Min: 68 / Avg: 68.44 / Max: 69.07Min: 69.12 / Avg: 69.65 / Max: 70.13Min: 69.55 / Avg: 69.93 / Max: 70.56Min: 72.62 / Avg: 73.06 / Max: 73.3Min: 73.02 / Avg: 73.27 / Max: 73.46Min: 74.58 / Avg: 74.69 / Max: 74.79Min: 75.48 / Avg: 75.86 / Max: 76.07Min: 76.63 / Avg: 76.92 / Max: 77.15Min: 77.91 / Avg: 78.24 / Max: 78.521. (CXX) g++ options: -O3 -fPIC -lm

OSPRay Studio

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 1.0Camera: 3 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path Tracer - Acceleration: CPUEPYC 9754 2PEPYC 9684X 2PEPYC 9654 2PXeon Platinum 8592+ 2PXeon Platinum 8490H 2PEPYC 9754Xeon Max 9480 2PEPYC 9684XXeon Max 9468 2PEPYC 9654Xeon Platinum 8592+Xeon Platinum 8490HXeon Max 9480Xeon Max 9468EPYC 8534PEPYC 8534PN6001200180024003000SE +/- 0.67, N = 3SE +/- 1.45, N = 3SE +/- 0.58, N = 3SE +/- 0.00, N = 3SE +/- 0.88, N = 3SE +/- 0.88, N = 3SE +/- 0.33, N = 3SE +/- 1.53, N = 3SE +/- 2.65, N = 3SE +/- 1.00, N = 3SE +/- 1.45, N = 3SE +/- 0.88, N = 3SE +/- 1.20, N = 3SE +/- 1.20, N = 3SE +/- 1.00, N = 3SE +/- 3.06, N = 3630660780898106311301143122512371391170919772123235724212649
OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 1.0Camera: 3 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path Tracer - Acceleration: CPUEPYC 9754 2PEPYC 9684X 2PEPYC 9654 2PXeon Platinum 8592+ 2PXeon Platinum 8490H 2PEPYC 9754Xeon Max 9480 2PEPYC 9684XXeon Max 9468 2PEPYC 9654Xeon Platinum 8592+Xeon Platinum 8490HXeon Max 9480Xeon Max 9468EPYC 8534PEPYC 8534PN5001000150020002500Min: 629 / Avg: 630.33 / Max: 631Min: 657 / Avg: 659.67 / Max: 662Min: 779 / Avg: 780 / Max: 781Min: 898 / Avg: 898 / Max: 898Min: 1062 / Avg: 1063.33 / Max: 1065Min: 1129 / Avg: 1130.33 / Max: 1132Min: 1142 / Avg: 1142.67 / Max: 1143Min: 1222 / Avg: 1225 / Max: 1227Min: 1232 / Avg: 1237 / Max: 1241Min: 1390 / Avg: 1391 / Max: 1393Min: 1707 / Avg: 1709.33 / Max: 1712Min: 1976 / Avg: 1977.33 / Max: 1979Min: 2121 / Avg: 2123.33 / Max: 2125Min: 2355 / Avg: 2357.33 / Max: 2359Min: 2419 / Avg: 2421 / Max: 2422Min: 2643 / Avg: 2649 / Max: 2653

ONNX Runtime

ONNX Runtime is developed by Microsoft and partners as a open-source, cross-platform, high performance machine learning inferencing and training accelerator. This test profile runs the ONNX Runtime with various models available from the ONNX Model Zoo. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgInference Time Cost (ms), Fewer Is BetterONNX Runtime 1.17Model: Faster R-CNN R-50-FPN-int8 - Device: CPU - Executor: ParallelXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8592+ 2PXeon Platinum 8490H 2PEPYC 9654EPYC 9684XXeon Max 9468Xeon Max 9480EPYC 8534PEPYC 8534PNEPYC 9754EPYC 9754 2PEPYC 9654 2PXeon Max 9468 2PXeon Max 9480 2PEPYC 9684X 2P918273645SE +/- 0.01, N = 3SE +/- 0.07, N = 3SE +/- 0.00, N = 3SE +/- 0.06, N = 3SE +/- 0.41, N = 3SE +/- 0.22, N = 3SE +/- 0.13, N = 3SE +/- 0.08, N = 3SE +/- 0.18, N = 3SE +/- 0.33, N = 3SE +/- 0.43, N = 4SE +/- 0.35, N = 7SE +/- 0.07, N = 3SE +/- 0.55, N = 3SE +/- 0.32, N = 3SE +/- 0.15, N = 329.9630.9231.5333.2933.5234.8135.0735.1135.7935.8836.4538.0039.0240.4540.5241.571. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt
OpenBenchmarking.orgInference Time Cost (ms), Fewer Is BetterONNX Runtime 1.17Model: Faster R-CNN R-50-FPN-int8 - Device: CPU - Executor: ParallelXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8592+ 2PXeon Platinum 8490H 2PEPYC 9654EPYC 9684XXeon Max 9468Xeon Max 9480EPYC 8534PEPYC 8534PNEPYC 9754EPYC 9754 2PEPYC 9654 2PXeon Max 9468 2PXeon Max 9480 2PEPYC 9684X 2P918273645Min: 29.94 / Avg: 29.96 / Max: 29.97Min: 30.82 / Avg: 30.92 / Max: 31.04Min: 31.52 / Avg: 31.53 / Max: 31.54Min: 33.17 / Avg: 33.29 / Max: 33.4Min: 33.05 / Avg: 33.52 / Max: 34.33Min: 34.39 / Avg: 34.81 / Max: 35.14Min: 34.81 / Avg: 35.07 / Max: 35.22Min: 34.95 / Avg: 35.11 / Max: 35.22Min: 35.49 / Avg: 35.79 / Max: 36.09Min: 35.31 / Avg: 35.88 / Max: 36.43Min: 35.19 / Avg: 36.45 / Max: 37.18Min: 37.23 / Avg: 38 / Max: 39.98Min: 38.89 / Avg: 39.02 / Max: 39.13Min: 39.45 / Avg: 40.45 / Max: 41.37Min: 39.89 / Avg: 40.52 / Max: 40.88Min: 41.29 / Avg: 41.57 / Max: 41.791. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.17Model: Faster R-CNN R-50-FPN-int8 - Device: CPU - Executor: ParallelXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8592+ 2PXeon Platinum 8490H 2PEPYC 9654EPYC 9684XXeon Max 9468Xeon Max 9480EPYC 8534PEPYC 8534PNEPYC 9754EPYC 9754 2PEPYC 9654 2PXeon Max 9468 2PXeon Max 9480 2PEPYC 9684X 2P816243240SE +/- 0.01, N = 3SE +/- 0.07, N = 3SE +/- 0.00, N = 3SE +/- 0.06, N = 3SE +/- 0.36, N = 3SE +/- 0.19, N = 3SE +/- 0.10, N = 3SE +/- 0.07, N = 3SE +/- 0.14, N = 3SE +/- 0.25, N = 3SE +/- 0.33, N = 4SE +/- 0.24, N = 7SE +/- 0.05, N = 3SE +/- 0.34, N = 3SE +/- 0.19, N = 3SE +/- 0.08, N = 333.3832.3431.7130.0429.8428.7328.5228.4827.9427.8727.4526.3325.6324.7324.6824.051. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt
OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.17Model: Faster R-CNN R-50-FPN-int8 - Device: CPU - Executor: ParallelXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8592+ 2PXeon Platinum 8490H 2PEPYC 9654EPYC 9684XXeon Max 9468Xeon Max 9480EPYC 8534PEPYC 8534PNEPYC 9754EPYC 9754 2PEPYC 9654 2PXeon Max 9468 2PXeon Max 9480 2PEPYC 9684X 2P714212835Min: 33.37 / Avg: 33.38 / Max: 33.4Min: 32.21 / Avg: 32.34 / Max: 32.44Min: 31.71 / Avg: 31.71 / Max: 31.72Min: 29.94 / Avg: 30.04 / Max: 30.14Min: 29.13 / Avg: 29.84 / Max: 30.25Min: 28.45 / Avg: 28.73 / Max: 29.08Min: 28.39 / Avg: 28.52 / Max: 28.72Min: 28.39 / Avg: 28.48 / Max: 28.61Min: 27.7 / Avg: 27.94 / Max: 28.18Min: 27.44 / Avg: 27.87 / Max: 28.32Min: 26.89 / Avg: 27.45 / Max: 28.42Min: 25.01 / Avg: 26.33 / Max: 26.86Min: 25.55 / Avg: 25.63 / Max: 25.71Min: 24.17 / Avg: 24.73 / Max: 25.34Min: 24.46 / Avg: 24.68 / Max: 25.07Min: 23.93 / Avg: 24.05 / Max: 24.211. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

OSPRay Studio

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 1.0Camera: 3 - Resolution: 4K - Samples Per Pixel: 16 - Renderer: Path Tracer - Acceleration: CPUEPYC 9754 2PEPYC 9684X 2PEPYC 9654 2PXeon Platinum 8592+ 2PXeon Platinum 8490H 2PXeon Max 9480 2PEPYC 9754EPYC 9684XXeon Max 9468 2PEPYC 9654Xeon Platinum 8592+Xeon Platinum 8490HXeon Max 9480Xeon Max 9468EPYC 8534PEPYC 8534PN10K20K30K40K50KSE +/- 16.90, N = 3SE +/- 32.79, N = 3SE +/- 27.79, N = 3SE +/- 8.00, N = 3SE +/- 29.96, N = 3SE +/- 10.97, N = 3SE +/- 21.05, N = 3SE +/- 24.66, N = 3SE +/- 25.12, N = 3SE +/- 5.55, N = 3SE +/- 26.00, N = 3SE +/- 61.20, N = 3SE +/- 74.33, N = 3SE +/- 36.47, N = 3SE +/- 111.72, N = 3SE +/- 197.99, N = 310015105141242714358168371811118129195351970122305319933664939238428374537748844
OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 1.0Camera: 3 - Resolution: 4K - Samples Per Pixel: 16 - Renderer: Path Tracer - Acceleration: CPUEPYC 9754 2PEPYC 9684X 2PEPYC 9654 2PXeon Platinum 8592+ 2PXeon Platinum 8490H 2PXeon Max 9480 2PEPYC 9754EPYC 9684XXeon Max 9468 2PEPYC 9654Xeon Platinum 8592+Xeon Platinum 8490HXeon Max 9480Xeon Max 9468EPYC 8534PEPYC 8534PN8K16K24K32K40KMin: 9990 / Avg: 10014.67 / Max: 10047Min: 10449 / Avg: 10514 / Max: 10554Min: 12374 / Avg: 12427 / Max: 12468Min: 14342 / Avg: 14358 / Max: 14366Min: 16795 / Avg: 16837 / Max: 16895Min: 18092 / Avg: 18110.67 / Max: 18130Min: 18090 / Avg: 18129.33 / Max: 18162Min: 19502 / Avg: 19534.67 / Max: 19583Min: 19670 / Avg: 19701.33 / Max: 19751Min: 22296 / Avg: 22304.67 / Max: 22315Min: 31947 / Avg: 31993 / Max: 32037Min: 36542 / Avg: 36648.67 / Max: 36754Min: 39114 / Avg: 39238 / Max: 39371Min: 42766 / Avg: 42837 / Max: 42887Min: 45183 / Avg: 45377 / Max: 45570Min: 48619 / Avg: 48844.33 / Max: 49239

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 1.0Camera: 1 - Resolution: 4K - Samples Per Pixel: 16 - Renderer: Path Tracer - Acceleration: CPUEPYC 9754 2PEPYC 9684X 2PEPYC 9654 2PXeon Platinum 8592+ 2PXeon Platinum 8490H 2PEPYC 9754Xeon Max 9480 2PEPYC 9684XXeon Max 9468 2PEPYC 9654Xeon Platinum 8592+Xeon Platinum 8490HXeon Max 9480Xeon Max 9468EPYC 8534PEPYC 8534PN9K18K27K36K45KSE +/- 12.34, N = 3SE +/- 17.16, N = 3SE +/- 32.74, N = 3SE +/- 7.13, N = 3SE +/- 34.10, N = 3SE +/- 33.33, N = 3SE +/- 51.39, N = 3SE +/- 39.30, N = 3SE +/- 72.42, N = 3SE +/- 44.33, N = 3SE +/- 37.49, N = 3SE +/- 62.46, N = 3SE +/- 83.47, N = 3SE +/- 28.06, N = 3SE +/- 250.73, N = 3SE +/- 31.02, N = 3841389161042812124141381528615357166031664518896231253138033790370553881142513
OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 1.0Camera: 1 - Resolution: 4K - Samples Per Pixel: 16 - Renderer: Path Tracer - Acceleration: CPUEPYC 9754 2PEPYC 9684X 2PEPYC 9654 2PXeon Platinum 8592+ 2PXeon Platinum 8490H 2PEPYC 9754Xeon Max 9480 2PEPYC 9684XXeon Max 9468 2PEPYC 9654Xeon Platinum 8592+Xeon Platinum 8490HXeon Max 9480Xeon Max 9468EPYC 8534PEPYC 8534PN7K14K21K28K35KMin: 8389 / Avg: 8413 / Max: 8430Min: 8895 / Avg: 8916 / Max: 8950Min: 10374 / Avg: 10427.67 / Max: 10487Min: 12114 / Avg: 12124.33 / Max: 12138Min: 14077 / Avg: 14137.67 / Max: 14195Min: 15253 / Avg: 15286.33 / Max: 15353Min: 15268 / Avg: 15357.33 / Max: 15446Min: 16554 / Avg: 16603.33 / Max: 16681Min: 16562 / Avg: 16644.67 / Max: 16789Min: 18845 / Avg: 18895.67 / Max: 18984Min: 23082 / Avg: 23125.33 / Max: 23200Min: 31258 / Avg: 31379.67 / Max: 31465Min: 33636 / Avg: 33789.67 / Max: 33923Min: 37000 / Avg: 37054.67 / Max: 37093Min: 38456 / Avg: 38810.67 / Max: 39295Min: 42451 / Avg: 42513 / Max: 42546

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 1.0Camera: 1 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path Tracer - Acceleration: CPUEPYC 9754 2PEPYC 9684X 2PEPYC 9654 2PXeon Platinum 8592+ 2PXeon Platinum 8490H 2PEPYC 9754Xeon Max 9480 2PEPYC 9684XXeon Max 9468 2PEPYC 9654Xeon Platinum 8592+Xeon Platinum 8490HXeon Max 9480Xeon Max 9468EPYC 8534PEPYC 8534PN5001000150020002500SE +/- 0.88, N = 3SE +/- 1.20, N = 3SE +/- 0.58, N = 3SE +/- 0.88, N = 3SE +/- 0.58, N = 3SE +/- 1.20, N = 3SE +/- 0.58, N = 3SE +/- 1.15, N = 3SE +/- 1.76, N = 3SE +/- 0.58, N = 3SE +/- 0.88, N = 3SE +/- 0.58, N = 3SE +/- 0.58, N = 3SE +/- 0.33, N = 3SE +/- 0.58, N = 3SE +/- 1.20, N = 3531561661759894954961103710491180144116571792198820432240
OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 1.0Camera: 1 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path Tracer - Acceleration: CPUEPYC 9754 2PEPYC 9684X 2PEPYC 9654 2PXeon Platinum 8592+ 2PXeon Platinum 8490H 2PEPYC 9754Xeon Max 9480 2PEPYC 9684XXeon Max 9468 2PEPYC 9654Xeon Platinum 8592+Xeon Platinum 8490HXeon Max 9480Xeon Max 9468EPYC 8534PEPYC 8534PN400800120016002000Min: 529 / Avg: 530.67 / Max: 532Min: 559 / Avg: 560.67 / Max: 563Min: 660 / Avg: 661 / Max: 662Min: 757 / Avg: 758.67 / Max: 760Min: 893 / Avg: 894 / Max: 895Min: 952 / Avg: 954.33 / Max: 956Min: 960 / Avg: 961 / Max: 962Min: 1035 / Avg: 1037 / Max: 1039Min: 1046 / Avg: 1048.67 / Max: 1052Min: 1179 / Avg: 1180 / Max: 1181Min: 1439 / Avg: 1440.67 / Max: 1442Min: 1656 / Avg: 1657 / Max: 1658Min: 1791 / Avg: 1792 / Max: 1793Min: 1988 / Avg: 1988.33 / Max: 1989Min: 2042 / Avg: 2043 / Max: 2044Min: 2238 / Avg: 2239.67 / Max: 2242

QuantLib

QuantLib is an open-source library/framework around quantitative finance for modeling, trading and risk management scenarios. QuantLib is written in C++ with Boost and its built-in benchmark used reports the QuantLib Benchmark Index benchmark score. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgMFLOPS, More Is BetterQuantLib 1.32Configuration: Multi-ThreadedEPYC 9754 2PEPYC 9684X 2PEPYC 9654 2PXeon Platinum 8592+ 2PEPYC 9754Xeon Platinum 8490H 2PEPYC 9684XXeon Max 9480 2PEPYC 9654Xeon Max 9468 2PXeon Platinum 8592+Xeon Platinum 8490HEPYC 8534PXeon Max 9480EPYC 8534PNXeon Max 9468160K320K480K640K800KSE +/- 804.57, N = 3SE +/- 1065.76, N = 3SE +/- 713.18, N = 3SE +/- 248.00, N = 3SE +/- 156.35, N = 3SE +/- 362.38, N = 3SE +/- 412.72, N = 3SE +/- 160.59, N = 3SE +/- 86.78, N = 3SE +/- 286.86, N = 3SE +/- 63.14, N = 3SE +/- 105.60, N = 3SE +/- 82.80, N = 3SE +/- 40.48, N = 3SE +/- 86.28, N = 3SE +/- 155.19, N = 3759922.1644091.0593246.9380867.5374413.5350187.5319827.2316359.2294183.2288129.1195648.8179647.5172566.8162727.4153920.8143755.31. (CXX) g++ options: -O3 -march=native -fPIE -pie
OpenBenchmarking.orgMFLOPS, More Is BetterQuantLib 1.32Configuration: Multi-ThreadedEPYC 9754 2PEPYC 9684X 2PEPYC 9654 2PXeon Platinum 8592+ 2PEPYC 9754Xeon Platinum 8490H 2PEPYC 9684XXeon Max 9480 2PEPYC 9654Xeon Max 9468 2PXeon Platinum 8592+Xeon Platinum 8490HEPYC 8534PXeon Max 9480EPYC 8534PNXeon Max 9468130K260K390K520K650KMin: 758869.4 / Avg: 759922.07 / Max: 761502.4Min: 642609.4 / Avg: 644091 / Max: 646158.9Min: 592478.4 / Avg: 593246.9 / Max: 594671.8Min: 380550.6 / Avg: 380867.5 / Max: 381356.4Min: 374185 / Avg: 374413.47 / Max: 374712.6Min: 349585.6 / Avg: 350187.53 / Max: 350838.1Min: 319397.1 / Avg: 319827.2 / Max: 320652.4Min: 316084 / Avg: 316359.23 / Max: 316640.2Min: 294038.7 / Avg: 294183.2 / Max: 294338.7Min: 287724.1 / Avg: 288129.07 / Max: 288683.5Min: 195522.5 / Avg: 195648.77 / Max: 195714Min: 179510.9 / Avg: 179647.5 / Max: 179855.3Min: 172472.7 / Avg: 172566.83 / Max: 172731.9Min: 162652.1 / Avg: 162727.43 / Max: 162790.8Min: 153778.8 / Avg: 153920.8 / Max: 154076.7Min: 143465.9 / Avg: 143755.33 / Max: 143997.11. (CXX) g++ options: -O3 -march=native -fPIE -pie

OSPRay

OpenBenchmarking.orgItems Per Second, More Is BetterOSPRay 3.1Benchmark: gravity_spheres_volume/dim_512/pathtracer/real_timeEPYC 9754 2PEPYC 9684X 2PEPYC 9654 2PXeon Platinum 8592+ 2PXeon Platinum 8490H 2PXeon Max 9480 2PEPYC 9754Xeon Max 9468 2PEPYC 9684XEPYC 9654Xeon Platinum 8592+Xeon Platinum 8490HXeon Max 9480Xeon Max 9468EPYC 8534PEPYC 8534PN1428425670SE +/- 0.05, N = 3SE +/- 0.14, N = 3SE +/- 0.07, N = 3SE +/- 0.04, N = 3SE +/- 0.02, N = 3SE +/- 0.16, N = 3SE +/- 0.02, N = 3SE +/- 0.09, N = 3SE +/- 0.04, N = 3SE +/- 0.01, N = 3SE +/- 0.03, N = 3SE +/- 0.02, N = 3SE +/- 0.03, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 363.8560.3752.6748.7642.8239.3437.7435.9334.6430.6127.1024.6422.3619.9118.4716.92
OpenBenchmarking.orgItems Per Second, More Is BetterOSPRay 3.1Benchmark: gravity_spheres_volume/dim_512/pathtracer/real_timeEPYC 9754 2PEPYC 9684X 2PEPYC 9654 2PXeon Platinum 8592+ 2PXeon Platinum 8490H 2PXeon Max 9480 2PEPYC 9754Xeon Max 9468 2PEPYC 9684XEPYC 9654Xeon Platinum 8592+Xeon Platinum 8490HXeon Max 9480Xeon Max 9468EPYC 8534PEPYC 8534PN1224364860Min: 63.76 / Avg: 63.85 / Max: 63.93Min: 60.19 / Avg: 60.37 / Max: 60.64Min: 52.58 / Avg: 52.67 / Max: 52.82Min: 48.7 / Avg: 48.76 / Max: 48.83Min: 42.79 / Avg: 42.82 / Max: 42.85Min: 39.02 / Avg: 39.34 / Max: 39.52Min: 37.71 / Avg: 37.74 / Max: 37.78Min: 35.81 / Avg: 35.93 / Max: 36.12Min: 34.59 / Avg: 34.64 / Max: 34.71Min: 30.59 / Avg: 30.61 / Max: 30.62Min: 27.06 / Avg: 27.1 / Max: 27.17Min: 24.61 / Avg: 24.64 / Max: 24.66Min: 22.32 / Avg: 22.36 / Max: 22.42Min: 19.9 / Avg: 19.91 / Max: 19.92Min: 18.46 / Avg: 18.47 / Max: 18.48Min: 16.91 / Avg: 16.92 / Max: 16.93

OpenVINO

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Face Detection FP16-INT8 - Device: CPUXeon Platinum 8592+EPYC 9684X 2PXeon Platinum 8592+ 2PXeon Max 9468EPYC 9654 2PXeon Max 9468 2PXeon Max 9480EPYC 9754 2PXeon Max 9480 2PXeon Platinum 8490H 2PXeon Platinum 8490HEPYC 9684XEPYC 9654EPYC 9754EPYC 8534PEPYC 8534PN140280420560700SE +/- 0.69, N = 3SE +/- 0.43, N = 3SE +/- 0.33, N = 3SE +/- 0.15, N = 3SE +/- 0.02, N = 3SE +/- 0.40, N = 3SE +/- 0.47, N = 3SE +/- 0.03, N = 3SE +/- 0.35, N = 3SE +/- 0.00, N = 3SE +/- 0.28, N = 3SE +/- 0.43, N = 3SE +/- 0.07, N = 3SE +/- 0.18, N = 3SE +/- 0.18, N = 3SE +/- 0.12, N = 3224.64233.63234.24236.52253.63256.63257.50275.53278.52283.11356.38471.98510.10551.07592.22654.83MIN: 153.29 / MAX: 553.64MIN: 208.22 / MAX: 306.45MIN: 148.68 / MAX: 448.54MIN: 172.47 / MAX: 265.77MIN: 208.02 / MAX: 272.56MIN: 191.95 / MAX: 301.21MIN: 187.62 / MAX: 295.06MIN: 260.9 / MAX: 318.85MIN: 196.58 / MAX: 401.59MIN: 203.37 / MAX: 332.08MIN: 109.11 / MAX: 395.69MIN: 439.42 / MAX: 492.74MIN: 263.11 / MAX: 527.97MIN: 513.17 / MAX: 582.25MIN: 486.17 / MAX: 612.41MIN: 592.1 / MAX: 665.731. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Face Detection FP16-INT8 - Device: CPUXeon Platinum 8592+EPYC 9684X 2PXeon Platinum 8592+ 2PXeon Max 9468EPYC 9654 2PXeon Max 9468 2PXeon Max 9480EPYC 9754 2PXeon Max 9480 2PXeon Platinum 8490H 2PXeon Platinum 8490HEPYC 9684XEPYC 9654EPYC 9754EPYC 8534PEPYC 8534PN120240360480600Min: 223.42 / Avg: 224.64 / Max: 225.79Min: 232.77 / Avg: 233.63 / Max: 234.17Min: 233.59 / Avg: 234.24 / Max: 234.69Min: 236.27 / Avg: 236.52 / Max: 236.8Min: 253.6 / Avg: 253.63 / Max: 253.66Min: 256.02 / Avg: 256.63 / Max: 257.38Min: 256.83 / Avg: 257.5 / Max: 258.41Min: 275.49 / Avg: 275.53 / Max: 275.59Min: 277.85 / Avg: 278.52 / Max: 279.04Min: 283.1 / Avg: 283.11 / Max: 283.11Min: 356.04 / Avg: 356.38 / Max: 356.93Min: 471.12 / Avg: 471.98 / Max: 472.41Min: 510.02 / Avg: 510.1 / Max: 510.24Min: 550.79 / Avg: 551.07 / Max: 551.42Min: 592.01 / Avg: 592.22 / Max: 592.58Min: 654.6 / Avg: 654.83 / Max: 654.981. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Face Detection FP16-INT8 - Device: CPUXeon Platinum 8592+ 2PXeon Platinum 8490H 2PXeon Max 9480 2PXeon Max 9468 2PXeon Platinum 8592+EPYC 9754 2PXeon Max 9480EPYC 9684X 2PXeon Max 9468EPYC 9654 2PXeon Platinum 8490HEPYC 9754EPYC 9684XEPYC 9654EPYC 8534PEPYC 8534PN120240360480600SE +/- 0.77, N = 3SE +/- 0.01, N = 3SE +/- 0.54, N = 3SE +/- 0.58, N = 3SE +/- 0.69, N = 3SE +/- 0.04, N = 3SE +/- 0.41, N = 3SE +/- 0.41, N = 3SE +/- 0.14, N = 3SE +/- 0.01, N = 3SE +/- 0.12, N = 3SE +/- 0.03, N = 3SE +/- 0.12, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.06, N = 3545.21423.18401.45373.50284.64231.83217.11205.03202.59188.74167.83115.78101.5193.9953.8948.731. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Face Detection FP16-INT8 - Device: CPUXeon Platinum 8592+ 2PXeon Platinum 8490H 2PXeon Max 9480 2PXeon Max 9468 2PXeon Platinum 8592+EPYC 9754 2PXeon Max 9480EPYC 9684X 2PXeon Max 9468EPYC 9654 2PXeon Platinum 8490HEPYC 9754EPYC 9684XEPYC 9654EPYC 8534PEPYC 8534PN100200300400500Min: 544.3 / Avg: 545.21 / Max: 546.74Min: 423.16 / Avg: 423.18 / Max: 423.19Min: 400.66 / Avg: 401.45 / Max: 402.49Min: 372.41 / Avg: 373.5 / Max: 374.39Min: 283.41 / Avg: 284.64 / Max: 285.79Min: 231.75 / Avg: 231.83 / Max: 231.9Min: 216.31 / Avg: 217.11 / Max: 217.68Min: 204.46 / Avg: 205.03 / Max: 205.82Min: 202.35 / Avg: 202.59 / Max: 202.83Min: 188.72 / Avg: 188.74 / Max: 188.76Min: 167.59 / Avg: 167.83 / Max: 168Min: 115.71 / Avg: 115.78 / Max: 115.81Min: 101.37 / Avg: 101.51 / Max: 101.75Min: 93.97 / Avg: 93.99 / Max: 94Min: 53.88 / Avg: 53.89 / Max: 53.9Min: 48.61 / Avg: 48.73 / Max: 48.81. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

ONNX Runtime

ONNX Runtime is developed by Microsoft and partners as a open-source, cross-platform, high performance machine learning inferencing and training accelerator. This test profile runs the ONNX Runtime with various models available from the ONNX Model Zoo. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgInference Time Cost (ms), Fewer Is BetterONNX Runtime 1.17Model: bertsquad-12 - Device: CPU - Executor: ParallelXeon Platinum 8592+Xeon Max 9468Xeon Platinum 8490HXeon Max 9480Xeon Platinum 8592+ 2PXeon Platinum 8490H 2PXeon Max 9468 2PXeon Max 9480 2PEPYC 9684XEPYC 9654EPYC 8534PEPYC 9754EPYC 8534PNEPYC 9654 2PEPYC 9684X 2PEPYC 9754 2P306090120150SE +/- 0.57, N = 3SE +/- 0.23, N = 3SE +/- 0.18, N = 3SE +/- 0.31, N = 3SE +/- 0.12, N = 3SE +/- 0.11, N = 3SE +/- 0.50, N = 3SE +/- 0.23, N = 3SE +/- 0.57, N = 3SE +/- 0.60, N = 3SE +/- 1.08, N = 3SE +/- 0.60, N = 3SE +/- 1.29, N = 4SE +/- 0.65, N = 3SE +/- 0.60, N = 3SE +/- 0.30, N = 350.8361.2562.1363.5464.7968.8372.8073.9781.4381.60102.05103.60112.76113.52114.16125.241. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt
OpenBenchmarking.orgInference Time Cost (ms), Fewer Is BetterONNX Runtime 1.17Model: bertsquad-12 - Device: CPU - Executor: ParallelXeon Platinum 8592+Xeon Max 9468Xeon Platinum 8490HXeon Max 9480Xeon Platinum 8592+ 2PXeon Platinum 8490H 2PXeon Max 9468 2PXeon Max 9480 2PEPYC 9684XEPYC 9654EPYC 8534PEPYC 9754EPYC 8534PNEPYC 9654 2PEPYC 9684X 2PEPYC 9754 2P20406080100Min: 50.26 / Avg: 50.83 / Max: 51.97Min: 60.83 / Avg: 61.25 / Max: 61.61Min: 61.93 / Avg: 62.13 / Max: 62.48Min: 62.99 / Avg: 63.54 / Max: 64.05Min: 64.66 / Avg: 64.79 / Max: 65.03Min: 68.6 / Avg: 68.83 / Max: 68.96Min: 72.2 / Avg: 72.8 / Max: 73.79Min: 73.59 / Avg: 73.97 / Max: 74.37Min: 80.8 / Avg: 81.43 / Max: 82.56Min: 80.97 / Avg: 81.6 / Max: 82.81Min: 99.97 / Avg: 102.05 / Max: 103.63Min: 102.65 / Avg: 103.6 / Max: 104.71Min: 109.94 / Avg: 112.76 / Max: 115.79Min: 112.66 / Avg: 113.52 / Max: 114.8Min: 113.45 / Avg: 114.16 / Max: 115.36Min: 124.83 / Avg: 125.24 / Max: 125.831. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.17Model: bertsquad-12 - Device: CPU - Executor: ParallelXeon Platinum 8592+Xeon Max 9468Xeon Platinum 8490HXeon Max 9480Xeon Platinum 8592+ 2PXeon Platinum 8490H 2PXeon Max 9468 2PXeon Max 9480 2PEPYC 9684XEPYC 9654EPYC 8534PEPYC 9754EPYC 8534PNEPYC 9654 2PEPYC 9684X 2PEPYC 9754 2P510152025SE +/- 0.21736, N = 3SE +/- 0.06023, N = 3SE +/- 0.04566, N = 3SE +/- 0.07567, N = 3SE +/- 0.02832, N = 3SE +/- 0.02421, N = 3SE +/- 0.09371, N = 3SE +/- 0.04124, N = 3SE +/- 0.08493, N = 3SE +/- 0.09004, N = 3SE +/- 0.10485, N = 3SE +/- 0.05587, N = 3SE +/- 0.10146, N = 4SE +/- 0.05052, N = 3SE +/- 0.04604, N = 3SE +/- 0.01907, N = 319.6773016.3251016.0956015.7394015.4341014.5280013.7366013.5190012.2807012.254909.800909.652968.871448.809308.759717.984021. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt
OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.17Model: bertsquad-12 - Device: CPU - Executor: ParallelXeon Platinum 8592+Xeon Max 9468Xeon Platinum 8490HXeon Max 9480Xeon Platinum 8592+ 2PXeon Platinum 8490H 2PXeon Max 9468 2PXeon Max 9480 2PEPYC 9684XEPYC 9654EPYC 8534PEPYC 9754EPYC 8534PNEPYC 9654 2PEPYC 9684X 2PEPYC 9754 2P510152025Min: 19.24 / Avg: 19.68 / Max: 19.9Min: 16.23 / Avg: 16.33 / Max: 16.44Min: 16 / Avg: 16.1 / Max: 16.15Min: 15.61 / Avg: 15.74 / Max: 15.87Min: 15.38 / Avg: 15.43 / Max: 15.47Min: 14.5 / Avg: 14.53 / Max: 14.58Min: 13.55 / Avg: 13.74 / Max: 13.85Min: 13.45 / Avg: 13.52 / Max: 13.59Min: 12.11 / Avg: 12.28 / Max: 12.37Min: 12.07 / Avg: 12.25 / Max: 12.35Min: 9.65 / Avg: 9.8 / Max: 10Min: 9.55 / Avg: 9.65 / Max: 9.74Min: 8.64 / Avg: 8.87 / Max: 9.1Min: 8.71 / Avg: 8.81 / Max: 8.88Min: 8.67 / Avg: 8.76 / Max: 8.81Min: 7.95 / Avg: 7.98 / Max: 8.011. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

OpenVINO

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Person Vehicle Bike Detection FP16 - Device: CPUEPYC 9684X 2PEPYC 9654 2PEPYC 9754 2PEPYC 9684XEPYC 9654Xeon Platinum 8592+EPYC 8534PEPYC 9754Xeon Platinum 8592+ 2PXeon Max 9468EPYC 8534PNXeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PXeon Platinum 8490H 2PXeon Platinum 8490H48121620SE +/- 0.01, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.03, N = 3SE +/- 0.05, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.11, N = 3SE +/- 0.00, N = 3SE +/- 0.02, N = 3SE +/- 0.02, N = 3SE +/- 0.00, N = 3SE +/- 0.03, N = 3SE +/- 0.01, N = 3SE +/- 0.02, N = 3SE +/- 0.02, N = 34.915.206.278.489.4711.1711.2211.3511.6912.5412.6713.3413.5914.4215.0416.50MIN: 4.44 / MAX: 21.92MIN: 4.52 / MAX: 23.03MIN: 5.66 / MAX: 25.66MIN: 5 / MAX: 22.91MIN: 5.96 / MAX: 23.01MIN: 10.18 / MAX: 19.36MIN: 6.69 / MAX: 20.05MIN: 6.34 / MAX: 32.69MIN: 10.28 / MAX: 42.12MIN: 9.17 / MAX: 21.01MIN: 7.38 / MAX: 24.53MIN: 9.67 / MAX: 39.84MIN: 9.53 / MAX: 21.61MIN: 9.74 / MAX: 43.95MIN: 12.32 / MAX: 32.87MIN: 11.95 / MAX: 28.871. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Person Vehicle Bike Detection FP16 - Device: CPUEPYC 9684X 2PEPYC 9654 2PEPYC 9754 2PEPYC 9684XEPYC 9654Xeon Platinum 8592+EPYC 8534PEPYC 9754Xeon Platinum 8592+ 2PXeon Max 9468EPYC 8534PNXeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PXeon Platinum 8490H 2PXeon Platinum 8490H48121620Min: 4.9 / Avg: 4.91 / Max: 4.92Min: 5.2 / Avg: 5.2 / Max: 5.21Min: 6.27 / Avg: 6.27 / Max: 6.28Min: 8.43 / Avg: 8.48 / Max: 8.53Min: 9.41 / Avg: 9.47 / Max: 9.57Min: 11.15 / Avg: 11.17 / Max: 11.18Min: 11.2 / Avg: 11.22 / Max: 11.24Min: 11.19 / Avg: 11.35 / Max: 11.56Min: 11.69 / Avg: 11.69 / Max: 11.69Min: 12.51 / Avg: 12.54 / Max: 12.59Min: 12.65 / Avg: 12.67 / Max: 12.71Min: 13.34 / Avg: 13.34 / Max: 13.35Min: 13.55 / Avg: 13.59 / Max: 13.65Min: 14.41 / Avg: 14.42 / Max: 14.43Min: 15.02 / Avg: 15.04 / Max: 15.08Min: 16.47 / Avg: 16.5 / Max: 16.531. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Person Vehicle Bike Detection FP16 - Device: CPUXeon Platinum 8592+ 2PEPYC 9754 2PEPYC 9684X 2PEPYC 9654 2PXeon Platinum 8490H 2PXeon Max 9480 2PXeon Max 9468 2PXeon Platinum 8592+EPYC 9684XEPYC 9754EPYC 9654Xeon Max 9480Xeon Max 9468Xeon Platinum 8490HEPYC 8534PEPYC 8534PN2K4K6K8K10KSE +/- 3.37, N = 3SE +/- 4.91, N = 3SE +/- 10.88, N = 3SE +/- 6.56, N = 3SE +/- 8.98, N = 3SE +/- 3.66, N = 3SE +/- 4.05, N = 3SE +/- 4.97, N = 3SE +/- 18.02, N = 3SE +/- 54.09, N = 3SE +/- 25.68, N = 3SE +/- 9.37, N = 3SE +/- 7.17, N = 3SE +/- 4.52, N = 3SE +/- 2.97, N = 3SE +/- 3.87, N = 310934.1710182.169752.899203.197862.587689.327127.285725.035608.075594.815024.324093.733802.613606.122830.122506.101. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Person Vehicle Bike Detection FP16 - Device: CPUXeon Platinum 8592+ 2PEPYC 9754 2PEPYC 9684X 2PEPYC 9654 2PXeon Platinum 8490H 2PXeon Max 9480 2PXeon Max 9468 2PXeon Platinum 8592+EPYC 9684XEPYC 9754EPYC 9654Xeon Max 9480Xeon Max 9468Xeon Platinum 8490HEPYC 8534PEPYC 8534PN2K4K6K8K10KMin: 10930.3 / Avg: 10934.17 / Max: 10940.89Min: 10172.35 / Avg: 10182.16 / Max: 10187.34Min: 9736.52 / Avg: 9752.89 / Max: 9773.48Min: 9191.98 / Avg: 9203.19 / Max: 9214.69Min: 7844.62 / Avg: 7862.58 / Max: 7871.66Min: 7685.53 / Avg: 7689.32 / Max: 7696.65Min: 7120.17 / Avg: 7127.28 / Max: 7134.19Min: 5716.19 / Avg: 5725.03 / Max: 5733.37Min: 5573.91 / Avg: 5608.07 / Max: 5635.08Min: 5491.91 / Avg: 5594.81 / Max: 5675.15Min: 4973.45 / Avg: 5024.32 / Max: 5055.88Min: 4075.39 / Avg: 4093.73 / Max: 4106.2Min: 3788.72 / Avg: 3802.61 / Max: 3812.62Min: 3598.48 / Avg: 3606.12 / Max: 3614.13Min: 2826.08 / Avg: 2830.12 / Max: 2835.91Min: 2498.4 / Avg: 2506.1 / Max: 2510.571. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Person Re-Identification Retail FP16 - Device: CPUEPYC 9684X 2PEPYC 9654 2PEPYC 9754 2PXeon Platinum 8592+EPYC 9684XXeon Platinum 8592+ 2PXeon Max 9468EPYC 9654Xeon Max 9468 2PXeon Platinum 8490H 2PXeon Max 9480Xeon Max 9480 2PEPYC 9754EPYC 8534PEPYC 8534PNXeon Platinum 8490H3691215SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 33.783.984.376.726.936.957.137.237.327.727.767.978.038.599.469.79MIN: 3.43 / MAX: 19.66MIN: 3.41 / MAX: 18.88MIN: 4.13 / MAX: 27.79MIN: 6.22 / MAX: 11.15MIN: 3.55 / MAX: 50.69MIN: 6.28 / MAX: 20.42MIN: 6.64 / MAX: 12.22MIN: 3.57 / MAX: 20.82MIN: 6.78 / MAX: 18.72MIN: 7.16 / MAX: 18.31MIN: 6.86 / MAX: 12.92MIN: 7.04 / MAX: 21.51MIN: 4.21 / MAX: 29.66MIN: 5.08 / MAX: 17.25MIN: 5.55 / MAX: 22.41MIN: 4.37 / MAX: 18.181. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Person Re-Identification Retail FP16 - Device: CPUEPYC 9684X 2PEPYC 9654 2PEPYC 9754 2PXeon Platinum 8592+EPYC 9684XXeon Platinum 8592+ 2PXeon Max 9468EPYC 9654Xeon Max 9468 2PXeon Platinum 8490H 2PXeon Max 9480Xeon Max 9480 2PEPYC 9754EPYC 8534PEPYC 8534PNXeon Platinum 8490H3691215Min: 3.78 / Avg: 3.78 / Max: 3.78Min: 3.98 / Avg: 3.98 / Max: 3.98Min: 4.37 / Avg: 4.37 / Max: 4.38Min: 6.71 / Avg: 6.72 / Max: 6.72Min: 6.92 / Avg: 6.93 / Max: 6.93Min: 6.95 / Avg: 6.95 / Max: 6.96Min: 7.13 / Avg: 7.13 / Max: 7.14Min: 7.23 / Avg: 7.23 / Max: 7.24Min: 7.31 / Avg: 7.32 / Max: 7.32Min: 7.71 / Avg: 7.72 / Max: 7.72Min: 7.76 / Avg: 7.76 / Max: 7.76Min: 7.96 / Avg: 7.97 / Max: 7.97Min: 8.02 / Avg: 8.03 / Max: 8.03Min: 8.58 / Avg: 8.59 / Max: 8.61Min: 9.45 / Avg: 9.46 / Max: 9.47Min: 9.78 / Avg: 9.79 / Max: 9.81. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Person Re-Identification Retail FP16 - Device: CPUXeon Platinum 8592+ 2PXeon Platinum 8490H 2PEPYC 9754 2PXeon Max 9480 2PXeon Max 9468 2PEPYC 9684X 2PEPYC 9654 2PXeon Platinum 8592+EPYC 9754Xeon Max 9480EPYC 9684XXeon Max 9468EPYC 9654Xeon Platinum 8490HEPYC 8534PEPYC 8534PN4K8K12K16K20KSE +/- 7.74, N = 3SE +/- 4.14, N = 3SE +/- 10.13, N = 3SE +/- 7.22, N = 3SE +/- 3.67, N = 3SE +/- 7.99, N = 3SE +/- 7.03, N = 3SE +/- 5.57, N = 3SE +/- 4.98, N = 3SE +/- 0.46, N = 3SE +/- 4.58, N = 3SE +/- 3.72, N = 3SE +/- 4.14, N = 3SE +/- 3.97, N = 3SE +/- 3.18, N = 3SE +/- 1.89, N = 318375.6315519.9214601.5214033.9413102.2812665.6212024.189515.867862.657207.746846.796717.656554.125943.663692.673355.731. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Person Re-Identification Retail FP16 - Device: CPUXeon Platinum 8592+ 2PXeon Platinum 8490H 2PEPYC 9754 2PXeon Max 9480 2PXeon Max 9468 2PEPYC 9684X 2PEPYC 9654 2PXeon Platinum 8592+EPYC 9754Xeon Max 9480EPYC 9684XXeon Max 9468EPYC 9654Xeon Platinum 8490HEPYC 8534PEPYC 8534PN3K6K9K12K15KMin: 18360.15 / Avg: 18375.63 / Max: 18383.72Min: 15515.26 / Avg: 15519.92 / Max: 15528.17Min: 14581.32 / Avg: 14601.52 / Max: 14612.9Min: 14023.17 / Avg: 14033.94 / Max: 14047.65Min: 13098.5 / Avg: 13102.28 / Max: 13109.61Min: 12654.72 / Avg: 12665.62 / Max: 12681.18Min: 12014.87 / Avg: 12024.18 / Max: 12037.97Min: 9508.89 / Avg: 9515.86 / Max: 9526.87Min: 7854.66 / Avg: 7862.65 / Max: 7871.8Min: 7207.09 / Avg: 7207.74 / Max: 7208.64Min: 6840.17 / Avg: 6846.79 / Max: 6855.59Min: 6710.36 / Avg: 6717.65 / Max: 6722.63Min: 6546.28 / Avg: 6554.12 / Max: 6560.34Min: 5937.09 / Avg: 5943.66 / Max: 5950.81Min: 3686.72 / Avg: 3692.67 / Max: 3697.61Min: 3352.34 / Avg: 3355.73 / Max: 3358.871. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Weld Porosity Detection FP16-INT8 - Device: CPUXeon Platinum 8592+Xeon Platinum 8592+ 2PXeon Max 9468Xeon Platinum 8490H 2PXeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PXeon Platinum 8490HEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN3691215SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.03, N = 4SE +/- 0.00, N = 3SE +/- 0.01, N = 3SE +/- 0.00, N = 3SE +/- 0.01, N = 3SE +/- 0.00, N = 3SE +/- 0.04, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.08, N = 3SE +/- 0.01, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 32.362.482.502.502.532.672.793.589.259.4210.0910.1710.9211.2011.7813.11MIN: 2.02 / MAX: 21.33MIN: 1.98 / MAX: 34.01MIN: 2.22 / MAX: 27.89MIN: 2.28 / MAX: 40.8MIN: 2.23 / MAX: 31.44MIN: 2.39 / MAX: 34.22MIN: 2.44 / MAX: 34.21MIN: 1.4 / MAX: 12.71MIN: 8.35 / MAX: 44.99MIN: 4.22 / MAX: 26.07MIN: 4.29 / MAX: 26.52MIN: 8.74 / MAX: 41.95MIN: 4.98 / MAX: 37.58MIN: 9.95 / MAX: 64.26MIN: 6.2 / MAX: 24.38MIN: 6.01 / MAX: 25.621. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Weld Porosity Detection FP16-INT8 - Device: CPUXeon Platinum 8592+Xeon Platinum 8592+ 2PXeon Max 9468Xeon Platinum 8490H 2PXeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PXeon Platinum 8490HEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN48121620Min: 2.35 / Avg: 2.36 / Max: 2.36Min: 2.47 / Avg: 2.48 / Max: 2.48Min: 2.46 / Avg: 2.5 / Max: 2.59Min: 2.5 / Avg: 2.5 / Max: 2.51Min: 2.52 / Avg: 2.53 / Max: 2.54Min: 2.66 / Avg: 2.67 / Max: 2.67Min: 2.76 / Avg: 2.79 / Max: 2.81Min: 3.58 / Avg: 3.58 / Max: 3.59Min: 9.21 / Avg: 9.25 / Max: 9.34Min: 9.39 / Avg: 9.42 / Max: 9.43Min: 10.08 / Avg: 10.09 / Max: 10.1Min: 10.01 / Avg: 10.17 / Max: 10.28Min: 10.91 / Avg: 10.92 / Max: 10.93Min: 11.2 / Avg: 11.2 / Max: 11.21Min: 11.78 / Avg: 11.78 / Max: 11.78Min: 13.1 / Avg: 13.11 / Max: 13.111. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Weld Porosity Detection FP16-INT8 - Device: CPUXeon Platinum 8592+ 2PXeon Platinum 8490H 2PXeon Max 9480 2PXeon Max 9468 2PXeon Platinum 8592+EPYC 9754 2PXeon Max 9480EPYC 9684X 2PXeon Max 9468EPYC 9654 2PXeon Platinum 8490HEPYC 9754EPYC 9684XEPYC 9654EPYC 8534PEPYC 8534PN10K20K30K40K50KSE +/- 39.08, N = 3SE +/- 53.98, N = 3SE +/- 233.95, N = 3SE +/- 80.58, N = 3SE +/- 47.41, N = 3SE +/- 11.27, N = 3SE +/- 21.27, N = 3SE +/- 110.20, N = 3SE +/- 234.43, N = 4SE +/- 147.69, N = 3SE +/- 2.71, N = 3SE +/- 5.50, N = 3SE +/- 11.71, N = 3SE +/- 4.46, N = 3SE +/- 0.41, N = 3SE +/- 1.69, N = 348122.1647654.9540032.8137710.6026943.4222499.0320910.5320550.9319183.8318666.1615943.1711508.199997.899356.715366.794830.011. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Weld Porosity Detection FP16-INT8 - Device: CPUXeon Platinum 8592+ 2PXeon Platinum 8490H 2PXeon Max 9480 2PXeon Max 9468 2PXeon Platinum 8592+EPYC 9754 2PXeon Max 9480EPYC 9684X 2PXeon Max 9468EPYC 9654 2PXeon Platinum 8490HEPYC 9754EPYC 9684XEPYC 9654EPYC 8534PEPYC 8534PN8K16K24K32K40KMin: 48082.4 / Avg: 48122.16 / Max: 48200.32Min: 47565.14 / Avg: 47654.95 / Max: 47751.73Min: 39641.67 / Avg: 40032.81 / Max: 40450.75Min: 37586.55 / Avg: 37710.6 / Max: 37861.73Min: 26880.83 / Avg: 26943.42 / Max: 27036.41Min: 22476.61 / Avg: 22499.03 / Max: 22512.27Min: 20878.26 / Avg: 20910.53 / Max: 20950.67Min: 20331.11 / Avg: 20550.93 / Max: 20674.54Min: 18494.39 / Avg: 19183.83 / Max: 19482.1Min: 18465.31 / Avg: 18666.16 / Max: 18954.16Min: 15937.95 / Avg: 15943.17 / Max: 15947.04Min: 11500.94 / Avg: 11508.19 / Max: 11518.98Min: 9984.57 / Avg: 9997.89 / Max: 10021.24Min: 9348.41 / Avg: 9356.71 / Max: 9363.69Min: 5366.18 / Avg: 5366.79 / Max: 5367.56Min: 4827.98 / Avg: 4830.01 / Max: 4833.371. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

ONNX Runtime

ONNX Runtime is developed by Microsoft and partners as a open-source, cross-platform, high performance machine learning inferencing and training accelerator. This test profile runs the ONNX Runtime with various models available from the ONNX Model Zoo. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgInference Time Cost (ms), Fewer Is BetterONNX Runtime 1.17Model: GPT-2 - Device: CPU - Executor: ParallelXeon Platinum 8592+Xeon Platinum 8592+ 2PXeon Platinum 8490HXeon Max 9468Xeon Max 9480EPYC 9684XEPYC 9654Xeon Platinum 8490H 2PEPYC 9754Xeon Max 9480 2PXeon Max 9468 2PEPYC 8534PNEPYC 8534PEPYC 9684X 2PEPYC 9654 2PEPYC 9754 2P3691215SE +/- 0.00434, N = 3SE +/- 0.02114, N = 3SE +/- 0.01428, N = 3SE +/- 0.02823, N = 3SE +/- 0.07483, N = 3SE +/- 0.02436, N = 3SE +/- 0.00351, N = 3SE +/- 0.03717, N = 3SE +/- 0.00921, N = 3SE +/- 0.01417, N = 3SE +/- 0.08283, N = 3SE +/- 0.02580, N = 3SE +/- 0.03809, N = 3SE +/- 0.03939, N = 3SE +/- 0.02885, N = 3SE +/- 0.01997, N = 34.016875.109485.215205.227815.290276.184786.377806.906197.280877.308227.348487.705117.745219.066079.1245210.066601. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt
OpenBenchmarking.orgInference Time Cost (ms), Fewer Is BetterONNX Runtime 1.17Model: GPT-2 - Device: CPU - Executor: ParallelXeon Platinum 8592+Xeon Platinum 8592+ 2PXeon Platinum 8490HXeon Max 9468Xeon Max 9480EPYC 9684XEPYC 9654Xeon Platinum 8490H 2PEPYC 9754Xeon Max 9480 2PXeon Max 9468 2PEPYC 8534PNEPYC 8534PEPYC 9684X 2PEPYC 9654 2PEPYC 9754 2P3691215Min: 4.01 / Avg: 4.02 / Max: 4.02Min: 5.08 / Avg: 5.11 / Max: 5.15Min: 5.19 / Avg: 5.22 / Max: 5.24Min: 5.17 / Avg: 5.23 / Max: 5.26Min: 5.21 / Avg: 5.29 / Max: 5.44Min: 6.14 / Avg: 6.18 / Max: 6.21Min: 6.37 / Avg: 6.38 / Max: 6.38Min: 6.83 / Avg: 6.91 / Max: 6.95Min: 7.27 / Avg: 7.28 / Max: 7.3Min: 7.29 / Avg: 7.31 / Max: 7.34Min: 7.21 / Avg: 7.35 / Max: 7.49Min: 7.68 / Avg: 7.71 / Max: 7.76Min: 7.67 / Avg: 7.75 / Max: 7.78Min: 8.99 / Avg: 9.07 / Max: 9.12Min: 9.07 / Avg: 9.12 / Max: 9.16Min: 10.04 / Avg: 10.07 / Max: 10.111. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.17Model: GPT-2 - Device: CPU - Executor: ParallelXeon Platinum 8592+Xeon Platinum 8592+ 2PXeon Platinum 8490HXeon Max 9468Xeon Max 9480EPYC 9684XEPYC 9654Xeon Platinum 8490H 2PEPYC 9754Xeon Max 9480 2PXeon Max 9468 2PEPYC 8534PNEPYC 8534PEPYC 9684X 2PEPYC 9654 2PEPYC 9754 2P50100150200250SE +/- 0.27, N = 3SE +/- 0.81, N = 3SE +/- 0.53, N = 3SE +/- 1.04, N = 3SE +/- 2.63, N = 3SE +/- 0.64, N = 3SE +/- 0.08, N = 3SE +/- 0.78, N = 3SE +/- 0.17, N = 3SE +/- 0.26, N = 3SE +/- 1.53, N = 3SE +/- 0.43, N = 3SE +/- 0.64, N = 3SE +/- 0.48, N = 3SE +/- 0.35, N = 3SE +/- 0.19, N = 3248.68195.45191.56191.11188.93161.50156.61144.64137.19136.69135.98129.65128.98110.17109.4699.221. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt
OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.17Model: GPT-2 - Device: CPU - Executor: ParallelXeon Platinum 8592+Xeon Platinum 8592+ 2PXeon Platinum 8490HXeon Max 9468Xeon Max 9480EPYC 9684XEPYC 9654Xeon Platinum 8490H 2PEPYC 9754Xeon Max 9480 2PXeon Max 9468 2PEPYC 8534PNEPYC 8534PEPYC 9684X 2PEPYC 9654 2PEPYC 9754 2P50100150200250Min: 248.38 / Avg: 248.68 / Max: 249.23Min: 193.96 / Avg: 195.45 / Max: 196.73Min: 190.81 / Avg: 191.56 / Max: 192.57Min: 189.86 / Avg: 191.11 / Max: 193.18Min: 183.67 / Avg: 188.93 / Max: 191.81Min: 160.8 / Avg: 161.5 / Max: 162.77Min: 156.5 / Avg: 156.61 / Max: 156.78Min: 143.64 / Avg: 144.64 / Max: 146.17Min: 136.86 / Avg: 137.19 / Max: 137.45Min: 136.16 / Avg: 136.69 / Max: 136.97Min: 133.3 / Avg: 135.98 / Max: 138.6Min: 128.78 / Avg: 129.65 / Max: 130.13Min: 128.34 / Avg: 128.98 / Max: 130.26Min: 109.53 / Avg: 110.17 / Max: 111.11Min: 109.07 / Avg: 109.46 / Max: 110.16Min: 98.83 / Avg: 99.22 / Max: 99.461. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

OpenVINO

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Face Detection Retail FP16-INT8 - Device: CPUXeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Max 9468EPYC 9684X 2PEPYC 9684XXeon Max 9468 2PXeon Platinum 8490H 2PXeon Max 9480EPYC 9654EPYC 9654 2PXeon Max 9480 2PEPYC 9754Xeon Platinum 8490HEPYC 9754 2PEPYC 8534PEPYC 8534PN246810SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.01, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.01, N = 3SE +/- 0.00, N = 3SE +/- 0.01, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.01, N = 35.185.195.275.345.415.555.725.775.855.986.026.256.436.606.777.60MIN: 4.74 / MAX: 26.35MIN: 4.72 / MAX: 11.02MIN: 4.98 / MAX: 13.16MIN: 4.88 / MAX: 26.62MIN: 2.65 / MAX: 24.3MIN: 5.12 / MAX: 24.99MIN: 5.1 / MAX: 17.93MIN: 5.26 / MAX: 13.86MIN: 2.67 / MAX: 22.66MIN: 4.9 / MAX: 26.69MIN: 5.37 / MAX: 27.77MIN: 3.07 / MAX: 31.02MIN: 3.84 / MAX: 15.83MIN: 5.84 / MAX: 35.85MIN: 3.54 / MAX: 18.38MIN: 3.84 / MAX: 21.811. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Face Detection Retail FP16-INT8 - Device: CPUXeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Max 9468EPYC 9684X 2PEPYC 9684XXeon Max 9468 2PXeon Platinum 8490H 2PXeon Max 9480EPYC 9654EPYC 9654 2PXeon Max 9480 2PEPYC 9754Xeon Platinum 8490HEPYC 9754 2PEPYC 8534PEPYC 8534PN3691215Min: 5.17 / Avg: 5.18 / Max: 5.18Min: 5.18 / Avg: 5.19 / Max: 5.19Min: 5.26 / Avg: 5.27 / Max: 5.29Min: 5.33 / Avg: 5.34 / Max: 5.34Min: 5.41 / Avg: 5.41 / Max: 5.41Min: 5.55 / Avg: 5.55 / Max: 5.56Min: 5.72 / Avg: 5.72 / Max: 5.73Min: 5.76 / Avg: 5.77 / Max: 5.78Min: 5.84 / Avg: 5.85 / Max: 5.85Min: 5.96 / Avg: 5.98 / Max: 5.99Min: 6.02 / Avg: 6.02 / Max: 6.02Min: 6.25 / Avg: 6.25 / Max: 6.25Min: 6.43 / Avg: 6.43 / Max: 6.44Min: 6.6 / Avg: 6.6 / Max: 6.6Min: 6.77 / Avg: 6.77 / Max: 6.78Min: 7.59 / Avg: 7.6 / Max: 7.611. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Face Detection Retail FP16-INT8 - Device: CPUEPYC 9754 2PEPYC 9684X 2PEPYC 9654 2PXeon Platinum 8592+ 2PXeon Platinum 8490H 2PEPYC 9754Xeon Max 9480 2PXeon Max 9468 2PEPYC 9684XEPYC 9654Xeon Platinum 8592+Xeon Max 9480EPYC 8534PXeon Max 9468Xeon Platinum 8490HEPYC 8534PN8K16K24K32K40KSE +/- 10.72, N = 3SE +/- 15.46, N = 3SE +/- 46.87, N = 3SE +/- 17.69, N = 3SE +/- 12.64, N = 3SE +/- 8.57, N = 3SE +/- 3.89, N = 3SE +/- 12.64, N = 3SE +/- 7.70, N = 3SE +/- 2.59, N = 3SE +/- 4.30, N = 3SE +/- 7.39, N = 3SE +/- 2.45, N = 3SE +/- 18.13, N = 3SE +/- 5.45, N = 3SE +/- 7.49, N = 338546.6635809.5931974.8824676.8620937.5819917.5418561.9117252.2717230.3516038.9012317.949686.399256.119087.129004.238279.631. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Face Detection Retail FP16-INT8 - Device: CPUEPYC 9754 2PEPYC 9684X 2PEPYC 9654 2PXeon Platinum 8592+ 2PXeon Platinum 8490H 2PEPYC 9754Xeon Max 9480 2PXeon Max 9468 2PEPYC 9684XEPYC 9654Xeon Platinum 8592+Xeon Max 9480EPYC 8534PXeon Max 9468Xeon Platinum 8490HEPYC 8534PN7K14K21K28K35KMin: 38532.34 / Avg: 38546.66 / Max: 38567.63Min: 35790.86 / Avg: 35809.59 / Max: 35840.26Min: 31901.65 / Avg: 31974.88 / Max: 32062.18Min: 24653.87 / Avg: 24676.86 / Max: 24711.65Min: 20913.51 / Avg: 20937.58 / Max: 20956.31Min: 19906.36 / Avg: 19917.54 / Max: 19934.37Min: 18557.63 / Avg: 18561.91 / Max: 18569.68Min: 17227.05 / Avg: 17252.27 / Max: 17266.33Min: 17221.13 / Avg: 17230.35 / Max: 17245.65Min: 16035.53 / Avg: 16038.9 / Max: 16044Min: 12311.49 / Avg: 12317.94 / Max: 12326.08Min: 9673.85 / Avg: 9686.39 / Max: 9699.43Min: 9252.07 / Avg: 9256.11 / Max: 9260.54Min: 9051.23 / Avg: 9087.12 / Max: 9109.51Min: 8995.55 / Avg: 9004.23 / Max: 9014.29Min: 8271.92 / Avg: 8279.63 / Max: 8294.611. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

ONNX Runtime

ONNX Runtime is developed by Microsoft and partners as a open-source, cross-platform, high performance machine learning inferencing and training accelerator. This test profile runs the ONNX Runtime with various models available from the ONNX Model Zoo. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgInference Time Cost (ms), Fewer Is BetterONNX Runtime 1.17Model: yolov4 - Device: CPU - Executor: ParallelXeon Platinum 8592+Xeon Platinum 8490HXeon Max 9480Xeon Max 9468Xeon Platinum 8592+ 2PXeon Max 9468 2PXeon Platinum 8490H 2PXeon Max 9480 2PEPYC 9684XEPYC 9654EPYC 8534PEPYC 9754EPYC 8534PNEPYC 9654 2PEPYC 9684X 2PEPYC 9754 2P4080120160200SE +/- 0.30, N = 3SE +/- 0.05, N = 3SE +/- 0.01, N = 3SE +/- 0.22, N = 3SE +/- 0.57, N = 3SE +/- 0.74, N = 3SE +/- 0.09, N = 3SE +/- 0.13, N = 3SE +/- 0.05, N = 3SE +/- 0.20, N = 3SE +/- 0.01, N = 3SE +/- 0.20, N = 3SE +/- 0.53, N = 3SE +/- 0.61, N = 3SE +/- 0.15, N = 3SE +/- 2.38, N = 347.9055.1261.0161.8370.4476.4278.4079.38102.04102.19114.17115.79118.02157.51158.27179.991. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt
OpenBenchmarking.orgInference Time Cost (ms), Fewer Is BetterONNX Runtime 1.17Model: yolov4 - Device: CPU - Executor: ParallelXeon Platinum 8592+Xeon Platinum 8490HXeon Max 9480Xeon Max 9468Xeon Platinum 8592+ 2PXeon Max 9468 2PXeon Platinum 8490H 2PXeon Max 9480 2PEPYC 9684XEPYC 9654EPYC 8534PEPYC 9754EPYC 8534PNEPYC 9654 2PEPYC 9684X 2PEPYC 9754 2P306090120150Min: 47.51 / Avg: 47.9 / Max: 48.49Min: 55.06 / Avg: 55.12 / Max: 55.22Min: 60.99 / Avg: 61.01 / Max: 61.03Min: 61.53 / Avg: 61.83 / Max: 62.26Min: 69.71 / Avg: 70.44 / Max: 71.56Min: 74.95 / Avg: 76.42 / Max: 77.24Min: 78.27 / Avg: 78.4 / Max: 78.57Min: 79.2 / Avg: 79.38 / Max: 79.62Min: 101.94 / Avg: 102.03 / Max: 102.12Min: 101.79 / Avg: 102.19 / Max: 102.41Min: 114.15 / Avg: 114.17 / Max: 114.2Min: 115.42 / Avg: 115.79 / Max: 116.1Min: 117.28 / Avg: 118.02 / Max: 119.06Min: 156.37 / Avg: 157.51 / Max: 158.46Min: 157.97 / Avg: 158.26 / Max: 158.45Min: 175.68 / Avg: 179.99 / Max: 183.891. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.17Model: yolov4 - Device: CPU - Executor: ParallelXeon Platinum 8592+Xeon Platinum 8490HXeon Max 9480Xeon Max 9468Xeon Platinum 8592+ 2PXeon Max 9468 2PXeon Platinum 8490H 2PXeon Max 9480 2PEPYC 9684XEPYC 9654EPYC 8534PEPYC 9754EPYC 8534PNEPYC 9654 2PEPYC 9684X 2PEPYC 9754 2P510152025SE +/- 0.13074, N = 3SE +/- 0.01672, N = 3SE +/- 0.00279, N = 3SE +/- 0.05802, N = 3SE +/- 0.11392, N = 3SE +/- 0.12795, N = 3SE +/- 0.01439, N = 3SE +/- 0.02010, N = 3SE +/- 0.00491, N = 3SE +/- 0.01934, N = 3SE +/- 0.00112, N = 3SE +/- 0.01474, N = 3SE +/- 0.03807, N = 3SE +/- 0.02467, N = 3SE +/- 0.00606, N = 3SE +/- 0.07368, N = 320.8795018.1413016.3898016.1742014.1980013.0869012.7546012.597409.800089.785168.758148.635948.472836.348916.318285.557671. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt
OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.17Model: yolov4 - Device: CPU - Executor: ParallelXeon Platinum 8592+Xeon Platinum 8490HXeon Max 9480Xeon Max 9468Xeon Platinum 8592+ 2PXeon Max 9468 2PXeon Platinum 8490H 2PXeon Max 9480 2PEPYC 9684XEPYC 9654EPYC 8534PEPYC 9754EPYC 8534PNEPYC 9654 2PEPYC 9684X 2PEPYC 9754 2P510152025Min: 20.62 / Avg: 20.88 / Max: 21.05Min: 18.11 / Avg: 18.14 / Max: 18.16Min: 16.39 / Avg: 16.39 / Max: 16.4Min: 16.06 / Avg: 16.17 / Max: 16.25Min: 13.97 / Avg: 14.2 / Max: 14.35Min: 12.95 / Avg: 13.09 / Max: 13.34Min: 12.73 / Avg: 12.75 / Max: 12.78Min: 12.56 / Avg: 12.6 / Max: 12.63Min: 9.79 / Avg: 9.8 / Max: 9.81Min: 9.76 / Avg: 9.79 / Max: 9.82Min: 8.76 / Avg: 8.76 / Max: 8.76Min: 8.61 / Avg: 8.64 / Max: 8.66Min: 8.4 / Avg: 8.47 / Max: 8.53Min: 6.31 / Avg: 6.35 / Max: 6.39Min: 6.31 / Avg: 6.32 / Max: 6.33Min: 5.44 / Avg: 5.56 / Max: 5.691. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

OpenVINO

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Handwritten English Recognition FP16-INT8 - Device: CPUXeon Platinum 8592+Xeon Platinum 8592+ 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Platinum 8490H 2PXeon Max 9480 2PEPYC 9684XEPYC 9684X 2PEPYC 9654Xeon Platinum 8490HEPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN1020304050SE +/- 0.01, N = 3SE +/- 0.02, N = 3SE +/- 0.04, N = 3SE +/- 0.01, N = 3SE +/- 0.05, N = 3SE +/- 0.00, N = 3SE +/- 0.02, N = 3SE +/- 0.05, N = 3SE +/- 0.07, N = 3SE +/- 0.06, N = 3SE +/- 0.04, N = 3SE +/- 0.07, N = 3SE +/- 0.09, N = 3SE +/- 0.08, N = 3SE +/- 0.09, N = 3SE +/- 0.02, N = 321.8722.9623.1224.0024.9425.1225.7232.0033.1834.9236.2036.9038.8539.8641.3845.71MIN: 20.16 / MAX: 32.36MIN: 20.8 / MAX: 34.86MIN: 18.74 / MAX: 31.08MIN: 19.19 / MAX: 45.88MIN: 19.75 / MAX: 33.18MIN: 19.86 / MAX: 59.96MIN: 20.7 / MAX: 44.98MIN: 21.72 / MAX: 52.65MIN: 29.34 / MAX: 51.4MIN: 22.04 / MAX: 54.74MIN: 20.73 / MAX: 45.28MIN: 29.34 / MAX: 49.06MIN: 23.02 / MAX: 69.97MIN: 35.87 / MAX: 58.79MIN: 25.29 / MAX: 59.37MIN: 31.06 / MAX: 64.631. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Handwritten English Recognition FP16-INT8 - Device: CPUXeon Platinum 8592+Xeon Platinum 8592+ 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Platinum 8490H 2PXeon Max 9480 2PEPYC 9684XEPYC 9684X 2PEPYC 9654Xeon Platinum 8490HEPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN918273645Min: 21.86 / Avg: 21.87 / Max: 21.88Min: 22.93 / Avg: 22.96 / Max: 22.98Min: 23.07 / Avg: 23.12 / Max: 23.2Min: 23.99 / Avg: 24 / Max: 24.01Min: 24.85 / Avg: 24.94 / Max: 25.03Min: 25.11 / Avg: 25.12 / Max: 25.12Min: 25.7 / Avg: 25.72 / Max: 25.75Min: 31.92 / Avg: 32 / Max: 32.09Min: 33.09 / Avg: 33.18 / Max: 33.32Min: 34.84 / Avg: 34.92 / Max: 35.03Min: 36.13 / Avg: 36.2 / Max: 36.25Min: 36.79 / Avg: 36.9 / Max: 37.02Min: 38.71 / Avg: 38.85 / Max: 39.03Min: 39.76 / Avg: 39.86 / Max: 40.03Min: 41.26 / Avg: 41.38 / Max: 41.57Min: 45.68 / Avg: 45.71 / Max: 45.731. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Handwritten English Recognition FP16-INT8 - Device: CPUEPYC 9754 2PEPYC 9684X 2PXeon Platinum 8592+ 2PEPYC 9654 2PXeon Platinum 8490H 2PXeon Max 9480 2PXeon Max 9468 2PEPYC 9754EPYC 9684XXeon Platinum 8592+EPYC 9654Xeon Max 9480Xeon Max 9468Xeon Platinum 8490HEPYC 8534PEPYC 8534PN14002800420056007000SE +/- 14.68, N = 3SE +/- 13.59, N = 3SE +/- 3.43, N = 3SE +/- 9.83, N = 3SE +/- 2.46, N = 3SE +/- 2.81, N = 3SE +/- 1.09, N = 3SE +/- 7.27, N = 3SE +/- 4.06, N = 3SE +/- 0.73, N = 3SE +/- 4.84, N = 3SE +/- 4.55, N = 3SE +/- 3.41, N = 3SE +/- 1.46, N = 3SE +/- 3.51, N = 3SE +/- 0.47, N = 36400.945766.625570.635178.294744.054351.593998.023280.252986.332924.662739.012243.842074.301643.431542.611396.781. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Handwritten English Recognition FP16-INT8 - Device: CPUEPYC 9754 2PEPYC 9684X 2PXeon Platinum 8592+ 2PEPYC 9654 2PXeon Platinum 8490H 2PXeon Max 9480 2PXeon Max 9468 2PEPYC 9754EPYC 9684XXeon Platinum 8592+EPYC 9654Xeon Max 9480Xeon Max 9468Xeon Platinum 8490HEPYC 8534PEPYC 8534PN11002200330044005500Min: 6371.9 / Avg: 6400.94 / Max: 6419.17Min: 5739.95 / Avg: 5766.62 / Max: 5784.5Min: 5565.94 / Avg: 5570.63 / Max: 5577.32Min: 5160.08 / Avg: 5178.29 / Max: 5193.81Min: 4741.37 / Avg: 4744.05 / Max: 4748.96Min: 4346.02 / Avg: 4351.59 / Max: 4355.05Min: 3995.99 / Avg: 3998.02 / Max: 3999.72Min: 3266.6 / Avg: 3280.25 / Max: 3291.4Min: 2978.93 / Avg: 2986.33 / Max: 2992.91Min: 2923.2 / Avg: 2924.66 / Max: 2925.43Min: 2729.69 / Avg: 2739.01 / Max: 2745.92Min: 2236.43 / Avg: 2243.84 / Max: 2252.13Min: 2067.66 / Avg: 2074.3 / Max: 2078.94Min: 1640.97 / Avg: 1643.43 / Max: 1646.02Min: 1535.74 / Avg: 1542.61 / Max: 1547.3Min: 1396.26 / Avg: 1396.78 / Max: 1397.731. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

srsRAN Project

OpenBenchmarking.orgMbps, More Is BettersrsRAN Project 23.10.1-20240325Test: PDSCH Processor Benchmark, Throughput TotalXeon Platinum 8592+ 2PXeon Max 9468 2PXeon Platinum 8490H 2PEPYC 9754 2PEPYC 9684XEPYC 9654Xeon Platinum 8592+EPYC 9684X 2PEPYC 9754Xeon Platinum 8490HEPYC 9654 2PXeon Max 9468EPYC 8534PNEPYC 8534PXeon Max 9480Xeon Max 9480 2P7K14K21K28K35KSE +/- 356.81, N = 15SE +/- 175.78, N = 4SE +/- 312.17, N = 3SE +/- 2115.57, N = 15SE +/- 348.28, N = 4SE +/- 357.13, N = 12SE +/- 298.34, N = 15SE +/- 343.97, N = 3SE +/- 237.63, N = 3SE +/- 236.27, N = 4SE +/- 526.01, N = 15SE +/- 938.95, N = 15SE +/- 58.21, N = 3SE +/- 207.19, N = 5SE +/- 281.72, N = 15SE +/- 490.54, N = 1530547.630236.030108.729877.129384.927695.226378.125977.425194.624688.522931.821286.619485.819375.915081.011866.71. (CXX) g++ options: -O3 -march=native -mavx2 -mavx -msse4.1 -mfma -mavx512f -mavx512cd -mavx512bw -mavx512dq -fno-trapping-math -fno-math-errno -ldl
OpenBenchmarking.orgMbps, More Is BettersrsRAN Project 23.10.1-20240325Test: PDSCH Processor Benchmark, Throughput TotalXeon Platinum 8592+ 2PXeon Max 9468 2PXeon Platinum 8490H 2PEPYC 9754 2PEPYC 9684XEPYC 9654Xeon Platinum 8592+EPYC 9684X 2PEPYC 9754Xeon Platinum 8490HEPYC 9654 2PXeon Max 9468EPYC 8534PNEPYC 8534PXeon Max 9480Xeon Max 9480 2P5K10K15K20K25KMin: 28535.9 / Avg: 30547.59 / Max: 33263.4Min: 29772.1 / Avg: 30235.98 / Max: 30546.3Min: 29484.5 / Avg: 30108.7 / Max: 30432.5Min: 16747.3 / Avg: 29877.06 / Max: 38835.8Min: 28734 / Avg: 29384.85 / Max: 30372.4Min: 25729.4 / Avg: 27695.2 / Max: 29867.9Min: 24120 / Avg: 26378.14 / Max: 28050.8Min: 25432.8 / Avg: 25977.37 / Max: 26613.7Min: 24746 / Avg: 25194.6 / Max: 25554.8Min: 24005.5 / Avg: 24688.5 / Max: 25092.7Min: 19787.8 / Avg: 22931.83 / Max: 26132.1Min: 13002.8 / Avg: 21286.6 / Max: 24103.3Min: 19379.6 / Avg: 19485.83 / Max: 19580.2Min: 18943.9 / Avg: 19375.9 / Max: 20065.1Min: 13387.5 / Avg: 15080.97 / Max: 17986.8Min: 10692.2 / Avg: 11866.71 / Max: 172131. (CXX) g++ options: -O3 -march=native -mavx2 -mavx -msse4.1 -mfma -mavx512f -mavx512cd -mavx512bw -mavx512dq -fno-trapping-math -fno-math-errno -ldl

ONNX Runtime

ONNX Runtime is developed by Microsoft and partners as a open-source, cross-platform, high performance machine learning inferencing and training accelerator. This test profile runs the ONNX Runtime with various models available from the ONNX Model Zoo. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgInference Time Cost (ms), Fewer Is BetterONNX Runtime 1.17Model: ArcFace ResNet-100 - Device: CPU - Executor: ParallelXeon Platinum 8592+Xeon Platinum 8490HXeon Max 9480Xeon Max 9468Xeon Max 9468 2PXeon Platinum 8592+ 2PEPYC 9684XEPYC 9654Xeon Max 9480 2PXeon Platinum 8490H 2PEPYC 8534PEPYC 8534PNEPYC 9754EPYC 9684X 2PEPYC 9654 2PEPYC 9754 2P20406080100SE +/- 0.07, N = 3SE +/- 0.04, N = 3SE +/- 0.12, N = 3SE +/- 0.17, N = 3SE +/- 0.11, N = 3SE +/- 0.28, N = 3SE +/- 0.05, N = 3SE +/- 0.04, N = 3SE +/- 0.13, N = 3SE +/- 0.11, N = 3SE +/- 0.17, N = 3SE +/- 0.35, N = 3SE +/- 0.13, N = 3SE +/- 0.22, N = 3SE +/- 0.25, N = 3SE +/- 0.45, N = 316.5521.3423.6624.5530.4731.7933.5034.1634.2534.3136.6138.1040.6366.4466.6383.771. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt
OpenBenchmarking.orgInference Time Cost (ms), Fewer Is BetterONNX Runtime 1.17Model: ArcFace ResNet-100 - Device: CPU - Executor: ParallelXeon Platinum 8592+Xeon Platinum 8490HXeon Max 9480Xeon Max 9468Xeon Max 9468 2PXeon Platinum 8592+ 2PEPYC 9684XEPYC 9654Xeon Max 9480 2PXeon Platinum 8490H 2PEPYC 8534PEPYC 8534PNEPYC 9754EPYC 9684X 2PEPYC 9654 2PEPYC 9754 2P1632486480Min: 16.41 / Avg: 16.55 / Max: 16.64Min: 21.3 / Avg: 21.34 / Max: 21.43Min: 23.46 / Avg: 23.66 / Max: 23.86Min: 24.28 / Avg: 24.55 / Max: 24.86Min: 30.32 / Avg: 30.47 / Max: 30.69Min: 31.51 / Avg: 31.79 / Max: 32.34Min: 33.44 / Avg: 33.5 / Max: 33.59Min: 34.09 / Avg: 34.16 / Max: 34.2Min: 34.08 / Avg: 34.25 / Max: 34.51Min: 34.17 / Avg: 34.31 / Max: 34.52Min: 36.32 / Avg: 36.61 / Max: 36.9Min: 37.64 / Avg: 38.1 / Max: 38.79Min: 40.41 / Avg: 40.63 / Max: 40.85Min: 66.21 / Avg: 66.44 / Max: 66.88Min: 66.22 / Avg: 66.63 / Max: 67.08Min: 82.93 / Avg: 83.77 / Max: 84.51. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.17Model: ArcFace ResNet-100 - Device: CPU - Executor: ParallelXeon Platinum 8592+Xeon Platinum 8490HXeon Max 9480Xeon Max 9468Xeon Max 9468 2PXeon Platinum 8592+ 2PEPYC 9684XEPYC 9654Xeon Max 9480 2PXeon Platinum 8490H 2PEPYC 8534PEPYC 8534PNEPYC 9754EPYC 9684X 2PEPYC 9654 2PEPYC 9754 2P1428425670SE +/- 0.27, N = 3SE +/- 0.10, N = 3SE +/- 0.21, N = 3SE +/- 0.28, N = 3SE +/- 0.12, N = 3SE +/- 0.27, N = 3SE +/- 0.04, N = 3SE +/- 0.03, N = 3SE +/- 0.11, N = 3SE +/- 0.09, N = 3SE +/- 0.12, N = 3SE +/- 0.24, N = 3SE +/- 0.08, N = 3SE +/- 0.05, N = 3SE +/- 0.06, N = 3SE +/- 0.06, N = 360.4146.8542.2740.7332.8131.4629.8529.2729.2029.1527.3126.2524.6115.0515.0111.941. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt
OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.17Model: ArcFace ResNet-100 - Device: CPU - Executor: ParallelXeon Platinum 8592+Xeon Platinum 8490HXeon Max 9480Xeon Max 9468Xeon Max 9468 2PXeon Platinum 8592+ 2PEPYC 9684XEPYC 9654Xeon Max 9480 2PXeon Platinum 8490H 2PEPYC 8534PEPYC 8534PNEPYC 9754EPYC 9684X 2PEPYC 9654 2PEPYC 9754 2P1224364860Min: 60.09 / Avg: 60.41 / Max: 60.95Min: 46.65 / Avg: 46.85 / Max: 46.95Min: 41.9 / Avg: 42.27 / Max: 42.63Min: 40.22 / Avg: 40.73 / Max: 41.18Min: 32.58 / Avg: 32.81 / Max: 32.98Min: 30.92 / Avg: 31.46 / Max: 31.73Min: 29.77 / Avg: 29.85 / Max: 29.9Min: 29.23 / Avg: 29.27 / Max: 29.33Min: 28.97 / Avg: 29.2 / Max: 29.34Min: 28.97 / Avg: 29.15 / Max: 29.27Min: 27.1 / Avg: 27.31 / Max: 27.53Min: 25.78 / Avg: 26.25 / Max: 26.57Min: 24.48 / Avg: 24.61 / Max: 24.74Min: 14.95 / Avg: 15.05 / Max: 15.1Min: 14.91 / Avg: 15.01 / Max: 15.1Min: 11.83 / Avg: 11.94 / Max: 12.061. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

GPAW

GPAW is a density-functional theory (DFT) Python code based on the projector-augmented wave (PAW) method and the atomic simulation environment (ASE). Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterGPAW 23.6Input: Carbon NanotubeEPYC 9684X 2PEPYC 9654 2PEPYC 9754 2PEPYC 9684XEPYC 9754EPYC 9654Xeon Platinum 8592+ 2PXeon Platinum 8490H 2PXeon Max 9468 2PXeon Platinum 8592+Xeon Max 9480 2PXeon Platinum 8490HXeon Max 9480Xeon Max 9468EPYC 8534PEPYC 8534PN1530456075SE +/- 0.30, N = 15SE +/- 0.29, N = 15SE +/- 0.18, N = 3SE +/- 0.11, N = 3SE +/- 0.14, N = 3SE +/- 0.21, N = 3SE +/- 0.10, N = 3SE +/- 0.55, N = 3SE +/- 0.08, N = 3SE +/- 0.12, N = 3SE +/- 0.27, N = 3SE +/- 0.24, N = 3SE +/- 0.08, N = 3SE +/- 0.03, N = 3SE +/- 0.07, N = 3SE +/- 0.01, N = 324.1325.8427.1530.0033.1234.8738.0541.5642.8743.0543.9147.7848.4954.3863.8066.711. (CC) gcc options: -shared -lxc -lblas -lmpi
OpenBenchmarking.orgSeconds, Fewer Is BetterGPAW 23.6Input: Carbon NanotubeEPYC 9684X 2PEPYC 9654 2PEPYC 9754 2PEPYC 9684XEPYC 9754EPYC 9654Xeon Platinum 8592+ 2PXeon Platinum 8490H 2PXeon Max 9468 2PXeon Platinum 8592+Xeon Max 9480 2PXeon Platinum 8490HXeon Max 9480Xeon Max 9468EPYC 8534PEPYC 8534PN1326395265Min: 22.95 / Avg: 24.13 / Max: 26.08Min: 24.9 / Avg: 25.84 / Max: 28.04Min: 26.79 / Avg: 27.15 / Max: 27.33Min: 29.88 / Avg: 30 / Max: 30.22Min: 32.91 / Avg: 33.12 / Max: 33.38Min: 34.54 / Avg: 34.87 / Max: 35.27Min: 37.88 / Avg: 38.05 / Max: 38.21Min: 41.01 / Avg: 41.56 / Max: 42.67Min: 42.73 / Avg: 42.87 / Max: 43.02Min: 42.84 / Avg: 43.05 / Max: 43.24Min: 43.62 / Avg: 43.91 / Max: 44.46Min: 47.32 / Avg: 47.78 / Max: 48.11Min: 48.34 / Avg: 48.49 / Max: 48.59Min: 54.33 / Avg: 54.38 / Max: 54.43Min: 63.66 / Avg: 63.8 / Max: 63.88Min: 66.69 / Avg: 66.71 / Max: 66.731. (CC) gcc options: -shared -lxc -lblas -lmpi

Blender

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 4.1Blend File: Pabellon Barcelona - Compute: CPU-OnlyEPYC 9754 2PEPYC 9684X 2PEPYC 9654 2PEPYC 9754Xeon Platinum 8592+ 2PEPYC 9684XXeon Platinum 8490H 2PEPYC 9654Xeon Max 9480 2PXeon Max 9468 2PXeon Platinum 8592+EPYC 8534PXeon Platinum 8490HEPYC 8534PNXeon Max 9480Xeon Max 946820406080100SE +/- 0.13, N = 3SE +/- 0.11, N = 3SE +/- 0.10, N = 3SE +/- 0.13, N = 3SE +/- 0.06, N = 3SE +/- 0.16, N = 3SE +/- 0.26, N = 3SE +/- 0.04, N = 3SE +/- 0.20, N = 3SE +/- 0.08, N = 3SE +/- 0.09, N = 3SE +/- 0.16, N = 3SE +/- 0.15, N = 3SE +/- 0.05, N = 3SE +/- 0.44, N = 3SE +/- 0.31, N = 321.6623.8426.3539.8341.8544.8746.3848.8851.2955.2680.2985.1287.9294.4197.80106.96
OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 4.1Blend File: Pabellon Barcelona - Compute: CPU-OnlyEPYC 9754 2PEPYC 9684X 2PEPYC 9654 2PEPYC 9754Xeon Platinum 8592+ 2PEPYC 9684XXeon Platinum 8490H 2PEPYC 9654Xeon Max 9480 2PXeon Max 9468 2PXeon Platinum 8592+EPYC 8534PXeon Platinum 8490HEPYC 8534PNXeon Max 9480Xeon Max 946820406080100Min: 21.47 / Avg: 21.66 / Max: 21.92Min: 23.69 / Avg: 23.84 / Max: 24.06Min: 26.2 / Avg: 26.35 / Max: 26.55Min: 39.69 / Avg: 39.83 / Max: 40.08Min: 41.74 / Avg: 41.85 / Max: 41.95Min: 44.56 / Avg: 44.87 / Max: 45.11Min: 45.94 / Avg: 46.38 / Max: 46.84Min: 48.8 / Avg: 48.88 / Max: 48.93Min: 51.08 / Avg: 51.29 / Max: 51.69Min: 55.12 / Avg: 55.26 / Max: 55.41Min: 80.11 / Avg: 80.29 / Max: 80.39Min: 84.95 / Avg: 85.12 / Max: 85.44Min: 87.63 / Avg: 87.92 / Max: 88.15Min: 94.36 / Avg: 94.41 / Max: 94.51Min: 97.15 / Avg: 97.8 / Max: 98.64Min: 106.49 / Avg: 106.96 / Max: 107.55

GraphicsMagick

OpenBenchmarking.orgIterations Per Minute, More Is BetterGraphicsMagick 1.3.43Operation: Noise-GaussianXeon Platinum 8592+ 2PXeon Platinum 8490H 2PEPYC 9684X 2PEPYC 9654 2PXeon Platinum 8592+EPYC 9684XXeon Max 9480 2PEPYC 9754 2PEPYC 9654Xeon Platinum 8490HXeon Max 9480EPYC 9754Xeon Max 9468 2PXeon Max 9468EPYC 8534PEPYC 8534PN4080120160200SE +/- 0.88, N = 3SE +/- 1.15, N = 3SE +/- 0.67, N = 3SE +/- 0.67, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.33, N = 3SE +/- 0.58, N = 3SE +/- 0.58, N = 3SE +/- 0.33, N = 3SE +/- 0.33, N = 3SE +/- 0.58, N = 3SE +/- 0.58, N = 3SE +/- 0.33, N = 3SE +/- 0.33, N = 3SE +/- 0.00, N = 31941821791781711651641641601581581511501501231201. (CC) gcc options: -fopenmp -O2 -ltiff -ljbig -lsharpyuv -lwebp -lwebpmux -lfreetype -ljpeg -lXext -lSM -lICE -lX11 -lxml2 -lzstd -llzma -lbz2 -lz -lm -lpthread -lgomp
OpenBenchmarking.orgIterations Per Minute, More Is BetterGraphicsMagick 1.3.43Operation: Noise-GaussianXeon Platinum 8592+ 2PXeon Platinum 8490H 2PEPYC 9684X 2PEPYC 9654 2PXeon Platinum 8592+EPYC 9684XXeon Max 9480 2PEPYC 9754 2PEPYC 9654Xeon Platinum 8490HXeon Max 9480EPYC 9754Xeon Max 9468 2PXeon Max 9468EPYC 8534PEPYC 8534PN4080120160200Min: 192 / Avg: 193.67 / Max: 195Min: 180 / Avg: 182 / Max: 184Min: 178 / Avg: 178.67 / Max: 180Min: 177 / Avg: 177.67 / Max: 179Min: 171 / Avg: 171 / Max: 171Min: 165 / Avg: 165 / Max: 165Min: 164 / Avg: 164.33 / Max: 165Min: 163 / Avg: 164 / Max: 165Min: 159 / Avg: 160 / Max: 161Min: 158 / Avg: 158.33 / Max: 159Min: 157 / Avg: 157.67 / Max: 158Min: 150 / Avg: 151 / Max: 152Min: 149 / Avg: 150 / Max: 151Min: 149 / Avg: 149.67 / Max: 150Min: 123 / Avg: 123.33 / Max: 124Min: 120 / Avg: 120 / Max: 1201. (CC) gcc options: -fopenmp -O2 -ltiff -ljbig -lsharpyuv -lwebp -lwebpmux -lfreetype -ljpeg -lXext -lSM -lICE -lX11 -lxml2 -lzstd -llzma -lbz2 -lz -lm -lpthread -lgomp

OpenBenchmarking.orgIterations Per Minute, More Is BetterGraphicsMagick 1.3.43Operation: SharpenEPYC 9754 2PEPYC 9684X 2PXeon Platinum 8592+ 2PXeon Platinum 8490H 2PEPYC 9654 2PXeon Max 9480 2PEPYC 9754EPYC 9684XXeon Max 9468 2PEPYC 9654Xeon Platinum 8592+Xeon Platinum 8490HXeon Max 9480Xeon Max 9468EPYC 8534PEPYC 8534PN70140210280350SE +/- 3.00, N = 3SE +/- 0.88, N = 3SE +/- 1.67, N = 3SE +/- 1.67, N = 3SE +/- 1.20, N = 3SE +/- 0.33, N = 3SE +/- 0.33, N = 3SE +/- 0.00, N = 3SE +/- 1.20, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.33, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.33, N = 33102972842652622272072011991731671571301141121051. (CC) gcc options: -fopenmp -O2 -ltiff -ljbig -lsharpyuv -lwebp -lwebpmux -lfreetype -ljpeg -lXext -lSM -lICE -lX11 -lxml2 -lzstd -llzma -lbz2 -lz -lm -lpthread -lgomp
OpenBenchmarking.orgIterations Per Minute, More Is BetterGraphicsMagick 1.3.43Operation: SharpenEPYC 9754 2PEPYC 9684X 2PXeon Platinum 8592+ 2PXeon Platinum 8490H 2PEPYC 9654 2PXeon Max 9480 2PEPYC 9754EPYC 9684XXeon Max 9468 2PEPYC 9654Xeon Platinum 8592+Xeon Platinum 8490HXeon Max 9480Xeon Max 9468EPYC 8534PEPYC 8534PN60120180240300Min: 304 / Avg: 310 / Max: 313Min: 296 / Avg: 297.33 / Max: 299Min: 281 / Avg: 284.33 / Max: 286Min: 262 / Avg: 265.33 / Max: 267Min: 260 / Avg: 262.33 / Max: 264Min: 226 / Avg: 226.67 / Max: 227Min: 207 / Avg: 207.33 / Max: 208Min: 201 / Avg: 201 / Max: 201Min: 197 / Avg: 199.33 / Max: 201Min: 173 / Avg: 173 / Max: 173Min: 167 / Avg: 167 / Max: 167Min: 156 / Avg: 156.67 / Max: 157Min: 130 / Avg: 130 / Max: 130Min: 114 / Avg: 114 / Max: 114Min: 112 / Avg: 112 / Max: 112Min: 105 / Avg: 105.33 / Max: 1061. (CC) gcc options: -fopenmp -O2 -ltiff -ljbig -lsharpyuv -lwebp -lwebpmux -lfreetype -ljpeg -lXext -lSM -lICE -lX11 -lxml2 -lzstd -llzma -lbz2 -lz -lm -lpthread -lgomp

OpenBenchmarking.orgIterations Per Minute, More Is BetterGraphicsMagick 1.3.43Operation: EnhancedEPYC 9684X 2PEPYC 9754 2PXeon Platinum 8592+ 2PEPYC 9654 2PXeon Platinum 8490H 2PEPYC 9754Xeon Max 9480 2PEPYC 9684XXeon Max 9468 2PEPYC 9654Xeon Platinum 8592+Xeon Platinum 8490HXeon Max 9480EPYC 8534PEPYC 8534PNXeon Max 946890180270360450SE +/- 0.33, N = 3SE +/- 0.33, N = 3SE +/- 1.15, N = 3SE +/- 1.20, N = 3SE +/- 0.33, N = 3SE +/- 0.33, N = 3SE +/- 1.00, N = 3SE +/- 0.67, N = 3SE +/- 2.60, N = 3SE +/- 0.33, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 34084033743683423043013002692642282161811721631601. (CC) gcc options: -fopenmp -O2 -ltiff -ljbig -lsharpyuv -lwebp -lwebpmux -lfreetype -ljpeg -lXext -lSM -lICE -lX11 -lxml2 -lzstd -llzma -lbz2 -lz -lm -lpthread -lgomp
OpenBenchmarking.orgIterations Per Minute, More Is BetterGraphicsMagick 1.3.43Operation: EnhancedEPYC 9684X 2PEPYC 9754 2PXeon Platinum 8592+ 2PEPYC 9654 2PXeon Platinum 8490H 2PEPYC 9754Xeon Max 9480 2PEPYC 9684XXeon Max 9468 2PEPYC 9654Xeon Platinum 8592+Xeon Platinum 8490HXeon Max 9480EPYC 8534PEPYC 8534PNXeon Max 946870140210280350Min: 407 / Avg: 407.67 / Max: 408Min: 403 / Avg: 403.33 / Max: 404Min: 372 / Avg: 374 / Max: 376Min: 366 / Avg: 368.33 / Max: 370Min: 342 / Avg: 342.33 / Max: 343Min: 304 / Avg: 304.33 / Max: 305Min: 299 / Avg: 301 / Max: 302Min: 299 / Avg: 299.67 / Max: 301Min: 265 / Avg: 269.33 / Max: 274Min: 264 / Avg: 264.33 / Max: 265Min: 228 / Avg: 228 / Max: 228Min: 216 / Avg: 216 / Max: 216Min: 181 / Avg: 181 / Max: 181Min: 172 / Avg: 172 / Max: 172Min: 163 / Avg: 163 / Max: 163Min: 160 / Avg: 160 / Max: 1601. (CC) gcc options: -fopenmp -O2 -ltiff -ljbig -lsharpyuv -lwebp -lwebpmux -lfreetype -ljpeg -lXext -lSM -lICE -lX11 -lxml2 -lzstd -llzma -lbz2 -lz -lm -lpthread -lgomp

ONNX Runtime

ONNX Runtime is developed by Microsoft and partners as a open-source, cross-platform, high performance machine learning inferencing and training accelerator. This test profile runs the ONNX Runtime with various models available from the ONNX Model Zoo. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgInference Time Cost (ms), Fewer Is BetterONNX Runtime 1.17Model: super-resolution-10 - Device: CPU - Executor: ParallelXeon Platinum 8592+Xeon Platinum 8592+ 2PXeon Platinum 8490HXeon Max 9468Xeon Max 9480Xeon Platinum 8490H 2PXeon Max 9468 2PXeon Max 9480 2PEPYC 9654EPYC 9684XEPYC 8534PEPYC 8534PNEPYC 9754EPYC 9684X 2PEPYC 9654 2PEPYC 9754 2P3691215SE +/- 0.03569, N = 3SE +/- 0.02988, N = 3SE +/- 0.05586, N = 3SE +/- 0.02534, N = 3SE +/- 0.01694, N = 3SE +/- 0.02062, N = 3SE +/- 0.03854, N = 3SE +/- 0.02155, N = 3SE +/- 0.03015, N = 3SE +/- 0.08338, N = 3SE +/- 0.05765, N = 3SE +/- 0.07856, N = 3SE +/- 0.02898, N = 3SE +/- 0.05412, N = 3SE +/- 0.06993, N = 3SE +/- 0.13507, N = 34.263524.654314.866045.109145.260755.292875.749215.886289.089559.1852410.3026010.3977010.5537011.4580011.5024012.809301. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt
OpenBenchmarking.orgInference Time Cost (ms), Fewer Is BetterONNX Runtime 1.17Model: super-resolution-10 - Device: CPU - Executor: ParallelXeon Platinum 8592+Xeon Platinum 8592+ 2PXeon Platinum 8490HXeon Max 9468Xeon Max 9480Xeon Platinum 8490H 2PXeon Max 9468 2PXeon Max 9480 2PEPYC 9654EPYC 9684XEPYC 8534PEPYC 8534PNEPYC 9754EPYC 9684X 2PEPYC 9654 2PEPYC 9754 2P48121620Min: 4.19 / Avg: 4.26 / Max: 4.3Min: 4.6 / Avg: 4.65 / Max: 4.7Min: 4.78 / Avg: 4.87 / Max: 4.97Min: 5.06 / Avg: 5.11 / Max: 5.14Min: 5.24 / Avg: 5.26 / Max: 5.29Min: 5.25 / Avg: 5.29 / Max: 5.32Min: 5.68 / Avg: 5.75 / Max: 5.81Min: 5.85 / Avg: 5.89 / Max: 5.93Min: 9.03 / Avg: 9.09 / Max: 9.14Min: 9.03 / Avg: 9.19 / Max: 9.31Min: 10.2 / Avg: 10.3 / Max: 10.4Min: 10.29 / Avg: 10.4 / Max: 10.55Min: 10.51 / Avg: 10.55 / Max: 10.61Min: 11.37 / Avg: 11.46 / Max: 11.56Min: 11.36 / Avg: 11.5 / Max: 11.58Min: 12.54 / Avg: 12.81 / Max: 12.941. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.17Model: super-resolution-10 - Device: CPU - Executor: ParallelXeon Platinum 8592+Xeon Platinum 8592+ 2PXeon Platinum 8490HXeon Max 9468Xeon Max 9480Xeon Platinum 8490H 2PXeon Max 9468 2PXeon Max 9480 2PEPYC 9654EPYC 9684XEPYC 8534PEPYC 8534PNEPYC 9754EPYC 9684X 2PEPYC 9654 2PEPYC 9754 2P50100150200250SE +/- 1.98, N = 3SE +/- 1.38, N = 3SE +/- 2.34, N = 3SE +/- 0.98, N = 3SE +/- 0.61, N = 3SE +/- 0.74, N = 3SE +/- 1.17, N = 3SE +/- 0.62, N = 3SE +/- 0.36, N = 3SE +/- 0.99, N = 3SE +/- 0.54, N = 3SE +/- 0.72, N = 3SE +/- 0.26, N = 3SE +/- 0.41, N = 3SE +/- 0.53, N = 3SE +/- 0.83, N = 3234.54214.81205.53195.71190.06188.89173.91169.85110.00108.8797.0596.1794.7487.2686.9278.071. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt
OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.17Model: super-resolution-10 - Device: CPU - Executor: ParallelXeon Platinum 8592+Xeon Platinum 8592+ 2PXeon Platinum 8490HXeon Max 9468Xeon Max 9480Xeon Platinum 8490H 2PXeon Max 9468 2PXeon Max 9480 2PEPYC 9654EPYC 9684XEPYC 8534PEPYC 8534PNEPYC 9754EPYC 9684X 2PEPYC 9654 2PEPYC 9754 2P4080120160200Min: 232.42 / Avg: 234.54 / Max: 238.5Min: 212.63 / Avg: 214.81 / Max: 217.37Min: 201.08 / Avg: 205.52 / Max: 209.04Min: 194.68 / Avg: 195.71 / Max: 197.66Min: 188.89 / Avg: 190.06 / Max: 190.94Min: 187.98 / Avg: 188.89 / Max: 190.35Min: 172.15 / Avg: 173.91 / Max: 176.13Min: 168.73 / Avg: 169.85 / Max: 170.87Min: 109.41 / Avg: 110 / Max: 110.67Min: 107.4 / Avg: 108.87 / Max: 110.76Min: 96.11 / Avg: 97.05 / Max: 98Min: 94.76 / Avg: 96.17 / Max: 97.16Min: 94.23 / Avg: 94.74 / Max: 95.09Min: 86.49 / Avg: 87.26 / Max: 87.9Min: 86.32 / Avg: 86.92 / Max: 87.98Min: 77.23 / Avg: 78.07 / Max: 79.731. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

GraphicsMagick

OpenBenchmarking.orgIterations Per Minute, More Is BetterGraphicsMagick 1.3.43Operation: SwirlXeon Platinum 8592+ 2PXeon Platinum 8490H 2PEPYC 9684X 2PEPYC 9754 2PXeon Max 9480 2PEPYC 9654 2PEPYC 9684XEPYC 9754Xeon Platinum 8592+EPYC 9654Xeon Max 9468 2PXeon Platinum 8490HXeon Max 9480Xeon Max 9468EPYC 8534PEPYC 8534PN150300450600750SE +/- 0.58, N = 3SE +/- 1.76, N = 3SE +/- 0.67, N = 3SE +/- 0.33, N = 3SE +/- 0.67, N = 3SE +/- 0.33, N = 3SE +/- 0.00, N = 3SE +/- 0.33, N = 3SE +/- 0.88, N = 3SE +/- 0.33, N = 3SE +/- 1.33, N = 3SE +/- 1.15, N = 3SE +/- 0.67, N = 3SE +/- 0.58, N = 3SE +/- 0.33, N = 3SE +/- 0.88, N = 36896175835675585535465355295115095024323943793631. (CC) gcc options: -fopenmp -O2 -ltiff -ljbig -lsharpyuv -lwebp -lwebpmux -lfreetype -ljpeg -lXext -lSM -lICE -lX11 -lxml2 -lzstd -llzma -lbz2 -lz -lm -lpthread -lgomp
OpenBenchmarking.orgIterations Per Minute, More Is BetterGraphicsMagick 1.3.43Operation: SwirlXeon Platinum 8592+ 2PXeon Platinum 8490H 2PEPYC 9684X 2PEPYC 9754 2PXeon Max 9480 2PEPYC 9654 2PEPYC 9684XEPYC 9754Xeon Platinum 8592+EPYC 9654Xeon Max 9468 2PXeon Platinum 8490HXeon Max 9480Xeon Max 9468EPYC 8534PEPYC 8534PN120240360480600Min: 688 / Avg: 689 / Max: 690Min: 614 / Avg: 616.67 / Max: 620Min: 582 / Avg: 583.33 / Max: 584Min: 566 / Avg: 566.67 / Max: 567Min: 557 / Avg: 557.67 / Max: 559Min: 553 / Avg: 553.33 / Max: 554Min: 546 / Avg: 546 / Max: 546Min: 535 / Avg: 535.33 / Max: 536Min: 528 / Avg: 529.33 / Max: 531Min: 511 / Avg: 511.33 / Max: 512Min: 508 / Avg: 509.33 / Max: 512Min: 500 / Avg: 502 / Max: 504Min: 431 / Avg: 432.33 / Max: 433Min: 393 / Avg: 394 / Max: 395Min: 378 / Avg: 378.67 / Max: 379Min: 361 / Avg: 362.67 / Max: 3641. (CC) gcc options: -fopenmp -O2 -ltiff -ljbig -lsharpyuv -lwebp -lwebpmux -lfreetype -ljpeg -lXext -lSM -lICE -lX11 -lxml2 -lzstd -llzma -lbz2 -lz -lm -lpthread -lgomp

RocksDB

OpenBenchmarking.orgOp/s, More Is BetterRocksDB 9.0Test: Random ReadEPYC 9754 2PEPYC 9684X 2PEPYC 9654 2PXeon Platinum 8592+ 2PEPYC 9754Xeon Platinum 8490H 2PEPYC 9684XXeon Max 9480 2PEPYC 9654Xeon Max 9468 2PXeon Platinum 8592+EPYC 8534PXeon Platinum 8490HEPYC 8534PNXeon Max 9480Xeon Max 9468200M400M600M800M1000MSE +/- 1154820.73, N = 3SE +/- 2927744.32, N = 3SE +/- 599126.55, N = 3SE +/- 82996.27, N = 3SE +/- 153963.59, N = 3SE +/- 1411218.60, N = 3SE +/- 326038.01, N = 3SE +/- 785893.13, N = 3SE +/- 610621.13, N = 3SE +/- 1120857.00, N = 3SE +/- 1119855.47, N = 3SE +/- 206014.27, N = 3SE +/- 3338569.32, N = 3SE +/- 211259.57, N = 3SE +/- 86315.43, N = 3SE +/- 81327.78, N = 3113520656410312091518151451105783928005732354525250499985233100914737559464092729494055331732975179462661865372653661702349926362344699392053461541. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti -lpthread
OpenBenchmarking.orgOp/s, More Is BetterRocksDB 9.0Test: Random ReadEPYC 9754 2PEPYC 9684X 2PEPYC 9654 2PXeon Platinum 8592+ 2PEPYC 9754Xeon Platinum 8490H 2PEPYC 9684XXeon Max 9480 2PEPYC 9654Xeon Max 9468 2PXeon Platinum 8592+EPYC 8534PXeon Platinum 8490HEPYC 8534PNXeon Max 9480Xeon Max 9468200M400M600M800M1000MMin: 1133039360 / Avg: 1135206564.33 / Max: 1136981724Min: 1025561204 / Avg: 1031209151.33 / Max: 1035371250Min: 814516962 / Avg: 815145110.33 / Max: 816342887Min: 578230155 / Avg: 578392800 / Max: 578502847Min: 572938337 / Avg: 573235452 / Max: 573454055Min: 523359264 / Avg: 525049998.33 / Max: 527852577Min: 522961186 / Avg: 523310090.67 / Max: 523961619Min: 472700204 / Avg: 473755946.33 / Max: 475292252Min: 408096411 / Avg: 409272949 / Max: 410144755Min: 403617121 / Avg: 405533172.67 / Max: 407498929Min: 295339623 / Avg: 297517946 / Max: 299058118Min: 265919433 / Avg: 266186536.67 / Max: 266591782Min: 261907154 / Avg: 265366169.67 / Max: 272041842Min: 234581712 / Avg: 234992636.33 / Max: 235283232Min: 234318066 / Avg: 234469938.67 / Max: 234616953Min: 205193864 / Avg: 205346153.67 / Max: 2054717811. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti -lpthread

Aircrack-ng

Aircrack-ng is a tool for assessing WiFi/WLAN network security. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgk/s, More Is BetterAircrack-ng 1.7EPYC 9684XEPYC 9654EPYC 9754EPYC 8534PXeon Platinum 8592+Xeon Platinum 8490HEPYC 8534PNXeon Max 9480Xeon Max 9468Xeon Max 9468 2PXeon Max 9480 2PXeon Platinum 8592+ 2PXeon Platinum 8490H 2P40K80K120K160K200KSE +/- 1622.56, N = 3SE +/- 207.11, N = 3SE +/- 714.86, N = 3SE +/- 338.71, N = 3SE +/- 840.59, N = 3SE +/- 1953.08, N = 3SE +/- 319.60, N = 3SE +/- 122.31, N = 3SE +/- 36.42, N = 3SE +/- 1027.07, N = 15SE +/- 1131.21, N = 15SE +/- 773.70, N = 3SE +/- 1197.41, N = 15206619.29186675.43177989.89153818.03153584.20147469.33141831.78134048.96117588.9983665.7665663.8264181.2953914.931. (CXX) g++ options: -std=gnu++17 -O3 -fvisibility=hidden -fcommon -rdynamic -lnl-3 -lnl-genl-3 -lpcre -lsqlite3 -lpthread -lz -lssl -lcrypto -lhwloc -ldl -lm -pthread
OpenBenchmarking.orgk/s, More Is BetterAircrack-ng 1.7EPYC 9684XEPYC 9654EPYC 9754EPYC 8534PXeon Platinum 8592+Xeon Platinum 8490HEPYC 8534PNXeon Max 9480Xeon Max 9468Xeon Max 9468 2PXeon Max 9480 2PXeon Platinum 8592+ 2PXeon Platinum 8490H 2P40K80K120K160K200KMin: 203517.23 / Avg: 206619.29 / Max: 208995.59Min: 186378.25 / Avg: 186675.43 / Max: 187073.92Min: 176812.45 / Avg: 177989.89 / Max: 179280.97Min: 153422.39 / Avg: 153818.03 / Max: 154492.06Min: 152198.84 / Avg: 153584.2 / Max: 155101.73Min: 143615.3 / Avg: 147469.33 / Max: 149947.17Min: 141305.02 / Avg: 141831.78 / Max: 142408.72Min: 133845.03 / Avg: 134048.96 / Max: 134267.94Min: 117530.57 / Avg: 117588.99 / Max: 117655.87Min: 74275.53 / Avg: 83665.76 / Max: 90875.94Min: 58215.94 / Avg: 65663.82 / Max: 73521.7Min: 63027.57 / Avg: 64181.29 / Max: 65651.2Min: 46494.81 / Avg: 53914.93 / Max: 62158.721. (CXX) g++ options: -std=gnu++17 -O3 -fvisibility=hidden -fcommon -rdynamic -lnl-3 -lnl-genl-3 -lpcre -lsqlite3 -lpthread -lz -lssl -lcrypto -lhwloc -ldl -lm -pthread

EPYC 9654 2P: The test run did not produce a result.

EPYC 9684X 2P: The test run did not produce a result.

EPYC 9754 2P: The test run did not produce a result.

Timed Linux Kernel Compilation

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed Linux Kernel Compilation 6.8Build: defconfigEPYC 9684X 2PXeon Platinum 8592+ 2PEPYC 9654 2PXeon Platinum 8490H 2PXeon Max 9480 2PEPYC 9754 2PXeon Max 9468 2PEPYC 9684XEPYC 9654Xeon Platinum 8592+EPYC 9754Xeon Platinum 8490HXeon Max 9480Xeon Max 9468EPYC 8534PEPYC 8534PN1122334455SE +/- 0.17, N = 13SE +/- 0.23, N = 7SE +/- 0.33, N = 3SE +/- 0.43, N = 3SE +/- 0.31, N = 5SE +/- 0.28, N = 7SE +/- 0.40, N = 4SE +/- 0.46, N = 3SE +/- 0.43, N = 3SE +/- 0.39, N = 4SE +/- 0.44, N = 3SE +/- 0.55, N = 3SE +/- 0.57, N = 3SE +/- 0.59, N = 3SE +/- 0.50, N = 4SE +/- 0.54, N = 425.8725.8727.6829.9830.5330.6832.1432.8934.5734.5938.5339.4540.5043.4244.2846.35
OpenBenchmarking.orgSeconds, Fewer Is BetterTimed Linux Kernel Compilation 6.8Build: defconfigEPYC 9684X 2PXeon Platinum 8592+ 2PEPYC 9654 2PXeon Platinum 8490H 2PXeon Max 9480 2PEPYC 9754 2PXeon Max 9468 2PEPYC 9684XEPYC 9654Xeon Platinum 8592+EPYC 9754Xeon Platinum 8490HXeon Max 9480Xeon Max 9468EPYC 8534PEPYC 8534PN918273645Min: 25.48 / Avg: 25.87 / Max: 27.66Min: 25.39 / Avg: 25.87 / Max: 27.23Min: 27.34 / Avg: 27.68 / Max: 28.34Min: 29.37 / Avg: 29.98 / Max: 30.81Min: 30.11 / Avg: 30.53 / Max: 31.78Min: 30.09 / Avg: 30.68 / Max: 32.31Min: 31.72 / Avg: 32.14 / Max: 33.34Min: 32.38 / Avg: 32.89 / Max: 33.81Min: 34.04 / Avg: 34.57 / Max: 35.41Min: 34.14 / Avg: 34.59 / Max: 35.77Min: 38.05 / Avg: 38.53 / Max: 39.41Min: 38.81 / Avg: 39.45 / Max: 40.55Min: 39.82 / Avg: 40.5 / Max: 41.63Min: 42.78 / Avg: 43.42 / Max: 44.59Min: 43.74 / Avg: 44.28 / Max: 45.76Min: 45.72 / Avg: 46.35 / Max: 47.95

Blender

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 4.1Blend File: Classroom - Compute: CPU-OnlyEPYC 9754 2PEPYC 9684X 2PEPYC 9654 2PEPYC 9754Xeon Platinum 8592+ 2PEPYC 9684XXeon Platinum 8490H 2PEPYC 9654Xeon Max 9480 2PXeon Max 9468 2PXeon Platinum 8592+EPYC 8534PXeon Platinum 8490HEPYC 8534PNXeon Max 9480Xeon Max 946820406080100SE +/- 0.05, N = 3SE +/- 0.03, N = 3SE +/- 0.05, N = 3SE +/- 0.04, N = 3SE +/- 0.22, N = 3SE +/- 0.14, N = 3SE +/- 0.05, N = 3SE +/- 0.11, N = 3SE +/- 0.25, N = 3SE +/- 0.38, N = 3SE +/- 0.11, N = 3SE +/- 0.04, N = 3SE +/- 0.04, N = 3SE +/- 0.18, N = 3SE +/- 0.40, N = 3SE +/- 0.20, N = 316.8218.6721.1231.6533.6135.6635.9140.2640.3844.7163.6167.6768.6175.2676.8786.67
OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 4.1Blend File: Classroom - Compute: CPU-OnlyEPYC 9754 2PEPYC 9684X 2PEPYC 9654 2PEPYC 9754Xeon Platinum 8592+ 2PEPYC 9684XXeon Platinum 8490H 2PEPYC 9654Xeon Max 9480 2PXeon Max 9468 2PXeon Platinum 8592+EPYC 8534PXeon Platinum 8490HEPYC 8534PNXeon Max 9480Xeon Max 94681632486480Min: 16.76 / Avg: 16.82 / Max: 16.91Min: 18.61 / Avg: 18.67 / Max: 18.72Min: 21.05 / Avg: 21.12 / Max: 21.22Min: 31.58 / Avg: 31.65 / Max: 31.71Min: 33.38 / Avg: 33.61 / Max: 34.04Min: 35.49 / Avg: 35.66 / Max: 35.94Min: 35.81 / Avg: 35.91 / Max: 35.98Min: 40.06 / Avg: 40.26 / Max: 40.43Min: 39.89 / Avg: 40.38 / Max: 40.74Min: 44.3 / Avg: 44.71 / Max: 45.47Min: 63.41 / Avg: 63.61 / Max: 63.77Min: 67.6 / Avg: 67.67 / Max: 67.72Min: 68.53 / Avg: 68.61 / Max: 68.66Min: 74.94 / Avg: 75.26 / Max: 75.55Min: 76.14 / Avg: 76.87 / Max: 77.5Min: 86.32 / Avg: 86.67 / Max: 87

miniBUDE

MiniBUDE is a mini application for the the core computation of the Bristol University Docking Engine (BUDE). This test profile currently makes use of the OpenMP implementation of miniBUDE for CPU benchmarking. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgBillion Interactions/s, More Is BetterminiBUDE 20210901Implementation: OpenMP - Input Deck: BM2EPYC 9684X 2PEPYC 9654 2PEPYC 9754 2PEPYC 9754Xeon Platinum 8592+ 2PEPYC 9684XEPYC 9654Xeon Platinum 8490H 2PXeon Max 9480 2PXeon Max 9468 2PXeon Platinum 8592+EPYC 8534PEPYC 8534PNXeon Platinum 8490HXeon Max 9480Xeon Max 946870140210280350SE +/- 2.28, N = 3SE +/- 0.08, N = 3SE +/- 3.85, N = 3SE +/- 0.01, N = 3SE +/- 1.93, N = 15SE +/- 1.71, N = 3SE +/- 0.93, N = 3SE +/- 0.99, N = 3SE +/- 0.93, N = 3SE +/- 1.48, N = 3SE +/- 0.03, N = 3SE +/- 0.01, N = 3SE +/- 0.00, N = 3SE +/- 0.31, N = 3SE +/- 0.96, N = 4SE +/- 0.31, N = 3309.22291.28288.54232.75191.82187.68171.77140.83133.99127.85108.12107.7297.9886.9778.1170.211. (CC) gcc options: -std=c99 -Ofast -ffast-math -fopenmp -march=native -lm
OpenBenchmarking.orgBillion Interactions/s, More Is BetterminiBUDE 20210901Implementation: OpenMP - Input Deck: BM2EPYC 9684X 2PEPYC 9654 2PEPYC 9754 2PEPYC 9754Xeon Platinum 8592+ 2PEPYC 9684XEPYC 9654Xeon Platinum 8490H 2PXeon Max 9480 2PXeon Max 9468 2PXeon Platinum 8592+EPYC 8534PEPYC 8534PNXeon Platinum 8490HXeon Max 9480Xeon Max 946860120180240300Min: 305.66 / Avg: 309.22 / Max: 313.48Min: 291.15 / Avg: 291.28 / Max: 291.43Min: 280.86 / Avg: 288.54 / Max: 292.83Min: 232.73 / Avg: 232.75 / Max: 232.76Min: 180.36 / Avg: 191.82 / Max: 206.68Min: 184.3 / Avg: 187.68 / Max: 189.87Min: 170.75 / Avg: 171.77 / Max: 173.62Min: 139.5 / Avg: 140.83 / Max: 142.75Min: 132.16 / Avg: 133.99 / Max: 135.14Min: 125.14 / Avg: 127.85 / Max: 130.24Min: 108.09 / Avg: 108.12 / Max: 108.18Min: 107.71 / Avg: 107.71 / Max: 107.73Min: 97.97 / Avg: 97.98 / Max: 97.98Min: 86.39 / Avg: 86.97 / Max: 87.46Min: 75.51 / Avg: 78.1 / Max: 79.59Min: 69.59 / Avg: 70.21 / Max: 70.541. (CC) gcc options: -std=c99 -Ofast -ffast-math -fopenmp -march=native -lm

OpenBenchmarking.orgGFInst/s, More Is BetterminiBUDE 20210901Implementation: OpenMP - Input Deck: BM2EPYC 9684X 2PEPYC 9654 2PEPYC 9754 2PEPYC 9754Xeon Platinum 8592+ 2PEPYC 9684XEPYC 9654Xeon Platinum 8490H 2PXeon Max 9480 2PXeon Max 9468 2PXeon Platinum 8592+EPYC 8534PEPYC 8534PNXeon Platinum 8490HXeon Max 9480Xeon Max 946817003400510068008500SE +/- 57.10, N = 3SE +/- 2.03, N = 3SE +/- 96.25, N = 3SE +/- 0.20, N = 3SE +/- 48.20, N = 15SE +/- 42.85, N = 3SE +/- 23.15, N = 3SE +/- 24.63, N = 3SE +/- 23.14, N = 3SE +/- 36.96, N = 3SE +/- 0.70, N = 3SE +/- 0.13, N = 3SE +/- 0.10, N = 3SE +/- 7.77, N = 3SE +/- 23.93, N = 4SE +/- 7.81, N = 37730.477281.967213.435818.744795.464692.114294.283520.713349.763196.122703.092692.872449.452174.191952.611755.331. (CC) gcc options: -std=c99 -Ofast -ffast-math -fopenmp -march=native -lm
OpenBenchmarking.orgGFInst/s, More Is BetterminiBUDE 20210901Implementation: OpenMP - Input Deck: BM2EPYC 9684X 2PEPYC 9654 2PEPYC 9754 2PEPYC 9754Xeon Platinum 8592+ 2PEPYC 9684XEPYC 9654Xeon Platinum 8490H 2PXeon Max 9480 2PXeon Max 9468 2PXeon Platinum 8592+EPYC 8534PEPYC 8534PNXeon Platinum 8490HXeon Max 9480Xeon Max 946813002600390052006500Min: 7641.6 / Avg: 7730.47 / Max: 7837Min: 7278.77 / Avg: 7281.96 / Max: 7285.73Min: 7021.37 / Avg: 7213.43 / Max: 7320.64Min: 5818.36 / Avg: 5818.74 / Max: 5819Min: 4508.91 / Avg: 4795.46 / Max: 5166.93Min: 4607.59 / Avg: 4692.11 / Max: 4746.62Min: 4268.61 / Avg: 4294.28 / Max: 4340.49Min: 3487.53 / Avg: 3520.71 / Max: 3568.84Min: 3304 / Avg: 3349.76 / Max: 3378.59Min: 3128.55 / Avg: 3196.12 / Max: 3255.87Min: 2702.35 / Avg: 2703.09 / Max: 2704.49Min: 2692.71 / Avg: 2692.87 / Max: 2693.13Min: 2449.27 / Avg: 2449.45 / Max: 2449.58Min: 2159.76 / Avg: 2174.19 / Max: 2186.39Min: 1887.63 / Avg: 1952.61 / Max: 1989.74Min: 1739.72 / Avg: 1755.33 / Max: 1763.461. (CC) gcc options: -std=c99 -Ofast -ffast-math -fopenmp -march=native -lm

Liquid-DSP

LiquidSDR's Liquid-DSP is a software-defined radio (SDR) digital signal processing library. This test profile runs a multi-threaded benchmark of this SDR/DSP library focused on embedded platform usage. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgsamples/s, More Is BetterLiquid-DSP 1.6Threads: 1 - Buffer Length: 256 - Filter Length: 512Xeon Platinum 8592+Xeon Platinum 8592+ 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PXeon Platinum 8490HXeon Platinum 8490H 2PEPYC 9654EPYC 9654 2PEPYC 9684XEPYC 9684X 2PEPYC 8534PEPYC 9754 2PEPYC 8534PNEPYC 97544M8M12M16M20MSE +/- 9492.69, N = 3SE +/- 162096.41, N = 15SE +/- 5238.74, N = 3SE +/- 17457.89, N = 3SE +/- 30179.10, N = 3SE +/- 7571.88, N = 3SE +/- 8685.88, N = 3SE +/- 38670.98, N = 3SE +/- 121304.48, N = 3SE +/- 124115.99, N = 3SE +/- 134727.30, N = 3SE +/- 234395.65, N = 15SE +/- 3464.10, N = 3SE +/- 11050.39, N = 3SE +/- 31571.79, N = 3SE +/- 120841.84, N = 4187743331820053316906333169046671688533316884000168823331684333313394667133906671338733313083133112900001127366711236333111745001. (CC) gcc options: -O3 -pthread -lm -lc -lliquid
OpenBenchmarking.orgsamples/s, More Is BetterLiquid-DSP 1.6Threads: 1 - Buffer Length: 256 - Filter Length: 512Xeon Platinum 8592+Xeon Platinum 8592+ 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PXeon Platinum 8490HXeon Platinum 8490H 2PEPYC 9654EPYC 9654 2PEPYC 9684XEPYC 9684X 2PEPYC 8534PEPYC 9754 2PEPYC 8534PNEPYC 97543M6M9M12M15MMin: 18762000 / Avg: 18774333.33 / Max: 18793000Min: 17032000 / Avg: 18200533.33 / Max: 19386000Min: 16896000 / Avg: 16906333.33 / Max: 16913000Min: 16879000 / Avg: 16904666.67 / Max: 16938000Min: 16825000 / Avg: 16885333.33 / Max: 16917000Min: 16870000 / Avg: 16884000 / Max: 16896000Min: 16868000 / Avg: 16882333.33 / Max: 16898000Min: 16766000 / Avg: 16843333.33 / Max: 16883000Min: 13153000 / Avg: 13394666.67 / Max: 13534000Min: 13143000 / Avg: 13390666.67 / Max: 13529000Min: 13118000 / Avg: 13387333.33 / Max: 13529000Min: 10884000 / Avg: 13083133.33 / Max: 13531000Min: 11284000 / Avg: 11290000 / Max: 11296000Min: 11258000 / Avg: 11273666.67 / Max: 11295000Min: 11175000 / Avg: 11236333.33 / Max: 11280000Min: 10812000 / Avg: 11174500 / Max: 112990001. (CC) gcc options: -O3 -pthread -lm -lc -lliquid

WebP Image Encode

This is a test of Google's libwebp with the cwebp image encode utility and using a sample 6000x4000 pixel JPEG image as the input. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgMP/s, More Is BetterWebP Image Encode 1.2.4Encode Settings: Quality 100, Lossless, Highest CompressionXeon Platinum 8592+Xeon Platinum 8592+ 2PEPYC 9684XEPYC 9654 2PEPYC 9654EPYC 9684X 2PXeon Max 9480Xeon Max 9468Xeon Max 9480 2PXeon Max 9468 2PXeon Platinum 8490HXeon Platinum 8490H 2PEPYC 9754 2PEPYC 9754EPYC 8534PNEPYC 8534P0.1350.270.4050.540.675SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 30.600.590.570.570.570.560.550.550.540.540.520.510.480.480.480.481. (CC) gcc options: -fvisibility=hidden -O2 -lm
OpenBenchmarking.orgMP/s, More Is BetterWebP Image Encode 1.2.4Encode Settings: Quality 100, Lossless, Highest CompressionXeon Platinum 8592+Xeon Platinum 8592+ 2PEPYC 9684XEPYC 9654 2PEPYC 9654EPYC 9684X 2PXeon Max 9480Xeon Max 9468Xeon Max 9480 2PXeon Max 9468 2PXeon Platinum 8490HXeon Platinum 8490H 2PEPYC 9754 2PEPYC 9754EPYC 8534PNEPYC 8534P246810Min: 0.6 / Avg: 0.6 / Max: 0.6Min: 0.58 / Avg: 0.59 / Max: 0.6Min: 0.57 / Avg: 0.57 / Max: 0.57Min: 0.57 / Avg: 0.57 / Max: 0.57Min: 0.57 / Avg: 0.57 / Max: 0.57Min: 0.56 / Avg: 0.56 / Max: 0.56Min: 0.55 / Avg: 0.55 / Max: 0.55Min: 0.54 / Avg: 0.55 / Max: 0.55Min: 0.54 / Avg: 0.54 / Max: 0.55Min: 0.53 / Avg: 0.54 / Max: 0.55Min: 0.52 / Avg: 0.52 / Max: 0.52Min: 0.51 / Avg: 0.51 / Max: 0.52Min: 0.48 / Avg: 0.48 / Max: 0.48Min: 0.48 / Avg: 0.48 / Max: 0.48Min: 0.48 / Avg: 0.48 / Max: 0.48Min: 0.48 / Avg: 0.48 / Max: 0.481. (CC) gcc options: -fvisibility=hidden -O2 -lm

TensorFlow

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.16.1Device: CPU - Batch Size: 512 - Model: AlexNetXeon Platinum 8592+ 2PXeon Platinum 8490H 2PEPYC 9684X 2PEPYC 9754 2PEPYC 9654 2PXeon Max 9480 2PEPYC 9754Xeon Max 9468 2PXeon Platinum 8592+EPYC 9684XEPYC 9654Xeon Platinum 8490HXeon Max 9480Xeon Max 9468EPYC 8534PEPYC 8534PN400800120016002000SE +/- 19.23, N = 3SE +/- 18.52, N = 3SE +/- 23.15, N = 4SE +/- 7.97, N = 3SE +/- 12.71, N = 3SE +/- 8.55, N = 3SE +/- 4.07, N = 3SE +/- 17.88, N = 4SE +/- 1.84, N = 3SE +/- 0.49, N = 3SE +/- 0.67, N = 3SE +/- 0.51, N = 3SE +/- 5.13, N = 3SE +/- 3.89, N = 3SE +/- 0.35, N = 3SE +/- 0.57, N = 32039.631899.641897.641876.661862.791677.621620.531604.111486.121392.911363.331278.451108.951047.96875.23796.82
OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.16.1Device: CPU - Batch Size: 512 - Model: AlexNetXeon Platinum 8592+ 2PXeon Platinum 8490H 2PEPYC 9684X 2PEPYC 9754 2PEPYC 9654 2PXeon Max 9480 2PEPYC 9754Xeon Max 9468 2PXeon Platinum 8592+EPYC 9684XEPYC 9654Xeon Platinum 8490HXeon Max 9480Xeon Max 9468EPYC 8534PEPYC 8534PN400800120016002000Min: 2015.57 / Avg: 2039.63 / Max: 2077.65Min: 1868.64 / Avg: 1899.64 / Max: 1932.69Min: 1860.49 / Avg: 1897.64 / Max: 1963.84Min: 1865.56 / Avg: 1876.66 / Max: 1892.13Min: 1837.6 / Avg: 1862.79 / Max: 1878.34Min: 1660.98 / Avg: 1677.62 / Max: 1689.32Min: 1612.67 / Avg: 1620.53 / Max: 1626.28Min: 1571.21 / Avg: 1604.11 / Max: 1643.67Min: 1482.99 / Avg: 1486.12 / Max: 1489.37Min: 1391.94 / Avg: 1392.91 / Max: 1393.44Min: 1362.31 / Avg: 1363.33 / Max: 1364.58Min: 1277.58 / Avg: 1278.45 / Max: 1279.36Min: 1099.81 / Avg: 1108.95 / Max: 1117.55Min: 1040.33 / Avg: 1047.96 / Max: 1053.1Min: 874.54 / Avg: 875.23 / Max: 875.7Min: 795.68 / Avg: 796.82 / Max: 797.52

Coremark

This is a test of EEMBC CoreMark processor benchmark. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgIterations/Sec, More Is BetterCoremark 1.0CoreMark Size 666 - Iterations Per SecondEPYC 9684X 2PEPYC 9754 2PEPYC 9654 2PXeon Platinum 8592+ 2PEPYC 9754EPYC 9684XEPYC 9654Xeon Platinum 8490H 2PXeon Max 9480 2PXeon Max 9468 2PXeon Platinum 8592+EPYC 8534PXeon Platinum 8490HEPYC 8534PNXeon Max 9480Xeon Max 94682M4M6M8M10MSE +/- 76743.24, N = 3SE +/- 54771.53, N = 3SE +/- 2306.54, N = 3SE +/- 9700.21, N = 3SE +/- 4775.53, N = 3SE +/- 54326.71, N = 3SE +/- 10132.66, N = 3SE +/- 12743.41, N = 3SE +/- 20649.43, N = 3SE +/- 7219.73, N = 3SE +/- 4635.95, N = 3SE +/- 1374.66, N = 3SE +/- 9256.47, N = 3SE +/- 11678.22, N = 3SE +/- 5202.86, N = 3SE +/- 1747.99, N = 38448083.738171241.717975907.454966250.784525288.004152864.883926265.283902076.243279262.532993136.602369998.362274636.132194630.602069432.531855135.331614763.701. (CC) gcc options: -O2 -lrt" -lrt
OpenBenchmarking.orgIterations/Sec, More Is BetterCoremark 1.0CoreMark Size 666 - Iterations Per SecondEPYC 9684X 2PEPYC 9754 2PEPYC 9654 2PXeon Platinum 8592+ 2PEPYC 9754EPYC 9684XEPYC 9654Xeon Platinum 8490H 2PXeon Max 9480 2PXeon Max 9468 2PXeon Platinum 8592+EPYC 8534PXeon Platinum 8490HEPYC 8534PNXeon Max 9480Xeon Max 94681.5M3M4.5M6M7.5MMin: 8294632.25 / Avg: 8448083.73 / Max: 8527648.23Min: 8061722.56 / Avg: 8171241.71 / Max: 8227983.72Min: 7973008.05 / Avg: 7975907.45 / Max: 7980464.49Min: 4952761.75 / Avg: 4966250.78 / Max: 4985070.75Min: 4516451.53 / Avg: 4525288 / Max: 4532845.42Min: 4045192.38 / Avg: 4152864.88 / Max: 4219316.56Min: 3913375.8 / Avg: 3926265.28 / Max: 3946252.86Min: 3878640.96 / Avg: 3902076.24 / Max: 3922469.93Min: 3249040.2 / Avg: 3279262.53 / Max: 3318748.99Min: 2983161.45 / Avg: 2993136.6 / Max: 3007165.51Min: 2363949.77 / Avg: 2369998.36 / Max: 2379108.45Min: 2271886.88 / Avg: 2274636.13 / Max: 2276027.62Min: 2176176.81 / Avg: 2194630.6 / Max: 2205138.14Min: 2046144.83 / Avg: 2069432.53 / Max: 2082627.15Min: 1844878.84 / Avg: 1855135.33 / Max: 1861784.33Min: 1611278.95 / Avg: 1614763.7 / Max: 1616748.51. (CC) gcc options: -O2 -lrt" -lrt

7-Zip Compression

This is a test of 7-Zip compression/decompression with its integrated benchmark feature. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgMIPS, More Is Better7-Zip Compression 22.01Test: Decompression RatingEPYC 9754 2PEPYC 9684X 2PEPYC 9654 2PEPYC 9754EPYC 9684XEPYC 9654Xeon Platinum 8592+ 2PXeon Platinum 8490H 2PXeon Max 9480 2PXeon Max 9468 2PEPYC 8534PEPYC 8534PNXeon Platinum 8592+Xeon Platinum 8490HXeon Max 9480Xeon Max 9468300K600K900K1200K1500KSE +/- 14188.09, N = 3SE +/- 38431.24, N = 3SE +/- 15794.26, N = 3SE +/- 291.68, N = 3SE +/- 1085.99, N = 3SE +/- 111.53, N = 3SE +/- 28320.74, N = 3SE +/- 185.14, N = 3SE +/- 6276.88, N = 3SE +/- 2598.93, N = 3SE +/- 120.28, N = 3SE +/- 81.21, N = 3SE +/- 119.21, N = 3SE +/- 61.74, N = 3SE +/- 374.59, N = 3SE +/- 916.22, N = 31340226111646510332777808717160656426265734105570544691314017073679893383553381462878622433472077381. (CXX) g++ options: -lpthread -ldl -O2 -fPIC
OpenBenchmarking.orgMIPS, More Is Better7-Zip Compression 22.01Test: Decompression RatingEPYC 9754 2PEPYC 9684X 2PEPYC 9654 2PEPYC 9754EPYC 9684XEPYC 9654Xeon Platinum 8592+ 2PXeon Platinum 8490H 2PXeon Max 9480 2PXeon Max 9468 2PEPYC 8534PEPYC 8534PNXeon Platinum 8592+Xeon Platinum 8490HXeon Max 9480Xeon Max 9468200K400K600K800K1000KMin: 1312002 / Avg: 1340225.67 / Max: 1356882Min: 1050907 / Avg: 1116465 / Max: 1183993Min: 1014341 / Avg: 1033276.67 / Max: 1064641Min: 780322 / Avg: 780871.33 / Max: 781316Min: 713953 / Avg: 716065 / Max: 717560Min: 642428 / Avg: 642625.67 / Max: 642814Min: 529470 / Avg: 573410 / Max: 626334Min: 556694 / Avg: 557054 / Max: 557309Min: 456604 / Avg: 469131 / Max: 476104Min: 396748 / Avg: 401707.33 / Max: 405535Min: 367827 / Avg: 367989 / Max: 368224Min: 338211 / Avg: 338355.33 / Max: 338492Min: 338011 / Avg: 338146.33 / Max: 338384Min: 287786 / Avg: 287861.67 / Max: 287984Min: 242598 / Avg: 243347 / Max: 243736Min: 206272 / Avg: 207737.67 / Max: 2094231. (CXX) g++ options: -lpthread -ldl -O2 -fPIC

OpenBenchmarking.orgMIPS, More Is Better7-Zip Compression 22.01Test: Compression RatingEPYC 9754 2PEPYC 9654 2PEPYC 9684X 2PXeon Platinum 8592+ 2PXeon Platinum 8490H 2PEPYC 9684XEPYC 9754EPYC 9654Xeon Max 9480 2PXeon Max 9468 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Max 9480EPYC 8534PEPYC 8534PNXeon Max 9468170K340K510K680K850KSE +/- 2500.52, N = 3SE +/- 6869.20, N = 3SE +/- 3075.95, N = 3SE +/- 709.87, N = 3SE +/- 4200.62, N = 3SE +/- 1520.59, N = 3SE +/- 1188.96, N = 3SE +/- 719.89, N = 3SE +/- 3924.87, N = 3SE +/- 5127.15, N = 3SE +/- 1982.97, N = 3SE +/- 1535.53, N = 3SE +/- 2258.81, N = 3SE +/- 268.94, N = 3SE +/- 206.69, N = 3SE +/- 1836.55, N = 37769687617347413666742395927295791125754405495005255144917294416363881903423633313573190943147161. (CXX) g++ options: -lpthread -ldl -O2 -fPIC
OpenBenchmarking.orgMIPS, More Is Better7-Zip Compression 22.01Test: Compression RatingEPYC 9754 2PEPYC 9654 2PEPYC 9684X 2PXeon Platinum 8592+ 2PXeon Platinum 8490H 2PEPYC 9684XEPYC 9754EPYC 9654Xeon Max 9480 2PXeon Max 9468 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Max 9480EPYC 8534PEPYC 8534PNXeon Max 9468130K260K390K520K650KMin: 772190 / Avg: 776968 / Max: 780636Min: 749974 / Avg: 761734.33 / Max: 773765Min: 735239 / Avg: 741365.67 / Max: 744911Min: 673306 / Avg: 674238.67 / Max: 675632Min: 588274 / Avg: 592729 / Max: 601125Min: 577258 / Avg: 579112.33 / Max: 582127Min: 574194 / Avg: 575440 / Max: 577817Min: 548295 / Avg: 549500.33 / Max: 550785Min: 521447 / Avg: 525514 / Max: 533362Min: 484529 / Avg: 491728.67 / Max: 501652Min: 439125 / Avg: 441636 / Max: 445550Min: 386105 / Avg: 388189.67 / Max: 391185Min: 338862 / Avg: 342362.67 / Max: 346586Min: 330821 / Avg: 331357 / Max: 331664Min: 318736 / Avg: 319094 / Max: 319452Min: 312328 / Avg: 314716 / Max: 3183271. (CXX) g++ options: -lpthread -ldl -O2 -fPIC

LULESH

LULESH is the Livermore Unstructured Lagrangian Explicit Shock Hydrodynamics. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgz/s, More Is BetterLULESH 2.0.3Xeon Platinum 8592+ 2PEPYC 9684X 2PXeon Max 9480 2PXeon Max 9468 2PEPYC 9654 2PEPYC 9754 2PXeon Platinum 8490H 2PXeon Platinum 8592+EPYC 9684XEPYC 9654Xeon Max 9480EPYC 9754Xeon Max 9468Xeon Platinum 8490HEPYC 8534PEPYC 8534PN15K30K45K60K75KSE +/- 359.29, N = 3SE +/- 675.87, N = 3SE +/- 207.54, N = 5SE +/- 206.20, N = 5SE +/- 349.39, N = 15SE +/- 427.75, N = 3SE +/- 272.44, N = 4SE +/- 437.51, N = 4SE +/- 194.65, N = 15SE +/- 372.12, N = 3SE +/- 217.67, N = 6SE +/- 244.17, N = 3SE +/- 211.12, N = 6SE +/- 182.38, N = 15SE +/- 372.63, N = 12SE +/- 373.78, N = 1270826.7354678.4953269.4752102.6748760.8246126.0843724.0638433.9727287.2626082.7125831.8424218.8323848.5423072.3016949.5916855.891. (CXX) g++ options: -O3 -fopenmp -lm -lmpi_cxx -lmpi
OpenBenchmarking.orgz/s, More Is BetterLULESH 2.0.3Xeon Platinum 8592+ 2PEPYC 9684X 2PXeon Max 9480 2PXeon Max 9468 2PEPYC 9654 2PEPYC 9754 2PXeon Platinum 8490H 2PXeon Platinum 8592+EPYC 9684XEPYC 9654Xeon Max 9480EPYC 9754Xeon Max 9468Xeon Platinum 8490HEPYC 8534PEPYC 8534PN12K24K36K48K60KMin: 70411.43 / Avg: 70826.73 / Max: 71542.22Min: 53605.63 / Avg: 54678.49 / Max: 55927.06Min: 52904.08 / Avg: 53269.47 / Max: 54044.05Min: 51553.3 / Avg: 52102.67 / Max: 52648.4Min: 47571.55 / Avg: 48760.81 / Max: 52586.02Min: 45517.21 / Avg: 46126.08 / Max: 46950.96Min: 43120.05 / Avg: 43724.06 / Max: 44351.44Min: 37570.41 / Avg: 38433.97 / Max: 39581.93Min: 26684.32 / Avg: 27287.26 / Max: 29561.84Min: 25381.18 / Avg: 26082.71 / Max: 26648.66Min: 25218.46 / Avg: 25831.84 / Max: 26468.29Min: 23779.56 / Avg: 24218.83 / Max: 24623.24Min: 23318.39 / Avg: 23848.54 / Max: 24737.69Min: 22442.42 / Avg: 23072.3 / Max: 24854.97Min: 12887.73 / Avg: 16949.59 / Max: 17613.75Min: 12776.5 / Avg: 16855.89 / Max: 17542.761. (CXX) g++ options: -O3 -fopenmp -lm -lmpi_cxx -lmpi

srsRAN Project

OpenBenchmarking.orgMbps, More Is BettersrsRAN Project 23.10.1-20240325Test: PUSCH Processor Benchmark, Throughput TotalEPYC 9754 2PEPYC 9684X 2PEPYC 9654 2PEPYC 9754EPYC 9684XXeon Platinum 8592+ 2PEPYC 9654Xeon Platinum 8490H 2PXeon Max 9480 2PXeon Max 9468 2PEPYC 8534PXeon Platinum 8592+EPYC 8534PNXeon Platinum 8490HXeon Max 9480Xeon Max 94682K4K6K8K10KSE +/- 76.45, N = 3SE +/- 2.29, N = 3SE +/- 74.95, N = 4SE +/- 63.64, N = 5SE +/- 55.17, N = 3SE +/- 0.12, N = 3SE +/- 0.20, N = 3SE +/- 47.68, N = 6SE +/- 0.15, N = 3SE +/- 26.47, N = 3SE +/- 25.25, N = 3SE +/- 18.09, N = 3SE +/- 19.02, N = 13SE +/- 18.43, N = 3SE +/- 18.30, N = 3SE +/- 0.09, N = 38396.76999.76835.75973.85656.95493.45239.64853.64386.63787.03193.03088.72818.52616.92514.02170.7MIN: 8064.1 / MAX: 8549.4MIN: 6424.8 / MAX: 7003.9MIN: 6107.2 / MAX: 6950.8MIN: 4286.9 / MAX: 6228.4MIN: 3595.4 / MAX: 5767.2MIN: 3703.4 / MAX: 5493.6MIN: 3593.7 / MAX: 5240MIN: 3181.8 / MAX: 4929.4MIN: 2970.2 / MAX: 4386.9MIN: 2545.7 / MAX: 3839.9MIN: 1941.2 / MAX: 3219MIN: 1852.6 / MAX: 3124.9MIN: 1696.8 / MAX: 2893.2MIN: 1591.7 / MAX: 2653.8MIN: 1550.4 / MAX: 2532.5MIN: 1388.2 / MAX: 2170.81. (CXX) g++ options: -O3 -march=native -mavx2 -mavx -msse4.1 -mfma -mavx512f -mavx512cd -mavx512bw -mavx512dq -fno-trapping-math -fno-math-errno -ldl
OpenBenchmarking.orgMbps, More Is BettersrsRAN Project 23.10.1-20240325Test: PUSCH Processor Benchmark, Throughput TotalEPYC 9754 2PEPYC 9684X 2PEPYC 9654 2PEPYC 9754EPYC 9684XXeon Platinum 8592+ 2PEPYC 9654Xeon Platinum 8490H 2PXeon Max 9480 2PXeon Max 9468 2PEPYC 8534PXeon Platinum 8592+EPYC 8534PNXeon Platinum 8490HXeon Max 9480Xeon Max 946815003000450060007500Min: 8313.2 / Avg: 8396.73 / Max: 8549.4Min: 6996 / Avg: 6999.7 / Max: 7003.9Min: 6627 / Avg: 6835.73 / Max: 6950.8Min: 5909.9 / Avg: 5973.84 / Max: 6228.4Min: 5601.6 / Avg: 5656.87 / Max: 5767.2Min: 5493.2 / Avg: 5493.43 / Max: 5493.6Min: 5239.3 / Avg: 5239.63 / Max: 5240Min: 4702.5 / Avg: 4853.58 / Max: 4929.4Min: 4386.4 / Avg: 4386.63 / Max: 4386.9Min: 3760.1 / Avg: 3786.97 / Max: 3839.9Min: 3142.5 / Avg: 3193 / Max: 3219Min: 3070 / Avg: 3088.73 / Max: 3124.9Min: 2629.7 / Avg: 2818.52 / Max: 2893.2Min: 2598.4 / Avg: 2616.93 / Max: 2653.8Min: 2477.4 / Avg: 2514 / Max: 2532.5Min: 2170.5 / Avg: 2170.67 / Max: 2170.81. (CXX) g++ options: -O3 -march=native -mavx2 -mavx -msse4.1 -mfma -mavx512f -mavx512cd -mavx512bw -mavx512dq -fno-trapping-math -fno-math-errno -ldl

NAS Parallel Benchmarks

NPB, NAS Parallel Benchmarks, is a benchmark developed by NASA for high-end computer systems. This test profile currently uses the MPI version of NPB. This test profile offers selecting the different NPB tests/problems and varying problem sizes. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgTotal Mop/s, More Is BetterNAS Parallel Benchmarks 3.4Test / Class: EP.DEPYC 9684X 2PEPYC 9754 2PEPYC 9654 2PXeon Platinum 8592+ 2PXeon Platinum 8490H 2PXeon Max 9480 2PEPYC 9754EPYC 9684XXeon Max 9468 2PEPYC 9654Xeon Platinum 8592+Xeon Platinum 8490HXeon Max 9480EPYC 8534PEPYC 8534PNXeon Max 94685K10K15K20K25KSE +/- 602.37, N = 15SE +/- 1274.85, N = 12SE +/- 530.31, N = 15SE +/- 30.19, N = 4SE +/- 100.23, N = 4SE +/- 10.93, N = 4SE +/- 367.88, N = 12SE +/- 309.03, N = 15SE +/- 4.83, N = 4SE +/- 122.47, N = 15SE +/- 22.33, N = 3SE +/- 6.77, N = 3SE +/- 6.53, N = 3SE +/- 14.68, N = 3SE +/- 50.01, N = 8SE +/- 155.10, N = 1222166.6022017.7519414.9416004.0714946.7612793.0112575.3011424.0510970.4510652.038089.147562.806445.096416.345745.045366.691. (F9X) gfortran options: -O3 -march=native -lmpi_usempif08 -lmpi_mpifh -lmpi -lopen-rte -lopen-pal -lhwloc -levent_core -levent_pthreads -lm -lz 2. Open MPI 4.1.6
OpenBenchmarking.orgTotal Mop/s, More Is BetterNAS Parallel Benchmarks 3.4Test / Class: EP.DEPYC 9684X 2PEPYC 9754 2PEPYC 9654 2PXeon Platinum 8592+ 2PXeon Platinum 8490H 2PXeon Max 9480 2PEPYC 9754EPYC 9684XXeon Max 9468 2PEPYC 9654Xeon Platinum 8592+Xeon Platinum 8490HXeon Max 9480EPYC 8534PEPYC 8534PNXeon Max 94684K8K12K16K20KMin: 17649.37 / Avg: 22166.6 / Max: 24408Min: 9752.86 / Avg: 22017.75 / Max: 25714.16Min: 15313.65 / Avg: 19414.94 / Max: 21660.47Min: 15962.64 / Avg: 16004.07 / Max: 16092.29Min: 14774.48 / Avg: 14946.76 / Max: 15196.8Min: 12767.18 / Avg: 12793.01 / Max: 12820.48Min: 9627.94 / Avg: 12575.3 / Max: 13896.97Min: 8670.83 / Avg: 11424.05 / Max: 12361.62Min: 10957.6 / Avg: 10970.45 / Max: 10981.02Min: 9132.01 / Avg: 10652.03 / Max: 10990.48Min: 8047.87 / Avg: 8089.14 / Max: 8124.56Min: 7555.79 / Avg: 7562.8 / Max: 7576.34Min: 6432.47 / Avg: 6445.09 / Max: 6454.32Min: 6389.97 / Avg: 6416.34 / Max: 6440.7Min: 5451.19 / Avg: 5745.04 / Max: 5886.73Min: 3660.9 / Avg: 5366.69 / Max: 5540.081. (F9X) gfortran options: -O3 -march=native -lmpi_usempif08 -lmpi_mpifh -lmpi -lopen-rte -lopen-pal -lhwloc -levent_core -levent_pthreads -lm -lz 2. Open MPI 4.1.6

Algebraic Multi-Grid Benchmark

AMG is a parallel algebraic multigrid solver for linear systems arising from problems on unstructured grids. The driver provided with AMG builds linear systems for various 3-dimensional problems. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgFigure Of Merit, More Is BetterAlgebraic Multi-Grid Benchmark 1.2EPYC 9684X 2PEPYC 9654 2PXeon Platinum 8592+ 2PXeon Max 9480 2PXeon Max 9468 2PXeon Platinum 8490H 2PEPYC 9754 2PEPYC 9684XEPYC 9654EPYC 9754Xeon Platinum 8592+Xeon Platinum 8490HXeon Max 9480Xeon Max 9468EPYC 8534PEPYC 8534PN1000M2000M3000M4000M5000MSE +/- 6340323.98, N = 3SE +/- 8808919.44, N = 3SE +/- 9014927.20, N = 3SE +/- 9164253.67, N = 3SE +/- 7233468.75, N = 3SE +/- 2438223.49, N = 3SE +/- 235140242.43, N = 12SE +/- 4963892.66, N = 3SE +/- 1066998.75, N = 3SE +/- 433397.56, N = 3SE +/- 4000850.45, N = 3SE +/- 468935.32, N = 3SE +/- 1778769.08, N = 3SE +/- 3359086.30, N = 3SE +/- 2902028.33, N = 3SE +/- 291866.98, N = 344672813334324930333360964633332051610003156261667312440266727830390832376149000228280200022753526671814760000160509700015979933331588496667115005266711471080001. (CC) gcc options: -lparcsr_ls -lparcsr_mv -lseq_mv -lIJ_mv -lkrylov -lHYPRE_utilities -lm -fopenmp -lmpi
OpenBenchmarking.orgFigure Of Merit, More Is BetterAlgebraic Multi-Grid Benchmark 1.2EPYC 9684X 2PEPYC 9654 2PXeon Platinum 8592+ 2PXeon Max 9480 2PXeon Max 9468 2PXeon Platinum 8490H 2PEPYC 9754 2PEPYC 9684XEPYC 9654EPYC 9754Xeon Platinum 8592+Xeon Platinum 8490HXeon Max 9480Xeon Max 9468EPYC 8534PEPYC 8534PN800M1600M2400M3200M4000MMin: 4459287000 / Avg: 4467281333.33 / Max: 4479803000Min: 4313689000 / Avg: 4324930333.33 / Max: 4342299000Min: 3594221000 / Avg: 3609646333.33 / Max: 3625443000Min: 3187407000 / Avg: 3205161000 / Max: 3217981000Min: 3148914000 / Avg: 3156261666.67 / Max: 3170728000Min: 3119972000 / Avg: 3124402666.67 / Max: 3128382000Min: 2302586000 / Avg: 2783039083.33 / Max: 4283742000Min: 2370008000 / Avg: 2376149000 / Max: 2385975000Min: 2280669000 / Avg: 2282802000 / Max: 2283925000Min: 2274545000 / Avg: 2275352666.67 / Max: 2276029000Min: 1808063000 / Avg: 1814760000 / Max: 1821901000Min: 1604196000 / Avg: 1605097000 / Max: 1605773000Min: 1594535000 / Avg: 1597993333.33 / Max: 1600445000Min: 1583443000 / Avg: 1588496666.67 / Max: 1594857000Min: 1144250000 / Avg: 1150052666.67 / Max: 1153064000Min: 1146561000 / Avg: 1147108000 / Max: 11475580001. (CC) gcc options: -lparcsr_ls -lparcsr_mv -lseq_mv -lIJ_mv -lkrylov -lHYPRE_utilities -lm -fopenmp -lmpi

miniFE

MiniFE Finite Element is an application for unstructured implicit finite element codes. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgCG Mflops, More Is BetterminiFE 2.2Problem Size: SmallEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9754Xeon Platinum 8490H 2PEPYC 9654 2PXeon Platinum 8592+ 2PEPYC 9754 2PXeon Platinum 8490HXeon Platinum 8592+EPYC 8534PNEPYC 8534PXeon Max 9480 2PXeon Max 9468Xeon Max 9468 2PXeon Max 948013K26K39K52K65KSE +/- 2182.93, N = 15SE +/- 92.04, N = 5SE +/- 42.89, N = 5SE +/- 53.07, N = 5SE +/- 467.78, N = 4SE +/- 1510.37, N = 15SE +/- 1633.92, N = 15SE +/- 2087.13, N = 15SE +/- 11.14, N = 4SE +/- 135.77, N = 4SE +/- 42.17, N = 4SE +/- 49.20, N = 4SE +/- 283.44, N = 3SE +/- 601.03, N = 12SE +/- 1097.75, N = 15SE +/- 572.00, N = 1259466.653167.850909.650139.946877.543531.042114.642113.535230.131830.224548.824526.021583.220091.119876.518621.21. (CXX) g++ options: -O3 -fopenmp -lmpi_cxx -lmpi
OpenBenchmarking.orgCG Mflops, More Is BetterminiFE 2.2Problem Size: SmallEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9754Xeon Platinum 8490H 2PEPYC 9654 2PXeon Platinum 8592+ 2PEPYC 9754 2PXeon Platinum 8490HXeon Platinum 8592+EPYC 8534PNEPYC 8534PXeon Max 9480 2PXeon Max 9468Xeon Max 9468 2PXeon Max 948010K20K30K40K50KMin: 46247.4 / Avg: 59466.63 / Max: 76536.6Min: 52973.6 / Avg: 53167.78 / Max: 53401.6Min: 50759.9 / Avg: 50909.62 / Max: 50996.1Min: 49964.6 / Avg: 50139.86 / Max: 50299.6Min: 45706.5 / Avg: 46877.53 / Max: 47668.4Min: 34088.8 / Avg: 43531.03 / Max: 52485.7Min: 26242 / Avg: 42114.62 / Max: 48682.4Min: 29274.2 / Avg: 42113.47 / Max: 59923.7Min: 35202.3 / Avg: 35230.08 / Max: 35256.3Min: 31581.2 / Avg: 31830.2 / Max: 32217.1Min: 24462.2 / Avg: 24548.78 / Max: 24663.5Min: 24391.2 / Avg: 24525.98 / Max: 24627.3Min: 21273.9 / Avg: 21583.23 / Max: 22149.3Min: 17078.6 / Avg: 20091.11 / Max: 23135.7Min: 12173.5 / Avg: 19876.54 / Max: 26049.5Min: 16170.7 / Avg: 18621.23 / Max: 22590.41. (CXX) g++ options: -O3 -fopenmp -lmpi_cxx -lmpi

OpenRadioss

OpenRadioss is an open-source AGPL-licensed finite element solver for dynamic event analysis OpenRadioss is based on Altair Radioss and open-sourced in 2022. This open-source finite element solver is benchmarked with various example models available from https://www.openradioss.org/models/ and https://github.com/OpenRadioss/ModelExchange/tree/main/Examples. This test is currently using a reference OpenRadioss binary build offered via GitHub. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterOpenRadioss 2023.09.15Model: Cell Phone Drop TestEPYC 9684XEPYC 9684X 2PEPYC 9654EPYC 9654 2PEPYC 9754Xeon Platinum 8592+ 2PXeon Max 9468 2PXeon Max 9480 2PEPYC 9754 2PXeon Platinum 8592+Xeon Platinum 8490H 2PXeon Platinum 8490HXeon Max 9480EPYC 8534PXeon Max 9468EPYC 8534PN816243240SE +/- 0.19, N = 3SE +/- 0.05, N = 3SE +/- 0.26, N = 3SE +/- 0.05, N = 3SE +/- 0.26, N = 3SE +/- 0.32, N = 3SE +/- 0.01, N = 3SE +/- 0.05, N = 3SE +/- 0.05, N = 3SE +/- 0.18, N = 3SE +/- 0.10, N = 3SE +/- 0.08, N = 3SE +/- 0.02, N = 3SE +/- 0.18, N = 3SE +/- 0.08, N = 3SE +/- 0.35, N = 320.4522.5222.5323.5323.6926.8827.5127.6327.8627.9028.2231.4931.9233.2333.7535.95
OpenBenchmarking.orgSeconds, Fewer Is BetterOpenRadioss 2023.09.15Model: Cell Phone Drop TestEPYC 9684XEPYC 9684X 2PEPYC 9654EPYC 9654 2PEPYC 9754Xeon Platinum 8592+ 2PXeon Max 9468 2PXeon Max 9480 2PEPYC 9754 2PXeon Platinum 8592+Xeon Platinum 8490H 2PXeon Platinum 8490HXeon Max 9480EPYC 8534PXeon Max 9468EPYC 8534PN816243240Min: 20.19 / Avg: 20.45 / Max: 20.82Min: 22.45 / Avg: 22.52 / Max: 22.63Min: 22.03 / Avg: 22.53 / Max: 22.91Min: 23.43 / Avg: 23.53 / Max: 23.59Min: 23.32 / Avg: 23.69 / Max: 24.2Min: 26.52 / Avg: 26.88 / Max: 27.52Min: 27.5 / Avg: 27.51 / Max: 27.53Min: 27.53 / Avg: 27.63 / Max: 27.7Min: 27.76 / Avg: 27.86 / Max: 27.91Min: 27.61 / Avg: 27.9 / Max: 28.23Min: 28.01 / Avg: 28.22 / Max: 28.35Min: 31.4 / Avg: 31.49 / Max: 31.66Min: 31.89 / Avg: 31.92 / Max: 31.95Min: 32.93 / Avg: 33.23 / Max: 33.56Min: 33.61 / Avg: 33.75 / Max: 33.88Min: 35.28 / Avg: 35.95 / Max: 36.48

John The Ripper

This is a benchmark of John The Ripper, which is a password cracker. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgReal C/S, More Is BetterJohn The Ripper 2023.03.14Test: WPA PSKEPYC 9754 2PEPYC 9684X 2PEPYC 9654 2PEPYC 9754Xeon Platinum 8592+ 2PXeon Platinum 8490H 2PEPYC 9684XXeon Max 9480 2PEPYC 9654Xeon Max 9468 2PXeon Platinum 8592+Xeon Platinum 8490HEPYC 8534PEPYC 8534PNXeon Max 9480Xeon Max 9468300K600K900K1200K1500KSE +/- 4358.90, N = 3SE +/- 5291.50, N = 3SE +/- 1333.33, N = 3SE +/- 478.70, N = 3SE +/- 15579.94, N = 15SE +/- 2519.00, N = 3SE +/- 2683.36, N = 3SE +/- 788.50, N = 3SE +/- 921.74, N = 3SE +/- 5122.51, N = 3SE +/- 864.17, N = 3SE +/- 1599.31, N = 3SE +/- 321.00, N = 3SE +/- 79.20, N = 3SE +/- 1274.00, N = 3SE +/- 987.33, N = 31551000129400012533338031877970937932536713226578896434755628754281164012783862123399983340762865521. (CC) gcc options: -m64 -lssl -lcrypto -fopenmp -lgmp -lm -lrt -lz -ldl -lcrypt -lbz2
OpenBenchmarking.orgReal C/S, More Is BetterJohn The Ripper 2023.03.14Test: WPA PSKEPYC 9754 2PEPYC 9684X 2PEPYC 9654 2PEPYC 9754Xeon Platinum 8592+ 2PXeon Platinum 8490H 2PEPYC 9684XXeon Max 9480 2PEPYC 9654Xeon Max 9468 2PXeon Platinum 8592+Xeon Platinum 8490HEPYC 8534PEPYC 8534PNXeon Max 9480Xeon Max 9468300K600K900K1200K1500KMin: 1543000 / Avg: 1551000 / Max: 1558000Min: 1286000 / Avg: 1294000 / Max: 1304000Min: 1252000 / Avg: 1253333.33 / Max: 1256000Min: 802281 / Avg: 803187 / Max: 803908Min: 670974 / Avg: 797093.27 / Max: 846770Min: 788217 / Avg: 793253 / Max: 795894Min: 667016 / Avg: 671322 / Max: 676249Min: 656370 / Avg: 657888.67 / Max: 659016Min: 642448 / Avg: 643474.67 / Max: 645314Min: 553185 / Avg: 562874.67 / Max: 570601Min: 426388 / Avg: 428116.33 / Max: 428987Min: 398080 / Avg: 401277.67 / Max: 402944Min: 385570 / Avg: 386212 / Max: 386533Min: 339854 / Avg: 339998.33 / Max: 340127Min: 331528 / Avg: 334076 / Max: 335350Min: 284577 / Avg: 286551.67 / Max: 2875391. (CC) gcc options: -m64 -lssl -lcrypto -fopenmp -lgmp -lm -lrt -lz -ldl -lcrypt -lbz2

libavif avifenc

OpenBenchmarking.orgSeconds, Fewer Is Betterlibavif avifenc 1.0Encoder Speed: 2Xeon Platinum 8592+ 2PEPYC 9684XEPYC 9654Xeon Platinum 8592+EPYC 9684X 2PEPYC 9654 2PXeon Platinum 8490H 2PXeon Platinum 8490HXeon Max 9480 2PXeon Max 9468 2PXeon Max 9480EPYC 9754Xeon Max 9468EPYC 8534PEPYC 9754 2PEPYC 8534PN1020304050SE +/- 0.09, N = 3SE +/- 0.02, N = 3SE +/- 0.02, N = 3SE +/- 0.05, N = 3SE +/- 0.03, N = 3SE +/- 0.43, N = 3SE +/- 0.16, N = 3SE +/- 0.04, N = 3SE +/- 0.06, N = 3SE +/- 0.22, N = 3SE +/- 0.31, N = 3SE +/- 0.06, N = 3SE +/- 0.21, N = 3SE +/- 0.03, N = 3SE +/- 0.13, N = 3SE +/- 0.10, N = 333.6534.0434.1534.7935.3235.4037.3137.7538.1438.6539.8840.3541.1341.6641.9242.611. (CXX) g++ options: -O3 -fPIC -lm
OpenBenchmarking.orgSeconds, Fewer Is Betterlibavif avifenc 1.0Encoder Speed: 2Xeon Platinum 8592+ 2PEPYC 9684XEPYC 9654Xeon Platinum 8592+EPYC 9684X 2PEPYC 9654 2PXeon Platinum 8490H 2PXeon Platinum 8490HXeon Max 9480 2PXeon Max 9468 2PXeon Max 9480EPYC 9754Xeon Max 9468EPYC 8534PEPYC 9754 2PEPYC 8534PN918273645Min: 33.49 / Avg: 33.65 / Max: 33.8Min: 34.02 / Avg: 34.04 / Max: 34.08Min: 34.12 / Avg: 34.15 / Max: 34.17Min: 34.71 / Avg: 34.79 / Max: 34.88Min: 35.27 / Avg: 35.32 / Max: 35.36Min: 34.84 / Avg: 35.4 / Max: 36.26Min: 37.11 / Avg: 37.31 / Max: 37.63Min: 37.68 / Avg: 37.75 / Max: 37.8Min: 38.04 / Avg: 38.14 / Max: 38.24Min: 38.42 / Avg: 38.65 / Max: 39.1Min: 39.56 / Avg: 39.88 / Max: 40.5Min: 40.23 / Avg: 40.35 / Max: 40.41Min: 40.75 / Avg: 41.13 / Max: 41.49Min: 41.61 / Avg: 41.66 / Max: 41.71Min: 41.77 / Avg: 41.92 / Max: 42.17Min: 42.44 / Avg: 42.61 / Max: 42.781. (CXX) g++ options: -O3 -fPIC -lm

VVenC

OpenBenchmarking.orgFrames Per Second, More Is BetterVVenC 1.11Video Input: Bosphorus 4K - Video Preset: FasterEPYC 9684XEPYC 9654Xeon Platinum 8592+Xeon Platinum 8490HEPYC 9754Xeon Max 9480Xeon Max 9468EPYC 8534PEPYC 8534PNXeon Platinum 8592+ 2PXeon Platinum 8490H 2PXeon Max 9480 2PXeon Max 9468 2P48121620SE +/- 0.03, N = 3SE +/- 0.02, N = 3SE +/- 0.08, N = 3SE +/- 0.02, N = 3SE +/- 0.05, N = 3SE +/- 0.13, N = 3SE +/- 0.05, N = 3SE +/- 0.06, N = 3SE +/- 0.01, N = 3SE +/- 0.12, N = 3SE +/- 0.16, N = 3SE +/- 0.13, N = 3SE +/- 0.11, N = 317.0216.7315.9715.0614.7914.3614.1013.9713.6113.2612.5411.9711.901. (CXX) g++ options: -O3 -flto=auto -fno-fat-lto-objects
OpenBenchmarking.orgFrames Per Second, More Is BetterVVenC 1.11Video Input: Bosphorus 4K - Video Preset: FasterEPYC 9684XEPYC 9654Xeon Platinum 8592+Xeon Platinum 8490HEPYC 9754Xeon Max 9480Xeon Max 9468EPYC 8534PEPYC 8534PNXeon Platinum 8592+ 2PXeon Platinum 8490H 2PXeon Max 9480 2PXeon Max 9468 2P48121620Min: 16.97 / Avg: 17.02 / Max: 17.08Min: 16.68 / Avg: 16.73 / Max: 16.76Min: 15.87 / Avg: 15.97 / Max: 16.12Min: 15.03 / Avg: 15.06 / Max: 15.09Min: 14.71 / Avg: 14.79 / Max: 14.87Min: 14.1 / Avg: 14.36 / Max: 14.53Min: 14.04 / Avg: 14.1 / Max: 14.19Min: 13.88 / Avg: 13.97 / Max: 14.09Min: 13.6 / Avg: 13.61 / Max: 13.63Min: 13.03 / Avg: 13.26 / Max: 13.44Min: 12.28 / Avg: 12.54 / Max: 12.83Min: 11.71 / Avg: 11.97 / Max: 12.15Min: 11.68 / Avg: 11.9 / Max: 12.051. (CXX) g++ options: -O3 -flto=auto -fno-fat-lto-objects

Video Input: Bosphorus 4K - Video Preset: Faster

EPYC 9654 2P: The test quit with a non-zero exit status. E: Parameter Check Error: Number of threads out of range (-1

EPYC 9684X 2P: The test quit with a non-zero exit status. E: Parameter Check Error: Number of threads out of range (-1

EPYC 9754 2P: The test quit with a non-zero exit status. E: Parameter Check Error: Number of threads out of range (-1

GROMACS

The GROMACS (GROningen MAchine for Chemical Simulations) molecular dynamics package testing with the water_GMX50 data. This test profile allows selecting between CPU and GPU-based GROMACS builds. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgNs Per Day, More Is BetterGROMACS 2024Implementation: MPI CPU - Input: water_GMX50_bareEPYC 9684X 2PEPYC 9754 2PEPYC 9654 2PXeon Platinum 8592+ 2PXeon Platinum 8490H 2PEPYC 9684XXeon Max 9480 2PXeon Max 9468 2PEPYC 9754EPYC 9654Xeon Platinum 8592+Xeon Platinum 8490HXeon Max 9480Xeon Max 9468EPYC 8534PEPYC 8534PN510152025SE +/- 0.224, N = 14SE +/- 0.067, N = 3SE +/- 0.189, N = 6SE +/- 0.046, N = 3SE +/- 0.019, N = 3SE +/- 0.052, N = 3SE +/- 0.032, N = 3SE +/- 0.025, N = 3SE +/- 0.032, N = 3SE +/- 0.034, N = 3SE +/- 0.009, N = 3SE +/- 0.010, N = 3SE +/- 0.007, N = 3SE +/- 0.019, N = 3SE +/- 0.004, N = 3SE +/- 0.004, N = 322.52521.30520.23418.54015.45015.22214.12713.39213.24212.51410.4778.7628.2827.5456.4996.2461. (CXX) g++ options: -O3 -lm
OpenBenchmarking.orgNs Per Day, More Is BetterGROMACS 2024Implementation: MPI CPU - Input: water_GMX50_bareEPYC 9684X 2PEPYC 9754 2PEPYC 9654 2PXeon Platinum 8592+ 2PXeon Platinum 8490H 2PEPYC 9684XXeon Max 9480 2PXeon Max 9468 2PEPYC 9754EPYC 9654Xeon Platinum 8592+Xeon Platinum 8490HXeon Max 9480Xeon Max 9468EPYC 8534PEPYC 8534PN510152025Min: 19.93 / Avg: 22.53 / Max: 23.01Min: 21.17 / Avg: 21.31 / Max: 21.38Min: 19.3 / Avg: 20.23 / Max: 20.49Min: 18.45 / Avg: 18.54 / Max: 18.59Min: 15.41 / Avg: 15.45 / Max: 15.47Min: 15.12 / Avg: 15.22 / Max: 15.3Min: 14.07 / Avg: 14.13 / Max: 14.18Min: 13.36 / Avg: 13.39 / Max: 13.44Min: 13.19 / Avg: 13.24 / Max: 13.3Min: 12.45 / Avg: 12.51 / Max: 12.57Min: 10.46 / Avg: 10.48 / Max: 10.49Min: 8.75 / Avg: 8.76 / Max: 8.78Min: 8.27 / Avg: 8.28 / Max: 8.3Min: 7.51 / Avg: 7.55 / Max: 7.56Min: 6.5 / Avg: 6.5 / Max: 6.51Min: 6.24 / Avg: 6.25 / Max: 6.251. (CXX) g++ options: -O3 -lm

ASTC Encoder

OpenBenchmarking.orgMT/s, More Is BetterASTC Encoder 4.7Preset: Very ThoroughEPYC 9754 2PEPYC 9684X 2PEPYC 9654 2PXeon Platinum 8592+ 2PXeon Platinum 8490H 2PEPYC 9754Xeon Max 9480 2PEPYC 9684XXeon Max 9468 2PEPYC 9654Xeon Platinum 8592+Xeon Platinum 8490HXeon Max 9480EPYC 8534PEPYC 8534PNXeon Max 9468510152025SE +/- 0.1961, N = 15SE +/- 0.1284, N = 3SE +/- 0.1965, N = 3SE +/- 0.0007, N = 3SE +/- 0.0379, N = 3SE +/- 0.0006, N = 3SE +/- 0.0022, N = 3SE +/- 0.0254, N = 3SE +/- 0.0055, N = 3SE +/- 0.0006, N = 3SE +/- 0.0294, N = 3SE +/- 0.0054, N = 3SE +/- 0.0016, N = 3SE +/- 0.0007, N = 3SE +/- 0.0012, N = 3SE +/- 0.0016, N = 322.002319.405217.009814.633413.751812.318711.887510.322410.20519.18447.62407.08855.97025.74205.24065.13421. (CXX) g++ options: -O3 -flto -pthread
OpenBenchmarking.orgMT/s, More Is BetterASTC Encoder 4.7Preset: Very ThoroughEPYC 9754 2PEPYC 9684X 2PEPYC 9654 2PXeon Platinum 8592+ 2PXeon Platinum 8490H 2PEPYC 9754Xeon Max 9480 2PEPYC 9684XXeon Max 9468 2PEPYC 9654Xeon Platinum 8592+Xeon Platinum 8490HXeon Max 9480EPYC 8534PEPYC 8534PNXeon Max 9468510152025Min: 20.1 / Avg: 22 / Max: 22.78Min: 19.24 / Avg: 19.41 / Max: 19.66Min: 16.62 / Avg: 17.01 / Max: 17.22Min: 14.63 / Avg: 14.63 / Max: 14.63Min: 13.68 / Avg: 13.75 / Max: 13.8Min: 12.32 / Avg: 12.32 / Max: 12.32Min: 11.88 / Avg: 11.89 / Max: 11.89Min: 10.28 / Avg: 10.32 / Max: 10.37Min: 10.2 / Avg: 10.21 / Max: 10.22Min: 9.18 / Avg: 9.18 / Max: 9.19Min: 7.59 / Avg: 7.62 / Max: 7.68Min: 7.08 / Avg: 7.09 / Max: 7.1Min: 5.97 / Avg: 5.97 / Max: 5.97Min: 5.74 / Avg: 5.74 / Max: 5.74Min: 5.24 / Avg: 5.24 / Max: 5.24Min: 5.13 / Avg: 5.13 / Max: 5.141. (CXX) g++ options: -O3 -flto -pthread

Llamafile

OpenBenchmarking.orgTokens Per Second, More Is BetterLlamafile 0.7Test: llava-v1.5-7b-q4 - Acceleration: CPUEPYC 9654EPYC 9684XEPYC 8534PXeon Platinum 8490HEPYC 8534PNEPYC 9754Xeon Platinum 8592+EPYC 9654 2PEPYC 9684X 2PEPYC 9754 2PXeon Platinum 8490H 2PXeon Max 9480Xeon Max 9468 2PXeon Max 9468Xeon Platinum 8592+ 2PXeon Max 9480 2P612182430SE +/- 0.02, N = 5SE +/- 0.10, N = 5SE +/- 0.11, N = 4SE +/- 0.15, N = 4SE +/- 0.07, N = 4SE +/- 0.05, N = 4SE +/- 0.17, N = 4SE +/- 0.07, N = 4SE +/- 0.02, N = 4SE +/- 0.08, N = 4SE +/- 0.09, N = 15SE +/- 0.02, N = 3SE +/- 0.05, N = 3SE +/- 0.10, N = 3SE +/- 1.08, N = 12SE +/- 0.04, N = 325.7525.3821.0020.9520.6520.6416.6114.4714.2910.9410.448.137.777.677.497.26
OpenBenchmarking.orgTokens Per Second, More Is BetterLlamafile 0.7Test: llava-v1.5-7b-q4 - Acceleration: CPUEPYC 9654EPYC 9684XEPYC 8534PXeon Platinum 8490HEPYC 8534PNEPYC 9754Xeon Platinum 8592+EPYC 9654 2PEPYC 9684X 2PEPYC 9754 2PXeon Platinum 8490H 2PXeon Max 9480Xeon Max 9468 2PXeon Max 9468Xeon Platinum 8592+ 2PXeon Max 9480 2P612182430Min: 25.68 / Avg: 25.75 / Max: 25.79Min: 25.13 / Avg: 25.38 / Max: 25.67Min: 20.73 / Avg: 21 / Max: 21.27Min: 20.63 / Avg: 20.95 / Max: 21.26Min: 20.55 / Avg: 20.65 / Max: 20.85Min: 20.48 / Avg: 20.64 / Max: 20.73Min: 16.11 / Avg: 16.61 / Max: 16.84Min: 14.36 / Avg: 14.47 / Max: 14.67Min: 14.22 / Avg: 14.29 / Max: 14.32Min: 10.72 / Avg: 10.94 / Max: 11.04Min: 9.84 / Avg: 10.44 / Max: 11.02Min: 8.1 / Avg: 8.13 / Max: 8.18Min: 7.68 / Avg: 7.77 / Max: 7.82Min: 7.55 / Avg: 7.67 / Max: 7.87Min: 1.11 / Avg: 7.49 / Max: 9.77Min: 7.21 / Avg: 7.26 / Max: 7.34

Primesieve

OpenBenchmarking.orgSeconds, Fewer Is BetterPrimesieve 12.1Length: 1e13EPYC 9754 2PEPYC 9684X 2PEPYC 9654 2PEPYC 9754EPYC 9684XEPYC 9654Xeon Platinum 8592+ 2PXeon Platinum 8490H 2PXeon Max 9480 2PXeon Max 9468 2PEPYC 8534PXeon Platinum 8592+Xeon Platinum 8490HEPYC 8534PNXeon Max 9480Xeon Max 94681530456075SE +/- 0.01, N = 4SE +/- 0.02, N = 4SE +/- 0.01, N = 4SE +/- 0.02, N = 3SE +/- 0.02, N = 3SE +/- 0.02, N = 3SE +/- 0.04, N = 3SE +/- 0.01, N = 3SE +/- 0.07, N = 3SE +/- 0.04, N = 3SE +/- 0.02, N = 3SE +/- 0.04, N = 3SE +/- 0.04, N = 3SE +/- 0.01, N = 3SE +/- 0.04, N = 3SE +/- 0.07, N = 311.5612.1312.6321.7623.2724.2425.0227.1130.2033.9245.9548.4151.8254.3958.1667.321. (CXX) g++ options: -O3
OpenBenchmarking.orgSeconds, Fewer Is BetterPrimesieve 12.1Length: 1e13EPYC 9754 2PEPYC 9684X 2PEPYC 9654 2PEPYC 9754EPYC 9684XEPYC 9654Xeon Platinum 8592+ 2PXeon Platinum 8490H 2PXeon Max 9480 2PXeon Max 9468 2PEPYC 8534PXeon Platinum 8592+Xeon Platinum 8490HEPYC 8534PNXeon Max 9480Xeon Max 94681326395265Min: 11.53 / Avg: 11.56 / Max: 11.6Min: 12.07 / Avg: 12.13 / Max: 12.16Min: 12.61 / Avg: 12.63 / Max: 12.66Min: 21.74 / Avg: 21.76 / Max: 21.8Min: 23.23 / Avg: 23.26 / Max: 23.29Min: 24.21 / Avg: 24.24 / Max: 24.28Min: 24.98 / Avg: 25.02 / Max: 25.09Min: 27.09 / Avg: 27.11 / Max: 27.13Min: 30.13 / Avg: 30.2 / Max: 30.33Min: 33.85 / Avg: 33.92 / Max: 33.97Min: 45.91 / Avg: 45.95 / Max: 45.98Min: 48.35 / Avg: 48.41 / Max: 48.48Min: 51.77 / Avg: 51.82 / Max: 51.9Min: 54.37 / Avg: 54.39 / Max: 54.41Min: 58.09 / Avg: 58.16 / Max: 58.21Min: 67.25 / Avg: 67.32 / Max: 67.471. (CXX) g++ options: -O3

Liquid-DSP

LiquidSDR's Liquid-DSP is a software-defined radio (SDR) digital signal processing library. This test profile runs a multi-threaded benchmark of this SDR/DSP library focused on embedded platform usage. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgsamples/s, More Is BetterLiquid-DSP 1.6Threads: 1 - Buffer Length: 256 - Filter Length: 57Xeon Platinum 8592+Xeon Platinum 8592+ 2PXeon Max 9468Xeon Max 9480Xeon Platinum 8490HXeon Max 9468 2PXeon Platinum 8490H 2PXeon Max 9480 2PEPYC 9684XEPYC 9654EPYC 9684X 2PEPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN16M32M48M64M80MSE +/- 599433.09, N = 9SE +/- 68119.99, N = 3SE +/- 4910.31, N = 3SE +/- 5364.49, N = 3SE +/- 666.67, N = 3SE +/- 4163.33, N = 3SE +/- 3844.19, N = 3SE +/- 822374.71, N = 4SE +/- 7423.69, N = 3SE +/- 12719.19, N = 3SE +/- 34724.31, N = 3SE +/- 486361.09, N = 3SE +/- 7937.25, N = 3SE +/- 8089.77, N = 3SE +/- 4807.40, N = 3SE +/- 393224.42, N = 3731406677049900067130333671276676707466767064000669913336626600055455333554253335541566754954667462700004622966746210667454863331. (CC) gcc options: -O3 -pthread -lm -lc -lliquid
OpenBenchmarking.orgsamples/s, More Is BetterLiquid-DSP 1.6Threads: 1 - Buffer Length: 256 - Filter Length: 57Xeon Platinum 8592+Xeon Platinum 8592+ 2PXeon Max 9468Xeon Max 9480Xeon Platinum 8490HXeon Max 9468 2PXeon Platinum 8490H 2PXeon Max 9480 2PEPYC 9684XEPYC 9654EPYC 9684X 2PEPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PN13M26M39M52M65MMin: 70713000 / Avg: 73140666.67 / Max: 74344000Min: 70424000 / Avg: 70499000 / Max: 70635000Min: 67122000 / Avg: 67130333.33 / Max: 67139000Min: 67120000 / Avg: 67127666.67 / Max: 67138000Min: 67074000 / Avg: 67074666.67 / Max: 67076000Min: 67058000 / Avg: 67064000 / Max: 67072000Min: 66987000 / Avg: 66991333.33 / Max: 66999000Min: 63799000 / Avg: 66266000 / Max: 67110000Min: 55446000 / Avg: 55455333.33 / Max: 55470000Min: 55400000 / Avg: 55425333.33 / Max: 55440000Min: 55347000 / Avg: 55415666.67 / Max: 55459000Min: 53982000 / Avg: 54954666.67 / Max: 55450000Min: 46258000 / Avg: 46270000 / Max: 46285000Min: 46214000 / Avg: 46229666.67 / Max: 46241000Min: 46204000 / Avg: 46210666.67 / Max: 46220000Min: 44996000 / Avg: 45486333.33 / Max: 462640001. (CC) gcc options: -O3 -pthread -lm -lc -lliquid

OpenBenchmarking.orgsamples/s, More Is BetterLiquid-DSP 1.6Threads: 64 - Buffer Length: 256 - Filter Length: 512Xeon Platinum 8592+ 2PEPYC 9684XEPYC 9684X 2PEPYC 9654 2PEPYC 9654Xeon Platinum 8490H 2PXeon Platinum 8592+Xeon Max 9480 2PXeon Platinum 8490HXeon Max 9468 2PEPYC 9754EPYC 9754 2PXeon Max 9480EPYC 8534PXeon Max 9468EPYC 8534PN200M400M600M800M1000MSE +/- 7562646.32, N = 8SE +/- 752558.60, N = 3SE +/- 3039034.93, N = 3SE +/- 2261241.06, N = 3SE +/- 1678355.68, N = 3SE +/- 3717554.45, N = 3SE +/- 1515552.70, N = 3SE +/- 6141471.96, N = 3SE +/- 940265.92, N = 3SE +/- 4432294.36, N = 3SE +/- 673003.22, N = 3SE +/- 958772.36, N = 3SE +/- 1289603.73, N = 3SE +/- 822739.33, N = 3SE +/- 1611276.24, N = 3SE +/- 2292977.20, N = 38837012508505866678493400008245833338113733337994966677837700007571766677444100007325600007096500007093933336890033336338600006323966675772633331. (CC) gcc options: -O3 -pthread -lm -lc -lliquid
OpenBenchmarking.orgsamples/s, More Is BetterLiquid-DSP 1.6Threads: 64 - Buffer Length: 256 - Filter Length: 512Xeon Platinum 8592+ 2PEPYC 9684XEPYC 9684X 2PEPYC 9654 2PEPYC 9654Xeon Platinum 8490H 2PXeon Platinum 8592+Xeon Max 9480 2PXeon Platinum 8490HXeon Max 9468 2PEPYC 9754EPYC 9754 2PXeon Max 9480EPYC 8534PXeon Max 9468EPYC 8534PN150M300M450M600M750MMin: 843790000 / Avg: 883701250 / Max: 908490000Min: 849550000 / Avg: 850586666.67 / Max: 852050000Min: 843620000 / Avg: 849340000 / Max: 853980000Min: 821280000 / Avg: 824583333.33 / Max: 828910000Min: 808250000 / Avg: 811373333.33 / Max: 814000000Min: 794190000 / Avg: 799496666.67 / Max: 806660000Min: 780790000 / Avg: 783770000 / Max: 785740000Min: 745540000 / Avg: 757176666.67 / Max: 766400000Min: 743120000 / Avg: 744410000 / Max: 746240000Min: 725240000 / Avg: 732560000 / Max: 740550000Min: 708870000 / Avg: 709650000 / Max: 710990000Min: 707580000 / Avg: 709393333.33 / Max: 710840000Min: 687500000 / Avg: 689003333.33 / Max: 691570000Min: 632850000 / Avg: 633860000 / Max: 635490000Min: 630210000 / Avg: 632396666.67 / Max: 635540000Min: 573430000 / Avg: 577263333.33 / Max: 5813600001. (CC) gcc options: -O3 -pthread -lm -lc -lliquid

Embree

Intel Embree is a collection of high-performance ray-tracing kernels for execution on CPUs (and GPUs via SYCL) and supporting instruction sets such as SSE, AVX, AVX2, and AVX-512. Embree also supports making use of the Intel SPMD Program Compiler (ISPC). Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgFrames Per Second, More Is BetterEmbree 4.3Binary: Pathtracer ISPC - Model: Asian Dragon ObjEPYC 9684X 2PEPYC 9754 2PEPYC 9654 2PXeon Platinum 8592+ 2PEPYC 9754EPYC 9684XXeon Platinum 8490H 2PEPYC 9654Xeon Max 9480 2PXeon Max 9468 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Max 9480Xeon Max 9468EPYC 8534PEPYC 8534PN50100150200250SE +/- 1.72, N = 15SE +/- 3.26, N = 12SE +/- 1.58, N = 15SE +/- 0.29, N = 4SE +/- 0.07, N = 4SE +/- 0.11, N = 4SE +/- 0.22, N = 4SE +/- 0.02, N = 4SE +/- 0.89, N = 15SE +/- 0.76, N = 3SE +/- 0.35, N = 3SE +/- 0.09, N = 3SE +/- 0.09, N = 3SE +/- 0.08, N = 3SE +/- 0.04, N = 3SE +/- 0.04, N = 3210.44200.16175.60173.22133.93133.48132.28113.28112.72104.8497.1979.3871.8364.9664.3363.34MIN: 168.12 / MAX: 235.13MIN: 148.48 / MAX: 223.22MIN: 154.41 / MAX: 194.22MIN: 164.07 / MAX: 187.8MIN: 131.91 / MAX: 136.58MIN: 130.86 / MAX: 138.79MIN: 125 / MAX: 146.52MIN: 111.7 / MAX: 116.19MIN: 102 / MAX: 125.96MIN: 101.05 / MAX: 112.02MIN: 92.96 / MAX: 102.04MIN: 76.07 / MAX: 85.98MIN: 69.55 / MAX: 76.73MIN: 63.12 / MAX: 67.81MIN: 63.73 / MAX: 65.21MIN: 62.81 / MAX: 64.1
OpenBenchmarking.orgFrames Per Second, More Is BetterEmbree 4.3Binary: Pathtracer ISPC - Model: Asian Dragon ObjEPYC 9684X 2PEPYC 9754 2PEPYC 9654 2PXeon Platinum 8592+ 2PEPYC 9754EPYC 9684XXeon Platinum 8490H 2PEPYC 9654Xeon Max 9480 2PXeon Max 9468 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Max 9480Xeon Max 9468EPYC 8534PEPYC 8534PN4080120160200Min: 191.17 / Avg: 210.44 / Max: 218.73Min: 178.36 / Avg: 200.16 / Max: 213.61Min: 165.85 / Avg: 175.6 / Max: 186.42Min: 172.52 / Avg: 173.22 / Max: 173.86Min: 133.76 / Avg: 133.93 / Max: 134.05Min: 133.15 / Avg: 133.48 / Max: 133.63Min: 131.73 / Avg: 132.28 / Max: 132.76Min: 113.24 / Avg: 113.28 / Max: 113.33Min: 105.89 / Avg: 112.72 / Max: 117.07Min: 103.67 / Avg: 104.84 / Max: 106.27Min: 96.49 / Avg: 97.19 / Max: 97.59Min: 79.19 / Avg: 79.38 / Max: 79.5Min: 71.64 / Avg: 71.83 / Max: 71.93Min: 64.82 / Avg: 64.96 / Max: 65.11Min: 64.24 / Avg: 64.33 / Max: 64.37Min: 63.28 / Avg: 63.34 / Max: 63.4

SVT-AV1

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 2.0Encoder Mode: Preset 13 - Input: Bosphorus 4KXeon Platinum 8592+EPYC 9654EPYC 9654 2PEPYC 9754Xeon Platinum 8592+ 2PEPYC 9684XXeon Platinum 8490HEPYC 9684X 2PEPYC 8534PEPYC 9754 2PXeon Platinum 8490H 2PEPYC 8534PNXeon Max 9480Xeon Max 9468Xeon Max 9480 2PXeon Max 9468 2P4080120160200SE +/- 2.83, N = 15SE +/- 4.38, N = 15SE +/- 4.23, N = 15SE +/- 4.48, N = 15SE +/- 2.84, N = 15SE +/- 3.81, N = 15SE +/- 2.31, N = 15SE +/- 1.54, N = 15SE +/- 4.25, N = 15SE +/- 4.46, N = 15SE +/- 2.18, N = 15SE +/- 3.84, N = 15SE +/- 1.62, N = 15SE +/- 1.44, N = 15SE +/- 1.67, N = 15SE +/- 1.63, N = 15174.83172.88167.22163.41162.98162.48162.47161.34160.79159.75154.50153.42150.00144.70124.26122.621. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq
OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 2.0Encoder Mode: Preset 13 - Input: Bosphorus 4KXeon Platinum 8592+EPYC 9654EPYC 9654 2PEPYC 9754Xeon Platinum 8592+ 2PEPYC 9684XXeon Platinum 8490HEPYC 9684X 2PEPYC 8534PEPYC 9754 2PXeon Platinum 8490H 2PEPYC 8534PNXeon Max 9480Xeon Max 9468Xeon Max 9480 2PXeon Max 9468 2P306090120150Min: 135.47 / Avg: 174.83 / Max: 179.18Min: 111.98 / Avg: 172.87 / Max: 181.18Min: 108.71 / Avg: 167.22 / Max: 175.15Min: 101.53 / Avg: 163.41 / Max: 173.07Min: 123.62 / Avg: 162.98 / Max: 168.5Min: 109.23 / Avg: 162.48 / Max: 169.1Min: 130.33 / Avg: 162.47 / Max: 166.5Min: 148.84 / Avg: 161.34 / Max: 167.65Min: 101.5 / Avg: 160.78 / Max: 167.06Min: 100.25 / Avg: 159.75 / Max: 172.1Min: 124.23 / Avg: 154.5 / Max: 158.43Min: 100.12 / Avg: 153.42 / Max: 159.57Min: 127.75 / Avg: 150 / Max: 153.19Min: 124.82 / Avg: 144.7 / Max: 147.49Min: 101.43 / Avg: 124.26 / Max: 128.92Min: 101.28 / Avg: 122.62 / Max: 131.091. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

Liquid-DSP

LiquidSDR's Liquid-DSP is a software-defined radio (SDR) digital signal processing library. This test profile runs a multi-threaded benchmark of this SDR/DSP library focused on embedded platform usage. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgsamples/s, More Is BetterLiquid-DSP 1.6Threads: 1 - Buffer Length: 256 - Filter Length: 32Xeon Platinum 8592+Xeon Platinum 8592+ 2PXeon Max 9480Xeon Max 9468Xeon Max 9480 2PXeon Platinum 8490HXeon Max 9468 2PXeon Platinum 8490H 2PEPYC 9654EPYC 9684XEPYC 9684X 2PEPYC 9654 2PEPYC 9754EPYC 8534PEPYC 8534PNEPYC 9754 2P9M18M27M36M45MSE +/- 417042.80, N = 5SE +/- 419600.12, N = 5SE +/- 3000.00, N = 3SE +/- 1666.67, N = 3SE +/- 1452.97, N = 3SE +/- 1527.53, N = 3SE +/- 1201.85, N = 3SE +/- 1154.70, N = 3SE +/- 7753.14, N = 3SE +/- 7023.77, N = 3SE +/- 19139.84, N = 3SE +/- 13503.09, N = 3SE +/- 6984.11, N = 3SE +/- 2333.33, N = 3SE +/- 881.92, N = 3SE +/- 2185.81, N = 3402440003895060036539000365376673652133336506000364976673646100036068333360660003604000036033000299073332989966729899333298933331. (CC) gcc options: -O3 -pthread -lm -lc -lliquid
OpenBenchmarking.orgsamples/s, More Is BetterLiquid-DSP 1.6Threads: 1 - Buffer Length: 256 - Filter Length: 32Xeon Platinum 8592+Xeon Platinum 8592+ 2PXeon Max 9480Xeon Max 9468Xeon Max 9480 2PXeon Platinum 8490HXeon Max 9468 2PXeon Platinum 8490H 2PEPYC 9654EPYC 9684XEPYC 9684X 2PEPYC 9654 2PEPYC 9754EPYC 8534PEPYC 8534PNEPYC 9754 2P7M14M21M28M35MMin: 38576000 / Avg: 40244000 / Max: 40671000Min: 38530000 / Avg: 38950600 / Max: 40629000Min: 36536000 / Avg: 36539000 / Max: 36545000Min: 36536000 / Avg: 36537666.67 / Max: 36541000Min: 36519000 / Avg: 36521333.33 / Max: 36524000Min: 36503000 / Avg: 36506000 / Max: 36508000Min: 36496000 / Avg: 36497666.67 / Max: 36500000Min: 36459000 / Avg: 36461000 / Max: 36463000Min: 36053000 / Avg: 36068333.33 / Max: 36078000Min: 36058000 / Avg: 36066000 / Max: 36080000Min: 36003000 / Avg: 36040000 / Max: 36067000Min: 36006000 / Avg: 36033000 / Max: 36047000Min: 29898000 / Avg: 29907333.33 / Max: 29921000Min: 29896000 / Avg: 29899666.67 / Max: 29904000Min: 29898000 / Avg: 29899333.33 / Max: 29901000Min: 29889000 / Avg: 29893333.33 / Max: 298960001. (CC) gcc options: -O3 -pthread -lm -lc -lliquid

OpenBenchmarking.orgsamples/s, More Is BetterLiquid-DSP 1.6Threads: 64 - Buffer Length: 256 - Filter Length: 57EPYC 9684XEPYC 9654EPYC 9684X 2PEPYC 9654 2PXeon Platinum 8490H 2PXeon Platinum 8592+ 2PXeon Platinum 8490HXeon Max 9468 2PXeon Max 9480 2PXeon Platinum 8592+EPYC 9754EPYC 9754 2PXeon Max 9480EPYC 8534PXeon Max 9468EPYC 8534PN600M1200M1800M2400M3000MSE +/- 8476044.68, N = 3SE +/- 3786085.64, N = 3SE +/- 8732315.46, N = 3SE +/- 10590929.03, N = 3SE +/- 28500058.48, N = 3SE +/- 32405829.38, N = 3SE +/- 7076957.92, N = 3SE +/- 28812627.44, N = 4SE +/- 27382304.50, N = 5SE +/- 11426868.92, N = 3SE +/- 8567444.84, N = 3SE +/- 17457503.96, N = 3SE +/- 5493127.02, N = 3SE +/- 4914717.13, N = 3SE +/- 2629533.12, N = 3SE +/- 7776531.65, N = 328620000002859833333277280000027302333332655500000262006666725392000002494050000249134000024755000002444933333237476666723089666672186833333213876666720263333331. (CC) gcc options: -O3 -pthread -lm -lc -lliquid
OpenBenchmarking.orgsamples/s, More Is BetterLiquid-DSP 1.6Threads: 64 - Buffer Length: 256 - Filter Length: 57EPYC 9684XEPYC 9654EPYC 9684X 2PEPYC 9654 2PXeon Platinum 8490H 2PXeon Platinum 8592+ 2PXeon Platinum 8490HXeon Max 9468 2PXeon Max 9480 2PXeon Platinum 8592+EPYC 9754EPYC 9754 2PXeon Max 9480EPYC 8534PXeon Max 9468EPYC 8534PN500M1000M1500M2000M2500MMin: 2845100000 / Avg: 2862000000 / Max: 2871600000Min: 2855800000 / Avg: 2859833333.33 / Max: 2867400000Min: 2756200000 / Avg: 2772800000 / Max: 2785800000Min: 2711200000 / Avg: 2730233333.33 / Max: 2747800000Min: 2626900000 / Avg: 2655500000 / Max: 2712500000Min: 2565000000 / Avg: 2620066666.67 / Max: 2677200000Min: 2526700000 / Avg: 2539200000 / Max: 2551200000Min: 2449200000 / Avg: 2494050000 / Max: 2574500000Min: 2425700000 / Avg: 2491340000 / Max: 2564300000Min: 2454700000 / Avg: 2475500000 / Max: 2494100000Min: 2427800000 / Avg: 2444933333.33 / Max: 2453700000Min: 2340500000 / Avg: 2374766666.67 / Max: 2397700000Min: 2298600000 / Avg: 2308966666.67 / Max: 2317300000Min: 2178600000 / Avg: 2186833333.33 / Max: 2195600000Min: 2134100000 / Avg: 2138766666.67 / Max: 2143200000Min: 2013300000 / Avg: 2026333333.33 / Max: 20402000001. (CC) gcc options: -O3 -pthread -lm -lc -lliquid

OpenBenchmarking.orgsamples/s, More Is BetterLiquid-DSP 1.6Threads: 128 - Buffer Length: 256 - Filter Length: 512Xeon Platinum 8592+ 2PEPYC 9684X 2PEPYC 9754EPYC 9684XEPYC 9754 2PXeon Max 9480 2PEPYC 9654 2PEPYC 9654Xeon Platinum 8592+Xeon Platinum 8490H 2PXeon Max 9468 2PXeon Platinum 8490HXeon Max 9480EPYC 8534PXeon Max 9468EPYC 8534PN300M600M900M1200M1500MSE +/- 4790383.89, N = 3SE +/- 3901424.24, N = 3SE +/- 814452.78, N = 3SE +/- 2412697.89, N = 3SE +/- 503322.30, N = 3SE +/- 2123152.79, N = 3SE +/- 2338327.99, N = 3SE +/- 1047748.91, N = 3SE +/- 2313246.88, N = 3SE +/- 6842108.19, N = 3SE +/- 11560043.25, N = 5SE +/- 1740596.96, N = 3SE +/- 1345523.44, N = 3SE +/- 390953.25, N = 3SE +/- 681281.47, N = 3SE +/- 431058.13, N = 3149383333313947333331369800000136873333313498000001206066667119996666711581666671152933333112646666710914600009185666678822000008099166678001866677317566671. (CC) gcc options: -O3 -pthread -lm -lc -lliquid
OpenBenchmarking.orgsamples/s, More Is BetterLiquid-DSP 1.6Threads: 128 - Buffer Length: 256 - Filter Length: 512Xeon Platinum 8592+ 2PEPYC 9684X 2PEPYC 9754EPYC 9684XEPYC 9754 2PXeon Max 9480 2PEPYC 9654 2PEPYC 9654Xeon Platinum 8592+Xeon Platinum 8490H 2PXeon Max 9468 2PXeon Platinum 8490HXeon Max 9480EPYC 8534PXeon Max 9468EPYC 8534PN300M600M900M1200M1500MMin: 1488600000 / Avg: 1493833333.33 / Max: 1503400000Min: 1389300000 / Avg: 1394733333.33 / Max: 1402300000Min: 1368500000 / Avg: 1369800000 / Max: 1371300000Min: 1365100000 / Avg: 1368733333.33 / Max: 1373300000Min: 1348800000 / Avg: 1349800000 / Max: 1350400000Min: 1202900000 / Avg: 1206066666.67 / Max: 1210100000Min: 1195500000 / Avg: 1199966666.67 / Max: 1203400000Min: 1156100000 / Avg: 1158166666.67 / Max: 1159500000Min: 1148800000 / Avg: 1152933333.33 / Max: 1156800000Min: 1112900000 / Avg: 1126466666.67 / Max: 1134800000Min: 1052100000 / Avg: 1091460000 / Max: 1118000000Min: 916530000 / Avg: 918566666.67 / Max: 922030000Min: 880040000 / Avg: 882200000 / Max: 884670000Min: 809190000 / Avg: 809916666.67 / Max: 810530000Min: 799130000 / Avg: 800186666.67 / Max: 801460000Min: 731040000 / Avg: 731756666.67 / Max: 7325300001. (CC) gcc options: -O3 -pthread -lm -lc -lliquid

QuantLib

QuantLib is an open-source library/framework around quantitative finance for modeling, trading and risk management scenarios. QuantLib is written in C++ with Boost and its built-in benchmark used reports the QuantLib Benchmark Index benchmark score. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgMFLOPS, More Is BetterQuantLib 1.32Configuration: Single-ThreadedXeon Platinum 8592+Xeon Platinum 8592+ 2PXeon Max 9480Xeon Max 9468Xeon Max 9480 2PXeon Platinum 8490H 2PXeon Platinum 8490HXeon Max 9468 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 8534PEPYC 8534PNEPYC 9754 2P8001600240032004000SE +/- 33.58, N = 3SE +/- 30.36, N = 12SE +/- 25.35, N = 3SE +/- 22.17, N = 3SE +/- 28.57, N = 3SE +/- 25.40, N = 3SE +/- 28.42, N = 3SE +/- 28.11, N = 3SE +/- 1.14, N = 3SE +/- 22.39, N = 3SE +/- 24.27, N = 3SE +/- 19.83, N = 3SE +/- 14.83, N = 3SE +/- 18.64, N = 3SE +/- 14.40, N = 3SE +/- 19.30, N = 33600.53586.33229.13225.73222.83210.13209.63207.03125.43114.23105.93098.52596.12593.32593.02590.81. (CXX) g++ options: -O3 -march=native -fPIE -pie
OpenBenchmarking.orgMFLOPS, More Is BetterQuantLib 1.32Configuration: Single-ThreadedXeon Platinum 8592+Xeon Platinum 8592+ 2PXeon Max 9480Xeon Max 9468Xeon Max 9480 2PXeon Platinum 8490H 2PXeon Platinum 8490HXeon Max 9468 2PEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 8534PEPYC 8534PNEPYC 9754 2P6001200180024003000Min: 3533.3 / Avg: 3600.47 / Max: 3634.3Min: 3261.3 / Avg: 3586.3 / Max: 3632.5Min: 3178.4 / Avg: 3229.1 / Max: 3254.8Min: 3181.4 / Avg: 3225.73 / Max: 3247.9Min: 3165.7 / Avg: 3222.8 / Max: 3253Min: 3159.5 / Avg: 3210.1 / Max: 3239.3Min: 3152.8 / Avg: 3209.63 / Max: 3239Min: 3153.8 / Avg: 3207.03 / Max: 3249.3Min: 3123.2 / Avg: 3125.4 / Max: 3127Min: 3069.5 / Avg: 3114.23 / Max: 3138.4Min: 3057.7 / Avg: 3105.87 / Max: 3135.2Min: 3060.1 / Avg: 3098.53 / Max: 3126.2Min: 2567.2 / Avg: 2596.07 / Max: 2616.4Min: 2556.1 / Avg: 2593.27 / Max: 2614.3Min: 2566 / Avg: 2592.97 / Max: 2615.2Min: 2552.3 / Avg: 2590.83 / Max: 26121. (CXX) g++ options: -O3 -march=native -fPIE -pie

TensorFlow

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.16.1Device: CPU - Batch Size: 256 - Model: AlexNetXeon Platinum 8490H 2PXeon Platinum 8592+ 2PEPYC 9684X 2PXeon Max 9480 2PEPYC 9654 2PXeon Max 9468 2PEPYC 9754EPYC 9754 2PEPYC 9684XEPYC 9654Xeon Platinum 8592+Xeon Platinum 8490HXeon Max 9480Xeon Max 9468EPYC 8534PEPYC 8534PN400800120016002000SE +/- 5.06, N = 3SE +/- 1.86, N = 3SE +/- 15.82, N = 3SE +/- 5.81, N = 3SE +/- 6.01, N = 3SE +/- 1.15, N = 3SE +/- 4.01, N = 3SE +/- 10.23, N = 15SE +/- 1.54, N = 3SE +/- 2.58, N = 3SE +/- 4.27, N = 3SE +/- 0.54, N = 3SE +/- 6.82, N = 3SE +/- 1.21, N = 3SE +/- 0.99, N = 3SE +/- 0.41, N = 31730.251681.441560.561528.411524.741479.531454.711403.461301.261278.581277.461205.301058.99986.04843.63771.47
OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.16.1Device: CPU - Batch Size: 256 - Model: AlexNetXeon Platinum 8490H 2PXeon Platinum 8592+ 2PEPYC 9684X 2PXeon Max 9480 2PEPYC 9654 2PXeon Max 9468 2PEPYC 9754EPYC 9754 2PEPYC 9684XEPYC 9654Xeon Platinum 8592+Xeon Platinum 8490HXeon Max 9480Xeon Max 9468EPYC 8534PEPYC 8534PN30060090012001500Min: 1720.58 / Avg: 1730.25 / Max: 1737.65Min: 1678.14 / Avg: 1681.44 / Max: 1684.59Min: 1536.03 / Avg: 1560.56 / Max: 1590.14Min: 1517.02 / Avg: 1528.41 / Max: 1536.13Min: 1513.89 / Avg: 1524.74 / Max: 1534.65Min: 1477.32 / Avg: 1479.53 / Max: 1481.18Min: 1449.72 / Avg: 1454.71 / Max: 1462.64Min: 1348.73 / Avg: 1403.46 / Max: 1480.41Min: 1298.66 / Avg: 1301.26 / Max: 1303.99Min: 1273.44 / Avg: 1278.58 / Max: 1281.51Min: 1270.92 / Avg: 1277.46 / Max: 1285.48Min: 1204.31 / Avg: 1205.3 / Max: 1206.15Min: 1046.92 / Avg: 1058.99 / Max: 1070.53Min: 983.65 / Avg: 986.04 / Max: 987.58Min: 841.76 / Avg: 843.63 / Max: 845.14Min: 770.76 / Avg: 771.47 / Max: 772.19

ASTC Encoder

OpenBenchmarking.orgMT/s, More Is BetterASTC Encoder 4.7Preset: ExhaustiveEPYC 9754 2PEPYC 9684X 2PEPYC 9654 2PXeon Platinum 8592+ 2PXeon Platinum 8490H 2PEPYC 9754Xeon Max 9480 2PEPYC 9684XXeon Max 9468 2PEPYC 9654Xeon Platinum 8592+Xeon Platinum 8490HXeon Max 9480EPYC 8534PEPYC 8534PNXeon Max 946848121620SE +/- 0.1160, N = 3SE +/- 0.0170, N = 3SE +/- 0.0218, N = 3SE +/- 0.0157, N = 3SE +/- 0.0164, N = 3SE +/- 0.0025, N = 3SE +/- 0.0016, N = 3SE +/- 0.0086, N = 3SE +/- 0.0033, N = 3SE +/- 0.0002, N = 3SE +/- 0.0072, N = 3SE +/- 0.0024, N = 3SE +/- 0.0011, N = 3SE +/- 0.0010, N = 3SE +/- 0.0006, N = 3SE +/- 0.0003, N = 314.103811.910710.60188.90918.37017.55737.20756.30276.21265.63014.63034.26893.62763.51463.19933.12041. (CXX) g++ options: -O3 -flto -pthread
OpenBenchmarking.orgMT/s, More Is BetterASTC Encoder 4.7Preset: ExhaustiveEPYC 9754 2PEPYC 9684X 2PEPYC 9654 2PXeon Platinum 8592+ 2PXeon Platinum 8490H 2PEPYC 9754Xeon Max 9480 2PEPYC 9684XXeon Max 9468 2PEPYC 9654Xeon Platinum 8592+Xeon Platinum 8490HXeon Max 9480EPYC 8534PEPYC 8534PNXeon Max 946848121620Min: 13.89 / Avg: 14.1 / Max: 14.29Min: 11.88 / Avg: 11.91 / Max: 11.93Min: 10.56 / Avg: 10.6 / Max: 10.63Min: 8.88 / Avg: 8.91 / Max: 8.94Min: 8.34 / Avg: 8.37 / Max: 8.4Min: 7.55 / Avg: 7.56 / Max: 7.56Min: 7.2 / Avg: 7.21 / Max: 7.21Min: 6.29 / Avg: 6.3 / Max: 6.32Min: 6.21 / Avg: 6.21 / Max: 6.22Min: 5.63 / Avg: 5.63 / Max: 5.63Min: 4.62 / Avg: 4.63 / Max: 4.64Min: 4.26 / Avg: 4.27 / Max: 4.27Min: 3.63 / Avg: 3.63 / Max: 3.63Min: 3.51 / Avg: 3.51 / Max: 3.52Min: 3.2 / Avg: 3.2 / Max: 3.2Min: 3.12 / Avg: 3.12 / Max: 3.121. (CXX) g++ options: -O3 -flto -pthread

John The Ripper

This is a benchmark of John The Ripper, which is a password cracker. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgReal C/S, More Is BetterJohn The Ripper 2023.03.14Test: bcryptEPYC 9754 2PEPYC 9684X 2PEPYC 9654 2PEPYC 9754Xeon Platinum 8592+ 2PEPYC 9684XXeon Platinum 8490H 2PEPYC 9654Xeon Max 9480 2PXeon Max 9468 2PXeon Platinum 8592+EPYC 8534PXeon Platinum 8490HEPYC 8534PNXeon Max 9480Xeon Max 946890K180K270K360K450KSE +/- 4958.68, N = 4SE +/- 1315.55, N = 3SE +/- 710.46, N = 3SE +/- 1.33, N = 3SE +/- 288.38, N = 3SE +/- 154.46, N = 3SE +/- 292.24, N = 3SE +/- 20.00, N = 3SE +/- 576.80, N = 3SE +/- 866.68, N = 3SE +/- 46.28, N = 3SE +/- 22.28, N = 3SE +/- 10.67, N = 3SE +/- 0.00, N = 3SE +/- 8.67, N = 3SE +/- 8.84, N = 3412723376268320527220188206778192898183603166541155959133866105781102222945519347279144678751. (CC) gcc options: -m64 -lssl -lcrypto -fopenmp -lgmp -lm -lrt -lz -ldl -lcrypt -lbz2
OpenBenchmarking.orgReal C/S, More Is BetterJohn The Ripper 2023.03.14Test: bcryptEPYC 9754 2PEPYC 9684X 2PEPYC 9654 2PEPYC 9754Xeon Platinum 8592+ 2PEPYC 9684XXeon Platinum 8490H 2PEPYC 9654Xeon Max 9480 2PXeon Max 9468 2PXeon Platinum 8592+EPYC 8534PXeon Platinum 8490HEPYC 8534PNXeon Max 9480Xeon Max 946870K140K210K280K350KMin: 398131 / Avg: 412723 / Max: 419840Min: 373862 / Avg: 376268.33 / Max: 378393Min: 319334 / Avg: 320527.33 / Max: 321792Min: 220185 / Avg: 220187.67 / Max: 220189Min: 206292 / Avg: 206778.33 / Max: 207290Min: 192665 / Avg: 192897.67 / Max: 193190Min: 183024 / Avg: 183603.33 / Max: 183960Min: 166521 / Avg: 166541 / Max: 166581Min: 155113 / Avg: 155958.67 / Max: 157061Min: 132134 / Avg: 133866.33 / Max: 134784Min: 105718 / Avg: 105780.67 / Max: 105871Min: 102182 / Avg: 102222 / Max: 102259Min: 94540 / Avg: 94550.67 / Max: 94572Min: 93472 / Avg: 93472 / Max: 93472Min: 79135 / Avg: 79143.67 / Max: 79161Min: 67858 / Avg: 67875.33 / Max: 678871. (CC) gcc options: -m64 -lssl -lcrypto -fopenmp -lgmp -lm -lrt -lz -ldl -lcrypt -lbz2

Liquid-DSP

LiquidSDR's Liquid-DSP is a software-defined radio (SDR) digital signal processing library. This test profile runs a multi-threaded benchmark of this SDR/DSP library focused on embedded platform usage. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgsamples/s, More Is BetterLiquid-DSP 1.6Threads: 256 - Buffer Length: 256 - Filter Length: 512EPYC 9684X 2PEPYC 9654 2PXeon Platinum 8592+ 2PEPYC 9754EPYC 9754 2PXeon Platinum 8490H 2PEPYC 9684XXeon Max 9480 2PXeon Max 9468 2PEPYC 9654Xeon Platinum 8592+Xeon Platinum 8490HXeon Max 9480Xeon Max 9468EPYC 8534PEPYC 8534PN500M1000M1500M2000M2500MSE +/- 14870701.99, N = 3SE +/- 11753202.87, N = 3SE +/- 14465476.14, N = 3SE +/- 1300000.00, N = 3SE +/- 1650252.51, N = 3SE +/- 5630373.98, N = 3SE +/- 2676440.42, N = 3SE +/- 6728628.72, N = 3SE +/- 4238841.56, N = 3SE +/- 520683.31, N = 3SE +/- 240370.09, N = 3SE +/- 1722723.94, N = 3SE +/- 740202.67, N = 3SE +/- 569766.03, N = 3SE +/- 776881.23, N = 3SE +/- 170391.71, N = 32394333333212953333320270000001744700000173480000016169666671570400000151893333314440666671362166667117876666710208333339445500008385300008210133337417400001. (CC) gcc options: -O3 -pthread -lm -lc -lliquid
OpenBenchmarking.orgsamples/s, More Is BetterLiquid-DSP 1.6Threads: 256 - Buffer Length: 256 - Filter Length: 512EPYC 9684X 2PEPYC 9654 2PXeon Platinum 8592+ 2PEPYC 9754EPYC 9754 2PXeon Platinum 8490H 2PEPYC 9684XXeon Max 9480 2PXeon Max 9468 2PEPYC 9654Xeon Platinum 8592+Xeon Platinum 8490HXeon Max 9480Xeon Max 9468EPYC 8534PEPYC 8534PN400M800M1200M1600M2000MMin: 2371400000 / Avg: 2394333333.33 / Max: 2422200000Min: 2115000000 / Avg: 2129533333.33 / Max: 2152800000Min: 2004500000 / Avg: 2027000000 / Max: 2054000000Min: 1742400000 / Avg: 1744700000 / Max: 1746900000Min: 1731500000 / Avg: 1734800000 / Max: 1736500000Min: 1609500000 / Avg: 1616966666.67 / Max: 1628000000Min: 1567100000 / Avg: 1570400000 / Max: 1575700000Min: 1507100000 / Avg: 1518933333.33 / Max: 1530400000Min: 1439100000 / Avg: 1444066666.67 / Max: 1452500000Min: 1361300000 / Avg: 1362166666.67 / Max: 1363100000Min: 1178300000 / Avg: 1178766666.67 / Max: 1179100000Min: 1017400000 / Avg: 1020833333.33 / Max: 1022800000Min: 943070000 / Avg: 944550000 / Max: 945320000Min: 837510000 / Avg: 838530000 / Max: 839480000Min: 819490000 / Avg: 821013333.33 / Max: 822040000Min: 741550000 / Avg: 741740000 / Max: 7420800001. (CC) gcc options: -O3 -pthread -lm -lc -lliquid

OpenBenchmarking.orgsamples/s, More Is BetterLiquid-DSP 1.6Threads: 128 - Buffer Length: 256 - Filter Length: 57EPYC 9684X 2PEPYC 9684XEPYC 9754EPYC 9754 2PXeon Platinum 8592+ 2PEPYC 9654 2PEPYC 9654Xeon Max 9480 2PXeon Platinum 8490H 2PXeon Max 9468 2PXeon Platinum 8592+Xeon Platinum 8490HEPYC 8534PXeon Max 9480EPYC 8534PNXeon Max 94681000M2000M3000M4000M5000MSE +/- 11892621.43, N = 3SE +/- 6778479.02, N = 3SE +/- 18691531.06, N = 3SE +/- 14606429.33, N = 3SE +/- 51282832.98, N = 4SE +/- 4098915.85, N = 3SE +/- 20120967.50, N = 3SE +/- 14772609.79, N = 3SE +/- 13655808.69, N = 3SE +/- 25888414.40, N = 3SE +/- 5260228.13, N = 3SE +/- 3116800.35, N = 3SE +/- 3527510.93, N = 3SE +/- 3119294.79, N = 3SE +/- 6398003.16, N = 3SE +/- 2030052.00, N = 347593666674755333333471450000046265666674450525000428093333342563000003896500000372366666735964000003503200000318126666729828000002972400000268706666726700333331. (CC) gcc options: -O3 -pthread -lm -lc -lliquid
OpenBenchmarking.orgsamples/s, More Is BetterLiquid-DSP 1.6Threads: 128 - Buffer Length: 256 - Filter Length: 57EPYC 9684X 2PEPYC 9684XEPYC 9754EPYC 9754 2PXeon Platinum 8592+ 2PEPYC 9654 2PEPYC 9654Xeon Max 9480 2PXeon Platinum 8490H 2PXeon Max 9468 2PXeon Platinum 8592+Xeon Platinum 8490HEPYC 8534PXeon Max 9480EPYC 8534PNXeon Max 9468800M1600M2400M3200M4000MMin: 4738000000 / Avg: 4759366666.67 / Max: 4779100000Min: 4742100000 / Avg: 4755333333.33 / Max: 4764500000Min: 4677300000 / Avg: 4714500000 / Max: 4736300000Min: 4603000000 / Avg: 4626566666.67 / Max: 4653300000Min: 4359000000 / Avg: 4450525000 / Max: 4593200000Min: 4273400000 / Avg: 4280933333.33 / Max: 4287500000Min: 4230300000 / Avg: 4256300000 / Max: 4295900000Min: 3878000000 / Avg: 3896500000 / Max: 3925700000Min: 3702000000 / Avg: 3723666666.67 / Max: 3748900000Min: 3565300000 / Avg: 3596400000 / Max: 3647800000Min: 3493100000 / Avg: 3503200000 / Max: 3510800000Min: 3175500000 / Avg: 3181266666.67 / Max: 3186200000Min: 2976900000 / Avg: 2982800000 / Max: 2989100000Min: 2967100000 / Avg: 2972400000 / Max: 2977900000Min: 2677700000 / Avg: 2687066666.67 / Max: 2699300000Min: 2667300000 / Avg: 2670033333.33 / Max: 26740000001. (CC) gcc options: -O3 -pthread -lm -lc -lliquid

John The Ripper

This is a benchmark of John The Ripper, which is a password cracker. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgReal C/S, More Is BetterJohn The Ripper 2023.03.14Test: BlowfishEPYC 9754 2PEPYC 9684X 2PEPYC 9654 2PEPYC 9754Xeon Platinum 8592+ 2PEPYC 9684XXeon Platinum 8490H 2PEPYC 9654Xeon Max 9480 2PXeon Max 9468 2PXeon Platinum 8592+EPYC 8534PXeon Platinum 8490HEPYC 8534PNXeon Max 9480Xeon Max 946890K180K270K360K450KSE +/- 2397.15, N = 3SE +/- 454.86, N = 3SE +/- 3455.48, N = 3SE +/- 1.33, N = 3SE +/- 649.08, N = 3SE +/- 98.33, N = 3SE +/- 348.45, N = 3SE +/- 38.33, N = 3SE +/- 169.28, N = 3SE +/- 116.69, N = 3SE +/- 79.75, N = 3SE +/- 13.72, N = 3SE +/- 11.39, N = 3SE +/- 20.54, N = 3SE +/- 8.67, N = 3SE +/- 17.33, N = 3415412374589316492220188205499192574183583166541156658134562105831102198945139347379152678931. (CC) gcc options: -m64 -lssl -lcrypto -fopenmp -lgmp -lm -lrt -lz -ldl -lcrypt -lbz2
OpenBenchmarking.orgReal C/S, More Is BetterJohn The Ripper 2023.03.14Test: BlowfishEPYC 9754 2PEPYC 9684X 2PEPYC 9654 2PEPYC 9754Xeon Platinum 8592+ 2PEPYC 9684XXeon Platinum 8490H 2PEPYC 9654Xeon Max 9480 2PXeon Max 9468 2PXeon Platinum 8592+EPYC 8534PXeon Platinum 8490HEPYC 8534PNXeon Max 9480Xeon Max 946870K140K210K280K350KMin: 411715 / Avg: 415412 / Max: 419904Min: 373968 / Avg: 374588.67 / Max: 375475Min: 309657 / Avg: 316492.33 / Max: 320793Min: 220185 / Avg: 220187.67 / Max: 220189Min: 204296 / Avg: 205499 / Max: 206523Min: 192377 / Avg: 192573.67 / Max: 192672Min: 183096 / Avg: 183582.67 / Max: 184258Min: 166464 / Avg: 166540.67 / Max: 166579Min: 156456 / Avg: 156657.67 / Max: 156994Min: 134336 / Avg: 134561.67 / Max: 134726Min: 105715 / Avg: 105831.33 / Max: 105984Min: 102182 / Avg: 102197.67 / Max: 102225Min: 94500 / Avg: 94513.33 / Max: 94536Min: 93434 / Avg: 93472.67 / Max: 93504Min: 79135 / Avg: 79152.33 / Max: 79161Min: 67858 / Avg: 67892.67 / Max: 679101. (CC) gcc options: -m64 -lssl -lcrypto -fopenmp -lgmp -lm -lrt -lz -ldl -lcrypt -lbz2

Liquid-DSP

LiquidSDR's Liquid-DSP is a software-defined radio (SDR) digital signal processing library. This test profile runs a multi-threaded benchmark of this SDR/DSP library focused on embedded platform usage. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgsamples/s, More Is BetterLiquid-DSP 1.6Threads: 256 - Buffer Length: 256 - Filter Length: 57EPYC 9684X 2PEPYC 9654 2PEPYC 9754EPYC 9754 2PXeon Platinum 8592+ 2PEPYC 9684XXeon Platinum 8490H 2PEPYC 9654Xeon Max 9480 2PXeon Max 9468 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Max 9480EPYC 8534PXeon Max 9468EPYC 8534PN2000M4000M6000M8000M10000MSE +/- 50144890.07, N = 3SE +/- 60380193.59, N = 3SE +/- 12739745.33, N = 3SE +/- 8069352.17, N = 3SE +/- 61971606.40, N = 3SE +/- 8144527.82, N = 3SE +/- 2331189.49, N = 3SE +/- 2618735.91, N = 3SE +/- 28453880.81, N = 3SE +/- 17558125.69, N = 3SE +/- 3555434.03, N = 3SE +/- 5292237.50, N = 3SE +/- 1976810.00, N = 3SE +/- 1959875.28, N = 3SE +/- 4088330.28, N = 3SE +/- 4481443.22, N = 380127000007411866667640136666763162666676284300000581190000053612666675266466667503600000048251333333806833333350083333332225333333116933333284893333327937000001. (CC) gcc options: -O3 -pthread -lm -lc -lliquid
OpenBenchmarking.orgsamples/s, More Is BetterLiquid-DSP 1.6Threads: 256 - Buffer Length: 256 - Filter Length: 57EPYC 9684X 2PEPYC 9654 2PEPYC 9754EPYC 9754 2PXeon Platinum 8592+ 2PEPYC 9684XXeon Platinum 8490H 2PEPYC 9654Xeon Max 9480 2PXeon Max 9468 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Max 9480EPYC 8534PXeon Max 9468EPYC 8534PN1400M2800M4200M5600M7000MMin: 7925400000 / Avg: 8012700000 / Max: 8099100000Min: 7292000000 / Avg: 7411866666.67 / Max: 7484500000Min: 6375900000 / Avg: 6401366666.67 / Max: 6414800000Min: 6303500000 / Avg: 6316266666.67 / Max: 6331200000Min: 6187100000 / Avg: 6284300000 / Max: 6399500000Min: 5796900000 / Avg: 5811900000 / Max: 5824900000Min: 5358500000 / Avg: 5361266666.67 / Max: 5365900000Min: 5263000000 / Avg: 5266466666.67 / Max: 5271600000Min: 4985700000 / Avg: 5036000000 / Max: 5084200000Min: 4801700000 / Avg: 4825133333.33 / Max: 4859500000Min: 3801800000 / Avg: 3806833333.33 / Max: 3813700000Min: 3493200000 / Avg: 3500833333.33 / Max: 3511000000Min: 3218900000 / Avg: 3222533333.33 / Max: 3225700000Min: 3113900000 / Avg: 3116933333.33 / Max: 3120600000Min: 2841500000 / Avg: 2848933333.33 / Max: 2855600000Min: 2786200000 / Avg: 2793700000 / Max: 28017000001. (CC) gcc options: -O3 -pthread -lm -lc -lliquid

OpenBenchmarking.orgsamples/s, More Is BetterLiquid-DSP 1.6Threads: 256 - Buffer Length: 256 - Filter Length: 32EPYC 9684X 2PEPYC 9654 2PEPYC 9754EPYC 9754 2PXeon Platinum 8490H 2PXeon Platinum 8592+ 2PEPYC 9684XXeon Max 9480 2PEPYC 9654Xeon Max 9468 2PXeon Platinum 8490HXeon Platinum 8592+EPYC 8534PEPYC 8534PNXeon Max 9480Xeon Max 94682000M4000M6000M8000M10000MSE +/- 34610274.65, N = 3SE +/- 46730658.51, N = 3SE +/- 3768731.00, N = 3SE +/- 2936551.27, N = 3SE +/- 10496401.50, N = 3SE +/- 6711433.03, N = 3SE +/- 11426625.83, N = 3SE +/- 895048.11, N = 3SE +/- 1419311.26, N = 3SE +/- 2447674.63, N = 3SE +/- 4021608.30, N = 3SE +/- 2516611.48, N = 3SE +/- 1501110.70, N = 3SE +/- 1928730.15, N = 3SE +/- 1338323.99, N = 3SE +/- 1320353.49, N = 379352666677513333333658820000064390000006116566667607730000058624666675367033333527193333346709666673243800000316720000030622000002789600000276906666723818000001. (CC) gcc options: -O3 -pthread -lm -lc -lliquid
OpenBenchmarking.orgsamples/s, More Is BetterLiquid-DSP 1.6Threads: 256 - Buffer Length: 256 - Filter Length: 32EPYC 9684X 2PEPYC 9654 2PEPYC 9754EPYC 9754 2PXeon Platinum 8490H 2PXeon Platinum 8592+ 2PEPYC 9684XXeon Max 9480 2PEPYC 9654Xeon Max 9468 2PXeon Platinum 8490HXeon Platinum 8592+EPYC 8534PEPYC 8534PNXeon Max 9480Xeon Max 94681400M2800M4200M5600M7000MMin: 7867200000 / Avg: 7935266666.67 / Max: 7980200000Min: 7454300000 / Avg: 7513333333.33 / Max: 7605600000Min: 6583800000 / Avg: 6588200000 / Max: 6595700000Min: 6433600000 / Avg: 6439000000 / Max: 6443700000Min: 6102900000 / Avg: 6116566666.67 / Max: 6137200000Min: 6067400000 / Avg: 6077300000 / Max: 6090100000Min: 5847900000 / Avg: 5862466666.67 / Max: 5885000000Min: 5365900000 / Avg: 5367033333.33 / Max: 5368800000Min: 5269100000 / Avg: 5271933333.33 / Max: 5273500000Min: 4667100000 / Avg: 4670966666.67 / Max: 4675500000Min: 3236000000 / Avg: 3243800000 / Max: 3249400000Min: 3164200000 / Avg: 3167200000 / Max: 3172200000Min: 3059200000 / Avg: 3062200000 / Max: 3063800000Min: 2786000000 / Avg: 2789600000 / Max: 2792600000Min: 2766600000 / Avg: 2769066666.67 / Max: 2771200000Min: 2380100000 / Avg: 2381800000 / Max: 23844000001. (CC) gcc options: -O3 -pthread -lm -lc -lliquid

OpenBenchmarking.orgsamples/s, More Is BetterLiquid-DSP 1.6Threads: 128 - Buffer Length: 256 - Filter Length: 32EPYC 9684X 2PEPYC 9684XEPYC 9654 2PEPYC 9654EPYC 9754 2PEPYC 9754Xeon Platinum 8490H 2PXeon Platinum 8592+ 2PXeon Max 9480 2PXeon Max 9468 2PXeon Platinum 8490HXeon Platinum 8592+EPYC 8534PEPYC 8534PNXeon Max 9480Xeon Max 9468900M1800M2700M3600M4500MSE +/- 4250882.26, N = 3SE +/- 841295.30, N = 3SE +/- 3186603.90, N = 3SE +/- 2714365.08, N = 3SE +/- 384418.75, N = 3SE +/- 4056818.68, N = 3SE +/- 26633124.74, N = 3SE +/- 13813198.20, N = 3SE +/- 2403700.85, N = 3SE +/- 4598671.31, N = 3SE +/- 1858314.65, N = 3SE +/- 2236316.42, N = 3SE +/- 3138116.92, N = 3SE +/- 2003607.86, N = 3SE +/- 1342054.81, N = 3SE +/- 400000.00, N = 344079000004353533333406333333340327333333794133333379156666735586000003520766667333706666732540333333200600000314823333330470666672767933333273963333323519000001. (CC) gcc options: -O3 -pthread -lm -lc -lliquid
OpenBenchmarking.orgsamples/s, More Is BetterLiquid-DSP 1.6Threads: 128 - Buffer Length: 256 - Filter Length: 32EPYC 9684X 2PEPYC 9684XEPYC 9654 2PEPYC 9654EPYC 9754 2PEPYC 9754Xeon Platinum 8490H 2PXeon Platinum 8592+ 2PXeon Max 9480 2PXeon Max 9468 2PXeon Platinum 8490HXeon Platinum 8592+EPYC 8534PEPYC 8534PNXeon Max 9480Xeon Max 9468800M1600M2400M3200M4000MMin: 4400800000 / Avg: 4407900000 / Max: 4415500000Min: 4352000000 / Avg: 4353533333.33 / Max: 4354900000Min: 4058100000 / Avg: 4063333333.33 / Max: 4069100000Min: 4028100000 / Avg: 4032733333.33 / Max: 4037500000Min: 3793700000 / Avg: 3794133333.33 / Max: 3794900000Min: 3783900000 / Avg: 3791566666.67 / Max: 3797700000Min: 3510300000 / Avg: 3558600000 / Max: 3602200000Min: 3497500000 / Avg: 3520766666.67 / Max: 3545300000Min: 3332400000 / Avg: 3337066666.67 / Max: 3340400000Min: 3248800000 / Avg: 3254033333.33 / Max: 3263200000Min: 3197600000 / Avg: 3200600000 / Max: 3204000000Min: 3144000000 / Avg: 3148233333.33 / Max: 3151600000Min: 3040800000 / Avg: 3047066666.67 / Max: 3050500000Min: 2764700000 / Avg: 2767933333.33 / Max: 2771600000Min: 2737000000 / Avg: 2739633333.33 / Max: 2741400000Min: 2351100000 / Avg: 2351900000 / Max: 23523000001. (CC) gcc options: -O3 -pthread -lm -lc -lliquid

OpenBenchmarking.orgsamples/s, More Is BetterLiquid-DSP 1.6Threads: 64 - Buffer Length: 256 - Filter Length: 32EPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9684X 2PXeon Platinum 8592+ 2PXeon Max 9480 2PXeon Platinum 8490H 2PXeon Max 9468 2PXeon Platinum 8592+EPYC 9754EPYC 9754 2PXeon Platinum 8490HEPYC 8534PEPYC 8534PNXeon Max 9480Xeon Max 9468500M1000M1500M2000M2500MSE +/- 3000185.18, N = 3SE +/- 2810891.52, N = 3SE +/- 1567730.14, N = 3SE +/- 2510644.01, N = 3SE +/- 17236814.61, N = 3SE +/- 3017909.50, N = 3SE +/- 3300505.01, N = 3SE +/- 2206304.10, N = 3SE +/- 27191440.65, N = 3SE +/- 1550627.11, N = 3SE +/- 1462114.15, N = 3SE +/- 3167192.94, N = 3SE +/- 3090487.20, N = 3SE +/- 3256958.36, N = 3SE +/- 692820.32, N = 3SE +/- 688799.28, N = 322874666672282766667228206666722793000002154633333209046666720250000001963233333192776666718987666671894966667189056666718713333331776866667167970000016402666671. (CC) gcc options: -O3 -pthread -lm -lc -lliquid
OpenBenchmarking.orgsamples/s, More Is BetterLiquid-DSP 1.6Threads: 64 - Buffer Length: 256 - Filter Length: 32EPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9684X 2PXeon Platinum 8592+ 2PXeon Max 9480 2PXeon Platinum 8490H 2PXeon Max 9468 2PXeon Platinum 8592+EPYC 9754EPYC 9754 2PXeon Platinum 8490HEPYC 8534PEPYC 8534PNXeon Max 9480Xeon Max 9468400M800M1200M1600M2000MMin: 2281500000 / Avg: 2287466666.67 / Max: 2291000000Min: 2277400000 / Avg: 2282766666.67 / Max: 2286900000Min: 2279200000 / Avg: 2282066666.67 / Max: 2284600000Min: 2276400000 / Avg: 2279300000 / Max: 2284300000Min: 2127000000 / Avg: 2154633333.33 / Max: 2186300000Min: 2084800000 / Avg: 2090466666.67 / Max: 2095100000Min: 2018400000 / Avg: 2025000000 / Max: 2028400000Min: 1959200000 / Avg: 1963233333.33 / Max: 1966800000Min: 1889600000 / Avg: 1927766666.67 / Max: 1980400000Min: 1895700000 / Avg: 1898766666.67 / Max: 1900700000Min: 1892100000 / Avg: 1894966666.67 / Max: 1896900000Min: 1887300000 / Avg: 1890566666.67 / Max: 1896900000Min: 1865400000 / Avg: 1871333333.33 / Max: 1875800000Min: 1771900000 / Avg: 1776866666.67 / Max: 1783000000Min: 1678500000 / Avg: 1679700000 / Max: 1680900000Min: 1638900000 / Avg: 1640266666.67 / Max: 16411000001. (CC) gcc options: -O3 -pthread -lm -lc -lliquid

Google SynthMark

SynthMark is a cross platform tool for benchmarking CPU performance under a variety of real-time audio workloads. It uses a polyphonic synthesizer model to provide standardized tests for latency, jitter and computational throughput. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgVoices, More Is BetterGoogle SynthMark 20201109Test: VoiceMark_100Xeon Platinum 8592+Xeon Platinum 8592+ 2PEPYC 9654EPYC 9684XEPYC 9684X 2PEPYC 9654 2PXeon Platinum 8490H 2PXeon Max 9480 2PXeon Max 9480Xeon Platinum 8490HXeon Max 9468Xeon Max 9468 2PEPYC 8534PNEPYC 9754EPYC 8534PEPYC 9754 2P2004006008001000SE +/- 0.13, N = 3SE +/- 0.38, N = 3SE +/- 0.55, N = 3SE +/- 0.69, N = 3SE +/- 0.72, N = 3SE +/- 0.56, N = 3SE +/- 1.51, N = 3SE +/- 0.48, N = 3SE +/- 0.24, N = 3SE +/- 0.22, N = 3SE +/- 0.26, N = 3SE +/- 0.30, N = 3SE +/- 0.60, N = 3SE +/- 0.45, N = 3SE +/- 0.14, N = 3SE +/- 0.88, N = 3799.72799.49783.78783.42783.20782.32712.70712.09712.01711.38711.10710.92656.25655.80655.24655.051. (CXX) g++ options: -lm -lpthread -std=c++11 -Ofast
OpenBenchmarking.orgVoices, More Is BetterGoogle SynthMark 20201109Test: VoiceMark_100Xeon Platinum 8592+Xeon Platinum 8592+ 2PEPYC 9654EPYC 9684XEPYC 9684X 2PEPYC 9654 2PXeon Platinum 8490H 2PXeon Max 9480 2PXeon Max 9480Xeon Platinum 8490HXeon Max 9468Xeon Max 9468 2PEPYC 8534PNEPYC 9754EPYC 8534PEPYC 9754 2P140280420560700Min: 799.47 / Avg: 799.72 / Max: 799.89Min: 798.81 / Avg: 799.49 / Max: 800.14Min: 782.68 / Avg: 783.78 / Max: 784.37Min: 782.04 / Avg: 783.42 / Max: 784.26Min: 781.78 / Avg: 783.2 / Max: 784.13Min: 781.42 / Avg: 782.32 / Max: 783.34Min: 710.79 / Avg: 712.7 / Max: 715.68Min: 711.17 / Avg: 712.09 / Max: 712.76Min: 711.65 / Avg: 712.01 / Max: 712.48Min: 711.02 / Avg: 711.38 / Max: 711.79Min: 710.75 / Avg: 711.1 / Max: 711.61Min: 710.34 / Avg: 710.92 / Max: 711.3Min: 655.12 / Avg: 656.25 / Max: 657.16Min: 655.15 / Avg: 655.8 / Max: 656.66Min: 655 / Avg: 655.24 / Max: 655.49Min: 653.67 / Avg: 655.05 / Max: 656.691. (CXX) g++ options: -lm -lpthread -std=c++11 -Ofast

TensorFlow

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.16.1Device: CPU - Batch Size: 64 - Model: GoogLeNetXeon Platinum 8490HEPYC 9654Xeon Max 9468 2PXeon Max 9480Xeon Max 9468Xeon Platinum 8490H 2PEPYC 9684XXeon Platinum 8592+EPYC 9754Xeon Max 9480 2PXeon Platinum 8592+ 2PEPYC 8534PEPYC 8534PNEPYC 9684X 2PEPYC 9654 2PEPYC 9754 2P80160240320400SE +/- 1.62, N = 3SE +/- 4.22, N = 3SE +/- 3.52, N = 5SE +/- 0.83, N = 3SE +/- 1.94, N = 3SE +/- 2.37, N = 3SE +/- 1.66, N = 3SE +/- 1.12, N = 3SE +/- 3.84, N = 4SE +/- 2.38, N = 3SE +/- 0.21, N = 3SE +/- 0.30, N = 3SE +/- 0.44, N = 3SE +/- 2.47, N = 3SE +/- 2.41, N = 3SE +/- 1.18, N = 3380.14354.59341.51335.58333.73331.76330.26319.76314.67308.95291.37276.93256.79248.03227.22176.00
OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.16.1Device: CPU - Batch Size: 64 - Model: GoogLeNetXeon Platinum 8490HEPYC 9654Xeon Max 9468 2PXeon Max 9480Xeon Max 9468Xeon Platinum 8490H 2PEPYC 9684XXeon Platinum 8592+EPYC 9754Xeon Max 9480 2PXeon Platinum 8592+ 2PEPYC 8534PEPYC 8534PNEPYC 9684X 2PEPYC 9654 2PEPYC 9754 2P70140210280350Min: 377.14 / Avg: 380.14 / Max: 382.69Min: 346.71 / Avg: 354.59 / Max: 361.14Min: 329.53 / Avg: 341.51 / Max: 350.64Min: 334.46 / Avg: 335.58 / Max: 337.2Min: 329.88 / Avg: 333.73 / Max: 336.1Min: 327.05 / Avg: 331.76 / Max: 334.55Min: 327.17 / Avg: 330.26 / Max: 332.85Min: 317.52 / Avg: 319.76 / Max: 320.93Min: 304.02 / Avg: 314.67 / Max: 322.25Min: 306.48 / Avg: 308.95 / Max: 313.7Min: 291.02 / Avg: 291.37 / Max: 291.73Min: 276.36 / Avg: 276.93 / Max: 277.36Min: 256.05 / Avg: 256.79 / Max: 257.56Min: 244.25 / Avg: 248.03 / Max: 252.67Min: 223.25 / Avg: 227.22 / Max: 231.56Min: 173.82 / Avg: 176 / Max: 177.86

uvg266

uvg266 is an open-source VVC/H.266 (Versatile Video Coding) encoder based on Kvazaar as part of the Ultra Video Group, Tampere University, Finland. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgFrames Per Second, More Is Betteruvg266 0.4.1Video Input: Bosphorus 4K - Video Preset: SlowEPYC 9684X 2PEPYC 9654 2PEPYC 9754 2PEPYC 9684XEPYC 9754EPYC 9654Xeon Platinum 8592+ 2PXeon Platinum 8490H 2PXeon Max 9480 2PXeon Max 9468 2PEPYC 8534PXeon Platinum 8592+EPYC 8534PNXeon Platinum 8490HXeon Max 9480Xeon Max 94681020304050SE +/- 0.12, N = 4SE +/- 0.21, N = 4SE +/- 0.23, N = 4SE +/- 0.04, N = 3SE +/- 0.04, N = 3SE +/- 0.04, N = 3SE +/- 0.02, N = 3SE +/- 0.04, N = 3SE +/- 0.04, N = 3SE +/- 0.04, N = 3SE +/- 0.04, N = 3SE +/- 0.01, N = 3SE +/- 0.02, N = 3SE +/- 0.03, N = 3SE +/- 0.01, N = 3SE +/- 0.02, N = 343.3940.9637.1329.1829.0028.0127.1124.7122.1419.7517.0416.0615.7715.7113.8913.36
OpenBenchmarking.orgFrames Per Second, More Is Betteruvg266 0.4.1Video Input: Bosphorus 4K - Video Preset: SlowEPYC 9684X 2PEPYC 9654 2PEPYC 9754 2PEPYC 9684XEPYC 9754EPYC 9654Xeon Platinum 8592+ 2PXeon Platinum 8490H 2PXeon Max 9480 2PXeon Max 9468 2PEPYC 8534PXeon Platinum 8592+EPYC 8534PNXeon Platinum 8490HXeon Max 9480Xeon Max 9468918273645Min: 43.19 / Avg: 43.39 / Max: 43.68Min: 40.56 / Avg: 40.96 / Max: 41.51Min: 36.47 / Avg: 37.13 / Max: 37.47Min: 29.14 / Avg: 29.18 / Max: 29.27Min: 28.94 / Avg: 29 / Max: 29.07Min: 27.94 / Avg: 28.01 / Max: 28.06Min: 27.07 / Avg: 27.11 / Max: 27.15Min: 24.63 / Avg: 24.71 / Max: 24.76Min: 22.06 / Avg: 22.14 / Max: 22.2Min: 19.68 / Avg: 19.75 / Max: 19.79Min: 16.96 / Avg: 17.04 / Max: 17.1Min: 16.03 / Avg: 16.06 / Max: 16.08Min: 15.73 / Avg: 15.77 / Max: 15.81Min: 15.67 / Avg: 15.71 / Max: 15.76Min: 13.87 / Avg: 13.89 / Max: 13.91Min: 13.32 / Avg: 13.36 / Max: 13.39

OpenBenchmarking.orgFrames Per Second, More Is Betteruvg266 0.4.1Video Input: Bosphorus 4K - Video Preset: MediumEPYC 9684X 2PEPYC 9654 2PEPYC 9754 2PEPYC 9684XEPYC 9754EPYC 9654Xeon Platinum 8592+ 2PXeon Platinum 8490H 2PXeon Max 9480 2PXeon Max 9468 2PEPYC 8534PXeon Platinum 8490HEPYC 8534PNXeon Platinum 8592+Xeon Max 9480Xeon Max 94681020304050SE +/- 0.46, N = 4SE +/- 0.23, N = 4SE +/- 0.28, N = 11SE +/- 0.03, N = 3SE +/- 0.05, N = 3SE +/- 0.01, N = 3SE +/- 0.05, N = 3SE +/- 0.04, N = 3SE +/- 0.03, N = 3SE +/- 0.03, N = 3SE +/- 0.01, N = 3SE +/- 0.02, N = 3SE +/- 0.01, N = 3SE +/- 0.16, N = 3SE +/- 0.02, N = 3SE +/- 0.02, N = 345.2642.0338.1232.7432.4431.4430.3727.6524.6522.2519.2517.8517.8016.6415.6815.17
OpenBenchmarking.orgFrames Per Second, More Is Betteruvg266 0.4.1Video Input: Bosphorus 4K - Video Preset: MediumEPYC 9684X 2PEPYC 9654 2PEPYC 9754 2PEPYC 9684XEPYC 9754EPYC 9654Xeon Platinum 8592+ 2PXeon Platinum 8490H 2PXeon Max 9480 2PXeon Max 9468 2PEPYC 8534PXeon Platinum 8490HEPYC 8534PNXeon Platinum 8592+Xeon Max 9480Xeon Max 9468918273645Min: 44.18 / Avg: 45.26 / Max: 46.03Min: 41.57 / Avg: 42.03 / Max: 42.66Min: 36.18 / Avg: 38.12 / Max: 39.05Min: 32.7 / Avg: 32.74 / Max: 32.8Min: 32.34 / Avg: 32.44 / Max: 32.52Min: 31.41 / Avg: 31.44 / Max: 31.45Min: 30.29 / Avg: 30.37 / Max: 30.45Min: 27.57 / Avg: 27.65 / Max: 27.71Min: 24.59 / Avg: 24.65 / Max: 24.7Min: 22.2 / Avg: 22.25 / Max: 22.29Min: 19.24 / Avg: 19.25 / Max: 19.27Min: 17.83 / Avg: 17.85 / Max: 17.89Min: 17.78 / Avg: 17.8 / Max: 17.81Min: 16.41 / Avg: 16.64 / Max: 16.94Min: 15.65 / Avg: 15.68 / Max: 15.7Min: 15.13 / Avg: 15.17 / Max: 15.21

Appleseed

Appleseed is an open-source production renderer focused on physically-based global illumination rendering engine primarily designed for animation and visual effects. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterAppleseed 2.0 BetaScene: Disney MaterialEPYC 9684XEPYC 9654Xeon Platinum 8592+ 2PEPYC 9754Xeon Platinum 8592+Xeon Platinum 8490H 2PXeon Max 9480 2PXeon Max 9468 2PXeon Platinum 8490HXeon Max 9480EPYC 8534PXeon Max 9468EPYC 8534PN142842567040.9243.4543.7045.0848.4348.5649.1451.2553.4956.4056.4258.3861.36

Scene: Disney Material

EPYC 9654 2P: The test run did not produce a result.

EPYC 9684X 2P: The test run did not produce a result.

EPYC 9754 2P: The test run did not produce a result.

Blender

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 4.1Blend File: Junkshop - Compute: CPU-OnlyEPYC 9754 2PEPYC 9684X 2PEPYC 9654 2PEPYC 9754Xeon Platinum 8592+ 2PEPYC 9684XEPYC 9654Xeon Platinum 8490H 2PXeon Max 9480 2PXeon Max 9468 2PXeon Platinum 8592+EPYC 8534PXeon Platinum 8490HEPYC 8534PNXeon Max 9480Xeon Max 94681020304050SE +/- 0.02, N = 4SE +/- 0.08, N = 4SE +/- 0.02, N = 4SE +/- 0.08, N = 3SE +/- 0.09, N = 3SE +/- 0.13, N = 3SE +/- 0.06, N = 3SE +/- 0.04, N = 3SE +/- 0.19, N = 3SE +/- 0.06, N = 3SE +/- 0.10, N = 3SE +/- 0.06, N = 3SE +/- 0.24, N = 3SE +/- 0.03, N = 3SE +/- 0.10, N = 3SE +/- 0.04, N = 311.2111.4712.8717.7018.3118.6521.0221.1523.4524.9932.0835.8235.9638.8639.1742.85
OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 4.1Blend File: Junkshop - Compute: CPU-OnlyEPYC 9754 2PEPYC 9684X 2PEPYC 9654 2PEPYC 9754Xeon Platinum 8592+ 2PEPYC 9684XEPYC 9654Xeon Platinum 8490H 2PXeon Max 9480 2PXeon Max 9468 2PXeon Platinum 8592+EPYC 8534PXeon Platinum 8490HEPYC 8534PNXeon Max 9480Xeon Max 9468918273645Min: 11.16 / Avg: 11.21 / Max: 11.25Min: 11.35 / Avg: 11.47 / Max: 11.69Min: 12.8 / Avg: 12.87 / Max: 12.92Min: 17.6 / Avg: 17.7 / Max: 17.85Min: 18.17 / Avg: 18.31 / Max: 18.47Min: 18.46 / Avg: 18.65 / Max: 18.89Min: 20.94 / Avg: 21.02 / Max: 21.13Min: 21.1 / Avg: 21.15 / Max: 21.23Min: 23.22 / Avg: 23.45 / Max: 23.82Min: 24.92 / Avg: 24.99 / Max: 25.11Min: 31.88 / Avg: 32.08 / Max: 32.19Min: 35.72 / Avg: 35.82 / Max: 35.93Min: 35.61 / Avg: 35.96 / Max: 36.43Min: 38.81 / Avg: 38.86 / Max: 38.91Min: 38.99 / Avg: 39.17 / Max: 39.32Min: 42.81 / Avg: 42.85 / Max: 42.93

SVT-AV1

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 2.0Encoder Mode: Preset 4 - Input: Bosphorus 4KEPYC 9684XEPYC 9684X 2PEPYC 9654EPYC 9654 2PXeon Platinum 8592+Xeon Platinum 8592+ 2PEPYC 9754EPYC 9754 2PXeon Platinum 8490HEPYC 8534PEPYC 8534PNXeon Platinum 8490H 2PXeon Max 9480Xeon Max 9468Xeon Max 9480 2PXeon Max 9468 2P246810SE +/- 0.021, N = 3SE +/- 0.040, N = 3SE +/- 0.019, N = 3SE +/- 0.046, N = 3SE +/- 0.005, N = 3SE +/- 0.044, N = 3SE +/- 0.024, N = 3SE +/- 0.004, N = 3SE +/- 0.030, N = 3SE +/- 0.007, N = 3SE +/- 0.015, N = 3SE +/- 0.049, N = 3SE +/- 0.047, N = 3SE +/- 0.027, N = 3SE +/- 0.042, N = 3SE +/- 0.015, N = 38.5958.5138.4228.3497.8767.3607.2837.1537.0616.9396.7276.6986.5726.4906.0525.9911. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq
OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 2.0Encoder Mode: Preset 4 - Input: Bosphorus 4KEPYC 9684XEPYC 9684X 2PEPYC 9654EPYC 9654 2PXeon Platinum 8592+Xeon Platinum 8592+ 2PEPYC 9754EPYC 9754 2PXeon Platinum 8490HEPYC 8534PEPYC 8534PNXeon Platinum 8490H 2PXeon Max 9480Xeon Max 9468Xeon Max 9480 2PXeon Max 9468 2P3691215Min: 8.56 / Avg: 8.6 / Max: 8.64Min: 8.43 / Avg: 8.51 / Max: 8.56Min: 8.39 / Avg: 8.42 / Max: 8.46Min: 8.28 / Avg: 8.35 / Max: 8.43Min: 7.87 / Avg: 7.88 / Max: 7.88Min: 7.27 / Avg: 7.36 / Max: 7.42Min: 7.24 / Avg: 7.28 / Max: 7.32Min: 7.15 / Avg: 7.15 / Max: 7.16Min: 7.02 / Avg: 7.06 / Max: 7.12Min: 6.93 / Avg: 6.94 / Max: 6.95Min: 6.7 / Avg: 6.73 / Max: 6.75Min: 6.6 / Avg: 6.7 / Max: 6.75Min: 6.51 / Avg: 6.57 / Max: 6.66Min: 6.46 / Avg: 6.49 / Max: 6.54Min: 5.98 / Avg: 6.05 / Max: 6.13Min: 5.98 / Avg: 5.99 / Max: 6.021. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

Blender

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 4.1Blend File: Fishy Cat - Compute: CPU-OnlyEPYC 9754 2PEPYC 9684X 2PEPYC 9654 2PEPYC 9754Xeon Platinum 8592+ 2PEPYC 9684XXeon Platinum 8490H 2PEPYC 9654Xeon Max 9480 2PXeon Max 9468 2PXeon Platinum 8592+EPYC 8534PXeon Platinum 8490HEPYC 8534PNXeon Max 9480Xeon Max 94681020304050SE +/- 0.04, N = 5SE +/- 0.02, N = 5SE +/- 0.05, N = 4SE +/- 0.13, N = 3SE +/- 0.04, N = 3SE +/- 0.07, N = 3SE +/- 0.08, N = 3SE +/- 0.11, N = 3SE +/- 0.18, N = 3SE +/- 0.13, N = 3SE +/- 0.06, N = 3SE +/- 0.23, N = 3SE +/- 0.11, N = 3SE +/- 0.07, N = 3SE +/- 0.04, N = 3SE +/- 0.17, N = 39.7110.1611.2516.5817.2918.3619.1320.1521.4523.1731.9134.3534.8338.0438.4842.78
OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 4.1Blend File: Fishy Cat - Compute: CPU-OnlyEPYC 9754 2PEPYC 9684X 2PEPYC 9654 2PEPYC 9754Xeon Platinum 8592+ 2PEPYC 9684XXeon Platinum 8490H 2PEPYC 9654Xeon Max 9480 2PXeon Max 9468 2PXeon Platinum 8592+EPYC 8534PXeon Platinum 8490HEPYC 8534PNXeon Max 9480Xeon Max 9468918273645Min: 9.57 / Avg: 9.71 / Max: 9.77Min: 10.09 / Avg: 10.16 / Max: 10.21Min: 11.13 / Avg: 11.25 / Max: 11.35Min: 16.42 / Avg: 16.58 / Max: 16.84Min: 17.22 / Avg: 17.29 / Max: 17.37Min: 18.23 / Avg: 18.36 / Max: 18.45Min: 19.01 / Avg: 19.13 / Max: 19.28Min: 19.99 / Avg: 20.15 / Max: 20.37Min: 21.14 / Avg: 21.45 / Max: 21.75Min: 23 / Avg: 23.17 / Max: 23.42Min: 31.84 / Avg: 31.91 / Max: 32.02Min: 34.02 / Avg: 34.35 / Max: 34.8Min: 34.66 / Avg: 34.83 / Max: 35.05Min: 37.91 / Avg: 38.04 / Max: 38.14Min: 38.44 / Avg: 38.48 / Max: 38.56Min: 42.54 / Avg: 42.78 / Max: 43.11

Pennant

Pennant is an application focused on hydrodynamics on general unstructured meshes in 2D. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgHydro Cycle Time - Seconds, Fewer Is BetterPennant 1.0.1Test: sedovbigEPYC 9754 2PEPYC 9684X 2PEPYC 9654 2PEPYC 9754EPYC 9684XEPYC 9654Xeon Platinum 8592+ 2PXeon Platinum 8490H 2PEPYC 8534PXeon Max 9480 2PEPYC 8534PNXeon Max 9468 2PXeon Platinum 8490HXeon Platinum 8592+Xeon Max 9480Xeon Max 9468510152025SE +/- 0.037087, N = 15SE +/- 0.041359, N = 15SE +/- 0.040626, N = 15SE +/- 0.074320, N = 15SE +/- 0.080453, N = 15SE +/- 0.052975, N = 7SE +/- 0.018471, N = 4SE +/- 0.016400, N = 4SE +/- 0.024479, N = 4SE +/- 0.003253, N = 4SE +/- 0.029749, N = 4SE +/- 0.003237, N = 4SE +/- 0.002987, N = 3SE +/- 0.002400, N = 3SE +/- 0.013353, N = 3SE +/- 0.001847, N = 32.9404563.0811083.4083375.1476585.4606605.9164589.96452611.28438011.36964012.10690012.15132013.21125016.03080016.96910019.88246021.0211201. (CXX) g++ options: -fopenmp -lmpi_cxx -lmpi
OpenBenchmarking.orgHydro Cycle Time - Seconds, Fewer Is BetterPennant 1.0.1Test: sedovbigEPYC 9754 2PEPYC 9684X 2PEPYC 9654 2PEPYC 9754EPYC 9684XEPYC 9654Xeon Platinum 8592+ 2PXeon Platinum 8490H 2PEPYC 8534PXeon Max 9480 2PEPYC 8534PNXeon Max 9468 2PXeon Platinum 8490HXeon Platinum 8592+Xeon Max 9480Xeon Max 9468510152025Min: 2.76 / Avg: 2.94 / Max: 3.23Min: 2.92 / Avg: 3.08 / Max: 3.52Min: 3.23 / Avg: 3.41 / Max: 3.78Min: 4.77 / Avg: 5.15 / Max: 5.62Min: 5.09 / Avg: 5.46 / Max: 6.12Min: 5.72 / Avg: 5.92 / Max: 6.12Min: 9.93 / Avg: 9.96 / Max: 10.01Min: 11.26 / Avg: 11.28 / Max: 11.32Min: 11.31 / Avg: 11.37 / Max: 11.42Min: 12.1 / Avg: 12.11 / Max: 12.12Min: 12.1 / Avg: 12.15 / Max: 12.21Min: 13.2 / Avg: 13.21 / Max: 13.22Min: 16.03 / Avg: 16.03 / Max: 16.04Min: 16.96 / Avg: 16.97 / Max: 16.97Min: 19.86 / Avg: 19.88 / Max: 19.91Min: 21.02 / Avg: 21.02 / Max: 21.021. (CXX) g++ options: -fopenmp -lmpi_cxx -lmpi

Kvazaar

This is a test of Kvazaar as a CPU-based H.265/HEVC video encoder written in the C programming language and optimized in Assembly. Kvazaar is the winner of the 2016 ACM Open-Source Software Competition and developed at the Ultra Video Group, Tampere University, Finland. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgFrames Per Second, More Is BetterKvazaar 2.2Video Input: Bosphorus 4K - Video Preset: MediumEPYC 9684X 2PEPYC 9654 2PEPYC 9754 2PXeon Platinum 8592+ 2PEPYC 9684XEPYC 9654EPYC 9754Xeon Platinum 8490H 2PXeon Max 9480 2PXeon Max 9468 2PXeon Platinum 8592+EPYC 8534PEPYC 8534PNXeon Platinum 8490HXeon Max 9480Xeon Max 94681428425670SE +/- 0.40, N = 5SE +/- 0.56, N = 5SE +/- 0.52, N = 15SE +/- 0.27, N = 4SE +/- 0.01, N = 4SE +/- 0.07, N = 4SE +/- 0.04, N = 4SE +/- 0.06, N = 3SE +/- 0.07, N = 3SE +/- 0.08, N = 3SE +/- 0.03, N = 3SE +/- 0.05, N = 3SE +/- 0.03, N = 3SE +/- 0.02, N = 3SE +/- 0.02, N = 3SE +/- 0.04, N = 363.4861.1154.5741.5840.5039.5839.0832.0429.6226.6924.8024.3123.0220.9718.8418.131. (CC) gcc options: -pthread -ftree-vectorize -fvisibility=hidden -O2 -lpthread -lm -lrt
OpenBenchmarking.orgFrames Per Second, More Is BetterKvazaar 2.2Video Input: Bosphorus 4K - Video Preset: MediumEPYC 9684X 2PEPYC 9654 2PEPYC 9754 2PXeon Platinum 8592+ 2PEPYC 9684XEPYC 9654EPYC 9754Xeon Platinum 8490H 2PXeon Max 9480 2PXeon Max 9468 2PXeon Platinum 8592+EPYC 8534PEPYC 8534PNXeon Platinum 8490HXeon Max 9480Xeon Max 94681224364860Min: 62 / Avg: 63.48 / Max: 64.12Min: 59.85 / Avg: 61.11 / Max: 62.82Min: 51 / Avg: 54.57 / Max: 57.22Min: 40.95 / Avg: 41.58 / Max: 42.09Min: 40.48 / Avg: 40.5 / Max: 40.5Min: 39.47 / Avg: 39.58 / Max: 39.77Min: 38.97 / Avg: 39.08 / Max: 39.15Min: 31.94 / Avg: 32.04 / Max: 32.16Min: 29.53 / Avg: 29.62 / Max: 29.76Min: 26.53 / Avg: 26.69 / Max: 26.79Min: 24.75 / Avg: 24.8 / Max: 24.86Min: 24.22 / Avg: 24.31 / Max: 24.38Min: 22.97 / Avg: 23.02 / Max: 23.08Min: 20.94 / Avg: 20.97 / Max: 21.01Min: 18.81 / Avg: 18.84 / Max: 18.89Min: 18.06 / Avg: 18.13 / Max: 18.211. (CC) gcc options: -pthread -ftree-vectorize -fvisibility=hidden -O2 -lpthread -lm -lrt

OpenBenchmarking.orgFrames Per Second, More Is BetterKvazaar 2.2Video Input: Bosphorus 4K - Video Preset: SlowEPYC 9684X 2PEPYC 9654 2PEPYC 9754 2PXeon Platinum 8592+ 2PEPYC 9684XEPYC 9654EPYC 9754Xeon Platinum 8490H 2PXeon Max 9480 2PXeon Max 9468 2PXeon Platinum 8592+EPYC 8534PEPYC 8534PNXeon Platinum 8490HXeon Max 9480Xeon Max 94681428425670SE +/- 0.26, N = 5SE +/- 0.50, N = 5SE +/- 0.47, N = 8SE +/- 0.04, N = 4SE +/- 0.07, N = 4SE +/- 0.01, N = 4SE +/- 0.05, N = 4SE +/- 0.08, N = 3SE +/- 0.02, N = 3SE +/- 0.03, N = 3SE +/- 0.07, N = 3SE +/- 0.04, N = 3SE +/- 0.05, N = 3SE +/- 0.03, N = 3SE +/- 0.02, N = 3SE +/- 0.03, N = 362.8261.0754.8840.9240.0038.9038.4731.2428.9626.0024.2323.7122.4620.2318.2417.521. (CC) gcc options: -pthread -ftree-vectorize -fvisibility=hidden -O2 -lpthread -lm -lrt
OpenBenchmarking.orgFrames Per Second, More Is BetterKvazaar 2.2Video Input: Bosphorus 4K - Video Preset: SlowEPYC 9684X 2PEPYC 9654 2PEPYC 9754 2PXeon Platinum 8592+ 2PEPYC 9684XEPYC 9654EPYC 9754Xeon Platinum 8490H 2PXeon Max 9480 2PXeon Max 9468 2PXeon Platinum 8592+EPYC 8534PEPYC 8534PNXeon Platinum 8490HXeon Max 9480Xeon Max 94681224364860Min: 62.19 / Avg: 62.82 / Max: 63.59Min: 59.88 / Avg: 61.07 / Max: 62.54Min: 52.2 / Avg: 54.88 / Max: 56.46Min: 40.79 / Avg: 40.92 / Max: 40.99Min: 39.8 / Avg: 40 / Max: 40.13Min: 38.87 / Avg: 38.9 / Max: 38.91Min: 38.39 / Avg: 38.47 / Max: 38.62Min: 31.09 / Avg: 31.24 / Max: 31.35Min: 28.91 / Avg: 28.96 / Max: 28.99Min: 25.94 / Avg: 26 / Max: 26.06Min: 24.1 / Avg: 24.23 / Max: 24.34Min: 23.63 / Avg: 23.71 / Max: 23.76Min: 22.37 / Avg: 22.46 / Max: 22.52Min: 20.18 / Avg: 20.23 / Max: 20.29Min: 18.21 / Avg: 18.24 / Max: 18.26Min: 17.47 / Avg: 17.52 / Max: 17.571. (CC) gcc options: -pthread -ftree-vectorize -fvisibility=hidden -O2 -lpthread -lm -lrt

OpenFOAM

OpenFOAM is the leading free, open-source software for computational fluid dynamics (CFD). This test profile currently uses the drivaerFastback test case for analyzing automotive aerodynamics or alternatively the older motorBike input. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterOpenFOAM 10Input: drivaerFastback, Small Mesh Size - Execution TimeEPYC 9684X 2PXeon Platinum 8592+ 2PEPYC 9754 2PEPYC 9654 2PXeon Max 9480 2PEPYC 9684XXeon Platinum 8490H 2PXeon Max 9468 2PEPYC 9654Xeon Platinum 8592+EPYC 9754Xeon Max 9480Xeon Platinum 8490HXeon Max 9468EPYC 8534PEPYC 8534PN132639526522.7123.5624.5725.0127.5828.3328.5628.9932.5933.0733.8141.7542.2245.9558.1759.271. (CXX) g++ options: -std=c++14 -m64 -O3 -ftemplate-depth-100 -fPIC -fuse-ld=bfd -Xlinker --add-needed --no-as-needed -lfiniteVolume -lmeshTools -lparallel -llagrangian -lregionModels -lgenericPatchFields -lOpenFOAM -ldl -lm

OpenBenchmarking.orgSeconds, Fewer Is BetterOpenFOAM 10Input: drivaerFastback, Small Mesh Size - Mesh TimeEPYC 9684XEPYC 9684X 2PEPYC 9654 2PEPYC 9654Xeon Max 9480 2PXeon Platinum 8592+ 2PEPYC 9754 2PEPYC 9754Xeon Platinum 8490HXeon Platinum 8592+Xeon Max 9468Xeon Max 9480Xeon Max 9468 2PEPYC 8534PXeon Platinum 8490H 2PEPYC 8534PN81624324025.9326.8227.7428.0328.8429.3329.4730.3831.3831.7031.7832.0032.4833.6735.6036.821. (CXX) g++ options: -std=c++14 -m64 -O3 -ftemplate-depth-100 -fPIC -fuse-ld=bfd -Xlinker --add-needed --no-as-needed -lfiniteVolume -lmeshTools -lparallel -llagrangian -lregionModels -lgenericPatchFields -lOpenFOAM -ldl -lm

Pennant

Pennant is an application focused on hydrodynamics on general unstructured meshes in 2D. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgHydro Cycle Time - Seconds, Fewer Is BetterPennant 1.0.1Test: leblancbigEPYC 9684X 2PEPYC 9754 2PXeon Platinum 8592+ 2PEPYC 9654 2PXeon Max 9480 2PXeon Platinum 8490H 2PXeon Max 9468 2PEPYC 9684XEPYC 9754EPYC 9654Xeon Platinum 8592+Xeon Platinum 8490HXeon Max 9480Xeon Max 9468EPYC 8534PEPYC 8534PN246810SE +/- 0.055800, N = 15SE +/- 0.022246, N = 15SE +/- 0.013568, N = 6SE +/- 0.063684, N = 15SE +/- 0.008354, N = 7SE +/- 0.019069, N = 15SE +/- 0.010204, N = 7SE +/- 0.115724, N = 15SE +/- 0.115702, N = 15SE +/- 0.115723, N = 15SE +/- 0.022698, N = 7SE +/- 0.022393, N = 7SE +/- 0.023904, N = 7SE +/- 0.025580, N = 6SE +/- 0.057580, N = 6SE +/- 0.045713, N = 132.0768352.0843842.1594592.3129772.5273632.5298072.8810993.3604533.6543033.7548354.1827074.9558655.1141615.9309576.5417686.8527121. (CXX) g++ options: -fopenmp -lmpi_cxx -lmpi
OpenBenchmarking.orgHydro Cycle Time - Seconds, Fewer Is BetterPennant 1.0.1Test: leblancbigEPYC 9684X 2PEPYC 9754 2PXeon Platinum 8592+ 2PEPYC 9654 2PXeon Max 9480 2PXeon Platinum 8490H 2PXeon Max 9468 2PEPYC 9684XEPYC 9754EPYC 9654Xeon Platinum 8592+Xeon Platinum 8490HXeon Max 9480Xeon Max 9468EPYC 8534PEPYC 8534PN3691215Min: 1.76 / Avg: 2.08 / Max: 2.35Min: 1.86 / Avg: 2.08 / Max: 2.19Min: 2.1 / Avg: 2.16 / Max: 2.2Min: 1.92 / Avg: 2.31 / Max: 2.62Min: 2.5 / Avg: 2.53 / Max: 2.55Min: 2.43 / Avg: 2.53 / Max: 2.69Min: 2.84 / Avg: 2.88 / Max: 2.91Min: 2.91 / Avg: 3.36 / Max: 4.42Min: 2.73 / Avg: 3.65 / Max: 3.93Min: 3.25 / Avg: 3.75 / Max: 4.92Min: 4.11 / Avg: 4.18 / Max: 4.29Min: 4.88 / Avg: 4.96 / Max: 5.02Min: 5.02 / Avg: 5.11 / Max: 5.19Min: 5.84 / Avg: 5.93 / Max: 6Min: 6.43 / Avg: 6.54 / Max: 6.77Min: 6.71 / Avg: 6.85 / Max: 7.311. (CXX) g++ options: -fopenmp -lmpi_cxx -lmpi

Intel Open Image Denoise

Open Image Denoise is a denoising library for ray-tracing and part of the Intel oneAPI rendering toolkit. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgImages / Sec, More Is BetterIntel Open Image Denoise 2.2Run: RTLightmap.hdr.4096x4096 - Device: CPU-OnlyXeon Platinum 8592+ 2PXeon Platinum 8490H 2PXeon Max 9480 2PXeon Max 9468 2PEPYC 9754 2PEPYC 9654 2PEPYC 9684X 2PXeon Platinum 8592+EPYC 9754EPYC 9654Xeon Platinum 8490HEPYC 9684XXeon Max 9480Xeon Max 9468EPYC 8534PEPYC 8534PN0.541.081.622.162.7SE +/- 0.01, N = 4SE +/- 0.01, N = 4SE +/- 0.01, N = 3SE +/- 0.02, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.01, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.01, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 32.402.181.741.721.711.671.641.581.501.311.291.281.141.080.860.80
OpenBenchmarking.orgImages / Sec, More Is BetterIntel Open Image Denoise 2.2Run: RTLightmap.hdr.4096x4096 - Device: CPU-OnlyXeon Platinum 8592+ 2PXeon Platinum 8490H 2PXeon Max 9480 2PXeon Max 9468 2PEPYC 9754 2PEPYC 9654 2PEPYC 9684X 2PXeon Platinum 8592+EPYC 9754EPYC 9654Xeon Platinum 8490HEPYC 9684XXeon Max 9480Xeon Max 9468EPYC 8534PEPYC 8534PN246810Min: 2.36 / Avg: 2.4 / Max: 2.43Min: 2.17 / Avg: 2.18 / Max: 2.2Min: 1.72 / Avg: 1.74 / Max: 1.77Min: 1.69 / Avg: 1.72 / Max: 1.75Min: 1.7 / Avg: 1.71 / Max: 1.71Min: 1.67 / Avg: 1.67 / Max: 1.67Min: 1.63 / Avg: 1.64 / Max: 1.64Min: 1.57 / Avg: 1.58 / Max: 1.58Min: 1.49 / Avg: 1.5 / Max: 1.5Min: 1.3 / Avg: 1.31 / Max: 1.32Min: 1.29 / Avg: 1.29 / Max: 1.29Min: 1.26 / Avg: 1.28 / Max: 1.3Min: 1.14 / Avg: 1.14 / Max: 1.14Min: 1.08 / Avg: 1.08 / Max: 1.08Min: 0.86 / Avg: 0.86 / Max: 0.86Min: 0.8 / Avg: 0.8 / Max: 0.8

uvg266

uvg266 is an open-source VVC/H.266 (Versatile Video Coding) encoder based on Kvazaar as part of the Ultra Video Group, Tampere University, Finland. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgFrames Per Second, More Is Betteruvg266 0.4.1Video Input: Bosphorus 4K - Video Preset: Very FastEPYC 9684XEPYC 9654EPYC 9684X 2PXeon Platinum 8490H 2PEPYC 9754Xeon Platinum 8592+ 2PEPYC 9654 2PEPYC 8534PXeon Platinum 8490HXeon Max 9480 2PEPYC 9754 2PEPYC 8534PNXeon Max 9468 2PXeon Max 9480Xeon Max 9468Xeon Platinum 8592+1428425670SE +/- 0.13, N = 5SE +/- 0.13, N = 5SE +/- 0.12, N = 5SE +/- 0.50, N = 5SE +/- 0.18, N = 5SE +/- 0.16, N = 5SE +/- 0.55, N = 5SE +/- 0.08, N = 4SE +/- 0.01, N = 4SE +/- 0.38, N = 9SE +/- 0.43, N = 15SE +/- 0.06, N = 4SE +/- 0.39, N = 4SE +/- 0.02, N = 4SE +/- 0.12, N = 4SE +/- 0.08, N = 362.7062.0255.0554.8854.4653.6653.4450.0449.4246.2546.0044.9244.7540.8239.5635.10
OpenBenchmarking.orgFrames Per Second, More Is Betteruvg266 0.4.1Video Input: Bosphorus 4K - Video Preset: Very FastEPYC 9684XEPYC 9654EPYC 9684X 2PXeon Platinum 8490H 2PEPYC 9754Xeon Platinum 8592+ 2PEPYC 9654 2PEPYC 8534PXeon Platinum 8490HXeon Max 9480 2PEPYC 9754 2PEPYC 8534PNXeon Max 9468 2PXeon Max 9480Xeon Max 9468Xeon Platinum 8592+1224364860Min: 62.21 / Avg: 62.7 / Max: 62.95Min: 61.51 / Avg: 62.02 / Max: 62.28Min: 54.78 / Avg: 55.05 / Max: 55.4Min: 53.2 / Avg: 54.88 / Max: 55.71Min: 53.97 / Avg: 54.46 / Max: 55.06Min: 53.09 / Avg: 53.66 / Max: 54.03Min: 51.67 / Avg: 53.44 / Max: 54.35Min: 49.88 / Avg: 50.04 / Max: 50.22Min: 49.38 / Avg: 49.42 / Max: 49.44Min: 43.42 / Avg: 46.25 / Max: 47.35Min: 43.34 / Avg: 46 / Max: 49.47Min: 44.76 / Avg: 44.92 / Max: 45.03Min: 43.63 / Avg: 44.75 / Max: 45.44Min: 40.78 / Avg: 40.82 / Max: 40.87Min: 39.31 / Avg: 39.56 / Max: 39.87Min: 35 / Avg: 35.1 / Max: 35.26

TensorFlow

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.16.1Device: CPU - Batch Size: 64 - Model: AlexNetXeon Platinum 8490H 2PXeon Platinum 8490HEPYC 9654Xeon Max 9480 2PXeon Max 9468 2PEPYC 9754EPYC 9684XXeon Platinum 8592+ 2PXeon Max 9480Xeon Max 9468Xeon Platinum 8592+EPYC 9684X 2PEPYC 9654 2PEPYC 8534PEPYC 9754 2PEPYC 8534PN2004006008001000SE +/- 7.98, N = 5SE +/- 0.51, N = 5SE +/- 1.31, N = 5SE +/- 7.35, N = 5SE +/- 6.39, N = 13SE +/- 2.99, N = 5SE +/- 1.37, N = 5SE +/- 2.22, N = 5SE +/- 2.31, N = 5SE +/- 1.95, N = 5SE +/- 6.22, N = 5SE +/- 7.66, N = 5SE +/- 8.87, N = 4SE +/- 0.45, N = 4SE +/- 7.43, N = 15SE +/- 0.16, N = 4996.47969.62942.19940.40932.59924.80868.54858.84852.36841.68819.89738.31727.77673.42658.97617.03
OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.16.1Device: CPU - Batch Size: 64 - Model: AlexNetXeon Platinum 8490H 2PXeon Platinum 8490HEPYC 9654Xeon Max 9480 2PXeon Max 9468 2PEPYC 9754EPYC 9684XXeon Platinum 8592+ 2PXeon Max 9480Xeon Max 9468Xeon Platinum 8592+EPYC 9684X 2PEPYC 9654 2PEPYC 8534PEPYC 9754 2PEPYC 8534PN2004006008001000Min: 974.8 / Avg: 996.47 / Max: 1013.95Min: 967.81 / Avg: 969.62 / Max: 970.66Min: 938.43 / Avg: 942.19 / Max: 945.54Min: 915.38 / Avg: 940.4 / Max: 955.94Min: 886.72 / Avg: 932.59 / Max: 964.83Min: 919.56 / Avg: 924.8 / Max: 935.78Min: 865.09 / Avg: 868.54 / Max: 871.49Min: 851.44 / Avg: 858.84 / Max: 863.21Min: 843.3 / Avg: 852.36 / Max: 855.6Min: 835.07 / Avg: 841.68 / Max: 847.3Min: 804.06 / Avg: 819.89 / Max: 835.54Min: 720.46 / Avg: 738.31 / Max: 762.68Min: 701.83 / Avg: 727.77 / Max: 739.34Min: 672.34 / Avg: 673.42 / Max: 674.49Min: 602.85 / Avg: 658.97 / Max: 687.47Min: 616.65 / Avg: 617.03 / Max: 617.39

Blender

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 4.1Blend File: BMW27 - Compute: CPU-OnlyEPYC 9754 2PEPYC 9684X 2PEPYC 9654 2PXeon Platinum 8592+ 2PEPYC 9754Xeon Platinum 8490H 2PEPYC 9684XXeon Max 9480 2PEPYC 9654Xeon Max 9468 2PXeon Platinum 8592+Xeon Platinum 8490HEPYC 8534PXeon Max 9480EPYC 8534PNXeon Max 9468714212835SE +/- 0.02, N = 6SE +/- 0.03, N = 6SE +/- 0.02, N = 5SE +/- 0.03, N = 4SE +/- 0.01, N = 4SE +/- 0.08, N = 4SE +/- 0.04, N = 4SE +/- 0.08, N = 4SE +/- 0.07, N = 4SE +/- 0.03, N = 3SE +/- 0.04, N = 3SE +/- 0.15, N = 3SE +/- 0.04, N = 3SE +/- 0.24, N = 3SE +/- 0.05, N = 3SE +/- 0.11, N = 37.177.758.6112.7612.8613.7414.2915.2915.9616.5523.7225.8927.1228.4930.0731.66
OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 4.1Blend File: BMW27 - Compute: CPU-OnlyEPYC 9754 2PEPYC 9684X 2PEPYC 9654 2PXeon Platinum 8592+ 2PEPYC 9754Xeon Platinum 8490H 2PEPYC 9684XXeon Max 9480 2PEPYC 9654Xeon Max 9468 2PXeon Platinum 8592+Xeon Platinum 8490HEPYC 8534PXeon Max 9480EPYC 8534PNXeon Max 9468714212835Min: 7.12 / Avg: 7.17 / Max: 7.24Min: 7.66 / Avg: 7.75 / Max: 7.83Min: 8.56 / Avg: 8.61 / Max: 8.66Min: 12.68 / Avg: 12.76 / Max: 12.84Min: 12.84 / Avg: 12.86 / Max: 12.9Min: 13.55 / Avg: 13.74 / Max: 13.95Min: 14.23 / Avg: 14.29 / Max: 14.39Min: 15.11 / Avg: 15.29 / Max: 15.48Min: 15.8 / Avg: 15.96 / Max: 16.15Min: 16.52 / Avg: 16.55 / Max: 16.6Min: 23.65 / Avg: 23.72 / Max: 23.79Min: 25.7 / Avg: 25.89 / Max: 26.18Min: 27.05 / Avg: 27.12 / Max: 27.2Min: 28.24 / Avg: 28.49 / Max: 28.97Min: 29.97 / Avg: 30.07 / Max: 30.13Min: 31.52 / Avg: 31.66 / Max: 31.88

Timed FFmpeg Compilation

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed FFmpeg Compilation 7.0Time To CompileXeon Platinum 8592+ 2PEPYC 9684X 2PEPYC 9654 2PXeon Platinum 8490H 2PEPYC 9684XXeon Max 9480 2PEPYC 9654Xeon Max 9468 2PEPYC 9754 2PXeon Platinum 8592+EPYC 9754Xeon Platinum 8490HXeon Max 9480Xeon Max 9468EPYC 8534PEPYC 8534PN714212835SE +/- 0.05, N = 3SE +/- 0.03, N = 3SE +/- 0.05, N = 3SE +/- 0.01, N = 3SE +/- 0.02, N = 3SE +/- 0.03, N = 3SE +/- 0.03, N = 3SE +/- 0.09, N = 3SE +/- 0.30, N = 3SE +/- 0.07, N = 3SE +/- 0.11, N = 3SE +/- 0.04, N = 3SE +/- 0.09, N = 3SE +/- 0.03, N = 3SE +/- 0.05, N = 3SE +/- 0.04, N = 317.3917.8418.0919.5119.9920.0120.4920.7921.2221.3623.2224.0624.8426.4627.5428.42
OpenBenchmarking.orgSeconds, Fewer Is BetterTimed FFmpeg Compilation 7.0Time To CompileXeon Platinum 8592+ 2PEPYC 9684X 2PEPYC 9654 2PXeon Platinum 8490H 2PEPYC 9684XXeon Max 9480 2PEPYC 9654Xeon Max 9468 2PEPYC 9754 2PXeon Platinum 8592+EPYC 9754Xeon Platinum 8490HXeon Max 9480Xeon Max 9468EPYC 8534PEPYC 8534PN612182430Min: 17.29 / Avg: 17.39 / Max: 17.47Min: 17.77 / Avg: 17.84 / Max: 17.89Min: 17.99 / Avg: 18.09 / Max: 18.17Min: 19.48 / Avg: 19.51 / Max: 19.53Min: 19.97 / Avg: 19.99 / Max: 20.02Min: 19.96 / Avg: 20.01 / Max: 20.06Min: 20.46 / Avg: 20.49 / Max: 20.55Min: 20.61 / Avg: 20.79 / Max: 20.91Min: 20.82 / Avg: 21.22 / Max: 21.8Min: 21.25 / Avg: 21.36 / Max: 21.48Min: 23 / Avg: 23.22 / Max: 23.34Min: 23.99 / Avg: 24.06 / Max: 24.11Min: 24.75 / Avg: 24.84 / Max: 25.02Min: 26.4 / Avg: 26.46 / Max: 26.49Min: 27.44 / Avg: 27.54 / Max: 27.63Min: 28.37 / Avg: 28.42 / Max: 28.49

NAS Parallel Benchmarks

NPB, NAS Parallel Benchmarks, is a benchmark developed by NASA for high-end computer systems. This test profile currently uses the MPI version of NPB. This test profile offers selecting the different NPB tests/problems and varying problem sizes. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgTotal Mop/s, More Is BetterNAS Parallel Benchmarks 3.4Test / Class: LU.CEPYC 9754 2PEPYC 9684X 2PEPYC 9654 2PXeon Platinum 8592+ 2PEPYC 9684XEPYC 9754EPYC 9654Xeon Platinum 8490H 2PXeon Max 9480 2PXeon Max 9468 2PXeon Platinum 8592+Xeon Platinum 8490HEPYC 8534PXeon Max 9480EPYC 8534PNXeon Max 9468130K260K390K520K650KSE +/- 5800.63, N = 15SE +/- 1879.23, N = 6SE +/- 4162.49, N = 6SE +/- 726.00, N = 5SE +/- 1849.65, N = 6SE +/- 2566.89, N = 15SE +/- 789.76, N = 5SE +/- 398.40, N = 5SE +/- 411.20, N = 5SE +/- 441.66, N = 5SE +/- 213.44, N = 5SE +/- 130.20, N = 4SE +/- 314.42, N = 4SE +/- 37.04, N = 4SE +/- 274.93, N = 3SE +/- 71.37, N = 3588329.32551955.55472931.04455312.09362511.43279397.45269047.28261127.09257384.55246822.52232012.77135125.15133284.46131606.86130839.12126171.521. (F9X) gfortran options: -O3 -march=native -lmpi_usempif08 -lmpi_mpifh -lmpi -lopen-rte -lopen-pal -lhwloc -levent_core -levent_pthreads -lm -lz 2. Open MPI 4.1.6
OpenBenchmarking.orgTotal Mop/s, More Is BetterNAS Parallel Benchmarks 3.4Test / Class: LU.CEPYC 9754 2PEPYC 9684X 2PEPYC 9654 2PXeon Platinum 8592+ 2PEPYC 9684XEPYC 9754EPYC 9654Xeon Platinum 8490H 2PXeon Max 9480 2PXeon Max 9468 2PXeon Platinum 8592+Xeon Platinum 8490HEPYC 8534PXeon Max 9480EPYC 8534PNXeon Max 9468100K200K300K400K500KMin: 544633.25 / Avg: 588329.32 / Max: 617486.61Min: 546984.31 / Avg: 551955.55 / Max: 558380.76Min: 458815.95 / Avg: 472931.04 / Max: 484561.08Min: 453562.19 / Avg: 455312.09 / Max: 457552.33Min: 356268.89 / Avg: 362511.43 / Max: 368633.83Min: 253788.71 / Avg: 279397.45 / Max: 288536.79Min: 266894.47 / Avg: 269047.28 / Max: 271534.97Min: 259931.1 / Avg: 261127.09 / Max: 262324.4Min: 256169.08 / Avg: 257384.55 / Max: 258663.51Min: 245480.17 / Avg: 246822.52 / Max: 248109.68Min: 231497.6 / Avg: 232012.77 / Max: 232534.8Min: 134862.89 / Avg: 135125.15 / Max: 135480.43Min: 132604.66 / Avg: 133284.46 / Max: 134072.91Min: 131510.26 / Avg: 131606.86 / Max: 131683.36Min: 130500.1 / Avg: 130839.12 / Max: 131383.55Min: 126028.82 / Avg: 126171.52 / Max: 126245.731. (F9X) gfortran options: -O3 -march=native -lmpi_usempif08 -lmpi_mpifh -lmpi -lopen-rte -lopen-pal -lhwloc -levent_core -levent_pthreads -lm -lz 2. Open MPI 4.1.6

ASTC Encoder

OpenBenchmarking.orgMT/s, More Is BetterASTC Encoder 4.7Preset: ThoroughEPYC 9754 2PEPYC 9684X 2PEPYC 9654 2PXeon Platinum 8592+ 2PXeon Platinum 8490H 2PEPYC 9754Xeon Max 9480 2PEPYC 9684XXeon Max 9468 2PEPYC 9654Xeon Platinum 8592+Xeon Platinum 8490HXeon Max 9480EPYC 8534PEPYC 8534PNXeon Max 9468306090120150SE +/- 1.20, N = 5SE +/- 1.46, N = 12SE +/- 0.73, N = 15SE +/- 0.55, N = 5SE +/- 0.19, N = 5SE +/- 0.01, N = 5SE +/- 0.03, N = 5SE +/- 0.06, N = 5SE +/- 0.05, N = 4SE +/- 0.01, N = 4SE +/- 0.05, N = 4SE +/- 0.01, N = 4SE +/- 0.03, N = 4SE +/- 0.02, N = 4SE +/- 0.02, N = 3SE +/- 0.01, N = 3121.30116.12105.4197.9486.9886.0183.3473.3872.3365.3054.4551.3042.9841.0237.9637.011. (CXX) g++ options: -O3 -flto -pthread
OpenBenchmarking.orgMT/s, More Is BetterASTC Encoder 4.7Preset: ThoroughEPYC 9754 2PEPYC 9684X 2PEPYC 9654 2PXeon Platinum 8592+ 2PXeon Platinum 8490H 2PEPYC 9754Xeon Max 9480 2PEPYC 9684XXeon Max 9468 2PEPYC 9654Xeon Platinum 8592+Xeon Platinum 8490HXeon Max 9480EPYC 8534PEPYC 8534PNXeon Max 946820406080100Min: 118.96 / Avg: 121.3 / Max: 125.71Min: 107.46 / Avg: 116.12 / Max: 124.21Min: 100.32 / Avg: 105.41 / Max: 110.01Min: 96.94 / Avg: 97.94 / Max: 100Min: 86.65 / Avg: 86.98 / Max: 87.71Min: 85.97 / Avg: 86.01 / Max: 86.04Min: 83.28 / Avg: 83.34 / Max: 83.41Min: 73.21 / Avg: 73.38 / Max: 73.53Min: 72.18 / Avg: 72.33 / Max: 72.42Min: 65.27 / Avg: 65.3 / Max: 65.32Min: 54.31 / Avg: 54.45 / Max: 54.51Min: 51.28 / Avg: 51.3 / Max: 51.34Min: 42.9 / Avg: 42.98 / Max: 43.03Min: 40.97 / Avg: 41.02 / Max: 41.06Min: 37.92 / Avg: 37.96 / Max: 37.99Min: 36.99 / Avg: 37.01 / Max: 37.021. (CXX) g++ options: -O3 -flto -pthread

NAS Parallel Benchmarks

NPB, NAS Parallel Benchmarks, is a benchmark developed by NASA for high-end computer systems. This test profile currently uses the MPI version of NPB. This test profile offers selecting the different NPB tests/problems and varying problem sizes. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgTotal Mop/s, More Is BetterNAS Parallel Benchmarks 3.4Test / Class: IS.DEPYC 9684X 2PEPYC 9654 2PEPYC 9754 2PXeon Platinum 8592+ 2PEPYC 9684XEPYC 9754EPYC 9654Xeon Platinum 8592+Xeon Platinum 8490H 2PXeon Max 9480 2PXeon Max 9468 2PXeon Max 9480Xeon Max 9468Xeon Platinum 8490HEPYC 8534PEPYC 8534PN3K6K9K12K15KSE +/- 119.22, N = 6SE +/- 76.70, N = 10SE +/- 85.04, N = 8SE +/- 155.00, N = 15SE +/- 29.95, N = 5SE +/- 35.67, N = 5SE +/- 17.53, N = 5SE +/- 8.92, N = 4SE +/- 23.92, N = 4SE +/- 4.96, N = 4SE +/- 12.99, N = 4SE +/- 18.08, N = 4SE +/- 15.55, N = 4SE +/- 6.56, N = 3SE +/- 9.85, N = 4SE +/- 14.39, N = 412296.2710139.699771.417437.816346.155702.135229.414059.703960.283819.833816.703076.663050.162865.722746.202718.941. (F9X) gfortran options: -O3 -march=native -lmpi_usempif08 -lmpi_mpifh -lmpi -lopen-rte -lopen-pal -lhwloc -levent_core -levent_pthreads -lm -lz 2. Open MPI 4.1.6
OpenBenchmarking.orgTotal Mop/s, More Is BetterNAS Parallel Benchmarks 3.4Test / Class: IS.DEPYC 9684X 2PEPYC 9654 2PEPYC 9754 2PXeon Platinum 8592+ 2PEPYC 9684XEPYC 9754EPYC 9654Xeon Platinum 8592+Xeon Platinum 8490H 2PXeon Max 9480 2PXeon Max 9468 2PXeon Max 9480Xeon Max 9468Xeon Platinum 8490HEPYC 8534PEPYC 8534PN2K4K6K8K10KMin: 11978.42 / Avg: 12296.27 / Max: 12792.55Min: 9706.9 / Avg: 10139.69 / Max: 10398.37Min: 9316.13 / Avg: 9771.41 / Max: 10073.61Min: 6535.32 / Avg: 7437.81 / Max: 8135.72Min: 6229.45 / Avg: 6346.15 / Max: 6392.36Min: 5579.72 / Avg: 5702.13 / Max: 5796.67Min: 5186.28 / Avg: 5229.41 / Max: 5274.14Min: 4037.02 / Avg: 4059.7 / Max: 4080.47Min: 3893.71 / Avg: 3960.28 / Max: 3998.43Min: 3805.61 / Avg: 3819.83 / Max: 3827.3Min: 3782.03 / Avg: 3816.7 / Max: 3842.02Min: 3024.29 / Avg: 3076.66 / Max: 3104.23Min: 3009.06 / Avg: 3050.16 / Max: 3079.43Min: 2855.78 / Avg: 2865.72 / Max: 2878.11Min: 2725.72 / Avg: 2746.2 / Max: 2765.92Min: 2688.66 / Avg: 2718.94 / Max: 2754.521. (F9X) gfortran options: -O3 -march=native -lmpi_usempif08 -lmpi_mpifh -lmpi -lopen-rte -lopen-pal -lhwloc -levent_core -levent_pthreads -lm -lz 2. Open MPI 4.1.6

SVT-AV1

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 2.0Encoder Mode: Preset 8 - Input: Bosphorus 4KEPYC 9654EPYC 9684X 2PEPYC 9654 2PEPYC 9684XXeon Platinum 8592+EPYC 9754EPYC 9754 2PXeon Platinum 8490HXeon Platinum 8592+ 2PEPYC 8534PXeon Max 9480Xeon Platinum 8490H 2PEPYC 8534PNXeon Max 9468Xeon Max 9480 2PXeon Max 9468 2P20406080100SE +/- 0.56, N = 5SE +/- 0.63, N = 5SE +/- 0.40, N = 5SE +/- 0.42, N = 5SE +/- 0.22, N = 5SE +/- 0.38, N = 5SE +/- 0.31, N = 4SE +/- 0.20, N = 5SE +/- 0.79, N = 5SE +/- 0.11, N = 4SE +/- 0.29, N = 4SE +/- 0.46, N = 4SE +/- 0.67, N = 4SE +/- 0.26, N = 4SE +/- 0.44, N = 15SE +/- 0.58, N = 587.9987.8286.3486.3079.4478.7477.6070.9170.4368.1965.3665.2264.7962.7555.9854.821. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq
OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 2.0Encoder Mode: Preset 8 - Input: Bosphorus 4KEPYC 9654EPYC 9684X 2PEPYC 9654 2PEPYC 9684XXeon Platinum 8592+EPYC 9754EPYC 9754 2PXeon Platinum 8490HXeon Platinum 8592+ 2PEPYC 8534PXeon Max 9480Xeon Platinum 8490H 2PEPYC 8534PNXeon Max 9468Xeon Max 9480 2PXeon Max 9468 2P20406080100Min: 87.19 / Avg: 87.99 / Max: 90.1Min: 86.16 / Avg: 87.82 / Max: 89.96Min: 85.17 / Avg: 86.34 / Max: 87.48Min: 85.05 / Avg: 86.3 / Max: 87.48Min: 78.71 / Avg: 79.44 / Max: 80.05Min: 77.49 / Avg: 78.74 / Max: 79.79Min: 76.99 / Avg: 77.6 / Max: 78.2Min: 70.19 / Avg: 70.91 / Max: 71.45Min: 68.36 / Avg: 70.43 / Max: 73.07Min: 68 / Avg: 68.19 / Max: 68.46Min: 64.77 / Avg: 65.36 / Max: 66.14Min: 64.17 / Avg: 65.22 / Max: 66.2Min: 63.17 / Avg: 64.79 / Max: 66.14Min: 62.03 / Avg: 62.75 / Max: 63.22Min: 53.7 / Avg: 55.98 / Max: 59Min: 53.25 / Avg: 54.82 / Max: 56.571. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

x265

OpenBenchmarking.orgFrames Per Second, More Is Betterx265 3.6Video Input: Bosphorus 4KXeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PEPYC 9684XEPYC 9684X 2PEPYC 9654Xeon Max 9480Xeon Max 9468EPYC 9654 2PEPYC 9754EPYC 8534PEPYC 9754 2PXeon Max 9480 2PEPYC 8534PNXeon Max 9468 2P918273645SE +/- 0.09, N = 4SE +/- 0.06, N = 4SE +/- 0.11, N = 4SE +/- 0.20, N = 4SE +/- 0.11, N = 3SE +/- 0.10, N = 3SE +/- 0.08, N = 3SE +/- 0.39, N = 3SE +/- 0.08, N = 3SE +/- 0.09, N = 3SE +/- 0.02, N = 3SE +/- 0.06, N = 3SE +/- 0.06, N = 3SE +/- 0.10, N = 3SE +/- 0.06, N = 3SE +/- 0.12, N = 339.3138.9337.8637.0432.1231.9531.7231.4029.0528.8128.1628.1328.1127.9027.7427.261. (CXX) g++ options: -O3 -rdynamic -lpthread -lrt -ldl -lnuma
OpenBenchmarking.orgFrames Per Second, More Is Betterx265 3.6Video Input: Bosphorus 4KXeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PEPYC 9684XEPYC 9684X 2PEPYC 9654Xeon Max 9480Xeon Max 9468EPYC 9654 2PEPYC 9754EPYC 8534PEPYC 9754 2PXeon Max 9480 2PEPYC 8534PNXeon Max 9468 2P816243240Min: 39.1 / Avg: 39.31 / Max: 39.54Min: 38.78 / Avg: 38.93 / Max: 39.05Min: 37.57 / Avg: 37.86 / Max: 38.09Min: 36.47 / Avg: 37.04 / Max: 37.35Min: 31.92 / Avg: 32.12 / Max: 32.31Min: 31.8 / Avg: 31.95 / Max: 32.13Min: 31.6 / Avg: 31.72 / Max: 31.86Min: 30.63 / Avg: 31.4 / Max: 31.86Min: 28.95 / Avg: 29.05 / Max: 29.2Min: 28.64 / Avg: 28.81 / Max: 28.91Min: 28.12 / Avg: 28.16 / Max: 28.18Min: 28 / Avg: 28.13 / Max: 28.19Min: 28 / Avg: 28.11 / Max: 28.2Min: 27.71 / Avg: 27.9 / Max: 28.05Min: 27.64 / Avg: 27.74 / Max: 27.84Min: 27.05 / Avg: 27.26 / Max: 27.461. (CXX) g++ options: -O3 -rdynamic -lpthread -lrt -ldl -lnuma

NAS Parallel Benchmarks

NPB, NAS Parallel Benchmarks, is a benchmark developed by NASA for high-end computer systems. This test profile currently uses the MPI version of NPB. This test profile offers selecting the different NPB tests/problems and varying problem sizes. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgTotal Mop/s, More Is BetterNAS Parallel Benchmarks 3.4Test / Class: SP.CEPYC 9684X 2PEPYC 9654 2PXeon Platinum 8592+ 2PEPYC 9684XEPYC 9754 2PXeon Platinum 8490H 2PXeon Max 9480 2PXeon Max 9468 2PEPYC 9754EPYC 9654Xeon Platinum 8592+Xeon Platinum 8490HXeon Max 9480Xeon Max 9468EPYC 8534PEPYC 8534PN80K160K240K320K400KSE +/- 1666.53, N = 6SE +/- 1929.89, N = 5SE +/- 1528.09, N = 5SE +/- 1178.78, N = 6SE +/- 2064.71, N = 6SE +/- 560.20, N = 4SE +/- 420.81, N = 4SE +/- 679.14, N = 4SE +/- 126.50, N = 4SE +/- 72.03, N = 4SE +/- 31.76, N = 4SE +/- 150.79, N = 3SE +/- 9.58, N = 3SE +/- 67.02, N = 3SE +/- 23.20, N = 3SE +/- 14.31, N = 3390520.93256584.67228184.68225311.82214017.18147311.14141954.15135939.25127519.37125191.11109416.4271245.2669776.4158815.3652745.6452684.931. (F9X) gfortran options: -O3 -march=native -lmpi_usempif08 -lmpi_mpifh -lmpi -lopen-rte -lopen-pal -lhwloc -levent_core -levent_pthreads -lm -lz 2. Open MPI 4.1.6
OpenBenchmarking.orgTotal Mop/s, More Is BetterNAS Parallel Benchmarks 3.4Test / Class: SP.CEPYC 9684X 2PEPYC 9654 2PXeon Platinum 8592+ 2PEPYC 9684XEPYC 9754 2PXeon Platinum 8490H 2PXeon Max 9480 2PXeon Max 9468 2PEPYC 9754EPYC 9654Xeon Platinum 8592+Xeon Platinum 8490HXeon Max 9480Xeon Max 9468EPYC 8534PEPYC 8534PN70K140K210K280K350KMin: 385928.37 / Avg: 390520.93 / Max: 396167.98Min: 249743.44 / Avg: 256584.67 / Max: 261160.94Min: 224647.99 / Avg: 228184.68 / Max: 232147.61Min: 221445.14 / Avg: 225311.82 / Max: 229655.95Min: 204670.06 / Avg: 214017.18 / Max: 217535.21Min: 145959.03 / Avg: 147311.14 / Max: 148493.65Min: 141180.27 / Avg: 141954.15 / Max: 143017.08Min: 134710.35 / Avg: 135939.25 / Max: 137559.55Min: 127231.63 / Avg: 127519.37 / Max: 127812.63Min: 124982.39 / Avg: 125191.11 / Max: 125309.88Min: 109336.91 / Avg: 109416.42 / Max: 109491.39Min: 70955.45 / Avg: 71245.26 / Max: 71462.44Min: 69763.13 / Avg: 69776.41 / Max: 69795.01Min: 58681.77 / Avg: 58815.36 / Max: 58891.71Min: 52703.76 / Avg: 52745.64 / Max: 52783.88Min: 52660.53 / Avg: 52684.93 / Max: 52710.091. (F9X) gfortran options: -O3 -march=native -lmpi_usempif08 -lmpi_mpifh -lmpi -lopen-rte -lopen-pal -lhwloc -levent_core -levent_pthreads -lm -lz 2. Open MPI 4.1.6

Y-Cruncher

Y-Cruncher is a multi-threaded Pi benchmark capable of computing Pi to trillions of digits. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterY-Cruncher 0.8.3Pi Digits To Calculate: 1BXeon Platinum 8490H 2PXeon Platinum 8592+ 2PXeon Max 9480 2PXeon Max 9468 2PXeon Platinum 8592+EPYC 9654EPYC 9754Xeon Platinum 8490HEPYC 9684XEPYC 9754 2PXeon Max 9480EPYC 9654 2PXeon Max 9468EPYC 9684X 2PEPYC 8534PEPYC 8534PN3691215SE +/- 0.007, N = 6SE +/- 0.010, N = 6SE +/- 0.142, N = 12SE +/- 0.122, N = 15SE +/- 0.030, N = 5SE +/- 0.008, N = 5SE +/- 0.007, N = 4SE +/- 0.005, N = 5SE +/- 0.008, N = 4SE +/- 0.049, N = 4SE +/- 0.026, N = 5SE +/- 0.012, N = 4SE +/- 0.045, N = 5SE +/- 0.012, N = 4SE +/- 0.005, N = 4SE +/- 0.001, N = 45.0085.1106.2666.3346.7016.7436.9287.0477.4717.9157.9598.1968.3008.99210.20510.427
OpenBenchmarking.orgSeconds, Fewer Is BetterY-Cruncher 0.8.3Pi Digits To Calculate: 1BXeon Platinum 8490H 2PXeon Platinum 8592+ 2PXeon Max 9480 2PXeon Max 9468 2PXeon Platinum 8592+EPYC 9654EPYC 9754Xeon Platinum 8490HEPYC 9684XEPYC 9754 2PXeon Max 9480EPYC 9654 2PXeon Max 9468EPYC 9684X 2PEPYC 8534PEPYC 8534PN3691215Min: 4.99 / Avg: 5.01 / Max: 5.03Min: 5.07 / Avg: 5.11 / Max: 5.14Min: 5.81 / Avg: 6.27 / Max: 7.49Min: 5.91 / Avg: 6.33 / Max: 7.33Min: 6.63 / Avg: 6.7 / Max: 6.81Min: 6.72 / Avg: 6.74 / Max: 6.76Min: 6.92 / Avg: 6.93 / Max: 6.95Min: 7.03 / Avg: 7.05 / Max: 7.06Min: 7.45 / Avg: 7.47 / Max: 7.48Min: 7.84 / Avg: 7.91 / Max: 8.06Min: 7.91 / Avg: 7.96 / Max: 8.06Min: 8.16 / Avg: 8.2 / Max: 8.22Min: 8.2 / Avg: 8.3 / Max: 8.43Min: 8.96 / Avg: 8.99 / Max: 9.02Min: 10.19 / Avg: 10.2 / Max: 10.21Min: 10.42 / Avg: 10.43 / Max: 10.43

PyBench

This test profile reports the total time of the different average timed test results from PyBench. PyBench reports average test times for different functions such as BuiltinFunctionCalls and NestedForLoops, with this total result providing a rough estimate as to Python's average performance on a given system. This test profile runs PyBench each time for 20 rounds. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgMilliseconds, Fewer Is BetterPyBench 2018-02-16Total For Average Test TimesXeon Platinum 8592+Xeon Platinum 8592+ 2PXeon Max 9480Xeon Max 9468Xeon Max 9468 2PXeon Max 9480 2PXeon Platinum 8490HXeon Platinum 8490H 2PEPYC 9654EPYC 9684XEPYC 9684X 2PEPYC 9654 2PEPYC 9754 2PEPYC 8534PNEPYC 9754EPYC 8534P2004006008001000SE +/- 0.41, N = 4SE +/- 0.48, N = 4SE +/- 0.58, N = 3SE +/- 0.33, N = 3SE +/- 0.67, N = 3SE +/- 0.67, N = 3SE +/- 0.33, N = 3SE +/- 1.15, N = 3SE +/- 2.19, N = 3SE +/- 2.08, N = 3SE +/- 1.20, N = 3SE +/- 1.86, N = 3SE +/- 1.33, N = 3SE +/- 2.40, N = 3SE +/- 0.58, N = 3SE +/- 1.45, N = 3691692762763763763765767818818818822972974974976
OpenBenchmarking.orgMilliseconds, Fewer Is BetterPyBench 2018-02-16Total For Average Test TimesXeon Platinum 8592+Xeon Platinum 8592+ 2PXeon Max 9480Xeon Max 9468Xeon Max 9468 2PXeon Max 9480 2PXeon Platinum 8490HXeon Platinum 8490H 2PEPYC 9654EPYC 9684XEPYC 9684X 2PEPYC 9654 2PEPYC 9754 2PEPYC 8534PNEPYC 9754EPYC 8534P2004006008001000Min: 690 / Avg: 691 / Max: 692Min: 691 / Avg: 691.75 / Max: 693Min: 761 / Avg: 762 / Max: 763Min: 762 / Avg: 762.67 / Max: 763Min: 762 / Avg: 763.33 / Max: 764Min: 762 / Avg: 762.67 / Max: 764Min: 764 / Avg: 764.67 / Max: 765Min: 765 / Avg: 767 / Max: 769Min: 814 / Avg: 818.33 / Max: 821Min: 814 / Avg: 818 / Max: 821Min: 816 / Avg: 817.67 / Max: 820Min: 820 / Avg: 822.33 / Max: 826Min: 969 / Avg: 971.67 / Max: 973Min: 971 / Avg: 974.33 / Max: 979Min: 973 / Avg: 974 / Max: 975Min: 974 / Avg: 976.33 / Max: 979

Xcompact3d Incompact3d

Xcompact3d Incompact3d is a Fortran-MPI based, finite difference high-performance code for solving the incompressible Navier-Stokes equation and as many as you need scalar transport equations. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterXcompact3d Incompact3d 2021-03-11Input: input.i3d 193 Cells Per DirectionEPYC 9684X 2PEPYC 9654 2PEPYC 9754 2PXeon Platinum 8592+ 2PXeon Platinum 8490H 2PXeon Max 9480 2PEPYC 9684XXeon Max 9468 2PEPYC 9654EPYC 9754Xeon Platinum 8592+Xeon Max 9480Xeon Platinum 8490HXeon Max 9468EPYC 8534PEPYC 8534PN510152025SE +/- 0.00891960, N = 5SE +/- 0.04312156, N = 5SE +/- 0.01633300, N = 4SE +/- 0.03329814, N = 5SE +/- 0.04312801, N = 5SE +/- 0.05695382, N = 15SE +/- 0.05847189, N = 6SE +/- 0.01741826, N = 5SE +/- 0.06577912, N = 5SE +/- 0.03951909, N = 5SE +/- 0.02923582, N = 4SE +/- 0.01708632, N = 4SE +/- 0.01004100, N = 4SE +/- 0.04445674, N = 4SE +/- 0.01040414, N = 3SE +/- 0.10237421, N = 33.753199014.260785964.510618935.391259676.391698176.663875106.881212797.293491178.253835118.8722591410.1967066012.7997582012.9293413013.9692376020.9379139021.178030701. (F9X) gfortran options: -cpp -O2 -funroll-loops -floop-optimize -fcray-pointer -fbacktrace -lmpi_usempif08 -lmpi_mpifh -lmpi -lopen-rte -lopen-pal -lhwloc -levent_core -levent_pthreads -lm -lz
OpenBenchmarking.orgSeconds, Fewer Is BetterXcompact3d Incompact3d 2021-03-11Input: input.i3d 193 Cells Per DirectionEPYC 9684X 2PEPYC 9654 2PEPYC 9754 2PXeon Platinum 8592+ 2PXeon Platinum 8490H 2PXeon Max 9480 2PEPYC 9684XXeon Max 9468 2PEPYC 9654EPYC 9754Xeon Platinum 8592+Xeon Max 9480Xeon Platinum 8490HXeon Max 9468EPYC 8534PEPYC 8534PN510152025Min: 3.73 / Avg: 3.75 / Max: 3.78Min: 4.2 / Avg: 4.26 / Max: 4.43Min: 4.49 / Avg: 4.51 / Max: 4.56Min: 5.3 / Avg: 5.39 / Max: 5.5Min: 6.3 / Avg: 6.39 / Max: 6.5Min: 6.44 / Avg: 6.66 / Max: 7.05Min: 6.72 / Avg: 6.88 / Max: 7.07Min: 7.25 / Avg: 7.29 / Max: 7.35Min: 8.09 / Avg: 8.25 / Max: 8.49Min: 8.77 / Avg: 8.87 / Max: 9Min: 10.11 / Avg: 10.2 / Max: 10.24Min: 12.76 / Avg: 12.8 / Max: 12.84Min: 12.9 / Avg: 12.93 / Max: 12.94Min: 13.89 / Avg: 13.97 / Max: 14.08Min: 20.92 / Avg: 20.94 / Max: 20.95Min: 21.06 / Avg: 21.18 / Max: 21.381. (F9X) gfortran options: -cpp -O2 -funroll-loops -floop-optimize -fcray-pointer -fbacktrace -lmpi_usempif08 -lmpi_mpifh -lmpi -lopen-rte -lopen-pal -lhwloc -levent_core -levent_pthreads -lm -lz

miniBUDE

MiniBUDE is a mini application for the the core computation of the Bristol University Docking Engine (BUDE). This test profile currently makes use of the OpenMP implementation of miniBUDE for CPU benchmarking. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgBillion Interactions/s, More Is BetterminiBUDE 20210901Implementation: OpenMP - Input Deck: BM1EPYC 9684X 2PEPYC 9754EPYC 9654 2PEPYC 9754 2PXeon Platinum 8592+ 2PEPYC 9684XEPYC 9654Xeon Platinum 8490H 2PXeon Max 9480 2PXeon Max 9468 2PEPYC 8534PXeon Platinum 8592+EPYC 8534PNXeon Platinum 8490HXeon Max 9480Xeon Max 946850100150200250SE +/- 6.15, N = 12SE +/- 0.70, N = 9SE +/- 2.97, N = 13SE +/- 3.98, N = 15SE +/- 1.02, N = 8SE +/- 3.27, N = 13SE +/- 1.18, N = 7SE +/- 0.81, N = 7SE +/- 1.85, N = 12SE +/- 1.28, N = 12SE +/- 0.04, N = 6SE +/- 0.20, N = 6SE +/- 0.03, N = 6SE +/- 0.61, N = 5SE +/- 0.84, N = 15SE +/- 0.12, N = 4236.61229.91217.85214.62199.73151.95136.95133.63114.90108.40107.35106.4098.2182.8570.8463.621. (CC) gcc options: -std=c99 -Ofast -ffast-math -fopenmp -march=native -lm
OpenBenchmarking.orgBillion Interactions/s, More Is BetterminiBUDE 20210901Implementation: OpenMP - Input Deck: BM1EPYC 9684X 2PEPYC 9754EPYC 9654 2PEPYC 9754 2PXeon Platinum 8592+ 2PEPYC 9684XEPYC 9654Xeon Platinum 8490H 2PXeon Max 9480 2PXeon Max 9468 2PEPYC 8534PXeon Platinum 8592+EPYC 8534PNXeon Platinum 8490HXeon Max 9480Xeon Max 94684080120160200Min: 210.08 / Avg: 236.61 / Max: 273.23Min: 226.45 / Avg: 229.91 / Max: 232.06Min: 206.23 / Avg: 217.85 / Max: 244.93Min: 182.87 / Avg: 214.62 / Max: 244.32Min: 193.37 / Avg: 199.73 / Max: 203.55Min: 143.74 / Avg: 151.95 / Max: 187.34Min: 134 / Avg: 136.95 / Max: 143.66Min: 130.38 / Avg: 133.63 / Max: 135.93Min: 99.31 / Avg: 114.9 / Max: 122.85Min: 100.57 / Avg: 108.4 / Max: 116.86Min: 107.23 / Avg: 107.35 / Max: 107.45Min: 105.99 / Avg: 106.4 / Max: 107.33Min: 98.05 / Avg: 98.21 / Max: 98.27Min: 81.26 / Avg: 82.85 / Max: 83.99Min: 65.44 / Avg: 70.84 / Max: 75.47Min: 63.4 / Avg: 63.62 / Max: 63.941. (CC) gcc options: -std=c99 -Ofast -ffast-math -fopenmp -march=native -lm

OpenBenchmarking.orgGFInst/s, More Is BetterminiBUDE 20210901Implementation: OpenMP - Input Deck: BM1EPYC 9684X 2PEPYC 9754EPYC 9654 2PEPYC 9754 2PXeon Platinum 8592+ 2PEPYC 9684XEPYC 9654Xeon Platinum 8490H 2PXeon Max 9480 2PXeon Max 9468 2PEPYC 8534PXeon Platinum 8592+EPYC 8534PNXeon Platinum 8490HXeon Max 9480Xeon Max 946813002600390052006500SE +/- 153.85, N = 12SE +/- 17.54, N = 9SE +/- 74.36, N = 13SE +/- 99.42, N = 15SE +/- 25.44, N = 8SE +/- 81.83, N = 13SE +/- 29.52, N = 7SE +/- 20.15, N = 7SE +/- 46.19, N = 12SE +/- 32.01, N = 12SE +/- 0.97, N = 6SE +/- 5.07, N = 6SE +/- 0.82, N = 6SE +/- 15.23, N = 5SE +/- 21.10, N = 15SE +/- 2.91, N = 45915.255747.825446.165365.424993.343798.703423.633340.692872.562709.932683.832659.882455.162071.191771.071590.501. (CC) gcc options: -std=c99 -Ofast -ffast-math -fopenmp -march=native -lm
OpenBenchmarking.orgGFInst/s, More Is BetterminiBUDE 20210901Implementation: OpenMP - Input Deck: BM1EPYC 9684X 2PEPYC 9754EPYC 9654 2PEPYC 9754 2PXeon Platinum 8592+ 2PEPYC 9684XEPYC 9654Xeon Platinum 8490H 2PXeon Max 9480 2PXeon Max 9468 2PEPYC 8534PXeon Platinum 8592+EPYC 8534PNXeon Platinum 8490HXeon Max 9480Xeon Max 946810002000300040005000Min: 5252.04 / Avg: 5915.25 / Max: 6830.62Min: 5661.25 / Avg: 5747.82 / Max: 5801.58Min: 5155.8 / Avg: 5446.16 / Max: 6123.35Min: 4571.79 / Avg: 5365.42 / Max: 6108.01Min: 4834.27 / Avg: 4993.34 / Max: 5088.63Min: 3593.47 / Avg: 3798.7 / Max: 4683.59Min: 3349.91 / Avg: 3423.63 / Max: 3591.57Min: 3259.48 / Avg: 3340.69 / Max: 3398.22Min: 2482.82 / Avg: 2872.56 / Max: 3071.28Min: 2514.13 / Avg: 2709.93 / Max: 2921.44Min: 2680.65 / Avg: 2683.83 / Max: 2686.26Min: 2649.69 / Avg: 2659.88 / Max: 2683.19Min: 2451.29 / Avg: 2455.16 / Max: 2456.63Min: 2031.44 / Avg: 2071.19 / Max: 2099.76Min: 1636 / Avg: 1771.07 / Max: 1886.65Min: 1585.04 / Avg: 1590.5 / Max: 1598.581. (CC) gcc options: -std=c99 -Ofast -ffast-math -fopenmp -march=native -lm

Timed Mesa Compilation

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed Mesa Compilation 24.0Time To CompileXeon Platinum 8592+ 2PEPYC 9684X 2PEPYC 9654 2PEPYC 9684XEPYC 9654Xeon Platinum 8592+Xeon Max 9480 2PXeon Platinum 8490H 2PXeon Max 9468 2PXeon Platinum 8490HEPYC 9754 2PXeon Max 9480EPYC 9754Xeon Max 9468EPYC 8534PEPYC 8534PN510152025SE +/- 0.05, N = 4SE +/- 0.08, N = 4SE +/- 0.02, N = 4SE +/- 0.02, N = 3SE +/- 0.03, N = 3SE +/- 0.07, N = 3SE +/- 0.17, N = 3SE +/- 0.12, N = 3SE +/- 0.07, N = 3SE +/- 0.07, N = 3SE +/- 0.12, N = 3SE +/- 0.08, N = 3SE +/- 0.03, N = 3SE +/- 0.03, N = 3SE +/- 0.04, N = 3SE +/- 0.02, N = 316.1816.4016.4116.6716.9617.2618.1418.2918.4719.2319.5619.6519.9120.1821.0421.53
OpenBenchmarking.orgSeconds, Fewer Is BetterTimed Mesa Compilation 24.0Time To CompileXeon Platinum 8592+ 2PEPYC 9684X 2PEPYC 9654 2PEPYC 9684XEPYC 9654Xeon Platinum 8592+Xeon Max 9480 2PXeon Platinum 8490H 2PXeon Max 9468 2PXeon Platinum 8490HEPYC 9754 2PXeon Max 9480EPYC 9754Xeon Max 9468EPYC 8534PEPYC 8534PN510152025Min: 16.1 / Avg: 16.18 / Max: 16.32Min: 16.31 / Avg: 16.4 / Max: 16.63Min: 16.38 / Avg: 16.41 / Max: 16.47Min: 16.65 / Avg: 16.67 / Max: 16.7Min: 16.92 / Avg: 16.96 / Max: 17.02Min: 17.11 / Avg: 17.26 / Max: 17.36Min: 17.89 / Avg: 18.14 / Max: 18.46Min: 18.08 / Avg: 18.29 / Max: 18.51Min: 18.34 / Avg: 18.47 / Max: 18.57Min: 19.12 / Avg: 19.23 / Max: 19.35Min: 19.39 / Avg: 19.56 / Max: 19.8Min: 19.52 / Avg: 19.65 / Max: 19.8Min: 19.85 / Avg: 19.91 / Max: 19.94Min: 20.13 / Avg: 20.18 / Max: 20.21Min: 20.97 / Avg: 21.03 / Max: 21.09Min: 21.5 / Avg: 21.53 / Max: 21.58

srsRAN Project

OpenBenchmarking.orgMbps, More Is BettersrsRAN Project 23.10.1-20240325Test: PUSCH Processor Benchmark, Throughput ThreadXeon Platinum 8490H 2PXeon Platinum 8490HXeon Max 9480 2PXeon Max 9480Xeon Max 9468 2PXeon Max 9468Xeon Platinum 8592+ 2PXeon Platinum 8592+EPYC 9684X 2PEPYC 9684XEPYC 9654 2PEPYC 9654EPYC 9754 2PEPYC 9754EPYC 8534PNEPYC 8534P306090120150SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3129.7129.7129.7129.7129.7129.7129.5129.5112.2112.2112.2112.2112.1112.1112.1112.1MIN: 105.9MIN: 105.9MIN: 105.9MIN: 105.9MIN: 105.9MIN: 105.9MIN: 105.7MIN: 105.7MIN: 79.3MIN: 79.3MIN: 79.3MIN: 79.3MIN: 79.3MIN: 79.3MIN: 79.3MIN: 79.31. (CXX) g++ options: -O3 -march=native -mavx2 -mavx -msse4.1 -mfma -mavx512f -mavx512cd -mavx512bw -mavx512dq -fno-trapping-math -fno-math-errno -ldl
OpenBenchmarking.orgMbps, More Is BettersrsRAN Project 23.10.1-20240325Test: PUSCH Processor Benchmark, Throughput ThreadXeon Platinum 8490H 2PXeon Platinum 8490HXeon Max 9480 2PXeon Max 9480Xeon Max 9468 2PXeon Max 9468Xeon Platinum 8592+ 2PXeon Platinum 8592+EPYC 9684X 2PEPYC 9684XEPYC 9654 2PEPYC 9654EPYC 9754 2PEPYC 9754EPYC 8534PNEPYC 8534P20406080100Min: 129.7 / Avg: 129.7 / Max: 129.7Min: 129.7 / Avg: 129.7 / Max: 129.7Min: 129.7 / Avg: 129.7 / Max: 129.7Min: 129.7 / Avg: 129.7 / Max: 129.7Min: 129.7 / Avg: 129.7 / Max: 129.7Min: 129.7 / Avg: 129.7 / Max: 129.7Min: 129.5 / Avg: 129.5 / Max: 129.5Min: 129.5 / Avg: 129.5 / Max: 129.5Min: 112.2 / Avg: 112.2 / Max: 112.2Min: 112.2 / Avg: 112.2 / Max: 112.2Min: 112.2 / Avg: 112.2 / Max: 112.2Min: 112.2 / Avg: 112.2 / Max: 112.2Min: 112.1 / Avg: 112.1 / Max: 112.1Min: 112.1 / Avg: 112.1 / Max: 112.1Min: 112.1 / Avg: 112.1 / Max: 112.1Min: 112.1 / Avg: 112.1 / Max: 112.11. (CXX) g++ options: -O3 -march=native -mavx2 -mavx -msse4.1 -mfma -mavx512f -mavx512cd -mavx512bw -mavx512dq -fno-trapping-math -fno-math-errno -ldl

Kvazaar

This is a test of Kvazaar as a CPU-based H.265/HEVC video encoder written in the C programming language and optimized in Assembly. Kvazaar is the winner of the 2016 ACM Open-Source Software Competition and developed at the Ultra Video Group, Tampere University, Finland. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgFrames Per Second, More Is BetterKvazaar 2.2Video Input: Bosphorus 4K - Video Preset: Very FastEPYC 9684XEPYC 9654EPYC 9684X 2PEPYC 9654 2PEPYC 9754Xeon Platinum 8490H 2PXeon Platinum 8592+ 2PEPYC 9754 2PEPYC 8534PXeon Max 9480 2PXeon Max 9468 2PEPYC 8534PNXeon Platinum 8490HXeon Max 9480Xeon Max 9468Xeon Platinum 8592+20406080100SE +/- 0.32, N = 6SE +/- 0.62, N = 6SE +/- 0.28, N = 6SE +/- 0.71, N = 6SE +/- 0.21, N = 5SE +/- 0.45, N = 5SE +/- 0.36, N = 5SE +/- 0.63, N = 15SE +/- 0.07, N = 5SE +/- 0.29, N = 4SE +/- 0.33, N = 4SE +/- 0.07, N = 4SE +/- 0.08, N = 4SE +/- 0.08, N = 4SE +/- 0.06, N = 4SE +/- 0.04, N = 478.1576.8374.0372.6868.5667.6465.3859.0154.6052.2351.9151.5150.0341.3440.2338.021. (CC) gcc options: -pthread -ftree-vectorize -fvisibility=hidden -O2 -lpthread -lm -lrt
OpenBenchmarking.orgFrames Per Second, More Is BetterKvazaar 2.2Video Input: Bosphorus 4K - Video Preset: Very FastEPYC 9684XEPYC 9654EPYC 9684X 2PEPYC 9654 2PEPYC 9754Xeon Platinum 8490H 2PXeon Platinum 8592+ 2PEPYC 9754 2PEPYC 8534PXeon Max 9480 2PXeon Max 9468 2PEPYC 8534PNXeon Platinum 8490HXeon Max 9480Xeon Max 9468Xeon Platinum 8592+1530456075Min: 76.98 / Avg: 78.15 / Max: 78.81Min: 75.08 / Avg: 76.83 / Max: 79.2Min: 72.97 / Avg: 74.03 / Max: 75.1Min: 69.21 / Avg: 72.68 / Max: 73.94Min: 68.04 / Avg: 68.56 / Max: 69.1Min: 65.99 / Avg: 67.64 / Max: 68.59Min: 64.71 / Avg: 65.38 / Max: 66.72Min: 53.6 / Avg: 59.01 / Max: 62.51Min: 54.46 / Avg: 54.6 / Max: 54.82Min: 51.62 / Avg: 52.23 / Max: 52.85Min: 51.22 / Avg: 51.91 / Max: 52.55Min: 51.3 / Avg: 51.51 / Max: 51.61Min: 49.83 / Avg: 50.03 / Max: 50.24Min: 41.16 / Avg: 41.34 / Max: 41.47Min: 40.08 / Avg: 40.23 / Max: 40.36Min: 37.96 / Avg: 38.02 / Max: 38.141. (CC) gcc options: -pthread -ftree-vectorize -fvisibility=hidden -O2 -lpthread -lm -lrt

Timed ImageMagick Compilation

This test times how long it takes to build ImageMagick. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed ImageMagick Compilation 6.9.0Time To CompileXeon Platinum 8592+ 2PEPYC 9684X 2PEPYC 9684XXeon Platinum 8592+EPYC 9654 2PXeon Platinum 8490H 2PEPYC 9654Xeon Max 9480 2PXeon Max 9468 2PXeon Platinum 8490HXeon Max 9480EPYC 9754 2PXeon Max 9468EPYC 9754EPYC 8534PEPYC 8534PN48121620SE +/- 0.03, N = 4SE +/- 0.04, N = 4SE +/- 0.06, N = 4SE +/- 0.10, N = 4SE +/- 0.04, N = 4SE +/- 0.13, N = 4SE +/- 0.09, N = 4SE +/- 0.07, N = 4SE +/- 0.11, N = 4SE +/- 0.10, N = 4SE +/- 0.06, N = 4SE +/- 0.02, N = 4SE +/- 0.15, N = 4SE +/- 0.08, N = 4SE +/- 0.04, N = 3SE +/- 0.04, N = 311.4911.7212.2012.6012.7513.2613.4714.0914.4014.7215.3815.8116.0816.3917.9218.18
OpenBenchmarking.orgSeconds, Fewer Is BetterTimed ImageMagick Compilation 6.9.0Time To CompileXeon Platinum 8592+ 2PEPYC 9684X 2PEPYC 9684XXeon Platinum 8592+EPYC 9654 2PXeon Platinum 8490H 2PEPYC 9654Xeon Max 9480 2PXeon Max 9468 2PXeon Platinum 8490HXeon Max 9480EPYC 9754 2PXeon Max 9468EPYC 9754EPYC 8534PEPYC 8534PN510152025Min: 11.45 / Avg: 11.49 / Max: 11.58Min: 11.62 / Avg: 11.72 / Max: 11.78Min: 12.07 / Avg: 12.2 / Max: 12.35Min: 12.33 / Avg: 12.59 / Max: 12.77Min: 12.68 / Avg: 12.75 / Max: 12.85Min: 12.91 / Avg: 13.26 / Max: 13.45Min: 13.22 / Avg: 13.47 / Max: 13.62Min: 13.9 / Avg: 14.09 / Max: 14.22Min: 14.08 / Avg: 14.4 / Max: 14.57Min: 14.58 / Avg: 14.72 / Max: 15.02Min: 15.25 / Avg: 15.38 / Max: 15.51Min: 15.77 / Avg: 15.81 / Max: 15.84Min: 15.84 / Avg: 16.07 / Max: 16.45Min: 16.17 / Avg: 16.39 / Max: 16.57Min: 17.86 / Avg: 17.92 / Max: 17.99Min: 18.1 / Avg: 18.18 / Max: 18.22

m-queens

A solver for the N-queens problem with multi-threading support via the OpenMP library. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is Betterm-queens 1.2Time To SolveEPYC 9754 2PEPYC 9684X 2PEPYC 9654 2PEPYC 9754EPYC 9684XXeon Platinum 8592+ 2PEPYC 9654Xeon Platinum 8490H 2PXeon Max 9480 2PXeon Max 9468 2PEPYC 8534PXeon Platinum 8592+EPYC 8534PNXeon Platinum 8490HXeon Max 9480Xeon Max 9468510152025SE +/- 0.031, N = 8SE +/- 0.064, N = 15SE +/- 0.093, N = 15SE +/- 0.021, N = 6SE +/- 0.025, N = 6SE +/- 0.028, N = 6SE +/- 0.019, N = 6SE +/- 0.021, N = 6SE +/- 0.028, N = 5SE +/- 0.021, N = 5SE +/- 0.019, N = 4SE +/- 0.030, N = 4SE +/- 0.029, N = 4SE +/- 0.025, N = 4SE +/- 0.035, N = 3SE +/- 0.031, N = 33.9814.1334.6096.3506.9507.4027.7387.8819.28510.84013.25014.25714.49315.21118.10221.0301. (CXX) g++ options: -fopenmp -O2 -march=native
OpenBenchmarking.orgSeconds, Fewer Is Betterm-queens 1.2Time To SolveEPYC 9754 2PEPYC 9684X 2PEPYC 9654 2PEPYC 9754EPYC 9684XXeon Platinum 8592+ 2PEPYC 9654Xeon Platinum 8490H 2PXeon Max 9480 2PXeon Max 9468 2PEPYC 8534PXeon Platinum 8592+EPYC 8534PNXeon Platinum 8490HXeon Max 9480Xeon Max 9468510152025Min: 3.87 / Avg: 3.98 / Max: 4.1Min: 3.95 / Avg: 4.13 / Max: 4.79Min: 4.2 / Avg: 4.61 / Max: 5.14Min: 6.28 / Avg: 6.35 / Max: 6.41Min: 6.86 / Avg: 6.95 / Max: 7.04Min: 7.29 / Avg: 7.4 / Max: 7.48Min: 7.69 / Avg: 7.74 / Max: 7.83Min: 7.83 / Avg: 7.88 / Max: 7.95Min: 9.2 / Avg: 9.28 / Max: 9.37Min: 10.77 / Avg: 10.84 / Max: 10.89Min: 13.21 / Avg: 13.25 / Max: 13.3Min: 14.2 / Avg: 14.26 / Max: 14.31Min: 14.43 / Avg: 14.49 / Max: 14.56Min: 15.14 / Avg: 15.21 / Max: 15.26Min: 18.04 / Avg: 18.1 / Max: 18.16Min: 21 / Avg: 21.03 / Max: 21.091. (CXX) g++ options: -fopenmp -O2 -march=native

NAS Parallel Benchmarks

NPB, NAS Parallel Benchmarks, is a benchmark developed by NASA for high-end computer systems. This test profile currently uses the MPI version of NPB. This test profile offers selecting the different NPB tests/problems and varying problem sizes. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgTotal Mop/s, More Is BetterNAS Parallel Benchmarks 3.4Test / Class: CG.CXeon Platinum 8592+ 2PEPYC 9684X 2PEPYC 9654 2PXeon Max 9480 2PXeon Max 9468 2PXeon Platinum 8592+EPYC 9754 2PEPYC 9684XXeon Platinum 8490H 2PEPYC 9654EPYC 9754Xeon Max 9480Xeon Max 9468Xeon Platinum 8490HEPYC 8534PEPYC 8534PN20K40K60K80K100KSE +/- 271.54, N = 6SE +/- 661.05, N = 7SE +/- 779.47, N = 7SE +/- 560.41, N = 15SE +/- 545.92, N = 15SE +/- 328.18, N = 8SE +/- 545.82, N = 5SE +/- 386.70, N = 9SE +/- 178.23, N = 8SE +/- 393.67, N = 15SE +/- 480.71, N = 15SE +/- 260.16, N = 15SE +/- 313.88, N = 7SE +/- 243.41, N = 12SE +/- 126.79, N = 6SE +/- 207.19, N = 698764.9388487.9184477.7266492.4465396.2263760.4563265.0162071.1058128.2453182.7743799.7835234.0635116.5533811.6322229.9421684.801. (F9X) gfortran options: -O3 -march=native -lmpi_usempif08 -lmpi_mpifh -lmpi -lopen-rte -lopen-pal -lhwloc -levent_core -levent_pthreads -lm -lz 2. Open MPI 4.1.6
OpenBenchmarking.orgTotal Mop/s, More Is BetterNAS Parallel Benchmarks 3.4Test / Class: CG.CXeon Platinum 8592+ 2PEPYC 9684X 2PEPYC 9654 2PXeon Max 9480 2PXeon Max 9468 2PXeon Platinum 8592+EPYC 9754 2PEPYC 9684XXeon Platinum 8490H 2PEPYC 9654EPYC 9754Xeon Max 9480Xeon Max 9468Xeon Platinum 8490HEPYC 8534PEPYC 8534PN20K40K60K80K100KMin: 98048.32 / Avg: 98764.93 / Max: 99644.91Min: 86828.59 / Avg: 88487.91 / Max: 91345.07Min: 81385.52 / Avg: 84477.72 / Max: 86755.63Min: 64389.69 / Avg: 66492.44 / Max: 70869.72Min: 62703.28 / Avg: 65396.22 / Max: 69335.3Min: 62397.94 / Avg: 63760.45 / Max: 64819.94Min: 61210 / Avg: 63265.01 / Max: 64247.24Min: 59857.9 / Avg: 62071.1 / Max: 63617Min: 57523.16 / Avg: 58128.24 / Max: 59031.08Min: 50577.84 / Avg: 53182.77 / Max: 55585.41Min: 40753.07 / Avg: 43799.78 / Max: 47031.84Min: 33494.3 / Avg: 35234.06 / Max: 36603.54Min: 34000.56 / Avg: 35116.55 / Max: 36330.28Min: 32823.96 / Avg: 33811.63 / Max: 35427.22Min: 21810.34 / Avg: 22229.94 / Max: 22541.5Min: 21140.06 / Avg: 21684.8 / Max: 22491.491. (F9X) gfortran options: -O3 -march=native -lmpi_usempif08 -lmpi_mpifh -lmpi -lopen-rte -lopen-pal -lhwloc -levent_core -levent_pthreads -lm -lz 2. Open MPI 4.1.6

Y-Cruncher

Y-Cruncher is a multi-threaded Pi benchmark capable of computing Pi to trillions of digits. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterY-Cruncher 0.8.3Pi Digits To Calculate: 500MXeon Platinum 8490H 2PXeon Platinum 8592+ 2PXeon Max 9480 2PXeon Max 9468 2PXeon Platinum 8490HXeon Platinum 8592+Xeon Max 9480Xeon Max 9468EPYC 9654EPYC 9754EPYC 9754 2PEPYC 9684XEPYC 9654 2PEPYC 9684X 2PEPYC 8534PEPYC 8534PN1.16212.32423.48634.64845.8105SE +/- 0.002, N = 8SE +/- 0.004, N = 7SE +/- 0.074, N = 15SE +/- 0.064, N = 15SE +/- 0.003, N = 7SE +/- 0.008, N = 7SE +/- 0.023, N = 15SE +/- 0.010, N = 7SE +/- 0.003, N = 6SE +/- 0.005, N = 6SE +/- 0.015, N = 5SE +/- 0.003, N = 6SE +/- 0.003, N = 5SE +/- 0.007, N = 5SE +/- 0.006, N = 6SE +/- 0.008, N = 62.3642.6592.9613.1103.2673.3913.7043.7813.8503.9684.1004.3124.3294.5105.0775.165
OpenBenchmarking.orgSeconds, Fewer Is BetterY-Cruncher 0.8.3Pi Digits To Calculate: 500MXeon Platinum 8490H 2PXeon Platinum 8592+ 2PXeon Max 9480 2PXeon Max 9468 2PXeon Platinum 8490HXeon Platinum 8592+Xeon Max 9480Xeon Max 9468EPYC 9654EPYC 9754EPYC 9754 2PEPYC 9684XEPYC 9654 2PEPYC 9684X 2PEPYC 8534PEPYC 8534PN246810Min: 2.36 / Avg: 2.36 / Max: 2.38Min: 2.65 / Avg: 2.66 / Max: 2.68Min: 2.67 / Avg: 2.96 / Max: 3.48Min: 2.76 / Avg: 3.11 / Max: 3.5Min: 3.26 / Avg: 3.27 / Max: 3.28Min: 3.37 / Avg: 3.39 / Max: 3.43Min: 3.6 / Avg: 3.7 / Max: 3.98Min: 3.74 / Avg: 3.78 / Max: 3.82Min: 3.84 / Avg: 3.85 / Max: 3.86Min: 3.96 / Avg: 3.97 / Max: 3.99Min: 4.04 / Avg: 4.1 / Max: 4.12Min: 4.3 / Avg: 4.31 / Max: 4.32Min: 4.32 / Avg: 4.33 / Max: 4.34Min: 4.49 / Avg: 4.51 / Max: 4.53Min: 5.06 / Avg: 5.08 / Max: 5.1Min: 5.15 / Avg: 5.17 / Max: 5.21

Intel Open Image Denoise

Open Image Denoise is a denoising library for ray-tracing and part of the Intel oneAPI rendering toolkit. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgImages / Sec, More Is BetterIntel Open Image Denoise 2.2Run: RT.ldr_alb_nrm.3840x2160 - Device: CPU-OnlyXeon Platinum 8592+ 2PXeon Platinum 8490H 2PXeon Max 9480 2PEPYC 9754 2PXeon Max 9468 2PEPYC 9654 2PEPYC 9684X 2PXeon Platinum 8592+EPYC 9754EPYC 9654Xeon Platinum 8490HEPYC 9684XXeon Max 9480Xeon Max 9468EPYC 8534PEPYC 8534PN1.14532.29063.43594.58125.7265SE +/- 0.03, N = 6SE +/- 0.01, N = 6SE +/- 0.02, N = 5SE +/- 0.01, N = 5SE +/- 0.02, N = 5SE +/- 0.01, N = 5SE +/- 0.00, N = 5SE +/- 0.00, N = 5SE +/- 0.03, N = 6SE +/- 0.01, N = 4SE +/- 0.00, N = 4SE +/- 0.02, N = 4SE +/- 0.00, N = 4SE +/- 0.00, N = 4SE +/- 0.00, N = 3SE +/- 0.00, N = 35.094.483.663.573.493.493.473.323.162.732.712.662.392.271.801.69
OpenBenchmarking.orgImages / Sec, More Is BetterIntel Open Image Denoise 2.2Run: RT.ldr_alb_nrm.3840x2160 - Device: CPU-OnlyXeon Platinum 8592+ 2PXeon Platinum 8490H 2PXeon Max 9480 2PEPYC 9754 2PXeon Max 9468 2PEPYC 9654 2PEPYC 9684X 2PXeon Platinum 8592+EPYC 9754EPYC 9654Xeon Platinum 8490HEPYC 9684XXeon Max 9480Xeon Max 9468EPYC 8534PEPYC 8534PN246810Min: 4.98 / Avg: 5.09 / Max: 5.17Min: 4.44 / Avg: 4.48 / Max: 4.51Min: 3.61 / Avg: 3.66 / Max: 3.71Min: 3.54 / Avg: 3.57 / Max: 3.59Min: 3.47 / Avg: 3.49 / Max: 3.57Min: 3.47 / Avg: 3.49 / Max: 3.5Min: 3.47 / Avg: 3.47 / Max: 3.47Min: 3.31 / Avg: 3.32 / Max: 3.32Min: 3.07 / Avg: 3.16 / Max: 3.29Min: 2.71 / Avg: 2.73 / Max: 2.74Min: 2.71 / Avg: 2.71 / Max: 2.71Min: 2.64 / Avg: 2.66 / Max: 2.71Min: 2.38 / Avg: 2.39 / Max: 2.4Min: 2.26 / Avg: 2.27 / Max: 2.27Min: 1.8 / Avg: 1.8 / Max: 1.8Min: 1.69 / Avg: 1.69 / Max: 1.69

OpenBenchmarking.orgImages / Sec, More Is BetterIntel Open Image Denoise 2.2Run: RT.hdr_alb_nrm.3840x2160 - Device: CPU-OnlyXeon Platinum 8592+ 2PXeon Platinum 8490H 2PXeon Max 9480 2PEPYC 9754 2PXeon Max 9468 2PEPYC 9654 2PEPYC 9684X 2PXeon Platinum 8592+EPYC 9754EPYC 9654Xeon Platinum 8490HEPYC 9684XXeon Max 9480Xeon Max 9468EPYC 8534PEPYC 8534PN1.13182.26363.39544.52725.659SE +/- 0.03, N = 6SE +/- 0.03, N = 6SE +/- 0.04, N = 5SE +/- 0.01, N = 5SE +/- 0.01, N = 5SE +/- 0.01, N = 5SE +/- 0.00, N = 5SE +/- 0.00, N = 5SE +/- 0.02, N = 5SE +/- 0.01, N = 4SE +/- 0.00, N = 4SE +/- 0.00, N = 4SE +/- 0.00, N = 4SE +/- 0.00, N = 4SE +/- 0.00, N = 3SE +/- 0.00, N = 35.034.413.653.593.513.483.453.313.122.732.712.642.382.261.791.69
OpenBenchmarking.orgImages / Sec, More Is BetterIntel Open Image Denoise 2.2Run: RT.hdr_alb_nrm.3840x2160 - Device: CPU-OnlyXeon Platinum 8592+ 2PXeon Platinum 8490H 2PXeon Max 9480 2PEPYC 9754 2PXeon Max 9468 2PEPYC 9654 2PEPYC 9684X 2PXeon Platinum 8592+EPYC 9754EPYC 9654Xeon Platinum 8490HEPYC 9684XXeon Max 9480Xeon Max 9468EPYC 8534PEPYC 8534PN246810Min: 4.94 / Avg: 5.03 / Max: 5.1Min: 4.31 / Avg: 4.41 / Max: 4.47Min: 3.5 / Avg: 3.65 / Max: 3.72Min: 3.55 / Avg: 3.59 / Max: 3.61Min: 3.48 / Avg: 3.51 / Max: 3.55Min: 3.47 / Avg: 3.48 / Max: 3.5Min: 3.44 / Avg: 3.45 / Max: 3.46Min: 3.3 / Avg: 3.31 / Max: 3.31Min: 3.08 / Avg: 3.12 / Max: 3.21Min: 2.69 / Avg: 2.73 / Max: 2.76Min: 2.71 / Avg: 2.71 / Max: 2.71Min: 2.63 / Avg: 2.64 / Max: 2.65Min: 2.37 / Avg: 2.38 / Max: 2.38Min: 2.26 / Avg: 2.26 / Max: 2.26Min: 1.79 / Avg: 1.79 / Max: 1.79Min: 1.69 / Avg: 1.69 / Max: 1.69

Embree

Intel Embree is a collection of high-performance ray-tracing kernels for execution on CPUs (and GPUs via SYCL) and supporting instruction sets such as SSE, AVX, AVX2, and AVX-512. Embree also supports making use of the Intel SPMD Program Compiler (ISPC). Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgFrames Per Second, More Is BetterEmbree 4.3Binary: Pathtracer ISPC - Model: Asian DragonEPYC 9684X 2PEPYC 9754 2PXeon Platinum 8592+ 2PEPYC 9654 2PEPYC 9754EPYC 9684XXeon Platinum 8490H 2PEPYC 9654Xeon Max 9480 2PXeon Max 9468 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Max 9480Xeon Max 9468EPYC 8534PEPYC 8534PN50100150200250SE +/- 2.04, N = 8SE +/- 1.88, N = 7SE +/- 0.26, N = 8SE +/- 1.54, N = 8SE +/- 0.12, N = 7SE +/- 0.07, N = 7SE +/- 0.13, N = 7SE +/- 0.03, N = 6SE +/- 1.20, N = 15SE +/- 0.63, N = 6SE +/- 0.13, N = 6SE +/- 0.05, N = 5SE +/- 0.11, N = 5SE +/- 0.04, N = 5SE +/- 0.03, N = 5SE +/- 0.05, N = 5231.43208.31199.61185.71156.39155.12152.75132.49129.75125.75112.6691.9983.4975.4775.2173.91MIN: 187.58 / MAX: 274.64MIN: 162.41 / MAX: 258.13MIN: 185.98 / MAX: 216.64MIN: 154.13 / MAX: 227.12MIN: 153.92 / MAX: 160MIN: 152.39 / MAX: 161.68MIN: 143.8 / MAX: 168.98MIN: 130.77 / MAX: 135.13MIN: 110.67 / MAX: 151.91MIN: 120.06 / MAX: 135.13MIN: 107.88 / MAX: 117.19MIN: 88.57 / MAX: 98.54MIN: 80.58 / MAX: 88.97MIN: 72.93 / MAX: 78.77MIN: 74.55 / MAX: 76.96MIN: 73.25 / MAX: 75
OpenBenchmarking.orgFrames Per Second, More Is BetterEmbree 4.3Binary: Pathtracer ISPC - Model: Asian DragonEPYC 9684X 2PEPYC 9754 2PXeon Platinum 8592+ 2PEPYC 9654 2PEPYC 9754EPYC 9684XXeon Platinum 8490H 2PEPYC 9654Xeon Max 9480 2PXeon Max 9468 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Max 9480Xeon Max 9468EPYC 8534PEPYC 8534PN4080120160200Min: 223.86 / Avg: 231.43 / Max: 241.89Min: 203.33 / Avg: 208.31 / Max: 214.64Min: 198.29 / Avg: 199.61 / Max: 200.37Min: 179.3 / Avg: 185.71 / Max: 191.56Min: 155.81 / Avg: 156.39 / Max: 156.76Min: 154.93 / Avg: 155.12 / Max: 155.47Min: 152.14 / Avg: 152.75 / Max: 153.15Min: 132.41 / Avg: 132.49 / Max: 132.61Min: 122.92 / Avg: 129.75 / Max: 137.51Min: 123.85 / Avg: 125.75 / Max: 127.4Min: 112.23 / Avg: 112.66 / Max: 112.98Min: 91.83 / Avg: 91.99 / Max: 92.12Min: 83.26 / Avg: 83.49 / Max: 83.88Min: 75.31 / Avg: 75.47 / Max: 75.57Min: 75.11 / Avg: 75.21 / Max: 75.29Min: 73.77 / Avg: 73.91 / Max: 74.04

GNU Octave Benchmark

This test profile measures how long it takes to complete several reference GNU Octave files via octave-benchmark. GNU Octave is used for numerical computations and is an open-source alternative to MATLAB. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterGNU Octave Benchmark 8.4.0Xeon Platinum 8592+Xeon Platinum 8592+ 2PEPYC 9684XEPYC 9684X 2PEPYC 9654Xeon Platinum 8490HXeon Max 9468EPYC 9654 2PXeon Max 9480Xeon Platinum 8490H 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PNXeon Max 9480 2PXeon Max 9468 2P3691215SE +/- 0.020, N = 6SE +/- 0.019, N = 6SE +/- 0.018, N = 6SE +/- 0.007, N = 6SE +/- 0.009, N = 6SE +/- 0.015, N = 6SE +/- 0.015, N = 6SE +/- 0.004, N = 6SE +/- 0.024, N = 6SE +/- 0.019, N = 6SE +/- 0.014, N = 5SE +/- 0.025, N = 5SE +/- 0.011, N = 5SE +/- 0.007, N = 5SE +/- 0.082, N = 5SE +/- 0.096, N = 56.4586.8566.8576.9557.5287.5327.6227.6457.7488.0368.8018.8488.9298.94812.57812.617
OpenBenchmarking.orgSeconds, Fewer Is BetterGNU Octave Benchmark 8.4.0Xeon Platinum 8592+Xeon Platinum 8592+ 2PEPYC 9684XEPYC 9684X 2PEPYC 9654Xeon Platinum 8490HXeon Max 9468EPYC 9654 2PXeon Max 9480Xeon Platinum 8490H 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PNXeon Max 9480 2PXeon Max 9468 2P48121620Min: 6.42 / Avg: 6.46 / Max: 6.55Min: 6.81 / Avg: 6.86 / Max: 6.94Min: 6.78 / Avg: 6.86 / Max: 6.91Min: 6.94 / Avg: 6.95 / Max: 6.99Min: 7.5 / Avg: 7.53 / Max: 7.56Min: 7.49 / Avg: 7.53 / Max: 7.6Min: 7.57 / Avg: 7.62 / Max: 7.67Min: 7.63 / Avg: 7.65 / Max: 7.66Min: 7.69 / Avg: 7.75 / Max: 7.83Min: 7.97 / Avg: 8.04 / Max: 8.09Min: 8.77 / Avg: 8.8 / Max: 8.84Min: 8.8 / Avg: 8.85 / Max: 8.93Min: 8.91 / Avg: 8.93 / Max: 8.97Min: 8.93 / Avg: 8.95 / Max: 8.97Min: 12.35 / Avg: 12.58 / Max: 12.85Min: 12.38 / Avg: 12.62 / Max: 12.95

WebP Image Encode

This is a test of Google's libwebp with the cwebp image encode utility and using a sample 6000x4000 pixel JPEG image as the input. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgMP/s, More Is BetterWebP Image Encode 1.2.4Encode Settings: Quality 100, Highest CompressionEPYC 9684X 2PEPYC 9654 2PEPYC 9654EPYC 9684XXeon Platinum 8592+Xeon Platinum 8592+ 2PXeon Max 9480Xeon Max 9468Xeon Max 9480 2PXeon Max 9468 2PXeon Platinum 8490HXeon Platinum 8490H 2PEPYC 9754EPYC 9754 2PEPYC 8534PNEPYC 8534P0.81451.6292.44353.2584.0725SE +/- 0.00, N = 6SE +/- 0.00, N = 6SE +/- 0.00, N = 6SE +/- 0.00, N = 6SE +/- 0.00, N = 6SE +/- 0.00, N = 6SE +/- 0.00, N = 6SE +/- 0.00, N = 6SE +/- 0.00, N = 6SE +/- 0.00, N = 6SE +/- 0.00, N = 6SE +/- 0.00, N = 6SE +/- 0.00, N = 6SE +/- 0.00, N = 6SE +/- 0.00, N = 6SE +/- 0.00, N = 63.623.623.623.613.473.463.103.103.093.093.083.073.043.033.033.031. (CC) gcc options: -fvisibility=hidden -O2 -lm
OpenBenchmarking.orgMP/s, More Is BetterWebP Image Encode 1.2.4Encode Settings: Quality 100, Highest CompressionEPYC 9684X 2PEPYC 9654 2PEPYC 9654EPYC 9684XXeon Platinum 8592+Xeon Platinum 8592+ 2PXeon Max 9480Xeon Max 9468Xeon Max 9480 2PXeon Max 9468 2PXeon Platinum 8490HXeon Platinum 8490H 2PEPYC 9754EPYC 9754 2PEPYC 8534PNEPYC 8534P246810Min: 3.61 / Avg: 3.62 / Max: 3.62Min: 3.62 / Avg: 3.62 / Max: 3.62Min: 3.62 / Avg: 3.62 / Max: 3.63Min: 3.6 / Avg: 3.61 / Max: 3.62Min: 3.46 / Avg: 3.47 / Max: 3.47Min: 3.46 / Avg: 3.46 / Max: 3.46Min: 3.09 / Avg: 3.1 / Max: 3.1Min: 3.1 / Avg: 3.1 / Max: 3.1Min: 3.09 / Avg: 3.09 / Max: 3.09Min: 3.09 / Avg: 3.09 / Max: 3.09Min: 3.08 / Avg: 3.08 / Max: 3.08Min: 3.07 / Avg: 3.07 / Max: 3.07Min: 3.03 / Avg: 3.04 / Max: 3.04Min: 3.03 / Avg: 3.03 / Max: 3.03Min: 3.03 / Avg: 3.03 / Max: 3.04Min: 3.03 / Avg: 3.03 / Max: 3.041. (CC) gcc options: -fvisibility=hidden -O2 -lm

Embree

Intel Embree is a collection of high-performance ray-tracing kernels for execution on CPUs (and GPUs via SYCL) and supporting instruction sets such as SSE, AVX, AVX2, and AVX-512. Embree also supports making use of the Intel SPMD Program Compiler (ISPC). Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgFrames Per Second, More Is BetterEmbree 4.3Binary: Pathtracer ISPC - Model: CrownEPYC 9684X 2PEPYC 9754 2PEPYC 9654 2PXeon Platinum 8592+ 2PEPYC 9684XEPYC 9754Xeon Platinum 8490H 2PXeon Max 9480 2PEPYC 9654Xeon Max 9468 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Max 9480EPYC 8534PXeon Max 9468EPYC 8534PN50100150200250SE +/- 1.23, N = 8SE +/- 1.04, N = 7SE +/- 0.43, N = 7SE +/- 0.07, N = 7SE +/- 0.20, N = 7SE +/- 0.64, N = 6SE +/- 0.12, N = 6SE +/- 0.48, N = 6SE +/- 0.08, N = 6SE +/- 0.14, N = 6SE +/- 0.05, N = 5SE +/- 0.07, N = 5SE +/- 0.02, N = 4SE +/- 0.04, N = 4SE +/- 0.05, N = 4SE +/- 0.07, N = 4214.02190.08176.21153.16130.79126.15124.71116.61110.53107.6382.9770.0565.3362.1958.4258.28MIN: 181.82 / MAX: 248.2MIN: 164.86 / MAX: 219.06MIN: 163.69 / MAX: 195.97MIN: 143.78 / MAX: 166.08MIN: 126.46 / MAX: 138.83MIN: 122.27 / MAX: 133.25MIN: 115.3 / MAX: 143.82MIN: 107.47 / MAX: 129.72MIN: 107.72 / MAX: 115.26MIN: 102.22 / MAX: 114.8MIN: 79.09 / MAX: 87.11MIN: 63.26 / MAX: 79.13MIN: 60.89 / MAX: 69.91MIN: 61.2 / MAX: 63.88MIN: 55.81 / MAX: 61.43MIN: 57.28 / MAX: 60.13
OpenBenchmarking.orgFrames Per Second, More Is BetterEmbree 4.3Binary: Pathtracer ISPC - Model: CrownEPYC 9684X 2PEPYC 9754 2PEPYC 9654 2PXeon Platinum 8592+ 2PEPYC 9684XEPYC 9754Xeon Platinum 8490H 2PXeon Max 9480 2PEPYC 9654Xeon Max 9468 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Max 9480EPYC 8534PXeon Max 9468EPYC 8534PN4080120160200Min: 209.86 / Avg: 214.02 / Max: 219.87Min: 187.76 / Avg: 190.08 / Max: 194.89Min: 175.09 / Avg: 176.21 / Max: 178.35Min: 152.88 / Avg: 153.16 / Max: 153.46Min: 129.98 / Avg: 130.79 / Max: 131.57Min: 124.62 / Avg: 126.15 / Max: 128.28Min: 124.35 / Avg: 124.71 / Max: 124.98Min: 114.38 / Avg: 116.61 / Max: 117.54Min: 110.26 / Avg: 110.53 / Max: 110.83Min: 107.1 / Avg: 107.63 / Max: 108.16Min: 82.86 / Avg: 82.97 / Max: 83.1Min: 69.83 / Avg: 70.05 / Max: 70.24Min: 65.28 / Avg: 65.33 / Max: 65.36Min: 62.07 / Avg: 62.19 / Max: 62.24Min: 58.32 / Avg: 58.42 / Max: 58.54Min: 58.07 / Avg: 58.28 / Max: 58.38

SVT-AV1

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 2.0Encoder Mode: Preset 12 - Input: Bosphorus 4KEPYC 9654Xeon Platinum 8592+EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 9684XXeon Platinum 8592+ 2PEPYC 8534PXeon Platinum 8490HEPYC 9684X 2PEPYC 8534PNXeon Platinum 8490H 2PXeon Max 9480Xeon Max 9468Xeon Max 9480 2PXeon Max 9468 2P4080120160200SE +/- 0.80, N = 7SE +/- 0.20, N = 7SE +/- 1.88, N = 15SE +/- 1.32, N = 6SE +/- 1.41, N = 6SE +/- 0.43, N = 7SE +/- 0.42, N = 7SE +/- 0.71, N = 6SE +/- 0.41, N = 7SE +/- 0.88, N = 6SE +/- 0.78, N = 6SE +/- 0.25, N = 7SE +/- 0.40, N = 7SE +/- 0.61, N = 7SE +/- 0.97, N = 6SE +/- 0.83, N = 5178.52177.86171.22169.23168.78165.75165.50165.09164.25163.80157.36156.52151.72146.10127.55122.091. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq
OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 2.0Encoder Mode: Preset 12 - Input: Bosphorus 4KEPYC 9654Xeon Platinum 8592+EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 9684XXeon Platinum 8592+ 2PEPYC 8534PXeon Platinum 8490HEPYC 9684X 2PEPYC 8534PNXeon Platinum 8490H 2PXeon Max 9480Xeon Max 9468Xeon Max 9480 2PXeon Max 9468 2P306090120150Min: 175.07 / Avg: 178.52 / Max: 180.99Min: 176.95 / Avg: 177.86 / Max: 178.57Min: 151.47 / Avg: 171.22 / Max: 179.13Min: 165.81 / Avg: 169.23 / Max: 174.9Min: 162.91 / Avg: 168.78 / Max: 172.56Min: 164.24 / Avg: 165.75 / Max: 167.2Min: 163.4 / Avg: 165.49 / Max: 167.01Min: 162.63 / Avg: 165.09 / Max: 167.11Min: 162.43 / Avg: 164.25 / Max: 165.44Min: 160.45 / Avg: 163.79 / Max: 166.01Min: 155.48 / Avg: 157.36 / Max: 159.91Min: 155.7 / Avg: 156.52 / Max: 157.59Min: 150.35 / Avg: 151.72 / Max: 153.47Min: 143.58 / Avg: 146.1 / Max: 148.45Min: 125.11 / Avg: 127.55 / Max: 131.28Min: 119.74 / Avg: 122.09 / Max: 124.161. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

ASTC Encoder

OpenBenchmarking.orgMT/s, More Is BetterASTC Encoder 4.7Preset: MediumXeon Platinum 8592+ 2PEPYC 9754EPYC 9684X 2PEPYC 9684XEPYC 9654 2PXeon Platinum 8490H 2PXeon Max 9480 2PEPYC 9754 2PEPYC 9654Xeon Max 9468 2PXeon Platinum 8490HXeon Platinum 8592+EPYC 8534PXeon Max 9480EPYC 8534PNXeon Max 9468120240360480600SE +/- 1.56, N = 7SE +/- 0.39, N = 7SE +/- 3.11, N = 7SE +/- 0.63, N = 7SE +/- 3.54, N = 6SE +/- 2.79, N = 6SE +/- 0.77, N = 6SE +/- 0.52, N = 6SE +/- 0.20, N = 7SE +/- 0.52, N = 6SE +/- 0.16, N = 6SE +/- 1.17, N = 6SE +/- 0.07, N = 6SE +/- 0.08, N = 6SE +/- 0.07, N = 6SE +/- 0.03, N = 6550.02527.80508.09500.77491.53484.55483.10462.24449.11441.65333.99327.78294.62284.33273.67247.301. (CXX) g++ options: -O3 -flto -pthread
OpenBenchmarking.orgMT/s, More Is BetterASTC Encoder 4.7Preset: MediumXeon Platinum 8592+ 2PEPYC 9754EPYC 9684X 2PEPYC 9684XEPYC 9654 2PXeon Platinum 8490H 2PXeon Max 9480 2PEPYC 9754 2PEPYC 9654Xeon Max 9468 2PXeon Platinum 8490HXeon Platinum 8592+EPYC 8534PXeon Max 9480EPYC 8534PNXeon Max 9468100200300400500Min: 544.51 / Avg: 550.02 / Max: 557.3Min: 526.48 / Avg: 527.8 / Max: 528.95Min: 492.18 / Avg: 508.09 / Max: 514.99Min: 497.64 / Avg: 500.77 / Max: 502.11Min: 479.63 / Avg: 491.53 / Max: 500.35Min: 475.22 / Avg: 484.55 / Max: 496.05Min: 481.24 / Avg: 483.1 / Max: 486.35Min: 461.02 / Avg: 462.24 / Max: 464.3Min: 448.48 / Avg: 449.11 / Max: 449.93Min: 440.15 / Avg: 441.65 / Max: 443.01Min: 333.25 / Avg: 333.99 / Max: 334.3Min: 323.69 / Avg: 327.78 / Max: 332.24Min: 294.4 / Avg: 294.62 / Max: 294.81Min: 284.1 / Avg: 284.33 / Max: 284.68Min: 273.39 / Avg: 273.67 / Max: 273.86Min: 247.19 / Avg: 247.3 / Max: 247.371. (CXX) g++ options: -O3 -flto -pthread

libavif avifenc

OpenBenchmarking.orgSeconds, Fewer Is Betterlibavif avifenc 1.0Encoder Speed: 6, LosslessXeon Platinum 8592+ 2PEPYC 9684XXeon Platinum 8592+EPYC 9654EPYC 9654 2PEPYC 9684X 2PXeon Platinum 8490H 2PXeon Platinum 8490HXeon Max 9480Xeon Max 9468EPYC 9754EPYC 9754 2PXeon Max 9480 2PXeon Max 9468 2PEPYC 8534PEPYC 8534PN246810SE +/- 0.031, N = 7SE +/- 0.014, N = 7SE +/- 0.025, N = 7SE +/- 0.010, N = 7SE +/- 0.020, N = 7SE +/- 0.015, N = 7SE +/- 0.022, N = 7SE +/- 0.013, N = 7SE +/- 0.033, N = 6SE +/- 0.045, N = 6SE +/- 0.007, N = 6SE +/- 0.025, N = 6SE +/- 0.035, N = 6SE +/- 0.027, N = 6SE +/- 0.009, N = 6SE +/- 0.011, N = 65.6135.7575.7845.7995.8465.9506.1726.2786.6056.8366.8536.9867.0387.1217.1827.3011. (CXX) g++ options: -O3 -fPIC -lm
OpenBenchmarking.orgSeconds, Fewer Is Betterlibavif avifenc 1.0Encoder Speed: 6, LosslessXeon Platinum 8592+ 2PEPYC 9684XXeon Platinum 8592+EPYC 9654EPYC 9654 2PEPYC 9684X 2PXeon Platinum 8490H 2PXeon Platinum 8490HXeon Max 9480Xeon Max 9468EPYC 9754EPYC 9754 2PXeon Max 9480 2PXeon Max 9468 2PEPYC 8534PEPYC 8534PN3691215Min: 5.49 / Avg: 5.61 / Max: 5.76Min: 5.72 / Avg: 5.76 / Max: 5.83Min: 5.68 / Avg: 5.78 / Max: 5.87Min: 5.75 / Avg: 5.8 / Max: 5.83Min: 5.81 / Avg: 5.85 / Max: 5.95Min: 5.89 / Avg: 5.95 / Max: 6.02Min: 6.12 / Avg: 6.17 / Max: 6.28Min: 6.24 / Avg: 6.28 / Max: 6.34Min: 6.5 / Avg: 6.61 / Max: 6.7Min: 6.64 / Avg: 6.84 / Max: 6.93Min: 6.82 / Avg: 6.85 / Max: 6.87Min: 6.9 / Avg: 6.99 / Max: 7.08Min: 6.95 / Avg: 7.04 / Max: 7.19Min: 7.04 / Avg: 7.12 / Max: 7.21Min: 7.14 / Avg: 7.18 / Max: 7.21Min: 7.27 / Avg: 7.3 / Max: 7.341. (CXX) g++ options: -O3 -fPIC -lm

ACES DGEMM

This is a multi-threaded DGEMM benchmark. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgGFLOP/s, More Is BetterACES DGEMM 1.0Sustained Floating-Point RateEPYC 9754 2PEPYC 9684X 2PEPYC 9654 2PXeon Platinum 8592+ 2PXeon Platinum 8490H 2PEPYC 9684XEPYC 9754Xeon Max 9480 2PXeon Max 9468 2PEPYC 9654Xeon Platinum 8592+Xeon Platinum 8490HXeon Max 9480EPYC 8534PEPYC 8534PNXeon Max 946820406080100SE +/- 0.19, N = 10SE +/- 0.39, N = 9SE +/- 0.10, N = 9SE +/- 0.11, N = 8SE +/- 0.28, N = 7SE +/- 0.40, N = 7SE +/- 0.17, N = 7SE +/- 0.04, N = 7SE +/- 0.06, N = 7SE +/- 0.22, N = 7SE +/- 0.08, N = 6SE +/- 0.09, N = 5SE +/- 0.09, N = 5SE +/- 0.16, N = 5SE +/- 0.10, N = 5SE +/- 0.04, N = 484.6978.5068.8758.2545.9745.2544.9744.6739.3539.0929.1423.5422.5421.8221.0019.771. (CC) gcc options: -O3 -march=native -fopenmp
OpenBenchmarking.orgGFLOP/s, More Is BetterACES DGEMM 1.0Sustained Floating-Point RateEPYC 9754 2PEPYC 9684X 2PEPYC 9654 2PXeon Platinum 8592+ 2PXeon Platinum 8490H 2PEPYC 9684XEPYC 9754Xeon Max 9480 2PXeon Max 9468 2PEPYC 9654Xeon Platinum 8592+Xeon Platinum 8490HXeon Max 9480EPYC 8534PEPYC 8534PNXeon Max 94681632486480Min: 83.93 / Avg: 84.69 / Max: 85.99Min: 76.72 / Avg: 78.5 / Max: 80.31Min: 68.45 / Avg: 68.87 / Max: 69.29Min: 57.76 / Avg: 58.25 / Max: 58.71Min: 44.71 / Avg: 45.97 / Max: 47.18Min: 43.45 / Avg: 45.25 / Max: 46.29Min: 44.5 / Avg: 44.97 / Max: 45.81Min: 44.57 / Avg: 44.67 / Max: 44.81Min: 39.07 / Avg: 39.35 / Max: 39.58Min: 38.21 / Avg: 39.09 / Max: 39.83Min: 28.91 / Avg: 29.14 / Max: 29.35Min: 23.19 / Avg: 23.54 / Max: 23.66Min: 22.19 / Avg: 22.54 / Max: 22.74Min: 21.25 / Avg: 21.82 / Max: 22.23Min: 20.68 / Avg: 21 / Max: 21.32Min: 19.64 / Avg: 19.77 / Max: 19.831. (CC) gcc options: -O3 -march=native -fopenmp

NAS Parallel Benchmarks

NPB, NAS Parallel Benchmarks, is a benchmark developed by NASA for high-end computer systems. This test profile currently uses the MPI version of NPB. This test profile offers selecting the different NPB tests/problems and varying problem sizes. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgTotal Mop/s, More Is BetterNAS Parallel Benchmarks 3.4Test / Class: MG.CEPYC 9754 2PEPYC 9684X 2PXeon Platinum 8592+ 2PEPYC 9654 2PXeon Max 9468 2PXeon Max 9480 2PXeon Platinum 8490H 2PEPYC 9684XEPYC 9754EPYC 9654Xeon Platinum 8592+Xeon Max 9480Xeon Max 9468Xeon Platinum 8490HEPYC 8534PEPYC 8534PN50K100K150K200K250KSE +/- 1776.37, N = 11SE +/- 7207.31, N = 15SE +/- 1422.07, N = 7SE +/- 2707.72, N = 14SE +/- 1415.96, N = 9SE +/- 1298.67, N = 9SE +/- 1262.04, N = 9SE +/- 1372.89, N = 15SE +/- 884.47, N = 9SE +/- 1153.71, N = 15SE +/- 406.29, N = 9SE +/- 382.59, N = 10SE +/- 436.97, N = 10SE +/- 152.92, N = 9SE +/- 167.65, N = 8SE +/- 301.54, N = 8245447.72244738.81220893.78194942.32172614.10171436.47163333.21134994.14125567.07116725.04107321.8986407.4685910.9583448.7063930.6462449.551. (F9X) gfortran options: -O3 -march=native -lmpi_usempif08 -lmpi_mpifh -lmpi -lopen-rte -lopen-pal -lhwloc -levent_core -levent_pthreads -lm -lz 2. Open MPI 4.1.6
OpenBenchmarking.orgTotal Mop/s, More Is BetterNAS Parallel Benchmarks 3.4Test / Class: MG.CEPYC 9754 2PEPYC 9684X 2PXeon Platinum 8592+ 2PEPYC 9654 2PXeon Max 9468 2PXeon Max 9480 2PXeon Platinum 8490H 2PEPYC 9684XEPYC 9754EPYC 9654Xeon Platinum 8592+Xeon Max 9480Xeon Max 9468Xeon Platinum 8490HEPYC 8534PEPYC 8534PN40K80K120K160K200KMin: 233170.75 / Avg: 245447.72 / Max: 255160.98Min: 208510.15 / Avg: 244738.81 / Max: 315785.78Min: 215470.66 / Avg: 220893.78 / Max: 226829.96Min: 178935.43 / Avg: 194942.32 / Max: 211842.06Min: 164903.28 / Avg: 172614.1 / Max: 177274.16Min: 166974.27 / Avg: 171436.47 / Max: 178199.79Min: 159113.63 / Avg: 163333.21 / Max: 170615.72Min: 127793.03 / Avg: 134994.14 / Max: 144587.43Min: 119418.6 / Avg: 125567.07 / Max: 128581.27Min: 108294.61 / Avg: 116725.04 / Max: 123557.72Min: 105988.93 / Avg: 107321.89 / Max: 109240.43Min: 84619.8 / Avg: 86407.46 / Max: 88485.16Min: 83606.71 / Avg: 85910.95 / Max: 88256.51Min: 82696.98 / Avg: 83448.7 / Max: 83933.89Min: 63078.71 / Avg: 63930.64 / Max: 64423.05Min: 60600.68 / Avg: 62449.55 / Max: 63479.221. (F9X) gfortran options: -O3 -march=native -lmpi_usempif08 -lmpi_mpifh -lmpi -lopen-rte -lopen-pal -lhwloc -levent_core -levent_pthreads -lm -lz 2. Open MPI 4.1.6

libavif avifenc

OpenBenchmarking.orgSeconds, Fewer Is Betterlibavif avifenc 1.0Encoder Speed: 10, LosslessXeon Platinum 8592+Xeon Platinum 8592+ 2PEPYC 9684XEPYC 9654EPYC 9654 2PXeon Max 9480Xeon Max 9468Xeon Platinum 8490HEPYC 9684X 2PXeon Platinum 8490H 2PXeon Max 9480 2PXeon Max 9468 2PEPYC 9754EPYC 8534PNEPYC 8534PEPYC 9754 2P1.29152.5833.87455.1666.4575SE +/- 0.008, N = 8SE +/- 0.015, N = 8SE +/- 0.002, N = 8SE +/- 0.006, N = 8SE +/- 0.006, N = 8SE +/- 0.015, N = 7SE +/- 0.005, N = 7SE +/- 0.006, N = 7SE +/- 0.003, N = 7SE +/- 0.014, N = 7SE +/- 0.028, N = 7SE +/- 0.019, N = 7SE +/- 0.004, N = 7SE +/- 0.010, N = 7SE +/- 0.006, N = 7SE +/- 0.006, N = 74.4564.5794.7704.7924.8294.8674.9164.9234.9435.0745.3115.3175.6625.7345.7355.7401. (CXX) g++ options: -O3 -fPIC -lm
OpenBenchmarking.orgSeconds, Fewer Is Betterlibavif avifenc 1.0Encoder Speed: 10, LosslessXeon Platinum 8592+Xeon Platinum 8592+ 2PEPYC 9684XEPYC 9654EPYC 9654 2PXeon Max 9480Xeon Max 9468Xeon Platinum 8490HEPYC 9684X 2PXeon Platinum 8490H 2PXeon Max 9480 2PXeon Max 9468 2PEPYC 9754EPYC 8534PNEPYC 8534PEPYC 9754 2P246810Min: 4.42 / Avg: 4.46 / Max: 4.48Min: 4.53 / Avg: 4.58 / Max: 4.67Min: 4.76 / Avg: 4.77 / Max: 4.78Min: 4.77 / Avg: 4.79 / Max: 4.82Min: 4.81 / Avg: 4.83 / Max: 4.85Min: 4.78 / Avg: 4.87 / Max: 4.91Min: 4.9 / Avg: 4.92 / Max: 4.93Min: 4.9 / Avg: 4.92 / Max: 4.94Min: 4.93 / Avg: 4.94 / Max: 4.95Min: 4.99 / Avg: 5.07 / Max: 5.1Min: 5.22 / Avg: 5.31 / Max: 5.44Min: 5.24 / Avg: 5.32 / Max: 5.39Min: 5.65 / Avg: 5.66 / Max: 5.68Min: 5.7 / Avg: 5.73 / Max: 5.77Min: 5.71 / Avg: 5.73 / Max: 5.76Min: 5.73 / Avg: 5.74 / Max: 5.771. (CXX) g++ options: -O3 -fPIC -lm

srsRAN Project

OpenBenchmarking.orgMbps, More Is BettersrsRAN Project 23.10.1-20240325Test: PDSCH Processor Benchmark, Throughput ThreadXeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Max 9480Xeon Max 9468EPYC 9654EPYC 9684XXeon Platinum 8490HXeon Platinum 8490H 2PEPYC 9654 2PEPYC 9684X 2PXeon Max 9480 2PXeon Max 9468 2PEPYC 9754EPYC 9754 2PEPYC 8534PNEPYC 8534P160320480640800SE +/- 1.89, N = 8SE +/- 1.34, N = 8SE +/- 1.27, N = 8SE +/- 1.64, N = 8SE +/- 1.71, N = 8SE +/- 3.13, N = 8SE +/- 1.17, N = 8SE +/- 2.57, N = 8SE +/- 3.72, N = 8SE +/- 5.52, N = 8SE +/- 5.02, N = 8SE +/- 3.86, N = 8SE +/- 0.80, N = 7SE +/- 4.48, N = 7SE +/- 1.24, N = 7SE +/- 3.14, N = 7755.5742.9705.5702.6684.7680.7680.2675.5673.4664.7663.8651.9596.2576.8563.6557.91. (CXX) g++ options: -O3 -march=native -mavx2 -mavx -msse4.1 -mfma -mavx512f -mavx512cd -mavx512bw -mavx512dq -fno-trapping-math -fno-math-errno -ldl
OpenBenchmarking.orgMbps, More Is BettersrsRAN Project 23.10.1-20240325Test: PDSCH Processor Benchmark, Throughput ThreadXeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Max 9480Xeon Max 9468EPYC 9654EPYC 9684XXeon Platinum 8490HXeon Platinum 8490H 2PEPYC 9654 2PEPYC 9684X 2PXeon Max 9480 2PXeon Max 9468 2PEPYC 9754EPYC 9754 2PEPYC 8534PNEPYC 8534P130260390520650Min: 744 / Avg: 755.46 / Max: 760.7Min: 736.2 / Avg: 742.86 / Max: 748Min: 698.5 / Avg: 705.51 / Max: 709.4Min: 693.6 / Avg: 702.59 / Max: 706.9Min: 673.7 / Avg: 684.68 / Max: 688.7Min: 660.5 / Avg: 680.74 / Max: 687.8Min: 673.5 / Avg: 680.21 / Max: 684.9Min: 660.5 / Avg: 675.49 / Max: 682.4Min: 656.4 / Avg: 673.44 / Max: 686.1Min: 641.1 / Avg: 664.68 / Max: 683.1Min: 648.1 / Avg: 663.79 / Max: 686.5Min: 630.2 / Avg: 651.88 / Max: 668Min: 594 / Avg: 596.19 / Max: 599.9Min: 558 / Avg: 576.76 / Max: 588.8Min: 558.5 / Avg: 563.64 / Max: 568.6Min: 544.6 / Avg: 557.94 / Max: 566.11. (CXX) g++ options: -O3 -march=native -mavx2 -mavx -msse4.1 -mfma -mavx512f -mavx512cd -mavx512bw -mavx512dq -fno-trapping-math -fno-math-errno -ldl

LAMMPS Molecular Dynamics Simulator

LAMMPS is a classical molecular dynamics code, and an acronym for Large-scale Atomic/Molecular Massively Parallel Simulator. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgns/day, More Is BetterLAMMPS Molecular Dynamics Simulator 23Jun2022Model: Rhodopsin ProteinXeon Platinum 8592+ 2PEPYC 9684X 2PXeon Max 9480 2PEPYC 9754 2PEPYC 9654 2PXeon Max 9468 2PXeon Platinum 8490H 2PEPYC 9754EPYC 9684XEPYC 9654Xeon Platinum 8592+Xeon Max 9480Xeon Platinum 8490HXeon Max 9468EPYC 8534PEPYC 8534PN1224364860SE +/- 0.97, N = 15SE +/- 0.43, N = 7SE +/- 0.09, N = 8SE +/- 0.24, N = 5SE +/- 0.39, N = 7SE +/- 0.11, N = 9SE +/- 0.33, N = 8SE +/- 0.29, N = 10SE +/- 0.35, N = 15SE +/- 0.14, N = 11SE +/- 0.29, N = 15SE +/- 0.04, N = 11SE +/- 0.36, N = 15SE +/- 0.05, N = 11SE +/- 0.29, N = 15SE +/- 0.30, N = 1555.5053.7752.2451.6350.1247.5142.2840.3940.0036.1534.3030.8428.7227.6324.2521.941. (CXX) g++ options: -O3 -lm -ldl
OpenBenchmarking.orgns/day, More Is BetterLAMMPS Molecular Dynamics Simulator 23Jun2022Model: Rhodopsin ProteinXeon Platinum 8592+ 2PEPYC 9684X 2PXeon Max 9480 2PEPYC 9754 2PEPYC 9654 2PXeon Max 9468 2PXeon Platinum 8490H 2PEPYC 9754EPYC 9684XEPYC 9654Xeon Platinum 8592+Xeon Max 9480Xeon Platinum 8490HXeon Max 9468EPYC 8534PEPYC 8534PN1122334455Min: 49.67 / Avg: 55.5 / Max: 63.1Min: 51.6 / Avg: 53.77 / Max: 54.85Min: 51.98 / Avg: 52.24 / Max: 52.65Min: 51.22 / Avg: 51.63 / Max: 52.27Min: 48.89 / Avg: 50.12 / Max: 51.82Min: 46.93 / Avg: 47.51 / Max: 47.92Min: 41.22 / Avg: 42.28 / Max: 43.66Min: 39.27 / Avg: 40.39 / Max: 42.04Min: 37.21 / Avg: 40 / Max: 41.7Min: 35.52 / Avg: 36.15 / Max: 36.85Min: 32.32 / Avg: 34.3 / Max: 36.34Min: 30.65 / Avg: 30.84 / Max: 31.07Min: 26.69 / Avg: 28.72 / Max: 30.77Min: 27.37 / Avg: 27.63 / Max: 27.89Min: 22.64 / Avg: 24.25 / Max: 25.9Min: 20.69 / Avg: 21.94 / Max: 24.591. (CXX) g++ options: -O3 -lm -ldl

libavif avifenc

OpenBenchmarking.orgSeconds, Fewer Is Betterlibavif avifenc 1.0Encoder Speed: 6EPYC 9684XEPYC 9654Xeon Platinum 8592+ 2PEPYC 9654 2PEPYC 9684X 2PXeon Platinum 8592+Xeon Platinum 8490H 2PXeon Platinum 8490HEPYC 9754EPYC 9754 2PEPYC 8534PXeon Max 9480EPYC 8534PNXeon Max 9468Xeon Max 9480 2PXeon Max 9468 2P0.84961.69922.54883.39844.248SE +/- 0.005, N = 10SE +/- 0.011, N = 10SE +/- 0.009, N = 10SE +/- 0.008, N = 10SE +/- 0.005, N = 9SE +/- 0.016, N = 9SE +/- 0.008, N = 9SE +/- 0.022, N = 9SE +/- 0.002, N = 9SE +/- 0.026, N = 9SE +/- 0.016, N = 9SE +/- 0.011, N = 9SE +/- 0.011, N = 9SE +/- 0.017, N = 9SE +/- 0.022, N = 9SE +/- 0.029, N = 82.7232.7562.8052.8102.8902.9713.0443.1693.2513.3413.4843.5503.6233.7303.7383.7761. (CXX) g++ options: -O3 -fPIC -lm
OpenBenchmarking.orgSeconds, Fewer Is Betterlibavif avifenc 1.0Encoder Speed: 6EPYC 9684XEPYC 9654Xeon Platinum 8592+ 2PEPYC 9654 2PEPYC 9684X 2PXeon Platinum 8592+Xeon Platinum 8490H 2PXeon Platinum 8490HEPYC 9754EPYC 9754 2PEPYC 8534PXeon Max 9480EPYC 8534PNXeon Max 9468Xeon Max 9480 2PXeon Max 9468 2P246810Min: 2.7 / Avg: 2.72 / Max: 2.75Min: 2.73 / Avg: 2.76 / Max: 2.84Min: 2.77 / Avg: 2.81 / Max: 2.87Min: 2.78 / Avg: 2.81 / Max: 2.86Min: 2.87 / Avg: 2.89 / Max: 2.91Min: 2.91 / Avg: 2.97 / Max: 3.06Min: 3.02 / Avg: 3.04 / Max: 3.08Min: 3.07 / Avg: 3.17 / Max: 3.24Min: 3.24 / Avg: 3.25 / Max: 3.27Min: 3.28 / Avg: 3.34 / Max: 3.52Min: 3.42 / Avg: 3.48 / Max: 3.55Min: 3.52 / Avg: 3.55 / Max: 3.62Min: 3.59 / Avg: 3.62 / Max: 3.67Min: 3.65 / Avg: 3.73 / Max: 3.81Min: 3.67 / Avg: 3.74 / Max: 3.87Min: 3.64 / Avg: 3.78 / Max: 3.931. (CXX) g++ options: -O3 -fPIC -lm

oneDNN

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.4Harness: Deconvolution Batch shapes_3d - Engine: CPUXeon Platinum 8592+ 2PXeon Platinum 8490H 2PEPYC 9754 2PXeon Max 9480 2PXeon Platinum 8592+EPYC 9754Xeon Max 9468 2PEPYC 9684X 2PEPYC 9654 2PXeon Platinum 8490HEPYC 9684XEPYC 9654Xeon Max 9480Xeon Max 9468EPYC 8534PEPYC 8534PN0.40440.80881.21321.61762.022SE +/- 0.000902, N = 9SE +/- 0.001274, N = 9SE +/- 0.003127, N = 9SE +/- 0.001240, N = 9SE +/- 0.000392, N = 9SE +/- 0.001089, N = 9SE +/- 0.000806, N = 9SE +/- 0.002070, N = 9SE +/- 0.001921, N = 9SE +/- 0.000805, N = 9SE +/- 0.001272, N = 9SE +/- 0.001484, N = 9SE +/- 0.000927, N = 9SE +/- 0.000508, N = 9SE +/- 0.000791, N = 9SE +/- 0.001685, N = 90.6242500.7361700.8296530.8643580.9071610.9436210.9450751.0019141.0094731.0774301.1192301.1548701.1964301.2640701.4983501.797490MIN: 0.58MIN: 0.66MIN: 0.65MIN: 0.81MIN: 0.87MIN: 0.92MIN: 0.9MIN: 0.92MIN: 0.94MIN: 1.06MIN: 1.02MIN: 1.04MIN: 1.16MIN: 1.21MIN: 1.37MIN: 1.651. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread
OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.4Harness: Deconvolution Batch shapes_3d - Engine: CPUXeon Platinum 8592+ 2PXeon Platinum 8490H 2PEPYC 9754 2PXeon Max 9480 2PXeon Platinum 8592+EPYC 9754Xeon Max 9468 2PEPYC 9684X 2PEPYC 9654 2PXeon Platinum 8490HEPYC 9684XEPYC 9654Xeon Max 9480Xeon Max 9468EPYC 8534PEPYC 8534PN246810Min: 0.62 / Avg: 0.62 / Max: 0.63Min: 0.73 / Avg: 0.74 / Max: 0.74Min: 0.82 / Avg: 0.83 / Max: 0.85Min: 0.86 / Avg: 0.86 / Max: 0.87Min: 0.91 / Avg: 0.91 / Max: 0.91Min: 0.94 / Avg: 0.94 / Max: 0.95Min: 0.94 / Avg: 0.95 / Max: 0.95Min: 0.99 / Avg: 1 / Max: 1.01Min: 1 / Avg: 1.01 / Max: 1.02Min: 1.07 / Avg: 1.08 / Max: 1.08Min: 1.11 / Avg: 1.12 / Max: 1.12Min: 1.15 / Avg: 1.15 / Max: 1.16Min: 1.19 / Avg: 1.2 / Max: 1.2Min: 1.26 / Avg: 1.26 / Max: 1.27Min: 1.5 / Avg: 1.5 / Max: 1.5Min: 1.79 / Avg: 1.8 / Max: 1.811. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread

Primesieve

OpenBenchmarking.orgSeconds, Fewer Is BetterPrimesieve 12.1Length: 1e12EPYC 9684X 2PEPYC 9654 2PEPYC 9754 2PEPYC 9754EPYC 9684XEPYC 9654Xeon Platinum 8592+ 2PXeon Platinum 8490H 2PXeon Max 9480 2PXeon Max 9468 2PEPYC 8534PXeon Platinum 8592+EPYC 8534PNXeon Platinum 8490HXeon Max 9480Xeon Max 9468246810SE +/- 0.003, N = 12SE +/- 0.005, N = 12SE +/- 0.010, N = 15SE +/- 0.002, N = 11SE +/- 0.004, N = 11SE +/- 0.003, N = 11SE +/- 0.008, N = 11SE +/- 0.006, N = 10SE +/- 0.005, N = 10SE +/- 0.004, N = 9SE +/- 0.006, N = 8SE +/- 0.007, N = 8SE +/- 0.003, N = 8SE +/- 0.019, N = 8SE +/- 0.010, N = 7SE +/- 0.006, N = 71.1991.2421.3591.9211.9842.0582.1872.3252.6913.1213.8014.2504.5454.5765.3326.1601. (CXX) g++ options: -O3
OpenBenchmarking.orgSeconds, Fewer Is BetterPrimesieve 12.1Length: 1e12EPYC 9684X 2PEPYC 9654 2PEPYC 9754 2PEPYC 9754EPYC 9684XEPYC 9654Xeon Platinum 8592+ 2PXeon Platinum 8490H 2PXeon Max 9480 2PXeon Max 9468 2PEPYC 8534PXeon Platinum 8592+EPYC 8534PNXeon Platinum 8490HXeon Max 9480Xeon Max 9468246810Min: 1.18 / Avg: 1.2 / Max: 1.23Min: 1.21 / Avg: 1.24 / Max: 1.27Min: 1.3 / Avg: 1.36 / Max: 1.44Min: 1.91 / Avg: 1.92 / Max: 1.93Min: 1.97 / Avg: 1.98 / Max: 2.01Min: 2.05 / Avg: 2.06 / Max: 2.08Min: 2.14 / Avg: 2.19 / Max: 2.24Min: 2.29 / Avg: 2.32 / Max: 2.35Min: 2.67 / Avg: 2.69 / Max: 2.72Min: 3.11 / Avg: 3.12 / Max: 3.15Min: 3.78 / Avg: 3.8 / Max: 3.83Min: 4.23 / Avg: 4.25 / Max: 4.29Min: 4.53 / Avg: 4.54 / Max: 4.56Min: 4.5 / Avg: 4.58 / Max: 4.65Min: 5.29 / Avg: 5.33 / Max: 5.37Min: 6.14 / Avg: 6.16 / Max: 6.191. (CXX) g++ options: -O3

Parallel BZIP2 Compression

OpenBenchmarking.orgSeconds, Fewer Is BetterParallel BZIP2 Compression 1.1.13FreeBSD-13.0-RELEASE-amd64-memstick.img CompressionEPYC 9754 2PEPYC 9684X 2PEPYC 9654 2PEPYC 9754EPYC 9684XEPYC 9654Xeon Platinum 8592+ 2PXeon Platinum 8490H 2PXeon Max 9480 2PXeon Platinum 8592+Xeon Max 9468 2PXeon Platinum 8490HEPYC 8534PXeon Max 9480EPYC 8534PNXeon Max 94680.59221.18441.77662.36882.961SE +/- 0.012053, N = 15SE +/- 0.015217, N = 15SE +/- 0.019468, N = 15SE +/- 0.010826, N = 15SE +/- 0.015384, N = 15SE +/- 0.014512, N = 15SE +/- 0.024402, N = 15SE +/- 0.017240, N = 15SE +/- 0.028863, N = 15SE +/- 0.023842, N = 15SE +/- 0.030907, N = 15SE +/- 0.007749, N = 10SE +/- 0.023387, N = 15SE +/- 0.020941, N = 15SE +/- 0.016947, N = 15SE +/- 0.023295, N = 151.0683981.1094461.1263291.3557371.3690631.4229541.4323621.4692101.7112961.8475371.9829322.1448572.2004972.2877662.3211952.6320771. (CXX) g++ options: -O2 -pthread -lbz2 -lpthread
OpenBenchmarking.orgSeconds, Fewer Is BetterParallel BZIP2 Compression 1.1.13FreeBSD-13.0-RELEASE-amd64-memstick.img CompressionEPYC 9754 2PEPYC 9684X 2PEPYC 9654 2PEPYC 9754EPYC 9684XEPYC 9654Xeon Platinum 8592+ 2PXeon Platinum 8490H 2PXeon Max 9480 2PXeon Platinum 8592+Xeon Max 9468 2PXeon Platinum 8490HEPYC 8534PXeon Max 9480EPYC 8534PNXeon Max 9468246810Min: 1 / Avg: 1.07 / Max: 1.17Min: 1.02 / Avg: 1.11 / Max: 1.23Min: 1.02 / Avg: 1.13 / Max: 1.31Min: 1.3 / Avg: 1.36 / Max: 1.44Min: 1.31 / Avg: 1.37 / Max: 1.55Min: 1.34 / Avg: 1.42 / Max: 1.53Min: 1.33 / Avg: 1.43 / Max: 1.7Min: 1.4 / Avg: 1.47 / Max: 1.67Min: 1.55 / Avg: 1.71 / Max: 1.92Min: 1.7 / Avg: 1.85 / Max: 2.11Min: 1.86 / Avg: 1.98 / Max: 2.22Min: 2.11 / Avg: 2.14 / Max: 2.2Min: 2 / Avg: 2.2 / Max: 2.36Min: 2.15 / Avg: 2.29 / Max: 2.4Min: 2.18 / Avg: 2.32 / Max: 2.42Min: 2.49 / Avg: 2.63 / Max: 2.871. (CXX) g++ options: -O2 -pthread -lbz2 -lpthread

CPU Power Consumption Monitor

OpenBenchmarking.orgWattsCPU Power Consumption MonitorPhoronix Test Suite System MonitoringEPYC 8534PNEPYC 8534PEPYC 9754EPYC 9654Xeon Platinum 8592+Xeon Platinum 8490HEPYC 9684XXeon Max 9468Xeon Max 9480EPYC 9754 2PXeon Platinum 8592+ 2PEPYC 9654 2PXeon Platinum 8490H 2PEPYC 9684X 2PXeon Max 9468 2PXeon Max 9480 2P170340510680850Min: 9.26 / Avg: 114.13 / Max: 155.71Min: 8.43 / Avg: 128.7 / Max: 184.62Min: 10.09 / Avg: 225.05 / Max: 397.44Min: 14.69 / Avg: 244.69 / Max: 373.1Min: 17.77 / Avg: 260.08 / Max: 405.42Min: 30.38 / Avg: 278.1 / Max: 383.24Min: 17.06 / Avg: 290.08 / Max: 413.51Min: 38.11 / Avg: 291.53 / Max: 379.76Min: 38.16 / Avg: 295.53 / Max: 384.53Min: 20.22 / Avg: 375.51 / Max: 735.74Min: 39.72 / Avg: 455.07 / Max: 946.96Min: 35.7 / Avg: 464.49 / Max: 751.79Min: 87.48 / Avg: 517.33 / Max: 758.17Min: 33.66 / Avg: 525.49 / Max: 837.69Min: 102.49 / Avg: 566.6 / Max: 756.48Min: 95.52 / Avg: 569.8 / Max: 760.61

258 Results Shown

WRF
OpenVKL
NWChem
High Performance Conjugate Gradient
RELION
BRL-CAD
Xcompact3d Incompact3d
ASKAP
CloverLeaf
TensorFlow
PostgreSQL:
  100 - 1000 - Read Only - Average Latency
  100 - 1000 - Read Only
TensorFlow
PyTorch:
  CPU - 512 - ResNet-152
  CPU - 256 - ResNet-152
Stockfish
OpenSSL:
  RSA4096:
    verify/s
    sign/s
PyTorch
Apache IoTDB:
  800 - 100 - 800 - 100:
    Average Latency
    point/sec
Timed Linux Kernel Compilation
SecureMark
ClickHouse:
  100M Rows Hits Dataset, Third Run
  100M Rows Hits Dataset, Second Run
  100M Rows Hits Dataset, First Run / Cold Cache
Apache IoTDB:
  500 - 100 - 800 - 400:
    Average Latency
    point/sec
OpenRadioss
Timed Gem5 Compilation
NAMD
ONNX Runtime:
  fcn-resnet101-11 - CPU - Standard:
    Inference Time Cost (ms)
    Inferences Per Second
LAMMPS Molecular Dynamics Simulator
TensorFlow
LuxCoreRender
Timed Node.js Compilation
PostgreSQL:
  100 - 1000 - Read Write - Average Latency
  100 - 1000 - Read Write
ONNX Runtime:
  Faster R-CNN R-50-FPN-int8 - CPU - Standard:
    Inference Time Cost (ms)
    Inferences Per Second
OpenSSL:
  AES-128-GCM
  AES-256-GCM
  SHA512
  ChaCha20
  SHA256
  ChaCha20-Poly1305
LuxCoreRender
ONNX Runtime:
  ResNet50 v1-12-int8 - CPU - Standard:
    Inference Time Cost (ms)
    Inferences Per Second
FFmpeg
Blender
FFmpeg:
  libx265 - Video On Demand
  libx265 - Platform
RocksDB
PyTorch
ONNX Runtime:
  ArcFace ResNet-100 - CPU - Standard:
    Inference Time Cost (ms)
    Inferences Per Second
OSPRay
Numpy Benchmark
LuxCoreRender
PyTorch
ONNX Runtime:
  CaffeNet 12-int8 - CPU - Standard:
    Inference Time Cost (ms)
    Inferences Per Second
OpenFOAM:
  drivaerFastback, Medium Mesh Size - Execution Time
  drivaerFastback, Medium Mesh Size - Mesh Time
Timed LLVM Compilation
Speedb
Llamafile
OpenVINO:
  Person Detection FP16 - CPU:
    ms
    FPS
ONNX Runtime:
  CaffeNet 12-int8 - CPU - Parallel:
    Inference Time Cost (ms)
    Inferences Per Second
PyTorch
ONNX Runtime:
  yolov4 - CPU - Standard:
    Inference Time Cost (ms)
    Inferences Per Second
OpenRadioss
ONNX Runtime:
  fcn-resnet101-11 - CPU - Parallel:
    Inference Time Cost (ms)
    Inferences Per Second
Timed Godot Game Engine Compilation
ONNX Runtime:
  bertsquad-12 - CPU - Standard:
    Inference Time Cost (ms)
    Inferences Per Second
TensorFlow
Zstd Compression:
  19 - Decompression Speed
  19 - Compression Speed
QMCPACK
Speedb
OSPRay
Xmrig
ONNX Runtime:
  GPT-2 - CPU - Standard:
    Inference Time Cost (ms)
    Inferences Per Second
OpenVINO:
  Age Gender Recognition Retail 0013 FP16-INT8 - CPU:
    ms
    FPS
ONNX Runtime:
  T5 Encoder - CPU - Standard:
    Inference Time Cost (ms)
    Inferences Per Second
VVenC
ONNX Runtime:
  super-resolution-10 - CPU - Standard:
    Inference Time Cost (ms)
    Inferences Per Second
Zstd Compression:
  19, Long Mode - Decompression Speed
  19, Long Mode - Compression Speed
NAMD
ONNX Runtime:
  ResNet50 v1-12-int8 - CPU - Parallel:
    Inference Time Cost (ms)
    Inferences Per Second
  T5 Encoder - CPU - Parallel:
    Inference Time Cost (ms)
    Inferences Per Second
OpenVINO:
  Noise Suppression Poconet-Like FP16 - CPU:
    ms
    FPS
CloverLeaf
OSPRay Studio
TensorFlow
Memcached
ASKAP:
  tConvolve MPI - Gridding
  tConvolve MPI - Degridding
OpenVINO:
  Machine Translation EN To DE FP16 - CPU:
    ms
    FPS
  Road Segmentation ADAS FP16-INT8 - CPU:
    ms
    FPS
  Vehicle Detection FP16-INT8 - CPU:
    ms
    FPS
OSPRay Studio
Helsing
libavif avifenc
OSPRay Studio
ONNX Runtime:
  Faster R-CNN R-50-FPN-int8 - CPU - Parallel:
    Inference Time Cost (ms)
    Inferences Per Second
OSPRay Studio:
  3 - 4K - 16 - Path Tracer - CPU
  1 - 4K - 16 - Path Tracer - CPU
  1 - 4K - 1 - Path Tracer - CPU
QuantLib
OSPRay
OpenVINO:
  Face Detection FP16-INT8 - CPU:
    ms
    FPS
ONNX Runtime:
  bertsquad-12 - CPU - Parallel:
    Inference Time Cost (ms)
    Inferences Per Second
OpenVINO:
  Person Vehicle Bike Detection FP16 - CPU:
    ms
    FPS
  Person Re-Identification Retail FP16 - CPU:
    ms
    FPS
  Weld Porosity Detection FP16-INT8 - CPU:
    ms
    FPS
ONNX Runtime:
  GPT-2 - CPU - Parallel:
    Inference Time Cost (ms)
    Inferences Per Second
OpenVINO:
  Face Detection Retail FP16-INT8 - CPU:
    ms
    FPS
ONNX Runtime:
  yolov4 - CPU - Parallel:
    Inference Time Cost (ms)
    Inferences Per Second
OpenVINO:
  Handwritten English Recognition FP16-INT8 - CPU:
    ms
    FPS
srsRAN Project
ONNX Runtime:
  ArcFace ResNet-100 - CPU - Parallel:
    Inference Time Cost (ms)
    Inferences Per Second
GPAW
Blender
GraphicsMagick:
  Noise-Gaussian
  Sharpen
  Enhanced
ONNX Runtime:
  super-resolution-10 - CPU - Parallel:
    Inference Time Cost (ms)
    Inferences Per Second
GraphicsMagick
RocksDB
Aircrack-ng
Timed Linux Kernel Compilation
Blender
miniBUDE:
  OpenMP - BM2:
    Billion Interactions/s
    GFInst/s
Liquid-DSP
WebP Image Encode
TensorFlow
Coremark
7-Zip Compression:
  Decompression Rating
  Compression Rating
LULESH
srsRAN Project
NAS Parallel Benchmarks
Algebraic Multi-Grid Benchmark
miniFE
OpenRadioss
John The Ripper
libavif avifenc
VVenC
GROMACS
ASTC Encoder
Llamafile
Primesieve
Liquid-DSP:
  1 - 256 - 57
  64 - 256 - 512
Embree
SVT-AV1
Liquid-DSP:
  1 - 256 - 32
  64 - 256 - 57
  128 - 256 - 512
QuantLib
TensorFlow
ASTC Encoder
John The Ripper
Liquid-DSP:
  256 - 256 - 512
  128 - 256 - 57
John The Ripper
Liquid-DSP:
  256 - 256 - 57
  256 - 256 - 32
  128 - 256 - 32
  64 - 256 - 32
Google SynthMark
TensorFlow
uvg266:
  Bosphorus 4K - Slow
  Bosphorus 4K - Medium
Appleseed
Blender
SVT-AV1
Blender
Pennant
Kvazaar:
  Bosphorus 4K - Medium
  Bosphorus 4K - Slow
OpenFOAM:
  drivaerFastback, Small Mesh Size - Execution Time
  drivaerFastback, Small Mesh Size - Mesh Time
Pennant
Intel Open Image Denoise
uvg266
TensorFlow
Blender
Timed FFmpeg Compilation
NAS Parallel Benchmarks
ASTC Encoder
NAS Parallel Benchmarks
SVT-AV1
x265
NAS Parallel Benchmarks
Y-Cruncher
PyBench
Xcompact3d Incompact3d
miniBUDE:
  OpenMP - BM1:
    Billion Interactions/s
    GFInst/s
Timed Mesa Compilation
srsRAN Project
Kvazaar
Timed ImageMagick Compilation
m-queens
NAS Parallel Benchmarks
Y-Cruncher
Intel Open Image Denoise:
  RT.ldr_alb_nrm.3840x2160 - CPU-Only
  RT.hdr_alb_nrm.3840x2160 - CPU-Only
Embree
GNU Octave Benchmark
WebP Image Encode
Embree
SVT-AV1
ASTC Encoder
libavif avifenc
ACES DGEMM
NAS Parallel Benchmarks
libavif avifenc
srsRAN Project
LAMMPS Molecular Dynamics Simulator
libavif avifenc
oneDNN
Primesieve
Parallel BZIP2 Compression
CPU Power Consumption Monitor