2024 Server CPUs

2 x Intel Xeon 6780E testing with a Quanta Cloud QuantaGrid D55Q-2U S7Q-MB-MPS-MDP (2A05.QCT001 BIOS) and ASPEED on Ubuntu 24.04 via the Phoronix Test Suite.

Compare your own system(s) to this result file with the Phoronix Test Suite by running the command: phoronix-test-suite benchmark 2406049-NE-2024SERVE17
Jump To Table - Results

View

Do Not Show Noisy Results
Do Not Show Results With Incomplete Data
Do Not Show Results With Little Change/Spread
List Notable Results

Limit displaying results to tests within:

AV1 2 Tests
BLAS (Basic Linear Algebra Sub-Routine) Tests 4 Tests
C++ Boost Tests 5 Tests
Chess Test Suite 2 Tests
Timed Code Compilation 8 Tests
C/C++ Compiler Tests 16 Tests
Compression Tests 3 Tests
CPU Massive 25 Tests
Creator Workloads 23 Tests
Cryptography 5 Tests
Database Test Suite 5 Tests
Encoding 7 Tests
Fortran Tests 7 Tests
Game Development 5 Tests
HPC - High Performance Computing 29 Tests
Imaging 3 Tests
Common Kernel Benchmarks 3 Tests
LAPACK (Linear Algebra Pack) Tests 3 Tests
Linear Algebra 2 Tests
Machine Learning 7 Tests
Molecular Dynamics 10 Tests
MPI Benchmarks 10 Tests
Multi-Core 44 Tests
NVIDIA GPU Compute 3 Tests
Intel oneAPI 7 Tests
OpenMPI Tests 18 Tests
Programmer / Developer System Benchmarks 12 Tests
Python 2 Tests
Raytracing 2 Tests
Renderers 5 Tests
Scientific Computing 15 Tests
Software Defined Radio 2 Tests
Server 7 Tests
Server CPU Tests 17 Tests
Single-Threaded 2 Tests
Video Encoding 7 Tests
Common Workstation Benchmarks 3 Tests

Statistics

Show Overall Harmonic Mean(s)
Show Overall Geometric Mean
Show Geometric Means Per-Suite/Category
Show Wins / Losses Counts (Pie Chart)
Normalize Results
Remove Outliers Before Calculating Averages

Graph Settings

Force Line Graphs Where Applicable
Convert To Scalar Where Applicable
Disable Color Branding
Prefer Vertical Bar Graphs
No Box Plots
On Line Graphs With Missing Data, Connect The Line Gaps

Additional Graphs

Show Perf Per Core/Thread Calculation Graphs Where Applicable
Show Perf Per Clock Calculation Graphs Where Applicable
Show Perf Per RAM Channel Calculation Graphs Where Applicable

Multi-Way Comparison

Condense Multi-Option Tests Into Single Result Graphs
Condense Test Profiles With Multiple Version Results Into Single Result Graphs

Table

Show Detailed System Result Table

Run Management

Highlight
Result
Hide
Result
Result
Identifier
View Logs
Performance Per
Dollar
Date
Run
  Test
  Duration
Xeon Platinum 8490H
April 16
  22 Hours, 19 Minutes
Xeon Platinum 8490H 2P
April 17
  23 Hours
Xeon Platinum 8592+
April 11
  22 Hours, 9 Minutes
Xeon Platinum 8592+ 2P
April 08
  23 Hours, 49 Minutes
Xeon Max 9468
April 21
  1 Day, 3 Hours, 43 Minutes
Xeon Max 9468 2P
April 22
  1 Day, 34 Minutes
Xeon Max 9480
April 26
  1 Day, 1 Hour, 37 Minutes
Xeon Max 9480 2P
April 27
  1 Day, 6 Hours, 26 Minutes
Xeon Platinum 8380 2P
May 07
  1 Day, 5 Hours, 29 Minutes
Xeon Platinum 8380
May 09
  1 Day, 7 Hours, 15 Minutes
EPYC 9684X 2P
May 11
  1 Day, 4 Hours, 57 Minutes
EPYC 9684X
May 12
  1 Day, 27 Minutes
EPYC 9654
May 13
  1 Day, 1 Hour, 48 Minutes
EPYC 9654 2P
May 14
  1 Day, 6 Hours, 48 Minutes
EPYC 9754
May 15
  1 Day, 6 Hours
EPYC 9754 2P
May 17
  1 Day, 9 Hours, 52 Minutes
EPYC 8534P
May 18
  1 Day, 3 Hours, 8 Minutes
EPYC 8534PN
May 19
  1 Day, 3 Hours, 48 Minutes
Xeon 6766E 2P
May 24
  1 Day, 3 Hours, 18 Minutes
Xeon 6766E
May 25
  18 Hours, 24 Minutes
Xeon 6780E
May 26
  17 Hours, 33 Minutes
Xeon 6780E 2P
May 27
  23 Hours, 13 Minutes
Invert Hiding All Results Option
  1 Day, 2 Hours, 10 Minutes

Only show results where is faster than
Only show results matching title/arguments (delimit multiple options with a comma):
Do not show results matching title/arguments (delimit multiple options with a comma):


2024 Server CPUsProcessorMotherboardChipsetMemoryDiskGraphicsNetworkMonitorOSKernelCompilerFile-SystemScreen ResolutionXeon Platinum 8490HXeon Platinum 8490H 2PXeon Platinum 8592+Xeon Platinum 8592+ 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PXeon Platinum 8380 2PXeon Platinum 8380EPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PNXeon 6766E 2PXeon 6766EXeon 6780EXeon 6780E 2PIntel Xeon Platinum 8490H @ 3.50GHz (60 Cores / 120 Threads)Quanta Cloud QuantaGrid D54Q-2U S6Q-MB-MPS (3B05.TEL4P1 BIOS)Intel Device 1bce512GB2 x 1920GB KIOXIA KCD8XPUG1T92ASPEEDUbuntu 24.046.9.0-060900rc3-generic (x86_64)GCC 13.2.0ext41920x12002 x Intel Xeon Platinum 8490H @ 3.50GHz (120 Cores / 240 Threads)1008GB2 x Intel X710 for 10GBASE-TINTEL XEON PLATINUM 8592+ @ 3.90GHz (64 Cores / 128 Threads)512GB2 x INTEL XEON PLATINUM 8592+ @ 3.90GHz (128 Cores / 256 Threads)1008GB2 x Intel X710 for 10GBASE-TIntel Xeon Max 9468 @ 3.50GHz (48 Cores / 96 Threads)576GB2 x Intel Xeon Max 9468 @ 3.50GHz (96 Cores / 192 Threads)1136GB2 x Intel X710 for 10GBASE-TIntel Xeon Max 9480 @ 3.50GHz (56 Cores / 112 Threads)576GB2 x Intel Xeon Max 9480 @ 3.50GHz (112 Cores / 224 Threads)1136GB2 x Intel X710 for 10GBASE-T2 x Intel Xeon Platinum 8380 @ 3.40GHz (80 Cores / 160 Threads)Intel M50CYP2SB2U (SE5C6200.86B.0022.D08.2103221623 BIOS)Intel Ice Lake IEH512GBVE2282 x Intel X710 for 10GBASE-T + 2 x Intel E810-C for QSFP1920x1080Intel Xeon Platinum 8380 @ 3.40GHz (40 Cores / 80 Threads)256GB2 x AMD EPYC 9684X 96-Core @ 2.55GHz (192 Cores / 384 Threads)AMD Titanite_4G (RTI1007B BIOS)AMD Device 14a41520GBBroadcom NetXtreme BCM5720 PCIe1920x1200AMD EPYC 9684X 96-Core @ 2.55GHz (96 Cores / 192 Threads)12 x 64GB DDR5-4800MT/s Samsung M321R8GA0BB0-CQKEGAMD EPYC 9654 96-Core @ 2.40GHz (96 Cores / 192 Threads)2 x AMD EPYC 9654 96-Core @ 2.40GHz (192 Cores / 384 Threads)1520GBAMD EPYC 9754 128-Core @ 2.25GHz (128 Cores / 256 Threads)12 x 64GB DDR5-4800MT/s Samsung M321R8GA0BB0-CQKEG2 x AMD EPYC 9754 128-Core @ 2.25GHz (256 Cores / 512 Threads)1520GBAMD EPYC 8534P 64-Core @ 2.30GHz (64 Cores / 128 Threads)AMD Cinnabar (RCB1009C BIOS)6 x 32GB DDR5-4800MT/s Samsung M321R4GA0BB0-CQKMG2 x 1920GB KIOXIA KCD8XPUG1T92 + 2000GB Corsair MP700 PRO2 x Broadcom NetXtreme BCM5720 PCIeAMD EPYC 8534PN 64-Core @ 2.00GHz (64 Cores / 128 Threads)2 x 1920GB KIOXIA KCD8XPUG1T922 x Intel Xeon 6766E @ 2.70GHz (288 Cores)Quanta Cloud QuantaGrid D55Q-2U S7Q-MB-MPS-MDP (2A05.QCT001 BIOS)Intel Ice Lake IEH512GB3201GB Micron_7450_MTFDKCB3T2TFS + 2 x 1920GB KIOXIA KCD8XPUG1T922 x Broadcom BCM57416 NetXtreme-E Dual-Media 10G RDMAIntel Xeon 6766E @ 2.70GHz (144 Cores)256GB2 x 1920GB KIOXIA KCD8XPUG1T92 + 3201GB Micron_7450_MTFDKCB3T2TFSIntel Xeon 6780E @ 3.00GHz (144 Cores)3201GB Micron_7450_MTFDKCB3T2TFS + 2 x 1920GB KIOXIA KCD8XPUG1T922 x Intel Xeon 6780E @ 3.00GHz (288 Cores)512GBOpenBenchmarking.orgKernel Details- Transparent Huge Pages: madviseCompiler Details- --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-backtrace --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-defaulted --enable-offload-targets=nvptx-none=/build/gcc-13-OiuXZC/gcc-13-13.2.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-13-OiuXZC/gcc-13-13.2.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -vProcessor Details- Xeon Platinum 8490H: Scaling Governor: intel_pstate performance (EPP: performance) - CPU Microcode: 0x2b000590- Xeon Platinum 8490H 2P: Scaling Governor: intel_pstate performance (EPP: performance) - CPU Microcode: 0x2b000590- Xeon Platinum 8592+: Scaling Governor: intel_pstate performance (EPP: performance) - CPU Microcode: 0x21000200- Xeon Platinum 8592+ 2P: Scaling Governor: intel_pstate performance (EPP: performance) - CPU Microcode: 0x21000200- Xeon Max 9468: Scaling Governor: intel_pstate performance (EPP: performance) - CPU Microcode: 0x2c000290- Xeon Max 9468 2P: Scaling Governor: intel_pstate performance (EPP: performance) - CPU Microcode: 0x2c000290- Xeon Max 9480: Scaling Governor: intel_pstate performance (EPP: performance) - CPU Microcode: 0x2c000290- Xeon Max 9480 2P: Scaling Governor: intel_pstate performance (EPP: performance) - CPU Microcode: 0x2c000290- Xeon Platinum 8380 2P: Scaling Governor: intel_pstate performance (EPP: performance) - CPU Microcode: 0xd0003d1- Xeon Platinum 8380: Scaling Governor: intel_pstate performance (EPP: performance) - CPU Microcode: 0xd0003d1- EPYC 9684X 2P: Scaling Governor: acpi-cpufreq performance (Boost: Enabled) - CPU Microcode: 0xa101144- EPYC 9684X: Scaling Governor: acpi-cpufreq performance (Boost: Enabled) - CPU Microcode: 0xa101144- EPYC 9654: Scaling Governor: acpi-cpufreq performance (Boost: Enabled) - CPU Microcode: 0xa101144- EPYC 9654 2P: Scaling Governor: acpi-cpufreq performance (Boost: Enabled) - CPU Microcode: 0xa101144- EPYC 9754: Scaling Governor: acpi-cpufreq performance (Boost: Enabled) - CPU Microcode: 0xaa00116- EPYC 9754 2P: Scaling Governor: acpi-cpufreq performance (Boost: Enabled) - CPU Microcode: 0xaa00116- EPYC 8534P: Scaling Governor: acpi-cpufreq performance (Boost: Enabled) - CPU Microcode: 0xaa00213- EPYC 8534PN: Scaling Governor: acpi-cpufreq performance (Boost: Enabled) - CPU Microcode: 0xaa00213- Xeon 6766E 2P: Scaling Governor: intel_pstate performance (EPP: performance) - CPU Microcode: 0x13000131- Xeon 6766E: Scaling Governor: intel_pstate performance (EPP: performance) - CPU Microcode: 0x13000131- Xeon 6780E: Scaling Governor: intel_pstate performance (EPP: performance) - CPU Microcode: 0x13000131- Xeon 6780E 2P: Scaling Governor: intel_pstate performance (EPP: performance) - CPU Microcode: 0x13000131Java Details- OpenJDK Runtime Environment (build 21.0.3-ea+7-Ubuntu-1build1)Python Details- Python 3.12.2Security Details- Xeon Platinum 8490H: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + reg_file_data_sampling: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Not affected- Xeon Platinum 8490H 2P: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + reg_file_data_sampling: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Not affected- Xeon Platinum 8592+: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + reg_file_data_sampling: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Not affected- Xeon Platinum 8592+ 2P: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + reg_file_data_sampling: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Not affected- Xeon Max 9468: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + reg_file_data_sampling: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Not affected- Xeon Max 9468 2P: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + reg_file_data_sampling: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Not affected- Xeon Max 9480: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + reg_file_data_sampling: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Not affected- Xeon Max 9480 2P: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + reg_file_data_sampling: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Not affected- Xeon Platinum 8380 2P: gather_data_sampling: Mitigation of Microcode + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Mitigation of Clear buffers; SMT vulnerable + reg_file_data_sampling: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Not affected- Xeon Platinum 8380: gather_data_sampling: Mitigation of Microcode + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Mitigation of Clear buffers; SMT vulnerable + reg_file_data_sampling: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Not affected- EPYC 9684X 2P: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + reg_file_data_sampling: Not affected + retbleed: Not affected + spec_rstack_overflow: Mitigation of Safe RET + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional STIBP: always-on RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected- EPYC 9684X: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + reg_file_data_sampling: Not affected + retbleed: Not affected + spec_rstack_overflow: Mitigation of Safe RET + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional STIBP: always-on RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected- EPYC 9654: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + reg_file_data_sampling: Not affected + retbleed: Not affected + spec_rstack_overflow: Mitigation of Safe RET + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional STIBP: always-on RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected- EPYC 9654 2P: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + reg_file_data_sampling: Not affected + retbleed: Not affected + spec_rstack_overflow: Mitigation of Safe RET + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional STIBP: always-on RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected- EPYC 9754: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + reg_file_data_sampling: Not affected + retbleed: Not affected + spec_rstack_overflow: Mitigation of Safe RET + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional STIBP: always-on RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected- EPYC 9754 2P: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + reg_file_data_sampling: Not affected + retbleed: Not affected + spec_rstack_overflow: Mitigation of Safe RET + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional STIBP: always-on RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected- EPYC 8534P: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + reg_file_data_sampling: Not affected + retbleed: Not affected + spec_rstack_overflow: Mitigation of Safe RET + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional STIBP: always-on RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected- EPYC 8534PN: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + reg_file_data_sampling: Not affected + retbleed: Not affected + spec_rstack_overflow: Mitigation of Safe RET + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional STIBP: always-on RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected- Xeon 6766E 2P: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + reg_file_data_sampling: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected- Xeon 6766E: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + reg_file_data_sampling: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected- Xeon 6780E: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + reg_file_data_sampling: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected- Xeon 6780E 2P: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + reg_file_data_sampling: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected

Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Platinum 8592+Xeon Platinum 8592+ 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PXeon Platinum 8380 2PXeon Platinum 8380EPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PNXeon 6766E 2PXeon 6766EXeon 6780EXeon 6780E 2PLogarithmic Result OverviewPhoronix Test SuiteNAMDStockfishASTC EncoderRocksDBCoremarkJohn The RipperminiBUDEOpenSSLSpeedbBlenderACES DGEMMHelsingPrimesievem-queensOSPRayOSPRay StudioLlamafileMemcached7-Zip CompressionOpenVKLOpenVINOEmbreePyTorchLULESHoneDNNONNX RuntimeTimed Node.js CompilationKvazaarTimed LLVM CompilationLuxCoreRenderPostgreSQLminiFEParallel BZIP2 CompressionIntel Open Image Denoiseuvg266QuantLibTimed Linux Kernel CompilationGraphicsMagickCloverLeafY-CruncherLiquid-DSPsrsRAN ProjectNumpy BenchmarkTensorFlowFFmpegx265ClickHouseBRL-CADXmriglibavif avifencTimed FFmpeg CompilationTimed Godot Game Engine CompilationGNU Octave BenchmarkApache IoTDBSVT-AV1Timed ImageMagick CompilationTimed Gem5 CompilationZstd CompressionWebP Image EncodePyBenchGoogle SynthMarkTimed Mesa CompilationSecureMark

Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Platinum 8592+Xeon Platinum 8592+ 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PXeon Platinum 8380 2PXeon Platinum 8380EPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PNXeon 6766E 2PXeon 6766EXeon 6780EXeon 6780E 2PLogarithmic Per Watt Result OverviewPhoronix Test SuiteminiFEMemcachedWebP Image EncodeZstd CompressionSVT-AV1PyTorchFFmpegASTC EncodersrsRAN ProjectNumpy Benchmarkx265Google SynthMarkminiBUDESecureMarkCoremarkACES DGEMM7-Zip CompressionKvazaarClickHouseXmrigSpeedbTensorFlowuvg266LuxCoreRenderRocksDBGraphicsMagickLiquid-DSPEmbreeOpenVKLQuantLibOSPRayLULESHJohn The RipperStockfishBRL-CADOpenSSLIntel Open Image DenoiseLlamafileNAMDP.W.G.MP.W.G.MP.W.G.MP.W.G.MP.W.G.MP.W.G.MP.W.G.MP.W.G.MP.W.G.MP.W.G.MP.W.G.MP.W.G.MP.W.G.MP.W.G.MP.W.G.MP.W.G.MP.W.G.MP.W.G.MP.W.G.MP.W.G.MP.W.G.MP.W.G.MP.W.G.MP.W.G.MP.W.G.MP.W.G.MP.W.G.MP.W.G.MP.W.G.MP.W.G.MP.W.G.MP.W.G.MP.W.G.MP.W.G.MP.W.G.MP.W.G.MP.W.G.MP.W.G.MP.W.G.M

2024 Server CPUsopenvino: Person Vehicle Bike Detection FP16 - CPUopenssl: SHA512openssl: RSA4096llamafile: llava-v1.5-7b-q4 - CPUtensorflow: CPU - 1 - GoogLeNetpennant: sedovbigopenfoam: drivaerFastback, Medium Mesh Size - Execution Timequantlib: Multi-Threadedopenvino: Handwritten English Recognition FP16-INT8 - CPUjohn-the-ripper: WPA PSKopenvino: Machine Translation EN To DE FP16 - CPUminibude: OpenMP - BM2minibude: OpenMP - BM2astcenc: Thoroughrelion: Basic - CPUopenssl: ChaCha20-Poly1305blender: Classroom - CPU-Onlyopenvino: Person Detection FP16 - CPUopenssl: ChaCha20john-the-ripper: Blowfishjohn-the-ripper: bcryptcompress-7zip: Decompression Ratingprimesieve: 1e13blender: Barbershop - CPU-Onlyblender: Pabellon Barcelona - CPU-Onlycoremark: CoreMark Size 666 - Iterations Per Secondopenradioss: Chrysler Neon 1Mopenvino: Face Detection Retail FP16-INT8 - CPUospray-studio: 1 - 4K - 16 - Path Tracer - CPUblender: BMW27 - CPU-Onlyopenvino: Person Re-Identification Retail FP16 - CPUincompact3d: input.i3d 193 Cells Per Directionopenssl: RSA4096ospray-studio: 3 - 4K - 16 - Path Tracer - CPUopenvino: Road Segmentation ADAS FP16-INT8 - CPUmt-dgemm: Sustained Floating-Point Ratehelsing: 14 digitamg: ospray-studio: 1 - 4K - 32 - Path Tracer - CPUblender: Fishy Cat - CPU-Onlym-queens: Time To Solveospray-studio: 3 - 4K - 32 - Path Tracer - CPUminibude: OpenMP - BM1minibude: OpenMP - BM1openvino: Vehicle Detection FP16-INT8 - CPUnpb: LU.Cospray: particle_volume/scivis/real_timeopenssl: AES-128-GCMospray: particle_volume/ao/real_timellamafile: wizardcoder-python-34b-v1.0.Q6_K - CPUospray-studio: 1 - 4K - 1 - Path Tracer - CPUospray-studio: 3 - 4K - 1 - Path Tracer - CPUopenssl: AES-256-GCMprimesieve: 1e12blender: Junkshop - CPU-Onlyopenvino: Road Segmentation ADAS FP16-INT8 - CPUnpb: IS.Dospray: gravity_spheres_volume/dim_512/pathtracer/real_timeopenvino: Vehicle Detection FP16-INT8 - CPUopenvino: Person Vehicle Bike Detection FP16 - CPUpytorch: CPU - 1 - ResNet-50pgbench: 100 - 1000 - Read Only - Average Latencypgbench: 100 - 1000 - Read Onlyspeedb: Read While Writingonnx: T5 Encoder - CPU - Parallelliquid-dsp: 256 - 256 - 57embree: Pathtracer ISPC - Crownmemcached: 1:100openvino: Age Gender Recognition Retail 0013 FP16-INT8 - CPUpytorch: CPU - 256 - ResNet-50graphics-magick: Sharpensrsran: PUSCH Processor Benchmark, Throughput Totalgromacs: MPI CPU - water_GMX50_bareopenvkl: vklBenchmarkCPU ISPCpytorch: CPU - 64 - ResNet-50pytorch: CPU - 512 - ResNet-50onnx: yolov4 - CPU - Parallelnpb: CG.Caskap: tConvolve MT - Griddingembree: Pathtracer ISPC - Asian Dragon Objliquid-dsp: 256 - 256 - 512onnx: super-resolution-10 - CPU - Standardliquid-dsp: 256 - 256 - 32astcenc: Mediumwrf: conus 2.5kmnpb: MG.Connx: GPT-2 - CPU - Parallelpytorch: CPU - 1 - ResNet-152lulesh: embree: Pathtracer ISPC - Asian Dragononnx: ResNet50 v1-12-int8 - CPU - Standardkvazaar: Bosphorus 4K - Slowkvazaar: Bosphorus 4K - Mediumpytorch: CPU - 256 - ResNet-152pytorch: CPU - 512 - ResNet-152pytorch: CPU - 64 - ResNet-152onednn: Deconvolution Batch shapes_3d - CPUopenvino: Noise Suppression Poconet-Like FP16 - CPUuvg266: Bosphorus 4K - Slowonnx: super-resolution-10 - CPU - Parallelonnx: fcn-resnet101-11 - CPU - Parallelaircrack-ng: openvino: Face Detection Retail FP16-INT8 - CPUbuild-nodejs: Time To Compileonnx: T5 Encoder - CPU - Standarduvg266: Bosphorus 4K - Mediumonnx: yolov4 - CPU - Standardbuild-linux-kernel: allmodconfigtensorflow: CPU - 1 - AlexNetopenvino: Face Detection FP16-INT8 - CPUincompact3d: X3D-benchmarking input.i3dhpcg: 144 144 144 - 60build-llvm: Ninjagraphics-magick: Enhancedopenfoam: drivaerFastback, Small Mesh Size - Execution Timeonnx: CaffeNet 12-int8 - CPU - Standardcompress-7zip: Compression Ratingcompress-pbzip2: FreeBSD-13.0-RELEASE-amd64-memstick.img Compressiongpaw: Carbon Nanotubeonnx: GPT-2 - CPU - Standardopenvino: Age Gender Recognition Retail 0013 FP16-INT8 - CPUliquid-dsp: 128 - 256 - 57oidn: RT.ldr_alb_nrm.3840x2160 - CPU-Onlytensorflow: CPU - 512 - AlexNetoidn: RTLightmap.hdr.4096x4096 - CPU-Onlyliquid-dsp: 1 - 256 - 512oidn: RT.hdr_alb_nrm.3840x2160 - CPU-Onlyonnx: bertsquad-12 - CPU - Parallellammps: 20k Atomsluxcorerender: LuxCore Benchmark - CPUtensorflow: CPU - 256 - AlexNetliquid-dsp: 128 - 256 - 512cloverleaf: clover_bm64_shortlammps: Rhodopsin Proteinpgbench: 100 - 1000 - Read Write - Average Latencypgbench: 100 - 1000 - Read Writesrsran: PUSCH Processor Benchmark, Throughput Threadsrsran: PDSCH Processor Benchmark, Throughput Threadopenradioss: INIVOL and Fluid Structure Interaction Drop Containerliquid-dsp: 64 - 256 - 512nwchem: C240 Buckyballkvazaar: Bosphorus 4K - Very Fastgraphics-magick: Swirlliquid-dsp: 128 - 256 - 32cloverleaf: clover_bm16avifenc: 0avifenc: 2svt-av1: Preset 4 - Bosphorus 4Kuvg266: Bosphorus 4K - Very Fastaskap: tConvolve MT - Degriddingtensorflow: CPU - 64 - GoogLeNettensorflow: CPU - 64 - AlexNety-cruncher: 1By-cruncher: 500Mliquid-dsp: 1 - 256 - 57build-linux-kernel: defconfigopenradioss: Cell Phone Drop Testtensorflow: CPU - 512 - GoogLeNetnumpy: ffmpeg: libx265 - Video On Demandffmpeg: libx265 - Platformsvt-av1: Preset 8 - Bosphorus 4Kquantlib: Single-Threadedtensorflow: CPU - 256 - GoogLeNetapache-iotdb: 800 - 100 - 800 - 100clickhouse: 100M Rows Hits Dataset, Second Runapache-iotdb: 800 - 100 - 800 - 100clickhouse: 100M Rows Hits Dataset, Third Runx265: Bosphorus 4Konnx: ArcFace ResNet-100 - CPU - Parallelaskap: tConvolve MPI - Degriddingbrl-cad: VGR Performance Metricopenvino: Person Detection FP16 - CPUaskap: tConvolve MPI - Griddingxmrig: GhostRider - 1Mopenvino: Weld Porosity Detection FP16-INT8 - CPUonnx: ArcFace ResNet-100 - CPU - Standardonnx: ResNet50 v1-12-int8 - CPU - Parallelopenssl: SHA256openvino: Face Detection FP16-INT8 - CPUopenvino: Noise Suppression Poconet-Like FP16 - CPUopenvino: Machine Translation EN To DE FP16 - CPUopenvino: Person Re-Identification Retail FP16 - CPUopenvino: Weld Porosity Detection FP16-INT8 - CPUastcenc: Exhaustivenpb: SP.Connx: CaffeNet 12-int8 - CPU - Parallelastcenc: Very Thoroughspeedb: Rand Readrocksdb: Rand Readtensorflow: CPU - 1 - ResNet-50openvino: Handwritten English Recognition FP16-INT8 - CPUffmpeg: libx265 - Uploadclickhouse: 100M Rows Hits Dataset, First Run / Cold Cachebuild-ffmpeg: Time To Compiletensorflow: CPU - 64 - ResNet-50build-godot: Time To Compileoctave-benchmark: appleseed: Disney Materialliquid-dsp: 64 - 256 - 57compress-zstd: 19 - Decompression Speedtensorflow: CPU - 512 - ResNet-50onnx: Faster R-CNN R-50-FPN-int8 - CPU - Parallelcompress-zstd: 19, Long Mode - Decompression Speedapache-iotdb: 500 - 100 - 800 - 400vvenc: Bosphorus 4K - Fasttensorflow: CPU - 256 - ResNet-50build-imagemagick: Time To Compileavifenc: 10, Losslessapache-iotdb: 500 - 100 - 800 - 400qmcpack: Li2_STO_aeavifenc: 6, Losslessavifenc: 6build-gem5: Time To Compilecompress-zstd: 19, Long Mode - Compression Speedwebp: Quality 100, Lossless, Highest Compressioncompress-zstd: 19 - Compression Speedsvt-av1: Preset 12 - Bosphorus 4Kgraphics-magick: Noise-Gaussianvvenc: Bosphorus 4K - Fasterwebp: Quality 100, Highest Compressionopenfoam: drivaerFastback, Medium Mesh Size - Mesh Timepybench: Total For Average Test Timessynthmark: VoiceMark_100build-mesa: Time To Compilesecuremark: SecureMark-TLSopenfoam: drivaerFastback, Small Mesh Size - Mesh Timeliquid-dsp: 64 - 256 - 32liquid-dsp: 1 - 256 - 32stockfish: Chess Benchmarkonnx: T5 Encoder - CPU - Parallelonnx: T5 Encoder - CPU - Standardonnx: Faster R-CNN R-50-FPN-int8 - CPU - Parallelonnx: Faster R-CNN R-50-FPN-int8 - CPU - Standardonnx: Faster R-CNN R-50-FPN-int8 - CPU - Standardonnx: CaffeNet 12-int8 - CPU - Parallelonnx: CaffeNet 12-int8 - CPU - Standardonnx: ResNet50 v1-12-int8 - CPU - Parallelonnx: ResNet50 v1-12-int8 - CPU - Standardonnx: ArcFace ResNet-100 - CPU - Parallelonnx: ArcFace ResNet-100 - CPU - Standardonnx: GPT-2 - CPU - Parallelonnx: GPT-2 - CPU - Standardonnx: bertsquad-12 - CPU - Parallelonnx: bertsquad-12 - CPU - Standardonnx: bertsquad-12 - CPU - Standardonnx: super-resolution-10 - CPU - Parallelonnx: super-resolution-10 - CPU - Standardonnx: fcn-resnet101-11 - CPU - Parallelonnx: fcn-resnet101-11 - CPU - Standardonnx: fcn-resnet101-11 - CPU - Standardonnx: yolov4 - CPU - Parallelonnx: yolov4 - CPU - Standardsrsran: PDSCH Processor Benchmark, Throughput Totalsvt-av1: Preset 13 - Bosphorus 4Kluxcorerender: Orange Juice - CPUluxcorerender: DLSC - CPUnpb: EP.Dpennant: leblancbignamd: STMV with 1,066,628 Atomsnamd: ATPase with 327,506 Atomsminife: Smallrocksdb: Read While WritingXeon Platinum 8490HXeon Platinum 8490H 2PXeon Platinum 8592+Xeon Platinum 8592+ 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PXeon Platinum 8380 2PXeon Platinum 8380EPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PNXeon 6766E 2PXeon 6766EXeon 6780EXeon 6780E 2P3606.122221992772327431.120.9533.5616.03080420.6467179647.536.20401278477.7786.9672174.19251.2971373.18222503885073068.61100.39316126421173945139455128786251.820261.9787.922194630.600449207.209004.233138025.899.7912.9293413974189.9366491068.4323.54370593.34816050970005802634.8315.2116800682.8482071.1893325.90135125.1521.893276880469369721.93245.85165719777002393527174.57635.9655.992865.7224.644517.8416.5051.460.572174814610695360326.143350083333370.05404481667.950.4354.841572616.98.762173456.0156.4418.141333811.638088.1179.38051020833333227.4233243800000333.990211980.80683448.70191.56219.4123072.30291.9925315.41020.2320.9720.2520.4620.131.0774313.9515.71205.5253.03922147469.3286.43254.003357.35517.8519.8593362.45456.53356.38357.00971231.0738187.01721642.219419852.3263881902.14485747.776222.029115106.3031812666672.711278.451.29168823332.7116.095634.8927.101205.3091856666739.4828.71614.04071227129.7680.2140.437444100002070.350.035023200600000328.4769.93137.7527.06149.42380.14969.627.0473.2676707466739.45031.49461.23455.5749.8449.7970.9083209.6448.4685.16486.0590871770481.6637.8646.849117891.6833892298.5621314.25808.83.5852.8167313.10061806994523167.834209.1062.465943.6615943.174.268971245.26784.3047.088527617961726536617010.531643.4324.97465.5024.056120.93140.2337.53253.49027625392000001032.0148.4532.34331069.1877972066.719143.6714.7244.923294.33109.306.2783.169210.9347.940.5214.6164.25015815.0603.08160.72685765711.37819.22627720531.384585189056666736506000968874793.065002.7969430.916529.408034.00211.273681.172923.192983.1700221.343618.93195.215204.4997662.127649.637620.14534.866044.39649329.036116.3158.5971955.120450.352224688.5162.47413.468.727562.804.9558651.052742.9702135230.178417387862.584284625447754601.110.4413.5011.28438196.49644350187.525.12793253793.64140.8283520.70586.9845203.40744220253297735.9145.7862440297294718358318360355705427.107141.5446.383902076.243612115.8920937.581413813.747.726.391698171916162.9168371843.6145.96595550.83131244026673341119.137.88138813133.6283340.6945483.81261127.0938.2269153302630072738.22353.82894106313695343284702.32521.1565.023960.2842.818821.7315.0435.531.29377814117297027246.3355361266667124.70843245908.400.2937.442654853.615.450271637.0837.5512.754658128.247630.06132.28061616966667212.9246116566667484.54996674.12163333.21144.64015.7743724.062152.7472177.76331.2432.0414.0814.5914.030.73617015.9624.71188.8902.8349853914.9335.72172.990288.47127.6515.5555218.57037.57283.11196.80811660.8515122.31434228.556037696.9805927291.46921041.563180.032189893.3137236666674.481899.642.18168433334.4114.528050.5218.821730.25112646666726.5842.28114.85667315129.7675.5107.367994966671960.967.646173558600000214.8067.37537.3116.69854.88331.76996.475.0082.3646699133329.98128.22576.08456.1848.7748.7665.2243210.1528.9392.23507.5683651785501.6337.0429.148734614.14136969654.8441773.011263.22.5036.2493156.461119106802107423.187356.6337.5815519.9247654.958.3701147311.14566.37713.75185512869585250499984.394744.0524.56485.6319.506115.47118.5728.03648.564182655500000963.6174.9530.0368992.1801696206.480161.0613.2625.074317.36101.6296.1723.044178.2828.160.5115.2156.51618212.5363.07162.02669767712.69718.29327547235.6040972025000000364610001877617694.058813.4657133.289929.753633.60821.763531.435736.390315.6251734.305427.59446.906195.5510168.829960.358916.57055.292874.72530352.73892.347310.8362378.398964.285830108.7154.50218.7011.1214946.762.5298071.109002.2194846877.5123213005725.032388605477031594.416.6121.6716.96910302.0641195648.821.87428116592.20108.1242703.08854.4547290.44822362573801363.6139.6234415091693710583110578133814648.406236.7380.292369998.356940157.5612317.942312523.726.7210.19670661036735.6319931159.6629.14107889.07018147600005079831.9114.25759522106.3952659.8834656.92232012.7730.679988956750654030.84044.08144117097443876836704.25032.0855.074059.7027.101013.7311.1777.520.589169904612168413462.855380683333382.96634752673.790.4963.601673088.710.477200463.0663.3020.879563760.455062.0797.18611178766667259.1863167200000327.782910602.408107321.89248.68227.2138433.973112.6611314.05724.2324.8023.3323.4123.490.9071619.4016.06234.5403.30836153584.2035.19214.431460.77516.6422.9689316.90235.50224.64323.24569735.1361165.04822833.065393908.1874416361.84753743.048270.32981279.7935032000003.321486.121.58187743333.3119.677337.4608.061277.46115293333339.3834.30113.26475396129.5742.9128.747837700001878.338.025293148233333410.5964.47534.7917.87635.10319.76819.896.7013.3917314066734.59127.90462.78520.2253.9953.9279.4373600.5423.5981.73455.7994616807458.2338.9360.409431177.2916904403.2037265.98378.32.3666.5162308.80166573957920284.646757.2626.859515.8626943.424.6303109416.42830.7257.62403151783812975179466.432924.6626.93437.2021.35791.51122.7186.45848.42505124755000001221.8140.5333.37971242.6927097517.392129.0212.5954.456280.26105.985.7842.971187.5079.800.6018.0177.86117115.9663.47148.40248691799.71717.25830989631.7049051927766667402440001097663452.159802.1696629.956629.018534.45951.202981.100423.237803.1839216.553415.03764.016873.6964950.830739.745125.15914.263523.85774302.266109.6709.1188547.895343.535526378.1174.83214.749.388089.144.1827071.437874.6481431830.2892689310934.174652076070761499.67.4912.699.964526137.03802380867.522.967970931128.78191.8184795.46297.9383155.74144409914427033.6143.4168428438276020549920677857341025.021125.8741.854966250.77798386.9324676.861212412.766.955.391259672057021.6143582237.6958.25334048.09136096463332424917.297.40233391199.7344993.3438719.37455312.0953.9348176931314601354.11953.0575989814975299393772.18718.3157.137437.8148.757614.6711.6945.691.14988188117585737354.7546284300000153.16223780240.560.4641.452845493.418.540322240.7740.8314.198098764.936038.92173.22082027000000251.3056077300000550.01685601.101220893.78195.45317.5770826.734199.6089171.23140.9241.5816.0016.1716.250.62425013.1527.11214.8123.0508564181.2935.18145.413356.76430.3716.9672189.73930.76234.24171.37577869.2976106.81537423.558932754.8056742391.43236238.049236.648128566.8144505250005.092039.632.40182005335.0315.434156.4008.881681.44149383333331.9055.49630.20333110129.5755.5100.008837012501809.765.386893520766667378.0560.52633.6507.36053.66291.37858.845.1102.6597049900025.87226.88577.76519.8953.2953.2270.4263586.3501.3982.73443.5892771639438.6039.3131.458959139.25186677736.2372004.016324.72.4838.4240153.922131976050120545.219360.8928.1718375.6348122.168.9091228184.68605.58914.63345861478715783928003.855570.6326.80423.3017.38994.66103.3766.85643.69539926200666671165.8169.7531.71091189.7892318506.960150.3311.4934.579286.7897.9115.6132.805157.3639.670.5917.8165.49519413.2563.46139.61713692799.49116.18330843429.3251252154633333389506002226103782.817392.8026331.532428.848134.66281.649191.324546.496935.8395431.790726.08665.109484.2953164.789144.599622.42514.654313.98013327.875100.7389.9268470.437758.939430547.6162.97919.9112.7416004.072.1594592.254225.8526742114.6124255193802.611619926127722861.07.6736.1321.02112440.83113143755.323.12286552415.9670.2131755.33337.0051412.37116132105821386.6741.93226597354153678936787520773867.324320.11106.961614763.703237228.749087.123705531.667.1313.9692376697707.242837860.6419.768930123.83215884966676897342.7821.0308074263.6201590.5012935.47126171.5216.086964120084817016.05021.47198823575074567280876.16042.8555.743050.1619.910216.3312.5450.990.55917926368795408337.004284893333358.42304384040.520.3352.971142170.77.545124351.5551.0516.174235116.553375.3264.9597838530000217.8802381800000247.297913273.69485910.95191.11119.9923848.54075.4690330.10417.5218.1319.2019.4719.011.2640711.3713.36195.7052.62544117588.9925.27270.380219.53215.1718.2179428.38748.28236.52407.58940625.2423212.48216045.947435728.4693147162.63207754.376176.333135075.0726700333332.271047.961.08169063332.2616.325128.2786.30986.0480018666741.4327.62914.29269969129.7702.6160.566323966672530.540.233942351900000351.2976.91541.1256.49039.56333.73841.688.3003.7816713033343.42133.75383.57461.6147.3447.3262.7503225.7375.7390.02465.0685744542470.0229.0540.728918522713937285.9521766.55446.82.5047.2703319.04344439185187202.594208.4928.736717.6519183.833.120458815.36687.6715.134221145704820534615411.292074.3023.33446.4026.458104.23149.3787.62258.37911621387666671126.4117.5328.51641131.1824556646.324119.7316.0754.916314.44121.196.8363.730220.5697.760.5514.4146.09715014.1013.10153.12467763711.10120.17527764731.781874164026666736537667680190882.970944.5758135.066533.334129.99731.452801.378313.133663.0289724.553521.21795.227815.6770061.254747.241721.17025.109144.58912380.902139.0967.2418761.825654.959921286.6144.69811.867.465366.695.9309571.452235.9713020091.174396637127.283230422299345531.07.7718.2413.21125201.10956288129.124.00562875795.63127.8453196.12372.3297214.41632039672044744.7142.1644990849492713456213386640170733.921169.4455.262993136.601832125.1517252.271664516.557.327.293491171395446.4197011691.7939.34573265.02631562616673892623.1710.84045211108.3972709.9305576.86246822.5229.3496127758338275729.50181.771049123710118989933233.12124.9956.713816.7035.932417.1913.3446.491.02797603513859254246.6804825133333107.62993373323.920.2841.681993787.013.392177642.3541.6513.086965396.223347.93104.84251444066667205.8854670966667441.65187157.961172614.10135.97617.9152102.668125.7494174.67726.0026.6916.3016.6815.840.94507517.1519.75173.9092.1746383665.7585.55175.625199.07922.2514.4831246.93637.76256.63189.68611654.4054134.41926928.993119604.7554917291.98293242.873141.954174862.5635964000003.491604.111.72169046673.5113.736646.7056.811479.53109146000032.2547.51216.96358952129.7651.9114.29732560000178551.915093254033333263.3369.64738.6535.99144.75341.51932.596.3343.1106706400032.14327.51467.91435.2145.2945.9554.8233207.0447.5094.84499.1880770465501.0727.2632.814136900.53658790568.8142939.210975.82.5340.5671166.48588635753413373.505565.2329.9813102.2837710.606.2126135939.25492.88510.20514199435704055331735.113998.0222.34491.8920.788111.71123.88212.61751.24589824940500001040.2145.2924.72741041.8775012486.023141.9514.4025.317328.41102.127.1213.776184.2987.620.5413.8122.08915011.8973.09134.78213763710.91618.47427758932.4819931963233333364976671379772034.052705.0226740.453436.228327.60742.026591.652706.005255.7449130.473324.65107.348487.0411172.801860.112016.63945.749214.85818460.673121.6708.3996276.422769.450130236.0122.61716.9110.1710970.452.8810991.886797.3006519876.596244174093.731889398078325441.58.1331.4719.88246410.29005162727.424.94334076467.0878.1051952.60642.9834384.38418779617444076.8759.69263740690067791527914424334758.159290.5697.801855135.326098212.999686.393379028.497.7612.7997582813667.639238894.8722.539990107.23715979933336254038.4818.1027336670.8431771.0652877.32131606.8618.485174771070266018.55331.54179221235920141154535.33239.1762.533076.6622.362519.4413.5948.590.62216074249988176346.213322253333365.33184315467.170.3751.561302514.08.282135651.3551.8616.389835234.063406.9671.8253944550000213.9852769066667284.333612410.2986407.46188.93018.0725831.83883.4921296.79918.2418.8419.5819.2919.241.1964312.7213.89190.0632.61721134048.9645.77252.648215.12715.6816.9166384.06343.67257.50351.64416530.5872197.84418141.746192705.6063423632.28776648.487168.859140144.0129724000002.391108.951.14168853332.3815.739432.1576.821058.9988220000042.2230.84313.84572225129.7705.5146.036890033332245.241.344322739633333357.5773.06039.8766.57240.82335.58852.367.9593.7046712766740.50131.92398.40464.7248.1448.3565.3593229.1386.0089.53474.6886354518476.9131.4042.271120561.4767812301.3023250.26122.32.6742.2747301.13651840436763217.114386.4838.507207.7420910.533.627669776.41678.4835.97022440706742344699399.992243.8423.77461.6224.840103.56143.8087.74856.40169823089666671127.5125.1428.47981133.3834756456.501123.6915.3764.867309.03117.816.6053.550215.4967.720.5514.5151.71815814.3623.10150.66848762712.01319.65027726031.998248167970000036539000735922302.887344.6475735.111033.987729.42501.472491.416623.320303.3703423.656523.66255.290275.9196163.535349.974020.01035.260754.67269382.109155.7886.5496561.010759.179515081.0149.99612.508.006445.095.1141611.502145.9250118621.273665007689.323756452205348534.87.2614.6712.10690186.32539316359.225.72657889889.18133.9903349.75683.3395201.38237273521529740.3864.9152291240334715665815595946913130.196156.7051.293279262.530349117.9118561.911535715.297.976.663875101627941.4181111801.8944.66830258.24832051610003617921.459.28541971114.9022872.5625525.56257384.5533.1275148466962705033.11251.54961114311811489573532.69123.4562.113819.8339.338920.2414.4235.461.09892072515354400252.6715036000000116.60533392842.380.3037.912274386.614.127185238.3037.8412.597466492.444382.97112.72311518933333199.8965367033333483.10496840.057171436.47136.68914.8653269.469129.7482161.88628.9629.6214.9214.7414.960.86435818.7222.14169.8502.1048065663.8236.02171.174185.4624.6514.4583231.03333.21278.52187.22400462.6357128.06630127.577291581.7695255141.71129643.911132.712176900.3238965000003.661677.621.74168840003.6513.519051.8167.411528.41120606666732.4452.24416.65560046129.7663.8110.567571766671873.152.235583337066667269.2068.43738.1366.05246.25308.95940.406.2662.9616626600030.53027.63477.33439.8446.7946.5955.9793222.8449.9195.39467.9680139566471.7927.9029.195540368.64075342569.6045195.112115.02.7933.9621153.407103382860113401.455933.6541.5714033.9440032.817.2075141954.15478.46711.88754979074904737559464.374351.5923.30460.6620.008107.30122.70412.57849.13617524913400001039.2138.3924.68181046.0780577286.077135.2814.0945.311325.97106.277.0383.738181.6297.460.5413.3127.54616411.9673.09159.31171763712.08518.13827729828.8401572090466667365213331494090823.958195.3912340.517836.003927.77722.087801.718756.517446.1779634.250729.44487.308227.5325973.968455.901917.98735.886285.00222475.254121.7808.2601679.377069.201411866.7124.26316.6410.4412793.012.5273631.767782.5631921583.2112233292030.972207953990036371.612.2929.1815.24719362.5935182366.960.90491583281.3697.0752426.88130.0309368.21929350212241362.54113.7042545119006311322311321936653440.444235.3176.101839444.396311185.0313467.283044223.6724.3911.24980161099481.5348661186.2424.97410482.9597231535335524730.7512.3906418885.2892132.2354390.81185954.5417.622280722926530017.82693.10155318337124854114473.36633.2016.843345.4522.50814.549.8242.640.525193000611795318249.484303710000082.91954814941.530.4536.971443288.48.964152737.7537.4514.216938906.135279.0784.80101061033333192.8103572233333216.967814030.513110742.15153.53816.6821389.82399.2430222.52219.7120.3314.8814.7615.110.86706526.3313.79178.6152.89253159709.7475.93303.421292.51716.1916.4123356.98737.26207.84292.03031430.1110194.38221540.286404701.7243917192.18145548.453194.149151627.4226890333333.101470.461.48135990003.0814.946035.7016.431340.3498109000035.2933.54413.69373042112.3490.3135.56646513333217044.114033044700000295.3088.06547.5055.43740.699893.32347.72904.367.7443.7245393033339.41031.17411.05394.7143.8043.5559.0972558.6402.78102.67295.4375178480295.0630.8038.502512800.42300947175.7214497.35230.98.2745.5414192.9935453070057696.082963.8270.953263.039657.082.647190420.25641.0014.29352591364662512341039.131313.3921.73285.1725.939108.32151.5379.69458.3767321999266667900.5127.9725.9606912.9746530075.877125.9116.3345.919349.42131.377.3883.528219.6697.830.4914.3140.75615313.0232.81162.32335971548.36221.43723107636.8621161731166667319920001045972004.006753.4312538.517929.764533.60271.558211.428495.180704.4931725.981321.95646.507475.1648066.913654.283218.42225.597635.29844345.938110.9709.0336770.340960.928218943.6138.72214.318.988880.824.7025571.612326.7266331046.598366891100.181098094009318389.319.1153.3825.78945798.3498691036.562.64248066156.1349.2031230.08015.5038705.584146156212950124.63236.81212294883830569395693918834581.355456.81150.391218453.342873343.165913.045445646.3223.2523.9708284587354.863035642.4413.494557165.785107362766710346159.1524.17512173447.2601181.4942120.3398557.169.700223995268154279.777644.41305236163560620408836.67361.2231.052266.3211.86389.2618.0861.320.58117207627147120282.252161046666743.67334826284.800.5648.89791770.04.81386948.9948.9917.674722655.325172.9647.6437542606667197.8521823566667126.440718998.81657317.66180.22522.2717348.42955.4208335.15215.0915.5117.7017.5517.731.4221325.9110.93176.2922.75242101665.4696.56423.626298.67312.5620.2495612.78242.05415.89558.38486820.4129298.40912374.956584849.5592437323.39318976.175207.93461956.9315546666671.81883.000.86136083331.8116.686321.3794.29852.1453922666760.8921.16216.34161233112.3484.8204.215032533333576.431.252781797400000512.36100.46152.2275.43830.177425.22282.50690.0910.7124.8745408966755.73843.45290.16400.6444.1344.0155.2382534.5290.27100.29339.6776729495342.9929.7644.27488429.1343088584.309623.772593.28.5851.0172315.0302785850449047.991525.57127.891698.054502.741.331937567.61767.4762.159613035914512558495317.82637.7621.96326.6534.28990.72187.8759.10479.83239814691666671032.491.7528.08861018.3788231125.58391.6518.8445.906326.53163.758.2014.093275.7147.520.5013.7134.07212113.1002.82182.23572973555.59723.65823135739.117914156176666731995000510995453.542423.3496635.604928.018135.68751.301731.175613.173602.9830622.585419.60355.543794.8041859.935348.470020.87235.671755.05427363.351160.5276.2474056.580249.386213537.7133.1888.825.634479.2811.852131.110563.6047922957.355398709752.899145597120098237.014.2912.833.08110893.568115644091.033.1812940001110.49309.2197730.471116.122693.16876765271954718.6743.771086618191950374589376268111646512.13067.5223.848448083.72998049.5535809.5989167.753.783.753199013214376.3105144013.9678.49615830.69444672813331785510.164.13320893236.6105915.25311735.42551955.5555.2576199035205996755.33825.2456166017140617610871.19911.4711.9512296.2760.37484.084.9119.840.289348090933307574276.2078012700000214.01788683410.790.3516.972976999.722.525390617.2816.826.3182888487.9114185.1210.43672394333333119.55857935266667508.09264431.344244738.81110.1688.3554678.485231.4272141.83062.8263.487.027.077.081.00191422.2043.3987.25790.8576855.34114.912263.52445.267.24869181.99519.92233.63167.12816444.950289.27540822.707989446.8057413661.10944624.134161.947178488.0347593666673.471897.641.64130831333.458.7597162.00010.611560.56139473333322.8353.77118.15955272112.2664.779.428493400001429.974.035834407900000223.5463.40435.3168.51355.0516906.2248.03738.318.9924.5105541566725.87222.52464.78540.9655.0155.1187.8243125.4391.4061.46528.21124947288526.3631.9515.051612348061939211095.79121976.931157.89.2523.4960100.4600276267766403205.038231.7243.1712665.6220550.9311.9107390520.93310.59119.4052105954653310312091513.925766.6227.43513.9217.83986.0896.1616.95527728000001392.5137.5024.05401321.4106778379120.1111.7204.943246.0891.9665.9502.890161.9368.420.5616.8163.7951793.62135.5163818783.20016.40130174026.8236272279300000360400003991242233.617923.8079241.569622.788644.06353.217812.246459.952457.0968266.435542.88799.066076.17190114.15890.062111.270711.45808.399691165.93182.2685.49711158.265137.98925977.4161.33933.0822.5822166.602.0768356.3834320.7525959466.6198516645608.074586513191348996.825.3834.205.460660178.25382319827.232.00671322576.98187.6844692.10673.3796176.42238392565207735.66110.9154490408477319257419289871606523.265123.9044.874152864.87538077.3217230.351660314.296.936.881212791613828.7195352212.4145.24579456.91223761490003864518.366.95044349151.9483798.6956017.19362511.4332.523299600710926732.51888.48103712258597205999631.98418.6521.636346.1534.64477.858.4841.170.251398935819595777446.3035811900000130.78748634258.390.4534.902015656.915.222239634.7134.699.8000862071.1014955.6133.47691570400000122.9485862466667500.76737885.16134994.14161.49715.8627287.261155.1208243.34040.0040.5014.0813.9513.891.1192313.5229.18108.8681.25179206619.2925.41147.837279.64132.749.73685290.34126.23471.98309.84765327.5824124.45530028.325594672.9165791121.36906330.001162.092138605.5247553333332.661392.911.28133873332.6412.280746.89112.431301.26136873333342.1739.99812.58079492112.2680.794.768505866671450.578.155464353533333245.8261.62934.0448.59562.7014143.1330.26868.547.4714.3125545533332.88920.45425.25542.1555.5655.3886.2983114.2406.5852.93597.73144760448595.1932.1229.849364260.23122574433.0674389.015786.69.4241.4745178.698138409588983101.516963.3183.116846.799997.896.3027225311.82590.70710.32245376330345233100918.962986.3327.61566.3119.991104.52103.3526.85740.91896128620000001385.3121.9628.72501324.91261610287.547123.3712.1994.770209.6897.0045.7572.723176.8768.450.5717.2165.75316517.0163.61118.54229818783.42216.66830083325.9316462287466667360660002145246592.239223.5754334.812621.578446.87641.693071.485965.594914.1091433.499424.10976.184786.1666881.431971.556413.97459.185248.13326801.961178.0325.66508102.035102.73429384.9162.47524.6916.2111424.053.3604533.410859.3353453167.8141584195024.323962757549735964.925.7532.805.916458325.42331294183.234.92643475525.88171.7714294.28365.3025238.88135096099835740.26157.4550331102112316654116654164262624.237139.2548.883926265.277120176.1416038.901889615.967.238.253835111436324.9223051743.4939.08626262.17322828020004329020.157.73850019136.9453423.6345528.15269047.2828.068989728843612328.09568.35118013917676965536672.05821.0227.465229.4130.60738.589.4740.450.278360326118024993374.7455266466667110.52538220895.450.4834.901735239.612.514207735.0134.659.7851653182.7712394.6113.27831362166667122.6835271933333449.114110176.864116725.04156.61015.5726082.711132.4918225.30838.9039.5813.9514.0513.841.1548716.3228.01109.9981.25135186675.4325.85164.021187.01231.449.86018311.82532.56510.10466.54801428.3185135.66626432.591783604.0455495001.42295434.866126.816133779.6242563000002.731363.331.31133946672.7312.254942.50711.341278.58115816666746.5036.15112.50279987112.2684.7100.248113733331575.576.835114032733333334.3061.99234.1488.42262.0214217.1354.59942.196.7433.8505542533334.56722.53470.95529.8055.5955.6187.9933105.9447.6153.77562.50142102254559.5531.7229.269042172.43161216306.2746233.714207.710.0939.2586190.38212647513769093.995697.5191.166554.129356.715.6301125191.11586.1789.18444285570544092729499.012739.0127.66536.8220.494114.63111.6887.52843.45405128598333331388.9140.0129.83811328.51255620607.431138.1113.4714.792211.85108.025.7992.756185.3008.380.5717.2178.51616016.7303.62136.39912818783.77816.96329834128.0310222282766667360683331977083502.667115.3465633.520923.919842.06921.705791.660465.253214.4613534.163625.47896.377807.8858481.604172.123213.86479.089558.15092800.231182.0175.55018102.191101.468627695.2172.87521.3214.2910652.033.7548352.878778.1827550909.6146085449203.197882225738371942.014.4712.423.408337124.29946593246.936.901253333990.16291.2787281.958105.4052145.64769892582222321.1263.981001502634860316492320527103327712.63179.0526.357975907.45064977.6431974.88104288.613.984.260785962861959.8124273353.7368.86850533.67543249303332075011.254.60927943217.8465446.16110708.91472931.0447.5267178500687906747.61435.2466178015265054658131.24212.8714.3010139.6952.67414.465.2019.340.293342273130324596271.6207411866667176.20618498306.780.3517.412626835.720.234333517.0716.246.3489184477.7212708.5175.5971212953333395.83727513333333491.53446918.021194942.32109.4648.2748760.815185.7110133.48561.0761.117.147.207.041.00947323.1240.9686.92300.9170435.98118.902167.10742.036.41229197.63019.88253.63248.86731542.515894.81036825.005632444.8477617341.12632925.844102.572172688.5042809333333.491862.791.67133906673.488.8093057.09910.561524.74119996666730.0550.12118.05955505112.2673.485.898245833331558.472.685534063333333266.1062.88735.4028.34953.4411941.3227.22727.778.1964.3295495466727.67823.53525.84529.0352.8152.7986.3413098.5401.8461.07529.80125595607525.2328.8115.008281025.86162228750.1186757.726702.710.1723.5786100.3586251645629887188.747810.6548.4312024.1818666.1610.6018256584.67315.35517.00988576871798151451103.665178.2926.41504.8418.08982.94102.5837.64527302333331382.1161.9025.62651324.6108821580133.8712.7494.829240.43102.985.8462.810164.8998.300.5717.0171.2181783.62140.48261822782.32216.40929961027.7377122282066667360330003707515303.680015.9843639.017625.317139.80353.170642.250209.962457.5555866.628542.51379.124529.74614113.51793.834010.661511.502410.43441094.256220.3514.53817157.505155.96022931.8167.22329.6117.8919414.942.3129775.2783917.8110543531.0201082895594.815274663411353966.920.6421.005.147658449.46597374413.538.85803187621.42232.7495818.73686.0139360.20745703974887031.65230.2465639632938722018822018878087121.762114.7639.834525288.003014231.9619917.541528612.868.038.872259141872096.1181291671.2344.97082648.84922753526673738316.586.35042945229.9135747.8235778.51279397.4535.1464116722114187035.24617.4795411309975390078731.92117.7038.215702.1337.738110.9711.3531.620.292342249222829426319.4526401366667126.14567736018.740.7327.782075973.813.242250827.6827.538.6359443799.7812731.8133.92971744700000106.1306588200000527.799711895.407125567.07137.19313.0524218.831156.3909160.90438.4739.0811.0110.9110.880.94362122.6729.0094.73653.13156177989.8916.25186.103131.00432.448.29533337.68535.08551.07534.05942823.6266146.76130433.814223382.1035754401.35573733.12089.7350132973.4347145000003.161620.531.50111745003.129.6529647.98612.411454.71136980000048.3640.38613.84372244112.1596.2106.54709650000170068.565353791566667400.5273.27140.3517.28354.469839.64314.67924.806.9283.9684627000038.52623.69450.61425.4647.3347.3178.7392596.1462.7958.11450.12131781309458.9628.1624.609528476.63484477283.1828854.39320.510.9230.8572153.246161269162280115.785310.07102.847862.6511508.197.5573127519.37452.32312.31875899510705732354526.193280.2523.36433.7923.217106.14128.2798.80145.07808724449333331139.9135.1727.44711102.21166853266.465125.7616.3885.662227.40110.806.8533.251212.5466.680.4813.8169.23015114.7853.04167.40625974655.79519.90625069530.3813721898766667299073331897637993.129047.6333736.446026.445837.95852.210202.616536.523676.2279140.633032.47447.2808711.1392103.59787.655211.418210.55379.42177319.348166.7936.01164115.790120.55625194.6163.41323.7616.7912575.303.6543032.888697.9975650139.91577618610182.16104776633047107830.610.948.102.940456137.11385759922.139.8615510001127.05288.5377213.433121.3017201.26590602860899016.8285.861306928507573415412412723134022611.55765.5821.668171241.70851293.9938546.6684137.174.374.510618933729470.8100154032.6684.68859426.7762783039083169609.713.98120071214.6175365.42112750.59588329.3256.4485231661194528356.69364.6353163019831030267001.35911.2115.849771.4163.845956.2714.900.329304462036593204250.6346316266667190.08397645325.700.4113.113108396.721.305401213.6813.765.5576763265.0111208.7200.1612173480000098.63746439000000462.23827365.863245447.7299.21826.6446126.080208.3131117.61754.8854.575.715.755.790.82965328.1037.1378.06762.517096.6147.735127.53738.126.74977210.19718.59275.53253.31855341.8727101.56140324.570122316.1137769681.06839827.14586.6864166151.4246265666673.571876.661.71112736673.597.9840258.8399.651403.46134980000027.7451.62916.88459228112.1576.890.857093933331712.659.015673794133333349.6774.68941.9167.15346.0013455.0176.00658.977.9154.1004622966730.68027.86588.43422.7647.1447.1377.5962590.8397.4466.54420.35115317834427.9528.1111.938252639.55861750750.9654066.017873.111.2018.013388.3741320258686237231.836513.3656.7314601.5222499.0314.1038214017.18270.63122.0023116994738511352065642.476400.9423.28411.2621.22467.08126.1128.84823747666671139.0174.9326.32571104.2103630483131.3815.8105.740253.13111.156.9863.341192.9776.640.4813.7168.7791643.03192.41705972655.04619.55825107529.4744841894966667298933333012022323.987357.8406538.000027.897535.87123.696023.1644111.31488.5180883.766055.915810.066611.5774125.24493.636010.7518812.809310.23106397.429203.5714.91420179.989148.20829877.1159.74632.2622.0022017.752.0843845.8360618.9745442113.5229001522830.122437846082025894.621.0036.6611.36964691.64224172566.841.38386212317.38107.7152692.87341.0225468.68821118566172767.67161.4830706893837710219810222236798945.953240.1385.122274636.131544297.259256.113881127.128.5920.9379139881480.845377998.0921.817577105.67611500526677205134.3513.25084261107.3532683.8312943.08133284.4617.944853978493137317.96685.16204324214623097505303.80135.8231.992746.2018.470510.7811.2241.110.384260650012053901255.671311693333362.18666198256.720.5333.681123193.06.499126633.4933.768.7581422229.945826.4464.3253821013333106.5263062200000294.620916146.99763930.64128.98215.2516949.59175.2149219.05823.7124.3113.2613.2813.191.4983517.3017.0497.05082.57278153818.0316.77277.525127.08519.258.87446406.41434.51592.22567.28694722.1972205.01417258.169235443.0583313572.20049763.79689.208187511.1129828000001.80875.230.86112900001.799.800927.5327.38843.6380991666757.3824.24616.32161272112.1557.9176.876338600002024.754.603793047066667495.2575.86441.6576.93950.047382.43276.93673.4210.2055.0774621066744.27633.23313.50421.9946.8846.8768.1882593.3308.4665.66337.32116879799338.8428.1327.312816704.4851997197.9116573.24660.011.7830.3743207.3367458472100753.893636.33100.673692.675366.793.514652745.64547.5245.742027409177826618653710.791542.6123.25323.5927.53687.31154.0108.92956.41751821868333331118.8101.1727.93621101.41054328626.11898.7017.9175.735251.47137.237.1823.484242.9316.760.4813.9165.08912313.9683.03163.69864976655.23921.03525002433.673162187133333329899667991981443.910067.8732535.794327.928136.07721.824432.257164.825064.5702936.611932.92017.7452111.2047102.050380.723212.388410.30269.38681388.743216.7034.66491114.174112.72819375.9160.78513.819.396416.346.5417681.519015.7067224526.093336452506.102219447097321047.520.6536.4812.15132690.73503153920.845.71339998293.0797.9782449.45437.9597496.24119330509364375.26156.59282053327077934739347233835554.389263.7694.412069432.528093300.698279.634251330.079.4621.1780307810291.848844918.5320.997732120.56011471080007809338.0414.4939164398.2072455.1632763.48130839.1216.450548896539085716.45045.11224026494158939632074.54538.8634.762718.9416.920011.4812.6740.970.414241637511882103254.727279370000058.27765820618.180.633.301052818.56.246117733.2333.188.4728321684.805821.4663.3433741740000102.9662789600000273.670316609.78162449.55129.64615.1116855.89173.9073211.18722.4623.0213.1813.2813.151.7974918.4915.7796.16792.25453141831.7767.60288.118127.20817.808.75233438.16834.35654.83568.25404922.1341215.92516359.266377446.6893190942.32119566.70588.568878334.9226870666671.69796.820.80112363331.698.8714425.3346.93771.4773175666757.5421.93518.05355395112.1563.6187.035772633332224.651.513632767933333498.2278.24142.6056.72744.927421.23256.79617.0310.4275.1654548633346.35235.95295.29418.8946.9346.8664.7872593.0287.4264.93337.44117884977335.4627.7426.247515903.4771352204.0516399.74564.313.1131.0644203.0556780673038748.733405.94109.003355.734830.013.199352684.93553.4715.240624294011023499263610.701396.7823.27322.6928.42080.86159.6248.94861.36246320263333331144.895.6327.87031096.51051385516.00092.8218.1755.734251.05151.277.3013.623251.6066.740.4813.8157.36212013.6143.03188.37105974656.25021.53025016236.823441177686666729899333906581563.924557.8601535.883126.829037.53021.805732.238684.926534.7422138.102732.22947.7051111.2864112.76086.651511.544710.39779.71131443.961226.6264.46533118.023114.31119485.8153.41713.008.485745.046.8527121.461635.4497124548.889341762743.397859939523022587.42.835.88456271.0180.29367657243.7678.2351955.88171.024724000513515327.41293.0235282682165336330036313376731329.385106.4835.116575205.53864614551.123822810.5618.751479879.0439061731.5031.47855758.9576244916.526.0457158376.6021915.0414376.0932.7979109608219971332.96632.56149718329794193887972.60518.7041.5021.222716.2826.1216.450.81512296492763078192.50836800900000121.43201783869.961.2014.673363067.0202014.8414.814.58960125.1146130673333359.49836821533333338.146858.57676.4742946.258138.849980.419929.1529.156.116.336.152.49734340.2620.4660.28801.6467419.23187.654178.113122.037.49940192.09816.24719.83138.566350276.2355918351.857642136.39175761.5037121333332.97979.891.5162807672.986.667186.41857.2070705333328.9928.8073471649.8293.134974666736.404743607900000226.60143.79779.2003.71027.33168.10464.807.9673.6293343933335.546354.81258.4926.8926.9042.8571760.8301.46107.28320.1771664005320.8722.073.497852239294245.2710431.628.245.5824127.472725633034977799.72843.92294.693787.9410020.917.129181.257211.3573115849654611157207421.761593.8813.90311.6325.71161.48160.46212.2451852366667721.4113.4217.6172701.267599793103.2220.5888.094380.339.9604.829252.9685.600.3510.6108.4951182.231119494.37925.87919729817805333333170566723544549910.80666.1432756.773447.197721.198212.30213.6192036.400912.4345285.988179.14417.05537.32610149.994155.9006.6047116.582816.8062608.094194.1075.15166217.929133.35631677.2108.29316.887.710.707572.5540039580.9244661431414.864060513792311348.58.5612.40233836.3172.72188925138.5339.348983.70740.692412059178725752.47283.8317724906218319020919005842106357.713191.2065.672915609.7473687721.005208319.8517.81743282.757657924.9015.941604115.4628857929.5511.47910144439.171979.2792366.8319.425156572076778319.51595.39231827315063013746234.80629.0638.8712.173715.1125.3332.450.572174865817548934237.803425943333373.95582299150.511.3626.822531953.1126726.8926.917.1358776.529284837666759.29894301166667284.4616131.53613.3926024.60284.7057130.06218.8619.3411.8811.7411.952.2971282.1213.7769.06831.77809114715.78918.20246.848207.94215.6512.7015274.85529.56692.79184.202270445.6234138512.504621139.45484584.1337363000001.93677.400.9862843001.938.572867.90609.6771962666738.0112.6287919149.8299.435957666741.865043671966667314.88140.85976.4743.97240.73214.14443.7411.1985.1773344466741.095278.05261.1927.1727.1746.4831765.6260.8390.31381.0585117897379.9220.226.245211508453126.645315.727.019.3729455.862212997599473351.851747.50259.662006.005278.463.6505176.6435.86325969554945747495524.67832.2914.01365.6227.85071.41165.40910.99658.3067151906266667743.591.9623.3078739.1819004774.05287.1720.9087.507312.329.1884.243267.9515.650.3510.6115.34514510.3912.231117494.04625.8851967401841400000317260001227942464.203554.8072542.901641.083324.33945.664262.2432317.90007.68977160.128106.6887.595897.16440116.644124.0648.0601314.476116.8631562.398188.3005.31050140.14478.730227281.9114.54215.909.400.523573.7681140441.0113403891525.264508875564012610.89.6013.14262432.6153.76209803149.6343.7281093.20645.210013403303909048.07266.9119692068327021144921131146376852.074174.4960.113340274.0343098536.394687517.6116.36826049.5525011018.1817.853682103.8638100326.5210.3019217543.5531088.8332553.5521.514763845320376321.62225.58209024725689375783134.32426.4935.3013.401814.0123.4935.850.542184608017945745246.037471470000081.83402339570.281.2530.862812118.6139130.6930.877.6958383.732194027000066.19714799133333314.6232140.02614.5326864.11092.8784143.35520.8721.3913.6413.6113.002.0491075.2215.2475.86501.94144116716.40116.41228.571217.44517.2913.8295251.19531.99618.97169.447299482.2094380482.279971148.10791273.0241367666672.11732.791.0769839332.119.503538.47668.3379634000038.0111.5378667752.5333.239856666746.185664102200000313.50126.96669.3434.35044.44232.51482.0610.3864.7703719566737.640298.16284.3329.9529.9450.8221960.7281.6284.59403.9690973414400.5221.306.813301640921134.775753.924.2510.342564.158414416302728058.061906.99240.382179.995866.634.0574190.7826.51666731592176453094835.02934.9715.47388.2925.23576.37152.22910.24352.3213812099033333816.797.6726.0268797.7871903974.44092.4219.2036.849296.368.3593.872238.4326.190.3911.5126.58515511.1812.491007540.24023.4052200512057300000352590001251940664.062724.5970338.419736.783427.18445.240512.0728815.58566.97509146.77996.68707.135356.74630105.223111.8748.9383313.178915.1057515.079174.1405.74234129.94072.312029804.4124.59715.8310.090.567173.7634840626.4118648152957.698919441685725098.02.996.72519392.2157.28407256264.6686.8842172.10379.285226658385788724.61274.5239191122548040473940227584633526.46297.1831.287302247.13820616394.06350819.7116.731644363.7392831933.0835.19669253.0155608215.165.5126648784.3472108.6754992.7836.2464126688286665336.50432.671342163111253730411732.33716.8937.1723.116314.3024.2417.910.77512921222765777694.42477597566667133.41501821144.001.0916.223813414.2222816.1015.974.56278136.2218143710000066.17727546366667363.384460.38837.1044136.525151.248187.086731.8531.706.616.656.592.24526293.3621.6365.43201.7036516.98173.087210.36522.598.14615174.27218.34630.23125.274389292.7916112001.718022103.894776895.2940686666673.311064.181.6869699673.317.139176.741010.9377794000028.9226.2883804352.6323.738440666738.925174021033333236.81129.91071.9684.04028.43190.80520.017.4683.4113712133332.655378.79283.5228.3928.3947.2531954.2335.38101.49339.5075740139337.7519.553.760032449334261.6411147.224.775.9528328.3969287035041140113.68978.46271.144259.9911390.047.906082.442112.6220132416334012729075611.991826.8214.87333.0623.32368.52148.99311.6192036733333774.4124.6018.4295753.268320800115.1218.8517.603377.589.3514.486233.2056.100.3811.6117.6811262.471005538.90823.45621753619893000003519066726691982510.58834.7485954.254343.806822.828912.12683.4153735.226611.4820266.104167.97416.541810.58571140.07141.5747.3128515.278415.1274587.000182.3615.48343219.173122.75133010.5116.61817.457.990.576942.3977037461.127059786OpenBenchmarking.org

OpenVINO

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Person Vehicle Bike Detection FP16 - Device: CPUXeon Platinum 8380Xeon 6766EXeon 6780EXeon Platinum 8380 2PEPYC 8534PNXeon 6766E 2PEPYC 8534PXeon 6780E 2PXeon Platinum 8490HXeon Max 9468Xeon Max 9480EPYC 9654EPYC 9754EPYC 9684XXeon Platinum 8592+Xeon Max 9468 2PXeon Max 9480 2PXeon Platinum 8490H 2PEPYC 9654 2PEPYC 9684X 2PEPYC 9754 2PXeon Platinum 8592+ 2P2K4K6K8K10KSE +/- 0.24, N = 3SE +/- 2.55, N = 3SE +/- 2.87, N = 3SE +/- 1.00, N = 3SE +/- 3.87, N = 3SE +/- 5.02, N = 3SE +/- 2.97, N = 3SE +/- 3.86, N = 3SE +/- 4.52, N = 3SE +/- 7.17, N = 3SE +/- 9.37, N = 3SE +/- 25.68, N = 3SE +/- 54.09, N = 3SE +/- 18.02, N = 3SE +/- 4.97, N = 3SE +/- 4.05, N = 3SE +/- 3.66, N = 3SE +/- 8.98, N = 3SE +/- 6.56, N = 3SE +/- 10.88, N = 3SE +/- 4.91, N = 3SE +/- 3.37, N = 31100.181414.861525.262030.972506.102743.392830.122957.693606.123802.614093.735024.325594.815608.075725.037127.287689.327862.589203.199752.8910182.1610934.171. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Person Vehicle Bike Detection FP16 - Device: CPUXeon Platinum 8380Xeon 6766EXeon 6780EXeon Platinum 8380 2PEPYC 8534PNXeon 6766E 2PEPYC 8534PXeon 6780E 2PXeon Platinum 8490HXeon Max 9468Xeon Max 9480EPYC 9654EPYC 9754EPYC 9684XXeon Platinum 8592+Xeon Max 9468 2PXeon Max 9480 2PXeon Platinum 8490H 2PEPYC 9654 2PEPYC 9684X 2PEPYC 9754 2PXeon Platinum 8592+ 2P2K4K6K8K10KMin: 1099.86 / Avg: 1100.18 / Max: 1100.64Min: 1410.97 / Avg: 1414.86 / Max: 1419.66Min: 1522.34 / Avg: 1525.26 / Max: 1530.99Min: 2029.89 / Avg: 2030.97 / Max: 2032.96Min: 2498.4 / Avg: 2506.1 / Max: 2510.57Min: 2734.89 / Avg: 2743.39 / Max: 2752.27Min: 2826.08 / Avg: 2830.12 / Max: 2835.91Min: 2950.58 / Avg: 2957.69 / Max: 2963.84Min: 3598.48 / Avg: 3606.12 / Max: 3614.13Min: 3788.72 / Avg: 3802.61 / Max: 3812.62Min: 4075.39 / Avg: 4093.73 / Max: 4106.2Min: 4973.45 / Avg: 5024.32 / Max: 5055.88Min: 5491.91 / Avg: 5594.81 / Max: 5675.15Min: 5573.91 / Avg: 5608.07 / Max: 5635.08Min: 5716.19 / Avg: 5725.03 / Max: 5733.37Min: 7120.17 / Avg: 7127.28 / Max: 7134.19Min: 7685.53 / Avg: 7689.32 / Max: 7696.65Min: 7844.62 / Avg: 7862.58 / Max: 7871.66Min: 9191.98 / Avg: 9203.19 / Max: 9214.69Min: 9736.52 / Avg: 9752.89 / Max: 9773.48Min: 10172.35 / Avg: 10182.16 / Max: 10187.34Min: 10930.3 / Avg: 10934.17 / Max: 10940.891. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenSSL

OpenBenchmarking.orgbyte/s, More Is BetterOpenSSL 3.3Algorithm: SHA512Xeon Platinum 8380Xeon Max 9468Xeon Max 9480Xeon Platinum 8380 2PEPYC 8534PNXeon Platinum 8490HXeon Platinum 8592+EPYC 8534PXeon Max 9468 2PXeon Max 9480 2PEPYC 9654Xeon 6766EXeon Platinum 8490H 2PXeon 6780EEPYC 9684XXeon Platinum 8592+ 2PEPYC 9754Xeon 6766E 2PEPYC 9654 2PXeon 6780E 2PEPYC 9684X 2PEPYC 9754 2P20000M40000M60000M80000M100000MSE +/- 6313493.56, N = 3SE +/- 500176.69, N = 3SE +/- 1250834.62, N = 3SE +/- 20492408.59, N = 3SE +/- 9990938.84, N = 3SE +/- 203213936.42, N = 3SE +/- 37654528.63, N = 3SE +/- 15082903.45, N = 3SE +/- 3500318.33, N = 3SE +/- 14339684.98, N = 3SE +/- 6285194.15, N = 3SE +/- 14430784.68, N = 3SE +/- 481040738.21, N = 3SE +/- 24045021.87, N = 3SE +/- 55712209.05, N = 3SE +/- 14734422.48, N = 3SE +/- 5822493.86, N = 3SE +/- 66704467.17, N = 3SE +/- 37307640.51, N = 3SE +/- 64065176.93, N = 3SE +/- 44023374.36, N = 3SE +/- 17716195.81, N = 31098094009316199261277188939807832207953990022194470973222199277232388605477024378460820323042229933756452205339627575497406051379234284625447745088755640458651319134652076070752746634113785993952307882225738389194416857914559712001047766330471. (CC) gcc options: -pthread -m64 -O3 -lssl -lcrypto -ldl
OpenBenchmarking.orgbyte/s, More Is BetterOpenSSL 3.3Algorithm: SHA512Xeon Platinum 8380Xeon Max 9468Xeon Max 9480Xeon Platinum 8380 2PEPYC 8534PNXeon Platinum 8490HXeon Platinum 8592+EPYC 8534PXeon Max 9468 2PXeon Max 9480 2PEPYC 9654Xeon 6766EXeon Platinum 8490H 2PXeon 6780EEPYC 9684XXeon Platinum 8592+ 2PEPYC 9754Xeon 6766E 2PEPYC 9654 2PXeon 6780E 2PEPYC 9684X 2PEPYC 9754 2P20000M40000M60000M80000M100000MMin: 10974177160 / Avg: 10980940093.33 / Max: 10993556150Min: 16198336550 / Avg: 16199261276.67 / Max: 16200054080Min: 18891629010 / Avg: 18893980783.33 / Max: 18895895340Min: 22038980850 / Avg: 22079539900 / Max: 22104922270Min: 22180744680 / Avg: 22194470973.33 / Max: 22213909820Min: 21813753380 / Avg: 22219927723.33 / Max: 22435445260Min: 23845431080 / Avg: 23886054770 / Max: 23961283620Min: 24348691850 / Avg: 24378460820 / Max: 24397568840Min: 32297389590 / Avg: 32304222993.33 / Max: 32308956940Min: 37536606990 / Avg: 37564522053.33 / Max: 37584175340Min: 39615986680 / Avg: 39627575496.67 / Max: 39637587190Min: 40587290300 / Avg: 40605137923.33 / Max: 40633704530Min: 41884310320 / Avg: 42846254476.67 / Max: 43341303310Min: 45045570940 / Avg: 45088755640 / Max: 45128672850Min: 45754704480 / Avg: 45865131913.33 / Max: 45933225350Min: 46497952550 / Avg: 46520760706.67 / Max: 46548324940Min: 52735029190 / Avg: 52746634113.33 / Max: 52753272410Min: 78506721660 / Avg: 78599395230 / Max: 78728841370Min: 78749035330 / Avg: 78822257383.33 / Max: 78871297340Min: 89120159520 / Avg: 89194416856.67 / Max: 89321974650Min: 91376626160 / Avg: 91455971200 / Max: 91528695890Min: 104742342430 / Avg: 104776633046.67 / Max: 1048015053201. (CC) gcc options: -pthread -m64 -O3 -lssl -lcrypto -ldl

OpenBenchmarking.orgsign/s, More Is BetterOpenSSL 3.3Algorithm: RSA4096Xeon 6766EXeon 6780EXeon Platinum 8380EPYC 8534PNXeon 6766E 2PXeon Max 9468Xeon 6780E 2PXeon Max 9480EPYC 8534PXeon Platinum 8490HXeon Platinum 8592+EPYC 9654Xeon Platinum 8380 2PXeon Max 9468 2PXeon Max 9480 2PEPYC 9684XEPYC 9754Xeon Platinum 8490H 2PXeon Platinum 8592+ 2PEPYC 9654 2PEPYC 9684X 2PEPYC 9754 2P20K40K60K80K100KSE +/- 1.37, N = 3SE +/- 1.63, N = 3SE +/- 40.37, N = 3SE +/- 12.56, N = 3SE +/- 8.25, N = 3SE +/- 19.45, N = 3SE +/- 8.20, N = 3SE +/- 20.13, N = 3SE +/- 22.17, N = 3SE +/- 9.84, N = 3SE +/- 15.15, N = 3SE +/- 29.11, N = 3SE +/- 108.70, N = 3SE +/- 6.92, N = 3SE +/- 83.09, N = 3SE +/- 98.71, N = 3SE +/- 27.42, N = 3SE +/- 14.34, N = 3SE +/- 56.68, N = 3SE +/- 81.38, N = 3SE +/- 247.60, N = 3SE +/- 80.37, N = 311348.512610.818389.321047.522587.422861.025098.025441.525894.627431.131594.435964.936371.645531.048534.848996.853966.954601.161499.671942.098237.0107830.61. (CC) gcc options: -pthread -m64 -O3 -lssl -lcrypto -ldl
OpenBenchmarking.orgsign/s, More Is BetterOpenSSL 3.3Algorithm: RSA4096Xeon 6766EXeon 6780EXeon Platinum 8380EPYC 8534PNXeon 6766E 2PXeon Max 9468Xeon 6780E 2PXeon Max 9480EPYC 8534PXeon Platinum 8490HXeon Platinum 8592+EPYC 9654Xeon Platinum 8380 2PXeon Max 9468 2PXeon Max 9480 2PEPYC 9684XEPYC 9754Xeon Platinum 8490H 2PXeon Platinum 8592+ 2PEPYC 9654 2PEPYC 9684X 2PEPYC 9754 2P20K40K60K80K100KMin: 11345.8 / Avg: 11348.5 / Max: 11350.3Min: 12607.6 / Avg: 12610.77 / Max: 12613Min: 18330.5 / Avg: 18389.27 / Max: 18466.6Min: 21033.9 / Avg: 21047.5 / Max: 21072.6Min: 22570.9 / Avg: 22587.4 / Max: 22596.1Min: 22837.3 / Avg: 22861.03 / Max: 22899.6Min: 25082.1 / Avg: 25098.03 / Max: 25109.4Min: 25410.6 / Avg: 25441.5 / Max: 25479.3Min: 25872.2 / Avg: 25894.57 / Max: 25938.9Min: 27412.5 / Avg: 27431.07 / Max: 27446Min: 31564.8 / Avg: 31594.43 / Max: 31614.7Min: 35934.4 / Avg: 35964.9 / Max: 36023.1Min: 36259.2 / Avg: 36371.63 / Max: 36589Min: 45522.9 / Avg: 45531.03 / Max: 45544.8Min: 48448.6 / Avg: 48534.77 / Max: 48700.9Min: 48884.5 / Avg: 48996.83 / Max: 49193.6Min: 53938.3 / Avg: 53966.87 / Max: 54021.7Min: 54572.8 / Avg: 54601.13 / Max: 54619.2Min: 61388.1 / Avg: 61499.57 / Max: 61573.2Min: 71850.6 / Avg: 71941.97 / Max: 72104.3Min: 97966.5 / Avg: 98237.03 / Max: 98731.5Min: 107718.7 / Avg: 107830.63 / Max: 107986.51. (CC) gcc options: -pthread -m64 -O3 -lssl -lcrypto -ldl

Llamafile

OpenBenchmarking.orgTokens Per Second, More Is BetterLlamafile 0.7Test: llava-v1.5-7b-q4 - Acceleration: CPUXeon 6766E 2PXeon 6780E 2PXeon Max 9480 2PXeon Platinum 8592+ 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon 6766EXeon 6780EXeon Platinum 8490H 2PEPYC 9754 2PXeon Platinum 8380 2PEPYC 9684X 2PEPYC 9654 2PXeon Platinum 8592+Xeon Platinum 8380EPYC 9754EPYC 8534PNXeon Platinum 8490HEPYC 8534PEPYC 9684XEPYC 9654612182430SE +/- 0.02, N = 3SE +/- 0.04, N = 3SE +/- 0.04, N = 3SE +/- 1.08, N = 12SE +/- 0.10, N = 3SE +/- 0.05, N = 3SE +/- 0.02, N = 3SE +/- 0.08, N = 3SE +/- 0.30, N = 15SE +/- 0.09, N = 15SE +/- 0.08, N = 4SE +/- 0.10, N = 15SE +/- 0.02, N = 4SE +/- 0.07, N = 4SE +/- 0.17, N = 4SE +/- 0.11, N = 3SE +/- 0.05, N = 4SE +/- 0.07, N = 4SE +/- 0.15, N = 4SE +/- 0.11, N = 4SE +/- 0.10, N = 5SE +/- 0.02, N = 52.832.997.267.497.677.778.138.569.6010.4410.9412.2914.2914.4716.6119.1120.6420.6520.9521.0025.3825.75
OpenBenchmarking.orgTokens Per Second, More Is BetterLlamafile 0.7Test: llava-v1.5-7b-q4 - Acceleration: CPUXeon 6766E 2PXeon 6780E 2PXeon Max 9480 2PXeon Platinum 8592+ 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon 6766EXeon 6780EXeon Platinum 8490H 2PEPYC 9754 2PXeon Platinum 8380 2PEPYC 9684X 2PEPYC 9654 2PXeon Platinum 8592+Xeon Platinum 8380EPYC 9754EPYC 8534PNXeon Platinum 8490HEPYC 8534PEPYC 9684XEPYC 9654612182430Min: 2.8 / Avg: 2.83 / Max: 2.86Min: 2.92 / Avg: 2.99 / Max: 3.05Min: 7.21 / Avg: 7.26 / Max: 7.34Min: 1.11 / Avg: 7.49 / Max: 9.77Min: 7.55 / Avg: 7.67 / Max: 7.87Min: 7.68 / Avg: 7.77 / Max: 7.82Min: 8.1 / Avg: 8.13 / Max: 8.18Min: 8.43 / Avg: 8.56 / Max: 8.71Min: 8.72 / Avg: 9.6 / Max: 11.63Min: 9.84 / Avg: 10.44 / Max: 11.02Min: 10.72 / Avg: 10.94 / Max: 11.04Min: 11.75 / Avg: 12.29 / Max: 12.86Min: 14.22 / Avg: 14.29 / Max: 14.32Min: 14.36 / Avg: 14.47 / Max: 14.67Min: 16.11 / Avg: 16.61 / Max: 16.84Min: 18.96 / Avg: 19.11 / Max: 19.32Min: 20.48 / Avg: 20.64 / Max: 20.73Min: 20.55 / Avg: 20.65 / Max: 20.85Min: 20.63 / Avg: 20.95 / Max: 21.26Min: 20.73 / Avg: 21 / Max: 21.27Min: 25.13 / Avg: 25.38 / Max: 25.67Min: 25.68 / Avg: 25.75 / Max: 25.79

TensorFlow

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.16.1Device: CPU - Batch Size: 1 - Model: GoogLeNetXeon 6766E 2PXeon 6780E 2PEPYC 9754 2PXeon 6766EEPYC 9654 2PXeon Platinum 8592+ 2PEPYC 9684X 2PXeon 6780EXeon Platinum 8490H 2PXeon Max 9480 2PXeon Max 9468 2PEPYC 9754Xeon Platinum 8592+Xeon Platinum 8380 2PXeon Max 9480EPYC 9654Xeon Platinum 8490HEPYC 9684XXeon Max 9468EPYC 8534PNEPYC 8534PXeon Platinum 83801224364860SE +/- 0.05, N = 7SE +/- 0.06, N = 9SE +/- 0.04, N = 3SE +/- 0.04, N = 4SE +/- 0.14, N = 15SE +/- 0.12, N = 6SE +/- 0.17, N = 15SE +/- 0.09, N = 4SE +/- 0.23, N = 15SE +/- 0.23, N = 12SE +/- 0.20, N = 15SE +/- 0.27, N = 15SE +/- 0.21, N = 6SE +/- 0.34, N = 15SE +/- 0.27, N = 6SE +/- 0.41, N = 15SE +/- 0.19, N = 6SE +/- 0.33, N = 15SE +/- 0.27, N = 7SE +/- 0.14, N = 6SE +/- 0.30, N = 15SE +/- 0.24, N = 75.886.728.1012.4012.4212.6912.8313.1413.5014.6718.2421.0021.6729.1831.4732.8033.5634.2036.1336.4836.6653.38
OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.16.1Device: CPU - Batch Size: 1 - Model: GoogLeNetXeon 6766E 2PXeon 6780E 2PEPYC 9754 2PXeon 6766EEPYC 9654 2PXeon Platinum 8592+ 2PEPYC 9684X 2PXeon 6780EXeon Platinum 8490H 2PXeon Max 9480 2PXeon Max 9468 2PEPYC 9754Xeon Platinum 8592+Xeon Platinum 8380 2PXeon Max 9480EPYC 9654Xeon Platinum 8490HEPYC 9684XXeon Max 9468EPYC 8534PNEPYC 8534PXeon Platinum 83801122334455Min: 5.68 / Avg: 5.88 / Max: 6.05Min: 6.46 / Avg: 6.72 / Max: 6.97Min: 8.05 / Avg: 8.1 / Max: 8.17Min: 12.34 / Avg: 12.4 / Max: 12.52Min: 11.43 / Avg: 12.42 / Max: 13.06Min: 12.4 / Avg: 12.69 / Max: 13.12Min: 11.84 / Avg: 12.83 / Max: 13.79Min: 12.92 / Avg: 13.14 / Max: 13.34Min: 11.96 / Avg: 13.5 / Max: 15.09Min: 13.61 / Avg: 14.67 / Max: 15.96Min: 16.92 / Avg: 18.24 / Max: 19.31Min: 19.39 / Avg: 21 / Max: 22.81Min: 21.03 / Avg: 21.67 / Max: 22.4Min: 26.5 / Avg: 29.18 / Max: 31.1Min: 30.65 / Avg: 31.47 / Max: 32.43Min: 30.13 / Avg: 32.8 / Max: 34.6Min: 32.93 / Avg: 33.56 / Max: 34.1Min: 30.96 / Avg: 34.2 / Max: 35.47Min: 35.26 / Avg: 36.13 / Max: 37.01Min: 36.08 / Avg: 36.48 / Max: 36.85Min: 35.05 / Avg: 36.66 / Max: 37.91Min: 52.4 / Avg: 53.38 / Max: 54.55

Pennant

Pennant is an application focused on hydrodynamics on general unstructured meshes in 2D. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgHydro Cycle Time - Seconds, Fewer Is BetterPennant 1.0.1Test: sedovbigXeon Platinum 8380Xeon Max 9468Xeon Max 9480Xeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8380 2PXeon Max 9468 2PEPYC 8534PNXeon Max 9480 2PEPYC 8534PXeon Platinum 8490H 2PXeon Platinum 8592+ 2PEPYC 9654EPYC 9684XEPYC 9754EPYC 9654 2PEPYC 9684X 2PEPYC 9754 2P612182430SE +/- 0.034794, N = 3SE +/- 0.001847, N = 3SE +/- 0.013353, N = 3SE +/- 0.002400, N = 3SE +/- 0.002987, N = 3SE +/- 0.052953, N = 3SE +/- 0.003237, N = 4SE +/- 0.029749, N = 4SE +/- 0.003253, N = 4SE +/- 0.024479, N = 4SE +/- 0.016400, N = 4SE +/- 0.018471, N = 4SE +/- 0.052975, N = 7SE +/- 0.080453, N = 15SE +/- 0.074320, N = 15SE +/- 0.040626, N = 15SE +/- 0.041359, N = 15SE +/- 0.037087, N = 1525.78945021.02112019.88246016.96910016.03080015.24719013.21125012.15132012.10690011.36964011.2843809.9645265.9164585.4606605.1476583.4083373.0811082.9404561. (CXX) g++ options: -fopenmp -lmpi_cxx -lmpi
OpenBenchmarking.orgHydro Cycle Time - Seconds, Fewer Is BetterPennant 1.0.1Test: sedovbigXeon Platinum 8380Xeon Max 9468Xeon Max 9480Xeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8380 2PXeon Max 9468 2PEPYC 8534PNXeon Max 9480 2PEPYC 8534PXeon Platinum 8490H 2PXeon Platinum 8592+ 2PEPYC 9654EPYC 9684XEPYC 9754EPYC 9654 2PEPYC 9684X 2PEPYC 9754 2P612182430Min: 25.73 / Avg: 25.79 / Max: 25.85Min: 21.02 / Avg: 21.02 / Max: 21.02Min: 19.86 / Avg: 19.88 / Max: 19.91Min: 16.96 / Avg: 16.97 / Max: 16.97Min: 16.03 / Avg: 16.03 / Max: 16.04Min: 15.18 / Avg: 15.25 / Max: 15.35Min: 13.2 / Avg: 13.21 / Max: 13.22Min: 12.1 / Avg: 12.15 / Max: 12.21Min: 12.1 / Avg: 12.11 / Max: 12.12Min: 11.31 / Avg: 11.37 / Max: 11.42Min: 11.26 / Avg: 11.28 / Max: 11.32Min: 9.93 / Avg: 9.96 / Max: 10.01Min: 5.72 / Avg: 5.92 / Max: 6.12Min: 5.09 / Avg: 5.46 / Max: 6.12Min: 4.77 / Avg: 5.15 / Max: 5.62Min: 3.23 / Avg: 3.41 / Max: 3.78Min: 2.92 / Avg: 3.08 / Max: 3.52Min: 2.76 / Avg: 2.94 / Max: 3.231. (CXX) g++ options: -fopenmp -lmpi_cxx -lmpi

OpenFOAM

OpenFOAM is the leading free, open-source software for computational fluid dynamics (CFD). This test profile currently uses the drivaerFastback test case for analyzing automotive aerodynamics or alternatively the older motorBike input. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterOpenFOAM 10Input: drivaerFastback, Medium Mesh Size - Execution TimeXeon Platinum 8380EPYC 8534PEPYC 8534PNEPYC 9754Xeon Max 9468Xeon Platinum 8490HXeon Max 9480Xeon Platinum 8380 2PEPYC 9654Xeon Platinum 8592+Xeon Max 9468 2PXeon Platinum 8490H 2PXeon Max 9480 2PEPYC 9684XEPYC 9754 2PXeon Platinum 8592+ 2PEPYC 9654 2PEPYC 9684X 2P2004006008001000798.35691.64690.74449.47440.83420.65410.29362.59325.42302.06201.11196.50186.33178.25137.11137.04124.3093.571. (CXX) g++ options: -std=c++14 -m64 -O3 -ftemplate-depth-100 -fPIC -fuse-ld=bfd -Xlinker --add-needed --no-as-needed -lfiniteVolume -lmeshTools -lparallel -llagrangian -lregionModels -lgenericPatchFields -lOpenFOAM -ldl -lm

QuantLib

QuantLib is an open-source library/framework around quantitative finance for modeling, trading and risk management scenarios. QuantLib is written in C++ with Boost and its built-in benchmark used reports the QuantLib Benchmark Index benchmark score. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgMFLOPS, More Is BetterQuantLib 1.32Configuration: Multi-ThreadedXeon Platinum 8380Xeon Max 9468EPYC 8534PNXeon Max 9480EPYC 8534PXeon Platinum 8490HXeon Platinum 8380 2PXeon Platinum 8592+Xeon 6766EXeon 6780EXeon Max 9468 2PEPYC 9654Xeon Max 9480 2PEPYC 9684XXeon Platinum 8490H 2PEPYC 9754Xeon Platinum 8592+ 2PXeon 6766E 2PXeon 6780E 2PEPYC 9654 2PEPYC 9684X 2PEPYC 9754 2P160K320K480K640K800KSE +/- 395.04, N = 3SE +/- 155.19, N = 3SE +/- 86.28, N = 3SE +/- 40.48, N = 3SE +/- 82.80, N = 3SE +/- 105.60, N = 3SE +/- 457.00, N = 3SE +/- 63.14, N = 3SE +/- 306.14, N = 3SE +/- 846.02, N = 3SE +/- 286.86, N = 3SE +/- 86.78, N = 3SE +/- 160.59, N = 3SE +/- 412.72, N = 3SE +/- 362.38, N = 3SE +/- 156.35, N = 3SE +/- 248.00, N = 3SE +/- 1610.78, N = 3SE +/- 1647.70, N = 3SE +/- 713.18, N = 3SE +/- 1065.76, N = 3SE +/- 804.57, N = 391036.5143755.3153920.8162727.4172566.8179647.5182366.9195648.8233836.3262432.6288129.1294183.2316359.2319827.2350187.5374413.5380867.5456271.0519392.2593246.9644091.0759922.11. (CXX) g++ options: -O3 -march=native -fPIE -pie
OpenBenchmarking.orgMFLOPS, More Is BetterQuantLib 1.32Configuration: Multi-ThreadedXeon Platinum 8380Xeon Max 9468EPYC 8534PNXeon Max 9480EPYC 8534PXeon Platinum 8490HXeon Platinum 8380 2PXeon Platinum 8592+Xeon 6766EXeon 6780EXeon Max 9468 2PEPYC 9654Xeon Max 9480 2PEPYC 9684XXeon Platinum 8490H 2PEPYC 9754Xeon Platinum 8592+ 2PXeon 6766E 2PXeon 6780E 2PEPYC 9654 2PEPYC 9684X 2PEPYC 9754 2P130K260K390K520K650KMin: 90483 / Avg: 91036.47 / Max: 91801.5Min: 143465.9 / Avg: 143755.33 / Max: 143997.1Min: 153778.8 / Avg: 153920.8 / Max: 154076.7Min: 162652.1 / Avg: 162727.43 / Max: 162790.8Min: 172472.7 / Avg: 172566.83 / Max: 172731.9Min: 179510.9 / Avg: 179647.5 / Max: 179855.3Min: 181790.3 / Avg: 182366.93 / Max: 183269.4Min: 195522.5 / Avg: 195648.77 / Max: 195714Min: 233497.3 / Avg: 233836.33 / Max: 234447.4Min: 261157.7 / Avg: 262432.6 / Max: 264033.5Min: 287724.1 / Avg: 288129.07 / Max: 288683.5Min: 294038.7 / Avg: 294183.2 / Max: 294338.7Min: 316084 / Avg: 316359.23 / Max: 316640.2Min: 319397.1 / Avg: 319827.2 / Max: 320652.4Min: 349585.6 / Avg: 350187.53 / Max: 350838.1Min: 374185 / Avg: 374413.47 / Max: 374712.6Min: 380550.6 / Avg: 380867.5 / Max: 381356.4Min: 454126.4 / Avg: 456271 / Max: 459425.2Min: 517219.1 / Avg: 519392.2 / Max: 522624.2Min: 592478.4 / Avg: 593246.9 / Max: 594671.8Min: 642609.4 / Avg: 644091 / Max: 646158.9Min: 758869.4 / Avg: 759922.07 / Max: 761502.41. (CXX) g++ options: -O3 -march=native -fPIE -pie

OpenVINO

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Handwritten English Recognition FP16-INT8 - Device: CPUXeon 6766E 2PXeon 6766EXeon 6780E 2PXeon 6780EXeon Platinum 8380Xeon Platinum 8380 2PEPYC 8534PNEPYC 8534PEPYC 9754 2PEPYC 9754EPYC 9654 2PXeon Platinum 8490HEPYC 9654EPYC 9684X 2PEPYC 9684XXeon Max 9480 2PXeon Platinum 8490H 2PXeon Max 9480Xeon Max 9468 2PXeon Max 9468Xeon Platinum 8592+ 2PXeon Platinum 8592+4080120160200SE +/- 0.13, N = 3SE +/- 0.34, N = 3SE +/- 0.33, N = 3SE +/- 0.10, N = 3SE +/- 0.46, N = 3SE +/- 0.45, N = 15SE +/- 0.02, N = 3SE +/- 0.09, N = 3SE +/- 0.08, N = 3SE +/- 0.09, N = 3SE +/- 0.07, N = 3SE +/- 0.04, N = 3SE +/- 0.06, N = 3SE +/- 0.07, N = 3SE +/- 0.05, N = 3SE +/- 0.02, N = 3SE +/- 0.00, N = 3SE +/- 0.05, N = 3SE +/- 0.01, N = 3SE +/- 0.04, N = 3SE +/- 0.02, N = 3SE +/- 0.01, N = 3180.29172.72157.28153.7662.6460.9045.7141.3839.8638.8536.9036.2034.9233.1832.0025.7225.1224.9424.0023.1222.9621.871. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Handwritten English Recognition FP16-INT8 - Device: CPUXeon 6766E 2PXeon 6766EXeon 6780E 2PXeon 6780EXeon Platinum 8380Xeon Platinum 8380 2PEPYC 8534PNEPYC 8534PEPYC 9754 2PEPYC 9754EPYC 9654 2PXeon Platinum 8490HEPYC 9654EPYC 9684X 2PEPYC 9684XXeon Max 9480 2PXeon Platinum 8490H 2PXeon Max 9480Xeon Max 9468 2PXeon Max 9468Xeon Platinum 8592+ 2PXeon Platinum 8592+306090120150Min: 180.03 / Avg: 180.29 / Max: 180.48Min: 172.05 / Avg: 172.72 / Max: 173.13Min: 156.65 / Avg: 157.28 / Max: 157.76Min: 153.63 / Avg: 153.76 / Max: 153.96Min: 61.83 / Avg: 62.64 / Max: 63.43Min: 58.4 / Avg: 60.9 / Max: 64.33Min: 45.68 / Avg: 45.71 / Max: 45.73Min: 41.26 / Avg: 41.38 / Max: 41.57Min: 39.76 / Avg: 39.86 / Max: 40.03Min: 38.71 / Avg: 38.85 / Max: 39.03Min: 36.79 / Avg: 36.9 / Max: 37.02Min: 36.13 / Avg: 36.2 / Max: 36.25Min: 34.84 / Avg: 34.92 / Max: 35.03Min: 33.09 / Avg: 33.18 / Max: 33.32Min: 31.92 / Avg: 32 / Max: 32.09Min: 25.7 / Avg: 25.72 / Max: 25.75Min: 25.11 / Avg: 25.12 / Max: 25.12Min: 24.85 / Avg: 24.94 / Max: 25.03Min: 23.99 / Avg: 24 / Max: 24.01Min: 23.07 / Avg: 23.12 / Max: 23.2Min: 22.93 / Avg: 22.96 / Max: 22.98Min: 21.86 / Avg: 21.87 / Max: 21.881. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

John The Ripper

This is a benchmark of John The Ripper, which is a password cracker. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgReal C/S, More Is BetterJohn The Ripper 2023.03.14Test: WPA PSKXeon 6766EXeon 6780EXeon Platinum 8380Xeon Max 9468Xeon Max 9480EPYC 8534PNXeon 6766E 2PEPYC 8534PXeon Platinum 8490HXeon 6780E 2PXeon Platinum 8592+Xeon Platinum 8380 2PXeon Max 9468 2PEPYC 9654Xeon Max 9480 2PEPYC 9684XXeon Platinum 8490H 2PXeon Platinum 8592+ 2PEPYC 9754EPYC 9654 2PEPYC 9684X 2PEPYC 9754 2P300K600K900K1200K1500KSE +/- 30.00, N = 3SE +/- 66.16, N = 3SE +/- 177.03, N = 3SE +/- 987.33, N = 3SE +/- 1274.00, N = 3SE +/- 79.20, N = 3SE +/- 187.67, N = 3SE +/- 321.00, N = 3SE +/- 1599.31, N = 3SE +/- 394.40, N = 3SE +/- 864.17, N = 3SE +/- 1491.72, N = 3SE +/- 5122.51, N = 3SE +/- 921.74, N = 3SE +/- 788.50, N = 3SE +/- 2683.36, N = 3SE +/- 2519.00, N = 3SE +/- 15579.94, N = 15SE +/- 478.70, N = 3SE +/- 1333.33, N = 3SE +/- 5291.50, N = 3SE +/- 4358.90, N = 31889252098032480662865523340763399983676573862124012784072564281164915835628756434756578896713227932537970938031871253333129400015510001. (CC) gcc options: -m64 -lssl -lcrypto -fopenmp -lgmp -lm -lrt -lz -ldl -lcrypt -lbz2
OpenBenchmarking.orgReal C/S, More Is BetterJohn The Ripper 2023.03.14Test: WPA PSKXeon 6766EXeon 6780EXeon Platinum 8380Xeon Max 9468Xeon Max 9480EPYC 8534PNXeon 6766E 2PEPYC 8534PXeon Platinum 8490HXeon 6780E 2PXeon Platinum 8592+Xeon Platinum 8380 2PXeon Max 9468 2PEPYC 9654Xeon Max 9480 2PEPYC 9684XXeon Platinum 8490H 2PXeon Platinum 8592+ 2PEPYC 9754EPYC 9654 2PEPYC 9684X 2PEPYC 9754 2P300K600K900K1200K1500KMin: 188865 / Avg: 188925 / Max: 188955Min: 209677 / Avg: 209803 / Max: 209901Min: 247813 / Avg: 248066 / Max: 248407Min: 284577 / Avg: 286551.67 / Max: 287539Min: 331528 / Avg: 334076 / Max: 335350Min: 339854 / Avg: 339998.33 / Max: 340127Min: 367288 / Avg: 367656.67 / Max: 367902Min: 385570 / Avg: 386212 / Max: 386533Min: 398080 / Avg: 401277.67 / Max: 402944Min: 406597 / Avg: 407256.33 / Max: 407961Min: 426388 / Avg: 428116.33 / Max: 428987Min: 488626 / Avg: 491583.33 / Max: 493403Min: 553185 / Avg: 562874.67 / Max: 570601Min: 642448 / Avg: 643474.67 / Max: 645314Min: 656370 / Avg: 657888.67 / Max: 659016Min: 667016 / Avg: 671322 / Max: 676249Min: 788217 / Avg: 793253 / Max: 795894Min: 670974 / Avg: 797093.27 / Max: 846770Min: 802281 / Avg: 803187 / Max: 803908Min: 1252000 / Avg: 1253333.33 / Max: 1256000Min: 1286000 / Avg: 1294000 / Max: 1304000Min: 1543000 / Avg: 1551000 / Max: 15580001. (CC) gcc options: -m64 -lssl -lcrypto -fopenmp -lgmp -lm -lrt -lz -ldl -lcrypt -lbz2

OpenVINO

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Machine Translation EN To DE FP16 - Device: CPUXeon 6766EXeon 6780EXeon Platinum 8380Xeon 6766E 2PXeon 6780E 2PXeon Platinum 8380 2PEPYC 8534PNEPYC 8534PXeon Max 9468Xeon Max 9480Xeon Platinum 8490HEPYC 9654EPYC 9684XXeon Platinum 8592+EPYC 9754Xeon Platinum 8490H 2PXeon Max 9468 2PXeon Max 9480 2PEPYC 9654 2PEPYC 9684X 2PEPYC 9754 2PXeon Platinum 8592+ 2P2004006008001000SE +/- 0.25, N = 3SE +/- 0.03, N = 3SE +/- 0.45, N = 3SE +/- 2.30, N = 15SE +/- 3.00, N = 3SE +/- 0.17, N = 3SE +/- 0.13, N = 3SE +/- 0.39, N = 3SE +/- 1.21, N = 3SE +/- 4.09, N = 3SE +/- 0.17, N = 3SE +/- 4.59, N = 7SE +/- 4.29, N = 11SE +/- 0.54, N = 3SE +/- 6.34, N = 5SE +/- 3.48, N = 3SE +/- 1.99, N = 3SE +/- 1.13, N = 3SE +/- 8.96, N = 3SE +/- 0.37, N = 3SE +/- 11.78, N = 3SE +/- 0.85, N = 3138.53149.63156.13243.76264.66281.36293.07317.38415.96467.08477.77525.88576.98592.20621.42793.64795.63889.18990.161110.491127.051128.781. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Machine Translation EN To DE FP16 - Device: CPUXeon 6766EXeon 6780EXeon Platinum 8380Xeon 6766E 2PXeon 6780E 2PXeon Platinum 8380 2PEPYC 8534PNEPYC 8534PXeon Max 9468Xeon Max 9480Xeon Platinum 8490HEPYC 9654EPYC 9684XXeon Platinum 8592+EPYC 9754Xeon Platinum 8490H 2PXeon Max 9468 2PXeon Max 9480 2PEPYC 9654 2PEPYC 9684X 2PEPYC 9754 2PXeon Platinum 8592+ 2P2004006008001000Min: 138.13 / Avg: 138.53 / Max: 138.99Min: 149.57 / Avg: 149.63 / Max: 149.68Min: 155.61 / Avg: 156.13 / Max: 157.03Min: 229.37 / Avg: 243.76 / Max: 253.78Min: 259.24 / Avg: 264.66 / Max: 269.58Min: 281.04 / Avg: 281.36 / Max: 281.61Min: 292.87 / Avg: 293.07 / Max: 293.31Min: 316.82 / Avg: 317.38 / Max: 318.14Min: 413.7 / Avg: 415.96 / Max: 417.83Min: 460.09 / Avg: 467.08 / Max: 474.24Min: 477.45 / Avg: 477.77 / Max: 478.03Min: 517.77 / Avg: 525.88 / Max: 552.88Min: 564.85 / Avg: 576.98 / Max: 607.66Min: 591.13 / Avg: 592.2 / Max: 592.87Min: 601.54 / Avg: 621.42 / Max: 640.68Min: 789.51 / Avg: 793.64 / Max: 800.56Min: 791.97 / Avg: 795.63 / Max: 798.81Min: 886.92 / Avg: 889.18 / Max: 890.47Min: 978.52 / Avg: 990.16 / Max: 1007.78Min: 1109.98 / Avg: 1110.49 / Max: 1111.2Min: 1111.4 / Avg: 1127.05 / Max: 1150.12Min: 1127.09 / Avg: 1128.78 / Max: 1129.731. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

miniBUDE

MiniBUDE is a mini application for the the core computation of the Bristol University Docking Engine (BUDE). This test profile currently makes use of the OpenMP implementation of miniBUDE for CPU benchmarking. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgBillion Interactions/s, More Is BetterminiBUDE 20210901Implementation: OpenMP - Input Deck: BM2Xeon 6766EXeon 6780EXeon Platinum 8380Xeon Max 9468Xeon Max 9480Xeon 6766E 2PXeon 6780E 2PXeon Platinum 8490HXeon Platinum 8380 2PEPYC 8534PNEPYC 8534PXeon Platinum 8592+Xeon Max 9468 2PXeon Max 9480 2PXeon Platinum 8490H 2PEPYC 9654EPYC 9684XXeon Platinum 8592+ 2PEPYC 9754EPYC 9754 2PEPYC 9654 2PEPYC 9684X 2P70140210280350SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.11, N = 3SE +/- 0.31, N = 3SE +/- 0.96, N = 4SE +/- 0.03, N = 3SE +/- 0.08, N = 3SE +/- 0.31, N = 3SE +/- 0.75, N = 3SE +/- 0.00, N = 3SE +/- 0.01, N = 3SE +/- 0.03, N = 3SE +/- 1.48, N = 3SE +/- 0.93, N = 3SE +/- 0.99, N = 3SE +/- 0.93, N = 3SE +/- 1.71, N = 3SE +/- 1.93, N = 15SE +/- 0.01, N = 3SE +/- 3.85, N = 3SE +/- 0.08, N = 3SE +/- 2.28, N = 339.3543.7349.2070.2178.1178.2486.8886.9797.0897.98107.72108.12127.85133.99140.83171.77187.68191.82232.75288.54291.28309.221. (CC) gcc options: -std=c99 -Ofast -ffast-math -fopenmp -march=native -lm
OpenBenchmarking.orgBillion Interactions/s, More Is BetterminiBUDE 20210901Implementation: OpenMP - Input Deck: BM2Xeon 6766EXeon 6780EXeon Platinum 8380Xeon Max 9468Xeon Max 9480Xeon 6766E 2PXeon 6780E 2PXeon Platinum 8490HXeon Platinum 8380 2PEPYC 8534PNEPYC 8534PXeon Platinum 8592+Xeon Max 9468 2PXeon Max 9480 2PXeon Platinum 8490H 2PEPYC 9654EPYC 9684XXeon Platinum 8592+ 2PEPYC 9754EPYC 9754 2PEPYC 9654 2PEPYC 9684X 2P60120180240300Min: 39.35 / Avg: 39.35 / Max: 39.35Min: 43.72 / Avg: 43.73 / Max: 43.73Min: 49.01 / Avg: 49.2 / Max: 49.38Min: 69.59 / Avg: 70.21 / Max: 70.54Min: 75.51 / Avg: 78.1 / Max: 79.59Min: 78.17 / Avg: 78.24 / Max: 78.28Min: 86.73 / Avg: 86.88 / Max: 86.98Min: 86.39 / Avg: 86.97 / Max: 87.46Min: 96.12 / Avg: 97.08 / Max: 98.55Min: 97.97 / Avg: 97.98 / Max: 97.98Min: 107.71 / Avg: 107.71 / Max: 107.73Min: 108.09 / Avg: 108.12 / Max: 108.18Min: 125.14 / Avg: 127.85 / Max: 130.24Min: 132.16 / Avg: 133.99 / Max: 135.14Min: 139.5 / Avg: 140.83 / Max: 142.75Min: 170.75 / Avg: 171.77 / Max: 173.62Min: 184.3 / Avg: 187.68 / Max: 189.87Min: 180.36 / Avg: 191.82 / Max: 206.68Min: 232.73 / Avg: 232.75 / Max: 232.76Min: 280.86 / Avg: 288.54 / Max: 292.83Min: 291.15 / Avg: 291.28 / Max: 291.43Min: 305.66 / Avg: 309.22 / Max: 313.481. (CC) gcc options: -std=c99 -Ofast -ffast-math -fopenmp -march=native -lm

OpenBenchmarking.orgGFInst/s, More Is BetterminiBUDE 20210901Implementation: OpenMP - Input Deck: BM2Xeon 6766EXeon 6780EXeon Platinum 8380Xeon Max 9468Xeon Max 9480Xeon 6766E 2PXeon 6780E 2PXeon Platinum 8490HXeon Platinum 8380 2PEPYC 8534PNEPYC 8534PXeon Platinum 8592+Xeon Max 9468 2PXeon Max 9480 2PXeon Platinum 8490H 2PEPYC 9654EPYC 9684XXeon Platinum 8592+ 2PEPYC 9754EPYC 9754 2PEPYC 9654 2PEPYC 9684X 2P17003400510068008500SE +/- 0.03, N = 3SE +/- 0.09, N = 3SE +/- 2.69, N = 3SE +/- 7.81, N = 3SE +/- 23.93, N = 4SE +/- 0.82, N = 3SE +/- 1.96, N = 3SE +/- 7.77, N = 3SE +/- 18.66, N = 3SE +/- 0.10, N = 3SE +/- 0.13, N = 3SE +/- 0.70, N = 3SE +/- 36.96, N = 3SE +/- 23.14, N = 3SE +/- 24.63, N = 3SE +/- 23.15, N = 3SE +/- 42.85, N = 3SE +/- 48.20, N = 15SE +/- 0.20, N = 3SE +/- 96.25, N = 3SE +/- 2.03, N = 3SE +/- 57.10, N = 3983.711093.211230.081755.331952.611955.882172.102174.192426.882449.452692.872703.093196.123349.763520.714294.284692.114795.465818.747213.437281.967730.471. (CC) gcc options: -std=c99 -Ofast -ffast-math -fopenmp -march=native -lm
OpenBenchmarking.orgGFInst/s, More Is BetterminiBUDE 20210901Implementation: OpenMP - Input Deck: BM2Xeon 6766EXeon 6780EXeon Platinum 8380Xeon Max 9468Xeon Max 9480Xeon 6766E 2PXeon 6780E 2PXeon Platinum 8490HXeon Platinum 8380 2PEPYC 8534PNEPYC 8534PXeon Platinum 8592+Xeon Max 9468 2PXeon Max 9480 2PXeon Platinum 8490H 2PEPYC 9654EPYC 9684XXeon Platinum 8592+ 2PEPYC 9754EPYC 9754 2PEPYC 9654 2PEPYC 9684X 2P13002600390052006500Min: 983.64 / Avg: 983.71 / Max: 983.75Min: 1093.03 / Avg: 1093.21 / Max: 1093.35Min: 1225.28 / Avg: 1230.08 / Max: 1234.6Min: 1739.72 / Avg: 1755.33 / Max: 1763.46Min: 1887.63 / Avg: 1952.61 / Max: 1989.74Min: 1954.27 / Avg: 1955.88 / Max: 1956.91Min: 2168.21 / Avg: 2172.1 / Max: 2174.47Min: 2159.76 / Avg: 2174.19 / Max: 2186.39Min: 2403.03 / Avg: 2426.88 / Max: 2463.66Min: 2449.27 / Avg: 2449.45 / Max: 2449.58Min: 2692.71 / Avg: 2692.87 / Max: 2693.13Min: 2702.35 / Avg: 2703.09 / Max: 2704.49Min: 3128.55 / Avg: 3196.12 / Max: 3255.87Min: 3304 / Avg: 3349.76 / Max: 3378.59Min: 3487.53 / Avg: 3520.71 / Max: 3568.84Min: 4268.61 / Avg: 4294.28 / Max: 4340.49Min: 4607.59 / Avg: 4692.11 / Max: 4746.62Min: 4508.91 / Avg: 4795.46 / Max: 5166.93Min: 5818.36 / Avg: 5818.74 / Max: 5819Min: 7021.37 / Avg: 7213.43 / Max: 7320.64Min: 7278.77 / Avg: 7281.96 / Max: 7285.73Min: 7641.6 / Avg: 7730.47 / Max: 78371. (CC) gcc options: -std=c99 -Ofast -ffast-math -fopenmp -march=native -lm

ASTC Encoder

OpenBenchmarking.orgMT/s, More Is BetterASTC Encoder 4.7Preset: ThoroughXeon Platinum 8380Xeon Platinum 8380 2PXeon Max 9468EPYC 8534PNXeon 6766EEPYC 8534PXeon Max 9480Xeon 6780EXeon Platinum 8490HXeon Platinum 8592+EPYC 9654Xeon 6766E 2PXeon Max 9468 2PEPYC 9684XXeon 6780E 2PXeon Max 9480 2PEPYC 9754Xeon Platinum 8490H 2PXeon Platinum 8592+ 2PEPYC 9654 2PEPYC 9684X 2PEPYC 9754 2P306090120150SE +/- 0.03, N = 3SE +/- 0.04, N = 3SE +/- 0.01, N = 3SE +/- 0.02, N = 3SE +/- 0.00, N = 3SE +/- 0.02, N = 4SE +/- 0.03, N = 4SE +/- 0.01, N = 3SE +/- 0.01, N = 4SE +/- 0.05, N = 4SE +/- 0.01, N = 4SE +/- 0.42, N = 4SE +/- 0.05, N = 4SE +/- 0.06, N = 5SE +/- 0.85, N = 4SE +/- 0.03, N = 5SE +/- 0.01, N = 5SE +/- 0.19, N = 5SE +/- 0.55, N = 5SE +/- 0.73, N = 15SE +/- 1.46, N = 12SE +/- 1.20, N = 515.5030.0337.0137.9640.6941.0242.9845.2151.3054.4565.3071.0272.3373.3879.2983.3486.0186.9897.94105.41116.12121.301. (CXX) g++ options: -O3 -flto -pthread
OpenBenchmarking.orgMT/s, More Is BetterASTC Encoder 4.7Preset: ThoroughXeon Platinum 8380Xeon Platinum 8380 2PXeon Max 9468EPYC 8534PNXeon 6766EEPYC 8534PXeon Max 9480Xeon 6780EXeon Platinum 8490HXeon Platinum 8592+EPYC 9654Xeon 6766E 2PXeon Max 9468 2PEPYC 9684XXeon 6780E 2PXeon Max 9480 2PEPYC 9754Xeon Platinum 8490H 2PXeon Platinum 8592+ 2PEPYC 9654 2PEPYC 9684X 2PEPYC 9754 2P20406080100Min: 15.44 / Avg: 15.5 / Max: 15.55Min: 29.97 / Avg: 30.03 / Max: 30.1Min: 36.99 / Avg: 37.01 / Max: 37.02Min: 37.92 / Avg: 37.96 / Max: 37.99Min: 40.69 / Avg: 40.69 / Max: 40.7Min: 40.97 / Avg: 41.02 / Max: 41.06Min: 42.9 / Avg: 42.98 / Max: 43.03Min: 45.19 / Avg: 45.21 / Max: 45.23Min: 51.28 / Avg: 51.3 / Max: 51.34Min: 54.31 / Avg: 54.45 / Max: 54.51Min: 65.27 / Avg: 65.3 / Max: 65.32Min: 70.06 / Avg: 71.02 / Max: 72.1Min: 72.18 / Avg: 72.33 / Max: 72.42Min: 73.21 / Avg: 73.38 / Max: 73.53Min: 76.91 / Avg: 79.29 / Max: 80.74Min: 83.28 / Avg: 83.34 / Max: 83.41Min: 85.97 / Avg: 86.01 / Max: 86.04Min: 86.65 / Avg: 86.98 / Max: 87.71Min: 96.94 / Avg: 97.94 / Max: 100Min: 100.32 / Avg: 105.41 / Max: 110.01Min: 107.46 / Avg: 116.12 / Max: 124.21Min: 118.96 / Avg: 121.3 / Max: 125.711. (CXX) g++ options: -O3 -flto -pthread

RELION

RELION - REgularised LIkelihood OptimisatioN - is a stand-alone computer program for Maximum A Posteriori refinement of (multiple) 3D reconstructions or 2D class averages in cryo-electron microscopy (cryo-EM). It is developed in the research group of Sjors Scheres at the MRC Laboratory of Molecular Biology. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterRELION 4.0.1Test: Basic - Device: CPUXeon Platinum 8380EPYC 8534PNEPYC 8534PXeon Max 9468Xeon Max 9480Xeon Platinum 8490HXeon Platinum 8380 2PEPYC 9754Xeon Platinum 8592+EPYC 9654Xeon Max 9468 2PXeon Platinum 8490H 2PXeon Max 9480 2PEPYC 9754 2PEPYC 9684XXeon Platinum 8592+ 2PEPYC 9654 2PEPYC 9684X 2P150300450600750SE +/- 7.86, N = 9SE +/- 6.20, N = 3SE +/- 4.63, N = 3SE +/- 2.98, N = 3SE +/- 4.65, N = 9SE +/- 7.14, N = 9SE +/- 0.35, N = 3SE +/- 7.69, N = 9SE +/- 2.68, N = 7SE +/- 2.95, N = 3SE +/- 3.24, N = 12SE +/- 2.65, N = 3SE +/- 2.66, N = 12SE +/- 4.04, N = 12SE +/- 2.17, N = 3SE +/- 1.41, N = 3SE +/- 2.11, N = 12SE +/- 1.27, N = 15705.58496.24468.69412.37384.38373.18368.22360.21290.45238.88214.42203.41201.38201.27176.42155.74145.6593.171. (CXX) g++ options: -fopenmp -std=c++11 -O3 -rdynamic -ldl -ltiff -lfftw3f -lfftw3 -lpng -ljpeg -lmpi_cxx -lmpi
OpenBenchmarking.orgSeconds, Fewer Is BetterRELION 4.0.1Test: Basic - Device: CPUXeon Platinum 8380EPYC 8534PNEPYC 8534PXeon Max 9468Xeon Max 9480Xeon Platinum 8490HXeon Platinum 8380 2PEPYC 9754Xeon Platinum 8592+EPYC 9654Xeon Max 9468 2PXeon Platinum 8490H 2PXeon Max 9480 2PEPYC 9754 2PEPYC 9684XXeon Platinum 8592+ 2PEPYC 9654 2PEPYC 9684X 2P120240360480600Min: 661.77 / Avg: 705.58 / Max: 731.56Min: 489.16 / Avg: 496.24 / Max: 508.6Min: 463.06 / Avg: 468.69 / Max: 477.88Min: 406.42 / Avg: 412.37 / Max: 415.48Min: 361.02 / Avg: 384.38 / Max: 399.13Min: 321.77 / Avg: 373.18 / Max: 391.54Min: 367.66 / Avg: 368.22 / Max: 368.86Min: 327.68 / Avg: 360.21 / Max: 384.89Min: 281.55 / Avg: 290.45 / Max: 301.47Min: 234.22 / Avg: 238.88 / Max: 244.33Min: 190.69 / Avg: 214.42 / Max: 226.92Min: 200.25 / Avg: 203.41 / Max: 208.67Min: 177.35 / Avg: 201.38 / Max: 211.97Min: 176.29 / Avg: 201.26 / Max: 216.52Min: 173.24 / Avg: 176.42 / Max: 180.58Min: 153.09 / Avg: 155.74 / Max: 157.87Min: 127.74 / Avg: 145.65 / Max: 155.47Min: 81.41 / Avg: 93.17 / Max: 98.241. (CXX) g++ options: -fopenmp -std=c++11 -O3 -rdynamic -ldl -ltiff -lfftw3f -lfftw3 -lpng -ljpeg -lmpi_cxx -lmpi

OpenSSL

OpenBenchmarking.orgbyte/s, More Is BetterOpenSSL 3.3Algorithm: ChaCha20-Poly1305Xeon 6766EXeon 6780EXeon Platinum 8380Xeon Max 9468Xeon Max 9480EPYC 8534PNEPYC 8534PXeon Platinum 8592+Xeon Platinum 8490HXeon 6766E 2PXeon 6780E 2PXeon Platinum 8380 2PXeon Max 9468 2PEPYC 9654Xeon Max 9480 2PEPYC 9684XXeon Platinum 8490H 2PXeon Platinum 8592+ 2PEPYC 9754EPYC 9654 2PEPYC 9684X 2PEPYC 9754 2P200000M400000M600000M800000M1000000MSE +/- 2360978.39, N = 3SE +/- 18243420.30, N = 3SE +/- 255765711.98, N = 3SE +/- 6370607.14, N = 3SE +/- 37795783.50, N = 3SE +/- 65233629.47, N = 3SE +/- 24234601.89, N = 3SE +/- 120899798.30, N = 3SE +/- 766713911.50, N = 3SE +/- 37182497.08, N = 3SE +/- 38565703.74, N = 3SE +/- 31274617.76, N = 3SE +/- 4148679.28, N = 3SE +/- 29295317.86, N = 3SE +/- 36941390.18, N = 3SE +/- 4478378.70, N = 3SE +/- 132227134.30, N = 3SE +/- 82161991.11, N = 3SE +/- 151303743.70, N = 3SE +/- 6119305.11, N = 3SE +/- 558033954.71, N = 3SE +/- 19082587.00, N = 31205917872571340330390901461562129501613210582131877961744401933050936432111856617272236257380132250388507302400051351532665838578872935021224133203967204473509609983573727352152973839256520774422025329774440991442704570397488706989258222237676527195479060286089901. (CC) gcc options: -pthread -m64 -O3 -lssl -lcrypto -ldl
OpenBenchmarking.orgbyte/s, More Is BetterOpenSSL 3.3Algorithm: ChaCha20-Poly1305Xeon 6766EXeon 6780EXeon Platinum 8380Xeon Max 9468Xeon Max 9480EPYC 8534PNEPYC 8534PXeon Platinum 8592+Xeon Platinum 8490HXeon 6766E 2PXeon 6780E 2PXeon Platinum 8380 2PXeon Max 9468 2PEPYC 9654Xeon Max 9480 2PEPYC 9684XXeon Platinum 8490H 2PXeon Platinum 8592+ 2PEPYC 9754EPYC 9654 2PEPYC 9684X 2PEPYC 9754 2P160000M320000M480000M640000M800000MMin: 120587296490 / Avg: 120591787256.67 / Max: 120595296530Min: 134013203800 / Avg: 134033039090 / Max: 134069478200Min: 145686944150 / Avg: 146156212950 / Max: 146567166360Min: 161308707500 / Avg: 161321058213.33 / Max: 161329944440Min: 187728433970 / Avg: 187796174440 / Max: 187859096100Min: 193174668900 / Avg: 193305093643.33 / Max: 193373190280Min: 211147541710 / Avg: 211185661726.67 / Max: 211230646550Min: 223384491620 / Avg: 223625738013.33 / Max: 223760518080Min: 223505534430 / Avg: 225038850730 / Max: 225821524790Min: 239942419660 / Avg: 240005135153.33 / Max: 240071100550Min: 266506974280 / Avg: 266583857886.67 / Max: 266627649810Min: 293439883670 / Avg: 293502122413.33 / Max: 293538632450Min: 320390195610 / Avg: 320396720446.67 / Max: 320404421840Min: 350907523350 / Avg: 350960998356.67 / Max: 351008471450Min: 372685934870 / Avg: 372735215296.67 / Max: 372807527080Min: 383920347550 / Avg: 383925652076.67 / Max: 383934554470Min: 441973884520 / Avg: 442202532976.67 / Max: 442431930910Min: 443969338300 / Avg: 444099144270 / Max: 444251308850Min: 456863553950 / Avg: 457039748870 / Max: 457340907310Min: 698914381820 / Avg: 698925822223.33 / Max: 698935307470Min: 766609263000 / Avg: 767652719546.67 / Max: 768517382960Min: 905991562580 / Avg: 906028608990 / Max: 9060550762501. (CC) gcc options: -pthread -m64 -O3 -lssl -lcrypto -ldl

Blender

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 4.1Blend File: Classroom - Compute: CPU-OnlyXeon Platinum 8380Xeon Max 9468Xeon Max 9480EPYC 8534PNXeon Platinum 8490HEPYC 8534PXeon Platinum 8592+Xeon Platinum 8380 2PXeon 6766EXeon 6780EXeon Max 9468 2PXeon Max 9480 2PEPYC 9654Xeon Platinum 8490H 2PEPYC 9684XXeon Platinum 8592+ 2PEPYC 9754Xeon 6766E 2PXeon 6780E 2PEPYC 9654 2PEPYC 9684X 2PEPYC 9754 2P306090120150SE +/- 0.38, N = 3SE +/- 0.20, N = 3SE +/- 0.40, N = 3SE +/- 0.18, N = 3SE +/- 0.04, N = 3SE +/- 0.04, N = 3SE +/- 0.11, N = 3SE +/- 0.16, N = 3SE +/- 0.05, N = 3SE +/- 0.67, N = 3SE +/- 0.38, N = 3SE +/- 0.25, N = 3SE +/- 0.11, N = 3SE +/- 0.05, N = 3SE +/- 0.14, N = 3SE +/- 0.22, N = 3SE +/- 0.04, N = 3SE +/- 0.09, N = 3SE +/- 0.05, N = 3SE +/- 0.05, N = 3SE +/- 0.03, N = 3SE +/- 0.05, N = 3124.6386.6776.8775.2668.6167.6763.6162.5452.4748.0744.7140.3840.2635.9135.6633.6131.6527.4124.6121.1218.6716.82
OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 4.1Blend File: Classroom - Compute: CPU-OnlyXeon Platinum 8380Xeon Max 9468Xeon Max 9480EPYC 8534PNXeon Platinum 8490HEPYC 8534PXeon Platinum 8592+Xeon Platinum 8380 2PXeon 6766EXeon 6780EXeon Max 9468 2PXeon Max 9480 2PEPYC 9654Xeon Platinum 8490H 2PEPYC 9684XXeon Platinum 8592+ 2PEPYC 9754Xeon 6766E 2PXeon 6780E 2PEPYC 9654 2PEPYC 9684X 2PEPYC 9754 2P20406080100Min: 124.12 / Avg: 124.63 / Max: 125.37Min: 86.32 / Avg: 86.67 / Max: 87Min: 76.14 / Avg: 76.87 / Max: 77.5Min: 74.94 / Avg: 75.26 / Max: 75.55Min: 68.53 / Avg: 68.61 / Max: 68.66Min: 67.6 / Avg: 67.67 / Max: 67.72Min: 63.41 / Avg: 63.61 / Max: 63.77Min: 62.24 / Avg: 62.54 / Max: 62.77Min: 52.38 / Avg: 52.47 / Max: 52.52Min: 47.25 / Avg: 48.07 / Max: 49.39Min: 44.3 / Avg: 44.71 / Max: 45.47Min: 39.89 / Avg: 40.38 / Max: 40.74Min: 40.06 / Avg: 40.26 / Max: 40.43Min: 35.81 / Avg: 35.91 / Max: 35.98Min: 35.49 / Avg: 35.66 / Max: 35.94Min: 33.38 / Avg: 33.61 / Max: 34.04Min: 31.58 / Avg: 31.65 / Max: 31.71Min: 27.24 / Avg: 27.41 / Max: 27.52Min: 24.56 / Avg: 24.61 / Max: 24.72Min: 21.05 / Avg: 21.12 / Max: 21.22Min: 18.61 / Avg: 18.67 / Max: 18.72Min: 16.76 / Avg: 16.82 / Max: 16.91

OpenVINO

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Person Detection FP16 - Device: CPUXeon 6766E 2PXeon 6766EXeon 6780E 2PXeon 6780EXeon Platinum 8380EPYC 9754EPYC 8534PEPYC 9654EPYC 8534PNXeon Platinum 8380 2PEPYC 9684XXeon Platinum 8490HEPYC 9754 2PXeon Max 9480 2PEPYC 9654 2PXeon Max 9480Xeon Platinum 8490H 2PEPYC 9684X 2PXeon Platinum 8592+ 2PXeon Max 9468 2PXeon Max 9468Xeon Platinum 8592+60120180240300SE +/- 0.07, N = 3SE +/- 0.25, N = 3SE +/- 0.34, N = 3SE +/- 0.15, N = 3SE +/- 0.92, N = 3SE +/- 6.97, N = 15SE +/- 0.19, N = 3SE +/- 2.90, N = 15SE +/- 0.41, N = 3SE +/- 0.14, N = 3SE +/- 1.22, N = 15SE +/- 0.01, N = 3SE +/- 1.90, N = 15SE +/- 0.06, N = 3SE +/- 0.44, N = 15SE +/- 0.10, N = 3SE +/- 0.05, N = 3SE +/- 0.09, N = 3SE +/- 0.09, N = 3SE +/- 0.10, N = 3SE +/- 0.18, N = 3SE +/- 0.09, N = 3293.02283.83274.52266.91236.81230.24161.48157.45156.59113.70110.91100.3985.8664.9163.9859.6945.7843.7743.4142.1641.9339.621. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Person Detection FP16 - Device: CPUXeon 6766E 2PXeon 6766EXeon 6780E 2PXeon 6780EXeon Platinum 8380EPYC 9754EPYC 8534PEPYC 9654EPYC 8534PNXeon Platinum 8380 2PEPYC 9684XXeon Platinum 8490HEPYC 9754 2PXeon Max 9480 2PEPYC 9654 2PXeon Max 9480Xeon Platinum 8490H 2PEPYC 9684X 2PXeon Platinum 8592+ 2PXeon Max 9468 2PXeon Max 9468Xeon Platinum 8592+50100150200250Min: 292.92 / Avg: 293.02 / Max: 293.16Min: 283.39 / Avg: 283.83 / Max: 284.24Min: 273.98 / Avg: 274.52 / Max: 275.15Min: 266.61 / Avg: 266.91 / Max: 267.1Min: 235.1 / Avg: 236.81 / Max: 238.24Min: 136.44 / Avg: 230.24 / Max: 253.06Min: 161.11 / Avg: 161.48 / Max: 161.74Min: 118.89 / Avg: 157.45 / Max: 163.99Min: 156.09 / Avg: 156.59 / Max: 157.4Min: 113.47 / Avg: 113.7 / Max: 113.95Min: 98.01 / Avg: 110.91 / Max: 113.45Min: 100.37 / Avg: 100.39 / Max: 100.4Min: 63.36 / Avg: 85.86 / Max: 89.82Min: 64.82 / Avg: 64.91 / Max: 65.03Min: 58.73 / Avg: 63.98 / Max: 65.33Min: 59.52 / Avg: 59.69 / Max: 59.87Min: 45.68 / Avg: 45.78 / Max: 45.84Min: 43.6 / Avg: 43.77 / Max: 43.87Min: 43.24 / Avg: 43.41 / Max: 43.52Min: 42.01 / Avg: 42.16 / Max: 42.34Min: 41.75 / Avg: 41.93 / Max: 42.29Min: 39.45 / Avg: 39.62 / Max: 39.731. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenSSL

OpenBenchmarking.orgbyte/s, More Is BetterOpenSSL 3.3Algorithm: ChaCha20Xeon 6766EXeon 6780EXeon Platinum 8380Xeon Max 9468Xeon Max 9480EPYC 8534PNEPYC 8534PXeon Platinum 8490HXeon Platinum 8592+Xeon 6766E 2PXeon 6780E 2PXeon Platinum 8380 2PXeon Max 9468 2PEPYC 9654Xeon Max 9480 2PEPYC 9684XXeon Platinum 8490H 2PEPYC 9754Xeon Platinum 8592+ 2PEPYC 9654 2PEPYC 9684X 2PEPYC 9754 2P300000M600000M900000M1200000M1500000MSE +/- 11028602.79, N = 3SE +/- 39095934.62, N = 3SE +/- 151152302.42, N = 3SE +/- 415487944.57, N = 3SE +/- 312824840.64, N = 3SE +/- 71110585.03, N = 3SE +/- 9570566.28, N = 3SE +/- 232288636.76, N = 3SE +/- 3335467.26, N = 3SE +/- 11835135.62, N = 3SE +/- 63366974.35, N = 3SE +/- 352722951.98, N = 3SE +/- 329510485.23, N = 3SE +/- 151272595.84, N = 3SE +/- 863978337.15, N = 3SE +/- 94935214.36, N = 3SE +/- 271318554.29, N = 3SE +/- 170968063.89, N = 3SE +/- 303075210.03, N = 3SE +/- 80233613.02, N = 3SE +/- 874940734.18, N = 3SE +/- 63368290.15, N = 31772490621831969206832702122948838302265973541532637406900672820533270773070689383773161264211733441509169373528268216533919112254804254511900634499084949275033110211235229124033475449040847736244029729476563963293876842843827601001502634860108661819195013069285075731. (CC) gcc options: -pthread -m64 -O3 -lssl -lcrypto -ldl
OpenBenchmarking.orgbyte/s, More Is BetterOpenSSL 3.3Algorithm: ChaCha20Xeon 6766EXeon 6780EXeon Platinum 8380Xeon Max 9468Xeon Max 9480EPYC 8534PNEPYC 8534PXeon Platinum 8490HXeon Platinum 8592+Xeon 6766E 2PXeon 6780E 2PXeon Platinum 8380 2PXeon Max 9468 2PEPYC 9654Xeon Max 9480 2PEPYC 9684XXeon Platinum 8490H 2PEPYC 9754Xeon Platinum 8592+ 2PEPYC 9654 2PEPYC 9684X 2PEPYC 9754 2P200000M400000M600000M800000M1000000MMin: 177233284030 / Avg: 177249062183.33 / Max: 177270299580Min: 196842563990 / Avg: 196920683270 / Max: 196962660080Min: 211993373630 / Avg: 212294883830 / Max: 212464606140Min: 225829051050 / Avg: 226597354153.33 / Max: 227255683480Min: 263115681790 / Avg: 263740690066.67 / Max: 264077722420Min: 281950999890 / Avg: 282053327076.67 / Max: 282190030170Min: 307050204910 / Avg: 307068938376.67 / Max: 307081708070Min: 315723909260 / Avg: 316126421173.33 / Max: 316528580470Min: 344145814050 / Avg: 344150916936.67 / Max: 344157189460Min: 352811176210 / Avg: 352826821653.33 / Max: 352850027040Min: 391830688390 / Avg: 391911225480 / Max: 392036237480Min: 424793228250 / Avg: 425451190063.33 / Max: 426000523260Min: 449342850940 / Avg: 449908494926.67 / Max: 450484176340Min: 503012756140 / Avg: 503311021123.33 / Max: 503504070520Min: 521204638730 / Avg: 522912403346.67 / Max: 523994388070Min: 544715543890 / Avg: 544904084773.33 / Max: 545017780360Min: 623925663880 / Avg: 624402972946.67 / Max: 624865174600Min: 656158189620 / Avg: 656396329386.67 / Max: 656727901800Min: 683775698530 / Avg: 684284382760 / Max: 684824196440Min: 1001353429810 / Avg: 1001502634860 / Max: 1001628381180Min: 1084888202990 / Avg: 1086618191950 / Max: 1087711040580Min: 1306801844220 / Avg: 1306928507573.3 / Max: 13069955697701. (CC) gcc options: -pthread -m64 -O3 -lssl -lcrypto -ldl

John The Ripper

This is a benchmark of John The Ripper, which is a password cracker. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgReal C/S, More Is BetterJohn The Ripper 2023.03.14Test: BlowfishXeon Platinum 8380Xeon Max 9468Xeon Max 9480EPYC 8534PNXeon Platinum 8490HEPYC 8534PXeon Platinum 8592+Xeon Platinum 8380 2PXeon Max 9468 2PXeon Max 9480 2PEPYC 9654Xeon Platinum 8490H 2PXeon 6766EEPYC 9684XXeon Platinum 8592+ 2PXeon 6780EEPYC 9754EPYC 9654 2PXeon 6766E 2PEPYC 9684X 2PXeon 6780E 2PEPYC 9754 2P90K180K270K360K450KSE +/- 6.33, N = 3SE +/- 17.33, N = 3SE +/- 8.67, N = 3SE +/- 20.54, N = 3SE +/- 11.39, N = 3SE +/- 13.72, N = 3SE +/- 79.75, N = 3SE +/- 14.62, N = 3SE +/- 116.69, N = 3SE +/- 169.28, N = 3SE +/- 38.33, N = 3SE +/- 348.45, N = 3SE +/- 174.44, N = 3SE +/- 98.33, N = 3SE +/- 649.08, N = 3SE +/- 14.67, N = 3SE +/- 1.33, N = 3SE +/- 3455.48, N = 3SE +/- 353.58, N = 3SE +/- 454.86, N = 3SE +/- 482.17, N = 3SE +/- 2397.15, N = 356939678937915293473945131021981058311132231345621566581665411835831902091925742054992114492201883164923633003745894047394154121. (CC) gcc options: -m64 -lssl -lcrypto -fopenmp -lgmp -lm -lrt -lz -ldl -lcrypt -lbz2
OpenBenchmarking.orgReal C/S, More Is BetterJohn The Ripper 2023.03.14Test: BlowfishXeon Platinum 8380Xeon Max 9468Xeon Max 9480EPYC 8534PNXeon Platinum 8490HEPYC 8534PXeon Platinum 8592+Xeon Platinum 8380 2PXeon Max 9468 2PXeon Max 9480 2PEPYC 9654Xeon Platinum 8490H 2PXeon 6766EEPYC 9684XXeon Platinum 8592+ 2PXeon 6780EEPYC 9754EPYC 9654 2PXeon 6766E 2PEPYC 9684X 2PXeon 6780E 2PEPYC 9754 2P70K140K210K280K350KMin: 56933 / Avg: 56939.33 / Max: 56952Min: 67858 / Avg: 67892.67 / Max: 67910Min: 79135 / Avg: 79152.33 / Max: 79161Min: 93434 / Avg: 93472.67 / Max: 93504Min: 94500 / Avg: 94513.33 / Max: 94536Min: 102182 / Avg: 102197.67 / Max: 102225Min: 105715 / Avg: 105831.33 / Max: 105984Min: 113194 / Avg: 113222.67 / Max: 113242Min: 134336 / Avg: 134561.67 / Max: 134726Min: 156456 / Avg: 156657.67 / Max: 156994Min: 166464 / Avg: 166540.67 / Max: 166579Min: 183096 / Avg: 183582.67 / Max: 184258Min: 189864 / Avg: 190209.33 / Max: 190425Min: 192377 / Avg: 192573.67 / Max: 192672Min: 204296 / Avg: 205499 / Max: 206523Min: 211420 / Avg: 211449.33 / Max: 211464Min: 220185 / Avg: 220187.67 / Max: 220189Min: 309657 / Avg: 316492.33 / Max: 320793Min: 362880 / Avg: 363300.33 / Max: 364003Min: 373968 / Avg: 374588.67 / Max: 375475Min: 404006 / Avg: 404738.67 / Max: 405648Min: 411715 / Avg: 415412 / Max: 4199041. (CC) gcc options: -m64 -lssl -lcrypto -fopenmp -lgmp -lm -lrt -lz -ldl -lcrypt -lbz2

OpenBenchmarking.orgReal C/S, More Is BetterJohn The Ripper 2023.03.14Test: bcryptXeon Platinum 8380Xeon Max 9468Xeon Max 9480EPYC 8534PNXeon Platinum 8490HEPYC 8534PXeon Platinum 8592+Xeon Platinum 8380 2PXeon Max 9468 2PXeon Max 9480 2PEPYC 9654Xeon Platinum 8490H 2PXeon 6766EEPYC 9684XXeon Platinum 8592+ 2PXeon 6780EEPYC 9754EPYC 9654 2PXeon 6766E 2PEPYC 9684X 2PXeon 6780E 2PEPYC 9754 2P90K180K270K360K450KSE +/- 6.33, N = 3SE +/- 8.84, N = 3SE +/- 8.67, N = 3SE +/- 0.00, N = 3SE +/- 10.67, N = 3SE +/- 22.28, N = 3SE +/- 46.28, N = 3SE +/- 12.67, N = 3SE +/- 866.68, N = 3SE +/- 576.80, N = 3SE +/- 20.00, N = 3SE +/- 292.24, N = 3SE +/- 32.84, N = 3SE +/- 154.46, N = 3SE +/- 288.38, N = 3SE +/- 87.49, N = 3SE +/- 1.33, N = 3SE +/- 710.46, N = 3SE +/- 801.76, N = 3SE +/- 1315.55, N = 3SE +/- 2096.39, N = 3SE +/- 4958.68, N = 456939678757914493472945511022221057811132191338661559591665411836031900581928982067782113112201883205273631333762684022754127231. (CC) gcc options: -m64 -lssl -lcrypto -fopenmp -lgmp -lm -lrt -lz -ldl -lcrypt -lbz2
OpenBenchmarking.orgReal C/S, More Is BetterJohn The Ripper 2023.03.14Test: bcryptXeon Platinum 8380Xeon Max 9468Xeon Max 9480EPYC 8534PNXeon Platinum 8490HEPYC 8534PXeon Platinum 8592+Xeon Platinum 8380 2PXeon Max 9468 2PXeon Max 9480 2PEPYC 9654Xeon Platinum 8490H 2PXeon 6766EEPYC 9684XXeon Platinum 8592+ 2PXeon 6780EEPYC 9754EPYC 9654 2PXeon 6766E 2PEPYC 9684X 2PXeon 6780E 2PEPYC 9754 2P70K140K210K280K350KMin: 56933 / Avg: 56939.33 / Max: 56952Min: 67858 / Avg: 67875.33 / Max: 67887Min: 79135 / Avg: 79143.67 / Max: 79161Min: 93472 / Avg: 93472 / Max: 93472Min: 94540 / Avg: 94550.67 / Max: 94572Min: 102182 / Avg: 102222 / Max: 102259Min: 105718 / Avg: 105780.67 / Max: 105871Min: 113194 / Avg: 113219.33 / Max: 113232Min: 132134 / Avg: 133866.33 / Max: 134784Min: 155113 / Avg: 155958.67 / Max: 157061Min: 166521 / Avg: 166541 / Max: 166581Min: 183024 / Avg: 183603.33 / Max: 183960Min: 190016 / Avg: 190058.33 / Max: 190123Min: 192665 / Avg: 192897.67 / Max: 193190Min: 206292 / Avg: 206778.33 / Max: 207290Min: 211161 / Avg: 211310.67 / Max: 211464Min: 220185 / Avg: 220187.67 / Max: 220189Min: 319334 / Avg: 320527.33 / Max: 321792Min: 361549 / Avg: 363133 / Max: 364141Min: 373862 / Avg: 376268.33 / Max: 378393Min: 398084 / Avg: 402275 / Max: 404476Min: 398131 / Avg: 412723 / Max: 4198401. (CC) gcc options: -m64 -lssl -lcrypto -fopenmp -lgmp -lm -lrt -lz -ldl -lcrypt -lbz2

7-Zip Compression

This is a test of 7-Zip compression/decompression with its integrated benchmark feature. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgMIPS, More Is Better7-Zip Compression 22.01Test: Decompression RatingXeon Platinum 8380Xeon Max 9468Xeon Max 9480Xeon Platinum 8490HXeon Platinum 8592+EPYC 8534PNXeon Platinum 8380 2PEPYC 8534PXeon Max 9468 2PXeon 6766EXeon 6780EXeon Max 9480 2PXeon Platinum 8490H 2PXeon Platinum 8592+ 2PEPYC 9654EPYC 9684XXeon 6766E 2PEPYC 9754Xeon 6780E 2PEPYC 9654 2PEPYC 9684X 2PEPYC 9754 2P300K600K900K1200K1500KSE +/- 309.57, N = 3SE +/- 916.22, N = 3SE +/- 374.59, N = 3SE +/- 61.74, N = 3SE +/- 119.21, N = 3SE +/- 81.21, N = 3SE +/- 559.82, N = 3SE +/- 120.28, N = 3SE +/- 2598.93, N = 3SE +/- 343.82, N = 3SE +/- 258.19, N = 3SE +/- 6276.88, N = 3SE +/- 185.14, N = 3SE +/- 28320.74, N = 3SE +/- 111.53, N = 3SE +/- 1085.99, N = 3SE +/- 2333.15, N = 3SE +/- 291.68, N = 3SE +/- 903.01, N = 3SE +/- 15794.26, N = 3SE +/- 38431.24, N = 3SE +/- 14188.09, N = 31883452077382433472878623381463383553665343679894017074210634637684691315570545734106426267160657673137808718463351033277111646513402261. (CXX) g++ options: -lpthread -ldl -O2 -fPIC
OpenBenchmarking.orgMIPS, More Is Better7-Zip Compression 22.01Test: Decompression RatingXeon Platinum 8380Xeon Max 9468Xeon Max 9480Xeon Platinum 8490HXeon Platinum 8592+EPYC 8534PNXeon Platinum 8380 2PEPYC 8534PXeon Max 9468 2PXeon 6766EXeon 6780EXeon Max 9480 2PXeon Platinum 8490H 2PXeon Platinum 8592+ 2PEPYC 9654EPYC 9684XXeon 6766E 2PEPYC 9754Xeon 6780E 2PEPYC 9654 2PEPYC 9684X 2PEPYC 9754 2P200K400K600K800K1000KMin: 187743 / Avg: 188344.67 / Max: 188772Min: 206272 / Avg: 207737.67 / Max: 209423Min: 242598 / Avg: 243347 / Max: 243736Min: 287786 / Avg: 287861.67 / Max: 287984Min: 338011 / Avg: 338146.33 / Max: 338384Min: 338211 / Avg: 338355.33 / Max: 338492Min: 365574 / Avg: 366534.33 / Max: 367513Min: 367827 / Avg: 367989 / Max: 368224Min: 396748 / Avg: 401707.33 / Max: 405535Min: 420382 / Avg: 421063 / Max: 421486Min: 463504 / Avg: 463767.67 / Max: 464284Min: 456604 / Avg: 469131 / Max: 476104Min: 556694 / Avg: 557054 / Max: 557309Min: 529470 / Avg: 573410 / Max: 626334Min: 642428 / Avg: 642625.67 / Max: 642814Min: 713953 / Avg: 716065 / Max: 717560Min: 763897 / Avg: 767313 / Max: 771774Min: 780322 / Avg: 780871.33 / Max: 781316Min: 844577 / Avg: 846334.67 / Max: 847573Min: 1014341 / Avg: 1033276.67 / Max: 1064641Min: 1050907 / Avg: 1116465 / Max: 1183993Min: 1312002 / Avg: 1340225.67 / Max: 13568821. (CXX) g++ options: -lpthread -ldl -O2 -fPIC

Primesieve

OpenBenchmarking.orgSeconds, Fewer Is BetterPrimesieve 12.1Length: 1e13Xeon Platinum 8380Xeon Max 9468Xeon Max 9480Xeon 6766EEPYC 8534PNXeon 6780EXeon Platinum 8490HXeon Platinum 8592+EPYC 8534PXeon Platinum 8380 2PXeon Max 9468 2PXeon Max 9480 2PXeon 6766E 2PXeon Platinum 8490H 2PXeon 6780E 2PXeon Platinum 8592+ 2PEPYC 9654EPYC 9684XEPYC 9754EPYC 9654 2PEPYC 9684X 2PEPYC 9754 2P20406080100SE +/- 0.25, N = 3SE +/- 0.07, N = 3SE +/- 0.04, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.02, N = 3SE +/- 0.04, N = 3SE +/- 0.04, N = 3SE +/- 0.02, N = 3SE +/- 0.10, N = 3SE +/- 0.04, N = 3SE +/- 0.07, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.04, N = 3SE +/- 0.04, N = 3SE +/- 0.02, N = 3SE +/- 0.02, N = 3SE +/- 0.02, N = 3SE +/- 0.01, N = 4SE +/- 0.02, N = 4SE +/- 0.01, N = 481.3667.3258.1657.7154.3952.0751.8248.4145.9540.4433.9230.2029.3927.1126.4625.0224.2423.2721.7612.6312.1311.561. (CXX) g++ options: -O3
OpenBenchmarking.orgSeconds, Fewer Is BetterPrimesieve 12.1Length: 1e13Xeon Platinum 8380Xeon Max 9468Xeon Max 9480Xeon 6766EEPYC 8534PNXeon 6780EXeon Platinum 8490HXeon Platinum 8592+EPYC 8534PXeon Platinum 8380 2PXeon Max 9468 2PXeon Max 9480 2PXeon 6766E 2PXeon Platinum 8490H 2PXeon 6780E 2PXeon Platinum 8592+ 2PEPYC 9654EPYC 9684XEPYC 9754EPYC 9654 2PEPYC 9684X 2PEPYC 9754 2P1632486480Min: 80.87 / Avg: 81.36 / Max: 81.7Min: 67.25 / Avg: 67.32 / Max: 67.47Min: 58.09 / Avg: 58.16 / Max: 58.21Min: 57.69 / Avg: 57.71 / Max: 57.73Min: 54.37 / Avg: 54.39 / Max: 54.41Min: 52.06 / Avg: 52.07 / Max: 52.11Min: 51.77 / Avg: 51.82 / Max: 51.9Min: 48.35 / Avg: 48.41 / Max: 48.48Min: 45.91 / Avg: 45.95 / Max: 45.98Min: 40.25 / Avg: 40.44 / Max: 40.55Min: 33.85 / Avg: 33.92 / Max: 33.97Min: 30.13 / Avg: 30.2 / Max: 30.33Min: 29.36 / Avg: 29.39 / Max: 29.4Min: 27.09 / Avg: 27.11 / Max: 27.13Min: 26.4 / Avg: 26.46 / Max: 26.54Min: 24.98 / Avg: 25.02 / Max: 25.09Min: 24.21 / Avg: 24.24 / Max: 24.28Min: 23.23 / Avg: 23.26 / Max: 23.29Min: 21.74 / Avg: 21.76 / Max: 21.8Min: 12.61 / Avg: 12.63 / Max: 12.66Min: 12.07 / Avg: 12.13 / Max: 12.16Min: 11.53 / Avg: 11.56 / Max: 11.61. (CXX) g++ options: -O3

Blender

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 4.1Blend File: Barbershop - Compute: CPU-OnlyXeon Platinum 8380Xeon Max 9468Xeon Max 9480EPYC 8534PNXeon Platinum 8490HEPYC 8534PXeon Platinum 8592+Xeon Platinum 8380 2PXeon 6766EXeon 6780EXeon Max 9468 2PXeon Max 9480 2PXeon Platinum 8490H 2PEPYC 9654Xeon Platinum 8592+ 2PEPYC 9684XEPYC 9754Xeon 6766E 2PXeon 6780E 2PEPYC 9654 2PEPYC 9684X 2PEPYC 9754 2P100200300400500SE +/- 0.03, N = 3SE +/- 0.12, N = 3SE +/- 1.09, N = 3SE +/- 0.07, N = 3SE +/- 0.18, N = 3SE +/- 0.06, N = 3SE +/- 0.69, N = 3SE +/- 0.25, N = 3SE +/- 0.33, N = 3SE +/- 0.08, N = 3SE +/- 0.23, N = 3SE +/- 0.06, N = 3SE +/- 0.42, N = 3SE +/- 0.25, N = 3SE +/- 0.21, N = 3SE +/- 0.12, N = 3SE +/- 0.03, N = 3SE +/- 0.41, N = 3SE +/- 0.17, N = 3SE +/- 0.02, N = 3SE +/- 0.11, N = 3SE +/- 0.07, N = 3456.81320.11290.56263.76261.97240.13236.73235.31191.20174.49169.44156.70141.54139.25125.87123.90114.76106.4897.1879.0567.5265.58
OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 4.1Blend File: Barbershop - Compute: CPU-OnlyXeon Platinum 8380Xeon Max 9468Xeon Max 9480EPYC 8534PNXeon Platinum 8490HEPYC 8534PXeon Platinum 8592+Xeon Platinum 8380 2PXeon 6766EXeon 6780EXeon Max 9468 2PXeon Max 9480 2PXeon Platinum 8490H 2PEPYC 9654Xeon Platinum 8592+ 2PEPYC 9684XEPYC 9754Xeon 6766E 2PXeon 6780E 2PEPYC 9654 2PEPYC 9684X 2PEPYC 9754 2P80160240320400Min: 456.75 / Avg: 456.81 / Max: 456.84Min: 319.91 / Avg: 320.11 / Max: 320.34Min: 288.45 / Avg: 290.56 / Max: 292.08Min: 263.63 / Avg: 263.76 / Max: 263.86Min: 261.68 / Avg: 261.97 / Max: 262.29Min: 240.04 / Avg: 240.13 / Max: 240.23Min: 235.47 / Avg: 236.73 / Max: 237.85Min: 234.94 / Avg: 235.31 / Max: 235.79Min: 190.65 / Avg: 191.2 / Max: 191.8Min: 174.36 / Avg: 174.49 / Max: 174.64Min: 168.99 / Avg: 169.44 / Max: 169.77Min: 156.59 / Avg: 156.7 / Max: 156.77Min: 140.92 / Avg: 141.54 / Max: 142.33Min: 138.74 / Avg: 139.25 / Max: 139.55Min: 125.6 / Avg: 125.87 / Max: 126.29Min: 123.68 / Avg: 123.9 / Max: 124.11Min: 114.7 / Avg: 114.76 / Max: 114.81Min: 106 / Avg: 106.48 / Max: 107.3Min: 96.9 / Avg: 97.18 / Max: 97.48Min: 79.01 / Avg: 79.05 / Max: 79.08Min: 67.32 / Avg: 67.52 / Max: 67.69Min: 65.48 / Avg: 65.58 / Max: 65.71

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 4.1Blend File: Pabellon Barcelona - Compute: CPU-OnlyXeon Platinum 8380Xeon Max 9468Xeon Max 9480EPYC 8534PNXeon Platinum 8490HEPYC 8534PXeon Platinum 8592+Xeon Platinum 8380 2PXeon 6766EXeon 6780EXeon Max 9468 2PXeon Max 9480 2PEPYC 9654Xeon Platinum 8490H 2PEPYC 9684XXeon Platinum 8592+ 2PEPYC 9754Xeon 6766E 2PXeon 6780E 2PEPYC 9654 2PEPYC 9684X 2PEPYC 9754 2P306090120150SE +/- 0.15, N = 3SE +/- 0.31, N = 3SE +/- 0.44, N = 3SE +/- 0.05, N = 3SE +/- 0.15, N = 3SE +/- 0.16, N = 3SE +/- 0.09, N = 3SE +/- 0.26, N = 3SE +/- 0.13, N = 3SE +/- 0.25, N = 3SE +/- 0.08, N = 3SE +/- 0.20, N = 3SE +/- 0.04, N = 3SE +/- 0.26, N = 3SE +/- 0.16, N = 3SE +/- 0.06, N = 3SE +/- 0.13, N = 3SE +/- 0.29, N = 3SE +/- 0.17, N = 3SE +/- 0.10, N = 3SE +/- 0.11, N = 3SE +/- 0.13, N = 3150.39106.9697.8094.4187.9285.1280.2976.1065.6760.1155.2651.2948.8846.3844.8741.8539.8335.1131.2826.3523.8421.66
OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 4.1Blend File: Pabellon Barcelona - Compute: CPU-OnlyXeon Platinum 8380Xeon Max 9468Xeon Max 9480EPYC 8534PNXeon Platinum 8490HEPYC 8534PXeon Platinum 8592+Xeon Platinum 8380 2PXeon 6766EXeon 6780EXeon Max 9468 2PXeon Max 9480 2PEPYC 9654Xeon Platinum 8490H 2PEPYC 9684XXeon Platinum 8592+ 2PEPYC 9754Xeon 6766E 2PXeon 6780E 2PEPYC 9654 2PEPYC 9684X 2PEPYC 9754 2P306090120150Min: 150.09 / Avg: 150.39 / Max: 150.61Min: 106.49 / Avg: 106.96 / Max: 107.55Min: 97.15 / Avg: 97.8 / Max: 98.64Min: 94.36 / Avg: 94.41 / Max: 94.51Min: 87.63 / Avg: 87.92 / Max: 88.15Min: 84.95 / Avg: 85.12 / Max: 85.44Min: 80.11 / Avg: 80.29 / Max: 80.39Min: 75.68 / Avg: 76.1 / Max: 76.57Min: 65.47 / Avg: 65.67 / Max: 65.91Min: 59.84 / Avg: 60.11 / Max: 60.6Min: 55.12 / Avg: 55.26 / Max: 55.41Min: 51.08 / Avg: 51.29 / Max: 51.69Min: 48.8 / Avg: 48.88 / Max: 48.93Min: 45.94 / Avg: 46.38 / Max: 46.84Min: 44.56 / Avg: 44.87 / Max: 45.11Min: 41.74 / Avg: 41.85 / Max: 41.95Min: 39.69 / Avg: 39.83 / Max: 40.08Min: 34.54 / Avg: 35.11 / Max: 35.44Min: 31.06 / Avg: 31.28 / Max: 31.61Min: 26.2 / Avg: 26.35 / Max: 26.55Min: 23.69 / Avg: 23.84 / Max: 24.06Min: 21.47 / Avg: 21.66 / Max: 21.92

Coremark

This is a test of EEMBC CoreMark processor benchmark. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgIterations/Sec, More Is BetterCoremark 1.0CoreMark Size 666 - Iterations Per SecondXeon Platinum 8380Xeon Max 9468Xeon Platinum 8380 2PXeon Max 9480EPYC 8534PNXeon Platinum 8490HEPYC 8534PXeon Platinum 8592+Xeon 6766EXeon Max 9468 2PXeon Max 9480 2PXeon 6780EXeon Platinum 8490H 2PEPYC 9654EPYC 9684XEPYC 9754Xeon Platinum 8592+ 2PXeon 6766E 2PXeon 6780E 2PEPYC 9654 2PEPYC 9754 2PEPYC 9684X 2P2M4M6M8M10MSE +/- 927.64, N = 3SE +/- 1747.99, N = 3SE +/- 30163.42, N = 15SE +/- 5202.86, N = 3SE +/- 11678.22, N = 3SE +/- 9256.47, N = 3SE +/- 1374.66, N = 3SE +/- 4635.95, N = 3SE +/- 10294.77, N = 3SE +/- 7219.73, N = 3SE +/- 20649.43, N = 3SE +/- 40214.40, N = 15SE +/- 12743.41, N = 3SE +/- 10132.66, N = 3SE +/- 54326.71, N = 3SE +/- 4775.53, N = 3SE +/- 9700.21, N = 3SE +/- 9906.84, N = 3SE +/- 7619.10, N = 3SE +/- 2306.54, N = 3SE +/- 54771.53, N = 3SE +/- 76743.24, N = 31218453.341614763.701839444.401855135.332069432.532194630.602274636.132369998.362915609.752993136.603279262.533340274.033902076.243926265.284152864.884525288.004966250.786575205.547302247.147975907.458171241.718448083.731. (CC) gcc options: -O2 -lrt" -lrt
OpenBenchmarking.orgIterations/Sec, More Is BetterCoremark 1.0CoreMark Size 666 - Iterations Per SecondXeon Platinum 8380Xeon Max 9468Xeon Platinum 8380 2PXeon Max 9480EPYC 8534PNXeon Platinum 8490HEPYC 8534PXeon Platinum 8592+Xeon 6766EXeon Max 9468 2PXeon Max 9480 2PXeon 6780EXeon Platinum 8490H 2PEPYC 9654EPYC 9684XEPYC 9754Xeon Platinum 8592+ 2PXeon 6766E 2PXeon 6780E 2PEPYC 9654 2PEPYC 9754 2PEPYC 9684X 2P1.5M3M4.5M6M7.5MMin: 1217401.23 / Avg: 1218453.34 / Max: 1220302.79Min: 1611278.95 / Avg: 1614763.7 / Max: 1616748.5Min: 1683014.7 / Avg: 1839444.4 / Max: 1976589.76Min: 1844878.84 / Avg: 1855135.33 / Max: 1861784.33Min: 2046144.83 / Avg: 2069432.53 / Max: 2082627.15Min: 2176176.81 / Avg: 2194630.6 / Max: 2205138.14Min: 2271886.88 / Avg: 2274636.13 / Max: 2276027.62Min: 2363949.77 / Avg: 2369998.36 / Max: 2379108.45Min: 2899523.46 / Avg: 2915609.75 / Max: 2934782.61Min: 2983161.45 / Avg: 2993136.6 / Max: 3007165.51Min: 3249040.2 / Avg: 3279262.53 / Max: 3318748.99Min: 3225987.12 / Avg: 3340274.03 / Max: 3693728.36Min: 3878640.96 / Avg: 3902076.24 / Max: 3922469.93Min: 3913375.8 / Avg: 3926265.28 / Max: 3946252.86Min: 4045192.38 / Avg: 4152864.88 / Max: 4219316.56Min: 4516451.53 / Avg: 4525288 / Max: 4532845.42Min: 4952761.75 / Avg: 4966250.78 / Max: 4985070.75Min: 6556879.41 / Avg: 6575205.54 / Max: 6590891.75Min: 7288832.65 / Avg: 7302247.14 / Max: 7315214.63Min: 7973008.05 / Avg: 7975907.45 / Max: 7980464.49Min: 8061722.56 / Avg: 8171241.71 / Max: 8227983.72Min: 8294632.25 / Avg: 8448083.73 / Max: 8527648.231. (CC) gcc options: -O2 -lrt" -lrt

OpenRadioss

OpenRadioss is an open-source AGPL-licensed finite element solver for dynamic event analysis OpenRadioss is based on Altair Radioss and open-sourced in 2022. This open-source finite element solver is benchmarked with various example models available from https://www.openradioss.org/models/ and https://github.com/OpenRadioss/ModelExchange/tree/main/Examples. This test is currently using a reference OpenRadioss binary build offered via GitHub. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterOpenRadioss 2023.09.15Model: Chrysler Neon 1MXeon Platinum 8380EPYC 8534PNEPYC 8534PEPYC 9754Xeon Max 9468Xeon Max 9480Xeon Platinum 8490HXeon Platinum 8380 2PEPYC 9654Xeon Platinum 8592+Xeon Max 9468 2PXeon Max 9480 2PXeon Platinum 8490H 2PEPYC 9754 2PXeon Platinum 8592+ 2PEPYC 9654 2PEPYC 9684XEPYC 9684X 2P70140210280350SE +/- 0.13, N = 3SE +/- 0.50, N = 3SE +/- 0.47, N = 3SE +/- 1.11, N = 3SE +/- 0.08, N = 3SE +/- 0.18, N = 3SE +/- 0.15, N = 3SE +/- 0.78, N = 3SE +/- 1.51, N = 8SE +/- 0.20, N = 3SE +/- 0.13, N = 3SE +/- 0.14, N = 3SE +/- 0.11, N = 3SE +/- 1.00, N = 10SE +/- 0.14, N = 3SE +/- 0.71, N = 12SE +/- 0.49, N = 3SE +/- 0.46, N = 3343.16300.69297.25231.96228.74212.99207.20185.03176.14157.56125.15117.91115.8993.9986.9377.6477.3249.55
OpenBenchmarking.orgSeconds, Fewer Is BetterOpenRadioss 2023.09.15Model: Chrysler Neon 1MXeon Platinum 8380EPYC 8534PNEPYC 8534PEPYC 9754Xeon Max 9468Xeon Max 9480Xeon Platinum 8490HXeon Platinum 8380 2PEPYC 9654Xeon Platinum 8592+Xeon Max 9468 2PXeon Max 9480 2PXeon Platinum 8490H 2PEPYC 9754 2PXeon Platinum 8592+ 2PEPYC 9654 2PEPYC 9684XEPYC 9684X 2P60120180240300Min: 342.91 / Avg: 343.16 / Max: 343.34Min: 300.16 / Avg: 300.69 / Max: 301.69Min: 296.35 / Avg: 297.25 / Max: 297.96Min: 229.74 / Avg: 231.96 / Max: 233.14Min: 228.6 / Avg: 228.74 / Max: 228.86Min: 212.71 / Avg: 212.99 / Max: 213.33Min: 207.03 / Avg: 207.2 / Max: 207.49Min: 184.03 / Avg: 185.03 / Max: 186.56Min: 166.67 / Avg: 176.14 / Max: 180.48Min: 157.21 / Avg: 157.56 / Max: 157.92Min: 124.93 / Avg: 125.15 / Max: 125.39Min: 117.77 / Avg: 117.91 / Max: 118.18Min: 115.68 / Avg: 115.89 / Max: 116.03Min: 85.32 / Avg: 93.99 / Max: 96.35Min: 86.78 / Avg: 86.93 / Max: 87.22Min: 69.97 / Avg: 77.64 / Max: 79.2Min: 76.77 / Avg: 77.32 / Max: 78.3Min: 48.8 / Avg: 49.55 / Max: 50.39

OpenVINO

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Face Detection Retail FP16-INT8 - Device: CPUXeon Platinum 8380Xeon 6766EEPYC 8534PNXeon 6780EXeon Platinum 8490HXeon Max 9468EPYC 8534PXeon Max 9480Xeon Platinum 8592+Xeon Platinum 8380 2PXeon 6766E 2PEPYC 9654Xeon 6780E 2PEPYC 9684XXeon Max 9468 2PXeon Max 9480 2PEPYC 9754Xeon Platinum 8490H 2PXeon Platinum 8592+ 2PEPYC 9654 2PEPYC 9684X 2PEPYC 9754 2P8K16K24K32K40KSE +/- 15.90, N = 3SE +/- 2.54, N = 3SE +/- 7.49, N = 3SE +/- 0.67, N = 3SE +/- 5.45, N = 3SE +/- 18.13, N = 3SE +/- 2.45, N = 3SE +/- 7.39, N = 3SE +/- 4.30, N = 3SE +/- 16.45, N = 3SE +/- 30.29, N = 3SE +/- 2.59, N = 3SE +/- 41.98, N = 3SE +/- 7.70, N = 3SE +/- 12.64, N = 3SE +/- 3.89, N = 3SE +/- 8.57, N = 3SE +/- 12.64, N = 3SE +/- 17.69, N = 3SE +/- 46.87, N = 3SE +/- 15.46, N = 3SE +/- 10.72, N = 35913.047721.008279.638536.399004.239087.129256.119686.3912317.9413467.2814551.1216038.9016394.0617230.3517252.2718561.9119917.5420937.5824676.8631974.8835809.5938546.661. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Face Detection Retail FP16-INT8 - Device: CPUXeon Platinum 8380Xeon 6766EEPYC 8534PNXeon 6780EXeon Platinum 8490HXeon Max 9468EPYC 8534PXeon Max 9480Xeon Platinum 8592+Xeon Platinum 8380 2PXeon 6766E 2PEPYC 9654Xeon 6780E 2PEPYC 9684XXeon Max 9468 2PXeon Max 9480 2PEPYC 9754Xeon Platinum 8490H 2PXeon Platinum 8592+ 2PEPYC 9654 2PEPYC 9684X 2PEPYC 9754 2P7K14K21K28K35KMin: 5891.68 / Avg: 5913.04 / Max: 5944.13Min: 7717.98 / Avg: 7721 / Max: 7726.05Min: 8271.92 / Avg: 8279.63 / Max: 8294.61Min: 8535.45 / Avg: 8536.39 / Max: 8537.68Min: 8995.55 / Avg: 9004.23 / Max: 9014.29Min: 9051.23 / Avg: 9087.12 / Max: 9109.51Min: 9252.07 / Avg: 9256.11 / Max: 9260.54Min: 9673.85 / Avg: 9686.39 / Max: 9699.43Min: 12311.49 / Avg: 12317.94 / Max: 12326.08Min: 13447.7 / Avg: 13467.28 / Max: 13499.98Min: 14506.96 / Avg: 14551.12 / Max: 14609.11Min: 16035.53 / Avg: 16038.9 / Max: 16044Min: 16351.39 / Avg: 16394.06 / Max: 16478.02Min: 17221.13 / Avg: 17230.35 / Max: 17245.65Min: 17227.05 / Avg: 17252.27 / Max: 17266.33Min: 18557.63 / Avg: 18561.91 / Max: 18569.68Min: 19906.36 / Avg: 19917.54 / Max: 19934.37Min: 20913.51 / Avg: 20937.58 / Max: 20956.31Min: 24653.87 / Avg: 24676.86 / Max: 24711.65Min: 31901.65 / Avg: 31974.88 / Max: 32062.18Min: 35790.86 / Avg: 35809.59 / Max: 35840.26Min: 38532.34 / Avg: 38546.66 / Max: 38567.631. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OSPRay Studio

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 1.0Camera: 1 - Resolution: 4K - Samples Per Pixel: 16 - Renderer: Path Tracer - Acceleration: CPUXeon Platinum 8380Xeon 6766EXeon 6780EEPYC 8534PNEPYC 8534PXeon 6766E 2PXeon Max 9468Xeon 6780E 2PXeon Max 9480Xeon Platinum 8490HXeon Platinum 8380 2PXeon Platinum 8592+EPYC 9654Xeon Max 9468 2PEPYC 9684XXeon Max 9480 2PEPYC 9754Xeon Platinum 8490H 2PXeon Platinum 8592+ 2PEPYC 9654 2PEPYC 9684X 2PEPYC 9754 2P12K24K36K48K60KSE +/- 148.46, N = 3SE +/- 199.93, N = 3SE +/- 371.33, N = 3SE +/- 31.02, N = 3SE +/- 250.73, N = 3SE +/- 409.89, N = 15SE +/- 28.06, N = 3SE +/- 429.71, N = 4SE +/- 83.47, N = 3SE +/- 62.46, N = 3SE +/- 53.03, N = 3SE +/- 37.49, N = 3SE +/- 44.33, N = 3SE +/- 72.42, N = 3SE +/- 39.30, N = 3SE +/- 51.39, N = 3SE +/- 33.33, N = 3SE +/- 34.10, N = 3SE +/- 7.13, N = 3SE +/- 32.74, N = 3SE +/- 17.16, N = 3SE +/- 12.34, N = 3544565208346875425133881138228370553508133790313803044223125188961664516603153571528614138121241042889168413
OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 1.0Camera: 1 - Resolution: 4K - Samples Per Pixel: 16 - Renderer: Path Tracer - Acceleration: CPUXeon Platinum 8380Xeon 6766EXeon 6780EEPYC 8534PNEPYC 8534PXeon 6766E 2PXeon Max 9468Xeon 6780E 2PXeon Max 9480Xeon Platinum 8490HXeon Platinum 8380 2PXeon Platinum 8592+EPYC 9654Xeon Max 9468 2PEPYC 9684XXeon Max 9480 2PEPYC 9754Xeon Platinum 8490H 2PXeon Platinum 8592+ 2PEPYC 9654 2PEPYC 9684X 2PEPYC 9754 2P9K18K27K36K45KMin: 54239 / Avg: 54456 / Max: 54740Min: 51873 / Avg: 52083.33 / Max: 52483Min: 46287 / Avg: 46875.33 / Max: 47562Min: 42451 / Avg: 42513 / Max: 42546Min: 38456 / Avg: 38810.67 / Max: 39295Min: 35432 / Avg: 38227.53 / Max: 39692Min: 37000 / Avg: 37054.67 / Max: 37093Min: 34113 / Avg: 35080.5 / Max: 35894Min: 33636 / Avg: 33789.67 / Max: 33923Min: 31258 / Avg: 31379.67 / Max: 31465Min: 30338 / Avg: 30442.33 / Max: 30511Min: 23082 / Avg: 23125.33 / Max: 23200Min: 18845 / Avg: 18895.67 / Max: 18984Min: 16562 / Avg: 16644.67 / Max: 16789Min: 16554 / Avg: 16603.33 / Max: 16681Min: 15268 / Avg: 15357.33 / Max: 15446Min: 15253 / Avg: 15286.33 / Max: 15353Min: 14077 / Avg: 14137.67 / Max: 14195Min: 12114 / Avg: 12124.33 / Max: 12138Min: 10374 / Avg: 10427.67 / Max: 10487Min: 8895 / Avg: 8916 / Max: 8950Min: 8389 / Avg: 8413 / Max: 8430

Blender

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 4.1Blend File: BMW27 - Compute: CPU-OnlyXeon Platinum 8380Xeon Max 9468EPYC 8534PNXeon Max 9480EPYC 8534PXeon Platinum 8490HXeon Platinum 8592+Xeon Platinum 8380 2PXeon 6766EXeon 6780EXeon Max 9468 2PEPYC 9654Xeon Max 9480 2PEPYC 9684XXeon Platinum 8490H 2PEPYC 9754Xeon Platinum 8592+ 2PXeon 6766E 2PXeon 6780E 2PEPYC 9654 2PEPYC 9684X 2PEPYC 9754 2P1122334455SE +/- 0.11, N = 3SE +/- 0.11, N = 3SE +/- 0.05, N = 3SE +/- 0.24, N = 3SE +/- 0.04, N = 3SE +/- 0.15, N = 3SE +/- 0.04, N = 3SE +/- 0.03, N = 3SE +/- 0.17, N = 8SE +/- 0.05, N = 3SE +/- 0.03, N = 3SE +/- 0.07, N = 4SE +/- 0.08, N = 4SE +/- 0.04, N = 4SE +/- 0.08, N = 4SE +/- 0.01, N = 4SE +/- 0.03, N = 4SE +/- 0.06, N = 5SE +/- 0.09, N = 5SE +/- 0.02, N = 5SE +/- 0.03, N = 6SE +/- 0.02, N = 646.3231.6630.0728.4927.1225.8923.7223.6719.8517.6116.5515.9615.2914.2913.7412.8612.7610.569.718.617.757.17
OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 4.1Blend File: BMW27 - Compute: CPU-OnlyXeon Platinum 8380Xeon Max 9468EPYC 8534PNXeon Max 9480EPYC 8534PXeon Platinum 8490HXeon Platinum 8592+Xeon Platinum 8380 2PXeon 6766EXeon 6780EXeon Max 9468 2PEPYC 9654Xeon Max 9480 2PEPYC 9684XXeon Platinum 8490H 2PEPYC 9754Xeon Platinum 8592+ 2PXeon 6766E 2PXeon 6780E 2PEPYC 9654 2PEPYC 9684X 2PEPYC 9754 2P918273645Min: 46.11 / Avg: 46.32 / Max: 46.43Min: 31.52 / Avg: 31.66 / Max: 31.88Min: 29.97 / Avg: 30.07 / Max: 30.13Min: 28.24 / Avg: 28.49 / Max: 28.97Min: 27.05 / Avg: 27.12 / Max: 27.2Min: 25.7 / Avg: 25.89 / Max: 26.18Min: 23.65 / Avg: 23.72 / Max: 23.79Min: 23.62 / Avg: 23.67 / Max: 23.7Min: 19.46 / Avg: 19.85 / Max: 20.66Min: 17.51 / Avg: 17.61 / Max: 17.69Min: 16.52 / Avg: 16.55 / Max: 16.6Min: 15.8 / Avg: 15.96 / Max: 16.15Min: 15.11 / Avg: 15.29 / Max: 15.48Min: 14.23 / Avg: 14.29 / Max: 14.39Min: 13.55 / Avg: 13.74 / Max: 13.95Min: 12.84 / Avg: 12.86 / Max: 12.9Min: 12.68 / Avg: 12.76 / Max: 12.84Min: 10.44 / Avg: 10.56 / Max: 10.76Min: 9.46 / Avg: 9.71 / Max: 9.88Min: 8.56 / Avg: 8.61 / Max: 8.66Min: 7.66 / Avg: 7.75 / Max: 7.83Min: 7.12 / Avg: 7.17 / Max: 7.24

OpenVINO

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Person Re-Identification Retail FP16 - Device: CPUXeon Platinum 8380 2PXeon Platinum 8380Xeon 6766E 2PXeon 6766EXeon 6780E 2PXeon 6780EXeon Platinum 8490HEPYC 8534PNEPYC 8534PEPYC 9754Xeon Max 9480 2PXeon Max 9480Xeon Platinum 8490H 2PXeon Max 9468 2PEPYC 9654Xeon Max 9468Xeon Platinum 8592+ 2PEPYC 9684XXeon Platinum 8592+EPYC 9754 2PEPYC 9654 2PEPYC 9684X 2P612182430SE +/- 0.02, N = 3SE +/- 0.02, N = 3SE +/- 0.02, N = 3SE +/- 0.16, N = 3SE +/- 0.02, N = 3SE +/- 0.08, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 324.3923.2518.7517.8116.7316.369.799.468.598.037.977.767.727.327.237.136.956.936.724.373.983.781. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Person Re-Identification Retail FP16 - Device: CPUXeon Platinum 8380 2PXeon Platinum 8380Xeon 6766E 2PXeon 6766EXeon 6780E 2PXeon 6780EXeon Platinum 8490HEPYC 8534PNEPYC 8534PEPYC 9754Xeon Max 9480 2PXeon Max 9480Xeon Platinum 8490H 2PXeon Max 9468 2PEPYC 9654Xeon Max 9468Xeon Platinum 8592+ 2PEPYC 9684XXeon Platinum 8592+EPYC 9754 2PEPYC 9654 2PEPYC 9684X 2P612182430Min: 24.35 / Avg: 24.39 / Max: 24.42Min: 23.22 / Avg: 23.25 / Max: 23.28Min: 18.72 / Avg: 18.75 / Max: 18.77Min: 17.51 / Avg: 17.81 / Max: 18.03Min: 16.7 / Avg: 16.73 / Max: 16.77Min: 16.26 / Avg: 16.36 / Max: 16.52Min: 9.78 / Avg: 9.79 / Max: 9.8Min: 9.45 / Avg: 9.46 / Max: 9.47Min: 8.58 / Avg: 8.59 / Max: 8.61Min: 8.02 / Avg: 8.03 / Max: 8.03Min: 7.96 / Avg: 7.97 / Max: 7.97Min: 7.76 / Avg: 7.76 / Max: 7.76Min: 7.71 / Avg: 7.72 / Max: 7.72Min: 7.31 / Avg: 7.32 / Max: 7.32Min: 7.23 / Avg: 7.23 / Max: 7.24Min: 7.13 / Avg: 7.13 / Max: 7.14Min: 6.95 / Avg: 6.95 / Max: 6.96Min: 6.92 / Avg: 6.93 / Max: 6.93Min: 6.71 / Avg: 6.72 / Max: 6.72Min: 4.37 / Avg: 4.37 / Max: 4.38Min: 3.98 / Avg: 3.98 / Max: 3.98Min: 3.78 / Avg: 3.78 / Max: 3.781. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

Xcompact3d Incompact3d

Xcompact3d Incompact3d is a Fortran-MPI based, finite difference high-performance code for solving the incompressible Navier-Stokes equation and as many as you need scalar transport equations. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterXcompact3d Incompact3d 2021-03-11Input: input.i3d 193 Cells Per DirectionXeon Platinum 8380EPYC 8534PNEPYC 8534PXeon Max 9468Xeon Platinum 8490HXeon Max 9480Xeon Platinum 8380 2PXeon Platinum 8592+EPYC 9754EPYC 9654Xeon Max 9468 2PEPYC 9684XXeon Max 9480 2PXeon Platinum 8490H 2PXeon Platinum 8592+ 2PEPYC 9754 2PEPYC 9654 2PEPYC 9684X 2P612182430SE +/- 0.01216869, N = 3SE +/- 0.10237421, N = 3SE +/- 0.01040414, N = 3SE +/- 0.04445674, N = 4SE +/- 0.01004100, N = 4SE +/- 0.01708632, N = 4SE +/- 0.02691998, N = 4SE +/- 0.02923582, N = 4SE +/- 0.03951909, N = 5SE +/- 0.06577912, N = 5SE +/- 0.01741826, N = 5SE +/- 0.05847189, N = 6SE +/- 0.05695382, N = 15SE +/- 0.04312801, N = 5SE +/- 0.03329814, N = 5SE +/- 0.01633300, N = 4SE +/- 0.04312156, N = 5SE +/- 0.00891960, N = 523.9708284021.1780307020.9379139013.9692376012.9293413012.7997582011.2498016010.196706608.872259148.253835117.293491176.881212796.663875106.391698175.391259674.510618934.260785963.753199011. (F9X) gfortran options: -cpp -O2 -funroll-loops -floop-optimize -fcray-pointer -fbacktrace -lmpi_usempif08 -lmpi_mpifh -lmpi -lopen-rte -lopen-pal -lhwloc -levent_core -levent_pthreads -lm -lz
OpenBenchmarking.orgSeconds, Fewer Is BetterXcompact3d Incompact3d 2021-03-11Input: input.i3d 193 Cells Per DirectionXeon Platinum 8380EPYC 8534PNEPYC 8534PXeon Max 9468Xeon Platinum 8490HXeon Max 9480Xeon Platinum 8380 2PXeon Platinum 8592+EPYC 9754EPYC 9654Xeon Max 9468 2PEPYC 9684XXeon Max 9480 2PXeon Platinum 8490H 2PXeon Platinum 8592+ 2PEPYC 9754 2PEPYC 9654 2PEPYC 9684X 2P612182430Min: 23.95 / Avg: 23.97 / Max: 23.98Min: 21.06 / Avg: 21.18 / Max: 21.38Min: 20.92 / Avg: 20.94 / Max: 20.95Min: 13.89 / Avg: 13.97 / Max: 14.08Min: 12.9 / Avg: 12.93 / Max: 12.94Min: 12.76 / Avg: 12.8 / Max: 12.84Min: 11.22 / Avg: 11.25 / Max: 11.33Min: 10.11 / Avg: 10.2 / Max: 10.24Min: 8.77 / Avg: 8.87 / Max: 9Min: 8.09 / Avg: 8.25 / Max: 8.49Min: 7.25 / Avg: 7.29 / Max: 7.35Min: 6.72 / Avg: 6.88 / Max: 7.07Min: 6.44 / Avg: 6.66 / Max: 7.05Min: 6.3 / Avg: 6.39 / Max: 6.5Min: 5.3 / Avg: 5.39 / Max: 5.5Min: 4.49 / Avg: 4.51 / Max: 4.56Min: 4.2 / Avg: 4.26 / Max: 4.43Min: 3.73 / Avg: 3.75 / Max: 3.781. (F9X) gfortran options: -cpp -O2 -funroll-loops -floop-optimize -fcray-pointer -fbacktrace -lmpi_usempif08 -lmpi_mpifh -lmpi -lopen-rte -lopen-pal -lhwloc -levent_core -levent_pthreads -lm -lz

OpenSSL

OpenBenchmarking.orgverify/s, More Is BetterOpenSSL 3.3Algorithm: RSA4096Xeon Platinum 8380Xeon Max 9468Xeon 6766EEPYC 8534PNXeon Max 9480Xeon 6780EEPYC 8534PXeon Platinum 8490HXeon Platinum 8592+Xeon Platinum 8380 2PXeon Max 9468 2PEPYC 9654Xeon 6766E 2PEPYC 9684XXeon Max 9480 2PXeon 6780E 2PEPYC 9754Xeon Platinum 8490H 2PXeon Platinum 8592+ 2PEPYC 9654 2PEPYC 9684X 2PEPYC 9754 2P800K1600K2400K3200K4000KSE +/- 198.68, N = 3SE +/- 165.80, N = 3SE +/- 9.55, N = 3SE +/- 136.07, N = 3SE +/- 200.66, N = 3SE +/- 23.84, N = 3SE +/- 126.84, N = 3SE +/- 92.46, N = 3SE +/- 92.62, N = 3SE +/- 40228.60, N = 3SE +/- 355.69, N = 3SE +/- 149.48, N = 3SE +/- 37.76, N = 3SE +/- 1576.96, N = 3SE +/- 277.84, N = 3SE +/- 205.33, N = 3SE +/- 444.74, N = 3SE +/- 862.96, N = 3SE +/- 6745.42, N = 3SE +/- 5.26, N = 3SE +/- 6125.37, N = 3SE +/- 2222.55, N = 3587354.8697707.2743282.7810291.8813667.6826049.5881480.8974189.91036735.61099481.51395446.41436324.91479879.01613828.71627941.41644363.71872096.11916162.92057021.62861959.83214376.33729470.81. (CC) gcc options: -pthread -m64 -O3 -lssl -lcrypto -ldl
OpenBenchmarking.orgverify/s, More Is BetterOpenSSL 3.3Algorithm: RSA4096Xeon Platinum 8380Xeon Max 9468Xeon 6766EEPYC 8534PNXeon Max 9480Xeon 6780EEPYC 8534PXeon Platinum 8490HXeon Platinum 8592+Xeon Platinum 8380 2PXeon Max 9468 2PEPYC 9654Xeon 6766E 2PEPYC 9684XXeon Max 9480 2PXeon 6780E 2PEPYC 9754Xeon Platinum 8490H 2PXeon Platinum 8592+ 2PEPYC 9654 2PEPYC 9684X 2PEPYC 9754 2P600K1200K1800K2400K3000KMin: 587109.8 / Avg: 587354.77 / Max: 587748.2Min: 697529.8 / Avg: 697707.17 / Max: 698038.5Min: 743271.7 / Avg: 743282.67 / Max: 743301.7Min: 810123.6 / Avg: 810291.83 / Max: 810561.2Min: 813395.8 / Avg: 813667.6 / Max: 814059.2Min: 826006.1 / Avg: 826049.53 / Max: 826088.3Min: 881287.6 / Avg: 881480.83 / Max: 881719.8Min: 974005 / Avg: 974189.87 / Max: 974286.4Min: 1036563.4 / Avg: 1036735.63 / Max: 1036880.8Min: 1035363.1 / Avg: 1099481.47 / Max: 1173631.6Min: 1394736 / Avg: 1395446.43 / Max: 1395833.4Min: 1436117.5 / Avg: 1436324.93 / Max: 1436615.1Min: 1479808.5 / Avg: 1479878.97 / Max: 1479937.7Min: 1612210.9 / Avg: 1613828.73 / Max: 1616982.3Min: 1627415 / Avg: 1627941.37 / Max: 1628358.8Min: 1644084.4 / Avg: 1644363.73 / Max: 1644764.1Min: 1871280.9 / Avg: 1872096.07 / Max: 1872811.9Min: 1914634.4 / Avg: 1916162.9 / Max: 1917621.3Min: 2043628.9 / Avg: 2057021.63 / Max: 2065124.5Min: 2861949.8 / Avg: 2861959.83 / Max: 2861967.6Min: 3207836.3 / Avg: 3214376.33 / Max: 3226617.5Min: 3727222.4 / Avg: 3729470.8 / Max: 3733915.81. (CC) gcc options: -pthread -m64 -O3 -lssl -lcrypto -ldl

OSPRay Studio

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 1.0Camera: 3 - Resolution: 4K - Samples Per Pixel: 16 - Renderer: Path Tracer - Acceleration: CPUXeon Platinum 8380Xeon 6766EXeon 6780EEPYC 8534PNEPYC 8534PXeon 6766E 2PXeon Max 9468Xeon 6780E 2PXeon Max 9480Xeon Platinum 8490HXeon Platinum 8380 2PXeon Platinum 8592+EPYC 9654Xeon Max 9468 2PEPYC 9684XEPYC 9754Xeon Max 9480 2PXeon Platinum 8490H 2PXeon Platinum 8592+ 2PEPYC 9654 2PEPYC 9684X 2PEPYC 9754 2P14K28K42K56K70KSE +/- 62.75, N = 3SE +/- 500.31, N = 3SE +/- 26.58, N = 3SE +/- 197.99, N = 3SE +/- 111.72, N = 3SE +/- 51.90, N = 3SE +/- 36.47, N = 3SE +/- 301.00, N = 12SE +/- 74.33, N = 3SE +/- 61.20, N = 3SE +/- 28.75, N = 3SE +/- 26.00, N = 3SE +/- 5.55, N = 3SE +/- 25.12, N = 3SE +/- 24.66, N = 3SE +/- 21.05, N = 3SE +/- 10.97, N = 3SE +/- 29.96, N = 3SE +/- 8.00, N = 3SE +/- 27.79, N = 3SE +/- 32.79, N = 3SE +/- 16.90, N = 363035576575250148844453774390642837392833923836649348663199322305197011953518129181111683714358124271051410015
OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 1.0Camera: 3 - Resolution: 4K - Samples Per Pixel: 16 - Renderer: Path Tracer - Acceleration: CPUXeon Platinum 8380Xeon 6766EXeon 6780EEPYC 8534PNEPYC 8534PXeon 6766E 2PXeon Max 9468Xeon 6780E 2PXeon Max 9480Xeon Platinum 8490HXeon Platinum 8380 2PXeon Platinum 8592+EPYC 9654Xeon Max 9468 2PEPYC 9684XEPYC 9754Xeon Max 9480 2PXeon Platinum 8490H 2PXeon Platinum 8592+ 2PEPYC 9654 2PEPYC 9684X 2PEPYC 9754 2P11K22K33K44K55KMin: 62941 / Avg: 63035 / Max: 63154Min: 57070 / Avg: 57656.67 / Max: 58652Min: 52448 / Avg: 52501 / Max: 52531Min: 48619 / Avg: 48844.33 / Max: 49239Min: 45183 / Avg: 45377 / Max: 45570Min: 43821 / Avg: 43905.67 / Max: 44000Min: 42766 / Avg: 42837 / Max: 42887Min: 36127 / Avg: 39283.42 / Max: 39907Min: 39114 / Avg: 39238 / Max: 39371Min: 36542 / Avg: 36648.67 / Max: 36754Min: 34820 / Avg: 34866.33 / Max: 34919Min: 31947 / Avg: 31993 / Max: 32037Min: 22296 / Avg: 22304.67 / Max: 22315Min: 19670 / Avg: 19701.33 / Max: 19751Min: 19502 / Avg: 19534.67 / Max: 19583Min: 18090 / Avg: 18129.33 / Max: 18162Min: 18092 / Avg: 18110.67 / Max: 18130Min: 16795 / Avg: 16837 / Max: 16895Min: 14342 / Avg: 14358 / Max: 14366Min: 12374 / Avg: 12427 / Max: 12468Min: 10449 / Avg: 10514 / Max: 10554Min: 9990 / Avg: 10014.67 / Max: 10047

OpenVINO

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Road Segmentation ADAS FP16-INT8 - Device: CPUXeon Platinum 8380Xeon Max 9468Xeon Max 9480EPYC 8534PNXeon 6766EEPYC 8534PXeon 6780EXeon Platinum 8490HXeon Platinum 8592+Xeon Platinum 8380 2PEPYC 9754Xeon Max 9468 2PXeon 6766E 2PEPYC 9654Xeon Max 9480 2PXeon Platinum 8490H 2PXeon 6780E 2PEPYC 9684XXeon Platinum 8592+ 2PEPYC 9654 2PEPYC 9684X 2PEPYC 9754 2P9001800270036004500SE +/- 0.62, N = 3SE +/- 2.29, N = 3SE +/- 2.94, N = 3SE +/- 0.81, N = 3SE +/- 2.69, N = 3SE +/- 0.65, N = 3SE +/- 2.82, N = 3SE +/- 2.65, N = 3SE +/- 0.47, N = 3SE +/- 3.75, N = 3SE +/- 11.41, N = 15SE +/- 1.56, N = 3SE +/- 2.08, N = 3SE +/- 6.85, N = 3SE +/- 1.74, N = 3SE +/- 0.66, N = 3SE +/- 2.23, N = 3SE +/- 1.09, N = 3SE +/- 11.53, N = 3SE +/- 3.90, N = 3SE +/- 5.33, N = 3SE +/- 5.40, N = 3642.44860.64894.87918.53924.90998.091018.181068.431159.661186.241671.231691.791731.501743.491801.891843.611933.082212.412237.693353.734013.964032.661. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Road Segmentation ADAS FP16-INT8 - Device: CPUXeon Platinum 8380Xeon Max 9468Xeon Max 9480EPYC 8534PNXeon 6766EEPYC 8534PXeon 6780EXeon Platinum 8490HXeon Platinum 8592+Xeon Platinum 8380 2PEPYC 9754Xeon Max 9468 2PXeon 6766E 2PEPYC 9654Xeon Max 9480 2PXeon Platinum 8490H 2PXeon 6780E 2PEPYC 9684XXeon Platinum 8592+ 2PEPYC 9654 2PEPYC 9684X 2PEPYC 9754 2P7001400210028003500Min: 641.2 / Avg: 642.44 / Max: 643.07Min: 857.92 / Avg: 860.64 / Max: 865.19Min: 889.09 / Avg: 894.87 / Max: 898.73Min: 916.96 / Avg: 918.53 / Max: 919.63Min: 920 / Avg: 924.9 / Max: 929.28Min: 997.22 / Avg: 998.09 / Max: 999.35Min: 1012.53 / Avg: 1018.18 / Max: 1021.12Min: 1065.34 / Avg: 1068.43 / Max: 1073.71Min: 1159 / Avg: 1159.66 / Max: 1160.57Min: 1179.74 / Avg: 1186.24 / Max: 1192.74Min: 1607.92 / Avg: 1671.23 / Max: 1770.86Min: 1688.93 / Avg: 1691.79 / Max: 1694.3Min: 1728.48 / Avg: 1731.5 / Max: 1735.48Min: 1733.4 / Avg: 1743.49 / Max: 1756.55Min: 1799.84 / Avg: 1801.89 / Max: 1805.36Min: 1842.38 / Avg: 1843.61 / Max: 1844.65Min: 1928.73 / Avg: 1933.08 / Max: 1936.09Min: 2210.7 / Avg: 2212.41 / Max: 2214.44Min: 2214.76 / Avg: 2237.69 / Max: 2251.29Min: 3345.97 / Avg: 3353.73 / Max: 3358.21Min: 4007.3 / Avg: 4013.96 / Max: 4024.51Min: 4026.19 / Avg: 4032.66 / Max: 4043.381. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

ACES DGEMM

This is a multi-threaded DGEMM benchmark. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgGFLOP/s, More Is BetterACES DGEMM 1.0Sustained Floating-Point RateXeon Platinum 8380Xeon 6766EXeon 6780EXeon Max 9468EPYC 8534PNEPYC 8534PXeon Max 9480Xeon Platinum 8490HXeon Platinum 8380 2PXeon Platinum 8592+Xeon 6766E 2PXeon 6780E 2PEPYC 9654Xeon Max 9468 2PXeon Max 9480 2PEPYC 9754EPYC 9684XXeon Platinum 8490H 2PXeon Platinum 8592+ 2PEPYC 9654 2PEPYC 9684X 2PEPYC 9754 2P20406080100SE +/- 0.01, N = 3SE +/- 0.01, N = 4SE +/- 0.01, N = 4SE +/- 0.04, N = 4SE +/- 0.10, N = 5SE +/- 0.16, N = 5SE +/- 0.09, N = 5SE +/- 0.09, N = 5SE +/- 0.09, N = 5SE +/- 0.08, N = 6SE +/- 0.03, N = 6SE +/- 0.04, N = 6SE +/- 0.22, N = 7SE +/- 0.06, N = 7SE +/- 0.04, N = 7SE +/- 0.17, N = 7SE +/- 0.40, N = 7SE +/- 0.28, N = 7SE +/- 0.11, N = 8SE +/- 0.10, N = 9SE +/- 0.39, N = 9SE +/- 0.19, N = 1013.4915.9417.8519.7721.0021.8222.5423.5424.9729.1431.4835.2039.0939.3544.6744.9745.2545.9758.2568.8778.5084.691. (CC) gcc options: -O3 -march=native -fopenmp
OpenBenchmarking.orgGFLOP/s, More Is BetterACES DGEMM 1.0Sustained Floating-Point RateXeon Platinum 8380Xeon 6766EXeon 6780EXeon Max 9468EPYC 8534PNEPYC 8534PXeon Max 9480Xeon Platinum 8490HXeon Platinum 8380 2PXeon Platinum 8592+Xeon 6766E 2PXeon 6780E 2PEPYC 9654Xeon Max 9468 2PXeon Max 9480 2PEPYC 9754EPYC 9684XXeon Platinum 8490H 2PXeon Platinum 8592+ 2PEPYC 9654 2PEPYC 9684X 2PEPYC 9754 2P1632486480Min: 13.47 / Avg: 13.49 / Max: 13.51Min: 15.92 / Avg: 15.94 / Max: 15.97Min: 17.84 / Avg: 17.85 / Max: 17.87Min: 19.64 / Avg: 19.77 / Max: 19.83Min: 20.68 / Avg: 21 / Max: 21.32Min: 21.25 / Avg: 21.82 / Max: 22.23Min: 22.19 / Avg: 22.54 / Max: 22.74Min: 23.19 / Avg: 23.54 / Max: 23.66Min: 24.74 / Avg: 24.97 / Max: 25.16Min: 28.91 / Avg: 29.14 / Max: 29.35Min: 31.4 / Avg: 31.48 / Max: 31.58Min: 35.04 / Avg: 35.2 / Max: 35.28Min: 38.21 / Avg: 39.09 / Max: 39.83Min: 39.07 / Avg: 39.35 / Max: 39.58Min: 44.57 / Avg: 44.67 / Max: 44.81Min: 44.5 / Avg: 44.97 / Max: 45.81Min: 43.45 / Avg: 45.25 / Max: 46.29Min: 44.71 / Avg: 45.97 / Max: 47.18Min: 57.76 / Avg: 58.25 / Max: 58.71Min: 68.45 / Avg: 68.87 / Max: 69.29Min: 76.72 / Avg: 78.5 / Max: 80.31Min: 83.93 / Avg: 84.69 / Max: 85.991. (CC) gcc options: -O3 -march=native -fopenmp

Helsing

Helsing is an open-source POSIX vampire number generator. This test profile measures the time it takes to generate vampire numbers between varying numbers of digits. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterHelsing 1.0-betaDigit Range: 14 digitXeon Platinum 8380Xeon Max 9468EPYC 8534PNXeon 6766EXeon Max 9480EPYC 8534PXeon 6780EXeon Platinum 8490HXeon Platinum 8592+Xeon Platinum 8380 2PXeon Max 9468 2PEPYC 9654Xeon 6766E 2PXeon Max 9480 2PEPYC 9684XXeon 6780E 2PXeon Platinum 8490H 2PEPYC 9754Xeon Platinum 8592+ 2PEPYC 9654 2PEPYC 9684X 2PEPYC 9754 2P4080120160200SE +/- 0.08, N = 3SE +/- 0.53, N = 3SE +/- 0.06, N = 3SE +/- 0.12, N = 3SE +/- 0.12, N = 3SE +/- 0.27, N = 3SE +/- 0.10, N = 3SE +/- 0.26, N = 3SE +/- 0.08, N = 3SE +/- 0.09, N = 3SE +/- 0.11, N = 3SE +/- 0.10, N = 3SE +/- 0.11, N = 3SE +/- 0.42, N = 3SE +/- 0.14, N = 3SE +/- 0.01, N = 3SE +/- 0.06, N = 3SE +/- 0.02, N = 3SE +/- 0.07, N = 3SE +/- 0.38, N = 5SE +/- 0.42, N = 3SE +/- 0.32, N = 3165.79123.83120.56115.46107.24105.68103.8693.3589.0782.9665.0362.1758.9658.2556.9153.0250.8348.8548.0933.6830.6926.781. (CC) gcc options: -O2 -pthread
OpenBenchmarking.orgSeconds, Fewer Is BetterHelsing 1.0-betaDigit Range: 14 digitXeon Platinum 8380Xeon Max 9468EPYC 8534PNXeon 6766EXeon Max 9480EPYC 8534PXeon 6780EXeon Platinum 8490HXeon Platinum 8592+Xeon Platinum 8380 2PXeon Max 9468 2PEPYC 9654Xeon 6766E 2PXeon Max 9480 2PEPYC 9684XXeon 6780E 2PXeon Platinum 8490H 2PEPYC 9754Xeon Platinum 8592+ 2PEPYC 9654 2PEPYC 9684X 2PEPYC 9754 2P306090120150Min: 165.64 / Avg: 165.79 / Max: 165.9Min: 122.82 / Avg: 123.83 / Max: 124.63Min: 120.45 / Avg: 120.56 / Max: 120.67Min: 115.31 / Avg: 115.46 / Max: 115.69Min: 107.01 / Avg: 107.24 / Max: 107.36Min: 105.32 / Avg: 105.68 / Max: 106.2Min: 103.68 / Avg: 103.86 / Max: 104.03Min: 92.89 / Avg: 93.35 / Max: 93.78Min: 88.98 / Avg: 89.07 / Max: 89.23Min: 82.83 / Avg: 82.96 / Max: 83.14Min: 64.83 / Avg: 65.03 / Max: 65.19Min: 61.99 / Avg: 62.17 / Max: 62.32Min: 58.74 / Avg: 58.96 / Max: 59.06Min: 57.64 / Avg: 58.25 / Max: 59.05Min: 56.73 / Avg: 56.91 / Max: 57.19Min: 53 / Avg: 53.01 / Max: 53.03Min: 50.71 / Avg: 50.83 / Max: 50.93Min: 48.82 / Avg: 48.85 / Max: 48.88Min: 47.96 / Avg: 48.09 / Max: 48.21Min: 32.89 / Avg: 33.68 / Max: 35.05Min: 29.91 / Avg: 30.69 / Max: 31.35Min: 26.27 / Avg: 26.78 / Max: 27.351. (CC) gcc options: -O2 -pthread

Algebraic Multi-Grid Benchmark

AMG is a parallel algebraic multigrid solver for linear systems arising from problems on unstructured grids. The driver provided with AMG builds linear systems for various 3-dimensional problems. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgFigure Of Merit, More Is BetterAlgebraic Multi-Grid Benchmark 1.2Xeon Platinum 8380 2PXeon Platinum 8380EPYC 8534PNEPYC 8534PXeon Max 9468Xeon Max 9480Xeon Platinum 8490HXeon Platinum 8592+EPYC 9754EPYC 9654EPYC 9684XEPYC 9754 2PXeon Platinum 8490H 2PXeon Max 9468 2PXeon Max 9480 2PXeon Platinum 8592+ 2PEPYC 9654 2PEPYC 9684X 2P1000M2000M3000M4000M5000MSE +/- 467864.03, N = 3SE +/- 971797.70, N = 3SE +/- 291866.98, N = 3SE +/- 2902028.33, N = 3SE +/- 3359086.30, N = 3SE +/- 1778769.08, N = 3SE +/- 468935.32, N = 3SE +/- 4000850.45, N = 3SE +/- 433397.56, N = 3SE +/- 1066998.75, N = 3SE +/- 4963892.66, N = 3SE +/- 235140242.43, N = 12SE +/- 2438223.49, N = 3SE +/- 7233468.75, N = 3SE +/- 9164253.67, N = 3SE +/- 9014927.20, N = 3SE +/- 8808919.44, N = 3SE +/- 6340323.98, N = 3723153533107362766711471080001150052667158849666715979933331605097000181476000022753526672282802000237614900027830390833124402667315626166732051610003609646333432493033344672813331. (CC) gcc options: -lparcsr_ls -lparcsr_mv -lseq_mv -lIJ_mv -lkrylov -lHYPRE_utilities -lm -fopenmp -lmpi
OpenBenchmarking.orgFigure Of Merit, More Is BetterAlgebraic Multi-Grid Benchmark 1.2Xeon Platinum 8380 2PXeon Platinum 8380EPYC 8534PNEPYC 8534PXeon Max 9468Xeon Max 9480Xeon Platinum 8490HXeon Platinum 8592+EPYC 9754EPYC 9654EPYC 9684XEPYC 9754 2PXeon Platinum 8490H 2PXeon Max 9468 2PXeon Max 9480 2PXeon Platinum 8592+ 2PEPYC 9654 2PEPYC 9684X 2P800M1600M2400M3200M4000MMin: 722670700 / Avg: 723153533.33 / Max: 724089100Min: 1072398000 / Avg: 1073627666.67 / Max: 1075546000Min: 1146561000 / Avg: 1147108000 / Max: 1147558000Min: 1144250000 / Avg: 1150052666.67 / Max: 1153064000Min: 1583443000 / Avg: 1588496666.67 / Max: 1594857000Min: 1594535000 / Avg: 1597993333.33 / Max: 1600445000Min: 1604196000 / Avg: 1605097000 / Max: 1605773000Min: 1808063000 / Avg: 1814760000 / Max: 1821901000Min: 2274545000 / Avg: 2275352666.67 / Max: 2276029000Min: 2280669000 / Avg: 2282802000 / Max: 2283925000Min: 2370008000 / Avg: 2376149000 / Max: 2385975000Min: 2302586000 / Avg: 2783039083.33 / Max: 4283742000Min: 3119972000 / Avg: 3124402666.67 / Max: 3128382000Min: 3148914000 / Avg: 3156261666.67 / Max: 3170728000Min: 3187407000 / Avg: 3205161000 / Max: 3217981000Min: 3594221000 / Avg: 3609646333.33 / Max: 3625443000Min: 4313689000 / Avg: 4324930333.33 / Max: 4342299000Min: 4459287000 / Avg: 4467281333.33 / Max: 44798030001. (CC) gcc options: -lparcsr_ls -lparcsr_mv -lseq_mv -lIJ_mv -lkrylov -lHYPRE_utilities -lm -fopenmp -lmpi

OSPRay Studio

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 1.0Camera: 1 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path Tracer - Acceleration: CPUXeon Platinum 8380Xeon 6766EXeon 6780EEPYC 8534PNEPYC 8534PXeon Max 9468Xeon Max 9480Xeon 6766E 2PXeon Platinum 8490HXeon 6780E 2PXeon Platinum 8380 2PXeon Platinum 8592+EPYC 9654Xeon Max 9468 2PEPYC 9684XEPYC 9754Xeon Max 9480 2PXeon Platinum 8490H 2PXeon Platinum 8592+ 2PEPYC 9654 2PEPYC 9684X 2PEPYC 9754 2P20K40K60K80K100KSE +/- 175.68, N = 3SE +/- 541.85, N = 3SE +/- 424.84, N = 3SE +/- 346.19, N = 3SE +/- 172.59, N = 3SE +/- 134.33, N = 3SE +/- 64.91, N = 3SE +/- 739.02, N = 15SE +/- 102.40, N = 3SE +/- 605.82, N = 15SE +/- 152.29, N = 3SE +/- 90.37, N = 3SE +/- 42.05, N = 3SE +/- 37.55, N = 3SE +/- 193.23, N = 3SE +/- 312.83, N = 12SE +/- 13.86, N = 3SE +/- 64.24, N = 3SE +/- 16.05, N = 3SE +/- 109.43, N = 3SE +/- 14.62, N = 3SE +/- 47.34, N = 3103461885798100378093720516897362540624495802656082552475079843290389263864537383361793341124249207501785516960
OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 1.0Camera: 1 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path Tracer - Acceleration: CPUXeon Platinum 8380Xeon 6766EXeon 6780EEPYC 8534PNEPYC 8534PXeon Max 9468Xeon Max 9480Xeon 6766E 2PXeon Platinum 8490HXeon 6780E 2PXeon Platinum 8380 2PXeon Platinum 8592+EPYC 9654Xeon Max 9468 2PEPYC 9684XEPYC 9754Xeon Max 9480 2PXeon Platinum 8490H 2PXeon Platinum 8592+ 2PEPYC 9654 2PEPYC 9684X 2PEPYC 9754 2P20K40K60K80K100KMin: 103110 / Avg: 103460.67 / Max: 103655Min: 87623 / Avg: 88579 / Max: 89499Min: 80574 / Avg: 81003.33 / Max: 81853Min: 77422 / Avg: 78092.67 / Max: 78577Min: 71706 / Avg: 72051 / Max: 72233Min: 68712 / Avg: 68973.33 / Max: 69158Min: 62411 / Avg: 62539.67 / Max: 62619Min: 57481 / Avg: 62449.07 / Max: 65162Min: 57887 / Avg: 58026.33 / Max: 58226Min: 51861 / Avg: 56082.13 / Max: 58571Min: 54961 / Avg: 55246.67 / Max: 55481Min: 50683 / Avg: 50797.67 / Max: 50976Min: 43212 / Avg: 43290.33 / Max: 43356Min: 38866 / Avg: 38925.67 / Max: 38995Min: 38278 / Avg: 38645.33 / Max: 38933Min: 36477 / Avg: 37383.08 / Max: 40725Min: 36158 / Avg: 36178.67 / Max: 36205Min: 33291 / Avg: 33410.67 / Max: 33511Min: 24217 / Avg: 24248.67 / Max: 24269Min: 20563 / Avg: 20750.33 / Max: 20942Min: 17828 / Avg: 17855.33 / Max: 17878Min: 16873 / Avg: 16959.67 / Max: 17036

Blender

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 4.1Blend File: Fishy Cat - Compute: CPU-OnlyXeon Platinum 8380Xeon Max 9468Xeon Max 9480EPYC 8534PNXeon Platinum 8490HEPYC 8534PXeon Platinum 8592+Xeon Platinum 8380 2PXeon 6766EXeon 6780EXeon Max 9468 2PXeon Max 9480 2PEPYC 9654Xeon Platinum 8490H 2PEPYC 9684XXeon Platinum 8592+ 2PEPYC 9754Xeon 6766E 2PXeon 6780E 2PEPYC 9654 2PEPYC 9684X 2PEPYC 9754 2P1326395265SE +/- 0.15, N = 3SE +/- 0.17, N = 3SE +/- 0.04, N = 3SE +/- 0.07, N = 3SE +/- 0.11, N = 3SE +/- 0.23, N = 3SE +/- 0.06, N = 3SE +/- 0.27, N = 3SE +/- 0.37, N = 3SE +/- 0.08, N = 3SE +/- 0.13, N = 3SE +/- 0.18, N = 3SE +/- 0.11, N = 3SE +/- 0.08, N = 3SE +/- 0.07, N = 3SE +/- 0.04, N = 3SE +/- 0.13, N = 3SE +/- 0.05, N = 3SE +/- 0.01, N = 4SE +/- 0.05, N = 4SE +/- 0.02, N = 5SE +/- 0.04, N = 559.1542.7838.4838.0434.8334.3531.9130.7529.5526.5223.1721.4520.1519.1318.3617.2916.5816.5215.1611.2510.169.71
OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 4.1Blend File: Fishy Cat - Compute: CPU-OnlyXeon Platinum 8380Xeon Max 9468Xeon Max 9480EPYC 8534PNXeon Platinum 8490HEPYC 8534PXeon Platinum 8592+Xeon Platinum 8380 2PXeon 6766EXeon 6780EXeon Max 9468 2PXeon Max 9480 2PEPYC 9654Xeon Platinum 8490H 2PEPYC 9684XXeon Platinum 8592+ 2PEPYC 9754Xeon 6766E 2PXeon 6780E 2PEPYC 9654 2PEPYC 9684X 2PEPYC 9754 2P1224364860Min: 58.87 / Avg: 59.15 / Max: 59.4Min: 42.54 / Avg: 42.78 / Max: 43.11Min: 38.44 / Avg: 38.48 / Max: 38.56Min: 37.91 / Avg: 38.04 / Max: 38.14Min: 34.66 / Avg: 34.83 / Max: 35.05Min: 34.02 / Avg: 34.35 / Max: 34.8Min: 31.84 / Avg: 31.91 / Max: 32.02Min: 30.4 / Avg: 30.75 / Max: 31.28Min: 29.02 / Avg: 29.55 / Max: 30.26Min: 26.36 / Avg: 26.52 / Max: 26.63Min: 23 / Avg: 23.17 / Max: 23.42Min: 21.14 / Avg: 21.45 / Max: 21.75Min: 19.99 / Avg: 20.15 / Max: 20.37Min: 19.01 / Avg: 19.13 / Max: 19.28Min: 18.23 / Avg: 18.36 / Max: 18.45Min: 17.22 / Avg: 17.29 / Max: 17.37Min: 16.42 / Avg: 16.58 / Max: 16.84Min: 16.42 / Avg: 16.52 / Max: 16.58Min: 15.12 / Avg: 15.16 / Max: 15.18Min: 11.13 / Avg: 11.25 / Max: 11.35Min: 10.09 / Avg: 10.16 / Max: 10.21Min: 9.57 / Avg: 9.71 / Max: 9.77

m-queens

A solver for the N-queens problem with multi-threading support via the OpenMP library. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is Betterm-queens 1.2Time To SolveXeon Platinum 8380Xeon Max 9468Xeon Max 9480Xeon Platinum 8490HEPYC 8534PNXeon Platinum 8592+EPYC 8534PXeon Platinum 8380 2PXeon 6766EXeon Max 9468 2PXeon 6780EXeon Max 9480 2PXeon Platinum 8490H 2PEPYC 9654Xeon Platinum 8592+ 2PEPYC 9684XEPYC 9754Xeon 6766E 2PXeon 6780E 2PEPYC 9654 2PEPYC 9684X 2PEPYC 9754 2P612182430SE +/- 0.023, N = 3SE +/- 0.031, N = 3SE +/- 0.035, N = 3SE +/- 0.025, N = 4SE +/- 0.029, N = 4SE +/- 0.030, N = 4SE +/- 0.019, N = 4SE +/- 0.066, N = 4SE +/- 0.039, N = 5SE +/- 0.021, N = 5SE +/- 0.032, N = 5SE +/- 0.028, N = 5SE +/- 0.021, N = 6SE +/- 0.019, N = 6SE +/- 0.028, N = 6SE +/- 0.025, N = 6SE +/- 0.021, N = 6SE +/- 0.035, N = 7SE +/- 0.034, N = 7SE +/- 0.093, N = 15SE +/- 0.064, N = 15SE +/- 0.031, N = 824.17521.03018.10215.21114.49314.25713.25012.39011.47910.84010.3019.2857.8817.7387.4026.9506.3506.0455.5124.6094.1333.9811. (CXX) g++ options: -fopenmp -O2 -march=native
OpenBenchmarking.orgSeconds, Fewer Is Betterm-queens 1.2Time To SolveXeon Platinum 8380Xeon Max 9468Xeon Max 9480Xeon Platinum 8490HEPYC 8534PNXeon Platinum 8592+EPYC 8534PXeon Platinum 8380 2PXeon 6766EXeon Max 9468 2PXeon 6780EXeon Max 9480 2PXeon Platinum 8490H 2PEPYC 9654Xeon Platinum 8592+ 2PEPYC 9684XEPYC 9754Xeon 6766E 2PXeon 6780E 2PEPYC 9654 2PEPYC 9684X 2PEPYC 9754 2P612182430Min: 24.15 / Avg: 24.18 / Max: 24.22Min: 21 / Avg: 21.03 / Max: 21.09Min: 18.04 / Avg: 18.1 / Max: 18.16Min: 15.14 / Avg: 15.21 / Max: 15.26Min: 14.43 / Avg: 14.49 / Max: 14.56Min: 14.2 / Avg: 14.26 / Max: 14.31Min: 13.21 / Avg: 13.25 / Max: 13.3Min: 12.21 / Avg: 12.39 / Max: 12.5Min: 11.34 / Avg: 11.48 / Max: 11.57Min: 10.77 / Avg: 10.84 / Max: 10.89Min: 10.21 / Avg: 10.3 / Max: 10.39Min: 9.2 / Avg: 9.28 / Max: 9.37Min: 7.83 / Avg: 7.88 / Max: 7.95Min: 7.69 / Avg: 7.74 / Max: 7.83Min: 7.29 / Avg: 7.4 / Max: 7.48Min: 6.86 / Avg: 6.95 / Max: 7.04Min: 6.28 / Avg: 6.35 / Max: 6.41Min: 5.98 / Avg: 6.05 / Max: 6.23Min: 5.36 / Avg: 5.51 / Max: 5.62Min: 4.2 / Avg: 4.61 / Max: 5.14Min: 3.95 / Avg: 4.13 / Max: 4.79Min: 3.87 / Avg: 3.98 / Max: 4.11. (CXX) g++ options: -fopenmp -O2 -march=native

OSPRay Studio

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 1.0Camera: 3 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path Tracer - Acceleration: CPUXeon Platinum 8380Xeon 6766EXeon 6780EEPYC 8534PNEPYC 8534PXeon Max 9468Xeon Max 9480Xeon 6766E 2PXeon Platinum 8490HXeon 6780E 2PXeon Platinum 8380 2PXeon Platinum 8592+EPYC 9654Xeon Max 9468 2PEPYC 9684XEPYC 9754Xeon Max 9480 2PXeon Platinum 8490H 2PXeon Platinum 8592+ 2PEPYC 9654 2PEPYC 9684X 2PEPYC 9754 2P30K60K90K120K150KSE +/- 623.29, N = 3SE +/- 365.52, N = 3SE +/- 189.03, N = 3SE +/- 13.58, N = 3SE +/- 29.36, N = 3SE +/- 41.33, N = 3SE +/- 65.97, N = 3SE +/- 900.17, N = 15SE +/- 58.68, N = 3SE +/- 176.25, N = 3SE +/- 32.38, N = 3SE +/- 162.52, N = 3SE +/- 231.95, N = 3SE +/- 155.80, N = 3SE +/- 89.57, N = 3SE +/- 50.97, N = 3SE +/- 141.04, N = 3SE +/- 125.33, N = 3SE +/- 47.16, N = 3SE +/- 756.08, N = 15SE +/- 27.74, N = 3SE +/- 28.11, N = 31217341014449217591643842618074273366715836800666487641885952250019452114434942945419713881333391279432089320071
OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 1.0Camera: 3 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path Tracer - Acceleration: CPUXeon Platinum 8380Xeon 6766EXeon 6780EEPYC 8534PNEPYC 8534PXeon Max 9468Xeon Max 9480Xeon 6766E 2PXeon Platinum 8490HXeon 6780E 2PXeon Platinum 8380 2PXeon Platinum 8592+EPYC 9654Xeon Max 9468 2PEPYC 9684XEPYC 9754Xeon Max 9480 2PXeon Platinum 8490H 2PXeon Platinum 8592+ 2PEPYC 9654 2PEPYC 9684X 2PEPYC 9754 2P20K40K60K80K100KMin: 120940 / Avg: 121733.67 / Max: 122963Min: 100967 / Avg: 101443.67 / Max: 102162Min: 91959 / Avg: 92175.33 / Max: 92552Min: 91627 / Avg: 91643 / Max: 91670Min: 84202 / Avg: 84260.67 / Max: 84292Min: 80692 / Avg: 80742 / Max: 80824Min: 73275 / Avg: 73365.67 / Max: 73494Min: 64731 / Avg: 71583.2 / Max: 75438Min: 67889 / Avg: 68005.67 / Max: 68075Min: 66301 / Avg: 66486.67 / Max: 66839Min: 64123 / Avg: 64187.67 / Max: 64223Min: 59240 / Avg: 59521.67 / Max: 59803Min: 49626 / Avg: 50019.33 / Max: 50429Min: 44930 / Avg: 45211.33 / Max: 45468Min: 44186 / Avg: 44348.67 / Max: 44495Min: 42869 / Avg: 42945.33 / Max: 43042Min: 41773 / Avg: 41971 / Max: 42244Min: 38562 / Avg: 38812.67 / Max: 38938Min: 33306 / Avg: 33390.67 / Max: 33469Min: 24809 / Avg: 27943.07 / Max: 30937Min: 20846 / Avg: 20892.67 / Max: 20942Min: 20031 / Avg: 20070.67 / Max: 20125

miniBUDE

MiniBUDE is a mini application for the the core computation of the Bristol University Docking Engine (BUDE). This test profile currently makes use of the OpenMP implementation of miniBUDE for CPU benchmarking. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgBillion Interactions/s, More Is BetterminiBUDE 20210901Implementation: OpenMP - Input Deck: BM1Xeon 6766EXeon 6780EXeon Platinum 8380Xeon Max 9468Xeon Max 9480Xeon 6766E 2PXeon Platinum 8490HXeon 6780E 2PXeon Platinum 8380 2PEPYC 8534PNXeon Platinum 8592+EPYC 8534PXeon Max 9468 2PXeon Max 9480 2PXeon Platinum 8490H 2PEPYC 9654EPYC 9684XXeon Platinum 8592+ 2PEPYC 9754 2PEPYC 9654 2PEPYC 9754EPYC 9684X 2P50100150200250SE +/- 0.02, N = 3SE +/- 0.01, N = 3SE +/- 0.38, N = 9SE +/- 0.12, N = 4SE +/- 0.84, N = 15SE +/- 0.05, N = 5SE +/- 0.61, N = 5SE +/- 0.46, N = 15SE +/- 1.19, N = 15SE +/- 0.03, N = 6SE +/- 0.20, N = 6SE +/- 0.04, N = 6SE +/- 1.28, N = 12SE +/- 1.85, N = 12SE +/- 0.81, N = 7SE +/- 1.18, N = 7SE +/- 3.27, N = 13SE +/- 1.02, N = 8SE +/- 3.98, N = 15SE +/- 2.97, N = 13SE +/- 0.70, N = 9SE +/- 6.15, N = 1239.1743.5547.2663.6270.8476.6082.8584.3585.2998.21106.40107.35108.40114.90133.63136.95151.95199.73214.62217.85229.91236.611. (CC) gcc options: -std=c99 -Ofast -ffast-math -fopenmp -march=native -lm
OpenBenchmarking.orgBillion Interactions/s, More Is BetterminiBUDE 20210901Implementation: OpenMP - Input Deck: BM1Xeon 6766EXeon 6780EXeon Platinum 8380Xeon Max 9468Xeon Max 9480Xeon 6766E 2PXeon Platinum 8490HXeon 6780E 2PXeon Platinum 8380 2PEPYC 8534PNXeon Platinum 8592+EPYC 8534PXeon Max 9468 2PXeon Max 9480 2PXeon Platinum 8490H 2PEPYC 9654EPYC 9684XXeon Platinum 8592+ 2PEPYC 9754 2PEPYC 9654 2PEPYC 9754EPYC 9684X 2P4080120160200Min: 39.13 / Avg: 39.17 / Max: 39.19Min: 43.53 / Avg: 43.55 / Max: 43.57Min: 44.39 / Avg: 47.26 / Max: 47.97Min: 63.4 / Avg: 63.62 / Max: 63.94Min: 65.44 / Avg: 70.84 / Max: 75.47Min: 76.39 / Avg: 76.6 / Max: 76.67Min: 81.26 / Avg: 82.85 / Max: 83.99Min: 78.04 / Avg: 84.35 / Max: 85.43Min: 68.79 / Avg: 85.29 / Max: 87.18Min: 98.05 / Avg: 98.21 / Max: 98.27Min: 105.99 / Avg: 106.4 / Max: 107.33Min: 107.23 / Avg: 107.35 / Max: 107.45Min: 100.57 / Avg: 108.4 / Max: 116.86Min: 99.31 / Avg: 114.9 / Max: 122.85Min: 130.38 / Avg: 133.63 / Max: 135.93Min: 134 / Avg: 136.95 / Max: 143.66Min: 143.74 / Avg: 151.95 / Max: 187.34Min: 193.37 / Avg: 199.73 / Max: 203.55Min: 182.87 / Avg: 214.62 / Max: 244.32Min: 206.23 / Avg: 217.85 / Max: 244.93Min: 226.45 / Avg: 229.91 / Max: 232.06Min: 210.08 / Avg: 236.61 / Max: 273.231. (CC) gcc options: -std=c99 -Ofast -ffast-math -fopenmp -march=native -lm

OpenBenchmarking.orgGFInst/s, More Is BetterminiBUDE 20210901Implementation: OpenMP - Input Deck: BM1Xeon 6766EXeon 6780EXeon Platinum 8380Xeon Max 9468Xeon Max 9480Xeon 6766E 2PXeon Platinum 8490HXeon 6780E 2PXeon Platinum 8380 2PEPYC 8534PNXeon Platinum 8592+EPYC 8534PXeon Max 9468 2PXeon Max 9480 2PXeon Platinum 8490H 2PEPYC 9654EPYC 9684XXeon Platinum 8592+ 2PEPYC 9754 2PEPYC 9654 2PEPYC 9754EPYC 9684X 2P13002600390052006500SE +/- 0.46, N = 3SE +/- 0.29, N = 3SE +/- 9.38, N = 9SE +/- 2.91, N = 4SE +/- 21.10, N = 15SE +/- 1.36, N = 5SE +/- 15.23, N = 5SE +/- 11.58, N = 15SE +/- 29.84, N = 15SE +/- 0.82, N = 6SE +/- 5.07, N = 6SE +/- 0.97, N = 6SE +/- 32.01, N = 12SE +/- 46.19, N = 12SE +/- 20.15, N = 7SE +/- 29.52, N = 7SE +/- 81.83, N = 13SE +/- 25.44, N = 8SE +/- 99.42, N = 15SE +/- 74.36, N = 13SE +/- 17.54, N = 9SE +/- 153.85, N = 12979.281088.831181.491590.501771.071915.042071.192108.682132.242455.162659.882683.832709.932872.563340.693423.633798.704993.345365.425446.165747.825915.251. (CC) gcc options: -std=c99 -Ofast -ffast-math -fopenmp -march=native -lm
OpenBenchmarking.orgGFInst/s, More Is BetterminiBUDE 20210901Implementation: OpenMP - Input Deck: BM1Xeon 6766EXeon 6780EXeon Platinum 8380Xeon Max 9468Xeon Max 9480Xeon 6766E 2PXeon Platinum 8490HXeon 6780E 2PXeon Platinum 8380 2PEPYC 8534PNXeon Platinum 8592+EPYC 8534PXeon Max 9468 2PXeon Max 9480 2PXeon Platinum 8490H 2PEPYC 9654EPYC 9684XXeon Platinum 8592+ 2PEPYC 9754 2PEPYC 9654 2PEPYC 9754EPYC 9684X 2P10002000300040005000Min: 978.36 / Avg: 979.28 / Max: 979.76Min: 1088.25 / Avg: 1088.83 / Max: 1089.2Min: 1109.8 / Avg: 1181.49 / Max: 1199.23Min: 1585.04 / Avg: 1590.5 / Max: 1598.58Min: 1636 / Avg: 1771.07 / Max: 1886.65Min: 1909.68 / Avg: 1915.04 / Max: 1916.77Min: 2031.44 / Avg: 2071.19 / Max: 2099.76Min: 1951 / Avg: 2108.68 / Max: 2135.62Min: 1719.71 / Avg: 2132.23 / Max: 2179.52Min: 2451.29 / Avg: 2455.16 / Max: 2456.63Min: 2649.69 / Avg: 2659.88 / Max: 2683.19Min: 2680.65 / Avg: 2683.83 / Max: 2686.26Min: 2514.13 / Avg: 2709.93 / Max: 2921.44Min: 2482.82 / Avg: 2872.56 / Max: 3071.28Min: 3259.48 / Avg: 3340.69 / Max: 3398.22Min: 3349.91 / Avg: 3423.63 / Max: 3591.57Min: 3593.47 / Avg: 3798.7 / Max: 4683.59Min: 4834.27 / Avg: 4993.34 / Max: 5088.63Min: 4571.79 / Avg: 5365.42 / Max: 6108.01Min: 5155.8 / Avg: 5446.16 / Max: 6123.35Min: 5661.25 / Avg: 5747.82 / Max: 5801.58Min: 5252.04 / Avg: 5915.25 / Max: 6830.621. (CC) gcc options: -std=c99 -Ofast -ffast-math -fopenmp -march=native -lm

OpenVINO

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Vehicle Detection FP16-INT8 - Device: CPUXeon Platinum 8380Xeon 6766EXeon 6780EEPYC 8534PNXeon Max 9480Xeon Max 9468EPYC 8534PXeon Platinum 8490HXeon 6766E 2PXeon Platinum 8380 2PXeon Platinum 8592+Xeon 6780E 2PXeon Platinum 8490H 2PXeon Max 9480 2PEPYC 9654Xeon Max 9468 2PEPYC 9754EPYC 9684XXeon Platinum 8592+ 2PEPYC 9654 2PEPYC 9684X 2PEPYC 9754 2P3K6K9K12K15KSE +/- 1.06, N = 3SE +/- 1.12, N = 3SE +/- 2.61, N = 3SE +/- 2.89, N = 3SE +/- 5.68, N = 3SE +/- 8.09, N = 3SE +/- 2.22, N = 3SE +/- 0.81, N = 3SE +/- 8.74, N = 3SE +/- 2.84, N = 3SE +/- 0.73, N = 3SE +/- 5.08, N = 3SE +/- 11.51, N = 3SE +/- 8.70, N = 3SE +/- 8.39, N = 3SE +/- 4.11, N = 3SE +/- 66.33, N = 15SE +/- 3.54, N = 3SE +/- 6.25, N = 3SE +/- 4.21, N = 3SE +/- 4.04, N = 3SE +/- 1.24, N = 32120.332366.832553.552763.482877.322935.472943.083325.904376.094390.814656.924992.785483.815525.565528.155576.865778.516017.198719.3710708.9111735.4212750.591. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Vehicle Detection FP16-INT8 - Device: CPUXeon Platinum 8380Xeon 6766EXeon 6780EEPYC 8534PNXeon Max 9480Xeon Max 9468EPYC 8534PXeon Platinum 8490HXeon 6766E 2PXeon Platinum 8380 2PXeon Platinum 8592+Xeon 6780E 2PXeon Platinum 8490H 2PXeon Max 9480 2PEPYC 9654Xeon Max 9468 2PEPYC 9754EPYC 9684XXeon Platinum 8592+ 2PEPYC 9654 2PEPYC 9684X 2PEPYC 9754 2P2K4K6K8K10KMin: 2118.64 / Avg: 2120.33 / Max: 2122.28Min: 2364.79 / Avg: 2366.83 / Max: 2368.66Min: 2548.44 / Avg: 2553.55 / Max: 2557.03Min: 2759.81 / Avg: 2763.48 / Max: 2769.18Min: 2867.21 / Avg: 2877.32 / Max: 2886.87Min: 2921.65 / Avg: 2935.47 / Max: 2949.68Min: 2939.36 / Avg: 2943.08 / Max: 2947.04Min: 3324.4 / Avg: 3325.9 / Max: 3327.18Min: 4363.16 / Avg: 4376.09 / Max: 4392.75Min: 4385.74 / Avg: 4390.81 / Max: 4395.56Min: 4656.19 / Avg: 4656.92 / Max: 4658.37Min: 4984.39 / Avg: 4992.78 / Max: 5001.93Min: 5460.82 / Avg: 5483.81 / Max: 5496.2Min: 5513.58 / Avg: 5525.56 / Max: 5542.48Min: 5514.17 / Avg: 5528.15 / Max: 5543.17Min: 5570.53 / Avg: 5576.86 / Max: 5584.57Min: 5415.22 / Avg: 5778.51 / Max: 6357.39Min: 6010.21 / Avg: 6017.19 / Max: 6021.67Min: 8712.89 / Avg: 8719.37 / Max: 8731.87Min: 10701.2 / Avg: 10708.91 / Max: 10715.71Min: 11728.63 / Avg: 11735.42 / Max: 11742.62Min: 12748.78 / Avg: 12750.59 / Max: 12752.971. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

NAS Parallel Benchmarks

NPB, NAS Parallel Benchmarks, is a benchmark developed by NASA for high-end computer systems. This test profile currently uses the MPI version of NPB. This test profile offers selecting the different NPB tests/problems and varying problem sizes. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgTotal Mop/s, More Is BetterNAS Parallel Benchmarks 3.4Test / Class: LU.CXeon Platinum 8380Xeon Max 9468EPYC 8534PNXeon Max 9480EPYC 8534PXeon Platinum 8490HXeon Platinum 8380 2PXeon Platinum 8592+Xeon Max 9468 2PXeon Max 9480 2PXeon Platinum 8490H 2PEPYC 9654EPYC 9754EPYC 9684XXeon Platinum 8592+ 2PEPYC 9654 2PEPYC 9684X 2PEPYC 9754 2P130K260K390K520K650KSE +/- 123.65, N = 3SE +/- 71.37, N = 3SE +/- 274.93, N = 3SE +/- 37.04, N = 4SE +/- 314.42, N = 4SE +/- 130.20, N = 4SE +/- 155.95, N = 4SE +/- 213.44, N = 5SE +/- 441.66, N = 5SE +/- 411.20, N = 5SE +/- 398.40, N = 5SE +/- 789.76, N = 5SE +/- 2566.89, N = 15SE +/- 1849.65, N = 6SE +/- 726.00, N = 5SE +/- 4162.49, N = 6SE +/- 1879.23, N = 6SE +/- 5800.63, N = 1598557.16126171.52130839.12131606.86133284.46135125.15185954.54232012.77246822.52257384.55261127.09269047.28279397.45362511.43455312.09472931.04551955.55588329.321. (F9X) gfortran options: -O3 -march=native -lmpi_usempif08 -lmpi_mpifh -lmpi -lopen-rte -lopen-pal -lhwloc -levent_core -levent_pthreads -lm -lz 2. Open MPI 4.1.6
OpenBenchmarking.orgTotal Mop/s, More Is BetterNAS Parallel Benchmarks 3.4Test / Class: LU.CXeon Platinum 8380Xeon Max 9468EPYC 8534PNXeon Max 9480EPYC 8534PXeon Platinum 8490HXeon Platinum 8380 2PXeon Platinum 8592+Xeon Max 9468 2PXeon Max 9480 2PXeon Platinum 8490H 2PEPYC 9654EPYC 9754EPYC 9684XXeon Platinum 8592+ 2PEPYC 9654 2PEPYC 9684X 2PEPYC 9754 2P100K200K300K400K500KMin: 98355.56 / Avg: 98557.16 / Max: 98782.01Min: 126028.82 / Avg: 126171.52 / Max: 126245.73Min: 130500.1 / Avg: 130839.12 / Max: 131383.55Min: 131510.26 / Avg: 131606.86 / Max: 131683.36Min: 132604.66 / Avg: 133284.46 / Max: 134072.91Min: 134862.89 / Avg: 135125.15 / Max: 135480.43Min: 185519.15 / Avg: 185954.54 / Max: 186257.78Min: 231497.6 / Avg: 232012.77 / Max: 232534.8Min: 245480.17 / Avg: 246822.52 / Max: 248109.68Min: 256169.08 / Avg: 257384.55 / Max: 258663.51Min: 259931.1 / Avg: 261127.09 / Max: 262324.4Min: 266894.47 / Avg: 269047.28 / Max: 271534.97Min: 253788.71 / Avg: 279397.45 / Max: 288536.79Min: 356268.89 / Avg: 362511.43 / Max: 368633.83Min: 453562.19 / Avg: 455312.09 / Max: 457552.33Min: 458815.95 / Avg: 472931.04 / Max: 484561.08Min: 546984.31 / Avg: 551955.55 / Max: 558380.76Min: 544633.25 / Avg: 588329.32 / Max: 617486.611. (F9X) gfortran options: -O3 -march=native -lmpi_usempif08 -lmpi_mpifh -lmpi -lopen-rte -lopen-pal -lhwloc -levent_core -levent_pthreads -lm -lz 2. Open MPI 4.1.6

OSPRay

OpenBenchmarking.orgItems Per Second, More Is BetterOSPRay 3.1Benchmark: particle_volume/scivis/real_timeXeon Platinum 8380Xeon Max 9468EPYC 8534PNXeon Platinum 8380 2PEPYC 8534PXeon Max 9480Xeon 6766EXeon 6780EXeon Platinum 8490HEPYC 9654Xeon Max 9468 2PXeon Platinum 8592+EPYC 9684XXeon 6766E 2PXeon Max 9480 2PEPYC 9754Xeon 6780E 2PXeon Platinum 8490H 2PEPYC 9654 2PXeon Platinum 8592+ 2PEPYC 9684X 2PEPYC 9754 2P1326395265SE +/- 0.00909, N = 3SE +/- 0.00932, N = 3SE +/- 0.00583, N = 3SE +/- 0.03711, N = 3SE +/- 0.01395, N = 3SE +/- 0.03593, N = 3SE +/- 0.00610, N = 3SE +/- 0.01460, N = 3SE +/- 0.00525, N = 3SE +/- 0.01265, N = 3SE +/- 0.05872, N = 3SE +/- 0.04057, N = 3SE +/- 0.01858, N = 3SE +/- 0.04097, N = 3SE +/- 0.04134, N = 3SE +/- 0.02252, N = 3SE +/- 0.02131, N = 3SE +/- 0.02499, N = 3SE +/- 0.04960, N = 3SE +/- 0.04682, N = 3SE +/- 0.01792, N = 3SE +/- 0.01106, N = 39.7002216.0869016.4505017.6222017.9448018.4851019.4251021.5147021.8932028.0689029.3496030.6799032.5232032.7979033.1275035.1464036.2464038.2269047.5267053.9348055.2576056.44850
OpenBenchmarking.orgItems Per Second, More Is BetterOSPRay 3.1Benchmark: particle_volume/scivis/real_timeXeon Platinum 8380Xeon Max 9468EPYC 8534PNXeon Platinum 8380 2PEPYC 8534PXeon Max 9480Xeon 6766EXeon 6780EXeon Platinum 8490HEPYC 9654Xeon Max 9468 2PXeon Platinum 8592+EPYC 9684XXeon 6766E 2PXeon Max 9480 2PEPYC 9754Xeon 6780E 2PXeon Platinum 8490H 2PEPYC 9654 2PXeon Platinum 8592+ 2PEPYC 9684X 2PEPYC 9754 2P1122334455Min: 9.68 / Avg: 9.7 / Max: 9.72Min: 16.07 / Avg: 16.09 / Max: 16.1Min: 16.44 / Avg: 16.45 / Max: 16.46Min: 17.58 / Avg: 17.62 / Max: 17.7Min: 17.92 / Avg: 17.94 / Max: 17.96Min: 18.41 / Avg: 18.49 / Max: 18.52Min: 19.42 / Avg: 19.43 / Max: 19.44Min: 21.49 / Avg: 21.51 / Max: 21.54Min: 21.88 / Avg: 21.89 / Max: 21.9Min: 28.05 / Avg: 28.07 / Max: 28.09Min: 29.25 / Avg: 29.35 / Max: 29.45Min: 30.6 / Avg: 30.68 / Max: 30.73Min: 32.49 / Avg: 32.52 / Max: 32.55Min: 32.72 / Avg: 32.8 / Max: 32.85Min: 33.05 / Avg: 33.13 / Max: 33.19Min: 35.12 / Avg: 35.15 / Max: 35.19Min: 36.2 / Avg: 36.25 / Max: 36.27Min: 38.18 / Avg: 38.23 / Max: 38.26Min: 47.44 / Avg: 47.53 / Max: 47.61Min: 53.85 / Avg: 53.93 / Max: 54Min: 55.22 / Avg: 55.26 / Max: 55.28Min: 56.43 / Avg: 56.45 / Max: 56.46

OpenSSL

OpenBenchmarking.orgbyte/s, More Is BetterOpenSSL 3.3Algorithm: AES-128-GCMXeon Platinum 8380EPYC 8534PNEPYC 8534PXeon 6766EXeon 6780EXeon Max 9468Xeon Max 9480Xeon Platinum 8490HXeon Platinum 8380 2PXeon Platinum 8592+EPYC 9654EPYC 9684XXeon 6766E 2PEPYC 9754Xeon 6780E 2PXeon Max 9468 2PXeon Max 9480 2PXeon Platinum 8490H 2PXeon Platinum 8592+ 2PEPYC 9654 2PEPYC 9684X 2PEPYC 9754 2P500000M1000000M1500000M2000000M2500000MSE +/- 706172241.68, N = 3SE +/- 409615403.40, N = 3SE +/- 530918594.60, N = 3SE +/- 195953395.92, N = 3SE +/- 129279575.06, N = 3SE +/- 43545680.66, N = 3SE +/- 56355870.99, N = 3SE +/- 28627701.54, N = 3SE +/- 266669781.18, N = 3SE +/- 1253503549.61, N = 3SE +/- 164763342.54, N = 3SE +/- 570058274.06, N = 3SE +/- 429428665.34, N = 3SE +/- 49279694.68, N = 3SE +/- 333650111.34, N = 3SE +/- 268465891.11, N = 3SE +/- 697208281.49, N = 3SE +/- 159598753.20, N = 3SE +/- 1622921637.03, N = 3SE +/- 337702856.52, N = 3SE +/- 1428966819.54, N = 3SE +/- 1841260363.24, N = 339952681542748896539085753978493137356572076778363845320376364120084817074771070266076880469369780722926530088956750654089728843612399600710926710960821997131167221141870126688286665312775833827571484669627050153302630072717693131460131785006879067199035205996723166119452831. (CC) gcc options: -pthread -m64 -O3 -lssl -lcrypto -ldl
OpenBenchmarking.orgbyte/s, More Is BetterOpenSSL 3.3Algorithm: AES-128-GCMXeon Platinum 8380EPYC 8534PNEPYC 8534PXeon 6766EXeon 6780EXeon Max 9468Xeon Max 9480Xeon Platinum 8490HXeon Platinum 8380 2PXeon Platinum 8592+EPYC 9654EPYC 9684XXeon 6766E 2PEPYC 9754Xeon 6780E 2PXeon Max 9468 2PXeon Max 9480 2PXeon Platinum 8490H 2PXeon Platinum 8592+ 2PEPYC 9654 2PEPYC 9684X 2PEPYC 9754 2P400000M800000M1200000M1600000M2000000MMin: 398207199100 / Avg: 399526815426.67 / Max: 400622510350Min: 488191196090 / Avg: 488965390856.67 / Max: 489584482170Min: 538795554950 / Avg: 539784931373.33 / Max: 540613497380Min: 565335428300 / Avg: 565720767783.33 / Max: 565975310880Min: 638201243780 / Avg: 638453203763.33 / Max: 638629450550Min: 641113915120 / Avg: 641200848170 / Max: 641248860300Min: 747630093380 / Avg: 747710702660 / Max: 747819231640Min: 768752002660 / Avg: 768804693696.67 / Max: 768850439650Min: 806905279440 / Avg: 807229265300 / Max: 807758154930Min: 888030335850 / Avg: 889567506540 / Max: 892051213790Min: 896972292920 / Avg: 897288436123.33 / Max: 897527012280Min: 995087500630 / Avg: 996007109266.67 / Max: 997050556690Min: 1095247024950 / Avg: 1096082199713.3 / Max: 1096673249690Min: 1167149951390 / Avg: 1167221141870 / Max: 1167315765930Min: 1266243153370 / Avg: 1266882866653.3 / Max: 1267367168960Min: 1277092543690 / Avg: 1277583382756.7 / Max: 1278017295160Min: 1483608758680 / Avg: 1484669627050 / Max: 1485983781140Min: 1532769000930 / Avg: 1533026300726.7 / Max: 1533318544320Min: 1767482912490 / Avg: 1769313146013.3 / Max: 1772549751060Min: 1784615558840 / Avg: 1785006879066.7 / Max: 1785679279170Min: 1987535076580 / Avg: 1990352059966.7 / Max: 1992178034550Min: 2314727732020 / Avg: 2316611945283.3 / Max: 23202941293701. (CC) gcc options: -pthread -m64 -O3 -lssl -lcrypto -ldl

OSPRay

OpenBenchmarking.orgItems Per Second, More Is BetterOSPRay 3.1Benchmark: particle_volume/ao/real_timeXeon Platinum 8380Xeon Max 9468EPYC 8534PNXeon Platinum 8380 2PEPYC 8534PXeon Max 9480Xeon 6766EXeon 6780EXeon Platinum 8490HEPYC 9654Xeon Max 9468 2PXeon Platinum 8592+EPYC 9684XXeon 6766E 2PXeon Max 9480 2PEPYC 9754Xeon 6780E 2PXeon Platinum 8490H 2PEPYC 9654 2PXeon Platinum 8592+ 2PEPYC 9684X 2PEPYC 9754 2P1326395265SE +/- 0.05948, N = 3SE +/- 0.03513, N = 3SE +/- 0.04390, N = 3SE +/- 0.03319, N = 3SE +/- 0.02190, N = 3SE +/- 0.01050, N = 3SE +/- 0.02488, N = 3SE +/- 0.01225, N = 3SE +/- 0.00975, N = 3SE +/- 0.01424, N = 3SE +/- 0.01945, N = 3SE +/- 0.01144, N = 3SE +/- 0.01754, N = 3SE +/- 0.03817, N = 3SE +/- 0.00297, N = 3SE +/- 0.03039, N = 3SE +/- 0.03595, N = 3SE +/- 0.02269, N = 3SE +/- 0.01406, N = 3SE +/- 0.07203, N = 3SE +/- 0.02899, N = 3SE +/- 0.01800, N = 39.7776416.0502016.4504017.8269017.9668018.5533019.5159021.6222021.9324028.0956029.5018030.8404032.5188032.9663033.1125035.2461036.5043038.2235047.6143054.1195055.3382056.69360
OpenBenchmarking.orgItems Per Second, More Is BetterOSPRay 3.1Benchmark: particle_volume/ao/real_timeXeon Platinum 8380Xeon Max 9468EPYC 8534PNXeon Platinum 8380 2PEPYC 8534PXeon Max 9480Xeon 6766EXeon 6780EXeon Platinum 8490HEPYC 9654Xeon Max 9468 2PXeon Platinum 8592+EPYC 9684XXeon 6766E 2PXeon Max 9480 2PEPYC 9754Xeon 6780E 2PXeon Platinum 8490H 2PEPYC 9654 2PXeon Platinum 8592+ 2PEPYC 9684X 2PEPYC 9754 2P1122334455Min: 9.66 / Avg: 9.78 / Max: 9.85Min: 15.99 / Avg: 16.05 / Max: 16.11Min: 16.37 / Avg: 16.45 / Max: 16.51Min: 17.79 / Avg: 17.83 / Max: 17.89Min: 17.94 / Avg: 17.97 / Max: 18.01Min: 18.53 / Avg: 18.55 / Max: 18.57Min: 19.47 / Avg: 19.52 / Max: 19.56Min: 21.6 / Avg: 21.62 / Max: 21.63Min: 21.91 / Avg: 21.93 / Max: 21.95Min: 28.07 / Avg: 28.1 / Max: 28.12Min: 29.46 / Avg: 29.5 / Max: 29.53Min: 30.82 / Avg: 30.84 / Max: 30.85Min: 32.5 / Avg: 32.52 / Max: 32.55Min: 32.91 / Avg: 32.97 / Max: 33.04Min: 33.11 / Avg: 33.11 / Max: 33.12Min: 35.21 / Avg: 35.25 / Max: 35.31Min: 36.46 / Avg: 36.5 / Max: 36.58Min: 38.18 / Avg: 38.22 / Max: 38.25Min: 47.59 / Avg: 47.61 / Max: 47.64Min: 53.98 / Avg: 54.12 / Max: 54.23Min: 55.28 / Avg: 55.34 / Max: 55.38Min: 56.66 / Avg: 56.69 / Max: 56.72

Llamafile

OpenBenchmarking.orgTokens Per Second, More Is BetterLlamafile 0.7Test: wizardcoder-python-34b-v1.0.Q6_K - Acceleration: CPUXeon Max 9468Xeon Max 9480Xeon Max 9480 2PXeon Max 9468 2PXeon 6766E 2PXeon 6780E 2PXeon Platinum 8592+ 2PXeon Platinum 8380 2PXeon Platinum 8490H 2PXeon Platinum 8592+Xeon Platinum 8380EPYC 9754 2PEPYC 8534PNEPYC 8534PEPYC 9684X 2PEPYC 9654 2PXeon 6766EXeon 6780EXeon Platinum 8490HEPYC 9754EPYC 9654EPYC 9684X246810SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.12, N = 6SE +/- 0.01, N = 3SE +/- 0.02, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.02, N = 3SE +/- 0.01, N = 3SE +/- 0.02, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.03, N = 3SE +/- 0.02, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.02, N = 3SE +/- 0.02, N = 3SE +/- 0.01, N = 3SE +/- 0.03, N = 3SE +/- 0.03, N = 3SE +/- 0.01, N = 31.471.541.541.772.562.673.053.103.824.084.414.635.115.165.245.245.395.585.857.478.358.48
OpenBenchmarking.orgTokens Per Second, More Is BetterLlamafile 0.7Test: wizardcoder-python-34b-v1.0.Q6_K - Acceleration: CPUXeon Max 9468Xeon Max 9480Xeon Max 9480 2PXeon Max 9468 2PXeon 6766E 2PXeon 6780E 2PXeon Platinum 8592+ 2PXeon Platinum 8380 2PXeon Platinum 8490H 2PXeon Platinum 8592+Xeon Platinum 8380EPYC 9754 2PEPYC 8534PNEPYC 8534PEPYC 9684X 2PEPYC 9654 2PXeon 6766EXeon 6780EXeon Platinum 8490HEPYC 9754EPYC 9654EPYC 9684X3691215Min: 1.47 / Avg: 1.47 / Max: 1.48Min: 1.53 / Avg: 1.54 / Max: 1.54Min: 1.07 / Avg: 1.54 / Max: 1.78Min: 1.76 / Avg: 1.77 / Max: 1.78Min: 2.53 / Avg: 2.56 / Max: 2.59Min: 2.65 / Avg: 2.67 / Max: 2.68Min: 3.03 / Avg: 3.05 / Max: 3.06Min: 3.07 / Avg: 3.1 / Max: 3.12Min: 3.8 / Avg: 3.82 / Max: 3.84Min: 4.05 / Avg: 4.08 / Max: 4.1Min: 4.4 / Avg: 4.41 / Max: 4.42Min: 4.61 / Avg: 4.63 / Max: 4.64Min: 5.06 / Avg: 5.11 / Max: 5.14Min: 5.13 / Avg: 5.16 / Max: 5.2Min: 5.23 / Avg: 5.24 / Max: 5.26Min: 5.23 / Avg: 5.24 / Max: 5.25Min: 5.36 / Avg: 5.39 / Max: 5.43Min: 5.54 / Avg: 5.58 / Max: 5.62Min: 5.83 / Avg: 5.85 / Max: 5.86Min: 7.42 / Avg: 7.47 / Max: 7.5Min: 8.28 / Avg: 8.35 / Max: 8.39Min: 8.46 / Avg: 8.48 / Max: 8.49

OSPRay Studio

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 1.0Camera: 1 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path Tracer - Acceleration: CPUXeon Platinum 8380Xeon 6766EEPYC 8534PNXeon 6780EEPYC 8534PXeon Max 9468Xeon Max 9480Xeon Platinum 8490HXeon Platinum 8380 2PXeon 6766E 2PXeon Platinum 8592+Xeon 6780E 2PEPYC 9654Xeon Max 9468 2PEPYC 9684XXeon Max 9480 2PEPYC 9754Xeon Platinum 8490H 2PXeon Platinum 8592+ 2PEPYC 9654 2PEPYC 9684X 2PEPYC 9754 2P7001400210028003500SE +/- 4.62, N = 3SE +/- 7.84, N = 3SE +/- 1.20, N = 3SE +/- 11.06, N = 3SE +/- 0.58, N = 3SE +/- 0.33, N = 3SE +/- 0.58, N = 3SE +/- 0.58, N = 3SE +/- 0.33, N = 3SE +/- 21.79, N = 12SE +/- 0.88, N = 3SE +/- 24.01, N = 12SE +/- 0.58, N = 3SE +/- 1.76, N = 3SE +/- 1.15, N = 3SE +/- 0.58, N = 3SE +/- 1.20, N = 3SE +/- 0.58, N = 3SE +/- 0.88, N = 3SE +/- 0.58, N = 3SE +/- 1.20, N = 3SE +/- 0.88, N = 3305223182240209020431988179216571553149714411342118010491037961954894759661561531
OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 1.0Camera: 1 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path Tracer - Acceleration: CPUXeon Platinum 8380Xeon 6766EEPYC 8534PNXeon 6780EEPYC 8534PXeon Max 9468Xeon Max 9480Xeon Platinum 8490HXeon Platinum 8380 2PXeon 6766E 2PXeon Platinum 8592+Xeon 6780E 2PEPYC 9654Xeon Max 9468 2PEPYC 9684XXeon Max 9480 2PEPYC 9754Xeon Platinum 8490H 2PXeon Platinum 8592+ 2PEPYC 9654 2PEPYC 9684X 2PEPYC 9754 2P5001000150020002500Min: 3044 / Avg: 3052 / Max: 3060Min: 2302 / Avg: 2317.67 / Max: 2326Min: 2238 / Avg: 2239.67 / Max: 2242Min: 2077 / Avg: 2090 / Max: 2112Min: 2042 / Avg: 2043 / Max: 2044Min: 1988 / Avg: 1988.33 / Max: 1989Min: 1791 / Avg: 1792 / Max: 1793Min: 1656 / Avg: 1657 / Max: 1658Min: 1552 / Avg: 1552.67 / Max: 1553Min: 1349 / Avg: 1496.5 / Max: 1559Min: 1439 / Avg: 1440.67 / Max: 1442Min: 1206 / Avg: 1341.75 / Max: 1404Min: 1179 / Avg: 1180 / Max: 1181Min: 1046 / Avg: 1048.67 / Max: 1052Min: 1035 / Avg: 1037 / Max: 1039Min: 960 / Avg: 961 / Max: 962Min: 952 / Avg: 954.33 / Max: 956Min: 893 / Avg: 894 / Max: 895Min: 757 / Avg: 758.67 / Max: 760Min: 660 / Avg: 661 / Max: 662Min: 559 / Avg: 560.67 / Max: 563Min: 529 / Avg: 530.67 / Max: 532

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 1.0Camera: 3 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path Tracer - Acceleration: CPUXeon Platinum 8380Xeon 6766EEPYC 8534PNXeon 6780EEPYC 8534PXeon Max 9468Xeon Max 9480Xeon Platinum 8490HXeon Platinum 8380 2PXeon 6766E 2PXeon Platinum 8592+Xeon 6780E 2PEPYC 9654Xeon Max 9468 2PEPYC 9684XXeon Max 9480 2PEPYC 9754Xeon Platinum 8490H 2PXeon Platinum 8592+ 2PEPYC 9654 2PEPYC 9684X 2PEPYC 9754 2P8001600240032004000SE +/- 3.79, N = 3SE +/- 6.23, N = 3SE +/- 3.06, N = 3SE +/- 3.51, N = 3SE +/- 1.00, N = 3SE +/- 1.20, N = 3SE +/- 1.20, N = 3SE +/- 0.88, N = 3SE +/- 2.73, N = 3SE +/- 4.67, N = 3SE +/- 1.45, N = 3SE +/- 16.65, N = 5SE +/- 1.00, N = 3SE +/- 2.65, N = 3SE +/- 1.53, N = 3SE +/- 0.33, N = 3SE +/- 0.88, N = 3SE +/- 0.88, N = 3SE +/- 0.00, N = 3SE +/- 0.58, N = 3SE +/- 1.45, N = 3SE +/- 0.67, N = 3361627312649247224212357212319771833183217091631139112371225114311301063898780660630
OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 1.0Camera: 3 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path Tracer - Acceleration: CPUXeon Platinum 8380Xeon 6766EEPYC 8534PNXeon 6780EEPYC 8534PXeon Max 9468Xeon Max 9480Xeon Platinum 8490HXeon Platinum 8380 2PXeon 6766E 2PXeon Platinum 8592+Xeon 6780E 2PEPYC 9654Xeon Max 9468 2PEPYC 9684XXeon Max 9480 2PEPYC 9754Xeon Platinum 8490H 2PXeon Platinum 8592+ 2PEPYC 9654 2PEPYC 9684X 2PEPYC 9754 2P6001200180024003000Min: 3609 / Avg: 3616 / Max: 3622Min: 2723 / Avg: 2730.67 / Max: 2743Min: 2643 / Avg: 2649 / Max: 2653Min: 2468 / Avg: 2472 / Max: 2479Min: 2419 / Avg: 2421 / Max: 2422Min: 2355 / Avg: 2357.33 / Max: 2359Min: 2121 / Avg: 2123.33 / Max: 2125Min: 1976 / Avg: 1977.33 / Max: 1979Min: 1828 / Avg: 1833.33 / Max: 1837Min: 1823 / Avg: 1832.33 / Max: 1837Min: 1707 / Avg: 1709.33 / Max: 1712Min: 1565 / Avg: 1631.2 / Max: 1653Min: 1390 / Avg: 1391 / Max: 1393Min: 1232 / Avg: 1237 / Max: 1241Min: 1222 / Avg: 1225 / Max: 1227Min: 1142 / Avg: 1142.67 / Max: 1143Min: 1129 / Avg: 1130.33 / Max: 1132Min: 1062 / Avg: 1063.33 / Max: 1065Min: 898 / Avg: 898 / Max: 898Min: 779 / Avg: 780 / Max: 781Min: 657 / Avg: 659.67 / Max: 662Min: 629 / Avg: 630.33 / Max: 631

OpenSSL

OpenBenchmarking.orgbyte/s, More Is BetterOpenSSL 3.3Algorithm: AES-256-GCMXeon Platinum 8380EPYC 8534PNEPYC 8534PXeon 6766EXeon Max 9468Xeon 6780EXeon Max 9480Xeon Platinum 8490HXeon Platinum 8380 2PXeon Platinum 8592+EPYC 9654EPYC 9684XXeon 6766E 2PEPYC 9754Xeon Max 9468 2PXeon 6780E 2PXeon Max 9480 2PXeon Platinum 8490H 2PXeon Platinum 8592+ 2PEPYC 9654 2PEPYC 9684X 2PEPYC 9754 2P400000M800000M1200000M1600000M2000000MSE +/- 81945775.93, N = 3SE +/- 3442274884.66, N = 3SE +/- 148092414.72, N = 3SE +/- 34244051.67, N = 3SE +/- 119857064.56, N = 3SE +/- 317370827.95, N = 3SE +/- 63026881.96, N = 3SE +/- 2848140790.67, N = 3SE +/- 116420153.53, N = 3SE +/- 3966858436.56, N = 3SE +/- 818689705.82, N = 3SE +/- 671752057.50, N = 3SE +/- 252081360.30, N = 3SE +/- 290015345.25, N = 3SE +/- 108288170.03, N = 3SE +/- 301551944.80, N = 3SE +/- 112278705.55, N = 3SE +/- 1397764228.85, N = 3SE +/- 1320809584.03, N = 3SE +/- 2225250504.62, N = 3SE +/- 1859275059.09, N = 3SE +/- 1791964708.17, N = 3356062040883415893963207462309750530506301374623507456728087568937578313592014115453700239352717712485411447744387683670767696553667859720599963979419388797997539007873101189899332311253730411731181148957353136953432847014975299393771526505465813171406176108719831030267001. (CC) gcc options: -pthread -m64 -O3 -lssl -lcrypto -ldl
OpenBenchmarking.orgbyte/s, More Is BetterOpenSSL 3.3Algorithm: AES-256-GCMXeon Platinum 8380EPYC 8534PNEPYC 8534PXeon 6766EXeon Max 9468Xeon 6780EXeon Max 9480Xeon Platinum 8490HXeon Platinum 8380 2PXeon Platinum 8592+EPYC 9654EPYC 9684XXeon 6766E 2PEPYC 9754Xeon Max 9468 2PXeon 6780E 2PXeon Max 9480 2PXeon Platinum 8490H 2PXeon Platinum 8592+ 2PEPYC 9654 2PEPYC 9684X 2PEPYC 9754 2P300000M600000M900000M1200000M1500000MMin: 355943805750 / Avg: 356062040883.33 / Max: 356219447160Min: 409016534080 / Avg: 415893963206.67 / Max: 419603778490Min: 462159458030 / Avg: 462309750530 / Max: 462605924410Min: 506237467230 / Avg: 506301374623.33 / Max: 506354655510Min: 507221000470 / Avg: 507456728086.67 / Max: 507612294890Min: 568303956510 / Avg: 568937578313.33 / Max: 569287027920Min: 591917684600 / Avg: 592014115453.33 / Max: 592132637220Min: 694545018060 / Avg: 700239352716.67 / Max: 703215487110Min: 712286071740 / Avg: 712485411446.67 / Max: 712689286470Min: 740373466320 / Avg: 744387683670 / Max: 752321211320Min: 766399544800 / Avg: 767696553666.67 / Max: 769210554780Min: 858821939750 / Avg: 859720599963.33 / Max: 861034834600Min: 979036800610 / Avg: 979419388796.67 / Max: 979895032580Min: 997169946620 / Avg: 997539007873.33 / Max: 998111058880Min: 1011763512390 / Avg: 1011898993323.3 / Max: 1012113064480Min: 1124769961570 / Avg: 1125373041173.3 / Max: 1125679268220Min: 1180954994550 / Avg: 1181148957353.3 / Max: 1181343935420Min: 1367768906960 / Avg: 1369534328470 / Max: 1372294191240Min: 1494955760300 / Avg: 1497529939376.7 / Max: 1499330658580Min: 1522495208110 / Avg: 1526505465813.3 / Max: 1530181999550Min: 1710857643840 / Avg: 1714061761086.7 / Max: 1717298119480Min: 1979633105030 / Avg: 1983103026700 / Max: 19856146118001. (CC) gcc options: -pthread -m64 -O3 -lssl -lcrypto -ldl

Primesieve

OpenBenchmarking.orgSeconds, Fewer Is BetterPrimesieve 12.1Length: 1e12Xeon Platinum 8380Xeon Max 9468Xeon Max 9480Xeon 6766EXeon Platinum 8490HEPYC 8534PNXeon 6780EXeon Platinum 8592+EPYC 8534PXeon Platinum 8380 2PXeon Max 9468 2PXeon Max 9480 2PXeon 6766E 2PXeon 6780E 2PXeon Platinum 8490H 2PXeon Platinum 8592+ 2PEPYC 9654EPYC 9684XEPYC 9754EPYC 9754 2PEPYC 9654 2PEPYC 9684X 2P246810SE +/- 0.006, N = 6SE +/- 0.006, N = 7SE +/- 0.010, N = 7SE +/- 0.003, N = 8SE +/- 0.019, N = 8SE +/- 0.003, N = 8SE +/- 0.003, N = 8SE +/- 0.007, N = 8SE +/- 0.006, N = 8SE +/- 0.003, N = 9SE +/- 0.004, N = 9SE +/- 0.005, N = 10SE +/- 0.012, N = 10SE +/- 0.008, N = 10SE +/- 0.006, N = 10SE +/- 0.008, N = 11SE +/- 0.003, N = 11SE +/- 0.004, N = 11SE +/- 0.002, N = 11SE +/- 0.010, N = 15SE +/- 0.005, N = 12SE +/- 0.003, N = 126.6736.1605.3324.8064.5764.5454.3244.2503.8013.3663.1212.6912.6052.3372.3252.1872.0581.9841.9211.3591.2421.1991. (CXX) g++ options: -O3
OpenBenchmarking.orgSeconds, Fewer Is BetterPrimesieve 12.1Length: 1e12Xeon Platinum 8380Xeon Max 9468Xeon Max 9480Xeon 6766EXeon Platinum 8490HEPYC 8534PNXeon 6780EXeon Platinum 8592+EPYC 8534PXeon Platinum 8380 2PXeon Max 9468 2PXeon Max 9480 2PXeon 6766E 2PXeon 6780E 2PXeon Platinum 8490H 2PXeon Platinum 8592+ 2PEPYC 9654EPYC 9684XEPYC 9754EPYC 9754 2PEPYC 9654 2PEPYC 9684X 2P3691215Min: 6.65 / Avg: 6.67 / Max: 6.68Min: 6.14 / Avg: 6.16 / Max: 6.19Min: 5.29 / Avg: 5.33 / Max: 5.37Min: 4.79 / Avg: 4.81 / Max: 4.82Min: 4.5 / Avg: 4.58 / Max: 4.65Min: 4.53 / Avg: 4.54 / Max: 4.56Min: 4.32 / Avg: 4.32 / Max: 4.34Min: 4.23 / Avg: 4.25 / Max: 4.29Min: 3.78 / Avg: 3.8 / Max: 3.83Min: 3.35 / Avg: 3.37 / Max: 3.38Min: 3.11 / Avg: 3.12 / Max: 3.15Min: 2.67 / Avg: 2.69 / Max: 2.72Min: 2.56 / Avg: 2.6 / Max: 2.67Min: 2.31 / Avg: 2.34 / Max: 2.38Min: 2.29 / Avg: 2.32 / Max: 2.35Min: 2.14 / Avg: 2.19 / Max: 2.24Min: 2.05 / Avg: 2.06 / Max: 2.08Min: 1.97 / Avg: 1.98 / Max: 2.01Min: 1.91 / Avg: 1.92 / Max: 1.93Min: 1.3 / Avg: 1.36 / Max: 1.44Min: 1.21 / Avg: 1.24 / Max: 1.27Min: 1.18 / Avg: 1.2 / Max: 1.231. (CXX) g++ options: -O3

Blender

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 4.1Blend File: Junkshop - Compute: CPU-OnlyXeon Platinum 8380Xeon Max 9468Xeon Max 9480EPYC 8534PNXeon Platinum 8490HEPYC 8534PXeon Platinum 8380 2PXeon Platinum 8592+Xeon 6766EXeon 6780EXeon Max 9468 2PXeon Max 9480 2PXeon Platinum 8490H 2PEPYC 9654Xeon 6766E 2PEPYC 9684XXeon Platinum 8592+ 2PEPYC 9754Xeon 6780E 2PEPYC 9654 2PEPYC 9684X 2PEPYC 9754 2P1428425670SE +/- 0.09, N = 3SE +/- 0.04, N = 3SE +/- 0.10, N = 3SE +/- 0.03, N = 3SE +/- 0.24, N = 3SE +/- 0.06, N = 3SE +/- 0.10, N = 3SE +/- 0.10, N = 3SE +/- 0.08, N = 3SE +/- 0.03, N = 3SE +/- 0.06, N = 3SE +/- 0.19, N = 3SE +/- 0.04, N = 3SE +/- 0.06, N = 3SE +/- 0.11, N = 3SE +/- 0.13, N = 3SE +/- 0.09, N = 3SE +/- 0.08, N = 3SE +/- 0.14, N = 3SE +/- 0.02, N = 4SE +/- 0.08, N = 4SE +/- 0.02, N = 461.2242.8539.1738.8635.9635.8233.2032.0829.0626.4924.9923.4521.1521.0218.7018.6518.3117.7016.8912.8711.4711.21
OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 4.1Blend File: Junkshop - Compute: CPU-OnlyXeon Platinum 8380Xeon Max 9468Xeon Max 9480EPYC 8534PNXeon Platinum 8490HEPYC 8534PXeon Platinum 8380 2PXeon Platinum 8592+Xeon 6766EXeon 6780EXeon Max 9468 2PXeon Max 9480 2PXeon Platinum 8490H 2PEPYC 9654Xeon 6766E 2PEPYC 9684XXeon Platinum 8592+ 2PEPYC 9754Xeon 6780E 2PEPYC 9654 2PEPYC 9684X 2PEPYC 9754 2P1224364860Min: 61.04 / Avg: 61.22 / Max: 61.36Min: 42.81 / Avg: 42.85 / Max: 42.93Min: 38.99 / Avg: 39.17 / Max: 39.32Min: 38.81 / Avg: 38.86 / Max: 38.91Min: 35.61 / Avg: 35.96 / Max: 36.43Min: 35.72 / Avg: 35.82 / Max: 35.93Min: 33.05 / Avg: 33.2 / Max: 33.4Min: 31.88 / Avg: 32.08 / Max: 32.19Min: 28.93 / Avg: 29.06 / Max: 29.19Min: 26.42 / Avg: 26.49 / Max: 26.52Min: 24.92 / Avg: 24.99 / Max: 25.11Min: 23.22 / Avg: 23.45 / Max: 23.82Min: 21.1 / Avg: 21.15 / Max: 21.23Min: 20.94 / Avg: 21.02 / Max: 21.13Min: 18.56 / Avg: 18.7 / Max: 18.91Min: 18.46 / Avg: 18.65 / Max: 18.89Min: 18.17 / Avg: 18.31 / Max: 18.47Min: 17.6 / Avg: 17.7 / Max: 17.85Min: 16.63 / Avg: 16.89 / Max: 17.09Min: 12.8 / Avg: 12.87 / Max: 12.92Min: 11.35 / Avg: 11.47 / Max: 11.69Min: 11.16 / Avg: 11.21 / Max: 11.25

OpenVINO

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Road Segmentation ADAS FP16-INT8 - Device: CPUXeon Platinum 8490H 2PXeon Max 9480Xeon Max 9480 2PXeon Platinum 8592+ 2PXeon Max 9468 2PXeon Platinum 8490HXeon Max 9468Xeon Platinum 8592+Xeon 6766E 2PXeon 6766EEPYC 9754Xeon 6780E 2PXeon 6780EEPYC 8534PNEPYC 8534PXeon Platinum 8380EPYC 9654EPYC 9684XXeon Platinum 8380 2PEPYC 9754 2PEPYC 9654 2PEPYC 9684X 2P1530456075SE +/- 0.03, N = 3SE +/- 0.21, N = 3SE +/- 0.06, N = 3SE +/- 0.28, N = 3SE +/- 0.05, N = 3SE +/- 0.14, N = 3SE +/- 0.15, N = 3SE +/- 0.02, N = 3SE +/- 0.05, N = 3SE +/- 0.11, N = 3SE +/- 0.26, N = 15SE +/- 0.04, N = 3SE +/- 0.10, N = 3SE +/- 0.03, N = 3SE +/- 0.02, N = 3SE +/- 0.03, N = 3SE +/- 0.11, N = 3SE +/- 0.01, N = 3SE +/- 0.05, N = 3SE +/- 0.02, N = 3SE +/- 0.02, N = 3SE +/- 0.02, N = 365.0262.5362.1157.1356.7155.9955.7455.0741.5038.8738.2137.1735.3034.7631.9931.0527.4621.6316.8415.8414.3011.951. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Road Segmentation ADAS FP16-INT8 - Device: CPUXeon Platinum 8490H 2PXeon Max 9480Xeon Max 9480 2PXeon Platinum 8592+ 2PXeon Max 9468 2PXeon Platinum 8490HXeon Max 9468Xeon Platinum 8592+Xeon 6766E 2PXeon 6766EEPYC 9754Xeon 6780E 2PXeon 6780EEPYC 8534PNEPYC 8534PXeon Platinum 8380EPYC 9654EPYC 9684XXeon Platinum 8380 2PEPYC 9754 2PEPYC 9654 2PEPYC 9684X 2P1326395265Min: 64.98 / Avg: 65.02 / Max: 65.08Min: 62.27 / Avg: 62.53 / Max: 62.94Min: 61.99 / Avg: 62.11 / Max: 62.18Min: 56.8 / Avg: 57.13 / Max: 57.69Min: 56.63 / Avg: 56.71 / Max: 56.8Min: 55.71 / Avg: 55.99 / Max: 56.15Min: 55.44 / Avg: 55.74 / Max: 55.92Min: 55.03 / Avg: 55.07 / Max: 55.1Min: 41.4 / Avg: 41.5 / Max: 41.58Min: 38.68 / Avg: 38.87 / Max: 39.07Min: 36.04 / Avg: 38.21 / Max: 39.69Min: 37.12 / Avg: 37.17 / Max: 37.25Min: 35.2 / Avg: 35.3 / Max: 35.5Min: 34.72 / Avg: 34.76 / Max: 34.82Min: 31.95 / Avg: 31.99 / Max: 32.01Min: 31.02 / Avg: 31.05 / Max: 31.11Min: 27.26 / Avg: 27.46 / Max: 27.62Min: 21.61 / Avg: 21.63 / Max: 21.64Min: 16.74 / Avg: 16.84 / Max: 16.93Min: 15.8 / Avg: 15.84 / Max: 15.87Min: 14.28 / Avg: 14.3 / Max: 14.33Min: 11.92 / Avg: 11.95 / Max: 11.971. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

NAS Parallel Benchmarks

NPB, NAS Parallel Benchmarks, is a benchmark developed by NASA for high-end computer systems. This test profile currently uses the MPI version of NPB. This test profile offers selecting the different NPB tests/problems and varying problem sizes. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgTotal Mop/s, More Is BetterNAS Parallel Benchmarks 3.4Test / Class: IS.DXeon Platinum 8380EPYC 8534PNEPYC 8534PXeon Platinum 8490HXeon Max 9468Xeon Max 9480Xeon Platinum 8380 2PXeon Max 9468 2PXeon Max 9480 2PXeon Platinum 8490H 2PXeon Platinum 8592+EPYC 9654EPYC 9754EPYC 9684XXeon Platinum 8592+ 2PEPYC 9754 2PEPYC 9654 2PEPYC 9684X 2P3K6K9K12K15KSE +/- 11.05, N = 3SE +/- 14.39, N = 4SE +/- 9.85, N = 4SE +/- 6.56, N = 3SE +/- 15.55, N = 4SE +/- 18.08, N = 4SE +/- 8.35, N = 4SE +/- 12.99, N = 4SE +/- 4.96, N = 4SE +/- 23.92, N = 4SE +/- 8.92, N = 4SE +/- 17.53, N = 5SE +/- 35.67, N = 5SE +/- 29.95, N = 5SE +/- 155.00, N = 15SE +/- 85.04, N = 8SE +/- 76.70, N = 10SE +/- 119.22, N = 62266.322718.942746.202865.723050.163076.663345.453816.703819.833960.284059.705229.415702.136346.157437.819771.4110139.6912296.271. (F9X) gfortran options: -O3 -march=native -lmpi_usempif08 -lmpi_mpifh -lmpi -lopen-rte -lopen-pal -lhwloc -levent_core -levent_pthreads -lm -lz 2. Open MPI 4.1.6
OpenBenchmarking.orgTotal Mop/s, More Is BetterNAS Parallel Benchmarks 3.4Test / Class: IS.DXeon Platinum 8380EPYC 8534PNEPYC 8534PXeon Platinum 8490HXeon Max 9468Xeon Max 9480Xeon Platinum 8380 2PXeon Max 9468 2PXeon Max 9480 2PXeon Platinum 8490H 2PXeon Platinum 8592+EPYC 9654EPYC 9754EPYC 9684XXeon Platinum 8592+ 2PEPYC 9754 2PEPYC 9654 2PEPYC 9684X 2P2K4K6K8K10KMin: 2244.86 / Avg: 2266.32 / Max: 2281.6Min: 2688.66 / Avg: 2718.94 / Max: 2754.52Min: 2725.72 / Avg: 2746.2 / Max: 2765.92Min: 2855.78 / Avg: 2865.72 / Max: 2878.11Min: 3009.06 / Avg: 3050.16 / Max: 3079.43Min: 3024.29 / Avg: 3076.66 / Max: 3104.23Min: 3331.55 / Avg: 3345.45 / Max: 3366.52Min: 3782.03 / Avg: 3816.7 / Max: 3842.02Min: 3805.61 / Avg: 3819.83 / Max: 3827.3Min: 3893.71 / Avg: 3960.28 / Max: 3998.43Min: 4037.02 / Avg: 4059.7 / Max: 4080.47Min: 5186.28 / Avg: 5229.41 / Max: 5274.14Min: 5579.72 / Avg: 5702.13 / Max: 5796.67Min: 6229.45 / Avg: 6346.15 / Max: 6392.36Min: 6535.32 / Avg: 7437.81 / Max: 8135.72Min: 9316.13 / Avg: 9771.41 / Max: 10073.61Min: 9706.9 / Avg: 10139.69 / Max: 10398.37Min: 11978.42 / Avg: 12296.27 / Max: 12792.551. (F9X) gfortran options: -O3 -march=native -lmpi_usempif08 -lmpi_mpifh -lmpi -lopen-rte -lopen-pal -lhwloc -levent_core -levent_pthreads -lm -lz 2. Open MPI 4.1.6

OSPRay

OpenBenchmarking.orgItems Per Second, More Is BetterOSPRay 3.1Benchmark: gravity_spheres_volume/dim_512/pathtracer/real_timeXeon Platinum 8380Xeon 6766EXeon 6780EEPYC 8534PNEPYC 8534PXeon Max 9468Xeon 6766E 2PXeon Max 9480Xeon Platinum 8380 2PXeon 6780E 2PXeon Platinum 8490HXeon Platinum 8592+EPYC 9654EPYC 9684XXeon Max 9468 2PEPYC 9754Xeon Max 9480 2PXeon Platinum 8490H 2PXeon Platinum 8592+ 2PEPYC 9654 2PEPYC 9684X 2PEPYC 9754 2P1428425670SE +/- 0.04, N = 3SE +/- 0.00, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.23, N = 3SE +/- 0.03, N = 3SE +/- 0.03, N = 3SE +/- 0.03, N = 3SE +/- 0.02, N = 3SE +/- 0.03, N = 3SE +/- 0.01, N = 3SE +/- 0.04, N = 3SE +/- 0.09, N = 3SE +/- 0.02, N = 3SE +/- 0.16, N = 3SE +/- 0.02, N = 3SE +/- 0.04, N = 3SE +/- 0.07, N = 3SE +/- 0.14, N = 3SE +/- 0.05, N = 311.8612.1713.4016.9218.4719.9121.2222.3622.5123.1224.6427.1030.6134.6435.9337.7439.3442.8248.7652.6760.3763.85
OpenBenchmarking.orgItems Per Second, More Is BetterOSPRay 3.1Benchmark: gravity_spheres_volume/dim_512/pathtracer/real_timeXeon Platinum 8380Xeon 6766EXeon 6780EEPYC 8534PNEPYC 8534PXeon Max 9468Xeon 6766E 2PXeon Max 9480Xeon Platinum 8380 2PXeon 6780E 2PXeon Platinum 8490HXeon Platinum 8592+EPYC 9654EPYC 9684XXeon Max 9468 2PEPYC 9754Xeon Max 9480 2PXeon Platinum 8490H 2PXeon Platinum 8592+ 2PEPYC 9654 2PEPYC 9684X 2PEPYC 9754 2P1224364860Min: 11.79 / Avg: 11.86 / Max: 11.92Min: 12.17 / Avg: 12.17 / Max: 12.18Min: 13.39 / Avg: 13.4 / Max: 13.41Min: 16.91 / Avg: 16.92 / Max: 16.93Min: 18.46 / Avg: 18.47 / Max: 18.48Min: 19.9 / Avg: 19.91 / Max: 19.92Min: 20.77 / Avg: 21.22 / Max: 21.54Min: 22.32 / Avg: 22.36 / Max: 22.42Min: 22.46 / Avg: 22.51 / Max: 22.55Min: 23.06 / Avg: 23.12 / Max: 23.16Min: 24.61 / Avg: 24.64 / Max: 24.66Min: 27.06 / Avg: 27.1 / Max: 27.17Min: 30.59 / Avg: 30.61 / Max: 30.62Min: 34.59 / Avg: 34.64 / Max: 34.71Min: 35.81 / Avg: 35.93 / Max: 36.12Min: 37.71 / Avg: 37.74 / Max: 37.78Min: 39.02 / Avg: 39.34 / Max: 39.52Min: 42.79 / Avg: 42.82 / Max: 42.85Min: 48.7 / Avg: 48.76 / Max: 48.83Min: 52.58 / Avg: 52.67 / Max: 52.82Min: 60.19 / Avg: 60.37 / Max: 60.64Min: 63.76 / Avg: 63.85 / Max: 63.93

OpenVINO

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Vehicle Detection FP16-INT8 - Device: CPUXeon Platinum 8490H 2PXeon Max 9480 2PXeon Max 9480Xeon Platinum 8490HXeon Max 9468 2PXeon Max 9468Xeon 6766E 2PXeon 6766EXeon Platinum 8592+ 2PXeon 6780E 2PXeon 6780EXeon Platinum 8592+EPYC 8534PNEPYC 9754EPYC 8534PXeon Platinum 8380EPYC 9654EPYC 9684XEPYC 9754 2PXeon Platinum 8380 2PEPYC 9654 2PEPYC 9684X 2P510152025SE +/- 0.04, N = 3SE +/- 0.03, N = 3SE +/- 0.04, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.05, N = 3SE +/- 0.03, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.00, N = 3SE +/- 0.01, N = 3SE +/- 0.12, N = 15SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 321.7320.2419.4417.8417.1916.3316.2815.1114.6714.3014.0113.7311.4810.9710.789.268.587.855.004.544.464.081. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Vehicle Detection FP16-INT8 - Device: CPUXeon Platinum 8490H 2PXeon Max 9480 2PXeon Max 9480Xeon Platinum 8490HXeon Max 9468 2PXeon Max 9468Xeon 6766E 2PXeon 6766EXeon Platinum 8592+ 2PXeon 6780E 2PXeon 6780EXeon Platinum 8592+EPYC 8534PNEPYC 9754EPYC 8534PXeon Platinum 8380EPYC 9654EPYC 9684XEPYC 9754 2PXeon Platinum 8380 2PEPYC 9654 2PEPYC 9684X 2P510152025Min: 21.69 / Avg: 21.73 / Max: 21.81Min: 20.18 / Avg: 20.24 / Max: 20.28Min: 19.38 / Avg: 19.44 / Max: 19.51Min: 17.83 / Avg: 17.84 / Max: 17.86Min: 17.17 / Avg: 17.19 / Max: 17.21Min: 16.25 / Avg: 16.33 / Max: 16.41Min: 16.23 / Avg: 16.28 / Max: 16.32Min: 15.1 / Avg: 15.11 / Max: 15.12Min: 14.65 / Avg: 14.67 / Max: 14.68Min: 14.27 / Avg: 14.3 / Max: 14.32Min: 13.99 / Avg: 14.01 / Max: 14.03Min: 13.72 / Avg: 13.73 / Max: 13.73Min: 11.46 / Avg: 11.48 / Max: 11.5Min: 9.93 / Avg: 10.97 / Max: 11.7Min: 10.77 / Avg: 10.78 / Max: 10.79Min: 9.25 / Avg: 9.26 / Max: 9.27Min: 8.56 / Avg: 8.58 / Max: 8.6Min: 7.84 / Avg: 7.85 / Max: 7.85Min: 5 / Avg: 5 / Max: 5Min: 4.53 / Avg: 4.54 / Max: 4.54Min: 4.46 / Avg: 4.46 / Max: 4.47Min: 4.08 / Avg: 4.08 / Max: 4.081. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Person Vehicle Bike Detection FP16 - Device: CPUXeon 6766E 2PXeon 6766EXeon 6780E 2PXeon 6780EXeon Platinum 8380Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9480 2PXeon Max 9480Xeon Max 9468 2PEPYC 8534PNXeon Max 9468Xeon Platinum 8592+ 2PEPYC 9754EPYC 8534PXeon Platinum 8592+Xeon Platinum 8380 2PEPYC 9654EPYC 9684XEPYC 9754 2PEPYC 9654 2PEPYC 9684X 2P612182430SE +/- 0.05, N = 3SE +/- 0.04, N = 3SE +/- 0.03, N = 3SE +/- 0.05, N = 3SE +/- 0.00, N = 3SE +/- 0.02, N = 3SE +/- 0.02, N = 3SE +/- 0.01, N = 3SE +/- 0.03, N = 3SE +/- 0.00, N = 3SE +/- 0.02, N = 3SE +/- 0.02, N = 3SE +/- 0.00, N = 3SE +/- 0.11, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.00, N = 3SE +/- 0.05, N = 3SE +/- 0.03, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.01, N = 326.1225.3324.2423.4918.0816.5015.0414.4213.5913.3412.6712.5411.6911.3511.2211.179.829.478.486.275.204.911. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Person Vehicle Bike Detection FP16 - Device: CPUXeon 6766E 2PXeon 6766EXeon 6780E 2PXeon 6780EXeon Platinum 8380Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9480 2PXeon Max 9480Xeon Max 9468 2PEPYC 8534PNXeon Max 9468Xeon Platinum 8592+ 2PEPYC 9754EPYC 8534PXeon Platinum 8592+Xeon Platinum 8380 2PEPYC 9654EPYC 9684XEPYC 9754 2PEPYC 9654 2PEPYC 9684X 2P612182430Min: 26.04 / Avg: 26.12 / Max: 26.2Min: 25.25 / Avg: 25.33 / Max: 25.4Min: 24.19 / Avg: 24.24 / Max: 24.29Min: 23.4 / Avg: 23.49 / Max: 23.54Min: 18.07 / Avg: 18.08 / Max: 18.08Min: 16.47 / Avg: 16.5 / Max: 16.53Min: 15.02 / Avg: 15.04 / Max: 15.08Min: 14.41 / Avg: 14.42 / Max: 14.43Min: 13.55 / Avg: 13.59 / Max: 13.65Min: 13.34 / Avg: 13.34 / Max: 13.35Min: 12.65 / Avg: 12.67 / Max: 12.71Min: 12.51 / Avg: 12.54 / Max: 12.59Min: 11.69 / Avg: 11.69 / Max: 11.69Min: 11.19 / Avg: 11.35 / Max: 11.56Min: 11.2 / Avg: 11.22 / Max: 11.24Min: 11.15 / Avg: 11.17 / Max: 11.18Min: 9.81 / Avg: 9.82 / Max: 9.82Min: 9.41 / Avg: 9.47 / Max: 9.57Min: 8.43 / Avg: 8.48 / Max: 8.53Min: 6.27 / Avg: 6.27 / Max: 6.28Min: 5.2 / Avg: 5.2 / Max: 5.21Min: 4.9 / Avg: 4.91 / Max: 4.921. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

PyTorch

OpenBenchmarking.orgbatches/sec, More Is BetterPyTorch 2.2.1Device: CPU - Batch Size: 1 - Model: ResNet-50EPYC 9754 2PXeon 6766E 2PXeon 6780E 2PEPYC 9654 2PEPYC 9684X 2PEPYC 9754Xeon 6766EXeon Max 9480 2PXeon Platinum 8490H 2PXeon 6780EEPYC 9654EPYC 8534PNEPYC 8534PEPYC 9684XXeon Platinum 8380 2PXeon Platinum 8592+ 2PXeon Max 9468 2PXeon Max 9480Xeon Max 9468Xeon Platinum 8490HXeon Platinum 8380Xeon Platinum 8592+20406080100SE +/- 0.06, N = 3SE +/- 0.20, N = 3SE +/- 0.22, N = 4SE +/- 0.28, N = 15SE +/- 0.37, N = 12SE +/- 0.12, N = 3SE +/- 0.12, N = 3SE +/- 0.44, N = 3SE +/- 0.49, N = 3SE +/- 0.45, N = 4SE +/- 0.15, N = 3SE +/- 0.30, N = 3SE +/- 0.12, N = 3SE +/- 0.15, N = 3SE +/- 0.20, N = 3SE +/- 0.52, N = 3SE +/- 0.38, N = 8SE +/- 0.36, N = 3SE +/- 0.28, N = 3SE +/- 0.03, N = 3SE +/- 0.22, N = 3SE +/- 0.16, N = 314.9016.4517.9119.3419.8431.6232.4535.4635.5335.8540.4540.9741.1141.1742.6445.6946.4948.5950.9951.4661.3277.52
OpenBenchmarking.orgbatches/sec, More Is BetterPyTorch 2.2.1Device: CPU - Batch Size: 1 - Model: ResNet-50EPYC 9754 2PXeon 6766E 2PXeon 6780E 2PEPYC 9654 2PEPYC 9684X 2PEPYC 9754Xeon 6766EXeon Max 9480 2PXeon Platinum 8490H 2PXeon 6780EEPYC 9654EPYC 8534PNEPYC 8534PEPYC 9684XXeon Platinum 8380 2PXeon Platinum 8592+ 2PXeon Max 9468 2PXeon Max 9480Xeon Max 9468Xeon Platinum 8490HXeon Platinum 8380Xeon Platinum 8592+1530456075Min: 14.8 / Avg: 14.9 / Max: 15.02Min: 16.05 / Avg: 16.45 / Max: 16.66Min: 17.32 / Avg: 17.91 / Max: 18.38Min: 17.35 / Avg: 19.34 / Max: 20.43Min: 16.64 / Avg: 19.84 / Max: 21.9Min: 31.38 / Avg: 31.62 / Max: 31.77Min: 32.3 / Avg: 32.45 / Max: 32.68Min: 34.58 / Avg: 35.46 / Max: 35.97Min: 34.55 / Avg: 35.53 / Max: 36.12Min: 34.69 / Avg: 35.85 / Max: 36.61Min: 40.15 / Avg: 40.45 / Max: 40.61Min: 40.51 / Avg: 40.97 / Max: 41.54Min: 40.88 / Avg: 41.11 / Max: 41.24Min: 40.88 / Avg: 41.17 / Max: 41.39Min: 42.37 / Avg: 42.64 / Max: 43.04Min: 45.09 / Avg: 45.69 / Max: 46.73Min: 44 / Avg: 46.49 / Max: 47.5Min: 48.02 / Avg: 48.59 / Max: 49.26Min: 50.49 / Avg: 50.99 / Max: 51.46Min: 51.42 / Avg: 51.46 / Max: 51.52Min: 60.93 / Avg: 61.32 / Max: 61.7Min: 77.23 / Avg: 77.52 / Max: 77.78

PostgreSQL

This is a benchmark of PostgreSQL using the integrated pgbench for facilitating the database benchmarks. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgms, Fewer Is BetterPostgreSQL 16Scaling Factor: 100 - Clients: 1000 - Mode: Read Only - Average LatencyXeon Platinum 8490H 2PXeon Platinum 8592+ 2PXeon Max 9480 2PXeon Max 9468 2PXeon 6766E 2PXeon 6780E 2PXeon Max 9480Xeon Platinum 8592+Xeon Platinum 8380Xeon 6766EXeon Platinum 8490HXeon Max 9468Xeon 6780EXeon Platinum 8380 2PEPYC 8534PNEPYC 8534PEPYC 9754 2PEPYC 9654 2PEPYC 9754EPYC 9684X 2PEPYC 9654EPYC 9684X0.29090.58180.87271.16361.4545SE +/- 0.030, N = 12SE +/- 0.040, N = 12SE +/- 0.038, N = 9SE +/- 0.017, N = 9SE +/- 0.009, N = 12SE +/- 0.008, N = 12SE +/- 0.007, N = 3SE +/- 0.005, N = 12SE +/- 0.005, N = 3SE +/- 0.007, N = 3SE +/- 0.007, N = 3SE +/- 0.008, N = 12SE +/- 0.006, N = 5SE +/- 0.022, N = 9SE +/- 0.001, N = 3SE +/- 0.002, N = 3SE +/- 0.001, N = 3SE +/- 0.004, N = 12SE +/- 0.001, N = 3SE +/- 0.006, N = 12SE +/- 0.003, N = 3SE +/- 0.002, N = 31.2931.1491.0981.0270.8150.7750.6220.5890.5810.5720.5720.5590.5420.5250.4140.3840.3290.2930.2920.2890.2780.2511. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm
OpenBenchmarking.orgms, Fewer Is BetterPostgreSQL 16Scaling Factor: 100 - Clients: 1000 - Mode: Read Only - Average LatencyXeon Platinum 8490H 2PXeon Platinum 8592+ 2PXeon Max 9480 2PXeon Max 9468 2PXeon 6766E 2PXeon 6780E 2PXeon Max 9480Xeon Platinum 8592+Xeon Platinum 8380Xeon 6766EXeon Platinum 8490HXeon Max 9468Xeon 6780EXeon Platinum 8380 2PEPYC 8534PNEPYC 8534PEPYC 9754 2PEPYC 9654 2PEPYC 9754EPYC 9684X 2PEPYC 9654EPYC 9684X246810Min: 1.09 / Avg: 1.29 / Max: 1.48Min: 0.92 / Avg: 1.15 / Max: 1.37Min: 0.84 / Avg: 1.1 / Max: 1.24Min: 0.93 / Avg: 1.03 / Max: 1.11Min: 0.77 / Avg: 0.81 / Max: 0.88Min: 0.73 / Avg: 0.77 / Max: 0.82Min: 0.61 / Avg: 0.62 / Max: 0.64Min: 0.57 / Avg: 0.59 / Max: 0.62Min: 0.58 / Avg: 0.58 / Max: 0.59Min: 0.56 / Avg: 0.57 / Max: 0.58Min: 0.56 / Avg: 0.57 / Max: 0.58Min: 0.54 / Avg: 0.56 / Max: 0.63Min: 0.53 / Avg: 0.54 / Max: 0.56Min: 0.47 / Avg: 0.52 / Max: 0.62Min: 0.41 / Avg: 0.41 / Max: 0.42Min: 0.38 / Avg: 0.38 / Max: 0.39Min: 0.33 / Avg: 0.33 / Max: 0.33Min: 0.28 / Avg: 0.29 / Max: 0.32Min: 0.29 / Avg: 0.29 / Max: 0.3Min: 0.27 / Avg: 0.29 / Max: 0.33Min: 0.27 / Avg: 0.28 / Max: 0.28Min: 0.25 / Avg: 0.25 / Max: 0.251. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm

OpenBenchmarking.orgTPS, More Is BetterPostgreSQL 16Scaling Factor: 100 - Clients: 1000 - Mode: Read OnlyXeon Platinum 8490H 2PXeon Platinum 8592+ 2PXeon Max 9480 2PXeon Max 9468 2PXeon 6766E 2PXeon 6780E 2PXeon Max 9480Xeon Platinum 8592+Xeon Platinum 8380Xeon Platinum 8490HXeon 6766EXeon Max 9468Xeon 6780EXeon Platinum 8380 2PEPYC 8534PNEPYC 8534PEPYC 9754 2PEPYC 9754EPYC 9654 2PEPYC 9684X 2PEPYC 9654EPYC 9684X900K1800K2700K3600K4500KSE +/- 18635.21, N = 12SE +/- 30933.90, N = 12SE +/- 36627.33, N = 9SE +/- 16726.04, N = 9SE +/- 13874.42, N = 12SE +/- 13233.94, N = 12SE +/- 17697.00, N = 3SE +/- 13863.97, N = 12SE +/- 13469.59, N = 3SE +/- 20350.34, N = 3SE +/- 20221.52, N = 3SE +/- 24978.23, N = 12SE +/- 19583.16, N = 5SE +/- 74539.48, N = 9SE +/- 4774.62, N = 3SE +/- 11512.67, N = 3SE +/- 13473.87, N = 3SE +/- 15503.17, N = 3SE +/- 41074.86, N = 12SE +/- 71870.42, N = 12SE +/- 39970.22, N = 3SE +/- 27594.68, N = 37781418818819207259760351229649129212216074241699046172076217481461748658179263618460801930006241637526065003044620342249234227313480909360326139893581. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm
OpenBenchmarking.orgTPS, More Is BetterPostgreSQL 16Scaling Factor: 100 - Clients: 1000 - Mode: Read OnlyXeon Platinum 8490H 2PXeon Platinum 8592+ 2PXeon Max 9480 2PXeon Max 9468 2PXeon 6766E 2PXeon 6780E 2PXeon Max 9480Xeon Platinum 8592+Xeon Platinum 8380Xeon Platinum 8490HXeon 6766EXeon Max 9468Xeon 6780EXeon Platinum 8380 2PEPYC 8534PNEPYC 8534PEPYC 9754 2PEPYC 9754EPYC 9654 2PEPYC 9684X 2PEPYC 9654EPYC 9684X700K1400K2100K2800K3500KMin: 675010 / Avg: 778140.99 / Max: 917513.6Min: 730756.21 / Avg: 881881.35 / Max: 1084339.69Min: 805818.73 / Avg: 920724.73 / Max: 1185417.76Min: 898628.97 / Avg: 976034.51 / Max: 1074194.42Min: 1141441.56 / Avg: 1229648.75 / Max: 1300980.46Min: 1223141.04 / Avg: 1292122.5 / Max: 1366175.95Min: 1575272.28 / Avg: 1607424.15 / Max: 1636315.87Min: 1614190.59 / Avg: 1699045.74 / Max: 1759981.07Min: 1694250.04 / Avg: 1720762.46 / Max: 1738154.86Min: 1714551.7 / Avg: 1748146.26 / Max: 1784842.35Min: 1712261.32 / Avg: 1748657.99 / Max: 1782126.95Min: 1592416.34 / Avg: 1792635.72 / Max: 1862528.55Min: 1775642.06 / Avg: 1846080.11 / Max: 1894511.55Min: 1615260.15 / Avg: 1930005.69 / Max: 2121546.53Min: 2407809.58 / Avg: 2416375.18 / Max: 2424313.64Min: 2585025.03 / Avg: 2606500.12 / Max: 2624430.7Min: 3021935.84 / Avg: 3044619.98 / Max: 3068559.96Min: 3391671.01 / Avg: 3422492 / Max: 3440834.3Min: 3096387.1 / Avg: 3422731.25 / Max: 3566653.83Min: 3042220.94 / Avg: 3480909.16 / Max: 3754154.43Min: 3536441.99 / Avg: 3603260.59 / Max: 3674673.98Min: 3936068.09 / Avg: 3989357.67 / Max: 4028434.851. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm

Speedb

Speedb is a next-generation key value storage engine that is RocksDB compatible and aiming for stability, efficiency, and performance. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgOp/s, More Is BetterSpeedb 2.7Test: Read While WritingXeon Platinum 8380Xeon Max 9468Xeon Max 9480Xeon Platinum 8490HXeon Platinum 8380 2PEPYC 8534PNEPYC 8534PXeon Platinum 8592+Xeon Max 9468 2PXeon Max 9480 2PXeon Platinum 8490H 2PXeon 6766EXeon Platinum 8592+ 2PXeon 6780EEPYC 9654EPYC 9684XEPYC 9754Xeon 6766E 2PXeon 6780E 2PEPYC 9654 2PEPYC 9684X 2PEPYC 9754 2P8M16M24M32M40MSE +/- 48302.92, N = 15SE +/- 88257.34, N = 3SE +/- 93731.24, N = 7SE +/- 62510.72, N = 3SE +/- 48351.08, N = 3SE +/- 86788.79, N = 3SE +/- 88013.69, N = 15SE +/- 143570.67, N = 4SE +/- 171807.74, N = 3SE +/- 197596.27, N = 3SE +/- 239363.92, N = 3SE +/- 45758.35, N = 3SE +/- 195912.00, N = 15SE +/- 75416.94, N = 3SE +/- 170909.18, N = 3SE +/- 118870.12, N = 3SE +/- 172052.60, N = 3SE +/- 138092.00, N = 3SE +/- 223786.94, N = 15SE +/- 746932.76, N = 15SE +/- 651901.79, N = 15SE +/- 803844.71, N = 15714712087954089988176106953601179531811882103120539011216841313859254153544001729702717548934175857371794574518024993195957772282942627630781276577763032459633307574365932041. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti -lpthread
OpenBenchmarking.orgOp/s, More Is BetterSpeedb 2.7Test: Read While WritingXeon Platinum 8380Xeon Max 9468Xeon Max 9480Xeon Platinum 8490HXeon Platinum 8380 2PEPYC 8534PNEPYC 8534PXeon Platinum 8592+Xeon Max 9468 2PXeon Max 9480 2PXeon Platinum 8490H 2PXeon 6766EXeon Platinum 8592+ 2PXeon 6780EEPYC 9654EPYC 9684XEPYC 9754Xeon 6766E 2PXeon 6780E 2PEPYC 9654 2PEPYC 9684X 2PEPYC 9754 2P6M12M18M24M30MMin: 6956376 / Avg: 7147119.8 / Max: 7561052Min: 8642809 / Avg: 8795407.67 / Max: 8948540Min: 9687263 / Avg: 9988176.43 / Max: 10411581Min: 10620683 / Avg: 10695359.67 / Max: 10819533Min: 11731862 / Avg: 11795318 / Max: 11890240Min: 11725465 / Avg: 11882103 / Max: 12025193Min: 11617188 / Avg: 12053900.93 / Max: 12740574Min: 11766394 / Avg: 12168412.75 / Max: 12413695Min: 13643803 / Avg: 13859254 / Max: 14198797Min: 15030824 / Avg: 15354399.67 / Max: 15712674Min: 16836096 / Avg: 17297027.33 / Max: 17639484Min: 17458841 / Avg: 17548934 / Max: 17607906Min: 16371972 / Avg: 17585736.6 / Max: 19279365Min: 17864263 / Avg: 17945745.33 / Max: 18096412Min: 17739848 / Avg: 18024993 / Max: 18330811Min: 19379424 / Avg: 19595777 / Max: 19789299Min: 22504452 / Avg: 22829425.67 / Max: 23089894Min: 27491029 / Avg: 27630780.67 / Max: 27906958Min: 26570064 / Avg: 27657775.6 / Max: 29306683Min: 25392982 / Avg: 30324595.8 / Max: 37197421Min: 28304403 / Avg: 33307573.87 / Max: 37493854Min: 31536610 / Avg: 36593204.4 / Max: 417494331. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti -lpthread

ONNX Runtime

ONNX Runtime is developed by Microsoft and partners as a open-source, cross-platform, high performance machine learning inferencing and training accelerator. This test profile runs the ONNX Runtime with various models available from the ONNX Model Zoo. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.17Model: T5 Encoder - Device: CPU - Executor: ParallelXeon 6766E 2PXeon 6780E 2PXeon 6766EXeon 6780EXeon Platinum 8490H 2PXeon Max 9468 2PXeon Platinum 8380 2PEPYC 9754 2PXeon Max 9480 2PEPYC 8534PNEPYC 8534PEPYC 9654 2PEPYC 9684X 2PXeon Platinum 8380EPYC 9754Xeon Platinum 8490HXeon Max 9468Xeon Max 9480Xeon Platinum 8592+ 2PEPYC 9654EPYC 9684XXeon Platinum 8592+100200300400500SE +/- 1.08, N = 3SE +/- 1.28, N = 3SE +/- 0.65, N = 3SE +/- 0.69, N = 3SE +/- 2.94, N = 3SE +/- 2.44, N = 3SE +/- 1.11, N = 3SE +/- 0.64, N = 3SE +/- 1.67, N = 15SE +/- 1.96, N = 3SE +/- 2.24, N = 3SE +/- 2.43, N = 3SE +/- 0.65, N = 3SE +/- 2.25, N = 3SE +/- 3.02, N = 3SE +/- 0.86, N = 3SE +/- 3.48, N = 15SE +/- 1.74, N = 3SE +/- 1.73, N = 3SE +/- 0.55, N = 3SE +/- 3.58, N = 3SE +/- 3.84, N = 392.5194.42237.80246.04246.34246.68249.48250.63252.67254.73255.67271.62276.21282.25319.45326.14337.00346.21354.75374.75446.30462.861. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt
OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.17Model: T5 Encoder - Device: CPU - Executor: ParallelXeon 6766E 2PXeon 6780E 2PXeon 6766EXeon 6780EXeon Platinum 8490H 2PXeon Max 9468 2PXeon Platinum 8380 2PEPYC 9754 2PXeon Max 9480 2PEPYC 8534PNEPYC 8534PEPYC 9654 2PEPYC 9684X 2PXeon Platinum 8380EPYC 9754Xeon Platinum 8490HXeon Max 9468Xeon Max 9480Xeon Platinum 8592+ 2PEPYC 9654EPYC 9684XXeon Platinum 8592+80160240320400Min: 90.7 / Avg: 92.51 / Max: 94.45Min: 92.4 / Avg: 94.42 / Max: 96.8Min: 236.97 / Avg: 237.8 / Max: 239.08Min: 244.86 / Avg: 246.04 / Max: 247.27Min: 242.46 / Avg: 246.33 / Max: 252.1Min: 241.81 / Avg: 246.68 / Max: 249.47Min: 247.88 / Avg: 249.48 / Max: 251.62Min: 249.63 / Avg: 250.63 / Max: 251.82Min: 239.84 / Avg: 252.67 / Max: 263.27Min: 251.8 / Avg: 254.73 / Max: 258.44Min: 252.52 / Avg: 255.67 / Max: 260.01Min: 267.11 / Avg: 271.62 / Max: 275.45Min: 274.9 / Avg: 276.21 / Max: 276.9Min: 277.75 / Avg: 282.25 / Max: 284.66Min: 313.42 / Avg: 319.45 / Max: 322.65Min: 324.75 / Avg: 326.14 / Max: 327.7Min: 296.9 / Avg: 337 / Max: 348.81Min: 343.93 / Avg: 346.21 / Max: 349.63Min: 351.82 / Avg: 354.75 / Max: 357.8Min: 373.68 / Avg: 374.74 / Max: 375.52Min: 439.15 / Avg: 446.3 / Max: 450.09Min: 455.4 / Avg: 462.85 / Max: 468.181. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

Liquid-DSP

LiquidSDR's Liquid-DSP is a software-defined radio (SDR) digital signal processing library. This test profile runs a multi-threaded benchmark of this SDR/DSP library focused on embedded platform usage. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgsamples/s, More Is BetterLiquid-DSP 1.6Threads: 256 - Buffer Length: 256 - Filter Length: 57Xeon Platinum 8380EPYC 8534PNXeon Max 9468Xeon Platinum 8380 2PEPYC 8534PXeon Max 9480Xeon Platinum 8490HXeon Platinum 8592+Xeon 6766EXeon 6780EXeon Max 9468 2PXeon Max 9480 2PEPYC 9654Xeon Platinum 8490H 2PEPYC 9684XXeon Platinum 8592+ 2PEPYC 9754 2PEPYC 9754Xeon 6766E 2PEPYC 9654 2PXeon 6780E 2PEPYC 9684X 2P2000M4000M6000M8000M10000MSE +/- 2935605.18, N = 3SE +/- 4481443.22, N = 3SE +/- 4088330.28, N = 3SE +/- 3572580.77, N = 3SE +/- 1959875.28, N = 3SE +/- 1976810.00, N = 3SE +/- 5292237.50, N = 3SE +/- 3555434.03, N = 3SE +/- 8015887.00, N = 3SE +/- 6906036.01, N = 3SE +/- 17558125.69, N = 3SE +/- 28453880.81, N = 3SE +/- 2618735.91, N = 3SE +/- 2331189.49, N = 3SE +/- 8144527.82, N = 3SE +/- 61971606.40, N = 3SE +/- 8069352.17, N = 3SE +/- 12739745.33, N = 3SE +/- 28436830.58, N = 3SE +/- 60380193.59, N = 3SE +/- 30821331.00, N = 3SE +/- 50144890.07, N = 316104666672793700000284893333330371000003116933333322253333335008333333806833333425943333347147000004825133333503600000052664666675361266667581190000062843000006316266667640136666768009000007411866667759756666780127000001. (CC) gcc options: -O3 -pthread -lm -lc -lliquid
OpenBenchmarking.orgsamples/s, More Is BetterLiquid-DSP 1.6Threads: 256 - Buffer Length: 256 - Filter Length: 57Xeon Platinum 8380EPYC 8534PNXeon Max 9468Xeon Platinum 8380 2PEPYC 8534PXeon Max 9480Xeon Platinum 8490HXeon Platinum 8592+Xeon 6766EXeon 6780EXeon Max 9468 2PXeon Max 9480 2PEPYC 9654Xeon Platinum 8490H 2PEPYC 9684XXeon Platinum 8592+ 2PEPYC 9754 2PEPYC 9754Xeon 6766E 2PEPYC 9654 2PXeon 6780E 2PEPYC 9684X 2P1400M2800M4200M5600M7000MMin: 1604600000 / Avg: 1610466666.67 / Max: 1613600000Min: 2786200000 / Avg: 2793700000 / Max: 2801700000Min: 2841500000 / Avg: 2848933333.33 / Max: 2855600000Min: 3031600000 / Avg: 3037100000 / Max: 3043800000Min: 3113900000 / Avg: 3116933333.33 / Max: 3120600000Min: 3218900000 / Avg: 3222533333.33 / Max: 3225700000Min: 3493200000 / Avg: 3500833333.33 / Max: 3511000000Min: 3801800000 / Avg: 3806833333.33 / Max: 3813700000Min: 4250200000 / Avg: 4259433333.33 / Max: 4275400000Min: 4703500000 / Avg: 4714700000 / Max: 4727300000Min: 4801700000 / Avg: 4825133333.33 / Max: 4859500000Min: 4985700000 / Avg: 5036000000 / Max: 5084200000Min: 5263000000 / Avg: 5266466666.67 / Max: 5271600000Min: 5358500000 / Avg: 5361266666.67 / Max: 5365900000Min: 5796900000 / Avg: 5811900000 / Max: 5824900000Min: 6187100000 / Avg: 6284300000 / Max: 6399500000Min: 6303500000 / Avg: 6316266666.67 / Max: 6331200000Min: 6375900000 / Avg: 6401366666.67 / Max: 6414800000Min: 6764300000 / Avg: 6800900000 / Max: 6856900000Min: 7292000000 / Avg: 7411866666.67 / Max: 7484500000Min: 7547300000 / Avg: 7597566666.67 / Max: 7653600000Min: 7925400000 / Avg: 8012700000 / Max: 80991000001. (CC) gcc options: -O3 -pthread -lm -lc -lliquid

Embree

Intel Embree is a collection of high-performance ray-tracing kernels for execution on CPUs (and GPUs via SYCL) and supporting instruction sets such as SSE, AVX, AVX2, and AVX-512. Embree also supports making use of the Intel SPMD Program Compiler (ISPC). Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgFrames Per Second, More Is BetterEmbree 4.3Binary: Pathtracer ISPC - Model: CrownXeon Platinum 8380EPYC 8534PNXeon Max 9468EPYC 8534PXeon Max 9480Xeon Platinum 8490HXeon 6766EXeon 6780EXeon Platinum 8380 2PXeon Platinum 8592+Xeon Max 9468 2PEPYC 9654Xeon Max 9480 2PXeon 6766E 2PXeon Platinum 8490H 2PEPYC 9754EPYC 9684XXeon 6780E 2PXeon Platinum 8592+ 2PEPYC 9654 2PEPYC 9754 2PEPYC 9684X 2P50100150200250SE +/- 0.07, N = 3SE +/- 0.07, N = 4SE +/- 0.05, N = 4SE +/- 0.04, N = 4SE +/- 0.02, N = 4SE +/- 0.07, N = 5SE +/- 0.05, N = 5SE +/- 0.02, N = 5SE +/- 0.08, N = 5SE +/- 0.05, N = 5SE +/- 0.14, N = 6SE +/- 0.08, N = 6SE +/- 0.48, N = 6SE +/- 0.11, N = 6SE +/- 0.12, N = 6SE +/- 0.64, N = 6SE +/- 0.20, N = 7SE +/- 0.14, N = 6SE +/- 0.07, N = 7SE +/- 0.43, N = 7SE +/- 1.04, N = 7SE +/- 1.23, N = 843.6758.2858.4262.1965.3370.0573.9681.8382.9282.97107.63110.53116.61121.43124.71126.15130.79133.42153.16176.21190.08214.02
OpenBenchmarking.orgFrames Per Second, More Is BetterEmbree 4.3Binary: Pathtracer ISPC - Model: CrownXeon Platinum 8380EPYC 8534PNXeon Max 9468EPYC 8534PXeon Max 9480Xeon Platinum 8490HXeon 6766EXeon 6780EXeon Platinum 8380 2PXeon Platinum 8592+Xeon Max 9468 2PEPYC 9654Xeon Max 9480 2PXeon 6766E 2PXeon Platinum 8490H 2PEPYC 9754EPYC 9684XXeon 6780E 2PXeon Platinum 8592+ 2PEPYC 9654 2PEPYC 9754 2PEPYC 9684X 2P4080120160200Min: 43.58 / Avg: 43.67 / Max: 43.8Min: 58.07 / Avg: 58.28 / Max: 58.38Min: 58.32 / Avg: 58.42 / Max: 58.54Min: 62.07 / Avg: 62.19 / Max: 62.24Min: 65.28 / Avg: 65.33 / Max: 65.36Min: 69.83 / Avg: 70.05 / Max: 70.24Min: 73.84 / Avg: 73.96 / Max: 74.11Min: 81.78 / Avg: 81.83 / Max: 81.9Min: 82.66 / Avg: 82.92 / Max: 83.12Min: 82.86 / Avg: 82.97 / Max: 83.1Min: 107.1 / Avg: 107.63 / Max: 108.16Min: 110.26 / Avg: 110.53 / Max: 110.83Min: 114.38 / Avg: 116.61 / Max: 117.54Min: 121.09 / Avg: 121.43 / Max: 121.8Min: 124.35 / Avg: 124.71 / Max: 124.98Min: 124.62 / Avg: 126.15 / Max: 128.28Min: 129.98 / Avg: 130.79 / Max: 131.57Min: 132.97 / Avg: 133.42 / Max: 133.84Min: 152.88 / Avg: 153.16 / Max: 153.46Min: 175.09 / Avg: 176.21 / Max: 178.35Min: 187.76 / Avg: 190.08 / Max: 194.89Min: 209.86 / Avg: 214.02 / Max: 219.87

Memcached

Memcached is a high performance, distributed memory object caching system. This Memcached test profiles makes use of memtier_benchmark for excuting this CPU/memory-focused server benchmark. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgOps/sec, More Is BetterMemcached 1.6.19Set To Get Ratio: 1:100Xeon 6766E 2PXeon 6780E 2PXeon 6766EXeon 6780EXeon Platinum 8490H 2PXeon Max 9468 2PXeon Max 9480 2PXeon Platinum 8592+ 2PXeon Max 9480Xeon Max 9468Xeon Platinum 8490HXeon Platinum 8592+Xeon Platinum 8380 2PXeon Platinum 8380EPYC 8534PNEPYC 8534PEPYC 9754 2PEPYC 9754EPYC 9654EPYC 9654 2PEPYC 9684XEPYC 9684X 2P2M4M6M8M10MSE +/- 16910.46, N = 15SE +/- 16926.98, N = 15SE +/- 19070.02, N = 15SE +/- 19998.04, N = 15SE +/- 50660.01, N = 15SE +/- 26891.33, N = 3SE +/- 24083.78, N = 3SE +/- 35300.21, N = 3SE +/- 52575.97, N = 3SE +/- 21428.06, N = 3SE +/- 25335.31, N = 3SE +/- 35182.67, N = 3SE +/- 101903.23, N = 15SE +/- 38410.91, N = 15SE +/- 41123.40, N = 3SE +/- 36366.89, N = 3SE +/- 14591.70, N = 3SE +/- 38372.96, N = 3SE +/- 29027.89, N = 3SE +/- 83562.82, N = 3SE +/- 58081.25, N = 3SE +/- 27143.58, N = 31783869.961821144.002299150.512339570.283245908.403373323.923392842.383780240.564315467.174384040.524481667.954752673.794814941.534826284.805820618.186198256.727645325.707736018.748220895.458498306.788634258.398683410.791. (CXX) g++ options: -O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre
OpenBenchmarking.orgOps/sec, More Is BetterMemcached 1.6.19Set To Get Ratio: 1:100Xeon 6766E 2PXeon 6780E 2PXeon 6766EXeon 6780EXeon Platinum 8490H 2PXeon Max 9468 2PXeon Max 9480 2PXeon Platinum 8592+ 2PXeon Max 9480Xeon Max 9468Xeon Platinum 8490HXeon Platinum 8592+Xeon Platinum 8380 2PXeon Platinum 8380EPYC 8534PNEPYC 8534PEPYC 9754 2PEPYC 9754EPYC 9654EPYC 9654 2PEPYC 9684XEPYC 9684X 2P1.5M3M4.5M6M7.5MMin: 1678433 / Avg: 1783869.96 / Max: 1911330.85Min: 1719917.49 / Avg: 1821144 / Max: 1963311.36Min: 2209198.77 / Avg: 2299150.51 / Max: 2407865.74Min: 2206946.48 / Avg: 2339570.28 / Max: 2455715.42Min: 2978749.57 / Avg: 3245908.4 / Max: 3602162.86Min: 3327832.66 / Avg: 3373323.92 / Max: 3420915.87Min: 3344835.19 / Avg: 3392842.38 / Max: 3420247.08Min: 3727174.59 / Avg: 3780240.56 / Max: 3847101.16Min: 4241023.34 / Avg: 4315467.17 / Max: 4417003.03Min: 4341203.5 / Avg: 4384040.52 / Max: 4406567.27Min: 4432195.38 / Avg: 4481667.95 / Max: 4515890.16Min: 4682633.04 / Avg: 4752673.79 / Max: 4793540.69Min: 4426929.34 / Avg: 4814941.53 / Max: 5762591.13Min: 4629808.71 / Avg: 4826284.8 / Max: 5177059.09Min: 5748289.42 / Avg: 5820618.18 / Max: 5890691.47Min: 6125781.47 / Avg: 6198256.72 / Max: 6239800.48Min: 7629002.82 / Avg: 7645325.7 / Max: 7674437.7Min: 7661698.1 / Avg: 7736018.74 / Max: 7789755.67Min: 8165237.18 / Avg: 8220895.45 / Max: 8263023.98Min: 8331995.61 / Avg: 8498306.78 / Max: 8595733.93Min: 8541184.65 / Avg: 8634258.39 / Max: 8740988.73Min: 8629407.21 / Avg: 8683410.79 / Max: 8715211.671. (CXX) g++ options: -O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre

OpenVINO

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPUXeon 6766EXeon 6780EXeon 6766E 2PXeon 6780E 2PEPYC 9754EPYC 8534PNXeon Platinum 8380EPYC 8534PXeon Platinum 8592+EPYC 9654Xeon Platinum 8592+ 2PEPYC 9684XXeon Platinum 8380 2PXeon Platinum 8490HEPYC 9754 2PXeon Max 9480EPYC 9654 2PEPYC 9684X 2PXeon Max 9468Xeon Max 9480 2PXeon Platinum 8490H 2PXeon Max 9468 2P0.3060.6120.9181.2241.53SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 9SE +/- 0.01, N = 3SE +/- 0.00, N = 15SE +/- 0.00, N = 7SE +/- 0.00, N = 3SE +/- 0.00, N = 15SE +/- 0.00, N = 3SE +/- 0.00, N = 31.361.251.201.090.730.600.560.530.490.480.460.450.450.430.410.370.350.350.330.300.290.281. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPUXeon 6766EXeon 6780EXeon 6766E 2PXeon 6780E 2PEPYC 9754EPYC 8534PNXeon Platinum 8380EPYC 8534PXeon Platinum 8592+EPYC 9654Xeon Platinum 8592+ 2PEPYC 9684XXeon Platinum 8380 2PXeon Platinum 8490HEPYC 9754 2PXeon Max 9480EPYC 9654 2PEPYC 9684X 2PXeon Max 9468Xeon Max 9480 2PXeon Platinum 8490H 2PXeon Max 9468 2P246810Min: 1.36 / Avg: 1.36 / Max: 1.36Min: 1.25 / Avg: 1.25 / Max: 1.26Min: 1.19 / Avg: 1.2 / Max: 1.2Min: 1.08 / Avg: 1.09 / Max: 1.09Min: 0.72 / Avg: 0.73 / Max: 0.73Min: 0.6 / Avg: 0.6 / Max: 0.6Min: 0.55 / Avg: 0.56 / Max: 0.56Min: 0.53 / Avg: 0.53 / Max: 0.53Min: 0.49 / Avg: 0.49 / Max: 0.5Min: 0.47 / Avg: 0.48 / Max: 0.49Min: 0.45 / Avg: 0.46 / Max: 0.47Min: 0.45 / Avg: 0.45 / Max: 0.46Min: 0.45 / Avg: 0.45 / Max: 0.45Min: 0.43 / Avg: 0.43 / Max: 0.43Min: 0.41 / Avg: 0.41 / Max: 0.41Min: 0.36 / Avg: 0.37 / Max: 0.38Min: 0.35 / Avg: 0.35 / Max: 0.35Min: 0.35 / Avg: 0.35 / Max: 0.35Min: 0.33 / Avg: 0.33 / Max: 0.34Min: 0.3 / Avg: 0.3 / Max: 0.31Min: 0.29 / Avg: 0.29 / Max: 0.29Min: 0.28 / Avg: 0.28 / Max: 0.291. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

PyTorch

OpenBenchmarking.orgbatches/sec, More Is BetterPyTorch 2.2.1Device: CPU - Batch Size: 256 - Model: ResNet-50EPYC 9754 2PXeon 6766E 2PXeon 6780E 2PEPYC 9684X 2PEPYC 9654 2PXeon 6766EEPYC 9754Xeon 6780EEPYC 8534PNEPYC 8534PEPYC 9684XEPYC 9654Xeon Platinum 8380 2PXeon Platinum 8490H 2PXeon Max 9480 2PXeon Platinum 8592+ 2PXeon Max 9468 2PXeon Platinum 8380Xeon Max 9480Xeon Max 9468Xeon Platinum 8490HXeon Platinum 8592+1428425670SE +/- 0.28, N = 12SE +/- 0.11, N = 3SE +/- 0.12, N = 3SE +/- 0.32, N = 12SE +/- 0.37, N = 12SE +/- 0.12, N = 3SE +/- 0.08, N = 3SE +/- 0.13, N = 3SE +/- 0.13, N = 3SE +/- 0.18, N = 3SE +/- 0.09, N = 3SE +/- 0.21, N = 3SE +/- 0.23, N = 3SE +/- 0.49, N = 3SE +/- 0.45, N = 3SE +/- 0.29, N = 3SE +/- 0.52, N = 3SE +/- 0.04, N = 3SE +/- 0.62, N = 3SE +/- 0.76, N = 3SE +/- 0.52, N = 3SE +/- 0.64, N = 313.1114.6716.2216.9717.4126.8227.7830.8633.3033.6834.9034.9036.9737.4437.9141.4541.6848.8951.5652.9754.8463.60
OpenBenchmarking.orgbatches/sec, More Is BetterPyTorch 2.2.1Device: CPU - Batch Size: 256 - Model: ResNet-50EPYC 9754 2PXeon 6766E 2PXeon 6780E 2PEPYC 9684X 2PEPYC 9654 2PXeon 6766EEPYC 9754Xeon 6780EEPYC 8534PNEPYC 8534PEPYC 9684XEPYC 9654Xeon Platinum 8380 2PXeon Platinum 8490H 2PXeon Max 9480 2PXeon Platinum 8592+ 2PXeon Max 9468 2PXeon Platinum 8380Xeon Max 9480Xeon Max 9468Xeon Platinum 8490HXeon Platinum 8592+1224364860Min: 11.78 / Avg: 13.11 / Max: 14.36Min: 14.49 / Avg: 14.67 / Max: 14.86Min: 16.09 / Avg: 16.22 / Max: 16.46Min: 15.12 / Avg: 16.97 / Max: 18.62Min: 15.76 / Avg: 17.41 / Max: 19.14Min: 26.68 / Avg: 26.82 / Max: 27.07Min: 27.63 / Avg: 27.78 / Max: 27.91Min: 30.68 / Avg: 30.86 / Max: 31.1Min: 33.06 / Avg: 33.3 / Max: 33.49Min: 33.35 / Avg: 33.68 / Max: 33.95Min: 34.77 / Avg: 34.9 / Max: 35.07Min: 34.66 / Avg: 34.9 / Max: 35.31Min: 36.73 / Avg: 36.97 / Max: 37.42Min: 36.73 / Avg: 37.44 / Max: 38.39Min: 37.02 / Avg: 37.91 / Max: 38.38Min: 40.97 / Avg: 41.45 / Max: 41.96Min: 40.84 / Avg: 41.68 / Max: 42.62Min: 48.82 / Avg: 48.89 / Max: 48.93Min: 50.46 / Avg: 51.56 / Max: 52.61Min: 51.73 / Avg: 52.97 / Max: 54.35Min: 53.9 / Avg: 54.84 / Max: 55.68Min: 62.37 / Avg: 63.6 / Max: 64.51

GraphicsMagick

OpenBenchmarking.orgIterations Per Minute, More Is BetterGraphicsMagick 1.3.43Operation: SharpenXeon Platinum 8380EPYC 8534PNEPYC 8534PXeon Max 9468Xeon Max 9480Xeon Platinum 8380 2PXeon Platinum 8490HXeon Platinum 8592+EPYC 9654Xeon Max 9468 2PEPYC 9684XEPYC 9754Xeon Max 9480 2PXeon 6766EEPYC 9654 2PXeon Platinum 8490H 2PXeon 6780EXeon Platinum 8592+ 2PEPYC 9684X 2PEPYC 9754 2PXeon 6766E 2PXeon 6780E 2P80160240320400SE +/- 0.33, N = 3SE +/- 0.33, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.33, N = 3SE +/- 0.33, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 1.20, N = 3SE +/- 0.00, N = 3SE +/- 0.33, N = 3SE +/- 0.33, N = 3SE +/- 0.00, N = 3SE +/- 1.20, N = 3SE +/- 1.67, N = 3SE +/- 0.00, N = 3SE +/- 1.67, N = 3SE +/- 0.88, N = 3SE +/- 3.00, N = 3SE +/- 0.88, N = 3SE +/- 0.67, N = 3791051121141301441571671731992012072272532622652812842973103363811. (CC) gcc options: -fopenmp -O2 -ltiff -ljbig -lsharpyuv -lwebp -lwebpmux -lfreetype -ljpeg -lXext -lSM -lICE -lX11 -lxml2 -lzstd -llzma -lbz2 -lz -lm -lpthread -lgomp
OpenBenchmarking.orgIterations Per Minute, More Is BetterGraphicsMagick 1.3.43Operation: SharpenXeon Platinum 8380EPYC 8534PNEPYC 8534PXeon Max 9468Xeon Max 9480Xeon Platinum 8380 2PXeon Platinum 8490HXeon Platinum 8592+EPYC 9654Xeon Max 9468 2PEPYC 9684XEPYC 9754Xeon Max 9480 2PXeon 6766EEPYC 9654 2PXeon Platinum 8490H 2PXeon 6780EXeon Platinum 8592+ 2PEPYC 9684X 2PEPYC 9754 2PXeon 6766E 2PXeon 6780E 2P70140210280350Min: 79 / Avg: 79.33 / Max: 80Min: 105 / Avg: 105.33 / Max: 106Min: 112 / Avg: 112 / Max: 112Min: 114 / Avg: 114 / Max: 114Min: 130 / Avg: 130 / Max: 130Min: 143 / Avg: 143.67 / Max: 144Min: 156 / Avg: 156.67 / Max: 157Min: 167 / Avg: 167 / Max: 167Min: 173 / Avg: 173 / Max: 173Min: 197 / Avg: 199.33 / Max: 201Min: 201 / Avg: 201 / Max: 201Min: 207 / Avg: 207.33 / Max: 208Min: 226 / Avg: 226.67 / Max: 227Min: 253 / Avg: 253 / Max: 253Min: 260 / Avg: 262.33 / Max: 264Min: 262 / Avg: 265.33 / Max: 267Min: 281 / Avg: 281 / Max: 281Min: 281 / Avg: 284.33 / Max: 286Min: 296 / Avg: 297.33 / Max: 299Min: 304 / Avg: 310 / Max: 313Min: 335 / Avg: 336.33 / Max: 338Min: 380 / Avg: 380.67 / Max: 3821. (CC) gcc options: -fopenmp -O2 -ltiff -ljbig -lsharpyuv -lwebp -lwebpmux -lfreetype -ljpeg -lXext -lSM -lICE -lX11 -lxml2 -lzstd -llzma -lbz2 -lz -lm -lpthread -lgomp

srsRAN Project

OpenBenchmarking.orgMbps, More Is BettersrsRAN Project 23.10.1-20240325Test: PUSCH Processor Benchmark, Throughput TotalXeon Platinum 8380Xeon 6766EXeon 6780EXeon Max 9468Xeon Max 9480Xeon Platinum 8490HEPYC 8534PNXeon 6766E 2PXeon Platinum 8592+EPYC 8534PXeon Platinum 8380 2PXeon 6780E 2PXeon Max 9468 2PXeon Max 9480 2PXeon Platinum 8490H 2PEPYC 9654Xeon Platinum 8592+ 2PEPYC 9684XEPYC 9754EPYC 9654 2PEPYC 9684X 2PEPYC 9754 2P2K4K6K8K10KSE +/- 0.07, N = 3SE +/- 8.17, N = 3SE +/- 0.00, N = 3SE +/- 0.09, N = 3SE +/- 18.30, N = 3SE +/- 18.43, N = 3SE +/- 19.02, N = 13SE +/- 36.60, N = 3SE +/- 18.09, N = 3SE +/- 25.25, N = 3SE +/- 0.17, N = 3SE +/- 14.40, N = 3SE +/- 26.47, N = 3SE +/- 0.15, N = 3SE +/- 47.68, N = 6SE +/- 0.20, N = 3SE +/- 0.12, N = 3SE +/- 55.17, N = 3SE +/- 63.64, N = 5SE +/- 74.95, N = 4SE +/- 2.29, N = 3SE +/- 76.45, N = 31770.01953.12118.62170.72514.02616.92818.53067.03088.73193.03288.43414.23787.04386.64853.65239.65493.45656.95973.86835.76999.78396.71. (CXX) g++ options: -O3 -march=native -mavx2 -mavx -msse4.1 -mfma -fno-trapping-math -fno-math-errno -ldl
OpenBenchmarking.orgMbps, More Is BettersrsRAN Project 23.10.1-20240325Test: PUSCH Processor Benchmark, Throughput TotalXeon Platinum 8380Xeon 6766EXeon 6780EXeon Max 9468Xeon Max 9480Xeon Platinum 8490HEPYC 8534PNXeon 6766E 2PXeon Platinum 8592+EPYC 8534PXeon Platinum 8380 2PXeon 6780E 2PXeon Max 9468 2PXeon Max 9480 2PXeon Platinum 8490H 2PEPYC 9654Xeon Platinum 8592+ 2PEPYC 9684XEPYC 9754EPYC 9654 2PEPYC 9684X 2PEPYC 9754 2P15003000450060007500Min: 1769.9 / Avg: 1769.97 / Max: 1770.1Min: 1936.8 / Avg: 1953.13 / Max: 1961.3Min: 2118.6 / Avg: 2118.6 / Max: 2118.6Min: 2170.5 / Avg: 2170.67 / Max: 2170.8Min: 2477.4 / Avg: 2514 / Max: 2532.5Min: 2598.4 / Avg: 2616.93 / Max: 2653.8Min: 2629.7 / Avg: 2818.52 / Max: 2893.2Min: 3020.5 / Avg: 3067 / Max: 3139.2Min: 3070 / Avg: 3088.73 / Max: 3124.9Min: 3142.5 / Avg: 3193 / Max: 3219Min: 3288.1 / Avg: 3288.4 / Max: 3288.7Min: 3387.9 / Avg: 3414.2 / Max: 3437.5Min: 3760.1 / Avg: 3786.97 / Max: 3839.9Min: 4386.4 / Avg: 4386.63 / Max: 4386.9Min: 4702.5 / Avg: 4853.58 / Max: 4929.4Min: 5239.3 / Avg: 5239.63 / Max: 5240Min: 5493.2 / Avg: 5493.43 / Max: 5493.6Min: 5601.6 / Avg: 5656.87 / Max: 5767.2Min: 5909.9 / Avg: 5973.84 / Max: 6228.4Min: 6627 / Avg: 6835.73 / Max: 6950.8Min: 6996 / Avg: 6999.7 / Max: 7003.9Min: 8313.2 / Avg: 8396.73 / Max: 8549.41. (CXX) g++ options: -O3 -march=native -mavx2 -mavx -msse4.1 -mfma -fno-trapping-math -fno-math-errno -ldl

GROMACS

The GROMACS (GROningen MAchine for Chemical Simulations) molecular dynamics package testing with the water_GMX50 data. This test profile allows selecting between CPU and GPU-based GROMACS builds. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgNs Per Day, More Is BetterGROMACS 2024Implementation: MPI CPU - Input: water_GMX50_bareXeon Platinum 8380EPYC 8534PNEPYC 8534PXeon Max 9468Xeon Max 9480Xeon Platinum 8490HXeon Platinum 8380 2PXeon Platinum 8592+EPYC 9654EPYC 9754Xeon Max 9468 2PXeon Max 9480 2PEPYC 9684XXeon Platinum 8490H 2PXeon Platinum 8592+ 2PEPYC 9654 2PEPYC 9754 2PEPYC 9684X 2P510152025SE +/- 0.018, N = 3SE +/- 0.004, N = 3SE +/- 0.004, N = 3SE +/- 0.019, N = 3SE +/- 0.007, N = 3SE +/- 0.010, N = 3SE +/- 0.036, N = 3SE +/- 0.009, N = 3SE +/- 0.034, N = 3SE +/- 0.032, N = 3SE +/- 0.025, N = 3SE +/- 0.032, N = 3SE +/- 0.052, N = 3SE +/- 0.019, N = 3SE +/- 0.046, N = 3SE +/- 0.189, N = 6SE +/- 0.067, N = 3SE +/- 0.224, N = 144.8136.2466.4997.5458.2828.7628.96410.47712.51413.24213.39214.12715.22215.45018.54020.23421.30522.5251. (CXX) g++ options: -O3 -lm
OpenBenchmarking.orgNs Per Day, More Is BetterGROMACS 2024Implementation: MPI CPU - Input: water_GMX50_bareXeon Platinum 8380EPYC 8534PNEPYC 8534PXeon Max 9468Xeon Max 9480Xeon Platinum 8490HXeon Platinum 8380 2PXeon Platinum 8592+EPYC 9654EPYC 9754Xeon Max 9468 2PXeon Max 9480 2PEPYC 9684XXeon Platinum 8490H 2PXeon Platinum 8592+ 2PEPYC 9654 2PEPYC 9754 2PEPYC 9684X 2P510152025Min: 4.79 / Avg: 4.81 / Max: 4.85Min: 6.24 / Avg: 6.25 / Max: 6.25Min: 6.5 / Avg: 6.5 / Max: 6.51Min: 7.51 / Avg: 7.55 / Max: 7.56Min: 8.27 / Avg: 8.28 / Max: 8.3Min: 8.75 / Avg: 8.76 / Max: 8.78Min: 8.9 / Avg: 8.96 / Max: 9.03Min: 10.46 / Avg: 10.48 / Max: 10.49Min: 12.45 / Avg: 12.51 / Max: 12.57Min: 13.19 / Avg: 13.24 / Max: 13.3Min: 13.36 / Avg: 13.39 / Max: 13.44Min: 14.07 / Avg: 14.13 / Max: 14.18Min: 15.12 / Avg: 15.22 / Max: 15.3Min: 15.41 / Avg: 15.45 / Max: 15.47Min: 18.45 / Avg: 18.54 / Max: 18.59Min: 19.3 / Avg: 20.23 / Max: 20.49Min: 21.17 / Avg: 21.31 / Max: 21.38Min: 19.93 / Avg: 22.53 / Max: 23.011. (CXX) g++ options: -O3 -lm

OpenVKL

OpenVKL is the Intel Open Volume Kernel Library that offers high-performance volume computation kernels and part of the Intel oneAPI rendering toolkit. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgItems / Sec, More Is BetterOpenVKL 2.0.0Benchmark: vklBenchmarkCPU ISPCXeon Platinum 8380EPYC 8534PNXeon Max 9468EPYC 8534PXeon 6766EXeon Max 9480Xeon 6780EXeon Platinum 8380 2PXeon Platinum 8490HXeon Max 9468 2PXeon Max 9480 2PXeon Platinum 8592+Xeon 6766E 2PEPYC 9654Xeon 6780E 2PEPYC 9684XEPYC 9754Xeon Platinum 8490H 2PXeon Platinum 8592+ 2PEPYC 9654 2PEPYC 9684X 2PEPYC 9754 2P9001800270036004500SE +/- 6.81, N = 3SE +/- 8.17, N = 3SE +/- 6.66, N = 3SE +/- 1.20, N = 3SE +/- 0.58, N = 3SE +/- 13.96, N = 3SE +/- 0.67, N = 3SE +/- 12.02, N = 3SE +/- 1.53, N = 3SE +/- 8.62, N = 3SE +/- 4.36, N = 3SE +/- 2.08, N = 3SE +/- 7.31, N = 3SE +/- 1.20, N = 3SE +/- 3.61, N = 3SE +/- 1.00, N = 3SE +/- 0.88, N = 3SE +/- 6.74, N = 3SE +/- 13.62, N = 3SE +/- 8.67, N = 3SE +/- 5.36, N = 3SE +/- 26.33, N = 3869117712431266126713561391152717341776185220042020207722282396250827163222333539064012
OpenBenchmarking.orgItems / Sec, More Is BetterOpenVKL 2.0.0Benchmark: vklBenchmarkCPU ISPCXeon Platinum 8380EPYC 8534PNXeon Max 9468EPYC 8534PXeon 6766EXeon Max 9480Xeon 6780EXeon Platinum 8380 2PXeon Platinum 8490HXeon Max 9468 2PXeon Max 9480 2PXeon Platinum 8592+Xeon 6766E 2PEPYC 9654Xeon 6780E 2PEPYC 9684XEPYC 9754Xeon Platinum 8490H 2PXeon Platinum 8592+ 2PEPYC 9654 2PEPYC 9684X 2PEPYC 9754 2P7001400210028003500Min: 856 / Avg: 869 / Max: 879Min: 1161 / Avg: 1177.33 / Max: 1186Min: 1231 / Avg: 1243 / Max: 1254Min: 1264 / Avg: 1266.33 / Max: 1268Min: 1266 / Avg: 1267 / Max: 1268Min: 1334 / Avg: 1356.33 / Max: 1382Min: 1390 / Avg: 1391.33 / Max: 1392Min: 1504 / Avg: 1527.33 / Max: 1544Min: 1731 / Avg: 1734 / Max: 1736Min: 1759 / Avg: 1776 / Max: 1787Min: 1844 / Avg: 1852 / Max: 1859Min: 2001 / Avg: 2004 / Max: 2008Min: 2010 / Avg: 2019.67 / Max: 2034Min: 2075 / Avg: 2077.33 / Max: 2079Min: 2221 / Avg: 2228 / Max: 2233Min: 2395 / Avg: 2396 / Max: 2398Min: 2506 / Avg: 2507.67 / Max: 2509Min: 2706 / Avg: 2716.33 / Max: 2729Min: 3200 / Avg: 3222.33 / Max: 3247Min: 3326 / Avg: 3334.67 / Max: 3352Min: 3896 / Avg: 3906.33 / Max: 3914Min: 3986 / Avg: 4012.33 / Max: 4065

PyTorch

OpenBenchmarking.orgbatches/sec, More Is BetterPyTorch 2.2.1Device: CPU - Batch Size: 64 - Model: ResNet-50EPYC 9754 2PXeon 6766E 2PXeon 6780E 2PEPYC 9654 2PEPYC 9684X 2PXeon 6766EEPYC 9754Xeon 6780EEPYC 8534PNEPYC 8534PEPYC 9684XEPYC 9654Xeon Platinum 8490H 2PXeon Platinum 8380 2PXeon Max 9480 2PXeon Platinum 8592+ 2PXeon Max 9468 2PXeon Platinum 8380Xeon Max 9480Xeon Max 9468Xeon Platinum 8490HXeon Platinum 8592+1428425670SE +/- 0.23, N = 9SE +/- 0.06, N = 3SE +/- 0.11, N = 3SE +/- 0.35, N = 12SE +/- 0.37, N = 12SE +/- 0.14, N = 3SE +/- 0.10, N = 3SE +/- 0.33, N = 5SE +/- 0.18, N = 3SE +/- 0.06, N = 3SE +/- 0.10, N = 3SE +/- 0.26, N = 3SE +/- 0.50, N = 3SE +/- 0.40, N = 15SE +/- 0.46, N = 4SE +/- 0.12, N = 3SE +/- 0.51, N = 3SE +/- 0.14, N = 3SE +/- 0.62, N = 3SE +/- 0.71, N = 3SE +/- 0.24, N = 3SE +/- 0.12, N = 313.6814.8416.1017.0717.2826.8927.6830.6933.2333.4934.7135.0137.0837.7538.3040.7742.3548.9951.3551.5556.0163.06
OpenBenchmarking.orgbatches/sec, More Is BetterPyTorch 2.2.1Device: CPU - Batch Size: 64 - Model: ResNet-50EPYC 9754 2PXeon 6766E 2PXeon 6780E 2PEPYC 9654 2PEPYC 9684X 2PXeon 6766EEPYC 9754Xeon 6780EEPYC 8534PNEPYC 8534PEPYC 9684XEPYC 9654Xeon Platinum 8490H 2PXeon Platinum 8380 2PXeon Max 9480 2PXeon Platinum 8592+ 2PXeon Max 9468 2PXeon Platinum 8380Xeon Max 9480Xeon Max 9468Xeon Platinum 8490HXeon Platinum 8592+1224364860Min: 12.52 / Avg: 13.68 / Max: 14.43Min: 14.72 / Avg: 14.84 / Max: 14.93Min: 15.89 / Avg: 16.1 / Max: 16.29Min: 15.52 / Avg: 17.07 / Max: 19.21Min: 15.34 / Avg: 17.28 / Max: 18.84Min: 26.62 / Avg: 26.89 / Max: 27.09Min: 27.51 / Avg: 27.68 / Max: 27.86Min: 29.81 / Avg: 30.69 / Max: 31.64Min: 32.87 / Avg: 33.23 / Max: 33.45Min: 33.37 / Avg: 33.49 / Max: 33.57Min: 34.56 / Avg: 34.71 / Max: 34.9Min: 34.66 / Avg: 35.01 / Max: 35.52Min: 36.19 / Avg: 37.08 / Max: 37.92Min: 35.29 / Avg: 37.75 / Max: 40.54Min: 36.95 / Avg: 38.3 / Max: 38.97Min: 40.55 / Avg: 40.77 / Max: 40.96Min: 41.36 / Avg: 42.35 / Max: 43.03Min: 48.76 / Avg: 48.99 / Max: 49.25Min: 50.48 / Avg: 51.35 / Max: 52.55Min: 50.78 / Avg: 51.55 / Max: 52.97Min: 55.54 / Avg: 56.01 / Max: 56.33Min: 62.84 / Avg: 63.06 / Max: 63.24

OpenBenchmarking.orgbatches/sec, More Is BetterPyTorch 2.2.1Device: CPU - Batch Size: 512 - Model: ResNet-50EPYC 9754 2PXeon 6766E 2PXeon 6780E 2PEPYC 9654 2PEPYC 9684X 2PXeon 6766EEPYC 9754Xeon 6780EEPYC 8534PNEPYC 8534PEPYC 9654EPYC 9684XXeon Platinum 8380 2PXeon Platinum 8490H 2PXeon Max 9480 2PXeon Platinum 8592+ 2PXeon Max 9468 2PXeon Platinum 8380Xeon Max 9468Xeon Max 9480Xeon Platinum 8490HXeon Platinum 8592+1428425670SE +/- 0.22, N = 12SE +/- 0.03, N = 3SE +/- 0.13, N = 9SE +/- 0.23, N = 3SE +/- 0.29, N = 12SE +/- 0.24, N = 3SE +/- 0.04, N = 3SE +/- 0.02, N = 3SE +/- 0.11, N = 3SE +/- 0.08, N = 3SE +/- 0.10, N = 3SE +/- 0.19, N = 3SE +/- 0.38, N = 15SE +/- 0.21, N = 3SE +/- 0.34, N = 15SE +/- 0.30, N = 15SE +/- 0.26, N = 3SE +/- 0.17, N = 3SE +/- 0.72, N = 3SE +/- 0.43, N = 15SE +/- 0.12, N = 3SE +/- 0.19, N = 313.7614.8115.9716.2416.8226.9127.5330.8733.1833.7634.6534.6937.4537.5537.8440.8341.6548.9951.0551.8656.4463.30
OpenBenchmarking.orgbatches/sec, More Is BetterPyTorch 2.2.1Device: CPU - Batch Size: 512 - Model: ResNet-50EPYC 9754 2PXeon 6766E 2PXeon 6780E 2PEPYC 9654 2PEPYC 9684X 2PXeon 6766EEPYC 9754Xeon 6780EEPYC 8534PNEPYC 8534PEPYC 9654EPYC 9684XXeon Platinum 8380 2PXeon Platinum 8490H 2PXeon Max 9480 2PXeon Platinum 8592+ 2PXeon Max 9468 2PXeon Platinum 8380Xeon Max 9468Xeon Max 9480Xeon Platinum 8490HXeon Platinum 8592+1224364860Min: 11.74 / Avg: 13.76 / Max: 14.57Min: 14.76 / Avg: 14.81 / Max: 14.85Min: 15.22 / Avg: 15.97 / Max: 16.57Min: 15.95 / Avg: 16.24 / Max: 16.71Min: 15.34 / Avg: 16.82 / Max: 18.37Min: 26.61 / Avg: 26.91 / Max: 27.38Min: 27.44 / Avg: 27.53 / Max: 27.59Min: 30.83 / Avg: 30.87 / Max: 30.91Min: 32.96 / Avg: 33.18 / Max: 33.3Min: 33.61 / Avg: 33.76 / Max: 33.88Min: 34.53 / Avg: 34.65 / Max: 34.85Min: 34.41 / Avg: 34.69 / Max: 35.06Min: 35.48 / Avg: 37.45 / Max: 39.79Min: 37.32 / Avg: 37.55 / Max: 37.96Min: 35.44 / Avg: 37.84 / Max: 39.47Min: 38.66 / Avg: 40.83 / Max: 41.99Min: 41.16 / Avg: 41.65 / Max: 42.05Min: 48.77 / Avg: 48.99 / Max: 49.32Min: 49.89 / Avg: 51.05 / Max: 52.38Min: 48.81 / Avg: 51.86 / Max: 54.88Min: 56.2 / Avg: 56.44 / Max: 56.58Min: 62.94 / Avg: 63.3 / Max: 63.6

ONNX Runtime

ONNX Runtime is developed by Microsoft and partners as a open-source, cross-platform, high performance machine learning inferencing and training accelerator. This test profile runs the ONNX Runtime with various models available from the ONNX Model Zoo. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.17Model: yolov4 - Device: CPU - Executor: ParallelXeon 6780E 2PXeon 6766E 2PEPYC 9754 2PEPYC 9684X 2PEPYC 9654 2PXeon 6766EXeon 6780EEPYC 8534PNEPYC 9754EPYC 8534PEPYC 9654EPYC 9684XXeon Max 9480 2PXeon Platinum 8490H 2PXeon Max 9468 2PXeon Platinum 8592+ 2PXeon Platinum 8380 2PXeon Max 9468Xeon Max 9480Xeon Platinum 8380Xeon Platinum 8490HXeon Platinum 8592+510152025SE +/- 0.02942, N = 3SE +/- 0.05214, N = 3SE +/- 0.07368, N = 3SE +/- 0.00606, N = 3SE +/- 0.02467, N = 3SE +/- 0.04609, N = 3SE +/- 0.03075, N = 3SE +/- 0.03807, N = 3SE +/- 0.01474, N = 3SE +/- 0.00112, N = 3SE +/- 0.01934, N = 3SE +/- 0.00491, N = 3SE +/- 0.02010, N = 3SE +/- 0.01439, N = 3SE +/- 0.12795, N = 3SE +/- 0.11392, N = 3SE +/- 0.09305, N = 3SE +/- 0.05802, N = 3SE +/- 0.00279, N = 3SE +/- 0.11211, N = 3SE +/- 0.01672, N = 3SE +/- 0.13074, N = 34.562784.589605.557676.318286.348917.135877.695838.472838.635948.758149.785169.8000812.5974012.7546013.0869014.1980014.2169016.1742016.3898017.6747018.1413020.879501. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt
OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.17Model: yolov4 - Device: CPU - Executor: ParallelXeon 6780E 2PXeon 6766E 2PEPYC 9754 2PEPYC 9684X 2PEPYC 9654 2PXeon 6766EXeon 6780EEPYC 8534PNEPYC 9754EPYC 8534PEPYC 9654EPYC 9684XXeon Max 9480 2PXeon Platinum 8490H 2PXeon Max 9468 2PXeon Platinum 8592+ 2PXeon Platinum 8380 2PXeon Max 9468Xeon Max 9480Xeon Platinum 8380Xeon Platinum 8490HXeon Platinum 8592+510152025Min: 4.51 / Avg: 4.56 / Max: 4.61Min: 4.49 / Avg: 4.59 / Max: 4.67Min: 5.44 / Avg: 5.56 / Max: 5.69Min: 6.31 / Avg: 6.32 / Max: 6.33Min: 6.31 / Avg: 6.35 / Max: 6.39Min: 7.05 / Avg: 7.14 / Max: 7.21Min: 7.63 / Avg: 7.7 / Max: 7.73Min: 8.4 / Avg: 8.47 / Max: 8.53Min: 8.61 / Avg: 8.64 / Max: 8.66Min: 8.76 / Avg: 8.76 / Max: 8.76Min: 9.76 / Avg: 9.79 / Max: 9.82Min: 9.79 / Avg: 9.8 / Max: 9.81Min: 12.56 / Avg: 12.6 / Max: 12.63Min: 12.73 / Avg: 12.75 / Max: 12.78Min: 12.95 / Avg: 13.09 / Max: 13.34Min: 13.97 / Avg: 14.2 / Max: 14.35Min: 14.04 / Avg: 14.22 / Max: 14.36Min: 16.06 / Avg: 16.17 / Max: 16.25Min: 16.39 / Avg: 16.39 / Max: 16.4Min: 17.54 / Avg: 17.67 / Max: 17.9Min: 18.11 / Avg: 18.14 / Max: 18.16Min: 20.62 / Avg: 20.88 / Max: 21.051. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

NAS Parallel Benchmarks

NPB, NAS Parallel Benchmarks, is a benchmark developed by NASA for high-end computer systems. This test profile currently uses the MPI version of NPB. This test profile offers selecting the different NPB tests/problems and varying problem sizes. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgTotal Mop/s, More Is BetterNAS Parallel Benchmarks 3.4Test / Class: CG.CEPYC 8534PNEPYC 8534PXeon Platinum 8380Xeon Platinum 8490HXeon Max 9468Xeon Max 9480Xeon Platinum 8380 2PEPYC 9754EPYC 9654Xeon Platinum 8490H 2PEPYC 9684XEPYC 9754 2PXeon Platinum 8592+Xeon Max 9468 2PXeon Max 9480 2PEPYC 9654 2PEPYC 9684X 2PXeon Platinum 8592+ 2P20K40K60K80K100KSE +/- 207.19, N = 6SE +/- 126.79, N = 6SE +/- 34.34, N = 6SE +/- 243.41, N = 12SE +/- 313.88, N = 7SE +/- 260.16, N = 15SE +/- 28.62, N = 7SE +/- 480.71, N = 15SE +/- 393.67, N = 15SE +/- 178.23, N = 8SE +/- 386.70, N = 9SE +/- 545.82, N = 5SE +/- 328.18, N = 8SE +/- 545.92, N = 15SE +/- 560.41, N = 15SE +/- 779.47, N = 7SE +/- 661.05, N = 7SE +/- 271.54, N = 621684.8022229.9422655.3233811.6335116.5535234.0638906.1343799.7853182.7758128.2462071.1063265.0163760.4565396.2266492.4484477.7288487.9198764.931. (F9X) gfortran options: -O3 -march=native -lmpi_usempif08 -lmpi_mpifh -lmpi -lopen-rte -lopen-pal -lhwloc -levent_core -levent_pthreads -lm -lz 2. Open MPI 4.1.6
OpenBenchmarking.orgTotal Mop/s, More Is BetterNAS Parallel Benchmarks 3.4Test / Class: CG.CEPYC 8534PNEPYC 8534PXeon Platinum 8380Xeon Platinum 8490HXeon Max 9468Xeon Max 9480Xeon Platinum 8380 2PEPYC 9754EPYC 9654Xeon Platinum 8490H 2PEPYC 9684XEPYC 9754 2PXeon Platinum 8592+Xeon Max 9468 2PXeon Max 9480 2PEPYC 9654 2PEPYC 9684X 2PXeon Platinum 8592+ 2P20K40K60K80K100KMin: 21140.06 / Avg: 21684.8 / Max: 22491.49Min: 21810.34 / Avg: 22229.94 / Max: 22541.5Min: 22536.52 / Avg: 22655.32 / Max: 22722.85Min: 32823.96 / Avg: 33811.63 / Max: 35427.22Min: 34000.56 / Avg: 35116.55 / Max: 36330.28Min: 33494.3 / Avg: 35234.06 / Max: 36603.54Min: 38799.71 / Avg: 38906.13 / Max: 39013.91Min: 40753.07 / Avg: 43799.78 / Max: 47031.84Min: 50577.84 / Avg: 53182.77 / Max: 55585.41Min: 57523.16 / Avg: 58128.24 / Max: 59031.08Min: 59857.9 / Avg: 62071.1 / Max: 63617Min: 61210 / Avg: 63265.01 / Max: 64247.24Min: 62397.94 / Avg: 63760.45 / Max: 64819.94Min: 62703.28 / Avg: 65396.22 / Max: 69335.3Min: 64389.69 / Avg: 66492.44 / Max: 70869.72Min: 81385.52 / Avg: 84477.72 / Max: 86755.63Min: 86828.59 / Avg: 88487.91 / Max: 91345.07Min: 98048.32 / Avg: 98764.93 / Max: 99644.911. (F9X) gfortran options: -O3 -march=native -lmpi_usempif08 -lmpi_mpifh -lmpi -lopen-rte -lopen-pal -lhwloc -levent_core -levent_pthreads -lm -lz 2. Open MPI 4.1.6

ASKAP

ASKAP is a set of benchmarks from the Australian SKA Pathfinder. The principal ASKAP benchmarks are the Hogbom Clean Benchmark (tHogbomClean) and Convolutional Resamping Benchmark (tConvolve) as well as some previous ASKAP benchmarks being included as well for OpenCL and CUDA execution of tConvolve. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgMillion Grid Points Per Second, More Is BetterASKAP 1.0Test: tConvolve MT - GriddingXeon Max 9468 2PXeon Max 9468Xeon Max 9480Xeon Max 9480 2PXeon Platinum 8592+Xeon Platinum 8380Xeon Platinum 8380 2PEPYC 8534PNEPYC 8534PXeon Platinum 8592+ 2PXeon Platinum 8490H 2PXeon Platinum 8490HEPYC 9754 2PEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9684X 2PEPYC 9684X3K6K9K12K15KSE +/- 23.56, N = 3SE +/- 87.89, N = 12SE +/- 32.87, N = 12SE +/- 195.28, N = 8SE +/- 54.27, N = 5SE +/- 6.18, N = 3SE +/- 19.36, N = 3SE +/- 0.88, N = 3SE +/- 0.88, N = 3SE +/- 60.72, N = 3SE +/- 75.19, N = 5SE +/- 4.15, N = 3SE +/- 21.01, N = 3SE +/- 59.24, N = 3SE +/- 141.43, N = 5SE +/- 2.09, N = 3SE +/- 204.28, N = 3SE +/- 262.30, N = 123347.933375.323406.964382.975062.075172.965279.075821.465826.446038.927630.068088.1111208.7012394.6012708.5012731.8014185.1014955.601. (CXX) g++ options: -O3 -fstrict-aliasing -fopenmp
OpenBenchmarking.orgMillion Grid Points Per Second, More Is BetterASKAP 1.0Test: tConvolve MT - GriddingXeon Max 9468 2PXeon Max 9468Xeon Max 9480Xeon Max 9480 2PXeon Platinum 8592+Xeon Platinum 8380Xeon Platinum 8380 2PEPYC 8534PNEPYC 8534PXeon Platinum 8592+ 2PXeon Platinum 8490H 2PXeon Platinum 8490HEPYC 9754 2PEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9684X 2PEPYC 9684X3K6K9K12K15KMin: 3301.97 / Avg: 3347.93 / Max: 3379.91Min: 2777.12 / Avg: 3375.32 / Max: 3849.48Min: 3251.98 / Avg: 3406.96 / Max: 3632.24Min: 3160.98 / Avg: 4382.97 / Max: 4764.45Min: 4957.92 / Avg: 5062.07 / Max: 5265.07Min: 5165 / Avg: 5172.96 / Max: 5185.12Min: 5241.26 / Avg: 5279.07 / Max: 5305.23Min: 5819.8 / Avg: 5821.46 / Max: 5822.79Min: 5824.78 / Avg: 5826.44 / Max: 5827.76Min: 5928.12 / Avg: 6038.92 / Max: 6137.36Min: 7461.63 / Avg: 7630.06 / Max: 7858.99Min: 8080.61 / Avg: 8088.11 / Max: 8094.94Min: 11167.6 / Avg: 11208.73 / Max: 11236.7Min: 12279.9 / Avg: 12394.57 / Max: 12477.7Min: 12310.9 / Avg: 12708.48 / Max: 13074.5Min: 12728.6 / Avg: 12731.77 / Max: 12735.7Min: 13971.3 / Avg: 14185.1 / Max: 14593.5Min: 13077.8 / Avg: 14955.56 / Max: 16322.21. (CXX) g++ options: -O3 -fstrict-aliasing -fopenmp

Embree

Intel Embree is a collection of high-performance ray-tracing kernels for execution on CPUs (and GPUs via SYCL) and supporting instruction sets such as SSE, AVX, AVX2, and AVX-512. Embree also supports making use of the Intel SPMD Program Compiler (ISPC). Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgFrames Per Second, More Is BetterEmbree 4.3Binary: Pathtracer ISPC - Model: Asian Dragon ObjXeon Platinum 8380EPYC 8534PNEPYC 8534PXeon Max 9468Xeon Max 9480Xeon 6766EXeon Platinum 8490HXeon 6780EXeon Platinum 8380 2PXeon Platinum 8592+Xeon Max 9468 2PXeon Max 9480 2PEPYC 9654Xeon 6766E 2PXeon Platinum 8490H 2PEPYC 9684XEPYC 9754Xeon 6780E 2PXeon Platinum 8592+ 2PEPYC 9654 2PEPYC 9754 2PEPYC 9684X 2P50100150200250SE +/- 0.03, N = 3SE +/- 0.04, N = 3SE +/- 0.04, N = 3SE +/- 0.08, N = 3SE +/- 0.09, N = 3SE +/- 0.03, N = 3SE +/- 0.09, N = 3SE +/- 0.09, N = 3SE +/- 0.10, N = 3SE +/- 0.35, N = 3SE +/- 0.76, N = 3SE +/- 0.89, N = 15SE +/- 0.02, N = 4SE +/- 0.22, N = 3SE +/- 0.22, N = 4SE +/- 0.11, N = 4SE +/- 0.07, N = 4SE +/- 0.09, N = 3SE +/- 0.29, N = 4SE +/- 1.58, N = 15SE +/- 3.26, N = 12SE +/- 1.72, N = 1547.6463.3464.3364.9671.8376.5379.3883.7384.8097.19104.84112.72113.28125.11132.28133.48133.93136.22173.22175.60200.16210.44
OpenBenchmarking.orgFrames Per Second, More Is BetterEmbree 4.3Binary: Pathtracer ISPC - Model: Asian Dragon ObjXeon Platinum 8380EPYC 8534PNEPYC 8534PXeon Max 9468Xeon Max 9480Xeon 6766EXeon Platinum 8490HXeon 6780EXeon Platinum 8380 2PXeon Platinum 8592+Xeon Max 9468 2PXeon Max 9480 2PEPYC 9654Xeon 6766E 2PXeon Platinum 8490H 2PEPYC 9684XEPYC 9754Xeon 6780E 2PXeon Platinum 8592+ 2PEPYC 9654 2PEPYC 9754 2PEPYC 9684X 2P4080120160200Min: 47.6 / Avg: 47.64 / Max: 47.68Min: 63.28 / Avg: 63.34 / Max: 63.4Min: 64.24 / Avg: 64.33 / Max: 64.37Min: 64.82 / Avg: 64.96 / Max: 65.11Min: 71.64 / Avg: 71.83 / Max: 71.93Min: 76.49 / Avg: 76.53 / Max: 76.58Min: 79.19 / Avg: 79.38 / Max: 79.5Min: 83.54 / Avg: 83.73 / Max: 83.85Min: 84.63 / Avg: 84.8 / Max: 84.98Min: 96.49 / Avg: 97.19 / Max: 97.59Min: 103.67 / Avg: 104.84 / Max: 106.27Min: 105.89 / Avg: 112.72 / Max: 117.07Min: 113.24 / Avg: 113.28 / Max: 113.33Min: 124.72 / Avg: 125.11 / Max: 125.47Min: 131.73 / Avg: 132.28 / Max: 132.76Min: 133.15 / Avg: 133.48 / Max: 133.63Min: 133.76 / Avg: 133.93 / Max: 134.05Min: 136.1 / Avg: 136.22 / Max: 136.39Min: 172.52 / Avg: 173.22 / Max: 173.86Min: 165.85 / Avg: 175.6 / Max: 186.42Min: 178.36 / Avg: 200.16 / Max: 213.61Min: 191.17 / Avg: 210.44 / Max: 218.73

Liquid-DSP

LiquidSDR's Liquid-DSP is a software-defined radio (SDR) digital signal processing library. This test profile runs a multi-threaded benchmark of this SDR/DSP library focused on embedded platform usage. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgsamples/s, More Is BetterLiquid-DSP 1.6Threads: 256 - Buffer Length: 256 - Filter Length: 512Xeon Platinum 8380EPYC 8534PNEPYC 8534PXeon Max 9468Xeon 6766EXeon 6780EXeon Max 9480Xeon Platinum 8490HXeon Platinum 8380 2PXeon Platinum 8592+Xeon 6766E 2PEPYC 9654Xeon 6780E 2PXeon Max 9468 2PXeon Max 9480 2PEPYC 9684XXeon Platinum 8490H 2PEPYC 9754 2PEPYC 9754Xeon Platinum 8592+ 2PEPYC 9654 2PEPYC 9684X 2P500M1000M1500M2000M2500MSE +/- 4629652.01, N = 3SE +/- 170391.71, N = 3SE +/- 776881.23, N = 3SE +/- 569766.03, N = 3SE +/- 320537.74, N = 3SE +/- 409267.64, N = 3SE +/- 740202.67, N = 3SE +/- 1722723.94, N = 3SE +/- 11053858.05, N = 3SE +/- 240370.09, N = 3SE +/- 2198737.01, N = 3SE +/- 520683.31, N = 3SE +/- 6411708.04, N = 3SE +/- 4238841.56, N = 3SE +/- 6728628.72, N = 3SE +/- 2676440.42, N = 3SE +/- 5630373.98, N = 3SE +/- 1650252.51, N = 3SE +/- 1300000.00, N = 3SE +/- 14465476.14, N = 3SE +/- 11753202.87, N = 3SE +/- 14870701.99, N = 35426066677417400008210133338385300008483766679402700009445500001020833333106103333311787666671306733333136216666714371000001444066667151893333315704000001616966667173480000017447000002027000000212953333323943333331. (CC) gcc options: -O3 -pthread -lm -lc -lliquid
OpenBenchmarking.orgsamples/s, More Is BetterLiquid-DSP 1.6Threads: 256 - Buffer Length: 256 - Filter Length: 512Xeon Platinum 8380EPYC 8534PNEPYC 8534PXeon Max 9468Xeon 6766EXeon 6780EXeon Max 9480Xeon Platinum 8490HXeon Platinum 8380 2PXeon Platinum 8592+Xeon 6766E 2PEPYC 9654Xeon 6780E 2PXeon Max 9468 2PXeon Max 9480 2PEPYC 9684XXeon Platinum 8490H 2PEPYC 9754 2PEPYC 9754Xeon Platinum 8592+ 2PEPYC 9654 2PEPYC 9684X 2P400M800M1200M1600M2000MMin: 533500000 / Avg: 542606666.67 / Max: 548610000Min: 741550000 / Avg: 741740000 / Max: 742080000Min: 819490000 / Avg: 821013333.33 / Max: 822040000Min: 837510000 / Avg: 838530000 / Max: 839480000Min: 847740000 / Avg: 848376666.67 / Max: 848760000Min: 939720000 / Avg: 940270000 / Max: 941070000Min: 943070000 / Avg: 944550000 / Max: 945320000Min: 1017400000 / Avg: 1020833333.33 / Max: 1022800000Min: 1039100000 / Avg: 1061033333.33 / Max: 1074400000Min: 1178300000 / Avg: 1178766666.67 / Max: 1179100000Min: 1302600000 / Avg: 1306733333.33 / Max: 1310100000Min: 1361300000 / Avg: 1362166666.67 / Max: 1363100000Min: 1426200000 / Avg: 1437100000 / Max: 1448400000Min: 1439100000 / Avg: 1444066666.67 / Max: 1452500000Min: 1507100000 / Avg: 1518933333.33 / Max: 1530400000Min: 1567100000 / Avg: 1570400000 / Max: 1575700000Min: 1609500000 / Avg: 1616966666.67 / Max: 1628000000Min: 1731500000 / Avg: 1734800000 / Max: 1736500000Min: 1742400000 / Avg: 1744700000 / Max: 1746900000Min: 2004500000 / Avg: 2027000000 / Max: 2054000000Min: 2115000000 / Avg: 2129533333.33 / Max: 2152800000Min: 2371400000 / Avg: 2394333333.33 / Max: 24222000001. (CC) gcc options: -O3 -pthread -lm -lc -lliquid

ONNX Runtime

ONNX Runtime is developed by Microsoft and partners as a open-source, cross-platform, high performance machine learning inferencing and training accelerator. This test profile runs the ONNX Runtime with various models available from the ONNX Model Zoo. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.17Model: super-resolution-10 - Device: CPU - Executor: StandardXeon 6766EXeon 6766E 2PXeon 6780E 2PXeon 6780EEPYC 9654 2PEPYC 9754 2PEPYC 8534PNEPYC 9754EPYC 8534PEPYC 9684X 2PEPYC 9654EPYC 9684XXeon Platinum 8380 2PXeon Platinum 8380Xeon Max 9480 2PXeon Max 9468 2PXeon Platinum 8490H 2PXeon Max 9480Xeon Max 9468Xeon Platinum 8490HXeon Platinum 8592+ 2PXeon Platinum 8592+60120180240300SE +/- 0.31, N = 3SE +/- 0.27, N = 3SE +/- 0.60, N = 15SE +/- 0.32, N = 3SE +/- 0.61, N = 3SE +/- 2.46, N = 15SE +/- 0.30, N = 3SE +/- 0.26, N = 3SE +/- 0.30, N = 3SE +/- 2.15, N = 12SE +/- 0.67, N = 3SE +/- 0.58, N = 3SE +/- 6.83, N = 12SE +/- 1.75, N = 3SE +/- 1.02, N = 3SE +/- 2.30, N = 4SE +/- 4.15, N = 15SE +/- 0.25, N = 3SE +/- 0.09, N = 3SE +/- 0.16, N = 3SE +/- 3.39, N = 3SE +/- 0.03, N = 359.3059.5066.1866.2095.8498.64102.97106.13106.53119.56122.68122.95192.81197.85199.90205.89212.92213.99217.88227.42251.31259.191. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt
OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.17Model: super-resolution-10 - Device: CPU - Executor: StandardXeon 6766EXeon 6766E 2PXeon 6780E 2PXeon 6780EEPYC 9654 2PEPYC 9754 2PEPYC 8534PNEPYC 9754EPYC 8534PEPYC 9684X 2PEPYC 9654EPYC 9684XXeon Platinum 8380 2PXeon Platinum 8380Xeon Max 9480 2PXeon Max 9468 2PXeon Platinum 8490H 2PXeon Max 9480Xeon Max 9468Xeon Platinum 8490HXeon Platinum 8592+ 2PXeon Platinum 8592+50100150200250Min: 58.77 / Avg: 59.3 / Max: 59.84Min: 58.98 / Avg: 59.5 / Max: 59.87Min: 61.12 / Avg: 66.18 / Max: 69.12Min: 65.58 / Avg: 66.2 / Max: 66.62Min: 94.69 / Avg: 95.84 / Max: 96.74Min: 84.1 / Avg: 98.64 / Max: 107.78Min: 102.52 / Avg: 102.97 / Max: 103.54Min: 105.73 / Avg: 106.13 / Max: 106.63Min: 106.15 / Avg: 106.53 / Max: 107.11Min: 96.02 / Avg: 119.56 / Max: 122.78Min: 121.53 / Avg: 122.68 / Max: 123.86Min: 122.34 / Avg: 122.95 / Max: 124.1Min: 117.93 / Avg: 192.81 / Max: 201.29Min: 194.38 / Avg: 197.85 / Max: 199.93Min: 197.86 / Avg: 199.9 / Max: 200.92Min: 201.86 / Avg: 205.88 / Max: 212.41Min: 166.26 / Avg: 212.92 / Max: 226.64Min: 213.65 / Avg: 213.99 / Max: 214.46Min: 217.72 / Avg: 217.88 / Max: 218.03Min: 227.12 / Avg: 227.42 / Max: 227.66Min: 245.94 / Avg: 251.3 / Max: 257.58Min: 259.13 / Avg: 259.19 / Max: 259.221. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

Liquid-DSP

LiquidSDR's Liquid-DSP is a software-defined radio (SDR) digital signal processing library. This test profile runs a multi-threaded benchmark of this SDR/DSP library focused on embedded platform usage. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgsamples/s, More Is BetterLiquid-DSP 1.6Threads: 256 - Buffer Length: 256 - Filter Length: 32Xeon Platinum 8380Xeon Max 9468Xeon Max 9480EPYC 8534PNEPYC 8534PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8380 2PXeon 6766EXeon Max 9468 2PXeon 6780EEPYC 9654Xeon Max 9480 2PEPYC 9684XXeon Platinum 8592+ 2PXeon Platinum 8490H 2PEPYC 9754 2PEPYC 9754Xeon 6766E 2PEPYC 9654 2PXeon 6780E 2PEPYC 9684X 2P2000M4000M6000M8000M10000MSE +/- 1266666.67, N = 3SE +/- 1320353.49, N = 3SE +/- 1338323.99, N = 3SE +/- 1928730.15, N = 3SE +/- 1501110.70, N = 3SE +/- 2516611.48, N = 3SE +/- 4021608.30, N = 3SE +/- 7369833.41, N = 3SE +/- 821245.67, N = 3SE +/- 2447674.63, N = 3SE +/- 2601495.30, N = 3SE +/- 1419311.26, N = 3SE +/- 895048.11, N = 3SE +/- 11426625.83, N = 3SE +/- 6711433.03, N = 3SE +/- 10496401.50, N = 3SE +/- 2936551.27, N = 3SE +/- 3768731.00, N = 3SE +/- 32054242.22, N = 3SE +/- 46730658.51, N = 3SE +/- 20501246.57, N = 3SE +/- 34610274.65, N = 318235666672381800000276906666727896000003062200000316720000032438000003572233333430116666746709666674799133333527193333353670333335862466667607730000061165666676439000000658820000068215333337513333333754636666779352666671. (CC) gcc options: -O3 -pthread -lm -lc -lliquid
OpenBenchmarking.orgsamples/s, More Is BetterLiquid-DSP 1.6Threads: 256 - Buffer Length: 256 - Filter Length: 32Xeon Platinum 8380Xeon Max 9468Xeon Max 9480EPYC 8534PNEPYC 8534PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8380 2PXeon 6766EXeon Max 9468 2PXeon 6780EEPYC 9654Xeon Max 9480 2PEPYC 9684XXeon Platinum 8592+ 2PXeon Platinum 8490H 2PEPYC 9754 2PEPYC 9754Xeon 6766E 2PEPYC 9654 2PXeon 6780E 2PEPYC 9684X 2P1400M2800M4200M5600M7000MMin: 1822300000 / Avg: 1823566666.67 / Max: 1826100000Min: 2380100000 / Avg: 2381800000 / Max: 2384400000Min: 2766600000 / Avg: 2769066666.67 / Max: 2771200000Min: 2786000000 / Avg: 2789600000 / Max: 2792600000Min: 3059200000 / Avg: 3062200000 / Max: 3063800000Min: 3164200000 / Avg: 3167200000 / Max: 3172200000Min: 3236000000 / Avg: 3243800000 / Max: 3249400000Min: 3563000000 / Avg: 3572233333.33 / Max: 3586800000Min: 4300200000 / Avg: 4301166666.67 / Max: 4302800000Min: 4667100000 / Avg: 4670966666.67 / Max: 4675500000Min: 4794500000 / Avg: 4799133333.33 / Max: 4803500000Min: 5269100000 / Avg: 5271933333.33 / Max: 5273500000Min: 5365900000 / Avg: 5367033333.33 / Max: 5368800000Min: 5847900000 / Avg: 5862466666.67 / Max: 5885000000Min: 6067400000 / Avg: 6077300000 / Max: 6090100000Min: 6102900000 / Avg: 6116566666.67 / Max: 6137200000Min: 6433600000 / Avg: 6439000000 / Max: 6443700000Min: 6583800000 / Avg: 6588200000 / Max: 6595700000Min: 6762500000 / Avg: 6821533333.33 / Max: 6872700000Min: 7454300000 / Avg: 7513333333.33 / Max: 7605600000Min: 7506500000 / Avg: 7546366666.67 / Max: 7574600000Min: 7867200000 / Avg: 7935266666.67 / Max: 79802000001. (CC) gcc options: -O3 -pthread -lm -lc -lliquid

ASTC Encoder

OpenBenchmarking.orgMT/s, More Is BetterASTC Encoder 4.7Preset: MediumXeon Platinum 8380Xeon Platinum 8380 2PXeon Max 9468EPYC 8534PNXeon Max 9480Xeon 6766EEPYC 8534PXeon 6780EXeon Platinum 8592+Xeon Platinum 8490HXeon 6766E 2PXeon 6780E 2PXeon Max 9468 2PEPYC 9654EPYC 9754 2PXeon Max 9480 2PXeon Platinum 8490H 2PEPYC 9654 2PEPYC 9684XEPYC 9684X 2PEPYC 9754Xeon Platinum 8592+ 2P120240360480600SE +/- 0.32, N = 4SE +/- 2.26, N = 5SE +/- 0.03, N = 6SE +/- 0.07, N = 6SE +/- 0.08, N = 6SE +/- 0.18, N = 5SE +/- 0.07, N = 6SE +/- 0.13, N = 6SE +/- 1.17, N = 6SE +/- 0.16, N = 6SE +/- 1.77, N = 5SE +/- 2.01, N = 5SE +/- 0.52, N = 6SE +/- 0.20, N = 7SE +/- 0.52, N = 6SE +/- 0.77, N = 6SE +/- 2.79, N = 6SE +/- 3.54, N = 6SE +/- 0.63, N = 7SE +/- 3.11, N = 7SE +/- 0.39, N = 7SE +/- 1.56, N = 7126.44216.97247.30273.67284.33284.46294.62314.62327.78333.99338.15363.38441.65449.11462.24483.10484.55491.53500.77508.09527.80550.021. (CXX) g++ options: -O3 -flto -pthread
OpenBenchmarking.orgMT/s, More Is BetterASTC Encoder 4.7Preset: MediumXeon Platinum 8380Xeon Platinum 8380 2PXeon Max 9468EPYC 8534PNXeon Max 9480Xeon 6766EEPYC 8534PXeon 6780EXeon Platinum 8592+Xeon Platinum 8490HXeon 6766E 2PXeon 6780E 2PXeon Max 9468 2PEPYC 9654EPYC 9754 2PXeon Max 9480 2PXeon Platinum 8490H 2PEPYC 9654 2PEPYC 9684XEPYC 9684X 2PEPYC 9754Xeon Platinum 8592+ 2P100200300400500Min: 125.58 / Avg: 126.44 / Max: 127.06Min: 211.57 / Avg: 216.97 / Max: 222.37Min: 247.19 / Avg: 247.3 / Max: 247.37Min: 273.39 / Avg: 273.67 / Max: 273.86Min: 284.1 / Avg: 284.33 / Max: 284.68Min: 283.97 / Avg: 284.46 / Max: 285.07Min: 294.4 / Avg: 294.62 / Max: 294.81Min: 314.21 / Avg: 314.62 / Max: 315.14Min: 323.69 / Avg: 327.78 / Max: 332.24Min: 333.25 / Avg: 333.99 / Max: 334.3Min: 334.59 / Avg: 338.15 / Max: 344.43Min: 356.35 / Avg: 363.38 / Max: 367.51Min: 440.15 / Avg: 441.65 / Max: 443.01Min: 448.48 / Avg: 449.11 / Max: 449.93Min: 461.02 / Avg: 462.24 / Max: 464.3Min: 481.24 / Avg: 483.1 / Max: 486.35Min: 475.22 / Avg: 484.55 / Max: 496.05Min: 479.63 / Avg: 491.53 / Max: 500.35Min: 497.64 / Avg: 500.77 / Max: 502.11Min: 492.18 / Avg: 508.09 / Max: 514.99Min: 526.48 / Avg: 527.8 / Max: 528.95Min: 544.51 / Avg: 550.02 / Max: 557.31. (CXX) g++ options: -O3 -flto -pthread

WRF

WRF, the Weather Research and Forecasting Model, is a "next-generation mesoscale numerical weather prediction system designed for both atmospheric research and operational forecasting applications. It features two dynamical cores, a data assimilation system, and a software architecture supporting parallel computation and system extensibility." Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterWRF 4.2.2Input: conus 2.5kmXeon Platinum 8380EPYC 8534PNEPYC 8534PXeon Platinum 8380 2PXeon Max 9468Xeon Max 9480Xeon Platinum 8490HEPYC 9754Xeon Platinum 8592+EPYC 9654EPYC 9684XEPYC 9754 2PXeon Max 9468 2PEPYC 9654 2PXeon Max 9480 2PXeon Platinum 8490H 2PXeon Platinum 8592+ 2PEPYC 9684X 2P4K8K12K16K20K18998.8216609.7816147.0014030.5113273.6912410.2911980.8111895.4110602.4110176.867885.167365.867157.966918.026840.066674.125601.104431.341. (F9X) gfortran options: -O2 -ftree-vectorize -funroll-loops -ffree-form -fconvert=big-endian -frecord-marker=4 -fallow-invalid-boz -lesmf_time -lwrfio_nf -lnetcdff -lnetcdf -lmpi_usempif08 -lmpi_mpifh -lmpi -lopen-rte -lopen-pal -lhwloc -levent_core -levent_pthreads -lm -lz

NAS Parallel Benchmarks

NPB, NAS Parallel Benchmarks, is a benchmark developed by NASA for high-end computer systems. This test profile currently uses the MPI version of NPB. This test profile offers selecting the different NPB tests/problems and varying problem sizes. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgTotal Mop/s, More Is BetterNAS Parallel Benchmarks 3.4Test / Class: MG.CXeon Platinum 8380EPYC 8534PNEPYC 8534PXeon Platinum 8490HXeon Max 9468Xeon Max 9480Xeon Platinum 8592+Xeon Platinum 8380 2PEPYC 9654EPYC 9754EPYC 9684XXeon Platinum 8490H 2PXeon Max 9480 2PXeon Max 9468 2PEPYC 9654 2PXeon Platinum 8592+ 2PEPYC 9684X 2PEPYC 9754 2P50K100K150K200K250KSE +/- 53.56, N = 9SE +/- 301.54, N = 8SE +/- 167.65, N = 8SE +/- 152.92, N = 9SE +/- 436.97, N = 10SE +/- 382.59, N = 10SE +/- 406.29, N = 9SE +/- 233.83, N = 9SE +/- 1153.71, N = 15SE +/- 884.47, N = 9SE +/- 1372.89, N = 15SE +/- 1262.04, N = 9SE +/- 1298.67, N = 9SE +/- 1415.96, N = 9SE +/- 2707.72, N = 14SE +/- 1422.07, N = 7SE +/- 7207.31, N = 15SE +/- 1776.37, N = 1157317.6662449.5563930.6483448.7085910.9586407.46107321.89110742.15116725.04125567.07134994.14163333.21171436.47172614.10194942.32220893.78244738.81245447.721. (F9X) gfortran options: -O3 -march=native -lmpi_usempif08 -lmpi_mpifh -lmpi -lopen-rte -lopen-pal -lhwloc -levent_core -levent_pthreads -lm -lz 2. Open MPI 4.1.6
OpenBenchmarking.orgTotal Mop/s, More Is BetterNAS Parallel Benchmarks 3.4Test / Class: MG.CXeon Platinum 8380EPYC 8534PNEPYC 8534PXeon Platinum 8490HXeon Max 9468Xeon Max 9480Xeon Platinum 8592+Xeon Platinum 8380 2PEPYC 9654EPYC 9754EPYC 9684XXeon Platinum 8490H 2PXeon Max 9480 2PXeon Max 9468 2PEPYC 9654 2PXeon Platinum 8592+ 2PEPYC 9684X 2PEPYC 9754 2P40K80K120K160K200KMin: 57015.53 / Avg: 57317.66 / Max: 57615.81Min: 60600.68 / Avg: 62449.55 / Max: 63479.22Min: 63078.71 / Avg: 63930.64 / Max: 64423.05Min: 82696.98 / Avg: 83448.7 / Max: 83933.89Min: 83606.71 / Avg: 85910.95 / Max: 88256.51Min: 84619.8 / Avg: 86407.46 / Max: 88485.16Min: 105988.93 / Avg: 107321.89 / Max: 109240.43Min: 109756.95 / Avg: 110742.15 / Max: 111725.14Min: 108294.61 / Avg: 116725.04 / Max: 123557.72Min: 119418.6 / Avg: 125567.07 / Max: 128581.27Min: 127793.03 / Avg: 134994.14 / Max: 144587.43Min: 159113.63 / Avg: 163333.21 / Max: 170615.72Min: 166974.27 / Avg: 171436.47 / Max: 178199.79Min: 164903.28 / Avg: 172614.1 / Max: 177274.16Min: 178935.43 / Avg: 194942.32 / Max: 211842.06Min: 215470.66 / Avg: 220893.78 / Max: 226829.96Min: 208510.15 / Avg: 244738.81 / Max: 315785.78Min: 233170.75 / Avg: 245447.72 / Max: 255160.981. (F9X) gfortran options: -O3 -march=native -lmpi_usempif08 -lmpi_mpifh -lmpi -lopen-rte -lopen-pal -lhwloc -levent_core -levent_pthreads -lm -lz 2. Open MPI 4.1.6

ONNX Runtime

ONNX Runtime is developed by Microsoft and partners as a open-source, cross-platform, high performance machine learning inferencing and training accelerator. This test profile runs the ONNX Runtime with various models available from the ONNX Model Zoo. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.17Model: GPT-2 - Device: CPU - Executor: ParallelXeon 6766E 2PXeon 6780E 2PEPYC 9754 2PEPYC 9654 2PEPYC 9684X 2PEPYC 8534PEPYC 8534PNXeon 6766EXeon Max 9468 2PXeon Max 9480 2PEPYC 9754Xeon 6780EXeon Platinum 8490H 2PXeon Platinum 8380 2PEPYC 9654EPYC 9684XXeon Platinum 8380Xeon Max 9480Xeon Max 9468Xeon Platinum 8490HXeon Platinum 8592+ 2PXeon Platinum 8592+50100150200250SE +/- 0.40, N = 3SE +/- 0.04, N = 3SE +/- 0.19, N = 3SE +/- 0.35, N = 3SE +/- 0.48, N = 3SE +/- 0.64, N = 3SE +/- 0.43, N = 3SE +/- 0.09, N = 3SE +/- 1.53, N = 3SE +/- 0.26, N = 3SE +/- 0.17, N = 3SE +/- 0.23, N = 3SE +/- 0.78, N = 3SE +/- 1.59, N = 3SE +/- 0.08, N = 3SE +/- 0.64, N = 3SE +/- 0.64, N = 3SE +/- 2.63, N = 3SE +/- 1.04, N = 3SE +/- 0.53, N = 3SE +/- 0.81, N = 3SE +/- 0.27, N = 358.5860.3999.22109.46110.17128.98129.65131.54135.98136.69137.19140.03144.64153.54156.61161.50180.23188.93191.11191.56195.45248.681. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt
OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.17Model: GPT-2 - Device: CPU - Executor: ParallelXeon 6766E 2PXeon 6780E 2PEPYC 9754 2PEPYC 9654 2PEPYC 9684X 2PEPYC 8534PEPYC 8534PNXeon 6766EXeon Max 9468 2PXeon Max 9480 2PEPYC 9754Xeon 6780EXeon Platinum 8490H 2PXeon Platinum 8380 2PEPYC 9654EPYC 9684XXeon Platinum 8380Xeon Max 9480Xeon Max 9468Xeon Platinum 8490HXeon Platinum 8592+ 2PXeon Platinum 8592+50100150200250Min: 57.92 / Avg: 58.58 / Max: 59.3Min: 60.32 / Avg: 60.39 / Max: 60.46Min: 98.83 / Avg: 99.22 / Max: 99.46Min: 109.07 / Avg: 109.46 / Max: 110.16Min: 109.53 / Avg: 110.17 / Max: 111.11Min: 128.34 / Avg: 128.98 / Max: 130.26Min: 128.78 / Avg: 129.65 / Max: 130.13Min: 131.38 / Avg: 131.54 / Max: 131.69Min: 133.3 / Avg: 135.98 / Max: 138.6Min: 136.16 / Avg: 136.69 / Max: 136.97Min: 136.86 / Avg: 137.19 / Max: 137.45Min: 139.56 / Avg: 140.03 / Max: 140.29Min: 143.64 / Avg: 144.64 / Max: 146.17Min: 150.56 / Avg: 153.54 / Max: 156Min: 156.5 / Avg: 156.61 / Max: 156.78Min: 160.8 / Avg: 161.5 / Max: 162.77Min: 179.15 / Avg: 180.23 / Max: 181.37Min: 183.67 / Avg: 188.93 / Max: 191.81Min: 189.86 / Avg: 191.11 / Max: 193.18Min: 190.81 / Avg: 191.56 / Max: 192.57Min: 193.96 / Avg: 195.45 / Max: 196.73Min: 248.38 / Avg: 248.68 / Max: 249.231. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

PyTorch

OpenBenchmarking.orgbatches/sec, More Is BetterPyTorch 2.2.1Device: CPU - Batch Size: 1 - Model: ResNet-152Xeon 6766E 2PEPYC 9754 2PXeon 6780E 2PEPYC 9654 2PEPYC 9684X 2PEPYC 9754Xeon 6766EXeon 6780EXeon Max 9480 2PEPYC 8534PNEPYC 8534PEPYC 9654Xeon Platinum 8490H 2PEPYC 9684XXeon Platinum 8380 2PXeon Platinum 8592+ 2PXeon Max 9468 2PXeon Max 9480Xeon Platinum 8490HXeon Max 9468Xeon Platinum 8380Xeon Platinum 8592+612182430SE +/- 0.17, N = 9SE +/- 0.15, N = 12SE +/- 0.07, N = 3SE +/- 0.27, N = 9SE +/- 0.20, N = 12SE +/- 0.04, N = 3SE +/- 0.12, N = 3SE +/- 0.06, N = 3SE +/- 0.13, N = 8SE +/- 0.06, N = 3SE +/- 0.17, N = 3SE +/- 0.09, N = 3SE +/- 0.16, N = 4SE +/- 0.01, N = 3SE +/- 0.10, N = 3SE +/- 0.19, N = 5SE +/- 0.18, N = 3SE +/- 0.16, N = 3SE +/- 0.09, N = 3SE +/- 0.26, N = 3SE +/- 0.12, N = 3SE +/- 0.08, N = 36.476.647.108.278.3513.0513.3914.5314.8615.1115.2515.5715.7715.8616.6817.5717.9118.0719.4119.9922.2727.21
OpenBenchmarking.orgbatches/sec, More Is BetterPyTorch 2.2.1Device: CPU - Batch Size: 1 - Model: ResNet-152Xeon 6766E 2PEPYC 9754 2PXeon 6780E 2PEPYC 9654 2PEPYC 9684X 2PEPYC 9754Xeon 6766EXeon 6780EXeon Max 9480 2PEPYC 8534PNEPYC 8534PEPYC 9654Xeon Platinum 8490H 2PEPYC 9684XXeon Platinum 8380 2PXeon Platinum 8592+ 2PXeon Max 9468 2PXeon Max 9480Xeon Platinum 8490HXeon Max 9468Xeon Platinum 8380Xeon Platinum 8592+612182430Min: 5.45 / Avg: 6.47 / Max: 6.9Min: 5.54 / Avg: 6.64 / Max: 7.18Min: 6.96 / Avg: 7.1 / Max: 7.17Min: 7.22 / Avg: 8.27 / Max: 9.38Min: 7.28 / Avg: 8.35 / Max: 9.33Min: 13 / Avg: 13.05 / Max: 13.13Min: 13.19 / Avg: 13.39 / Max: 13.6Min: 14.42 / Avg: 14.53 / Max: 14.61Min: 14.16 / Avg: 14.86 / Max: 15.24Min: 15.02 / Avg: 15.11 / Max: 15.24Min: 15.04 / Avg: 15.25 / Max: 15.59Min: 15.4 / Avg: 15.57 / Max: 15.72Min: 15.42 / Avg: 15.77 / Max: 16.18Min: 15.84 / Avg: 15.86 / Max: 15.88Min: 16.48 / Avg: 16.68 / Max: 16.8Min: 16.94 / Avg: 17.57 / Max: 18.06Min: 17.56 / Avg: 17.91 / Max: 18.15Min: 17.8 / Avg: 18.07 / Max: 18.35Min: 19.22 / Avg: 19.41 / Max: 19.51Min: 19.48 / Avg: 19.99 / Max: 20.28Min: 22.07 / Avg: 22.27 / Max: 22.49Min: 27.06 / Avg: 27.21 / Max: 27.32

LULESH

LULESH is the Livermore Unstructured Lagrangian Explicit Shock Hydrodynamics. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgz/s, More Is BetterLULESH 2.0.3EPYC 8534PNEPYC 8534PXeon Platinum 8380Xeon Platinum 8380 2PXeon Platinum 8490HXeon Max 9468EPYC 9754Xeon Max 9480Xeon 6766EEPYC 9654Xeon 6780EEPYC 9684XXeon Platinum 8592+Xeon 6766E 2PXeon Platinum 8490H 2PXeon 6780E 2PEPYC 9754 2PEPYC 9654 2PXeon Max 9468 2PXeon Max 9480 2PEPYC 9684X 2PXeon Platinum 8592+ 2P15K30K45K60K75KSE +/- 373.78, N = 12SE +/- 372.63, N = 12SE +/- 53.94, N = 5SE +/- 188.07, N = 8SE +/- 182.38, N = 15SE +/- 211.12, N = 6SE +/- 244.17, N = 3SE +/- 217.67, N = 6SE +/- 254.25, N = 6SE +/- 372.12, N = 3SE +/- 314.85, N = 4SE +/- 194.65, N = 15SE +/- 437.51, N = 4SE +/- 55.60, N = 3SE +/- 272.44, N = 4SE +/- 91.45, N = 3SE +/- 427.75, N = 3SE +/- 349.39, N = 15SE +/- 206.20, N = 5SE +/- 207.54, N = 5SE +/- 675.87, N = 3SE +/- 359.29, N = 316855.8916949.5917348.4321389.8223072.3023848.5424218.8325831.8426024.6026082.7126864.1127287.2638433.9742946.2643724.0644136.5346126.0848760.8252102.6753269.4754678.4970826.731. (CXX) g++ options: -O3 -fopenmp -lm -lmpi_cxx -lmpi
OpenBenchmarking.orgz/s, More Is BetterLULESH 2.0.3EPYC 8534PNEPYC 8534PXeon Platinum 8380Xeon Platinum 8380 2PXeon Platinum 8490HXeon Max 9468EPYC 9754Xeon Max 9480Xeon 6766EEPYC 9654Xeon 6780EEPYC 9684XXeon Platinum 8592+Xeon 6766E 2PXeon Platinum 8490H 2PXeon 6780E 2PEPYC 9754 2PEPYC 9654 2PXeon Max 9468 2PXeon Max 9480 2PEPYC 9684X 2PXeon Platinum 8592+ 2P12K24K36K48K60KMin: 12776.5 / Avg: 16855.89 / Max: 17542.76Min: 12887.73 / Avg: 16949.59 / Max: 17613.75Min: 17255.56 / Avg: 17348.43 / Max: 17557.14Min: 20599.98 / Avg: 21389.82 / Max: 22156.38Min: 22442.42 / Avg: 23072.3 / Max: 24854.97Min: 23318.39 / Avg: 23848.54 / Max: 24737.69Min: 23779.56 / Avg: 24218.83 / Max: 24623.24Min: 25218.46 / Avg: 25831.84 / Max: 26468.29Min: 24763.82 / Avg: 26024.6 / Max: 26407.79Min: 25381.18 / Avg: 26082.71 / Max: 26648.66Min: 25929.74 / Avg: 26864.11 / Max: 27281.24Min: 26684.32 / Avg: 27287.26 / Max: 29561.84Min: 37570.41 / Avg: 38433.97 / Max: 39581.93Min: 42845.57 / Avg: 42946.26 / Max: 43037.49Min: 43120.05 / Avg: 43724.06 / Max: 44351.44Min: 43986.13 / Avg: 44136.53 / Max: 44301.86Min: 45517.21 / Avg: 46126.08 / Max: 46950.96Min: 47571.55 / Avg: 48760.81 / Max: 52586.02Min: 51553.3 / Avg: 52102.67 / Max: 52648.4Min: 52904.08 / Avg: 53269.47 / Max: 54044.05Min: 53605.63 / Avg: 54678.49 / Max: 55927.06Min: 70411.43 / Avg: 70826.73 / Max: 71542.221. (CXX) g++ options: -O3 -fopenmp -lm -lmpi_cxx -lmpi

Embree

Intel Embree is a collection of high-performance ray-tracing kernels for execution on CPUs (and GPUs via SYCL) and supporting instruction sets such as SSE, AVX, AVX2, and AVX-512. Embree also supports making use of the Intel SPMD Program Compiler (ISPC). Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgFrames Per Second, More Is BetterEmbree 4.3Binary: Pathtracer ISPC - Model: Asian DragonXeon Platinum 8380EPYC 8534PNEPYC 8534PXeon Max 9468Xeon Max 9480Xeon 6766EXeon Platinum 8490HXeon 6780EXeon Platinum 8380 2PXeon Platinum 8592+Xeon Max 9468 2PXeon Max 9480 2PEPYC 9654Xeon 6766E 2PXeon 6780E 2PXeon Platinum 8490H 2PEPYC 9684XEPYC 9754EPYC 9654 2PXeon Platinum 8592+ 2PEPYC 9754 2PEPYC 9684X 2P50100150200250SE +/- 0.04, N = 4SE +/- 0.05, N = 5SE +/- 0.03, N = 5SE +/- 0.04, N = 5SE +/- 0.11, N = 5SE +/- 0.04, N = 5SE +/- 0.05, N = 5SE +/- 0.05, N = 5SE +/- 0.29, N = 6SE +/- 0.13, N = 6SE +/- 0.63, N = 6SE +/- 1.20, N = 15SE +/- 0.03, N = 6SE +/- 0.10, N = 6SE +/- 0.16, N = 7SE +/- 0.13, N = 7SE +/- 0.07, N = 7SE +/- 0.12, N = 7SE +/- 1.54, N = 8SE +/- 0.26, N = 8SE +/- 1.88, N = 7SE +/- 2.04, N = 855.4273.9175.2175.4783.4984.7191.9992.8899.24112.66125.75129.75132.49138.85151.25152.75155.12156.39185.71199.61208.31231.43
OpenBenchmarking.orgFrames Per Second, More Is BetterEmbree 4.3Binary: Pathtracer ISPC - Model: Asian DragonXeon Platinum 8380EPYC 8534PNEPYC 8534PXeon Max 9468Xeon Max 9480Xeon 6766EXeon Platinum 8490HXeon 6780EXeon Platinum 8380 2PXeon Platinum 8592+Xeon Max 9468 2PXeon Max 9480 2PEPYC 9654Xeon 6766E 2PXeon 6780E 2PXeon Platinum 8490H 2PEPYC 9684XEPYC 9754EPYC 9654 2PXeon Platinum 8592+ 2PEPYC 9754 2PEPYC 9684X 2P4080120160200Min: 55.35 / Avg: 55.42 / Max: 55.53Min: 73.77 / Avg: 73.91 / Max: 74.04Min: 75.11 / Avg: 75.21 / Max: 75.29Min: 75.31 / Avg: 75.47 / Max: 75.57Min: 83.26 / Avg: 83.49 / Max: 83.88Min: 84.58 / Avg: 84.71 / Max: 84.77Min: 91.83 / Avg: 91.99 / Max: 92.12Min: 92.75 / Avg: 92.88 / Max: 93.05Min: 98.47 / Avg: 99.24 / Max: 99.92Min: 112.23 / Avg: 112.66 / Max: 112.98Min: 123.85 / Avg: 125.75 / Max: 127.4Min: 122.92 / Avg: 129.75 / Max: 137.51Min: 132.41 / Avg: 132.49 / Max: 132.61Min: 138.43 / Avg: 138.85 / Max: 139.05Min: 150.65 / Avg: 151.25 / Max: 151.86Min: 152.14 / Avg: 152.75 / Max: 153.15Min: 154.93 / Avg: 155.12 / Max: 155.47Min: 155.81 / Avg: 156.39 / Max: 156.76Min: 179.3 / Avg: 185.71 / Max: 191.56Min: 198.29 / Avg: 199.61 / Max: 200.37Min: 203.33 / Avg: 208.31 / Max: 214.64Min: 223.86 / Avg: 231.43 / Max: 241.89

ONNX Runtime

ONNX Runtime is developed by Microsoft and partners as a open-source, cross-platform, high performance machine learning inferencing and training accelerator. This test profile runs the ONNX Runtime with various models available from the ONNX Model Zoo. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.17Model: ResNet50 v1-12-int8 - Device: CPU - Executor: StandardXeon 6766E 2PXeon 6780E 2PEPYC 9754 2PXeon 6766EEPYC 9654 2PEPYC 9684X 2PXeon 6780EEPYC 9754Xeon Max 9480 2PXeon Platinum 8592+ 2PXeon Max 9468 2PXeon Platinum 8490H 2PEPYC 8534PNEPYC 8534PXeon Platinum 8380 2PEPYC 9654EPYC 9684XXeon Max 9480Xeon Platinum 8592+Xeon Platinum 8490HXeon Max 9468Xeon Platinum 838070140210280350SE +/- 0.44, N = 3SE +/- 0.05, N = 3SE +/- 1.44, N = 15SE +/- 1.47, N = 3SE +/- 3.84, N = 12SE +/- 3.21, N = 15SE +/- 0.67, N = 3SE +/- 2.12, N = 15SE +/- 1.78, N = 3SE +/- 0.40, N = 3SE +/- 2.72, N = 15SE +/- 1.01, N = 3SE +/- 2.40, N = 15SE +/- 2.24, N = 15SE +/- 0.64, N = 3SE +/- 4.35, N = 15SE +/- 0.95, N = 3SE +/- 3.31, N = 5SE +/- 2.52, N = 3SE +/- 1.80, N = 3SE +/- 2.40, N = 3SE +/- 1.65, N = 380.4287.09117.62130.06133.49141.83143.36160.90161.89171.23174.68177.76211.19219.06222.52225.31243.34296.80314.06315.41330.10335.151. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt
OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.17Model: ResNet50 v1-12-int8 - Device: CPU - Executor: StandardXeon 6766E 2PXeon 6780E 2PEPYC 9754 2PXeon 6766EEPYC 9654 2PEPYC 9684X 2PXeon 6780EEPYC 9754Xeon Max 9480 2PXeon Platinum 8592+ 2PXeon Max 9468 2PXeon Platinum 8490H 2PEPYC 8534PNEPYC 8534PXeon Platinum 8380 2PEPYC 9654EPYC 9684XXeon Max 9480Xeon Platinum 8592+Xeon Platinum 8490HXeon Max 9468Xeon Platinum 838060120180240300Min: 79.54 / Avg: 80.42 / Max: 80.93Min: 86.98 / Avg: 87.09 / Max: 87.15Min: 108.96 / Avg: 117.62 / Max: 129.52Min: 128.27 / Avg: 130.06 / Max: 132.98Min: 119.11 / Avg: 133.48 / Max: 157.92Min: 132.01 / Avg: 141.83 / Max: 162.51Min: 142.27 / Avg: 143.36 / Max: 144.57Min: 153.36 / Avg: 160.9 / Max: 174.42Min: 158.56 / Avg: 161.89 / Max: 164.63Min: 170.81 / Avg: 171.23 / Max: 172.03Min: 153.07 / Avg: 174.68 / Max: 185.97Min: 175.79 / Avg: 177.76 / Max: 179.16Min: 200.89 / Avg: 211.19 / Max: 222.47Min: 208.96 / Avg: 219.06 / Max: 231.17Min: 221.88 / Avg: 222.52 / Max: 223.79Min: 205.08 / Avg: 225.31 / Max: 242.82Min: 242.03 / Avg: 243.34 / Max: 245.18Min: 285.12 / Avg: 296.8 / Max: 305.13Min: 309.09 / Avg: 314.06 / Max: 317.25Min: 312.56 / Avg: 315.41 / Max: 318.75Min: 327.17 / Avg: 330.1 / Max: 334.85Min: 332.07 / Avg: 335.15 / Max: 337.721. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

Kvazaar

This is a test of Kvazaar as a CPU-based H.265/HEVC video encoder written in the C programming language and optimized in Assembly. Kvazaar is the winner of the 2016 ACM Open-Source Software Competition and developed at the Ultra Video Group, Tampere University, Finland. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgFrames Per Second, More Is BetterKvazaar 2.2Video Input: Bosphorus 4K - Video Preset: SlowXeon Platinum 8380Xeon Max 9468Xeon Max 9480Xeon 6766EXeon Platinum 8380 2PXeon Platinum 8490HXeon 6780EEPYC 8534PNEPYC 8534PXeon Platinum 8592+Xeon Max 9468 2PXeon Max 9480 2PXeon 6766E 2PXeon Platinum 8490H 2PXeon 6780E 2PEPYC 9754EPYC 9654EPYC 9684XXeon Platinum 8592+ 2PEPYC 9754 2PEPYC 9654 2PEPYC 9684X 2P1428425670SE +/- 0.00, N = 3SE +/- 0.03, N = 3SE +/- 0.02, N = 3SE +/- 0.07, N = 3SE +/- 0.05, N = 3SE +/- 0.03, N = 3SE +/- 0.07, N = 3SE +/- 0.05, N = 3SE +/- 0.04, N = 3SE +/- 0.07, N = 3SE +/- 0.03, N = 3SE +/- 0.02, N = 3SE +/- 0.09, N = 3SE +/- 0.08, N = 3SE +/- 0.18, N = 3SE +/- 0.05, N = 4SE +/- 0.01, N = 4SE +/- 0.07, N = 4SE +/- 0.04, N = 4SE +/- 0.47, N = 8SE +/- 0.50, N = 5SE +/- 0.26, N = 515.0917.5218.2418.8619.7120.2320.8722.4623.7124.2326.0028.9629.1531.2431.8538.4738.9040.0040.9254.8861.0762.821. (CC) gcc options: -pthread -ftree-vectorize -fvisibility=hidden -O2 -lpthread -lm -lrt
OpenBenchmarking.orgFrames Per Second, More Is BetterKvazaar 2.2Video Input: Bosphorus 4K - Video Preset: SlowXeon Platinum 8380Xeon Max 9468Xeon Max 9480Xeon 6766EXeon Platinum 8380 2PXeon Platinum 8490HXeon 6780EEPYC 8534PNEPYC 8534PXeon Platinum 8592+Xeon Max 9468 2PXeon Max 9480 2PXeon 6766E 2PXeon Platinum 8490H 2PXeon 6780E 2PEPYC 9754EPYC 9654EPYC 9684XXeon Platinum 8592+ 2PEPYC 9754 2PEPYC 9654 2PEPYC 9684X 2P1224364860Min: 15.08 / Avg: 15.09 / Max: 15.09Min: 17.47 / Avg: 17.52 / Max: 17.57Min: 18.21 / Avg: 18.24 / Max: 18.26Min: 18.72 / Avg: 18.86 / Max: 18.94Min: 19.62 / Avg: 19.71 / Max: 19.76Min: 20.18 / Avg: 20.23 / Max: 20.29Min: 20.73 / Avg: 20.87 / Max: 20.94Min: 22.37 / Avg: 22.46 / Max: 22.52Min: 23.63 / Avg: 23.71 / Max: 23.76Min: 24.1 / Avg: 24.23 / Max: 24.34Min: 25.94 / Avg: 26 / Max: 26.06Min: 28.91 / Avg: 28.96 / Max: 28.99Min: 29.02 / Avg: 29.15 / Max: 29.33Min: 31.09 / Avg: 31.24 / Max: 31.35Min: 31.51 / Avg: 31.85 / Max: 32.11Min: 38.39 / Avg: 38.47 / Max: 38.62Min: 38.87 / Avg: 38.9 / Max: 38.91Min: 39.8 / Avg: 40 / Max: 40.13Min: 40.79 / Avg: 40.92 / Max: 40.99Min: 52.2 / Avg: 54.88 / Max: 56.46Min: 59.88 / Avg: 61.07 / Max: 62.54Min: 62.19 / Avg: 62.82 / Max: 63.591. (CC) gcc options: -pthread -ftree-vectorize -fvisibility=hidden -O2 -lpthread -lm -lrt

OpenBenchmarking.orgFrames Per Second, More Is BetterKvazaar 2.2Video Input: Bosphorus 4K - Video Preset: MediumXeon Platinum 8380Xeon Max 9468Xeon Max 9480Xeon 6766EXeon Platinum 8380 2PXeon Platinum 8490HXeon 6780EEPYC 8534PNEPYC 8534PXeon Platinum 8592+Xeon Max 9468 2PXeon 6766E 2PXeon Max 9480 2PXeon 6780E 2PXeon Platinum 8490H 2PEPYC 9754EPYC 9654EPYC 9684XXeon Platinum 8592+ 2PEPYC 9754 2PEPYC 9654 2PEPYC 9684X 2P1428425670SE +/- 0.01, N = 3SE +/- 0.04, N = 3SE +/- 0.02, N = 3SE +/- 0.00, N = 3SE +/- 0.03, N = 3SE +/- 0.02, N = 3SE +/- 0.01, N = 3SE +/- 0.03, N = 3SE +/- 0.05, N = 3SE +/- 0.03, N = 3SE +/- 0.08, N = 3SE +/- 0.21, N = 3SE +/- 0.07, N = 3SE +/- 0.23, N = 3SE +/- 0.06, N = 3SE +/- 0.04, N = 4SE +/- 0.07, N = 4SE +/- 0.01, N = 4SE +/- 0.27, N = 4SE +/- 0.52, N = 15SE +/- 0.56, N = 5SE +/- 0.40, N = 515.5118.1318.8419.3420.3320.9721.3923.0224.3124.8026.6929.1529.6231.7032.0439.0839.5840.5041.5854.5761.1163.481. (CC) gcc options: -pthread -ftree-vectorize -fvisibility=hidden -O2 -lpthread -lm -lrt
OpenBenchmarking.orgFrames Per Second, More Is BetterKvazaar 2.2Video Input: Bosphorus 4K - Video Preset: MediumXeon Platinum 8380Xeon Max 9468Xeon Max 9480Xeon 6766EXeon Platinum 8380 2PXeon Platinum 8490HXeon 6780EEPYC 8534PNEPYC 8534PXeon Platinum 8592+Xeon Max 9468 2PXeon 6766E 2PXeon Max 9480 2PXeon 6780E 2PXeon Platinum 8490H 2PEPYC 9754EPYC 9654EPYC 9684XXeon Platinum 8592+ 2PEPYC 9754 2PEPYC 9654 2PEPYC 9684X 2P1224364860Min: 15.5 / Avg: 15.51 / Max: 15.53Min: 18.06 / Avg: 18.13 / Max: 18.21Min: 18.81 / Avg: 18.84 / Max: 18.89Min: 19.34 / Avg: 19.34 / Max: 19.34Min: 20.29 / Avg: 20.33 / Max: 20.38Min: 20.94 / Avg: 20.97 / Max: 21.01Min: 21.38 / Avg: 21.39 / Max: 21.4Min: 22.97 / Avg: 23.02 / Max: 23.08Min: 24.22 / Avg: 24.31 / Max: 24.38Min: 24.75 / Avg: 24.8 / Max: 24.86Min: 26.53 / Avg: 26.69 / Max: 26.79Min: 28.8 / Avg: 29.15 / Max: 29.54Min: 29.53 / Avg: 29.62 / Max: 29.76Min: 31.26 / Avg: 31.7 / Max: 32.02Min: 31.94 / Avg: 32.04 / Max: 32.16Min: 38.97 / Avg: 39.08 / Max: 39.15Min: 39.47 / Avg: 39.58 / Max: 39.77Min: 40.48 / Avg: 40.5 / Max: 40.5Min: 40.95 / Avg: 41.58 / Max: 42.09Min: 51 / Avg: 54.57 / Max: 57.22Min: 59.85 / Avg: 61.11 / Max: 62.82Min: 62 / Avg: 63.48 / Max: 64.121. (CC) gcc options: -pthread -ftree-vectorize -fvisibility=hidden -O2 -lpthread -lm -lrt

PyTorch

OpenBenchmarking.orgbatches/sec, More Is BetterPyTorch 2.2.1Device: CPU - Batch Size: 256 - Model: ResNet-152EPYC 9754 2PXeon 6766E 2PXeon 6780E 2PEPYC 9684X 2PEPYC 9654 2PEPYC 9754Xeon 6766EEPYC 8534PNEPYC 8534PXeon 6780EEPYC 9654Xeon Platinum 8490H 2PEPYC 9684XXeon Platinum 8380 2PXeon Max 9480 2PXeon Platinum 8592+ 2PXeon Max 9468 2PXeon Platinum 8380Xeon Max 9468Xeon Max 9480Xeon Platinum 8490HXeon Platinum 8592+612182430SE +/- 0.12, N = 9SE +/- 0.06, N = 9SE +/- 0.04, N = 3SE +/- 0.13, N = 9SE +/- 0.13, N = 9SE +/- 0.15, N = 3SE +/- 0.04, N = 3SE +/- 0.04, N = 3SE +/- 0.06, N = 3SE +/- 0.19, N = 3SE +/- 0.11, N = 3SE +/- 0.13, N = 7SE +/- 0.20, N = 3SE +/- 0.08, N = 3SE +/- 0.18, N = 4SE +/- 0.16, N = 3SE +/- 0.09, N = 3SE +/- 0.05, N = 3SE +/- 0.15, N = 3SE +/- 0.15, N = 3SE +/- 0.08, N = 3SE +/- 0.29, N = 35.716.116.617.027.1411.0111.8813.1813.2613.6413.9514.0814.0814.8814.9216.0016.3017.7019.2019.5820.2523.33
OpenBenchmarking.orgbatches/sec, More Is BetterPyTorch 2.2.1Device: CPU - Batch Size: 256 - Model: ResNet-152EPYC 9754 2PXeon 6766E 2PXeon 6780E 2PEPYC 9684X 2PEPYC 9654 2PEPYC 9754Xeon 6766EEPYC 8534PNEPYC 8534PXeon 6780EEPYC 9654Xeon Platinum 8490H 2PEPYC 9684XXeon Platinum 8380 2PXeon Max 9480 2PXeon Platinum 8592+ 2PXeon Max 9468 2PXeon Platinum 8380Xeon Max 9468Xeon Max 9480Xeon Platinum 8490HXeon Platinum 8592+510152025Min: 5.09 / Avg: 5.71 / Max: 6.15Min: 5.93 / Avg: 6.11 / Max: 6.48Min: 6.57 / Avg: 6.61 / Max: 6.7Min: 6.5 / Avg: 7.02 / Max: 7.6Min: 6.45 / Avg: 7.14 / Max: 7.59Min: 10.8 / Avg: 11.01 / Max: 11.3Min: 11.79 / Avg: 11.88 / Max: 11.93Min: 13.09 / Avg: 13.18 / Max: 13.23Min: 13.15 / Avg: 13.26 / Max: 13.36Min: 13.27 / Avg: 13.64 / Max: 13.9Min: 13.72 / Avg: 13.95 / Max: 14.08Min: 13.69 / Avg: 14.08 / Max: 14.61Min: 13.81 / Avg: 14.08 / Max: 14.47Min: 14.77 / Avg: 14.88 / Max: 15.05Min: 14.45 / Avg: 14.92 / Max: 15.35Min: 15.77 / Avg: 16 / Max: 16.32Min: 16.14 / Avg: 16.3 / Max: 16.46Min: 17.59 / Avg: 17.7 / Max: 17.75Min: 18.9 / Avg: 19.2 / Max: 19.38Min: 19.41 / Avg: 19.58 / Max: 19.87Min: 20.08 / Avg: 20.25 / Max: 20.35Min: 22.87 / Avg: 23.33 / Max: 23.86

OpenBenchmarking.orgbatches/sec, More Is BetterPyTorch 2.2.1Device: CPU - Batch Size: 512 - Model: ResNet-152EPYC 9754 2PXeon 6766E 2PXeon 6780E 2PEPYC 9684X 2PEPYC 9654 2PEPYC 9754Xeon 6766EEPYC 8534PEPYC 8534PNXeon 6780EEPYC 9684XEPYC 9654Xeon Platinum 8490H 2PXeon Max 9480 2PXeon Platinum 8380 2PXeon Platinum 8592+ 2PXeon Max 9468 2PXeon Platinum 8380Xeon Max 9480Xeon Max 9468Xeon Platinum 8490HXeon Platinum 8592+612182430SE +/- 0.11, N = 9SE +/- 0.07, N = 3SE +/- 0.07, N = 3SE +/- 0.13, N = 9SE +/- 0.14, N = 9SE +/- 0.02, N = 3SE +/- 0.14, N = 3SE +/- 0.11, N = 3SE +/- 0.09, N = 3SE +/- 0.19, N = 3SE +/- 0.12, N = 3SE +/- 0.18, N = 3SE +/- 0.09, N = 3SE +/- 0.16, N = 3SE +/- 0.17, N = 3SE +/- 0.18, N = 3SE +/- 0.09, N = 3SE +/- 0.13, N = 3SE +/- 0.18, N = 7SE +/- 0.18, N = 7SE +/- 0.04, N = 3SE +/- 0.16, N = 35.756.336.657.077.2010.9111.7413.2813.2813.6113.9514.0514.5914.7414.7616.1716.6817.5519.2919.4720.4623.41
OpenBenchmarking.orgbatches/sec, More Is BetterPyTorch 2.2.1Device: CPU - Batch Size: 512 - Model: ResNet-152EPYC 9754 2PXeon 6766E 2PXeon 6780E 2PEPYC 9684X 2PEPYC 9654 2PEPYC 9754Xeon 6766EEPYC 8534PEPYC 8534PNXeon 6780EEPYC 9684XEPYC 9654Xeon Platinum 8490H 2PXeon Max 9480 2PXeon Platinum 8380 2PXeon Platinum 8592+ 2PXeon Max 9468 2PXeon Platinum 8380Xeon Max 9480Xeon Max 9468Xeon Platinum 8490HXeon Platinum 8592+510152025Min: 5.24 / Avg: 5.75 / Max: 6.2Min: 6.25 / Avg: 6.33 / Max: 6.47Min: 6.54 / Avg: 6.65 / Max: 6.78Min: 6.48 / Avg: 7.07 / Max: 7.58Min: 6.54 / Avg: 7.2 / Max: 7.86Min: 10.89 / Avg: 10.91 / Max: 10.95Min: 11.52 / Avg: 11.74 / Max: 12.01Min: 13.1 / Avg: 13.28 / Max: 13.47Min: 13.14 / Avg: 13.28 / Max: 13.44Min: 13.23 / Avg: 13.61 / Max: 13.86Min: 13.76 / Avg: 13.95 / Max: 14.16Min: 13.84 / Avg: 14.05 / Max: 14.4Min: 14.43 / Avg: 14.59 / Max: 14.74Min: 14.42 / Avg: 14.74 / Max: 14.92Min: 14.42 / Avg: 14.76 / Max: 14.97Min: 15.82 / Avg: 16.17 / Max: 16.41Min: 16.56 / Avg: 16.68 / Max: 16.86Min: 17.34 / Avg: 17.55 / Max: 17.78Min: 18.48 / Avg: 19.29 / Max: 19.78Min: 18.55 / Avg: 19.47 / Max: 20.1Min: 20.39 / Avg: 20.46 / Max: 20.54Min: 23.13 / Avg: 23.41 / Max: 23.67

OpenBenchmarking.orgbatches/sec, More Is BetterPyTorch 2.2.1Device: CPU - Batch Size: 64 - Model: ResNet-152EPYC 9754 2PXeon 6766E 2PXeon 6780E 2PEPYC 9654 2PEPYC 9684X 2PEPYC 9754Xeon 6766EXeon 6780EEPYC 8534PNEPYC 8534PEPYC 9654EPYC 9684XXeon Platinum 8490H 2PXeon Max 9480 2PXeon Platinum 8380 2PXeon Max 9468 2PXeon Platinum 8592+ 2PXeon Platinum 8380Xeon Max 9468Xeon Max 9480Xeon Platinum 8490HXeon Platinum 8592+612182430SE +/- 0.03, N = 3SE +/- 0.07, N = 3SE +/- 0.05, N = 3SE +/- 0.13, N = 9SE +/- 0.15, N = 9SE +/- 0.02, N = 3SE +/- 0.04, N = 3SE +/- 0.13, N = 3SE +/- 0.03, N = 3SE +/- 0.16, N = 3SE +/- 0.17, N = 3SE +/- 0.10, N = 3SE +/- 0.17, N = 3SE +/- 0.05, N = 3SE +/- 0.12, N = 3SE +/- 0.21, N = 3SE +/- 0.15, N = 12SE +/- 0.05, N = 3SE +/- 0.19, N = 5SE +/- 0.17, N = 12SE +/- 0.18, N = 3SE +/- 0.34, N = 35.796.156.597.047.0810.8811.9513.0013.1513.1913.8413.8914.0314.9615.1115.8416.2517.7319.0119.2420.1323.49
OpenBenchmarking.orgbatches/sec, More Is BetterPyTorch 2.2.1Device: CPU - Batch Size: 64 - Model: ResNet-152EPYC 9754 2PXeon 6766E 2PXeon 6780E 2PEPYC 9654 2PEPYC 9684X 2PEPYC 9754Xeon 6766EXeon 6780EEPYC 8534PNEPYC 8534PEPYC 9654EPYC 9684XXeon Platinum 8490H 2PXeon Max 9480 2PXeon Platinum 8380 2PXeon Max 9468 2PXeon Platinum 8592+ 2PXeon Platinum 8380Xeon Max 9468Xeon Max 9480Xeon Platinum 8490HXeon Platinum 8592+510152025Min: 5.74 / Avg: 5.79 / Max: 5.83Min: 6.01 / Avg: 6.15 / Max: 6.25Min: 6.5 / Avg: 6.59 / Max: 6.64Min: 6.42 / Avg: 7.04 / Max: 7.57Min: 6.54 / Avg: 7.08 / Max: 7.82Min: 10.86 / Avg: 10.88 / Max: 10.92Min: 11.91 / Avg: 11.95 / Max: 12.03Min: 12.75 / Avg: 13 / Max: 13.15Min: 13.1 / Avg: 13.15 / Max: 13.21Min: 13.02 / Avg: 13.19 / Max: 13.52Min: 13.64 / Avg: 13.84 / Max: 14.17Min: 13.69 / Avg: 13.89 / Max: 14.03Min: 13.7 / Avg: 14.03 / Max: 14.29Min: 14.87 / Avg: 14.96 / Max: 15.01Min: 14.88 / Avg: 15.11 / Max: 15.27Min: 15.57 / Avg: 15.84 / Max: 16.25Min: 15.08 / Avg: 16.25 / Max: 17.16Min: 17.63 / Avg: 17.73 / Max: 17.81Min: 18.55 / Avg: 19.01 / Max: 19.68Min: 18.21 / Avg: 19.24 / Max: 20.15Min: 19.76 / Avg: 20.13 / Max: 20.37Min: 22.82 / Avg: 23.49 / Max: 23.88

oneDNN

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.4Harness: Deconvolution Batch shapes_3d - Engine: CPUXeon 6766E 2PXeon 6766EXeon 6780E 2PXeon 6780EEPYC 8534PNEPYC 8534PXeon Platinum 8380Xeon Max 9468Xeon Max 9480EPYC 9654EPYC 9684XXeon Platinum 8490HEPYC 9654 2PEPYC 9684X 2PXeon Max 9468 2PEPYC 9754Xeon Platinum 8592+Xeon Platinum 8380 2PXeon Max 9480 2PEPYC 9754 2PXeon Platinum 8490H 2PXeon Platinum 8592+ 2P0.56191.12381.68572.24762.8095SE +/- 0.001467, N = 9SE +/- 0.001097, N = 9SE +/- 0.001365, N = 9SE +/- 0.002181, N = 9SE +/- 0.001685, N = 9SE +/- 0.000791, N = 9SE +/- 0.006599, N = 9SE +/- 0.000508, N = 9SE +/- 0.000927, N = 9SE +/- 0.001484, N = 9SE +/- 0.001272, N = 9SE +/- 0.000805, N = 9SE +/- 0.001921, N = 9SE +/- 0.002070, N = 9SE +/- 0.000806, N = 9SE +/- 0.001089, N = 9SE +/- 0.000392, N = 9SE +/- 0.001091, N = 9SE +/- 0.001240, N = 9SE +/- 0.003127, N = 9SE +/- 0.001274, N = 9SE +/- 0.000902, N = 92.4973402.2971202.2452602.0491001.7974901.4983501.4221301.2640701.1964301.1548701.1192301.0774301.0094731.0019140.9450750.9436210.9071610.8670650.8643580.8296530.7361700.6242501. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread
OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.4Harness: Deconvolution Batch shapes_3d - Engine: CPUXeon 6766E 2PXeon 6766EXeon 6780E 2PXeon 6780EEPYC 8534PNEPYC 8534PXeon Platinum 8380Xeon Max 9468Xeon Max 9480EPYC 9654EPYC 9684XXeon Platinum 8490HEPYC 9654 2PEPYC 9684X 2PXeon Max 9468 2PEPYC 9754Xeon Platinum 8592+Xeon Platinum 8380 2PXeon Max 9480 2PEPYC 9754 2PXeon Platinum 8490H 2PXeon Platinum 8592+ 2P246810Min: 2.49 / Avg: 2.5 / Max: 2.51Min: 2.29 / Avg: 2.3 / Max: 2.3Min: 2.24 / Avg: 2.25 / Max: 2.25Min: 2.04 / Avg: 2.05 / Max: 2.07Min: 1.79 / Avg: 1.8 / Max: 1.81Min: 1.5 / Avg: 1.5 / Max: 1.5Min: 1.4 / Avg: 1.42 / Max: 1.45Min: 1.26 / Avg: 1.26 / Max: 1.27Min: 1.19 / Avg: 1.2 / Max: 1.2Min: 1.15 / Avg: 1.15 / Max: 1.16Min: 1.11 / Avg: 1.12 / Max: 1.12Min: 1.07 / Avg: 1.08 / Max: 1.08Min: 1 / Avg: 1.01 / Max: 1.02Min: 0.99 / Avg: 1 / Max: 1.01Min: 0.94 / Avg: 0.95 / Max: 0.95Min: 0.94 / Avg: 0.94 / Max: 0.95Min: 0.91 / Avg: 0.91 / Max: 0.91Min: 0.86 / Avg: 0.87 / Max: 0.87Min: 0.86 / Avg: 0.86 / Max: 0.87Min: 0.82 / Avg: 0.83 / Max: 0.85Min: 0.73 / Avg: 0.74 / Max: 0.74Min: 0.62 / Avg: 0.62 / Max: 0.631. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread

OpenVINO

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Noise Suppression Poconet-Like FP16 - Device: CPUXeon 6766E 2PXeon 6780E 2PXeon 6766EXeon 6780EEPYC 9754 2PXeon Platinum 8380 2PXeon Platinum 8380EPYC 9654 2PEPYC 9754EPYC 9684X 2PXeon Max 9480 2PEPYC 8534PNEPYC 8534PXeon Max 9468 2PEPYC 9654Xeon Platinum 8490H 2PXeon Platinum 8490HEPYC 9684XXeon Platinum 8592+ 2PXeon Max 9480Xeon Max 9468Xeon Platinum 8592+70140210280350SE +/- 4.48, N = 3SE +/- 0.86, N = 3SE +/- 0.66, N = 3SE +/- 0.65, N = 3SE +/- 0.10, N = 3SE +/- 0.07, N = 3SE +/- 0.03, N = 3SE +/- 0.08, N = 3SE +/- 0.45, N = 12SE +/- 0.04, N = 3SE +/- 0.09, N = 3SE +/- 0.02, N = 3SE +/- 0.00, N = 3SE +/- 0.12, N = 3SE +/- 0.16, N = 14SE +/- 0.05, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.04, N = 3SE +/- 0.02, N = 3SE +/- 0.04, N = 3SE +/- 0.01, N = 3340.26293.3682.1275.2228.1026.3325.9123.1222.6722.2018.7218.4917.3017.1516.3215.9613.9513.5213.1512.7211.379.401. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Noise Suppression Poconet-Like FP16 - Device: CPUXeon 6766E 2PXeon 6780E 2PXeon 6766EXeon 6780EEPYC 9754 2PXeon Platinum 8380 2PXeon Platinum 8380EPYC 9654 2PEPYC 9754EPYC 9684X 2PXeon Max 9480 2PEPYC 8534PNEPYC 8534PXeon Max 9468 2PEPYC 9654Xeon Platinum 8490H 2PXeon Platinum 8490HEPYC 9684XXeon Platinum 8592+ 2PXeon Max 9480Xeon Max 9468Xeon Platinum 8592+60120180240300Min: 334.47 / Avg: 340.26 / Max: 349.07Min: 291.7 / Avg: 293.36 / Max: 294.59Min: 81.37 / Avg: 82.12 / Max: 83.44Min: 74.36 / Avg: 75.22 / Max: 76.5Min: 27.97 / Avg: 28.1 / Max: 28.29Min: 26.26 / Avg: 26.33 / Max: 26.47Min: 25.85 / Avg: 25.91 / Max: 25.94Min: 22.99 / Avg: 23.12 / Max: 23.27Min: 18.1 / Avg: 22.67 / Max: 24.62Min: 22.15 / Avg: 22.2 / Max: 22.27Min: 18.58 / Avg: 18.72 / Max: 18.9Min: 18.46 / Avg: 18.49 / Max: 18.52Min: 17.29 / Avg: 17.3 / Max: 17.3Min: 16.93 / Avg: 17.15 / Max: 17.33Min: 14.29 / Avg: 16.32 / Max: 16.64Min: 15.86 / Avg: 15.96 / Max: 16.02Min: 13.94 / Avg: 13.95 / Max: 13.95Min: 13.52 / Avg: 13.52 / Max: 13.52Min: 13.1 / Avg: 13.15 / Max: 13.23Min: 12.67 / Avg: 12.72 / Max: 12.74Min: 11.33 / Avg: 11.37 / Max: 11.45Min: 9.38 / Avg: 9.4 / Max: 9.431. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

uvg266

uvg266 is an open-source VVC/H.266 (Versatile Video Coding) encoder based on Kvazaar as part of the Ultra Video Group, Tampere University, Finland. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgFrames Per Second, More Is Betteruvg266 0.4.1Video Input: Bosphorus 4K - Video Preset: SlowXeon Platinum 8380Xeon Max 9468Xeon 6766EXeon Platinum 8380 2PXeon Max 9480Xeon 6780EXeon Platinum 8490HEPYC 8534PNXeon Platinum 8592+EPYC 8534PXeon Max 9468 2PXeon 6766E 2PXeon 6780E 2PXeon Max 9480 2PXeon Platinum 8490H 2PXeon Platinum 8592+ 2PEPYC 9654EPYC 9754EPYC 9684XEPYC 9754 2PEPYC 9654 2PEPYC 9684X 2P1020304050SE +/- 0.01, N = 3SE +/- 0.02, N = 3SE +/- 0.04, N = 3SE +/- 0.03, N = 3SE +/- 0.01, N = 3SE +/- 0.03, N = 3SE +/- 0.03, N = 3SE +/- 0.02, N = 3SE +/- 0.01, N = 3SE +/- 0.04, N = 3SE +/- 0.04, N = 3SE +/- 0.02, N = 3SE +/- 0.18, N = 3SE +/- 0.04, N = 3SE +/- 0.04, N = 3SE +/- 0.02, N = 3SE +/- 0.04, N = 3SE +/- 0.04, N = 3SE +/- 0.04, N = 3SE +/- 0.23, N = 4SE +/- 0.21, N = 4SE +/- 0.12, N = 410.9313.3613.7713.7913.8915.2415.7115.7716.0617.0419.7520.4621.6322.1424.7127.1128.0129.0029.1837.1340.9643.39
OpenBenchmarking.orgFrames Per Second, More Is Betteruvg266 0.4.1Video Input: Bosphorus 4K - Video Preset: SlowXeon Platinum 8380Xeon Max 9468Xeon 6766EXeon Platinum 8380 2PXeon Max 9480Xeon 6780EXeon Platinum 8490HEPYC 8534PNXeon Platinum 8592+EPYC 8534PXeon Max 9468 2PXeon 6766E 2PXeon 6780E 2PXeon Max 9480 2PXeon Platinum 8490H 2PXeon Platinum 8592+ 2PEPYC 9654EPYC 9754EPYC 9684XEPYC 9754 2PEPYC 9654 2PEPYC 9684X 2P918273645Min: 10.92 / Avg: 10.93 / Max: 10.95Min: 13.32 / Avg: 13.36 / Max: 13.39Min: 13.7 / Avg: 13.77 / Max: 13.81Min: 13.75 / Avg: 13.79 / Max: 13.85Min: 13.87 / Avg: 13.89 / Max: 13.91Min: 15.19 / Avg: 15.24 / Max: 15.27Min: 15.67 / Avg: 15.71 / Max: 15.76Min: 15.73 / Avg: 15.77 / Max: 15.81Min: 16.03 / Avg: 16.06 / Max: 16.08Min: 16.96 / Avg: 17.04 / Max: 17.1Min: 19.68 / Avg: 19.75 / Max: 19.79Min: 20.42 / Avg: 20.46 / Max: 20.5Min: 21.27 / Avg: 21.63 / Max: 21.81Min: 22.06 / Avg: 22.14 / Max: 22.2Min: 24.63 / Avg: 24.71 / Max: 24.76Min: 27.07 / Avg: 27.11 / Max: 27.15Min: 27.94 / Avg: 28.01 / Max: 28.06Min: 28.94 / Avg: 29 / Max: 29.07Min: 29.14 / Avg: 29.18 / Max: 29.27Min: 36.47 / Avg: 37.13 / Max: 37.47Min: 40.56 / Avg: 40.96 / Max: 41.51Min: 43.19 / Avg: 43.39 / Max: 43.68

ONNX Runtime

ONNX Runtime is developed by Microsoft and partners as a open-source, cross-platform, high performance machine learning inferencing and training accelerator. This test profile runs the ONNX Runtime with various models available from the ONNX Model Zoo. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.17Model: super-resolution-10 - Device: CPU - Executor: ParallelXeon 6766E 2PXeon 6780E 2PXeon 6766EXeon 6780EEPYC 9754 2PEPYC 9654 2PEPYC 9684X 2PEPYC 9754EPYC 8534PNEPYC 8534PEPYC 9684XEPYC 9654Xeon Max 9480 2PXeon Max 9468 2PXeon Platinum 8380Xeon Platinum 8380 2PXeon Platinum 8490H 2PXeon Max 9480Xeon Max 9468Xeon Platinum 8490HXeon Platinum 8592+ 2PXeon Platinum 8592+50100150200250SE +/- 0.23, N = 3SE +/- 0.11, N = 3SE +/- 0.04, N = 3SE +/- 0.04, N = 3SE +/- 0.83, N = 3SE +/- 0.53, N = 3SE +/- 0.41, N = 3SE +/- 0.26, N = 3SE +/- 0.72, N = 3SE +/- 0.54, N = 3SE +/- 0.99, N = 3SE +/- 0.36, N = 3SE +/- 0.62, N = 3SE +/- 1.17, N = 3SE +/- 0.40, N = 3SE +/- 0.90, N = 3SE +/- 0.74, N = 3SE +/- 0.61, N = 3SE +/- 0.98, N = 3SE +/- 2.34, N = 3SE +/- 1.38, N = 3SE +/- 1.98, N = 360.2965.4369.0775.8778.0786.9287.2694.7496.1797.05108.87110.00169.85173.91176.29178.62188.89190.06195.71205.53214.81234.541. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt
OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.17Model: super-resolution-10 - Device: CPU - Executor: ParallelXeon 6766E 2PXeon 6780E 2PXeon 6766EXeon 6780EEPYC 9754 2PEPYC 9654 2PEPYC 9684X 2PEPYC 9754EPYC 8534PNEPYC 8534PEPYC 9684XEPYC 9654Xeon Max 9480 2PXeon Max 9468 2PXeon Platinum 8380Xeon Platinum 8380 2PXeon Platinum 8490H 2PXeon Max 9480Xeon Max 9468Xeon Platinum 8490HXeon Platinum 8592+ 2PXeon Platinum 8592+4080120160200Min: 59.84 / Avg: 60.29 / Max: 60.6Min: 65.22 / Avg: 65.43 / Max: 65.61Min: 69.02 / Avg: 69.07 / Max: 69.15Min: 75.79 / Avg: 75.86 / Max: 75.92Min: 77.23 / Avg: 78.07 / Max: 79.73Min: 86.32 / Avg: 86.92 / Max: 87.98Min: 86.49 / Avg: 87.26 / Max: 87.9Min: 94.23 / Avg: 94.74 / Max: 95.09Min: 94.76 / Avg: 96.17 / Max: 97.16Min: 96.11 / Avg: 97.05 / Max: 98Min: 107.4 / Avg: 108.87 / Max: 110.76Min: 109.41 / Avg: 110 / Max: 110.67Min: 168.73 / Avg: 169.85 / Max: 170.87Min: 172.15 / Avg: 173.91 / Max: 176.13Min: 175.74 / Avg: 176.29 / Max: 177.07Min: 176.95 / Avg: 178.62 / Max: 180.05Min: 187.98 / Avg: 188.89 / Max: 190.35Min: 188.89 / Avg: 190.06 / Max: 190.94Min: 194.68 / Avg: 195.71 / Max: 197.66Min: 201.08 / Avg: 205.52 / Max: 209.04Min: 212.63 / Avg: 214.81 / Max: 217.37Min: 232.42 / Avg: 234.54 / Max: 238.51. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.17Model: fcn-resnet101-11 - Device: CPU - Executor: ParallelEPYC 9684X 2PEPYC 9654 2PEPYC 9654EPYC 9684XXeon 6766E 2PXeon 6780E 2PXeon 6766EXeon 6780EXeon Max 9480 2PXeon Max 9468 2PEPYC 8534PNEPYC 9754 2PEPYC 8534PXeon Max 9480Xeon Max 9468Xeon Platinum 8380Xeon Platinum 8490H 2PXeon Platinum 8380 2PXeon Platinum 8490HXeon Platinum 8592+ 2PEPYC 9754Xeon Platinum 8592+0.74441.48882.23322.97763.722SE +/- 0.001170, N = 3SE +/- 0.016597, N = 12SE +/- 0.013875, N = 12SE +/- 0.020352, N = 15SE +/- 0.016386, N = 15SE +/- 0.009611, N = 3SE +/- 0.001935, N = 3SE +/- 0.002384, N = 3SE +/- 0.026516, N = 3SE +/- 0.027020, N = 13SE +/- 0.018603, N = 15SE +/- 0.034519, N = 3SE +/- 0.023203, N = 3SE +/- 0.015170, N = 3SE +/- 0.011894, N = 3SE +/- 0.019473, N = 3SE +/- 0.007683, N = 3SE +/- 0.019617, N = 15SE +/- 0.008707, N = 3SE +/- 0.038257, N = 3SE +/- 0.018814, N = 3SE +/- 0.008053, N = 30.8576850.9170431.2513501.2517901.6467401.7036501.7780901.9414402.1048002.1746302.2545302.5170902.5727802.6172102.6254402.7524202.8349802.8925303.0392203.0508503.1315603.3083601. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt
OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.17Model: fcn-resnet101-11 - Device: CPU - Executor: ParallelEPYC 9684X 2PEPYC 9654 2PEPYC 9654EPYC 9684XXeon 6766E 2PXeon 6780E 2PXeon 6766EXeon 6780EXeon Max 9480 2PXeon Max 9468 2PEPYC 8534PNEPYC 9754 2PEPYC 8534PXeon Max 9480Xeon Max 9468Xeon Platinum 8380Xeon Platinum 8490H 2PXeon Platinum 8380 2PXeon Platinum 8490HXeon Platinum 8592+ 2PEPYC 9754Xeon Platinum 8592+246810Min: 0.86 / Avg: 0.86 / Max: 0.86Min: 0.86 / Avg: 0.92 / Max: 1.02Min: 1.16 / Avg: 1.25 / Max: 1.33Min: 1.09 / Avg: 1.25 / Max: 1.4Min: 1.53 / Avg: 1.65 / Max: 1.75Min: 1.69 / Avg: 1.7 / Max: 1.72Min: 1.78 / Avg: 1.78 / Max: 1.78Min: 1.94 / Avg: 1.94 / Max: 1.95Min: 2.05 / Avg: 2.1 / Max: 2.14Min: 2.01 / Avg: 2.17 / Max: 2.4Min: 2.17 / Avg: 2.25 / Max: 2.39Min: 2.45 / Avg: 2.52 / Max: 2.57Min: 2.53 / Avg: 2.57 / Max: 2.6Min: 2.6 / Avg: 2.62 / Max: 2.65Min: 2.6 / Avg: 2.63 / Max: 2.64Min: 2.73 / Avg: 2.75 / Max: 2.79Min: 2.82 / Avg: 2.83 / Max: 2.84Min: 2.78 / Avg: 2.89 / Max: 3Min: 3.03 / Avg: 3.04 / Max: 3.06Min: 3 / Avg: 3.05 / Max: 3.13Min: 3.11 / Avg: 3.13 / Max: 3.17Min: 3.29 / Avg: 3.31 / Max: 3.321. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

Aircrack-ng

Aircrack-ng is a tool for assessing WiFi/WLAN network security. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgk/s, More Is BetterAircrack-ng 1.7Xeon Platinum 8490H 2PXeon Platinum 8592+ 2PXeon Max 9480 2PXeon Max 9468 2PXeon Platinum 8380Xeon 6766EXeon 6780EXeon Max 9468Xeon Max 9480EPYC 8534PNXeon Platinum 8490HXeon Platinum 8592+EPYC 8534PXeon Platinum 8380 2PEPYC 9754EPYC 9654EPYC 9684X40K80K120K160K200KSE +/- 1197.41, N = 15SE +/- 773.70, N = 3SE +/- 1131.21, N = 15SE +/- 1027.07, N = 15SE +/- 728.55, N = 3SE +/- 1379.58, N = 4SE +/- 888.98, N = 3SE +/- 36.42, N = 3SE +/- 122.31, N = 3SE +/- 319.60, N = 3SE +/- 1953.08, N = 3SE +/- 840.59, N = 3SE +/- 338.71, N = 3SE +/- 1234.47, N = 15SE +/- 714.86, N = 3SE +/- 207.11, N = 3SE +/- 1622.56, N = 353914.9364181.2965663.8283665.76101665.47114715.79116716.40117588.99134048.96141831.78147469.33153584.20153818.03159709.75177989.89186675.43206619.291. (CXX) g++ options: -std=gnu++17 -O3 -fvisibility=hidden -fcommon -rdynamic -lnl-3 -lnl-genl-3 -lpcre -lsqlite3 -lpthread -lz -lssl -lcrypto -lhwloc -ldl -lm -pthread
OpenBenchmarking.orgk/s, More Is BetterAircrack-ng 1.7Xeon Platinum 8490H 2PXeon Platinum 8592+ 2PXeon Max 9480 2PXeon Max 9468 2PXeon Platinum 8380Xeon 6766EXeon 6780EXeon Max 9468Xeon Max 9480EPYC 8534PNXeon Platinum 8490HXeon Platinum 8592+EPYC 8534PXeon Platinum 8380 2PEPYC 9754EPYC 9654EPYC 9684X40K80K120K160K200KMin: 46494.81 / Avg: 53914.93 / Max: 62158.72Min: 63027.57 / Avg: 64181.29 / Max: 65651.2Min: 58215.94 / Avg: 65663.82 / Max: 73521.7Min: 74275.53 / Avg: 83665.76 / Max: 90875.94Min: 100693.11 / Avg: 101665.47 / Max: 103091.47Min: 111487.1 / Avg: 114715.79 / Max: 117589.42Min: 115205.17 / Avg: 116716.4 / Max: 118283.18Min: 117530.57 / Avg: 117588.99 / Max: 117655.87Min: 133845.03 / Avg: 134048.96 / Max: 134267.94Min: 141305.02 / Avg: 141831.78 / Max: 142408.72Min: 143615.3 / Avg: 147469.33 / Max: 149947.17Min: 152198.84 / Avg: 153584.2 / Max: 155101.73Min: 153422.39 / Avg: 153818.03 / Max: 154492.06Min: 147820.61 / Avg: 159709.75 / Max: 165693.03Min: 176812.45 / Avg: 177989.89 / Max: 179280.97Min: 186378.25 / Avg: 186675.43 / Max: 187073.92Min: 203517.23 / Avg: 206619.29 / Max: 208995.591. (CXX) g++ options: -std=gnu++17 -O3 -fvisibility=hidden -fcommon -rdynamic -lnl-3 -lnl-genl-3 -lpcre -lsqlite3 -lpthread -lz -lssl -lcrypto -lhwloc -ldl -lm -pthread

EPYC 9684X 2P: The test run did not produce a result.

EPYC 9654 2P: The test run did not produce a result.

EPYC 9754 2P: The test run did not produce a result.

Xeon 6766E 2P: The test run did not produce a result.

Xeon 6780E 2P: The test run did not produce a result.

OpenVINO

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Face Detection Retail FP16-INT8 - Device: CPUXeon 6766E 2PXeon 6766EXeon 6780E 2PXeon 6780EEPYC 8534PNEPYC 8534PEPYC 9754 2PXeon Platinum 8380Xeon Platinum 8490HEPYC 9754Xeon Max 9480 2PEPYC 9654 2PXeon Platinum 8380 2PEPYC 9654Xeon Max 9480Xeon Platinum 8490H 2PXeon Max 9468 2PEPYC 9684XEPYC 9684X 2PXeon Max 9468Xeon Platinum 8592+Xeon Platinum 8592+ 2P510152025SE +/- 0.02, N = 3SE +/- 0.00, N = 3SE +/- 0.01, N = 3SE +/- 0.00, N = 3SE +/- 0.01, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.01, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.00, N = 3SE +/- 0.01, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.01, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 319.2318.2016.9816.417.606.776.606.566.436.256.025.985.935.855.775.725.555.415.345.275.195.181. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Face Detection Retail FP16-INT8 - Device: CPUXeon 6766E 2PXeon 6766EXeon 6780E 2PXeon 6780EEPYC 8534PNEPYC 8534PEPYC 9754 2PXeon Platinum 8380Xeon Platinum 8490HEPYC 9754Xeon Max 9480 2PEPYC 9654 2PXeon Platinum 8380 2PEPYC 9654Xeon Max 9480Xeon Platinum 8490H 2PXeon Max 9468 2PEPYC 9684XEPYC 9684X 2PXeon Max 9468Xeon Platinum 8592+Xeon Platinum 8592+ 2P510152025Min: 19.2 / Avg: 19.23 / Max: 19.25Min: 18.19 / Avg: 18.2 / Max: 18.2Min: 16.97 / Avg: 16.98 / Max: 16.99Min: 16.41 / Avg: 16.41 / Max: 16.42Min: 7.59 / Avg: 7.6 / Max: 7.61Min: 6.77 / Avg: 6.77 / Max: 6.78Min: 6.6 / Avg: 6.6 / Max: 6.6Min: 6.55 / Avg: 6.56 / Max: 6.57Min: 6.43 / Avg: 6.43 / Max: 6.44Min: 6.25 / Avg: 6.25 / Max: 6.25Min: 6.02 / Avg: 6.02 / Max: 6.02Min: 5.96 / Avg: 5.98 / Max: 5.99Min: 5.91 / Avg: 5.93 / Max: 5.94Min: 5.84 / Avg: 5.85 / Max: 5.85Min: 5.76 / Avg: 5.77 / Max: 5.78Min: 5.72 / Avg: 5.72 / Max: 5.73Min: 5.55 / Avg: 5.55 / Max: 5.56Min: 5.41 / Avg: 5.41 / Max: 5.41Min: 5.33 / Avg: 5.34 / Max: 5.34Min: 5.26 / Avg: 5.27 / Max: 5.29Min: 5.18 / Avg: 5.19 / Max: 5.19Min: 5.17 / Avg: 5.18 / Max: 5.181. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

Timed Node.js Compilation

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed Node.js Compilation 21.7.2Time To CompileXeon Platinum 8380Xeon Platinum 8380 2PEPYC 8534PNEPYC 8534PXeon Max 9468Xeon Platinum 8490HXeon Max 9480Xeon 6766EXeon 6780EXeon Platinum 8592+Xeon 6766E 2PEPYC 9754Xeon Max 9468 2PXeon 6780E 2PXeon Platinum 8490H 2PXeon Max 9480 2PEPYC 9654EPYC 9684XEPYC 9754 2PXeon Platinum 8592+ 2PEPYC 9654 2PEPYC 9684X 2P90180270360450SE +/- 0.22, N = 3SE +/- 0.68, N = 3SE +/- 0.19, N = 3SE +/- 0.17, N = 3SE +/- 0.53, N = 3SE +/- 0.71, N = 3SE +/- 0.74, N = 3SE +/- 0.15, N = 3SE +/- 0.51, N = 3SE +/- 0.52, N = 3SE +/- 1.20, N = 3SE +/- 0.72, N = 3SE +/- 0.84, N = 3SE +/- 0.60, N = 3SE +/- 0.48, N = 3SE +/- 0.52, N = 3SE +/- 0.59, N = 3SE +/- 0.50, N = 3SE +/- 1.51, N = 3SE +/- 0.12, N = 3SE +/- 0.18, N = 3SE +/- 1.19, N = 3423.63303.42288.12277.53270.38254.00252.65246.85228.57214.43187.65186.10175.63173.09172.99171.17164.02147.84147.74145.41118.90114.91
OpenBenchmarking.orgSeconds, Fewer Is BetterTimed Node.js Compilation 21.7.2Time To CompileXeon Platinum 8380Xeon Platinum 8380 2PEPYC 8534PNEPYC 8534PXeon Max 9468Xeon Platinum 8490HXeon Max 9480Xeon 6766EXeon 6780EXeon Platinum 8592+Xeon 6766E 2PEPYC 9754Xeon Max 9468 2PXeon 6780E 2PXeon Platinum 8490H 2PXeon Max 9480 2PEPYC 9654EPYC 9684XEPYC 9754 2PXeon Platinum 8592+ 2PEPYC 9654 2PEPYC 9684X 2P80160240320400Min: 423.28 / Avg: 423.63 / Max: 424.04Min: 302.59 / Avg: 303.42 / Max: 304.77Min: 287.75 / Avg: 288.12 / Max: 288.35Min: 277.32 / Avg: 277.52 / Max: 277.86Min: 269.34 / Avg: 270.38 / Max: 271.1Min: 253.22 / Avg: 254 / Max: 255.43Min: 251.27 / Avg: 252.65 / Max: 253.82Min: 246.6 / Avg: 246.85 / Max: 247.11Min: 227.56 / Avg: 228.57 / Max: 229.2Min: 213.49 / Avg: 214.43 / Max: 215.29Min: 186.27 / Avg: 187.65 / Max: 190.04Min: 185.05 / Avg: 186.1 / Max: 187.47Min: 174.7 / Avg: 175.63 / Max: 177.31Min: 171.93 / Avg: 173.09 / Max: 173.96Min: 172.43 / Avg: 172.99 / Max: 173.95Min: 170.52 / Avg: 171.17 / Max: 172.21Min: 162.92 / Avg: 164.02 / Max: 164.95Min: 146.87 / Avg: 147.84 / Max: 148.55Min: 145.49 / Avg: 147.74 / Max: 150.62Min: 145.21 / Avg: 145.41 / Max: 145.61Min: 118.61 / Avg: 118.9 / Max: 119.22Min: 112.53 / Avg: 114.91 / Max: 116.19

ONNX Runtime

ONNX Runtime is developed by Microsoft and partners as a open-source, cross-platform, high performance machine learning inferencing and training accelerator. This test profile runs the ONNX Runtime with various models available from the ONNX Model Zoo. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.17Model: T5 Encoder - Device: CPU - Executor: StandardEPYC 8534PEPYC 8534PNEPYC 9754 2PEPYC 9754EPYC 9654 2PXeon 6766E 2PXeon Max 9480 2PEPYC 9654Xeon Max 9468 2PXeon 6766EXeon 6780E 2PXeon Max 9480Xeon 6780EXeon Max 9468EPYC 9684X 2PEPYC 9684XXeon Platinum 8490H 2PXeon Platinum 8380 2PXeon Platinum 8380Xeon Platinum 8592+ 2PXeon Platinum 8490HXeon Platinum 8592+100200300400500SE +/- 0.98, N = 13SE +/- 0.54, N = 3SE +/- 1.15, N = 3SE +/- 1.16, N = 3SE +/- 1.86, N = 3SE +/- 11.98, N = 15SE +/- 0.89, N = 3SE +/- 1.08, N = 3SE +/- 1.31, N = 3SE +/- 0.35, N = 3SE +/- 1.00, N = 3SE +/- 0.51, N = 3SE +/- 0.17, N = 3SE +/- 3.95, N = 15SE +/- 4.17, N = 15SE +/- 1.35, N = 3SE +/- 0.26, N = 3SE +/- 4.93, N = 15SE +/- 2.62, N = 15SE +/- 3.01, N = 3SE +/- 0.84, N = 3SE +/- 1.00, N = 3127.09127.21127.54131.00167.11178.11185.46187.01199.08207.94210.37215.13217.45219.53263.52279.64288.47292.52298.67356.76357.36460.781. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt
OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.17Model: T5 Encoder - Device: CPU - Executor: StandardEPYC 8534PEPYC 8534PNEPYC 9754 2PEPYC 9754EPYC 9654 2PXeon 6766E 2PXeon Max 9480 2PEPYC 9654Xeon Max 9468 2PXeon 6766EXeon 6780E 2PXeon Max 9480Xeon 6780EXeon Max 9468EPYC 9684X 2PEPYC 9684XXeon Platinum 8490H 2PXeon Platinum 8380 2PXeon Platinum 8380Xeon Platinum 8592+ 2PXeon Platinum 8490HXeon Platinum 8592+80160240320400Min: 116.79 / Avg: 127.08 / Max: 131.65Min: 126.49 / Avg: 127.21 / Max: 128.27Min: 125.24 / Avg: 127.54 / Max: 128.77Min: 129.09 / Avg: 131 / Max: 133.1Min: 164.4 / Avg: 167.11 / Max: 170.67Min: 99.68 / Avg: 178.11 / Max: 206.82Min: 183.72 / Avg: 185.46 / Max: 186.68Min: 184.94 / Avg: 187.01 / Max: 188.53Min: 197.61 / Avg: 199.08 / Max: 201.68Min: 207.3 / Avg: 207.94 / Max: 208.49Min: 208.75 / Avg: 210.36 / Max: 212.21Min: 214.14 / Avg: 215.13 / Max: 215.81Min: 217.24 / Avg: 217.45 / Max: 217.79Min: 189.44 / Avg: 219.53 / Max: 232.62Min: 237.75 / Avg: 263.52 / Max: 279.12Min: 277.47 / Avg: 279.64 / Max: 282.11Min: 287.98 / Avg: 288.47 / Max: 288.88Min: 249.85 / Avg: 292.52 / Max: 307.91Min: 274.43 / Avg: 298.67 / Max: 310.86Min: 351.26 / Avg: 356.76 / Max: 361.65Min: 356.49 / Avg: 357.35 / Max: 359.04Min: 459 / Avg: 460.78 / Max: 462.471. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

uvg266

uvg266 is an open-source VVC/H.266 (Versatile Video Coding) encoder based on Kvazaar as part of the Ultra Video Group, Tampere University, Finland. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgFrames Per Second, More Is Betteruvg266 0.4.1Video Input: Bosphorus 4K - Video Preset: MediumXeon Platinum 8380Xeon Max 9468Xeon 6766EXeon Max 9480Xeon Platinum 8380 2PXeon Platinum 8592+Xeon 6780EEPYC 8534PNXeon Platinum 8490HEPYC 8534PXeon 6766E 2PXeon Max 9468 2PXeon 6780E 2PXeon Max 9480 2PXeon Platinum 8490H 2PXeon Platinum 8592+ 2PEPYC 9654EPYC 9754EPYC 9684XEPYC 9754 2PEPYC 9654 2PEPYC 9684X 2P1020304050SE +/- 0.00, N = 3SE +/- 0.02, N = 3SE +/- 0.01, N = 3SE +/- 0.02, N = 3SE +/- 0.02, N = 3SE +/- 0.16, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.02, N = 3SE +/- 0.01, N = 3SE +/- 0.23, N = 5SE +/- 0.03, N = 3SE +/- 0.16, N = 15SE +/- 0.03, N = 3SE +/- 0.04, N = 3SE +/- 0.05, N = 3SE +/- 0.01, N = 3SE +/- 0.05, N = 3SE +/- 0.03, N = 3SE +/- 0.28, N = 11SE +/- 0.23, N = 4SE +/- 0.46, N = 412.5615.1715.6515.6816.1916.6417.2917.8017.8519.2522.0322.2522.5924.6527.6530.3731.4432.4432.7438.1242.0345.26
OpenBenchmarking.orgFrames Per Second, More Is Betteruvg266 0.4.1Video Input: Bosphorus 4K - Video Preset: MediumXeon Platinum 8380Xeon Max 9468Xeon 6766EXeon Max 9480Xeon Platinum 8380 2PXeon Platinum 8592+Xeon 6780EEPYC 8534PNXeon Platinum 8490HEPYC 8534PXeon 6766E 2PXeon Max 9468 2PXeon 6780E 2PXeon Max 9480 2PXeon Platinum 8490H 2PXeon Platinum 8592+ 2PEPYC 9654EPYC 9754EPYC 9684XEPYC 9754 2PEPYC 9654 2PEPYC 9684X 2P918273645Min: 12.56 / Avg: 12.56 / Max: 12.57Min: 15.13 / Avg: 15.17 / Max: 15.21Min: 15.63 / Avg: 15.65 / Max: 15.66Min: 15.65 / Avg: 15.68 / Max: 15.7Min: 16.17 / Avg: 16.19 / Max: 16.23Min: 16.41 / Avg: 16.64 / Max: 16.94Min: 17.28 / Avg: 17.29 / Max: 17.3Min: 17.78 / Avg: 17.8 / Max: 17.81Min: 17.83 / Avg: 17.85 / Max: 17.89Min: 19.24 / Avg: 19.25 / Max: 19.27Min: 21.4 / Avg: 22.03 / Max: 22.58Min: 22.2 / Avg: 22.25 / Max: 22.29Min: 21.52 / Avg: 22.59 / Max: 23.32Min: 24.59 / Avg: 24.65 / Max: 24.7Min: 27.57 / Avg: 27.65 / Max: 27.71Min: 30.29 / Avg: 30.37 / Max: 30.45Min: 31.41 / Avg: 31.44 / Max: 31.45Min: 32.34 / Avg: 32.44 / Max: 32.52Min: 32.7 / Avg: 32.74 / Max: 32.8Min: 36.18 / Avg: 38.12 / Max: 39.05Min: 41.57 / Avg: 42.03 / Max: 42.66Min: 44.18 / Avg: 45.26 / Max: 46.03

ONNX Runtime

ONNX Runtime is developed by Microsoft and partners as a open-source, cross-platform, high performance machine learning inferencing and training accelerator. This test profile runs the ONNX Runtime with various models available from the ONNX Model Zoo. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.17Model: yolov4 - Device: CPU - Executor: StandardEPYC 9654 2PEPYC 9754 2PEPYC 9684X 2PXeon 6766E 2PXeon 6780E 2PEPYC 9754EPYC 8534PNEPYC 8534PEPYC 9684XEPYC 9654Xeon 6766EXeon 6780EXeon Max 9480 2PXeon Max 9468 2PXeon Platinum 8490H 2PXeon Platinum 8380 2PXeon Max 9480Xeon Platinum 8592+ 2PXeon Max 9468Xeon Platinum 8490HXeon Platinum 8380Xeon Platinum 8592+612182430SE +/- 0.04207, N = 3SE +/- 0.09575, N = 3SE +/- 0.08454, N = 3SE +/- 0.06011, N = 3SE +/- 0.01654, N = 3SE +/- 0.05314, N = 3SE +/- 0.09781, N = 5SE +/- 0.10588, N = 4SE +/- 0.12519, N = 3SE +/- 0.08554, N = 8SE +/- 0.05969, N = 3SE +/- 0.09768, N = 3SE +/- 0.09595, N = 14SE +/- 0.29451, N = 15SE +/- 0.06825, N = 3SE +/- 0.06818, N = 3SE +/- 0.15263, N = 15SE +/- 0.09991, N = 3SE +/- 0.16821, N = 15SE +/- 0.04802, N = 3SE +/- 0.15605, N = 3SE +/- 0.05084, N = 36.412296.749777.248697.499408.146158.295338.752338.874469.736859.8601812.7015013.8295014.4583014.4831015.5555016.4123016.9166016.9672018.2179019.8593020.2495022.968901. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt
OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.17Model: yolov4 - Device: CPU - Executor: StandardEPYC 9654 2PEPYC 9754 2PEPYC 9684X 2PXeon 6766E 2PXeon 6780E 2PEPYC 9754EPYC 8534PNEPYC 8534PEPYC 9684XEPYC 9654Xeon 6766EXeon 6780EXeon Max 9480 2PXeon Max 9468 2PXeon Platinum 8490H 2PXeon Platinum 8380 2PXeon Max 9480Xeon Platinum 8592+ 2PXeon Max 9468Xeon Platinum 8490HXeon Platinum 8380Xeon Platinum 8592+510152025Min: 6.33 / Avg: 6.41 / Max: 6.47Min: 6.62 / Avg: 6.75 / Max: 6.94Min: 7.11 / Avg: 7.25 / Max: 7.4Min: 7.38 / Avg: 7.5 / Max: 7.56Min: 8.12 / Avg: 8.15 / Max: 8.17Min: 8.22 / Avg: 8.3 / Max: 8.4Min: 8.36 / Avg: 8.75 / Max: 8.87Min: 8.59 / Avg: 8.87 / Max: 9.04Min: 9.49 / Avg: 9.74 / Max: 9.87Min: 9.53 / Avg: 9.86 / Max: 10.11Min: 12.58 / Avg: 12.7 / Max: 12.77Min: 13.64 / Avg: 13.83 / Max: 13.97Min: 13.71 / Avg: 14.46 / Max: 14.95Min: 13.06 / Avg: 14.48 / Max: 15.82Min: 15.42 / Avg: 15.56 / Max: 15.64Min: 16.34 / Avg: 16.41 / Max: 16.55Min: 15.84 / Avg: 16.92 / Max: 17.62Min: 16.86 / Avg: 16.97 / Max: 17.17Min: 16.16 / Avg: 18.22 / Max: 18.79Min: 19.81 / Avg: 19.86 / Max: 19.96Min: 20.04 / Avg: 20.25 / Max: 20.55Min: 22.89 / Avg: 22.97 / Max: 23.061. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

Timed Linux Kernel Compilation

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed Linux Kernel Compilation 6.8Build: allmodconfigXeon Platinum 8380EPYC 8534PNXeon Max 9468EPYC 8534PXeon Max 9480Xeon Platinum 8490HXeon Platinum 8380 2PEPYC 9754Xeon Platinum 8592+EPYC 9654EPYC 9684XXeon 6766EXeon 6780EXeon Max 9468 2PXeon Max 9480 2PXeon Platinum 8490H 2PEPYC 9754 2PEPYC 9654 2PXeon 6766E 2PXeon Platinum 8592+ 2PEPYC 9684X 2PXeon 6780E 2P130260390520650SE +/- 0.35, N = 3SE +/- 0.78, N = 3SE +/- 0.61, N = 3SE +/- 0.91, N = 3SE +/- 0.67, N = 3SE +/- 0.80, N = 3SE +/- 0.92, N = 3SE +/- 1.05, N = 3SE +/- 0.72, N = 3SE +/- 0.49, N = 3SE +/- 0.37, N = 3SE +/- 0.76, N = 3SE +/- 0.67, N = 3SE +/- 0.56, N = 3SE +/- 0.73, N = 3SE +/- 0.86, N = 3SE +/- 1.31, N = 3SE +/- 0.49, N = 3SE +/- 0.81, N = 3SE +/- 0.56, N = 3SE +/- 0.98, N = 3SE +/- 0.90, N = 3612.78438.17428.39406.41384.06362.45356.99337.69316.90311.83290.34274.86251.20246.94231.03218.57210.20197.63192.10189.74182.00174.27
OpenBenchmarking.orgSeconds, Fewer Is BetterTimed Linux Kernel Compilation 6.8Build: allmodconfigXeon Platinum 8380EPYC 8534PNXeon Max 9468EPYC 8534PXeon Max 9480Xeon Platinum 8490HXeon Platinum 8380 2PEPYC 9754Xeon Platinum 8592+EPYC 9654EPYC 9684XXeon 6766EXeon 6780EXeon Max 9468 2PXeon Max 9480 2PXeon Platinum 8490H 2PEPYC 9754 2PEPYC 9654 2PXeon 6766E 2PXeon Platinum 8592+ 2PEPYC 9684X 2PXeon 6780E 2P110220330440550Min: 612.08 / Avg: 612.78 / Max: 613.17Min: 437.25 / Avg: 438.17 / Max: 439.71Min: 427.77 / Avg: 428.39 / Max: 429.6Min: 405.29 / Avg: 406.41 / Max: 408.21Min: 383.35 / Avg: 384.06 / Max: 385.39Min: 361.57 / Avg: 362.45 / Max: 364.05Min: 355.78 / Avg: 356.99 / Max: 358.79Min: 335.59 / Avg: 337.68 / Max: 338.81Min: 316.04 / Avg: 316.9 / Max: 318.34Min: 310.91 / Avg: 311.83 / Max: 312.59Min: 289.85 / Avg: 290.34 / Max: 291.08Min: 273.8 / Avg: 274.86 / Max: 276.34Min: 250.47 / Avg: 251.2 / Max: 252.53Min: 246.34 / Avg: 246.94 / Max: 248.06Min: 230.21 / Avg: 231.03 / Max: 232.48Min: 217.6 / Avg: 218.57 / Max: 220.29Min: 208.35 / Avg: 210.2 / Max: 212.72Min: 196.97 / Avg: 197.63 / Max: 198.59Min: 191.12 / Avg: 192.1 / Max: 193.7Min: 189.09 / Avg: 189.74 / Max: 190.86Min: 180.32 / Avg: 182 / Max: 183.71Min: 173.15 / Avg: 174.27 / Max: 176.04

TensorFlow

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.16.1Device: CPU - Batch Size: 1 - Model: AlexNetXeon 6766E 2PXeon 6780E 2PEPYC 9754 2PEPYC 9654 2PEPYC 9684X 2PEPYC 9684XXeon 6766EXeon Platinum 8592+ 2PXeon 6780EEPYC 9654Xeon Max 9480 2PEPYC 8534PNEPYC 8534PEPYC 9754Xeon Platinum 8592+Xeon Platinum 8380 2PXeon Platinum 8490H 2PXeon Max 9468 2PXeon Platinum 8380Xeon Max 9480Xeon Max 9468Xeon Platinum 8490H1326395265SE +/- 0.12, N = 15SE +/- 0.19, N = 5SE +/- 0.15, N = 9SE +/- 0.17, N = 15SE +/- 0.10, N = 6SE +/- 0.07, N = 7SE +/- 0.07, N = 6SE +/- 0.45, N = 15SE +/- 0.08, N = 7SE +/- 0.18, N = 7SE +/- 0.52, N = 15SE +/- 0.04, N = 7SE +/- 0.05, N = 7SE +/- 0.48, N = 15SE +/- 0.66, N = 15SE +/- 0.33, N = 15SE +/- 0.44, N = 15SE +/- 0.57, N = 15SE +/- 0.05, N = 7SE +/- 1.22, N = 15SE +/- 0.76, N = 15SE +/- 0.08, N = 816.2418.3418.5919.8819.9226.2329.5630.7631.9932.5633.2134.3534.5135.0835.5037.2637.5737.7642.0543.6748.2856.53
OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.16.1Device: CPU - Batch Size: 1 - Model: AlexNetXeon 6766E 2PXeon 6780E 2PEPYC 9754 2PEPYC 9654 2PEPYC 9684X 2PEPYC 9684XXeon 6766EXeon Platinum 8592+ 2PXeon 6780EEPYC 9654Xeon Max 9480 2PEPYC 8534PNEPYC 8534PEPYC 9754Xeon Platinum 8592+Xeon Platinum 8380 2PXeon Platinum 8490H 2PXeon Max 9468 2PXeon Platinum 8380Xeon Max 9480Xeon Max 9468Xeon Platinum 8490H1122334455Min: 14.92 / Avg: 16.24 / Max: 16.75Min: 17.61 / Avg: 18.34 / Max: 18.67Min: 17.96 / Avg: 18.59 / Max: 19.27Min: 18.93 / Avg: 19.88 / Max: 20.87Min: 19.64 / Avg: 19.92 / Max: 20.3Min: 26 / Avg: 26.23 / Max: 26.51Min: 29.39 / Avg: 29.56 / Max: 29.83Min: 27.56 / Avg: 30.76 / Max: 33.44Min: 31.6 / Avg: 31.99 / Max: 32.24Min: 32 / Avg: 32.56 / Max: 33.45Min: 30.26 / Avg: 33.21 / Max: 37.23Min: 34.13 / Avg: 34.35 / Max: 34.48Min: 34.32 / Avg: 34.51 / Max: 34.68Min: 32.43 / Avg: 35.08 / Max: 40.57Min: 31.2 / Avg: 35.5 / Max: 39.42Min: 34.14 / Avg: 37.26 / Max: 39.25Min: 33.9 / Avg: 37.57 / Max: 40.77Min: 34.31 / Avg: 37.76 / Max: 41.21Min: 41.88 / Avg: 42.05 / Max: 42.26Min: 30.34 / Avg: 43.67 / Max: 49.86Min: 42.43 / Avg: 48.28 / Max: 52.42Min: 56.28 / Avg: 56.53 / Max: 57.04

OpenVINO

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Face Detection FP16-INT8 - Device: CPUXeon 6766E 2PXeon 6766EEPYC 8534PNXeon 6780E 2PXeon 6780EEPYC 8534PEPYC 9754EPYC 9654EPYC 9684XXeon Platinum 8380Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9480 2PEPYC 9754 2PXeon Max 9480Xeon Max 9468 2PEPYC 9654 2PXeon Max 9468Xeon Platinum 8592+ 2PEPYC 9684X 2PXeon Platinum 8592+Xeon Platinum 8380 2P160320480640800SE +/- 1.58, N = 3SE +/- 0.99, N = 3SE +/- 0.12, N = 3SE +/- 1.63, N = 3SE +/- 1.47, N = 3SE +/- 0.18, N = 3SE +/- 0.18, N = 3SE +/- 0.07, N = 3SE +/- 0.43, N = 3SE +/- 3.13, N = 3SE +/- 0.28, N = 3SE +/- 0.00, N = 3SE +/- 0.35, N = 3SE +/- 0.03, N = 3SE +/- 0.47, N = 3SE +/- 0.40, N = 3SE +/- 0.02, N = 3SE +/- 0.15, N = 3SE +/- 0.33, N = 3SE +/- 0.43, N = 3SE +/- 0.69, N = 3SE +/- 0.22, N = 3719.83692.79654.83630.23618.97592.22551.07510.10471.98415.89356.38283.11278.52275.53257.50256.63253.63236.52234.24233.63224.64207.841. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Face Detection FP16-INT8 - Device: CPUXeon 6766E 2PXeon 6766EEPYC 8534PNXeon 6780E 2PXeon 6780EEPYC 8534PEPYC 9754EPYC 9654EPYC 9684XXeon Platinum 8380Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9480 2PEPYC 9754 2PXeon Max 9480Xeon Max 9468 2PEPYC 9654 2PXeon Max 9468Xeon Platinum 8592+ 2PEPYC 9684X 2PXeon Platinum 8592+Xeon Platinum 8380 2P130260390520650Min: 717.48 / Avg: 719.83 / Max: 722.83Min: 690.81 / Avg: 692.79 / Max: 693.86Min: 654.6 / Avg: 654.83 / Max: 654.98Min: 627.16 / Avg: 630.23 / Max: 632.69Min: 616.06 / Avg: 618.97 / Max: 620.8Min: 592.01 / Avg: 592.22 / Max: 592.58Min: 550.79 / Avg: 551.07 / Max: 551.42Min: 510.02 / Avg: 510.1 / Max: 510.24Min: 471.12 / Avg: 471.98 / Max: 472.41Min: 412.13 / Avg: 415.89 / Max: 422.11Min: 356.04 / Avg: 356.38 / Max: 356.93Min: 283.1 / Avg: 283.11 / Max: 283.11Min: 277.85 / Avg: 278.52 / Max: 279.04Min: 275.49 / Avg: 275.53 / Max: 275.59Min: 256.83 / Avg: 257.5 / Max: 258.41Min: 256.02 / Avg: 256.63 / Max: 257.38Min: 253.6 / Avg: 253.63 / Max: 253.66Min: 236.27 / Avg: 236.52 / Max: 236.8Min: 233.59 / Avg: 234.24 / Max: 234.69Min: 232.77 / Avg: 233.63 / Max: 234.17Min: 223.42 / Avg: 224.64 / Max: 225.79Min: 207.41 / Avg: 207.84 / Max: 208.081. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

Xcompact3d Incompact3d

Xcompact3d Incompact3d is a Fortran-MPI based, finite difference high-performance code for solving the incompressible Navier-Stokes equation and as many as you need scalar transport equations. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterXcompact3d Incompact3d 2021-03-11Input: X3D-benchmarking input.i3dEPYC 8534PNEPYC 8534PXeon Platinum 8380EPYC 9754EPYC 9654Xeon Max 9468Xeon Platinum 8490HXeon Max 9480Xeon Platinum 8592+EPYC 9684XXeon Platinum 8380 2PEPYC 9754 2PEPYC 9654 2PXeon Platinum 8490H 2PXeon Max 9468 2PXeon Max 9480 2PXeon Platinum 8592+ 2PEPYC 9684X 2P120240360480600SE +/- 0.22, N = 3SE +/- 0.92, N = 3SE +/- 0.13, N = 3SE +/- 5.39, N = 3SE +/- 4.73, N = 3SE +/- 1.25, N = 3SE +/- 3.88, N = 4SE +/- 0.14, N = 3SE +/- 2.51, N = 3SE +/- 3.06, N = 9SE +/- 1.19, N = 3SE +/- 9.13, N = 9SE +/- 3.26, N = 9SE +/- 0.05, N = 3SE +/- 0.04, N = 3SE +/- 0.01, N = 3SE +/- 0.37, N = 3SE +/- 2.20, N = 12568.25567.29558.38534.06466.55407.59357.01351.64323.25309.85292.03253.32248.87196.81189.69187.22171.38167.131. (F9X) gfortran options: -cpp -O2 -funroll-loops -floop-optimize -fcray-pointer -fbacktrace -lmpi_usempif08 -lmpi_mpifh -lmpi -lopen-rte -lopen-pal -lhwloc -levent_core -levent_pthreads -lm -lz
OpenBenchmarking.orgSeconds, Fewer Is BetterXcompact3d Incompact3d 2021-03-11Input: X3D-benchmarking input.i3dEPYC 8534PNEPYC 8534PXeon Platinum 8380EPYC 9754EPYC 9654Xeon Max 9468Xeon Platinum 8490HXeon Max 9480Xeon Platinum 8592+EPYC 9684XXeon Platinum 8380 2PEPYC 9754 2PEPYC 9654 2PXeon Platinum 8490H 2PXeon Max 9468 2PXeon Max 9480 2PXeon Platinum 8592+ 2PEPYC 9684X 2P100200300400500Min: 567.93 / Avg: 568.25 / Max: 568.68Min: 565.55 / Avg: 567.29 / Max: 568.67Min: 558.18 / Avg: 558.38 / Max: 558.63Min: 523.29 / Avg: 534.06 / Max: 539.85Min: 457.26 / Avg: 466.55 / Max: 472.76Min: 406.25 / Avg: 407.59 / Max: 410.08Min: 352.67 / Avg: 357.01 / Max: 368.65Min: 351.39 / Avg: 351.64 / Max: 351.84Min: 318.23 / Avg: 323.25 / Max: 325.77Min: 288.64 / Avg: 309.85 / Max: 322.97Min: 290.77 / Avg: 292.03 / Max: 294.4Min: 180.49 / Avg: 253.32 / Max: 264.89Min: 223.02 / Avg: 248.87 / Max: 254.3Min: 196.75 / Avg: 196.81 / Max: 196.91Min: 189.62 / Avg: 189.69 / Max: 189.76Min: 187.21 / Avg: 187.22 / Max: 187.23Min: 170.71 / Avg: 171.38 / Max: 171.97Min: 147.46 / Avg: 167.13 / Max: 176.241. (F9X) gfortran options: -cpp -O2 -funroll-loops -floop-optimize -fcray-pointer -fbacktrace -lmpi_usempif08 -lmpi_mpifh -lmpi -lopen-rte -lopen-pal -lhwloc -levent_core -levent_pthreads -lm -lz

High Performance Conjugate Gradient

HPCG is the High Performance Conjugate Gradient and is a new scientific benchmark from Sandia National Lans focused for super-computer testing with modern real-world workloads compared to HPCC. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgGFLOP/s, More Is BetterHigh Performance Conjugate Gradient 3.1X Y Z: 144 144 144 - RT: 60Xeon Platinum 8380EPYC 8534PNEPYC 8534PEPYC 9754Xeon Max 9468EPYC 9684XEPYC 9654Xeon Platinum 8380 2PXeon Max 9480Xeon Platinum 8490HXeon Platinum 8592+EPYC 9754 2PEPYC 9654 2PEPYC 9684X 2PXeon Max 9468 2PXeon Platinum 8490H 2PXeon Max 9480 2PXeon Platinum 8592+ 2P1530456075SE +/- 0.01, N = 3SE +/- 0.02, N = 3SE +/- 0.03, N = 3SE +/- 0.04, N = 3SE +/- 0.08, N = 3SE +/- 0.28, N = 5SE +/- 0.05, N = 3SE +/- 0.34, N = 9SE +/- 0.37, N = 3SE +/- 0.02, N = 3SE +/- 0.08, N = 3SE +/- 0.02, N = 3SE +/- 0.05, N = 3SE +/- 0.51, N = 3SE +/- 0.29, N = 3SE +/- 0.03, N = 3SE +/- 0.07, N = 3SE +/- 0.94, N = 320.4122.1322.2023.6325.2427.5828.3230.1130.5931.0735.1441.8742.5244.9554.4160.8562.6469.301. (CXX) g++ options: -O3 -ffast-math -ftree-vectorize -lmpi_cxx -lmpi
OpenBenchmarking.orgGFLOP/s, More Is BetterHigh Performance Conjugate Gradient 3.1X Y Z: 144 144 144 - RT: 60Xeon Platinum 8380EPYC 8534PNEPYC 8534PEPYC 9754Xeon Max 9468EPYC 9684XEPYC 9654Xeon Platinum 8380 2PXeon Max 9480Xeon Platinum 8490HXeon Platinum 8592+EPYC 9754 2PEPYC 9654 2PEPYC 9684X 2PXeon Max 9468 2PXeon Platinum 8490H 2PXeon Max 9480 2PXeon Platinum 8592+ 2P1326395265Min: 20.39 / Avg: 20.41 / Max: 20.43Min: 22.1 / Avg: 22.13 / Max: 22.17Min: 22.16 / Avg: 22.2 / Max: 22.25Min: 23.55 / Avg: 23.63 / Max: 23.69Min: 25.1 / Avg: 25.24 / Max: 25.39Min: 26.56 / Avg: 27.58 / Max: 28.1Min: 28.27 / Avg: 28.32 / Max: 28.41Min: 29.69 / Avg: 30.11 / Max: 32.77Min: 29.88 / Avg: 30.59 / Max: 31.14Min: 31.05 / Avg: 31.07 / Max: 31.11Min: 34.98 / Avg: 35.14 / Max: 35.22Min: 41.84 / Avg: 41.87 / Max: 41.91Min: 42.42 / Avg: 42.52 / Max: 42.58Min: 44.11 / Avg: 44.95 / Max: 45.87Min: 54.03 / Avg: 54.41 / Max: 54.99Min: 60.81 / Avg: 60.85 / Max: 60.92Min: 62.56 / Avg: 62.64 / Max: 62.77Min: 67.54 / Avg: 69.3 / Max: 70.741. (CXX) g++ options: -O3 -ffast-math -ftree-vectorize -lmpi_cxx -lmpi

Timed LLVM Compilation

This test times how long it takes to compile/build the LLVM compiler stack. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed LLVM Compilation 16.0Build System: NinjaXeon Platinum 8380EPYC 8534PNXeon Max 9468EPYC 8534PXeon Max 9480Xeon Platinum 8380 2PXeon Platinum 8490HXeon 6766EXeon 6780EXeon Platinum 8592+EPYC 9754Xeon 6766E 2PEPYC 9654Xeon Max 9468 2PXeon Max 9480 2PXeon 6780E 2PEPYC 9684XXeon Platinum 8490H 2PXeon Platinum 8592+ 2PEPYC 9754 2PEPYC 9654 2PEPYC 9684X 2P60120180240300SE +/- 1.03, N = 3SE +/- 0.10, N = 3SE +/- 0.19, N = 3SE +/- 0.20, N = 3SE +/- 0.36, N = 3SE +/- 0.37, N = 3SE +/- 0.07, N = 3SE +/- 0.20, N = 3SE +/- 0.06, N = 3SE +/- 0.12, N = 3SE +/- 0.74, N = 3SE +/- 1.52, N = 3SE +/- 0.31, N = 3SE +/- 0.17, N = 3SE +/- 0.79, N = 3SE +/- 0.05, N = 3SE +/- 0.27, N = 3SE +/- 0.15, N = 3SE +/- 0.27, N = 3SE +/- 0.45, N = 3SE +/- 0.08, N = 3SE +/- 0.09, N = 3298.41215.93212.48205.01197.84194.38187.02184.20169.45165.05146.76138.57135.67134.42128.07125.27124.46122.31106.82101.5694.8189.28
OpenBenchmarking.orgSeconds, Fewer Is BetterTimed LLVM Compilation 16.0Build System: NinjaXeon Platinum 8380EPYC 8534PNXeon Max 9468EPYC 8534PXeon Max 9480Xeon Platinum 8380 2PXeon Platinum 8490HXeon 6766EXeon 6780EXeon Platinum 8592+EPYC 9754Xeon 6766E 2PEPYC 9654Xeon Max 9468 2PXeon Max 9480 2PXeon 6780E 2PEPYC 9684XXeon Platinum 8490H 2PXeon Platinum 8592+ 2PEPYC 9754 2PEPYC 9654 2PEPYC 9684X 2P50100150200250Min: 297.11 / Avg: 298.41 / Max: 300.45Min: 215.75 / Avg: 215.93 / Max: 216.08Min: 212.28 / Avg: 212.48 / Max: 212.86Min: 204.72 / Avg: 205.01 / Max: 205.39Min: 197.13 / Avg: 197.84 / Max: 198.28Min: 194 / Avg: 194.38 / Max: 195.12Min: 186.89 / Avg: 187.02 / Max: 187.11Min: 183.87 / Avg: 184.2 / Max: 184.55Min: 169.33 / Avg: 169.45 / Max: 169.54Min: 164.82 / Avg: 165.05 / Max: 165.22Min: 145.31 / Avg: 146.76 / Max: 147.75Min: 135.89 / Avg: 138.57 / Max: 141.15Min: 135.09 / Avg: 135.67 / Max: 136.15Min: 134.13 / Avg: 134.42 / Max: 134.71Min: 126.57 / Avg: 128.07 / Max: 129.25Min: 125.2 / Avg: 125.27 / Max: 125.36Min: 123.96 / Avg: 124.46 / Max: 124.89Min: 122.06 / Avg: 122.31 / Max: 122.58Min: 106.41 / Avg: 106.81 / Max: 107.32Min: 100.66 / Avg: 101.56 / Max: 102.09Min: 94.66 / Avg: 94.81 / Max: 94.91Min: 89.12 / Avg: 89.28 / Max: 89.44

GraphicsMagick

OpenBenchmarking.orgIterations Per Minute, More Is BetterGraphicsMagick 1.3.43Operation: EnhancedXeon Platinum 8380Xeon Max 9468EPYC 8534PNEPYC 8534PXeon Max 9480Xeon Platinum 8380 2PXeon Platinum 8490HXeon Platinum 8592+EPYC 9654Xeon Max 9468 2PXeon 6766EXeon 6780EEPYC 9684XXeon Max 9480 2PEPYC 9754Xeon Platinum 8490H 2PXeon 6766E 2PEPYC 9654 2PXeon Platinum 8592+ 2PXeon 6780E 2PEPYC 9754 2PEPYC 9684X 2P90180270360450SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 1.45, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.33, N = 3SE +/- 2.60, N = 3SE +/- 0.00, N = 3SE +/- 0.33, N = 3SE +/- 0.67, N = 3SE +/- 1.00, N = 3SE +/- 0.33, N = 3SE +/- 0.33, N = 3SE +/- 0.33, N = 3SE +/- 1.20, N = 3SE +/- 1.15, N = 3SE +/- 1.53, N = 3SE +/- 0.33, N = 3SE +/- 0.33, N = 31231601631721812152162282642692702993003013043423503683743894034081. (CC) gcc options: -fopenmp -O2 -ltiff -ljbig -lsharpyuv -lwebp -lwebpmux -lfreetype -ljpeg -lXext -lSM -lICE -lX11 -lxml2 -lzstd -llzma -lbz2 -lz -lm -lpthread -lgomp
OpenBenchmarking.orgIterations Per Minute, More Is BetterGraphicsMagick 1.3.43Operation: EnhancedXeon Platinum 8380Xeon Max 9468EPYC 8534PNEPYC 8534PXeon Max 9480Xeon Platinum 8380 2PXeon Platinum 8490HXeon Platinum 8592+EPYC 9654Xeon Max 9468 2PXeon 6766EXeon 6780EEPYC 9684XXeon Max 9480 2PEPYC 9754Xeon Platinum 8490H 2PXeon 6766E 2PEPYC 9654 2PXeon Platinum 8592+ 2PXeon 6780E 2PEPYC 9754 2PEPYC 9684X 2P70140210280350Min: 123 / Avg: 123 / Max: 123Min: 160 / Avg: 160 / Max: 160Min: 163 / Avg: 163 / Max: 163Min: 172 / Avg: 172 / Max: 172Min: 181 / Avg: 181 / Max: 181Min: 212 / Avg: 214.67 / Max: 217Min: 216 / Avg: 216 / Max: 216Min: 228 / Avg: 228 / Max: 228Min: 264 / Avg: 264.33 / Max: 265Min: 265 / Avg: 269.33 / Max: 274Min: 270 / Avg: 270 / Max: 270Min: 299 / Avg: 299.33 / Max: 300Min: 299 / Avg: 299.67 / Max: 301Min: 299 / Avg: 301 / Max: 302Min: 304 / Avg: 304.33 / Max: 305Min: 342 / Avg: 342.33 / Max: 343Min: 350 / Avg: 350.33 / Max: 351Min: 366 / Avg: 368.33 / Max: 370Min: 372 / Avg: 374 / Max: 376Min: 386 / Avg: 389 / Max: 391Min: 403 / Avg: 403.33 / Max: 404Min: 407 / Avg: 407.67 / Max: 4081. (CC) gcc options: -fopenmp -O2 -ltiff -ljbig -lsharpyuv -lwebp -lwebpmux -lfreetype -ljpeg -lXext -lSM -lICE -lX11 -lxml2 -lzstd -llzma -lbz2 -lz -lm -lpthread -lgomp

OpenFOAM

OpenFOAM is the leading free, open-source software for computational fluid dynamics (CFD). This test profile currently uses the drivaerFastback test case for analyzing automotive aerodynamics or alternatively the older motorBike input. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterOpenFOAM 10Input: drivaerFastback, Small Mesh Size - Execution TimeXeon Platinum 8380EPYC 8534PNEPYC 8534PXeon Max 9468Xeon Platinum 8490HXeon Max 9480Xeon Platinum 8380 2PEPYC 9754Xeon Platinum 8592+EPYC 9654Xeon Max 9468 2PXeon Platinum 8490H 2PEPYC 9684XXeon Max 9480 2PEPYC 9654 2PEPYC 9754 2PXeon Platinum 8592+ 2PEPYC 9684X 2P2040608010074.9659.2758.1745.9542.2241.7540.2933.8133.0732.5928.9928.5628.3327.5825.0124.5723.5622.711. (CXX) g++ options: -std=c++14 -m64 -O3 -ftemplate-depth-100 -fPIC -fuse-ld=bfd -Xlinker --add-needed --no-as-needed -lfiniteVolume -lmeshTools -lparallel -llagrangian -lregionModels -lgenericPatchFields -lOpenFOAM -ldl -lm

ONNX Runtime

ONNX Runtime is developed by Microsoft and partners as a open-source, cross-platform, high performance machine learning inferencing and training accelerator. This test profile runs the ONNX Runtime with various models available from the ONNX Model Zoo. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.17Model: CaffeNet 12-int8 - Device: CPU - Executor: StandardXeon 6766E 2PXeon 6780E 2PEPYC 9754 2PEPYC 9754EPYC 8534PEPYC 9654 2PXeon 6766EEPYC 8534PNEPYC 9684X 2PXeon 6780EXeon Max 9480 2PEPYC 9654Xeon Max 9468 2PEPYC 9684XXeon Platinum 8490H 2PXeon Platinum 8380 2PXeon Max 9480Xeon Max 9468Xeon Platinum 8592+ 2PXeon Platinum 8380Xeon Platinum 8490HXeon Platinum 8592+2004006008001000SE +/- 0.86, N = 3SE +/- 3.37, N = 3SE +/- 2.36, N = 11SE +/- 2.19, N = 3SE +/- 4.84, N = 4SE +/- 4.37, N = 15SE +/- 0.67, N = 3SE +/- 6.13, N = 3SE +/- 7.76, N = 15SE +/- 0.28, N = 3SE +/- 6.21, N = 5SE +/- 9.50, N = 15SE +/- 1.83, N = 3SE +/- 6.60, N = 3SE +/- 6.50, N = 15SE +/- 10.46, N = 15SE +/- 7.34, N = 3SE +/- 12.91, N = 15SE +/- 8.88, N = 3SE +/- 1.66, N = 3SE +/- 11.46, N = 3SE +/- 2.43, N = 3276.24292.79316.11382.10443.06444.85445.62446.69446.81482.21581.77604.05604.76672.92696.98701.72705.61728.47754.81849.56852.33908.191. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt
OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.17Model: CaffeNet 12-int8 - Device: CPU - Executor: StandardXeon 6766E 2PXeon 6780E 2PEPYC 9754 2PEPYC 9754EPYC 8534PEPYC 9654 2PXeon 6766EEPYC 8534PNEPYC 9684X 2PXeon 6780EXeon Max 9480 2PEPYC 9654Xeon Max 9468 2PEPYC 9684XXeon Platinum 8490H 2PXeon Platinum 8380 2PXeon Max 9480Xeon Max 9468Xeon Platinum 8592+ 2PXeon Platinum 8380Xeon Platinum 8490HXeon Platinum 8592+160320480640800Min: 274.87 / Avg: 276.24 / Max: 277.81Min: 286.19 / Avg: 292.79 / Max: 297.26Min: 304.77 / Avg: 316.11 / Max: 329.04Min: 379.47 / Avg: 382.1 / Max: 386.46Min: 432.89 / Avg: 443.06 / Max: 456.21Min: 411.89 / Avg: 444.85 / Max: 478.32Min: 444.45 / Avg: 445.62 / Max: 446.77Min: 434.71 / Avg: 446.69 / Max: 454.94Min: 420.18 / Avg: 446.81 / Max: 503.5Min: 481.65 / Avg: 482.21 / Max: 482.49Min: 561.07 / Avg: 581.77 / Max: 598.93Min: 568.55 / Avg: 604.04 / Max: 666.46Min: 602.3 / Avg: 604.76 / Max: 608.34Min: 659.75 / Avg: 672.92 / Max: 680.24Min: 631.49 / Avg: 696.98 / Max: 720.32Min: 613.58 / Avg: 701.72 / Max: 732.67Min: 696.95 / Avg: 705.61 / Max: 720.19Min: 611.13 / Avg: 728.47 / Max: 762.65Min: 744.33 / Avg: 754.81 / Max: 772.47Min: 846.35 / Avg: 849.56 / Max: 851.92Min: 830.17 / Avg: 852.33 / Max: 868.51Min: 904.5 / Avg: 908.19 / Max: 912.791. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

7-Zip Compression

This is a test of 7-Zip compression/decompression with its integrated benchmark feature. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgMIPS, More Is Better7-Zip Compression 22.01Test: Compression RatingXeon Platinum 8380Xeon Max 9468EPYC 8534PNEPYC 8534PXeon Max 9480Xeon Platinum 8490HXeon Platinum 8380 2PXeon 6766EXeon 6780EXeon Platinum 8592+Xeon Max 9468 2PXeon Max 9480 2PEPYC 9654EPYC 9754EPYC 9684XXeon 6766E 2PXeon Platinum 8490H 2PXeon 6780E 2PXeon Platinum 8592+ 2PEPYC 9684X 2PEPYC 9654 2PEPYC 9754 2P170K340K510K680K850KSE +/- 248.73, N = 3SE +/- 1836.55, N = 3SE +/- 206.69, N = 3SE +/- 268.94, N = 3SE +/- 2258.81, N = 3SE +/- 1535.53, N = 3SE +/- 1785.84, N = 3SE +/- 610.46, N = 3SE +/- 933.46, N = 3SE +/- 1982.97, N = 3SE +/- 5127.15, N = 3SE +/- 3924.87, N = 3SE +/- 719.89, N = 3SE +/- 1188.96, N = 3SE +/- 1520.59, N = 3SE +/- 7384.79, N = 3SE +/- 4200.62, N = 3SE +/- 1102.28, N = 3SE +/- 709.87, N = 3SE +/- 3075.95, N = 3SE +/- 6869.20, N = 3SE +/- 2500.52, N = 32437323147163190943313573423633881903917194138514380484416364917295255145495005754405791125918355927296112006742397413667617347769681. (CXX) g++ options: -lpthread -ldl -O2 -fPIC
OpenBenchmarking.orgMIPS, More Is Better7-Zip Compression 22.01Test: Compression RatingXeon Platinum 8380Xeon Max 9468EPYC 8534PNEPYC 8534PXeon Max 9480Xeon Platinum 8490HXeon Platinum 8380 2PXeon 6766EXeon 6780EXeon Platinum 8592+Xeon Max 9468 2PXeon Max 9480 2PEPYC 9654EPYC 9754EPYC 9684XXeon 6766E 2PXeon Platinum 8490H 2PXeon 6780E 2PXeon Platinum 8592+ 2PEPYC 9684X 2PEPYC 9654 2PEPYC 9754 2P130K260K390K520K650KMin: 243473 / Avg: 243731.67 / Max: 244229Min: 312328 / Avg: 314716 / Max: 318327Min: 318736 / Avg: 319094 / Max: 319452Min: 330821 / Avg: 331357 / Max: 331664Min: 338862 / Avg: 342362.67 / Max: 346586Min: 386105 / Avg: 388189.67 / Max: 391185Min: 388147 / Avg: 391718.67 / Max: 393511Min: 412752 / Avg: 413851.33 / Max: 414861Min: 436358 / Avg: 438048 / Max: 439580Min: 439125 / Avg: 441636 / Max: 445550Min: 484529 / Avg: 491728.67 / Max: 501652Min: 521447 / Avg: 525514 / Max: 533362Min: 548295 / Avg: 549500.33 / Max: 550785Min: 574194 / Avg: 575440 / Max: 577817Min: 577258 / Avg: 579112.33 / Max: 582127Min: 582523 / Avg: 591834.67 / Max: 606419Min: 588274 / Avg: 592729 / Max: 601125Min: 609047 / Avg: 611200 / Max: 612687Min: 673306 / Avg: 674238.67 / Max: 675632Min: 735239 / Avg: 741365.67 / Max: 744911Min: 749974 / Avg: 761734.33 / Max: 773765Min: 772190 / Avg: 776968 / Max: 7806361. (CXX) g++ options: -lpthread -ldl -O2 -fPIC

Parallel BZIP2 Compression

OpenBenchmarking.orgSeconds, Fewer Is BetterParallel BZIP2 Compression 1.1.13FreeBSD-13.0-RELEASE-amd64-memstick.img CompressionXeon Platinum 8380Xeon Max 9468Xeon 6766EEPYC 8534PNXeon Max 9480Xeon 6780EEPYC 8534PXeon Platinum 8380 2PXeon Platinum 8490HXeon Max 9468 2PXeon 6766E 2PXeon Platinum 8592+Xeon 6780E 2PXeon Max 9480 2PXeon Platinum 8490H 2PXeon Platinum 8592+ 2PEPYC 9654EPYC 9684XEPYC 9754EPYC 9654 2PEPYC 9684X 2PEPYC 9754 2P0.76351.5272.29053.0543.8175SE +/- 0.048155, N = 15SE +/- 0.023295, N = 15SE +/- 0.012826, N = 10SE +/- 0.016947, N = 15SE +/- 0.020941, N = 15SE +/- 0.014326, N = 10SE +/- 0.023387, N = 15SE +/- 0.026496, N = 15SE +/- 0.007749, N = 10SE +/- 0.030907, N = 15SE +/- 0.015355, N = 15SE +/- 0.023842, N = 15SE +/- 0.015943, N = 15SE +/- 0.028863, N = 15SE +/- 0.017240, N = 15SE +/- 0.024402, N = 15SE +/- 0.014512, N = 15SE +/- 0.015384, N = 15SE +/- 0.010826, N = 15SE +/- 0.019468, N = 15SE +/- 0.015217, N = 15SE +/- 0.012053, N = 153.3931892.6320772.5046212.3211952.2877662.2799712.2004972.1814552.1448571.9829321.8576421.8475371.7180221.7112961.4692101.4323621.4229541.3690631.3557371.1263291.1094461.0683981. (CXX) g++ options: -O2 -pthread -lbz2 -lpthread
OpenBenchmarking.orgSeconds, Fewer Is BetterParallel BZIP2 Compression 1.1.13FreeBSD-13.0-RELEASE-amd64-memstick.img CompressionXeon Platinum 8380Xeon Max 9468Xeon 6766EEPYC 8534PNXeon Max 9480Xeon 6780EEPYC 8534PXeon Platinum 8380 2PXeon Platinum 8490HXeon Max 9468 2PXeon 6766E 2PXeon Platinum 8592+Xeon 6780E 2PXeon Max 9480 2PXeon Platinum 8490H 2PXeon Platinum 8592+ 2PEPYC 9654EPYC 9684XEPYC 9754EPYC 9654 2PEPYC 9684X 2PEPYC 9754 2P246810Min: 2.92 / Avg: 3.39 / Max: 3.6Min: 2.49 / Avg: 2.63 / Max: 2.87Min: 2.47 / Avg: 2.5 / Max: 2.6Min: 2.18 / Avg: 2.32 / Max: 2.42Min: 2.15 / Avg: 2.29 / Max: 2.4Min: 2.23 / Avg: 2.28 / Max: 2.38Min: 2 / Avg: 2.2 / Max: 2.36Min: 1.98 / Avg: 2.18 / Max: 2.33Min: 2.11 / Avg: 2.14 / Max: 2.2Min: 1.86 / Avg: 1.98 / Max: 2.22Min: 1.75 / Avg: 1.86 / Max: 2.03Min: 1.7 / Avg: 1.85 / Max: 2.11Min: 1.64 / Avg: 1.72 / Max: 1.91Min: 1.55 / Avg: 1.71 / Max: 1.92Min: 1.4 / Avg: 1.47 / Max: 1.67Min: 1.33 / Avg: 1.43 / Max: 1.7Min: 1.34 / Avg: 1.42 / Max: 1.53Min: 1.31 / Avg: 1.37 / Max: 1.55Min: 1.3 / Avg: 1.36 / Max: 1.44Min: 1.02 / Avg: 1.13 / Max: 1.31Min: 1.02 / Avg: 1.11 / Max: 1.23Min: 1 / Avg: 1.07 / Max: 1.171. (CXX) g++ options: -O2 -pthread -lbz2 -lpthread

GPAW

GPAW is a density-functional theory (DFT) Python code based on the projector-augmented wave (PAW) method and the atomic simulation environment (ASE). Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterGPAW 23.6Input: Carbon NanotubeXeon Platinum 8380EPYC 8534PNEPYC 8534PXeon Max 9468Xeon Max 9480Xeon Platinum 8380 2PXeon Platinum 8490HXeon Max 9480 2PXeon Platinum 8592+Xeon Max 9468 2PXeon Platinum 8490H 2PXeon Platinum 8592+ 2PEPYC 9654EPYC 9754EPYC 9684XEPYC 9754 2PEPYC 9654 2PEPYC 9684X 2P20406080100SE +/- 0.12, N = 3SE +/- 0.01, N = 3SE +/- 0.07, N = 3SE +/- 0.03, N = 3SE +/- 0.08, N = 3SE +/- 0.60, N = 3SE +/- 0.24, N = 3SE +/- 0.27, N = 3SE +/- 0.12, N = 3SE +/- 0.08, N = 3SE +/- 0.55, N = 3SE +/- 0.10, N = 3SE +/- 0.21, N = 3SE +/- 0.14, N = 3SE +/- 0.11, N = 3SE +/- 0.18, N = 3SE +/- 0.29, N = 15SE +/- 0.30, N = 1576.1866.7163.8054.3848.4948.4547.7843.9143.0542.8741.5638.0534.8733.1230.0027.1525.8424.131. (CC) gcc options: -shared -lxc -lblas -lmpi
OpenBenchmarking.orgSeconds, Fewer Is BetterGPAW 23.6Input: Carbon NanotubeXeon Platinum 8380EPYC 8534PNEPYC 8534PXeon Max 9468Xeon Max 9480Xeon Platinum 8380 2PXeon Platinum 8490HXeon Max 9480 2PXeon Platinum 8592+Xeon Max 9468 2PXeon Platinum 8490H 2PXeon Platinum 8592+ 2PEPYC 9654EPYC 9754EPYC 9684XEPYC 9754 2PEPYC 9654 2PEPYC 9684X 2P1530456075Min: 75.93 / Avg: 76.17 / Max: 76.34Min: 66.69 / Avg: 66.71 / Max: 66.73Min: 63.66 / Avg: 63.8 / Max: 63.88Min: 54.33 / Avg: 54.38 / Max: 54.43Min: 48.34 / Avg: 48.49 / Max: 48.59Min: 47.69 / Avg: 48.45 / Max: 49.63Min: 47.32 / Avg: 47.78 / Max: 48.11Min: 43.62 / Avg: 43.91 / Max: 44.46Min: 42.84 / Avg: 43.05 / Max: 43.24Min: 42.73 / Avg: 42.87 / Max: 43.02Min: 41.01 / Avg: 41.56 / Max: 42.67Min: 37.88 / Avg: 38.05 / Max: 38.21Min: 34.54 / Avg: 34.87 / Max: 35.27Min: 32.91 / Avg: 33.12 / Max: 33.38Min: 29.88 / Avg: 30 / Max: 30.22Min: 26.79 / Avg: 27.15 / Max: 27.33Min: 24.9 / Avg: 25.84 / Max: 28.04Min: 22.95 / Avg: 24.13 / Max: 26.081. (CC) gcc options: -shared -lxc -lblas -lmpi

ONNX Runtime

ONNX Runtime is developed by Microsoft and partners as a open-source, cross-platform, high performance machine learning inferencing and training accelerator. This test profile runs the ONNX Runtime with various models available from the ONNX Model Zoo. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.17Model: GPT-2 - Device: CPU - Executor: StandardEPYC 9754 2PEPYC 8534PNEPYC 8534PEPYC 9754EPYC 9654 2PXeon 6780E 2PEPYC 9654Xeon Max 9480 2PXeon 6766E 2PXeon 6766EXeon Max 9468 2PXeon 6780EEPYC 9684X 2PEPYC 9684XXeon Max 9480Xeon Max 9468Xeon Platinum 8490H 2PXeon Platinum 8380 2PXeon Platinum 8380Xeon Platinum 8490HXeon Platinum 8592+ 2PXeon Platinum 8592+60120180240300SE +/- 1.43, N = 15SE +/- 0.63, N = 3SE +/- 0.28, N = 3SE +/- 0.15, N = 3SE +/- 0.13, N = 3SE +/- 8.91, N = 15SE +/- 1.37, N = 5SE +/- 1.08, N = 3SE +/- 0.47, N = 3SE +/- 0.47, N = 3SE +/- 0.58, N = 3SE +/- 0.44, N = 3SE +/- 0.46, N = 3SE +/- 0.70, N = 3SE +/- 1.88, N = 3SE +/- 2.01, N = 15SE +/- 1.05, N = 3SE +/- 3.16, N = 15SE +/- 1.97, N = 3SE +/- 1.50, N = 3SE +/- 8.14, N = 15SE +/- 1.19, N = 386.6988.5789.2189.74102.57103.89126.82132.71136.39139.45141.95148.11161.95162.09168.86176.33180.03194.15207.93222.03236.65270.331. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt
OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.17Model: GPT-2 - Device: CPU - Executor: StandardEPYC 9754 2PEPYC 8534PNEPYC 8534PEPYC 9754EPYC 9654 2PXeon 6780E 2PEPYC 9654Xeon Max 9480 2PXeon 6766E 2PXeon 6766EXeon Max 9468 2PXeon 6780EEPYC 9684X 2PEPYC 9684XXeon Max 9480Xeon Max 9468Xeon Platinum 8490H 2PXeon Platinum 8380 2PXeon Platinum 8380Xeon Platinum 8490HXeon Platinum 8592+ 2PXeon Platinum 8592+50100150200250Min: 77.11 / Avg: 86.69 / Max: 92.15Min: 87.67 / Avg: 88.57 / Max: 89.78Min: 88.65 / Avg: 89.21 / Max: 89.56Min: 89.47 / Avg: 89.74 / Max: 89.98Min: 102.33 / Avg: 102.57 / Max: 102.75Min: 75.13 / Avg: 103.89 / Max: 145.77Min: 121.43 / Avg: 126.82 / Max: 129.02Min: 131.45 / Avg: 132.71 / Max: 134.87Min: 135.83 / Avg: 136.39 / Max: 137.32Min: 138.93 / Avg: 139.45 / Max: 140.39Min: 141.15 / Avg: 141.95 / Max: 143.09Min: 147.24 / Avg: 148.11 / Max: 148.59Min: 161.04 / Avg: 161.95 / Max: 162.43Min: 161.32 / Avg: 162.09 / Max: 163.5Min: 165.14 / Avg: 168.86 / Max: 171.13Min: 162.19 / Avg: 176.33 / Max: 187.26Min: 178.44 / Avg: 180.03 / Max: 182Min: 180.29 / Avg: 194.15 / Max: 208.19Min: 204.01 / Avg: 207.93 / Max: 210.16Min: 219.24 / Avg: 222.03 / Max: 224.4Min: 199.33 / Avg: 236.65 / Max: 269.01Min: 267.97 / Avg: 270.33 / Max: 271.721. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

OpenVINO

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPUXeon Platinum 8380Xeon 6766E 2PXeon 6780E 2PEPYC 8534PNXeon Platinum 8592+Xeon 6766EEPYC 8534PXeon 6780EXeon Platinum 8490HXeon Platinum 8592+ 2PEPYC 9754EPYC 9654Xeon Max 9468EPYC 9684XXeon Max 9480Xeon Platinum 8380 2PEPYC 9754 2PEPYC 9654 2PXeon Max 9468 2PXeon Max 9480 2PEPYC 9684X 2PXeon Platinum 8490H 2P40K80K120K160K200KSE +/- 95.54, N = 3SE +/- 1048.23, N = 3SE +/- 1067.91, N = 3SE +/- 55.52, N = 3SE +/- 988.12, N = 3SE +/- 68.06, N = 3SE +/- 86.99, N = 3SE +/- 100.17, N = 3SE +/- 75.30, N = 3SE +/- 1158.60, N = 3SE +/- 89.35, N = 3SE +/- 205.87, N = 3SE +/- 383.22, N = 3SE +/- 162.47, N = 3SE +/- 1761.33, N = 3SE +/- 696.52, N = 3SE +/- 1374.23, N = 9SE +/- 1922.38, N = 15SE +/- 18.38, N = 3SE +/- 1422.88, N = 15SE +/- 1640.61, N = 7SE +/- 2494.14, N = 361956.9375761.5076895.2978334.9281279.7984584.1387511.1191273.02115106.30128566.81132973.43133779.62135075.07138605.52140144.01151627.42166151.42172688.50174862.56176900.32178488.03189893.311. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPUXeon Platinum 8380Xeon 6766E 2PXeon 6780E 2PEPYC 8534PNXeon Platinum 8592+Xeon 6766EEPYC 8534PXeon 6780EXeon Platinum 8490HXeon Platinum 8592+ 2PEPYC 9754EPYC 9654Xeon Max 9468EPYC 9684XXeon Max 9480Xeon Platinum 8380 2PEPYC 9754 2PEPYC 9654 2PXeon Max 9468 2PXeon Max 9480 2PEPYC 9684X 2PXeon Platinum 8490H 2P30K60K90K120K150KMin: 61804.22 / Avg: 61956.93 / Max: 62132.76Min: 73668.58 / Avg: 75761.5 / Max: 76913.28Min: 75662.08 / Avg: 76895.29 / Max: 79022.08Min: 78265.68 / Avg: 78334.92 / Max: 78444.72Min: 79424.55 / Avg: 81279.79 / Max: 82797.06Min: 84467.38 / Avg: 84584.13 / Max: 84703.1Min: 87337.82 / Avg: 87511.11 / Max: 87611.1Min: 91072.95 / Avg: 91273.02 / Max: 91382.06Min: 115010.38 / Avg: 115106.3 / Max: 115254.8Min: 126358.92 / Avg: 128566.81 / Max: 130279.86Min: 132824.34 / Avg: 132973.43 / Max: 133133.3Min: 133368.55 / Avg: 133779.62 / Max: 134005.43Min: 134312.2 / Avg: 135075.07 / Max: 135520.49Min: 138401.16 / Avg: 138605.52 / Max: 138926.49Min: 136639.43 / Avg: 140144.01 / Max: 142204.97Min: 150828.3 / Avg: 151627.42 / Max: 153015.14Min: 162530.5 / Avg: 166151.42 / Max: 175835.15Min: 162383.84 / Avg: 172688.5 / Max: 188618.87Min: 174838.3 / Avg: 174862.56 / Max: 174898.6Min: 168872.14 / Avg: 176900.32 / Max: 183917.68Min: 173708.48 / Avg: 178488.03 / Max: 186134.02Min: 186685.76 / Avg: 189893.31 / Max: 194805.551. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

Liquid-DSP

LiquidSDR's Liquid-DSP is a software-defined radio (SDR) digital signal processing library. This test profile runs a multi-threaded benchmark of this SDR/DSP library focused on embedded platform usage. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgsamples/s, More Is BetterLiquid-DSP 1.6Threads: 128 - Buffer Length: 256 - Filter Length: 57Xeon Platinum 8380Xeon Max 9468EPYC 8534PNXeon Platinum 8380 2PXeon Max 9480EPYC 8534PXeon Platinum 8490HXeon Platinum 8592+Xeon Max 9468 2PXeon 6766E 2PXeon Platinum 8490H 2PXeon 6766EXeon Max 9480 2PXeon 6780E 2PXeon 6780EEPYC 9654EPYC 9654 2PXeon Platinum 8592+ 2PEPYC 9754 2PEPYC 9754EPYC 9684XEPYC 9684X 2P1000M2000M3000M4000M5000MSE +/- 1549551.91, N = 3SE +/- 2030052.00, N = 3SE +/- 6398003.16, N = 3SE +/- 11686221.71, N = 3SE +/- 3119294.79, N = 3SE +/- 3527510.93, N = 3SE +/- 3116800.35, N = 3SE +/- 5260228.13, N = 3SE +/- 25888414.40, N = 3SE +/- 2709448.49, N = 3SE +/- 13655808.69, N = 3SE +/- 6887912.12, N = 3SE +/- 14772609.79, N = 3SE +/- 13354940.83, N = 3SE +/- 1909915.65, N = 3SE +/- 20120967.50, N = 3SE +/- 4098915.85, N = 3SE +/- 51282832.98, N = 4SE +/- 14606429.33, N = 3SE +/- 18691531.06, N = 3SE +/- 6778479.02, N = 3SE +/- 11892621.43, N = 315546666672670033333268706666726890333332972400000298280000031812666673503200000359640000037121333333723666667373630000038965000004068666667413676666742563000004280933333445052500046265666674714500000475533333347593666671. (CC) gcc options: -O3 -pthread -lm -lc -lliquid
OpenBenchmarking.orgsamples/s, More Is BetterLiquid-DSP 1.6Threads: 128 - Buffer Length: 256 - Filter Length: 57Xeon Platinum 8380Xeon Max 9468EPYC 8534PNXeon Platinum 8380 2PXeon Max 9480EPYC 8534PXeon Platinum 8490HXeon Platinum 8592+Xeon Max 9468 2PXeon 6766E 2PXeon Platinum 8490H 2PXeon 6766EXeon Max 9480 2PXeon 6780E 2PXeon 6780EEPYC 9654EPYC 9654 2PXeon Platinum 8592+ 2PEPYC 9754 2PEPYC 9754EPYC 9684XEPYC 9684X 2P800M1600M2400M3200M4000MMin: 1552600000 / Avg: 1554666666.67 / Max: 1557700000Min: 2667300000 / Avg: 2670033333.33 / Max: 2674000000Min: 2677700000 / Avg: 2687066666.67 / Max: 2699300000Min: 2666400000 / Avg: 2689033333.33 / Max: 2705400000Min: 2967100000 / Avg: 2972400000 / Max: 2977900000Min: 2976900000 / Avg: 2982800000 / Max: 2989100000Min: 3175500000 / Avg: 3181266666.67 / Max: 3186200000Min: 3493100000 / Avg: 3503200000 / Max: 3510800000Min: 3565300000 / Avg: 3596400000 / Max: 3647800000Min: 3708800000 / Avg: 3712133333.33 / Max: 3717500000Min: 3702000000 / Avg: 3723666666.67 / Max: 3748900000Min: 3727600000 / Avg: 3736300000 / Max: 3749900000Min: 3878000000 / Avg: 3896500000 / Max: 3925700000Min: 4053600000 / Avg: 4068666666.67 / Max: 4095300000Min: 4134200000 / Avg: 4136766666.67 / Max: 4140500000Min: 4230300000 / Avg: 4256300000 / Max: 4295900000Min: 4273400000 / Avg: 4280933333.33 / Max: 4287500000Min: 4359000000 / Avg: 4450525000 / Max: 4593200000Min: 4603000000 / Avg: 4626566666.67 / Max: 4653300000Min: 4677300000 / Avg: 4714500000 / Max: 4736300000Min: 4742100000 / Avg: 4755333333.33 / Max: 4764500000Min: 4738000000 / Avg: 4759366666.67 / Max: 47791000001. (CC) gcc options: -O3 -pthread -lm -lc -lliquid

Intel Open Image Denoise

Open Image Denoise is a denoising library for ray-tracing and part of the Intel oneAPI rendering toolkit. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgImages / Sec, More Is BetterIntel Open Image Denoise 2.2Run: RT.ldr_alb_nrm.3840x2160 - Device: CPU-OnlyEPYC 8534PNEPYC 8534PXeon Platinum 8380Xeon 6766EXeon 6780EXeon Max 9468Xeon Max 9480EPYC 9684XXeon Platinum 8490HEPYC 9654Xeon 6766E 2PXeon Platinum 8380 2PEPYC 9754Xeon 6780E 2PXeon Platinum 8592+EPYC 9684X 2PXeon Max 9468 2PEPYC 9654 2PEPYC 9754 2PXeon Max 9480 2PXeon Platinum 8490H 2PXeon Platinum 8592+ 2P1.14532.29063.43594.58125.7265SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 4SE +/- 0.00, N = 4SE +/- 0.00, N = 4SE +/- 0.00, N = 4SE +/- 0.02, N = 4SE +/- 0.00, N = 4SE +/- 0.01, N = 4SE +/- 0.01, N = 4SE +/- 0.00, N = 5SE +/- 0.03, N = 6SE +/- 0.00, N = 5SE +/- 0.00, N = 5SE +/- 0.00, N = 5SE +/- 0.02, N = 5SE +/- 0.01, N = 5SE +/- 0.01, N = 5SE +/- 0.02, N = 5SE +/- 0.01, N = 6SE +/- 0.03, N = 61.691.801.811.932.112.272.392.662.712.732.973.103.163.313.323.473.493.493.573.664.485.09
OpenBenchmarking.orgImages / Sec, More Is BetterIntel Open Image Denoise 2.2Run: RT.ldr_alb_nrm.3840x2160 - Device: CPU-OnlyEPYC 8534PNEPYC 8534PXeon Platinum 8380Xeon 6766EXeon 6780EXeon Max 9468Xeon Max 9480EPYC 9684XXeon Platinum 8490HEPYC 9654Xeon 6766E 2PXeon Platinum 8380 2PEPYC 9754Xeon 6780E 2PXeon Platinum 8592+EPYC 9684X 2PXeon Max 9468 2PEPYC 9654 2PEPYC 9754 2PXeon Max 9480 2PXeon Platinum 8490H 2PXeon Platinum 8592+ 2P246810Min: 1.69 / Avg: 1.69 / Max: 1.69Min: 1.8 / Avg: 1.8 / Max: 1.8Min: 1.81 / Avg: 1.81 / Max: 1.82Min: 1.93 / Avg: 1.93 / Max: 1.93Min: 2.11 / Avg: 2.11 / Max: 2.11Min: 2.26 / Avg: 2.27 / Max: 2.27Min: 2.38 / Avg: 2.39 / Max: 2.4Min: 2.64 / Avg: 2.66 / Max: 2.71Min: 2.71 / Avg: 2.71 / Max: 2.71Min: 2.71 / Avg: 2.73 / Max: 2.74Min: 2.95 / Avg: 2.97 / Max: 3.01Min: 3.09 / Avg: 3.1 / Max: 3.11Min: 3.07 / Avg: 3.16 / Max: 3.29Min: 3.3 / Avg: 3.31 / Max: 3.33Min: 3.31 / Avg: 3.32 / Max: 3.32Min: 3.47 / Avg: 3.47 / Max: 3.47Min: 3.47 / Avg: 3.49 / Max: 3.57Min: 3.47 / Avg: 3.49 / Max: 3.5Min: 3.54 / Avg: 3.57 / Max: 3.59Min: 3.61 / Avg: 3.66 / Max: 3.71Min: 4.44 / Avg: 4.48 / Max: 4.51Min: 4.98 / Avg: 5.09 / Max: 5.17

TensorFlow

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.16.1Device: CPU - Batch Size: 512 - Model: AlexNetXeon 6766EXeon 6780EEPYC 8534PNEPYC 8534PXeon Platinum 8380Xeon 6766E 2PXeon Max 9468Xeon 6780E 2PXeon Max 9480Xeon Platinum 8490HEPYC 9654EPYC 9684XXeon Platinum 8380 2PXeon Platinum 8592+Xeon Max 9468 2PEPYC 9754Xeon Max 9480 2PEPYC 9654 2PEPYC 9754 2PEPYC 9684X 2PXeon Platinum 8490H 2PXeon Platinum 8592+ 2P400800120016002000SE +/- 2.03, N = 3SE +/- 0.86, N = 3SE +/- 0.57, N = 3SE +/- 0.35, N = 3SE +/- 1.47, N = 3SE +/- 20.10, N = 12SE +/- 3.89, N = 3SE +/- 38.99, N = 12SE +/- 5.13, N = 3SE +/- 0.51, N = 3SE +/- 0.67, N = 3SE +/- 0.49, N = 3SE +/- 5.91, N = 3SE +/- 1.84, N = 3SE +/- 17.88, N = 4SE +/- 4.07, N = 3SE +/- 8.55, N = 3SE +/- 12.71, N = 3SE +/- 7.97, N = 3SE +/- 23.15, N = 4SE +/- 18.52, N = 3SE +/- 19.23, N = 3677.40732.79796.82875.23883.00979.891047.961064.181108.951278.451363.331392.911470.461486.121604.111620.531677.621862.791876.661897.641899.642039.63
OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.16.1Device: CPU - Batch Size: 512 - Model: AlexNetXeon 6766EXeon 6780EEPYC 8534PNEPYC 8534PXeon Platinum 8380Xeon 6766E 2PXeon Max 9468Xeon 6780E 2PXeon Max 9480Xeon Platinum 8490HEPYC 9654EPYC 9684XXeon Platinum 8380 2PXeon Platinum 8592+Xeon Max 9468 2PEPYC 9754Xeon Max 9480 2PEPYC 9654 2PEPYC 9754 2PEPYC 9684X 2PXeon Platinum 8490H 2PXeon Platinum 8592+ 2P400800120016002000Min: 673.47 / Avg: 677.4 / Max: 680.22Min: 731.39 / Avg: 732.79 / Max: 734.36Min: 795.68 / Avg: 796.82 / Max: 797.52Min: 874.54 / Avg: 875.23 / Max: 875.7Min: 880.22 / Avg: 883 / Max: 885.2Min: 848.85 / Avg: 979.89 / Max: 1054.99Min: 1040.33 / Avg: 1047.96 / Max: 1053.1Min: 719.48 / Avg: 1064.18 / Max: 1158.58Min: 1099.81 / Avg: 1108.95 / Max: 1117.55Min: 1277.58 / Avg: 1278.45 / Max: 1279.36Min: 1362.31 / Avg: 1363.33 / Max: 1364.58Min: 1391.94 / Avg: 1392.91 / Max: 1393.44Min: 1460.24 / Avg: 1470.46 / Max: 1480.7Min: 1482.99 / Avg: 1486.12 / Max: 1489.37Min: 1571.21 / Avg: 1604.11 / Max: 1643.67Min: 1612.67 / Avg: 1620.53 / Max: 1626.28Min: 1660.98 / Avg: 1677.62 / Max: 1689.32Min: 1837.6 / Avg: 1862.79 / Max: 1878.34Min: 1865.56 / Avg: 1876.66 / Max: 1892.13Min: 1860.49 / Avg: 1897.64 / Max: 1963.84Min: 1868.64 / Avg: 1899.64 / Max: 1932.69Min: 2015.57 / Avg: 2039.63 / Max: 2077.65

Intel Open Image Denoise

Open Image Denoise is a denoising library for ray-tracing and part of the Intel oneAPI rendering toolkit. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgImages / Sec, More Is BetterIntel Open Image Denoise 2.2Run: RTLightmap.hdr.4096x4096 - Device: CPU-OnlyEPYC 8534PNXeon Platinum 8380EPYC 8534PXeon 6766EXeon 6780EXeon Max 9468Xeon Max 9480EPYC 9684XXeon Platinum 8490HEPYC 9654Xeon Platinum 8380 2PEPYC 9754Xeon 6766E 2PXeon Platinum 8592+EPYC 9684X 2PEPYC 9654 2PXeon 6780E 2PEPYC 9754 2PXeon Max 9468 2PXeon Max 9480 2PXeon Platinum 8490H 2PXeon Platinum 8592+ 2P0.541.081.622.162.7SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.01, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.02, N = 4SE +/- 0.00, N = 3SE +/- 0.01, N = 3SE +/- 0.00, N = 3SE +/- 0.02, N = 3SE +/- 0.00, N = 3SE +/- 0.02, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 4SE +/- 0.01, N = 40.800.860.860.981.071.081.141.281.291.311.481.501.511.581.641.671.681.711.721.742.182.40
OpenBenchmarking.orgImages / Sec, More Is BetterIntel Open Image Denoise 2.2Run: RTLightmap.hdr.4096x4096 - Device: CPU-OnlyEPYC 8534PNXeon Platinum 8380EPYC 8534PXeon 6766EXeon 6780EXeon Max 9468Xeon Max 9480EPYC 9684XXeon Platinum 8490HEPYC 9654Xeon Platinum 8380 2PEPYC 9754Xeon 6766E 2PXeon Platinum 8592+EPYC 9684X 2PEPYC 9654 2PXeon 6780E 2PEPYC 9754 2PXeon Max 9468 2PXeon Max 9480 2PXeon Platinum 8490H 2PXeon Platinum 8592+ 2P246810Min: 0.8 / Avg: 0.8 / Max: 0.8Min: 0.86 / Avg: 0.86 / Max: 0.87Min: 0.86 / Avg: 0.86 / Max: 0.86Min: 0.97 / Avg: 0.98 / Max: 0.98Min: 1.07 / Avg: 1.07 / Max: 1.07Min: 1.08 / Avg: 1.08 / Max: 1.08Min: 1.14 / Avg: 1.14 / Max: 1.14Min: 1.26 / Avg: 1.28 / Max: 1.3Min: 1.29 / Avg: 1.29 / Max: 1.29Min: 1.3 / Avg: 1.31 / Max: 1.32Min: 1.48 / Avg: 1.48 / Max: 1.49Min: 1.49 / Avg: 1.5 / Max: 1.5Min: 1.46 / Avg: 1.51 / Max: 1.53Min: 1.57 / Avg: 1.58 / Max: 1.58Min: 1.63 / Avg: 1.64 / Max: 1.64Min: 1.67 / Avg: 1.67 / Max: 1.67Min: 1.64 / Avg: 1.68 / Max: 1.73Min: 1.7 / Avg: 1.71 / Max: 1.71Min: 1.69 / Avg: 1.72 / Max: 1.75Min: 1.72 / Avg: 1.74 / Max: 1.77Min: 2.17 / Avg: 2.18 / Max: 2.2Min: 2.36 / Avg: 2.4 / Max: 2.43

Liquid-DSP

LiquidSDR's Liquid-DSP is a software-defined radio (SDR) digital signal processing library. This test profile runs a multi-threaded benchmark of this SDR/DSP library focused on embedded platform usage. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgsamples/s, More Is BetterLiquid-DSP 1.6Threads: 1 - Buffer Length: 256 - Filter Length: 512Xeon 6766E 2PXeon 6766EXeon 6780E 2PXeon 6780EEPYC 9754EPYC 8534PNEPYC 9754 2PEPYC 8534PEPYC 9684X 2PEPYC 9684XEPYC 9654 2PEPYC 9654Xeon Platinum 8380 2PXeon Platinum 8380Xeon Platinum 8490H 2PXeon Platinum 8490HXeon Max 9480 2PXeon Max 9480Xeon Max 9468 2PXeon Max 9468Xeon Platinum 8592+ 2PXeon Platinum 8592+4M8M12M16M20MSE +/- 33.33, N = 3SE +/- 115.47, N = 3SE +/- 133.33, N = 3SE +/- 88.19, N = 3SE +/- 120841.84, N = 4SE +/- 31571.79, N = 3SE +/- 11050.39, N = 3SE +/- 3464.10, N = 3SE +/- 234395.65, N = 15SE +/- 134727.30, N = 3SE +/- 124115.99, N = 3SE +/- 121304.48, N = 3SE +/- 11150.49, N = 3SE +/- 18478.22, N = 3SE +/- 38670.98, N = 3SE +/- 8685.88, N = 3SE +/- 7571.88, N = 3SE +/- 30179.10, N = 3SE +/- 17457.89, N = 3SE +/- 5238.74, N = 3SE +/- 162096.41, N = 15SE +/- 9492.69, N = 362807676284300696996769839331117450011236333112736671129000013083133133873331339066713394667135990001360833316843333168823331688400016885333169046671690633318200533187743331. (CC) gcc options: -O3 -pthread -lm -lc -lliquid
OpenBenchmarking.orgsamples/s, More Is BetterLiquid-DSP 1.6Threads: 1 - Buffer Length: 256 - Filter Length: 512Xeon 6766E 2PXeon 6766EXeon 6780E 2PXeon 6780EEPYC 9754EPYC 8534PNEPYC 9754 2PEPYC 8534PEPYC 9684X 2PEPYC 9684XEPYC 9654 2PEPYC 9654Xeon Platinum 8380 2PXeon Platinum 8380Xeon Platinum 8490H 2PXeon Platinum 8490HXeon Max 9480 2PXeon Max 9480Xeon Max 9468 2PXeon Max 9468Xeon Platinum 8592+ 2PXeon Platinum 8592+3M6M9M12M15MMin: 6280700 / Avg: 6280766.67 / Max: 6280800Min: 6284100 / Avg: 6284300 / Max: 6284500Min: 6969700 / Avg: 6969966.67 / Max: 6970100Min: 6983800 / Avg: 6983933.33 / Max: 6984100Min: 10812000 / Avg: 11174500 / Max: 11299000Min: 11175000 / Avg: 11236333.33 / Max: 11280000Min: 11258000 / Avg: 11273666.67 / Max: 11295000Min: 11284000 / Avg: 11290000 / Max: 11296000Min: 10884000 / Avg: 13083133.33 / Max: 13531000Min: 13118000 / Avg: 13387333.33 / Max: 13529000Min: 13143000 / Avg: 13390666.67 / Max: 13529000Min: 13153000 / Avg: 13394666.67 / Max: 13534000Min: 13582000 / Avg: 13599000 / Max: 13620000Min: 13586000 / Avg: 13608333.33 / Max: 13645000Min: 16766000 / Avg: 16843333.33 / Max: 16883000Min: 16868000 / Avg: 16882333.33 / Max: 16898000Min: 16870000 / Avg: 16884000 / Max: 16896000Min: 16825000 / Avg: 16885333.33 / Max: 16917000Min: 16879000 / Avg: 16904666.67 / Max: 16938000Min: 16896000 / Avg: 16906333.33 / Max: 16913000Min: 17032000 / Avg: 18200533.33 / Max: 19386000Min: 18762000 / Avg: 18774333.33 / Max: 187930001. (CC) gcc options: -O3 -pthread -lm -lc -lliquid

Intel Open Image Denoise

Open Image Denoise is a denoising library for ray-tracing and part of the Intel oneAPI rendering toolkit. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgImages / Sec, More Is BetterIntel Open Image Denoise 2.2Run: RT.hdr_alb_nrm.3840x2160 - Device: CPU-OnlyEPYC 8534PNEPYC 8534PXeon Platinum 8380Xeon 6766EXeon 6780EXeon Max 9468Xeon Max 9480EPYC 9684XXeon Platinum 8490HEPYC 9654Xeon 6766E 2PXeon Platinum 8380 2PEPYC 9754Xeon Platinum 8592+Xeon 6780E 2PEPYC 9684X 2PEPYC 9654 2PXeon Max 9468 2PEPYC 9754 2PXeon Max 9480 2PXeon Platinum 8490H 2PXeon Platinum 8592+ 2P1.13182.26363.39544.52725.659SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 4SE +/- 0.00, N = 4SE +/- 0.00, N = 4SE +/- 0.00, N = 4SE +/- 0.00, N = 4SE +/- 0.00, N = 4SE +/- 0.01, N = 4SE +/- 0.00, N = 4SE +/- 0.01, N = 5SE +/- 0.02, N = 5SE +/- 0.00, N = 5SE +/- 0.03, N = 5SE +/- 0.00, N = 5SE +/- 0.01, N = 5SE +/- 0.01, N = 5SE +/- 0.01, N = 5SE +/- 0.04, N = 5SE +/- 0.03, N = 6SE +/- 0.03, N = 61.691.791.811.932.112.262.382.642.712.732.983.083.123.313.313.453.483.513.593.654.415.03
OpenBenchmarking.orgImages / Sec, More Is BetterIntel Open Image Denoise 2.2Run: RT.hdr_alb_nrm.3840x2160 - Device: CPU-OnlyEPYC 8534PNEPYC 8534PXeon Platinum 8380Xeon 6766EXeon 6780EXeon Max 9468Xeon Max 9480EPYC 9684XXeon Platinum 8490HEPYC 9654Xeon 6766E 2PXeon Platinum 8380 2PEPYC 9754Xeon Platinum 8592+Xeon 6780E 2PEPYC 9684X 2PEPYC 9654 2PXeon Max 9468 2PEPYC 9754 2PXeon Max 9480 2PXeon Platinum 8490H 2PXeon Platinum 8592+ 2P246810Min: 1.69 / Avg: 1.69 / Max: 1.69Min: 1.79 / Avg: 1.79 / Max: 1.79Min: 1.81 / Avg: 1.81 / Max: 1.81Min: 1.93 / Avg: 1.93 / Max: 1.93Min: 2.11 / Avg: 2.11 / Max: 2.11Min: 2.26 / Avg: 2.26 / Max: 2.26Min: 2.37 / Avg: 2.38 / Max: 2.38Min: 2.63 / Avg: 2.64 / Max: 2.65Min: 2.71 / Avg: 2.71 / Max: 2.71Min: 2.69 / Avg: 2.73 / Max: 2.76Min: 2.97 / Avg: 2.98 / Max: 2.99Min: 3.05 / Avg: 3.08 / Max: 3.1Min: 3.08 / Avg: 3.12 / Max: 3.21Min: 3.3 / Avg: 3.31 / Max: 3.31Min: 3.22 / Avg: 3.31 / Max: 3.37Min: 3.44 / Avg: 3.45 / Max: 3.46Min: 3.47 / Avg: 3.48 / Max: 3.5Min: 3.48 / Avg: 3.51 / Max: 3.55Min: 3.55 / Avg: 3.59 / Max: 3.61Min: 3.5 / Avg: 3.65 / Max: 3.72Min: 4.31 / Avg: 4.41 / Max: 4.47Min: 4.94 / Avg: 5.03 / Max: 5.1

ONNX Runtime

ONNX Runtime is developed by Microsoft and partners as a open-source, cross-platform, high performance machine learning inferencing and training accelerator. This test profile runs the ONNX Runtime with various models available from the ONNX Model Zoo. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.17Model: bertsquad-12 - Device: CPU - Executor: ParallelXeon 6766E 2PXeon 6780E 2PEPYC 9754 2PXeon 6766EEPYC 9684X 2PEPYC 9654 2PEPYC 8534PNXeon 6780EEPYC 9754EPYC 8534PEPYC 9654EPYC 9684XXeon Max 9480 2PXeon Max 9468 2PXeon Platinum 8490H 2PXeon Platinum 8380 2PXeon Platinum 8592+ 2PXeon Max 9480Xeon Platinum 8490HXeon Max 9468Xeon Platinum 8380Xeon Platinum 8592+510152025SE +/- 0.03979, N = 3SE +/- 0.01071, N = 3SE +/- 0.01907, N = 3SE +/- 0.00728, N = 3SE +/- 0.04604, N = 3SE +/- 0.05052, N = 3SE +/- 0.10146, N = 4SE +/- 0.02804, N = 3SE +/- 0.05587, N = 3SE +/- 0.10485, N = 3SE +/- 0.09004, N = 3SE +/- 0.08493, N = 3SE +/- 0.04124, N = 3SE +/- 0.09371, N = 3SE +/- 0.02421, N = 3SE +/- 0.12404, N = 3SE +/- 0.02832, N = 3SE +/- 0.07567, N = 3SE +/- 0.04566, N = 3SE +/- 0.06023, N = 3SE +/- 0.13407, N = 3SE +/- 0.21736, N = 36.667187.139177.984028.572868.759718.809308.871449.503539.652969.8009012.2549012.2807013.5190013.7366014.5280014.9460015.4341015.7394016.0956016.3251016.6863019.677301. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt
OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.17Model: bertsquad-12 - Device: CPU - Executor: ParallelXeon 6766E 2PXeon 6780E 2PEPYC 9754 2PXeon 6766EEPYC 9684X 2PEPYC 9654 2PEPYC 8534PNXeon 6780EEPYC 9754EPYC 8534PEPYC 9654EPYC 9684XXeon Max 9480 2PXeon Max 9468 2PXeon Platinum 8490H 2PXeon Platinum 8380 2PXeon Platinum 8592+ 2PXeon Max 9480Xeon Platinum 8490HXeon Max 9468Xeon Platinum 8380Xeon Platinum 8592+510152025Min: 6.59 / Avg: 6.67 / Max: 6.73Min: 7.12 / Avg: 7.14 / Max: 7.15Min: 7.95 / Avg: 7.98 / Max: 8.01Min: 8.56 / Avg: 8.57 / Max: 8.59Min: 8.67 / Avg: 8.76 / Max: 8.81Min: 8.71 / Avg: 8.81 / Max: 8.88Min: 8.64 / Avg: 8.87 / Max: 9.1Min: 9.47 / Avg: 9.5 / Max: 9.56Min: 9.55 / Avg: 9.65 / Max: 9.74Min: 9.65 / Avg: 9.8 / Max: 10Min: 12.07 / Avg: 12.25 / Max: 12.35Min: 12.11 / Avg: 12.28 / Max: 12.37Min: 13.45 / Avg: 13.52 / Max: 13.59Min: 13.55 / Avg: 13.74 / Max: 13.85Min: 14.5 / Avg: 14.53 / Max: 14.58Min: 14.71 / Avg: 14.95 / Max: 15.13Min: 15.38 / Avg: 15.43 / Max: 15.47Min: 15.61 / Avg: 15.74 / Max: 15.87Min: 16 / Avg: 16.1 / Max: 16.15Min: 16.23 / Avg: 16.33 / Max: 16.44Min: 16.42 / Avg: 16.69 / Max: 16.85Min: 19.24 / Avg: 19.68 / Max: 19.91. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

LAMMPS Molecular Dynamics Simulator

LAMMPS is a classical molecular dynamics code, and an acronym for Large-scale Atomic/Molecular Massively Parallel Simulator. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgns/day, More Is BetterLAMMPS Molecular Dynamics Simulator 23Jun2022Model: 20k AtomsXeon Platinum 8380EPYC 8534PNEPYC 8534PXeon Max 9468Xeon Max 9480Xeon Platinum 8490HXeon Platinum 8380 2PXeon Platinum 8592+EPYC 9654Xeon Max 9468 2PEPYC 9684XEPYC 9754Xeon Platinum 8490H 2PXeon Max 9480 2PXeon Platinum 8592+ 2PEPYC 9654 2PEPYC 9754 2PEPYC 9684X 2P1428425670SE +/- 0.04, N = 3SE +/- 0.02, N = 3SE +/- 0.02, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.04, N = 3SE +/- 0.03, N = 3SE +/- 0.02, N = 3SE +/- 0.12, N = 3SE +/- 0.07, N = 3SE +/- 0.30, N = 3SE +/- 0.19, N = 3SE +/- 0.01, N = 3SE +/- 0.05, N = 3SE +/- 0.04, N = 3SE +/- 0.13, N = 3SE +/- 0.13, N = 3SE +/- 0.12, N = 321.3825.3327.5328.2832.1634.8935.7037.4642.5146.7146.8947.9950.5251.8256.4057.1058.8462.001. (CXX) g++ options: -O3 -lm -ldl
OpenBenchmarking.orgns/day, More Is BetterLAMMPS Molecular Dynamics Simulator 23Jun2022Model: 20k AtomsXeon Platinum 8380EPYC 8534PNEPYC 8534PXeon Max 9468Xeon Max 9480Xeon Platinum 8490HXeon Platinum 8380 2PXeon Platinum 8592+EPYC 9654Xeon Max 9468 2PEPYC 9684XEPYC 9754Xeon Platinum 8490H 2PXeon Max 9480 2PXeon Platinum 8592+ 2PEPYC 9654 2PEPYC 9754 2PEPYC 9684X 2P1224364860Min: 21.32 / Avg: 21.38 / Max: 21.45Min: 25.29 / Avg: 25.33 / Max: 25.36Min: 27.5 / Avg: 27.53 / Max: 27.57Min: 28.26 / Avg: 28.28 / Max: 28.29Min: 32.15 / Avg: 32.16 / Max: 32.17Min: 34.81 / Avg: 34.89 / Max: 34.94Min: 35.65 / Avg: 35.7 / Max: 35.76Min: 37.42 / Avg: 37.46 / Max: 37.49Min: 42.26 / Avg: 42.51 / Max: 42.63Min: 46.61 / Avg: 46.71 / Max: 46.84Min: 46.3 / Avg: 46.89 / Max: 47.27Min: 47.71 / Avg: 47.99 / Max: 48.35Min: 50.5 / Avg: 50.52 / Max: 50.54Min: 51.72 / Avg: 51.82 / Max: 51.89Min: 56.35 / Avg: 56.4 / Max: 56.48Min: 56.91 / Avg: 57.1 / Max: 57.36Min: 58.61 / Avg: 58.84 / Max: 59.04Min: 61.77 / Avg: 62 / Max: 62.171. (CXX) g++ options: -O3 -lm -ldl

LuxCoreRender

LuxCoreRender is an open-source 3D physically based renderer formerly known as LuxRender. LuxCoreRender supports CPU-based rendering as well as GPU acceleration via OpenCL, NVIDIA CUDA, and NVIDIA OptiX interfaces. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgM samples/sec, More Is BetterLuxCoreRender 2.6Scene: LuxCore Benchmark - Acceleration: CPUXeon Platinum 8380Xeon Max 9468Xeon 6766E 2PXeon Platinum 8380 2PXeon 6780E 2PXeon Max 9468 2PXeon Max 9480EPYC 8534PNXeon Platinum 8490HEPYC 8534PXeon Max 9480 2PXeon 6766EXeon Platinum 8592+Xeon 6780EXeon Platinum 8490H 2PXeon Platinum 8592+ 2PEPYC 9754 2PEPYC 9654 2PEPYC 9684X 2PEPYC 9654EPYC 9754EPYC 9684X3691215SE +/- 0.06, N = 15SE +/- 0.03, N = 3SE +/- 0.10, N = 15SE +/- 0.07, N = 15SE +/- 0.08, N = 15SE +/- 0.22, N = 12SE +/- 0.05, N = 3SE +/- 0.02, N = 3SE +/- 0.04, N = 3SE +/- 0.02, N = 3SE +/- 0.16, N = 15SE +/- 0.06, N = 3SE +/- 0.11, N = 3SE +/- 0.06, N = 3SE +/- 0.12, N = 3SE +/- 0.17, N = 12SE +/- 0.08, N = 15SE +/- 0.11, N = 15SE +/- 0.12, N = 15SE +/- 0.10, N = 7SE +/- 0.16, N = 3SE +/- 0.04, N = 34.296.306.416.436.746.816.826.937.107.387.417.908.068.478.828.889.6510.5610.6111.3412.4112.43
OpenBenchmarking.orgM samples/sec, More Is BetterLuxCoreRender 2.6Scene: LuxCore Benchmark - Acceleration: CPUXeon Platinum 8380Xeon Max 9468Xeon 6766E 2PXeon Platinum 8380 2PXeon 6780E 2PXeon Max 9468 2PXeon Max 9480EPYC 8534PNXeon Platinum 8490HEPYC 8534PXeon Max 9480 2PXeon 6766EXeon Platinum 8592+Xeon 6780EXeon Platinum 8490H 2PXeon Platinum 8592+ 2PEPYC 9754 2PEPYC 9654 2PEPYC 9684X 2PEPYC 9654EPYC 9754EPYC 9684X48121620Min: 4 / Avg: 4.29 / Max: 4.68Min: 6.25 / Avg: 6.3 / Max: 6.34Min: 5.98 / Avg: 6.41 / Max: 7.19Min: 5.81 / Avg: 6.43 / Max: 6.7Min: 6.25 / Avg: 6.74 / Max: 7.49Min: 6.05 / Avg: 6.81 / Max: 7.91Min: 6.74 / Avg: 6.82 / Max: 6.91Min: 6.89 / Avg: 6.93 / Max: 6.96Min: 7.04 / Avg: 7.1 / Max: 7.17Min: 7.34 / Avg: 7.38 / Max: 7.42Min: 6.33 / Avg: 7.41 / Max: 8.21Min: 7.83 / Avg: 7.9 / Max: 8.01Min: 7.95 / Avg: 8.06 / Max: 8.28Min: 8.39 / Avg: 8.47 / Max: 8.58Min: 8.61 / Avg: 8.82 / Max: 9.04Min: 8.28 / Avg: 8.88 / Max: 10.13Min: 9.11 / Avg: 9.65 / Max: 10.25Min: 9.78 / Avg: 10.56 / Max: 11.32Min: 9.81 / Avg: 10.61 / Max: 11.25Min: 11.04 / Avg: 11.34 / Max: 11.83Min: 12.09 / Avg: 12.41 / Max: 12.57Min: 12.38 / Avg: 12.43 / Max: 12.5

TensorFlow

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.16.1Device: CPU - Batch Size: 256 - Model: AlexNetXeon 6766EXeon 6780EEPYC 8534PNEPYC 8534PXeon Platinum 8380Xeon 6766E 2PXeon Max 9468Xeon 6780E 2PXeon Max 9480Xeon Platinum 8490HXeon Platinum 8592+EPYC 9654EPYC 9684XXeon Platinum 8380 2PEPYC 9754 2PEPYC 9754Xeon Max 9468 2PEPYC 9654 2PXeon Max 9480 2PEPYC 9684X 2PXeon Platinum 8592+ 2PXeon Platinum 8490H 2P400800120016002000SE +/- 1.03, N = 3SE +/- 2.12, N = 3SE +/- 0.41, N = 3SE +/- 0.99, N = 3SE +/- 1.28, N = 3SE +/- 19.06, N = 15SE +/- 1.21, N = 3SE +/- 10.51, N = 4SE +/- 6.82, N = 3SE +/- 0.54, N = 3SE +/- 4.27, N = 3SE +/- 2.58, N = 3SE +/- 1.54, N = 3SE +/- 3.03, N = 3SE +/- 10.23, N = 15SE +/- 4.01, N = 3SE +/- 1.15, N = 3SE +/- 6.01, N = 3SE +/- 5.81, N = 3SE +/- 15.82, N = 3SE +/- 1.86, N = 3SE +/- 5.06, N = 3609.67668.33771.47843.63852.14857.20986.041010.931058.991205.301277.461278.581301.261340.341403.461454.711479.531524.741528.411560.561681.441730.25
OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.16.1Device: CPU - Batch Size: 256 - Model: AlexNetXeon 6766EXeon 6780EEPYC 8534PNEPYC 8534PXeon Platinum 8380Xeon 6766E 2PXeon Max 9468Xeon 6780E 2PXeon Max 9480Xeon Platinum 8490HXeon Platinum 8592+EPYC 9654EPYC 9684XXeon Platinum 8380 2PEPYC 9754 2PEPYC 9754Xeon Max 9468 2PEPYC 9654 2PXeon Max 9480 2PEPYC 9684X 2PXeon Platinum 8592+ 2PXeon Platinum 8490H 2P30060090012001500Min: 607.67 / Avg: 609.67 / Max: 611.09Min: 665.64 / Avg: 668.33 / Max: 672.52Min: 770.76 / Avg: 771.47 / Max: 772.19Min: 841.76 / Avg: 843.63 / Max: 845.14Min: 850.49 / Avg: 852.14 / Max: 854.66Min: 735.62 / Avg: 857.2 / Max: 942.32Min: 983.65 / Avg: 986.04 / Max: 987.58Min: 981.26 / Avg: 1010.93 / Max: 1027.39Min: 1046.92 / Avg: 1058.99 / Max: 1070.53Min: 1204.31 / Avg: 1205.3 / Max: 1206.15Min: 1270.92 / Avg: 1277.46 / Max: 1285.48Min: 1273.44 / Avg: 1278.58 / Max: 1281.51Min: 1298.66 / Avg: 1301.26 / Max: 1303.99Min: 1336.15 / Avg: 1340.34 / Max: 1346.22Min: 1348.73 / Avg: 1403.46 / Max: 1480.41Min: 1449.72 / Avg: 1454.71 / Max: 1462.64Min: 1477.32 / Avg: 1479.53 / Max: 1481.18Min: 1513.89 / Avg: 1524.74 / Max: 1534.65Min: 1517.02 / Avg: 1528.41 / Max: 1536.13Min: 1536.03 / Avg: 1560.56 / Max: 1590.14Min: 1678.14 / Avg: 1681.44 / Max: 1684.59Min: 1720.58 / Avg: 1730.25 / Max: 1737.65

Liquid-DSP

LiquidSDR's Liquid-DSP is a software-defined radio (SDR) digital signal processing library. This test profile runs a multi-threaded benchmark of this SDR/DSP library focused on embedded platform usage. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgsamples/s, More Is BetterLiquid-DSP 1.6Threads: 128 - Buffer Length: 256 - Filter Length: 512Xeon Platinum 8380Xeon 6766E 2PXeon 6766EEPYC 8534PNXeon 6780E 2PXeon 6780EXeon Max 9468EPYC 8534PXeon Max 9480Xeon Platinum 8490HXeon Platinum 8380 2PXeon Max 9468 2PXeon Platinum 8490H 2PXeon Platinum 8592+EPYC 9654EPYC 9654 2PXeon Max 9480 2PEPYC 9754 2PEPYC 9684XEPYC 9754EPYC 9684X 2PXeon Platinum 8592+ 2P300M600M900M1200M1500MSE +/- 912164.70, N = 3SE +/- 1072572.19, N = 3SE +/- 305632.31, N = 3SE +/- 431058.13, N = 3SE +/- 866544.86, N = 3SE +/- 287923.60, N = 3SE +/- 681281.47, N = 3SE +/- 390953.25, N = 3SE +/- 1345523.44, N = 3SE +/- 1740596.96, N = 3SE +/- 8061118.62, N = 3SE +/- 11560043.25, N = 5SE +/- 6842108.19, N = 3SE +/- 2313246.88, N = 3SE +/- 1047748.91, N = 3SE +/- 2338327.99, N = 3SE +/- 2123152.79, N = 3SE +/- 503322.30, N = 3SE +/- 2412697.89, N = 3SE +/- 814452.78, N = 3SE +/- 3901424.24, N = 3SE +/- 4790383.89, N = 3539226667707053333719626667731756667777940000796340000800186667809916667882200000918566667981090000109146000011264666671152933333115816666711999666671206066667134980000013687333331369800000139473333314938333331. (CC) gcc options: -O3 -pthread -lm -lc -lliquid
OpenBenchmarking.orgsamples/s, More Is BetterLiquid-DSP 1.6Threads: 128 - Buffer Length: 256 - Filter Length: 512Xeon Platinum 8380Xeon 6766E 2PXeon 6766EEPYC 8534PNXeon 6780E 2PXeon 6780EXeon Max 9468EPYC 8534PXeon Max 9480Xeon Platinum 8490HXeon Platinum 8380 2PXeon Max 9468 2PXeon Platinum 8490H 2PXeon Platinum 8592+EPYC 9654EPYC 9654 2PXeon Max 9480 2PEPYC 9754 2PEPYC 9684XEPYC 9754EPYC 9684X 2PXeon Platinum 8592+ 2P300M600M900M1200M1500MMin: 538040000 / Avg: 539226666.67 / Max: 541020000Min: 705820000 / Avg: 707053333.33 / Max: 709190000Min: 719240000 / Avg: 719626666.67 / Max: 720230000Min: 731040000 / Avg: 731756666.67 / Max: 732530000Min: 776410000 / Avg: 777940000 / Max: 779410000Min: 795880000 / Avg: 796340000 / Max: 796870000Min: 799130000 / Avg: 800186666.67 / Max: 801460000Min: 809190000 / Avg: 809916666.67 / Max: 810530000Min: 880040000 / Avg: 882200000 / Max: 884670000Min: 916530000 / Avg: 918566666.67 / Max: 922030000Min: 965240000 / Avg: 981090000 / Max: 991570000Min: 1052100000 / Avg: 1091460000 / Max: 1118000000Min: 1112900000 / Avg: 1126466666.67 / Max: 1134800000Min: 1148800000 / Avg: 1152933333.33 / Max: 1156800000Min: 1156100000 / Avg: 1158166666.67 / Max: 1159500000Min: 1195500000 / Avg: 1199966666.67 / Max: 1203400000Min: 1202900000 / Avg: 1206066666.67 / Max: 1210100000Min: 1348800000 / Avg: 1349800000 / Max: 1350400000Min: 1365100000 / Avg: 1368733333.33 / Max: 1373300000Min: 1368500000 / Avg: 1369800000 / Max: 1371300000Min: 1389300000 / Avg: 1394733333.33 / Max: 1402300000Min: 1488600000 / Avg: 1493833333.33 / Max: 15034000001. (CC) gcc options: -O3 -pthread -lm -lc -lliquid

CloverLeaf

CloverLeaf is a Lagrangian-Eulerian hydrodynamics benchmark. This test profile currently makes use of CloverLeaf's OpenMP version. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterCloverLeaf 1.3Input: clover_bm64_shortXeon Platinum 8380EPYC 8534PNEPYC 8534PEPYC 9754EPYC 9654Xeon Max 9480EPYC 9684XXeon Max 9468Xeon Platinum 8490HXeon Platinum 8592+Xeon 6780EXeon 6766EXeon Platinum 8380 2PXeon Max 9480 2PXeon Max 9468 2PXeon Platinum 8592+ 2PEPYC 9654 2PXeon 6766E 2PXeon 6780E 2PEPYC 9754 2PXeon Platinum 8490H 2PEPYC 9684X 2P1428425670SE +/- 0.03, N = 3SE +/- 0.04, N = 3SE +/- 0.04, N = 3SE +/- 2.07, N = 12SE +/- 2.15, N = 15SE +/- 0.17, N = 3SE +/- 1.81, N = 15SE +/- 0.15, N = 3SE +/- 0.02, N = 3SE +/- 0.03, N = 3SE +/- 0.04, N = 3SE +/- 0.03, N = 3SE +/- 0.31, N = 3SE +/- 0.40, N = 4SE +/- 0.31, N = 15SE +/- 0.45, N = 3SE +/- 1.11, N = 12SE +/- 0.33, N = 3SE +/- 0.33, N = 3SE +/- 0.30, N = 3SE +/- 0.24, N = 3SE +/- 0.23, N = 360.8957.5457.3848.3646.5042.2242.1741.4339.4839.3838.0138.0135.2932.4432.2531.9030.0528.9928.9227.7426.5822.831. (F9X) gfortran options: -O3 -march=native -funroll-loops -fopenmp
OpenBenchmarking.orgSeconds, Fewer Is BetterCloverLeaf 1.3Input: clover_bm64_shortXeon Platinum 8380EPYC 8534PNEPYC 8534PEPYC 9754EPYC 9654Xeon Max 9480EPYC 9684XXeon Max 9468Xeon Platinum 8490HXeon Platinum 8592+Xeon 6780EXeon 6766EXeon Platinum 8380 2PXeon Max 9480 2PXeon Max 9468 2PXeon Platinum 8592+ 2PEPYC 9654 2PXeon 6766E 2PXeon 6780E 2PEPYC 9754 2PXeon Platinum 8490H 2PEPYC 9684X 2P1224364860Min: 60.83 / Avg: 60.89 / Max: 60.93Min: 57.46 / Avg: 57.54 / Max: 57.62Min: 57.33 / Avg: 57.38 / Max: 57.45Min: 28.75 / Avg: 48.36 / Max: 54.21Min: 27.6 / Avg: 46.5 / Max: 53.92Min: 41.95 / Avg: 42.22 / Max: 42.54Min: 26.4 / Avg: 42.17 / Max: 50.13Min: 41.15 / Avg: 41.43 / Max: 41.66Min: 39.45 / Avg: 39.48 / Max: 39.52Min: 39.35 / Avg: 39.38 / Max: 39.44Min: 37.95 / Avg: 38.01 / Max: 38.1Min: 37.98 / Avg: 38.01 / Max: 38.06Min: 34.82 / Avg: 35.29 / Max: 35.88Min: 31.41 / Avg: 32.44 / Max: 33.19Min: 30.55 / Avg: 32.25 / Max: 34.35Min: 31.03 / Avg: 31.9 / Max: 32.55Min: 24.13 / Avg: 30.05 / Max: 34.31Min: 28.58 / Avg: 28.99 / Max: 29.63Min: 28.3 / Avg: 28.92 / Max: 29.41Min: 27.4 / Avg: 27.74 / Max: 28.34Min: 26.11 / Avg: 26.58 / Max: 26.87Min: 22.41 / Avg: 22.83 / Max: 23.221. (F9X) gfortran options: -O3 -march=native -funroll-loops -fopenmp

LAMMPS Molecular Dynamics Simulator

LAMMPS is a classical molecular dynamics code, and an acronym for Large-scale Atomic/Molecular Massively Parallel Simulator. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgns/day, More Is BetterLAMMPS Molecular Dynamics Simulator 23Jun2022Model: Rhodopsin ProteinXeon Platinum 8380EPYC 8534PNEPYC 8534PXeon Max 9468Xeon Platinum 8490HXeon Max 9480Xeon Platinum 8380 2PXeon Platinum 8592+EPYC 9654EPYC 9684XEPYC 9754Xeon Platinum 8490H 2PXeon Max 9468 2PEPYC 9654 2PEPYC 9754 2PXeon Max 9480 2PEPYC 9684X 2PXeon Platinum 8592+ 2P1224364860SE +/- 0.28, N = 15SE +/- 0.30, N = 15SE +/- 0.29, N = 15SE +/- 0.05, N = 11SE +/- 0.36, N = 15SE +/- 0.04, N = 11SE +/- 0.53, N = 15SE +/- 0.29, N = 15SE +/- 0.14, N = 11SE +/- 0.35, N = 15SE +/- 0.29, N = 10SE +/- 0.33, N = 8SE +/- 0.11, N = 9SE +/- 0.39, N = 7SE +/- 0.24, N = 5SE +/- 0.09, N = 8SE +/- 0.43, N = 7SE +/- 0.97, N = 1521.1621.9424.2527.6328.7230.8433.5434.3036.1540.0040.3942.2847.5150.1251.6352.2453.7755.501. (CXX) g++ options: -O3 -lm -ldl
OpenBenchmarking.orgns/day, More Is BetterLAMMPS Molecular Dynamics Simulator 23Jun2022Model: Rhodopsin ProteinXeon Platinum 8380EPYC 8534PNEPYC 8534PXeon Max 9468Xeon Platinum 8490HXeon Max 9480Xeon Platinum 8380 2PXeon Platinum 8592+EPYC 9654EPYC 9684XEPYC 9754Xeon Platinum 8490H 2PXeon Max 9468 2PEPYC 9654 2PEPYC 9754 2PXeon Max 9480 2PEPYC 9684X 2PXeon Platinum 8592+ 2P1122334455Min: 19.08 / Avg: 21.16 / Max: 22.67Min: 20.69 / Avg: 21.94 / Max: 24.59Min: 22.64 / Avg: 24.25 / Max: 25.9Min: 27.37 / Avg: 27.63 / Max: 27.89Min: 26.69 / Avg: 28.72 / Max: 30.77Min: 30.65 / Avg: 30.84 / Max: 31.07Min: 31.09 / Avg: 33.54 / Max: 37.75Min: 32.32 / Avg: 34.3 / Max: 36.34Min: 35.52 / Avg: 36.15 / Max: 36.85Min: 37.21 / Avg: 40 / Max: 41.7Min: 39.27 / Avg: 40.39 / Max: 42.04Min: 41.22 / Avg: 42.28 / Max: 43.66Min: 46.93 / Avg: 47.51 / Max: 47.92Min: 48.89 / Avg: 50.12 / Max: 51.82Min: 51.22 / Avg: 51.63 / Max: 52.27Min: 51.98 / Avg: 52.24 / Max: 52.65Min: 51.6 / Avg: 53.77 / Max: 54.85Min: 49.67 / Avg: 55.5 / Max: 63.11. (CXX) g++ options: -O3 -lm -ldl

PostgreSQL

This is a benchmark of PostgreSQL using the integrated pgbench for facilitating the database benchmarks. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgms, Fewer Is BetterPostgreSQL 16Scaling Factor: 100 - Clients: 1000 - Mode: Read Write - Average LatencyXeon Platinum 8592+ 2PXeon 6766E 2PXeon 6780E 2PEPYC 9684X 2PEPYC 9654 2PEPYC 8534PNXeon Max 9468 2PEPYC 9754 2PXeon Max 9480 2PXeon Platinum 8380EPYC 8534PXeon Platinum 8490H 2PXeon Max 9468Xeon Platinum 8490HXeon Max 9480EPYC 9754Xeon Platinum 8380 2PXeon Platinum 8592+Xeon 6766EEPYC 9684XEPYC 9654Xeon 6780E714212835SE +/- 0.10, N = 3SE +/- 0.14, N = 3SE +/- 0.15, N = 3SE +/- 0.32, N = 12SE +/- 0.25, N = 12SE +/- 0.10, N = 3SE +/- 0.06, N = 3SE +/- 0.02, N = 3SE +/- 0.12, N = 3SE +/- 0.12, N = 12SE +/- 0.05, N = 3SE +/- 0.03, N = 3SE +/- 0.02, N = 3SE +/- 0.02, N = 3SE +/- 0.03, N = 3SE +/- 0.05, N = 3SE +/- 0.12, N = 3SE +/- 0.04, N = 3SE +/- 0.03, N = 3SE +/- 0.01, N = 3SE +/- 0.04, N = 3SE +/- 0.03, N = 330.2028.8126.2918.1618.0618.0516.9616.8816.6616.3416.3214.8614.2914.0413.8513.8413.6913.2612.6312.5812.5011.541. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm
OpenBenchmarking.orgms, Fewer Is BetterPostgreSQL 16Scaling Factor: 100 - Clients: 1000 - Mode: Read Write - Average LatencyXeon Platinum 8592+ 2PXeon 6766E 2PXeon 6780E 2PEPYC 9684X 2PEPYC 9654 2PEPYC 8534PNXeon Max 9468 2PEPYC 9754 2PXeon Max 9480 2PXeon Platinum 8380EPYC 8534PXeon Platinum 8490H 2PXeon Max 9468Xeon Platinum 8490HXeon Max 9480EPYC 9754Xeon Platinum 8380 2PXeon Platinum 8592+Xeon 6766EEPYC 9684XEPYC 9654Xeon 6780E714212835Min: 30.02 / Avg: 30.2 / Max: 30.35Min: 28.55 / Avg: 28.81 / Max: 29.01Min: 26.06 / Avg: 26.29 / Max: 26.58Min: 15.56 / Avg: 18.16 / Max: 18.93Min: 15.49 / Avg: 18.06 / Max: 18.58Min: 17.86 / Avg: 18.05 / Max: 18.18Min: 16.87 / Avg: 16.96 / Max: 17.07Min: 16.86 / Avg: 16.88 / Max: 16.92Min: 16.43 / Avg: 16.66 / Max: 16.85Min: 16.08 / Avg: 16.34 / Max: 17.6Min: 16.27 / Avg: 16.32 / Max: 16.41Min: 14.8 / Avg: 14.86 / Max: 14.89Min: 14.27 / Avg: 14.29 / Max: 14.33Min: 14.01 / Avg: 14.04 / Max: 14.06Min: 13.81 / Avg: 13.85 / Max: 13.9Min: 13.76 / Avg: 13.84 / Max: 13.92Min: 13.53 / Avg: 13.69 / Max: 13.94Min: 13.22 / Avg: 13.26 / Max: 13.33Min: 12.57 / Avg: 12.63 / Max: 12.66Min: 12.56 / Avg: 12.58 / Max: 12.61Min: 12.45 / Avg: 12.5 / Max: 12.57Min: 11.48 / Avg: 11.54 / Max: 11.581. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm

OpenBenchmarking.orgTPS, More Is BetterPostgreSQL 16Scaling Factor: 100 - Clients: 1000 - Mode: Read WriteXeon Platinum 8592+ 2PXeon 6766E 2PXeon 6780E 2PEPYC 9684X 2PEPYC 8534PNEPYC 9654 2PXeon Max 9468 2PEPYC 9754 2PXeon Max 9480 2PXeon Platinum 8380EPYC 8534PXeon Platinum 8490H 2PXeon Max 9468Xeon Platinum 8490HXeon Max 9480EPYC 9754Xeon Platinum 8380 2PXeon Platinum 8592+Xeon 6766EEPYC 9684XEPYC 9654Xeon 6780E20K40K60K80K100KSE +/- 106.16, N = 3SE +/- 163.06, N = 3SE +/- 221.82, N = 3SE +/- 1059.49, N = 12SE +/- 299.71, N = 3SE +/- 865.71, N = 12SE +/- 195.77, N = 3SE +/- 58.85, N = 3SE +/- 440.63, N = 3SE +/- 434.11, N = 12SE +/- 175.33, N = 3SE +/- 137.82, N = 3SE +/- 95.84, N = 3SE +/- 78.02, N = 3SE +/- 143.25, N = 3SE +/- 242.45, N = 3SE +/- 656.63, N = 3SE +/- 198.41, N = 3SE +/- 186.80, N = 3SE +/- 87.23, N = 3SE +/- 232.97, N = 3SE +/- 232.81, N = 3331103471638043552725539555505589525922860046612336127267315699697122772225722447304275396791917949279987866771. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm
OpenBenchmarking.orgTPS, More Is BetterPostgreSQL 16Scaling Factor: 100 - Clients: 1000 - Mode: Read WriteXeon Platinum 8592+ 2PXeon 6766E 2PXeon 6780E 2PEPYC 9684X 2PEPYC 8534PNEPYC 9654 2PXeon Max 9468 2PEPYC 9754 2PXeon Max 9480 2PXeon Platinum 8380EPYC 8534PXeon Platinum 8490H 2PXeon Max 9468Xeon Platinum 8490HXeon Max 9480EPYC 9754Xeon Platinum 8380 2PXeon Platinum 8592+Xeon 6766EEPYC 9684XEPYC 9654Xeon 6780E15K30K45K60K75KMin: 32945.41 / Avg: 33110.04 / Max: 33308.47Min: 34470.5 / Avg: 34715.59 / Max: 35024.46Min: 37622.43 / Avg: 38043.25 / Max: 38375.29Min: 52840.38 / Avg: 55272 / Max: 64270.3Min: 55003.55 / Avg: 55394.65 / Max: 55983.59Min: 53832.46 / Avg: 55505.05 / Max: 64541.8Min: 58590 / Avg: 58952.17 / Max: 59262.11Min: 59119.84 / Avg: 59227.63 / Max: 59322.48Min: 59344.37 / Avg: 60046.43 / Max: 60858.76Min: 56815.4 / Avg: 61233.49 / Max: 62177.84Min: 60921.84 / Avg: 61271.68 / Max: 61467.49Min: 67177.04 / Avg: 67315.11 / Max: 67590.75Min: 69776.9 / Avg: 69968.58 / Max: 70064.85Min: 71104.9 / Avg: 71227.06 / Max: 71372.21Min: 71942.13 / Avg: 72225.43 / Max: 72404.01Min: 71830.32 / Avg: 72243.51 / Max: 72669.9Min: 71750.86 / Avg: 73042.31 / Max: 73894.44Min: 75004.67 / Avg: 75396.07 / Max: 75648.36Min: 78993.26 / Avg: 79191.19 / Max: 79564.58Min: 79318.11 / Avg: 79491.85 / Max: 79592.38Min: 79552.17 / Avg: 79987.17 / Max: 80349.25Min: 86376.63 / Avg: 86677.26 / Max: 87135.491. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm

srsRAN Project

OpenBenchmarking.orgMbps, More Is BettersrsRAN Project 23.10.1-20240325Test: PUSCH Processor Benchmark, Throughput ThreadXeon 6766E 2PXeon 6766EXeon 6780EXeon 6780E 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PNEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PXeon Platinum 8380 2PXeon Platinum 8380Xeon Platinum 8592+Xeon Platinum 8592+ 2PXeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2P306090120150SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.07, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 349.849.852.552.6112.1112.1112.1112.1112.2112.2112.2112.2112.3112.3129.5129.5129.7129.7129.7129.7129.7129.71. (CXX) g++ options: -O3 -march=native -mavx2 -mavx -msse4.1 -mfma -fno-trapping-math -fno-math-errno -ldl
OpenBenchmarking.orgMbps, More Is BettersrsRAN Project 23.10.1-20240325Test: PUSCH Processor Benchmark, Throughput ThreadXeon 6766E 2PXeon 6766EXeon 6780EXeon 6780E 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PNEPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PXeon Platinum 8380 2PXeon Platinum 8380Xeon Platinum 8592+Xeon Platinum 8592+ 2PXeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2P20406080100Min: 49.8 / Avg: 49.8 / Max: 49.8Min: 49.8 / Avg: 49.8 / Max: 49.8Min: 52.5 / Avg: 52.5 / Max: 52.5Min: 52.5 / Avg: 52.57 / Max: 52.7Min: 112.1 / Avg: 112.1 / Max: 112.1Min: 112.1 / Avg: 112.1 / Max: 112.1Min: 112.1 / Avg: 112.1 / Max: 112.1Min: 112.1 / Avg: 112.1 / Max: 112.1Min: 112.2 / Avg: 112.2 / Max: 112.2Min: 112.2 / Avg: 112.2 / Max: 112.2Min: 112.2 / Avg: 112.2 / Max: 112.2Min: 112.2 / Avg: 112.2 / Max: 112.2Min: 112.3 / Avg: 112.3 / Max: 112.3Min: 112.3 / Avg: 112.3 / Max: 112.3Min: 129.5 / Avg: 129.5 / Max: 129.5Min: 129.5 / Avg: 129.5 / Max: 129.5Min: 129.7 / Avg: 129.7 / Max: 129.7Min: 129.7 / Avg: 129.7 / Max: 129.7Min: 129.7 / Avg: 129.7 / Max: 129.7Min: 129.7 / Avg: 129.7 / Max: 129.7Min: 129.7 / Avg: 129.7 / Max: 129.7Min: 129.7 / Avg: 129.7 / Max: 129.71. (CXX) g++ options: -O3 -march=native -mavx2 -mavx -msse4.1 -mfma -fno-trapping-math -fno-math-errno -ldl

OpenBenchmarking.orgMbps, More Is BettersrsRAN Project 23.10.1-20240325Test: PDSCH Processor Benchmark, Throughput ThreadXeon 6766E 2PXeon 6766EXeon 6780E 2PXeon 6780EXeon Platinum 8380Xeon Platinum 8380 2PEPYC 8534PEPYC 8534PNEPYC 9754 2PEPYC 9754Xeon Max 9468 2PXeon Max 9480 2PEPYC 9684X 2PEPYC 9654 2PXeon Platinum 8490H 2PXeon Platinum 8490HEPYC 9684XEPYC 9654Xeon Max 9468Xeon Max 9480Xeon Platinum 8592+Xeon Platinum 8592+ 2P160320480640800SE +/- 0.32, N = 5SE +/- 0.32, N = 5SE +/- 0.66, N = 5SE +/- 0.24, N = 5SE +/- 3.57, N = 7SE +/- 2.08, N = 7SE +/- 3.14, N = 7SE +/- 1.24, N = 7SE +/- 4.48, N = 7SE +/- 0.80, N = 7SE +/- 3.86, N = 8SE +/- 5.02, N = 8SE +/- 5.52, N = 8SE +/- 3.72, N = 8SE +/- 2.57, N = 8SE +/- 1.17, N = 8SE +/- 3.13, N = 8SE +/- 1.71, N = 8SE +/- 1.64, N = 8SE +/- 1.27, N = 8SE +/- 1.34, N = 8SE +/- 1.89, N = 8293.1299.4323.7333.2484.8490.3557.9563.6576.8596.2651.9663.8664.7673.4675.5680.2680.7684.7702.6705.5742.9755.51. (CXX) g++ options: -O3 -march=native -mavx2 -mavx -msse4.1 -mfma -fno-trapping-math -fno-math-errno -ldl
OpenBenchmarking.orgMbps, More Is BettersrsRAN Project 23.10.1-20240325Test: PDSCH Processor Benchmark, Throughput ThreadXeon 6766E 2PXeon 6766EXeon 6780E 2PXeon 6780EXeon Platinum 8380Xeon Platinum 8380 2PEPYC 8534PEPYC 8534PNEPYC 9754 2PEPYC 9754Xeon Max 9468 2PXeon Max 9480 2PEPYC 9684X 2PEPYC 9654 2PXeon Platinum 8490H 2PXeon Platinum 8490HEPYC 9684XEPYC 9654Xeon Max 9468Xeon Max 9480Xeon Platinum 8592+Xeon Platinum 8592+ 2P130260390520650Min: 291.9 / Avg: 293.14 / Max: 293.6Min: 298.2 / Avg: 299.44 / Max: 300Min: 321.1 / Avg: 323.72 / Max: 324.6Min: 332.7 / Avg: 333.2 / Max: 334Min: 470 / Avg: 484.76 / Max: 492.4Min: 481.4 / Avg: 490.29 / Max: 499.1Min: 544.6 / Avg: 557.94 / Max: 566.1Min: 558.5 / Avg: 563.64 / Max: 568.6Min: 558 / Avg: 576.76 / Max: 588.8Min: 594 / Avg: 596.19 / Max: 599.9Min: 630.2 / Avg: 651.88 / Max: 668Min: 648.1 / Avg: 663.79 / Max: 686.5Min: 641.1 / Avg: 664.68 / Max: 683.1Min: 656.4 / Avg: 673.44 / Max: 686.1Min: 660.5 / Avg: 675.49 / Max: 682.4Min: 673.5 / Avg: 680.21 / Max: 684.9Min: 660.5 / Avg: 680.74 / Max: 687.8Min: 673.7 / Avg: 684.68 / Max: 688.7Min: 693.6 / Avg: 702.59 / Max: 706.9Min: 698.5 / Avg: 705.51 / Max: 709.4Min: 736.2 / Avg: 742.86 / Max: 748Min: 744 / Avg: 755.46 / Max: 760.71. (CXX) g++ options: -O3 -march=native -mavx2 -mavx -msse4.1 -mfma -fno-trapping-math -fno-math-errno -ldl

OpenRadioss

OpenRadioss is an open-source AGPL-licensed finite element solver for dynamic event analysis OpenRadioss is based on Altair Radioss and open-sourced in 2022. This open-source finite element solver is benchmarked with various example models available from https://www.openradioss.org/models/ and https://github.com/OpenRadioss/ModelExchange/tree/main/Examples. This test is currently using a reference OpenRadioss binary build offered via GitHub. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterOpenRadioss 2023.09.15Model: INIVOL and Fluid Structure Interaction Drop ContainerXeon Platinum 8380EPYC 8534PNEPYC 8534PXeon Max 9468Xeon Max 9480Xeon Platinum 8490HXeon Platinum 8380 2PXeon Platinum 8592+Xeon Max 9468 2PXeon Max 9480 2PXeon Platinum 8490H 2PEPYC 9754EPYC 9654Xeon Platinum 8592+ 2PEPYC 9684XEPYC 9754 2PEPYC 9654 2PEPYC 9684X 2P4080120160200SE +/- 0.23, N = 3SE +/- 0.63, N = 3SE +/- 0.37, N = 3SE +/- 0.08, N = 3SE +/- 0.06, N = 3SE +/- 0.19, N = 3SE +/- 0.50, N = 3SE +/- 0.12, N = 3SE +/- 0.07, N = 3SE +/- 0.09, N = 3SE +/- 0.17, N = 3SE +/- 0.46, N = 3SE +/- 0.57, N = 3SE +/- 0.30, N = 3SE +/- 0.93, N = 3SE +/- 0.12, N = 3SE +/- 0.14, N = 3SE +/- 0.43, N = 3204.21187.03176.87160.56146.03140.43135.56128.74114.29110.56107.36106.54100.24100.0094.7690.8585.8979.42
OpenBenchmarking.orgSeconds, Fewer Is BetterOpenRadioss 2023.09.15Model: INIVOL and Fluid Structure Interaction Drop ContainerXeon Platinum 8380EPYC 8534PNEPYC 8534PXeon Max 9468Xeon Max 9480Xeon Platinum 8490HXeon Platinum 8380 2PXeon Platinum 8592+Xeon Max 9468 2PXeon Max 9480 2PXeon Platinum 8490H 2PEPYC 9754EPYC 9654Xeon Platinum 8592+ 2PEPYC 9684XEPYC 9754 2PEPYC 9654 2PEPYC 9684X 2P4080120160200Min: 203.78 / Avg: 204.21 / Max: 204.54Min: 185.77 / Avg: 187.03 / Max: 187.77Min: 176.2 / Avg: 176.87 / Max: 177.48Min: 160.43 / Avg: 160.56 / Max: 160.7Min: 145.92 / Avg: 146.03 / Max: 146.11Min: 140.15 / Avg: 140.43 / Max: 140.8Min: 134.95 / Avg: 135.56 / Max: 136.56Min: 128.51 / Avg: 128.74 / Max: 128.94Min: 114.19 / Avg: 114.29 / Max: 114.42Min: 110.44 / Avg: 110.56 / Max: 110.74Min: 107.19 / Avg: 107.36 / Max: 107.69Min: 105.81 / Avg: 106.54 / Max: 107.38Min: 99.14 / Avg: 100.24 / Max: 101.02Min: 99.46 / Avg: 100 / Max: 100.48Min: 93.16 / Avg: 94.76 / Max: 96.37Min: 90.66 / Avg: 90.85 / Max: 91.07Min: 85.63 / Avg: 85.89 / Max: 86.08Min: 78.79 / Avg: 79.42 / Max: 80.25

Liquid-DSP

LiquidSDR's Liquid-DSP is a software-defined radio (SDR) digital signal processing library. This test profile runs a multi-threaded benchmark of this SDR/DSP library focused on embedded platform usage. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgsamples/s, More Is BetterLiquid-DSP 1.6Threads: 64 - Buffer Length: 256 - Filter Length: 512Xeon 6766E 2PXeon 6766EXeon 6780E 2PXeon 6780EXeon Platinum 8380EPYC 8534PNXeon Max 9468EPYC 8534PXeon Platinum 8380 2PXeon Max 9480EPYC 9754 2PEPYC 9754Xeon Max 9468 2PXeon Platinum 8490HXeon Max 9480 2PXeon Platinum 8592+Xeon Platinum 8490H 2PEPYC 9654EPYC 9654 2PEPYC 9684X 2PEPYC 9684XXeon Platinum 8592+ 2P200M400M600M800M1000MSE +/- 584646.14, N = 3SE +/- 271682.00, N = 3SE +/- 3610015.39, N = 3SE +/- 124677.36, N = 3SE +/- 147685.85, N = 3SE +/- 2292977.20, N = 3SE +/- 1611276.24, N = 3SE +/- 822739.33, N = 3SE +/- 749718.47, N = 3SE +/- 1289603.73, N = 3SE +/- 958772.36, N = 3SE +/- 673003.22, N = 3SE +/- 4432294.36, N = 3SE +/- 940265.92, N = 3SE +/- 6141471.96, N = 3SE +/- 1515552.70, N = 3SE +/- 3717554.45, N = 3SE +/- 1678355.68, N = 3SE +/- 2261241.06, N = 3SE +/- 3039034.93, N = 3SE +/- 752558.60, N = 3SE +/- 7562646.32, N = 83497466673595766673844066673985666675032533335772633336323966676338600006465133336890033337093933337096500007325600007444100007571766677837700007994966678113733338245833338493400008505866678837012501. (CC) gcc options: -O3 -pthread -lm -lc -lliquid
OpenBenchmarking.orgsamples/s, More Is BetterLiquid-DSP 1.6Threads: 64 - Buffer Length: 256 - Filter Length: 512Xeon 6766E 2PXeon 6766EXeon 6780E 2PXeon 6780EXeon Platinum 8380EPYC 8534PNXeon Max 9468EPYC 8534PXeon Platinum 8380 2PXeon Max 9480EPYC 9754 2PEPYC 9754Xeon Max 9468 2PXeon Platinum 8490HXeon Max 9480 2PXeon Platinum 8592+Xeon Platinum 8490H 2PEPYC 9654EPYC 9654 2PEPYC 9684X 2PEPYC 9684XXeon Platinum 8592+ 2P150M300M450M600M750MMin: 348670000 / Avg: 349746666.67 / Max: 350680000Min: 359220000 / Avg: 359576666.67 / Max: 360110000Min: 380380000 / Avg: 384406666.67 / Max: 391610000Min: 398340000 / Avg: 398566666.67 / Max: 398770000Min: 503010000 / Avg: 503253333.33 / Max: 503520000Min: 573430000 / Avg: 577263333.33 / Max: 581360000Min: 630210000 / Avg: 632396666.67 / Max: 635540000Min: 632850000 / Avg: 633860000 / Max: 635490000Min: 645510000 / Avg: 646513333.33 / Max: 647980000Min: 687500000 / Avg: 689003333.33 / Max: 691570000Min: 707580000 / Avg: 709393333.33 / Max: 710840000Min: 708870000 / Avg: 709650000 / Max: 710990000Min: 725240000 / Avg: 732560000 / Max: 740550000Min: 743120000 / Avg: 744410000 / Max: 746240000Min: 745540000 / Avg: 757176666.67 / Max: 766400000Min: 780790000 / Avg: 783770000 / Max: 785740000Min: 794190000 / Avg: 799496666.67 / Max: 806660000Min: 808250000 / Avg: 811373333.33 / Max: 814000000Min: 821280000 / Avg: 824583333.33 / Max: 828910000Min: 843620000 / Avg: 849340000 / Max: 853980000Min: 849550000 / Avg: 850586666.67 / Max: 852050000Min: 843790000 / Avg: 883701250 / Max: 9084900001. (CC) gcc options: -O3 -pthread -lm -lc -lliquid

NWChem

NWChem is an open-source high performance computational chemistry package. Per NWChem's documentation, "NWChem aims to provide its users with computational chemistry tools that are scalable both in their ability to treat large scientific computational chemistry problems efficiently, and in their use of available parallel computing resources from high-performance parallel supercomputers to conventional workstation clusters." Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterNWChem 7.0.2Input: C240 BuckyballXeon Platinum 8380Xeon Max 9468Xeon Max 9480EPYC 8534PNXeon Platinum 8380 2PXeon Platinum 8490HEPYC 8534PXeon Platinum 8490H 2PXeon Platinum 8592+Xeon Max 9480 2PXeon Platinum 8592+ 2PXeon Max 9468 2PEPYC 9754 2PEPYC 9754EPYC 9654EPYC 9654 2PEPYC 9684XEPYC 9684X 2P80016002400320040003576.42530.52245.22224.62170.02070.32024.71960.91878.31873.11809.71785.01712.61700.01575.51558.41450.51429.91. (F9X) gfortran options: -lnwctask -lccsd -lmcscf -lselci -lmp2 -lmoints -lstepper -ldriver -loptim -lnwdft -lgradients -lcphf -lesp -lddscf -ldangchang -lguess -lhessian -lvib -lnwcutil -lrimp2 -lproperty -lsolvation -lnwints -lprepar -lnwmd -lnwpw -lofpw -lpaw -lpspw -lband -lnwpwlib -lcafe -lspace -lanalyze -lqhop -lpfft -ldplot -ldrdy -lvscf -lqmmm -lqmd -letrans -ltce -lbq -lmm -lcons -lperfm -ldntmc -lccca -ldimqm -lga -larmci -lpeigs -l64to32 -lopenblas -lpthread -lrt -llapack -lnwcblas -lmpi_usempif08 -lmpi_mpifh -lmpi -lopen-rte -lopen-pal -lhwloc -levent_core -levent_pthreads -lm -lz -lcomex -m64 -ffast-math -std=legacy -fdefault-integer-8 -finline-functions -O2

Kvazaar

This is a test of Kvazaar as a CPU-based H.265/HEVC video encoder written in the C programming language and optimized in Assembly. Kvazaar is the winner of the 2016 ACM Open-Source Software Competition and developed at the Ultra Video Group, Tampere University, Finland. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgFrames Per Second, More Is BetterKvazaar 2.2Video Input: Bosphorus 4K - Video Preset: Very FastXeon Platinum 8380Xeon 6766E 2PXeon Platinum 8592+Xeon 6780E 2PXeon Max 9468Xeon Max 9480Xeon 6766EXeon Platinum 8380 2PXeon 6780EXeon Platinum 8490HEPYC 8534PNXeon Max 9468 2PXeon Max 9480 2PEPYC 8534PEPYC 9754 2PXeon Platinum 8592+ 2PXeon Platinum 8490H 2PEPYC 9754EPYC 9654 2PEPYC 9684X 2PEPYC 9654EPYC 9684X20406080100SE +/- 0.06, N = 3SE +/- 0.36, N = 15SE +/- 0.04, N = 4SE +/- 0.50, N = 15SE +/- 0.06, N = 4SE +/- 0.08, N = 4SE +/- 0.04, N = 4SE +/- 0.18, N = 4SE +/- 0.00, N = 4SE +/- 0.08, N = 4SE +/- 0.07, N = 4SE +/- 0.33, N = 4SE +/- 0.29, N = 4SE +/- 0.07, N = 5SE +/- 0.63, N = 15SE +/- 0.36, N = 5SE +/- 0.45, N = 5SE +/- 0.21, N = 5SE +/- 0.71, N = 6SE +/- 0.28, N = 6SE +/- 0.62, N = 6SE +/- 0.32, N = 631.2536.4038.0238.9240.2341.3441.8644.1146.1850.0351.5151.9152.2354.6059.0165.3867.6468.5672.6874.0376.8378.151. (CC) gcc options: -pthread -ftree-vectorize -fvisibility=hidden -O2 -lpthread -lm -lrt
OpenBenchmarking.orgFrames Per Second, More Is BetterKvazaar 2.2Video Input: Bosphorus 4K - Video Preset: Very FastXeon Platinum 8380Xeon 6766E 2PXeon Platinum 8592+Xeon 6780E 2PXeon Max 9468Xeon Max 9480Xeon 6766EXeon Platinum 8380 2PXeon 6780EXeon Platinum 8490HEPYC 8534PNXeon Max 9468 2PXeon Max 9480 2PEPYC 8534PEPYC 9754 2PXeon Platinum 8592+ 2PXeon Platinum 8490H 2PEPYC 9754EPYC 9654 2PEPYC 9684X 2PEPYC 9654EPYC 9684X1530456075Min: 31.18 / Avg: 31.25 / Max: 31.36Min: 32.15 / Avg: 36.4 / Max: 37.55Min: 37.96 / Avg: 38.02 / Max: 38.14Min: 35.65 / Avg: 38.92 / Max: 42.77Min: 40.08 / Avg: 40.23 / Max: 40.36Min: 41.16 / Avg: 41.34 / Max: 41.47Min: 41.74 / Avg: 41.86 / Max: 41.92Min: 43.56 / Avg: 44.11 / Max: 44.36Min: 46.17 / Avg: 46.18 / Max: 46.19Min: 49.83 / Avg: 50.03 / Max: 50.24Min: 51.3 / Avg: 51.51 / Max: 51.61Min: 51.22 / Avg: 51.91 / Max: 52.55Min: 51.62 / Avg: 52.23 / Max: 52.85Min: 54.46 / Avg: 54.6 / Max: 54.82Min: 53.6 / Avg: 59.01 / Max: 62.51Min: 64.71 / Avg: 65.38 / Max: 66.72Min: 65.99 / Avg: 67.64 / Max: 68.59Min: 68.04 / Avg: 68.56 / Max: 69.1Min: 69.21 / Avg: 72.68 / Max: 73.94Min: 72.97 / Avg: 74.03 / Max: 75.1Min: 75.08 / Avg: 76.83 / Max: 79.2Min: 76.98 / Avg: 78.15 / Max: 78.811. (CC) gcc options: -pthread -ftree-vectorize -fvisibility=hidden -O2 -lpthread -lm -lrt

GraphicsMagick

OpenBenchmarking.orgIterations Per Minute, More Is BetterGraphicsMagick 1.3.43Operation: SwirlXeon Platinum 8380EPYC 8534PNEPYC 8534PXeon Max 9468Xeon Platinum 8380 2PXeon Max 9480Xeon 6766E 2PXeon Platinum 8490HXeon 6766EXeon Max 9468 2PEPYC 9654Xeon 6780E 2PXeon Platinum 8592+EPYC 9754EPYC 9684XEPYC 9654 2PXeon Max 9480 2PXeon 6780EEPYC 9754 2PEPYC 9684X 2PXeon Platinum 8490H 2PXeon Platinum 8592+ 2P150300450600750SE +/- 0.33, N = 3SE +/- 0.88, N = 3SE +/- 0.33, N = 3SE +/- 0.58, N = 3SE +/- 4.41, N = 3SE +/- 0.67, N = 3SE +/- 2.33, N = 3SE +/- 1.15, N = 3SE +/- 4.91, N = 3SE +/- 1.33, N = 3SE +/- 0.33, N = 3SE +/- 3.00, N = 3SE +/- 0.88, N = 3SE +/- 0.33, N = 3SE +/- 0.00, N = 3SE +/- 0.33, N = 3SE +/- 0.67, N = 3SE +/- 1.15, N = 3SE +/- 0.33, N = 3SE +/- 0.67, N = 3SE +/- 1.76, N = 3SE +/- 0.58, N = 32783633793944034324745025045095115175295355465535585665675836176891. (CC) gcc options: -fopenmp -O2 -ltiff -ljbig -lsharpyuv -lwebp -lwebpmux -lfreetype -ljpeg -lXext -lSM -lICE -lX11 -lxml2 -lzstd -llzma -lbz2 -lz -lm -lpthread -lgomp
OpenBenchmarking.orgIterations Per Minute, More Is BetterGraphicsMagick 1.3.43Operation: SwirlXeon Platinum 8380EPYC 8534PNEPYC 8534PXeon Max 9468Xeon Platinum 8380 2PXeon Max 9480Xeon 6766E 2PXeon Platinum 8490HXeon 6766EXeon Max 9468 2PEPYC 9654Xeon 6780E 2PXeon Platinum 8592+EPYC 9754EPYC 9684XEPYC 9654 2PXeon Max 9480 2PXeon 6780EEPYC 9754 2PEPYC 9684X 2PXeon Platinum 8490H 2PXeon Platinum 8592+ 2P120240360480600Min: 278 / Avg: 278.33 / Max: 279Min: 361 / Avg: 362.67 / Max: 364Min: 378 / Avg: 378.67 / Max: 379Min: 393 / Avg: 394 / Max: 395Min: 395 / Avg: 403.33 / Max: 410Min: 431 / Avg: 432.33 / Max: 433Min: 470 / Avg: 474.33 / Max: 478Min: 500 / Avg: 502 / Max: 504Min: 494 / Avg: 503.67 / Max: 510Min: 508 / Avg: 509.33 / Max: 512Min: 511 / Avg: 511.33 / Max: 512Min: 514 / Avg: 517 / Max: 523Min: 528 / Avg: 529.33 / Max: 531Min: 535 / Avg: 535.33 / Max: 536Min: 546 / Avg: 546 / Max: 546Min: 553 / Avg: 553.33 / Max: 554Min: 557 / Avg: 557.67 / Max: 559Min: 564 / Avg: 566 / Max: 568Min: 566 / Avg: 566.67 / Max: 567Min: 582 / Avg: 583.33 / Max: 584Min: 614 / Avg: 616.67 / Max: 620Min: 688 / Avg: 689 / Max: 6901. (CC) gcc options: -fopenmp -O2 -ltiff -ljbig -lsharpyuv -lwebp -lwebpmux -lfreetype -ljpeg -lXext -lSM -lICE -lX11 -lxml2 -lzstd -llzma -lbz2 -lz -lm -lpthread -lgomp

Liquid-DSP

LiquidSDR's Liquid-DSP is a software-defined radio (SDR) digital signal processing library. This test profile runs a multi-threaded benchmark of this SDR/DSP library focused on embedded platform usage. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgsamples/s, More Is BetterLiquid-DSP 1.6Threads: 128 - Buffer Length: 256 - Filter Length: 32Xeon Platinum 8380Xeon Max 9468Xeon Max 9480EPYC 8534PNXeon Platinum 8380 2PEPYC 8534PXeon Platinum 8592+Xeon Platinum 8490HXeon Max 9468 2PXeon Max 9480 2PXeon Platinum 8592+ 2PXeon Platinum 8490H 2PXeon 6766E 2PXeon 6766EEPYC 9754EPYC 9754 2PXeon 6780E 2PEPYC 9654EPYC 9654 2PXeon 6780EEPYC 9684XEPYC 9684X 2P900M1800M2700M3600M4500MSE +/- 3178574.10, N = 3SE +/- 400000.00, N = 3SE +/- 1342054.81, N = 3SE +/- 2003607.86, N = 3SE +/- 3557152.42, N = 3SE +/- 3138116.92, N = 3SE +/- 2236316.42, N = 3SE +/- 1858314.65, N = 3SE +/- 4598671.31, N = 3SE +/- 2403700.85, N = 3SE +/- 13813198.20, N = 3SE +/- 26633124.74, N = 3SE +/- 3194265.70, N = 3SE +/- 920748.49, N = 3SE +/- 4056818.68, N = 3SE +/- 384418.75, N = 3SE +/- 517472.49, N = 3SE +/- 2714365.08, N = 3SE +/- 3186603.90, N = 3SE +/- 2023198.79, N = 3SE +/- 841295.30, N = 3SE +/- 4250882.26, N = 317974000002351900000273963333327679333333044700000304706666731482333333200600000325403333333370666673520766667355860000036079000003671966667379156666737941333334021033333403273333340633333334102200000435353333344079000001. (CC) gcc options: -O3 -pthread -lm -lc -lliquid
OpenBenchmarking.orgsamples/s, More Is BetterLiquid-DSP 1.6Threads: 128 - Buffer Length: 256 - Filter Length: 32Xeon Platinum 8380Xeon Max 9468Xeon Max 9480EPYC 8534PNXeon Platinum 8380 2PEPYC 8534PXeon Platinum 8592+Xeon Platinum 8490HXeon Max 9468 2PXeon Max 9480 2PXeon Platinum 8592+ 2PXeon Platinum 8490H 2PXeon 6766E 2PXeon 6766EEPYC 9754EPYC 9754 2PXeon 6780E 2PEPYC 9654EPYC 9654 2PXeon 6780EEPYC 9684XEPYC 9684X 2P800M1600M2400M3200M4000MMin: 1792800000 / Avg: 1797400000 / Max: 1803500000Min: 2351100000 / Avg: 2351900000 / Max: 2352300000Min: 2737000000 / Avg: 2739633333.33 / Max: 2741400000Min: 2764700000 / Avg: 2767933333.33 / Max: 2771600000Min: 3040100000 / Avg: 3044700000 / Max: 3051700000Min: 3040800000 / Avg: 3047066666.67 / Max: 3050500000Min: 3144000000 / Avg: 3148233333.33 / Max: 3151600000Min: 3197600000 / Avg: 3200600000 / Max: 3204000000Min: 3248800000 / Avg: 3254033333.33 / Max: 3263200000Min: 3332400000 / Avg: 3337066666.67 / Max: 3340400000Min: 3497500000 / Avg: 3520766666.67 / Max: 3545300000Min: 3510300000 / Avg: 3558600000 / Max: 3602200000Min: 3603000000 / Avg: 3607900000 / Max: 3613900000Min: 3670200000 / Avg: 3671966666.67 / Max: 3673300000Min: 3783900000 / Avg: 3791566666.67 / Max: 3797700000Min: 3793700000 / Avg: 3794133333.33 / Max: 3794900000Min: 4020000000 / Avg: 4021033333.33 / Max: 4021600000Min: 4028100000 / Avg: 4032733333.33 / Max: 4037500000Min: 4058100000 / Avg: 4063333333.33 / Max: 4069100000Min: 4098800000 / Avg: 4102200000 / Max: 4105800000Min: 4352000000 / Avg: 4353533333.33 / Max: 4354900000Min: 4400800000 / Avg: 4407900000 / Max: 44155000001. (CC) gcc options: -O3 -pthread -lm -lc -lliquid

CloverLeaf

CloverLeaf is a Lagrangian-Eulerian hydrodynamics benchmark. This test profile currently makes use of CloverLeaf's OpenMP version. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterCloverLeaf 1.3Input: clover_bm16Xeon Platinum 8380EPYC 8534PNEPYC 8534PXeon Platinum 8592+EPYC 9754Xeon Platinum 8592+ 2PXeon Max 9480Xeon Max 9468EPYC 9754 2PEPYC 9654Xeon Platinum 8490HXeon 6766EXeon 6780EXeon Platinum 8380 2PXeon Max 9480 2PEPYC 9654 2PXeon Max 9468 2PEPYC 9684XXeon 6780E 2PXeon 6766E 2PEPYC 9684X 2PXeon Platinum 8490H 2P110220330440550SE +/- 1.58, N = 3SE +/- 1.08, N = 3SE +/- 0.79, N = 3SE +/- 0.54, N = 3SE +/- 4.99, N = 9SE +/- 2.02, N = 3SE +/- 2.03, N = 3SE +/- 1.43, N = 3SE +/- 1.02, N = 3SE +/- 3.79, N = 9SE +/- 0.13, N = 3SE +/- 0.11, N = 3SE +/- 0.00, N = 3SE +/- 3.41, N = 3SE +/- 2.11, N = 9SE +/- 0.12, N = 3SE +/- 1.56, N = 3SE +/- 2.24, N = 3SE +/- 2.04, N = 3SE +/- 1.60, N = 12SE +/- 0.59, N = 3SE +/- 0.74, N = 3512.36498.22495.25410.59400.52378.05357.57351.29349.67334.30328.47314.88313.50295.30269.20266.10263.33245.82236.81226.60223.54214.801. (F9X) gfortran options: -O3 -march=native -funroll-loops -fopenmp
OpenBenchmarking.orgSeconds, Fewer Is BetterCloverLeaf 1.3Input: clover_bm16Xeon Platinum 8380EPYC 8534PNEPYC 8534PXeon Platinum 8592+EPYC 9754Xeon Platinum 8592+ 2PXeon Max 9480Xeon Max 9468EPYC 9754 2PEPYC 9654Xeon Platinum 8490HXeon 6766EXeon 6780EXeon Platinum 8380 2PXeon Max 9480 2PEPYC 9654 2PXeon Max 9468 2PEPYC 9684XXeon 6780E 2PXeon 6766E 2PEPYC 9684X 2PXeon Platinum 8490H 2P90180270360450Min: 510.77 / Avg: 512.36 / Max: 515.52Min: 496.77 / Avg: 498.22 / Max: 500.32Min: 494.18 / Avg: 495.25 / Max: 496.8Min: 409.58 / Avg: 410.59 / Max: 411.42Min: 392.55 / Avg: 400.52 / Max: 440.01Min: 374.35 / Avg: 378.05 / Max: 381.3Min: 354.4 / Avg: 357.57 / Max: 361.34Min: 349.41 / Avg: 351.29 / Max: 354.11Min: 347.76 / Avg: 349.67 / Max: 351.23Min: 325.78 / Avg: 334.3 / Max: 360.63Min: 328.23 / Avg: 328.47 / Max: 328.69Min: 314.73 / Avg: 314.88 / Max: 315.1Min: 313.49 / Avg: 313.5 / Max: 313.5Min: 289.93 / Avg: 295.3 / Max: 301.64Min: 261.99 / Avg: 269.2 / Max: 280.35Min: 265.86 / Avg: 266.1 / Max: 266.27Min: 261.16 / Avg: 263.33 / Max: 266.36Min: 241.35 / Avg: 245.82 / Max: 248.31Min: 233.35 / Avg: 236.81 / Max: 240.42Min: 218.38 / Avg: 226.6 / Max: 234.85Min: 222.37 / Avg: 223.54 / Max: 224.23Min: 213.33 / Avg: 214.8 / Max: 215.621. (F9X) gfortran options: -O3 -march=native -funroll-loops -fopenmp

libavif avifenc

OpenBenchmarking.orgSeconds, Fewer Is Betterlibavif avifenc 1.0Encoder Speed: 0Xeon 6766E 2PXeon 6766EXeon 6780E 2PXeon 6780EXeon Platinum 8380Xeon Platinum 8380 2PEPYC 8534PNXeon Max 9468EPYC 8534PEPYC 9754 2PEPYC 9754Xeon Max 9480Xeon Platinum 8490HXeon Max 9468 2PXeon Max 9480 2PXeon Platinum 8490H 2PXeon Platinum 8592+EPYC 9684X 2PEPYC 9654 2PEPYC 9654EPYC 9684XXeon Platinum 8592+ 2P306090120150SE +/- 0.22, N = 3SE +/- 0.03, N = 3SE +/- 0.18, N = 3SE +/- 0.12, N = 3SE +/- 0.52, N = 3SE +/- 0.18, N = 3SE +/- 0.18, N = 3SE +/- 0.15, N = 3SE +/- 0.19, N = 3SE +/- 0.06, N = 3SE +/- 0.13, N = 3SE +/- 0.22, N = 3SE +/- 0.32, N = 3SE +/- 0.29, N = 3SE +/- 0.32, N = 3SE +/- 0.05, N = 3SE +/- 0.08, N = 3SE +/- 0.01, N = 3SE +/- 0.11, N = 3SE +/- 0.01, N = 3SE +/- 0.12, N = 3SE +/- 0.03, N = 3143.80140.86129.91126.97100.4688.0778.2476.9275.8674.6973.2773.0669.9369.6568.4467.3864.4863.4062.8961.9961.6360.531. (CXX) g++ options: -O3 -fPIC -lm
OpenBenchmarking.orgSeconds, Fewer Is Betterlibavif avifenc 1.0Encoder Speed: 0Xeon 6766E 2PXeon 6766EXeon 6780E 2PXeon 6780EXeon Platinum 8380Xeon Platinum 8380 2PEPYC 8534PNXeon Max 9468EPYC 8534PEPYC 9754 2PEPYC 9754Xeon Max 9480Xeon Platinum 8490HXeon Max 9468 2PXeon Max 9480 2PXeon Platinum 8490H 2PXeon Platinum 8592+EPYC 9684X 2PEPYC 9654 2PEPYC 9654EPYC 9684XXeon Platinum 8592+ 2P306090120150Min: 143.51 / Avg: 143.8 / Max: 144.22Min: 140.83 / Avg: 140.86 / Max: 140.92Min: 129.62 / Avg: 129.91 / Max: 130.26Min: 126.82 / Avg: 126.97 / Max: 127.21Min: 99.9 / Avg: 100.46 / Max: 101.5Min: 87.7 / Avg: 88.07 / Max: 88.31Min: 77.91 / Avg: 78.24 / Max: 78.52Min: 76.63 / Avg: 76.92 / Max: 77.15Min: 75.48 / Avg: 75.86 / Max: 76.07Min: 74.58 / Avg: 74.69 / Max: 74.79Min: 73.02 / Avg: 73.27 / Max: 73.46Min: 72.62 / Avg: 73.06 / Max: 73.3Min: 69.55 / Avg: 69.93 / Max: 70.56Min: 69.12 / Avg: 69.65 / Max: 70.13Min: 68 / Avg: 68.44 / Max: 69.07Min: 67.32 / Avg: 67.37 / Max: 67.47Min: 64.38 / Avg: 64.48 / Max: 64.63Min: 63.39 / Avg: 63.4 / Max: 63.42Min: 62.69 / Avg: 62.89 / Max: 63.07Min: 61.98 / Avg: 61.99 / Max: 62.02Min: 61.38 / Avg: 61.63 / Max: 61.76Min: 60.47 / Avg: 60.53 / Max: 60.571. (CXX) g++ options: -O3 -fPIC -lm

OpenBenchmarking.orgSeconds, Fewer Is Betterlibavif avifenc 1.0Encoder Speed: 2Xeon 6766E 2PXeon 6766EXeon 6780E 2PXeon 6780EXeon Platinum 8380Xeon Platinum 8380 2PEPYC 8534PNEPYC 9754 2PEPYC 8534PXeon Max 9468EPYC 9754Xeon Max 9480Xeon Max 9468 2PXeon Max 9480 2PXeon Platinum 8490HXeon Platinum 8490H 2PEPYC 9654 2PEPYC 9684X 2PXeon Platinum 8592+EPYC 9654EPYC 9684XXeon Platinum 8592+ 2P20406080100SE +/- 0.07, N = 3SE +/- 0.01, N = 3SE +/- 0.09, N = 3SE +/- 0.41, N = 3SE +/- 0.04, N = 3SE +/- 0.25, N = 3SE +/- 0.10, N = 3SE +/- 0.13, N = 3SE +/- 0.03, N = 3SE +/- 0.21, N = 3SE +/- 0.06, N = 3SE +/- 0.31, N = 3SE +/- 0.22, N = 3SE +/- 0.06, N = 3SE +/- 0.04, N = 3SE +/- 0.16, N = 3SE +/- 0.43, N = 3SE +/- 0.03, N = 3SE +/- 0.05, N = 3SE +/- 0.02, N = 3SE +/- 0.02, N = 3SE +/- 0.09, N = 379.2076.4771.9769.3452.2347.5142.6141.9241.6641.1340.3539.8838.6538.1437.7537.3135.4035.3234.7934.1534.0433.651. (CXX) g++ options: -O3 -fPIC -lm
OpenBenchmarking.orgSeconds, Fewer Is Betterlibavif avifenc 1.0Encoder Speed: 2Xeon 6766E 2PXeon 6766EXeon 6780E 2PXeon 6780EXeon Platinum 8380Xeon Platinum 8380 2PEPYC 8534PNEPYC 9754 2PEPYC 8534PXeon Max 9468EPYC 9754Xeon Max 9480Xeon Max 9468 2PXeon Max 9480 2PXeon Platinum 8490HXeon Platinum 8490H 2PEPYC 9654 2PEPYC 9684X 2PXeon Platinum 8592+EPYC 9654EPYC 9684XXeon Platinum 8592+ 2P1530456075Min: 79.08 / Avg: 79.2 / Max: 79.3Min: 76.46 / Avg: 76.47 / Max: 76.49Min: 71.87 / Avg: 71.97 / Max: 72.15Min: 68.92 / Avg: 69.34 / Max: 70.17Min: 52.14 / Avg: 52.23 / Max: 52.28Min: 47.23 / Avg: 47.51 / Max: 47.99Min: 42.44 / Avg: 42.61 / Max: 42.78Min: 41.77 / Avg: 41.92 / Max: 42.17Min: 41.61 / Avg: 41.66 / Max: 41.71Min: 40.75 / Avg: 41.13 / Max: 41.49Min: 40.23 / Avg: 40.35 / Max: 40.41Min: 39.56 / Avg: 39.88 / Max: 40.5Min: 38.42 / Avg: 38.65 / Max: 39.1Min: 38.04 / Avg: 38.14 / Max: 38.24Min: 37.68 / Avg: 37.75 / Max: 37.8Min: 37.11 / Avg: 37.31 / Max: 37.63Min: 34.84 / Avg: 35.4 / Max: 36.26Min: 35.27 / Avg: 35.32 / Max: 35.36Min: 34.71 / Avg: 34.79 / Max: 34.88Min: 34.12 / Avg: 34.15 / Max: 34.17Min: 34.02 / Avg: 34.04 / Max: 34.08Min: 33.49 / Avg: 33.65 / Max: 33.81. (CXX) g++ options: -O3 -fPIC -lm

SVT-AV1

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 2.0Encoder Mode: Preset 4 - Input: Bosphorus 4KXeon 6766E 2PXeon 6766EXeon 6780E 2PXeon 6780EXeon Platinum 8380 2PXeon Platinum 8380Xeon Max 9468 2PXeon Max 9480 2PXeon Max 9468Xeon Max 9480Xeon Platinum 8490H 2PEPYC 8534PNEPYC 8534PXeon Platinum 8490HEPYC 9754 2PEPYC 9754Xeon Platinum 8592+ 2PXeon Platinum 8592+EPYC 9654 2PEPYC 9654EPYC 9684X 2PEPYC 9684X246810SE +/- 0.023, N = 3SE +/- 0.002, N = 3SE +/- 0.041, N = 3SE +/- 0.003, N = 3SE +/- 0.014, N = 3SE +/- 0.014, N = 3SE +/- 0.015, N = 3SE +/- 0.042, N = 3SE +/- 0.027, N = 3SE +/- 0.047, N = 3SE +/- 0.049, N = 3SE +/- 0.015, N = 3SE +/- 0.007, N = 3SE +/- 0.030, N = 3SE +/- 0.004, N = 3SE +/- 0.024, N = 3SE +/- 0.044, N = 3SE +/- 0.005, N = 3SE +/- 0.046, N = 3SE +/- 0.019, N = 3SE +/- 0.040, N = 3SE +/- 0.021, N = 33.7103.9724.0404.3505.4375.4385.9916.0526.4906.5726.6986.7276.9397.0617.1537.2837.3607.8768.3498.4228.5138.5951. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq
OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 2.0Encoder Mode: Preset 4 - Input: Bosphorus 4KXeon 6766E 2PXeon 6766EXeon 6780E 2PXeon 6780EXeon Platinum 8380 2PXeon Platinum 8380Xeon Max 9468 2PXeon Max 9480 2PXeon Max 9468Xeon Max 9480Xeon Platinum 8490H 2PEPYC 8534PNEPYC 8534PXeon Platinum 8490HEPYC 9754 2PEPYC 9754Xeon Platinum 8592+ 2PXeon Platinum 8592+EPYC 9654 2PEPYC 9654EPYC 9684X 2PEPYC 9684X3691215Min: 3.67 / Avg: 3.71 / Max: 3.75Min: 3.97 / Avg: 3.97 / Max: 3.98Min: 3.96 / Avg: 4.04 / Max: 4.1Min: 4.35 / Avg: 4.35 / Max: 4.36Min: 5.41 / Avg: 5.44 / Max: 5.46Min: 5.42 / Avg: 5.44 / Max: 5.47Min: 5.98 / Avg: 5.99 / Max: 6.02Min: 5.98 / Avg: 6.05 / Max: 6.13Min: 6.46 / Avg: 6.49 / Max: 6.54Min: 6.51 / Avg: 6.57 / Max: 6.66Min: 6.6 / Avg: 6.7 / Max: 6.75Min: 6.7 / Avg: 6.73 / Max: 6.75Min: 6.93 / Avg: 6.94 / Max: 6.95Min: 7.02 / Avg: 7.06 / Max: 7.12Min: 7.15 / Avg: 7.15 / Max: 7.16Min: 7.24 / Avg: 7.28 / Max: 7.32Min: 7.27 / Avg: 7.36 / Max: 7.42Min: 7.87 / Avg: 7.88 / Max: 7.88Min: 8.28 / Avg: 8.35 / Max: 8.43Min: 8.39 / Avg: 8.42 / Max: 8.46Min: 8.43 / Avg: 8.51 / Max: 8.56Min: 8.56 / Avg: 8.6 / Max: 8.641. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

uvg266

uvg266 is an open-source VVC/H.266 (Versatile Video Coding) encoder based on Kvazaar as part of the Ultra Video Group, Tampere University, Finland. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgFrames Per Second, More Is Betteruvg266 0.4.1Video Input: Bosphorus 4K - Video Preset: Very FastXeon 6766E 2PXeon 6780E 2PXeon Platinum 8380Xeon Platinum 8592+Xeon Max 9468Xeon Platinum 8380 2PXeon 6766EXeon Max 9480Xeon 6780EXeon Max 9468 2PEPYC 8534PNEPYC 9754 2PXeon Max 9480 2PXeon Platinum 8490HEPYC 8534PEPYC 9654 2PXeon Platinum 8592+ 2PEPYC 9754Xeon Platinum 8490H 2PEPYC 9684X 2PEPYC 9654EPYC 9684X1428425670SE +/- 0.34, N = 15SE +/- 0.43, N = 15SE +/- 0.06, N = 3SE +/- 0.08, N = 3SE +/- 0.12, N = 4SE +/- 0.18, N = 4SE +/- 0.01, N = 4SE +/- 0.02, N = 4SE +/- 0.06, N = 4SE +/- 0.39, N = 4SE +/- 0.06, N = 4SE +/- 0.43, N = 15SE +/- 0.38, N = 9SE +/- 0.01, N = 4SE +/- 0.08, N = 4SE +/- 0.55, N = 5SE +/- 0.16, N = 5SE +/- 0.18, N = 5SE +/- 0.50, N = 5SE +/- 0.12, N = 5SE +/- 0.13, N = 5SE +/- 0.13, N = 527.3328.4330.1735.1039.5640.6940.7340.8244.4444.7544.9246.0046.2549.4250.0453.4453.6654.4654.8855.0562.0262.70
OpenBenchmarking.orgFrames Per Second, More Is Betteruvg266 0.4.1Video Input: Bosphorus 4K - Video Preset: Very FastXeon 6766E 2PXeon 6780E 2PXeon Platinum 8380Xeon Platinum 8592+Xeon Max 9468Xeon Platinum 8380 2PXeon 6766EXeon Max 9480Xeon 6780EXeon Max 9468 2PEPYC 8534PNEPYC 9754 2PXeon Max 9480 2PXeon Platinum 8490HEPYC 8534PEPYC 9654 2PXeon Platinum 8592+ 2PEPYC 9754Xeon Platinum 8490H 2PEPYC 9684X 2PEPYC 9654EPYC 9684X1224364860Min: 24.3 / Avg: 27.33 / Max: 29.83Min: 26.11 / Avg: 28.43 / Max: 31.68Min: 30.06 / Avg: 30.17 / Max: 30.25Min: 35 / Avg: 35.1 / Max: 35.26Min: 39.31 / Avg: 39.56 / Max: 39.87Min: 40.32 / Avg: 40.69 / Max: 41.02Min: 40.72 / Avg: 40.73 / Max: 40.75Min: 40.78 / Avg: 40.82 / Max: 40.87Min: 44.27 / Avg: 44.44 / Max: 44.55Min: 43.63 / Avg: 44.75 / Max: 45.44Min: 44.76 / Avg: 44.92 / Max: 45.03Min: 43.34 / Avg: 46 / Max: 49.47Min: 43.42 / Avg: 46.25 / Max: 47.35Min: 49.38 / Avg: 49.42 / Max: 49.44Min: 49.88 / Avg: 50.04 / Max: 50.22Min: 51.67 / Avg: 53.44 / Max: 54.35Min: 53.09 / Avg: 53.66 / Max: 54.03Min: 53.97 / Avg: 54.46 / Max: 55.06Min: 53.2 / Avg: 54.88 / Max: 55.71Min: 54.78 / Avg: 55.05 / Max: 55.4Min: 61.51 / Avg: 62.02 / Max: 62.28Min: 62.21 / Avg: 62.7 / Max: 62.95

ASKAP

ASKAP is a set of benchmarks from the Australian SKA Pathfinder. The principal ASKAP benchmarks are the Hogbom Clean Benchmark (tHogbomClean) and Convolutional Resamping Benchmark (tConvolve) as well as some previous ASKAP benchmarks being included as well for OpenCL and CUDA execution of tConvolve. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgMillion Grid Points Per Second, More Is BetterASKAP 1.0Test: tConvolve MT - DegriddingEPYC 8534PEPYC 8534PNXeon Platinum 8380EPYC 9754Xeon Platinum 8380 2PEPYC 9654 2PEPYC 9754 2PEPYC 9684XEPYC 9654EPYC 9684X 2P4K8K12K16K20KSE +/- 34.17, N = 3SE +/- 0.54, N = 3SE +/- 3.76, N = 3SE +/- 25.80, N = 3SE +/- 322.56, N = 3SE +/- 267.65, N = 5SE +/- 345.37, N = 3SE +/- 212.00, N = 12SE +/- 128.32, N = 3SE +/- 889.21, N = 37382.437421.237425.229839.649893.3211941.3013455.0014143.1014217.1016906.201. (CXX) g++ options: -O3 -fstrict-aliasing -fopenmp
OpenBenchmarking.orgMillion Grid Points Per Second, More Is BetterASKAP 1.0Test: tConvolve MT - DegriddingEPYC 8534PEPYC 8534PNXeon Platinum 8380EPYC 9754Xeon Platinum 8380 2PEPYC 9654 2PEPYC 9754 2PEPYC 9684XEPYC 9654EPYC 9684X 2P3K6K9K12K15KMin: 7318.18 / Avg: 7382.43 / Max: 7434.72Min: 7420.15 / Avg: 7421.23 / Max: 7421.77Min: 7419.18 / Avg: 7425.22 / Max: 7432.13Min: 9804.59 / Avg: 9839.64 / Max: 9889.95Min: 9443.8 / Avg: 9893.32 / Max: 10518.8Min: 11477.6 / Avg: 11941.34 / Max: 12906.1Min: 12916.7 / Avg: 13455 / Max: 14099Min: 12899.6 / Avg: 14143.11 / Max: 15187.5Min: 14086.8 / Avg: 14217.07 / Max: 14473.7Min: 15432.8 / Avg: 16906.17 / Max: 18505.41. (CXX) g++ options: -O3 -fstrict-aliasing -fopenmp

TensorFlow

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.16.1Device: CPU - Batch Size: 64 - Model: GoogLeNetXeon 6766E 2PEPYC 9754 2PXeon 6780E 2PXeon 6766EEPYC 9654 2PXeon 6780EEPYC 9684X 2PEPYC 8534PNEPYC 8534PXeon Platinum 8380Xeon Platinum 8592+ 2PXeon Max 9480 2PEPYC 9754Xeon Platinum 8592+EPYC 9684XXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9480Xeon Max 9468 2PXeon Platinum 8380 2PEPYC 9654Xeon Platinum 8490H80160240320400SE +/- 2.29, N = 3SE +/- 1.18, N = 3SE +/- 0.21, N = 3SE +/- 0.29, N = 3SE +/- 2.41, N = 3SE +/- 0.64, N = 3SE +/- 2.47, N = 3SE +/- 0.44, N = 3SE +/- 0.30, N = 3SE +/- 0.49, N = 3SE +/- 0.21, N = 3SE +/- 2.38, N = 3SE +/- 3.84, N = 4SE +/- 1.12, N = 3SE +/- 1.66, N = 3SE +/- 2.37, N = 3SE +/- 1.94, N = 3SE +/- 0.83, N = 3SE +/- 3.52, N = 5SE +/- 1.42, N = 3SE +/- 4.22, N = 3SE +/- 1.62, N = 3168.10176.00190.80214.14227.22232.51248.03256.79276.93282.50291.37308.95314.67319.76330.26331.76333.73335.58341.51347.72354.59380.14
OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.16.1Device: CPU - Batch Size: 64 - Model: GoogLeNetXeon 6766E 2PEPYC 9754 2PXeon 6780E 2PXeon 6766EEPYC 9654 2PXeon 6780EEPYC 9684X 2PEPYC 8534PNEPYC 8534PXeon Platinum 8380Xeon Platinum 8592+ 2PXeon Max 9480 2PEPYC 9754Xeon Platinum 8592+EPYC 9684XXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9480Xeon Max 9468 2PXeon Platinum 8380 2PEPYC 9654Xeon Platinum 8490H70140210280350Min: 163.61 / Avg: 168.1 / Max: 171.14Min: 173.82 / Avg: 176 / Max: 177.86Min: 190.43 / Avg: 190.8 / Max: 191.15Min: 213.78 / Avg: 214.14 / Max: 214.71Min: 223.25 / Avg: 227.22 / Max: 231.56Min: 231.84 / Avg: 232.51 / Max: 233.79Min: 244.25 / Avg: 248.03 / Max: 252.67Min: 256.05 / Avg: 256.79 / Max: 257.56Min: 276.36 / Avg: 276.93 / Max: 277.36Min: 281.79 / Avg: 282.5 / Max: 283.43Min: 291.02 / Avg: 291.37 / Max: 291.73Min: 306.48 / Avg: 308.95 / Max: 313.7Min: 304.02 / Avg: 314.67 / Max: 322.25Min: 317.52 / Avg: 319.76 / Max: 320.93Min: 327.17 / Avg: 330.26 / Max: 332.85Min: 327.05 / Avg: 331.76 / Max: 334.55Min: 329.88 / Avg: 333.73 / Max: 336.1Min: 334.46 / Avg: 335.58 / Max: 337.2Min: 329.53 / Avg: 341.51 / Max: 350.64Min: 344.89 / Avg: 347.72 / Max: 349.16Min: 346.71 / Avg: 354.59 / Max: 361.14Min: 377.14 / Avg: 380.14 / Max: 382.69

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.16.1Device: CPU - Batch Size: 64 - Model: AlexNetXeon 6766EXeon 6766E 2PXeon 6780EXeon 6780E 2PEPYC 8534PNEPYC 9754 2PEPYC 8534PXeon Platinum 8380EPYC 9654 2PEPYC 9684X 2PXeon Platinum 8592+Xeon Max 9468Xeon Max 9480Xeon Platinum 8592+ 2PEPYC 9684XXeon Platinum 8380 2PEPYC 9754Xeon Max 9468 2PXeon Max 9480 2PEPYC 9654Xeon Platinum 8490HXeon Platinum 8490H 2P2004006008001000SE +/- 0.70, N = 3SE +/- 5.44, N = 15SE +/- 0.97, N = 3SE +/- 5.91, N = 15SE +/- 0.16, N = 4SE +/- 7.43, N = 15SE +/- 0.45, N = 4SE +/- 0.27, N = 4SE +/- 8.87, N = 4SE +/- 7.66, N = 5SE +/- 6.22, N = 5SE +/- 1.95, N = 5SE +/- 2.31, N = 5SE +/- 2.22, N = 5SE +/- 1.37, N = 5SE +/- 3.70, N = 5SE +/- 2.99, N = 5SE +/- 6.39, N = 13SE +/- 7.35, N = 5SE +/- 1.31, N = 5SE +/- 0.51, N = 5SE +/- 7.98, N = 5443.74464.80482.06520.01617.03658.97673.42690.09727.77738.31819.89841.68852.36858.84868.54904.36924.80932.59940.40942.19969.62996.47
OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.16.1Device: CPU - Batch Size: 64 - Model: AlexNetXeon 6766EXeon 6766E 2PXeon 6780EXeon 6780E 2PEPYC 8534PNEPYC 9754 2PEPYC 8534PXeon Platinum 8380EPYC 9654 2PEPYC 9684X 2PXeon Platinum 8592+Xeon Max 9468Xeon Max 9480Xeon Platinum 8592+ 2PEPYC 9684XXeon Platinum 8380 2PEPYC 9754Xeon Max 9468 2PXeon Max 9480 2PEPYC 9654Xeon Platinum 8490HXeon Platinum 8490H 2P2004006008001000Min: 442.41 / Avg: 443.74 / Max: 444.77Min: 428.47 / Avg: 464.8 / Max: 502.93Min: 480.54 / Avg: 482.06 / Max: 483.85Min: 478.59 / Avg: 520.01 / Max: 551.77Min: 616.65 / Avg: 617.03 / Max: 617.39Min: 602.85 / Avg: 658.97 / Max: 687.47Min: 672.34 / Avg: 673.42 / Max: 674.49Min: 689.36 / Avg: 690.09 / Max: 690.67Min: 701.83 / Avg: 727.77 / Max: 739.34Min: 720.46 / Avg: 738.31 / Max: 762.68Min: 804.06 / Avg: 819.89 / Max: 835.54Min: 835.07 / Avg: 841.68 / Max: 847.3Min: 843.3 / Avg: 852.36 / Max: 855.6Min: 851.44 / Avg: 858.84 / Max: 863.21Min: 865.09 / Avg: 868.54 / Max: 871.49Min: 891.38 / Avg: 904.36 / Max: 911.98Min: 919.56 / Avg: 924.8 / Max: 935.78Min: 886.72 / Avg: 932.59 / Max: 964.83Min: 915.38 / Avg: 940.4 / Max: 955.94Min: 938.43 / Avg: 942.19 / Max: 945.54Min: 967.81 / Avg: 969.62 / Max: 970.66Min: 974.8 / Avg: 996.47 / Max: 1013.95

Y-Cruncher

Y-Cruncher is a multi-threaded Pi benchmark capable of computing Pi to trillions of digits. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterY-Cruncher 0.8.3Pi Digits To Calculate: 1BXeon 6766EXeon Platinum 8380EPYC 8534PNXeon 6780EEPYC 8534PEPYC 9684X 2PXeon Max 9468EPYC 9654 2PXeon 6766E 2PXeon Max 9480EPYC 9754 2PXeon Platinum 8380 2PEPYC 9684XXeon 6780E 2PXeon Platinum 8490HEPYC 9754EPYC 9654Xeon Platinum 8592+Xeon Max 9468 2PXeon Max 9480 2PXeon Platinum 8592+ 2PXeon Platinum 8490H 2P3691215SE +/- 0.018, N = 4SE +/- 0.011, N = 4SE +/- 0.001, N = 4SE +/- 0.020, N = 4SE +/- 0.005, N = 4SE +/- 0.012, N = 4SE +/- 0.045, N = 5SE +/- 0.012, N = 4SE +/- 0.007, N = 4SE +/- 0.026, N = 5SE +/- 0.049, N = 4SE +/- 0.010, N = 5SE +/- 0.008, N = 4SE +/- 0.002, N = 4SE +/- 0.005, N = 5SE +/- 0.007, N = 4SE +/- 0.008, N = 5SE +/- 0.030, N = 5SE +/- 0.122, N = 15SE +/- 0.142, N = 12SE +/- 0.010, N = 6SE +/- 0.007, N = 611.19810.71210.42710.38610.2058.9928.3008.1967.9677.9597.9157.7447.4717.4687.0476.9286.7436.7016.3346.2665.1105.008
OpenBenchmarking.orgSeconds, Fewer Is BetterY-Cruncher 0.8.3Pi Digits To Calculate: 1BXeon 6766EXeon Platinum 8380EPYC 8534PNXeon 6780EEPYC 8534PEPYC 9684X 2PXeon Max 9468EPYC 9654 2PXeon 6766E 2PXeon Max 9480EPYC 9754 2PXeon Platinum 8380 2PEPYC 9684XXeon 6780E 2PXeon Platinum 8490HEPYC 9754EPYC 9654Xeon Platinum 8592+Xeon Max 9468 2PXeon Max 9480 2PXeon Platinum 8592+ 2PXeon Platinum 8490H 2P3691215Min: 11.16 / Avg: 11.2 / Max: 11.23Min: 10.69 / Avg: 10.71 / Max: 10.74Min: 10.42 / Avg: 10.43 / Max: 10.43Min: 10.35 / Avg: 10.39 / Max: 10.44Min: 10.19 / Avg: 10.2 / Max: 10.21Min: 8.96 / Avg: 8.99 / Max: 9.02Min: 8.2 / Avg: 8.3 / Max: 8.43Min: 8.16 / Avg: 8.2 / Max: 8.22Min: 7.95 / Avg: 7.97 / Max: 7.98Min: 7.91 / Avg: 7.96 / Max: 8.06Min: 7.84 / Avg: 7.91 / Max: 8.06Min: 7.72 / Avg: 7.74 / Max: 7.78Min: 7.45 / Avg: 7.47 / Max: 7.48Min: 7.47 / Avg: 7.47 / Max: 7.47Min: 7.03 / Avg: 7.05 / Max: 7.06Min: 6.92 / Avg: 6.93 / Max: 6.95Min: 6.72 / Avg: 6.74 / Max: 6.76Min: 6.63 / Avg: 6.7 / Max: 6.81Min: 5.91 / Avg: 6.33 / Max: 7.33Min: 5.81 / Avg: 6.27 / Max: 7.49Min: 5.07 / Avg: 5.11 / Max: 5.14Min: 4.99 / Avg: 5.01 / Max: 5.03

OpenBenchmarking.orgSeconds, Fewer Is BetterY-Cruncher 0.8.3Pi Digits To Calculate: 500MXeon 6766EEPYC 8534PNEPYC 8534PXeon Platinum 8380Xeon 6780EEPYC 9684X 2PEPYC 9654 2PEPYC 9684XEPYC 9754 2PEPYC 9754EPYC 9654Xeon Max 9468Xeon Platinum 8380 2PXeon Max 9480Xeon 6766E 2PXeon 6780E 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Max 9468 2PXeon Max 9480 2PXeon Platinum 8592+ 2PXeon Platinum 8490H 2P1.16482.32963.49444.65925.824SE +/- 0.005, N = 6SE +/- 0.008, N = 6SE +/- 0.006, N = 6SE +/- 0.003, N = 6SE +/- 0.007, N = 6SE +/- 0.007, N = 5SE +/- 0.003, N = 5SE +/- 0.003, N = 6SE +/- 0.015, N = 5SE +/- 0.005, N = 6SE +/- 0.003, N = 6SE +/- 0.010, N = 7SE +/- 0.006, N = 7SE +/- 0.023, N = 15SE +/- 0.004, N = 6SE +/- 0.004, N = 6SE +/- 0.008, N = 7SE +/- 0.003, N = 7SE +/- 0.064, N = 15SE +/- 0.074, N = 15SE +/- 0.004, N = 7SE +/- 0.002, N = 85.1775.1655.0774.8744.7704.5104.3294.3124.1003.9683.8503.7813.7243.7043.6293.4113.3913.2673.1102.9612.6592.364
OpenBenchmarking.orgSeconds, Fewer Is BetterY-Cruncher 0.8.3Pi Digits To Calculate: 500MXeon 6766EEPYC 8534PNEPYC 8534PXeon Platinum 8380Xeon 6780EEPYC 9684X 2PEPYC 9654 2PEPYC 9684XEPYC 9754 2PEPYC 9754EPYC 9654Xeon Max 9468Xeon Platinum 8380 2PXeon Max 9480Xeon 6766E 2PXeon 6780E 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Max 9468 2PXeon Max 9480 2PXeon Platinum 8592+ 2PXeon Platinum 8490H 2P246810Min: 5.16 / Avg: 5.18 / Max: 5.2Min: 5.15 / Avg: 5.17 / Max: 5.21Min: 5.06 / Avg: 5.08 / Max: 5.1Min: 4.87 / Avg: 4.87 / Max: 4.89Min: 4.74 / Avg: 4.77 / Max: 4.78Min: 4.49 / Avg: 4.51 / Max: 4.53Min: 4.32 / Avg: 4.33 / Max: 4.34Min: 4.3 / Avg: 4.31 / Max: 4.32Min: 4.04 / Avg: 4.1 / Max: 4.12Min: 3.96 / Avg: 3.97 / Max: 3.99Min: 3.84 / Avg: 3.85 / Max: 3.86Min: 3.74 / Avg: 3.78 / Max: 3.82Min: 3.71 / Avg: 3.72 / Max: 3.76Min: 3.6 / Avg: 3.7 / Max: 3.98Min: 3.61 / Avg: 3.63 / Max: 3.64Min: 3.4 / Avg: 3.41 / Max: 3.42Min: 3.37 / Avg: 3.39 / Max: 3.43Min: 3.26 / Avg: 3.27 / Max: 3.28Min: 2.76 / Avg: 3.11 / Max: 3.5Min: 2.67 / Avg: 2.96 / Max: 3.48Min: 2.65 / Avg: 2.66 / Max: 2.68Min: 2.36 / Avg: 2.36 / Max: 2.38

Liquid-DSP

LiquidSDR's Liquid-DSP is a software-defined radio (SDR) digital signal processing library. This test profile runs a multi-threaded benchmark of this SDR/DSP library focused on embedded platform usage. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgsamples/s, More Is BetterLiquid-DSP 1.6Threads: 1 - Buffer Length: 256 - Filter Length: 57Xeon 6766E 2PXeon 6766EXeon 6780E 2PXeon 6780EEPYC 8534PNEPYC 8534PEPYC 9754 2PEPYC 9754Xeon Platinum 8380 2PXeon Platinum 8380EPYC 9654 2PEPYC 9684X 2PEPYC 9654EPYC 9684XXeon Max 9480 2PXeon Platinum 8490H 2PXeon Max 9468 2PXeon Platinum 8490HXeon Max 9480Xeon Max 9468Xeon Platinum 8592+ 2PXeon Platinum 8592+16M32M48M64M80MSE +/- 2185.81, N = 3SE +/- 20835.33, N = 3SE +/- 11392.00, N = 3SE +/- 5206.83, N = 3SE +/- 393224.42, N = 3SE +/- 4807.40, N = 3SE +/- 8089.77, N = 3SE +/- 7937.25, N = 3SE +/- 178712.37, N = 3SE +/- 15982.63, N = 3SE +/- 486361.09, N = 3SE +/- 34724.31, N = 3SE +/- 12719.19, N = 3SE +/- 7423.69, N = 3SE +/- 822374.71, N = 4SE +/- 3844.19, N = 3SE +/- 4163.33, N = 3SE +/- 666.67, N = 3SE +/- 5364.49, N = 3SE +/- 4910.31, N = 3SE +/- 68119.99, N = 3SE +/- 599433.09, N = 9334393333344466737121333371956674548633346210667462296674627000053930333540896675495466755415667554253335545533366266000669913336706400067074667671276676713033370499000731406671. (CC) gcc options: -O3 -pthread -lm -lc -lliquid
OpenBenchmarking.orgsamples/s, More Is BetterLiquid-DSP 1.6Threads: 1 - Buffer Length: 256 - Filter Length: 57Xeon 6766E 2PXeon 6766EXeon 6780E 2PXeon 6780EEPYC 8534PNEPYC 8534PEPYC 9754 2PEPYC 9754Xeon Platinum 8380 2PXeon Platinum 8380EPYC 9654 2PEPYC 9684X 2PEPYC 9654EPYC 9684XXeon Max 9480 2PXeon Platinum 8490H 2PXeon Max 9468 2PXeon Platinum 8490HXeon Max 9480Xeon Max 9468Xeon Platinum 8592+ 2PXeon Platinum 8592+13M26M39M52M65MMin: 33435000 / Avg: 33439333.33 / Max: 33442000Min: 33403000 / Avg: 33444666.67 / Max: 33466000Min: 37108000 / Avg: 37121333.33 / Max: 37144000Min: 37187000 / Avg: 37195666.67 / Max: 37205000Min: 44996000 / Avg: 45486333.33 / Max: 46264000Min: 46204000 / Avg: 46210666.67 / Max: 46220000Min: 46214000 / Avg: 46229666.67 / Max: 46241000Min: 46258000 / Avg: 46270000 / Max: 46285000Min: 53573000 / Avg: 53930333.33 / Max: 54116000Min: 54064000 / Avg: 54089666.67 / Max: 54119000Min: 53982000 / Avg: 54954666.67 / Max: 55450000Min: 55347000 / Avg: 55415666.67 / Max: 55459000Min: 55400000 / Avg: 55425333.33 / Max: 55440000Min: 55446000 / Avg: 55455333.33 / Max: 55470000Min: 63799000 / Avg: 66266000 / Max: 67110000Min: 66987000 / Avg: 66991333.33 / Max: 66999000Min: 67058000 / Avg: 67064000 / Max: 67072000Min: 67074000 / Avg: 67074666.67 / Max: 67076000Min: 67120000 / Avg: 67127666.67 / Max: 67138000Min: 67122000 / Avg: 67130333.33 / Max: 67139000Min: 70424000 / Avg: 70499000 / Max: 70635000Min: 70713000 / Avg: 73140666.67 / Max: 743440001. (CC) gcc options: -O3 -pthread -lm -lc -lliquid

Timed Linux Kernel Compilation

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed Linux Kernel Compilation 6.8Build: defconfigXeon Platinum 8380EPYC 8534PNEPYC 8534PXeon Max 9468Xeon 6766EXeon Max 9480Xeon Platinum 8490HXeon Platinum 8380 2PEPYC 9754Xeon 6780EXeon 6766E 2PXeon Platinum 8592+EPYC 9654EPYC 9684XXeon 6780E 2PXeon Max 9468 2PEPYC 9754 2PXeon Max 9480 2PXeon Platinum 8490H 2PEPYC 9654 2PEPYC 9684X 2PXeon Platinum 8592+ 2P1326395265SE +/- 0.33, N = 3SE +/- 0.54, N = 4SE +/- 0.50, N = 4SE +/- 0.59, N = 3SE +/- 0.39, N = 6SE +/- 0.57, N = 3SE +/- 0.55, N = 3SE +/- 0.42, N = 5SE +/- 0.44, N = 3SE +/- 0.37, N = 6SE +/- 0.22, N = 14SE +/- 0.39, N = 4SE +/- 0.43, N = 3SE +/- 0.46, N = 3SE +/- 0.28, N = 8SE +/- 0.40, N = 4SE +/- 0.28, N = 7SE +/- 0.31, N = 5SE +/- 0.43, N = 3SE +/- 0.33, N = 3SE +/- 0.17, N = 13SE +/- 0.23, N = 755.7446.3544.2843.4241.1040.5039.4539.4138.5337.6435.5534.5934.5732.8932.6632.1430.6830.5329.9827.6825.8725.87
OpenBenchmarking.orgSeconds, Fewer Is BetterTimed Linux Kernel Compilation 6.8Build: defconfigXeon Platinum 8380EPYC 8534PNEPYC 8534PXeon Max 9468Xeon 6766EXeon Max 9480Xeon Platinum 8490HXeon Platinum 8380 2PEPYC 9754Xeon 6780EXeon 6766E 2PXeon Platinum 8592+EPYC 9654EPYC 9684XXeon 6780E 2PXeon Max 9468 2PEPYC 9754 2PXeon Max 9480 2PXeon Platinum 8490H 2PEPYC 9654 2PEPYC 9684X 2PXeon Platinum 8592+ 2P1122334455Min: 55.28 / Avg: 55.74 / Max: 56.38Min: 45.72 / Avg: 46.35 / Max: 47.95Min: 43.74 / Avg: 44.28 / Max: 45.76Min: 42.78 / Avg: 43.42 / Max: 44.59Min: 40.6 / Avg: 41.09 / Max: 43.02Min: 39.82 / Avg: 40.5 / Max: 41.63Min: 38.81 / Avg: 39.45 / Max: 40.55Min: 38.62 / Avg: 39.41 / Max: 40.66Min: 38.05 / Avg: 38.53 / Max: 39.41Min: 37.15 / Avg: 37.64 / Max: 39.44Min: 35.01 / Avg: 35.55 / Max: 38.24Min: 34.14 / Avg: 34.59 / Max: 35.77Min: 34.04 / Avg: 34.57 / Max: 35.41Min: 32.38 / Avg: 32.89 / Max: 33.81Min: 32.11 / Avg: 32.65 / Max: 34.56Min: 31.72 / Avg: 32.14 / Max: 33.34Min: 30.09 / Avg: 30.68 / Max: 32.31Min: 30.11 / Avg: 30.53 / Max: 31.78Min: 29.37 / Avg: 29.98 / Max: 30.81Min: 27.34 / Avg: 27.68 / Max: 28.34Min: 25.48 / Avg: 25.87 / Max: 27.66Min: 25.39 / Avg: 25.87 / Max: 27.23

OpenRadioss

OpenRadioss is an open-source AGPL-licensed finite element solver for dynamic event analysis OpenRadioss is based on Altair Radioss and open-sourced in 2022. This open-source finite element solver is benchmarked with various example models available from https://www.openradioss.org/models/ and https://github.com/OpenRadioss/ModelExchange/tree/main/Examples. This test is currently using a reference OpenRadioss binary build offered via GitHub. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterOpenRadioss 2023.09.15Model: Cell Phone Drop TestXeon Platinum 8380EPYC 8534PNXeon Max 9468EPYC 8534PXeon Max 9480Xeon Platinum 8490HXeon Platinum 8380 2PXeon Platinum 8490H 2PXeon Platinum 8592+EPYC 9754 2PXeon Max 9480 2PXeon Max 9468 2PXeon Platinum 8592+ 2PEPYC 9754EPYC 9654 2PEPYC 9654EPYC 9684X 2PEPYC 9684X1020304050SE +/- 0.21, N = 3SE +/- 0.35, N = 3SE +/- 0.08, N = 3SE +/- 0.18, N = 3SE +/- 0.02, N = 3SE +/- 0.08, N = 3SE +/- 0.07, N = 3SE +/- 0.10, N = 3SE +/- 0.18, N = 3SE +/- 0.05, N = 3SE +/- 0.05, N = 3SE +/- 0.01, N = 3SE +/- 0.32, N = 3SE +/- 0.26, N = 3SE +/- 0.05, N = 3SE +/- 0.26, N = 3SE +/- 0.05, N = 3SE +/- 0.19, N = 343.4535.9533.7533.2331.9231.4931.1728.2227.9027.8627.6327.5126.8823.6923.5322.5322.5220.45
OpenBenchmarking.orgSeconds, Fewer Is BetterOpenRadioss 2023.09.15Model: Cell Phone Drop TestXeon Platinum 8380EPYC 8534PNXeon Max 9468EPYC 8534PXeon Max 9480Xeon Platinum 8490HXeon Platinum 8380 2PXeon Platinum 8490H 2PXeon Platinum 8592+EPYC 9754 2PXeon Max 9480 2PXeon Max 9468 2PXeon Platinum 8592+ 2PEPYC 9754EPYC 9654 2PEPYC 9654EPYC 9684X 2PEPYC 9684X918273645Min: 43.21 / Avg: 43.45 / Max: 43.87Min: 35.28 / Avg: 35.95 / Max: 36.48Min: 33.61 / Avg: 33.75 / Max: 33.88Min: 32.93 / Avg: 33.23 / Max: 33.56Min: 31.89 / Avg: 31.92 / Max: 31.95Min: 31.4 / Avg: 31.49 / Max: 31.66Min: 31.04 / Avg: 31.17 / Max: 31.24Min: 28.01 / Avg: 28.22 / Max: 28.35Min: 27.61 / Avg: 27.9 / Max: 28.23Min: 27.76 / Avg: 27.86 / Max: 27.91Min: 27.53 / Avg: 27.63 / Max: 27.7Min: 27.5 / Avg: 27.51 / Max: 27.53Min: 26.52 / Avg: 26.88 / Max: 27.52Min: 23.32 / Avg: 23.69 / Max: 24.2Min: 23.43 / Avg: 23.53 / Max: 23.59Min: 22.03 / Avg: 22.53 / Max: 22.91Min: 22.45 / Avg: 22.52 / Max: 22.63Min: 20.19 / Avg: 20.45 / Max: 20.82

TensorFlow

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.16.1Device: CPU - Batch Size: 512 - Model: GoogLeNetXeon 6766EXeon Platinum 8380EPYC 8534PNXeon 6780EEPYC 8534PXeon 6766E 2PXeon 6780E 2PXeon Max 9468Xeon Max 9480Xeon Platinum 8380 2PEPYC 9684XEPYC 9754Xeon Platinum 8490HXeon Platinum 8592+EPYC 9684X 2PXeon Max 9468 2PEPYC 9654Xeon Max 9480 2PEPYC 9654 2PXeon Platinum 8490H 2PXeon Platinum 8592+ 2PEPYC 9754 2P130260390520650SE +/- 0.26, N = 3SE +/- 0.12, N = 3SE +/- 0.03, N = 3SE +/- 0.19, N = 3SE +/- 0.06, N = 3SE +/- 1.19, N = 3SE +/- 1.26, N = 3SE +/- 0.41, N = 3SE +/- 0.37, N = 3SE +/- 0.25, N = 3SE +/- 3.05, N = 12SE +/- 12.03, N = 12SE +/- 0.34, N = 3SE +/- 3.68, N = 3SE +/- 1.60, N = 3SE +/- 1.14, N = 3SE +/- 4.02, N = 10SE +/- 2.46, N = 3SE +/- 5.11, N = 3SE +/- 2.62, N = 3SE +/- 1.52, N = 3SE +/- 5.63, N = 6278.05290.16295.29298.16313.50354.81378.79383.57398.40411.05425.25450.61461.23462.78464.78467.91470.95477.33525.84576.08577.76588.43
OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.16.1Device: CPU - Batch Size: 512 - Model: GoogLeNetXeon 6766EXeon Platinum 8380EPYC 8534PNXeon 6780EEPYC 8534PXeon 6766E 2PXeon 6780E 2PXeon Max 9468Xeon Max 9480Xeon Platinum 8380 2PEPYC 9684XEPYC 9754Xeon Platinum 8490HXeon Platinum 8592+EPYC 9684X 2PXeon Max 9468 2PEPYC 9654Xeon Max 9480 2PEPYC 9654 2PXeon Platinum 8490H 2PXeon Platinum 8592+ 2PEPYC 9754 2P100200300400500Min: 277.62 / Avg: 278.05 / Max: 278.51Min: 289.93 / Avg: 290.16 / Max: 290.3Min: 295.24 / Avg: 295.29 / Max: 295.35Min: 297.89 / Avg: 298.16 / Max: 298.53Min: 313.38 / Avg: 313.5 / Max: 313.6Min: 353.28 / Avg: 354.81 / Max: 357.16Min: 376.87 / Avg: 378.79 / Max: 381.17Min: 382.75 / Avg: 383.57 / Max: 384.07Min: 397.73 / Avg: 398.4 / Max: 398.99Min: 410.59 / Avg: 411.05 / Max: 411.44Min: 417.27 / Avg: 425.25 / Max: 457.11Min: 432.94 / Avg: 450.61 / Max: 582.08Min: 460.79 / Avg: 461.23 / Max: 461.9Min: 455.42 / Avg: 462.78 / Max: 466.49Min: 462.49 / Avg: 464.78 / Max: 467.85Min: 465.67 / Avg: 467.91 / Max: 469.37Min: 449.01 / Avg: 470.95 / Max: 501.08Min: 473.08 / Avg: 477.33 / Max: 481.61Min: 517.73 / Avg: 525.84 / Max: 535.28Min: 572.84 / Avg: 576.08 / Max: 581.26Min: 575.91 / Avg: 577.76 / Max: 580.78Min: 573.12 / Avg: 588.43 / Max: 606.36

Numpy Benchmark

This is a test to obtain the general Numpy performance. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgScore, More Is BetterNumpy BenchmarkXeon 6766E 2PXeon 6766EXeon 6780E 2PXeon 6780EXeon Platinum 8380 2PXeon Platinum 8380EPYC 8534PNEPYC 8534PEPYC 9754 2PEPYC 9754Xeon Max 9468 2PXeon Max 9480 2PXeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9480Xeon Platinum 8592+ 2PXeon Platinum 8592+EPYC 9654 2PEPYC 9654EPYC 9684X 2PEPYC 9684X120240360480600SE +/- 0.30, N = 3SE +/- 0.37, N = 3SE +/- 0.47, N = 3SE +/- 2.24, N = 3SE +/- 1.52, N = 3SE +/- 2.23, N = 3SE +/- 1.34, N = 3SE +/- 0.72, N = 3SE +/- 0.25, N = 3SE +/- 0.96, N = 3SE +/- 1.13, N = 3SE +/- 1.30, N = 3SE +/- 0.33, N = 3SE +/- 0.26, N = 3SE +/- 0.60, N = 3SE +/- 0.79, N = 3SE +/- 1.42, N = 3SE +/- 1.84, N = 3SE +/- 0.38, N = 3SE +/- 2.28, N = 3SE +/- 0.60, N = 3SE +/- 1.85, N = 3258.49261.19283.52284.33394.71400.64418.89421.99422.76425.46435.21439.84455.57456.18461.61464.72519.89520.22529.03529.80540.96542.15
OpenBenchmarking.orgScore, More Is BetterNumpy BenchmarkXeon 6766E 2PXeon 6766EXeon 6780E 2PXeon 6780EXeon Platinum 8380 2PXeon Platinum 8380EPYC 8534PNEPYC 8534PEPYC 9754 2PEPYC 9754Xeon Max 9468 2PXeon Max 9480 2PXeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9480Xeon Platinum 8592+ 2PXeon Platinum 8592+EPYC 9654 2PEPYC 9654EPYC 9684X 2PEPYC 9684X100200300400500Min: 258.04 / Avg: 258.49 / Max: 259.07Min: 260.75 / Avg: 261.19 / Max: 261.92Min: 282.76 / Avg: 283.52 / Max: 284.38Min: 279.91 / Avg: 284.33 / Max: 287.2Min: 393.14 / Avg: 394.71 / Max: 397.75Min: 396.21 / Avg: 400.64 / Max: 403.28Min: 416.21 / Avg: 418.89 / Max: 420.32Min: 420.54 / Avg: 421.99 / Max: 422.78Min: 422.26 / Avg: 422.76 / Max: 423.07Min: 423.54 / Avg: 425.46 / Max: 426.47Min: 433.47 / Avg: 435.21 / Max: 437.33Min: 437.94 / Avg: 439.84 / Max: 442.32Min: 454.98 / Avg: 455.57 / Max: 456.12Min: 455.67 / Avg: 456.18 / Max: 456.52Min: 460.51 / Avg: 461.61 / Max: 462.58Min: 463.6 / Avg: 464.72 / Max: 466.25Min: 517.06 / Avg: 519.89 / Max: 521.5Min: 518.27 / Avg: 520.22 / Max: 523.89Min: 528.29 / Avg: 529.03 / Max: 529.54Min: 525.41 / Avg: 529.8 / Max: 533.05Min: 540.23 / Avg: 540.96 / Max: 542.15Min: 539.94 / Avg: 542.15 / Max: 545.82

FFmpeg

OpenBenchmarking.orgFPS, More Is BetterFFmpeg 7.0Encoder: libx265 - Scenario: Video On DemandXeon 6766E 2PXeon 6766EXeon 6780E 2PXeon 6780EXeon Platinum 8380 2PXeon Platinum 8380Xeon Max 9468 2PXeon Max 9480 2PEPYC 8534PEPYC 8534PNEPYC 9754 2PEPYC 9754Xeon Max 9468Xeon Max 9480Xeon Platinum 8490H 2PXeon Platinum 8490HEPYC 9654 2PXeon Platinum 8592+ 2PXeon Platinum 8592+EPYC 9684X 2PEPYC 9684XEPYC 96541224364860SE +/- 0.04, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.02, N = 3SE +/- 0.07, N = 3SE +/- 0.43, N = 3SE +/- 0.13, N = 3SE +/- 0.02, N = 3SE +/- 0.05, N = 3SE +/- 0.00, N = 3SE +/- 0.03, N = 3SE +/- 0.10, N = 3SE +/- 0.07, N = 3SE +/- 0.03, N = 3SE +/- 0.02, N = 3SE +/- 0.03, N = 3SE +/- 0.14, N = 3SE +/- 0.03, N = 3SE +/- 0.07, N = 3SE +/- 0.03, N = 3SE +/- 0.03, N = 326.8927.1728.3929.9543.8044.1345.2946.7946.8846.9347.1447.3347.3448.1448.7749.8452.8153.2953.9955.0155.5655.591. (CXX) g++ options: -O3 -rdynamic -lpthread -lrt -ldl -lnuma
OpenBenchmarking.orgFPS, More Is BetterFFmpeg 7.0Encoder: libx265 - Scenario: Video On DemandXeon 6766E 2PXeon 6766EXeon 6780E 2PXeon 6780EXeon Platinum 8380 2PXeon Platinum 8380Xeon Max 9468 2PXeon Max 9480 2PEPYC 8534PEPYC 8534PNEPYC 9754 2PEPYC 9754Xeon Max 9468Xeon Max 9480Xeon Platinum 8490H 2PXeon Platinum 8490HEPYC 9654 2PXeon Platinum 8592+ 2PXeon Platinum 8592+EPYC 9684X 2PEPYC 9684XEPYC 96541122334455Min: 26.8 / Avg: 26.89 / Max: 26.94Min: 27.17 / Avg: 27.17 / Max: 27.18Min: 28.38 / Avg: 28.39 / Max: 28.4Min: 29.95 / Avg: 29.95 / Max: 29.95Min: 43.78 / Avg: 43.8 / Max: 43.85Min: 44.03 / Avg: 44.13 / Max: 44.27Min: 44.84 / Avg: 45.29 / Max: 46.15Min: 46.53 / Avg: 46.79 / Max: 46.92Min: 46.83 / Avg: 46.88 / Max: 46.92Min: 46.88 / Avg: 46.93 / Max: 47.03Min: 47.13 / Avg: 47.14 / Max: 47.14Min: 47.29 / Avg: 47.33 / Max: 47.38Min: 47.24 / Avg: 47.34 / Max: 47.53Min: 48 / Avg: 48.14 / Max: 48.22Min: 48.7 / Avg: 48.77 / Max: 48.81Min: 49.82 / Avg: 49.84 / Max: 49.88Min: 52.75 / Avg: 52.81 / Max: 52.87Min: 53.03 / Avg: 53.29 / Max: 53.49Min: 53.93 / Avg: 53.99 / Max: 54.05Min: 54.93 / Avg: 55.01 / Max: 55.14Min: 55.5 / Avg: 55.56 / Max: 55.6Min: 55.54 / Avg: 55.59 / Max: 55.651. (CXX) g++ options: -O3 -rdynamic -lpthread -lrt -ldl -lnuma

OpenBenchmarking.orgFPS, More Is BetterFFmpeg 7.0Encoder: libx265 - Scenario: PlatformXeon 6766E 2PXeon 6766EXeon 6780E 2PXeon 6780EXeon Platinum 8380 2PXeon Platinum 8380Xeon Max 9468 2PXeon Max 9480 2PEPYC 8534PNEPYC 8534PEPYC 9754 2PEPYC 9754Xeon Max 9468Xeon Max 9480Xeon Platinum 8490H 2PXeon Platinum 8490HEPYC 9654 2PXeon Platinum 8592+ 2PXeon Platinum 8592+EPYC 9684X 2PEPYC 9684XEPYC 96541224364860SE +/- 0.03, N = 3SE +/- 0.00, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.05, N = 3SE +/- 0.08, N = 3SE +/- 0.09, N = 3SE +/- 0.27, N = 3SE +/- 0.03, N = 3SE +/- 0.02, N = 3SE +/- 0.02, N = 3SE +/- 0.01, N = 3SE +/- 0.03, N = 3SE +/- 0.08, N = 3SE +/- 0.12, N = 3SE +/- 0.16, N = 3SE +/- 0.01, N = 3SE +/- 0.15, N = 3SE +/- 0.14, N = 3SE +/- 0.04, N = 3SE +/- 0.01, N = 3SE +/- 0.02, N = 326.9027.1728.3929.9443.5544.0145.9546.5946.8646.8747.1347.3147.3248.3548.7649.7952.7953.2253.9255.1155.3855.611. (CXX) g++ options: -O3 -rdynamic -lpthread -lrt -ldl -lnuma
OpenBenchmarking.orgFPS, More Is BetterFFmpeg 7.0Encoder: libx265 - Scenario: PlatformXeon 6766E 2PXeon 6766EXeon 6780E 2PXeon 6780EXeon Platinum 8380 2PXeon Platinum 8380Xeon Max 9468 2PXeon Max 9480 2PEPYC 8534PNEPYC 8534PEPYC 9754 2PEPYC 9754Xeon Max 9468Xeon Max 9480Xeon Platinum 8490H 2PXeon Platinum 8490HEPYC 9654 2PXeon Platinum 8592+ 2PXeon Platinum 8592+EPYC 9684X 2PEPYC 9684XEPYC 96541122334455Min: 26.86 / Avg: 26.9 / Max: 26.95Min: 27.16 / Avg: 27.17 / Max: 27.17Min: 28.37 / Avg: 28.39 / Max: 28.41Min: 29.92 / Avg: 29.94 / Max: 29.95Min: 43.45 / Avg: 43.55 / Max: 43.6Min: 43.87 / Avg: 44.01 / Max: 44.14Min: 45.76 / Avg: 45.95 / Max: 46.05Min: 46.08 / Avg: 46.59 / Max: 47.01Min: 46.83 / Avg: 46.86 / Max: 46.92Min: 46.84 / Avg: 46.87 / Max: 46.89Min: 47.11 / Avg: 47.13 / Max: 47.16Min: 47.3 / Avg: 47.31 / Max: 47.32Min: 47.27 / Avg: 47.32 / Max: 47.37Min: 48.2 / Avg: 48.35 / Max: 48.48Min: 48.53 / Avg: 48.76 / Max: 48.93Min: 49.5 / Avg: 49.79 / Max: 50.05Min: 52.77 / Avg: 52.79 / Max: 52.81Min: 52.97 / Avg: 53.22 / Max: 53.47Min: 53.65 / Avg: 53.92 / Max: 54.09Min: 55.05 / Avg: 55.11 / Max: 55.18Min: 55.36 / Avg: 55.38 / Max: 55.4Min: 55.58 / Avg: 55.61 / Max: 55.651. (CXX) g++ options: -O3 -rdynamic -lpthread -lrt -ldl -lnuma

SVT-AV1

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 2.0Encoder Mode: Preset 8 - Input: Bosphorus 4KXeon 6766E 2PXeon 6766EXeon 6780E 2PXeon 6780EXeon Max 9468 2PXeon Platinum 8380Xeon Max 9480 2PXeon Platinum 8380 2PXeon Max 9468EPYC 8534PNXeon Platinum 8490H 2PXeon Max 9480EPYC 8534PXeon Platinum 8592+ 2PXeon Platinum 8490HEPYC 9754 2PEPYC 9754Xeon Platinum 8592+EPYC 9684XEPYC 9654 2PEPYC 9684X 2PEPYC 965420406080100SE +/- 0.35, N = 15SE +/- 0.03, N = 4SE +/- 0.34, N = 3SE +/- 0.02, N = 4SE +/- 0.58, N = 5SE +/- 0.09, N = 4SE +/- 0.44, N = 15SE +/- 0.52, N = 7SE +/- 0.26, N = 4SE +/- 0.67, N = 4SE +/- 0.46, N = 4SE +/- 0.29, N = 4SE +/- 0.11, N = 4SE +/- 0.79, N = 5SE +/- 0.20, N = 5SE +/- 0.31, N = 4SE +/- 0.38, N = 5SE +/- 0.22, N = 5SE +/- 0.42, N = 5SE +/- 0.40, N = 5SE +/- 0.63, N = 5SE +/- 0.56, N = 542.8646.4847.2550.8254.8255.2455.9859.1062.7564.7965.2265.3668.1970.4370.9177.6078.7479.4486.3086.3487.8287.991. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq
OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 2.0Encoder Mode: Preset 8 - Input: Bosphorus 4KXeon 6766E 2PXeon 6766EXeon 6780E 2PXeon 6780EXeon Max 9468 2PXeon Platinum 8380Xeon Max 9480 2PXeon Platinum 8380 2PXeon Max 9468EPYC 8534PNXeon Platinum 8490H 2PXeon Max 9480EPYC 8534PXeon Platinum 8592+ 2PXeon Platinum 8490HEPYC 9754 2PEPYC 9754Xeon Platinum 8592+EPYC 9684XEPYC 9654 2PEPYC 9684X 2PEPYC 965420406080100Min: 39.51 / Avg: 42.86 / Max: 44.34Min: 46.42 / Avg: 46.48 / Max: 46.56Min: 46.79 / Avg: 47.25 / Max: 47.91Min: 50.78 / Avg: 50.82 / Max: 50.87Min: 53.25 / Avg: 54.82 / Max: 56.57Min: 55.06 / Avg: 55.24 / Max: 55.4Min: 53.7 / Avg: 55.98 / Max: 59Min: 57.24 / Avg: 59.1 / Max: 61.46Min: 62.03 / Avg: 62.75 / Max: 63.22Min: 63.17 / Avg: 64.79 / Max: 66.14Min: 64.17 / Avg: 65.22 / Max: 66.2Min: 64.77 / Avg: 65.36 / Max: 66.14Min: 68 / Avg: 68.19 / Max: 68.46Min: 68.36 / Avg: 70.43 / Max: 73.07Min: 70.19 / Avg: 70.91 / Max: 71.45Min: 76.99 / Avg: 77.6 / Max: 78.2Min: 77.49 / Avg: 78.74 / Max: 79.79Min: 78.71 / Avg: 79.44 / Max: 80.05Min: 85.05 / Avg: 86.3 / Max: 87.48Min: 85.17 / Avg: 86.34 / Max: 87.48Min: 86.16 / Avg: 87.82 / Max: 89.96Min: 87.19 / Avg: 87.99 / Max: 90.11. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

QuantLib

QuantLib is an open-source library/framework around quantitative finance for modeling, trading and risk management scenarios. QuantLib is written in C++ with Boost and its built-in benchmark used reports the QuantLib Benchmark Index benchmark score. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgMFLOPS, More Is BetterQuantLib 1.32Configuration: Single-ThreadedXeon 6766E 2PXeon 6766EXeon 6780E 2PXeon 6780EXeon Platinum 8380Xeon Platinum 8380 2PEPYC 9754 2PEPYC 8534PNEPYC 8534PEPYC 9754EPYC 9654 2PEPYC 9654EPYC 9684XEPYC 9684X 2PXeon Max 9468 2PXeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9480 2PXeon Max 9468Xeon Max 9480Xeon Platinum 8592+ 2PXeon Platinum 8592+8001600240032004000SE +/- 4.34, N = 3SE +/- 4.87, N = 3SE +/- 7.35, N = 3SE +/- 6.88, N = 3SE +/- 14.88, N = 3SE +/- 2.82, N = 3SE +/- 19.30, N = 3SE +/- 14.40, N = 3SE +/- 18.64, N = 3SE +/- 14.83, N = 3SE +/- 19.83, N = 3SE +/- 24.27, N = 3SE +/- 22.39, N = 3SE +/- 1.14, N = 3SE +/- 28.11, N = 3SE +/- 28.42, N = 3SE +/- 25.40, N = 3SE +/- 28.57, N = 3SE +/- 22.17, N = 3SE +/- 25.35, N = 3SE +/- 30.36, N = 12SE +/- 33.58, N = 31760.81765.61954.21960.72534.52558.62590.82593.02593.32596.13098.53105.93114.23125.43207.03209.63210.13222.83225.73229.13586.33600.51. (CXX) g++ options: -O3 -march=native -fPIE -pie
OpenBenchmarking.orgMFLOPS, More Is BetterQuantLib 1.32Configuration: Single-ThreadedXeon 6766E 2PXeon 6766EXeon 6780E 2PXeon 6780EXeon Platinum 8380Xeon Platinum 8380 2PEPYC 9754 2PEPYC 8534PNEPYC 8534PEPYC 9754EPYC 9654 2PEPYC 9654EPYC 9684XEPYC 9684X 2PXeon Max 9468 2PXeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9480 2PXeon Max 9468Xeon Max 9480Xeon Platinum 8592+ 2PXeon Platinum 8592+6001200180024003000Min: 1752.2 / Avg: 1760.8 / Max: 1766.1Min: 1755.9 / Avg: 1765.63 / Max: 1770.5Min: 1940.6 / Avg: 1954.23 / Max: 1965.8Min: 1949.9 / Avg: 1960.73 / Max: 1973.5Min: 2505.7 / Avg: 2534.53 / Max: 2555.3Min: 2554.7 / Avg: 2558.63 / Max: 2564.1Min: 2552.3 / Avg: 2590.83 / Max: 2612Min: 2566 / Avg: 2592.97 / Max: 2615.2Min: 2556.1 / Avg: 2593.27 / Max: 2614.3Min: 2567.2 / Avg: 2596.07 / Max: 2616.4Min: 3060.1 / Avg: 3098.53 / Max: 3126.2Min: 3057.7 / Avg: 3105.87 / Max: 3135.2Min: 3069.5 / Avg: 3114.23 / Max: 3138.4Min: 3123.2 / Avg: 3125.4 / Max: 3127Min: 3153.8 / Avg: 3207.03 / Max: 3249.3Min: 3152.8 / Avg: 3209.63 / Max: 3239Min: 3159.5 / Avg: 3210.1 / Max: 3239.3Min: 3165.7 / Avg: 3222.8 / Max: 3253Min: 3181.4 / Avg: 3225.73 / Max: 3247.9Min: 3178.4 / Avg: 3229.1 / Max: 3254.8Min: 3261.3 / Avg: 3586.3 / Max: 3632.5Min: 3533.3 / Avg: 3600.47 / Max: 3634.31. (CXX) g++ options: -O3 -march=native -fPIE -pie

TensorFlow

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.16.1Device: CPU - Batch Size: 256 - Model: GoogLeNetXeon 6766EXeon 6780EEPYC 8534PNXeon Platinum 8380Xeon 6766E 2PEPYC 8534PXeon 6780E 2PXeon Max 9468Xeon Max 9480EPYC 9684X 2PEPYC 9754 2PEPYC 9654 2PXeon Platinum 8380 2PEPYC 9684XXeon Platinum 8592+Xeon Max 9468 2PEPYC 9654Xeon Platinum 8490HXeon Max 9480 2PEPYC 9754Xeon Platinum 8592+ 2PXeon Platinum 8490H 2P110220330440550SE +/- 0.31, N = 3SE +/- 0.07, N = 3SE +/- 0.07, N = 3SE +/- 0.16, N = 3SE +/- 3.73, N = 4SE +/- 0.04, N = 3SE +/- 2.49, N = 3SE +/- 1.67, N = 3SE +/- 1.91, N = 3SE +/- 0.51, N = 3SE +/- 1.11, N = 3SE +/- 1.02, N = 3SE +/- 0.69, N = 3SE +/- 2.76, N = 15SE +/- 2.30, N = 3SE +/- 2.29, N = 3SE +/- 3.87, N = 15SE +/- 0.24, N = 3SE +/- 4.80, N = 3SE +/- 10.93, N = 12SE +/- 2.68, N = 3SE +/- 4.87, N = 3260.83281.62287.42290.27301.46308.46335.38375.73386.00391.40397.44401.84402.78406.58423.59447.50447.61448.46449.91462.79501.39528.93
OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.16.1Device: CPU - Batch Size: 256 - Model: GoogLeNetXeon 6766EXeon 6780EEPYC 8534PNXeon Platinum 8380Xeon 6766E 2PEPYC 8534PXeon 6780E 2PXeon Max 9468Xeon Max 9480EPYC 9684X 2PEPYC 9754 2PEPYC 9654 2PXeon Platinum 8380 2PEPYC 9684XXeon Platinum 8592+Xeon Max 9468 2PEPYC 9654Xeon Platinum 8490HXeon Max 9480 2PEPYC 9754Xeon Platinum 8592+ 2PXeon Platinum 8490H 2P90180270360450Min: 260.46 / Avg: 260.83 / Max: 261.44Min: 281.51 / Avg: 281.62 / Max: 281.75Min: 287.28 / Avg: 287.42 / Max: 287.52Min: 289.96 / Avg: 290.27 / Max: 290.48Min: 294.17 / Avg: 301.46 / Max: 311.53Min: 308.4 / Avg: 308.46 / Max: 308.54Min: 330.82 / Avg: 335.38 / Max: 339.39Min: 372.9 / Avg: 375.73 / Max: 378.68Min: 382.18 / Avg: 386 / Max: 388.1Min: 390.4 / Avg: 391.4 / Max: 392.06Min: 395.26 / Avg: 397.44 / Max: 398.87Min: 399.84 / Avg: 401.84 / Max: 403.19Min: 401.79 / Avg: 402.78 / Max: 404.1Min: 393.15 / Avg: 406.58 / Max: 426.62Min: 419.06 / Avg: 423.59 / Max: 426.5Min: 443.1 / Avg: 447.5 / Max: 450.82Min: 429.54 / Avg: 447.61 / Max: 484.44Min: 448.09 / Avg: 448.46 / Max: 448.91Min: 440.94 / Avg: 449.91 / Max: 457.38Min: 429.85 / Avg: 462.79 / Max: 538.85Min: 496.29 / Avg: 501.39 / Max: 505.37Min: 519.66 / Avg: 528.93 / Max: 536.16

Apache IoTDB

Apache IotDB is a time series database and this benchmark is facilitated using the IoT Benchmaark [https://github.com/thulab/iot-benchmark/]. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgAverage Latency, Fewer Is BetterApache IoTDB 1.2Device Count: 800 - Batch Size Per Write: 100 - Sensor Count: 800 - Client Number: 100Xeon 6766E 2PXeon Platinum 8380 2PXeon 6780E 2PXeon Platinum 8380Xeon Max 9480 2PXeon Max 9468 2PXeon Platinum 8490H 2PXeon 6766EXeon Max 9468Xeon Max 9480Xeon Platinum 8490HXeon 6780EXeon Platinum 8592+ 2PXeon Platinum 8592+EPYC 9754 2PEPYC 8534PEPYC 8534PNEPYC 9684X 2PEPYC 9654 2PEPYC 9754EPYC 9654EPYC 9684X20406080100SE +/- 1.37, N = 3SE +/- 0.53, N = 3SE +/- 0.65, N = 3SE +/- 0.43, N = 3SE +/- 1.11, N = 4SE +/- 1.01, N = 3SE +/- 1.18, N = 3SE +/- 0.11, N = 3SE +/- 0.48, N = 3SE +/- 0.87, N = 3SE +/- 0.15, N = 3SE +/- 0.15, N = 3SE +/- 0.80, N = 7SE +/- 0.68, N = 3SE +/- 0.79, N = 12SE +/- 0.31, N = 3SE +/- 0.03, N = 3SE +/- 0.59, N = 12SE +/- 0.65, N = 12SE +/- 0.10, N = 3SE +/- 0.31, N = 3SE +/- 0.23, N = 3107.28102.67101.49100.2995.3994.8492.2390.3190.0289.5385.1684.5982.7381.7366.5465.6664.9361.4661.0758.1153.7752.93
OpenBenchmarking.orgAverage Latency, Fewer Is BetterApache IoTDB 1.2Device Count: 800 - Batch Size Per Write: 100 - Sensor Count: 800 - Client Number: 100Xeon 6766E 2PXeon Platinum 8380 2PXeon 6780E 2PXeon Platinum 8380Xeon Max 9480 2PXeon Max 9468 2PXeon Platinum 8490H 2PXeon 6766EXeon Max 9468Xeon Max 9480Xeon Platinum 8490HXeon 6780EXeon Platinum 8592+ 2PXeon Platinum 8592+EPYC 9754 2PEPYC 8534PEPYC 8534PNEPYC 9684X 2PEPYC 9654 2PEPYC 9754EPYC 9654EPYC 9684X20406080100Min: 105.65 / Avg: 107.28 / Max: 110.01Min: 101.64 / Avg: 102.67 / Max: 103.41Min: 100.32 / Avg: 101.49 / Max: 102.58Min: 99.82 / Avg: 100.29 / Max: 101.15Min: 93.94 / Avg: 95.39 / Max: 98.68Min: 93.52 / Avg: 94.84 / Max: 96.82Min: 90.17 / Avg: 92.23 / Max: 94.25Min: 90.08 / Avg: 90.31 / Max: 90.43Min: 89.39 / Avg: 90.02 / Max: 90.97Min: 88.61 / Avg: 89.53 / Max: 91.26Min: 84.91 / Avg: 85.16 / Max: 85.42Min: 84.37 / Avg: 84.59 / Max: 84.88Min: 81.11 / Avg: 82.73 / Max: 87.36Min: 80.98 / Avg: 81.73 / Max: 83.09Min: 63.73 / Avg: 66.54 / Max: 74.56Min: 65.33 / Avg: 65.66 / Max: 66.28Min: 64.89 / Avg: 64.93 / Max: 65Min: 60.06 / Avg: 61.46 / Max: 67.79Min: 59.04 / Avg: 61.07 / Max: 66.93Min: 57.9 / Avg: 58.11 / Max: 58.22Min: 53.41 / Avg: 53.77 / Max: 54.38Min: 52.58 / Avg: 52.93 / Max: 53.36

ClickHouse

ClickHouse is an open-source, high performance OLAP data management system. This test profile uses ClickHouse's standard benchmark recommendations per https://clickhouse.com/docs/en/operations/performance-test/ / https://github.com/ClickHouse/ClickBench/tree/main/clickhouse with the 100 million rows web analytics dataset. The reported value is the query processing time using the geometric mean of all separate queries performed as an aggregate. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgQueries Per Minute, Geo Mean, More Is BetterClickHouse 22.12.3.5100M Rows Hits Dataset, Second RunXeon Platinum 8380 2PXeon 6766E 2PEPYC 8534PEPYC 8534PNXeon 6780E 2PXeon Platinum 8380Xeon 6766EXeon 6780EEPYC 9754 2PXeon Platinum 8592+ 2PEPYC 9754Xeon Platinum 8592+Xeon Max 9468Xeon Max 9480 2PXeon Max 9480Xeon Platinum 8490HXeon Max 9468 2PXeon Platinum 8490H 2PEPYC 9684X 2PEPYC 9654 2PEPYC 9654EPYC 9684X130260390520650SE +/- 3.61, N = 3SE +/- 1.53, N = 3SE +/- 2.99, N = 3SE +/- 5.72, N = 3SE +/- 3.25, N = 3SE +/- 0.73, N = 3SE +/- 3.34, N = 3SE +/- 2.12, N = 3SE +/- 4.85, N = 5SE +/- 3.10, N = 5SE +/- 9.26, N = 3SE +/- 2.86, N = 6SE +/- 1.94, N = 3SE +/- 3.17, N = 12SE +/- 4.95, N = 3SE +/- 2.93, N = 3SE +/- 0.19, N = 3SE +/- 3.26, N = 3SE +/- 6.78, N = 3SE +/- 8.37, N = 3SE +/- 3.14, N = 3SE +/- 0.42, N = 3295.43320.17337.32337.44339.50339.67381.05403.96420.35443.58450.12455.79465.06467.96474.68486.05499.18507.56528.21529.80562.50597.73
OpenBenchmarking.orgQueries Per Minute, Geo Mean, More Is BetterClickHouse 22.12.3.5100M Rows Hits Dataset, Second RunXeon Platinum 8380 2PXeon 6766E 2PEPYC 8534PEPYC 8534PNXeon 6780E 2PXeon Platinum 8380Xeon 6766EXeon 6780EEPYC 9754 2PXeon Platinum 8592+ 2PEPYC 9754Xeon Platinum 8592+Xeon Max 9468Xeon Max 9480 2PXeon Max 9480Xeon Platinum 8490HXeon Max 9468 2PXeon Platinum 8490H 2PEPYC 9684X 2PEPYC 9654 2PEPYC 9654EPYC 9684X110220330440550Min: 290.91 / Avg: 295.43 / Max: 302.57Min: 317.16 / Avg: 320.17 / Max: 322.11Min: 332.75 / Avg: 337.32 / Max: 342.95Min: 327.9 / Avg: 337.44 / Max: 347.68Min: 334.44 / Avg: 339.5 / Max: 345.56Min: 338.59 / Avg: 339.67 / Max: 341.07Min: 377.57 / Avg: 381.05 / Max: 387.74Min: 400 / Avg: 403.96 / Max: 407.24Min: 406.2 / Avg: 420.35 / Max: 435.49Min: 433.51 / Avg: 443.58 / Max: 451.39Min: 440.11 / Avg: 450.12 / Max: 468.63Min: 447.71 / Avg: 455.79 / Max: 463.66Min: 461.49 / Avg: 465.06 / Max: 468.18Min: 454.49 / Avg: 467.96 / Max: 490.02Min: 465.01 / Avg: 474.68 / Max: 481.39Min: 481.53 / Avg: 486.05 / Max: 491.55Min: 498.98 / Avg: 499.18 / Max: 499.57Min: 503.94 / Avg: 507.56 / Max: 514.07Min: 521.36 / Avg: 528.21 / Max: 541.76Min: 514.57 / Avg: 529.8 / Max: 543.43Min: 556.37 / Avg: 562.5 / Max: 566.71Min: 596.95 / Avg: 597.73 / Max: 598.4

Apache IoTDB

Apache IotDB is a time series database and this benchmark is facilitated using the IoT Benchmaark [https://github.com/thulab/iot-benchmark/]. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgpoint/sec, More Is BetterApache IoTDB 1.2Device Count: 800 - Batch Size Per Write: 100 - Sensor Count: 800 - Client Number: 100Xeon 6766E 2PXeon Platinum 8380 2PXeon 6780E 2PXeon Platinum 8380Xeon Max 9480 2PXeon Max 9468 2PXeon Platinum 8490H 2PXeon 6766EXeon Max 9468Xeon Max 9480Xeon Platinum 8490HXeon 6780EXeon Platinum 8592+ 2PXeon Platinum 8592+EPYC 9754 2PEPYC 8534PEPYC 8534PNEPYC 9684X 2PEPYC 9654 2PEPYC 9754EPYC 9654EPYC 9684X30M60M90M120M150MSE +/- 769517.20, N = 3SE +/- 365828.34, N = 3SE +/- 207721.96, N = 3SE +/- 306106.55, N = 3SE +/- 872659.60, N = 4SE +/- 594234.55, N = 3SE +/- 928557.10, N = 3SE +/- 84917.07, N = 3SE +/- 435900.66, N = 3SE +/- 782176.98, N = 3SE +/- 276414.35, N = 3SE +/- 174748.00, N = 3SE +/- 862582.24, N = 7SE +/- 739343.51, N = 3SE +/- 1225528.40, N = 12SE +/- 576868.09, N = 3SE +/- 41021.96, N = 3SE +/- 1058559.19, N = 12SE +/- 1249999.63, N = 12SE +/- 263772.09, N = 3SE +/- 665173.47, N = 3SE +/- 538692.55, N = 37166400575178480757401397672949580139566807704658365178585117897857445428635451890871770909734149277163994616807115317834116879799117884977124947288125595607131781309142102254144760448
OpenBenchmarking.orgpoint/sec, More Is BetterApache IoTDB 1.2Device Count: 800 - Batch Size Per Write: 100 - Sensor Count: 800 - Client Number: 100Xeon 6766E 2PXeon Platinum 8380 2PXeon 6780E 2PXeon Platinum 8380Xeon Max 9480 2PXeon Max 9468 2PXeon Platinum 8490H 2PXeon 6766EXeon Max 9468Xeon Max 9480Xeon Platinum 8490HXeon 6780EXeon Platinum 8592+ 2PXeon Platinum 8592+EPYC 9754 2PEPYC 8534PEPYC 8534PNEPYC 9684X 2PEPYC 9654 2PEPYC 9754EPYC 9654EPYC 9684X30M60M90M120M150MMin: 70146710.56 / Avg: 71664005.03 / Max: 72645885.98Min: 74767014.72 / Avg: 75178480.09 / Max: 75908152.95Min: 75434969.51 / Avg: 75740139.3 / Max: 76136852.81Min: 76202042.96 / Avg: 76729495.33 / Max: 77262385.32Min: 77579252.22 / Avg: 80139565.75 / Max: 81426556.35Min: 79582539.09 / Avg: 80770464.9 / Max: 81395545.65Min: 82086029.92 / Avg: 83651785.32 / Max: 85299511.22Min: 84948339.38 / Avg: 85117897.48 / Max: 85211059Min: 84895320.77 / Avg: 85744542.22 / Max: 86339873.09Min: 84804662.47 / Avg: 86354518.4 / Max: 87313463.81Min: 90321310.22 / Avg: 90871770.37 / Max: 91191271.14Min: 90630375.12 / Avg: 90973413.94 / Max: 91202845.97Min: 87833481.05 / Avg: 92771638.71 / Max: 94723672.41Min: 93141563.61 / Avg: 94616807.11 / Max: 95441772.58Min: 103181555.75 / Avg: 115317833.87 / Max: 119933113.35Min: 115726293.47 / Avg: 116879798.99 / Max: 117476529.93Min: 117840008.82 / Avg: 117884976.56 / Max: 117966889.63Min: 113723801.33 / Avg: 124947287.85 / Max: 128081350.59Min: 114727224.61 / Avg: 125595606.97 / Max: 129945596.97Min: 131336080.34 / Avg: 131781309.4 / Max: 132248986.1Min: 140773486.6 / Avg: 142102254 / Max: 142822763.62Min: 143706640.39 / Avg: 144760447.53 / Max: 145481482.17

ClickHouse

ClickHouse is an open-source, high performance OLAP data management system. This test profile uses ClickHouse's standard benchmark recommendations per https://clickhouse.com/docs/en/operations/performance-test/ / https://github.com/ClickHouse/ClickBench/tree/main/clickhouse with the 100 million rows web analytics dataset. The reported value is the query processing time using the geometric mean of all separate queries performed as an aggregate. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgQueries Per Minute, Geo Mean, More Is BetterClickHouse 22.12.3.5100M Rows Hits Dataset, Third RunXeon Platinum 8380 2PXeon 6766E 2PEPYC 8534PNXeon 6780E 2PEPYC 8534PXeon Platinum 8380Xeon 6766EXeon 6780EEPYC 9754 2PXeon Platinum 8592+ 2PXeon Platinum 8592+EPYC 9754Xeon Max 9468Xeon Max 9480 2PXeon Max 9480Xeon Platinum 8490HXeon Max 9468 2PXeon Platinum 8490H 2PEPYC 9654 2PEPYC 9684X 2PEPYC 9654EPYC 9684X130260390520650SE +/- 1.27, N = 3SE +/- 1.59, N = 3SE +/- 5.23, N = 3SE +/- 3.52, N = 3SE +/- 1.77, N = 3SE +/- 4.79, N = 3SE +/- 2.14, N = 3SE +/- 1.22, N = 3SE +/- 6.21, N = 5SE +/- 5.39, N = 5SE +/- 3.62, N = 6SE +/- 3.32, N = 3SE +/- 6.03, N = 3SE +/- 3.54, N = 12SE +/- 3.60, N = 3SE +/- 3.45, N = 3SE +/- 3.08, N = 3SE +/- 2.55, N = 3SE +/- 10.00, N = 3SE +/- 2.03, N = 3SE +/- 4.03, N = 3SE +/- 4.34, N = 3295.06320.87335.46337.75338.84342.99379.92400.52427.95438.60458.23458.96470.02471.79476.91481.66501.07501.63525.23526.36559.55595.19
OpenBenchmarking.orgQueries Per Minute, Geo Mean, More Is BetterClickHouse 22.12.3.5100M Rows Hits Dataset, Third RunXeon Platinum 8380 2PXeon 6766E 2PEPYC 8534PNXeon 6780E 2PEPYC 8534PXeon Platinum 8380Xeon 6766EXeon 6780EEPYC 9754 2PXeon Platinum 8592+ 2PXeon Platinum 8592+EPYC 9754Xeon Max 9468Xeon Max 9480 2PXeon Max 9480Xeon Platinum 8490HXeon Max 9468 2PXeon Platinum 8490H 2PEPYC 9654 2PEPYC 9684X 2PEPYC 9654EPYC 9684X110220330440550Min: 293.79 / Avg: 295.06 / Max: 297.59Min: 319.24 / Avg: 320.87 / Max: 324.05Min: 325.01 / Avg: 335.46 / Max: 341.15Min: 330.93 / Avg: 337.75 / Max: 342.68Min: 337.06 / Avg: 338.84 / Max: 342.38Min: 335.49 / Avg: 342.99 / Max: 351.91Min: 377.56 / Avg: 379.92 / Max: 384.2Min: 398.58 / Avg: 400.52 / Max: 402.78Min: 408.27 / Avg: 427.95 / Max: 444.06Min: 421.32 / Avg: 438.6 / Max: 447.62Min: 448.17 / Avg: 458.23 / Max: 470.76Min: 452.55 / Avg: 458.96 / Max: 463.63Min: 463.25 / Avg: 470.02 / Max: 482.06Min: 446.09 / Avg: 471.79 / Max: 491.73Min: 471.3 / Avg: 476.91 / Max: 483.63Min: 475.41 / Avg: 481.66 / Max: 487.3Min: 496.61 / Avg: 501.07 / Max: 506.98Min: 496.6 / Avg: 501.63 / Max: 504.9Min: 510.63 / Avg: 525.23 / Max: 544.36Min: 522.34 / Avg: 526.36 / Max: 528.82Min: 552.28 / Avg: 559.55 / Max: 566.2Min: 589.34 / Avg: 595.19 / Max: 603.68

x265

OpenBenchmarking.orgFrames Per Second, More Is Betterx265 3.6Video Input: Bosphorus 4KXeon 6780E 2PXeon 6766EXeon 6780EXeon 6766E 2PXeon Max 9468 2PEPYC 8534PNXeon Max 9480 2PEPYC 9754 2PEPYC 8534PEPYC 9754EPYC 9654 2PXeon Max 9468Xeon Platinum 8380Xeon Platinum 8380 2PXeon Max 9480EPYC 9654EPYC 9684X 2PEPYC 9684XXeon Platinum 8490H 2PXeon Platinum 8490HXeon Platinum 8592+Xeon Platinum 8592+ 2P918273645SE +/- 0.17, N = 3SE +/- 0.11, N = 3SE +/- 0.13, N = 3SE +/- 0.22, N = 6SE +/- 0.12, N = 3SE +/- 0.06, N = 3SE +/- 0.10, N = 3SE +/- 0.06, N = 3SE +/- 0.06, N = 3SE +/- 0.02, N = 3SE +/- 0.09, N = 3SE +/- 0.08, N = 3SE +/- 0.13, N = 3SE +/- 0.05, N = 3SE +/- 0.39, N = 3SE +/- 0.08, N = 3SE +/- 0.10, N = 3SE +/- 0.11, N = 3SE +/- 0.20, N = 4SE +/- 0.11, N = 4SE +/- 0.06, N = 4SE +/- 0.09, N = 419.5520.2221.3022.0727.2627.7427.9028.1128.1328.1628.8129.0529.7630.8031.4031.7231.9532.1237.0437.8638.9339.311. (CXX) g++ options: -O3 -rdynamic -lpthread -lrt -ldl -lnuma
OpenBenchmarking.orgFrames Per Second, More Is Betterx265 3.6Video Input: Bosphorus 4KXeon 6780E 2PXeon 6766EXeon 6780EXeon 6766E 2PXeon Max 9468 2PEPYC 8534PNXeon Max 9480 2PEPYC 9754 2PEPYC 8534PEPYC 9754EPYC 9654 2PXeon Max 9468Xeon Platinum 8380Xeon Platinum 8380 2PXeon Max 9480EPYC 9654EPYC 9684X 2PEPYC 9684XXeon Platinum 8490H 2PXeon Platinum 8490HXeon Platinum 8592+Xeon Platinum 8592+ 2P816243240Min: 19.29 / Avg: 19.55 / Max: 19.88Min: 20.07 / Avg: 20.22 / Max: 20.44Min: 21.16 / Avg: 21.3 / Max: 21.56Min: 21.66 / Avg: 22.07 / Max: 23.14Min: 27.05 / Avg: 27.26 / Max: 27.46Min: 27.64 / Avg: 27.74 / Max: 27.84Min: 27.71 / Avg: 27.9 / Max: 28.05Min: 28 / Avg: 28.11 / Max: 28.2Min: 28 / Avg: 28.13 / Max: 28.19Min: 28.12 / Avg: 28.16 / Max: 28.18Min: 28.64 / Avg: 28.81 / Max: 28.91Min: 28.95 / Avg: 29.05 / Max: 29.2Min: 29.59 / Avg: 29.76 / Max: 30.01Min: 30.73 / Avg: 30.8 / Max: 30.89Min: 30.63 / Avg: 31.4 / Max: 31.86Min: 31.6 / Avg: 31.72 / Max: 31.86Min: 31.8 / Avg: 31.95 / Max: 32.13Min: 31.92 / Avg: 32.12 / Max: 32.31Min: 36.47 / Avg: 37.04 / Max: 37.35Min: 37.57 / Avg: 37.86 / Max: 38.09Min: 38.78 / Avg: 38.93 / Max: 39.05Min: 39.1 / Avg: 39.31 / Max: 39.541. (CXX) g++ options: -O3 -rdynamic -lpthread -lrt -ldl -lnuma

ONNX Runtime

ONNX Runtime is developed by Microsoft and partners as a open-source, cross-platform, high performance machine learning inferencing and training accelerator. This test profile runs the ONNX Runtime with various models available from the ONNX Model Zoo. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.17Model: ArcFace ResNet-100 - Device: CPU - Executor: ParallelXeon 6766E 2PXeon 6780E 2PXeon 6766EXeon 6780EEPYC 9754 2PEPYC 9654 2PEPYC 9684X 2PEPYC 9754EPYC 8534PNEPYC 8534PXeon Platinum 8490H 2PXeon Max 9480 2PEPYC 9654EPYC 9684XXeon Platinum 8592+ 2PXeon Max 9468 2PXeon Platinum 8380 2PXeon Max 9468Xeon Max 9480Xeon Platinum 8380Xeon Platinum 8490HXeon Platinum 8592+1428425670SE +/- 0.04782, N = 3SE +/- 0.02474, N = 15SE +/- 0.03255, N = 3SE +/- 0.04131, N = 3SE +/- 0.06474, N = 3SE +/- 0.05569, N = 3SE +/- 0.05013, N = 3SE +/- 0.07716, N = 3SE +/- 0.23936, N = 3SE +/- 0.12474, N = 3SE +/- 0.09239, N = 3SE +/- 0.11212, N = 3SE +/- 0.03174, N = 3SE +/- 0.04145, N = 3SE +/- 0.27122, N = 3SE +/- 0.11901, N = 3SE +/- 0.55506, N = 3SE +/- 0.27882, N = 3SE +/- 0.20934, N = 3SE +/- 0.10899, N = 3SE +/- 0.09731, N = 3SE +/- 0.27014, N = 33.497853.760036.245216.8133011.9382015.0082015.0516024.6095026.2475027.3128029.1487029.1955029.2690029.8493031.4589032.8141038.5025040.7289042.2711044.2748046.8491060.409401. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt
OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.17Model: ArcFace ResNet-100 - Device: CPU - Executor: ParallelXeon 6766E 2PXeon 6780E 2PXeon 6766EXeon 6780EEPYC 9754 2PEPYC 9654 2PEPYC 9684X 2PEPYC 9754EPYC 8534PNEPYC 8534PXeon Platinum 8490H 2PXeon Max 9480 2PEPYC 9654EPYC 9684XXeon Platinum 8592+ 2PXeon Max 9468 2PXeon Platinum 8380 2PXeon Max 9468Xeon Max 9480Xeon Platinum 8380Xeon Platinum 8490HXeon Platinum 8592+1224364860Min: 3.43 / Avg: 3.5 / Max: 3.59Min: 3.59 / Avg: 3.76 / Max: 3.95Min: 6.18 / Avg: 6.25 / Max: 6.28Min: 6.74 / Avg: 6.81 / Max: 6.88Min: 11.83 / Avg: 11.94 / Max: 12.06Min: 14.91 / Avg: 15.01 / Max: 15.1Min: 14.95 / Avg: 15.05 / Max: 15.1Min: 24.48 / Avg: 24.61 / Max: 24.74Min: 25.78 / Avg: 26.25 / Max: 26.57Min: 27.1 / Avg: 27.31 / Max: 27.53Min: 28.97 / Avg: 29.15 / Max: 29.27Min: 28.97 / Avg: 29.2 / Max: 29.34Min: 29.23 / Avg: 29.27 / Max: 29.33Min: 29.77 / Avg: 29.85 / Max: 29.9Min: 30.92 / Avg: 31.46 / Max: 31.73Min: 32.58 / Avg: 32.81 / Max: 32.98Min: 37.73 / Avg: 38.5 / Max: 39.58Min: 40.22 / Avg: 40.73 / Max: 41.18Min: 41.9 / Avg: 42.27 / Max: 42.63Min: 44.07 / Avg: 44.27 / Max: 44.45Min: 46.65 / Avg: 46.85 / Max: 46.95Min: 60.09 / Avg: 60.41 / Max: 60.951. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

ASKAP

ASKAP is a set of benchmarks from the Australian SKA Pathfinder. The principal ASKAP benchmarks are the Hogbom Clean Benchmark (tHogbomClean) and Convolutional Resamping Benchmark (tConvolve) as well as some previous ASKAP benchmarks being included as well for OpenCL and CUDA execution of tConvolve. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgMpix/sec, More Is BetterASKAP 1.0Test: tConvolve MPI - DegriddingXeon Platinum 8380Xeon Platinum 8380 2PEPYC 8534PNEPYC 8534PXeon Platinum 8490HXeon Max 9468Xeon Max 9480EPYC 9754Xeon Platinum 8592+Xeon Platinum 8490H 2PXeon Max 9468 2PXeon Max 9480 2PEPYC 9654EPYC 9754 2PXeon Platinum 8592+ 2PEPYC 9684XEPYC 9654 2PEPYC 9684X 2P30K60K90K120K150KSE +/- 64.71, N = 3SE +/- 62.13, N = 3SE +/- 69.57, N = 3SE +/- 44.43, N = 3SE +/- 93.91, N = 3SE +/- 0.00, N = 3SE +/- 76.47, N = 3SE +/- 598.81, N = 12SE +/- 153.57, N = 3SE +/- 378.22, N = 4SE +/- 143.60, N = 3SE +/- 0.00, N = 3SE +/- 189.10, N = 3SE +/- 1077.92, N = 14SE +/- 480.95, N = 3SE +/- 0.00, N = 3SE +/- 882.91, N = 4SE +/- 0.00, N = 38429.1312800.4015903.4016704.4017891.6018522.0020561.4028476.6031177.2034614.1036900.5040368.6042172.4052639.5059139.2064260.2081025.80123480.001. (CXX) g++ options: -O3 -fstrict-aliasing -fopenmp
OpenBenchmarking.orgMpix/sec, More Is BetterASKAP 1.0Test: tConvolve MPI - DegriddingXeon Platinum 8380Xeon Platinum 8380 2PEPYC 8534PNEPYC 8534PXeon Platinum 8490HXeon Max 9468Xeon Max 9480EPYC 9754Xeon Platinum 8592+Xeon Platinum 8490H 2PXeon Max 9468 2PXeon Max 9480 2PEPYC 9654EPYC 9754 2PXeon Platinum 8592+ 2PEPYC 9684XEPYC 9654 2PEPYC 9684X 2P20K40K60K80K100KMin: 8303.66 / Avg: 8429.13 / Max: 8519.34Min: 12676.1 / Avg: 12800.37 / Max: 12862.5Min: 15783.2 / Avg: 15903.4 / Max: 16024.2Min: 16660 / Avg: 16704.43 / Max: 16793.3Min: 17729.4 / Avg: 17891.57 / Max: 18054.7Min: 18522 / Avg: 18522 / Max: 18522Min: 20408.5 / Avg: 20561.43 / Max: 20637.9Min: 25915.6 / Avg: 28476.62 / Max: 34132.8Min: 30870.1 / Avg: 31177.23 / Max: 31330.8Min: 33640.5 / Avg: 34614.1 / Max: 35458.9Min: 36613.3 / Avg: 36900.5 / Max: 37044.1Min: 40368.6 / Avg: 40368.6 / Max: 40368.6Min: 41983.3 / Avg: 42172.4 / Max: 42550.6Min: 51199.1 / Avg: 52639.47 / Max: 66640.2Min: 58310.1 / Avg: 59139.2 / Max: 59976.1Min: 64260.2 / Avg: 64260.2 / Max: 64260.2Min: 78718.7 / Avg: 81025.83 / Max: 82861.8Min: 123480 / Avg: 123480 / Max: 1234801. (CXX) g++ options: -O3 -fstrict-aliasing -fopenmp

BRL-CAD

OpenBenchmarking.orgVGR Performance Metric, More Is BetterBRL-CAD 7.38.2VGR Performance MetricXeon Platinum 8380Xeon Max 9468Xeon Max 9480EPYC 8534PNXeon Platinum 8490HEPYC 8534PXeon Platinum 8592+Xeon 6766EXeon 6780EXeon 6766E 2PXeon Platinum 8380 2PXeon 6780E 2PEPYC 9684XEPYC 9654EPYC 9754Xeon Max 9468 2PXeon Max 9480 2PXeon Platinum 8490H 2PXeon Platinum 8592+ 2PEPYC 9754 2PEPYC 9654 2PEPYC 9684X 2P1.3M2.6M3.9M5.2M6.5M4308857139377678127713528338928519979169041508453164092122392942300947244933431225743161216348447736587904075342413696951866775861750616222861939211. (CXX) g++ options: -std=c++17 -pipe -fvisibility=hidden -fno-strict-aliasing -fno-common -fexceptions -ftemplate-depth-128 -m64 -ggdb3 -O3 -fipa-pta -fstrength-reduce -finline-functions -flto -ltcl8.6 -lnetpbm -lregex_brl -lz_brl -lassimp -ldl -lm -ltk8.6

OpenVINO

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Person Detection FP16 - Device: CPUXeon Platinum 8380Xeon 6766EXeon 6780EXeon Platinum 8380 2PEPYC 8534PEPYC 8534PNXeon 6766E 2PXeon 6780E 2PEPYC 9754Xeon Max 9468Xeon Platinum 8490HXeon Max 9480EPYC 9654Xeon Platinum 8592+EPYC 9684XXeon Max 9468 2PXeon Max 9480 2PXeon Platinum 8490H 2PXeon Platinum 8592+ 2PEPYC 9654 2PEPYC 9754 2PEPYC 9684X 2P2004006008001000SE +/- 0.34, N = 3SE +/- 0.09, N = 3SE +/- 0.05, N = 3SE +/- 0.23, N = 3SE +/- 0.25, N = 3SE +/- 0.56, N = 3SE +/- 0.07, N = 3SE +/- 0.34, N = 3SE +/- 13.40, N = 15SE +/- 1.23, N = 3SE +/- 0.04, N = 3SE +/- 0.52, N = 3SE +/- 7.13, N = 15SE +/- 0.95, N = 3SE +/- 5.20, N = 15SE +/- 1.28, N = 3SE +/- 0.55, N = 3SE +/- 0.69, N = 3SE +/- 1.42, N = 3SE +/- 5.47, N = 15SE +/- 20.94, N = 15SE +/- 2.17, N = 384.30126.64134.77175.72197.91204.05245.27261.64283.18285.95298.56301.30306.27403.20433.06568.81569.60654.84736.23750.11750.961095.791. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Person Detection FP16 - Device: CPUXeon Platinum 8380Xeon 6766EXeon 6780EXeon Platinum 8380 2PEPYC 8534PEPYC 8534PNXeon 6766E 2PXeon 6780E 2PEPYC 9754Xeon Max 9468Xeon Platinum 8490HXeon Max 9480EPYC 9654Xeon Platinum 8592+EPYC 9684XXeon Max 9468 2PXeon Max 9480 2PXeon Platinum 8490H 2PXeon Platinum 8592+ 2PEPYC 9654 2PEPYC 9754 2PEPYC 9684X 2P2004006008001000Min: 83.78 / Avg: 84.3 / Max: 84.93Min: 126.52 / Avg: 126.64 / Max: 126.81Min: 134.7 / Avg: 134.77 / Max: 134.87Min: 175.32 / Avg: 175.72 / Max: 176.1Min: 197.54 / Avg: 197.91 / Max: 198.38Min: 202.94 / Avg: 204.05 / Max: 204.77Min: 245.2 / Avg: 245.27 / Max: 245.4Min: 260.98 / Avg: 261.64 / Max: 262.13Min: 252.5 / Avg: 283.18 / Max: 468.39Min: 283.49 / Avg: 285.95 / Max: 287.22Min: 298.49 / Avg: 298.56 / Max: 298.61Min: 300.38 / Avg: 301.3 / Max: 302.17Min: 292.32 / Avg: 306.27 / Max: 402.98Min: 402.04 / Avg: 403.2 / Max: 405.07Min: 422.63 / Avg: 433.06 / Max: 489.22Min: 566.4 / Avg: 568.81 / Max: 570.75Min: 568.56 / Avg: 569.6 / Max: 570.41Min: 653.98 / Avg: 654.84 / Max: 656.21Min: 734.28 / Avg: 736.23 / Max: 739Min: 734.04 / Avg: 750.11 / Max: 816.72Min: 711.63 / Avg: 750.96 / Max: 1009.2Min: 1093.36 / Avg: 1095.79 / Max: 1100.111. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

ASKAP

ASKAP is a set of benchmarks from the Australian SKA Pathfinder. The principal ASKAP benchmarks are the Hogbom Clean Benchmark (tHogbomClean) and Convolutional Resamping Benchmark (tConvolve) as well as some previous ASKAP benchmarks being included as well for OpenCL and CUDA execution of tConvolve. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgMpix/sec, More Is BetterASKAP 1.0Test: tConvolve MPI - GriddingXeon Platinum 8380Xeon Platinum 8380 2PEPYC 8534PNEPYC 8534PXeon Platinum 8490HXeon Max 9468Xeon Max 9480EPYC 9754Xeon Platinum 8592+Xeon Platinum 8490H 2PXeon Max 9468 2PXeon Max 9480 2PEPYC 9654EPYC 9754 2PXeon Platinum 8592+ 2PEPYC 9684XEPYC 9654 2PEPYC 9684X 2P30K60K90K120K150KSE +/- 47.29, N = 3SE +/- 46.25, N = 3SE +/- 0.00, N = 3SE +/- 86.77, N = 3SE +/- 76.67, N = 3SE +/- 99.83, N = 3SE +/- 0.00, N = 3SE +/- 685.49, N = 12SE +/- 219.20, N = 3SE +/- 412.68, N = 4SE +/- 194.30, N = 3SE +/- 802.88, N = 3SE +/- 1853.72, N = 3SE +/- 1180.69, N = 14SE +/- 1080.03, N = 3SE +/- 581.17, N = 3SE +/- 2386.93, N = 4SE +/- 19579.11, N = 39623.7714497.3016399.7016573.2021314.2021766.5023250.2028854.3037265.9041773.0042939.2045195.1046233.7054066.0072004.0074389.0086757.70121976.901. (CXX) g++ options: -O3 -fstrict-aliasing -fopenmp
OpenBenchmarking.orgMpix/sec, More Is BetterASKAP 1.0Test: tConvolve MPI - GriddingXeon Platinum 8380Xeon Platinum 8380 2PEPYC 8534PNEPYC 8534PXeon Platinum 8490HXeon Max 9468Xeon Max 9480EPYC 9754Xeon Platinum 8592+Xeon Platinum 8490H 2PXeon Max 9468 2PXeon Max 9480 2PEPYC 9654EPYC 9754 2PXeon Platinum 8592+ 2PEPYC 9684XEPYC 9654 2PEPYC 9684X 2P20K40K60K80K100KMin: 9576.48 / Avg: 9623.77 / Max: 9718.36Min: 14417.3 / Avg: 14497.27 / Max: 14577.5Min: 16399.7 / Avg: 16399.7 / Max: 16399.7Min: 16399.7 / Avg: 16573.23 / Max: 16660Min: 21160.9 / Avg: 21314.23 / Max: 21390.9Min: 21566.8 / Avg: 21766.47 / Max: 21866.3Min: 23250.2 / Avg: 23250.2 / Max: 23250.2Min: 24842.2 / Avg: 28854.32 / Max: 35280.1Min: 36827.5 / Avg: 37265.9 / Max: 37485.1Min: 40576.6 / Avg: 41773 / Max: 42321.9Min: 42550.6 / Avg: 42939.2 / Max: 43133.5Min: 43732.6 / Avg: 45195.13 / Max: 46500.5Min: 42550.6 / Avg: 46233.73 / Max: 48442.3Min: 52479.1 / Avg: 54066.02 / Max: 69393.9Min: 69972.2 / Avg: 72004.03 / Max: 73654.9Min: 73226.7 / Avg: 74389.03 / Max: 74970.2Min: 82861.8 / Avg: 86757.73 / Max: 92610.2Min: 82861.8 / Avg: 121976.93 / Max: 1431251. (CXX) g++ options: -O3 -fstrict-aliasing -fopenmp

Xmrig

Xmrig is an open-source cross-platform CPU/GPU miner for RandomX, KawPow, CryptoNight and AstroBWT. This test profile is setup to measure the Xmrig CPU mining performance. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgH/s, More Is BetterXmrig 6.21Variant: GhostRider - Hash Count: 1MXeon Platinum 8380EPYC 8534PNEPYC 8534PXeon Platinum 8380 2PXeon 6766EXeon Max 9468Xeon 6780EXeon Platinum 8490HXeon Max 9480Xeon Platinum 8592+EPYC 9754Xeon 6766E 2PXeon Max 9468 2PXeon 6780E 2PXeon Platinum 8490H 2PXeon Max 9480 2PEPYC 9654EPYC 9684XXeon Platinum 8592+ 2PEPYC 9754 2PEPYC 9654 2PEPYC 9684X 2P7K14K21K28K35KSE +/- 32.20, N = 2SE +/- 41.94, N = 3SE +/- 30.53, N = 3SE +/- 49.14, N = 12SE +/- 19.74, N = 3SE +/- 12.93, N = 3SE +/- 43.00, N = 3SE +/- 23.16, N = 3SE +/- 14.78, N = 3SE +/- 44.68, N = 3SE +/- 61.27, N = 3SE +/- 53.95, N = 3SE +/- 14.02, N = 3SE +/- 43.14, N = 3SE +/- 4.03, N = 3SE +/- 7.44, N = 3SE +/- 117.32, N = 3SE +/- 10.36, N = 3SE +/- 64.69, N = 3SE +/- 46.94, N = 3SE +/- 290.50, N = 3SE +/- 95.10, N = 32593.24564.34660.05230.95315.75446.85753.95808.86122.38378.39320.510431.610975.811147.211263.212115.014207.715786.616324.717873.126702.731157.81. (CXX) g++ options: -fexceptions -fno-rtti -maes -O3 -Ofast -static-libgcc -static-libstdc++ -rdynamic -lssl -lcrypto -luv -lpthread -lrt -ldl -lhwloc
OpenBenchmarking.orgH/s, More Is BetterXmrig 6.21Variant: GhostRider - Hash Count: 1MXeon Platinum 8380EPYC 8534PNEPYC 8534PXeon Platinum 8380 2PXeon 6766EXeon Max 9468Xeon 6780EXeon Platinum 8490HXeon Max 9480Xeon Platinum 8592+EPYC 9754Xeon 6766E 2PXeon Max 9468 2PXeon 6780E 2PXeon Platinum 8490H 2PXeon Max 9480 2PEPYC 9654EPYC 9684XXeon Platinum 8592+ 2PEPYC 9754 2PEPYC 9654 2PEPYC 9684X 2P5K10K15K20K25KMin: 2561 / Avg: 2593.2 / Max: 2625.4Min: 4483.5 / Avg: 4564.3 / Max: 4624.2Min: 4615.6 / Avg: 4660 / Max: 4718.5Min: 5061.4 / Avg: 5230.93 / Max: 5484.1Min: 5277.1 / Avg: 5315.7 / Max: 5342.2Min: 5428.9 / Avg: 5446.77 / Max: 5471.9Min: 5668.8 / Avg: 5753.87 / Max: 5807.4Min: 5783.9 / Avg: 5808.83 / Max: 5855.1Min: 6093.4 / Avg: 6122.3 / Max: 6142.1Min: 8302.5 / Avg: 8378.33 / Max: 8457.2Min: 9198 / Avg: 9320.53 / Max: 9383.4Min: 10324.4 / Avg: 10431.6 / Max: 10495.9Min: 10950.9 / Avg: 10975.83 / Max: 10999.4Min: 11071.4 / Avg: 11147.23 / Max: 11220.8Min: 11256.6 / Avg: 11263.17 / Max: 11270.5Min: 12100.2 / Avg: 12115 / Max: 12123.7Min: 14003.4 / Avg: 14207.67 / Max: 14409.8Min: 15775.4 / Avg: 15786.6 / Max: 15807.3Min: 16244.8 / Avg: 16324.73 / Max: 16452.8Min: 17783.2 / Avg: 17873.13 / Max: 17941.4Min: 26163.6 / Avg: 26702.67 / Max: 27159.9Min: 30975.1 / Avg: 31157.77 / Max: 312951. (CXX) g++ options: -fexceptions -fno-rtti -maes -O3 -Ofast -static-libgcc -static-libstdc++ -rdynamic -lssl -lcrypto -luv -lpthread -lrt -ldl -lhwloc

OpenVINO

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Weld Porosity Detection FP16-INT8 - Device: CPUXeon 6766E 2PXeon 6766EXeon 6780E 2PXeon 6780EEPYC 8534PNEPYC 8534PEPYC 9754 2PEPYC 9754EPYC 9654 2PEPYC 9654EPYC 9684XEPYC 9684X 2PXeon Platinum 8380Xeon Platinum 8380 2PXeon Platinum 8490HXeon Max 9480 2PXeon Max 9480Xeon Max 9468 2PXeon Max 9468Xeon Platinum 8490H 2PXeon Platinum 8592+ 2PXeon Platinum 8592+714212835SE +/- 0.05, N = 3SE +/- 0.04, N = 3SE +/- 0.05, N = 3SE +/- 0.03, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.01, N = 3SE +/- 0.08, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.04, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.00, N = 3SE +/- 0.01, N = 3SE +/- 0.00, N = 3SE +/- 0.01, N = 3SE +/- 0.03, N = 4SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 328.2427.0124.7724.2513.1111.7811.2010.9210.1710.099.429.258.588.273.582.792.672.532.502.502.482.361. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Weld Porosity Detection FP16-INT8 - Device: CPUXeon 6766E 2PXeon 6766EXeon 6780E 2PXeon 6780EEPYC 8534PNEPYC 8534PEPYC 9754 2PEPYC 9754EPYC 9654 2PEPYC 9654EPYC 9684XEPYC 9684X 2PXeon Platinum 8380Xeon Platinum 8380 2PXeon Platinum 8490HXeon Max 9480 2PXeon Max 9480Xeon Max 9468 2PXeon Max 9468Xeon Platinum 8490H 2PXeon Platinum 8592+ 2PXeon Platinum 8592+612182430Min: 28.15 / Avg: 28.24 / Max: 28.31Min: 26.94 / Avg: 27.01 / Max: 27.06Min: 24.68 / Avg: 24.77 / Max: 24.84Min: 24.19 / Avg: 24.25 / Max: 24.3Min: 13.1 / Avg: 13.11 / Max: 13.11Min: 11.78 / Avg: 11.78 / Max: 11.78Min: 11.2 / Avg: 11.2 / Max: 11.21Min: 10.91 / Avg: 10.92 / Max: 10.93Min: 10.01 / Avg: 10.17 / Max: 10.28Min: 10.08 / Avg: 10.09 / Max: 10.1Min: 9.39 / Avg: 9.42 / Max: 9.43Min: 9.21 / Avg: 9.25 / Max: 9.34Min: 8.56 / Avg: 8.58 / Max: 8.59Min: 8.26 / Avg: 8.27 / Max: 8.28Min: 3.58 / Avg: 3.58 / Max: 3.59Min: 2.76 / Avg: 2.79 / Max: 2.81Min: 2.66 / Avg: 2.67 / Max: 2.67Min: 2.52 / Avg: 2.53 / Max: 2.54Min: 2.46 / Avg: 2.5 / Max: 2.59Min: 2.5 / Avg: 2.5 / Max: 2.51Min: 2.47 / Avg: 2.48 / Max: 2.48Min: 2.35 / Avg: 2.36 / Max: 2.361. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

ONNX Runtime

ONNX Runtime is developed by Microsoft and partners as a open-source, cross-platform, high performance machine learning inferencing and training accelerator. This test profile runs the ONNX Runtime with various models available from the ONNX Model Zoo. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.17Model: ArcFace ResNet-100 - Device: CPU - Executor: StandardXeon 6766E 2PXeon 6780E 2PXeon 6766EXeon 6780EEPYC 9754 2PEPYC 9684X 2PEPYC 9654 2PEPYC 8534PEPYC 9754EPYC 8534PNXeon Max 9480 2PXeon Platinum 8490H 2PXeon Platinum 8592+ 2PEPYC 9654Xeon Max 9468 2PEPYC 9684XXeon Max 9480Xeon Platinum 8380 2PXeon Max 9468Xeon Platinum 8380Xeon Platinum 8490HXeon Platinum 8592+1530456075SE +/- 0.03571, N = 3SE +/- 0.00992, N = 3SE +/- 0.02972, N = 3SE +/- 0.03724, N = 3SE +/- 0.40826, N = 15SE +/- 0.56636, N = 15SE +/- 0.31646, N = 15SE +/- 0.06539, N = 3SE +/- 0.38216, N = 15SE +/- 0.29092, N = 15SE +/- 0.20595, N = 3SE +/- 0.47575, N = 3SE +/- 0.50579, N = 13SE +/- 0.42374, N = 4SE +/- 0.34209, N = 3SE +/- 0.05911, N = 3SE +/- 0.58786, N = 3SE +/- 0.18826, N = 3SE +/- 0.69010, N = 15SE +/- 0.54692, N = 3SE +/- 0.16471, N = 3SE +/- 0.82440, N = 35.582415.952839.3729410.3425018.0133023.4960023.5786030.3743030.8572031.0644033.9621036.2493038.4240039.2586040.5671041.4745042.2747045.5414047.2703051.0172052.8167066.516201. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt
OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.17Model: ArcFace ResNet-100 - Device: CPU - Executor: StandardXeon 6766E 2PXeon 6780E 2PXeon 6766EXeon 6780EEPYC 9754 2PEPYC 9684X 2PEPYC 9654 2PEPYC 8534PEPYC 9754EPYC 8534PNXeon Max 9480 2PXeon Platinum 8490H 2PXeon Platinum 8592+ 2PEPYC 9654Xeon Max 9468 2PEPYC 9684XXeon Max 9480Xeon Platinum 8380 2PXeon Max 9468Xeon Platinum 8380Xeon Platinum 8490HXeon Platinum 8592+1326395265Min: 5.52 / Avg: 5.58 / Max: 5.64Min: 5.94 / Avg: 5.95 / Max: 5.97Min: 9.32 / Avg: 9.37 / Max: 9.43Min: 10.27 / Avg: 10.34 / Max: 10.4Min: 16.01 / Avg: 18.01 / Max: 19.89Min: 21.22 / Avg: 23.5 / Max: 26.7Min: 21.66 / Avg: 23.58 / Max: 26.04Min: 30.27 / Avg: 30.37 / Max: 30.49Min: 29.41 / Avg: 30.86 / Max: 32.67Min: 29.19 / Avg: 31.06 / Max: 32.15Min: 33.63 / Avg: 33.96 / Max: 34.34Min: 35.36 / Avg: 36.25 / Max: 36.98Min: 32.57 / Avg: 38.42 / Max: 39.68Min: 38.09 / Avg: 39.26 / Max: 40.1Min: 39.96 / Avg: 40.57 / Max: 41.14Min: 41.41 / Avg: 41.47 / Max: 41.59Min: 41.14 / Avg: 42.27 / Max: 43.1Min: 45.34 / Avg: 45.54 / Max: 45.92Min: 42.77 / Avg: 47.27 / Max: 50.13Min: 50.04 / Avg: 51.02 / Max: 51.93Min: 52.55 / Avg: 52.82 / Max: 53.12Min: 64.87 / Avg: 66.52 / Max: 67.361. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.17Model: ResNet50 v1-12-int8 - Device: CPU - Executor: ParallelXeon 6766E 2PXeon 6780E 2PXeon 6766EXeon 6780EEPYC 9754 2PEPYC 9654 2PEPYC 9684X 2PEPYC 9754Xeon Max 9480 2PXeon Platinum 8592+ 2PXeon Platinum 8490H 2PXeon Max 9468 2PEPYC 9684XEPYC 9654Xeon Platinum 8380 2PEPYC 8534PNEPYC 8534PXeon Max 9480Xeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8380Xeon Max 946870140210280350SE +/- 0.26, N = 3SE +/- 0.27, N = 6SE +/- 0.27, N = 3SE +/- 0.32, N = 3SE +/- 0.66, N = 3SE +/- 0.54, N = 3SE +/- 0.54, N = 3SE +/- 0.53, N = 3SE +/- 0.73, N = 3SE +/- 1.63, N = 3SE +/- 0.73, N = 3SE +/- 0.47, N = 3SE +/- 1.50, N = 3SE +/- 2.31, N = 4SE +/- 1.30, N = 3SE +/- 1.50, N = 15SE +/- 1.54, N = 15SE +/- 2.72, N = 3SE +/- 2.50, N = 3SE +/- 0.53, N = 3SE +/- 1.73, N = 3SE +/- 1.74, N = 327.4728.4055.8664.1688.37100.36100.46153.25153.41153.92156.46166.49178.70190.38192.99203.06207.34301.14308.80313.10315.03319.041. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt
OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.17Model: ResNet50 v1-12-int8 - Device: CPU - Executor: ParallelXeon 6766E 2PXeon 6780E 2PXeon 6766EXeon 6780EEPYC 9754 2PEPYC 9654 2PEPYC 9684X 2PEPYC 9754Xeon Max 9480 2PXeon Platinum 8592+ 2PXeon Platinum 8490H 2PXeon Max 9468 2PEPYC 9684XEPYC 9654Xeon Platinum 8380 2PEPYC 8534PNEPYC 8534PXeon Max 9480Xeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8380Xeon Max 946860120180240300Min: 27.02 / Avg: 27.47 / Max: 27.92Min: 27.52 / Avg: 28.4 / Max: 29.43Min: 55.42 / Avg: 55.86 / Max: 56.36Min: 63.58 / Avg: 64.16 / Max: 64.69Min: 87.07 / Avg: 88.37 / Max: 89.17Min: 99.68 / Avg: 100.36 / Max: 101.42Min: 99.83 / Avg: 100.46 / Max: 101.53Min: 152.46 / Avg: 153.25 / Max: 154.25Min: 152.27 / Avg: 153.41 / Max: 154.76Min: 151.21 / Avg: 153.92 / Max: 156.84Min: 155.06 / Avg: 156.46 / Max: 157.5Min: 166.02 / Avg: 166.49 / Max: 167.42Min: 176.25 / Avg: 178.7 / Max: 181.41Min: 183.63 / Avg: 190.38 / Max: 193.87Min: 190.52 / Avg: 192.99 / Max: 194.93Min: 193.75 / Avg: 203.06 / Max: 213.6Min: 196.3 / Avg: 207.34 / Max: 214.28Min: 296.09 / Avg: 301.14 / Max: 305.44Min: 304.4 / Avg: 308.8 / Max: 313.06Min: 312.35 / Avg: 313.1 / Max: 314.13Min: 312.12 / Avg: 315.03 / Max: 318.09Min: 316.97 / Avg: 319.04 / Max: 322.51. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

OpenSSL

OpenBenchmarking.orgbyte/s, More Is BetterOpenSSL 3.3Algorithm: SHA256Xeon Platinum 8380Xeon Max 9468Xeon Max 9480Xeon Platinum 8380 2PXeon Platinum 8490HXeon Platinum 8592+EPYC 8534PNEPYC 8534PXeon Max 9468 2PXeon Max 9480 2PXeon Platinum 8490H 2PEPYC 9654Xeon 6766EXeon Platinum 8592+ 2PEPYC 9684XXeon 6780EEPYC 9754EPYC 9654 2PXeon 6766E 2PEPYC 9684X 2PXeon 6780E 2PEPYC 9754 2P70000M140000M210000M280000M350000MSE +/- 8534071.27, N = 3SE +/- 27466135.54, N = 3SE +/- 33334799.97, N = 3SE +/- 919807437.76, N = 12SE +/- 159515825.53, N = 3SE +/- 23323764.84, N = 3SE +/- 64797308.82, N = 3SE +/- 10642001.84, N = 3SE +/- 126029257.64, N = 3SE +/- 70647143.49, N = 3SE +/- 66583540.43, N = 3SE +/- 38601729.93, N = 3SE +/- 34216643.88, N = 3SE +/- 29142783.86, N = 3SE +/- 146384349.91, N = 3SE +/- 242095363.59, N = 3SE +/- 34182873.86, N = 3SE +/- 210407867.05, N = 3SE +/- 97765007.32, N = 3SE +/- 160246527.97, N = 3SE +/- 228931567.43, N = 3SE +/- 80639802.67, N = 32785850449044439185187518404367635453070057661806994523665739579206780673038774584721007886357534131033828601131191068021071264751376901299759947331319760501201384095889831441630272801612691622802516456298872563303497772762677664032870350411403202586862371. (CC) gcc options: -pthread -m64 -O3 -lssl -lcrypto -ldl
OpenBenchmarking.orgbyte/s, More Is BetterOpenSSL 3.3Algorithm: SHA256Xeon Platinum 8380Xeon Max 9468Xeon Max 9480Xeon Platinum 8380 2PXeon Platinum 8490HXeon Platinum 8592+EPYC 8534PNEPYC 8534PXeon Max 9468 2PXeon Max 9480 2PXeon Platinum 8490H 2PEPYC 9654Xeon 6766EXeon Platinum 8592+ 2PEPYC 9684XXeon 6780EEPYC 9754EPYC 9654 2PXeon 6766E 2PEPYC 9684X 2PXeon 6780E 2PEPYC 9754 2P60000M120000M180000M240000M300000MMin: 27841563680 / Avg: 27858504490 / Max: 27868777070Min: 44395980250 / Avg: 44439185186.67 / Max: 44490167340Min: 51778993930 / Avg: 51840436763.33 / Max: 51893568230Min: 44908913070 / Avg: 54530700575.83 / Max: 55972496820Min: 61618891490 / Avg: 61806994523.33 / Max: 62124202560Min: 66530973870 / Avg: 66573957920 / Max: 66611143020Min: 67679364230 / Avg: 67806730386.67 / Max: 67891137130Min: 74563443970 / Avg: 74584721006.67 / Max: 74595831110Min: 88435026300 / Avg: 88635753413.33 / Max: 88868145720Min: 103284149010 / Avg: 103382860113.33 / Max: 103519766480Min: 118985504260 / Avg: 119106802106.67 / Max: 119215045440Min: 126408084590 / Avg: 126475137690 / Max: 126541803220Min: 129909315090 / Avg: 129975994733.33 / Max: 130022665160Min: 131941867810 / Avg: 131976050120 / Max: 132034026270Min: 138117781740 / Avg: 138409588983.33 / Max: 138576023880Min: 143691968070 / Avg: 144163027280 / Max: 144495551270Min: 161202050780 / Avg: 161269162280 / Max: 161314007030Min: 251234414660 / Avg: 251645629886.67 / Max: 251928638660Min: 256134997090 / Avg: 256330349776.67 / Max: 256435236240Min: 276100310730 / Avg: 276267766403.33 / Max: 276588149680Min: 286666623270 / Avg: 287035041140 / Max: 287454686250Min: 320109812680 / Avg: 320258686236.67 / Max: 3203868429501. (CC) gcc options: -pthread -m64 -O3 -lssl -lcrypto -ldl

OpenVINO

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Face Detection FP16-INT8 - Device: CPUXeon Platinum 8380EPYC 8534PNXeon 6766EEPYC 8534PXeon 6780EEPYC 9654Xeon Platinum 8380 2PXeon 6766E 2PEPYC 9684XXeon 6780E 2PEPYC 9754Xeon Platinum 8490HEPYC 9654 2PXeon Max 9468EPYC 9684X 2PXeon Max 9480EPYC 9754 2PXeon Platinum 8592+Xeon Max 9468 2PXeon Max 9480 2PXeon Platinum 8490H 2PXeon Platinum 8592+ 2P120240360480600SE +/- 0.36, N = 3SE +/- 0.06, N = 3SE +/- 0.07, N = 3SE +/- 0.01, N = 3SE +/- 0.15, N = 3SE +/- 0.01, N = 3SE +/- 0.10, N = 3SE +/- 0.18, N = 3SE +/- 0.12, N = 3SE +/- 0.18, N = 3SE +/- 0.03, N = 3SE +/- 0.12, N = 3SE +/- 0.01, N = 3SE +/- 0.14, N = 3SE +/- 0.41, N = 3SE +/- 0.41, N = 3SE +/- 0.04, N = 3SE +/- 0.69, N = 3SE +/- 0.58, N = 3SE +/- 0.54, N = 3SE +/- 0.01, N = 3SE +/- 0.77, N = 347.9948.7351.8553.8958.0693.9996.0899.72101.51113.68115.78167.83188.74202.59205.03217.11231.83284.64373.50401.45423.18545.211. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Face Detection FP16-INT8 - Device: CPUXeon Platinum 8380EPYC 8534PNXeon 6766EEPYC 8534PXeon 6780EEPYC 9654Xeon Platinum 8380 2PXeon 6766E 2PEPYC 9684XXeon 6780E 2PEPYC 9754Xeon Platinum 8490HEPYC 9654 2PXeon Max 9468EPYC 9684X 2PXeon Max 9480EPYC 9754 2PXeon Platinum 8592+Xeon Max 9468 2PXeon Max 9480 2PXeon Platinum 8490H 2PXeon Platinum 8592+ 2P100200300400500Min: 47.27 / Avg: 47.99 / Max: 48.4Min: 48.61 / Avg: 48.73 / Max: 48.8Min: 51.71 / Avg: 51.85 / Max: 51.96Min: 53.88 / Avg: 53.89 / Max: 53.9Min: 57.86 / Avg: 58.06 / Max: 58.35Min: 93.97 / Avg: 93.99 / Max: 94Min: 95.97 / Avg: 96.08 / Max: 96.28Min: 99.36 / Avg: 99.72 / Max: 99.95Min: 101.37 / Avg: 101.51 / Max: 101.75Min: 113.45 / Avg: 113.68 / Max: 114.03Min: 115.71 / Avg: 115.78 / Max: 115.81Min: 167.59 / Avg: 167.83 / Max: 168Min: 188.72 / Avg: 188.74 / Max: 188.76Min: 202.35 / Avg: 202.59 / Max: 202.83Min: 204.46 / Avg: 205.03 / Max: 205.82Min: 216.31 / Avg: 217.11 / Max: 217.68Min: 231.75 / Avg: 231.83 / Max: 231.9Min: 283.41 / Avg: 284.64 / Max: 285.79Min: 372.41 / Avg: 373.5 / Max: 374.39Min: 400.66 / Avg: 401.45 / Max: 402.49Min: 423.16 / Avg: 423.18 / Max: 423.19Min: 544.3 / Avg: 545.21 / Max: 546.741. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Noise Suppression Poconet-Like FP16 - Device: CPUXeon 6766E 2PXeon 6780E 2PXeon Platinum 8380Xeon 6766EXeon 6780EXeon Platinum 8380 2PEPYC 8534PNEPYC 8534PXeon Max 9468Xeon Platinum 8490HXeon Max 9480EPYC 9754Xeon Max 9468 2PEPYC 9654Xeon Max 9480 2PEPYC 9754 2PXeon Platinum 8592+EPYC 9684XXeon Platinum 8490H 2PEPYC 9654 2PEPYC 9684X 2PXeon Platinum 8592+ 2P2K4K6K8K10KSE +/- 11.12, N = 3SE +/- 2.88, N = 3SE +/- 1.70, N = 3SE +/- 13.67, N = 3SE +/- 16.46, N = 3SE +/- 6.96, N = 3SE +/- 3.67, N = 3SE +/- 0.64, N = 3SE +/- 15.13, N = 3SE +/- 1.87, N = 3SE +/- 7.60, N = 3SE +/- 139.41, N = 12SE +/- 37.79, N = 3SE +/- 67.22, N = 14SE +/- 28.98, N = 3SE +/- 27.90, N = 3SE +/- 10.14, N = 3SE +/- 1.84, N = 3SE +/- 13.31, N = 3SE +/- 77.59, N = 3SE +/- 59.51, N = 3SE +/- 24.76, N = 3843.92978.461525.571747.501906.992963.823405.943636.334208.494209.104386.485310.075565.235697.515933.656513.366757.266963.317356.637810.658231.729360.891. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Noise Suppression Poconet-Like FP16 - Device: CPUXeon 6766E 2PXeon 6780E 2PXeon Platinum 8380Xeon 6766EXeon 6780EXeon Platinum 8380 2PEPYC 8534PNEPYC 8534PXeon Max 9468Xeon Platinum 8490HXeon Max 9480EPYC 9754Xeon Max 9468 2PEPYC 9654Xeon Max 9480 2PEPYC 9754 2PXeon Platinum 8592+EPYC 9684XXeon Platinum 8490H 2PEPYC 9654 2PEPYC 9684X 2PXeon Platinum 8592+ 2P16003200480064008000Min: 822.09 / Avg: 843.92 / Max: 858.53Min: 974.35 / Avg: 978.46 / Max: 984Min: 1523.46 / Avg: 1525.57 / Max: 1528.94Min: 1720.2 / Avg: 1747.5 / Max: 1762.42Min: 1874.67 / Avg: 1906.99 / Max: 1928.56Min: 2950.21 / Avg: 2963.82 / Max: 2973.15Min: 3398.8 / Avg: 3405.94 / Max: 3410.99Min: 3635.61 / Avg: 3636.33 / Max: 3637.62Min: 4178.31 / Avg: 4208.49 / Max: 4225.58Min: 4205.72 / Avg: 4209.1 / Max: 4212.18Min: 4378.2 / Avg: 4386.48 / Max: 4401.66Min: 4847.28 / Avg: 5310.07 / Max: 6771.47Min: 5510.56 / Avg: 5565.23 / Max: 5637.75Min: 5574.69 / Avg: 5697.51 / Max: 6560.89Min: 5878.07 / Avg: 5933.65 / Max: 5975.66Min: 6458.56 / Avg: 6513.36 / Max: 6549.86Min: 6738.08 / Avg: 6757.26 / Max: 6772.53Min: 6959.64 / Avg: 6963.31 / Max: 6965.39Min: 7337.71 / Avg: 7356.63 / Max: 7382.31Min: 7691.85 / Avg: 7810.65 / Max: 7956.5Min: 8164.66 / Avg: 8231.72 / Max: 8350.41Min: 9311.42 / Avg: 9360.89 / Max: 9387.661. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Machine Translation EN To DE FP16 - Device: CPUXeon 6766E 2PXeon 6780E 2PXeon 6766EXeon 6780EXeon Platinum 8380EPYC 8534PNEPYC 9754EPYC 8534PEPYC 9654EPYC 9684XXeon Platinum 8380 2PXeon Platinum 8490HEPYC 9754 2PEPYC 9654 2PEPYC 9684X 2PXeon Max 9480 2PXeon Max 9480Xeon Platinum 8490H 2PXeon Max 9468 2PXeon Max 9468Xeon Platinum 8592+ 2PXeon Platinum 8592+60120180240300SE +/- 2.84, N = 15SE +/- 3.14, N = 3SE +/- 0.48, N = 3SE +/- 0.06, N = 3SE +/- 0.39, N = 3SE +/- 0.05, N = 3SE +/- 1.05, N = 5SE +/- 0.13, N = 3SE +/- 0.77, N = 7SE +/- 0.60, N = 11SE +/- 0.05, N = 3SE +/- 0.03, N = 3SE +/- 0.59, N = 3SE +/- 0.44, N = 3SE +/- 0.01, N = 3SE +/- 0.05, N = 3SE +/- 0.34, N = 3SE +/- 0.16, N = 3SE +/- 0.07, N = 3SE +/- 0.12, N = 3SE +/- 0.02, N = 3SE +/- 0.02, N = 3294.69271.14259.66240.38127.89109.00102.84100.6791.1683.1170.9562.4656.7348.4343.1741.5738.5037.5829.9828.7328.1726.851. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Machine Translation EN To DE FP16 - Device: CPUXeon 6766E 2PXeon 6780E 2PXeon 6766EXeon 6780EXeon Platinum 8380EPYC 8534PNEPYC 9754EPYC 8534PEPYC 9654EPYC 9684XXeon Platinum 8380 2PXeon Platinum 8490HEPYC 9754 2PEPYC 9654 2PEPYC 9684X 2PXeon Max 9480 2PXeon Max 9480Xeon Platinum 8490H 2PXeon Max 9468 2PXeon Max 9468Xeon Platinum 8592+ 2PXeon Platinum 8592+50100150200250Min: 282.31 / Avg: 294.69 / Max: 313.03Min: 266.01 / Avg: 271.14 / Max: 276.84Min: 258.78 / Avg: 259.66 / Max: 260.43Min: 240.28 / Avg: 240.38 / Max: 240.47Min: 127.11 / Avg: 127.89 / Max: 128.32Min: 108.91 / Avg: 109 / Max: 109.06Min: 99.69 / Avg: 102.84 / Max: 106.19Min: 100.43 / Avg: 100.67 / Max: 100.85Min: 86.66 / Avg: 91.16 / Max: 92.55Min: 78.87 / Avg: 83.11 / Max: 84.85Min: 70.88 / Avg: 70.95 / Max: 71.04Min: 62.41 / Avg: 62.46 / Max: 62.51Min: 55.57 / Avg: 56.73 / Max: 57.52Min: 47.56 / Avg: 48.43 / Max: 49Min: 43.14 / Avg: 43.17 / Max: 43.18Min: 41.5 / Avg: 41.57 / Max: 41.67Min: 37.89 / Avg: 38.5 / Max: 39.08Min: 37.25 / Avg: 37.58 / Max: 37.76Min: 29.85 / Avg: 29.98 / Max: 30.09Min: 28.54 / Avg: 28.73 / Max: 28.94Min: 28.15 / Avg: 28.17 / Max: 28.21Min: 26.82 / Avg: 26.85 / Max: 26.891. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Person Re-Identification Retail FP16 - Device: CPUXeon Platinum 8380Xeon 6766EXeon 6780EXeon Platinum 8380 2PEPYC 8534PNEPYC 8534PXeon 6766E 2PXeon 6780E 2PXeon Platinum 8490HEPYC 9654Xeon Max 9468EPYC 9684XXeon Max 9480EPYC 9754Xeon Platinum 8592+EPYC 9654 2PEPYC 9684X 2PXeon Max 9468 2PXeon Max 9480 2PEPYC 9754 2PXeon Platinum 8490H 2PXeon Platinum 8592+ 2P4K8K12K16K20KSE +/- 1.47, N = 3SE +/- 20.57, N = 3SE +/- 11.75, N = 3SE +/- 2.06, N = 3SE +/- 1.89, N = 3SE +/- 3.18, N = 3SE +/- 6.55, N = 3SE +/- 4.90, N = 3SE +/- 3.97, N = 3SE +/- 4.14, N = 3SE +/- 3.72, N = 3SE +/- 4.58, N = 3SE +/- 0.46, N = 3SE +/- 4.98, N = 3SE +/- 5.57, N = 3SE +/- 7.03, N = 3SE +/- 7.99, N = 3SE +/- 3.67, N = 3SE +/- 7.22, N = 3SE +/- 10.13, N = 3SE +/- 4.14, N = 3SE +/- 7.74, N = 31698.052006.002179.993263.033355.733692.673787.944259.995943.666554.126717.656846.797207.747862.659515.8612024.1812665.6213102.2814033.9414601.5215519.9218375.631. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Person Re-Identification Retail FP16 - Device: CPUXeon Platinum 8380Xeon 6766EXeon 6780EXeon Platinum 8380 2PEPYC 8534PNEPYC 8534PXeon 6766E 2PXeon 6780E 2PXeon Platinum 8490HEPYC 9654Xeon Max 9468EPYC 9684XXeon Max 9480EPYC 9754Xeon Platinum 8592+EPYC 9654 2PEPYC 9684X 2PXeon Max 9468 2PXeon Max 9480 2PEPYC 9754 2PXeon Platinum 8490H 2PXeon Platinum 8592+ 2P3K6K9K12K15KMin: 1695.79 / Avg: 1698.05 / Max: 1700.8Min: 1976.64 / Avg: 2006 / Max: 2045.63Min: 2156.87 / Avg: 2179.99 / Max: 2195.23Min: 3258.93 / Avg: 3263.03 / Max: 3265.49Min: 3352.34 / Avg: 3355.73 / Max: 3358.87Min: 3686.72 / Avg: 3692.67 / Max: 3697.61Min: 3779.73 / Avg: 3787.94 / Max: 3800.88Min: 4250.38 / Avg: 4259.99 / Max: 4266.48Min: 5937.09 / Avg: 5943.66 / Max: 5950.81Min: 6546.28 / Avg: 6554.12 / Max: 6560.34Min: 6710.36 / Avg: 6717.65 / Max: 6722.63Min: 6840.17 / Avg: 6846.79 / Max: 6855.59Min: 7207.09 / Avg: 7207.74 / Max: 7208.64Min: 7854.66 / Avg: 7862.65 / Max: 7871.8Min: 9508.89 / Avg: 9515.86 / Max: 9526.87Min: 12014.87 / Avg: 12024.18 / Max: 12037.97Min: 12654.72 / Avg: 12665.62 / Max: 12681.18Min: 13098.5 / Avg: 13102.28 / Max: 13109.61Min: 14023.17 / Avg: 14033.94 / Max: 14047.65Min: 14581.32 / Avg: 14601.52 / Max: 14612.9Min: 15515.26 / Avg: 15519.92 / Max: 15528.17Min: 18360.15 / Avg: 18375.63 / Max: 18383.721. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Weld Porosity Detection FP16-INT8 - Device: CPUXeon Platinum 8380EPYC 8534PNXeon 6766EEPYC 8534PXeon 6780EEPYC 9654Xeon Platinum 8380 2PEPYC 9684XXeon 6766E 2PXeon 6780E 2PEPYC 9754Xeon Platinum 8490HEPYC 9654 2PXeon Max 9468EPYC 9684X 2PXeon Max 9480EPYC 9754 2PXeon Platinum 8592+Xeon Max 9468 2PXeon Max 9480 2PXeon Platinum 8490H 2PXeon Platinum 8592+ 2P10K20K30K40K50KSE +/- 5.62, N = 3SE +/- 1.69, N = 3SE +/- 7.59, N = 3SE +/- 0.41, N = 3SE +/- 6.61, N = 3SE +/- 4.46, N = 3SE +/- 6.41, N = 3SE +/- 11.71, N = 3SE +/- 12.93, N = 3SE +/- 19.55, N = 3SE +/- 5.50, N = 3SE +/- 2.71, N = 3SE +/- 147.69, N = 3SE +/- 234.43, N = 4SE +/- 110.20, N = 3SE +/- 21.27, N = 3SE +/- 11.27, N = 3SE +/- 47.41, N = 3SE +/- 80.58, N = 3SE +/- 233.95, N = 3SE +/- 53.98, N = 3SE +/- 39.08, N = 34502.744830.015278.465366.795866.639356.719657.089997.8910020.9111390.0411508.1915943.1718666.1619183.8320550.9320910.5322499.0326943.4237710.6040032.8147654.9548122.161. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Weld Porosity Detection FP16-INT8 - Device: CPUXeon Platinum 8380EPYC 8534PNXeon 6766EEPYC 8534PXeon 6780EEPYC 9654Xeon Platinum 8380 2PEPYC 9684XXeon 6766E 2PXeon 6780E 2PEPYC 9754Xeon Platinum 8490HEPYC 9654 2PXeon Max 9468EPYC 9684X 2PXeon Max 9480EPYC 9754 2PXeon Platinum 8592+Xeon Max 9468 2PXeon Max 9480 2PXeon Platinum 8490H 2PXeon Platinum 8592+ 2P8K16K24K32K40KMin: 4493.76 / Avg: 4502.74 / Max: 4513.07Min: 4827.98 / Avg: 4830.01 / Max: 4833.37Min: 5267.59 / Avg: 5278.46 / Max: 5293.08Min: 5366.18 / Avg: 5366.79 / Max: 5367.56Min: 5858.96 / Avg: 5866.63 / Max: 5879.79Min: 9348.41 / Avg: 9356.71 / Max: 9363.69Min: 9645.3 / Avg: 9657.08 / Max: 9667.36Min: 9984.57 / Avg: 9997.89 / Max: 10021.24Min: 10004.78 / Avg: 10020.91 / Max: 10046.48Min: 11369.54 / Avg: 11390.04 / Max: 11429.12Min: 11500.94 / Avg: 11508.19 / Max: 11518.98Min: 15937.95 / Avg: 15943.17 / Max: 15947.04Min: 18465.31 / Avg: 18666.16 / Max: 18954.16Min: 18494.39 / Avg: 19183.83 / Max: 19482.1Min: 20331.11 / Avg: 20550.93 / Max: 20674.54Min: 20878.26 / Avg: 20910.53 / Max: 20950.67Min: 22476.61 / Avg: 22499.03 / Max: 22512.27Min: 26880.83 / Avg: 26943.42 / Max: 27036.41Min: 37586.55 / Avg: 37710.6 / Max: 37861.73Min: 39641.67 / Avg: 40032.81 / Max: 40450.75Min: 47565.14 / Avg: 47654.95 / Max: 47751.73Min: 48082.4 / Avg: 48122.16 / Max: 48200.321. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

ASTC Encoder

OpenBenchmarking.orgMT/s, More Is BetterASTC Encoder 4.7Preset: ExhaustiveXeon Platinum 8380Xeon Platinum 8380 2PXeon Max 9468EPYC 8534PNEPYC 8534PXeon Max 9480Xeon 6766EXeon 6780EXeon Platinum 8490HXeon Platinum 8592+EPYC 9654Xeon Max 9468 2PEPYC 9684XXeon 6766E 2PXeon Max 9480 2PEPYC 9754Xeon 6780E 2PXeon Platinum 8490H 2PXeon Platinum 8592+ 2PEPYC 9654 2PEPYC 9684X 2PEPYC 9754 2P48121620SE +/- 0.0016, N = 3SE +/- 0.0029, N = 3SE +/- 0.0003, N = 3SE +/- 0.0006, N = 3SE +/- 0.0010, N = 3SE +/- 0.0011, N = 3SE +/- 0.0007, N = 3SE +/- 0.0000, N = 3SE +/- 0.0024, N = 3SE +/- 0.0072, N = 3SE +/- 0.0002, N = 3SE +/- 0.0033, N = 3SE +/- 0.0086, N = 3SE +/- 0.0040, N = 3SE +/- 0.0016, N = 3SE +/- 0.0025, N = 3SE +/- 0.0118, N = 3SE +/- 0.0164, N = 3SE +/- 0.0157, N = 3SE +/- 0.0218, N = 3SE +/- 0.0170, N = 3SE +/- 0.1160, N = 31.33192.64713.12043.19933.51463.62763.65054.05744.26894.63035.63016.21266.30277.12917.20757.55737.90608.37018.909110.601811.910714.10381. (CXX) g++ options: -O3 -flto -pthread
OpenBenchmarking.orgMT/s, More Is BetterASTC Encoder 4.7Preset: ExhaustiveXeon Platinum 8380Xeon Platinum 8380 2PXeon Max 9468EPYC 8534PNEPYC 8534PXeon Max 9480Xeon 6766EXeon 6780EXeon Platinum 8490HXeon Platinum 8592+EPYC 9654Xeon Max 9468 2PEPYC 9684XXeon 6766E 2PXeon Max 9480 2PEPYC 9754Xeon 6780E 2PXeon Platinum 8490H 2PXeon Platinum 8592+ 2PEPYC 9654 2PEPYC 9684X 2PEPYC 9754 2P48121620Min: 1.33 / Avg: 1.33 / Max: 1.34Min: 2.64 / Avg: 2.65 / Max: 2.65Min: 3.12 / Avg: 3.12 / Max: 3.12Min: 3.2 / Avg: 3.2 / Max: 3.2Min: 3.51 / Avg: 3.51 / Max: 3.52Min: 3.63 / Avg: 3.63 / Max: 3.63Min: 3.65 / Avg: 3.65 / Max: 3.65Min: 4.06 / Avg: 4.06 / Max: 4.06Min: 4.26 / Avg: 4.27 / Max: 4.27Min: 4.62 / Avg: 4.63 / Max: 4.64Min: 5.63 / Avg: 5.63 / Max: 5.63Min: 6.21 / Avg: 6.21 / Max: 6.22Min: 6.29 / Avg: 6.3 / Max: 6.32Min: 7.12 / Avg: 7.13 / Max: 7.14Min: 7.2 / Avg: 7.21 / Max: 7.21Min: 7.55 / Avg: 7.56 / Max: 7.56Min: 7.88 / Avg: 7.91 / Max: 7.93Min: 8.34 / Avg: 8.37 / Max: 8.4Min: 8.88 / Avg: 8.91 / Max: 8.94Min: 10.56 / Avg: 10.6 / Max: 10.63Min: 11.88 / Avg: 11.91 / Max: 11.93Min: 13.89 / Avg: 14.1 / Max: 14.291. (CXX) g++ options: -O3 -flto -pthread

NAS Parallel Benchmarks

NPB, NAS Parallel Benchmarks, is a benchmark developed by NASA for high-end computer systems. This test profile currently uses the MPI version of NPB. This test profile offers selecting the different NPB tests/problems and varying problem sizes. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgTotal Mop/s, More Is BetterNAS Parallel Benchmarks 3.4Test / Class: SP.CXeon Platinum 8380EPYC 8534PNEPYC 8534PXeon Max 9468Xeon Max 9480Xeon Platinum 8490HXeon Platinum 8380 2PXeon Platinum 8592+EPYC 9654EPYC 9754Xeon Max 9468 2PXeon Max 9480 2PXeon Platinum 8490H 2PEPYC 9754 2PEPYC 9684XXeon Platinum 8592+ 2PEPYC 9654 2PEPYC 9684X 2P80K160K240K320K400KSE +/- 11.99, N = 3SE +/- 14.31, N = 3SE +/- 23.20, N = 3SE +/- 67.02, N = 3SE +/- 9.58, N = 3SE +/- 150.79, N = 3SE +/- 33.85, N = 3SE +/- 31.76, N = 4SE +/- 72.03, N = 4SE +/- 126.50, N = 4SE +/- 679.14, N = 4SE +/- 420.81, N = 4SE +/- 560.20, N = 4SE +/- 2064.71, N = 6SE +/- 1178.78, N = 6SE +/- 1528.09, N = 5SE +/- 1929.89, N = 5SE +/- 1666.53, N = 637567.6152684.9352745.6458815.3669776.4171245.2690420.25109416.42125191.11127519.37135939.25141954.15147311.14214017.18225311.82228184.68256584.67390520.931. (F9X) gfortran options: -O3 -march=native -lmpi_usempif08 -lmpi_mpifh -lmpi -lopen-rte -lopen-pal -lhwloc -levent_core -levent_pthreads -lm -lz 2. Open MPI 4.1.6
OpenBenchmarking.orgTotal Mop/s, More Is BetterNAS Parallel Benchmarks 3.4Test / Class: SP.CXeon Platinum 8380EPYC 8534PNEPYC 8534PXeon Max 9468Xeon Max 9480Xeon Platinum 8490HXeon Platinum 8380 2PXeon Platinum 8592+EPYC 9654EPYC 9754Xeon Max 9468 2PXeon Max 9480 2PXeon Platinum 8490H 2PEPYC 9754 2PEPYC 9684XXeon Platinum 8592+ 2PEPYC 9654 2PEPYC 9684X 2P70K140K210K280K350KMin: 37544.14 / Avg: 37567.61 / Max: 37583.57Min: 52660.53 / Avg: 52684.93 / Max: 52710.09Min: 52703.76 / Avg: 52745.64 / Max: 52783.88Min: 58681.77 / Avg: 58815.36 / Max: 58891.71Min: 69763.13 / Avg: 69776.41 / Max: 69795.01Min: 70955.45 / Avg: 71245.26 / Max: 71462.44Min: 90352.9 / Avg: 90420.25 / Max: 90459.95Min: 109336.91 / Avg: 109416.42 / Max: 109491.39Min: 124982.39 / Avg: 125191.11 / Max: 125309.88Min: 127231.63 / Avg: 127519.37 / Max: 127812.63Min: 134710.35 / Avg: 135939.25 / Max: 137559.55Min: 141180.27 / Avg: 141954.15 / Max: 143017.08Min: 145959.03 / Avg: 147311.14 / Max: 148493.65Min: 204670.06 / Avg: 214017.18 / Max: 217535.21Min: 221445.14 / Avg: 225311.82 / Max: 229655.95Min: 224647.99 / Avg: 228184.68 / Max: 232147.61Min: 249743.44 / Avg: 256584.67 / Max: 261160.94Min: 385928.37 / Avg: 390520.93 / Max: 396167.981. (F9X) gfortran options: -O3 -march=native -lmpi_usempif08 -lmpi_mpifh -lmpi -lopen-rte -lopen-pal -lhwloc -levent_core -levent_pthreads -lm -lz 2. Open MPI 4.1.6

ONNX Runtime

ONNX Runtime is developed by Microsoft and partners as a open-source, cross-platform, high performance machine learning inferencing and training accelerator. This test profile runs the ONNX Runtime with various models available from the ONNX Model Zoo. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.17Model: CaffeNet 12-int8 - Device: CPU - Executor: ParallelXeon 6766E 2PXeon 6780E 2PXeon 6766EXeon 6780EEPYC 9754 2PEPYC 9684X 2PEPYC 9654 2PEPYC 9754Xeon Max 9480 2PXeon Max 9468 2PEPYC 8534PEPYC 8534PNXeon Platinum 8490H 2PEPYC 9654EPYC 9684XXeon Platinum 8592+ 2PXeon Platinum 8380 2PXeon Max 9480Xeon Max 9468Xeon Platinum 8380Xeon Platinum 8490HXeon Platinum 8592+2004006008001000SE +/- 0.53, N = 3SE +/- 0.77, N = 3SE +/- 1.50, N = 15SE +/- 1.57, N = 3SE +/- 2.41, N = 15SE +/- 4.10, N = 3SE +/- 2.35, N = 15SE +/- 3.02, N = 15SE +/- 1.98, N = 3SE +/- 1.77, N = 3SE +/- 0.91, N = 3SE +/- 5.34, N = 6SE +/- 4.81, N = 3SE +/- 4.99, N = 15SE +/- 5.53, N = 15SE +/- 2.57, N = 3SE +/- 3.90, N = 3SE +/- 4.87, N = 3SE +/- 4.16, N = 3SE +/- 1.09, N = 3SE +/- 5.72, N = 3SE +/- 10.06, N = 481.2682.44176.64190.78270.63310.59315.36452.32478.47492.89547.52553.47566.38586.18590.71605.59641.00678.48687.67767.48784.30830.731. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt
OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.17Model: CaffeNet 12-int8 - Device: CPU - Executor: ParallelXeon 6766E 2PXeon 6780E 2PXeon 6766EXeon 6780EEPYC 9754 2PEPYC 9684X 2PEPYC 9654 2PEPYC 9754Xeon Max 9480 2PXeon Max 9468 2PEPYC 8534PEPYC 8534PNXeon Platinum 8490H 2PEPYC 9654EPYC 9684XXeon Platinum 8592+ 2PXeon Platinum 8380 2PXeon Max 9480Xeon Max 9468Xeon Platinum 8380Xeon Platinum 8490HXeon Platinum 8592+150300450600750Min: 80.65 / Avg: 81.26 / Max: 82.31Min: 81.38 / Avg: 82.44 / Max: 83.93Min: 166.25 / Avg: 176.64 / Max: 185.42Min: 187.89 / Avg: 190.78 / Max: 193.28Min: 261.16 / Avg: 270.63 / Max: 289.9Min: 304.95 / Avg: 310.59 / Max: 318.56Min: 306.87 / Avg: 315.35 / Max: 335.69Min: 439.25 / Avg: 452.32 / Max: 474.7Min: 474.56 / Avg: 478.47 / Max: 480.94Min: 490.15 / Avg: 492.89 / Max: 496.19Min: 545.72 / Avg: 547.52 / Max: 548.63Min: 546.36 / Avg: 553.47 / Max: 579.95Min: 559.3 / Avg: 566.38 / Max: 575.57Min: 566.09 / Avg: 586.18 / Max: 624.18Min: 563.2 / Avg: 590.71 / Max: 616.1Min: 600.49 / Avg: 605.59 / Max: 608.66Min: 634.62 / Avg: 641 / Max: 648.08Min: 672.26 / Avg: 678.48 / Max: 688.08Min: 680.54 / Avg: 687.67 / Max: 694.95Min: 765.67 / Avg: 767.48 / Max: 769.44Min: 773 / Avg: 784.3 / Max: 791.5Min: 800.82 / Avg: 830.72 / Max: 843.81. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

ASTC Encoder

OpenBenchmarking.orgMT/s, More Is BetterASTC Encoder 4.7Preset: Very ThoroughXeon Platinum 8380Xeon Platinum 8380 2PXeon Max 9468EPYC 8534PNEPYC 8534PXeon 6766EXeon Max 9480Xeon 6780EXeon Platinum 8490HXeon Platinum 8592+EPYC 9654Xeon Max 9468 2PEPYC 9684XXeon 6766E 2PXeon Max 9480 2PEPYC 9754Xeon 6780E 2PXeon Platinum 8490H 2PXeon Platinum 8592+ 2PEPYC 9654 2PEPYC 9684X 2PEPYC 9754 2P510152025SE +/- 0.0075, N = 3SE +/- 0.0026, N = 3SE +/- 0.0016, N = 3SE +/- 0.0012, N = 3SE +/- 0.0007, N = 3SE +/- 0.0005, N = 3SE +/- 0.0016, N = 3SE +/- 0.0005, N = 3SE +/- 0.0054, N = 3SE +/- 0.0294, N = 3SE +/- 0.0006, N = 3SE +/- 0.0055, N = 3SE +/- 0.0254, N = 3SE +/- 0.0386, N = 3SE +/- 0.0022, N = 3SE +/- 0.0006, N = 3SE +/- 0.0314, N = 3SE +/- 0.0379, N = 3SE +/- 0.0007, N = 3SE +/- 0.1965, N = 3SE +/- 0.1284, N = 3SE +/- 0.1961, N = 152.15964.29355.13425.24065.74205.86325.97026.51667.08857.62409.184410.205110.322411.357311.887512.318712.622013.751814.633417.009819.405222.00231. (CXX) g++ options: -O3 -flto -pthread
OpenBenchmarking.orgMT/s, More Is BetterASTC Encoder 4.7Preset: Very ThoroughXeon Platinum 8380Xeon Platinum 8380 2PXeon Max 9468EPYC 8534PNEPYC 8534PXeon 6766EXeon Max 9480Xeon 6780EXeon Platinum 8490HXeon Platinum 8592+EPYC 9654Xeon Max 9468 2PEPYC 9684XXeon 6766E 2PXeon Max 9480 2PEPYC 9754Xeon 6780E 2PXeon Platinum 8490H 2PXeon Platinum 8592+ 2PEPYC 9654 2PEPYC 9684X 2PEPYC 9754 2P510152025Min: 2.15 / Avg: 2.16 / Max: 2.17Min: 4.29 / Avg: 4.29 / Max: 4.3Min: 5.13 / Avg: 5.13 / Max: 5.14Min: 5.24 / Avg: 5.24 / Max: 5.24Min: 5.74 / Avg: 5.74 / Max: 5.74Min: 5.86 / Avg: 5.86 / Max: 5.86Min: 5.97 / Avg: 5.97 / Max: 5.97Min: 6.52 / Avg: 6.52 / Max: 6.52Min: 7.08 / Avg: 7.09 / Max: 7.1Min: 7.59 / Avg: 7.62 / Max: 7.68Min: 9.18 / Avg: 9.18 / Max: 9.19Min: 10.2 / Avg: 10.21 / Max: 10.22Min: 10.28 / Avg: 10.32 / Max: 10.37Min: 11.3 / Avg: 11.36 / Max: 11.43Min: 11.88 / Avg: 11.89 / Max: 11.89Min: 12.32 / Avg: 12.32 / Max: 12.32Min: 12.59 / Avg: 12.62 / Max: 12.68Min: 13.68 / Avg: 13.75 / Max: 13.8Min: 14.63 / Avg: 14.63 / Max: 14.63Min: 16.62 / Avg: 17.01 / Max: 17.22Min: 19.24 / Avg: 19.41 / Max: 19.66Min: 20.1 / Avg: 22 / Max: 22.781. (CXX) g++ options: -O3 -flto -pthread

Speedb

Speedb is a next-generation key value storage engine that is RocksDB compatible and aiming for stability, efficiency, and performance. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgOp/s, More Is BetterSpeedb 2.7Test: Random ReadXeon Platinum 8380Xeon Max 9468EPYC 8534PNXeon Max 9480Xeon Platinum 8380 2PEPYC 8534PXeon Platinum 8490HXeon Platinum 8592+Xeon Max 9468 2PEPYC 9654Xeon Max 9480 2PEPYC 9684XXeon Platinum 8490H 2PXeon Platinum 8592+ 2PEPYC 9754Xeon 6766EXeon 6780EEPYC 9654 2PEPYC 9684X 2PXeon 6766E 2PEPYC 9754 2PXeon 6780E 2P300M600M900M1200M1500MSE +/- 232538.80, N = 3SE +/- 3698537.65, N = 15SE +/- 70537.88, N = 3SE +/- 2763560.64, N = 13SE +/- 706582.63, N = 3SE +/- 109015.29, N = 3SE +/- 168680.90, N = 3SE +/- 242146.75, N = 3SE +/- 8491098.40, N = 15SE +/- 66268.38, N = 3SE +/- 2955608.21, N = 3SE +/- 205170.43, N = 3SE +/- 5393159.45, N = 3SE +/- 5399265.88, N = 15SE +/- 1606748.01, N = 3SE +/- 998087.60, N = 3SE +/- 1322733.50, N = 3SE +/- 955915.20, N = 3SE +/- 5954964.38, N = 3SE +/- 1272758.30, N = 3SE +/- 2399164.12, N = 3SE +/- 2674444.99, N = 313035914521145704824294011024407067425913646627409177827617961731517838141994357042855705449790749053763303455128695858614787158995107059695549467315921785768717910595465331158496546116994738513241633401. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti -lpthread
OpenBenchmarking.orgOp/s, More Is BetterSpeedb 2.7Test: Random ReadXeon Platinum 8380Xeon Max 9468EPYC 8534PNXeon Max 9480Xeon Platinum 8380 2PEPYC 8534PXeon Platinum 8490HXeon Platinum 8592+Xeon Max 9468 2PEPYC 9654Xeon Max 9480 2PEPYC 9684XXeon Platinum 8490H 2PXeon Platinum 8592+ 2PEPYC 9754Xeon 6766EXeon 6780EEPYC 9654 2PEPYC 9684X 2PXeon 6766E 2PEPYC 9754 2PXeon 6780E 2P200M400M600M800M1000MMin: 129894610 / Avg: 130359145.33 / Max: 130610857Min: 183773999 / Avg: 211457047.53 / Max: 218801419Min: 242827547 / Avg: 242940110 / Max: 243070039Min: 211153701 / Avg: 244070673.77 / Max: 247613116Min: 257809302 / Avg: 259136466 / Max: 260220469Min: 273882563 / Avg: 274091778.33 / Max: 274249534Min: 275854286 / Avg: 276179617 / Max: 276419610Min: 314847036 / Avg: 315178380.67 / Max: 315649934Min: 365172792 / Avg: 419943569.73 / Max: 440904796Min: 428426945 / Avg: 428557054.33 / Max: 428643976Min: 493247765 / Avg: 497907489.67 / Max: 503387286Min: 537317761 / Avg: 537633034 / Max: 538018128Min: 540533097 / Avg: 551286957.67 / Max: 557388020Min: 537891393 / Avg: 586147871.33 / Max: 608835550Min: 586849882 / Avg: 589951069.67 / Max: 592230974Min: 595935540 / Avg: 596955493.67 / Max: 598951508Min: 671726289 / Avg: 673159217 / Max: 675801534Min: 855890268 / Avg: 857687178.67 / Max: 859151015Min: 1048590952 / Avg: 1059546533 / Max: 1069069844Min: 1155961542 / Avg: 1158496546.33 / Max: 1159964188Min: 1166288728 / Avg: 1169947385 / Max: 1174465326Min: 1319980183 / Avg: 1324163339.67 / Max: 13291417621. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti -lpthread

RocksDB

OpenBenchmarking.orgOp/s, More Is BetterRocksDB 9.0Test: Random ReadXeon Platinum 8380Xeon Max 9468Xeon Max 9480EPYC 8534PNXeon Platinum 8380 2PXeon Platinum 8490HEPYC 8534PXeon Platinum 8592+Xeon Max 9468 2PEPYC 9654Xeon Max 9480 2PEPYC 9684XXeon Platinum 8490H 2PEPYC 9754Xeon 6766EXeon Platinum 8592+ 2PXeon 6780EEPYC 9654 2PEPYC 9684X 2PXeon 6766E 2PEPYC 9754 2PXeon 6780E 2P300M600M900M1200M1500MSE +/- 744772.41, N = 3SE +/- 81327.78, N = 3SE +/- 86315.43, N = 3SE +/- 211259.57, N = 3SE +/- 704022.38, N = 3SE +/- 3338569.32, N = 3SE +/- 206014.27, N = 3SE +/- 1119855.47, N = 3SE +/- 1120857.00, N = 3SE +/- 610621.13, N = 3SE +/- 785893.13, N = 3SE +/- 326038.01, N = 3SE +/- 1411218.60, N = 3SE +/- 153963.59, N = 3SE +/- 1336933.52, N = 3SE +/- 82996.27, N = 3SE +/- 2130676.22, N = 3SE +/- 599126.55, N = 3SE +/- 2927744.32, N = 3SE +/- 4448269.22, N = 3SE +/- 1154820.73, N = 3SE +/- 1897433.73, N = 312558495320534615423446993923499263625123410326536617026618653729751794640553317340927294947375594652331009152504999857323545257474955257839280064530948381514511010312091511115720742113520656412729075611. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti -lpthread
OpenBenchmarking.orgOp/s, More Is BetterRocksDB 9.0Test: Random ReadXeon Platinum 8380Xeon Max 9468Xeon Max 9480EPYC 8534PNXeon Platinum 8380 2PXeon Platinum 8490HEPYC 8534PXeon Platinum 8592+Xeon Max 9468 2PEPYC 9654Xeon Max 9480 2PEPYC 9684XXeon Platinum 8490H 2PEPYC 9754Xeon 6766EXeon Platinum 8592+ 2PXeon 6780EEPYC 9654 2PEPYC 9684X 2PXeon 6766E 2PEPYC 9754 2PXeon 6780E 2P200M400M600M800M1000MMin: 124308540 / Avg: 125584953 / Max: 126888092Min: 205193864 / Avg: 205346153.67 / Max: 205471781Min: 234318066 / Avg: 234469938.67 / Max: 234616953Min: 234581712 / Avg: 234992636.33 / Max: 235283232Min: 249830811 / Avg: 251234103.33 / Max: 252035852Min: 261907154 / Avg: 265366169.67 / Max: 272041842Min: 265919433 / Avg: 266186536.67 / Max: 266591782Min: 295339623 / Avg: 297517946 / Max: 299058118Min: 403617121 / Avg: 405533172.67 / Max: 407498929Min: 408096411 / Avg: 409272949 / Max: 410144755Min: 472700204 / Avg: 473755946.33 / Max: 475292252Min: 522961186 / Avg: 523310090.67 / Max: 523961619Min: 523359264 / Avg: 525049998.33 / Max: 527852577Min: 572938337 / Avg: 573235452 / Max: 573454055Min: 572554729 / Avg: 574749552 / Max: 577169551Min: 578230155 / Avg: 578392800 / Max: 578502847Min: 642210742 / Avg: 645309483.33 / Max: 649392171Min: 814516962 / Avg: 815145110.33 / Max: 816342887Min: 1025561204 / Avg: 1031209151.33 / Max: 1035371250Min: 1110126091 / Avg: 1115720741.67 / Max: 1124508577Min: 1133039360 / Avg: 1135206564.33 / Max: 1136981724Min: 1270505803 / Avg: 1272907561.33 / Max: 12766529311. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti -lpthread

TensorFlow

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.16.1Device: CPU - Batch Size: 1 - Model: ResNet-50Xeon 6766E 2PXeon 6780E 2PEPYC 9754 2PEPYC 9654 2PXeon Platinum 8592+ 2PEPYC 9684X 2PXeon Max 9480 2PXeon Platinum 8490H 2PXeon 6766EXeon 6780EXeon Max 9468 2PEPYC 9754Xeon Platinum 8592+EPYC 9684XEPYC 9654Xeon Platinum 8380 2PXeon Max 9480Xeon Platinum 8490HEPYC 8534PNEPYC 8534PXeon Max 9468Xeon Platinum 838048121620SE +/- 0.01, N = 15SE +/- 0.02, N = 3SE +/- 0.03, N = 15SE +/- 0.06, N = 15SE +/- 0.03, N = 15SE +/- 0.01, N = 3SE +/- 0.04, N = 15SE +/- 0.06, N = 15SE +/- 0.04, N = 3SE +/- 0.01, N = 3SE +/- 0.07, N = 3SE +/- 0.05, N = 15SE +/- 0.05, N = 9SE +/- 0.09, N = 15SE +/- 0.01, N = 4SE +/- 0.13, N = 15SE +/- 0.10, N = 4SE +/- 0.05, N = 4SE +/- 0.08, N = 15SE +/- 0.08, N = 15SE +/- 0.09, N = 4SE +/- 0.08, N = 51.761.992.473.663.853.924.374.394.675.025.116.196.438.969.019.139.9910.5310.7010.7911.2917.82
OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.16.1Device: CPU - Batch Size: 1 - Model: ResNet-50Xeon 6766E 2PXeon 6780E 2PEPYC 9754 2PEPYC 9654 2PXeon Platinum 8592+ 2PEPYC 9684X 2PXeon Max 9480 2PXeon Platinum 8490H 2PXeon 6766EXeon 6780EXeon Max 9468 2PEPYC 9754Xeon Platinum 8592+EPYC 9684XEPYC 9654Xeon Platinum 8380 2PXeon Max 9480Xeon Platinum 8490HEPYC 8534PNEPYC 8534PXeon Max 9468Xeon Platinum 8380510152025Min: 1.65 / Avg: 1.76 / Max: 1.83Min: 1.95 / Avg: 1.99 / Max: 2.03Min: 2.25 / Avg: 2.47 / Max: 2.59Min: 3.19 / Avg: 3.66 / Max: 3.87Min: 3.69 / Avg: 3.85 / Max: 4.15Min: 3.9 / Avg: 3.92 / Max: 3.94Min: 4.15 / Avg: 4.37 / Max: 4.65Min: 3.94 / Avg: 4.39 / Max: 4.78Min: 4.59 / Avg: 4.67 / Max: 4.71Min: 5 / Avg: 5.02 / Max: 5.03Min: 5.03 / Avg: 5.11 / Max: 5.25Min: 5.74 / Avg: 6.19 / Max: 6.32Min: 6.29 / Avg: 6.43 / Max: 6.82Min: 8.25 / Avg: 8.96 / Max: 9.18Min: 8.99 / Avg: 9.01 / Max: 9.04Min: 8.29 / Avg: 9.13 / Max: 9.83Min: 9.74 / Avg: 9.99 / Max: 10.17Min: 10.44 / Avg: 10.53 / Max: 10.67Min: 10.28 / Avg: 10.7 / Max: 10.95Min: 10.41 / Avg: 10.79 / Max: 11.09Min: 11.1 / Avg: 11.29 / Max: 11.51Min: 17.52 / Avg: 17.82 / Max: 17.95

OpenVINO

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Handwritten English Recognition FP16-INT8 - Device: CPUXeon Platinum 8380Xeon 6766EXeon 6780EXeon Platinum 8380 2PEPYC 8534PNEPYC 8534PXeon 6766E 2PXeon Platinum 8490HXeon 6780E 2PXeon Max 9468Xeon Max 9480EPYC 9654Xeon Platinum 8592+EPYC 9684XEPYC 9754Xeon Max 9468 2PXeon Max 9480 2PXeon Platinum 8490H 2PEPYC 9654 2PXeon Platinum 8592+ 2PEPYC 9684X 2PEPYC 9754 2P14002800420056007000SE +/- 4.60, N = 3SE +/- 1.73, N = 3SE +/- 0.61, N = 3SE +/- 9.58, N = 15SE +/- 0.47, N = 3SE +/- 3.51, N = 3SE +/- 1.20, N = 3SE +/- 1.46, N = 3SE +/- 3.81, N = 3SE +/- 3.41, N = 3SE +/- 4.55, N = 3SE +/- 4.84, N = 3SE +/- 0.73, N = 3SE +/- 4.06, N = 3SE +/- 7.27, N = 3SE +/- 1.09, N = 3SE +/- 2.81, N = 3SE +/- 2.46, N = 3SE +/- 9.83, N = 3SE +/- 3.43, N = 3SE +/- 13.59, N = 3SE +/- 14.68, N = 3637.76832.29934.971313.391396.781542.611593.881643.431826.822074.302243.842739.012924.662986.333280.253998.024351.594744.055178.295570.635766.626400.941. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Handwritten English Recognition FP16-INT8 - Device: CPUXeon Platinum 8380Xeon 6766EXeon 6780EXeon Platinum 8380 2PEPYC 8534PNEPYC 8534PXeon 6766E 2PXeon Platinum 8490HXeon 6780E 2PXeon Max 9468Xeon Max 9480EPYC 9654Xeon Platinum 8592+EPYC 9684XEPYC 9754Xeon Max 9468 2PXeon Max 9480 2PXeon Platinum 8490H 2PEPYC 9654 2PXeon Platinum 8592+ 2PEPYC 9684X 2PEPYC 9754 2P11002200330044005500Min: 629.87 / Avg: 637.76 / Max: 645.79Min: 830.23 / Avg: 832.29 / Max: 835.73Min: 933.75 / Avg: 934.97 / Max: 935.63Min: 1242.87 / Avg: 1313.39 / Max: 1368.46Min: 1396.26 / Avg: 1396.78 / Max: 1397.73Min: 1535.74 / Avg: 1542.61 / Max: 1547.3Min: 1592.11 / Avg: 1593.88 / Max: 1596.17Min: 1640.97 / Avg: 1643.43 / Max: 1646.02Min: 1821.17 / Avg: 1826.82 / Max: 1834.07Min: 2067.66 / Avg: 2074.3 / Max: 2078.94Min: 2236.43 / Avg: 2243.84 / Max: 2252.13Min: 2729.69 / Avg: 2739.01 / Max: 2745.92Min: 2923.2 / Avg: 2924.66 / Max: 2925.43Min: 2978.93 / Avg: 2986.33 / Max: 2992.91Min: 3266.6 / Avg: 3280.25 / Max: 3291.4Min: 3995.99 / Avg: 3998.02 / Max: 3999.72Min: 4346.02 / Avg: 4351.59 / Max: 4355.05Min: 4741.37 / Avg: 4744.05 / Max: 4748.96Min: 5160.08 / Avg: 5178.29 / Max: 5193.81Min: 5565.94 / Avg: 5570.63 / Max: 5577.32Min: 5739.95 / Avg: 5766.62 / Max: 5784.5Min: 6371.9 / Avg: 6400.94 / Max: 6419.171. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

FFmpeg

OpenBenchmarking.orgFPS, More Is BetterFFmpeg 7.0Encoder: libx265 - Scenario: UploadXeon 6766E 2PXeon 6766EXeon 6780E 2PXeon 6780EXeon Platinum 8380 2PXeon Platinum 8380Xeon Max 9468 2PEPYC 8534PEPYC 8534PNEPYC 9754 2PXeon Max 9480 2PXeon Max 9468EPYC 9754Xeon Max 9480Xeon Platinum 8490H 2PXeon Platinum 8490HEPYC 9654 2PXeon Platinum 8592+ 2PXeon Platinum 8592+EPYC 9684X 2PEPYC 9684XEPYC 9654714212835SE +/- 0.01, N = 3SE +/- 0.00, N = 3SE +/- 0.01, N = 3SE +/- 0.00, N = 3SE +/- 0.06, N = 3SE +/- 0.07, N = 3SE +/- 0.12, N = 3SE +/- 0.04, N = 3SE +/- 0.02, N = 3SE +/- 0.04, N = 3SE +/- 0.07, N = 3SE +/- 0.00, N = 3SE +/- 0.03, N = 3SE +/- 0.07, N = 3SE +/- 0.10, N = 3SE +/- 0.04, N = 3SE +/- 0.04, N = 3SE +/- 0.04, N = 3SE +/- 0.05, N = 3SE +/- 0.03, N = 3SE +/- 0.03, N = 3SE +/- 0.01, N = 313.9014.0114.8715.4721.7321.9622.3423.2523.2723.2823.3023.3323.3623.7724.5624.9726.4126.8026.9327.4327.6127.661. (CXX) g++ options: -O3 -rdynamic -lpthread -lrt -ldl -lnuma
OpenBenchmarking.orgFPS, More Is BetterFFmpeg 7.0Encoder: libx265 - Scenario: UploadXeon 6766E 2PXeon 6766EXeon 6780E 2PXeon 6780EXeon Platinum 8380 2PXeon Platinum 8380Xeon Max 9468 2PEPYC 8534PEPYC 8534PNEPYC 9754 2PXeon Max 9480 2PXeon Max 9468EPYC 9754Xeon Max 9480Xeon Platinum 8490H 2PXeon Platinum 8490HEPYC 9654 2PXeon Platinum 8592+ 2PXeon Platinum 8592+EPYC 9684X 2PEPYC 9684XEPYC 9654612182430Min: 13.89 / Avg: 13.9 / Max: 13.91Min: 14.01 / Avg: 14.01 / Max: 14.02Min: 14.87 / Avg: 14.87 / Max: 14.89Min: 15.46 / Avg: 15.47 / Max: 15.47Min: 21.65 / Avg: 21.73 / Max: 21.85Min: 21.82 / Avg: 21.96 / Max: 22.05Min: 22.12 / Avg: 22.34 / Max: 22.55Min: 23.21 / Avg: 23.25 / Max: 23.32Min: 23.25 / Avg: 23.27 / Max: 23.3Min: 23.21 / Avg: 23.28 / Max: 23.34Min: 23.18 / Avg: 23.3 / Max: 23.4Min: 23.33 / Avg: 23.33 / Max: 23.33Min: 23.3 / Avg: 23.36 / Max: 23.39Min: 23.66 / Avg: 23.77 / Max: 23.89Min: 24.42 / Avg: 24.56 / Max: 24.75Min: 24.9 / Avg: 24.97 / Max: 25.05Min: 26.36 / Avg: 26.41 / Max: 26.48Min: 26.73 / Avg: 26.8 / Max: 26.85Min: 26.83 / Avg: 26.93 / Max: 26.98Min: 27.38 / Avg: 27.43 / Max: 27.47Min: 27.55 / Avg: 27.61 / Max: 27.64Min: 27.64 / Avg: 27.66 / Max: 27.681. (CXX) g++ options: -O3 -rdynamic -lpthread -lrt -ldl -lnuma

ClickHouse

ClickHouse is an open-source, high performance OLAP data management system. This test profile uses ClickHouse's standard benchmark recommendations per https://clickhouse.com/docs/en/operations/performance-test/ / https://github.com/ClickHouse/ClickBench/tree/main/clickhouse with the 100 million rows web analytics dataset. The reported value is the query processing time using the geometric mean of all separate queries performed as an aggregate. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgQueries Per Minute, Geo Mean, More Is BetterClickHouse 22.12.3.5100M Rows Hits Dataset, First Run / Cold CacheXeon Platinum 8380 2PXeon 6766E 2PEPYC 8534PNEPYC 8534PXeon Platinum 8380Xeon 6780E 2PXeon 6766EXeon 6780EEPYC 9754 2PXeon Platinum 8592+ 2PEPYC 9754Xeon Platinum 8592+Xeon Max 9468Xeon Max 9480 2PXeon Max 9480Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468 2PEPYC 9654 2PEPYC 9684X 2PEPYC 9654EPYC 9684X120240360480600SE +/- 1.56, N = 3SE +/- 1.51, N = 3SE +/- 1.88, N = 3SE +/- 1.57, N = 3SE +/- 1.56, N = 3SE +/- 3.71, N = 3SE +/- 2.21, N = 3SE +/- 1.12, N = 3SE +/- 4.49, N = 5SE +/- 4.12, N = 5SE +/- 2.78, N = 3SE +/- 4.18, N = 6SE +/- 2.85, N = 3SE +/- 3.85, N = 12SE +/- 5.88, N = 3SE +/- 3.41, N = 3SE +/- 4.37, N = 3SE +/- 1.35, N = 3SE +/- 6.05, N = 3SE +/- 4.34, N = 3SE +/- 5.33, N = 3SE +/- 7.88, N = 3285.17311.63322.69323.59326.65333.06365.62388.29411.26423.30433.79437.20446.40460.66461.62465.50485.63491.89504.84513.92536.82566.31
OpenBenchmarking.orgQueries Per Minute, Geo Mean, More Is BetterClickHouse 22.12.3.5100M Rows Hits Dataset, First Run / Cold CacheXeon Platinum 8380 2PXeon 6766E 2PEPYC 8534PNEPYC 8534PXeon Platinum 8380Xeon 6780E 2PXeon 6766EXeon 6780EEPYC 9754 2PXeon Platinum 8592+ 2PEPYC 9754Xeon Platinum 8592+Xeon Max 9468Xeon Max 9480 2PXeon Max 9480Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468 2PEPYC 9654 2PEPYC 9684X 2PEPYC 9654EPYC 9684X100200300400500Min: 282.15 / Avg: 285.17 / Max: 287.4Min: 309.18 / Avg: 311.63 / Max: 314.38Min: 320.77 / Avg: 322.69 / Max: 326.45Min: 320.66 / Avg: 323.59 / Max: 326.03Min: 324.87 / Avg: 326.65 / Max: 329.76Min: 326.62 / Avg: 333.06 / Max: 339.48Min: 361.74 / Avg: 365.62 / Max: 369.41Min: 386.44 / Avg: 388.29 / Max: 390.3Min: 395.43 / Avg: 411.26 / Max: 420.76Min: 412.49 / Avg: 423.3 / Max: 437.55Min: 429.82 / Avg: 433.79 / Max: 439.16Min: 426.53 / Avg: 437.2 / Max: 455.19Min: 441.14 / Avg: 446.4 / Max: 450.91Min: 437.57 / Avg: 460.66 / Max: 481.51Min: 452.26 / Avg: 461.62 / Max: 472.47Min: 460.18 / Avg: 465.5 / Max: 471.85Min: 476.93 / Avg: 485.63 / Max: 490.74Min: 489.2 / Avg: 491.89 / Max: 493.37Min: 493.09 / Avg: 504.84 / Max: 513.2Min: 505.69 / Avg: 513.92 / Max: 520.39Min: 529.9 / Avg: 536.82 / Max: 547.31Min: 553.2 / Avg: 566.31 / Max: 580.42

Timed FFmpeg Compilation

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed FFmpeg Compilation 7.0Time To CompileXeon Platinum 8380EPYC 8534PNXeon 6766EEPYC 8534PXeon Max 9468Xeon Platinum 8380 2PXeon 6766E 2PXeon 6780EXeon Max 9480Xeon Platinum 8490HXeon 6780E 2PEPYC 9754Xeon Platinum 8592+EPYC 9754 2PXeon Max 9468 2PEPYC 9654Xeon Max 9480 2PEPYC 9684XXeon Platinum 8490H 2PEPYC 9654 2PEPYC 9684X 2PXeon Platinum 8592+ 2P816243240SE +/- 0.06, N = 3SE +/- 0.04, N = 3SE +/- 0.03, N = 3SE +/- 0.05, N = 3SE +/- 0.03, N = 3SE +/- 0.03, N = 3SE +/- 0.06, N = 3SE +/- 0.01, N = 3SE +/- 0.09, N = 3SE +/- 0.04, N = 3SE +/- 0.03, N = 3SE +/- 0.11, N = 3SE +/- 0.07, N = 3SE +/- 0.30, N = 3SE +/- 0.09, N = 3SE +/- 0.03, N = 3SE +/- 0.03, N = 3SE +/- 0.02, N = 3SE +/- 0.01, N = 3SE +/- 0.05, N = 3SE +/- 0.03, N = 3SE +/- 0.05, N = 334.2928.4227.8527.5426.4625.9425.7125.2424.8424.0623.3223.2221.3621.2220.7920.4920.0119.9919.5118.0917.8417.39
OpenBenchmarking.orgSeconds, Fewer Is BetterTimed FFmpeg Compilation 7.0Time To CompileXeon Platinum 8380EPYC 8534PNXeon 6766EEPYC 8534PXeon Max 9468Xeon Platinum 8380 2PXeon 6766E 2PXeon 6780EXeon Max 9480Xeon Platinum 8490HXeon 6780E 2PEPYC 9754Xeon Platinum 8592+EPYC 9754 2PXeon Max 9468 2PEPYC 9654Xeon Max 9480 2PEPYC 9684XXeon Platinum 8490H 2PEPYC 9654 2PEPYC 9684X 2PXeon Platinum 8592+ 2P714212835Min: 34.2 / Avg: 34.29 / Max: 34.41Min: 28.37 / Avg: 28.42 / Max: 28.49Min: 27.8 / Avg: 27.85 / Max: 27.91Min: 27.44 / Avg: 27.54 / Max: 27.63Min: 26.4 / Avg: 26.46 / Max: 26.49Min: 25.89 / Avg: 25.94 / Max: 25.98Min: 25.59 / Avg: 25.71 / Max: 25.78Min: 25.22 / Avg: 25.23 / Max: 25.26Min: 24.75 / Avg: 24.84 / Max: 25.02Min: 23.99 / Avg: 24.06 / Max: 24.11Min: 23.29 / Avg: 23.32 / Max: 23.37Min: 23 / Avg: 23.22 / Max: 23.34Min: 21.25 / Avg: 21.36 / Max: 21.48Min: 20.82 / Avg: 21.22 / Max: 21.8Min: 20.61 / Avg: 20.79 / Max: 20.91Min: 20.46 / Avg: 20.49 / Max: 20.55Min: 19.96 / Avg: 20.01 / Max: 20.06Min: 19.97 / Avg: 19.99 / Max: 20.02Min: 19.48 / Avg: 19.51 / Max: 19.53Min: 17.99 / Avg: 18.09 / Max: 18.17Min: 17.77 / Avg: 17.84 / Max: 17.89Min: 17.29 / Avg: 17.39 / Max: 17.47

TensorFlow

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.16.1Device: CPU - Batch Size: 64 - Model: ResNet-50Xeon 6766E 2PEPYC 9754 2PXeon 6780E 2PXeon 6766EXeon 6780EEPYC 8534PNEPYC 9654 2PEPYC 9684X 2PEPYC 8534PXeon Platinum 8380Xeon Platinum 8592+Xeon Platinum 8592+ 2PXeon Max 9480Xeon Max 9468EPYC 9684XEPYC 9754Xeon Max 9480 2PXeon Platinum 8380 2PXeon Max 9468 2PEPYC 9654Xeon Platinum 8490H 2PXeon Platinum 8490H306090120150SE +/- 0.56, N = 3SE +/- 0.88, N = 3SE +/- 0.76, N = 3SE +/- 0.04, N = 3SE +/- 0.14, N = 3SE +/- 0.11, N = 3SE +/- 0.91, N = 5SE +/- 1.04, N = 4SE +/- 0.05, N = 3SE +/- 0.36, N = 3SE +/- 0.50, N = 3SE +/- 0.70, N = 3SE +/- 0.93, N = 3SE +/- 0.13, N = 3SE +/- 0.08, N = 3SE +/- 0.60, N = 3SE +/- 1.28, N = 3SE +/- 1.42, N = 3SE +/- 0.39, N = 3SE +/- 0.64, N = 3SE +/- 1.12, N = 3SE +/- 0.04, N = 361.4867.0868.5271.4176.3780.8682.9486.0887.3190.7291.5194.66103.56104.23104.52106.14107.30108.32111.71114.63115.47120.93
OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.16.1Device: CPU - Batch Size: 64 - Model: ResNet-50Xeon 6766E 2PEPYC 9754 2PXeon 6780E 2PXeon 6766EXeon 6780EEPYC 8534PNEPYC 9654 2PEPYC 9684X 2PEPYC 8534PXeon Platinum 8380Xeon Platinum 8592+Xeon Platinum 8592+ 2PXeon Max 9480Xeon Max 9468EPYC 9684XEPYC 9754Xeon Max 9480 2PXeon Platinum 8380 2PXeon Max 9468 2PEPYC 9654Xeon Platinum 8490H 2PXeon Platinum 8490H20406080100Min: 60.5 / Avg: 61.48 / Max: 62.44Min: 65.45 / Avg: 67.08 / Max: 68.46Min: 67 / Avg: 68.52 / Max: 69.38Min: 71.36 / Avg: 71.41 / Max: 71.48Min: 76.13 / Avg: 76.37 / Max: 76.62Min: 80.63 / Avg: 80.86 / Max: 80.98Min: 79.32 / Avg: 82.94 / Max: 84.03Min: 83.06 / Avg: 86.08 / Max: 87.8Min: 87.23 / Avg: 87.31 / Max: 87.41Min: 90.32 / Avg: 90.72 / Max: 91.44Min: 90.88 / Avg: 91.51 / Max: 92.5Min: 93.32 / Avg: 94.66 / Max: 95.7Min: 101.7 / Avg: 103.56 / Max: 104.56Min: 104.01 / Avg: 104.23 / Max: 104.47Min: 104.44 / Avg: 104.52 / Max: 104.67Min: 104.94 / Avg: 106.14 / Max: 106.84Min: 105.37 / Avg: 107.3 / Max: 109.71Min: 105.58 / Avg: 108.32 / Max: 110.31Min: 111.29 / Avg: 111.71 / Max: 112.49Min: 113.52 / Avg: 114.63 / Max: 115.72Min: 113.57 / Avg: 115.47 / Max: 117.44Min: 120.89 / Avg: 120.93 / Max: 121.01

Timed Godot Game Engine Compilation

This test times how long it takes to compile the Godot Game Engine. Godot is a popular, open-source, cross-platform 2D/3D game engine and is built using the SCons build system and targeting the X11 platform. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed Godot Game Engine Compilation 4.0Time To CompileXeon Platinum 8380Xeon 6766EXeon 6766E 2PEPYC 8534PNEPYC 8534PXeon 6780EXeon Platinum 8380 2PXeon Max 9468Xeon 6780E 2PXeon Max 9480Xeon Platinum 8490HEPYC 9754EPYC 9754 2PXeon Max 9468 2PXeon Platinum 8592+Xeon Max 9480 2PXeon Platinum 8490H 2PEPYC 9654Xeon Platinum 8592+ 2PEPYC 9684XEPYC 9654 2PEPYC 9684X 2P4080120160200SE +/- 0.22, N = 3SE +/- 0.16, N = 3SE +/- 0.64, N = 3SE +/- 0.16, N = 3SE +/- 0.32, N = 3SE +/- 0.73, N = 3SE +/- 0.69, N = 3SE +/- 0.18, N = 3SE +/- 1.40, N = 3SE +/- 0.32, N = 3SE +/- 0.76, N = 3SE +/- 0.20, N = 3SE +/- 0.55, N = 3SE +/- 0.56, N = 3SE +/- 0.91, N = 3SE +/- 1.69, N = 3SE +/- 0.56, N = 3SE +/- 0.16, N = 3SE +/- 0.29, N = 3SE +/- 0.12, N = 3SE +/- 0.06, N = 3SE +/- 0.62, N = 3187.88165.41160.46159.62154.01152.23151.54149.38148.99143.81140.23128.28126.11123.88122.72122.70118.57111.69103.38103.35102.5896.16
OpenBenchmarking.orgSeconds, Fewer Is BetterTimed Godot Game Engine Compilation 4.0Time To CompileXeon Platinum 8380Xeon 6766EXeon 6766E 2PEPYC 8534PNEPYC 8534PXeon 6780EXeon Platinum 8380 2PXeon Max 9468Xeon 6780E 2PXeon Max 9480Xeon Platinum 8490HEPYC 9754EPYC 9754 2PXeon Max 9468 2PXeon Platinum 8592+Xeon Max 9480 2PXeon Platinum 8490H 2PEPYC 9654Xeon Platinum 8592+ 2PEPYC 9684XEPYC 9654 2PEPYC 9684X 2P306090120150Min: 187.45 / Avg: 187.88 / Max: 188.19Min: 165.09 / Avg: 165.41 / Max: 165.61Min: 159.72 / Avg: 160.46 / Max: 161.73Min: 159.44 / Avg: 159.62 / Max: 159.94Min: 153.59 / Avg: 154.01 / Max: 154.64Min: 150.77 / Avg: 152.23 / Max: 152.96Min: 150.33 / Avg: 151.54 / Max: 152.72Min: 149.02 / Avg: 149.38 / Max: 149.59Min: 146.24 / Avg: 148.99 / Max: 150.85Min: 143.2 / Avg: 143.81 / Max: 144.31Min: 138.79 / Avg: 140.23 / Max: 141.34Min: 128.02 / Avg: 128.28 / Max: 128.66Min: 125.01 / Avg: 126.11 / Max: 126.72Min: 123.06 / Avg: 123.88 / Max: 124.94Min: 121.35 / Avg: 122.72 / Max: 124.45Min: 120.06 / Avg: 122.7 / Max: 125.86Min: 117.47 / Avg: 118.57 / Max: 119.27Min: 111.37 / Avg: 111.69 / Max: 111.85Min: 102.83 / Avg: 103.38 / Max: 103.79Min: 103.15 / Avg: 103.35 / Max: 103.58Min: 102.49 / Avg: 102.58 / Max: 102.7Min: 95.32 / Avg: 96.16 / Max: 97.38

GNU Octave Benchmark

This test profile measures how long it takes to complete several reference GNU Octave files via octave-benchmark. GNU Octave is used for numerical computations and is an open-source alternative to MATLAB. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterGNU Octave Benchmark 8.4.0Xeon Max 9468 2PXeon Max 9480 2PXeon 6766E 2PXeon 6780E 2PXeon 6766EXeon 6780EXeon Platinum 8380 2PXeon Platinum 8380EPYC 8534PNEPYC 8534PEPYC 9754 2PEPYC 9754Xeon Platinum 8490H 2PXeon Max 9480EPYC 9654 2PXeon Max 9468Xeon Platinum 8490HEPYC 9654EPYC 9684X 2PEPYC 9684XXeon Platinum 8592+ 2PXeon Platinum 8592+3691215SE +/- 0.096, N = 5SE +/- 0.082, N = 5SE +/- 0.023, N = 5SE +/- 0.108, N = 7SE +/- 0.035, N = 5SE +/- 0.051, N = 5SE +/- 0.052, N = 5SE +/- 0.017, N = 5SE +/- 0.007, N = 5SE +/- 0.011, N = 5SE +/- 0.025, N = 5SE +/- 0.014, N = 5SE +/- 0.019, N = 6SE +/- 0.024, N = 6SE +/- 0.004, N = 6SE +/- 0.015, N = 6SE +/- 0.015, N = 6SE +/- 0.009, N = 6SE +/- 0.007, N = 6SE +/- 0.018, N = 6SE +/- 0.019, N = 6SE +/- 0.020, N = 612.61712.57812.24511.61910.99610.2439.6949.1048.9488.9298.8488.8018.0367.7487.6457.6227.5327.5286.9556.8576.8566.458
OpenBenchmarking.orgSeconds, Fewer Is BetterGNU Octave Benchmark 8.4.0Xeon Max 9468 2PXeon Max 9480 2PXeon 6766E 2PXeon 6780E 2PXeon 6766EXeon 6780EXeon Platinum 8380 2PXeon Platinum 8380EPYC 8534PNEPYC 8534PEPYC 9754 2PEPYC 9754Xeon Platinum 8490H 2PXeon Max 9480EPYC 9654 2PXeon Max 9468Xeon Platinum 8490HEPYC 9654EPYC 9684X 2PEPYC 9684XXeon Platinum 8592+ 2PXeon Platinum 8592+48121620Min: 12.38 / Avg: 12.62 / Max: 12.95Min: 12.35 / Avg: 12.58 / Max: 12.85Min: 12.17 / Avg: 12.25 / Max: 12.31Min: 11.33 / Avg: 11.62 / Max: 12.2Min: 10.9 / Avg: 11 / Max: 11.08Min: 10.14 / Avg: 10.24 / Max: 10.41Min: 9.56 / Avg: 9.69 / Max: 9.82Min: 9.04 / Avg: 9.1 / Max: 9.13Min: 8.93 / Avg: 8.95 / Max: 8.97Min: 8.91 / Avg: 8.93 / Max: 8.97Min: 8.8 / Avg: 8.85 / Max: 8.93Min: 8.77 / Avg: 8.8 / Max: 8.84Min: 7.97 / Avg: 8.04 / Max: 8.09Min: 7.69 / Avg: 7.75 / Max: 7.83Min: 7.63 / Avg: 7.65 / Max: 7.66Min: 7.57 / Avg: 7.62 / Max: 7.67Min: 7.49 / Avg: 7.53 / Max: 7.6Min: 7.5 / Avg: 7.53 / Max: 7.56Min: 6.94 / Avg: 6.95 / Max: 6.99Min: 6.78 / Avg: 6.86 / Max: 6.91Min: 6.81 / Avg: 6.86 / Max: 6.94Min: 6.42 / Avg: 6.46 / Max: 6.55

Appleseed

Appleseed is an open-source production renderer focused on physically-based global illumination rendering engine primarily designed for animation and visual effects. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterAppleseed 2.0 BetaScene: Disney MaterialXeon Platinum 8380EPYC 8534PNXeon Max 9468Xeon Platinum 8380 2PXeon 6766EEPYC 8534PXeon Max 9480Xeon Platinum 8490HXeon 6780EXeon Max 9468 2PXeon Max 9480 2PXeon Platinum 8490H 2PXeon Platinum 8592+EPYC 9754Xeon Platinum 8592+ 2PEPYC 9654EPYC 9684X2040608010079.8361.3658.3858.3858.3156.4256.4053.4952.3251.2549.1448.5648.4345.0843.7043.4540.92

Scene: Disney Material

EPYC 9684X 2P: The test run did not produce a result.

EPYC 9654 2P: The test run did not produce a result.

EPYC 9754 2P: The test run did not produce a result.

Xeon 6766E 2P: The test run did not produce a result.

Xeon 6780E 2P: The test run did not produce a result.

Liquid-DSP

LiquidSDR's Liquid-DSP is a software-defined radio (SDR) digital signal processing library. This test profile runs a multi-threaded benchmark of this SDR/DSP library focused on embedded platform usage. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgsamples/s, More Is BetterLiquid-DSP 1.6Threads: 64 - Buffer Length: 256 - Filter Length: 57Xeon Platinum 8380Xeon 6766E 2PXeon 6766EXeon Platinum 8380 2PEPYC 8534PNXeon 6780E 2PXeon 6780EXeon Max 9468EPYC 8534PXeon Max 9480EPYC 9754 2PEPYC 9754Xeon Platinum 8592+Xeon Max 9480 2PXeon Max 9468 2PXeon Platinum 8490HXeon Platinum 8592+ 2PXeon Platinum 8490H 2PEPYC 9654 2PEPYC 9684X 2PEPYC 9654EPYC 9684X600M1200M1800M2400M3000MSE +/- 4885465.97, N = 3SE +/- 4223873.95, N = 3SE +/- 1953913.45, N = 3SE +/- 25737283.81, N = 3SE +/- 7776531.65, N = 3SE +/- 7523814.04, N = 3SE +/- 1361779.88, N = 3SE +/- 2629533.12, N = 3SE +/- 4914717.13, N = 3SE +/- 5493127.02, N = 3SE +/- 17457503.96, N = 3SE +/- 8567444.84, N = 3SE +/- 11426868.92, N = 3SE +/- 27382304.50, N = 5SE +/- 28812627.44, N = 4SE +/- 7076957.92, N = 3SE +/- 32405829.38, N = 3SE +/- 28500058.48, N = 3SE +/- 10590929.03, N = 3SE +/- 8732315.46, N = 3SE +/- 3786085.64, N = 3SE +/- 8476044.68, N = 314691666671852366667190626666719992666672026333333203673333320990333332138766667218683333323089666672374766667244493333324755000002491340000249405000025392000002620066667265550000027302333332772800000285983333328620000001. (CC) gcc options: -O3 -pthread -lm -lc -lliquid
OpenBenchmarking.orgsamples/s, More Is BetterLiquid-DSP 1.6Threads: 64 - Buffer Length: 256 - Filter Length: 57Xeon Platinum 8380Xeon 6766E 2PXeon 6766EXeon Platinum 8380 2PEPYC 8534PNXeon 6780E 2PXeon 6780EXeon Max 9468EPYC 8534PXeon Max 9480EPYC 9754 2PEPYC 9754Xeon Platinum 8592+Xeon Max 9480 2PXeon Max 9468 2PXeon Platinum 8490HXeon Platinum 8592+ 2PXeon Platinum 8490H 2PEPYC 9654 2PEPYC 9684X 2PEPYC 9654EPYC 9684X500M1000M1500M2000M2500MMin: 1459400000 / Avg: 1469166666.67 / Max: 1474300000Min: 1847000000 / Avg: 1852366666.67 / Max: 1860700000Min: 1903400000 / Avg: 1906266666.67 / Max: 1910000000Min: 1953800000 / Avg: 1999266666.67 / Max: 2042900000Min: 2013300000 / Avg: 2026333333.33 / Max: 2040200000Min: 2024900000 / Avg: 2036733333.33 / Max: 2050700000Min: 2096800000 / Avg: 2099033333.33 / Max: 2101500000Min: 2134100000 / Avg: 2138766666.67 / Max: 2143200000Min: 2178600000 / Avg: 2186833333.33 / Max: 2195600000Min: 2298600000 / Avg: 2308966666.67 / Max: 2317300000Min: 2340500000 / Avg: 2374766666.67 / Max: 2397700000Min: 2427800000 / Avg: 2444933333.33 / Max: 2453700000Min: 2454700000 / Avg: 2475500000 / Max: 2494100000Min: 2425700000 / Avg: 2491340000 / Max: 2564300000Min: 2449200000 / Avg: 2494050000 / Max: 2574500000Min: 2526700000 / Avg: 2539200000 / Max: 2551200000Min: 2565000000 / Avg: 2620066666.67 / Max: 2677200000Min: 2626900000 / Avg: 2655500000 / Max: 2712500000Min: 2711200000 / Avg: 2730233333.33 / Max: 2747800000Min: 2756200000 / Avg: 2772800000 / Max: 2785800000Min: 2855800000 / Avg: 2859833333.33 / Max: 2867400000Min: 2845100000 / Avg: 2862000000 / Max: 28716000001. (CC) gcc options: -O3 -pthread -lm -lc -lliquid

Zstd Compression

This test measures the time needed to compress/decompress a sample file (silesia.tar) using Zstd (Zstandard) compression with options for different compression levels / settings. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgMB/s, More Is BetterZstd Compression 1.5.4Compression Level: 19 - Decompression SpeedXeon 6766E 2PXeon 6766EXeon 6780E 2PXeon 6780EXeon Platinum 8380 2PXeon Platinum 8490H 2PXeon Platinum 8490HXeon Platinum 8380Xeon Max 9480 2PXeon Max 9468 2PEPYC 8534PXeon Max 9468Xeon Max 9480EPYC 9754 2PEPYC 9754EPYC 8534PNXeon Platinum 8592+ 2PXeon Platinum 8592+EPYC 9654 2PEPYC 9684XEPYC 9654EPYC 9684X 2P30060090012001500SE +/- 5.06, N = 3SE +/- 2.22, N = 3SE +/- 2.25, N = 3SE +/- 5.13, N = 3SE +/- 1.74, N = 4SE +/- 4.96, N = 3SE +/- 4.45, N = 3SE +/- 1.75, N = 3SE +/- 0.65, N = 15SE +/- 0.66, N = 15SE +/- 21.23, N = 3SE +/- 2.12, N = 3SE +/- 1.08, N = 15SE +/- 1.83, N = 3SE +/- 0.83, N = 3SE +/- 1.58, N = 3SE +/- 1.88, N = 3SE +/- 3.01, N = 4SE +/- 2.20, N = 3SE +/- 7.31, N = 3SE +/- 0.46, N = 3SE +/- 1.73, N = 3721.4743.5774.4816.7900.5963.61032.01032.41039.21040.21118.81126.41127.51139.01139.91144.81165.81221.81382.11385.31388.91392.51. (CC) gcc options: -O3 -pthread -lz -llzma
OpenBenchmarking.orgMB/s, More Is BetterZstd Compression 1.5.4Compression Level: 19 - Decompression SpeedXeon 6766E 2PXeon 6766EXeon 6780E 2PXeon 6780EXeon Platinum 8380 2PXeon Platinum 8490H 2PXeon Platinum 8490HXeon Platinum 8380Xeon Max 9480 2PXeon Max 9468 2PEPYC 8534PXeon Max 9468Xeon Max 9480EPYC 9754 2PEPYC 9754EPYC 8534PNXeon Platinum 8592+ 2PXeon Platinum 8592+EPYC 9654 2PEPYC 9684XEPYC 9654EPYC 9684X 2P2004006008001000Min: 711.4 / Avg: 721.37 / Max: 727.9Min: 740.2 / Avg: 743.47 / Max: 747.7Min: 770.2 / Avg: 774.4 / Max: 777.9Min: 807 / Avg: 816.73 / Max: 824.4Min: 897 / Avg: 900.53 / Max: 903.8Min: 954.2 / Avg: 963.57 / Max: 971.1Min: 1024.3 / Avg: 1032 / Max: 1039.7Min: 1029 / Avg: 1032.4 / Max: 1034.8Min: 1035.2 / Avg: 1039.18 / Max: 1043.3Min: 1036.2 / Avg: 1040.2 / Max: 1044.9Min: 1076.6 / Avg: 1118.83 / Max: 1143.8Min: 1122.6 / Avg: 1126.43 / Max: 1129.9Min: 1119 / Avg: 1127.51 / Max: 1131.8Min: 1135.5 / Avg: 1138.97 / Max: 1141.7Min: 1138.7 / Avg: 1139.93 / Max: 1141.5Min: 1141.8 / Avg: 1144.77 / Max: 1147.2Min: 1162.1 / Avg: 1165.8 / Max: 1168.2Min: 1217.4 / Avg: 1221.83 / Max: 1230.5Min: 1378.9 / Avg: 1382.07 / Max: 1386.3Min: 1370.9 / Avg: 1385.27 / Max: 1394.8Min: 1388 / Avg: 1388.9 / Max: 1389.5Min: 1389.3 / Avg: 1392.53 / Max: 1395.21. (CC) gcc options: -O3 -pthread -lz -llzma

TensorFlow

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.16.1Device: CPU - Batch Size: 512 - Model: ResNet-50Xeon Platinum 8380Xeon 6766EEPYC 8534PNXeon 6780EEPYC 8534PXeon 6766E 2PXeon Max 9468EPYC 9684XXeon 6780E 2PXeon Max 9480Xeon Platinum 8380 2PEPYC 9754EPYC 9684X 2PXeon Max 9480 2PEPYC 9654Xeon Platinum 8592+Xeon Max 9468 2PXeon Platinum 8490HEPYC 9654 2PXeon Platinum 8592+ 2PEPYC 9754 2PXeon Platinum 8490H 2P4080120160200SE +/- 0.08, N = 3SE +/- 0.01, N = 3SE +/- 0.02, N = 3SE +/- 0.04, N = 3SE +/- 0.01, N = 3SE +/- 0.93, N = 9SE +/- 1.17, N = 3SE +/- 1.42, N = 4SE +/- 1.22, N = 3SE +/- 0.61, N = 3SE +/- 0.21, N = 3SE +/- 1.62, N = 4SE +/- 0.31, N = 3SE +/- 1.80, N = 3SE +/- 0.34, N = 3SE +/- 0.48, N = 3SE +/- 0.79, N = 3SE +/- 0.01, N = 3SE +/- 1.83, N = 3SE +/- 0.61, N = 3SE +/- 0.81, N = 3SE +/- 1.39, N = 391.7591.9695.6397.67101.17113.42117.53121.96124.60125.14127.97135.17137.50138.39140.01140.53145.29148.45161.90169.75174.93174.95
OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.16.1Device: CPU - Batch Size: 512 - Model: ResNet-50Xeon Platinum 8380Xeon 6766EEPYC 8534PNXeon 6780EEPYC 8534PXeon 6766E 2PXeon Max 9468EPYC 9684XXeon 6780E 2PXeon Max 9480Xeon Platinum 8380 2PEPYC 9754EPYC 9684X 2PXeon Max 9480 2PEPYC 9654Xeon Platinum 8592+Xeon Max 9468 2PXeon Platinum 8490HEPYC 9654 2PXeon Platinum 8592+ 2PEPYC 9754 2PXeon Platinum 8490H 2P306090120150Min: 91.65 / Avg: 91.75 / Max: 91.9Min: 91.95 / Avg: 91.96 / Max: 91.99Min: 95.61 / Avg: 95.63 / Max: 95.67Min: 97.59 / Avg: 97.67 / Max: 97.73Min: 101.15 / Avg: 101.17 / Max: 101.2Min: 110.37 / Avg: 113.42 / Max: 117.89Min: 115.29 / Avg: 117.53 / Max: 119.21Min: 119.14 / Avg: 121.96 / Max: 124.79Min: 123.26 / Avg: 124.6 / Max: 127.03Min: 123.92 / Avg: 125.14 / Max: 125.82Min: 127.56 / Avg: 127.97 / Max: 128.25Min: 130.61 / Avg: 135.17 / Max: 137.97Min: 136.92 / Avg: 137.5 / Max: 137.98Min: 134.79 / Avg: 138.39 / Max: 140.44Min: 139.61 / Avg: 140.01 / Max: 140.69Min: 139.68 / Avg: 140.53 / Max: 141.35Min: 144.06 / Avg: 145.29 / Max: 146.77Min: 148.44 / Avg: 148.45 / Max: 148.46Min: 158.53 / Avg: 161.9 / Max: 164.83Min: 168.56 / Avg: 169.75 / Max: 170.55Min: 173.86 / Avg: 174.93 / Max: 176.53Min: 172.43 / Avg: 174.95 / Max: 177.22

ONNX Runtime

ONNX Runtime is developed by Microsoft and partners as a open-source, cross-platform, high performance machine learning inferencing and training accelerator. This test profile runs the ONNX Runtime with various models available from the ONNX Model Zoo. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.17Model: Faster R-CNN R-50-FPN-int8 - Device: CPU - Executor: ParallelXeon 6766E 2PXeon 6780E 2PXeon 6766EEPYC 9684X 2PXeon Max 9480 2PXeon Max 9468 2PEPYC 9654 2PXeon Platinum 8380 2PXeon 6780EEPYC 9754 2PEPYC 9754EPYC 8534PNEPYC 8534PXeon Platinum 8380Xeon Max 9480Xeon Max 9468EPYC 9684XEPYC 9654Xeon Platinum 8490H 2PXeon Platinum 8592+ 2PXeon Platinum 8490HXeon Platinum 8592+816243240SE +/- 0.22, N = 3SE +/- 0.04, N = 3SE +/- 0.03, N = 3SE +/- 0.08, N = 3SE +/- 0.19, N = 3SE +/- 0.34, N = 3SE +/- 0.05, N = 3SE +/- 0.05, N = 3SE +/- 0.05, N = 3SE +/- 0.24, N = 7SE +/- 0.33, N = 4SE +/- 0.25, N = 3SE +/- 0.14, N = 3SE +/- 0.24, N = 3SE +/- 0.07, N = 3SE +/- 0.10, N = 3SE +/- 0.19, N = 3SE +/- 0.36, N = 3SE +/- 0.06, N = 3SE +/- 0.00, N = 3SE +/- 0.07, N = 3SE +/- 0.01, N = 317.6218.4323.3124.0524.6824.7325.6325.9626.0326.3327.4527.8727.9428.0928.4828.5228.7329.8430.0431.7132.3433.381. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt
OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.17Model: Faster R-CNN R-50-FPN-int8 - Device: CPU - Executor: ParallelXeon 6766E 2PXeon 6780E 2PXeon 6766EEPYC 9684X 2PXeon Max 9480 2PXeon Max 9468 2PEPYC 9654 2PXeon Platinum 8380 2PXeon 6780EEPYC 9754 2PEPYC 9754EPYC 8534PNEPYC 8534PXeon Platinum 8380Xeon Max 9480Xeon Max 9468EPYC 9684XEPYC 9654Xeon Platinum 8490H 2PXeon Platinum 8592+ 2PXeon Platinum 8490HXeon Platinum 8592+714212835Min: 17.19 / Avg: 17.62 / Max: 17.91Min: 18.36 / Avg: 18.43 / Max: 18.5Min: 23.27 / Avg: 23.31 / Max: 23.36Min: 23.93 / Avg: 24.05 / Max: 24.21Min: 24.46 / Avg: 24.68 / Max: 25.07Min: 24.17 / Avg: 24.73 / Max: 25.34Min: 25.55 / Avg: 25.63 / Max: 25.71Min: 25.88 / Avg: 25.96 / Max: 26.04Min: 25.96 / Avg: 26.03 / Max: 26.13Min: 25.01 / Avg: 26.33 / Max: 26.86Min: 26.89 / Avg: 27.45 / Max: 28.42Min: 27.44 / Avg: 27.87 / Max: 28.32Min: 27.7 / Avg: 27.94 / Max: 28.18Min: 27.63 / Avg: 28.09 / Max: 28.42Min: 28.39 / Avg: 28.48 / Max: 28.61Min: 28.39 / Avg: 28.52 / Max: 28.72Min: 28.45 / Avg: 28.73 / Max: 29.08Min: 29.13 / Avg: 29.84 / Max: 30.25Min: 29.94 / Avg: 30.04 / Max: 30.14Min: 31.71 / Avg: 31.71 / Max: 31.72Min: 32.21 / Avg: 32.34 / Max: 32.44Min: 33.37 / Avg: 33.38 / Max: 33.41. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

Zstd Compression

This test measures the time needed to compress/decompress a sample file (silesia.tar) using Zstd (Zstandard) compression with options for different compression levels / settings. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgMB/s, More Is BetterZstd Compression 1.5.4Compression Level: 19, Long Mode - Decompression SpeedXeon 6766E 2PXeon 6766EXeon 6780E 2PXeon 6780EXeon Platinum 8380 2PXeon Platinum 8490H 2PXeon Platinum 8380Xeon Max 9468 2PXeon Max 9480 2PXeon Platinum 8490HEPYC 8534PNEPYC 8534PEPYC 9754EPYC 9754 2PXeon Max 9468Xeon Max 9480Xeon Platinum 8592+ 2PXeon Platinum 8592+EPYC 9684X 2PEPYC 9654 2PEPYC 9684XEPYC 965430060090012001500SE +/- 4.61, N = 3SE +/- 3.99, N = 3SE +/- 1.54, N = 3SE +/- 1.05, N = 3SE +/- 0.30, N = 3SE +/- 3.69, N = 3SE +/- 4.15, N = 3SE +/- 1.00, N = 3SE +/- 1.78, N = 15SE +/- 0.43, N = 3SE +/- 0.92, N = 3SE +/- 2.09, N = 3SE +/- 1.95, N = 3SE +/- 0.19, N = 3SE +/- 0.56, N = 3SE +/- 1.45, N = 3SE +/- 1.60, N = 3SE +/- 0.84, N = 3SE +/- 2.93, N = 3SE +/- 1.87, N = 3SE +/- 1.99, N = 3SE +/- 1.17, N = 3701.2739.1753.2797.7912.9992.11018.31041.81046.01069.11096.51101.41102.21104.21131.11133.31189.71242.61321.41324.61324.91328.51. (CC) gcc options: -O3 -pthread -lz -llzma
OpenBenchmarking.orgMB/s, More Is BetterZstd Compression 1.5.4Compression Level: 19, Long Mode - Decompression SpeedXeon 6766E 2PXeon 6766EXeon 6780E 2PXeon 6780EXeon Platinum 8380 2PXeon Platinum 8490H 2PXeon Platinum 8380Xeon Max 9468 2PXeon Max 9480 2PXeon Platinum 8490HEPYC 8534PNEPYC 8534PEPYC 9754EPYC 9754 2PXeon Max 9468Xeon Max 9480Xeon Platinum 8592+ 2PXeon Platinum 8592+EPYC 9684X 2PEPYC 9654 2PEPYC 9684XEPYC 96542004006008001000Min: 692.1 / Avg: 701.2 / Max: 707Min: 732.4 / Avg: 739.13 / Max: 746.2Min: 750.2 / Avg: 753.23 / Max: 755.2Min: 795.6 / Avg: 797.67 / Max: 799Min: 912.5 / Avg: 912.93 / Max: 913.5Min: 988 / Avg: 992.13 / Max: 999.5Min: 1010.2 / Avg: 1018.27 / Max: 1024Min: 1040.5 / Avg: 1041.83 / Max: 1043.8Min: 1022.2 / Avg: 1046.02 / Max: 1050.8Min: 1068.2 / Avg: 1069.07 / Max: 1069.5Min: 1094.7 / Avg: 1096.5 / Max: 1097.7Min: 1097.6 / Avg: 1101.37 / Max: 1104.8Min: 1098.4 / Avg: 1102.23 / Max: 1104.8Min: 1103.8 / Avg: 1104.17 / Max: 1104.4Min: 1130.3 / Avg: 1131.13 / Max: 1132.2Min: 1131.3 / Avg: 1133.27 / Max: 1136.1Min: 1186.5 / Avg: 1189.67 / Max: 1191.6Min: 1241.7 / Avg: 1242.63 / Max: 1244.3Min: 1315.7 / Avg: 1321.37 / Max: 1325.5Min: 1321.1 / Avg: 1324.6 / Max: 1327.5Min: 1322.3 / Avg: 1324.9 / Max: 1328.8Min: 1326.2 / Avg: 1328.53 / Max: 1329.91. (CC) gcc options: -O3 -pthread -lz -llzma

Apache IoTDB

Apache IotDB is a time series database and this benchmark is facilitated using the IoT Benchmaark [https://github.com/thulab/iot-benchmark/]. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgpoint/sec, More Is BetterApache IoTDB 1.2Device Count: 500 - Batch Size Per Write: 100 - Sensor Count: 800 - Client Number: 400Xeon 6766E 2PXeon 6780E 2PXeon Platinum 8380 2PXeon Max 9468 2PXeon Max 9480 2PXeon Platinum 8380Xeon Platinum 8490H 2PXeon 6766EXeon Max 9468Xeon Max 9480Xeon 6780EXeon Platinum 8490HXeon Platinum 8592+ 2PXeon Platinum 8592+EPYC 9754 2PEPYC 8534PNEPYC 8534PEPYC 9684X 2PEPYC 9654 2PEPYC 9754EPYC 9654EPYC 9684X30M60M90M120M150MSE +/- 531367.14, N = 12SE +/- 796440.21, N = 3SE +/- 661234.22, N = 3SE +/- 565297.90, N = 12SE +/- 574699.97, N = 12SE +/- 88241.50, N = 3SE +/- 692701.79, N = 8SE +/- 111181.55, N = 3SE +/- 662950.65, N = 3SE +/- 1037167.36, N = 3SE +/- 441557.52, N = 3SE +/- 308756.34, N = 3SE +/- 761276.42, N = 12SE +/- 746822.47, N = 3SE +/- 666882.79, N = 15SE +/- 412757.79, N = 3SE +/- 13050.78, N = 3SE +/- 353097.82, N = 3SE +/- 1152766.29, N = 3SE +/- 68559.13, N = 3SE +/- 255887.16, N = 3SE +/- 371659.60, N = 36759979368320800746530077750124878057728788231128016962081900477824556648347564587190397877972068923185092709751103630483105138551105432862106778379108821580116685326125562060126161028
OpenBenchmarking.orgpoint/sec, More Is BetterApache IoTDB 1.2Device Count: 500 - Batch Size Per Write: 100 - Sensor Count: 800 - Client Number: 400Xeon 6766E 2PXeon 6780E 2PXeon Platinum 8380 2PXeon Max 9468 2PXeon Max 9480 2PXeon Platinum 8380Xeon Platinum 8490H 2PXeon 6766EXeon Max 9468Xeon Max 9480Xeon 6780EXeon Platinum 8490HXeon Platinum 8592+ 2PXeon Platinum 8592+EPYC 9754 2PEPYC 8534PNEPYC 8534PEPYC 9684X 2PEPYC 9654 2PEPYC 9754EPYC 9654EPYC 9684X20M40M60M80M100MMin: 64137942.39 / Avg: 67599792.57 / Max: 69828280.07Min: 66926830.8 / Avg: 68320799.93 / Max: 69685308.7Min: 73949119.09 / Avg: 74653006.74 / Max: 75974537.45Min: 73145472.62 / Avg: 77501248.16 / Max: 79015213.11Min: 73090909.99 / Avg: 78057727.65 / Max: 80034510.45Min: 78734340.94 / Avg: 78823112.45 / Max: 78999594.39Min: 76187205.81 / Avg: 80169620.06 / Max: 82023058.74Min: 81696116.66 / Avg: 81900476.92 / Max: 82078562.75Min: 81296689.33 / Avg: 82455664.42 / Max: 83592909.29Min: 81771445.11 / Avg: 83475644.71 / Max: 85351915.5Min: 86344328.06 / Avg: 87190397.03 / Max: 87832622.29Min: 87266472.46 / Avg: 87797206.07 / Max: 88335945.89Min: 81747205.1 / Avg: 89231850.46 / Max: 91854673.51Min: 91216839.59 / Avg: 92709751.24 / Max: 93496734.87Min: 96231160.7 / Avg: 103630482.84 / Max: 107455633.39Min: 104451785.05 / Avg: 105138551.23 / Max: 105878634.65Min: 105406900.51 / Avg: 105432861.63 / Max: 105448183.99Min: 106100515.69 / Avg: 106778378.88 / Max: 107288804.88Min: 107579184.73 / Avg: 108821579.72 / Max: 111124725.91Min: 116554610.8 / Avg: 116685326.23 / Max: 116786547.15Min: 125098980.22 / Avg: 125562059.83 / Max: 125982286.33Min: 125442601.6 / Avg: 126161028.23 / Max: 126685438.25

VVenC

OpenBenchmarking.orgFrames Per Second, More Is BetterVVenC 1.11Video Input: Bosphorus 4K - Video Preset: FastXeon 6766EXeon 6780EXeon Platinum 8380Xeon Platinum 8380 2PEPYC 8534PNXeon Max 9468 2PXeon Max 9480 2PEPYC 8534PXeon Max 9468EPYC 9754Xeon Platinum 8490H 2PXeon Max 9480Xeon Platinum 8490HXeon Platinum 8592+ 2PXeon Platinum 8592+EPYC 9654EPYC 9684X246810SE +/- 0.008, N = 3SE +/- 0.007, N = 3SE +/- 0.010, N = 3SE +/- 0.028, N = 3SE +/- 0.041, N = 3SE +/- 0.081, N = 3SE +/- 0.043, N = 15SE +/- 0.038, N = 3SE +/- 0.010, N = 3SE +/- 0.045, N = 3SE +/- 0.047, N = 3SE +/- 0.033, N = 3SE +/- 0.022, N = 3SE +/- 0.038, N = 3SE +/- 0.023, N = 3SE +/- 0.048, N = 3SE +/- 0.057, N = 34.0524.4405.5835.8776.0006.0236.0776.1186.3246.4656.4806.5016.7196.9607.3927.4317.5471. (CXX) g++ options: -O3 -flto=auto -fno-fat-lto-objects
OpenBenchmarking.orgFrames Per Second, More Is BetterVVenC 1.11Video Input: Bosphorus 4K - Video Preset: FastXeon 6766EXeon 6780EXeon Platinum 8380Xeon Platinum 8380 2PEPYC 8534PNXeon Max 9468 2PXeon Max 9480 2PEPYC 8534PXeon Max 9468EPYC 9754Xeon Platinum 8490H 2PXeon Max 9480Xeon Platinum 8490HXeon Platinum 8592+ 2PXeon Platinum 8592+EPYC 9654EPYC 9684X3691215Min: 4.04 / Avg: 4.05 / Max: 4.06Min: 4.43 / Avg: 4.44 / Max: 4.45Min: 5.56 / Avg: 5.58 / Max: 5.6Min: 5.82 / Avg: 5.88 / Max: 5.92Min: 5.92 / Avg: 6 / Max: 6.05Min: 5.88 / Avg: 6.02 / Max: 6.16Min: 5.78 / Avg: 6.08 / Max: 6.31Min: 6.04 / Avg: 6.12 / Max: 6.16Min: 6.31 / Avg: 6.32 / Max: 6.34Min: 6.38 / Avg: 6.47 / Max: 6.52Min: 6.42 / Avg: 6.48 / Max: 6.57Min: 6.44 / Avg: 6.5 / Max: 6.56Min: 6.68 / Avg: 6.72 / Max: 6.76Min: 6.89 / Avg: 6.96 / Max: 7.02Min: 7.35 / Avg: 7.39 / Max: 7.43Min: 7.34 / Avg: 7.43 / Max: 7.49Min: 7.43 / Avg: 7.55 / Max: 7.611. (CXX) g++ options: -O3 -flto=auto -fno-fat-lto-objects

Video Input: Bosphorus 4K - Video Preset: Fast

EPYC 9684X 2P: The test quit with a non-zero exit status. E: Parameter Check Error: Number of threads out of range (-1

EPYC 9654 2P: The test quit with a non-zero exit status. E: Parameter Check Error: Number of threads out of range (-1

EPYC 9754 2P: The test quit with a non-zero exit status. E: Parameter Check Error: Number of threads out of range (-1

Xeon 6766E 2P: The test quit with a non-zero exit status. E: Parameter Check Error: Number of threads out of range (-1

Xeon 6780E 2P: The test quit with a non-zero exit status. E: Parameter Check Error: Number of threads out of range (-1

TensorFlow

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.16.1Device: CPU - Batch Size: 256 - Model: ResNet-50Xeon 6766EXeon Platinum 8380Xeon 6780EEPYC 8534PNEPYC 8534PXeon 6766E 2PXeon 6780E 2PXeon Max 9468EPYC 9684X 2PEPYC 9684XXeon Max 9480EPYC 9754Xeon Platinum 8380 2PXeon Platinum 8592+EPYC 9754 2PEPYC 9654 2PXeon Max 9480 2PEPYC 9654Xeon Max 9468 2PXeon Platinum 8490HXeon Platinum 8592+ 2PXeon Platinum 8490H 2P4080120160200SE +/- 0.01, N = 3SE +/- 0.02, N = 3SE +/- 0.04, N = 3SE +/- 0.06, N = 3SE +/- 0.05, N = 3SE +/- 0.48, N = 3SE +/- 0.54, N = 3SE +/- 0.14, N = 3SE +/- 0.50, N = 3SE +/- 1.39, N = 4SE +/- 0.63, N = 3SE +/- 2.00, N = 12SE +/- 0.46, N = 3SE +/- 0.58, N = 3SE +/- 0.18, N = 3SE +/- 0.57, N = 3SE +/- 1.04, N = 12SE +/- 0.66, N = 3SE +/- 1.40, N = 3SE +/- 0.03, N = 3SE +/- 0.21, N = 3SE +/- 1.57, N = 387.1791.6592.4292.8298.70103.22115.12119.73120.11123.37123.69125.76125.91129.02131.38133.87135.28138.11141.95143.67150.33161.06
OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.16.1Device: CPU - Batch Size: 256 - Model: ResNet-50Xeon 6766EXeon Platinum 8380Xeon 6780EEPYC 8534PNEPYC 8534PXeon 6766E 2PXeon 6780E 2PXeon Max 9468EPYC 9684X 2PEPYC 9684XXeon Max 9480EPYC 9754Xeon Platinum 8380 2PXeon Platinum 8592+EPYC 9754 2PEPYC 9654 2PXeon Max 9480 2PEPYC 9654Xeon Max 9468 2PXeon Platinum 8490HXeon Platinum 8592+ 2PXeon Platinum 8490H 2P306090120150Min: 87.15 / Avg: 87.17 / Max: 87.2Min: 91.62 / Avg: 91.65 / Max: 91.69Min: 92.35 / Avg: 92.42 / Max: 92.5Min: 92.76 / Avg: 92.82 / Max: 92.94Min: 98.6 / Avg: 98.7 / Max: 98.75Min: 102.7 / Avg: 103.22 / Max: 104.17Min: 114.18 / Avg: 115.12 / Max: 116.04Min: 119.49 / Avg: 119.73 / Max: 119.99Min: 119.16 / Avg: 120.11 / Max: 120.85Min: 120.83 / Avg: 123.37 / Max: 126.84Min: 122.52 / Avg: 123.69 / Max: 124.7Min: 120.59 / Avg: 125.76 / Max: 146.17Min: 124.99 / Avg: 125.91 / Max: 126.42Min: 127.87 / Avg: 129.02 / Max: 129.6Min: 131.09 / Avg: 131.38 / Max: 131.7Min: 132.82 / Avg: 133.87 / Max: 134.8Min: 128.65 / Avg: 135.28 / Max: 139.7Min: 137.07 / Avg: 138.11 / Max: 139.34Min: 139.16 / Avg: 141.95 / Max: 143.51Min: 143.62 / Avg: 143.67 / Max: 143.71Min: 149.91 / Avg: 150.33 / Max: 150.6Min: 158.11 / Avg: 161.06 / Max: 163.44

Timed ImageMagick Compilation

This test times how long it takes to build ImageMagick. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed ImageMagick Compilation 6.9.0Time To CompileXeon 6766EXeon 6766E 2PXeon 6780EXeon 6780E 2PXeon Platinum 8380EPYC 8534PNEPYC 8534PEPYC 9754Xeon Platinum 8380 2PXeon Max 9468EPYC 9754 2PXeon Max 9480Xeon Platinum 8490HXeon Max 9468 2PXeon Max 9480 2PEPYC 9654Xeon Platinum 8490H 2PEPYC 9654 2PXeon Platinum 8592+EPYC 9684XEPYC 9684X 2PXeon Platinum 8592+ 2P510152025SE +/- 0.08, N = 3SE +/- 0.08, N = 3SE +/- 0.05, N = 3SE +/- 0.11, N = 3SE +/- 0.03, N = 3SE +/- 0.04, N = 3SE +/- 0.04, N = 3SE +/- 0.08, N = 4SE +/- 0.13, N = 4SE +/- 0.15, N = 4SE +/- 0.02, N = 4SE +/- 0.06, N = 4SE +/- 0.10, N = 4SE +/- 0.11, N = 4SE +/- 0.07, N = 4SE +/- 0.09, N = 4SE +/- 0.13, N = 4SE +/- 0.04, N = 4SE +/- 0.10, N = 4SE +/- 0.06, N = 4SE +/- 0.04, N = 4SE +/- 0.03, N = 420.9120.5919.2018.8518.8418.1817.9216.3916.3316.0815.8115.3814.7214.4014.0913.4713.2612.7512.6012.2011.7211.49
OpenBenchmarking.orgSeconds, Fewer Is BetterTimed ImageMagick Compilation 6.9.0Time To CompileXeon 6766EXeon 6766E 2PXeon 6780EXeon 6780E 2PXeon Platinum 8380EPYC 8534PNEPYC 8534PEPYC 9754Xeon Platinum 8380 2PXeon Max 9468EPYC 9754 2PXeon Max 9480Xeon Platinum 8490HXeon Max 9468 2PXeon Max 9480 2PEPYC 9654Xeon Platinum 8490H 2PEPYC 9654 2PXeon Platinum 8592+EPYC 9684XEPYC 9684X 2PXeon Platinum 8592+ 2P510152025Min: 20.76 / Avg: 20.91 / Max: 21.04Min: 20.5 / Avg: 20.59 / Max: 20.75Min: 19.11 / Avg: 19.2 / Max: 19.28Min: 18.65 / Avg: 18.85 / Max: 19.04Min: 18.79 / Avg: 18.84 / Max: 18.88Min: 18.1 / Avg: 18.18 / Max: 18.22Min: 17.86 / Avg: 17.92 / Max: 17.99Min: 16.17 / Avg: 16.39 / Max: 16.57Min: 16.15 / Avg: 16.33 / Max: 16.7Min: 15.84 / Avg: 16.07 / Max: 16.45Min: 15.77 / Avg: 15.81 / Max: 15.84Min: 15.25 / Avg: 15.38 / Max: 15.51Min: 14.58 / Avg: 14.72 / Max: 15.02Min: 14.08 / Avg: 14.4 / Max: 14.57Min: 13.9 / Avg: 14.09 / Max: 14.22Min: 13.22 / Avg: 13.47 / Max: 13.62Min: 12.91 / Avg: 13.26 / Max: 13.45Min: 12.68 / Avg: 12.75 / Max: 12.85Min: 12.33 / Avg: 12.59 / Max: 12.77Min: 12.07 / Avg: 12.2 / Max: 12.35Min: 11.62 / Avg: 11.72 / Max: 11.78Min: 11.45 / Avg: 11.49 / Max: 11.58

libavif avifenc

OpenBenchmarking.orgSeconds, Fewer Is Betterlibavif avifenc 1.0Encoder Speed: 10, LosslessXeon 6766E 2PXeon 6780E 2PXeon 6766EXeon 6780EXeon Platinum 8380 2PXeon Platinum 8380EPYC 9754 2PEPYC 8534PEPYC 8534PNEPYC 9754Xeon Max 9468 2PXeon Max 9480 2PXeon Platinum 8490H 2PEPYC 9684X 2PXeon Platinum 8490HXeon Max 9468Xeon Max 9480EPYC 9654 2PEPYC 9654EPYC 9684XXeon Platinum 8592+ 2PXeon Platinum 8592+246810SE +/- 0.021, N = 6SE +/- 0.016, N = 6SE +/- 0.009, N = 6SE +/- 0.003, N = 6SE +/- 0.011, N = 7SE +/- 0.008, N = 7SE +/- 0.006, N = 7SE +/- 0.006, N = 7SE +/- 0.010, N = 7SE +/- 0.004, N = 7SE +/- 0.019, N = 7SE +/- 0.028, N = 7SE +/- 0.014, N = 7SE +/- 0.003, N = 7SE +/- 0.006, N = 7SE +/- 0.005, N = 7SE +/- 0.015, N = 7SE +/- 0.006, N = 8SE +/- 0.006, N = 8SE +/- 0.002, N = 8SE +/- 0.015, N = 8SE +/- 0.008, N = 88.0947.6037.5076.8495.9195.9065.7405.7355.7345.6625.3175.3115.0744.9434.9234.9164.8674.8294.7924.7704.5794.4561. (CXX) g++ options: -O3 -fPIC -lm
OpenBenchmarking.orgSeconds, Fewer Is Betterlibavif avifenc 1.0Encoder Speed: 10, LosslessXeon 6766E 2PXeon 6780E 2PXeon 6766EXeon 6780EXeon Platinum 8380 2PXeon Platinum 8380EPYC 9754 2PEPYC 8534PEPYC 8534PNEPYC 9754Xeon Max 9468 2PXeon Max 9480 2PXeon Platinum 8490H 2PEPYC 9684X 2PXeon Platinum 8490HXeon Max 9468Xeon Max 9480EPYC 9654 2PEPYC 9654EPYC 9684XXeon Platinum 8592+ 2PXeon Platinum 8592+3691215Min: 8.02 / Avg: 8.09 / Max: 8.18Min: 7.56 / Avg: 7.6 / Max: 7.67Min: 7.48 / Avg: 7.51 / Max: 7.54Min: 6.84 / Avg: 6.85 / Max: 6.86Min: 5.87 / Avg: 5.92 / Max: 5.95Min: 5.88 / Avg: 5.91 / Max: 5.93Min: 5.73 / Avg: 5.74 / Max: 5.77Min: 5.71 / Avg: 5.73 / Max: 5.76Min: 5.7 / Avg: 5.73 / Max: 5.77Min: 5.65 / Avg: 5.66 / Max: 5.68Min: 5.24 / Avg: 5.32 / Max: 5.39Min: 5.22 / Avg: 5.31 / Max: 5.44Min: 4.99 / Avg: 5.07 / Max: 5.1Min: 4.93 / Avg: 4.94 / Max: 4.95Min: 4.9 / Avg: 4.92 / Max: 4.94Min: 4.9 / Avg: 4.92 / Max: 4.93Min: 4.78 / Avg: 4.87 / Max: 4.91Min: 4.81 / Avg: 4.83 / Max: 4.85Min: 4.77 / Avg: 4.79 / Max: 4.82Min: 4.76 / Avg: 4.77 / Max: 4.78Min: 4.53 / Avg: 4.58 / Max: 4.67Min: 4.42 / Avg: 4.46 / Max: 4.481. (CXX) g++ options: -O3 -fPIC -lm

Apache IoTDB

Apache IotDB is a time series database and this benchmark is facilitated using the IoT Benchmaark [https://github.com/thulab/iot-benchmark/]. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgAverage Latency, Fewer Is BetterApache IoTDB 1.2Device Count: 500 - Batch Size Per Write: 100 - Sensor Count: 800 - Client Number: 400Xeon 6766E 2PXeon 6780E 2PXeon Platinum 8380 2PXeon Max 9468 2PXeon Platinum 8380Xeon Max 9480 2PXeon Platinum 8490H 2PXeon Max 9468Xeon 6766EXeon Max 9480Xeon 6780EXeon Platinum 8490HXeon Platinum 8592+ 2PXeon Platinum 8592+EPYC 9754 2PEPYC 8534PEPYC 8534PNEPYC 9684X 2PEPYC 9654 2PEPYC 9754EPYC 9654EPYC 9684X80160240320400SE +/- 3.93, N = 12SE +/- 5.20, N = 3SE +/- 3.47, N = 3SE +/- 2.59, N = 12SE +/- 4.06, N = 3SE +/- 3.74, N = 12SE +/- 3.79, N = 8SE +/- 5.15, N = 3SE +/- 1.12, N = 3SE +/- 5.07, N = 3SE +/- 4.45, N = 3SE +/- 2.20, N = 3SE +/- 3.40, N = 12SE +/- 3.41, N = 3SE +/- 2.16, N = 15SE +/- 0.38, N = 3SE +/- 0.82, N = 3SE +/- 1.87, N = 3SE +/- 3.49, N = 3SE +/- 1.41, N = 3SE +/- 1.96, N = 3SE +/- 1.71, N = 3380.33377.58349.42328.41326.53325.97317.36314.44312.32309.03296.36294.33286.78280.26253.13251.47251.05246.08240.43227.40211.85209.68
OpenBenchmarking.orgAverage Latency, Fewer Is BetterApache IoTDB 1.2Device Count: 500 - Batch Size Per Write: 100 - Sensor Count: 800 - Client Number: 400Xeon 6766E 2PXeon 6780E 2PXeon Platinum 8380 2PXeon Max 9468 2PXeon Platinum 8380Xeon Max 9480 2PXeon Platinum 8490H 2PXeon Max 9468Xeon 6766EXeon Max 9480Xeon 6780EXeon Platinum 8490HXeon Platinum 8592+ 2PXeon Platinum 8592+EPYC 9754 2PEPYC 8534PEPYC 8534PNEPYC 9684X 2PEPYC 9654 2PEPYC 9754EPYC 9654EPYC 9684X70140210280350Min: 365.71 / Avg: 380.33 / Max: 406.91Min: 367.79 / Avg: 377.58 / Max: 385.51Min: 345.69 / Avg: 349.42 / Max: 356.36Min: 319.07 / Avg: 328.41 / Max: 347.44Min: 318.63 / Avg: 326.53 / Max: 332.08Min: 307.82 / Avg: 325.97 / Max: 354.99Min: 303.36 / Avg: 317.36 / Max: 331.83Min: 304.72 / Avg: 314.44 / Max: 322.26Min: 310.41 / Avg: 312.32 / Max: 314.28Min: 299.22 / Avg: 309.03 / Max: 316.14Min: 291.17 / Avg: 296.36 / Max: 305.21Min: 291.11 / Avg: 294.33 / Max: 298.54Min: 273.05 / Avg: 286.78 / Max: 316.89Min: 275.8 / Avg: 280.26 / Max: 286.97Min: 234.43 / Avg: 253.13 / Max: 276.08Min: 250.71 / Avg: 251.47 / Max: 251.88Min: 249.93 / Avg: 251.05 / Max: 252.65Min: 243.68 / Avg: 246.08 / Max: 249.77Min: 235.73 / Avg: 240.43 / Max: 247.25Min: 224.63 / Avg: 227.4 / Max: 229.19Min: 209.09 / Avg: 211.85 / Max: 215.64Min: 206.79 / Avg: 209.68 / Max: 212.72

QMCPACK

QMCPACK is a modern high-performance open-source Quantum Monte Carlo (QMC) simulation code making use of MPI for this benchmark of the H20 example code. QMCPACK is an open-source production level many-body ab initio Quantum Monte Carlo code for computing the electronic structure of atoms, molecules, and solids. QMCPACK is supported by the U.S. Department of Energy. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgTotal Execution Time - Seconds, Fewer Is BetterQMCPACK 3.17.1Input: Li2_STO_aeXeon Platinum 8380EPYC 8534PNEPYC 8534PXeon Platinum 8380 2PXeon Max 9468Xeon Max 9480EPYC 9754 2PEPYC 9754Xeon Platinum 8490HEPYC 9654Xeon Max 9480 2PXeon Platinum 8592+EPYC 9654 2PXeon Max 9468 2PXeon Platinum 8490H 2PXeon Platinum 8592+ 2PEPYC 9684XEPYC 9684X 2P4080120160200SE +/- 1.47, N = 7SE +/- 0.40, N = 3SE +/- 1.13, N = 3SE +/- 0.50, N = 3SE +/- 1.20, N = 3SE +/- 1.04, N = 3SE +/- 0.42, N = 3SE +/- 0.63, N = 3SE +/- 0.89, N = 3SE +/- 0.54, N = 3SE +/- 1.11, N = 5SE +/- 1.03, N = 3SE +/- 0.23, N = 3SE +/- 0.88, N = 3SE +/- 1.11, N = 3SE +/- 0.93, N = 3SE +/- 1.06, N = 3SE +/- 0.06, N = 3163.75151.27137.23131.37121.19117.81111.15110.80109.30108.02106.27105.98102.98102.12101.6397.9197.0091.971. (CXX) g++ options: -fopenmp -foffload=disable -finline-limit=1000 -fstrict-aliasing -funroll-all-loops -ffast-math -march=native -O3 -lm -ldl
OpenBenchmarking.orgTotal Execution Time - Seconds, Fewer Is BetterQMCPACK 3.17.1Input: Li2_STO_aeXeon Platinum 8380EPYC 8534PNEPYC 8534PXeon Platinum 8380 2PXeon Max 9468Xeon Max 9480EPYC 9754 2PEPYC 9754Xeon Platinum 8490HEPYC 9654Xeon Max 9480 2PXeon Platinum 8592+EPYC 9654 2PXeon Max 9468 2PXeon Platinum 8490H 2PXeon Platinum 8592+ 2PEPYC 9684XEPYC 9684X 2P306090120150Min: 160.67 / Avg: 163.75 / Max: 172.19Min: 150.56 / Avg: 151.27 / Max: 151.93Min: 135.02 / Avg: 137.23 / Max: 138.75Min: 130.78 / Avg: 131.37 / Max: 132.36Min: 119.44 / Avg: 121.19 / Max: 123.49Min: 116.12 / Avg: 117.81 / Max: 119.69Min: 110.42 / Avg: 111.15 / Max: 111.89Min: 109.62 / Avg: 110.8 / Max: 111.78Min: 107.57 / Avg: 109.3 / Max: 110.52Min: 107.14 / Avg: 108.02 / Max: 109Min: 103.79 / Avg: 106.27 / Max: 109.86Min: 104.67 / Avg: 105.98 / Max: 108.02Min: 102.52 / Avg: 102.98 / Max: 103.22Min: 101.06 / Avg: 102.12 / Max: 103.88Min: 99.85 / Avg: 101.63 / Max: 103.68Min: 96.04 / Avg: 97.91 / Max: 98.88Min: 95.36 / Avg: 97 / Max: 98.97Min: 91.87 / Avg: 91.97 / Max: 92.091. (CXX) g++ options: -fopenmp -foffload=disable -finline-limit=1000 -fstrict-aliasing -funroll-all-loops -ffast-math -march=native -O3 -lm -ldl

libavif avifenc

OpenBenchmarking.orgSeconds, Fewer Is Betterlibavif avifenc 1.0Encoder Speed: 6, LosslessXeon 6766E 2PXeon 6780E 2PXeon 6766EXeon 6780EXeon Platinum 8380Xeon Platinum 8380 2PEPYC 8534PNEPYC 8534PXeon Max 9468 2PXeon Max 9480 2PEPYC 9754 2PEPYC 9754Xeon Max 9468Xeon Max 9480Xeon Platinum 8490HXeon Platinum 8490H 2PEPYC 9684X 2PEPYC 9654 2PEPYC 9654Xeon Platinum 8592+EPYC 9684XXeon Platinum 8592+ 2P3691215SE +/- 0.054, N = 5SE +/- 0.038, N = 5SE +/- 0.012, N = 5SE +/- 0.010, N = 6SE +/- 0.016, N = 6SE +/- 0.027, N = 6SE +/- 0.011, N = 6SE +/- 0.009, N = 6SE +/- 0.027, N = 6SE +/- 0.035, N = 6SE +/- 0.025, N = 6SE +/- 0.007, N = 6SE +/- 0.045, N = 6SE +/- 0.033, N = 6SE +/- 0.013, N = 7SE +/- 0.022, N = 7SE +/- 0.015, N = 7SE +/- 0.020, N = 7SE +/- 0.010, N = 7SE +/- 0.025, N = 7SE +/- 0.014, N = 7SE +/- 0.031, N = 79.9609.3519.1888.3598.2017.3887.3017.1827.1217.0386.9866.8536.8366.6056.2786.1725.9505.8465.7995.7845.7575.6131. (CXX) g++ options: -O3 -fPIC -lm
OpenBenchmarking.orgSeconds, Fewer Is Betterlibavif avifenc 1.0Encoder Speed: 6, LosslessXeon 6766E 2PXeon 6780E 2PXeon 6766EXeon 6780EXeon Platinum 8380Xeon Platinum 8380 2PEPYC 8534PNEPYC 8534PXeon Max 9468 2PXeon Max 9480 2PEPYC 9754 2PEPYC 9754Xeon Max 9468Xeon Max 9480Xeon Platinum 8490HXeon Platinum 8490H 2PEPYC 9684X 2PEPYC 9654 2PEPYC 9654Xeon Platinum 8592+EPYC 9684XXeon Platinum 8592+ 2P3691215Min: 9.82 / Avg: 9.96 / Max: 10.13Min: 9.26 / Avg: 9.35 / Max: 9.45Min: 9.15 / Avg: 9.19 / Max: 9.22Min: 8.32 / Avg: 8.36 / Max: 8.38Min: 8.15 / Avg: 8.2 / Max: 8.26Min: 7.33 / Avg: 7.39 / Max: 7.52Min: 7.27 / Avg: 7.3 / Max: 7.34Min: 7.14 / Avg: 7.18 / Max: 7.21Min: 7.04 / Avg: 7.12 / Max: 7.21Min: 6.95 / Avg: 7.04 / Max: 7.19Min: 6.9 / Avg: 6.99 / Max: 7.08Min: 6.82 / Avg: 6.85 / Max: 6.87Min: 6.64 / Avg: 6.84 / Max: 6.93Min: 6.5 / Avg: 6.61 / Max: 6.7Min: 6.24 / Avg: 6.28 / Max: 6.34Min: 6.12 / Avg: 6.17 / Max: 6.28Min: 5.89 / Avg: 5.95 / Max: 6.02Min: 5.81 / Avg: 5.85 / Max: 5.95Min: 5.75 / Avg: 5.8 / Max: 5.83Min: 5.68 / Avg: 5.78 / Max: 5.87Min: 5.72 / Avg: 5.76 / Max: 5.83Min: 5.49 / Avg: 5.61 / Max: 5.761. (CXX) g++ options: -O3 -fPIC -lm

OpenBenchmarking.orgSeconds, Fewer Is Betterlibavif avifenc 1.0Encoder Speed: 6Xeon 6766E 2PXeon 6780E 2PXeon 6766EXeon Platinum 8380Xeon 6780EXeon Max 9468 2PXeon Max 9480 2PXeon Max 9468EPYC 8534PNXeon Max 9480Xeon Platinum 8380 2PEPYC 8534PEPYC 9754 2PEPYC 9754Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Platinum 8592+EPYC 9684X 2PEPYC 9654 2PXeon Platinum 8592+ 2PEPYC 9654EPYC 9684X1.08652.1733.25954.3465.4325SE +/- 0.023, N = 8SE +/- 0.034, N = 8SE +/- 0.003, N = 8SE +/- 0.010, N = 8SE +/- 0.004, N = 8SE +/- 0.029, N = 8SE +/- 0.022, N = 9SE +/- 0.017, N = 9SE +/- 0.011, N = 9SE +/- 0.011, N = 9SE +/- 0.023, N = 15SE +/- 0.016, N = 9SE +/- 0.026, N = 9SE +/- 0.002, N = 9SE +/- 0.022, N = 9SE +/- 0.008, N = 9SE +/- 0.016, N = 9SE +/- 0.005, N = 9SE +/- 0.008, N = 10SE +/- 0.009, N = 10SE +/- 0.011, N = 10SE +/- 0.005, N = 104.8294.4864.2434.0933.8723.7763.7383.7303.6233.5503.5283.4843.3413.2513.1693.0442.9712.8902.8102.8052.7562.7231. (CXX) g++ options: -O3 -fPIC -lm
OpenBenchmarking.orgSeconds, Fewer Is Betterlibavif avifenc 1.0Encoder Speed: 6Xeon 6766E 2PXeon 6780E 2PXeon 6766EXeon Platinum 8380Xeon 6780EXeon Max 9468 2PXeon Max 9480 2PXeon Max 9468EPYC 8534PNXeon Max 9480Xeon Platinum 8380 2PEPYC 8534PEPYC 9754 2PEPYC 9754Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Platinum 8592+EPYC 9684X 2PEPYC 9654 2PXeon Platinum 8592+ 2PEPYC 9654EPYC 9684X246810Min: 4.74 / Avg: 4.83 / Max: 4.95Min: 4.31 / Avg: 4.49 / Max: 4.6Min: 4.23 / Avg: 4.24 / Max: 4.26Min: 4.05 / Avg: 4.09 / Max: 4.14Min: 3.86 / Avg: 3.87 / Max: 3.89Min: 3.64 / Avg: 3.78 / Max: 3.93Min: 3.67 / Avg: 3.74 / Max: 3.87Min: 3.65 / Avg: 3.73 / Max: 3.81Min: 3.59 / Avg: 3.62 / Max: 3.67Min: 3.52 / Avg: 3.55 / Max: 3.62Min: 3.42 / Avg: 3.53 / Max: 3.75Min: 3.42 / Avg: 3.48 / Max: 3.55Min: 3.28 / Avg: 3.34 / Max: 3.52Min: 3.24 / Avg: 3.25 / Max: 3.27Min: 3.07 / Avg: 3.17 / Max: 3.24Min: 3.02 / Avg: 3.04 / Max: 3.08Min: 2.91 / Avg: 2.97 / Max: 3.06Min: 2.87 / Avg: 2.89 / Max: 2.91Min: 2.78 / Avg: 2.81 / Max: 2.86Min: 2.77 / Avg: 2.81 / Max: 2.87Min: 2.73 / Avg: 2.76 / Max: 2.84Min: 2.7 / Avg: 2.72 / Max: 2.751. (CXX) g++ options: -O3 -fPIC -lm

Timed Gem5 Compilation

This test times how long it takes to compile Gem5. Gem5 is a simulator for computer system architecture research. Gem5 is widely used for computer architecture research within the industry, academia, and more. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed Gem5 Compilation 23.0.1Time To CompileXeon Platinum 8380Xeon 6766EXeon 6766E 2PEPYC 8534PNEPYC 8534PXeon 6780EXeon 6780E 2PXeon Max 9468Xeon Platinum 8380 2PXeon Max 9480EPYC 9754Xeon Platinum 8490HEPYC 9754 2PXeon Platinum 8592+EPYC 9654Xeon Max 9468 2PXeon Max 9480 2PXeon Platinum 8490H 2PEPYC 9684XEPYC 9654 2PEPYC 9684X 2PXeon Platinum 8592+ 2P60120180240300SE +/- 3.88, N = 3SE +/- 3.60, N = 3SE +/- 0.78, N = 3SE +/- 0.97, N = 3SE +/- 1.99, N = 9SE +/- 1.47, N = 3SE +/- 2.61, N = 3SE +/- 2.59, N = 4SE +/- 1.04, N = 3SE +/- 2.11, N = 6SE +/- 1.88, N = 3SE +/- 0.92, N = 3SE +/- 1.73, N = 3SE +/- 2.17, N = 3SE +/- 2.24, N = 4SE +/- 1.72, N = 3SE +/- 1.01, N = 3SE +/- 0.58, N = 3SE +/- 2.15, N = 3SE +/- 0.72, N = 3SE +/- 1.16, N = 3SE +/- 0.89, N = 3275.71267.95252.97251.61242.93238.43233.21220.57219.67215.50212.55210.93192.98187.51185.30184.30181.63178.28176.88164.90161.94157.36
OpenBenchmarking.orgSeconds, Fewer Is BetterTimed Gem5 Compilation 23.0.1Time To CompileXeon Platinum 8380Xeon 6766EXeon 6766E 2PEPYC 8534PNEPYC 8534PXeon 6780EXeon 6780E 2PXeon Max 9468Xeon Platinum 8380 2PXeon Max 9480EPYC 9754Xeon Platinum 8490HEPYC 9754 2PXeon Platinum 8592+EPYC 9654Xeon Max 9468 2PXeon Max 9480 2PXeon Platinum 8490H 2PEPYC 9684XEPYC 9654 2PEPYC 9684X 2PXeon Platinum 8592+ 2P50100150200250Min: 268.15 / Avg: 275.71 / Max: 281.03Min: 262.95 / Avg: 267.95 / Max: 274.93Min: 251.67 / Avg: 252.97 / Max: 254.37Min: 249.77 / Avg: 251.61 / Max: 253.04Min: 233.72 / Avg: 242.93 / Max: 249.42Min: 236.78 / Avg: 238.43 / Max: 241.37Min: 228.05 / Avg: 233.2 / Max: 236.42Min: 215.31 / Avg: 220.57 / Max: 225.44Min: 218.18 / Avg: 219.67 / Max: 221.67Min: 207.83 / Avg: 215.5 / Max: 219.52Min: 209.34 / Avg: 212.55 / Max: 215.87Min: 209.09 / Avg: 210.93 / Max: 211.86Min: 189.51 / Avg: 192.98 / Max: 194.8Min: 183.17 / Avg: 187.51 / Max: 189.86Min: 178.6 / Avg: 185.3 / Max: 188.11Min: 180.87 / Avg: 184.3 / Max: 186.22Min: 180.13 / Avg: 181.63 / Max: 183.54Min: 177.28 / Avg: 178.28 / Max: 179.29Min: 172.74 / Avg: 176.88 / Max: 179.95Min: 163.64 / Avg: 164.9 / Max: 166.13Min: 159.72 / Avg: 161.94 / Max: 163.63Min: 155.58 / Avg: 157.36 / Max: 158.28

Zstd Compression

This test measures the time needed to compress/decompress a sample file (silesia.tar) using Zstd (Zstandard) compression with options for different compression levels / settings. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgMB/s, More Is BetterZstd Compression 1.5.4Compression Level: 19, Long Mode - Compression SpeedXeon 6766E 2PXeon 6766EXeon 6780E 2PXeon 6780EEPYC 9754 2PEPYC 9754EPYC 8534PNEPYC 8534PXeon Max 9480 2PXeon Platinum 8380Xeon Max 9468 2PXeon Max 9480Xeon Max 9468Xeon Platinum 8380 2PXeon Platinum 8490HXeon Platinum 8490H 2PEPYC 9654 2PEPYC 9654EPYC 9684X 2PEPYC 9684XXeon Platinum 8592+ 2PXeon Platinum 8592+3691215SE +/- 0.04, N = 3SE +/- 0.00, N = 3SE +/- 0.03, N = 3SE +/- 0.01, N = 3SE +/- 0.05, N = 3SE +/- 0.02, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.06, N = 15SE +/- 0.03, N = 3SE +/- 0.03, N = 3SE +/- 0.03, N = 3SE +/- 0.04, N = 3SE +/- 0.05, N = 3SE +/- 0.03, N = 3SE +/- 0.05, N = 3SE +/- 0.03, N = 3SE +/- 0.02, N = 3SE +/- 0.03, N = 3SE +/- 0.02, N = 3SE +/- 0.04, N = 3SE +/- 0.05, N = 35.605.656.106.196.646.686.746.767.467.527.627.727.767.837.948.168.308.388.428.459.679.801. (CC) gcc options: -O3 -pthread -lz -llzma
OpenBenchmarking.orgMB/s, More Is BetterZstd Compression 1.5.4Compression Level: 19, Long Mode - Compression SpeedXeon 6766E 2PXeon 6766EXeon 6780E 2PXeon 6780EEPYC 9754 2PEPYC 9754EPYC 8534PNEPYC 8534PXeon Max 9480 2PXeon Platinum 8380Xeon Max 9468 2PXeon Max 9480Xeon Max 9468Xeon Platinum 8380 2PXeon Platinum 8490HXeon Platinum 8490H 2PEPYC 9654 2PEPYC 9654EPYC 9684X 2PEPYC 9684XXeon Platinum 8592+ 2PXeon Platinum 8592+3691215Min: 5.52 / Avg: 5.6 / Max: 5.67Min: 5.64 / Avg: 5.65 / Max: 5.65Min: 6.05 / Avg: 6.1 / Max: 6.14Min: 6.18 / Avg: 6.19 / Max: 6.2Min: 6.55 / Avg: 6.64 / Max: 6.71Min: 6.65 / Avg: 6.68 / Max: 6.7Min: 6.72 / Avg: 6.74 / Max: 6.75Min: 6.75 / Avg: 6.76 / Max: 6.77Min: 6.93 / Avg: 7.46 / Max: 7.82Min: 7.47 / Avg: 7.52 / Max: 7.55Min: 7.58 / Avg: 7.62 / Max: 7.67Min: 7.69 / Avg: 7.72 / Max: 7.78Min: 7.69 / Avg: 7.76 / Max: 7.81Min: 7.76 / Avg: 7.83 / Max: 7.93Min: 7.91 / Avg: 7.94 / Max: 7.99Min: 8.06 / Avg: 8.16 / Max: 8.23Min: 8.24 / Avg: 8.3 / Max: 8.33Min: 8.34 / Avg: 8.38 / Max: 8.41Min: 8.36 / Avg: 8.42 / Max: 8.46Min: 8.42 / Avg: 8.45 / Max: 8.47Min: 9.59 / Avg: 9.67 / Max: 9.72Min: 9.73 / Avg: 9.8 / Max: 9.891. (CC) gcc options: -O3 -pthread -lz -llzma

WebP Image Encode

This is a test of Google's libwebp with the cwebp image encode utility and using a sample 6000x4000 pixel JPEG image as the input. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgMP/s, More Is BetterWebP Image Encode 1.2.4Encode Settings: Quality 100, Lossless, Highest CompressionXeon 6766E 2PXeon 6766EXeon 6780E 2PXeon 6780EEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PNXeon Platinum 8380 2PXeon Platinum 8380Xeon Platinum 8490H 2PXeon Platinum 8490HXeon Max 9468 2PXeon Max 9480 2PXeon Max 9468Xeon Max 9480EPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PXeon Platinum 8592+ 2PXeon Platinum 8592+0.1350.270.4050.540.675SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 30.350.350.380.390.480.480.480.480.490.500.510.520.540.540.550.550.560.570.570.570.590.601. (CC) gcc options: -fvisibility=hidden -O2 -lm
OpenBenchmarking.orgMP/s, More Is BetterWebP Image Encode 1.2.4Encode Settings: Quality 100, Lossless, Highest CompressionXeon 6766E 2PXeon 6766EXeon 6780E 2PXeon 6780EEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PNXeon Platinum 8380 2PXeon Platinum 8380Xeon Platinum 8490H 2PXeon Platinum 8490HXeon Max 9468 2PXeon Max 9480 2PXeon Max 9468Xeon Max 9480EPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PXeon Platinum 8592+ 2PXeon Platinum 8592+246810Min: 0.35 / Avg: 0.35 / Max: 0.35Min: 0.35 / Avg: 0.35 / Max: 0.35Min: 0.38 / Avg: 0.38 / Max: 0.38Min: 0.39 / Avg: 0.39 / Max: 0.39Min: 0.48 / Avg: 0.48 / Max: 0.48Min: 0.48 / Avg: 0.48 / Max: 0.48Min: 0.48 / Avg: 0.48 / Max: 0.48Min: 0.48 / Avg: 0.48 / Max: 0.48Min: 0.48 / Avg: 0.49 / Max: 0.49Min: 0.5 / Avg: 0.5 / Max: 0.5Min: 0.51 / Avg: 0.51 / Max: 0.52Min: 0.52 / Avg: 0.52 / Max: 0.52Min: 0.53 / Avg: 0.54 / Max: 0.55Min: 0.54 / Avg: 0.54 / Max: 0.55Min: 0.54 / Avg: 0.55 / Max: 0.55Min: 0.55 / Avg: 0.55 / Max: 0.55Min: 0.56 / Avg: 0.56 / Max: 0.56Min: 0.57 / Avg: 0.57 / Max: 0.57Min: 0.57 / Avg: 0.57 / Max: 0.57Min: 0.57 / Avg: 0.57 / Max: 0.57Min: 0.58 / Avg: 0.59 / Max: 0.6Min: 0.6 / Avg: 0.6 / Max: 0.61. (CC) gcc options: -fvisibility=hidden -O2 -lm

Zstd Compression

This test measures the time needed to compress/decompress a sample file (silesia.tar) using Zstd (Zstandard) compression with options for different compression levels / settings. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgMB/s, More Is BetterZstd Compression 1.5.4Compression Level: 19 - Compression SpeedXeon 6766E 2PXeon 6766EXeon 6780EXeon 6780E 2PXeon Max 9480 2PXeon Platinum 8380EPYC 9754 2PXeon Max 9468 2PEPYC 9754EPYC 8534PNEPYC 8534PXeon Platinum 8380 2PXeon Max 9468Xeon Max 9480Xeon Platinum 8490HXeon Platinum 8490H 2PEPYC 9684X 2PEPYC 9654 2PEPYC 9684XEPYC 9654Xeon Platinum 8592+ 2PXeon Platinum 8592+48121620SE +/- 0.07, N = 3SE +/- 0.00, N = 3SE +/- 0.03, N = 3SE +/- 0.03, N = 3SE +/- 0.13, N = 15SE +/- 0.03, N = 3SE +/- 0.03, N = 3SE +/- 0.09, N = 15SE +/- 0.06, N = 3SE +/- 0.03, N = 3SE +/- 0.00, N = 3SE +/- 0.17, N = 4SE +/- 0.15, N = 3SE +/- 0.11, N = 15SE +/- 0.06, N = 3SE +/- 0.12, N = 3SE +/- 0.22, N = 3SE +/- 0.09, N = 3SE +/- 0.03, N = 3SE +/- 0.00, N = 3SE +/- 0.03, N = 3SE +/- 0.21, N = 410.610.611.511.613.313.713.713.813.813.813.914.314.414.514.615.216.817.017.217.217.818.01. (CC) gcc options: -O3 -pthread -lz -llzma
OpenBenchmarking.orgMB/s, More Is BetterZstd Compression 1.5.4Compression Level: 19 - Compression SpeedXeon 6766E 2PXeon 6766EXeon 6780EXeon 6780E 2PXeon Max 9480 2PXeon Platinum 8380EPYC 9754 2PXeon Max 9468 2PEPYC 9754EPYC 8534PNEPYC 8534PXeon Platinum 8380 2PXeon Max 9468Xeon Max 9480Xeon Platinum 8490HXeon Platinum 8490H 2PEPYC 9684X 2PEPYC 9654 2PEPYC 9684XEPYC 9654Xeon Platinum 8592+ 2PXeon Platinum 8592+510152025Min: 10.5 / Avg: 10.63 / Max: 10.7Min: 10.6 / Avg: 10.6 / Max: 10.6Min: 11.5 / Avg: 11.53 / Max: 11.6Min: 11.5 / Avg: 11.57 / Max: 11.6Min: 12.2 / Avg: 13.29 / Max: 13.9Min: 13.7 / Avg: 13.73 / Max: 13.8Min: 13.6 / Avg: 13.67 / Max: 13.7Min: 13.1 / Avg: 13.76 / Max: 14.4Min: 13.7 / Avg: 13.8 / Max: 13.9Min: 13.7 / Avg: 13.77 / Max: 13.8Min: 13.9 / Avg: 13.9 / Max: 13.9Min: 13.8 / Avg: 14.28 / Max: 14.6Min: 14.1 / Avg: 14.37 / Max: 14.6Min: 13.7 / Avg: 14.49 / Max: 15.2Min: 14.5 / Avg: 14.6 / Max: 14.7Min: 15 / Avg: 15.17 / Max: 15.4Min: 16.4 / Avg: 16.83 / Max: 17.1Min: 16.8 / Avg: 16.97 / Max: 17.1Min: 17.1 / Avg: 17.17 / Max: 17.2Min: 17.2 / Avg: 17.2 / Max: 17.2Min: 17.7 / Avg: 17.77 / Max: 17.8Min: 17.7 / Avg: 18 / Max: 18.61. (CC) gcc options: -O3 -pthread -lz -llzma

SVT-AV1

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 2.0Encoder Mode: Preset 12 - Input: Bosphorus 4KXeon 6766E 2PXeon 6766EXeon 6780E 2PXeon Max 9468 2PXeon 6780EXeon Max 9480 2PXeon Platinum 8380Xeon Platinum 8380 2PXeon Max 9468Xeon Max 9480Xeon Platinum 8490H 2PEPYC 8534PNEPYC 9684X 2PXeon Platinum 8490HEPYC 8534PXeon Platinum 8592+ 2PEPYC 9684XEPYC 9754 2PEPYC 9754EPYC 9654 2PXeon Platinum 8592+EPYC 96544080120160200SE +/- 0.88, N = 5SE +/- 0.08, N = 6SE +/- 1.07, N = 6SE +/- 0.83, N = 5SE +/- 0.15, N = 6SE +/- 0.97, N = 6SE +/- 0.48, N = 6SE +/- 1.28, N = 6SE +/- 0.61, N = 7SE +/- 0.40, N = 7SE +/- 0.25, N = 7SE +/- 0.78, N = 6SE +/- 0.88, N = 6SE +/- 0.41, N = 7SE +/- 0.71, N = 6SE +/- 0.42, N = 7SE +/- 0.43, N = 7SE +/- 1.41, N = 6SE +/- 1.32, N = 6SE +/- 1.88, N = 15SE +/- 0.20, N = 7SE +/- 0.80, N = 7108.50115.35117.68122.09126.59127.55134.07140.76146.10151.72156.52157.36163.80164.25165.09165.50165.75168.78169.23171.22177.86178.521. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq
OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 2.0Encoder Mode: Preset 12 - Input: Bosphorus 4KXeon 6766E 2PXeon 6766EXeon 6780E 2PXeon Max 9468 2PXeon 6780EXeon Max 9480 2PXeon Platinum 8380Xeon Platinum 8380 2PXeon Max 9468Xeon Max 9480Xeon Platinum 8490H 2PEPYC 8534PNEPYC 9684X 2PXeon Platinum 8490HEPYC 8534PXeon Platinum 8592+ 2PEPYC 9684XEPYC 9754 2PEPYC 9754EPYC 9654 2PXeon Platinum 8592+EPYC 9654306090120150Min: 105.12 / Avg: 108.49 / Max: 110.05Min: 115.02 / Avg: 115.35 / Max: 115.55Min: 113.47 / Avg: 117.68 / Max: 121.02Min: 119.74 / Avg: 122.09 / Max: 124.16Min: 125.96 / Avg: 126.59 / Max: 127.06Min: 125.11 / Avg: 127.55 / Max: 131.28Min: 132.81 / Avg: 134.07 / Max: 135.56Min: 135.97 / Avg: 140.76 / Max: 144.62Min: 143.58 / Avg: 146.1 / Max: 148.45Min: 150.35 / Avg: 151.72 / Max: 153.47Min: 155.7 / Avg: 156.52 / Max: 157.59Min: 155.48 / Avg: 157.36 / Max: 159.91Min: 160.45 / Avg: 163.79 / Max: 166.01Min: 162.43 / Avg: 164.25 / Max: 165.44Min: 162.63 / Avg: 165.09 / Max: 167.11Min: 163.4 / Avg: 165.49 / Max: 167.01Min: 164.24 / Avg: 165.75 / Max: 167.2Min: 162.91 / Avg: 168.78 / Max: 172.56Min: 165.81 / Avg: 169.23 / Max: 174.9Min: 151.47 / Avg: 171.22 / Max: 179.13Min: 176.95 / Avg: 177.86 / Max: 178.57Min: 175.07 / Avg: 178.52 / Max: 180.991. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

GraphicsMagick

OpenBenchmarking.orgIterations Per Minute, More Is BetterGraphicsMagick 1.3.43Operation: Noise-GaussianXeon 6766E 2PEPYC 8534PNXeon Platinum 8380EPYC 8534PXeon 6780E 2PXeon 6766EXeon Max 9468Xeon Max 9468 2PEPYC 9754Xeon Platinum 8380 2PXeon 6780EXeon Platinum 8490HXeon Max 9480EPYC 9654Xeon Max 9480 2PEPYC 9754 2PEPYC 9684XXeon Platinum 8592+EPYC 9654 2PEPYC 9684X 2PXeon Platinum 8490H 2PXeon Platinum 8592+ 2P4080120160200SE +/- 0.33, N = 3SE +/- 0.00, N = 3SE +/- 0.67, N = 3SE +/- 0.33, N = 3SE +/- 1.44, N = 4SE +/- 0.33, N = 3SE +/- 0.33, N = 3SE +/- 0.58, N = 3SE +/- 0.58, N = 3SE +/- 0.00, N = 3SE +/- 0.58, N = 3SE +/- 0.33, N = 3SE +/- 0.33, N = 3SE +/- 0.58, N = 3SE +/- 0.33, N = 3SE +/- 0.58, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.67, N = 3SE +/- 0.67, N = 3SE +/- 1.15, N = 3SE +/- 0.88, N = 31181201211231261451501501511531551581581601641641651711781791821941. (CC) gcc options: -fopenmp -O2 -ltiff -ljbig -lsharpyuv -lwebp -lwebpmux -lfreetype -ljpeg -lXext -lSM -lICE -lX11 -lxml2 -lzstd -llzma -lbz2 -lz -lm -lpthread -lgomp
OpenBenchmarking.orgIterations Per Minute, More Is BetterGraphicsMagick 1.3.43Operation: Noise-GaussianXeon 6766E 2PEPYC 8534PNXeon Platinum 8380EPYC 8534PXeon 6780E 2PXeon 6766EXeon Max 9468Xeon Max 9468 2PEPYC 9754Xeon Platinum 8380 2PXeon 6780EXeon Platinum 8490HXeon Max 9480EPYC 9654Xeon Max 9480 2PEPYC 9754 2PEPYC 9684XXeon Platinum 8592+EPYC 9654 2PEPYC 9684X 2PXeon Platinum 8490H 2PXeon Platinum 8592+ 2P4080120160200Min: 118 / Avg: 118.33 / Max: 119Min: 120 / Avg: 120 / Max: 120Min: 120 / Avg: 121.33 / Max: 122Min: 123 / Avg: 123.33 / Max: 124Min: 124 / Avg: 125.75 / Max: 130Min: 144 / Avg: 144.67 / Max: 145Min: 149 / Avg: 149.67 / Max: 150Min: 149 / Avg: 150 / Max: 151Min: 150 / Avg: 151 / Max: 152Min: 153 / Avg: 153 / Max: 153Min: 154 / Avg: 155 / Max: 156Min: 158 / Avg: 158.33 / Max: 159Min: 157 / Avg: 157.67 / Max: 158Min: 159 / Avg: 160 / Max: 161Min: 164 / Avg: 164.33 / Max: 165Min: 163 / Avg: 164 / Max: 165Min: 165 / Avg: 165 / Max: 165Min: 171 / Avg: 171 / Max: 171Min: 177 / Avg: 177.67 / Max: 179Min: 178 / Avg: 178.67 / Max: 180Min: 180 / Avg: 182 / Max: 184Min: 192 / Avg: 193.67 / Max: 1951. (CC) gcc options: -fopenmp -O2 -ltiff -ljbig -lsharpyuv -lwebp -lwebpmux -lfreetype -ljpeg -lXext -lSM -lICE -lX11 -lxml2 -lzstd -llzma -lbz2 -lz -lm -lpthread -lgomp

VVenC

OpenBenchmarking.orgFrames Per Second, More Is BetterVVenC 1.11Video Input: Bosphorus 4K - Video Preset: FasterXeon 6766EXeon 6780EXeon Max 9468 2PXeon Max 9480 2PXeon Platinum 8490H 2PXeon Platinum 8380 2PXeon Platinum 8380Xeon Platinum 8592+ 2PEPYC 8534PNEPYC 8534PXeon Max 9468Xeon Max 9480EPYC 9754Xeon Platinum 8490HXeon Platinum 8592+EPYC 9654EPYC 9684X48121620SE +/- 0.01, N = 3SE +/- 0.02, N = 3SE +/- 0.11, N = 3SE +/- 0.13, N = 3SE +/- 0.16, N = 3SE +/- 0.13, N = 6SE +/- 0.01, N = 3SE +/- 0.12, N = 3SE +/- 0.01, N = 3SE +/- 0.06, N = 3SE +/- 0.05, N = 3SE +/- 0.13, N = 3SE +/- 0.05, N = 3SE +/- 0.02, N = 3SE +/- 0.08, N = 3SE +/- 0.02, N = 3SE +/- 0.03, N = 310.3911.1811.9011.9712.5413.0213.1013.2613.6113.9714.1014.3614.7915.0615.9716.7317.021. (CXX) g++ options: -O3 -flto=auto -fno-fat-lto-objects
OpenBenchmarking.orgFrames Per Second, More Is BetterVVenC 1.11Video Input: Bosphorus 4K - Video Preset: FasterXeon 6766EXeon 6780EXeon Max 9468 2PXeon Max 9480 2PXeon Platinum 8490H 2PXeon Platinum 8380 2PXeon Platinum 8380Xeon Platinum 8592+ 2PEPYC 8534PNEPYC 8534PXeon Max 9468Xeon Max 9480EPYC 9754Xeon Platinum 8490HXeon Platinum 8592+EPYC 9654EPYC 9684X48121620Min: 10.38 / Avg: 10.39 / Max: 10.41Min: 11.16 / Avg: 11.18 / Max: 11.22Min: 11.68 / Avg: 11.9 / Max: 12.05Min: 11.71 / Avg: 11.97 / Max: 12.15Min: 12.28 / Avg: 12.54 / Max: 12.83Min: 12.56 / Avg: 13.02 / Max: 13.32Min: 13.09 / Avg: 13.1 / Max: 13.12Min: 13.03 / Avg: 13.26 / Max: 13.44Min: 13.6 / Avg: 13.61 / Max: 13.63Min: 13.88 / Avg: 13.97 / Max: 14.09Min: 14.04 / Avg: 14.1 / Max: 14.19Min: 14.1 / Avg: 14.36 / Max: 14.53Min: 14.71 / Avg: 14.79 / Max: 14.87Min: 15.03 / Avg: 15.06 / Max: 15.09Min: 15.87 / Avg: 15.97 / Max: 16.12Min: 16.68 / Avg: 16.73 / Max: 16.76Min: 16.97 / Avg: 17.02 / Max: 17.081. (CXX) g++ options: -O3 -flto=auto -fno-fat-lto-objects

Video Input: Bosphorus 4K - Video Preset: Faster

EPYC 9684X 2P: The test quit with a non-zero exit status. E: Parameter Check Error: Number of threads out of range (-1

EPYC 9654 2P: The test quit with a non-zero exit status. E: Parameter Check Error: Number of threads out of range (-1

EPYC 9754 2P: The test quit with a non-zero exit status. E: Parameter Check Error: Number of threads out of range (-1

Xeon 6766E 2P: The test quit with a non-zero exit status. E: Parameter Check Error: Number of threads out of range (-1

Xeon 6780E 2P: The test quit with a non-zero exit status. E: Parameter Check Error: Number of threads out of range (-1

WebP Image Encode

This is a test of Google's libwebp with the cwebp image encode utility and using a sample 6000x4000 pixel JPEG image as the input. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgMP/s, More Is BetterWebP Image Encode 1.2.4Encode Settings: Quality 100, Highest CompressionXeon 6766E 2PXeon 6766EXeon 6780E 2PXeon 6780EXeon Platinum 8380 2PXeon Platinum 8380EPYC 9754 2PEPYC 8534PEPYC 8534PNEPYC 9754Xeon Platinum 8490H 2PXeon Platinum 8490HXeon Max 9468 2PXeon Max 9480 2PXeon Max 9468Xeon Max 9480Xeon Platinum 8592+ 2PXeon Platinum 8592+EPYC 9684XEPYC 9684X 2PEPYC 9654EPYC 9654 2P0.81451.6292.44353.2584.0725SE +/- 0.00, N = 5SE +/- 0.00, N = 5SE +/- 0.00, N = 5SE +/- 0.00, N = 5SE +/- 0.00, N = 5SE +/- 0.00, N = 5SE +/- 0.00, N = 6SE +/- 0.00, N = 6SE +/- 0.00, N = 6SE +/- 0.00, N = 6SE +/- 0.00, N = 6SE +/- 0.00, N = 6SE +/- 0.00, N = 6SE +/- 0.00, N = 6SE +/- 0.00, N = 6SE +/- 0.00, N = 6SE +/- 0.00, N = 6SE +/- 0.00, N = 6SE +/- 0.00, N = 6SE +/- 0.00, N = 6SE +/- 0.00, N = 6SE +/- 0.00, N = 62.232.232.472.492.812.823.033.033.033.043.073.083.093.093.103.103.463.473.613.623.623.621. (CC) gcc options: -fvisibility=hidden -O2 -lm
OpenBenchmarking.orgMP/s, More Is BetterWebP Image Encode 1.2.4Encode Settings: Quality 100, Highest CompressionXeon 6766E 2PXeon 6766EXeon 6780E 2PXeon 6780EXeon Platinum 8380 2PXeon Platinum 8380EPYC 9754 2PEPYC 8534PEPYC 8534PNEPYC 9754Xeon Platinum 8490H 2PXeon Platinum 8490HXeon Max 9468 2PXeon Max 9480 2PXeon Max 9468Xeon Max 9480Xeon Platinum 8592+ 2PXeon Platinum 8592+EPYC 9684XEPYC 9684X 2PEPYC 9654EPYC 9654 2P246810Min: 2.23 / Avg: 2.23 / Max: 2.23Min: 2.23 / Avg: 2.23 / Max: 2.24Min: 2.45 / Avg: 2.47 / Max: 2.48Min: 2.48 / Avg: 2.49 / Max: 2.49Min: 2.79 / Avg: 2.81 / Max: 2.82Min: 2.81 / Avg: 2.82 / Max: 2.82Min: 3.03 / Avg: 3.03 / Max: 3.03Min: 3.03 / Avg: 3.03 / Max: 3.04Min: 3.03 / Avg: 3.03 / Max: 3.04Min: 3.03 / Avg: 3.04 / Max: 3.04Min: 3.07 / Avg: 3.07 / Max: 3.07Min: 3.08 / Avg: 3.08 / Max: 3.08Min: 3.09 / Avg: 3.09 / Max: 3.09Min: 3.09 / Avg: 3.09 / Max: 3.09Min: 3.1 / Avg: 3.1 / Max: 3.1Min: 3.09 / Avg: 3.1 / Max: 3.1Min: 3.46 / Avg: 3.46 / Max: 3.46Min: 3.46 / Avg: 3.47 / Max: 3.47Min: 3.6 / Avg: 3.61 / Max: 3.62Min: 3.61 / Avg: 3.62 / Max: 3.62Min: 3.62 / Avg: 3.62 / Max: 3.63Min: 3.62 / Avg: 3.62 / Max: 3.621. (CC) gcc options: -fvisibility=hidden -O2 -lm

OpenFOAM

OpenFOAM is the leading free, open-source software for computational fluid dynamics (CFD). This test profile currently uses the drivaerFastback test case for analyzing automotive aerodynamics or alternatively the older motorBike input. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterOpenFOAM 10Input: drivaerFastback, Medium Mesh Size - Mesh TimeEPYC 9754 2PEPYC 8534PNXeon Platinum 8380EPYC 9754EPYC 8534PXeon Platinum 8380 2PXeon Platinum 8490H 2PXeon Platinum 8490HXeon Max 9480 2PXeon Max 9468Xeon Max 9480Xeon Platinum 8592+EPYC 9654 2PXeon Platinum 8592+ 2PEPYC 9654EPYC 9684X 2PXeon Max 9468 2PEPYC 9684X4080120160200192.42188.37182.24167.41163.70162.32162.03160.73159.31153.12150.67148.40140.48139.62136.40135.52134.78118.541. (CXX) g++ options: -std=c++14 -m64 -O3 -ftemplate-depth-100 -fPIC -fuse-ld=bfd -Xlinker --add-needed --no-as-needed -lfiniteVolume -lmeshTools -lparallel -llagrangian -lregionModels -lgenericPatchFields -lOpenFOAM -ldl -lm

PyBench

This test profile reports the total time of the different average timed test results from PyBench. PyBench reports average test times for different functions such as BuiltinFunctionCalls and NestedForLoops, with this total result providing a rough estimate as to Python's average performance on a given system. This test profile runs PyBench each time for 20 rounds. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgMilliseconds, Fewer Is BetterPyBench 2018-02-16Total For Average Test TimesXeon 6766E 2PXeon 6766EXeon 6780EXeon 6780E 2PEPYC 8534PEPYC 8534PNEPYC 9754Xeon Platinum 8380EPYC 9754 2PXeon Platinum 8380 2PEPYC 9654 2PEPYC 9654EPYC 9684XEPYC 9684X 2PXeon Platinum 8490H 2PXeon Platinum 8490HXeon Max 9480 2PXeon Max 9468 2PXeon Max 9468Xeon Max 9480Xeon Platinum 8592+ 2PXeon Platinum 8592+2004006008001000SE +/- 0.33, N = 3SE +/- 1.15, N = 3SE +/- 0.88, N = 3SE +/- 0.58, N = 3SE +/- 1.45, N = 3SE +/- 2.40, N = 3SE +/- 0.58, N = 3SE +/- 2.85, N = 3SE +/- 1.33, N = 3SE +/- 0.33, N = 3SE +/- 1.86, N = 3SE +/- 2.19, N = 3SE +/- 2.08, N = 3SE +/- 1.20, N = 3SE +/- 1.15, N = 3SE +/- 0.33, N = 3SE +/- 0.67, N = 3SE +/- 0.67, N = 3SE +/- 0.33, N = 3SE +/- 0.58, N = 3SE +/- 0.48, N = 4SE +/- 0.41, N = 41119111710071005976974974973972971822818818818767765763763763762692691
OpenBenchmarking.orgMilliseconds, Fewer Is BetterPyBench 2018-02-16Total For Average Test TimesXeon 6766E 2PXeon 6766EXeon 6780EXeon 6780E 2PEPYC 8534PEPYC 8534PNEPYC 9754Xeon Platinum 8380EPYC 9754 2PXeon Platinum 8380 2PEPYC 9654 2PEPYC 9654EPYC 9684XEPYC 9684X 2PXeon Platinum 8490H 2PXeon Platinum 8490HXeon Max 9480 2PXeon Max 9468 2PXeon Max 9468Xeon Max 9480Xeon Platinum 8592+ 2PXeon Platinum 8592+2004006008001000Min: 1119 / Avg: 1119.33 / Max: 1120Min: 1115 / Avg: 1117 / Max: 1119Min: 1006 / Avg: 1007.33 / Max: 1009Min: 1004 / Avg: 1005 / Max: 1006Min: 974 / Avg: 976.33 / Max: 979Min: 971 / Avg: 974.33 / Max: 979Min: 973 / Avg: 974 / Max: 975Min: 970 / Avg: 973.33 / Max: 979Min: 969 / Avg: 971.67 / Max: 973Min: 971 / Avg: 971.33 / Max: 972Min: 820 / Avg: 822.33 / Max: 826Min: 814 / Avg: 818.33 / Max: 821Min: 814 / Avg: 818 / Max: 821Min: 816 / Avg: 817.67 / Max: 820Min: 765 / Avg: 767 / Max: 769Min: 764 / Avg: 764.67 / Max: 765Min: 762 / Avg: 762.67 / Max: 764Min: 762 / Avg: 763.33 / Max: 764Min: 762 / Avg: 762.67 / Max: 763Min: 761 / Avg: 762 / Max: 763Min: 691 / Avg: 691.75 / Max: 693Min: 690 / Avg: 691 / Max: 692

Google SynthMark

SynthMark is a cross platform tool for benchmarking CPU performance under a variety of real-time audio workloads. It uses a polyphonic synthesizer model to provide standardized tests for latency, jitter and computational throughput. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgVoices, More Is BetterGoogle SynthMark 20201109Test: VoiceMark_100Xeon 6766EXeon 6766E 2PXeon 6780E 2PXeon 6780EXeon Platinum 8380 2PXeon Platinum 8380EPYC 9754 2PEPYC 8534PEPYC 9754EPYC 8534PNXeon Max 9468 2PXeon Max 9468Xeon Platinum 8490HXeon Max 9480Xeon Max 9480 2PXeon Platinum 8490H 2PEPYC 9654 2PEPYC 9684X 2PEPYC 9684XEPYC 9654Xeon Platinum 8592+ 2PXeon Platinum 8592+2004006008001000SE +/- 0.58, N = 3SE +/- 0.33, N = 3SE +/- 0.06, N = 3SE +/- 0.18, N = 3SE +/- 0.53, N = 3SE +/- 7.09, N = 3SE +/- 0.88, N = 3SE +/- 0.14, N = 3SE +/- 0.45, N = 3SE +/- 0.60, N = 3SE +/- 0.30, N = 3SE +/- 0.26, N = 3SE +/- 0.22, N = 3SE +/- 0.24, N = 3SE +/- 0.48, N = 3SE +/- 1.51, N = 3SE +/- 0.56, N = 3SE +/- 0.72, N = 3SE +/- 0.69, N = 3SE +/- 0.55, N = 3SE +/- 0.38, N = 3SE +/- 0.13, N = 3494.05494.38538.91540.24548.36555.60655.05655.24655.80656.25710.92711.10711.38712.01712.09712.70782.32783.20783.42783.78799.49799.721. (CXX) g++ options: -lm -lpthread -std=c++11 -Ofast
OpenBenchmarking.orgVoices, More Is BetterGoogle SynthMark 20201109Test: VoiceMark_100Xeon 6766EXeon 6766E 2PXeon 6780E 2PXeon 6780EXeon Platinum 8380 2PXeon Platinum 8380EPYC 9754 2PEPYC 8534PEPYC 9754EPYC 8534PNXeon Max 9468 2PXeon Max 9468Xeon Platinum 8490HXeon Max 9480Xeon Max 9480 2PXeon Platinum 8490H 2PEPYC 9654 2PEPYC 9684X 2PEPYC 9684XEPYC 9654Xeon Platinum 8592+ 2PXeon Platinum 8592+140280420560700Min: 493.05 / Avg: 494.05 / Max: 495.05Min: 494.05 / Avg: 494.38 / Max: 495.05Min: 538.79 / Avg: 538.91 / Max: 538.97Min: 540.01 / Avg: 540.24 / Max: 540.6Min: 547.35 / Avg: 548.36 / Max: 549.12Min: 548.14 / Avg: 555.6 / Max: 569.78Min: 653.67 / Avg: 655.05 / Max: 656.69Min: 655 / Avg: 655.24 / Max: 655.49Min: 655.15 / Avg: 655.8 / Max: 656.66Min: 655.12 / Avg: 656.25 / Max: 657.16Min: 710.34 / Avg: 710.92 / Max: 711.3Min: 710.75 / Avg: 711.1 / Max: 711.61Min: 711.02 / Avg: 711.38 / Max: 711.79Min: 711.65 / Avg: 712.01 / Max: 712.48Min: 711.17 / Avg: 712.09 / Max: 712.76Min: 710.79 / Avg: 712.7 / Max: 715.68Min: 781.42 / Avg: 782.32 / Max: 783.34Min: 781.78 / Avg: 783.2 / Max: 784.13Min: 782.04 / Avg: 783.42 / Max: 784.26Min: 782.68 / Avg: 783.78 / Max: 784.37Min: 798.81 / Avg: 799.49 / Max: 800.14Min: 799.47 / Avg: 799.72 / Max: 799.891. (CXX) g++ options: -lm -lpthread -std=c++11 -Ofast

Timed Mesa Compilation

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed Mesa Compilation 24.0Time To CompileXeon 6766EXeon 6766E 2PXeon Platinum 8380Xeon 6780E 2PXeon 6780EEPYC 8534PNXeon Platinum 8380 2PEPYC 8534PXeon Max 9468EPYC 9754Xeon Max 9480EPYC 9754 2PXeon Platinum 8490HXeon Max 9468 2PXeon Platinum 8490H 2PXeon Max 9480 2PXeon Platinum 8592+EPYC 9654EPYC 9684XEPYC 9654 2PEPYC 9684X 2PXeon Platinum 8592+ 2P612182430SE +/- 0.06, N = 3SE +/- 0.08, N = 3SE +/- 0.05, N = 3SE +/- 0.06, N = 3SE +/- 0.05, N = 3SE +/- 0.02, N = 3SE +/- 0.05, N = 3SE +/- 0.04, N = 3SE +/- 0.03, N = 3SE +/- 0.03, N = 3SE +/- 0.08, N = 3SE +/- 0.12, N = 3SE +/- 0.07, N = 3SE +/- 0.07, N = 3SE +/- 0.12, N = 3SE +/- 0.17, N = 3SE +/- 0.07, N = 3SE +/- 0.03, N = 3SE +/- 0.02, N = 3SE +/- 0.02, N = 4SE +/- 0.08, N = 4SE +/- 0.05, N = 425.8925.8823.6623.4623.4121.5321.4421.0420.1819.9119.6519.5619.2318.4718.2918.1417.2616.9616.6716.4116.4016.18
OpenBenchmarking.orgSeconds, Fewer Is BetterTimed Mesa Compilation 24.0Time To CompileXeon 6766EXeon 6766E 2PXeon Platinum 8380Xeon 6780E 2PXeon 6780EEPYC 8534PNXeon Platinum 8380 2PEPYC 8534PXeon Max 9468EPYC 9754Xeon Max 9480EPYC 9754 2PXeon Platinum 8490HXeon Max 9468 2PXeon Platinum 8490H 2PXeon Max 9480 2PXeon Platinum 8592+EPYC 9654EPYC 9684XEPYC 9654 2PEPYC 9684X 2PXeon Platinum 8592+ 2P612182430Min: 25.8 / Avg: 25.89 / Max: 25.99Min: 25.77 / Avg: 25.88 / Max: 26.04Min: 23.57 / Avg: 23.66 / Max: 23.74Min: 23.38 / Avg: 23.46 / Max: 23.57Min: 23.33 / Avg: 23.41 / Max: 23.51Min: 21.5 / Avg: 21.53 / Max: 21.58Min: 21.35 / Avg: 21.44 / Max: 21.52Min: 20.97 / Avg: 21.03 / Max: 21.09Min: 20.13 / Avg: 20.18 / Max: 20.21Min: 19.85 / Avg: 19.91 / Max: 19.94Min: 19.52 / Avg: 19.65 / Max: 19.8Min: 19.39 / Avg: 19.56 / Max: 19.8Min: 19.12 / Avg: 19.23 / Max: 19.35Min: 18.34 / Avg: 18.47 / Max: 18.57Min: 18.08 / Avg: 18.29 / Max: 18.51Min: 17.89 / Avg: 18.14 / Max: 18.46Min: 17.11 / Avg: 17.26 / Max: 17.36Min: 16.92 / Avg: 16.96 / Max: 17.02Min: 16.65 / Avg: 16.67 / Max: 16.7Min: 16.38 / Avg: 16.41 / Max: 16.47Min: 16.31 / Avg: 16.4 / Max: 16.63Min: 16.1 / Avg: 16.18 / Max: 16.32

SecureMark

SecureMark is an objective, standardized benchmarking framework for measuring the efficiency of cryptographic processing solutions developed by EEMBC. SecureMark-TLS is benchmarking Transport Layer Security performance with a focus on IoT/edge computing. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgmarks, More Is BetterSecureMark 1.0.4Benchmark: SecureMark-TLSXeon 6766EXeon 6766E 2PXeon 6780E 2PXeon 6780EXeon Platinum 8380 2PXeon Platinum 8380EPYC 8534PEPYC 8534PNEPYC 9754EPYC 9754 2PXeon Platinum 8490H 2PXeon Platinum 8490HXeon Max 9480Xeon Max 9480 2PXeon Max 9468 2PXeon Max 9468EPYC 9654EPYC 9654 2PEPYC 9684XEPYC 9684X 2PXeon Platinum 8592+ 2PXeon Platinum 8592+70K140K210K280K350KSE +/- 553.57, N = 3SE +/- 722.69, N = 3SE +/- 1219.44, N = 3SE +/- 406.59, N = 3SE +/- 285.52, N = 3SE +/- 372.88, N = 3SE +/- 372.96, N = 3SE +/- 542.88, N = 3SE +/- 457.42, N = 3SE +/- 553.62, N = 3SE +/- 330.95, N = 3SE +/- 625.56, N = 3SE +/- 670.43, N = 3SE +/- 196.24, N = 3SE +/- 384.08, N = 3SE +/- 256.85, N = 3SE +/- 361.20, N = 3SE +/- 389.81, N = 3SE +/- 415.71, N = 3SE +/- 809.90, N = 3SE +/- 411.11, N = 3SE +/- 209.97, N = 31967401972982175362200512310762313572500242501622506952510752754722772052772602772982775892776472983412996103008333017403084343098961. (CC) gcc options: -pedantic -O3
OpenBenchmarking.orgmarks, More Is BetterSecureMark 1.0.4Benchmark: SecureMark-TLSXeon 6766EXeon 6766E 2PXeon 6780E 2PXeon 6780EXeon Platinum 8380 2PXeon Platinum 8380EPYC 8534PEPYC 8534PNEPYC 9754EPYC 9754 2PXeon Platinum 8490H 2PXeon Platinum 8490HXeon Max 9480Xeon Max 9480 2PXeon Max 9468 2PXeon Max 9468EPYC 9654EPYC 9654 2PEPYC 9684XEPYC 9684X 2PXeon Platinum 8592+ 2PXeon Platinum 8592+50K100K150K200K250KMin: 195644.13 / Avg: 196740.28 / Max: 197423.06Min: 196082.58 / Avg: 197297.83 / Max: 198583.13Min: 215952.72 / Avg: 217535.69 / Max: 219933.97Min: 219355.02 / Avg: 220051.24 / Max: 220763.23Min: 230648.27 / Avg: 231076.44 / Max: 231617.73Min: 230624.39 / Avg: 231357.23 / Max: 231843.36Min: 249308.77 / Avg: 250023.76 / Max: 250565.36Min: 249192.2 / Avg: 250161.8 / Max: 251069.78Min: 249780.47 / Avg: 250695.32 / Max: 251153.11Min: 249970.92 / Avg: 251075.08 / Max: 251698.72Min: 274903.75 / Avg: 275472.07 / Max: 276050.06Min: 276369.16 / Avg: 277204.97 / Max: 278429.13Min: 276120.94 / Avg: 277260.22 / Max: 278442.19Min: 276929.5 / Avg: 277298.43 / Max: 277598.84Min: 277153.66 / Avg: 277589.29 / Max: 278355.03Min: 277154.09 / Avg: 277646.99 / Max: 278018.78Min: 297791.66 / Avg: 298340.77 / Max: 299021.84Min: 299136.5 / Avg: 299610.25 / Max: 300383.34Min: 300002.16 / Avg: 300833.13 / Max: 301272.09Min: 300123.44 / Avg: 301739.95 / Max: 302637.53Min: 308006.75 / Avg: 308434.25 / Max: 309256.25Min: 309477.53 / Avg: 309896.25 / Max: 310133.281. (CC) gcc options: -pedantic -O3

OpenFOAM

OpenFOAM is the leading free, open-source software for computational fluid dynamics (CFD). This test profile currently uses the drivaerFastback test case for analyzing automotive aerodynamics or alternatively the older motorBike input. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterOpenFOAM 10Input: drivaerFastback, Small Mesh Size - Mesh TimeXeon Platinum 8380Xeon Platinum 8380 2PEPYC 8534PNXeon Platinum 8490H 2PEPYC 8534PXeon Max 9468 2PXeon Max 9480Xeon Max 9468Xeon Platinum 8592+Xeon Platinum 8490HEPYC 9754EPYC 9754 2PXeon Platinum 8592+ 2PXeon Max 9480 2PEPYC 9654EPYC 9654 2PEPYC 9684X 2PEPYC 9684X91827364539.1236.8636.8235.6033.6732.4832.0031.7831.7031.3830.3829.4729.3328.8428.0327.7426.8225.931. (CXX) g++ options: -std=c++14 -m64 -O3 -ftemplate-depth-100 -fPIC -fuse-ld=bfd -Xlinker --add-needed --no-as-needed -lfiniteVolume -lmeshTools -lparallel -llagrangian -lregionModels -lgenericPatchFields -lOpenFOAM -ldl -lm

Liquid-DSP

LiquidSDR's Liquid-DSP is a software-defined radio (SDR) digital signal processing library. This test profile runs a multi-threaded benchmark of this SDR/DSP library focused on embedded platform usage. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgsamples/s, More Is BetterLiquid-DSP 1.6Threads: 64 - Buffer Length: 256 - Filter Length: 32Xeon Platinum 8380Xeon Max 9468Xeon Max 9480Xeon Platinum 8380 2PEPYC 8534PNXeon 6766E 2PXeon 6766EEPYC 8534PXeon Platinum 8490HEPYC 9754 2PEPYC 9754Xeon Platinum 8592+Xeon Max 9468 2PXeon 6780E 2PXeon Platinum 8490H 2PXeon 6780EXeon Max 9480 2PXeon Platinum 8592+ 2PEPYC 9684X 2PEPYC 9654 2PEPYC 9654EPYC 9684X500M1000M1500M2000M2500MSE +/- 3209534.41, N = 3SE +/- 688799.28, N = 3SE +/- 692820.32, N = 3SE +/- 9052685.30, N = 3SE +/- 3256958.36, N = 3SE +/- 1003881.36, N = 3SE +/- 1379613.47, N = 3SE +/- 3090487.20, N = 3SE +/- 3167192.94, N = 3SE +/- 1462114.15, N = 3SE +/- 1550627.11, N = 3SE +/- 27191440.65, N = 3SE +/- 2206304.10, N = 3SE +/- 4028647.42, N = 3SE +/- 3300505.01, N = 3SE +/- 808290.38, N = 3SE +/- 3017909.50, N = 3SE +/- 17236814.61, N = 3SE +/- 2510644.01, N = 3SE +/- 1567730.14, N = 3SE +/- 2810891.52, N = 3SE +/- 3000185.18, N = 315617666671640266667167970000017311666671776866667178053333318414000001871333333189056666718949666671898766667192776666719632333331989300000202500000020573000002090466667215463333322793000002282066667228276666722874666671. (CC) gcc options: -O3 -pthread -lm -lc -lliquid
OpenBenchmarking.orgsamples/s, More Is BetterLiquid-DSP 1.6Threads: 64 - Buffer Length: 256 - Filter Length: 32Xeon Platinum 8380Xeon Max 9468Xeon Max 9480Xeon Platinum 8380 2PEPYC 8534PNXeon 6766E 2PXeon 6766EEPYC 8534PXeon Platinum 8490HEPYC 9754 2PEPYC 9754Xeon Platinum 8592+Xeon Max 9468 2PXeon 6780E 2PXeon Platinum 8490H 2PXeon 6780EXeon Max 9480 2PXeon Platinum 8592+ 2PEPYC 9684X 2PEPYC 9654 2PEPYC 9654EPYC 9684X400M800M1200M1600M2000MMin: 1555800000 / Avg: 1561766666.67 / Max: 1566800000Min: 1638900000 / Avg: 1640266666.67 / Max: 1641100000Min: 1678500000 / Avg: 1679700000 / Max: 1680900000Min: 1714300000 / Avg: 1731166666.67 / Max: 1745300000Min: 1771900000 / Avg: 1776866666.67 / Max: 1783000000Min: 1779200000 / Avg: 1780533333.33 / Max: 1782500000Min: 1838800000 / Avg: 1841400000 / Max: 1843500000Min: 1865400000 / Avg: 1871333333.33 / Max: 1875800000Min: 1887300000 / Avg: 1890566666.67 / Max: 1896900000Min: 1892100000 / Avg: 1894966666.67 / Max: 1896900000Min: 1895700000 / Avg: 1898766666.67 / Max: 1900700000Min: 1889600000 / Avg: 1927766666.67 / Max: 1980400000Min: 1959200000 / Avg: 1963233333.33 / Max: 1966800000Min: 1981800000 / Avg: 1989300000 / Max: 1995600000Min: 2018400000 / Avg: 2025000000 / Max: 2028400000Min: 2056300000 / Avg: 2057300000 / Max: 2058900000Min: 2084800000 / Avg: 2090466666.67 / Max: 2095100000Min: 2127000000 / Avg: 2154633333.33 / Max: 2186300000Min: 2276400000 / Avg: 2279300000 / Max: 2284300000Min: 2279200000 / Avg: 2282066666.67 / Max: 2284600000Min: 2277400000 / Avg: 2282766666.67 / Max: 2286900000Min: 2281500000 / Avg: 2287466666.67 / Max: 22910000001. (CC) gcc options: -O3 -pthread -lm -lc -lliquid

OpenBenchmarking.orgsamples/s, More Is BetterLiquid-DSP 1.6Threads: 1 - Buffer Length: 256 - Filter Length: 32EPYC 9754 2PEPYC 8534PNEPYC 8534PEPYC 9754Xeon 6766E 2PXeon 6766EXeon Platinum 8380 2PXeon Platinum 8380Xeon 6780E 2PXeon 6780EEPYC 9654 2PEPYC 9684X 2PEPYC 9684XEPYC 9654Xeon Platinum 8490H 2PXeon Max 9468 2PXeon Platinum 8490HXeon Max 9480 2PXeon Max 9468Xeon Max 9480Xeon Platinum 8592+ 2PXeon Platinum 8592+9M18M27M36M45MSE +/- 2185.81, N = 3SE +/- 881.92, N = 3SE +/- 2333.33, N = 3SE +/- 6984.11, N = 3SE +/- 881.92, N = 3SE +/- 0.00, N = 3SE +/- 577.35, N = 3SE +/- 1000.00, N = 3SE +/- 881.92, N = 3SE +/- 1527.53, N = 3SE +/- 13503.09, N = 3SE +/- 19139.84, N = 3SE +/- 7023.77, N = 3SE +/- 7753.14, N = 3SE +/- 1154.70, N = 3SE +/- 1201.85, N = 3SE +/- 1527.53, N = 3SE +/- 1452.97, N = 3SE +/- 1666.67, N = 3SE +/- 3000.00, N = 3SE +/- 419600.12, N = 5SE +/- 417042.80, N = 5298933332989933329899667299073333170566731726000319920003199500035190667352590003603300036040000360660003606833336461000364976673650600036521333365376673653900038950600402440001. (CC) gcc options: -O3 -pthread -lm -lc -lliquid
OpenBenchmarking.orgsamples/s, More Is BetterLiquid-DSP 1.6Threads: 1 - Buffer Length: 256 - Filter Length: 32EPYC 9754 2PEPYC 8534PNEPYC 8534PEPYC 9754Xeon 6766E 2PXeon 6766EXeon Platinum 8380 2PXeon Platinum 8380Xeon 6780E 2PXeon 6780EEPYC 9654 2PEPYC 9684X 2PEPYC 9684XEPYC 9654Xeon Platinum 8490H 2PXeon Max 9468 2PXeon Platinum 8490HXeon Max 9480 2PXeon Max 9468Xeon Max 9480Xeon Platinum 8592+ 2PXeon Platinum 8592+7M14M21M28M35MMin: 29889000 / Avg: 29893333.33 / Max: 29896000Min: 29898000 / Avg: 29899333.33 / Max: 29901000Min: 29896000 / Avg: 29899666.67 / Max: 29904000Min: 29898000 / Avg: 29907333.33 / Max: 29921000Min: 31704000 / Avg: 31705666.67 / Max: 31707000Min: 31726000 / Avg: 31726000 / Max: 31726000Min: 31991000 / Avg: 31992000 / Max: 31993000Min: 31993000 / Avg: 31995000 / Max: 31996000Min: 35189000 / Avg: 35190666.67 / Max: 35192000Min: 35256000 / Avg: 35259000 / Max: 35261000Min: 36006000 / Avg: 36033000 / Max: 36047000Min: 36003000 / Avg: 36040000 / Max: 36067000Min: 36058000 / Avg: 36066000 / Max: 36080000Min: 36053000 / Avg: 36068333.33 / Max: 36078000Min: 36459000 / Avg: 36461000 / Max: 36463000Min: 36496000 / Avg: 36497666.67 / Max: 36500000Min: 36503000 / Avg: 36506000 / Max: 36508000Min: 36519000 / Avg: 36521333.33 / Max: 36524000Min: 36536000 / Avg: 36537666.67 / Max: 36541000Min: 36536000 / Avg: 36539000 / Max: 36545000Min: 38530000 / Avg: 38950600 / Max: 40629000Min: 38576000 / Avg: 40244000 / Max: 406710001. (CC) gcc options: -O3 -pthread -lm -lc -lliquid

ONNX Runtime

OpenBenchmarking.orgWatts, Fewer Is BetterONNX Runtime 1.17CPU Power Consumption MonitorXeon Platinum 8380 2PEPYC 9684X 2PEPYC 9654 2PEPYC 9754 2PXeon Platinum 8380Xeon 6780E 2PXeon 6766E 2PEPYC 9684XEPYC 9654EPYC 9754Xeon 6780EXeon 6766EEPYC 8534PEPYC 8534PN60120180240300Min: 99.27 / Avg: 314.65 / Max: 333.57Min: 64.84 / Avg: 297.41 / Max: 317.19Min: 57.25 / Avg: 267.87 / Max: 282.78Min: 40.04 / Avg: 220.47 / Max: 233.47Min: 52.52 / Avg: 218.31 / Max: 234.43Min: 105.65 / Avg: 182.76 / Max: 192.69Min: 103.76 / Avg: 180.19 / Max: 189.22Min: 33.5 / Avg: 163.65 / Max: 174.8Min: 29.55 / Avg: 141.28 / Max: 150.78Min: 21.09 / Avg: 108.61 / Max: 116.43Min: 43.42 / Avg: 105.34 / Max: 111.27Min: 43.59 / Avg: 101.11 / Max: 106.64Min: 17.28 / Avg: 82.81 / Max: 89.26Min: 15.18 / Avg: 80.15 / Max: 85.73

OpenBenchmarking.orgWatts, Fewer Is BetterONNX Runtime 1.17CPU Power Consumption MonitorXeon Platinum 8380 2PEPYC 9684X 2PEPYC 9654 2PEPYC 9754 2PXeon Platinum 8380Xeon 6766E 2PXeon 6780E 2PEPYC 9684XEPYC 9654EPYC 9754Xeon 6780EXeon 6766EEPYC 8534PEPYC 8534PN60120180240300Min: 99.68 / Avg: 289.97 / Max: 319.08Min: 34.94 / Avg: 287.83 / Max: 306.6Min: 58.06 / Avg: 256.93 / Max: 271.34Min: 40.98 / Avg: 208.45 / Max: 223.35Min: 52.27 / Avg: 202.48 / Max: 217.49Min: 75.92 / Avg: 152.85 / Max: 173.61Min: 105.79 / Avg: 152.81 / Max: 159.65Min: 34.63 / Avg: 146.68 / Max: 155.53Min: 26.07 / Avg: 125.08 / Max: 132.3Min: 20.82 / Avg: 94.1 / Max: 99.49Min: 43.39 / Avg: 88.68 / Max: 93.08Min: 43.7 / Avg: 85.81 / Max: 89.61Min: 16.9 / Avg: 70.5 / Max: 76.74Min: 15.64 / Avg: 68.55 / Max: 73.08

OpenBenchmarking.orgWatts, Fewer Is BetterONNX Runtime 1.17CPU Power Consumption MonitorEPYC 9684X 2PEPYC 9654 2PXeon Platinum 8380 2PEPYC 9754 2PXeon 6780E 2PXeon 6766E 2PEPYC 9684XXeon Platinum 8380EPYC 9654EPYC 9754Xeon 6780EXeon 6766EEPYC 8534PEPYC 8534PN80160240320400Min: 65.93 / Avg: 426.21 / Max: 468.57Min: 58.29 / Avg: 391.03 / Max: 427.27Min: 101.44 / Avg: 386.17 / Max: 431.52Min: 41.16 / Avg: 302.54 / Max: 329.11Min: 106.52 / Avg: 256.16 / Max: 280.65Min: 104.02 / Avg: 236.43 / Max: 258.12Min: 33.52 / Avg: 227.41 / Max: 249.95Min: 53.88 / Avg: 210.59 / Max: 230.53Min: 29.71 / Avg: 198.61 / Max: 217.44Min: 21.43 / Avg: 160.48 / Max: 176.89Min: 43.46 / Avg: 155.26 / Max: 169.97Min: 43.71 / Avg: 132.85 / Max: 145.13Min: 17.92 / Avg: 105.97 / Max: 115.61Min: 16.17 / Avg: 95.68 / Max: 104.17

OpenBenchmarking.orgWatts, Fewer Is BetterONNX Runtime 1.17CPU Power Consumption MonitorEPYC 9684X 2PXeon Platinum 8380 2PEPYC 9654 2PEPYC 9754 2PEPYC 9684XXeon 6780E 2PXeon 6766E 2PXeon Platinum 8380EPYC 9654EPYC 9754Xeon 6780EXeon 6766EEPYC 8534PEPYC 8534PN90180270360450Min: 60.67 / Avg: 475.62 / Max: 514.58Min: 103.45 / Avg: 419.57 / Max: 461.32Min: 54.43 / Avg: 417.34 / Max: 450.65Min: 40.25 / Avg: 308.06 / Max: 331.38Min: 31.9 / Avg: 250.92 / Max: 275.39Min: 106.43 / Avg: 248.46 / Max: 271.28Min: 104.4 / Avg: 226.53 / Max: 245.57Min: 53.43 / Avg: 226.19 / Max: 247.32Min: 26.28 / Avg: 211.37 / Max: 231.46Min: 19.69 / Avg: 171.56 / Max: 188.27Min: 43.52 / Avg: 154.49 / Max: 168.64Min: 43.64 / Avg: 132.23 / Max: 144.22Min: 18.14 / Avg: 109.41 / Max: 118.96Min: 16.01 / Avg: 98.3 / Max: 106.86

OpenBenchmarking.orgWatts, Fewer Is BetterONNX Runtime 1.17CPU Power Consumption MonitorEPYC 9684X 2PEPYC 9654 2PXeon Platinum 8380 2PEPYC 9754 2PXeon 6780E 2PXeon 6766E 2PEPYC 9684XXeon Platinum 8380EPYC 9654EPYC 9754Xeon 6780EXeon 6766EEPYC 8534PEPYC 8534PN100200300400500Min: 66.9 / Avg: 542.3 / Max: 581.73Min: 57.19 / Avg: 475.21 / Max: 509.74Min: 98.39 / Avg: 431.89 / Max: 460.51Min: 39.85 / Avg: 399.31 / Max: 425.54Min: 108.06 / Avg: 346.02 / Max: 366.29Min: 104.72 / Avg: 302.14 / Max: 319.15Min: 35.49 / Avg: 275.71 / Max: 296Min: 53.65 / Avg: 232.18 / Max: 246.53Min: 25.06 / Avg: 230.17 / Max: 246.35Min: 19.98 / Avg: 184.69 / Max: 197.9Min: 43.54 / Avg: 166.24 / Max: 176.01Min: 43.72 / Avg: 141.66 / Max: 149.72Min: 16.81 / Avg: 122.1 / Max: 130.96Min: 17.47 / Avg: 111.54 / Max: 119.32

OpenBenchmarking.orgWatts, Fewer Is BetterONNX Runtime 1.17CPU Power Consumption MonitorEPYC 9684X 2PEPYC 9654 2PXeon Platinum 8380 2PEPYC 9754 2PXeon 6780E 2PXeon 6766E 2PEPYC 9684XXeon Platinum 8380EPYC 9654EPYC 9754Xeon 6780EXeon 6766EEPYC 8534PEPYC 8534PN100200300400500Min: 65.24 / Avg: 542.12 / Max: 580.41Min: 57.3 / Avg: 472.8 / Max: 505.93Min: 51.38 / Avg: 431.96 / Max: 458.85Min: 42.05 / Avg: 397.19 / Max: 423.71Min: 108.14 / Avg: 349.02 / Max: 367.93Min: 104.87 / Avg: 303.41 / Max: 320.11Min: 35.78 / Avg: 264.82 / Max: 285.07Min: 54.86 / Avg: 232.56 / Max: 248.24Min: 26 / Avg: 222.45 / Max: 240.99Min: 19.01 / Avg: 179.59 / Max: 191.94Min: 43.58 / Avg: 171.22 / Max: 182.02Min: 43.72 / Avg: 146.19 / Max: 154.64Min: 19.26 / Avg: 116.04 / Max: 124.74Min: 17.14 / Avg: 106.46 / Max: 113.35

OpenBenchmarking.orgWatts, Fewer Is BetterONNX Runtime 1.17CPU Power Consumption MonitorEPYC 9684X 2PEPYC 9654 2PXeon Platinum 8380 2PEPYC 9754 2PXeon 6780E 2PXeon 6766E 2PEPYC 9684XEPYC 9654Xeon Platinum 8380EPYC 9754Xeon 6780EXeon 6766EEPYC 8534PEPYC 8534PN100200300400500Min: 64.35 / Avg: 547.96 / Max: 588.36Min: 51.2 / Avg: 478.17 / Max: 512.01Min: 101.46 / Avg: 445.87 / Max: 473.79Min: 42.14 / Avg: 407.23 / Max: 436.3Min: 108.09 / Avg: 347.86 / Max: 369.84Min: 104.68 / Avg: 302.86 / Max: 321.76Min: 36.05 / Avg: 285.19 / Max: 306.51Min: 28.74 / Avg: 240.91 / Max: 259.49Min: 53.36 / Avg: 238.84 / Max: 254.78Min: 21.2 / Avg: 199.22 / Max: 213.69Min: 43.63 / Avg: 170.55 / Max: 180.89Min: 43.72 / Avg: 144.55 / Max: 152.6Min: 18.11 / Avg: 126.52 / Max: 135.68Min: 16.2 / Avg: 115 / Max: 124.26

OpenBenchmarking.orgWatts, Fewer Is BetterONNX Runtime 1.17CPU Power Consumption MonitorEPYC 9684X 2PEPYC 9654 2PXeon Platinum 8380 2PEPYC 9754 2PXeon 6780E 2PXeon 6766E 2PEPYC 9684XEPYC 9654Xeon Platinum 8380EPYC 9754Xeon 6780EXeon 6766EEPYC 8534PEPYC 8534PN100200300400500Min: 60.4 / Avg: 551.5 / Max: 590.7Min: 55.26 / Avg: 482.11 / Max: 517.72Min: 101.4 / Avg: 445.3 / Max: 473.57Min: 39.76 / Avg: 407.81 / Max: 436.29Min: 108.03 / Avg: 350.61 / Max: 370.78Min: 104.79 / Avg: 305.05 / Max: 321.54Min: 31.68 / Avg: 288.98 / Max: 309.48Min: 29.39 / Avg: 241.91 / Max: 260.94Min: 54.43 / Avg: 235.28 / Max: 251.36Min: 15.87 / Avg: 195.33 / Max: 210.52Min: 43.64 / Avg: 174.72 / Max: 185.33Min: 43.68 / Avg: 148.15 / Max: 156.57Min: 17.38 / Avg: 123.79 / Max: 132.65Min: 15.97 / Avg: 109.73 / Max: 119.37

OpenBenchmarking.orgWatts, Fewer Is BetterONNX Runtime 1.17CPU Power Consumption MonitorEPYC 9684X 2PEPYC 9654 2PXeon Platinum 8380 2PEPYC 9754 2PXeon 6780E 2PXeon 6766E 2PEPYC 9684XXeon Platinum 8380EPYC 9654EPYC 9754Xeon 6780EXeon 6766EEPYC 8534PEPYC 8534PN100200300400500Min: 62.47 / Avg: 550.79 / Max: 593.02Min: 55.89 / Avg: 483.5 / Max: 517.8Min: 102.55 / Avg: 456.44 / Max: 489.76Min: 35.54 / Avg: 404.89 / Max: 435.36Min: 107.98 / Avg: 351.03 / Max: 380.24Min: 104.82 / Avg: 306.33 / Max: 331.18Min: 34.21 / Avg: 290.09 / Max: 313.77Min: 51.87 / Avg: 247.61 / Max: 266.6Min: 30.05 / Avg: 245.24 / Max: 265.47Min: 21.46 / Avg: 198.94 / Max: 215.69Min: 43.59 / Avg: 175.34 / Max: 190.81Min: 43.73 / Avg: 146.66 / Max: 157.5Min: 19.18 / Avg: 133.31 / Max: 143.64Min: 16.96 / Avg: 119.46 / Max: 129.05

OpenBenchmarking.orgWatts, Fewer Is BetterONNX Runtime 1.17CPU Power Consumption MonitorEPYC 9684X 2PEPYC 9654 2PXeon Platinum 8380 2PEPYC 9754 2PXeon 6780E 2PXeon 6766E 2PEPYC 9684XEPYC 9654Xeon Platinum 8380EPYC 9754Xeon 6780EXeon 6766EEPYC 8534PEPYC 8534PN110220330440550Min: 58.32 / Avg: 553.19 / Max: 601.27Min: 56.82 / Avg: 486.07 / Max: 528.33Min: 99.93 / Avg: 462.76 / Max: 500.69Min: 37.61 / Avg: 403.98 / Max: 434.7Min: 107.32 / Avg: 350.27 / Max: 375.87Min: 103.92 / Avg: 301.78 / Max: 322.43Min: 34.41 / Avg: 294.42 / Max: 320.91Min: 25.68 / Avg: 250.64 / Max: 270.41Min: 53.12 / Avg: 250.25 / Max: 269.16Min: 20.36 / Avg: 200.16 / Max: 217.19Min: 43.54 / Avg: 183.75 / Max: 198.81Min: 43.72 / Avg: 151.02 / Max: 162.14Min: 17.21 / Avg: 132.4 / Max: 145.89Min: 16.31 / Avg: 120.57 / Max: 131.45

OpenBenchmarking.orgWatts, Fewer Is BetterONNX Runtime 1.17CPU Power Consumption MonitorXeon Platinum 8380 2PEPYC 9684X 2PEPYC 9654 2PEPYC 9754 2PXeon Platinum 8380Xeon 6780E 2PXeon 6766E 2PEPYC 9684XEPYC 9654EPYC 9754Xeon 6780EXeon 6766EEPYC 8534PEPYC 8534PN60120180240300Min: 97.1 / Avg: 306.05 / Max: 325.94Min: 61.69 / Avg: 290.82 / Max: 309Min: 57.53 / Avg: 262.4 / Max: 276.96Min: 40 / Avg: 213.81 / Max: 226.08Min: 53.03 / Avg: 204.41 / Max: 224.2Min: 94.92 / Avg: 183.21 / Max: 193.59Min: 103.68 / Avg: 180.17 / Max: 191.33Min: 35.03 / Avg: 153.85 / Max: 164.75Min: 27.22 / Avg: 134.62 / Max: 143.75Min: 19.44 / Avg: 102.38 / Max: 109.98Min: 43.53 / Avg: 101.74 / Max: 108.09Min: 43.73 / Avg: 95.8 / Max: 101.7Min: 16.21 / Avg: 79.24 / Max: 84.5Min: 15.83 / Avg: 75.69 / Max: 81.06

OpenBenchmarking.orgWatts, Fewer Is BetterONNX Runtime 1.17CPU Power Consumption MonitorXeon Platinum 8380 2PEPYC 9684X 2PEPYC 9654 2PEPYC 9754 2PXeon Platinum 8380Xeon 6780E 2PEPYC 9684XXeon 6766E 2PEPYC 9654EPYC 9754Xeon 6780EXeon 6766EEPYC 8534PEPYC 8534PN60120180240300Min: 97.22 / Avg: 292.43 / Max: 327.64Min: 65.9 / Avg: 291.34 / Max: 308.52Min: 55.76 / Avg: 257.41 / Max: 272.32Min: 39.34 / Avg: 208.62 / Max: 222.38Min: 52.71 / Avg: 203.23 / Max: 218.58Min: 105.25 / Avg: 166.09 / Max: 183.4Min: 34.75 / Avg: 149.45 / Max: 159.93Min: 103.86 / Avg: 148.82 / Max: 155.68Min: 27.83 / Avg: 127.32 / Max: 135.72Min: 20.73 / Avg: 94.62 / Max: 100.76Min: 43.54 / Avg: 90.3 / Max: 95.5Min: 43.72 / Avg: 86.91 / Max: 91.46Min: 16.03 / Avg: 72.08 / Max: 76.76Min: 15.72 / Avg: 69.12 / Max: 74.02

OpenBenchmarking.orgWatts, Fewer Is BetterONNX Runtime 1.17CPU Power Consumption MonitorEPYC 9684X 2PXeon Platinum 8380 2PEPYC 9654 2PXeon 6780E 2PEPYC 9754 2PXeon 6766E 2PEPYC 9684XXeon Platinum 8380EPYC 9654EPYC 9754Xeon 6780EXeon 6766EEPYC 8534PEPYC 8534PN90180270360450Min: 68.13 / Avg: 462.27 / Max: 495Min: 103.61 / Avg: 436.17 / Max: 466.43Min: 58.35 / Avg: 411.86 / Max: 441.41Min: 105.38 / Avg: 317.3 / Max: 341.18Min: 40.61 / Avg: 307.67 / Max: 327.17Min: 104.24 / Avg: 292.81 / Max: 313.39Min: 33.93 / Avg: 264.24 / Max: 286.38Min: 53.86 / Avg: 240.25 / Max: 259.56Min: 30.08 / Avg: 223.68 / Max: 241.02Min: 20.48 / Avg: 190.15 / Max: 204.22Min: 43.61 / Avg: 168.62 / Max: 180.75Min: 43.69 / Avg: 144.23 / Max: 154.04Min: 18.28 / Avg: 121.13 / Max: 131.61Min: 16.6 / Avg: 99.26 / Max: 116.55

OpenBenchmarking.orgWatts, Fewer Is BetterONNX Runtime 1.17CPU Power Consumption MonitorEPYC 9684X 2PXeon Platinum 8380 2PEPYC 9654 2PEPYC 9754 2PEPYC 9684XXeon Platinum 8380Xeon 6780E 2PEPYC 9654Xeon 6766E 2PEPYC 9754Xeon 6780EXeon 6766EEPYC 8534PEPYC 8534PN90180270360450Min: 63.67 / Avg: 460.32 / Max: 497.92Min: 95.98 / Avg: 424.24 / Max: 455.9Min: 56.36 / Avg: 405.91 / Max: 434.32Min: 38.39 / Avg: 302.95 / Max: 323.86Min: 33.42 / Avg: 261.74 / Max: 283.2Min: 51.89 / Avg: 246.13 / Max: 266.29Min: 106.24 / Avg: 233.19 / Max: 250.31Min: 29.64 / Avg: 222.91 / Max: 240.57Min: 104.06 / Avg: 210.79 / Max: 227.9Min: 20.33 / Avg: 188.2 / Max: 202.92Min: 43.51 / Avg: 163.29 / Max: 175Min: 43.62 / Avg: 139.52 / Max: 148.88Min: 16.8 / Avg: 119.38 / Max: 129.78Min: 16.97 / Avg: 101.89 / Max: 112.56

OpenBenchmarking.orgWatts, Fewer Is BetterONNX Runtime 1.17CPU Power Consumption MonitorXeon Platinum 8380 2PEPYC 9684X 2PEPYC 9654 2PXeon Platinum 8380EPYC 9754 2PEPYC 9684XXeon 6780E 2PXeon 6766E 2PEPYC 9654EPYC 9754Xeon 6780EEPYC 8534PEPYC 8534PNXeon 6766E60120180240300Min: 102.14 / Avg: 339.94 / Max: 362.78Min: 64.69 / Avg: 300.88 / Max: 323.81Min: 58.04 / Avg: 272.09 / Max: 288.97Min: 50.48 / Avg: 227.45 / Max: 243.02Min: 40.67 / Avg: 218.35 / Max: 232.79Min: 34.49 / Avg: 165.58 / Max: 176.42Min: 84.94 / Avg: 161.97 / Max: 179.97Min: 103.7 / Avg: 151.35 / Max: 165.49Min: 29.43 / Avg: 145.22 / Max: 154.34Min: 20.2 / Avg: 107.51 / Max: 113.85Min: 43.53 / Avg: 86.18 / Max: 89.75Min: 17.58 / Avg: 85.08 / Max: 90.86Min: 16.21 / Avg: 80.29 / Max: 85.38Min: 43.65 / Avg: 75.71 / Max: 78.31

OpenBenchmarking.orgWatts, Fewer Is BetterONNX Runtime 1.17CPU Power Consumption MonitorXeon Platinum 8380 2PEPYC 9684X 2PEPYC 9654 2PXeon Platinum 8380EPYC 9754 2PEPYC 9684XEPYC 9654Xeon 6780E 2PXeon 6766E 2PEPYC 9754EPYC 8534PEPYC 8534PNXeon 6780EXeon 6766E60120180240300Min: 98.64 / Avg: 328.39 / Max: 359.38Min: 62.01 / Avg: 306.76 / Max: 325.52Min: 57.88 / Avg: 270.43 / Max: 286.65Min: 51.72 / Avg: 236.59 / Max: 257.65Min: 40.2 / Avg: 219.21 / Max: 234.95Min: 28.38 / Avg: 160.26 / Max: 175.87Min: 27.15 / Avg: 144.22 / Max: 153.32Min: 104.68 / Avg: 138.22 / Max: 146.78Min: 103.86 / Avg: 127.8 / Max: 131.15Min: 21.68 / Avg: 106.78 / Max: 113.35Min: 18.73 / Avg: 83.53 / Max: 88.8Min: 16.93 / Avg: 76.89 / Max: 81.74Min: 43.48 / Avg: 72.93 / Max: 75.76Min: 33.7 / Avg: 65.57 / Max: 67.97

OpenBenchmarking.orgWatts, Fewer Is BetterONNX Runtime 1.17CPU Power Consumption MonitorEPYC 9684X 2PEPYC 9654 2PXeon Platinum 8380 2PEPYC 9754 2PXeon 6780E 2PXeon 6766E 2PEPYC 9684XXeon Platinum 8380EPYC 9654EPYC 9754Xeon 6780EXeon 6766EEPYC 8534PEPYC 8534PN100200300400500Min: 66.22 / Avg: 538.69 / Max: 582.15Min: 57.08 / Avg: 475.82 / Max: 514.33Min: 99.33 / Avg: 452.18 / Max: 484Min: 40.33 / Avg: 426.23 / Max: 461.75Min: 109.34 / Avg: 411.87 / Max: 447.93Min: 107.09 / Avg: 366.41 / Max: 399.46Min: 33.01 / Avg: 268.04 / Max: 290.06Min: 53.76 / Avg: 239.05 / Max: 256.78Min: 26.58 / Avg: 226.63 / Max: 248.05Min: 22.2 / Avg: 210.78 / Max: 229.48Min: 43.63 / Avg: 190.5 / Max: 207.06Min: 43.69 / Avg: 159.26 / Max: 172.23Min: 19.36 / Avg: 129.39 / Max: 140.24Min: 15.82 / Avg: 105.18 / Max: 117.88

OpenBenchmarking.orgWatts, Fewer Is BetterONNX Runtime 1.17CPU Power Consumption MonitorEPYC 9684X 2PEPYC 9654 2PXeon Platinum 8380 2PXeon 6780E 2PEPYC 9754 2PXeon 6766E 2PEPYC 9684XEPYC 9654Xeon Platinum 8380Xeon 6780EEPYC 9754Xeon 6766EEPYC 8534PEPYC 8534PN120240360480600Min: 64.5 / Avg: 611.91 / Max: 674.71Min: 60.03 / Avg: 522.44 / Max: 571.64Min: 100.08 / Avg: 498.61 / Max: 537.57Min: 108.32 / Avg: 473.62 / Max: 514.95Min: 41.83 / Avg: 453.96 / Max: 496.3Min: 105.71 / Avg: 414.92 / Max: 451.7Min: 33.76 / Avg: 321.88 / Max: 360.42Min: 27.94 / Avg: 273.66 / Max: 300.92Min: 53.6 / Avg: 252.85 / Max: 280.59Min: 43.58 / Avg: 243.68 / Max: 263.63Min: 21.08 / Avg: 240.98 / Max: 267.52Min: 43.7 / Avg: 200.72 / Max: 216.16Min: 19.31 / Avg: 140.51 / Max: 154.48Min: 17.45 / Avg: 121.04 / Max: 134.63

OpenBenchmarking.orgWatts, Fewer Is BetterONNX Runtime 1.17CPU Power Consumption MonitorEPYC 9684X 2PEPYC 9654 2PXeon Platinum 8380 2PEPYC 9754 2PXeon 6780E 2PXeon 6766E 2PEPYC 9684XXeon Platinum 8380EPYC 9654EPYC 9754Xeon 6780EXeon 6766EEPYC 8534PEPYC 8534PN110220330440550Min: 67.07 / Avg: 552.04 / Max: 595.99Min: 59.75 / Avg: 482.18 / Max: 521.5Min: 103.81 / Avg: 450.11 / Max: 482.7Min: 39.89 / Avg: 406.34 / Max: 438.62Min: 108.42 / Avg: 392.56 / Max: 431.32Min: 104.75 / Avg: 350.62 / Max: 384.9Min: 33.83 / Avg: 279.27 / Max: 303.77Min: 53.1 / Avg: 243.23 / Max: 261.05Min: 29.58 / Avg: 236.8 / Max: 255.65Min: 21.66 / Avg: 192.93 / Max: 209.55Min: 43.53 / Avg: 179.64 / Max: 193.29Min: 43.74 / Avg: 152.65 / Max: 163.54Min: 19.76 / Avg: 124.93 / Max: 135Min: 18.05 / Avg: 113.49 / Max: 122.89

OpenBenchmarking.orgWatts, Fewer Is BetterONNX Runtime 1.17CPU Power Consumption MonitorEPYC 9684X 2PEPYC 9654 2PXeon Platinum 8380 2PEPYC 9754 2PXeon 6780E 2PXeon 6766E 2PEPYC 9684XXeon Platinum 8380EPYC 9654Xeon 6780EEPYC 9754Xeon 6766EEPYC 8534PEPYC 8534PN110220330440550Min: 67.43 / Avg: 546.46 / Max: 595.03Min: 60.04 / Avg: 479.74 / Max: 516.86Min: 98.37 / Avg: 446.63 / Max: 480.06Min: 40.24 / Avg: 404.21 / Max: 436.31Min: 105.31 / Avg: 380 / Max: 411.37Min: 103.87 / Avg: 332.75 / Max: 361.02Min: 34.28 / Avg: 276.26 / Max: 300.81Min: 48.27 / Avg: 242.83 / Max: 266.43Min: 25.1 / Avg: 234.83 / Max: 253.99Min: 43.43 / Avg: 192.41 / Max: 207.48Min: 20.25 / Avg: 189.72 / Max: 207.12Min: 43.64 / Avg: 163.17 / Max: 174.94Min: 18.9 / Avg: 123.51 / Max: 135.75Min: 16.87 / Avg: 112.11 / Max: 123.24

CPU Power Consumption Monitor

OpenBenchmarking.orgWattsCPU Power Consumption MonitorPhoronix Test Suite System MonitoringXeon Max 9480 2PXeon Max 9468 2PEPYC 9684X 2PXeon Platinum 8490H 2PEPYC 9654 2PXeon Platinum 8592+ 2PXeon Platinum 8380 2PEPYC 9754 2PXeon 6780E 2PXeon Max 9480Xeon Max 9468Xeon 6766E 2PEPYC 9684XXeon Platinum 8490HXeon Platinum 8592+EPYC 9654Xeon Platinum 8380EPYC 9754Xeon 6780EXeon 6766EEPYC 8534PEPYC 8534PN170340510680850Min: 95.52 / Avg: 569.8 / Max: 760.61Min: 102.49 / Avg: 566.6 / Max: 756.48Min: 33.66 / Avg: 525.49 / Max: 837.69Min: 87.48 / Avg: 517.33 / Max: 758.17Min: 35.7 / Avg: 464.49 / Max: 751.79Min: 39.72 / Avg: 455.07 / Max: 946.96Min: 51.38 / Avg: 437.37 / Max: 583.47Min: 20.22 / Avg: 375.51 / Max: 735.74Min: 53.44 / Avg: 321.01 / Max: 713.33Min: 38.16 / Avg: 295.53 / Max: 384.53Min: 38.11 / Avg: 291.53 / Max: 379.76Min: 52.85 / Avg: 291.05 / Max: 542.48Min: 17.06 / Avg: 290.08 / Max: 413.51Min: 30.38 / Avg: 278.1 / Max: 383.24Min: 17.77 / Avg: 260.08 / Max: 405.42Min: 14.69 / Avg: 244.69 / Max: 373.1Min: 26.31 / Avg: 237.91 / Max: 292.14Min: 10.09 / Avg: 225.05 / Max: 397.44Min: 21.7 / Avg: 169.1 / Max: 357.69Min: 21.86 / Avg: 142.1 / Max: 271.22Min: 8.43 / Avg: 128.7 / Max: 184.62Min: 9.26 / Avg: 114.13 / Max: 155.71

Stockfish

OpenBenchmarking.orgWatts, Fewer Is BetterStockfish 16.1CPU Power Consumption MonitorEPYC 9684X 2PEPYC 9654 2PXeon Max 9480 2PXeon Max 9468 2PXeon Platinum 8490H 2PXeon Platinum 8592+ 2PEPYC 9754 2PXeon 6780E 2PXeon Platinum 8380 2PXeon 6766E 2PEPYC 9684XEPYC 9654Xeon Max 9468Xeon Max 9480Xeon Platinum 8490HXeon Platinum 8592+EPYC 9754Xeon 6780EXeon Platinum 8380Xeon 6766EEPYC 8534PEPYC 8534PN140280420560700Min: 70.77 / Avg: 766.5 / Max: 822.06Min: 57.4 / Avg: 686.5 / Max: 751.79Min: 195.85 / Avg: 680.45 / Max: 758.53Min: 203.83 / Avg: 679.75 / Max: 756.48Min: 166.29 / Avg: 678.39 / Max: 758.17Min: 78.55 / Avg: 672.28 / Max: 755.5Min: 37.25 / Avg: 640.56 / Max: 735.74Min: 109.43 / Avg: 618.97 / Max: 701.47Min: 100.78 / Avg: 519.4 / Max: 581.59Min: 105.79 / Avg: 474.56 / Max: 541.15Min: 35.5 / Avg: 386.38 / Max: 410.66Min: 30.05 / Avg: 347.3 / Max: 373.1Min: 71.31 / Avg: 341.39 / Max: 379.06Min: 74.29 / Avg: 341.12 / Max: 366.15Min: 56.83 / Avg: 339.56 / Max: 379.91Min: 22.35 / Avg: 337.72 / Max: 370.84Min: 21.51 / Avg: 332.06 / Max: 363.69Min: 43.61 / Avg: 310.08 / Max: 337.09Min: 53.05 / Avg: 263.42 / Max: 290.77Min: 43.78 / Avg: 240.94 / Max: 270.17Min: 17.26 / Avg: 174.36 / Max: 184.62Min: 16.19 / Avg: 145.98 / Max: 155.71

OpenBenchmarking.orgNodes Per Second Per Watt, More Is BetterStockfish 16.1Chess BenchmarkXeon Platinum 8380Xeon Max 9468Xeon Platinum 8380 2PXeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PXeon Platinum 8490H 2PXeon Platinum 8490HXeon Platinum 8592+Xeon Platinum 8592+ 2PXeon 6780EXeon 6780E 2PEPYC 9754 2PXeon 6766E 2PXeon 6766EEPYC 9684X 2PEPYC 9654 2PEPYC 9684XEPYC 8534PEPYC 9654EPYC 9754EPYC 8534PN130K260K390K520K650K193986.52199243.06201379.09202981.45215737.78219573.26276776.39285328.34325017.74331127.60403742.35431231.39470216.10496138.40509643.71520707.98540060.41555213.84568916.36569277.48571475.98621037.11

OpenBenchmarking.orgNodes Per Second, More Is BetterStockfish 16.1Chess BenchmarkXeon Platinum 8380Xeon Max 9468Xeon Max 9480EPYC 8534PNXeon Platinum 8490HEPYC 8534PXeon Platinum 8380 2PXeon Platinum 8592+Xeon 6766EXeon 6780EXeon Max 9468 2PXeon Max 9480 2PXeon Platinum 8490H 2PEPYC 9754EPYC 9654EPYC 9684XXeon Platinum 8592+ 2PXeon 6766E 2PXeon 6780E 2PEPYC 9754 2PEPYC 9654 2PEPYC 9684X 2P90M180M270M360M450MSE +/- 1466028.98, N = 9SE +/- 1751369.24, N = 12SE +/- 629927.17, N = 3SE +/- 2147688.02, N = 12SE +/- 1304590.97, N = 3SE +/- 2397455.91, N = 12SE +/- 1325249.25, N = 3SE +/- 2966712.90, N = 9SE +/- 3565305.92, N = 15SE +/- 1441726.26, N = 3SE +/- 4344961.90, N = 10SE +/- 2925715.37, N = 11SE +/- 2148606.38, N = 4SE +/- 4652276.19, N = 12SE +/- 3170744.86, N = 15SE +/- 2268830.04, N = 3SE +/- 2482737.87, N = 3SE +/- 2692064.58, N = 4SE +/- 3095674.84, N = 3SE +/- 7961094.38, N = 12SE +/- 2356843.91, N = 3SE +/- 919073.22, N = 35109954568019088735922309065815696887479991981441045972001097663451227942461251940661379772031494090821877617691897637991977083502145246592226103782354454992669198253012022323707515303991242231. (CXX) g++ options: -lgcov -m64 -lpthread -fno-exceptions -std=c++17 -fno-peel-loops -fno-tracer -pedantic -O3 -funroll-loops -msse -msse3 -mpopcnt -mavx2 -mbmi -msse4.1 -mssse3 -msse2 -mbmi2 -flto -flto-partition=one -flto=jobserver
OpenBenchmarking.orgNodes Per Second, More Is BetterStockfish 16.1Chess BenchmarkXeon Platinum 8380Xeon Max 9468Xeon Max 9480EPYC 8534PNXeon Platinum 8490HEPYC 8534PXeon Platinum 8380 2PXeon Platinum 8592+Xeon 6766EXeon 6780EXeon Max 9468 2PXeon Max 9480 2PXeon Platinum 8490H 2PEPYC 9754EPYC 9654EPYC 9684XXeon Platinum 8592+ 2PXeon 6766E 2PXeon 6780E 2PEPYC 9754 2PEPYC 9654 2PEPYC 9684X 2P70M140M210M280M350MMin: 46187735 / Avg: 51099544.56 / Max: 58411093Min: 59888483 / Avg: 68019087.75 / Max: 77730908Min: 72332406 / Avg: 73592230 / Max: 74229713Min: 77008870 / Avg: 90658155.75 / Max: 105582612Min: 94884961 / Avg: 96887479.33 / Max: 99337294Min: 88934946 / Avg: 99198144.33 / Max: 112868492Min: 102582821 / Avg: 104597199.67 / Max: 107096222Min: 95815903 / Avg: 109766344.67 / Max: 124123359Min: 102829819 / Avg: 122794245.67 / Max: 146810701Min: 122670700 / Avg: 125194065.67 / Max: 127664133Min: 114663193 / Avg: 137977202.6 / Max: 157872926Min: 129404582 / Avg: 149409082.45 / Max: 160455993Min: 182910465 / Avg: 187761768.75 / Max: 192568158Min: 169071949 / Avg: 189763799 / Max: 234765459Min: 173574520 / Avg: 197708349.67 / Max: 214024385Min: 210554411 / Avg: 214524658.67 / Max: 218412575Min: 218003860 / Avg: 222610378 / Max: 226518927Min: 227736920 / Avg: 235445498.75 / Max: 240278676Min: 261253648 / Avg: 266919824.67 / Max: 271914033Min: 249790326 / Avg: 301202231.83 / Max: 347346604Min: 367819084 / Avg: 370751530 / Max: 375413799Min: 397383832 / Avg: 399124223.33 / Max: 4005066351. (CXX) g++ options: -lgcov -m64 -lpthread -fno-exceptions -std=c++17 -fno-peel-loops -fno-tracer -pedantic -O3 -funroll-loops -msse -msse3 -mpopcnt -mavx2 -mbmi -msse4.1 -mssse3 -msse2 -mbmi2 -flto -flto-partition=one -flto=jobserver

ONNX Runtime

ONNX Runtime is developed by Microsoft and partners as a open-source, cross-platform, high performance machine learning inferencing and training accelerator. This test profile runs the ONNX Runtime with various models available from the ONNX Model Zoo. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgInference Time Cost (ms), Fewer Is BetterONNX Runtime 1.17Model: Faster R-CNN R-50-FPN-int8 - Device: CPU - Executor: StandardXeon 6766E 2PXeon 6780E 2PXeon 6766EXeon 6780EXeon Max 9468 2PXeon Max 9480 2PXeon Max 9480Xeon Max 9468Xeon Platinum 8380 2PXeon Platinum 8490H 2PXeon Platinum 8490HXeon Platinum 8592+Xeon Platinum 8592+ 2PXeon Platinum 8380EPYC 8534PEPYC 9754 2PEPYC 8534PNEPYC 9754EPYC 9654 2PEPYC 9654EPYC 9684X 2PEPYC 9684X1122334455SE +/- 0.36, N = 11SE +/- 0.35, N = 3SE +/- 0.08, N = 3SE +/- 0.06, N = 3SE +/- 0.40, N = 3SE +/- 0.33, N = 3SE +/- 0.31, N = 3SE +/- 0.11, N = 3SE +/- 0.35, N = 3SE +/- 0.12, N = 3SE +/- 0.04, N = 3SE +/- 0.09, N = 3SE +/- 0.09, N = 3SE +/- 0.01, N = 3SE +/- 0.63, N = 15SE +/- 0.23, N = 15SE +/- 0.61, N = 15SE +/- 0.45, N = 15SE +/- 0.61, N = 15SE +/- 0.50, N = 15SE +/- 0.40, N = 15SE +/- 0.61, N = 1547.2043.8141.0836.7836.2336.0033.9933.3329.7629.7529.4129.0228.8528.0227.9327.9026.8326.4525.3223.9222.7921.581. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt
OpenBenchmarking.orgInference Time Cost (ms), Fewer Is BetterONNX Runtime 1.17Model: Faster R-CNN R-50-FPN-int8 - Device: CPU - Executor: StandardXeon 6766E 2PXeon 6780E 2PXeon 6766EXeon 6780EXeon Max 9468 2PXeon Max 9480 2PXeon Max 9480Xeon Max 9468Xeon Platinum 8380 2PXeon Platinum 8490H 2PXeon Platinum 8490HXeon Platinum 8592+Xeon Platinum 8592+ 2PXeon Platinum 8380EPYC 8534PEPYC 9754 2PEPYC 8534PNEPYC 9754EPYC 9654 2PEPYC 9654EPYC 9684X 2PEPYC 9684X1020304050Min: 45.75 / Avg: 47.2 / Max: 49.83Min: 43.32 / Avg: 43.81 / Max: 44.48Min: 40.94 / Avg: 41.08 / Max: 41.22Min: 36.66 / Avg: 36.78 / Max: 36.86Min: 35.77 / Avg: 36.23 / Max: 37.04Min: 35.37 / Avg: 36 / Max: 36.49Min: 33.37 / Avg: 33.99 / Max: 34.35Min: 33.13 / Avg: 33.33 / Max: 33.49Min: 29.08 / Avg: 29.76 / Max: 30.24Min: 29.52 / Avg: 29.75 / Max: 29.9Min: 29.33 / Avg: 29.41 / Max: 29.45Min: 28.87 / Avg: 29.02 / Max: 29.17Min: 28.67 / Avg: 28.85 / Max: 28.95Min: 28.01 / Avg: 28.02 / Max: 28.03Min: 24.1 / Avg: 27.93 / Max: 29.83Min: 26.96 / Avg: 27.9 / Max: 30.68Min: 24.43 / Avg: 26.83 / Max: 30.1Min: 24.64 / Avg: 26.45 / Max: 29.86Min: 23.13 / Avg: 25.32 / Max: 28.47Min: 20.98 / Avg: 23.92 / Max: 25.93Min: 20.9 / Avg: 22.79 / Max: 24.76Min: 18.79 / Avg: 21.58 / Max: 23.881. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.17Model: Faster R-CNN R-50-FPN-int8 - Device: CPU - Executor: StandardXeon 6766E 2PXeon 6780E 2PXeon 6766EXeon 6780EXeon Max 9468 2PXeon Max 9480 2PXeon Max 9480Xeon Max 9468Xeon Platinum 8380 2PXeon Platinum 8490H 2PXeon Platinum 8490HXeon Platinum 8592+Xeon Platinum 8592+ 2PXeon Platinum 8380EPYC 9754 2PEPYC 8534PEPYC 8534PNEPYC 9754EPYC 9654 2PEPYC 9654EPYC 9684X 2PEPYC 9684X1122334455SE +/- 0.16, N = 11SE +/- 0.18, N = 3SE +/- 0.05, N = 3SE +/- 0.05, N = 3SE +/- 0.31, N = 3SE +/- 0.26, N = 3SE +/- 0.27, N = 3SE +/- 0.09, N = 3SE +/- 0.40, N = 3SE +/- 0.13, N = 3SE +/- 0.05, N = 3SE +/- 0.10, N = 3SE +/- 0.11, N = 3SE +/- 0.01, N = 3SE +/- 0.27, N = 15SE +/- 0.87, N = 15SE +/- 0.82, N = 15SE +/- 0.63, N = 15SE +/- 0.92, N = 15SE +/- 0.91, N = 15SE +/- 0.76, N = 15SE +/- 1.36, N = 1521.2022.8324.3427.1827.6127.7829.4330.0033.6033.6134.0034.4634.6635.6935.8736.0837.5337.9639.8042.0744.0646.881. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt
OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.17Model: Faster R-CNN R-50-FPN-int8 - Device: CPU - Executor: StandardXeon 6766E 2PXeon 6780E 2PXeon 6766EXeon 6780EXeon Max 9468 2PXeon Max 9480 2PXeon Max 9480Xeon Max 9468Xeon Platinum 8380 2PXeon Platinum 8490H 2PXeon Platinum 8490HXeon Platinum 8592+Xeon Platinum 8592+ 2PXeon Platinum 8380EPYC 9754 2PEPYC 8534PEPYC 8534PNEPYC 9754EPYC 9654 2PEPYC 9654EPYC 9684X 2PEPYC 9684X1020304050Min: 20.07 / Avg: 21.2 / Max: 21.86Min: 22.48 / Avg: 22.83 / Max: 23.08Min: 24.26 / Avg: 24.34 / Max: 24.42Min: 27.13 / Avg: 27.18 / Max: 27.28Min: 27 / Avg: 27.61 / Max: 27.95Min: 27.4 / Avg: 27.78 / Max: 28.27Min: 29.11 / Avg: 29.42 / Max: 29.97Min: 29.86 / Avg: 30 / Max: 30.18Min: 33.06 / Avg: 33.6 / Max: 34.38Min: 33.44 / Avg: 33.61 / Max: 33.87Min: 33.95 / Avg: 34 / Max: 34.09Min: 34.28 / Avg: 34.46 / Max: 34.63Min: 34.55 / Avg: 34.66 / Max: 34.88Min: 35.67 / Avg: 35.69 / Max: 35.7Min: 32.59 / Avg: 35.87 / Max: 37.09Min: 33.51 / Avg: 36.08 / Max: 41.49Min: 33.22 / Avg: 37.53 / Max: 40.92Min: 33.49 / Avg: 37.96 / Max: 40.59Min: 35.13 / Avg: 39.8 / Max: 43.23Min: 38.57 / Avg: 42.07 / Max: 47.67Min: 40.38 / Avg: 44.06 / Max: 47.85Min: 41.88 / Avg: 46.88 / Max: 53.221. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

OpenBenchmarking.orgInference Time Cost (ms), Fewer Is BetterONNX Runtime 1.17Model: bertsquad-12 - Device: CPU - Executor: StandardXeon 6766E 2PXeon 6780E 2PXeon 6766EXeon 6780EEPYC 9654 2PEPYC 9754 2PEPYC 9684X 2PEPYC 9754EPYC 8534PNEPYC 8534PEPYC 9654EPYC 9684XXeon Platinum 8490H 2PXeon Max 9468 2PXeon Max 9480 2PXeon Platinum 8380 2PXeon Max 9480Xeon Platinum 8490HXeon Platinum 8380Xeon Max 9468Xeon Platinum 8592+ 2PXeon Platinum 8592+306090120150SE +/- 6.85, N = 15SE +/- 6.88, N = 15SE +/- 0.05, N = 3SE +/- 0.06, N = 3SE +/- 0.90, N = 6SE +/- 2.33, N = 12SE +/- 2.80, N = 15SE +/- 0.70, N = 15SE +/- 1.26, N = 3SE +/- 0.51, N = 3SE +/- 0.17, N = 3SE +/- 0.18, N = 3SE +/- 0.62, N = 3SE +/- 0.68, N = 3SE +/- 1.12, N = 15SE +/- 0.29, N = 3SE +/- 0.23, N = 3SE +/- 0.17, N = 3SE +/- 1.84, N = 12SE +/- 0.44, N = 3SE +/- 0.44, N = 3SE +/- 0.04, N = 3155.90141.57124.06111.8793.8393.6490.0687.6686.6580.7272.1271.5660.3660.1155.9054.2849.9749.6448.4747.2444.6039.751. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt
OpenBenchmarking.orgInference Time Cost (ms), Fewer Is BetterONNX Runtime 1.17Model: bertsquad-12 - Device: CPU - Executor: StandardXeon 6766E 2PXeon 6780E 2PXeon 6766EXeon 6780EEPYC 9654 2PEPYC 9754 2PEPYC 9684X 2PEPYC 9754EPYC 8534PNEPYC 8534PEPYC 9654EPYC 9684XXeon Platinum 8490H 2PXeon Max 9468 2PXeon Max 9480 2PXeon Platinum 8380 2PXeon Max 9480Xeon Platinum 8490HXeon Platinum 8380Xeon Max 9468Xeon Platinum 8592+ 2PXeon Platinum 8592+306090120150Min: 124.11 / Avg: 155.9 / Max: 182.87Min: 112.05 / Avg: 141.57 / Max: 166.76Min: 123.98 / Avg: 124.06 / Max: 124.16Min: 111.79 / Avg: 111.87 / Max: 112Min: 91.93 / Avg: 93.83 / Max: 97.84Min: 83.32 / Avg: 93.64 / Max: 103.73Min: 72.63 / Avg: 90.06 / Max: 98.58Min: 83.4 / Avg: 87.66 / Max: 90.28Min: 84.77 / Avg: 86.65 / Max: 89.04Min: 80.14 / Avg: 80.72 / Max: 81.75Min: 71.8 / Avg: 72.12 / Max: 72.4Min: 71.24 / Avg: 71.56 / Max: 71.87Min: 59.65 / Avg: 60.36 / Max: 61.59Min: 59.24 / Avg: 60.11 / Max: 61.46Min: 51.18 / Avg: 55.9 / Max: 62.25Min: 53.71 / Avg: 54.28 / Max: 54.66Min: 49.68 / Avg: 49.97 / Max: 50.43Min: 49.44 / Avg: 49.64 / Max: 49.98Min: 46.12 / Avg: 48.47 / Max: 68.61Min: 46.39 / Avg: 47.24 / Max: 47.85Min: 43.99 / Avg: 44.6 / Max: 45.45Min: 39.7 / Avg: 39.75 / Max: 39.821. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.17Model: bertsquad-12 - Device: CPU - Executor: StandardXeon 6766E 2PXeon 6780E 2PXeon 6766EXeon 6780EEPYC 9654 2PEPYC 9754 2PEPYC 9684X 2PEPYC 9754EPYC 8534PNEPYC 8534PEPYC 9654EPYC 9684XXeon Platinum 8490H 2PXeon Max 9468 2PXeon Max 9480 2PXeon Platinum 8380 2PXeon Max 9480Xeon Platinum 8490HXeon Platinum 8380Xeon Max 9468Xeon Platinum 8592+ 2PXeon Platinum 8592+612182430SE +/- 0.31004, N = 15SE +/- 0.36771, N = 15SE +/- 0.00331, N = 3SE +/- 0.00509, N = 3SE +/- 0.10002, N = 6SE +/- 0.26635, N = 12SE +/- 0.38561, N = 15SE +/- 0.09294, N = 15SE +/- 0.16639, N = 3SE +/- 0.07825, N = 3SE +/- 0.03352, N = 3SE +/- 0.03564, N = 3SE +/- 0.16743, N = 3SE +/- 0.18711, N = 3SE +/- 0.35497, N = 15SE +/- 0.09869, N = 3SE +/- 0.09194, N = 3SE +/- 0.07031, N = 3SE +/- 0.58074, N = 12SE +/- 0.19764, N = 3SE +/- 0.21982, N = 3SE +/- 0.02370, N = 36.604717.312858.060138.9383310.6615010.7518811.2707011.4182011.5447012.3884013.8647013.9745016.5705016.6394017.9873018.4222020.0103020.1453020.8723021.1702022.4251025.159101. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt
OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.17Model: bertsquad-12 - Device: CPU - Executor: StandardXeon 6766E 2PXeon 6780E 2PXeon 6766EXeon 6780EEPYC 9654 2PEPYC 9754 2PEPYC 9684X 2PEPYC 9754EPYC 8534PNEPYC 8534PEPYC 9654EPYC 9684XXeon Platinum 8490H 2PXeon Max 9468 2PXeon Max 9480 2PXeon Platinum 8380 2PXeon Max 9480Xeon Platinum 8490HXeon Platinum 8380Xeon Max 9468Xeon Platinum 8592+ 2PXeon Platinum 8592+612182430Min: 5.47 / Avg: 6.6 / Max: 8.06Min: 6 / Avg: 7.31 / Max: 8.92Min: 8.05 / Avg: 8.06 / Max: 8.07Min: 8.93 / Avg: 8.94 / Max: 8.95Min: 10.22 / Avg: 10.66 / Max: 10.88Min: 9.64 / Avg: 10.75 / Max: 12Min: 10.14 / Avg: 11.27 / Max: 13.77Min: 11.08 / Avg: 11.42 / Max: 11.99Min: 11.23 / Avg: 11.54 / Max: 11.8Min: 12.23 / Avg: 12.39 / Max: 12.48Min: 13.81 / Avg: 13.86 / Max: 13.93Min: 13.91 / Avg: 13.97 / Max: 14.04Min: 16.24 / Avg: 16.57 / Max: 16.76Min: 16.27 / Avg: 16.64 / Max: 16.88Min: 16.06 / Avg: 17.99 / Max: 19.54Min: 18.3 / Avg: 18.42 / Max: 18.62Min: 19.83 / Avg: 20.01 / Max: 20.13Min: 20.01 / Avg: 20.15 / Max: 20.23Min: 14.57 / Avg: 20.87 / Max: 21.68Min: 20.9 / Avg: 21.17 / Max: 21.55Min: 22 / Avg: 22.43 / Max: 22.73Min: 25.11 / Avg: 25.16 / Max: 25.191. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

OpenBenchmarking.orgInference Time Cost (ms), Fewer Is BetterONNX Runtime 1.17Model: fcn-resnet101-11 - Device: CPU - Executor: StandardEPYC 8534PNEPYC 9654 2PEPYC 8534PEPYC 9754 2PXeon 6766E 2PXeon 6766EXeon 6780E 2PEPYC 9684X 2PEPYC 9654EPYC 9684XXeon 6780EEPYC 9754Xeon Platinum 8380Xeon Max 9480Xeon Max 9468Xeon Max 9480 2PXeon Max 9468 2PXeon Platinum 8490HXeon Platinum 8380 2PXeon Platinum 8592+Xeon Platinum 8592+ 2PXeon Platinum 8490H 2P50100150200250SE +/- 7.19, N = 15SE +/- 0.35, N = 3SE +/- 6.87, N = 12SE +/- 2.91, N = 3SE +/- 0.06, N = 3SE +/- 0.09, N = 3SE +/- 0.13, N = 3SE +/- 2.18, N = 15SE +/- 4.84, N = 15SE +/- 4.76, N = 12SE +/- 0.21, N = 3SE +/- 2.29, N = 15SE +/- 2.32, N = 15SE +/- 6.41, N = 15SE +/- 3.36, N = 15SE +/- 2.59, N = 15SE +/- 5.82, N = 12SE +/- 0.09, N = 3SE +/- 1.55, N = 15SE +/- 0.71, N = 3SE +/- 0.44, N = 3SE +/- 0.69, N = 15226.63220.35216.70203.57194.11188.30182.36182.27182.02178.03174.14166.79160.53155.79139.10121.78121.67116.32110.97109.67100.7492.351. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt
OpenBenchmarking.orgInference Time Cost (ms), Fewer Is BetterONNX Runtime 1.17Model: fcn-resnet101-11 - Device: CPU - Executor: StandardEPYC 8534PNEPYC 9654 2PEPYC 8534PEPYC 9754 2PXeon 6766E 2PXeon 6766EXeon 6780E 2PEPYC 9684X 2PEPYC 9654EPYC 9684XXeon 6780EEPYC 9754Xeon Platinum 8380Xeon Max 9480Xeon Max 9468Xeon Max 9480 2PXeon Max 9468 2PXeon Platinum 8490HXeon Platinum 8380 2PXeon Platinum 8592+Xeon Platinum 8592+ 2PXeon Platinum 8490H 2P4080120160200Min: 210.35 / Avg: 226.63 / Max: 296.48Min: 219.86 / Avg: 220.35 / Max: 221.03Min: 190.46 / Avg: 216.7 / Max: 246.51Min: 198.53 / Avg: 203.57 / Max: 208.6Min: 194 / Avg: 194.11 / Max: 194.19Min: 188.16 / Avg: 188.3 / Max: 188.45Min: 182.11 / Avg: 182.36 / Max: 182.52Min: 172.07 / Avg: 182.27 / Max: 200.42Min: 159.17 / Avg: 182.02 / Max: 203.06Min: 151.51 / Avg: 178.03 / Max: 194.09Min: 173.87 / Avg: 174.14 / Max: 174.55Min: 151.61 / Avg: 166.79 / Max: 175.8Min: 148.99 / Avg: 160.53 / Max: 176.91Min: 134.46 / Avg: 155.79 / Max: 211.84Min: 126.21 / Avg: 139.1 / Max: 173.52Min: 111.99 / Avg: 121.78 / Max: 145.67Min: 104.92 / Avg: 121.67 / Max: 167.8Min: 116.18 / Avg: 116.31 / Max: 116.48Min: 106.58 / Avg: 110.97 / Max: 128.37Min: 108.91 / Avg: 109.67 / Max: 111.08Min: 100.26 / Avg: 100.74 / Max: 101.61Min: 90.31 / Avg: 92.35 / Max: 100.181. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.17Model: fcn-resnet101-11 - Device: CPU - Executor: StandardEPYC 8534PNEPYC 9654 2PEPYC 8534PEPYC 9754 2PXeon 6766E 2PXeon 6766EXeon 6780E 2PEPYC 9684X 2PEPYC 9654EPYC 9684XXeon 6780EEPYC 9754Xeon Platinum 8380Xeon Max 9480Xeon Max 9468Xeon Max 9480 2PXeon Max 9468 2PXeon Platinum 8490HXeon Platinum 8380 2PXeon Platinum 8592+Xeon Platinum 8592+ 2PXeon Platinum 8490H 2P3691215SE +/- 0.11914, N = 15SE +/- 0.00718, N = 3SE +/- 0.14467, N = 12SE +/- 0.07023, N = 3SE +/- 0.00154, N = 3SE +/- 0.00241, N = 3SE +/- 0.00381, N = 3SE +/- 0.06453, N = 15SE +/- 0.15150, N = 15SE +/- 0.16422, N = 12SE +/- 0.00692, N = 3SE +/- 0.08489, N = 15SE +/- 0.08940, N = 15SE +/- 0.22869, N = 15SE +/- 0.15651, N = 15SE +/- 0.16487, N = 15SE +/- 0.34632, N = 12SE +/- 0.00664, N = 3SE +/- 0.11577, N = 15SE +/- 0.05824, N = 3SE +/- 0.04271, N = 3SE +/- 0.07619, N = 154.465334.538174.664914.914205.151665.310505.483435.497115.550185.665085.742346.011646.247406.549657.241878.260168.399628.597199.033679.118859.9268410.836231. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt
OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.17Model: fcn-resnet101-11 - Device: CPU - Executor: StandardEPYC 8534PNEPYC 9654 2PEPYC 8534PEPYC 9754 2PXeon 6766E 2PXeon 6766EXeon 6780E 2PEPYC 9684X 2PEPYC 9654EPYC 9684XXeon 6780EEPYC 9754Xeon Platinum 8380Xeon Max 9480Xeon Max 9468Xeon Max 9480 2PXeon Max 9468 2PXeon Platinum 8490HXeon Platinum 8380 2PXeon Platinum 8592+Xeon Platinum 8592+ 2PXeon Platinum 8490H 2P3691215Min: 3.37 / Avg: 4.47 / Max: 4.75Min: 4.52 / Avg: 4.54 / Max: 4.55Min: 4.06 / Avg: 4.66 / Max: 5.25Min: 4.79 / Avg: 4.91 / Max: 5.04Min: 5.15 / Avg: 5.15 / Max: 5.15Min: 5.31 / Avg: 5.31 / Max: 5.31Min: 5.48 / Avg: 5.48 / Max: 5.49Min: 4.99 / Avg: 5.5 / Max: 5.81Min: 4.92 / Avg: 5.55 / Max: 6.28Min: 5.15 / Avg: 5.67 / Max: 6.6Min: 5.73 / Avg: 5.74 / Max: 5.75Min: 5.69 / Avg: 6.01 / Max: 6.6Min: 5.65 / Avg: 6.25 / Max: 6.71Min: 4.72 / Avg: 6.55 / Max: 7.44Min: 5.76 / Avg: 7.24 / Max: 7.92Min: 6.86 / Avg: 8.26 / Max: 8.93Min: 5.96 / Avg: 8.4 / Max: 9.53Min: 8.58 / Avg: 8.6 / Max: 8.61Min: 7.79 / Avg: 9.03 / Max: 9.38Min: 9 / Avg: 9.12 / Max: 9.18Min: 9.84 / Avg: 9.93 / Max: 9.97Min: 9.98 / Avg: 10.84 / Max: 11.071. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

srsRAN Project

OpenBenchmarking.orgWatts, Fewer Is BettersrsRAN Project 23.10.1-20240325CPU Power Consumption MonitorEPYC 9684X 2PXeon Max 9480 2PXeon Max 9468 2PXeon Platinum 8490H 2PEPYC 9654 2PXeon Platinum 8592+ 2PEPYC 9754 2PXeon 6780E 2PXeon Platinum 8380 2PXeon 6766E 2PEPYC 9684XXeon Max 9480Xeon Platinum 8490HXeon Max 9468EPYC 9654Xeon Platinum 8592+EPYC 9754Xeon 6780EXeon Platinum 8380Xeon 6766EEPYC 8534PEPYC 8534PN130260390520650Min: 65.52 / Avg: 632.5 / Max: 723.62Min: 189.97 / Avg: 617.8 / Max: 721.97Min: 195.95 / Avg: 604.92 / Max: 745.23Min: 148.45 / Avg: 589.02 / Max: 721.35Min: 55.25 / Avg: 559.64 / Max: 633.66Min: 68.27 / Avg: 537.03 / Max: 710Min: 41.23 / Avg: 514.74 / Max: 612.62Min: 104.56 / Avg: 509.97 / Max: 630.46Min: 100.98 / Avg: 470 / Max: 560.27Min: 103.72 / Avg: 426.81 / Max: 506.19Min: 32.26 / Avg: 321.41 / Max: 408.75Min: 74.87 / Avg: 289.12 / Max: 373.87Min: 60.24 / Avg: 283.1 / Max: 369.61Min: 74.5 / Avg: 281.29 / Max: 379.76Min: 28.12 / Avg: 276.24 / Max: 341.73Min: 25.9 / Avg: 266.9 / Max: 379.06Min: 21.57 / Avg: 261.04 / Max: 306.84Min: 43.52 / Avg: 245.99 / Max: 312.37Min: 51.25 / Avg: 229.96 / Max: 288.72Min: 43.55 / Avg: 205.11 / Max: 263.97Min: 17.85 / Avg: 136.58 / Max: 166.81Min: 16.71 / Avg: 117.93 / Max: 142.26

OpenBenchmarking.orgMbps Per Watt, More Is BettersrsRAN Project 23.10.1-20240325Test: PDSCH Processor Benchmark, Throughput TotalXeon Max 9480 2PXeon Platinum 8380 2PEPYC 9654 2PEPYC 9684X 2PXeon Max 9468 2PXeon Platinum 8490H 2PXeon Max 9480Xeon Platinum 8592+ 2PEPYC 9754 2PXeon Platinum 8380Xeon 6780E 2PXeon 6766E 2PXeon Max 9468Xeon Platinum 8490HEPYC 9684XEPYC 9754Xeon Platinum 8592+EPYC 9654Xeon 6780EXeon 6766EEPYC 8534PEPYC 8534PN408012016020019.2140.3140.9841.0749.9851.1252.1656.8858.0458.8764.7374.2275.6887.2191.4296.5298.83100.26121.16133.01141.87165.23

OpenBenchmarking.orgMbps, More Is BettersrsRAN Project 23.10.1-20240325Test: PDSCH Processor Benchmark, Throughput TotalXeon Max 9480 2PXeon Platinum 8380Xeon Max 9480Xeon Platinum 8380 2PEPYC 8534PEPYC 8534PNXeon Max 9468EPYC 9654 2PXeon Platinum 8490HEPYC 9754EPYC 9684X 2PXeon Platinum 8592+Xeon 6766EEPYC 9654EPYC 9684XXeon 6780EEPYC 9754 2PXeon Platinum 8490H 2PXeon Max 9468 2PXeon Platinum 8592+ 2PXeon 6766E 2PXeon 6780E 2P7K14K21K28K35KSE +/- 490.54, N = 15SE +/- 44.42, N = 3SE +/- 281.72, N = 15SE +/- 308.01, N = 15SE +/- 207.19, N = 5SE +/- 58.21, N = 3SE +/- 938.95, N = 15SE +/- 526.01, N = 15SE +/- 236.27, N = 4SE +/- 237.63, N = 3SE +/- 343.97, N = 3SE +/- 298.34, N = 15SE +/- 150.02, N = 4SE +/- 357.13, N = 12SE +/- 348.28, N = 4SE +/- 134.28, N = 4SE +/- 2115.57, N = 15SE +/- 312.17, N = 3SE +/- 175.78, N = 4SE +/- 356.81, N = 15SE +/- 319.61, N = 3SE +/- 242.64, N = 311866.713537.715081.018943.619375.919485.821286.622931.824688.525194.625977.426378.127281.927695.229384.929804.429877.130108.730236.030547.631677.233010.51. (CXX) g++ options: -O3 -march=native -mavx2 -mavx -msse4.1 -mfma -fno-trapping-math -fno-math-errno -ldl
OpenBenchmarking.orgMbps, More Is BettersrsRAN Project 23.10.1-20240325Test: PDSCH Processor Benchmark, Throughput TotalXeon Max 9480 2PXeon Platinum 8380Xeon Max 9480Xeon Platinum 8380 2PEPYC 8534PEPYC 8534PNXeon Max 9468EPYC 9654 2PXeon Platinum 8490HEPYC 9754EPYC 9684X 2PXeon Platinum 8592+Xeon 6766EEPYC 9654EPYC 9684XXeon 6780EEPYC 9754 2PXeon Platinum 8490H 2PXeon Max 9468 2PXeon Platinum 8592+ 2PXeon 6766E 2PXeon 6780E 2P6K12K18K24K30KMin: 10692.2 / Avg: 11866.71 / Max: 17213Min: 13478.7 / Avg: 13537.67 / Max: 13624.7Min: 13387.5 / Avg: 15080.97 / Max: 17986.8Min: 16722 / Avg: 18943.59 / Max: 20184.7Min: 18943.9 / Avg: 19375.9 / Max: 20065.1Min: 19379.6 / Avg: 19485.83 / Max: 19580.2Min: 13002.8 / Avg: 21286.6 / Max: 24103.3Min: 19787.8 / Avg: 22931.83 / Max: 26132.1Min: 24005.5 / Avg: 24688.5 / Max: 25092.7Min: 24746 / Avg: 25194.6 / Max: 25554.8Min: 25432.8 / Avg: 25977.37 / Max: 26613.7Min: 24120 / Avg: 26378.14 / Max: 28050.8Min: 26961.9 / Avg: 27281.85 / Max: 27627.9Min: 25729.4 / Avg: 27695.2 / Max: 29867.9Min: 28734 / Avg: 29384.85 / Max: 30372.4Min: 29428.8 / Avg: 29804.38 / Max: 30020.7Min: 16747.3 / Avg: 29877.06 / Max: 38835.8Min: 29484.5 / Avg: 30108.7 / Max: 30432.5Min: 29772.1 / Avg: 30235.98 / Max: 30546.3Min: 28535.9 / Avg: 30547.59 / Max: 33263.4Min: 31070.2 / Avg: 31677.23 / Max: 32154.2Min: 32706.4 / Avg: 33010.53 / Max: 33490.11. (CXX) g++ options: -O3 -march=native -mavx2 -mavx -msse4.1 -mfma -fno-trapping-math -fno-math-errno -ldl

SVT-AV1

OpenBenchmarking.orgWatts, Fewer Is BetterSVT-AV1 2.0CPU Power Consumption MonitorXeon Max 9480 2PXeon Max 9468 2PXeon Platinum 8490H 2PXeon Platinum 8592+ 2PEPYC 9684X 2PXeon Platinum 8380 2PEPYC 9654 2PXeon Max 9468Xeon Max 9480EPYC 9754 2PXeon Platinum 8490HXeon 6780E 2PXeon 6766E 2PXeon Platinum 8592+Xeon Platinum 8380EPYC 9684XEPYC 9654EPYC 9754Xeon 6780EXeon 6766EEPYC 8534PEPYC 8534PN100200300400500Min: 193.69 / Avg: 401.02 / Max: 565.3Min: 196.97 / Avg: 398.41 / Max: 555.31Min: 160.44 / Avg: 317.58 / Max: 460.42Min: 70.69 / Avg: 247.31 / Max: 459.08Min: 60.69 / Avg: 231.16 / Max: 380.35Min: 96.21 / Avg: 219.64 / Max: 381.28Min: 56.44 / Avg: 206.94 / Max: 347.98Min: 73.18 / Avg: 187.24 / Max: 299.74Min: 69.14 / Avg: 187.17 / Max: 307.31Min: 38.31 / Avg: 171.31 / Max: 283.81Min: 59.06 / Avg: 155.98 / Max: 273.08Min: 106.17 / Avg: 142.03 / Max: 219.81Min: 104.02 / Avg: 131.43 / Max: 193.79Min: 26.49 / Avg: 131.08 / Max: 275.44Min: 49.33 / Avg: 128.89 / Max: 223.87Min: 31.67 / Avg: 118.98 / Max: 227.28Min: 25.79 / Avg: 105.15 / Max: 208.71Min: 19.23 / Avg: 84.14 / Max: 169.24Min: 43.43 / Avg: 73.7 / Max: 142.81Min: 43.57 / Avg: 69.02 / Max: 130.57Min: 16.06 / Avg: 60.52 / Max: 126.9Min: 14.1 / Avg: 55.32 / Max: 107.14

OpenBenchmarking.orgFrames Per Second Per Watt, More Is BetterSVT-AV1 2.0Encoder Mode: Preset 13 - Input: Bosphorus 4KXeon Max 9468 2PXeon Max 9480 2PXeon Platinum 8490H 2PXeon Platinum 8380 2PXeon Platinum 8592+ 2PEPYC 9684X 2PXeon Max 9468Xeon Max 9480EPYC 9654 2PXeon 6780E 2PXeon 6766E 2PEPYC 9754 2PXeon Platinum 8380Xeon Platinum 8490HXeon Platinum 8592+EPYC 9684XEPYC 9654Xeon 6766EXeon 6780EEPYC 9754EPYC 8534PEPYC 8534PN0.62391.24781.87172.49563.11950.3080.3100.4860.6320.6590.6980.7730.8010.8080.8210.8240.9331.0331.0421.3341.3661.6441.6601.6911.9422.6572.773

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 2.0Encoder Mode: Preset 13 - Input: Bosphorus 4KXeon 6766E 2PXeon 6766EXeon 6780E 2PXeon Max 9468 2PXeon Max 9480 2PXeon 6780EXeon Platinum 8380Xeon Platinum 8380 2PXeon Max 9468Xeon Max 9480EPYC 8534PNXeon Platinum 8490H 2PEPYC 9754 2PEPYC 8534PEPYC 9684X 2PXeon Platinum 8490HEPYC 9684XXeon Platinum 8592+ 2PEPYC 9754EPYC 9654 2PEPYC 9654Xeon Platinum 8592+4080120160200SE +/- 0.80, N = 15SE +/- 1.01, N = 8SE +/- 1.79, N = 15SE +/- 1.63, N = 15SE +/- 1.67, N = 15SE +/- 1.12, N = 7SE +/- 1.11, N = 15SE +/- 3.34, N = 15SE +/- 1.44, N = 15SE +/- 1.62, N = 15SE +/- 3.84, N = 15SE +/- 2.18, N = 15SE +/- 4.46, N = 15SE +/- 4.25, N = 15SE +/- 1.54, N = 15SE +/- 2.31, N = 15SE +/- 3.81, N = 15SE +/- 2.84, N = 15SE +/- 4.48, N = 15SE +/- 4.23, N = 15SE +/- 4.38, N = 15SE +/- 2.83, N = 15108.29114.54116.62122.62124.26124.60133.19138.72144.70150.00153.42154.50159.75160.79161.34162.47162.48162.98163.41167.22172.88174.831. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq
OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 2.0Encoder Mode: Preset 13 - Input: Bosphorus 4KXeon 6766E 2PXeon 6766EXeon 6780E 2PXeon Max 9468 2PXeon Max 9480 2PXeon 6780EXeon Platinum 8380Xeon Platinum 8380 2PXeon Max 9468Xeon Max 9480EPYC 8534PNXeon Platinum 8490H 2PEPYC 9754 2PEPYC 8534PEPYC 9684X 2PXeon Platinum 8490HEPYC 9684XXeon Platinum 8592+ 2PEPYC 9754EPYC 9654 2PEPYC 9654Xeon Platinum 8592+306090120150Min: 99.33 / Avg: 108.29 / Max: 111.09Min: 107.57 / Avg: 114.54 / Max: 115.97Min: 92.61 / Avg: 116.62 / Max: 120.58Min: 101.28 / Avg: 122.62 / Max: 131.09Min: 101.43 / Avg: 124.26 / Max: 128.92Min: 117.87 / Avg: 124.6 / Max: 125.96Min: 117.84 / Avg: 133.19 / Max: 135.01Min: 93.02 / Avg: 138.72 / Max: 145.41Min: 124.82 / Avg: 144.7 / Max: 147.49Min: 127.75 / Avg: 150 / Max: 153.19Min: 100.12 / Avg: 153.42 / Max: 159.57Min: 124.23 / Avg: 154.5 / Max: 158.43Min: 100.25 / Avg: 159.75 / Max: 172.1Min: 101.5 / Avg: 160.78 / Max: 167.06Min: 148.84 / Avg: 161.34 / Max: 167.65Min: 130.33 / Avg: 162.47 / Max: 166.5Min: 109.23 / Avg: 162.48 / Max: 169.1Min: 123.62 / Avg: 162.98 / Max: 168.5Min: 101.53 / Avg: 163.41 / Max: 173.07Min: 108.71 / Avg: 167.22 / Max: 175.15Min: 111.98 / Avg: 172.87 / Max: 181.18Min: 135.47 / Avg: 174.83 / Max: 179.181. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

LuxCoreRender

OpenBenchmarking.orgWatts, Fewer Is BetterLuxCoreRender 2.6CPU Power Consumption MonitorEPYC 9684X 2PXeon Max 9480 2PXeon Max 9468 2PXeon Platinum 8490H 2PXeon Platinum 8592+ 2PEPYC 9654 2PEPYC 9754 2PXeon Platinum 8380 2PEPYC 9684XXeon 6780E 2PXeon Max 9480Xeon Max 9468Xeon Platinum 8490HXeon 6766E 2PXeon Platinum 8592+EPYC 9754EPYC 9654Xeon Platinum 8380Xeon 6780EXeon 6766EEPYC 8534PEPYC 8534PN150300450600750Min: 66.69 / Avg: 722.97 / Max: 825.83Min: 201.92 / Avg: 656.25 / Max: 748.81Min: 204.79 / Avg: 656.04 / Max: 751.44Min: 172.79 / Avg: 646.27 / Max: 748.56Min: 82.44 / Avg: 639.12 / Max: 751.58Min: 57.15 / Avg: 586.21 / Max: 670.16Min: 41.55 / Avg: 551.09 / Max: 677.8Min: 100.16 / Avg: 499.14 / Max: 582.6Min: 33.09 / Avg: 373.72 / Max: 411.13Min: 107.87 / Avg: 364.17 / Max: 576.89Min: 83.75 / Avg: 327.46 / Max: 377.5Min: 75.77 / Avg: 326.79 / Max: 375.2Min: 61.77 / Avg: 323.08 / Max: 377.72Min: 104.86 / Avg: 321.3 / Max: 495.12Min: 34.75 / Avg: 320.73 / Max: 377.48Min: 22.04 / Avg: 298.61 / Max: 336.88Min: 27.54 / Avg: 296.6 / Max: 330.72Min: 53 / Avg: 249.69 / Max: 290.48Min: 43.49 / Avg: 223.98 / Max: 283.31Min: 43.68 / Avg: 191.46 / Max: 222.84Min: 19.16 / Avg: 150.1 / Max: 167.85Min: 17.62 / Avg: 128.09 / Max: 142.09

OpenBenchmarking.orgM samples/sec Per Watt, More Is BetterLuxCoreRender 2.6Scene: Orange Juice - Acceleration: CPUXeon Max 9480 2PXeon Max 9468 2PXeon Platinum 8490H 2PXeon Platinum 8380 2PXeon Platinum 8592+ 2PXeon Platinum 8380Xeon Max 9468Xeon Max 9480Xeon Platinum 8490HXeon Platinum 8592+EPYC 9684X 2PXeon 6780E 2PEPYC 9654 2PXeon 6766E 2PEPYC 9754 2PEPYC 9684XXeon 6780EEPYC 9654EPYC 9754Xeon 6766EEPYC 8534PEPYC 8534PN0.02270.04540.06810.09080.11350.0250.0260.0290.0290.0310.0350.0360.0380.0420.0460.0460.0480.0510.0530.0590.0660.0710.0720.0800.0830.0920.101

OpenBenchmarking.orgM samples/sec, More Is BetterLuxCoreRender 2.6Scene: Orange Juice - Acceleration: CPUXeon Platinum 8380Xeon Max 9468Xeon Max 9480EPYC 8534PNXeon Platinum 8490HEPYC 8534PXeon Platinum 8380 2PXeon Platinum 8592+Xeon 6780EXeon 6766EXeon Max 9480 2PXeon 6766E 2PXeon Max 9468 2PXeon 6780E 2PXeon Platinum 8490H 2PXeon Platinum 8592+ 2PEPYC 9654EPYC 9754EPYC 9684XEPYC 9654 2PEPYC 9754 2PEPYC 9684X 2P816243240SE +/- 0.03, N = 3SE +/- 0.10, N = 3SE +/- 0.04, N = 3SE +/- 0.05, N = 3SE +/- 0.07, N = 3SE +/- 0.05, N = 3SE +/- 0.06, N = 3SE +/- 0.05, N = 3SE +/- 0.06, N = 3SE +/- 0.19, N = 3SE +/- 0.28, N = 15SE +/- 0.46, N = 12SE +/- 0.16, N = 15SE +/- 0.46, N = 15SE +/- 0.12, N = 3SE +/- 0.30, N = 15SE +/- 0.18, N = 15SE +/- 0.07, N = 3SE +/- 0.28, N = 5SE +/- 0.84, N = 15SE +/- 1.12, N = 15SE +/- 1.06, N = 158.8211.8612.5013.0013.4613.8114.3114.7415.8315.9016.6416.8816.9117.4518.7019.9121.3223.7624.6929.6132.2633.08
OpenBenchmarking.orgM samples/sec, More Is BetterLuxCoreRender 2.6Scene: Orange Juice - Acceleration: CPUXeon Platinum 8380Xeon Max 9468Xeon Max 9480EPYC 8534PNXeon Platinum 8490HEPYC 8534PXeon Platinum 8380 2PXeon Platinum 8592+Xeon 6780EXeon 6766EXeon Max 9480 2PXeon 6766E 2PXeon Max 9468 2PXeon 6780E 2PXeon Platinum 8490H 2PXeon Platinum 8592+ 2PEPYC 9654EPYC 9754EPYC 9684XEPYC 9654 2PEPYC 9754 2PEPYC 9684X 2P714212835Min: 8.77 / Avg: 8.82 / Max: 8.86Min: 11.67 / Avg: 11.86 / Max: 11.97Min: 12.42 / Avg: 12.5 / Max: 12.54Min: 12.93 / Avg: 13 / Max: 13.1Min: 13.33 / Avg: 13.46 / Max: 13.55Min: 13.72 / Avg: 13.81 / Max: 13.86Min: 14.22 / Avg: 14.31 / Max: 14.41Min: 14.65 / Avg: 14.74 / Max: 14.8Min: 15.77 / Avg: 15.83 / Max: 15.94Min: 15.52 / Avg: 15.9 / Max: 16.14Min: 15.54 / Avg: 16.64 / Max: 18.7Min: 14.59 / Avg: 16.88 / Max: 19.05Min: 15.85 / Avg: 16.91 / Max: 17.99Min: 15.53 / Avg: 17.45 / Max: 20.71Min: 18.51 / Avg: 18.7 / Max: 18.91Min: 18.33 / Avg: 19.91 / Max: 22.1Min: 20.75 / Avg: 21.32 / Max: 22.36Min: 23.62 / Avg: 23.76 / Max: 23.86Min: 23.59 / Avg: 24.69 / Max: 24.99Min: 26.8 / Avg: 29.61 / Max: 34.89Min: 29.18 / Avg: 32.26 / Max: 40.92Min: 29.21 / Avg: 33.08 / Max: 38.43

OpenBenchmarking.orgWatts, Fewer Is BetterLuxCoreRender 2.6CPU Power Consumption MonitorEPYC 9684X 2PXeon Max 9480 2PXeon Max 9468 2PXeon Platinum 8490H 2PXeon Platinum 8592+ 2PEPYC 9654 2PEPYC 9754 2PXeon Platinum 8380 2PEPYC 9684XXeon 6780E 2PXeon Max 9468Xeon Platinum 8490HXeon Max 9480Xeon Platinum 8592+EPYC 9754EPYC 9654Xeon 6766E 2PXeon Platinum 8380Xeon 6780EXeon 6766EEPYC 8534PEPYC 8534PN150300450600750Min: 65.89 / Avg: 739.45 / Max: 837.69Min: 203.55 / Avg: 668.4 / Max: 754.98Min: 195.7 / Avg: 665.76 / Max: 753.2Min: 173.98 / Avg: 664.56 / Max: 753.01Min: 76.68 / Avg: 654.92 / Max: 755.35Min: 59.66 / Avg: 573.93 / Max: 661.76Min: 42.95 / Avg: 561.1 / Max: 675.69Min: 101.11 / Avg: 511.71 / Max: 580Min: 34.75 / Avg: 384.12 / Max: 412.45Min: 79.88 / Avg: 341.83 / Max: 482.57Min: 74.56 / Avg: 331.26 / Max: 374.04Min: 59.67 / Avg: 330.53 / Max: 373.83Min: 72.86 / Avg: 330.29 / Max: 377.65Min: 24.28 / Avg: 326.43 / Max: 375.69Min: 20.73 / Avg: 311.89 / Max: 340.37Min: 29.9 / Avg: 299.39 / Max: 326.71Min: 104.02 / Avg: 295.99 / Max: 409.35Min: 51.32 / Avg: 255.3 / Max: 289.97Min: 43.51 / Avg: 225.44 / Max: 288.32Min: 43.65 / Avg: 180.3 / Max: 223.44Min: 18.62 / Avg: 156.14 / Max: 171.55Min: 18.19 / Avg: 128.95 / Max: 140.58

OpenBenchmarking.orgM samples/sec Per Watt, More Is BetterLuxCoreRender 2.6Scene: DLSC - Acceleration: CPUXeon Max 9468 2PXeon Max 9480 2PXeon Platinum 8490H 2PXeon Platinum 8380 2PXeon Platinum 8592+ 2PXeon Platinum 8380Xeon Max 9468Xeon 6780E 2PXeon Max 9480Xeon Platinum 8490HXeon 6766E 2PXeon Platinum 8592+EPYC 9684X 2PEPYC 9654 2PEPYC 9754 2PEPYC 9684XXeon 6780EEPYC 9654Xeon 6766EEPYC 9754EPYC 8534PEPYC 8534PN0.01490.02980.04470.05960.07450.0150.0160.0170.0180.0190.0220.0230.0230.0240.0260.0260.0290.0310.0310.0390.0420.0450.0480.0520.0540.0600.066

OpenBenchmarking.orgM samples/sec, More Is BetterLuxCoreRender 2.6Scene: DLSC - Acceleration: CPUXeon Platinum 8380Xeon Max 9468Xeon 6766E 2PXeon 6780E 2PXeon Max 9480EPYC 8534PNXeon Platinum 8490HXeon Platinum 8380 2PXeon Platinum 8592+EPYC 8534PXeon 6766EXeon 6780EXeon Max 9468 2PXeon Max 9480 2PXeon Platinum 8490H 2PXeon Platinum 8592+ 2PEPYC 9654EPYC 9684XEPYC 9754EPYC 9654 2PEPYC 9754 2PEPYC 9684X 2P510152025SE +/- 0.05, N = 3SE +/- 0.08, N = 3SE +/- 0.22, N = 12SE +/- 0.22, N = 15SE +/- 0.10, N = 3SE +/- 0.03, N = 3SE +/- 0.06, N = 15SE +/- 0.04, N = 3SE +/- 0.02, N = 3SE +/- 0.06, N = 15SE +/- 0.02, N = 3SE +/- 0.06, N = 3SE +/- 0.12, N = 3SE +/- 0.20, N = 15SE +/- 0.23, N = 15SE +/- 0.24, N = 15SE +/- 0.13, N = 3SE +/- 0.18, N = 15SE +/- 0.28, N = 15SE +/- 0.12, N = 3SE +/- 1.02, N = 15SE +/- 0.91, N = 155.637.467.717.998.008.488.728.989.389.399.4010.0910.1710.4411.1212.7414.2916.2116.7917.8922.0022.58
OpenBenchmarking.orgM samples/sec, More Is BetterLuxCoreRender 2.6Scene: DLSC - Acceleration: CPUXeon Platinum 8380Xeon Max 9468Xeon 6766E 2PXeon 6780E 2PXeon Max 9480EPYC 8534PNXeon Platinum 8490HXeon Platinum 8380 2PXeon Platinum 8592+EPYC 8534PXeon 6766EXeon 6780EXeon Max 9468 2PXeon Max 9480 2PXeon Platinum 8490H 2PXeon Platinum 8592+ 2PEPYC 9654EPYC 9684XEPYC 9754EPYC 9654 2PEPYC 9754 2PEPYC 9684X 2P510152025Min: 5.53 / Avg: 5.63 / Max: 5.71Min: 7.31 / Avg: 7.46 / Max: 7.54Min: 6.85 / Avg: 7.71 / Max: 9.87Min: 7.26 / Avg: 7.99 / Max: 10.19Min: 7.87 / Avg: 8 / Max: 8.2Min: 8.43 / Avg: 8.48 / Max: 8.51Min: 8.48 / Avg: 8.72 / Max: 9.03Min: 8.92 / Avg: 8.98 / Max: 9.05Min: 9.35 / Avg: 9.38 / Max: 9.4Min: 9.12 / Avg: 9.39 / Max: 9.66Min: 9.37 / Avg: 9.4 / Max: 9.43Min: 10.02 / Avg: 10.09 / Max: 10.22Min: 9.93 / Avg: 10.17 / Max: 10.3Min: 9.65 / Avg: 10.44 / Max: 12.26Min: 10.06 / Avg: 11.12 / Max: 12.79Min: 11.63 / Avg: 12.74 / Max: 14.1Min: 14.16 / Avg: 14.29 / Max: 14.55Min: 15.68 / Avg: 16.21 / Max: 17.34Min: 15.95 / Avg: 16.79 / Max: 18.93Min: 17.67 / Avg: 17.89 / Max: 18.1Min: 18.37 / Avg: 22 / Max: 26.92Min: 18.97 / Avg: 22.58 / Max: 26.51

NAS Parallel Benchmarks

OpenBenchmarking.orgWatts, Fewer Is BetterNAS Parallel Benchmarks 3.4CPU Power Consumption MonitorXeon Max 9480 2PXeon Max 9468 2PXeon Platinum 8490H 2PEPYC 9684X 2PXeon Platinum 8592+ 2PXeon Platinum 8380 2PEPYC 9654 2PEPYC 9754 2PEPYC 9684XXeon Platinum 8490HXeon Platinum 8592+Xeon Max 9480Xeon Max 9468EPYC 9654Xeon Platinum 8380EPYC 9754EPYC 8534PEPYC 8534PN140280420560700Min: 196.31 / Avg: 561.84 / Max: 754.16Min: 200.97 / Avg: 537.97 / Max: 722.6Min: 155.56 / Avg: 520.43 / Max: 752.57Min: 65.8 / Avg: 495.73 / Max: 819.01Min: 68.69 / Avg: 471.7 / Max: 753.27Min: 100.12 / Avg: 440.29 / Max: 581.61Min: 56.44 / Avg: 416.97 / Max: 683.16Min: 40.5 / Avg: 379.03 / Max: 677.9Min: 31.93 / Avg: 307.77 / Max: 409.54Min: 57.58 / Avg: 291.31 / Max: 376.98Min: 26.35 / Avg: 276.68 / Max: 375.06Min: 76.21 / Avg: 270.13 / Max: 345.76Min: 73.35 / Avg: 254.67 / Max: 351.04Min: 26.47 / Avg: 242.89 / Max: 334.43Min: 51.37 / Avg: 242.36 / Max: 290.59Min: 21.19 / Avg: 234.01 / Max: 336.9Min: 18.8 / Avg: 129.08 / Max: 158.73Min: 17.1 / Avg: 113.27 / Max: 135.62

OpenBenchmarking.orgTotal Mop/s Per Watt, More Is BetterNAS Parallel Benchmarks 3.4Test / Class: EP.DXeon Platinum 8380Xeon Platinum 8380 2PXeon Max 9468 2PXeon Max 9468Xeon Max 9480 2PXeon Max 9480Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Platinum 8592+Xeon Platinum 8592+ 2PEPYC 9684XEPYC 9654EPYC 9684X 2PEPYC 9654 2PEPYC 8534PEPYC 8534PNEPYC 9754EPYC 9754 2P132639526518.4820.1720.3921.0722.7723.8625.9628.7229.2433.9337.1243.8644.7246.5649.7150.7253.7458.09

OpenBenchmarking.orgTotal Mop/s, More Is BetterNAS Parallel Benchmarks 3.4Test / Class: EP.DXeon Platinum 8380Xeon Max 9468EPYC 8534PNEPYC 8534PXeon Max 9480Xeon Platinum 8490HXeon Platinum 8592+Xeon Platinum 8380 2PEPYC 9654Xeon Max 9468 2PEPYC 9684XEPYC 9754Xeon Max 9480 2PXeon Platinum 8490H 2PXeon Platinum 8592+ 2PEPYC 9654 2PEPYC 9754 2PEPYC 9684X 2P5K10K15K20K25KSE +/- 13.82, N = 3SE +/- 155.10, N = 12SE +/- 50.01, N = 8SE +/- 14.68, N = 3SE +/- 6.53, N = 3SE +/- 6.77, N = 3SE +/- 22.33, N = 3SE +/- 17.53, N = 3SE +/- 122.47, N = 15SE +/- 4.83, N = 4SE +/- 309.03, N = 15SE +/- 367.88, N = 12SE +/- 10.93, N = 4SE +/- 100.23, N = 4SE +/- 30.19, N = 4SE +/- 530.31, N = 15SE +/- 1274.85, N = 12SE +/- 602.37, N = 154479.285366.695745.046416.346445.097562.808089.148880.8210652.0310970.4511424.0512575.3012793.0114946.7616004.0719414.9422017.7522166.601. (F9X) gfortran options: -O3 -march=native -lmpi_usempif08 -lmpi_mpifh -lmpi -lopen-rte -lopen-pal -lhwloc -levent_core -levent_pthreads -lm -lz 2. Open MPI 4.1.6
OpenBenchmarking.orgTotal Mop/s, More Is BetterNAS Parallel Benchmarks 3.4Test / Class: EP.DXeon Platinum 8380Xeon Max 9468EPYC 8534PNEPYC 8534PXeon Max 9480Xeon Platinum 8490HXeon Platinum 8592+Xeon Platinum 8380 2PEPYC 9654Xeon Max 9468 2PEPYC 9684XEPYC 9754Xeon Max 9480 2PXeon Platinum 8490H 2PXeon Platinum 8592+ 2PEPYC 9654 2PEPYC 9754 2PEPYC 9684X 2P4K8K12K16K20KMin: 4452.42 / Avg: 4479.28 / Max: 4498.33Min: 3660.9 / Avg: 5366.69 / Max: 5540.08Min: 5451.19 / Avg: 5745.04 / Max: 5886.73Min: 6389.97 / Avg: 6416.34 / Max: 6440.7Min: 6432.47 / Avg: 6445.09 / Max: 6454.32Min: 7555.79 / Avg: 7562.8 / Max: 7576.34Min: 8047.87 / Avg: 8089.14 / Max: 8124.56Min: 8858.4 / Avg: 8880.82 / Max: 8915.37Min: 9132.01 / Avg: 10652.03 / Max: 10990.48Min: 10957.6 / Avg: 10970.45 / Max: 10981.02Min: 8670.83 / Avg: 11424.05 / Max: 12361.62Min: 9627.94 / Avg: 12575.3 / Max: 13896.97Min: 12767.18 / Avg: 12793.01 / Max: 12820.48Min: 14774.48 / Avg: 14946.76 / Max: 15196.8Min: 15962.64 / Avg: 16004.07 / Max: 16092.29Min: 15313.65 / Avg: 19414.94 / Max: 21660.47Min: 9752.86 / Avg: 22017.75 / Max: 25714.16Min: 17649.37 / Avg: 22166.6 / Max: 244081. (F9X) gfortran options: -O3 -march=native -lmpi_usempif08 -lmpi_mpifh -lmpi -lopen-rte -lopen-pal -lhwloc -levent_core -levent_pthreads -lm -lz 2. Open MPI 4.1.6

Pennant

OpenBenchmarking.orgWatts, Fewer Is BetterPennant 1.0.1CPU Power Consumption MonitorXeon Max 9480 2PXeon Max 9468 2PXeon Platinum 8490H 2PEPYC 9684X 2PXeon Platinum 8380 2PXeon Platinum 8592+ 2PEPYC 9654 2PEPYC 9754 2PXeon Max 9468Xeon Max 9480Xeon Platinum 8490HXeon Platinum 8380EPYC 9684XXeon Platinum 8592+EPYC 9654EPYC 9754EPYC 8534PEPYC 8534PN140280420560700Min: 191.18 / Avg: 450.17 / Max: 753.29Min: 187.85 / Avg: 448.22 / Max: 752.01Min: 144.69 / Avg: 414.55 / Max: 753.5Min: 63.33 / Avg: 370.49 / Max: 818.97Min: 100.92 / Avg: 344.84 / Max: 581.63Min: 64.47 / Avg: 342.65 / Max: 753.04Min: 54.46 / Avg: 322.18 / Max: 670.5Min: 41.42 / Avg: 291.74 / Max: 665.7Min: 71.8 / Avg: 241.62 / Max: 375.61Min: 74.45 / Avg: 234.93 / Max: 375.6Min: 57.31 / Avg: 222.1 / Max: 377.34Min: 52.7 / Avg: 215.77 / Max: 289.7Min: 33.15 / Avg: 196.35 / Max: 409.53Min: 25.17 / Avg: 191.11 / Max: 377.76Min: 27.07 / Avg: 170.76 / Max: 330.73Min: 20.01 / Avg: 156.67 / Max: 328.66Min: 18.14 / Avg: 107.18 / Max: 164.25Min: 16.11 / Avg: 95.67 / Max: 145.23

OpenBenchmarking.orgHydro Cycle Time - Seconds, Fewer Is BetterPennant 1.0.1Test: leblancbigXeon Platinum 8380EPYC 8534PNEPYC 8534PXeon Max 9468Xeon Max 9480Xeon Platinum 8490HXeon Platinum 8380 2PXeon Platinum 8592+EPYC 9654EPYC 9754EPYC 9684XXeon Max 9468 2PXeon Platinum 8490H 2PXeon Max 9480 2PEPYC 9654 2PXeon Platinum 8592+ 2PEPYC 9754 2PEPYC 9684X 2P3691215SE +/- 0.010812, N = 4SE +/- 0.045713, N = 13SE +/- 0.057580, N = 6SE +/- 0.025580, N = 6SE +/- 0.023904, N = 7SE +/- 0.022393, N = 7SE +/- 0.037316, N = 9SE +/- 0.022698, N = 7SE +/- 0.115723, N = 15SE +/- 0.115702, N = 15SE +/- 0.115724, N = 15SE +/- 0.010204, N = 7SE +/- 0.019069, N = 15SE +/- 0.008354, N = 7SE +/- 0.063684, N = 15SE +/- 0.013568, N = 6SE +/- 0.022246, N = 15SE +/- 0.055800, N = 1511.8521306.8527126.5417685.9309575.1141614.9558654.7025574.1827073.7548353.6543033.3604532.8810992.5298072.5273632.3129772.1594592.0843842.0768351. (CXX) g++ options: -fopenmp -lmpi_cxx -lmpi
OpenBenchmarking.orgHydro Cycle Time - Seconds, Fewer Is BetterPennant 1.0.1Test: leblancbigXeon Platinum 8380EPYC 8534PNEPYC 8534PXeon Max 9468Xeon Max 9480Xeon Platinum 8490HXeon Platinum 8380 2PXeon Platinum 8592+EPYC 9654EPYC 9754EPYC 9684XXeon Max 9468 2PXeon Platinum 8490H 2PXeon Max 9480 2PEPYC 9654 2PXeon Platinum 8592+ 2PEPYC 9754 2PEPYC 9684X 2P3691215Min: 11.82 / Avg: 11.85 / Max: 11.87Min: 6.71 / Avg: 6.85 / Max: 7.31Min: 6.43 / Avg: 6.54 / Max: 6.77Min: 5.84 / Avg: 5.93 / Max: 6Min: 5.02 / Avg: 5.11 / Max: 5.19Min: 4.88 / Avg: 4.96 / Max: 5.02Min: 4.64 / Avg: 4.7 / Max: 5Min: 4.11 / Avg: 4.18 / Max: 4.29Min: 3.25 / Avg: 3.75 / Max: 4.92Min: 2.73 / Avg: 3.65 / Max: 3.93Min: 2.91 / Avg: 3.36 / Max: 4.42Min: 2.84 / Avg: 2.88 / Max: 2.91Min: 2.43 / Avg: 2.53 / Max: 2.69Min: 2.5 / Avg: 2.53 / Max: 2.55Min: 1.92 / Avg: 2.31 / Max: 2.62Min: 2.1 / Avg: 2.16 / Max: 2.2Min: 1.86 / Avg: 2.08 / Max: 2.19Min: 1.76 / Avg: 2.08 / Max: 2.351. (CXX) g++ options: -fopenmp -lmpi_cxx -lmpi

NAMD

OpenBenchmarking.orgWatts, Fewer Is BetterNAMD 3.0b6CPU Power Consumption MonitorXeon Max 9480 2PXeon Max 9468 2PXeon Platinum 8490H 2PXeon Platinum 8592+ 2PXeon Platinum 8380 2PEPYC 9684X 2PXeon Max 9480EPYC 9654 2PXeon Max 9468EPYC 9684XXeon Platinum 8490HXeon 6780E 2PXeon Platinum 8592+EPYC 9754 2PXeon 6766E 2PEPYC 9654Xeon Platinum 8380EPYC 9754Xeon 6780EEPYC 8534PXeon 6766EEPYC 8534PN140280420560700Min: 194.25 / Avg: 565.07 / Max: 686.05Min: 192.28 / Avg: 560.13 / Max: 714.79Min: 163.14 / Avg: 552.42 / Max: 653.46Min: 73.13 / Avg: 510.74 / Max: 686.96Min: 103.57 / Avg: 411.33 / Max: 527.15Min: 65.49 / Avg: 343.59 / Max: 811.63Min: 72.24 / Avg: 295.54 / Max: 371.41Min: 57.51 / Avg: 289.28 / Max: 672.46Min: 71.79 / Avg: 281.33 / Max: 364.12Min: 32.28 / Avg: 274.76 / Max: 406.72Min: 55.23 / Avg: 273.91 / Max: 344.33Min: 62.83 / Avg: 273.53 / Max: 463.21Min: 33.09 / Avg: 260.62 / Max: 349.3Min: 42.36 / Avg: 249.94 / Max: 651.86Min: 104.7 / Avg: 241.31 / Max: 387.86Min: 28.55 / Avg: 235.77 / Max: 330Min: 51.87 / Avg: 233.31 / Max: 276.8Min: 21.48 / Avg: 206.2 / Max: 309.47Min: 43.54 / Avg: 140.31 / Max: 283.29Min: 18.33 / Avg: 130.18 / Max: 164.25Min: 43.64 / Avg: 119.15 / Max: 229.24Min: 15.81 / Avg: 114.62 / Max: 140.3

OpenBenchmarking.orgns/day Per Watt, More Is BetterNAMD 3.0b6Input: STMV with 1,066,628 AtomsXeon Platinum 8490H 2PXeon 6780E 2PXeon Max 9468 2PXeon Max 9480 2PXeon 6766E 2PXeon Platinum 8490HXeon Platinum 8592+ 2PXeon Platinum 8380 2PXeon 6766EXeon 6780EXeon Max 9468Xeon Max 9480Xeon Platinum 8380Xeon Platinum 8592+EPYC 9684XEPYC 9654EPYC 8534PEPYC 8534PNEPYC 9754EPYC 9654 2PEPYC 9684X 2PEPYC 9754 2P0.00520.01040.01560.02080.0260.0020.0020.0030.0030.0030.0040.0040.0040.0040.0040.0050.0050.0050.0060.0120.0120.0120.0130.0140.0180.0190.023

OpenBenchmarking.orgns/day, More Is BetterNAMD 3.0b6Input: STMV with 1,066,628 AtomsXeon 6766EXeon 6780EXeon 6780E 2PXeon 6766E 2PXeon Platinum 8490HXeon Platinum 8490H 2PXeon Platinum 8380Xeon Platinum 8592+Xeon Max 9468EPYC 8534PNXeon Max 9480EPYC 8534PXeon Platinum 8380 2PXeon Max 9480 2PXeon Max 9468 2PXeon Platinum 8592+ 2PEPYC 9654EPYC 9754EPYC 9684XEPYC 9654 2PEPYC 9754 2PEPYC 9684X 2P246810SE +/- 0.00423, N = 3SE +/- 0.00540, N = 3SE +/- 0.03216, N = 9SE +/- 0.04439, N = 8SE +/- 0.01396, N = 15SE +/- 0.04403, N = 15SE +/- 0.00653, N = 3SE +/- 0.02648, N = 15SE +/- 0.05087, N = 15SE +/- 0.00540, N = 3SE +/- 0.05862, N = 15SE +/- 0.00440, N = 3SE +/- 0.00911, N = 3SE +/- 0.05463, N = 15SE +/- 0.05644, N = 12SE +/- 0.08185, N = 13SE +/- 0.00537, N = 3SE +/- 0.00847, N = 3SE +/- 0.00206, N = 3SE +/- 0.02927, N = 3SE +/- 0.00332, N = 3SE +/- 0.01739, N = 30.523570.567170.576940.707571.052741.109001.110561.437871.452231.461631.502141.519011.612321.767781.886792.254222.878772.888693.410855.278395.836066.38343
OpenBenchmarking.orgns/day, More Is BetterNAMD 3.0b6Input: STMV with 1,066,628 AtomsXeon 6766EXeon 6780EXeon 6780E 2PXeon 6766E 2PXeon Platinum 8490HXeon Platinum 8490H 2PXeon Platinum 8380Xeon Platinum 8592+Xeon Max 9468EPYC 8534PNXeon Max 9480EPYC 8534PXeon Platinum 8380 2PXeon Max 9480 2PXeon Max 9468 2PXeon Platinum 8592+ 2PEPYC 9654EPYC 9754EPYC 9684XEPYC 9654 2PEPYC 9754 2PEPYC 9684X 2P3691215Min: 0.52 / Avg: 0.52 / Max: 0.53Min: 0.56 / Avg: 0.57 / Max: 0.58Min: 0.42 / Avg: 0.58 / Max: 0.7Min: 0.57 / Avg: 0.71 / Max: 0.96Min: 0.97 / Avg: 1.05 / Max: 1.14Min: 0.9 / Avg: 1.11 / Max: 1.44Min: 1.1 / Avg: 1.11 / Max: 1.12Min: 1.23 / Avg: 1.44 / Max: 1.61Min: 1.15 / Avg: 1.45 / Max: 1.75Min: 1.45 / Avg: 1.46 / Max: 1.47Min: 1.09 / Avg: 1.5 / Max: 1.84Min: 1.51 / Avg: 1.52 / Max: 1.53Min: 1.6 / Avg: 1.61 / Max: 1.63Min: 1.49 / Avg: 1.77 / Max: 2.29Min: 1.63 / Avg: 1.89 / Max: 2.23Min: 1.76 / Avg: 2.25 / Max: 2.78Min: 2.87 / Avg: 2.88 / Max: 2.89Min: 2.88 / Avg: 2.89 / Max: 2.91Min: 3.41 / Avg: 3.41 / Max: 3.41Min: 5.22 / Avg: 5.28 / Max: 5.31Min: 5.83 / Avg: 5.84 / Max: 5.84Min: 6.36 / Avg: 6.38 / Max: 6.42

OpenBenchmarking.orgWatts, Fewer Is BetterNAMD 3.0b6CPU Power Consumption MonitorXeon Max 9480 2PXeon Platinum 8490H 2PXeon Max 9468 2PXeon Platinum 8592+ 2PXeon Platinum 8380 2PEPYC 9684X 2PXeon Max 9480Xeon 6780E 2PEPYC 9654 2PXeon Platinum 8490HXeon Max 9468Xeon 6766E 2PXeon Platinum 8592+EPYC 9754 2PXeon Platinum 8380EPYC 9654EPYC 9684XEPYC 9754Xeon 6780EXeon 6766EEPYC 8534PEPYC 8534PN140280420560700Min: 190.7 / Avg: 550.3 / Max: 686.19Min: 165.98 / Avg: 533.68 / Max: 633.47Min: 194.24 / Avg: 522.05 / Max: 693.75Min: 75.47 / Avg: 484.77 / Max: 671.95Min: 101.59 / Avg: 389.17 / Max: 564.97Min: 62.44 / Avg: 326.5 / Max: 779.77Min: 73.99 / Avg: 269.88 / Max: 376.76Min: 106.87 / Avg: 266.5 / Max: 492.66Min: 58.84 / Avg: 262.91 / Max: 648.62Min: 55.01 / Avg: 258.53 / Max: 352.06Min: 73.54 / Avg: 248.99 / Max: 374.54Min: 72.63 / Avg: 236.64 / Max: 427.46Min: 33.34 / Avg: 236.13 / Max: 373.62Min: 40.88 / Avg: 225.05 / Max: 615.88Min: 54.68 / Avg: 216.04 / Max: 281.76Min: 27.01 / Avg: 187.68 / Max: 312.41Min: 29.28 / Avg: 180.85 / Max: 379.02Min: 20.68 / Avg: 165.67 / Max: 289.24Min: 43.48 / Avg: 132.04 / Max: 342.42Min: 43.66 / Avg: 112.28 / Max: 262.76Min: 17 / Avg: 109.51 / Max: 166.07Min: 16.45 / Avg: 96.77 / Max: 141.98

OpenBenchmarking.orgns/day Per Watt, More Is BetterNAMD 3.0b6Input: ATPase with 327,506 AtomsXeon Platinum 8490H 2PXeon Max 9480 2PXeon 6780E 2PXeon Platinum 8490HXeon 6766E 2PXeon Platinum 8592+ 2PXeon Max 9468 2PXeon Platinum 8380 2PXeon Platinum 8380Xeon Platinum 8592+Xeon Max 9480Xeon Max 9468Xeon 6780EXeon 6766EEPYC 9654EPYC 9754EPYC 9684XEPYC 8534PEPYC 8534PNEPYC 9684X 2PEPYC 9654 2PEPYC 9754 2P0.01890.03780.05670.07560.09450.0040.0050.0090.0110.0110.0120.0140.0170.0170.0200.0220.0240.0290.0340.0440.0480.0520.0520.0560.0640.0680.084

OpenBenchmarking.orgns/day, More Is BetterNAMD 3.0b6Input: ATPase with 327,506 AtomsXeon Platinum 8490H 2PXeon 6780E 2PXeon 6766E 2PXeon Max 9480 2PXeon Platinum 8490HXeon Platinum 8380Xeon 6780EXeon 6766EXeon Platinum 8592+EPYC 8534PNEPYC 8534PXeon Platinum 8592+ 2PXeon Max 9480Xeon Max 9468Xeon Platinum 8380 2PXeon Max 9468 2PEPYC 9754EPYC 9654EPYC 9684XEPYC 9654 2PEPYC 9754 2PEPYC 9684X 2P510152025SE +/- 0.17435, N = 15SE +/- 0.20408, N = 12SE +/- 0.19805, N = 15SE +/- 0.44989, N = 15SE +/- 0.21567, N = 12SE +/- 0.02582, N = 3SE +/- 0.17734, N = 15SE +/- 0.02593, N = 3SE +/- 0.54361, N = 15SE +/- 0.00431, N = 4SE +/- 0.04338, N = 5SE +/- 0.34017, N = 12SE +/- 0.14537, N = 15SE +/- 0.16058, N = 15SE +/- 0.07204, N = 4SE +/- 0.26203, N = 15SE +/- 0.04917, N = 5SE +/- 0.01368, N = 5SE +/- 0.02148, N = 6SE +/- 0.04751, N = 3SE +/- 0.02125, N = 3SE +/- 0.08771, N = 32.219482.397702.554002.563192.970213.604793.763483.768114.648145.449715.706725.852675.925015.971306.726637.300657.997568.182759.3353417.8110518.9745420.75259
OpenBenchmarking.orgns/day, More Is BetterNAMD 3.0b6Input: ATPase with 327,506 AtomsXeon Platinum 8490H 2PXeon 6780E 2PXeon 6766E 2PXeon Max 9480 2PXeon Platinum 8490HXeon Platinum 8380Xeon 6780EXeon 6766EXeon Platinum 8592+EPYC 8534PNEPYC 8534PXeon Platinum 8592+ 2PXeon Max 9480Xeon Max 9468Xeon Platinum 8380 2PXeon Max 9468 2PEPYC 9754EPYC 9654EPYC 9684XEPYC 9654 2PEPYC 9754 2PEPYC 9684X 2P510152025Min: 1.23 / Avg: 2.22 / Max: 3.92Min: 1.63 / Avg: 2.4 / Max: 3.89Min: 1.75 / Avg: 2.55 / Max: 4.17Min: 0.77 / Avg: 2.56 / Max: 5.7Min: 1.8 / Avg: 2.97 / Max: 4.16Min: 3.55 / Avg: 3.6 / Max: 3.64Min: 2.19 / Avg: 3.76 / Max: 4.51Min: 3.72 / Avg: 3.77 / Max: 3.8Min: 1.28 / Avg: 4.65 / Max: 7.54Min: 5.44 / Avg: 5.45 / Max: 5.46Min: 5.53 / Avg: 5.71 / Max: 5.76Min: 3.15 / Avg: 5.85 / Max: 7.05Min: 5.29 / Avg: 5.93 / Max: 6.78Min: 4.66 / Avg: 5.97 / Max: 6.77Min: 6.52 / Avg: 6.73 / Max: 6.86Min: 5.44 / Avg: 7.3 / Max: 8.57Min: 7.87 / Avg: 8 / Max: 8.16Min: 8.14 / Avg: 8.18 / Max: 8.21Min: 9.29 / Avg: 9.34 / Max: 9.42Min: 17.72 / Avg: 17.81 / Max: 17.87Min: 18.93 / Avg: 18.97 / Max: 19.01Min: 20.61 / Avg: 20.75 / Max: 20.91

miniFE

OpenBenchmarking.orgWatts, Fewer Is BetterminiFE 2.2CPU Power Consumption MonitorXeon Max 9480 2PXeon Max 9468 2PXeon Platinum 8490H 2PXeon Platinum 8592+ 2PEPYC 9684X 2PXeon Platinum 8380 2PEPYC 9654 2PXeon Max 9480EPYC 9754 2PXeon Max 9468Xeon 6780E 2PXeon Platinum 8490HXeon 6766E 2PXeon Platinum 8592+Xeon Platinum 8380EPYC 9684XEPYC 9654EPYC 9754Xeon 6780EXeon 6766EEPYC 8534PEPYC 8534PN130260390520650Min: 199.32 / Avg: 500.61 / Max: 723.88Min: 189.32 / Avg: 498.77 / Max: 730.29Min: 168.8 / Avg: 424.3 / Max: 732.03Min: 73.08 / Avg: 366.83 / Max: 700.4Min: 63.04 / Avg: 330.55 / Max: 718.24Min: 99.06 / Avg: 326.82 / Max: 539.95Min: 53.09 / Avg: 309.09 / Max: 579.88Min: 73.91 / Avg: 260.35 / Max: 366.7Min: 40.05 / Avg: 258.88 / Max: 518.97Min: 75.77 / Avg: 253.53 / Max: 365.64Min: 106.66 / Avg: 225.73 / Max: 522.28Min: 61.92 / Avg: 224.98 / Max: 377.92Min: 104.71 / Avg: 215.79 / Max: 487.65Min: 31.62 / Avg: 198.71 / Max: 331.13Min: 53.33 / Avg: 190.48 / Max: 282.32Min: 33.7 / Avg: 177.88 / Max: 364.34Min: 28.79 / Avg: 152.24 / Max: 300.13Min: 21.36 / Avg: 127.63 / Max: 261.53Min: 43.53 / Avg: 119.29 / Max: 232.16Min: 43.59 / Avg: 108.34 / Max: 211.25Min: 19.07 / Avg: 96.36 / Max: 147.72Min: 15.16 / Avg: 86.83 / Max: 132.07

OpenBenchmarking.orgCG Mflops Per Watt, More Is BetterminiFE 2.2Problem Size: SmallXeon Max 9468 2PXeon Max 9480 2PXeon Max 9480Xeon Max 9468Xeon Platinum 8380 2PXeon Platinum 8490H 2PXeon Platinum 8592+ 2PXeon Platinum 8380EPYC 9654 2PXeon Platinum 8490HXeon Platinum 8592+EPYC 9754 2PXeon 6780E 2PEPYC 9684X 2PXeon 6766E 2PEPYC 8534PEPYC 8534PNEPYC 9684XEPYC 9654Xeon 6780EXeon 6766EEPYC 97549018027036045039.8543.1171.5279.2495.00110.48114.81120.52140.84156.59160.18162.67165.96179.90183.43254.52282.72298.90334.41340.56373.28392.87

OpenBenchmarking.orgCG Mflops, More Is BetterminiFE 2.2Problem Size: SmallXeon Max 9480Xeon Max 9468 2PXeon Max 9468Xeon Max 9480 2PXeon Platinum 8380EPYC 8534PEPYC 8534PNXeon Platinum 8380 2PXeon Platinum 8592+Xeon Platinum 8490HXeon 6780E 2PXeon 6766E 2PXeon 6766EXeon 6780EEPYC 9754 2PXeon Platinum 8592+ 2PEPYC 9654 2PXeon Platinum 8490H 2PEPYC 9754EPYC 9654EPYC 9684XEPYC 9684X 2P13K26K39K52K65KSE +/- 572.00, N = 12SE +/- 1097.75, N = 15SE +/- 601.03, N = 12SE +/- 283.44, N = 3SE +/- 54.57, N = 4SE +/- 49.20, N = 4SE +/- 42.17, N = 4SE +/- 366.08, N = 4SE +/- 135.77, N = 4SE +/- 11.14, N = 4SE +/- 712.94, N = 12SE +/- 1039.71, N = 15SE +/- 19.87, N = 4SE +/- 8.42, N = 4SE +/- 2087.13, N = 15SE +/- 1633.92, N = 15SE +/- 1510.37, N = 15SE +/- 467.78, N = 4SE +/- 53.07, N = 5SE +/- 42.89, N = 5SE +/- 92.04, N = 5SE +/- 2182.93, N = 1518621.219876.520091.121583.222957.324526.024548.831046.531830.235230.137461.139580.940441.040626.442113.542114.643531.046877.550139.950909.653167.859466.61. (CXX) g++ options: -O3 -fopenmp -lmpi_cxx -lmpi
OpenBenchmarking.orgCG Mflops, More Is BetterminiFE 2.2Problem Size: SmallXeon Max 9480Xeon Max 9468 2PXeon Max 9468Xeon Max 9480 2PXeon Platinum 8380EPYC 8534PEPYC 8534PNXeon Platinum 8380 2PXeon Platinum 8592+Xeon Platinum 8490HXeon 6780E 2PXeon 6766E 2PXeon 6766EXeon 6780EEPYC 9754 2PXeon Platinum 8592+ 2PEPYC 9654 2PXeon Platinum 8490H 2PEPYC 9754EPYC 9654EPYC 9684XEPYC 9684X 2P10K20K30K40K50KMin: 16170.7 / Avg: 18621.23 / Max: 22590.4Min: 12173.5 / Avg: 19876.54 / Max: 26049.5Min: 17078.6 / Avg: 20091.11 / Max: 23135.7Min: 21273.9 / Avg: 21583.23 / Max: 22149.3Min: 22793.6 / Avg: 22957.3 / Max: 23014.1Min: 24391.2 / Avg: 24525.98 / Max: 24627.3Min: 24462.2 / Avg: 24548.78 / Max: 24663.5Min: 30276.3 / Avg: 31046.48 / Max: 32036.2Min: 31581.2 / Avg: 31830.2 / Max: 32217.1Min: 35202.3 / Avg: 35230.08 / Max: 35256.3Min: 35234.3 / Avg: 37461.07 / Max: 43729.8Min: 29686.3 / Avg: 39580.95 / Max: 44011.8Min: 40394.2 / Avg: 40440.98 / Max: 40491.3Min: 40606.9 / Avg: 40626.43 / Max: 40647.8Min: 29274.2 / Avg: 42113.47 / Max: 59923.7Min: 26242 / Avg: 42114.62 / Max: 48682.4Min: 34088.8 / Avg: 43531.03 / Max: 52485.7Min: 45706.5 / Avg: 46877.53 / Max: 47668.4Min: 49964.6 / Avg: 50139.86 / Max: 50299.6Min: 50759.9 / Avg: 50909.62 / Max: 50996.1Min: 52973.6 / Avg: 53167.78 / Max: 53401.6Min: 46247.4 / Avg: 59466.63 / Max: 76536.61. (CXX) g++ options: -O3 -fopenmp -lmpi_cxx -lmpi

RocksDB

OpenBenchmarking.orgWatts, Fewer Is BetterRocksDB 9.0CPU Power Consumption MonitorEPYC 9684X 2PXeon Max 9480 2PXeon Platinum 8490H 2PXeon Max 9468 2PEPYC 9654 2PXeon Platinum 8592+ 2PXeon Platinum 8380 2PEPYC 9754 2PXeon 6780E 2PEPYC 9684XXeon 6766E 2PXeon Max 9468Xeon Max 9480Xeon Platinum 8490HXeon Platinum 8592+EPYC 9754EPYC 9654Xeon Platinum 8380Xeon 6780EXeon 6766EEPYC 8534PEPYC 8534PN140280420560700Min: 67.1 / Avg: 671.28 / Max: 820.11Min: 185.7 / Avg: 663.3 / Max: 752.58Min: 157.04 / Avg: 656.04 / Max: 755.91Min: 200.41 / Avg: 651.38 / Max: 755.47Min: 56.63 / Avg: 576.34 / Max: 690.47Min: 67.94 / Avg: 558.28 / Max: 752.93Min: 98.57 / Avg: 510.9 / Max: 583.45Min: 43.23 / Avg: 505.19 / Max: 682.09Min: 108.91 / Avg: 400.79 / Max: 709.44Min: 34.3 / Avg: 383.63 / Max: 411.02Min: 107.56 / Avg: 350.26 / Max: 540.44Min: 72.31 / Avg: 332.58 / Max: 376.04Min: 74.89 / Avg: 331.82 / Max: 375.82Min: 52.65 / Avg: 330.54 / Max: 376.66Min: 33.11 / Avg: 323.9 / Max: 378.14Min: 22 / Avg: 301.4 / Max: 339.84Min: 24.6 / Avg: 300.55 / Max: 337.2Min: 55.14 / Avg: 255.9 / Max: 290.56Min: 43.57 / Avg: 208.52 / Max: 356.32Min: 43.66 / Avg: 179.48 / Max: 270.38Min: 17.34 / Avg: 155.39 / Max: 168.8Min: 17.36 / Avg: 134 / Max: 149.2

OpenBenchmarking.orgOp/s Per Watt, More Is BetterRocksDB 9.0Test: Read While WritingXeon Max 9468 2PXeon Max 9480 2PXeon Platinum 8490H 2PXeon Platinum 8380 2PXeon Platinum 8380Xeon Max 9480Xeon Platinum 8592+ 2PXeon Max 9468Xeon Platinum 8490HXeon Platinum 8592+EPYC 9684X 2PEPYC 9654 2PEPYC 9684XEPYC 9754 2PEPYC 9654EPYC 9754Xeon 6780EEPYC 8534PXeon 6766EEPYC 8534PNXeon 6780E 2PXeon 6766E 2P15K30K45K60K75K14775.4916920.4618781.2719253.5221648.9922200.6222256.9522369.2623723.7627560.2829572.8934889.6536906.8345330.1848605.6952342.4656900.6260067.2163183.0366672.7067516.2969851.75

OpenBenchmarking.orgOp/s, More Is BetterRocksDB 9.0Test: Read While WritingXeon Platinum 8380Xeon Max 9480Xeon Max 9468Xeon Platinum 8490HXeon Platinum 8592+EPYC 8534PNEPYC 8534PXeon Max 9468 2PXeon Platinum 8380 2PXeon Max 9480 2PXeon 6766EXeon 6780EXeon Platinum 8490H 2PXeon Platinum 8592+ 2PEPYC 9684XEPYC 9654EPYC 9754EPYC 9684X 2PEPYC 9654 2PEPYC 9754 2PXeon 6766E 2PXeon 6780E 2P6M12M18M24M30MSE +/- 23120.76, N = 3SE +/- 26369.56, N = 3SE +/- 83772.27, N = 13SE +/- 61518.27, N = 10SE +/- 28201.44, N = 3SE +/- 81998.56, N = 3SE +/- 28098.62, N = 3SE +/- 218479.19, N = 15SE +/- 113154.86, N = 4SE +/- 254193.37, N = 15SE +/- 45015.86, N = 3SE +/- 136761.19, N = 4SE +/- 343737.14, N = 15SE +/- 215352.04, N = 15SE +/- 93669.97, N = 15SE +/- 36524.26, N = 3SE +/- 109424.14, N = 3SE +/- 236709.61, N = 3SE +/- 506458.47, N = 15SE +/- 273109.47, N = 3SE +/- 426084.70, N = 15SE +/- 726178.20, N = 12553987073665007439663784173889268938934176933364596244179836689112233291134038911864815123213001242551914158419146085441577618619851664201082892290015224466143270597861. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti -lpthread
OpenBenchmarking.orgOp/s, More Is BetterRocksDB 9.0Test: Read While WritingXeon Platinum 8380Xeon Max 9480Xeon Max 9468Xeon Platinum 8490HXeon Platinum 8592+EPYC 8534PNEPYC 8534PXeon Max 9468 2PXeon Platinum 8380 2PXeon Max 9480 2PXeon 6766EXeon 6780EXeon Platinum 8490H 2PXeon Platinum 8592+ 2PEPYC 9684XEPYC 9654EPYC 9754EPYC 9684X 2PEPYC 9654 2PEPYC 9754 2PXeon 6766E 2PXeon 6780E 2P5M10M15M20M25MMin: 5499576 / Avg: 5539869.67 / Max: 5579664Min: 7328644 / Avg: 7366499.67 / Max: 7417228Min: 7227203 / Avg: 7439663.23 / Max: 8347963Min: 7607121 / Avg: 7841737.7 / Max: 8193969Min: 8871422 / Avg: 8926893 / Max: 8963471Min: 8799620 / Avg: 8934176 / Max: 9082647Min: 9302459 / Avg: 9333645.33 / Max: 9389725Min: 8744273 / Avg: 9624416.6 / Max: 11852266Min: 9497572 / Avg: 9836688.75 / Max: 9958811Min: 9871431 / Avg: 11223328.93 / Max: 13362337Min: 11294893 / Avg: 11340389 / Max: 11430419Min: 11518174 / Avg: 11864814.5 / Max: 12149057Min: 10700779 / Avg: 12321300.13 / Max: 15657422Min: 11093004 / Avg: 12425519.07 / Max: 14001329Min: 13691669 / Avg: 14158419.4 / Max: 14830006Min: 14540147 / Avg: 14608544.33 / Max: 14664956Min: 15661690 / Avg: 15776186.33 / Max: 15994955Min: 19522509 / Avg: 19851664.33 / Max: 20310923Min: 16264288 / Avg: 20108288.67 / Max: 23918351Min: 22361145 / Avg: 22900152 / Max: 23246271Min: 21240338 / Avg: 24466143.47 / Max: 27142119Min: 23134269 / Avg: 27059785.5 / Max: 313589981. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti -lpthread

288 Results Shown

OpenVINO
OpenSSL:
  SHA512
  RSA4096
Llamafile
TensorFlow
Pennant
OpenFOAM
QuantLib
OpenVINO
John The Ripper
OpenVINO
miniBUDE:
  OpenMP - BM2:
    Billion Interactions/s
    GFInst/s
ASTC Encoder
RELION
OpenSSL
Blender
OpenVINO
OpenSSL
John The Ripper:
  Blowfish
  bcrypt
7-Zip Compression
Primesieve
Blender:
  Barbershop - CPU-Only
  Pabellon Barcelona - CPU-Only
Coremark
OpenRadioss
OpenVINO
OSPRay Studio
Blender
OpenVINO
Xcompact3d Incompact3d
OpenSSL
OSPRay Studio
OpenVINO
ACES DGEMM
Helsing
Algebraic Multi-Grid Benchmark
OSPRay Studio
Blender
m-queens
OSPRay Studio
miniBUDE:
  OpenMP - BM1:
    Billion Interactions/s
    GFInst/s
OpenVINO
NAS Parallel Benchmarks
OSPRay
OpenSSL
OSPRay
Llamafile
OSPRay Studio:
  1 - 4K - 1 - Path Tracer - CPU
  3 - 4K - 1 - Path Tracer - CPU
OpenSSL
Primesieve
Blender
OpenVINO
NAS Parallel Benchmarks
OSPRay
OpenVINO:
  Vehicle Detection FP16-INT8 - CPU
  Person Vehicle Bike Detection FP16 - CPU
PyTorch
PostgreSQL:
  100 - 1000 - Read Only - Average Latency
  100 - 1000 - Read Only
Speedb
ONNX Runtime
Liquid-DSP
Embree
Memcached
OpenVINO
PyTorch
GraphicsMagick
srsRAN Project
GROMACS
OpenVKL
PyTorch:
  CPU - 64 - ResNet-50
  CPU - 512 - ResNet-50
ONNX Runtime
NAS Parallel Benchmarks
ASKAP
Embree
Liquid-DSP
ONNX Runtime
Liquid-DSP
ASTC Encoder
WRF
NAS Parallel Benchmarks
ONNX Runtime
PyTorch
LULESH
Embree
ONNX Runtime
Kvazaar:
  Bosphorus 4K - Slow
  Bosphorus 4K - Medium
PyTorch:
  CPU - 256 - ResNet-152
  CPU - 512 - ResNet-152
  CPU - 64 - ResNet-152
oneDNN
OpenVINO
uvg266
ONNX Runtime:
  super-resolution-10 - CPU - Parallel
  fcn-resnet101-11 - CPU - Parallel
Aircrack-ng
OpenVINO
Timed Node.js Compilation
ONNX Runtime
uvg266
ONNX Runtime
Timed Linux Kernel Compilation
TensorFlow
OpenVINO
Xcompact3d Incompact3d
High Performance Conjugate Gradient
Timed LLVM Compilation
GraphicsMagick
OpenFOAM
ONNX Runtime
7-Zip Compression
Parallel BZIP2 Compression
GPAW
ONNX Runtime
OpenVINO
Liquid-DSP
Intel Open Image Denoise
TensorFlow
Intel Open Image Denoise
Liquid-DSP
Intel Open Image Denoise
ONNX Runtime
LAMMPS Molecular Dynamics Simulator
LuxCoreRender
TensorFlow
Liquid-DSP
CloverLeaf
LAMMPS Molecular Dynamics Simulator
PostgreSQL:
  100 - 1000 - Read Write - Average Latency
  100 - 1000 - Read Write
srsRAN Project:
  PUSCH Processor Benchmark, Throughput Thread
  PDSCH Processor Benchmark, Throughput Thread
OpenRadioss
Liquid-DSP
NWChem
Kvazaar
GraphicsMagick
Liquid-DSP
CloverLeaf
libavif avifenc:
  0
  2
SVT-AV1
uvg266
ASKAP
TensorFlow:
  CPU - 64 - GoogLeNet
  CPU - 64 - AlexNet
Y-Cruncher:
  1B
  500M
Liquid-DSP
Timed Linux Kernel Compilation
OpenRadioss
TensorFlow
Numpy Benchmark
FFmpeg:
  libx265 - Video On Demand
  libx265 - Platform
SVT-AV1
QuantLib
TensorFlow
Apache IoTDB
ClickHouse
Apache IoTDB
ClickHouse
x265
ONNX Runtime
ASKAP
BRL-CAD
OpenVINO
ASKAP
Xmrig
OpenVINO
ONNX Runtime:
  ArcFace ResNet-100 - CPU - Standard
  ResNet50 v1-12-int8 - CPU - Parallel
OpenSSL
OpenVINO:
  Face Detection FP16-INT8 - CPU
  Noise Suppression Poconet-Like FP16 - CPU
  Machine Translation EN To DE FP16 - CPU
  Person Re-Identification Retail FP16 - CPU
  Weld Porosity Detection FP16-INT8 - CPU
ASTC Encoder
NAS Parallel Benchmarks
ONNX Runtime
ASTC Encoder
Speedb
RocksDB
TensorFlow
OpenVINO
FFmpeg
ClickHouse
Timed FFmpeg Compilation
TensorFlow
Timed Godot Game Engine Compilation
GNU Octave Benchmark
Appleseed
Liquid-DSP
Zstd Compression
TensorFlow
ONNX Runtime
Zstd Compression
Apache IoTDB
VVenC
TensorFlow
Timed ImageMagick Compilation
libavif avifenc
Apache IoTDB
QMCPACK
libavif avifenc:
  6, Lossless
  6
Timed Gem5 Compilation
Zstd Compression
WebP Image Encode
Zstd Compression
SVT-AV1
GraphicsMagick
VVenC
WebP Image Encode
OpenFOAM
PyBench
Google SynthMark
Timed Mesa Compilation
SecureMark
OpenFOAM
Liquid-DSP:
  64 - 256 - 32
  1 - 256 - 32
ONNX Runtime:
  CPU Power Consumption Monitor:
    Watts
    Watts
    Watts
    Watts
    Watts
    Watts
    Watts
    Watts
    Watts
    Watts
    Watts
    Watts
    Watts
    Watts
    Watts
    Watts
    Watts
    Watts
    Watts
    Watts
  Phoronix Test Suite System Monitoring:
    Watts
  CPU Power Consumption Monitor:
    Watts
  Chess Benchmark:
    Nodes Per Second Per Watt
Stockfish
ONNX Runtime:
  Faster R-CNN R-50-FPN-int8 - CPU - Standard:
    Inference Time Cost (ms)
    Inferences Per Second
  bertsquad-12 - CPU - Standard:
    Inference Time Cost (ms)
    Inferences Per Second
  fcn-resnet101-11 - CPU - Standard:
    Inference Time Cost (ms)
    Inferences Per Second
srsRAN Project:
  CPU Power Consumption Monitor
  PDSCH Processor Benchmark, Throughput Total
srsRAN Project
SVT-AV1:
  CPU Power Consumption Monitor
  Preset 13 - Bosphorus 4K
SVT-AV1
LuxCoreRender:
  CPU Power Consumption Monitor
  Orange Juice - CPU
LuxCoreRender
LuxCoreRender:
  CPU Power Consumption Monitor
  DLSC - CPU
LuxCoreRender
NAS Parallel Benchmarks:
  CPU Power Consumption Monitor
  EP.D
NAS Parallel Benchmarks
Pennant
Pennant
NAMD:
  CPU Power Consumption Monitor
  STMV with 1,066,628 Atoms
NAMD
NAMD:
  CPU Power Consumption Monitor
  ATPase with 327,506 Atoms
NAMD
miniFE:
  CPU Power Consumption Monitor
  Small
miniFE
RocksDB:
  CPU Power Consumption Monitor
  Read While Writing
RocksDB